2024-01-31T04:45:45.140 INFO:root:teuthology version: 0.0.1.dev256+gd9fdb22 2024-01-31T04:45:45.140 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/fsstress}} --archive /home/teuthworker/archive/vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7539479 --owner scheduled_vshankar@teuthology --name vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi --verbose -- /home/teuthworker/archive/vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7539479/orig.config.yaml 2024-01-31T04:45:45.196 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-31T04:45:45.289 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7539479 branch: wip-vshankar-testing-20240125.044502 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/fsstress}} email: vshankar@redhat.com first_in_suite: false job_id: '7539479' kernel: client: sha1: distro flavor: default kdb: true sha1: cd42140e628558a450ba1d39a9d0835a2fa62cda ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-vshankar-testing-20240125.044502 ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow metadata IO - SLOW_OPS - slow request sha1: 661946e7044723130c03627323f6a879a9848cb5 subvols: create: 2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: 661946e7044723130c03627323f6a879a9848cb5 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - nowsync syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20240125.044502 sha1: 661946e7044723130c03627323f6a879a9848cb5 owner: scheduled_vshankar@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 9619 sha1: 661946e7044723130c03627323f6a879a9848cb5 sleep_before_teardown: 0 subset: 293/1024 suite: fs suite_branch: wip-vshankar-testing-20240125.044502 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 661946e7044723130c03627323f6a879a9848cb5 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi099.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHgfinytNuPe5fL0szIiNJSo+6YbrKeiyXe5nYg56kuj7x7mmSeIaruiwQupw1QuFWH5DPWSS0B9NLIcWdTX1cw= smithi179.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMuqElmGQnrB9hKXh1g2rZk67yC1MYVax0g3rxq3PKCVo8L63S2/hyMFG7YpdI0f7Rxc0/6bYyVlmAk8a86gocc= smithi181.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE7Xx1DCcFR78jhAjbZAAIJdamEISjrfRT0lpfmK6Buwr5ulkBGnLutMhfWsU4Ne/R3lwreXDI0WGTQQtS34Qjc= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/fsstress.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: d9fdb2209e15b39d9f061fd85399f352ce0f0894 timestamp: 2024-01-31_04:15:12 tube: smithi use_shaman: true user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-01-31T04:45:45.289 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa; will attempt to use it 2024-01-31T04:45:45.290 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa/tasks 2024-01-31T04:45:45.290 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-01-31T04:45:45.292 INFO:teuthology.task.internal:Checking packages... 2024-01-31T04:45:45.316 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '661946e7044723130c03627323f6a879a9848cb5' 2024-01-31T04:45:45.316 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-01-31T04:45:45.316 INFO:teuthology.packaging:ref: None 2024-01-31T04:45:45.316 INFO:teuthology.packaging:tag: None 2024-01-31T04:45:45.316 INFO:teuthology.packaging:branch: wip-vshankar-testing-20240125.044502 2024-01-31T04:45:45.316 INFO:teuthology.packaging:sha1: 661946e7044723130c03627323f6a879a9848cb5 2024-01-31T04:45:45.316 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-vshankar-testing-20240125.044502 2024-01-31T04:45:45.458 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-885.g661946e7 2024-01-31T04:45:45.459 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-01-31T04:45:45.466 INFO:teuthology.task.internal:no buildpackages task found 2024-01-31T04:45:45.466 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-01-31T04:45:45.511 INFO:teuthology.task.internal:Saving configuration 2024-01-31T04:45:45.531 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-01-31T04:45:45.543 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-31T04:45:45.567 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7539479', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-31 04:40:02.912658', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHgfinytNuPe5fL0szIiNJSo+6YbrKeiyXe5nYg56kuj7x7mmSeIaruiwQupw1QuFWH5DPWSS0B9NLIcWdTX1cw='} 2024-01-31T04:45:45.592 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7539479', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-31 04:40:02.913827', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMuqElmGQnrB9hKXh1g2rZk67yC1MYVax0g3rxq3PKCVo8L63S2/hyMFG7YpdI0f7Rxc0/6bYyVlmAk8a86gocc='} 2024-01-31T04:45:45.617 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi181.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7539479', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-31 04:40:02.911193', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE7Xx1DCcFR78jhAjbZAAIJdamEISjrfRT0lpfmK6Buwr5ulkBGnLutMhfWsU4Ne/R3lwreXDI0WGTQQtS34Qjc='} 2024-01-31T04:45:45.617 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-01-31T04:45:45.623 INFO:teuthology.task.internal:roles: ubuntu@smithi099.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-01-31T04:45:45.623 INFO:teuthology.task.internal:roles: ubuntu@smithi179.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-01-31T04:45:45.623 INFO:teuthology.task.internal:roles: ubuntu@smithi181.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-01-31T04:45:45.623 INFO:teuthology.run_tasks:Running task console_log... 2024-01-31T04:45:45.725 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8caf552160>, signals=[15]) 2024-01-31T04:45:45.726 INFO:teuthology.run_tasks:Running task internal.connect... 2024-01-31T04:45:45.731 INFO:teuthology.task.internal:Opening connections... 2024-01-31T04:45:45.732 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi099.front.sepia.ceph.com 2024-01-31T04:45:45.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:45:45.826 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi179.front.sepia.ceph.com 2024-01-31T04:45:45.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:45:45.916 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi181.front.sepia.ceph.com 2024-01-31T04:45:45.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:45:46.036 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-01-31T04:45:46.068 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2024-01-31T04:45:46.087 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2024-01-31T04:45:46.087 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2024-01-31T04:45:46.144 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream" 2024-01-31T04:45:46.144 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="9" 2024-01-31T04:45:46.144 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos" 2024-01-31T04:45:46.144 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora" 2024-01-31T04:45:46.144 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="9" 2024-01-31T04:45:46.144 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el9" 2024-01-31T04:45:46.144 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-31T04:45:46.144 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2024-01-31T04:45:46.145 INFO:teuthology.orchestra.run.smithi099.stdout:LOGO="fedora-logo-icon" 2024-01-31T04:45:46.145 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-31T04:45:46.145 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/" 2024-01-31T04:45:46.145 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-31T04:45:46.145 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-31T04:45:46.145 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-31T04:45:46.145 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2024-01-31T04:45:46.167 DEBUG:teuthology.orchestra.run.smithi179:> uname -m 2024-01-31T04:45:46.185 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64 2024-01-31T04:45:46.185 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2024-01-31T04:45:46.240 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="CentOS Stream" 2024-01-31T04:45:46.240 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="9" 2024-01-31T04:45:46.240 INFO:teuthology.orchestra.run.smithi179.stdout:ID="centos" 2024-01-31T04:45:46.241 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="rhel fedora" 2024-01-31T04:45:46.241 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="9" 2024-01-31T04:45:46.241 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el9" 2024-01-31T04:45:46.241 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-31T04:45:46.241 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2024-01-31T04:45:46.241 INFO:teuthology.orchestra.run.smithi179.stdout:LOGO="fedora-logo-icon" 2024-01-31T04:45:46.241 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-31T04:45:46.241 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://centos.org/" 2024-01-31T04:45:46.241 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-31T04:45:46.241 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-31T04:45:46.241 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-31T04:45:46.241 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2024-01-31T04:45:46.268 DEBUG:teuthology.orchestra.run.smithi181:> uname -m 2024-01-31T04:45:46.285 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64 2024-01-31T04:45:46.286 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2024-01-31T04:45:46.343 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="CentOS Stream" 2024-01-31T04:45:46.343 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="9" 2024-01-31T04:45:46.343 INFO:teuthology.orchestra.run.smithi181.stdout:ID="centos" 2024-01-31T04:45:46.343 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="rhel fedora" 2024-01-31T04:45:46.343 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="9" 2024-01-31T04:45:46.343 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el9" 2024-01-31T04:45:46.343 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-31T04:45:46.343 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2024-01-31T04:45:46.343 INFO:teuthology.orchestra.run.smithi181.stdout:LOGO="fedora-logo-icon" 2024-01-31T04:45:46.343 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-31T04:45:46.343 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://centos.org/" 2024-01-31T04:45:46.343 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-31T04:45:46.343 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-31T04:45:46.344 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-31T04:45:46.344 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2024-01-31T04:45:46.367 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-01-31T04:45:46.376 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-01-31T04:45:46.395 INFO:teuthology.task.internal:Checking for old test directory... 2024-01-31T04:45:46.395 DEBUG:teuthology.orchestra.run.smithi099:> test '!' -e /home/ubuntu/cephtest 2024-01-31T04:45:46.397 DEBUG:teuthology.orchestra.run.smithi179:> test '!' -e /home/ubuntu/cephtest 2024-01-31T04:45:46.400 DEBUG:teuthology.orchestra.run.smithi181:> test '!' -e /home/ubuntu/cephtest 2024-01-31T04:45:46.416 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-01-31T04:45:46.421 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-01-31T04:45:46.421 DEBUG:teuthology.orchestra.run.smithi099:> test -z $(ls -A /var/lib/ceph) 2024-01-31T04:45:46.454 DEBUG:teuthology.orchestra.run.smithi179:> test -z $(ls -A /var/lib/ceph) 2024-01-31T04:45:46.456 DEBUG:teuthology.orchestra.run.smithi181:> test -z $(ls -A /var/lib/ceph) 2024-01-31T04:45:46.666 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-01-31T04:45:46.741 INFO:teuthology.run_tasks:Running task kernel... 2024-01-31T04:45:46.754 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': 'cd42140e628558a450ba1d39a9d0835a2fa62cda'} 2024-01-31T04:45:46.755 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-01-31T04:45:46.755 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-01-31T04:45:46.755 DEBUG:teuthology.orchestra.run.smithi099:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-31T04:45:46.772 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T04:45:46.772 DEBUG:teuthology.orchestra.run.smithi099:> uname -r 2024-01-31T04:45:46.830 INFO:teuthology.orchestra.run.smithi099.stdout:5.14.0-361.el9.x86_64 2024-01-31T04:45:46.830 INFO:teuthology.task.kernel:Running kernel on smithi099: 5.14.0-361.el9.x86_64 2024-01-31T04:45:46.830 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum install -y kernel 2024-01-31T04:45:49.103 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS-9 - AppStream 17 MB/s | 7.8 MB 00:00 2024-01-31T04:45:50.837 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS-9 - BaseOS 5.7 MB/s | 2.5 MB 00:00 2024-01-31T04:45:54.627 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - BaseOS 2.4 MB/s | 8.0 MB 00:03 2024-01-31T04:45:58.203 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - AppStream 7.6 MB/s | 19 MB 00:02 2024-01-31T04:46:04.378 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - CRB 2.2 MB/s | 5.9 MB 00:02 2024-01-31T04:50:26.633 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - Extras packages 58 B/s | 15 kB 04:21 2024-01-31T04:50:28.186 INFO:teuthology.orchestra.run.smithi099.stdout:Extra Packages for Enterprise Linux 14 MB/s | 20 MB 00:01 2024-01-31T04:50:33.241 INFO:teuthology.orchestra.run.smithi099.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-01-31T04:50:35.434 INFO:teuthology.orchestra.run.smithi099.stderr:Modular dependency problems: 2024-01-31T04:50:35.434 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-01-31T04:50:35.434 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 1: conflicting requests 2024-01-31T04:50:35.435 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.435 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 2: conflicting requests 2024-01-31T04:50:35.435 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.435 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 3: conflicting requests 2024-01-31T04:50:35.435 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.435 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 4: conflicting requests 2024-01-31T04:50:35.435 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.435 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 5: conflicting requests 2024-01-31T04:50:35.435 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.435 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 6: conflicting requests 2024-01-31T04:50:35.435 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.435 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 7: conflicting requests 2024-01-31T04:50:35.435 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.436 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 8: conflicting requests 2024-01-31T04:50:35.436 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.436 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 9: conflicting requests 2024-01-31T04:50:35.436 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.436 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 10: conflicting requests 2024-01-31T04:50:35.436 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.436 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 11: conflicting requests 2024-01-31T04:50:35.436 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.436 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 12: conflicting requests 2024-01-31T04:50:35.436 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.436 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 13: conflicting requests 2024-01-31T04:50:35.436 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.436 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 14: conflicting requests 2024-01-31T04:50:35.437 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.437 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 15: conflicting requests 2024-01-31T04:50:35.437 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.437 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 16: conflicting requests 2024-01-31T04:50:35.437 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.437 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 17: conflicting requests 2024-01-31T04:50:35.437 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.437 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 18: conflicting requests 2024-01-31T04:50:35.437 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.437 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 19: conflicting requests 2024-01-31T04:50:35.437 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.437 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 20: conflicting requests 2024-01-31T04:50:35.437 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.437 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 21: conflicting requests 2024-01-31T04:50:35.437 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.438 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 22: conflicting requests 2024-01-31T04:50:35.438 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.438 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 23: conflicting requests 2024-01-31T04:50:35.438 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.438 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 24: conflicting requests 2024-01-31T04:50:35.438 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.438 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 25: conflicting requests 2024-01-31T04:50:35.438 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.438 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 26: conflicting requests 2024-01-31T04:50:35.438 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.438 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 27: conflicting requests 2024-01-31T04:50:35.438 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.438 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 28: conflicting requests 2024-01-31T04:50:35.438 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.439 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 29: conflicting requests 2024-01-31T04:50:35.439 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.439 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 30: conflicting requests 2024-01-31T04:50:35.439 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.439 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 31: conflicting requests 2024-01-31T04:50:35.439 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.439 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 32: conflicting requests 2024-01-31T04:50:35.439 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.439 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 33: conflicting requests 2024-01-31T04:50:35.439 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.439 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 34: conflicting requests 2024-01-31T04:50:35.439 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.439 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 35: conflicting requests 2024-01-31T04:50:35.440 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.440 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 36: conflicting requests 2024-01-31T04:50:35.440 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.440 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 37: conflicting requests 2024-01-31T04:50:35.440 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.440 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.440 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.440 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 38: cannot install the best candidate for the job 2024-01-31T04:50:35.440 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.440 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.440 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.441 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.441 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 39: conflicting requests 2024-01-31T04:50:35.441 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.441 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.441 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.441 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.441 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.441 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.441 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 40: cannot install the best candidate for the job 2024-01-31T04:50:35.441 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.441 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.441 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.441 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.441 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 41: cannot install the best candidate for the job 2024-01-31T04:50:35.442 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.442 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.442 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.442 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.442 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 42: cannot install the best candidate for the job 2024-01-31T04:50:35.442 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.442 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.442 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.442 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.442 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 43: cannot install the best candidate for the job 2024-01-31T04:50:35.442 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.442 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.442 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.442 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.442 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 44: cannot install the best candidate for the job 2024-01-31T04:50:35.443 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.443 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.443 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.443 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.443 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 45: cannot install the best candidate for the job 2024-01-31T04:50:35.443 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.443 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.443 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.443 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-31T04:50:35.848 INFO:teuthology.orchestra.run.smithi099.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-01-31T04:50:35.849 INFO:teuthology.orchestra.run.smithi099.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-01-31T04:50:35.953 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-01-31T04:50:35.961 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-01-31T04:50:35.961 INFO:teuthology.orchestra.run.smithi099.stdout: Package Architecture Version Repository Size 2024-01-31T04:50:35.961 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-01-31T04:50:35.961 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-01-31T04:50:35.961 INFO:teuthology.orchestra.run.smithi099.stdout: kernel x86_64 5.14.0-412.el9 baseos 6.0 M 2024-01-31T04:50:35.961 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-01-31T04:50:35.961 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-core x86_64 5.14.0-412.el9 baseos 21 M 2024-01-31T04:50:35.961 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-modules x86_64 5.14.0-412.el9 baseos 39 M 2024-01-31T04:50:35.961 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-modules-core x86_64 5.14.0-412.el9 baseos 33 M 2024-01-31T04:50:35.961 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T04:50:35.961 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-01-31T04:50:35.961 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-01-31T04:50:35.962 INFO:teuthology.orchestra.run.smithi099.stdout:Install 4 Packages 2024-01-31T04:50:35.962 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T04:50:35.962 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 99 M 2024-01-31T04:50:35.962 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 122 M 2024-01-31T04:50:35.962 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-01-31T04:50:37.050 INFO:teuthology.orchestra.run.smithi099.stdout:(1/4): kernel-5.14.0-412.el9.x86_64.rpm 5.8 MB/s | 6.0 MB 00:01 2024-01-31T04:50:37.726 INFO:teuthology.orchestra.run.smithi099.stdout:(2/4): kernel-core-5.14.0-412.el9.x86_64.rpm 12 MB/s | 21 MB 00:01 2024-01-31T04:50:38.617 INFO:teuthology.orchestra.run.smithi099.stdout:(3/4): kernel-modules-5.14.0-412.el9.x86_64.rpm 15 MB/s | 39 MB 00:02 2024-01-31T04:50:38.951 INFO:teuthology.orchestra.run.smithi099.stdout:(4/4): kernel-modules-core-5.14.0-412.el9.x86_6 18 MB/s | 33 MB 00:01 2024-01-31T04:50:38.954 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-01-31T04:50:38.954 INFO:teuthology.orchestra.run.smithi099.stdout:Total 33 MB/s | 99 MB 00:02 2024-01-31T04:50:39.839 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-01-31T04:50:40.220 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-01-31T04:50:40.220 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-01-31T04:50:41.560 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-01-31T04:50:41.560 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-01-31T04:50:44.519 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-01-31T04:50:45.196 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : kernel-modules-core-5.14.0-412.el9.x86_64 1/4 2024-01-31T04:50:45.335 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : kernel-core-5.14.0-412.el9.x86_64 2/4 2024-01-31T04:50:48.158 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-core-5.14.0-412.el9.x86_64 2/4 2024-01-31T04:50:48.332 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : kernel-modules-5.14.0-412.el9.x86_64 3/4 2024-01-31T04:50:53.024 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-modules-5.14.0-412.el9.x86_64 3/4 2024-01-31T04:50:53.233 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : kernel-5.14.0-412.el9.x86_64 4/4 2024-01-31T04:50:57.965 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-modules-core-5.14.0-412.el9.x86_64 4/4 2024-01-31T04:51:27.028 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-core-5.14.0-412.el9.x86_64 4/4 2024-01-31T04:51:27.028 INFO:teuthology.orchestra.run.smithi099.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-01-31T04:51:27.029 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T04:51:27.113 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-modules-5.14.0-412.el9.x86_64 4/4 2024-01-31T04:51:27.532 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-5.14.0-412.el9.x86_64 4/4 2024-01-31T04:51:27.533 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : kernel-5.14.0-412.el9.x86_64 1/4 2024-01-31T04:51:27.533 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : kernel-core-5.14.0-412.el9.x86_64 2/4 2024-01-31T04:51:27.533 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : kernel-modules-5.14.0-412.el9.x86_64 3/4 2024-01-31T04:51:27.978 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : kernel-modules-core-5.14.0-412.el9.x86_64 4/4 2024-01-31T04:51:27.978 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T04:51:27.978 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-01-31T04:51:27.978 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-5.14.0-412.el9.x86_64 2024-01-31T04:51:27.978 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-core-5.14.0-412.el9.x86_64 2024-01-31T04:51:27.978 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-modules-5.14.0-412.el9.x86_64 2024-01-31T04:51:27.978 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-modules-core-5.14.0-412.el9.x86_64 2024-01-31T04:51:27.978 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T04:51:27.979 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-01-31T04:51:28.537 DEBUG:teuthology.orchestra.run.smithi099:> rpm -q kernel | sort -rV | head -n 1 2024-01-31T04:51:28.686 INFO:teuthology.orchestra.run.smithi099.stdout:kernel-5.14.0-412.el9.x86_64 2024-01-31T04:51:28.686 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-412.el9.x86_64 2024-01-31T04:51:28.686 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-412.el9.x86_64 2024-01-31T04:51:28.686 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-01-31T04:51:28.686 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-01-31T04:51:28.687 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-01-31T04:51:28.687 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi099.front.sepia.ceph.com, path=None, version=distro) 2024-01-31T04:51:28.687 DEBUG:teuthology.orchestra.run.smithi099:> rpm -q kernel | sort -rV | head -n 1 2024-01-31T04:51:28.809 INFO:teuthology.orchestra.run.smithi099.stdout:kernel-5.14.0-412.el9.x86_64 2024-01-31T04:51:28.809 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-412.el9.x86_64 2024-01-31T04:51:28.809 DEBUG:teuthology.orchestra.run.smithi099:> sudo rpm -qi grub2-tools 2024-01-31T04:51:28.844 INFO:teuthology.orchestra.run.smithi099.stdout:Name : grub2-tools 2024-01-31T04:51:28.844 INFO:teuthology.orchestra.run.smithi099.stdout:Epoch : 1 2024-01-31T04:51:28.844 INFO:teuthology.orchestra.run.smithi099.stdout:Version : 2.06 2024-01-31T04:51:28.844 INFO:teuthology.orchestra.run.smithi099.stdout:Release : 68.el9 2024-01-31T04:51:28.844 INFO:teuthology.orchestra.run.smithi099.stdout:Architecture: x86_64 2024-01-31T04:51:28.844 INFO:teuthology.orchestra.run.smithi099.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-01-31T04:51:28.845 INFO:teuthology.orchestra.run.smithi099.stdout:Group : Unspecified 2024-01-31T04:51:28.845 INFO:teuthology.orchestra.run.smithi099.stdout:Size : 8264254 2024-01-31T04:51:28.845 INFO:teuthology.orchestra.run.smithi099.stdout:License : GPLv3+ 2024-01-31T04:51:28.845 INFO:teuthology.orchestra.run.smithi099.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-01-31T04:51:28.845 INFO:teuthology.orchestra.run.smithi099.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-01-31T04:51:28.845 INFO:teuthology.orchestra.run.smithi099.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-01-31T04:51:28.845 INFO:teuthology.orchestra.run.smithi099.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-01-31T04:51:28.845 INFO:teuthology.orchestra.run.smithi099.stdout:Packager : builder@centos.org 2024-01-31T04:51:28.845 INFO:teuthology.orchestra.run.smithi099.stdout:Vendor : CentOS 2024-01-31T04:51:28.845 INFO:teuthology.orchestra.run.smithi099.stdout:URL : http://www.gnu.org/software/grub/ 2024-01-31T04:51:28.845 INFO:teuthology.orchestra.run.smithi099.stdout:Summary : Support tools for GRUB. 2024-01-31T04:51:28.845 INFO:teuthology.orchestra.run.smithi099.stdout:Description : 2024-01-31T04:51:28.846 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T04:51:28.846 INFO:teuthology.orchestra.run.smithi099.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-01-31T04:51:28.846 INFO:teuthology.orchestra.run.smithi099.stdout:customizable bootloader with modular architecture. It supports a rich 2024-01-31T04:51:28.846 INFO:teuthology.orchestra.run.smithi099.stdout:variety of kernel formats, file systems, computer architectures and 2024-01-31T04:51:28.846 INFO:teuthology.orchestra.run.smithi099.stdout:hardware devices. 2024-01-31T04:51:28.846 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T04:51:28.846 INFO:teuthology.orchestra.run.smithi099.stdout:This subpackage provides tools for support of all platforms. 2024-01-31T04:51:28.847 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-01-31T04:51:28.847 INFO:teuthology.task.kernel:Updating grub on smithi099 to boot 5.14.0-412.el9.x86_64 2024-01-31T04:51:28.847 DEBUG:teuthology.orchestra.run.smithi099:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-01-31T04:51:29.420 INFO:teuthology.orchestra.run.smithi099.stderr:Generating grub configuration file ... 2024-01-31T04:51:30.885 INFO:teuthology.orchestra.run.smithi099.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-01-31T04:51:30.916 INFO:teuthology.orchestra.run.smithi099.stderr:done 2024-01-31T04:51:30.925 DEBUG:teuthology.orchestra.run.smithi099:> mktemp 2024-01-31T04:51:30.940 INFO:teuthology.orchestra.run.smithi099.stdout:/tmp/tmp.IDGXE0oncr 2024-01-31T04:51:30.941 DEBUG:teuthology.orchestra.run.smithi099:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.IDGXE0oncr 2024-01-31T04:51:31.015 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0666 /tmp/tmp.IDGXE0oncr 2024-01-31T04:51:31.157 DEBUG:teuthology.orchestra.remote:smithi099:/tmp/tmp.IDGXE0oncr is 6KB 2024-01-31T04:51:31.205 DEBUG:teuthology.orchestra.run.smithi099:> rm -fr /tmp/tmp.IDGXE0oncr 2024-01-31T04:51:31.219 DEBUG:teuthology.orchestra.run.smithi099:> sudo /bin/ls /boot/loader/entries || true 2024-01-31T04:51:31.284 INFO:teuthology.orchestra.run.smithi099.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-01-31T04:51:31.284 INFO:teuthology.orchestra.run.smithi099.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-01-31T04:51:31.284 INFO:teuthology.orchestra.run.smithi099.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-01-31T04:51:31.284 INFO:teuthology.orchestra.run.smithi099.stdout:15949e3c88704300882482eddfd7baae-5.14.0-412.el9.x86_64.conf 2024-01-31T04:51:31.285 DEBUG:teuthology.orchestra.run.smithi099:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-412.el9.x86_64 2024-01-31T04:51:31.454 DEBUG:teuthology.orchestra.run.smithi099:> sudo shutdown -r now 2024-01-31T04:52:01.456 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-01-31T04:52:01.457 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-01-31T04:52:01.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:52:19.900 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-01-31T04:52:28.901 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-01-31T04:52:28.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:52:31.964 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-01-31T04:52:43.965 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-01-31T04:52:43.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:53:02.396 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-01-31T04:53:17.397 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-01-31T04:53:17.397 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:53:17.727 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-01-31T04:53:18.122 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-01-31T04:53:18.123 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-412.el9.x86_64"... 2024-01-31T04:53:18.123 DEBUG:teuthology.orchestra.run.smithi099:> uname -r 2024-01-31T04:53:18.136 INFO:teuthology.orchestra.run.smithi099.stdout:5.14.0-412.el9.x86_64 2024-01-31T04:53:18.137 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-412.el9.x86_64 vs 5.14.0-412.el9.x86_64 2024-01-31T04:53:18.137 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-31T04:53:18.137 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-01-31T04:53:19.139 DEBUG:teuthology.parallel:result is None 2024-01-31T04:53:19.139 INFO:teuthology.run_tasks:Running task internal.base... 2024-01-31T04:53:19.146 INFO:teuthology.task.internal:Creating test directory... 2024-01-31T04:53:19.146 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-31T04:53:19.149 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-31T04:53:19.151 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-31T04:53:19.169 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-01-31T04:53:19.176 INFO:teuthology.run_tasks:Running task internal.archive... 2024-01-31T04:53:19.183 INFO:teuthology.task.internal:Creating archive directory... 2024-01-31T04:53:19.183 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-31T04:53:19.200 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-31T04:53:19.209 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-31T04:53:19.358 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-01-31T04:53:19.365 INFO:teuthology.task.internal:Enabling coredump saving... 2024-01-31T04:53:19.365 DEBUG:teuthology.orchestra.run.smithi179:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-31T04:53:19.382 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T04:53:19.383 DEBUG:teuthology.orchestra.run.smithi181:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-31T04:53:19.399 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T04:53:19.400 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-31T04:53:19.402 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-31T04:53:19.425 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-31T04:53:19.475 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-31T04:53:19.491 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-31T04:53:19.493 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-31T04:53:19.496 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-31T04:53:19.510 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-31T04:53:19.555 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-31T04:53:19.557 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-01-31T04:53:19.564 INFO:teuthology.task.internal:Configuring sudo... 2024-01-31T04:53:19.564 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-31T04:53:19.566 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-31T04:53:19.569 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-31T04:53:19.598 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-01-31T04:53:19.610 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-01-31T04:53:19.610 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-31T04:53:19.634 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-31T04:53:19.640 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-31T04:53:19.657 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-31T04:53:19.725 DEBUG:teuthology.orchestra.run.smithi099:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-31T04:53:19.781 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-31T04:53:19.822 DEBUG:teuthology.orchestra.run.smithi099:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-31T04:53:19.862 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-31T04:53:19.862 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-31T04:53:19.925 DEBUG:teuthology.orchestra.run.smithi179:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-31T04:53:19.970 DEBUG:teuthology.orchestra.run.smithi179:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-31T04:53:20.026 DEBUG:teuthology.orchestra.run.smithi179:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-31T04:53:20.112 DEBUG:teuthology.orchestra.run.smithi179:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-31T04:53:20.157 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-31T04:53:20.157 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-31T04:53:20.226 DEBUG:teuthology.orchestra.run.smithi181:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-31T04:53:20.270 DEBUG:teuthology.orchestra.run.smithi181:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-31T04:53:20.330 DEBUG:teuthology.orchestra.run.smithi181:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-31T04:53:20.367 DEBUG:teuthology.orchestra.run.smithi181:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-31T04:53:20.418 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-01-31T04:53:20.418 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-31T04:53:20.487 DEBUG:teuthology.orchestra.run.smithi099:> sudo service rsyslog restart 2024-01-31T04:53:20.490 DEBUG:teuthology.orchestra.run.smithi179:> sudo service rsyslog restart 2024-01-31T04:53:20.492 DEBUG:teuthology.orchestra.run.smithi181:> sudo service rsyslog restart 2024-01-31T04:53:20.532 INFO:teuthology.orchestra.run.smithi179.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-31T04:53:20.562 INFO:teuthology.orchestra.run.smithi181.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-31T04:53:20.572 INFO:teuthology.orchestra.run.smithi099.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-31T04:53:21.068 INFO:teuthology.run_tasks:Running task internal.timer... 2024-01-31T04:53:21.078 INFO:teuthology.task.internal:Starting timer... 2024-01-31T04:53:21.078 INFO:teuthology.run_tasks:Running task pcp... 2024-01-31T04:53:21.101 INFO:teuthology.run_tasks:Running task selinux... 2024-01-31T04:53:21.109 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-01-31T04:53:21.110 DEBUG:teuthology.orchestra.run.smithi099:> sudo service auditd rotate 2024-01-31T04:53:21.193 INFO:teuthology.orchestra.run.smithi099.stdout:Rotating logs: 2024-01-31T04:53:21.198 DEBUG:teuthology.orchestra.run.smithi179:> sudo service auditd rotate 2024-01-31T04:53:21.257 INFO:teuthology.orchestra.run.smithi179.stdout:Rotating logs: 2024-01-31T04:53:21.258 DEBUG:teuthology.orchestra.run.smithi181:> sudo service auditd rotate 2024-01-31T04:53:21.319 INFO:teuthology.orchestra.run.smithi181.stdout:Rotating logs: 2024-01-31T04:53:21.321 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-01-31T04:53:21.321 DEBUG:teuthology.orchestra.run.smithi099:> /usr/sbin/getenforce 2024-01-31T04:53:21.341 INFO:teuthology.orchestra.run.smithi099.stdout:Permissive 2024-01-31T04:53:21.341 DEBUG:teuthology.orchestra.run.smithi179:> /usr/sbin/getenforce 2024-01-31T04:53:21.360 INFO:teuthology.orchestra.run.smithi179.stdout:Permissive 2024-01-31T04:53:21.360 DEBUG:teuthology.orchestra.run.smithi181:> /usr/sbin/getenforce 2024-01-31T04:53:21.378 INFO:teuthology.orchestra.run.smithi181.stdout:Permissive 2024-01-31T04:53:21.378 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi099.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi179.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi181.front.sepia.ceph.com': 'permissive'} 2024-01-31T04:53:21.378 DEBUG:teuthology.orchestra.run.smithi099:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-31T04:53:21.408 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T04:53:21.409 DEBUG:teuthology.orchestra.run.smithi179:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-31T04:53:21.436 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T04:53:21.437 DEBUG:teuthology.orchestra.run.smithi181:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-31T04:53:21.463 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T04:53:21.464 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-01-31T04:53:21.464 DEBUG:teuthology.orchestra.run.smithi099:> sudo /usr/sbin/setenforce permissive 2024-01-31T04:53:21.501 DEBUG:teuthology.orchestra.run.smithi179:> sudo /usr/sbin/setenforce permissive 2024-01-31T04:53:21.537 DEBUG:teuthology.orchestra.run.smithi181:> sudo /usr/sbin/setenforce permissive 2024-01-31T04:53:21.571 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-01-31T04:53:21.581 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-01-31T04:53:21.597 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-01-31T04:53:21.598 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi099.front.sepia.ceph.com,smithi179.front.sepia.ceph.com,smithi181.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-01-31T04:58:06.539 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi099.front.sepia.ceph.com'), Remote(name='ubuntu@smithi179.front.sepia.ceph.com'), Remote(name='ubuntu@smithi181.front.sepia.ceph.com')] 2024-01-31T04:58:06.541 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-01-31T04:58:06.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:58:06.631 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-01-31T04:58:06.710 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-01-31T04:58:06.711 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-01-31T04:58:06.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:58:06.798 DEBUG:teuthology.orchestra.run.smithi179:> true 2024-01-31T04:58:06.870 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-01-31T04:58:06.871 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-01-31T04:58:06.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:58:06.963 DEBUG:teuthology.orchestra.run.smithi181:> true 2024-01-31T04:58:07.032 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-01-31T04:58:07.032 INFO:teuthology.run_tasks:Running task clock... 2024-01-31T04:58:07.043 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-01-31T04:58:07.043 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-31T04:58:07.043 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-31T04:58:07.045 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-31T04:58:07.046 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-31T04:58:07.048 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-31T04:58:07.048 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-31T04:58:07.075 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-01-31T04:58:07.075 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-01-31T04:58:07.091 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-01-31T04:58:07.092 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-01-31T04:58:07.105 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-01-31T04:58:07.120 INFO:teuthology.orchestra.run.smithi099.stderr:sudo: ntpd: command not found 2024-01-31T04:58:07.121 INFO:teuthology.orchestra.run.smithi179.stderr:sudo: ntpd: command not found 2024-01-31T04:58:07.122 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-01-31T04:58:07.134 INFO:teuthology.orchestra.run.smithi099.stdout:506 Cannot talk to daemon 2024-01-31T04:58:07.134 INFO:teuthology.orchestra.run.smithi179.stdout:506 Cannot talk to daemon 2024-01-31T04:58:07.151 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-01-31T04:58:07.151 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-01-31T04:58:07.153 INFO:teuthology.orchestra.run.smithi181.stderr:sudo: ntpd: command not found 2024-01-31T04:58:07.167 INFO:teuthology.orchestra.run.smithi181.stdout:506 Cannot talk to daemon 2024-01-31T04:58:07.167 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-01-31T04:58:07.168 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-01-31T04:58:07.183 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-01-31T04:58:07.200 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-01-31T04:58:07.211 INFO:teuthology.orchestra.run.smithi179.stderr:bash: line 1: ntpq: command not found 2024-01-31T04:58:07.214 INFO:teuthology.orchestra.run.smithi179.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-31T04:58:07.214 INFO:teuthology.orchestra.run.smithi179.stdout:=============================================================================== 2024-01-31T04:58:07.214 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-31T04:58:07.214 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-31T04:58:07.214 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-31T04:58:07.214 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-31T04:58:07.229 INFO:teuthology.orchestra.run.smithi099.stderr:bash: line 1: ntpq: command not found 2024-01-31T04:58:07.236 INFO:teuthology.orchestra.run.smithi099.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-31T04:58:07.236 INFO:teuthology.orchestra.run.smithi099.stdout:=============================================================================== 2024-01-31T04:58:07.236 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-31T04:58:07.236 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-31T04:58:07.236 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-31T04:58:07.236 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-31T04:58:07.244 INFO:teuthology.orchestra.run.smithi181.stderr:bash: line 1: ntpq: command not found 2024-01-31T04:58:07.248 INFO:teuthology.orchestra.run.smithi181.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-31T04:58:07.248 INFO:teuthology.orchestra.run.smithi181.stdout:=============================================================================== 2024-01-31T04:58:07.248 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-31T04:58:07.248 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-31T04:58:07.248 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-31T04:58:07.248 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-31T04:58:07.248 INFO:teuthology.run_tasks:Running task install... 2024-01-31T04:58:07.257 DEBUG:teuthology.task.install:project ceph 2024-01-31T04:58:07.257 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '661946e7044723130c03627323f6a879a9848cb5'}} 2024-01-31T04:58:07.257 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '661946e7044723130c03627323f6a879a9848cb5'} 2024-01-31T04:58:07.257 INFO:teuthology.task.install:Using flavor: default 2024-01-31T04:58:07.265 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-01-31T04:58:07.265 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-01-31T04:58:07.265 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '661946e7044723130c03627323f6a879a9848cb5', 'tag': None, 'wait_for_package': False} 2024-01-31T04:58:07.266 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=661946e7044723130c03627323f6a879a9848cb5 2024-01-31T04:58:07.268 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '661946e7044723130c03627323f6a879a9848cb5', 'tag': None, 'wait_for_package': False} 2024-01-31T04:58:07.268 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=661946e7044723130c03627323f6a879a9848cb5 2024-01-31T04:58:07.269 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '661946e7044723130c03627323f6a879a9848cb5', 'tag': None, 'wait_for_package': False} 2024-01-31T04:58:07.269 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=661946e7044723130c03627323f6a879a9848cb5 2024-01-31T04:58:07.412 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/centos/9/flavors/default/ 2024-01-31T04:58:07.413 INFO:teuthology.task.install.rpm:Package version is 19.0.0-885.g661946e7 2024-01-31T04:58:07.416 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/centos/9/flavors/default/ 2024-01-31T04:58:07.416 INFO:teuthology.task.install.rpm:Package version is 19.0.0-885.g661946e7 2024-01-31T04:58:07.479 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/centos/9/flavors/default/ 2024-01-31T04:58:07.480 INFO:teuthology.task.install.rpm:Package version is 19.0.0-885.g661946e7 2024-01-31T04:58:07.582 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-01-31T04:58:07.583 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-31T04:58:07.583 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-01-31T04:58:07.589 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-01-31T04:58:07.589 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-31T04:58:07.590 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-01-31T04:58:07.592 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-01-31T04:58:07.592 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-01-31T04:58:07.592 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-01-31T04:58:07.611 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-01-31T04:58:07.611 DEBUG:teuthology.orchestra.run.smithi099:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/661946e7044723130c03627323f6a879a9848cb5/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-01-31T04:58:07.620 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-01-31T04:58:07.620 DEBUG:teuthology.orchestra.run.smithi179:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/661946e7044723130c03627323f6a879a9848cb5/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-01-31T04:58:07.620 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-01-31T04:58:07.621 DEBUG:teuthology.orchestra.run.smithi181:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/661946e7044723130c03627323f6a879a9848cb5/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-01-31T04:58:07.679 DEBUG:teuthology.orchestra.run.smithi099:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-01-31T04:58:07.687 DEBUG:teuthology.orchestra.run.smithi181:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-01-31T04:58:07.688 DEBUG:teuthology.orchestra.run.smithi179:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-01-31T04:58:07.759 DEBUG:teuthology.orchestra.run.smithi099:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-01-31T04:58:07.767 DEBUG:teuthology.orchestra.run.smithi181:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-01-31T04:58:07.768 DEBUG:teuthology.orchestra.run.smithi179:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-01-31T04:58:07.825 INFO:teuthology.orchestra.run.smithi099.stdout:check_obsoletes = 1 2024-01-31T04:58:07.827 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum clean all 2024-01-31T04:58:07.833 INFO:teuthology.orchestra.run.smithi181.stdout:check_obsoletes = 1 2024-01-31T04:58:07.835 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum clean all 2024-01-31T04:58:07.837 INFO:teuthology.orchestra.run.smithi179.stdout:check_obsoletes = 1 2024-01-31T04:58:07.837 DEBUG:teuthology.orchestra.run.smithi179:> sudo yum clean all 2024-01-31T04:58:08.067 INFO:teuthology.orchestra.run.smithi099.stdout:74 files removed 2024-01-31T04:58:08.068 INFO:teuthology.orchestra.run.smithi181.stdout:74 files removed 2024-01-31T04:58:08.071 INFO:teuthology.orchestra.run.smithi179.stdout:74 files removed 2024-01-31T04:58:08.093 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-01-31T04:58:08.095 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-01-31T04:58:08.099 DEBUG:teuthology.orchestra.run.smithi179:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-01-31T04:58:08.755 INFO:teuthology.orchestra.run.smithi181.stdout:ceph packages for x86_64 218 kB/s | 80 kB 00:00 2024-01-31T04:58:08.804 INFO:teuthology.orchestra.run.smithi179.stdout:ceph packages for x86_64 194 kB/s | 80 kB 00:00 2024-01-31T04:58:08.818 INFO:teuthology.orchestra.run.smithi099.stdout:ceph packages for x86_64 197 kB/s | 80 kB 00:00 2024-01-31T04:58:09.172 INFO:teuthology.orchestra.run.smithi181.stdout:ceph noarch packages 25 kB/s | 9.5 kB 00:00 2024-01-31T04:58:09.185 INFO:teuthology.orchestra.run.smithi099.stdout:ceph noarch packages 30 kB/s | 9.5 kB 00:00 2024-01-31T04:58:09.496 INFO:teuthology.orchestra.run.smithi179.stdout:ceph noarch packages 15 kB/s | 9.5 kB 00:00 2024-01-31T04:58:09.552 INFO:teuthology.orchestra.run.smithi099.stdout:ceph source packages 5.7 kB/s | 1.9 kB 00:00 2024-01-31T04:58:09.564 INFO:teuthology.orchestra.run.smithi181.stdout:ceph source packages 5.2 kB/s | 1.9 kB 00:00 2024-01-31T04:58:09.855 INFO:teuthology.orchestra.run.smithi179.stdout:ceph source packages 5.7 kB/s | 1.9 kB 00:00 2024-01-31T04:58:10.088 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS-9 - AppStream 16 MB/s | 7.8 MB 00:00 2024-01-31T04:58:10.316 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS-9 - AppStream 11 MB/s | 7.8 MB 00:00 2024-01-31T04:58:10.332 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS-9 - AppStream 17 MB/s | 7.8 MB 00:00 2024-01-31T04:58:11.805 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS-9 - BaseOS 6.1 MB/s | 2.5 MB 00:00 2024-01-31T04:58:11.903 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS-9 - BaseOS 8.0 MB/s | 2.5 MB 00:00 2024-01-31T04:58:11.943 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS-9 - BaseOS 7.2 MB/s | 2.5 MB 00:00 2024-01-31T04:58:12.896 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.0 MB 00:00 2024-01-31T04:58:12.990 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.0 MB 00:00 2024-01-31T04:58:13.283 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - BaseOS 8.5 MB/s | 8.0 MB 00:00 2024-01-31T04:58:16.203 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - AppStream 10 MB/s | 19 MB 00:01 2024-01-31T04:58:18.971 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - AppStream 3.8 MB/s | 19 MB 00:04 2024-01-31T04:58:21.368 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 5.9 MB 00:01 2024-01-31T04:58:22.685 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - Extras packages 91 kB/s | 15 kB 00:00 2024-01-31T04:58:23.291 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - AppStream 2.0 MB/s | 19 MB 00:09 2024-01-31T04:58:23.720 INFO:teuthology.orchestra.run.smithi181.stdout:Extra Packages for Enterprise Linux 23 MB/s | 20 MB 00:00 2024-01-31T04:58:26.146 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - CRB 1.6 MB/s | 5.9 MB 00:03 2024-01-31T04:58:27.847 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - Extras packages 28 kB/s | 15 kB 00:00 2024-01-31T04:58:28.408 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 5.9 MB 00:01 2024-01-31T04:58:28.653 INFO:teuthology.orchestra.run.smithi181.stdout:lab-extras 36 kB/s | 1.7 kB 00:00 2024-01-31T04:58:29.484 INFO:teuthology.orchestra.run.smithi099.stdout:Extra Packages for Enterprise Linux 14 MB/s | 20 MB 00:01 2024-01-31T04:58:30.642 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - Extras packages 14 kB/s | 15 kB 00:01 2024-01-31T04:58:31.179 INFO:teuthology.orchestra.run.smithi181.stderr:Modular dependency problems: 2024-01-31T04:58:31.179 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-01-31T04:58:31.179 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 1: conflicting requests 2024-01-31T04:58:31.179 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.179 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 2: conflicting requests 2024-01-31T04:58:31.179 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.179 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 3: conflicting requests 2024-01-31T04:58:31.179 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.179 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 4: conflicting requests 2024-01-31T04:58:31.180 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.180 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 5: conflicting requests 2024-01-31T04:58:31.180 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.180 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 6: conflicting requests 2024-01-31T04:58:31.180 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.180 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 7: conflicting requests 2024-01-31T04:58:31.180 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.180 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 8: conflicting requests 2024-01-31T04:58:31.180 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.180 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 9: conflicting requests 2024-01-31T04:58:31.180 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.180 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 10: conflicting requests 2024-01-31T04:58:31.181 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.181 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 11: conflicting requests 2024-01-31T04:58:31.181 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.181 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 12: conflicting requests 2024-01-31T04:58:31.181 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.181 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 13: conflicting requests 2024-01-31T04:58:31.181 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.181 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 14: conflicting requests 2024-01-31T04:58:31.181 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.181 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 15: conflicting requests 2024-01-31T04:58:31.181 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.181 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 16: conflicting requests 2024-01-31T04:58:31.181 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.181 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 17: conflicting requests 2024-01-31T04:58:31.182 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.182 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 18: conflicting requests 2024-01-31T04:58:31.182 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.182 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 19: conflicting requests 2024-01-31T04:58:31.182 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.182 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 20: conflicting requests 2024-01-31T04:58:31.182 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.182 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 21: conflicting requests 2024-01-31T04:58:31.182 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.182 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 22: conflicting requests 2024-01-31T04:58:31.182 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.182 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 23: conflicting requests 2024-01-31T04:58:31.182 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.182 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 24: conflicting requests 2024-01-31T04:58:31.183 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.183 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 25: conflicting requests 2024-01-31T04:58:31.183 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.183 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 26: conflicting requests 2024-01-31T04:58:31.183 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.183 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 27: conflicting requests 2024-01-31T04:58:31.183 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.183 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 28: conflicting requests 2024-01-31T04:58:31.183 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.183 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 29: conflicting requests 2024-01-31T04:58:31.183 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.183 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 30: conflicting requests 2024-01-31T04:58:31.183 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.183 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 31: conflicting requests 2024-01-31T04:58:31.184 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.184 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 32: conflicting requests 2024-01-31T04:58:31.184 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.184 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 33: conflicting requests 2024-01-31T04:58:31.184 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.184 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 34: conflicting requests 2024-01-31T04:58:31.184 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.184 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 35: conflicting requests 2024-01-31T04:58:31.184 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.184 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 36: conflicting requests 2024-01-31T04:58:31.184 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.184 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 37: conflicting requests 2024-01-31T04:58:31.184 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.185 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.185 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.185 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 38: cannot install the best candidate for the job 2024-01-31T04:58:31.185 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.185 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.185 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.185 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.185 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 39: conflicting requests 2024-01-31T04:58:31.185 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.185 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.185 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.185 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.185 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.185 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.185 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 40: cannot install the best candidate for the job 2024-01-31T04:58:31.186 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.186 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.186 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.186 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.186 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 41: cannot install the best candidate for the job 2024-01-31T04:58:31.186 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.186 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.186 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.186 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.186 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 42: cannot install the best candidate for the job 2024-01-31T04:58:31.186 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.186 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.186 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.187 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.187 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 43: cannot install the best candidate for the job 2024-01-31T04:58:31.187 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.187 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.187 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.187 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.187 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 44: cannot install the best candidate for the job 2024-01-31T04:58:31.187 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.187 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.187 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.187 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.187 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 45: cannot install the best candidate for the job 2024-01-31T04:58:31.187 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.187 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.187 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.188 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-31T04:58:31.607 INFO:teuthology.orchestra.run.smithi181.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-01-31T04:58:31.608 INFO:teuthology.orchestra.run.smithi181.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-01-31T04:58:31.620 INFO:teuthology.orchestra.run.smithi181.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-01-31T04:58:31.621 INFO:teuthology.orchestra.run.smithi181.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-01-31T04:58:31.622 INFO:teuthology.orchestra.run.smithi181.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-01-31T04:58:31.623 INFO:teuthology.orchestra.run.smithi181.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-01-31T04:58:31.625 INFO:teuthology.orchestra.run.smithi181.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-01-31T04:58:31.628 INFO:teuthology.orchestra.run.smithi181.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-01-31T04:58:31.629 INFO:teuthology.orchestra.run.smithi181.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-01-31T04:58:31.715 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-01-31T04:58:31.732 INFO:teuthology.orchestra.run.smithi181.stdout:======================================================================================== 2024-01-31T04:58:31.732 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2024-01-31T04:58:31.732 INFO:teuthology.orchestra.run.smithi181.stdout:======================================================================================== 2024-01-31T04:58:31.732 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-01-31T04:58:31.732 INFO:teuthology.orchestra.run.smithi181.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-01-31T04:58:31.733 INFO:teuthology.orchestra.run.smithi181.stdout: ceph x86_64 2:19.0.0-885.g661946e7.el9 ceph 6.5 k 2024-01-31T04:58:31.733 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-base x86_64 2:19.0.0-885.g661946e7.el9 ceph 5.1 M 2024-01-31T04:58:31.733 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-fuse x86_64 2:19.0.0-885.g661946e7.el9 ceph 886 k 2024-01-31T04:58:31.733 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-885.g661946e7.el9 ceph 145 k 2024-01-31T04:58:31.733 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr x86_64 2:19.0.0-885.g661946e7.el9 ceph 1.5 M 2024-01-31T04:58:31.733 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-cephadm noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 133 k 2024-01-31T04:58:31.733 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-dashboard noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 1.7 M 2024-01-31T04:58:31.733 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 7.4 M 2024-01-31T04:58:31.733 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-rook noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 51 k 2024-01-31T04:58:31.733 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-radosgw x86_64 2:19.0.0-885.g661946e7.el9 ceph 8.7 M 2024-01-31T04:58:31.733 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-test x86_64 2:19.0.0-885.g661946e7.el9 ceph 46 M 2024-01-31T04:58:31.733 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-volume noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 262 k 2024-01-31T04:58:31.734 INFO:teuthology.orchestra.run.smithi181.stdout: cephadm noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 742 k 2024-01-31T04:58:31.734 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-mirror x86_64 2:19.0.0-885.g661946e7.el9 ceph 217 k 2024-01-31T04:58:31.734 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-shell x86_64 2:19.0.0-885.g661946e7.el9 ceph 27 k 2024-01-31T04:58:31.734 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-top noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 18 k 2024-01-31T04:58:31.734 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-01-31T04:58:31.734 INFO:teuthology.orchestra.run.smithi181.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-01-31T04:58:31.734 INFO:teuthology.orchestra.run.smithi181.stdout: libaio-devel x86_64 0.3.112-1.el8 CentOS-BaseOS 18 k 2024-01-31T04:58:31.734 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs-devel x86_64 2:19.0.0-885.g661946e7.el9 ceph 31 k 2024-01-31T04:58:31.734 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs2 x86_64 2:19.0.0-885.g661946e7.el9 ceph 743 k 2024-01-31T04:58:31.734 INFO:teuthology.orchestra.run.smithi181.stdout: librados-devel x86_64 2:19.0.0-885.g661946e7.el9 ceph 127 k 2024-01-31T04:58:31.734 INFO:teuthology.orchestra.run.smithi181.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-01-31T04:58:31.734 INFO:teuthology.orchestra.run.smithi181.stdout: libuuid-devel x86_64 2.37.4-15.el9 appstream 26 k 2024-01-31T04:58:31.735 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2024-01-31T04:58:31.735 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql x86_64 13.11-1.el9 appstream 1.6 M 2024-01-31T04:58:31.735 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-contrib x86_64 13.11-1.el9 appstream 905 k 2024-01-31T04:58:31.735 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-server x86_64 13.11-1.el9 appstream 5.7 M 2024-01-31T04:58:31.735 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cephfs x86_64 2:19.0.0-885.g661946e7.el9 ceph 162 k 2024-01-31T04:58:31.735 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rados x86_64 2:19.0.0-885.g661946e7.el9 ceph 321 k 2024-01-31T04:58:31.735 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rbd x86_64 2:19.0.0-885.g661946e7.el9 ceph 298 k 2024-01-31T04:58:31.735 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rgw x86_64 2:19.0.0-885.g661946e7.el9 ceph 99 k 2024-01-31T04:58:31.735 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-fuse x86_64 2:19.0.0-885.g661946e7.el9 ceph 85 k 2024-01-31T04:58:31.735 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-mirror x86_64 2:19.0.0-885.g661946e7.el9 ceph 3.1 M 2024-01-31T04:58:31.736 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-nbd x86_64 2:19.0.0-885.g661946e7.el9 ceph 170 k 2024-01-31T04:58:31.736 INFO:teuthology.orchestra.run.smithi181.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-01-31T04:58:31.736 INFO:teuthology.orchestra.run.smithi181.stdout:Upgrading: 2024-01-31T04:58:31.736 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager x86_64 1:1.45.10-1.el9 baseos 2.3 M 2024-01-31T04:58:31.736 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-libnm x86_64 1:1.45.10-1.el9 baseos 1.8 M 2024-01-31T04:58:31.736 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-team x86_64 1:1.45.10-1.el9 baseos 43 k 2024-01-31T04:58:31.736 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-tui x86_64 1:1.45.10-1.el9 baseos 247 k 2024-01-31T04:58:31.736 INFO:teuthology.orchestra.run.smithi181.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-01-31T04:58:31.737 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-01-31T04:58:31.737 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-01-31T04:58:31.737 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-01-31T04:58:31.737 INFO:teuthology.orchestra.run.smithi181.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-01-31T04:58:31.737 INFO:teuthology.orchestra.run.smithi181.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-01-31T04:58:31.737 INFO:teuthology.orchestra.run.smithi181.stdout: librados2 x86_64 2:19.0.0-885.g661946e7.el9 ceph 3.4 M 2024-01-31T04:58:31.737 INFO:teuthology.orchestra.run.smithi181.stdout: librbd1 x86_64 2:19.0.0-885.g661946e7.el9 ceph 3.1 M 2024-01-31T04:58:31.737 INFO:teuthology.orchestra.run.smithi181.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2024-01-31T04:58:31.737 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2024-01-31T04:58:31.737 INFO:teuthology.orchestra.run.smithi181.stdout: xfsdump x86_64 3.1.12-4.el9 baseos 323 k 2024-01-31T04:58:31.737 INFO:teuthology.orchestra.run.smithi181.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-01-31T04:58:31.737 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2024-01-31T04:58:31.737 INFO:teuthology.orchestra.run.smithi181.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-01-31T04:58:31.738 INFO:teuthology.orchestra.run.smithi181.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-01-31T04:58:31.738 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-common x86_64 2:19.0.0-885.g661946e7.el9 ceph 19 M 2024-01-31T04:58:31.738 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-grafana-dashboards noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 28 k 2024-01-31T04:58:31.738 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mds x86_64 2:19.0.0-885.g661946e7.el9 ceph 2.1 M 2024-01-31T04:58:31.738 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-modules-core noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 245 k 2024-01-31T04:58:31.738 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mon x86_64 2:19.0.0-885.g661946e7.el9 ceph 4.7 M 2024-01-31T04:58:31.738 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-osd x86_64 2:19.0.0-885.g661946e7.el9 ceph 17 M 2024-01-31T04:58:31.738 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-prometheus-alerts noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 15 k 2024-01-31T04:58:31.738 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-selinux x86_64 2:19.0.0-885.g661946e7.el9 ceph 25 k 2024-01-31T04:58:31.738 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-01-31T04:58:31.738 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-01-31T04:58:31.738 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-01-31T04:58:31.739 INFO:teuthology.orchestra.run.smithi181.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-01-31T04:58:31.739 INFO:teuthology.orchestra.run.smithi181.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-01-31T04:58:31.739 INFO:teuthology.orchestra.run.smithi181.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-01-31T04:58:31.739 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-01-31T04:58:31.739 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-01-31T04:58:31.739 INFO:teuthology.orchestra.run.smithi181.stdout: libcephsqlite x86_64 2:19.0.0-885.g661946e7.el9 ceph 163 k 2024-01-31T04:58:31.739 INFO:teuthology.orchestra.run.smithi181.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-01-31T04:58:31.739 INFO:teuthology.orchestra.run.smithi181.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-01-31T04:58:31.739 INFO:teuthology.orchestra.run.smithi181.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-01-31T04:58:31.739 INFO:teuthology.orchestra.run.smithi181.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-01-31T04:58:31.739 INFO:teuthology.orchestra.run.smithi181.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-01-31T04:58:31.739 INFO:teuthology.orchestra.run.smithi181.stdout: libradosstriper1 x86_64 2:19.0.0-885.g661946e7.el9 ceph 499 k 2024-01-31T04:58:31.739 INFO:teuthology.orchestra.run.smithi181.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-01-31T04:58:31.740 INFO:teuthology.orchestra.run.smithi181.stdout: librgw2 x86_64 2:19.0.0-885.g661946e7.el9 ceph 4.8 M 2024-01-31T04:58:31.740 INFO:teuthology.orchestra.run.smithi181.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-01-31T04:58:31.740 INFO:teuthology.orchestra.run.smithi181.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-01-31T04:58:31.740 INFO:teuthology.orchestra.run.smithi181.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-01-31T04:58:31.740 INFO:teuthology.orchestra.run.smithi181.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-01-31T04:58:31.740 INFO:teuthology.orchestra.run.smithi181.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-01-31T04:58:31.740 INFO:teuthology.orchestra.run.smithi181.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-01-31T04:58:31.740 INFO:teuthology.orchestra.run.smithi181.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-01-31T04:58:31.740 INFO:teuthology.orchestra.run.smithi181.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-01-31T04:58:31.740 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-01-31T04:58:31.740 INFO:teuthology.orchestra.run.smithi181.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-01-31T04:58:31.741 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-private-libs x86_64 13.11-1.el9 appstream 135 k 2024-01-31T04:58:31.741 INFO:teuthology.orchestra.run.smithi181.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2024-01-31T04:58:31.741 INFO:teuthology.orchestra.run.smithi181.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-01-31T04:58:31.741 INFO:teuthology.orchestra.run.smithi181.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-01-31T04:58:31.741 INFO:teuthology.orchestra.run.smithi181.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-01-31T04:58:31.741 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-01-31T04:58:31.741 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-argparse x86_64 2:19.0.0-885.g661946e7.el9 ceph 45 k 2024-01-31T04:58:31.741 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-common x86_64 2:19.0.0-885.g661946e7.el9 ceph 130 k 2024-01-31T04:58:31.741 INFO:teuthology.orchestra.run.smithi181.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-01-31T04:58:31.741 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-01-31T04:58:31.741 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-01-31T04:58:31.741 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-01-31T04:58:31.741 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-01-31T04:58:31.742 INFO:teuthology.orchestra.run.smithi181.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-01-31T04:58:31.742 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-01-31T04:58:31.742 INFO:teuthology.orchestra.run.smithi181.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-01-31T04:58:31.742 INFO:teuthology.orchestra.run.smithi181.stdout: python3-google-auth noarch 1:2.26.2-1.el9 epel 202 k 2024-01-31T04:58:31.742 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-01-31T04:58:31.742 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-01-31T04:58:31.742 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-01-31T04:58:31.742 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-01-31T04:58:31.742 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-01-31T04:58:31.742 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jinja2 noarch 2.11.3-4.el9 appstream 249 k 2024-01-31T04:58:31.742 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-01-31T04:58:31.742 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-01-31T04:58:31.743 INFO:teuthology.orchestra.run.smithi181.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-01-31T04:58:31.743 INFO:teuthology.orchestra.run.smithi181.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-01-31T04:58:31.743 INFO:teuthology.orchestra.run.smithi181.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-01-31T04:58:31.743 INFO:teuthology.orchestra.run.smithi181.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-01-31T04:58:31.743 INFO:teuthology.orchestra.run.smithi181.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-01-31T04:58:31.743 INFO:teuthology.orchestra.run.smithi181.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-01-31T04:58:31.743 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-01-31T04:58:31.743 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-01-31T04:58:31.743 INFO:teuthology.orchestra.run.smithi181.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-01-31T04:58:31.743 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-01-31T04:58:31.743 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-01-31T04:58:31.743 INFO:teuthology.orchestra.run.smithi181.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-01-31T04:58:31.743 INFO:teuthology.orchestra.run.smithi181.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-01-31T04:58:31.744 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-01-31T04:58:31.744 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-01-31T04:58:31.744 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-01-31T04:58:31.744 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-01-31T04:58:31.744 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-01-31T04:58:31.744 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-01-31T04:58:31.744 INFO:teuthology.orchestra.run.smithi181.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-01-31T04:58:31.744 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-01-31T04:58:31.744 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-01-31T04:58:31.744 INFO:teuthology.orchestra.run.smithi181.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-01-31T04:58:31.744 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-01-31T04:58:31.744 INFO:teuthology.orchestra.run.smithi181.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-01-31T04:58:31.744 INFO:teuthology.orchestra.run.smithi181.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-01-31T04:58:31.745 INFO:teuthology.orchestra.run.smithi181.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-01-31T04:58:31.745 INFO:teuthology.orchestra.run.smithi181.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-01-31T04:58:31.745 INFO:teuthology.orchestra.run.smithi181.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-01-31T04:58:31.745 INFO:teuthology.orchestra.run.smithi181.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-01-31T04:58:31.745 INFO:teuthology.orchestra.run.smithi181.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-01-31T04:58:31.745 INFO:teuthology.orchestra.run.smithi181.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-01-31T04:58:31.745 INFO:teuthology.orchestra.run.smithi181.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-01-31T04:58:31.745 INFO:teuthology.orchestra.run.smithi181.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-01-31T04:58:31.745 INFO:teuthology.orchestra.run.smithi181.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-01-31T04:58:31.745 INFO:teuthology.orchestra.run.smithi181.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-01-31T04:58:31.745 INFO:teuthology.orchestra.run.smithi181.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-01-31T04:58:31.745 INFO:teuthology.orchestra.run.smithi181.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-01-31T04:58:31.745 INFO:teuthology.orchestra.run.smithi181.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-01-31T04:58:31.746 INFO:teuthology.orchestra.run.smithi181.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2024-01-31T04:58:31.746 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-01-31T04:58:31.746 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-01-31T04:58:31.746 INFO:teuthology.orchestra.run.smithi181.stdout:======================================================================================== 2024-01-31T04:58:31.746 INFO:teuthology.orchestra.run.smithi181.stdout:Install 139 Packages 2024-01-31T04:58:31.746 INFO:teuthology.orchestra.run.smithi181.stdout:Upgrade 16 Packages 2024-01-31T04:58:31.746 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-01-31T04:58:31.747 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 212 M 2024-01-31T04:58:31.747 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-01-31T04:58:32.227 INFO:teuthology.orchestra.run.smithi179.stdout:Extra Packages for Enterprise Linux 14 MB/s | 20 MB 00:01 2024-01-31T04:58:32.263 INFO:teuthology.orchestra.run.smithi181.stdout:(1/155): ceph-19.0.0-885.g661946e7.el9.x86_64.r 29 kB/s | 6.5 kB 00:00 2024-01-31T04:58:32.630 INFO:teuthology.orchestra.run.smithi181.stdout:(2/155): ceph-base-19.0.0-885.g661946e7.el9.x86 8.6 MB/s | 5.1 MB 00:00 2024-01-31T04:58:32.697 INFO:teuthology.orchestra.run.smithi181.stdout:(3/155): ceph-immutable-object-cache-19.0.0-885 2.1 MB/s | 145 kB 00:00 2024-01-31T04:58:32.955 INFO:teuthology.orchestra.run.smithi181.stdout:(4/155): ceph-mds-19.0.0-885.g661946e7.el9.x86_ 8.2 MB/s | 2.1 MB 00:00 2024-01-31T04:58:33.131 INFO:teuthology.orchestra.run.smithi181.stdout:(5/155): ceph-mgr-19.0.0-885.g661946e7.el9.x86_ 8.5 MB/s | 1.5 MB 00:00 2024-01-31T04:58:33.164 INFO:teuthology.orchestra.run.smithi181.stdout:(6/155): ceph-fuse-19.0.0-885.g661946e7.el9.x86 983 kB/s | 886 kB 00:00 2024-01-31T04:58:33.506 INFO:teuthology.orchestra.run.smithi181.stdout:(7/155): ceph-common-19.0.0-885.g661946e7.el9.x 13 MB/s | 19 MB 00:01 2024-01-31T04:58:34.140 INFO:teuthology.orchestra.run.smithi181.stdout:(8/155): ceph-radosgw-19.0.0-885.g661946e7.el9. 14 MB/s | 8.7 MB 00:00 2024-01-31T04:58:34.198 INFO:teuthology.orchestra.run.smithi181.stdout:(9/155): ceph-selinux-19.0.0-885.g661946e7.el9. 432 kB/s | 25 kB 00:00 2024-01-31T04:58:34.623 INFO:teuthology.orchestra.run.smithi099.stdout:lab-extras 5.2 kB/s | 1.7 kB 00:00 2024-01-31T04:58:34.841 INFO:teuthology.orchestra.run.smithi181.stdout:(10/155): ceph-osd-19.0.0-885.g661946e7.el9.x86 10 MB/s | 17 MB 00:01 2024-01-31T04:58:34.915 INFO:teuthology.orchestra.run.smithi181.stdout:(11/155): ceph-mon-19.0.0-885.g661946e7.el9.x86 2.6 MB/s | 4.7 MB 00:01 2024-01-31T04:58:34.941 INFO:teuthology.orchestra.run.smithi181.stdout:(12/155): cephfs-mirror-19.0.0-885.g661946e7.el 2.1 MB/s | 217 kB 00:00 2024-01-31T04:58:34.966 INFO:teuthology.orchestra.run.smithi181.stdout:(13/155): cephfs-shell-19.0.0-885.g661946e7.el9 540 kB/s | 27 kB 00:00 2024-01-31T04:58:34.983 INFO:teuthology.orchestra.run.smithi181.stdout:(14/155): libcephfs-devel-19.0.0-885.g661946e7. 745 kB/s | 31 kB 00:00 2024-01-31T04:58:35.058 INFO:teuthology.orchestra.run.smithi181.stdout:(15/155): libcephsqlite-19.0.0-885.g661946e7.el 2.1 MB/s | 163 kB 00:00 2024-01-31T04:58:35.142 INFO:teuthology.orchestra.run.smithi181.stdout:(16/155): librados-devel-19.0.0-885.g661946e7.e 1.5 MB/s | 127 kB 00:00 2024-01-31T04:58:35.175 INFO:teuthology.orchestra.run.smithi181.stdout:(17/155): libcephfs2-19.0.0-885.g661946e7.el9.x 3.5 MB/s | 743 kB 00:00 2024-01-31T04:58:35.226 INFO:teuthology.orchestra.run.smithi181.stdout:(18/155): libradosstriper1-19.0.0-885.g661946e7 5.8 MB/s | 499 kB 00:00 2024-01-31T04:58:35.293 INFO:teuthology.orchestra.run.smithi181.stdout:(19/155): python3-ceph-argparse-19.0.0-885.g661 677 kB/s | 45 kB 00:00 2024-01-31T04:58:35.368 INFO:teuthology.orchestra.run.smithi181.stdout:(20/155): python3-ceph-common-19.0.0-885.g66194 1.7 MB/s | 130 kB 00:00 2024-01-31T04:58:35.443 INFO:teuthology.orchestra.run.smithi181.stdout:(21/155): python3-cephfs-19.0.0-885.g661946e7.e 2.1 MB/s | 162 kB 00:00 2024-01-31T04:58:35.535 INFO:teuthology.orchestra.run.smithi181.stdout:(22/155): python3-rados-19.0.0-885.g661946e7.el 3.4 MB/s | 321 kB 00:00 2024-01-31T04:58:35.635 INFO:teuthology.orchestra.run.smithi181.stdout:(23/155): python3-rbd-19.0.0-885.g661946e7.el9. 2.9 MB/s | 298 kB 00:00 2024-01-31T04:58:35.719 INFO:teuthology.orchestra.run.smithi181.stdout:(24/155): python3-rgw-19.0.0-885.g661946e7.el9. 1.2 MB/s | 99 kB 00:00 2024-01-31T04:58:35.803 INFO:teuthology.orchestra.run.smithi181.stdout:(25/155): rbd-fuse-19.0.0-885.g661946e7.el9.x86 1.0 MB/s | 85 kB 00:00 2024-01-31T04:58:36.078 INFO:teuthology.orchestra.run.smithi181.stdout:(26/155): librgw2-19.0.0-885.g661946e7.el9.x86_ 5.3 MB/s | 4.8 MB 00:00 2024-01-31T04:58:36.170 INFO:teuthology.orchestra.run.smithi181.stdout:(27/155): rbd-mirror-19.0.0-885.g661946e7.el9.x 8.4 MB/s | 3.1 MB 00:00 2024-01-31T04:58:36.195 INFO:teuthology.orchestra.run.smithi181.stdout:(28/155): rbd-nbd-19.0.0-885.g661946e7.el9.x86_ 1.4 MB/s | 170 kB 00:00 2024-01-31T04:58:36.220 INFO:teuthology.orchestra.run.smithi181.stdout:(29/155): ceph-grafana-dashboards-19.0.0-885.g6 567 kB/s | 28 kB 00:00 2024-01-31T04:58:36.271 INFO:teuthology.orchestra.run.smithi181.stdout:(30/155): ceph-mgr-cephadm-19.0.0-885.g661946e7 1.7 MB/s | 133 kB 00:00 2024-01-31T04:58:36.429 INFO:teuthology.orchestra.run.smithi181.stdout:(31/155): ceph-mgr-dashboard-19.0.0-885.g661946 8.3 MB/s | 1.7 MB 00:00 2024-01-31T04:58:36.505 INFO:teuthology.orchestra.run.smithi181.stdout:(32/155): ceph-mgr-modules-core-19.0.0-885.g661 3.2 MB/s | 245 kB 00:00 2024-01-31T04:58:36.572 INFO:teuthology.orchestra.run.smithi181.stdout:(33/155): ceph-mgr-rook-19.0.0-885.g661946e7.el 760 kB/s | 51 kB 00:00 2024-01-31T04:58:36.631 INFO:teuthology.orchestra.run.smithi181.stdout:(34/155): ceph-prometheus-alerts-19.0.0-885.g66 260 kB/s | 15 kB 00:00 2024-01-31T04:58:36.706 INFO:teuthology.orchestra.run.smithi181.stdout:(35/155): ceph-volume-19.0.0-885.g661946e7.el9. 3.4 MB/s | 262 kB 00:00 2024-01-31T04:58:36.798 INFO:teuthology.orchestra.run.smithi181.stdout:(36/155): cephadm-19.0.0-885.g661946e7.el9.noar 7.9 MB/s | 742 kB 00:00 2024-01-31T04:58:37.153 INFO:teuthology.orchestra.run.smithi099.stderr:Modular dependency problems: 2024-01-31T04:58:37.153 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-01-31T04:58:37.153 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 1: conflicting requests 2024-01-31T04:58:37.153 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.153 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 2: conflicting requests 2024-01-31T04:58:37.154 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.154 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 3: conflicting requests 2024-01-31T04:58:37.154 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.154 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 4: conflicting requests 2024-01-31T04:58:37.154 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.154 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 5: conflicting requests 2024-01-31T04:58:37.154 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.154 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 6: conflicting requests 2024-01-31T04:58:37.154 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.154 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 7: conflicting requests 2024-01-31T04:58:37.154 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.154 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 8: conflicting requests 2024-01-31T04:58:37.155 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.155 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 9: conflicting requests 2024-01-31T04:58:37.155 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.155 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 10: conflicting requests 2024-01-31T04:58:37.155 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.155 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 11: conflicting requests 2024-01-31T04:58:37.155 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.155 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 12: conflicting requests 2024-01-31T04:58:37.155 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.155 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 13: conflicting requests 2024-01-31T04:58:37.155 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.155 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 14: conflicting requests 2024-01-31T04:58:37.155 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.155 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 15: conflicting requests 2024-01-31T04:58:37.156 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.156 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 16: conflicting requests 2024-01-31T04:58:37.156 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.156 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 17: conflicting requests 2024-01-31T04:58:37.156 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.156 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 18: conflicting requests 2024-01-31T04:58:37.156 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.156 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 19: conflicting requests 2024-01-31T04:58:37.156 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.157 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 20: conflicting requests 2024-01-31T04:58:37.157 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.157 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 21: conflicting requests 2024-01-31T04:58:37.157 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.157 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 22: conflicting requests 2024-01-31T04:58:37.157 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.157 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 23: conflicting requests 2024-01-31T04:58:37.157 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.157 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 24: conflicting requests 2024-01-31T04:58:37.157 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.157 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 25: conflicting requests 2024-01-31T04:58:37.157 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.157 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 26: conflicting requests 2024-01-31T04:58:37.157 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.158 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 27: conflicting requests 2024-01-31T04:58:37.158 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.158 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 28: conflicting requests 2024-01-31T04:58:37.158 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.158 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 29: conflicting requests 2024-01-31T04:58:37.158 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.158 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 30: conflicting requests 2024-01-31T04:58:37.158 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.158 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 31: conflicting requests 2024-01-31T04:58:37.158 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.158 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 32: conflicting requests 2024-01-31T04:58:37.158 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.158 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 33: conflicting requests 2024-01-31T04:58:37.158 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.158 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 34: conflicting requests 2024-01-31T04:58:37.159 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.159 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 35: conflicting requests 2024-01-31T04:58:37.159 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.159 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 36: conflicting requests 2024-01-31T04:58:37.159 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.159 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 37: conflicting requests 2024-01-31T04:58:37.159 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.160 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.160 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.160 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 38: cannot install the best candidate for the job 2024-01-31T04:58:37.160 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.160 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.160 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.160 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.160 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 39: conflicting requests 2024-01-31T04:58:37.161 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.161 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.161 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.161 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.161 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.161 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.161 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 40: cannot install the best candidate for the job 2024-01-31T04:58:37.161 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.162 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.162 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.162 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.162 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 41: cannot install the best candidate for the job 2024-01-31T04:58:37.162 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.162 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.162 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.162 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.162 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 42: cannot install the best candidate for the job 2024-01-31T04:58:37.162 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.162 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.162 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.162 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.162 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 43: cannot install the best candidate for the job 2024-01-31T04:58:37.163 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.164 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.164 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.164 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.165 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 44: cannot install the best candidate for the job 2024-01-31T04:58:37.165 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.165 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.166 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.166 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.166 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 45: cannot install the best candidate for the job 2024-01-31T04:58:37.166 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.166 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.166 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.167 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-31T04:58:37.215 INFO:teuthology.orchestra.run.smithi181.stdout:(37/155): ceph-test-19.0.0-885.g661946e7.el9.x8 15 MB/s | 46 MB 00:03 2024-01-31T04:58:37.240 INFO:teuthology.orchestra.run.smithi181.stdout:(38/155): cephfs-top-19.0.0-885.g661946e7.el9.n 41 kB/s | 18 kB 00:00 2024-01-31T04:58:37.252 INFO:teuthology.orchestra.run.smithi179.stdout:lab-extras 10 kB/s | 1.7 kB 00:00 2024-01-31T04:58:37.324 INFO:teuthology.orchestra.run.smithi181.stdout:(39/155): libaio-devel-0.3.112-1.el8.x86_64.rpm 162 kB/s | 18 kB 00:00 2024-01-31T04:58:37.466 INFO:teuthology.orchestra.run.smithi181.stdout:(40/155): ceph-mgr-diskprediction-local-19.0.0- 6.2 MB/s | 7.4 MB 00:01 2024-01-31T04:58:37.594 INFO:teuthology.orchestra.run.smithi099.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-01-31T04:58:37.594 INFO:teuthology.orchestra.run.smithi099.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-01-31T04:58:37.607 INFO:teuthology.orchestra.run.smithi099.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-01-31T04:58:37.608 INFO:teuthology.orchestra.run.smithi099.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-01-31T04:58:37.609 INFO:teuthology.orchestra.run.smithi099.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-01-31T04:58:37.610 INFO:teuthology.orchestra.run.smithi099.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-01-31T04:58:37.612 INFO:teuthology.orchestra.run.smithi099.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-01-31T04:58:37.615 INFO:teuthology.orchestra.run.smithi099.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-01-31T04:58:37.615 INFO:teuthology.orchestra.run.smithi099.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-01-31T04:58:37.702 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-01-31T04:58:37.723 INFO:teuthology.orchestra.run.smithi099.stdout:======================================================================================== 2024-01-31T04:58:37.723 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-01-31T04:58:37.723 INFO:teuthology.orchestra.run.smithi099.stdout:======================================================================================== 2024-01-31T04:58:37.723 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-01-31T04:58:37.723 INFO:teuthology.orchestra.run.smithi099.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-01-31T04:58:37.723 INFO:teuthology.orchestra.run.smithi099.stdout: ceph x86_64 2:19.0.0-885.g661946e7.el9 ceph 6.5 k 2024-01-31T04:58:37.724 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-base x86_64 2:19.0.0-885.g661946e7.el9 ceph 5.1 M 2024-01-31T04:58:37.724 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-fuse x86_64 2:19.0.0-885.g661946e7.el9 ceph 886 k 2024-01-31T04:58:37.724 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-885.g661946e7.el9 ceph 145 k 2024-01-31T04:58:37.724 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr x86_64 2:19.0.0-885.g661946e7.el9 ceph 1.5 M 2024-01-31T04:58:37.724 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-cephadm noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 133 k 2024-01-31T04:58:37.724 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-dashboard noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 1.7 M 2024-01-31T04:58:37.724 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 7.4 M 2024-01-31T04:58:37.724 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-rook noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 51 k 2024-01-31T04:58:37.724 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-radosgw x86_64 2:19.0.0-885.g661946e7.el9 ceph 8.7 M 2024-01-31T04:58:37.724 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-test x86_64 2:19.0.0-885.g661946e7.el9 ceph 46 M 2024-01-31T04:58:37.724 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-volume noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 262 k 2024-01-31T04:58:37.725 INFO:teuthology.orchestra.run.smithi099.stdout: cephadm noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 742 k 2024-01-31T04:58:37.725 INFO:teuthology.orchestra.run.smithi099.stdout: cephfs-mirror x86_64 2:19.0.0-885.g661946e7.el9 ceph 217 k 2024-01-31T04:58:37.725 INFO:teuthology.orchestra.run.smithi099.stdout: cephfs-shell x86_64 2:19.0.0-885.g661946e7.el9 ceph 27 k 2024-01-31T04:58:37.725 INFO:teuthology.orchestra.run.smithi099.stdout: cephfs-top noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 18 k 2024-01-31T04:58:37.725 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-01-31T04:58:37.725 INFO:teuthology.orchestra.run.smithi099.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-01-31T04:58:37.725 INFO:teuthology.orchestra.run.smithi099.stdout: libaio-devel x86_64 0.3.112-1.el8 CentOS-BaseOS 18 k 2024-01-31T04:58:37.725 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs-devel x86_64 2:19.0.0-885.g661946e7.el9 ceph 31 k 2024-01-31T04:58:37.725 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs2 x86_64 2:19.0.0-885.g661946e7.el9 ceph 743 k 2024-01-31T04:58:37.725 INFO:teuthology.orchestra.run.smithi099.stdout: librados-devel x86_64 2:19.0.0-885.g661946e7.el9 ceph 127 k 2024-01-31T04:58:37.726 INFO:teuthology.orchestra.run.smithi099.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-01-31T04:58:37.726 INFO:teuthology.orchestra.run.smithi099.stdout: libuuid-devel x86_64 2.37.4-15.el9 appstream 26 k 2024-01-31T04:58:37.726 INFO:teuthology.orchestra.run.smithi099.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2024-01-31T04:58:37.726 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql x86_64 13.11-1.el9 appstream 1.6 M 2024-01-31T04:58:37.726 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-contrib x86_64 13.11-1.el9 appstream 905 k 2024-01-31T04:58:37.726 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-server x86_64 13.11-1.el9 appstream 5.7 M 2024-01-31T04:58:37.727 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cephfs x86_64 2:19.0.0-885.g661946e7.el9 ceph 162 k 2024-01-31T04:58:37.727 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rados x86_64 2:19.0.0-885.g661946e7.el9 ceph 321 k 2024-01-31T04:58:37.727 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rbd x86_64 2:19.0.0-885.g661946e7.el9 ceph 298 k 2024-01-31T04:58:37.727 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rgw x86_64 2:19.0.0-885.g661946e7.el9 ceph 99 k 2024-01-31T04:58:37.727 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-fuse x86_64 2:19.0.0-885.g661946e7.el9 ceph 85 k 2024-01-31T04:58:37.727 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-mirror x86_64 2:19.0.0-885.g661946e7.el9 ceph 3.1 M 2024-01-31T04:58:37.727 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-nbd x86_64 2:19.0.0-885.g661946e7.el9 ceph 170 k 2024-01-31T04:58:37.727 INFO:teuthology.orchestra.run.smithi099.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-01-31T04:58:37.727 INFO:teuthology.orchestra.run.smithi099.stdout:Upgrading: 2024-01-31T04:58:37.727 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager x86_64 1:1.45.10-1.el9 baseos 2.3 M 2024-01-31T04:58:37.727 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-libnm x86_64 1:1.45.10-1.el9 baseos 1.8 M 2024-01-31T04:58:37.727 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-team x86_64 1:1.45.10-1.el9 baseos 43 k 2024-01-31T04:58:37.727 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-tui x86_64 1:1.45.10-1.el9 baseos 247 k 2024-01-31T04:58:37.728 INFO:teuthology.orchestra.run.smithi099.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-01-31T04:58:37.728 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-01-31T04:58:37.728 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-01-31T04:58:37.728 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-01-31T04:58:37.728 INFO:teuthology.orchestra.run.smithi099.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-01-31T04:58:37.728 INFO:teuthology.orchestra.run.smithi099.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-01-31T04:58:37.728 INFO:teuthology.orchestra.run.smithi099.stdout: librados2 x86_64 2:19.0.0-885.g661946e7.el9 ceph 3.4 M 2024-01-31T04:58:37.728 INFO:teuthology.orchestra.run.smithi099.stdout: librbd1 x86_64 2:19.0.0-885.g661946e7.el9 ceph 3.1 M 2024-01-31T04:58:37.728 INFO:teuthology.orchestra.run.smithi099.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2024-01-31T04:58:37.728 INFO:teuthology.orchestra.run.smithi099.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2024-01-31T04:58:37.728 INFO:teuthology.orchestra.run.smithi099.stdout: xfsdump x86_64 3.1.12-4.el9 baseos 323 k 2024-01-31T04:58:37.728 INFO:teuthology.orchestra.run.smithi099.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-01-31T04:58:37.728 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-01-31T04:58:37.729 INFO:teuthology.orchestra.run.smithi099.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-01-31T04:58:37.729 INFO:teuthology.orchestra.run.smithi099.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-01-31T04:58:37.729 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-common x86_64 2:19.0.0-885.g661946e7.el9 ceph 19 M 2024-01-31T04:58:37.729 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-grafana-dashboards noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 28 k 2024-01-31T04:58:37.729 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mds x86_64 2:19.0.0-885.g661946e7.el9 ceph 2.1 M 2024-01-31T04:58:37.729 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-modules-core noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 245 k 2024-01-31T04:58:37.729 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mon x86_64 2:19.0.0-885.g661946e7.el9 ceph 4.7 M 2024-01-31T04:58:37.729 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-osd x86_64 2:19.0.0-885.g661946e7.el9 ceph 17 M 2024-01-31T04:58:37.729 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-prometheus-alerts noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 15 k 2024-01-31T04:58:37.729 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-selinux x86_64 2:19.0.0-885.g661946e7.el9 ceph 25 k 2024-01-31T04:58:37.729 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-01-31T04:58:37.729 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-01-31T04:58:37.729 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-01-31T04:58:37.729 INFO:teuthology.orchestra.run.smithi099.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-01-31T04:58:37.729 INFO:teuthology.orchestra.run.smithi099.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-01-31T04:58:37.730 INFO:teuthology.orchestra.run.smithi099.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-01-31T04:58:37.730 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-01-31T04:58:37.730 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-01-31T04:58:37.730 INFO:teuthology.orchestra.run.smithi099.stdout: libcephsqlite x86_64 2:19.0.0-885.g661946e7.el9 ceph 163 k 2024-01-31T04:58:37.730 INFO:teuthology.orchestra.run.smithi099.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-01-31T04:58:37.730 INFO:teuthology.orchestra.run.smithi099.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-01-31T04:58:37.730 INFO:teuthology.orchestra.run.smithi099.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-01-31T04:58:37.730 INFO:teuthology.orchestra.run.smithi099.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-01-31T04:58:37.730 INFO:teuthology.orchestra.run.smithi099.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-01-31T04:58:37.730 INFO:teuthology.orchestra.run.smithi099.stdout: libradosstriper1 x86_64 2:19.0.0-885.g661946e7.el9 ceph 499 k 2024-01-31T04:58:37.730 INFO:teuthology.orchestra.run.smithi099.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-01-31T04:58:37.730 INFO:teuthology.orchestra.run.smithi099.stdout: librgw2 x86_64 2:19.0.0-885.g661946e7.el9 ceph 4.8 M 2024-01-31T04:58:37.730 INFO:teuthology.orchestra.run.smithi099.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-01-31T04:58:37.730 INFO:teuthology.orchestra.run.smithi099.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-01-31T04:58:37.731 INFO:teuthology.orchestra.run.smithi099.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-01-31T04:58:37.731 INFO:teuthology.orchestra.run.smithi099.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-01-31T04:58:37.731 INFO:teuthology.orchestra.run.smithi099.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-01-31T04:58:37.731 INFO:teuthology.orchestra.run.smithi099.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-01-31T04:58:37.731 INFO:teuthology.orchestra.run.smithi099.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-01-31T04:58:37.731 INFO:teuthology.orchestra.run.smithi099.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-01-31T04:58:37.731 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-01-31T04:58:37.731 INFO:teuthology.orchestra.run.smithi099.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-01-31T04:58:37.731 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-private-libs x86_64 13.11-1.el9 appstream 135 k 2024-01-31T04:58:37.731 INFO:teuthology.orchestra.run.smithi099.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2024-01-31T04:58:37.731 INFO:teuthology.orchestra.run.smithi099.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-01-31T04:58:37.731 INFO:teuthology.orchestra.run.smithi099.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-01-31T04:58:37.731 INFO:teuthology.orchestra.run.smithi099.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-01-31T04:58:37.731 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-01-31T04:58:37.732 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-argparse x86_64 2:19.0.0-885.g661946e7.el9 ceph 45 k 2024-01-31T04:58:37.732 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-common x86_64 2:19.0.0-885.g661946e7.el9 ceph 130 k 2024-01-31T04:58:37.732 INFO:teuthology.orchestra.run.smithi099.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-01-31T04:58:37.732 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-01-31T04:58:37.732 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-01-31T04:58:37.732 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-01-31T04:58:37.732 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-01-31T04:58:37.732 INFO:teuthology.orchestra.run.smithi099.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-01-31T04:58:37.732 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-01-31T04:58:37.733 INFO:teuthology.orchestra.run.smithi099.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-01-31T04:58:37.733 INFO:teuthology.orchestra.run.smithi099.stdout: python3-google-auth noarch 1:2.26.2-1.el9 epel 202 k 2024-01-31T04:58:37.733 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-01-31T04:58:37.733 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-01-31T04:58:37.733 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-01-31T04:58:37.733 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-01-31T04:58:37.733 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-01-31T04:58:37.733 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jinja2 noarch 2.11.3-4.el9 appstream 249 k 2024-01-31T04:58:37.733 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-01-31T04:58:37.733 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-01-31T04:58:37.733 INFO:teuthology.orchestra.run.smithi099.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-01-31T04:58:37.733 INFO:teuthology.orchestra.run.smithi099.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-01-31T04:58:37.733 INFO:teuthology.orchestra.run.smithi099.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-01-31T04:58:37.734 INFO:teuthology.orchestra.run.smithi099.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-01-31T04:58:37.734 INFO:teuthology.orchestra.run.smithi099.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-01-31T04:58:37.734 INFO:teuthology.orchestra.run.smithi099.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-01-31T04:58:37.734 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-01-31T04:58:37.734 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-01-31T04:58:37.734 INFO:teuthology.orchestra.run.smithi099.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-01-31T04:58:37.734 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-01-31T04:58:37.734 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-01-31T04:58:37.734 INFO:teuthology.orchestra.run.smithi099.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-01-31T04:58:37.734 INFO:teuthology.orchestra.run.smithi099.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-01-31T04:58:37.734 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-01-31T04:58:37.734 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-01-31T04:58:37.734 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-01-31T04:58:37.734 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-01-31T04:58:37.735 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-01-31T04:58:37.735 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-01-31T04:58:37.735 INFO:teuthology.orchestra.run.smithi099.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-01-31T04:58:37.735 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-01-31T04:58:37.735 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-01-31T04:58:37.735 INFO:teuthology.orchestra.run.smithi099.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-01-31T04:58:37.735 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-01-31T04:58:37.735 INFO:teuthology.orchestra.run.smithi099.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-01-31T04:58:37.735 INFO:teuthology.orchestra.run.smithi099.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-01-31T04:58:37.735 INFO:teuthology.orchestra.run.smithi099.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-01-31T04:58:37.735 INFO:teuthology.orchestra.run.smithi099.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-01-31T04:58:37.735 INFO:teuthology.orchestra.run.smithi099.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-01-31T04:58:37.735 INFO:teuthology.orchestra.run.smithi099.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-01-31T04:58:37.735 INFO:teuthology.orchestra.run.smithi099.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-01-31T04:58:37.735 INFO:teuthology.orchestra.run.smithi099.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-01-31T04:58:37.736 INFO:teuthology.orchestra.run.smithi099.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-01-31T04:58:37.736 INFO:teuthology.orchestra.run.smithi099.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-01-31T04:58:37.736 INFO:teuthology.orchestra.run.smithi099.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-01-31T04:58:37.736 INFO:teuthology.orchestra.run.smithi099.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-01-31T04:58:37.736 INFO:teuthology.orchestra.run.smithi099.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-01-31T04:58:37.736 INFO:teuthology.orchestra.run.smithi099.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-01-31T04:58:37.736 INFO:teuthology.orchestra.run.smithi099.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-01-31T04:58:37.736 INFO:teuthology.orchestra.run.smithi099.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2024-01-31T04:58:37.736 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T04:58:37.736 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-01-31T04:58:37.736 INFO:teuthology.orchestra.run.smithi099.stdout:======================================================================================== 2024-01-31T04:58:37.736 INFO:teuthology.orchestra.run.smithi099.stdout:Install 139 Packages 2024-01-31T04:58:37.736 INFO:teuthology.orchestra.run.smithi099.stdout:Upgrade 16 Packages 2024-01-31T04:58:37.736 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T04:58:37.737 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 212 M 2024-01-31T04:58:37.737 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-01-31T04:58:37.775 INFO:teuthology.orchestra.run.smithi181.stdout:(41/155): fuse-2.9.9-15.el9.x86_64.rpm 150 kB/s | 80 kB 00:00 2024-01-31T04:58:37.949 INFO:teuthology.orchestra.run.smithi181.stdout:(42/155): jq-1.6-16.el9.x86_64.rpm 312 kB/s | 187 kB 00:00 2024-01-31T04:58:38.033 INFO:teuthology.orchestra.run.smithi181.stdout:(43/155): libgfortran-11.4.1-3.el9.x86_64.rpm 1.5 MB/s | 803 kB 00:00 2024-01-31T04:58:38.058 INFO:teuthology.orchestra.run.smithi181.stdout:(44/155): libquadmath-11.4.1-3.el9.x86_64.rpm 688 kB/s | 195 kB 00:00 2024-01-31T04:58:38.083 INFO:teuthology.orchestra.run.smithi181.stdout:(45/155): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.6 MB/s | 218 kB 00:00 2024-01-31T04:58:38.142 INFO:teuthology.orchestra.run.smithi181.stdout:(46/155): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-01-31T04:58:38.226 INFO:teuthology.orchestra.run.smithi181.stdout:(47/155): python3-cryptography-36.0.1-4.el9.x86 7.3 MB/s | 1.2 MB 00:00 2024-01-31T04:58:38.251 INFO:teuthology.orchestra.run.smithi181.stdout:(48/155): python3-ply-3.11-14.el9.noarch.rpm 637 kB/s | 106 kB 00:00 2024-01-31T04:58:38.276 INFO:teuthology.orchestra.run.smithi181.stdout:(49/155): python3-pycparser-2.20-6.el9.noarch.r 1.0 MB/s | 135 kB 00:00 2024-01-31T04:58:38.326 INFO:teuthology.orchestra.run.smithi181.stdout:(50/155): python3-requests-2.25.1-8.el9.noarch. 1.2 MB/s | 125 kB 00:00 2024-01-31T04:58:38.382 INFO:teuthology.orchestra.run.smithi099.stdout:(1/155): ceph-19.0.0-885.g661946e7.el9.x86_64.r 32 kB/s | 6.5 kB 00:00 2024-01-31T04:58:38.385 INFO:teuthology.orchestra.run.smithi181.stdout:(51/155): python3-urllib3-1.26.5-5.el9.noarch.r 1.9 MB/s | 215 kB 00:00 2024-01-31T04:58:38.957 INFO:teuthology.orchestra.run.smithi099.stdout:(2/155): ceph-fuse-19.0.0-885.g661946e7.el9.x86 1.5 MB/s | 886 kB 00:00 2024-01-31T04:58:39.049 INFO:teuthology.orchestra.run.smithi099.stdout:(3/155): ceph-immutable-object-cache-19.0.0-885 1.5 MB/s | 145 kB 00:00 2024-01-31T04:58:39.119 INFO:teuthology.orchestra.run.smithi181.stdout:(52/155): boost-program-options-1.75.0-8.el9.x8 146 kB/s | 107 kB 00:00 2024-01-31T04:58:39.260 INFO:teuthology.orchestra.run.smithi181.stdout:(53/155): automake-1.16.2-8.el9.noarch.rpm 700 kB/s | 689 kB 00:00 2024-01-31T04:58:39.294 INFO:teuthology.orchestra.run.smithi181.stdout:(54/155): bison-3.7.4-5.el9.x86_64.rpm 975 kB/s | 943 kB 00:00 2024-01-31T04:58:39.724 INFO:teuthology.orchestra.run.smithi099.stdout:(4/155): ceph-mds-19.0.0-885.g661946e7.el9.x86_ 3.1 MB/s | 2.1 MB 00:00 2024-01-31T04:58:39.753 INFO:teuthology.orchestra.run.smithi181.stdout:(55/155): elfutils-libelf-devel-0.190-2.el9.x86 34 kB/s | 21 kB 00:00 2024-01-31T04:58:39.770 INFO:teuthology.orchestra.run.smithi179.stderr:Modular dependency problems: 2024-01-31T04:58:39.770 INFO:teuthology.orchestra.run.smithi179.stderr: 2024-01-31T04:58:39.771 INFO:teuthology.orchestra.run.smithi179.stderr: Problem 1: conflicting requests 2024-01-31T04:58:39.771 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.771 INFO:teuthology.orchestra.run.smithi179.stderr: Problem 2: conflicting requests 2024-01-31T04:58:39.771 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.771 INFO:teuthology.orchestra.run.smithi179.stderr: Problem 3: conflicting requests 2024-01-31T04:58:39.771 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.771 INFO:teuthology.orchestra.run.smithi179.stderr: Problem 4: conflicting requests 2024-01-31T04:58:39.771 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.771 INFO:teuthology.orchestra.run.smithi179.stderr: Problem 5: conflicting requests 2024-01-31T04:58:39.771 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.771 INFO:teuthology.orchestra.run.smithi179.stderr: Problem 6: conflicting requests 2024-01-31T04:58:39.771 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.771 INFO:teuthology.orchestra.run.smithi179.stderr: Problem 7: conflicting requests 2024-01-31T04:58:39.772 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.772 INFO:teuthology.orchestra.run.smithi179.stderr: Problem 8: conflicting requests 2024-01-31T04:58:39.772 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.772 INFO:teuthology.orchestra.run.smithi179.stderr: Problem 9: conflicting requests 2024-01-31T04:58:39.772 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.772 INFO:teuthology.orchestra.run.smithi179.stderr: Problem 10: conflicting requests 2024-01-31T04:58:39.772 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.772 INFO:teuthology.orchestra.run.smithi179.stderr: Problem 11: conflicting requests 2024-01-31T04:58:39.772 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.772 INFO:teuthology.orchestra.run.smithi179.stderr: Problem 12: conflicting requests 2024-01-31T04:58:39.772 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.772 INFO:teuthology.orchestra.run.smithi179.stderr: Problem 13: conflicting requests 2024-01-31T04:58:39.772 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.772 INFO:teuthology.orchestra.run.smithi179.stderr: Problem 14: conflicting requests 2024-01-31T04:58:39.773 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.773 INFO:teuthology.orchestra.run.smithi179.stderr: Problem 15: conflicting requests 2024-01-31T04:58:39.773 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.773 INFO:teuthology.orchestra.run.smithi179.stderr: Problem 16: conflicting requests 2024-01-31T04:58:39.773 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.773 INFO:teuthology.orchestra.run.smithi179.stderr: Problem 17: conflicting requests 2024-01-31T04:58:39.773 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.773 INFO:teuthology.orchestra.run.smithi179.stderr: Problem 18: conflicting requests 2024-01-31T04:58:39.773 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.773 INFO:teuthology.orchestra.run.smithi179.stderr: Problem 19: conflicting requests 2024-01-31T04:58:39.773 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.773 INFO:teuthology.orchestra.run.smithi179.stderr: Problem 20: conflicting requests 2024-01-31T04:58:39.773 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.774 INFO:teuthology.orchestra.run.smithi179.stderr: Problem 21: conflicting requests 2024-01-31T04:58:39.774 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.774 INFO:teuthology.orchestra.run.smithi179.stderr: Problem 22: conflicting requests 2024-01-31T04:58:39.774 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.774 INFO:teuthology.orchestra.run.smithi179.stderr: Problem 23: conflicting requests 2024-01-31T04:58:39.774 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.774 INFO:teuthology.orchestra.run.smithi179.stderr: Problem 24: conflicting requests 2024-01-31T04:58:39.774 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.774 INFO:teuthology.orchestra.run.smithi179.stderr: Problem 25: conflicting requests 2024-01-31T04:58:39.774 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.774 INFO:teuthology.orchestra.run.smithi179.stderr: Problem 26: conflicting requests 2024-01-31T04:58:39.774 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.774 INFO:teuthology.orchestra.run.smithi179.stderr: Problem 27: conflicting requests 2024-01-31T04:58:39.774 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.775 INFO:teuthology.orchestra.run.smithi179.stderr: Problem 28: conflicting requests 2024-01-31T04:58:39.775 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.775 INFO:teuthology.orchestra.run.smithi179.stderr: Problem 29: conflicting requests 2024-01-31T04:58:39.775 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.775 INFO:teuthology.orchestra.run.smithi179.stderr: Problem 30: conflicting requests 2024-01-31T04:58:39.775 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.775 INFO:teuthology.orchestra.run.smithi179.stderr: Problem 31: conflicting requests 2024-01-31T04:58:39.775 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.775 INFO:teuthology.orchestra.run.smithi179.stderr: Problem 32: conflicting requests 2024-01-31T04:58:39.775 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.775 INFO:teuthology.orchestra.run.smithi179.stderr: Problem 33: conflicting requests 2024-01-31T04:58:39.775 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.775 INFO:teuthology.orchestra.run.smithi179.stderr: Problem 34: conflicting requests 2024-01-31T04:58:39.775 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.776 INFO:teuthology.orchestra.run.smithi179.stderr: Problem 35: conflicting requests 2024-01-31T04:58:39.776 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.776 INFO:teuthology.orchestra.run.smithi179.stderr: Problem 36: conflicting requests 2024-01-31T04:58:39.776 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.776 INFO:teuthology.orchestra.run.smithi179.stderr: Problem 37: conflicting requests 2024-01-31T04:58:39.776 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.776 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.776 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.776 INFO:teuthology.orchestra.run.smithi179.stderr: Problem 38: cannot install the best candidate for the job 2024-01-31T04:58:39.776 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.776 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.776 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.776 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.777 INFO:teuthology.orchestra.run.smithi179.stderr: Problem 39: conflicting requests 2024-01-31T04:58:39.777 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.777 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.777 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.777 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.777 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.777 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.777 INFO:teuthology.orchestra.run.smithi179.stderr: Problem 40: cannot install the best candidate for the job 2024-01-31T04:58:39.777 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.777 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.777 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.777 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.777 INFO:teuthology.orchestra.run.smithi179.stderr: Problem 41: cannot install the best candidate for the job 2024-01-31T04:58:39.778 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.778 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.778 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.778 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.778 INFO:teuthology.orchestra.run.smithi179.stderr: Problem 42: cannot install the best candidate for the job 2024-01-31T04:58:39.778 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.778 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.778 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.778 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.778 INFO:teuthology.orchestra.run.smithi179.stderr: Problem 43: cannot install the best candidate for the job 2024-01-31T04:58:39.778 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.778 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.778 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.778 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.778 INFO:teuthology.orchestra.run.smithi179.stderr: Problem 44: cannot install the best candidate for the job 2024-01-31T04:58:39.779 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.779 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.779 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.779 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.779 INFO:teuthology.orchestra.run.smithi179.stderr: Problem 45: cannot install the best candidate for the job 2024-01-31T04:58:39.779 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.779 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.779 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.779 INFO:teuthology.orchestra.run.smithi179.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-31T04:58:39.961 INFO:teuthology.orchestra.run.smithi181.stdout:(56/155): flexiblas-3.0.4-8.el9.x86_64.rpm 49 kB/s | 33 kB 00:00 2024-01-31T04:58:40.066 INFO:teuthology.orchestra.run.smithi099.stdout:(5/155): ceph-common-19.0.0-885.g661946e7.el9.x 10 MB/s | 19 MB 00:01 2024-01-31T04:58:40.139 INFO:teuthology.orchestra.run.smithi181.stdout:(57/155): flex-2.6.4-9.el9.x86_64.rpm 358 kB/s | 313 kB 00:00 2024-01-31T04:58:40.152 INFO:teuthology.orchestra.run.smithi099.stdout:(6/155): ceph-base-19.0.0-885.g661946e7.el9.x86 2.6 MB/s | 5.1 MB 00:01 2024-01-31T04:58:40.181 INFO:teuthology.orchestra.run.smithi179.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-01-31T04:58:40.182 INFO:teuthology.orchestra.run.smithi179.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-01-31T04:58:40.195 INFO:teuthology.orchestra.run.smithi179.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-01-31T04:58:40.195 INFO:teuthology.orchestra.run.smithi179.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-01-31T04:58:40.196 INFO:teuthology.orchestra.run.smithi179.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-01-31T04:58:40.197 INFO:teuthology.orchestra.run.smithi179.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-01-31T04:58:40.199 INFO:teuthology.orchestra.run.smithi179.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-01-31T04:58:40.202 INFO:teuthology.orchestra.run.smithi179.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-01-31T04:58:40.203 INFO:teuthology.orchestra.run.smithi179.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-01-31T04:58:40.235 INFO:teuthology.orchestra.run.smithi099.stdout:(7/155): ceph-mgr-19.0.0-885.g661946e7.el9.x86_ 2.9 MB/s | 1.5 MB 00:00 2024-01-31T04:58:40.289 INFO:teuthology.orchestra.run.smithi179.stdout:Dependencies resolved. 2024-01-31T04:58:40.304 INFO:teuthology.orchestra.run.smithi179.stdout:======================================================================================== 2024-01-31T04:58:40.305 INFO:teuthology.orchestra.run.smithi179.stdout: Package Arch Version Repository Size 2024-01-31T04:58:40.305 INFO:teuthology.orchestra.run.smithi179.stdout:======================================================================================== 2024-01-31T04:58:40.305 INFO:teuthology.orchestra.run.smithi179.stdout:Installing: 2024-01-31T04:58:40.305 INFO:teuthology.orchestra.run.smithi179.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-01-31T04:58:40.305 INFO:teuthology.orchestra.run.smithi179.stdout: ceph x86_64 2:19.0.0-885.g661946e7.el9 ceph 6.5 k 2024-01-31T04:58:40.305 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-base x86_64 2:19.0.0-885.g661946e7.el9 ceph 5.1 M 2024-01-31T04:58:40.305 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-fuse x86_64 2:19.0.0-885.g661946e7.el9 ceph 886 k 2024-01-31T04:58:40.305 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-885.g661946e7.el9 ceph 145 k 2024-01-31T04:58:40.305 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr x86_64 2:19.0.0-885.g661946e7.el9 ceph 1.5 M 2024-01-31T04:58:40.305 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-cephadm noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 133 k 2024-01-31T04:58:40.305 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-dashboard noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 1.7 M 2024-01-31T04:58:40.305 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 7.4 M 2024-01-31T04:58:40.306 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-rook noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 51 k 2024-01-31T04:58:40.306 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-radosgw x86_64 2:19.0.0-885.g661946e7.el9 ceph 8.7 M 2024-01-31T04:58:40.306 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-test x86_64 2:19.0.0-885.g661946e7.el9 ceph 46 M 2024-01-31T04:58:40.306 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-volume noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 262 k 2024-01-31T04:58:40.306 INFO:teuthology.orchestra.run.smithi179.stdout: cephadm noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 742 k 2024-01-31T04:58:40.306 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-mirror x86_64 2:19.0.0-885.g661946e7.el9 ceph 217 k 2024-01-31T04:58:40.306 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-shell x86_64 2:19.0.0-885.g661946e7.el9 ceph 27 k 2024-01-31T04:58:40.306 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-top noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 18 k 2024-01-31T04:58:40.306 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-01-31T04:58:40.306 INFO:teuthology.orchestra.run.smithi179.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-01-31T04:58:40.306 INFO:teuthology.orchestra.run.smithi179.stdout: libaio-devel x86_64 0.3.112-1.el8 CentOS-BaseOS 18 k 2024-01-31T04:58:40.306 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs-devel x86_64 2:19.0.0-885.g661946e7.el9 ceph 31 k 2024-01-31T04:58:40.306 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs2 x86_64 2:19.0.0-885.g661946e7.el9 ceph 743 k 2024-01-31T04:58:40.306 INFO:teuthology.orchestra.run.smithi179.stdout: librados-devel x86_64 2:19.0.0-885.g661946e7.el9 ceph 127 k 2024-01-31T04:58:40.307 INFO:teuthology.orchestra.run.smithi179.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-01-31T04:58:40.307 INFO:teuthology.orchestra.run.smithi179.stdout: libuuid-devel x86_64 2.37.4-15.el9 appstream 26 k 2024-01-31T04:58:40.307 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2024-01-31T04:58:40.307 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql x86_64 13.11-1.el9 appstream 1.6 M 2024-01-31T04:58:40.307 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-contrib x86_64 13.11-1.el9 appstream 905 k 2024-01-31T04:58:40.307 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-server x86_64 13.11-1.el9 appstream 5.7 M 2024-01-31T04:58:40.307 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cephfs x86_64 2:19.0.0-885.g661946e7.el9 ceph 162 k 2024-01-31T04:58:40.307 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rados x86_64 2:19.0.0-885.g661946e7.el9 ceph 321 k 2024-01-31T04:58:40.307 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rbd x86_64 2:19.0.0-885.g661946e7.el9 ceph 298 k 2024-01-31T04:58:40.307 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rgw x86_64 2:19.0.0-885.g661946e7.el9 ceph 99 k 2024-01-31T04:58:40.307 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-fuse x86_64 2:19.0.0-885.g661946e7.el9 ceph 85 k 2024-01-31T04:58:40.307 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-mirror x86_64 2:19.0.0-885.g661946e7.el9 ceph 3.1 M 2024-01-31T04:58:40.307 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-nbd x86_64 2:19.0.0-885.g661946e7.el9 ceph 170 k 2024-01-31T04:58:40.308 INFO:teuthology.orchestra.run.smithi179.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-01-31T04:58:40.308 INFO:teuthology.orchestra.run.smithi179.stdout:Upgrading: 2024-01-31T04:58:40.308 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager x86_64 1:1.45.10-1.el9 baseos 2.3 M 2024-01-31T04:58:40.308 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-libnm x86_64 1:1.45.10-1.el9 baseos 1.8 M 2024-01-31T04:58:40.308 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-team x86_64 1:1.45.10-1.el9 baseos 43 k 2024-01-31T04:58:40.308 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-tui x86_64 1:1.45.10-1.el9 baseos 247 k 2024-01-31T04:58:40.308 INFO:teuthology.orchestra.run.smithi179.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-01-31T04:58:40.308 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-01-31T04:58:40.308 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-01-31T04:58:40.308 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-01-31T04:58:40.308 INFO:teuthology.orchestra.run.smithi179.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-01-31T04:58:40.308 INFO:teuthology.orchestra.run.smithi179.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-01-31T04:58:40.309 INFO:teuthology.orchestra.run.smithi179.stdout: librados2 x86_64 2:19.0.0-885.g661946e7.el9 ceph 3.4 M 2024-01-31T04:58:40.309 INFO:teuthology.orchestra.run.smithi179.stdout: librbd1 x86_64 2:19.0.0-885.g661946e7.el9 ceph 3.1 M 2024-01-31T04:58:40.309 INFO:teuthology.orchestra.run.smithi179.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2024-01-31T04:58:40.309 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2024-01-31T04:58:40.309 INFO:teuthology.orchestra.run.smithi179.stdout: xfsdump x86_64 3.1.12-4.el9 baseos 323 k 2024-01-31T04:58:40.309 INFO:teuthology.orchestra.run.smithi179.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-01-31T04:58:40.309 INFO:teuthology.orchestra.run.smithi179.stdout:Installing dependencies: 2024-01-31T04:58:40.309 INFO:teuthology.orchestra.run.smithi179.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-01-31T04:58:40.309 INFO:teuthology.orchestra.run.smithi179.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-01-31T04:58:40.309 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-common x86_64 2:19.0.0-885.g661946e7.el9 ceph 19 M 2024-01-31T04:58:40.309 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-grafana-dashboards noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 28 k 2024-01-31T04:58:40.309 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mds x86_64 2:19.0.0-885.g661946e7.el9 ceph 2.1 M 2024-01-31T04:58:40.309 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-modules-core noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 245 k 2024-01-31T04:58:40.309 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mon x86_64 2:19.0.0-885.g661946e7.el9 ceph 4.7 M 2024-01-31T04:58:40.310 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-osd x86_64 2:19.0.0-885.g661946e7.el9 ceph 17 M 2024-01-31T04:58:40.310 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-prometheus-alerts noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 15 k 2024-01-31T04:58:40.310 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-selinux x86_64 2:19.0.0-885.g661946e7.el9 ceph 25 k 2024-01-31T04:58:40.310 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-01-31T04:58:40.310 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-01-31T04:58:40.310 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-01-31T04:58:40.310 INFO:teuthology.orchestra.run.smithi179.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-01-31T04:58:40.310 INFO:teuthology.orchestra.run.smithi179.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-01-31T04:58:40.311 INFO:teuthology.orchestra.run.smithi179.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-01-31T04:58:40.311 INFO:teuthology.orchestra.run.smithi179.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-01-31T04:58:40.311 INFO:teuthology.orchestra.run.smithi179.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-01-31T04:58:40.311 INFO:teuthology.orchestra.run.smithi179.stdout: libcephsqlite x86_64 2:19.0.0-885.g661946e7.el9 ceph 163 k 2024-01-31T04:58:40.311 INFO:teuthology.orchestra.run.smithi179.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-01-31T04:58:40.311 INFO:teuthology.orchestra.run.smithi179.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-01-31T04:58:40.311 INFO:teuthology.orchestra.run.smithi179.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-01-31T04:58:40.311 INFO:teuthology.orchestra.run.smithi179.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-01-31T04:58:40.311 INFO:teuthology.orchestra.run.smithi179.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-01-31T04:58:40.311 INFO:teuthology.orchestra.run.smithi179.stdout: libradosstriper1 x86_64 2:19.0.0-885.g661946e7.el9 ceph 499 k 2024-01-31T04:58:40.311 INFO:teuthology.orchestra.run.smithi179.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-01-31T04:58:40.311 INFO:teuthology.orchestra.run.smithi179.stdout: librgw2 x86_64 2:19.0.0-885.g661946e7.el9 ceph 4.8 M 2024-01-31T04:58:40.312 INFO:teuthology.orchestra.run.smithi179.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-01-31T04:58:40.312 INFO:teuthology.orchestra.run.smithi179.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-01-31T04:58:40.312 INFO:teuthology.orchestra.run.smithi179.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-01-31T04:58:40.312 INFO:teuthology.orchestra.run.smithi179.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-01-31T04:58:40.312 INFO:teuthology.orchestra.run.smithi179.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-01-31T04:58:40.312 INFO:teuthology.orchestra.run.smithi179.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-01-31T04:58:40.312 INFO:teuthology.orchestra.run.smithi179.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-01-31T04:58:40.312 INFO:teuthology.orchestra.run.smithi179.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-01-31T04:58:40.312 INFO:teuthology.orchestra.run.smithi179.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-01-31T04:58:40.312 INFO:teuthology.orchestra.run.smithi179.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-01-31T04:58:40.312 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-private-libs x86_64 13.11-1.el9 appstream 135 k 2024-01-31T04:58:40.312 INFO:teuthology.orchestra.run.smithi179.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2024-01-31T04:58:40.312 INFO:teuthology.orchestra.run.smithi179.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-01-31T04:58:40.313 INFO:teuthology.orchestra.run.smithi179.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-01-31T04:58:40.313 INFO:teuthology.orchestra.run.smithi179.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-01-31T04:58:40.313 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-01-31T04:58:40.313 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-argparse x86_64 2:19.0.0-885.g661946e7.el9 ceph 45 k 2024-01-31T04:58:40.313 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-common x86_64 2:19.0.0-885.g661946e7.el9 ceph 130 k 2024-01-31T04:58:40.313 INFO:teuthology.orchestra.run.smithi179.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-01-31T04:58:40.313 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-01-31T04:58:40.313 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-01-31T04:58:40.313 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-01-31T04:58:40.313 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-01-31T04:58:40.313 INFO:teuthology.orchestra.run.smithi179.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-01-31T04:58:40.313 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-01-31T04:58:40.313 INFO:teuthology.orchestra.run.smithi179.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-01-31T04:58:40.313 INFO:teuthology.orchestra.run.smithi179.stdout: python3-google-auth noarch 1:2.26.2-1.el9 epel 202 k 2024-01-31T04:58:40.314 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-01-31T04:58:40.314 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-01-31T04:58:40.314 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-01-31T04:58:40.314 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-01-31T04:58:40.314 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-01-31T04:58:40.314 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jinja2 noarch 2.11.3-4.el9 appstream 249 k 2024-01-31T04:58:40.314 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-01-31T04:58:40.314 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-01-31T04:58:40.314 INFO:teuthology.orchestra.run.smithi179.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-01-31T04:58:40.314 INFO:teuthology.orchestra.run.smithi179.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-01-31T04:58:40.314 INFO:teuthology.orchestra.run.smithi179.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-01-31T04:58:40.314 INFO:teuthology.orchestra.run.smithi179.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-01-31T04:58:40.314 INFO:teuthology.orchestra.run.smithi179.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-01-31T04:58:40.315 INFO:teuthology.orchestra.run.smithi179.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-01-31T04:58:40.315 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-01-31T04:58:40.315 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-01-31T04:58:40.315 INFO:teuthology.orchestra.run.smithi179.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-01-31T04:58:40.315 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-01-31T04:58:40.315 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-01-31T04:58:40.315 INFO:teuthology.orchestra.run.smithi179.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-01-31T04:58:40.315 INFO:teuthology.orchestra.run.smithi179.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-01-31T04:58:40.315 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-01-31T04:58:40.315 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-01-31T04:58:40.315 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-01-31T04:58:40.315 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-01-31T04:58:40.315 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-01-31T04:58:40.316 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-01-31T04:58:40.316 INFO:teuthology.orchestra.run.smithi179.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-01-31T04:58:40.316 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-01-31T04:58:40.316 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-01-31T04:58:40.316 INFO:teuthology.orchestra.run.smithi179.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-01-31T04:58:40.316 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-01-31T04:58:40.316 INFO:teuthology.orchestra.run.smithi179.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-01-31T04:58:40.316 INFO:teuthology.orchestra.run.smithi179.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-01-31T04:58:40.316 INFO:teuthology.orchestra.run.smithi179.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-01-31T04:58:40.316 INFO:teuthology.orchestra.run.smithi179.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-01-31T04:58:40.316 INFO:teuthology.orchestra.run.smithi179.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-01-31T04:58:40.316 INFO:teuthology.orchestra.run.smithi179.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-01-31T04:58:40.317 INFO:teuthology.orchestra.run.smithi179.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-01-31T04:58:40.317 INFO:teuthology.orchestra.run.smithi179.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-01-31T04:58:40.317 INFO:teuthology.orchestra.run.smithi179.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-01-31T04:58:40.317 INFO:teuthology.orchestra.run.smithi179.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-01-31T04:58:40.317 INFO:teuthology.orchestra.run.smithi179.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-01-31T04:58:40.317 INFO:teuthology.orchestra.run.smithi179.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-01-31T04:58:40.317 INFO:teuthology.orchestra.run.smithi179.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-01-31T04:58:40.317 INFO:teuthology.orchestra.run.smithi179.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-01-31T04:58:40.317 INFO:teuthology.orchestra.run.smithi179.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-01-31T04:58:40.317 INFO:teuthology.orchestra.run.smithi179.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2024-01-31T04:58:40.317 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-31T04:58:40.318 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction Summary 2024-01-31T04:58:40.318 INFO:teuthology.orchestra.run.smithi179.stdout:======================================================================================== 2024-01-31T04:58:40.318 INFO:teuthology.orchestra.run.smithi179.stdout:Install 139 Packages 2024-01-31T04:58:40.318 INFO:teuthology.orchestra.run.smithi179.stdout:Upgrade 16 Packages 2024-01-31T04:58:40.318 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-31T04:58:40.318 INFO:teuthology.orchestra.run.smithi179.stdout:Total download size: 212 M 2024-01-31T04:58:40.319 INFO:teuthology.orchestra.run.smithi179.stdout:Downloading Packages: 2024-01-31T04:58:40.361 INFO:teuthology.orchestra.run.smithi099.stdout:(8/155): ceph-mon-19.0.0-885.g661946e7.el9.x86_ 16 MB/s | 4.7 MB 00:00 2024-01-31T04:58:40.403 INFO:teuthology.orchestra.run.smithi099.stdout:(9/155): ceph-selinux-19.0.0-885.g661946e7.el9. 606 kB/s | 25 kB 00:00 2024-01-31T04:58:40.520 INFO:teuthology.orchestra.run.smithi181.stdout:(58/155): flexiblas-openblas-openmp-3.0.4-8.el9 33 kB/s | 18 kB 00:00 2024-01-31T04:58:40.887 INFO:teuthology.orchestra.run.smithi181.stdout:(59/155): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.6 MB/s | 3.0 MB 00:01 2024-01-31T04:58:40.912 INFO:teuthology.orchestra.run.smithi181.stdout:(60/155): libpmemobj-1.12.1-1.el9.x86_64.rpm 207 kB/s | 160 kB 00:00 2024-01-31T04:58:40.987 INFO:teuthology.orchestra.run.smithi179.stdout:(1/155): ceph-19.0.0-885.g661946e7.el9.x86_64.r 15 kB/s | 6.5 kB 00:00 2024-01-31T04:58:41.213 INFO:teuthology.orchestra.run.smithi181.stdout:(61/155): librabbitmq-0.11.0-7.el9.x86_64.rpm 65 kB/s | 45 kB 00:00 2024-01-31T04:58:41.813 INFO:teuthology.orchestra.run.smithi181.stdout:(62/155): libuuid-devel-2.37.4-15.el9.x86_64.rp 43 kB/s | 26 kB 00:00 2024-01-31T04:58:41.846 INFO:teuthology.orchestra.run.smithi181.stdout:(63/155): libtool-2.4.6-45.el9.x86_64.rpm 624 kB/s | 582 kB 00:00 2024-01-31T04:58:41.880 INFO:teuthology.orchestra.run.smithi181.stdout:(64/155): librdkafka-1.6.1-102.el9.x86_64.rpm 668 kB/s | 662 kB 00:00 2024-01-31T04:58:42.362 INFO:teuthology.orchestra.run.smithi179.stdout:(2/155): ceph-fuse-19.0.0-885.g661946e7.el9.x86 644 kB/s | 886 kB 00:01 2024-01-31T04:58:42.464 INFO:teuthology.orchestra.run.smithi181.stdout:(65/155): libzstd-devel-1.5.1-2.el9.x86_64.rpm 73 kB/s | 47 kB 00:00 2024-01-31T04:58:42.512 INFO:teuthology.orchestra.run.smithi179.stdout:(3/155): ceph-immutable-object-cache-19.0.0-885 970 kB/s | 145 kB 00:00 2024-01-31T04:58:42.536 INFO:teuthology.orchestra.run.smithi099.stdout:(10/155): ceph-radosgw-19.0.0-885.g661946e7.el9 3.8 MB/s | 8.7 MB 00:02 2024-01-31T04:58:42.653 INFO:teuthology.orchestra.run.smithi099.stdout:(11/155): cephfs-mirror-19.0.0-885.g661946e7.el 1.8 MB/s | 217 kB 00:00 2024-01-31T04:58:42.672 INFO:teuthology.orchestra.run.smithi181.stdout:(66/155): lua-5.4.4-4.el9.x86_64.rpm 238 kB/s | 188 kB 00:00 2024-01-31T04:58:42.697 INFO:teuthology.orchestra.run.smithi181.stdout:(67/155): lttng-ust-2.12.0-6.el9.x86_64.rpm 344 kB/s | 292 kB 00:00 2024-01-31T04:58:42.745 INFO:teuthology.orchestra.run.smithi099.stdout:(12/155): cephfs-shell-19.0.0-885.g661946e7.el9 295 kB/s | 27 kB 00:00 2024-01-31T04:58:42.853 INFO:teuthology.orchestra.run.smithi099.stdout:(13/155): libcephfs-devel-19.0.0-885.g661946e7. 288 kB/s | 31 kB 00:00 2024-01-31T04:58:43.114 INFO:teuthology.orchestra.run.smithi181.stdout:(68/155): openblas-0.3.21-2.el9.x86_64.rpm 54 kB/s | 35 kB 00:00 2024-01-31T04:58:43.171 INFO:teuthology.orchestra.run.smithi179.stdout:(4/155): ceph-base-19.0.0-885.g661946e7.el9.x86 1.9 MB/s | 5.1 MB 00:02 2024-01-31T04:58:43.338 INFO:teuthology.orchestra.run.smithi179.stdout:(5/155): ceph-mgr-19.0.0-885.g661946e7.el9.x86_ 8.9 MB/s | 1.5 MB 00:00 2024-01-31T04:58:43.354 INFO:teuthology.orchestra.run.smithi099.stdout:(14/155): ceph-test-19.0.0-885.g661946e7.el9.x8 16 MB/s | 46 MB 00:02 2024-01-31T04:58:43.387 INFO:teuthology.orchestra.run.smithi099.stdout:(15/155): libcephfs2-19.0.0-885.g661946e7.el9.x 1.4 MB/s | 743 kB 00:00 2024-01-31T04:58:43.388 INFO:teuthology.orchestra.run.smithi179.stdout:(6/155): ceph-mds-19.0.0-885.g661946e7.el9.x86_ 2.4 MB/s | 2.1 MB 00:00 2024-01-31T04:58:43.404 INFO:teuthology.orchestra.run.smithi099.stdout:(16/155): libcephsqlite-19.0.0-885.g661946e7.el 3.2 MB/s | 163 kB 00:00 2024-01-31T04:58:43.671 INFO:teuthology.orchestra.run.smithi099.stdout:(17/155): ceph-osd-19.0.0-885.g661946e7.el9.x86 4.8 MB/s | 17 MB 00:03 2024-01-31T04:58:43.697 INFO:teuthology.orchestra.run.smithi099.stdout:(18/155): librados-devel-19.0.0-885.g661946e7.e 410 kB/s | 127 kB 00:00 2024-01-31T04:58:43.705 INFO:teuthology.orchestra.run.smithi179.stdout:(7/155): ceph-mon-19.0.0-885.g661946e7.el9.x86_ 13 MB/s | 4.7 MB 00:00 2024-01-31T04:58:43.722 INFO:teuthology.orchestra.run.smithi099.stdout:(19/155): libradosstriper1-19.0.0-885.g661946e7 1.5 MB/s | 499 kB 00:00 2024-01-31T04:58:43.747 INFO:teuthology.orchestra.run.smithi099.stdout:(20/155): python3-ceph-argparse-19.0.0-885.g661 903 kB/s | 45 kB 00:00 2024-01-31T04:58:43.797 INFO:teuthology.orchestra.run.smithi099.stdout:(21/155): python3-ceph-common-19.0.0-885.g66194 1.7 MB/s | 130 kB 00:00 2024-01-31T04:58:43.873 INFO:teuthology.orchestra.run.smithi181.stdout:(69/155): openssl-devel-3.0.7-25.el9.x86_64.rpm 3.5 MB/s | 4.1 MB 00:01 2024-01-31T04:58:43.889 INFO:teuthology.orchestra.run.smithi099.stdout:(22/155): python3-rados-19.0.0-885.g661946e7.el 3.4 MB/s | 321 kB 00:00 2024-01-31T04:58:43.914 INFO:teuthology.orchestra.run.smithi099.stdout:(23/155): python3-cephfs-19.0.0-885.g661946e7.e 968 kB/s | 162 kB 00:00 2024-01-31T04:58:43.940 INFO:teuthology.orchestra.run.smithi181.stdout:(70/155): openblas-openmp-0.3.21-2.el9.x86_64.r 3.7 MB/s | 4.7 MB 00:01 2024-01-31T04:58:43.973 INFO:teuthology.orchestra.run.smithi099.stdout:(24/155): python3-rbd-19.0.0-885.g661946e7.el9. 3.5 MB/s | 298 kB 00:00 2024-01-31T04:58:44.015 INFO:teuthology.orchestra.run.smithi099.stdout:(25/155): python3-rgw-19.0.0-885.g661946e7.el9. 991 kB/s | 99 kB 00:00 2024-01-31T04:58:44.057 INFO:teuthology.orchestra.run.smithi099.stdout:(26/155): rbd-fuse-19.0.0-885.g661946e7.el9.x86 1.0 MB/s | 85 kB 00:00 2024-01-31T04:58:44.157 INFO:teuthology.orchestra.run.smithi099.stdout:(27/155): rbd-nbd-19.0.0-885.g661946e7.el9.x86_ 1.7 MB/s | 170 kB 00:00 2024-01-31T04:58:44.232 INFO:teuthology.orchestra.run.smithi181.stdout:(71/155): postgresql-13.11-1.el9.x86_64.rpm 1.4 MB/s | 1.6 MB 00:01 2024-01-31T04:58:44.233 INFO:teuthology.orchestra.run.smithi099.stdout:(28/155): ceph-grafana-dashboards-19.0.0-885.g6 378 kB/s | 28 kB 00:00 2024-01-31T04:58:44.333 INFO:teuthology.orchestra.run.smithi099.stdout:(29/155): ceph-mgr-cephadm-19.0.0-885.g661946e7 1.3 MB/s | 133 kB 00:00 2024-01-31T04:58:44.530 INFO:teuthology.orchestra.run.smithi179.stdout:(8/155): ceph-radosgw-19.0.0-885.g661946e7.el9. 11 MB/s | 8.7 MB 00:00 2024-01-31T04:58:44.575 INFO:teuthology.orchestra.run.smithi099.stdout:(30/155): librgw2-19.0.0-885.g661946e7.el9.x86_ 5.3 MB/s | 4.8 MB 00:00 2024-01-31T04:58:44.580 INFO:teuthology.orchestra.run.smithi179.stdout:(9/155): ceph-selinux-19.0.0-885.g661946e7.el9. 507 kB/s | 25 kB 00:00 2024-01-31T04:58:44.617 INFO:teuthology.orchestra.run.smithi099.stdout:(31/155): ceph-mgr-dashboard-19.0.0-885.g661946 6.1 MB/s | 1.7 MB 00:00 2024-01-31T04:58:44.692 INFO:teuthology.orchestra.run.smithi099.stdout:(32/155): ceph-mgr-modules-core-19.0.0-885.g661 3.2 MB/s | 245 kB 00:00 2024-01-31T04:58:44.715 INFO:teuthology.orchestra.run.smithi181.stdout:(72/155): postgresql-private-libs-13.11-1.el9.x 174 kB/s | 135 kB 00:00 2024-01-31T04:58:44.759 INFO:teuthology.orchestra.run.smithi099.stdout:(33/155): rbd-mirror-19.0.0-885.g661946e7.el9.x 4.2 MB/s | 3.1 MB 00:00 2024-01-31T04:58:44.776 INFO:teuthology.orchestra.run.smithi099.stdout:(34/155): ceph-mgr-rook-19.0.0-885.g661946e7.el 606 kB/s | 51 kB 00:00 2024-01-31T04:58:44.827 INFO:teuthology.orchestra.run.smithi099.stdout:(35/155): ceph-prometheus-alerts-19.0.0-885.g66 226 kB/s | 15 kB 00:00 2024-01-31T04:58:44.852 INFO:teuthology.orchestra.run.smithi099.stdout:(36/155): ceph-volume-19.0.0-885.g661946e7.el9. 3.4 MB/s | 262 kB 00:00 2024-01-31T04:58:44.890 INFO:teuthology.orchestra.run.smithi181.stdout:(73/155): postgresql-contrib-13.11-1.el9.x86_64 890 kB/s | 905 kB 00:01 2024-01-31T04:58:44.919 INFO:teuthology.orchestra.run.smithi099.stdout:(37/155): cephfs-top-19.0.0-885.g661946e7.el9.n 273 kB/s | 18 kB 00:00 2024-01-31T04:58:44.986 INFO:teuthology.orchestra.run.smithi099.stdout:(38/155): cephadm-19.0.0-885.g661946e7.el9.noar 4.6 MB/s | 742 kB 00:00 2024-01-31T04:58:45.019 INFO:teuthology.orchestra.run.smithi099.stdout:(39/155): libaio-devel-0.3.112-1.el8.x86_64.rpm 175 kB/s | 18 kB 00:00 2024-01-31T04:58:45.086 INFO:teuthology.orchestra.run.smithi099.stdout:(40/155): fuse-2.9.9-15.el9.x86_64.rpm 813 kB/s | 80 kB 00:00 2024-01-31T04:58:45.162 INFO:teuthology.orchestra.run.smithi099.stdout:(41/155): jq-1.6-16.el9.x86_64.rpm 1.3 MB/s | 187 kB 00:00 2024-01-31T04:58:45.220 INFO:teuthology.orchestra.run.smithi099.stdout:(42/155): libquadmath-11.4.1-3.el9.x86_64.rpm 3.3 MB/s | 195 kB 00:00 2024-01-31T04:58:45.262 INFO:teuthology.orchestra.run.smithi099.stdout:(43/155): libgfortran-11.4.1-3.el9.x86_64.rpm 4.5 MB/s | 803 kB 00:00 2024-01-31T04:58:45.288 INFO:teuthology.orchestra.run.smithi099.stdout:(44/155): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.2 MB/s | 218 kB 00:00 2024-01-31T04:58:45.338 INFO:teuthology.orchestra.run.smithi099.stdout:(45/155): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-01-31T04:58:45.380 INFO:teuthology.orchestra.run.smithi099.stdout:(46/155): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-01-31T04:58:45.422 INFO:teuthology.orchestra.run.smithi099.stdout:(47/155): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-01-31T04:58:45.464 INFO:teuthology.orchestra.run.smithi099.stdout:(48/155): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-01-31T04:58:45.474 INFO:teuthology.orchestra.run.smithi181.stdout:(74/155): postgresql-server-13.11-1.el9.x86_64. 4.6 MB/s | 5.7 MB 00:01 2024-01-31T04:58:45.491 INFO:teuthology.orchestra.run.smithi181.stdout:(75/155): python3-attrs-20.3.0-7.el9.noarch.rpm 113 kB/s | 87 kB 00:00 2024-01-31T04:58:45.522 INFO:teuthology.orchestra.run.smithi099.stdout:(49/155): python3-urllib3-1.26.5-5.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-01-31T04:58:45.539 INFO:teuthology.orchestra.run.smithi179.stdout:(10/155): ceph-osd-19.0.0-885.g661946e7.el9.x86 7.8 MB/s | 17 MB 00:02 2024-01-31T04:58:45.565 INFO:teuthology.orchestra.run.smithi099.stdout:(50/155): python3-cryptography-36.0.1-4.el9.x86 4.4 MB/s | 1.2 MB 00:00 2024-01-31T04:58:45.606 INFO:teuthology.orchestra.run.smithi179.stdout:(11/155): cephfs-mirror-19.0.0-885.g661946e7.el 3.2 MB/s | 217 kB 00:00 2024-01-31T04:58:45.665 INFO:teuthology.orchestra.run.smithi179.stdout:(12/155): cephfs-shell-19.0.0-885.g661946e7.el9 464 kB/s | 27 kB 00:00 2024-01-31T04:58:45.732 INFO:teuthology.orchestra.run.smithi179.stdout:(13/155): libcephfs-devel-19.0.0-885.g661946e7. 468 kB/s | 31 kB 00:00 2024-01-31T04:58:45.740 INFO:teuthology.orchestra.run.smithi099.stdout:(51/155): ceph-mgr-diskprediction-local-19.0.0- 6.3 MB/s | 7.4 MB 00:01 2024-01-31T04:58:45.832 INFO:teuthology.orchestra.run.smithi179.stdout:(14/155): libcephfs2-19.0.0-885.g661946e7.el9.x 7.3 MB/s | 743 kB 00:00 2024-01-31T04:58:45.899 INFO:teuthology.orchestra.run.smithi179.stdout:(15/155): libcephsqlite-19.0.0-885.g661946e7.el 2.4 MB/s | 163 kB 00:00 2024-01-31T04:58:45.966 INFO:teuthology.orchestra.run.smithi179.stdout:(16/155): librados-devel-19.0.0-885.g661946e7.e 1.9 MB/s | 127 kB 00:00 2024-01-31T04:58:46.049 INFO:teuthology.orchestra.run.smithi179.stdout:(17/155): libradosstriper1-19.0.0-885.g661946e7 5.9 MB/s | 499 kB 00:00 2024-01-31T04:58:46.165 INFO:teuthology.orchestra.run.smithi099.stdout:(52/155): boost-program-options-1.75.0-8.el9.x8 252 kB/s | 107 kB 00:00 2024-01-31T04:58:46.190 INFO:teuthology.orchestra.run.smithi099.stdout:(53/155): automake-1.16.2-8.el9.noarch.rpm 1.0 MB/s | 689 kB 00:00 2024-01-31T04:58:46.191 INFO:teuthology.orchestra.run.smithi181.stdout:(76/155): python3-babel-2.9.1-2.el9.noarch.rpm 4.6 MB/s | 6.0 MB 00:01 2024-01-31T04:58:46.265 INFO:teuthology.orchestra.run.smithi099.stdout:(54/155): elfutils-libelf-devel-0.190-2.el9.x86 214 kB/s | 21 kB 00:00 2024-01-31T04:58:46.299 INFO:teuthology.orchestra.run.smithi099.stdout:(55/155): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-01-31T04:58:46.308 INFO:teuthology.orchestra.run.smithi181.stdout:(77/155): python3-devel-3.9.17-2.el9.x86_64.rpm 294 kB/s | 245 kB 00:00 2024-01-31T04:58:46.334 INFO:teuthology.orchestra.run.smithi181.stdout:(78/155): python3-jinja2-2.11.3-4.el9.noarch.rp 296 kB/s | 249 kB 00:00 2024-01-31T04:58:46.366 INFO:teuthology.orchestra.run.smithi099.stdout:(56/155): flexiblas-3.0.4-8.el9.x86_64.rpm 326 kB/s | 33 kB 00:00 2024-01-31T04:58:46.408 INFO:teuthology.orchestra.run.smithi179.stdout:(18/155): librgw2-19.0.0-885.g661946e7.el9.x86_ 13 MB/s | 4.8 MB 00:00 2024-01-31T04:58:46.416 INFO:teuthology.orchestra.run.smithi099.stdout:(57/155): bison-3.7.4-5.el9.x86_64.rpm 1.1 MB/s | 943 kB 00:00 2024-01-31T04:58:46.466 INFO:teuthology.orchestra.run.smithi099.stdout:(58/155): flexiblas-openblas-openmp-3.0.4-8.el9 181 kB/s | 18 kB 00:00 2024-01-31T04:58:46.476 INFO:teuthology.orchestra.run.smithi179.stdout:(19/155): python3-ceph-argparse-19.0.0-885.g661 679 kB/s | 45 kB 00:00 2024-01-31T04:58:46.525 INFO:teuthology.orchestra.run.smithi099.stdout:(59/155): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-01-31T04:58:46.550 INFO:teuthology.orchestra.run.smithi179.stdout:(20/155): python3-ceph-common-19.0.0-885.g66194 1.7 MB/s | 130 kB 00:00 2024-01-31T04:58:46.567 INFO:teuthology.orchestra.run.smithi099.stdout:(60/155): librabbitmq-0.11.0-7.el9.x86_64.rpm 451 kB/s | 45 kB 00:00 2024-01-31T04:58:46.626 INFO:teuthology.orchestra.run.smithi179.stdout:(21/155): python3-cephfs-19.0.0-885.g661946e7.e 2.1 MB/s | 162 kB 00:00 2024-01-31T04:58:46.634 INFO:teuthology.orchestra.run.smithi099.stdout:(61/155): librdkafka-1.6.1-102.el9.x86_64.rpm 6.0 MB/s | 662 kB 00:00 2024-01-31T04:58:46.718 INFO:teuthology.orchestra.run.smithi179.stdout:(22/155): python3-rados-19.0.0-885.g661946e7.el 3.4 MB/s | 321 kB 00:00 2024-01-31T04:58:46.734 INFO:teuthology.orchestra.run.smithi099.stdout:(62/155): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.9 MB/s | 3.0 MB 00:00 2024-01-31T04:58:46.760 INFO:teuthology.orchestra.run.smithi099.stdout:(63/155): libuuid-devel-2.37.4-15.el9.x86_64.rp 203 kB/s | 26 kB 00:00 2024-01-31T04:58:46.775 INFO:teuthology.orchestra.run.smithi181.stdout:(79/155): python3-jsonpatch-1.21-16.el9.noarch. 44 kB/s | 26 kB 00:00 2024-01-31T04:58:46.801 INFO:teuthology.orchestra.run.smithi179.stdout:(23/155): python3-rbd-19.0.0-885.g661946e7.el9. 3.5 MB/s | 298 kB 00:00 2024-01-31T04:58:46.842 INFO:teuthology.orchestra.run.smithi181.stdout:(80/155): python3-jsonpointer-2.0-4.el9.noarch. 36 kB/s | 19 kB 00:00 2024-01-31T04:58:46.852 INFO:teuthology.orchestra.run.smithi099.stdout:(64/155): libtool-2.4.6-45.el9.x86_64.rpm 2.0 MB/s | 582 kB 00:00 2024-01-31T04:58:46.877 INFO:teuthology.orchestra.run.smithi179.stdout:(24/155): python3-rgw-19.0.0-885.g661946e7.el9. 1.3 MB/s | 99 kB 00:00 2024-01-31T04:58:46.877 INFO:teuthology.orchestra.run.smithi099.stdout:(65/155): libzstd-devel-1.5.1-2.el9.x86_64.rpm 334 kB/s | 47 kB 00:00 2024-01-31T04:58:46.902 INFO:teuthology.orchestra.run.smithi099.stdout:(66/155): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.0 MB/s | 292 kB 00:00 2024-01-31T04:58:46.952 INFO:teuthology.orchestra.run.smithi179.stdout:(25/155): rbd-fuse-19.0.0-885.g661946e7.el9.x86 1.1 MB/s | 85 kB 00:00 2024-01-31T04:58:46.961 INFO:teuthology.orchestra.run.smithi099.stdout:(67/155): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-01-31T04:58:46.977 INFO:teuthology.orchestra.run.smithi099.stdout:(68/155): openblas-0.3.21-2.el9.x86_64.rpm 350 kB/s | 35 kB 00:00 2024-01-31T04:58:47.167 INFO:teuthology.orchestra.run.smithi181.stdout:(81/155): python3-mako-1.1.4-6.el9.noarch.rpm 207 kB/s | 172 kB 00:00 2024-01-31T04:58:47.210 INFO:teuthology.orchestra.run.smithi179.stdout:(26/155): rbd-mirror-19.0.0-885.g661946e7.el9.x 12 MB/s | 3.1 MB 00:00 2024-01-31T04:58:47.219 INFO:teuthology.orchestra.run.smithi099.stdout:(69/155): openblas-openmp-0.3.21-2.el9.x86_64.r 15 MB/s | 4.7 MB 00:00 2024-01-31T04:58:47.277 INFO:teuthology.orchestra.run.smithi179.stdout:(27/155): rbd-nbd-19.0.0-885.g661946e7.el9.x86_ 2.5 MB/s | 170 kB 00:00 2024-01-31T04:58:47.361 INFO:teuthology.orchestra.run.smithi179.stdout:(28/155): ceph-grafana-dashboards-19.0.0-885.g6 341 kB/s | 28 kB 00:00 2024-01-31T04:58:47.370 INFO:teuthology.orchestra.run.smithi099.stdout:(70/155): postgresql-contrib-13.11-1.el9.x86_64 5.9 MB/s | 905 kB 00:00 2024-01-31T04:58:47.418 INFO:teuthology.orchestra.run.smithi181.stdout:(82/155): python3-markupsafe-1.1.1-12.el9.x86_6 54 kB/s | 35 kB 00:00 2024-01-31T04:58:47.437 INFO:teuthology.orchestra.run.smithi099.stdout:(71/155): openssl-devel-3.0.7-25.el9.x86_64.rpm 8.7 MB/s | 4.1 MB 00:00 2024-01-31T04:58:47.444 INFO:teuthology.orchestra.run.smithi179.stdout:(29/155): ceph-mgr-cephadm-19.0.0-885.g661946e7 1.6 MB/s | 133 kB 00:00 2024-01-31T04:58:47.479 INFO:teuthology.orchestra.run.smithi099.stdout:(72/155): postgresql-private-libs-13.11-1.el9.x 1.2 MB/s | 135 kB 00:00 2024-01-31T04:58:47.562 INFO:teuthology.orchestra.run.smithi099.stdout:(73/155): postgresql-13.11-1.el9.x86_64.rpm 2.7 MB/s | 1.6 MB 00:00 2024-01-31T04:58:47.588 INFO:teuthology.orchestra.run.smithi099.stdout:(74/155): python3-attrs-20.3.0-7.el9.noarch.rpm 806 kB/s | 87 kB 00:00 2024-01-31T04:58:47.620 INFO:teuthology.orchestra.run.smithi179.stdout:(30/155): ceph-mgr-dashboard-19.0.0-885.g661946 9.9 MB/s | 1.7 MB 00:00 2024-01-31T04:58:47.696 INFO:teuthology.orchestra.run.smithi099.stdout:(75/155): python3-devel-3.9.17-2.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-01-31T04:58:47.822 INFO:teuthology.orchestra.run.smithi099.stdout:(76/155): python3-jinja2-2.11.3-4.el9.noarch.rp 2.0 MB/s | 249 kB 00:00 2024-01-31T04:58:47.980 INFO:teuthology.orchestra.run.smithi099.stdout:(77/155): postgresql-server-13.11-1.el9.x86_64. 11 MB/s | 5.7 MB 00:00 2024-01-31T04:58:47.997 INFO:teuthology.orchestra.run.smithi099.stdout:(78/155): python3-jsonpatch-1.21-16.el9.noarch. 146 kB/s | 26 kB 00:00 2024-01-31T04:58:48.084 INFO:teuthology.orchestra.run.smithi181.stdout:(83/155): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.1 MB/s | 5.1 MB 00:01 2024-01-31T04:58:48.089 INFO:teuthology.orchestra.run.smithi099.stdout:(79/155): python3-jsonpointer-2.0-4.el9.noarch. 177 kB/s | 19 kB 00:00 2024-01-31T04:58:48.110 INFO:teuthology.orchestra.run.smithi181.stdout:(84/155): python3-numpy-f2py-1.20.1-5.el9.x86_6 266 kB/s | 250 kB 00:00 2024-01-31T04:58:48.114 INFO:teuthology.orchestra.run.smithi099.stdout:(80/155): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-01-31T04:58:48.128 INFO:teuthology.orchestra.run.smithi179.stdout:(31/155): ceph-mgr-diskprediction-local-19.0.0- 15 MB/s | 7.4 MB 00:00 2024-01-31T04:58:48.181 INFO:teuthology.orchestra.run.smithi099.stdout:(81/155): python3-markupsafe-1.1.1-12.el9.x86_6 378 kB/s | 35 kB 00:00 2024-01-31T04:58:48.237 INFO:teuthology.orchestra.run.smithi179.stdout:(32/155): ceph-mgr-modules-core-19.0.0-885.g661 2.2 MB/s | 245 kB 00:00 2024-01-31T04:58:48.290 INFO:teuthology.orchestra.run.smithi099.stdout:(82/155): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-01-31T04:58:48.293 INFO:teuthology.orchestra.run.smithi181.stdout:(85/155): python3-oauthlib-3.1.1-5.el9.noarch.r 262 kB/s | 222 kB 00:00 2024-01-31T04:58:48.296 INFO:teuthology.orchestra.run.smithi179.stdout:(33/155): ceph-mgr-rook-19.0.0-885.g661946e7.el 871 kB/s | 51 kB 00:00 2024-01-31T04:58:48.354 INFO:teuthology.orchestra.run.smithi179.stdout:(34/155): ceph-prometheus-alerts-19.0.0-885.g66 260 kB/s | 15 kB 00:00 2024-01-31T04:58:48.382 INFO:teuthology.orchestra.run.smithi099.stdout:(83/155): python3-numpy-1.20.1-5.el9.x86_64.rpm 19 MB/s | 5.1 MB 00:00 2024-01-31T04:58:48.407 INFO:teuthology.orchestra.run.smithi099.stdout:(84/155): python3-oauthlib-3.1.1-5.el9.noarch.r 1.9 MB/s | 222 kB 00:00 2024-01-31T04:58:48.438 INFO:teuthology.orchestra.run.smithi179.stdout:(35/155): ceph-volume-19.0.0-885.g661946e7.el9. 3.1 MB/s | 262 kB 00:00 2024-01-31T04:58:48.491 INFO:teuthology.orchestra.run.smithi099.stdout:(85/155): python3-prettytable-0.7.2-27.el9.noar 389 kB/s | 42 kB 00:00 2024-01-31T04:58:48.516 INFO:teuthology.orchestra.run.smithi099.stdout:(86/155): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-01-31T04:58:48.547 INFO:teuthology.orchestra.run.smithi179.stdout:(36/155): cephadm-19.0.0-885.g661946e7.el9.noar 6.7 MB/s | 742 kB 00:00 2024-01-31T04:58:48.600 INFO:teuthology.orchestra.run.smithi099.stdout:(87/155): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 279 kB 00:00 2024-01-31T04:58:48.613 INFO:teuthology.orchestra.run.smithi179.stdout:(37/155): cephfs-top-19.0.0-885.g661946e7.el9.n 274 kB/s | 18 kB 00:00 2024-01-31T04:58:48.625 INFO:teuthology.orchestra.run.smithi099.stdout:(88/155): python3-pytz-2021.1-5.el9.noarch.rpm 469 kB/s | 51 kB 00:00 2024-01-31T04:58:48.698 INFO:teuthology.orchestra.run.smithi179.stdout:(38/155): libaio-devel-0.3.112-1.el8.x86_64.rpm 211 kB/s | 18 kB 00:00 2024-01-31T04:58:48.700 INFO:teuthology.orchestra.run.smithi099.stdout:(89/155): python3-requests-oauthlib-1.3.0-12.el 535 kB/s | 54 kB 00:00 2024-01-31T04:58:48.736 INFO:teuthology.orchestra.run.smithi181.stdout:(86/155): python3-prettytable-0.7.2-27.el9.noar 65 kB/s | 42 kB 00:00 2024-01-31T04:58:48.801 INFO:teuthology.orchestra.run.smithi099.stdout:(90/155): python3-toml-0.10.2-6.el9.noarch.rpm 416 kB/s | 42 kB 00:00 2024-01-31T04:58:48.886 INFO:teuthology.orchestra.run.smithi181.stdout:(87/155): python3-pyasn1-0.4.8-6.el9.noarch.rpm 205 kB/s | 159 kB 00:00 2024-01-31T04:58:48.909 INFO:teuthology.orchestra.run.smithi099.stdout:(91/155): python3-wcwidth-0.2.5-8.el9.noarch.rp 408 kB/s | 44 kB 00:00 2024-01-31T04:58:49.026 INFO:teuthology.orchestra.run.smithi099.stdout:(92/155): socat-1.7.4.1-5.el9.x86_64.rpm 2.6 MB/s | 305 kB 00:00 2024-01-31T04:58:49.135 INFO:teuthology.orchestra.run.smithi099.stdout:(93/155): uuid-1.6.2-55.el9.x86_64.rpm 534 kB/s | 58 kB 00:00 2024-01-31T04:58:49.181 INFO:teuthology.orchestra.run.smithi179.stdout:(39/155): ceph-test-19.0.0-885.g661946e7.el9.x8 10 MB/s | 46 MB 00:04 2024-01-31T04:58:49.235 INFO:teuthology.orchestra.run.smithi099.stdout:(94/155): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 937 kB/s | 94 kB 00:00 2024-01-31T04:58:49.236 INFO:teuthology.orchestra.run.smithi181.stdout:(88/155): python3-pyasn1-modules-0.4.8-6.el9.no 296 kB/s | 279 kB 00:00 2024-01-31T04:58:49.344 INFO:teuthology.orchestra.run.smithi099.stdout:(95/155): xmlstarlet-1.6.1-20.el9.x86_64.rpm 588 kB/s | 64 kB 00:00 2024-01-31T04:58:49.390 INFO:teuthology.orchestra.run.smithi179.stdout:(40/155): ceph-common-19.0.0-885.g661946e7.el9. 2.2 MB/s | 19 MB 00:08 2024-01-31T04:58:49.428 INFO:teuthology.orchestra.run.smithi181.stdout:(89/155): python3-pytz-2021.1-5.el9.noarch.rpm 74 kB/s | 51 kB 00:00 2024-01-31T04:58:49.452 INFO:teuthology.orchestra.run.smithi099.stdout:(96/155): zlib-devel-1.2.11-40.el9.x86_64.rpm 417 kB/s | 45 kB 00:00 2024-01-31T04:58:49.523 INFO:teuthology.orchestra.run.smithi179.stdout:(41/155): fuse-2.9.9-15.el9.x86_64.rpm 97 kB/s | 80 kB 00:00 2024-01-31T04:58:49.561 INFO:teuthology.orchestra.run.smithi181.stdout:(90/155): python3-requests-oauthlib-1.3.0-12.el 79 kB/s | 54 kB 00:00 2024-01-31T04:58:49.575 INFO:teuthology.orchestra.run.smithi179.stdout:(42/155): jq-1.6-16.el9.x86_64.rpm 478 kB/s | 187 kB 00:00 2024-01-31T04:58:49.632 INFO:teuthology.orchestra.run.smithi179.stdout:(43/155): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.7 MB/s | 218 kB 00:00 2024-01-31T04:58:49.661 INFO:teuthology.orchestra.run.smithi099.stdout:(97/155): lua-devel-5.4.4-4.el9.x86_64.rpm 107 kB/s | 22 kB 00:00 2024-01-31T04:58:49.682 INFO:teuthology.orchestra.run.smithi179.stdout:(44/155): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.9 MB/s | 253 kB 00:00 2024-01-31T04:58:49.774 INFO:teuthology.orchestra.run.smithi179.stdout:(45/155): python3-cryptography-36.0.1-4.el9.x86 13 MB/s | 1.2 MB 00:00 2024-01-31T04:58:49.808 INFO:teuthology.orchestra.run.smithi179.stdout:(46/155): python3-ply-3.11-14.el9.noarch.rpm 3.1 MB/s | 106 kB 00:00 2024-01-31T04:58:49.850 INFO:teuthology.orchestra.run.smithi179.stdout:(47/155): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-01-31T04:58:49.892 INFO:teuthology.orchestra.run.smithi179.stdout:(48/155): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-01-31T04:58:49.942 INFO:teuthology.orchestra.run.smithi179.stdout:(49/155): python3-urllib3-1.26.5-5.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-01-31T04:58:49.953 INFO:teuthology.orchestra.run.smithi099.stdout:(98/155): python3-scipy-1.6.2-8.el9.x86_64.rpm 12 MB/s | 16 MB 00:01 2024-01-31T04:58:50.045 INFO:teuthology.orchestra.run.smithi181.stdout:(91/155): python3-toml-0.10.2-6.el9.noarch.rpm 67 kB/s | 42 kB 00:00 2024-01-31T04:58:50.092 INFO:teuthology.orchestra.run.smithi179.stdout:(50/155): automake-1.16.2-8.el9.noarch.rpm 4.5 MB/s | 689 kB 00:00 2024-01-31T04:58:50.112 INFO:teuthology.orchestra.run.smithi099.stdout:(99/155): gperftools-libs-2.9.1-2.el9.x86_64.rp 686 kB/s | 309 kB 00:00 2024-01-31T04:58:50.117 INFO:teuthology.orchestra.run.smithi179.stdout:(51/155): libquadmath-11.4.1-3.el9.x86_64.rpm 329 kB/s | 195 kB 00:00 2024-01-31T04:58:50.168 INFO:teuthology.orchestra.run.smithi179.stdout:(52/155): bison-3.7.4-5.el9.x86_64.rpm 12 MB/s | 943 kB 00:00 2024-01-31T04:58:50.179 INFO:teuthology.orchestra.run.smithi099.stdout:(100/155): libarrow-doc-9.0.0-10.el9.noarch.rpm 390 kB/s | 26 kB 00:00 2024-01-31T04:58:50.195 INFO:teuthology.orchestra.run.smithi181.stdout:(92/155): python3-wcwidth-0.2.5-8.el9.noarch.rp 70 kB/s | 44 kB 00:00 2024-01-31T04:58:50.218 INFO:teuthology.orchestra.run.smithi179.stdout:(53/155): libgfortran-11.4.1-3.el9.x86_64.rpm 1.0 MB/s | 803 kB 00:00 2024-01-31T04:58:50.244 INFO:teuthology.orchestra.run.smithi179.stdout:(54/155): elfutils-libelf-devel-0.190-2.el9.x86 285 kB/s | 21 kB 00:00 2024-01-31T04:58:50.245 INFO:teuthology.orchestra.run.smithi099.stdout:(101/155): liboath-2.6.7-2.el9.x86_64.rpm 728 kB/s | 49 kB 00:00 2024-01-31T04:58:50.269 INFO:teuthology.orchestra.run.smithi179.stdout:(55/155): boost-program-options-1.75.0-8.el9.x8 709 kB/s | 107 kB 00:00 2024-01-31T04:58:50.294 INFO:teuthology.orchestra.run.smithi179.stdout:(56/155): flexiblas-3.0.4-8.el9.x86_64.rpm 652 kB/s | 33 kB 00:00 2024-01-31T04:58:50.321 INFO:teuthology.orchestra.run.smithi099.stdout:(102/155): libunwind-1.6.2-1.el9.x86_64.rpm 900 kB/s | 67 kB 00:00 2024-01-31T04:58:50.336 INFO:teuthology.orchestra.run.smithi179.stdout:(57/155): flexiblas-openblas-openmp-3.0.4-8.el9 440 kB/s | 18 kB 00:00 2024-01-31T04:58:50.378 INFO:teuthology.orchestra.run.smithi179.stdout:(58/155): flex-2.6.4-9.el9.x86_64.rpm 1.9 MB/s | 313 kB 00:00 2024-01-31T04:58:50.396 INFO:teuthology.orchestra.run.smithi099.stdout:(103/155): luarocks-3.9.2-1.el9.noarch.rpm 2.0 MB/s | 151 kB 00:00 2024-01-31T04:58:50.411 INFO:teuthology.orchestra.run.smithi179.stdout:(59/155): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-01-31T04:58:50.445 INFO:teuthology.orchestra.run.smithi179.stdout:(60/155): librabbitmq-0.11.0-7.el9.x86_64.rpm 678 kB/s | 45 kB 00:00 2024-01-31T04:58:50.504 INFO:teuthology.orchestra.run.smithi179.stdout:(61/155): librdkafka-1.6.1-102.el9.x86_64.rpm 7.0 MB/s | 662 kB 00:00 2024-01-31T04:58:50.538 INFO:teuthology.orchestra.run.smithi179.stdout:(62/155): libtool-2.4.6-45.el9.x86_64.rpm 6.2 MB/s | 582 kB 00:00 2024-01-31T04:58:50.563 INFO:teuthology.orchestra.run.smithi179.stdout:(63/155): libuuid-devel-2.37.4-15.el9.x86_64.rp 437 kB/s | 26 kB 00:00 2024-01-31T04:58:50.572 INFO:teuthology.orchestra.run.smithi099.stdout:(104/155): libarrow-9.0.0-10.el9.x86_64.rpm 7.2 MB/s | 4.4 MB 00:00 2024-01-31T04:58:50.621 INFO:teuthology.orchestra.run.smithi179.stdout:(64/155): flexiblas-netlib-3.0.4-8.el9.x86_64.r 8.5 MB/s | 3.0 MB 00:00 2024-01-31T04:58:50.622 INFO:teuthology.orchestra.run.smithi099.stdout:(105/155): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.6 MB/s | 838 kB 00:00 2024-01-31T04:58:50.647 INFO:teuthology.orchestra.run.smithi179.stdout:(65/155): libzstd-devel-1.5.1-2.el9.x86_64.rpm 436 kB/s | 47 kB 00:00 2024-01-31T04:58:50.647 INFO:teuthology.orchestra.run.smithi099.stdout:(106/155): python3-asyncssh-2.13.2-3.el9.noarch 7.1 MB/s | 548 kB 00:00 2024-01-31T04:58:50.672 INFO:teuthology.orchestra.run.smithi179.stdout:(66/155): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-01-31T04:58:50.689 INFO:teuthology.orchestra.run.smithi179.stdout:(67/155): openblas-0.3.21-2.el9.x86_64.rpm 844 kB/s | 35 kB 00:00 2024-01-31T04:58:50.689 INFO:teuthology.orchestra.run.smithi099.stdout:(107/155): python3-bcrypt-3.2.2-1.el9.x86_64.rp 648 kB/s | 43 kB 00:00 2024-01-31T04:58:50.714 INFO:teuthology.orchestra.run.smithi099.stdout:(108/155): python3-cachetools-4.2.4-1.el9.noarc 481 kB/s | 32 kB 00:00 2024-01-31T04:58:50.714 INFO:teuthology.orchestra.run.smithi179.stdout:(68/155): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.9 MB/s | 292 kB 00:00 2024-01-31T04:58:50.756 INFO:teuthology.orchestra.run.smithi099.stdout:(109/155): python3-certifi-2021.10.8-2.el9.noar 224 kB/s | 15 kB 00:00 2024-01-31T04:58:50.790 INFO:teuthology.orchestra.run.smithi179.stdout:(69/155): postgresql-13.11-1.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-01-31T04:58:50.790 INFO:teuthology.orchestra.run.smithi099.stdout:(110/155): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-01-31T04:58:50.832 INFO:teuthology.orchestra.run.smithi099.stdout:(111/155): python3-cherrypy-18.6.1-2.el9.noarch 4.6 MB/s | 358 kB 00:00 2024-01-31T04:58:50.848 INFO:teuthology.orchestra.run.smithi179.stdout:(70/155): openssl-devel-3.0.7-25.el9.x86_64.rpm 26 MB/s | 4.1 MB 00:00 2024-01-31T04:58:50.865 INFO:teuthology.orchestra.run.smithi099.stdout:(112/155): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-01-31T04:58:50.879 INFO:teuthology.orchestra.run.smithi181.stdout:(93/155): python3-scipy-1.6.2-8.el9.x86_64.rpm 9.9 MB/s | 16 MB 00:01 2024-01-31T04:58:50.899 INFO:teuthology.orchestra.run.smithi099.stdout:(113/155): python3-colorama-0.4.4-12.el9.noarch 528 kB/s | 35 kB 00:00 2024-01-31T04:58:50.912 INFO:teuthology.orchestra.run.smithi181.stdout:(94/155): uuid-1.6.2-55.el9.x86_64.rpm 81 kB/s | 58 kB 00:00 2024-01-31T04:58:50.915 INFO:teuthology.orchestra.run.smithi179.stdout:(71/155): openblas-openmp-0.3.21-2.el9.x86_64.r 20 MB/s | 4.7 MB 00:00 2024-01-31T04:58:50.937 INFO:teuthology.orchestra.run.smithi181.stdout:(95/155): socat-1.7.4.1-5.el9.x86_64.rpm 342 kB/s | 305 kB 00:00 2024-01-31T04:58:50.940 INFO:teuthology.orchestra.run.smithi179.stdout:(72/155): postgresql-private-libs-13.11-1.el9.x 1.4 MB/s | 135 kB 00:00 2024-01-31T04:58:50.941 INFO:teuthology.orchestra.run.smithi099.stdout:(114/155): python3-google-auth-2.26.2-1.el9.noa 2.6 MB/s | 202 kB 00:00 2024-01-31T04:58:50.966 INFO:teuthology.orchestra.run.smithi099.stdout:(115/155): python3-jaraco-8.2.1-3.el9.noarch.rp 160 kB/s | 11 kB 00:00 2024-01-31T04:58:50.982 INFO:teuthology.orchestra.run.smithi179.stdout:(73/155): postgresql-contrib-13.11-1.el9.x86_64 4.6 MB/s | 905 kB 00:00 2024-01-31T04:58:51.008 INFO:teuthology.orchestra.run.smithi179.stdout:(74/155): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-01-31T04:58:51.008 INFO:teuthology.orchestra.run.smithi099.stdout:(116/155): python3-jaraco-classes-3.2.1-5.el9.n 265 kB/s | 18 kB 00:00 2024-01-31T04:58:51.034 INFO:teuthology.orchestra.run.smithi099.stdout:(117/155): python3-jaraco-collections-3.0.0-8.e 347 kB/s | 23 kB 00:00 2024-01-31T04:58:51.058 INFO:teuthology.orchestra.run.smithi179.stdout:(75/155): python3-devel-3.9.17-2.el9.x86_64.rpm 4.8 MB/s | 245 kB 00:00 2024-01-31T04:58:51.075 INFO:teuthology.orchestra.run.smithi099.stdout:(118/155): python3-jaraco-functools-3.5.0-2.el9 289 kB/s | 19 kB 00:00 2024-01-31T04:58:51.101 INFO:teuthology.orchestra.run.smithi099.stdout:(119/155): python3-jaraco-text-3.2.0-6.el9.noar 293 kB/s | 20 kB 00:00 2024-01-31T04:58:51.150 INFO:teuthology.orchestra.run.smithi179.stdout:(76/155): postgresql-server-13.11-1.el9.x86_64. 25 MB/s | 5.7 MB 00:00 2024-01-31T04:58:51.159 INFO:teuthology.orchestra.run.smithi099.stdout:(120/155): python3-kubernetes-26.1.0-2.el9.noar 12 MB/s | 1.0 MB 00:00 2024-01-31T04:58:51.175 INFO:teuthology.orchestra.run.smithi179.stdout:(77/155): python3-jinja2-2.11.3-4.el9.noarch.rp 2.1 MB/s | 249 kB 00:00 2024-01-31T04:58:51.184 INFO:teuthology.orchestra.run.smithi099.stdout:(121/155): python3-logutils-0.3.5-21.el9.noarch 555 kB/s | 46 kB 00:00 2024-01-31T04:58:51.201 INFO:teuthology.orchestra.run.smithi179.stdout:(78/155): python3-jsonpatch-1.21-16.el9.noarch. 512 kB/s | 26 kB 00:00 2024-01-31T04:58:51.226 INFO:teuthology.orchestra.run.smithi179.stdout:(79/155): python3-jsonpointer-2.0-4.el9.noarch. 383 kB/s | 19 kB 00:00 2024-01-31T04:58:51.227 INFO:teuthology.orchestra.run.smithi099.stdout:(122/155): python3-more-itertools-8.12.0-2.el9. 1.1 MB/s | 79 kB 00:00 2024-01-31T04:58:51.251 INFO:teuthology.orchestra.run.smithi179.stdout:(80/155): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-01-31T04:58:51.252 INFO:teuthology.orchestra.run.smithi099.stdout:(123/155): python3-natsort-7.1.1-5.el9.noarch.r 861 kB/s | 58 kB 00:00 2024-01-31T04:58:51.277 INFO:teuthology.orchestra.run.smithi179.stdout:(81/155): python3-markupsafe-1.1.1-12.el9.x86_6 691 kB/s | 35 kB 00:00 2024-01-31T04:58:51.352 INFO:teuthology.orchestra.run.smithi099.stdout:(124/155): python3-babel-2.9.1-2.el9.noarch.rpm 1.6 MB/s | 6.0 MB 00:03 2024-01-31T04:58:51.368 INFO:teuthology.orchestra.run.smithi179.stdout:(82/155): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-01-31T04:58:51.377 INFO:teuthology.orchestra.run.smithi099.stdout:(125/155): python3-portend-3.1.0-2.el9.noarch.r 131 kB/s | 16 kB 00:00 2024-01-31T04:58:51.396 INFO:teuthology.orchestra.run.smithi179.stdout:(83/155): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-01-31T04:58:51.403 INFO:teuthology.orchestra.run.smithi099.stdout:(126/155): python3-pecan-1.4.2-3.el9.noarch.rpm 1.5 MB/s | 272 kB 00:00 2024-01-31T04:58:51.428 INFO:teuthology.orchestra.run.smithi179.stdout:(84/155): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-01-31T04:58:51.445 INFO:teuthology.orchestra.run.smithi099.stdout:(127/155): python3-pyperclip-1.8.2-2.el9.noarch 421 kB/s | 28 kB 00:00 2024-01-31T04:58:51.453 INFO:teuthology.orchestra.run.smithi179.stdout:(85/155): python3-prettytable-0.7.2-27.el9.noar 722 kB/s | 42 kB 00:00 2024-01-31T04:58:51.470 INFO:teuthology.orchestra.run.smithi099.stdout:(128/155): python3-repoze-lru-0.7-16.el9.noarch 460 kB/s | 31 kB 00:00 2024-01-31T04:58:51.478 INFO:teuthology.orchestra.run.smithi179.stdout:(86/155): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-01-31T04:58:51.503 INFO:teuthology.orchestra.run.smithi179.stdout:(87/155): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-01-31T04:58:51.520 INFO:teuthology.orchestra.run.smithi099.stdout:(129/155): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-01-31T04:58:51.528 INFO:teuthology.orchestra.run.smithi179.stdout:(88/155): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-01-31T04:58:51.546 INFO:teuthology.orchestra.run.smithi099.stdout:(130/155): python3-rsa-4.9-2.el9.noarch.rpm 786 kB/s | 59 kB 00:00 2024-01-31T04:58:51.554 INFO:teuthology.orchestra.run.smithi179.stdout:(89/155): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-01-31T04:58:51.579 INFO:teuthology.orchestra.run.smithi099.stdout:(131/155): python3-tempora-5.0.0-2.el9.noarch.r 612 kB/s | 36 kB 00:00 2024-01-31T04:58:51.596 INFO:teuthology.orchestra.run.smithi181.stdout:(96/155): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 131 kB/s | 94 kB 00:00 2024-01-31T04:58:51.613 INFO:teuthology.orchestra.run.smithi099.stdout:(132/155): python3-pyOpenSSL-21.0.0-1.el9.noarc 346 kB/s | 90 kB 00:00 2024-01-31T04:58:51.613 INFO:teuthology.orchestra.run.smithi181.stdout:(97/155): xmlstarlet-1.6.1-20.el9.x86_64.rpm 91 kB/s | 64 kB 00:00 2024-01-31T04:58:51.630 INFO:teuthology.orchestra.run.smithi099.stdout:(133/155): python3-typing-extensions-4.4.0-2.el 608 kB/s | 51 kB 00:00 2024-01-31T04:58:51.630 INFO:teuthology.orchestra.run.smithi181.stdout:(98/155): zlib-devel-1.2.11-40.el9.x86_64.rpm 65 kB/s | 45 kB 00:00 2024-01-31T04:58:51.646 INFO:teuthology.orchestra.run.smithi179.stdout:(90/155): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 5.1 MB 00:00 2024-01-31T04:58:51.655 INFO:teuthology.orchestra.run.smithi099.stdout:(134/155): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-01-31T04:58:51.671 INFO:teuthology.orchestra.run.smithi179.stdout:(91/155): python3-toml-0.10.2-6.el9.noarch.rpm 357 kB/s | 42 kB 00:00 2024-01-31T04:58:51.696 INFO:teuthology.orchestra.run.smithi179.stdout:(92/155): python3-wcwidth-0.2.5-8.el9.noarch.rp 885 kB/s | 44 kB 00:00 2024-01-31T04:58:51.706 INFO:teuthology.orchestra.run.smithi099.stdout:(135/155): python3-werkzeug-2.0.3-3.el9.1.noarc 5.6 MB/s | 427 kB 00:00 2024-01-31T04:58:51.722 INFO:teuthology.orchestra.run.smithi179.stdout:(93/155): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 305 kB 00:00 2024-01-31T04:58:51.730 INFO:teuthology.orchestra.run.smithi099.stdout:(136/155): python3-websocket-client-1.2.3-2.el9 764 kB/s | 90 kB 00:00 2024-01-31T04:58:51.747 INFO:teuthology.orchestra.run.smithi179.stdout:(94/155): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-01-31T04:58:51.756 INFO:teuthology.orchestra.run.smithi099.stdout:(137/155): python3-zc-lockfile-2.0-10.el9.noarc 198 kB/s | 20 kB 00:00 2024-01-31T04:58:51.772 INFO:teuthology.orchestra.run.smithi179.stdout:(95/155): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.8 MB/s | 94 kB 00:00 2024-01-31T04:58:51.781 INFO:teuthology.orchestra.run.smithi099.stdout:(138/155): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-01-31T04:58:51.797 INFO:teuthology.orchestra.run.smithi179.stdout:(96/155): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-01-31T04:58:51.823 INFO:teuthology.orchestra.run.smithi179.stdout:(97/155): zlib-devel-1.2.11-40.el9.x86_64.rpm 899 kB/s | 45 kB 00:00 2024-01-31T04:58:51.855 INFO:teuthology.orchestra.run.smithi181.stdout:(99/155): gperftools-libs-2.9.1-2.el9.x86_64.rp 1.3 MB/s | 309 kB 00:00 2024-01-31T04:58:51.922 INFO:teuthology.orchestra.run.smithi181.stdout:(100/155): libarrow-doc-9.0.0-10.el9.noarch.rpm 612 kB/s | 26 kB 00:00 2024-01-31T04:58:51.964 INFO:teuthology.orchestra.run.smithi181.stdout:(101/155): liboath-2.6.7-2.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2024-01-31T04:58:51.965 INFO:teuthology.orchestra.run.smithi099.stdout:(139/155): thrift-0.15.0-2.el9.x86_64.rpm 6.8 MB/s | 1.6 MB 00:00 2024-01-31T04:58:51.990 INFO:teuthology.orchestra.run.smithi179.stdout:(98/155): gperftools-libs-2.9.1-2.el9.x86_64.rp 1.8 MB/s | 309 kB 00:00 2024-01-31T04:58:52.007 INFO:teuthology.orchestra.run.smithi181.stdout:(102/155): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-01-31T04:58:52.065 INFO:teuthology.orchestra.run.smithi181.stdout:(103/155): luarocks-3.9.2-1.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-01-31T04:58:52.165 INFO:teuthology.orchestra.run.smithi179.stdout:(99/155): python3-scipy-1.6.2-8.el9.x86_64.rpm 26 MB/s | 16 MB 00:00 2024-01-31T04:58:52.240 INFO:teuthology.orchestra.run.smithi181.stdout:(104/155): lua-devel-5.4.4-4.el9.x86_64.rpm 35 kB/s | 22 kB 00:00 2024-01-31T04:58:52.298 INFO:teuthology.orchestra.run.smithi179.stdout:(100/155): libarrow-doc-9.0.0-10.el9.noarch.rpm 242 kB/s | 26 kB 00:00 2024-01-31T04:58:52.307 INFO:teuthology.orchestra.run.smithi099.stdout:(140/155): librbd1-19.0.0-885.g661946e7.el9.x86 6.0 MB/s | 3.1 MB 00:00 2024-01-31T04:58:52.340 INFO:teuthology.orchestra.run.smithi181.stdout:(105/155): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.0 MB/s | 838 kB 00:00 2024-01-31T04:58:52.357 INFO:teuthology.orchestra.run.smithi179.stdout:(101/155): lua-devel-5.4.4-4.el9.x86_64.rpm 40 kB/s | 22 kB 00:00 2024-01-31T04:58:52.365 INFO:teuthology.orchestra.run.smithi099.stdout:(141/155): librados2-19.0.0-885.g661946e7.el9.x 5.5 MB/s | 3.4 MB 00:00 2024-01-31T04:58:52.382 INFO:teuthology.orchestra.run.smithi181.stdout:(106/155): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.1 MB/s | 43 kB 00:00 2024-01-31T04:58:52.424 INFO:teuthology.orchestra.run.smithi181.stdout:(107/155): python3-cachetools-4.2.4-1.el9.noarc 772 kB/s | 32 kB 00:00 2024-01-31T04:58:52.441 INFO:teuthology.orchestra.run.smithi179.stdout:(102/155): liboath-2.6.7-2.el9.x86_64.rpm 342 kB/s | 49 kB 00:00 2024-01-31T04:58:52.457 INFO:teuthology.orchestra.run.smithi099.stdout:(142/155): NetworkManager-team-1.45.10-1.el9.x8 475 kB/s | 43 kB 00:00 2024-01-31T04:58:52.466 INFO:teuthology.orchestra.run.smithi181.stdout:(108/155): python3-certifi-2021.10.8-2.el9.noar 360 kB/s | 15 kB 00:00 2024-01-31T04:58:52.499 INFO:teuthology.orchestra.run.smithi099.stdout:(143/155): NetworkManager-1.45.10-1.el9.x86_64. 4.2 MB/s | 2.3 MB 00:00 2024-01-31T04:58:52.499 INFO:teuthology.orchestra.run.smithi179.stdout:(103/155): libunwind-1.6.2-1.el9.x86_64.rpm 477 kB/s | 67 kB 00:00 2024-01-31T04:58:52.541 INFO:teuthology.orchestra.run.smithi099.stdout:(144/155): NetworkManager-tui-1.45.10-1.el9.x86 2.9 MB/s | 247 kB 00:00 2024-01-31T04:58:52.541 INFO:teuthology.orchestra.run.smithi181.stdout:(109/155): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-01-31T04:58:52.566 INFO:teuthology.orchestra.run.smithi099.stdout:(145/155): acl-2.3.1-4.el9.x86_64.rpm 1.0 MB/s | 71 kB 00:00 2024-01-31T04:58:52.567 INFO:teuthology.orchestra.run.smithi181.stdout:(110/155): python3-asyncssh-2.13.2-3.el9.noarch 1.6 MB/s | 548 kB 00:00 2024-01-31T04:58:52.591 INFO:teuthology.orchestra.run.smithi099.stdout:(146/155): elfutils-debuginfod-client-0.190-2.e 725 kB/s | 36 kB 00:00 2024-01-31T04:58:52.616 INFO:teuthology.orchestra.run.smithi179.stdout:(104/155): libarrow-9.0.0-10.el9.x86_64.rpm 7.1 MB/s | 4.4 MB 00:00 2024-01-31T04:58:52.634 INFO:teuthology.orchestra.run.smithi099.stdout:(147/155): elfutils-libelf-0.190-2.el9.x86_64.r 2.8 MB/s | 192 kB 00:00 2024-01-31T04:58:52.642 INFO:teuthology.orchestra.run.smithi179.stdout:(105/155): luarocks-3.9.2-1.el9.noarch.rpm 754 kB/s | 151 kB 00:00 2024-01-31T04:58:52.659 INFO:teuthology.orchestra.run.smithi181.stdout:(111/155): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2024-01-31T04:58:52.659 INFO:teuthology.orchestra.run.smithi099.stdout:(148/155): elfutils-libs-0.190-2.el9.x86_64.rpm 3.7 MB/s | 256 kB 00:00 2024-01-31T04:58:52.676 INFO:teuthology.orchestra.run.smithi099.stdout:(149/155): libacl-2.3.1-4.el9.x86_64.rpm 551 kB/s | 23 kB 00:00 2024-01-31T04:58:52.700 INFO:teuthology.orchestra.run.smithi181.stdout:(112/155): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.2 MB/s | 303 kB 00:00 2024-01-31T04:58:52.726 INFO:teuthology.orchestra.run.smithi181.stdout:(113/155): python3-colorama-0.4.4-12.el9.noarch 529 kB/s | 35 kB 00:00 2024-01-31T04:58:52.733 INFO:teuthology.orchestra.run.smithi179.stdout:(106/155): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.5 MB/s | 838 kB 00:00 2024-01-31T04:58:52.768 INFO:teuthology.orchestra.run.smithi181.stdout:(114/155): python3-jaraco-8.2.1-3.el9.noarch.rp 256 kB/s | 11 kB 00:00 2024-01-31T04:58:52.793 INFO:teuthology.orchestra.run.smithi181.stdout:(115/155): python3-google-auth-2.26.2-1.el9.noa 2.1 MB/s | 202 kB 00:00 2024-01-31T04:58:52.801 INFO:teuthology.orchestra.run.smithi179.stdout:(107/155): python3-bcrypt-3.2.2-1.el9.x86_64.rp 323 kB/s | 43 kB 00:00 2024-01-31T04:58:52.818 INFO:teuthology.orchestra.run.smithi099.stdout:(150/155): NetworkManager-libnm-1.45.10-1.el9.x 3.5 MB/s | 1.8 MB 00:00 2024-01-31T04:58:52.818 INFO:teuthology.orchestra.run.smithi181.stdout:(116/155): python3-jaraco-classes-3.2.1-5.el9.n 353 kB/s | 18 kB 00:00 2024-01-31T04:58:52.842 INFO:teuthology.orchestra.run.smithi179.stdout:(108/155): python3-asyncssh-2.13.2-3.el9.noarch 2.4 MB/s | 548 kB 00:00 2024-01-31T04:58:52.843 INFO:teuthology.orchestra.run.smithi181.stdout:(117/155): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-01-31T04:58:52.877 INFO:teuthology.orchestra.run.smithi181.stdout:(118/155): python3-jaraco-functools-3.5.0-2.el9 332 kB/s | 19 kB 00:00 2024-01-31T04:58:52.884 INFO:teuthology.orchestra.run.smithi179.stdout:(109/155): python3-cachetools-4.2.4-1.el9.noarc 215 kB/s | 32 kB 00:00 2024-01-31T04:58:52.894 INFO:teuthology.orchestra.run.smithi181.stdout:(119/155): python3-jaraco-text-3.2.0-6.el9.noar 390 kB/s | 20 kB 00:00 2024-01-31T04:58:52.928 INFO:teuthology.orchestra.run.smithi181.stdout:(120/155): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-01-31T04:58:52.934 INFO:teuthology.orchestra.run.smithi179.stdout:(110/155): python3-certifi-2021.10.8-2.el9.noar 113 kB/s | 15 kB 00:00 2024-01-31T04:58:52.951 INFO:teuthology.orchestra.run.smithi099.stdout:(151/155): openssl-3.0.7-25.el9.x86_64.rpm 4.2 MB/s | 1.2 MB 00:00 2024-01-31T04:58:52.962 INFO:teuthology.orchestra.run.smithi181.stdout:(121/155): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-01-31T04:58:52.977 INFO:teuthology.orchestra.run.smithi099.stdout:(152/155): xfsdump-3.1.12-4.el9.x86_64.rpm 2.0 MB/s | 323 kB 00:00 2024-01-31T04:58:52.995 INFO:teuthology.orchestra.run.smithi181.stdout:(122/155): python3-natsort-7.1.1-5.el9.noarch.r 1.7 MB/s | 58 kB 00:00 2024-01-31T04:58:53.035 INFO:teuthology.orchestra.run.smithi179.stdout:(111/155): python3-cheroot-8.6.0-4.el9.noarch.r 1.0 MB/s | 172 kB 00:00 2024-01-31T04:58:53.077 INFO:teuthology.orchestra.run.smithi099.stdout:(153/155): libacl-devel-2.3.1-4.el9.x86_64.rpm 743 kB/s | 74 kB 00:00 2024-01-31T04:58:53.094 INFO:teuthology.orchestra.run.smithi179.stdout:(112/155): python3-cherrypy-18.6.1-2.el9.noarch 1.9 MB/s | 358 kB 00:00 2024-01-31T04:58:53.095 INFO:teuthology.orchestra.run.smithi181.stdout:(123/155): libarrow-9.0.0-10.el9.x86_64.rpm 3.0 MB/s | 4.4 MB 00:01 2024-01-31T04:58:53.111 INFO:teuthology.orchestra.run.smithi099.stdout:(154/155): xfsprogs-6.3.0-1.el9.x86_64.rpm 6.8 MB/s | 1.1 MB 00:00 2024-01-31T04:58:53.137 INFO:teuthology.orchestra.run.smithi181.stdout:(124/155): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2024-01-31T04:58:53.152 INFO:teuthology.orchestra.run.smithi179.stdout:(113/155): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.5 MB/s | 303 kB 00:00 2024-01-31T04:58:53.163 INFO:teuthology.orchestra.run.smithi181.stdout:(125/155): python3-portend-3.1.0-2.el9.noarch.r 245 kB/s | 16 kB 00:00 2024-01-31T04:58:53.177 INFO:teuthology.orchestra.run.smithi179.stdout:(114/155): python3-colorama-0.4.4-12.el9.noarch 249 kB/s | 35 kB 00:00 2024-01-31T04:58:53.205 INFO:teuthology.orchestra.run.smithi181.stdout:(126/155): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-01-31T04:58:53.240 INFO:teuthology.orchestra.run.smithi181.stdout:(127/155): python3-kubernetes-26.1.0-2.el9.noar 2.8 MB/s | 1.0 MB 00:00 2024-01-31T04:58:53.261 INFO:teuthology.orchestra.run.smithi179.stdout:(115/155): python3-jaraco-8.2.1-3.el9.noarch.rp 99 kB/s | 11 kB 00:00 2024-01-31T04:58:53.263 INFO:teuthology.orchestra.run.smithi181.stdout:(128/155): python3-pyperclip-1.8.2-2.el9.noarch 281 kB/s | 28 kB 00:00 2024-01-31T04:58:53.289 INFO:teuthology.orchestra.run.smithi181.stdout:(129/155): python3-repoze-lru-0.7-16.el9.noarch 366 kB/s | 31 kB 00:00 2024-01-31T04:58:53.294 INFO:teuthology.orchestra.run.smithi179.stdout:(116/155): python3-google-auth-2.26.2-1.el9.noa 1.0 MB/s | 202 kB 00:00 2024-01-31T04:58:53.314 INFO:teuthology.orchestra.run.smithi181.stdout:(130/155): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-01-31T04:58:53.327 INFO:teuthology.orchestra.run.smithi099.stdout:(155/155): openssl-libs-3.0.7-25.el9.x86_64.rpm 3.3 MB/s | 2.2 MB 00:00 2024-01-31T04:58:53.330 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-01-31T04:58:53.331 INFO:teuthology.orchestra.run.smithi099.stdout:Total 14 MB/s | 212 MB 00:15 2024-01-31T04:58:53.339 INFO:teuthology.orchestra.run.smithi181.stdout:(131/155): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-01-31T04:58:53.345 INFO:teuthology.orchestra.run.smithi179.stdout:(117/155): python3-jaraco-classes-3.2.1-5.el9.n 123 kB/s | 18 kB 00:00 2024-01-31T04:58:53.365 INFO:teuthology.orchestra.run.smithi181.stdout:(132/155): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-01-31T04:58:53.390 INFO:teuthology.orchestra.run.smithi181.stdout:(133/155): python3-typing-extensions-4.4.0-2.el 675 kB/s | 51 kB 00:00 2024-01-31T04:58:53.429 INFO:teuthology.orchestra.run.smithi179.stdout:(118/155): python3-jaraco-collections-3.0.0-8.e 139 kB/s | 23 kB 00:00 2024-01-31T04:58:53.432 INFO:teuthology.orchestra.run.smithi181.stdout:(134/155): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-01-31T04:58:53.457 INFO:teuthology.orchestra.run.smithi181.stdout:(135/155): python3-webob-1.8.7-6.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-01-31T04:58:53.482 INFO:teuthology.orchestra.run.smithi181.stdout:(136/155): python3-zc-lockfile-2.0-10.el9.noarc 400 kB/s | 20 kB 00:00 2024-01-31T04:58:53.495 INFO:teuthology.orchestra.run.smithi179.stdout:(119/155): python3-jaraco-functools-3.5.0-2.el9 110 kB/s | 19 kB 00:00 2024-01-31T04:58:53.521 INFO:teuthology.orchestra.run.smithi179.stdout:(120/155): python3-jaraco-text-3.2.0-6.el9.noar 130 kB/s | 20 kB 00:00 2024-01-31T04:58:53.558 INFO:teuthology.orchestra.run.smithi181.stdout:(137/155): python3-werkzeug-2.0.3-3.el9.1.noarc 2.5 MB/s | 427 kB 00:00 2024-01-31T04:58:53.583 INFO:teuthology.orchestra.run.smithi181.stdout:(138/155): re2-20211101-3.el9.x86_64.rpm 1.5 MB/s | 192 kB 00:00 2024-01-31T04:58:53.629 INFO:teuthology.orchestra.run.smithi179.stdout:(121/155): python3-logutils-0.3.5-21.el9.noarch 349 kB/s | 46 kB 00:00 2024-01-31T04:58:53.688 INFO:teuthology.orchestra.run.smithi179.stdout:(122/155): python3-more-itertools-8.12.0-2.el9. 550 kB/s | 79 kB 00:00 2024-01-31T04:58:53.722 INFO:teuthology.orchestra.run.smithi179.stdout:(123/155): python3-kubernetes-26.1.0-2.el9.noar 3.5 MB/s | 1.0 MB 00:00 2024-01-31T04:58:53.822 INFO:teuthology.orchestra.run.smithi179.stdout:(124/155): python3-natsort-7.1.1-5.el9.noarch.r 301 kB/s | 58 kB 00:00 2024-01-31T04:58:53.880 INFO:teuthology.orchestra.run.smithi179.stdout:(125/155): python3-portend-3.1.0-2.el9.noarch.r 122 kB/s | 16 kB 00:00 2024-01-31T04:58:53.905 INFO:teuthology.orchestra.run.smithi179.stdout:(126/155): python3-pecan-1.4.2-3.el9.noarch.rpm 1.2 MB/s | 272 kB 00:00 2024-01-31T04:58:53.950 INFO:teuthology.orchestra.run.smithi181.stdout:(139/155): librbd1-19.0.0-885.g661946e7.el9.x86 8.5 MB/s | 3.1 MB 00:00 2024-01-31T04:58:53.989 INFO:teuthology.orchestra.run.smithi179.stdout:(127/155): python3-pyOpenSSL-21.0.0-1.el9.noarc 538 kB/s | 90 kB 00:00 2024-01-31T04:58:53.992 INFO:teuthology.orchestra.run.smithi181.stdout:(140/155): thrift-0.15.0-2.el9.x86_64.rpm 3.1 MB/s | 1.6 MB 00:00 2024-01-31T04:58:54.022 INFO:teuthology.orchestra.run.smithi179.stdout:(128/155): python3-pyperclip-1.8.2-2.el9.noarch 200 kB/s | 28 kB 00:00 2024-01-31T04:58:54.106 INFO:teuthology.orchestra.run.smithi179.stdout:(129/155): python3-repoze-lru-0.7-16.el9.noarch 174 kB/s | 31 kB 00:00 2024-01-31T04:58:54.134 INFO:teuthology.orchestra.run.smithi181.stdout:(141/155): NetworkManager-1.45.10-1.el9.x86_64. 12 MB/s | 2.3 MB 00:00 2024-01-31T04:58:54.176 INFO:teuthology.orchestra.run.smithi181.stdout:(142/155): NetworkManager-libnm-1.45.10-1.el9.x 9.9 MB/s | 1.8 MB 00:00 2024-01-31T04:58:54.182 INFO:teuthology.orchestra.run.smithi179.stdout:(130/155): python3-rsa-4.9-2.el9.noarch.rpm 436 kB/s | 59 kB 00:00 2024-01-31T04:58:54.234 INFO:teuthology.orchestra.run.smithi181.stdout:(143/155): librados2-19.0.0-885.g661946e7.el9.x 5.0 MB/s | 3.4 MB 00:00 2024-01-31T04:58:54.257 INFO:teuthology.orchestra.run.smithi179.stdout:(131/155): python3-tempora-5.0.0-2.el9.noarch.r 240 kB/s | 36 kB 00:00 2024-01-31T04:58:54.260 INFO:teuthology.orchestra.run.smithi181.stdout:(144/155): NetworkManager-team-1.45.10-1.el9.x8 350 kB/s | 43 kB 00:00 2024-01-31T04:58:54.282 INFO:teuthology.orchestra.run.smithi179.stdout:(132/155): python3-routes-2.5.1-5.el9.noarch.rp 646 kB/s | 188 kB 00:00 2024-01-31T04:58:54.285 INFO:teuthology.orchestra.run.smithi181.stdout:(145/155): NetworkManager-tui-1.45.10-1.el9.x86 2.2 MB/s | 247 kB 00:00 2024-01-31T04:58:54.335 INFO:teuthology.orchestra.run.smithi181.stdout:(146/155): acl-2.3.1-4.el9.x86_64.rpm 710 kB/s | 71 kB 00:00 2024-01-31T04:58:54.361 INFO:teuthology.orchestra.run.smithi181.stdout:(147/155): elfutils-debuginfod-client-0.190-2.e 364 kB/s | 36 kB 00:00 2024-01-31T04:58:54.374 INFO:teuthology.orchestra.run.smithi179.stdout:(133/155): python3-typing-extensions-4.4.0-2.el 265 kB/s | 51 kB 00:00 2024-01-31T04:58:54.394 INFO:teuthology.orchestra.run.smithi181.stdout:(148/155): elfutils-libelf-0.190-2.el9.x86_64.r 1.7 MB/s | 192 kB 00:00 2024-01-31T04:58:54.436 INFO:teuthology.orchestra.run.smithi181.stdout:(149/155): elfutils-libs-0.190-2.el9.x86_64.rpm 2.5 MB/s | 256 kB 00:00 2024-01-31T04:58:54.441 INFO:teuthology.orchestra.run.smithi179.stdout:(134/155): python3-webob-1.8.7-6.el9.noarch.rpm 1.2 MB/s | 230 kB 00:00 2024-01-31T04:58:54.462 INFO:teuthology.orchestra.run.smithi181.stdout:(150/155): libacl-2.3.1-4.el9.x86_64.rpm 228 kB/s | 23 kB 00:00 2024-01-31T04:58:54.500 INFO:teuthology.orchestra.run.smithi179.stdout:(135/155): python3-websocket-client-1.2.3-2.el9 462 kB/s | 90 kB 00:00 2024-01-31T04:58:54.520 INFO:teuthology.orchestra.run.smithi181.stdout:(151/155): openssl-3.0.7-25.el9.x86_64.rpm 9.7 MB/s | 1.2 MB 00:00 2024-01-31T04:58:54.534 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-01-31T04:58:54.567 INFO:teuthology.orchestra.run.smithi179.stdout:(136/155): python3-zc-lockfile-2.0-10.el9.noarc 161 kB/s | 20 kB 00:00 2024-01-31T04:58:54.592 INFO:teuthology.orchestra.run.smithi179.stdout:(137/155): python3-werkzeug-2.0.3-3.el9.1.noarc 1.9 MB/s | 427 kB 00:00 2024-01-31T04:58:54.604 INFO:teuthology.orchestra.run.smithi181.stdout:(152/155): openssl-libs-3.0.7-25.el9.x86_64.rpm 13 MB/s | 2.2 MB 00:00 2024-01-31T04:58:54.629 INFO:teuthology.orchestra.run.smithi181.stdout:(153/155): xfsdump-3.1.12-4.el9.x86_64.rpm 1.9 MB/s | 323 kB 00:00 2024-01-31T04:58:54.668 INFO:teuthology.orchestra.run.smithi179.stdout:(138/155): re2-20211101-3.el9.x86_64.rpm 1.1 MB/s | 192 kB 00:00 2024-01-31T04:58:54.671 INFO:teuthology.orchestra.run.smithi181.stdout:(154/155): xfsprogs-6.3.0-1.el9.x86_64.rpm 7.2 MB/s | 1.1 MB 00:00 2024-01-31T04:58:54.793 INFO:teuthology.orchestra.run.smithi179.stdout:(139/155): thrift-0.15.0-2.el9.x86_64.rpm 7.0 MB/s | 1.6 MB 00:00 2024-01-31T04:58:54.827 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-01-31T04:58:54.827 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-01-31T04:58:54.901 INFO:teuthology.orchestra.run.smithi179.stdout:(140/155): NetworkManager-1.45.10-1.el9.x86_64. 21 MB/s | 2.3 MB 00:00 2024-01-31T04:58:54.960 INFO:teuthology.orchestra.run.smithi179.stdout:(141/155): librados2-19.0.0-885.g661946e7.el9.x 9.8 MB/s | 3.4 MB 00:00 2024-01-31T04:58:55.010 INFO:teuthology.orchestra.run.smithi179.stdout:(142/155): NetworkManager-libnm-1.45.10-1.el9.x 17 MB/s | 1.8 MB 00:00 2024-01-31T04:58:55.036 INFO:teuthology.orchestra.run.smithi179.stdout:(143/155): NetworkManager-team-1.45.10-1.el9.x8 591 kB/s | 43 kB 00:00 2024-01-31T04:58:55.061 INFO:teuthology.orchestra.run.smithi179.stdout:(144/155): NetworkManager-tui-1.45.10-1.el9.x86 4.8 MB/s | 247 kB 00:00 2024-01-31T04:58:55.086 INFO:teuthology.orchestra.run.smithi179.stdout:(145/155): acl-2.3.1-4.el9.x86_64.rpm 1.4 MB/s | 71 kB 00:00 2024-01-31T04:58:55.111 INFO:teuthology.orchestra.run.smithi179.stdout:(146/155): elfutils-debuginfod-client-0.190-2.e 730 kB/s | 36 kB 00:00 2024-01-31T04:58:55.137 INFO:teuthology.orchestra.run.smithi179.stdout:(147/155): elfutils-libelf-0.190-2.el9.x86_64.r 3.7 MB/s | 192 kB 00:00 2024-01-31T04:58:55.162 INFO:teuthology.orchestra.run.smithi179.stdout:(148/155): elfutils-libs-0.190-2.el9.x86_64.rpm 5.0 MB/s | 256 kB 00:00 2024-01-31T04:58:55.187 INFO:teuthology.orchestra.run.smithi179.stdout:(149/155): libacl-2.3.1-4.el9.x86_64.rpm 462 kB/s | 23 kB 00:00 2024-01-31T04:58:55.221 INFO:teuthology.orchestra.run.smithi179.stdout:(150/155): openssl-3.0.7-25.el9.x86_64.rpm 21 MB/s | 1.2 MB 00:00 2024-01-31T04:58:55.279 INFO:teuthology.orchestra.run.smithi179.stdout:(151/155): openssl-libs-3.0.7-25.el9.x86_64.rpm 24 MB/s | 2.2 MB 00:00 2024-01-31T04:58:55.287 INFO:teuthology.orchestra.run.smithi181.stdout:(155/155): libacl-devel-2.3.1-4.el9.x86_64.rpm 109 kB/s | 74 kB 00:00 2024-01-31T04:58:55.297 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-01-31T04:58:55.297 INFO:teuthology.orchestra.run.smithi181.stdout:Total 9.0 MB/s | 212 MB 00:23 2024-01-31T04:58:55.305 INFO:teuthology.orchestra.run.smithi179.stdout:(152/155): xfsdump-3.1.12-4.el9.x86_64.rpm 3.9 MB/s | 323 kB 00:00 2024-01-31T04:58:55.343 INFO:teuthology.orchestra.run.smithi179.stdout:(153/155): xfsprogs-6.3.0-1.el9.x86_64.rpm 17 MB/s | 1.1 MB 00:00 2024-01-31T04:58:55.393 INFO:teuthology.orchestra.run.smithi179.stdout:(154/155): librbd1-19.0.0-885.g661946e7.el9.x86 4.3 MB/s | 3.1 MB 00:00 2024-01-31T04:58:55.418 INFO:teuthology.orchestra.run.smithi179.stdout:(155/155): libacl-devel-2.3.1-4.el9.x86_64.rpm 666 kB/s | 74 kB 00:00 2024-01-31T04:58:55.423 INFO:teuthology.orchestra.run.smithi179.stdout:-------------------------------------------------------------------------------- 2024-01-31T04:58:55.423 INFO:teuthology.orchestra.run.smithi179.stdout:Total 14 MB/s | 212 MB 00:15 2024-01-31T04:58:56.457 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-01-31T04:58:56.596 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction check 2024-01-31T04:58:56.712 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-01-31T04:58:56.715 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-01-31T04:58:56.855 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction check succeeded. 2024-01-31T04:58:56.856 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction test 2024-01-31T04:58:56.902 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-01-31T04:58:56.903 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-01-31T04:58:58.514 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-01-31T04:58:58.515 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-01-31T04:58:58.580 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction test succeeded. 2024-01-31T04:58:58.581 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction 2024-01-31T04:59:03.210 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-01-31T04:59:03.314 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/171 2024-01-31T04:59:03.360 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/171 2024-01-31T04:59:03.431 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/171 2024-01-31T04:59:03.464 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/171 2024-01-31T04:59:03.490 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/171 2024-01-31T04:59:03.536 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/171 2024-01-31T04:59:03.857 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/171 2024-01-31T04:59:03.925 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : librados2-2:19.0.0-885.g661946e7.el9.x86_64 8/171 2024-01-31T04:59:04.060 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librados2-2:19.0.0-885.g661946e7.el9.x86_64 8/171 2024-01-31T04:59:04.092 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephfs2-2:19.0.0-885.g661946e7.el9.x86_64 9/171 2024-01-31T04:59:04.183 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libcephfs2-2:19.0.0-885.g661946e7.el9.x86_64 9/171 2024-01-31T04:59:04.221 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rados-2:19.0.0-885.g661946e7.el9.x86_64 10/171 2024-01-31T04:59:04.319 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/171 2024-01-31T04:59:04.421 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 12/171 2024-01-31T04:59:04.592 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 13/171 2024-01-31T04:59:04.639 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : postgresql-13.11-1.el9.x86_64 14/171 2024-01-31T04:59:04.667 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephsqlite-2:19.0.0-885.g661946e7.el9.x86_64 15/171 2024-01-31T04:59:04.769 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libcephsqlite-2:19.0.0-885.g661946e7.el9.x86_64 15/171 2024-01-31T04:59:04.792 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libradosstriper1-2:19.0.0-885.g661946e7.el9.x86_ 16/171 2024-01-31T04:59:04.837 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libradosstriper1-2:19.0.0-885.g661946e7.el9.x86_ 16/171 2024-01-31T04:59:04.960 INFO:teuthology.orchestra.run.smithi179.stdout: Preparing : 1/1 2024-01-31T04:59:05.015 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 17/171 2024-01-31T04:59:05.073 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/171 2024-01-31T04:59:05.111 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/171 2024-01-31T04:59:05.130 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : NetworkManager-libnm-1:1.45.10-1.el9.x86_64 18/171 2024-01-31T04:59:05.138 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-01-31T04:59:05.172 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/171 2024-01-31T04:59:05.182 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.10-1.el9.x86_64 18/171 2024-01-31T04:59:05.207 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/171 2024-01-31T04:59:05.240 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/171 2024-01-31T04:59:05.267 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/171 2024-01-31T04:59:05.282 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: NetworkManager-1:1.45.10-1.el9.x86_64 19/171 2024-01-31T04:59:05.282 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/171 2024-01-31T04:59:05.306 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/171 2024-01-31T04:59:05.325 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : NetworkManager-1:1.45.10-1.el9.x86_64 19/171 2024-01-31T04:59:05.367 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/171 2024-01-31T04:59:05.401 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/171 2024-01-31T04:59:05.426 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/171 2024-01-31T04:59:05.468 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/171 2024-01-31T04:59:05.585 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: NetworkManager-1:1.45.10-1.el9.x86_64 19/171 2024-01-31T04:59:05.609 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/171 2024-01-31T04:59:05.621 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 20/171 2024-01-31T04:59:05.655 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/171 2024-01-31T04:59:05.691 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : librados2-2:19.0.0-885.g661946e7.el9.x86_64 8/171 2024-01-31T04:59:05.720 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/171 2024-01-31T04:59:05.755 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/171 2024-01-31T04:59:05.788 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/171 2024-01-31T04:59:05.798 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/171 2024-01-31T04:59:05.812 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librados2-2:19.0.0-885.g661946e7.el9.x86_64 8/171 2024-01-31T04:59:05.816 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/171 2024-01-31T04:59:05.842 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcephfs2-2:19.0.0-885.g661946e7.el9.x86_64 9/171 2024-01-31T04:59:05.860 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : librados2-2:19.0.0-885.g661946e7.el9.x86_64 8/171 2024-01-31T04:59:05.884 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/171 2024-01-31T04:59:05.916 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libcephfs2-2:19.0.0-885.g661946e7.el9.x86_64 9/171 2024-01-31T04:59:05.938 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/171 2024-01-31T04:59:05.955 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rados-2:19.0.0-885.g661946e7.el9.x86_64 10/171 2024-01-31T04:59:05.970 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/171 2024-01-31T04:59:05.983 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librados2-2:19.0.0-885.g661946e7.el9.x86_64 8/171 2024-01-31T04:59:06.011 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephfs2-2:19.0.0-885.g661946e7.el9.x86_64 9/171 2024-01-31T04:59:06.013 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/171 2024-01-31T04:59:06.046 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/171 2024-01-31T04:59:06.086 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libcephfs2-2:19.0.0-885.g661946e7.el9.x86_64 9/171 2024-01-31T04:59:06.088 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/171 2024-01-31T04:59:06.116 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rados-2:19.0.0-885.g661946e7.el9.x86_64 10/171 2024-01-31T04:59:06.124 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-ceph-common-2:19.0.0-885.g661946e7.el9.x 31/171 2024-01-31T04:59:06.131 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 12/171 2024-01-31T04:59:06.169 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-ceph-argparse-2:19.0.0-885.g661946e7.el9 32/171 2024-01-31T04:59:06.189 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/171 2024-01-31T04:59:06.205 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cephfs-2:19.0.0-885.g661946e7.el9.x86_64 33/171 2024-01-31T04:59:06.268 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 12/171 2024-01-31T04:59:06.274 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/171 2024-01-31T04:59:06.319 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 13/171 2024-01-31T04:59:06.351 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/171 2024-01-31T04:59:06.367 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : postgresql-13.11-1.el9.x86_64 14/171 2024-01-31T04:59:06.394 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcephsqlite-2:19.0.0-885.g661946e7.el9.x86_64 15/171 2024-01-31T04:59:06.450 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 13/171 2024-01-31T04:59:06.493 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/171 2024-01-31T04:59:06.499 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-13.11-1.el9.x86_64 14/171 2024-01-31T04:59:06.516 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libcephsqlite-2:19.0.0-885.g661946e7.el9.x86_64 15/171 2024-01-31T04:59:06.527 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephsqlite-2:19.0.0-885.g661946e7.el9.x86_64 15/171 2024-01-31T04:59:06.546 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/171 2024-01-31T04:59:06.546 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libradosstriper1-2:19.0.0-885.g661946e7.el9.x86_ 16/171 2024-01-31T04:59:06.607 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libradosstriper1-2:19.0.0-885.g661946e7.el9.x86_ 16/171 2024-01-31T04:59:06.647 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libcephsqlite-2:19.0.0-885.g661946e7.el9.x86_64 15/171 2024-01-31T04:59:06.672 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libradosstriper1-2:19.0.0-885.g661946e7.el9.x86_ 16/171 2024-01-31T04:59:06.705 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 17/171 2024-01-31T04:59:06.726 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libradosstriper1-2:19.0.0-885.g661946e7.el9.x86_ 16/171 2024-01-31T04:59:06.817 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : NetworkManager-libnm-1:1.45.10-1.el9.x86_64 18/171 2024-01-31T04:59:06.820 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 17/171 2024-01-31T04:59:06.877 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.10-1.el9.x86_64 18/171 2024-01-31T04:59:06.919 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : NetworkManager-libnm-1:1.45.10-1.el9.x86_64 18/171 2024-01-31T04:59:06.938 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-1:1.45.10-1.el9.x86_64 19/171 2024-01-31T04:59:06.979 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.10-1.el9.x86_64 18/171 2024-01-31T04:59:07.003 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : NetworkManager-1:1.45.10-1.el9.x86_64 19/171 2024-01-31T04:59:07.042 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-1:1.45.10-1.el9.x86_64 19/171 2024-01-31T04:59:07.063 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/171 2024-01-31T04:59:07.105 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : NetworkManager-1:1.45.10-1.el9.x86_64 19/171 2024-01-31T04:59:07.158 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/171 2024-01-31T04:59:07.196 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 40/171 2024-01-31T04:59:07.247 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 41/171 2024-01-31T04:59:07.285 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-1:1.45.10-1.el9.x86_64 19/171 2024-01-31T04:59:07.285 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librados-devel-2:19.0.0-885.g661946e7.el9.x86_64 42/171 2024-01-31T04:59:07.324 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 20/171 2024-01-31T04:59:07.327 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/171 2024-01-31T04:59:07.358 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/171 2024-01-31T04:59:07.361 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-1:1.45.10-1.el9.x86_64 19/171 2024-01-31T04:59:07.395 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 20/171 2024-01-31T04:59:07.423 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/171 2024-01-31T04:59:07.428 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/171 2024-01-31T04:59:07.458 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 44/171 2024-01-31T04:59:07.466 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/171 2024-01-31T04:59:07.508 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/171 2024-01-31T04:59:07.510 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/171 2024-01-31T04:59:07.511 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 45/171 2024-01-31T04:59:07.536 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/171 2024-01-31T04:59:07.544 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/171 2024-01-31T04:59:07.578 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/171 2024-01-31T04:59:07.604 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/171 2024-01-31T04:59:07.607 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/171 2024-01-31T04:59:07.612 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : re2-1:20211101-3.el9.x86_64 46/171 2024-01-31T04:59:07.651 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 47/171 2024-01-31T04:59:07.658 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/171 2024-01-31T04:59:07.665 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/171 2024-01-31T04:59:07.689 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/171 2024-01-31T04:59:07.706 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/171 2024-01-31T04:59:07.720 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/171 2024-01-31T04:59:07.724 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/171 2024-01-31T04:59:07.751 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/171 2024-01-31T04:59:07.770 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 49/171 2024-01-31T04:59:07.786 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/171 2024-01-31T04:59:07.800 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/171 2024-01-31T04:59:07.802 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 50/171 2024-01-31T04:59:07.843 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-ceph-common-2:19.0.0-885.g661946e7.el9.x 31/171 2024-01-31T04:59:07.861 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/171 2024-01-31T04:59:07.864 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 51/171 2024-01-31T04:59:07.903 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-ceph-argparse-2:19.0.0-885.g661946e7.el9 32/171 2024-01-31T04:59:07.905 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ceph-common-2:19.0.0-885.g661946e7.el9.x 31/171 2024-01-31T04:59:07.909 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 52/171 2024-01-31T04:59:07.932 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cephfs-2:19.0.0-885.g661946e7.el9.x86_64 33/171 2024-01-31T04:59:07.946 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 53/171 2024-01-31T04:59:07.948 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ceph-argparse-2:19.0.0-885.g661946e7.el9 32/171 2024-01-31T04:59:07.978 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cephfs-2:19.0.0-885.g661946e7.el9.x86_64 33/171 2024-01-31T04:59:07.989 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 54/171 2024-01-31T04:59:08.002 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/171 2024-01-31T04:59:08.032 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 55/171 2024-01-31T04:59:08.045 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/171 2024-01-31T04:59:08.079 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/171 2024-01-31T04:59:08.123 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/171 2024-01-31T04:59:08.166 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 56/171 2024-01-31T04:59:08.212 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/171 2024-01-31T04:59:08.219 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 57/171 2024-01-31T04:59:08.250 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 58/171 2024-01-31T04:59:08.255 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/171 2024-01-31T04:59:08.265 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/171 2024-01-31T04:59:08.292 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 59/171 2024-01-31T04:59:08.310 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/171 2024-01-31T04:59:08.385 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 60/171 2024-01-31T04:59:08.426 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-google-auth-1:2.26.2-1.el9.noarch 61/171 2024-01-31T04:59:08.467 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 62/171 2024-01-31T04:59:08.500 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 63/171 2024-01-31T04:59:08.677 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 64/171 2024-01-31T04:59:08.772 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 65/171 2024-01-31T04:59:08.783 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/171 2024-01-31T04:59:08.814 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 66/171 2024-01-31T04:59:08.824 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/171 2024-01-31T04:59:08.855 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : uuid-1.6.2-55.el9.x86_64 67/171 2024-01-31T04:59:08.877 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/171 2024-01-31T04:59:08.892 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/171 2024-01-31T04:59:08.909 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 40/171 2024-01-31T04:59:08.913 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/171 2024-01-31T04:59:08.921 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/171 2024-01-31T04:59:08.946 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 40/171 2024-01-31T04:59:08.955 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/171 2024-01-31T04:59:08.957 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 41/171 2024-01-31T04:59:08.989 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/171 2024-01-31T04:59:08.996 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librados-devel-2:19.0.0-885.g661946e7.el9.x86_64 42/171 2024-01-31T04:59:09.003 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 41/171 2024-01-31T04:59:09.031 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/171 2024-01-31T04:59:09.037 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/171 2024-01-31T04:59:09.040 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librados-devel-2:19.0.0-885.g661946e7.el9.x86_64 42/171 2024-01-31T04:59:09.073 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/171 2024-01-31T04:59:09.082 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/171 2024-01-31T04:59:09.108 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/171 2024-01-31T04:59:09.186 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 44/171 2024-01-31T04:59:09.207 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 44/171 2024-01-31T04:59:09.208 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 75/171 2024-01-31T04:59:09.230 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 45/171 2024-01-31T04:59:09.258 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 45/171 2024-01-31T04:59:09.266 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 76/171 2024-01-31T04:59:09.337 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : re2-1:20211101-3.el9.x86_64 46/171 2024-01-31T04:59:09.373 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : re2-1:20211101-3.el9.x86_64 46/171 2024-01-31T04:59:09.375 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 47/171 2024-01-31T04:59:09.411 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 47/171 2024-01-31T04:59:09.430 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/171 2024-01-31T04:59:09.466 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/171 2024-01-31T04:59:09.502 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 49/171 2024-01-31T04:59:09.530 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 49/171 2024-01-31T04:59:09.533 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 50/171 2024-01-31T04:59:09.562 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 50/171 2024-01-31T04:59:09.570 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 51/171 2024-01-31T04:59:09.598 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 51/171 2024-01-31T04:59:09.625 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 52/171 2024-01-31T04:59:09.644 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 52/171 2024-01-31T04:59:09.669 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 53/171 2024-01-31T04:59:09.681 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 53/171 2024-01-31T04:59:09.712 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 54/171 2024-01-31T04:59:09.723 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 54/171 2024-01-31T04:59:09.754 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 55/171 2024-01-31T04:59:09.766 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 55/171 2024-01-31T04:59:09.888 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 56/171 2024-01-31T04:59:09.896 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 56/171 2024-01-31T04:59:09.935 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 57/171 2024-01-31T04:59:09.938 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 57/171 2024-01-31T04:59:09.966 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 58/171 2024-01-31T04:59:09.968 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 58/171 2024-01-31T04:59:09.987 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 77/171 2024-01-31T04:59:10.007 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 59/171 2024-01-31T04:59:10.009 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 59/171 2024-01-31T04:59:10.030 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 78/171 2024-01-31T04:59:10.063 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 79/171 2024-01-31T04:59:10.101 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 60/171 2024-01-31T04:59:10.102 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 60/171 2024-01-31T04:59:10.140 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-google-auth-1:2.26.2-1.el9.noarch 61/171 2024-01-31T04:59:10.143 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-google-auth-1:2.26.2-1.el9.noarch 61/171 2024-01-31T04:59:10.162 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 80/171 2024-01-31T04:59:10.189 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 62/171 2024-01-31T04:59:10.191 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 62/171 2024-01-31T04:59:10.213 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/171 2024-01-31T04:59:10.214 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 63/171 2024-01-31T04:59:10.241 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 64/171 2024-01-31T04:59:10.249 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 63/171 2024-01-31T04:59:10.269 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 65/171 2024-01-31T04:59:10.277 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 64/171 2024-01-31T04:59:10.299 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 82/171 2024-01-31T04:59:10.303 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 66/171 2024-01-31T04:59:10.305 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 65/171 2024-01-31T04:59:10.340 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 66/171 2024-01-31T04:59:10.343 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : uuid-1.6.2-55.el9.x86_64 67/171 2024-01-31T04:59:10.348 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 83/171 2024-01-31T04:59:10.374 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/171 2024-01-31T04:59:10.379 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : uuid-1.6.2-55.el9.x86_64 67/171 2024-01-31T04:59:10.405 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/171 2024-01-31T04:59:10.410 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/171 2024-01-31T04:59:10.439 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/171 2024-01-31T04:59:10.441 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/171 2024-01-31T04:59:10.472 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/171 2024-01-31T04:59:10.475 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/171 2024-01-31T04:59:10.508 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/171 2024-01-31T04:59:10.513 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/171 2024-01-31T04:59:10.526 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : openblas-0.3.21-2.el9.x86_64 84/171 2024-01-31T04:59:10.548 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/171 2024-01-31T04:59:10.550 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/171 2024-01-31T04:59:10.563 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 85/171 2024-01-31T04:59:10.583 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/171 2024-01-31T04:59:10.584 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/171 2024-01-31T04:59:10.619 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/171 2024-01-31T04:59:10.641 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 86/171 2024-01-31T04:59:10.694 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 75/171 2024-01-31T04:59:10.720 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 75/171 2024-01-31T04:59:10.751 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 76/171 2024-01-31T04:59:10.770 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 76/171 2024-01-31T04:59:11.286 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 87/171 2024-01-31T04:59:11.401 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 88/171 2024-01-31T04:59:11.474 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 77/171 2024-01-31T04:59:11.491 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 77/171 2024-01-31T04:59:11.523 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 78/171 2024-01-31T04:59:11.534 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 78/171 2024-01-31T04:59:11.557 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 79/171 2024-01-31T04:59:11.568 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 79/171 2024-01-31T04:59:11.657 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 80/171 2024-01-31T04:59:11.665 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 80/171 2024-01-31T04:59:11.714 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/171 2024-01-31T04:59:11.717 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/171 2024-01-31T04:59:11.794 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 82/171 2024-01-31T04:59:11.803 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 82/171 2024-01-31T04:59:11.834 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 83/171 2024-01-31T04:59:11.845 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 83/171 2024-01-31T04:59:12.012 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : openblas-0.3.21-2.el9.x86_64 84/171 2024-01-31T04:59:12.022 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openblas-0.3.21-2.el9.x86_64 84/171 2024-01-31T04:59:12.049 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 85/171 2024-01-31T04:59:12.051 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 85/171 2024-01-31T04:59:12.125 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 86/171 2024-01-31T04:59:12.127 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 86/171 2024-01-31T04:59:12.655 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 89/171 2024-01-31T04:59:12.741 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 90/171 2024-01-31T04:59:12.750 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 87/171 2024-01-31T04:59:12.764 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 87/171 2024-01-31T04:59:12.769 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 91/171 2024-01-31T04:59:12.801 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 92/171 2024-01-31T04:59:12.871 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 88/171 2024-01-31T04:59:12.880 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 88/171 2024-01-31T04:59:13.108 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 93/171 2024-01-31T04:59:13.131 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : librbd1-2:19.0.0-885.g661946e7.el9.x86_64 94/171 2024-01-31T04:59:13.214 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librbd1-2:19.0.0-885.g661946e7.el9.x86_64 94/171 2024-01-31T04:59:13.244 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rbd-2:19.0.0-885.g661946e7.el9.x86_64 95/171 2024-01-31T04:59:13.280 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 96/171 2024-01-31T04:59:13.700 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 97/171 2024-01-31T04:59:13.726 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librgw2-2:19.0.0-885.g661946e7.el9.x86_64 98/171 2024-01-31T04:59:13.797 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librgw2-2:19.0.0-885.g661946e7.el9.x86_64 98/171 2024-01-31T04:59:13.827 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rgw-2:19.0.0-885.g661946e7.el9.x86_64 99/171 2024-01-31T04:59:14.080 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 89/171 2024-01-31T04:59:14.095 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 89/171 2024-01-31T04:59:14.155 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 90/171 2024-01-31T04:59:14.178 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 90/171 2024-01-31T04:59:14.182 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 91/171 2024-01-31T04:59:14.206 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 91/171 2024-01-31T04:59:14.215 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 92/171 2024-01-31T04:59:14.239 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 92/171 2024-01-31T04:59:14.524 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 93/171 2024-01-31T04:59:14.548 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 93/171 2024-01-31T04:59:14.553 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : librbd1-2:19.0.0-885.g661946e7.el9.x86_64 94/171 2024-01-31T04:59:14.576 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : librbd1-2:19.0.0-885.g661946e7.el9.x86_64 94/171 2024-01-31T04:59:14.643 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librbd1-2:19.0.0-885.g661946e7.el9.x86_64 94/171 2024-01-31T04:59:14.648 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librbd1-2:19.0.0-885.g661946e7.el9.x86_64 94/171 2024-01-31T04:59:14.674 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rbd-2:19.0.0-885.g661946e7.el9.x86_64 95/171 2024-01-31T04:59:14.681 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rbd-2:19.0.0-885.g661946e7.el9.x86_64 95/171 2024-01-31T04:59:14.711 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 96/171 2024-01-31T04:59:14.726 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 96/171 2024-01-31T04:59:15.140 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 97/171 2024-01-31T04:59:15.156 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 97/171 2024-01-31T04:59:15.173 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librgw2-2:19.0.0-885.g661946e7.el9.x86_64 98/171 2024-01-31T04:59:15.189 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librgw2-2:19.0.0-885.g661946e7.el9.x86_64 98/171 2024-01-31T04:59:15.227 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librgw2-2:19.0.0-885.g661946e7.el9.x86_64 98/171 2024-01-31T04:59:15.250 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rgw-2:19.0.0-885.g661946e7.el9.x86_64 99/171 2024-01-31T04:59:15.259 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librgw2-2:19.0.0-885.g661946e7.el9.x86_64 98/171 2024-01-31T04:59:15.282 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rgw-2:19.0.0-885.g661946e7.el9.x86_64 99/171 2024-01-31T04:59:15.989 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 100/171 2024-01-31T04:59:16.041 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 100/171 2024-01-31T04:59:16.567 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 100/171 2024-01-31T04:59:16.603 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-base-2:19.0.0-885.g661946e7.el9.x86_64 101/171 2024-01-31T04:59:16.698 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-base-2:19.0.0-885.g661946e7.el9.x86_64 101/171 2024-01-31T04:59:16.698 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-01-31T04:59:16.698 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-01-31T04:59:16.698 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T04:59:16.737 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-selinux-2:19.0.0-885.g661946e7.el9.x86_64 102/171 2024-01-31T04:59:17.353 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 100/171 2024-01-31T04:59:17.389 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 100/171 2024-01-31T04:59:17.428 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 100/171 2024-01-31T04:59:17.462 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 100/171 2024-01-31T04:59:17.906 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 100/171 2024-01-31T04:59:17.942 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-base-2:19.0.0-885.g661946e7.el9.x86_64 101/171 2024-01-31T04:59:17.980 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 100/171 2024-01-31T04:59:18.024 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-base-2:19.0.0-885.g661946e7.el9.x86_64 101/171 2024-01-31T04:59:18.024 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-base-2:19.0.0-885.g661946e7.el9.x86_64 101/171 2024-01-31T04:59:18.024 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-01-31T04:59:18.024 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-01-31T04:59:18.024 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-01-31T04:59:18.060 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-selinux-2:19.0.0-885.g661946e7.el9.x86_64 102/171 2024-01-31T04:59:18.105 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-base-2:19.0.0-885.g661946e7.el9.x86_64 101/171 2024-01-31T04:59:18.105 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-01-31T04:59:18.105 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-01-31T04:59:18.106 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-31T04:59:18.142 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-selinux-2:19.0.0-885.g661946e7.el9.x86_64 102/171 2024-01-31T04:59:28.153 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-selinux-2:19.0.0-885.g661946e7.el9.x86_64 102/171 2024-01-31T04:59:28.153 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /sys 2024-01-31T04:59:28.154 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /proc 2024-01-31T04:59:28.154 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /mnt 2024-01-31T04:59:28.154 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /var/tmp 2024-01-31T04:59:28.154 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /home 2024-01-31T04:59:28.154 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /root 2024-01-31T04:59:28.154 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /tmp 2024-01-31T04:59:28.154 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T04:59:28.319 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-volume-2:19.0.0-885.g661946e7.el9.noarch 103/171 2024-01-31T04:59:28.335 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-volume-2:19.0.0-885.g661946e7.el9.noarch 103/171 2024-01-31T04:59:28.335 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-31T04:59:28.335 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-01-31T04:59:28.335 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T04:59:29.279 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-selinux-2:19.0.0-885.g661946e7.el9.x86_64 102/171 2024-01-31T04:59:29.279 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /sys 2024-01-31T04:59:29.279 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /proc 2024-01-31T04:59:29.279 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /mnt 2024-01-31T04:59:29.279 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /var/tmp 2024-01-31T04:59:29.279 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /home 2024-01-31T04:59:29.280 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /root 2024-01-31T04:59:29.280 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /tmp 2024-01-31T04:59:29.280 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-31T04:59:29.453 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-volume-2:19.0.0-885.g661946e7.el9.noarch 103/171 2024-01-31T04:59:29.469 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-volume-2:19.0.0-885.g661946e7.el9.noarch 103/171 2024-01-31T04:59:29.469 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-31T04:59:29.469 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-01-31T04:59:29.469 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-31T04:59:29.513 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-selinux-2:19.0.0-885.g661946e7.el9.x86_64 102/171 2024-01-31T04:59:29.513 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /sys 2024-01-31T04:59:29.513 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /proc 2024-01-31T04:59:29.513 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /mnt 2024-01-31T04:59:29.513 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /var/tmp 2024-01-31T04:59:29.513 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /home 2024-01-31T04:59:29.513 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /root 2024-01-31T04:59:29.513 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /tmp 2024-01-31T04:59:29.513 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-01-31T04:59:29.688 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-volume-2:19.0.0-885.g661946e7.el9.noarch 103/171 2024-01-31T04:59:29.703 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-volume-2:19.0.0-885.g661946e7.el9.noarch 103/171 2024-01-31T04:59:29.703 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-31T04:59:29.703 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-01-31T04:59:29.703 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-01-31T04:59:29.813 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-osd-2:19.0.0-885.g661946e7.el9.x86_64 104/171 2024-01-31T04:59:29.841 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-osd-2:19.0.0-885.g661946e7.el9.x86_64 104/171 2024-01-31T04:59:29.842 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-31T04:59:29.842 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-01-31T04:59:29.842 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-01-31T04:59:29.842 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-01-31T04:59:29.842 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T04:59:30.065 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mds-2:19.0.0-885.g661946e7.el9.x86_64 105/171 2024-01-31T04:59:30.088 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mds-2:19.0.0-885.g661946e7.el9.x86_64 105/171 2024-01-31T04:59:30.088 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-31T04:59:30.089 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-01-31T04:59:30.089 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-01-31T04:59:30.089 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-01-31T04:59:30.089 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T04:59:30.549 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mon-2:19.0.0-885.g661946e7.el9.x86_64 106/171 2024-01-31T04:59:30.572 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mon-2:19.0.0-885.g661946e7.el9.x86_64 106/171 2024-01-31T04:59:30.572 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-31T04:59:30.572 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-01-31T04:59:30.572 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-01-31T04:59:30.572 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-01-31T04:59:30.572 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T04:59:30.671 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : automake-1.16.2-8.el9.noarch 107/171 2024-01-31T04:59:30.727 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-ply-3.11-14.el9.noarch 108/171 2024-01-31T04:59:30.782 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 109/171 2024-01-31T04:59:30.940 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-osd-2:19.0.0-885.g661946e7.el9.x86_64 104/171 2024-01-31T04:59:30.964 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-osd-2:19.0.0-885.g661946e7.el9.x86_64 104/171 2024-01-31T04:59:30.964 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-31T04:59:30.964 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-01-31T04:59:30.964 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-01-31T04:59:30.964 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-01-31T04:59:30.964 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-31T04:59:30.966 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 110/171 2024-01-31T04:59:31.016 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 111/171 2024-01-31T04:59:31.093 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 112/171 2024-01-31T04:59:31.141 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-osd-2:19.0.0-885.g661946e7.el9.x86_64 104/171 2024-01-31T04:59:31.166 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-osd-2:19.0.0-885.g661946e7.el9.x86_64 104/171 2024-01-31T04:59:31.167 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-31T04:59:31.167 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-01-31T04:59:31.167 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-01-31T04:59:31.167 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-01-31T04:59:31.167 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-01-31T04:59:31.182 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 113/171 2024-01-31T04:59:31.182 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mds-2:19.0.0-885.g661946e7.el9.x86_64 105/171 2024-01-31T04:59:31.204 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mds-2:19.0.0-885.g661946e7.el9.x86_64 105/171 2024-01-31T04:59:31.204 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-31T04:59:31.204 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-01-31T04:59:31.204 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-01-31T04:59:31.204 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-01-31T04:59:31.204 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-31T04:59:31.330 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 114/171 2024-01-31T04:59:31.372 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 115/171 2024-01-31T04:59:31.383 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mds-2:19.0.0-885.g661946e7.el9.x86_64 105/171 2024-01-31T04:59:31.406 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mds-2:19.0.0-885.g661946e7.el9.x86_64 105/171 2024-01-31T04:59:31.406 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-31T04:59:31.406 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-01-31T04:59:31.406 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-01-31T04:59:31.406 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-01-31T04:59:31.406 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-01-31T04:59:31.407 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 116/171 2024-01-31T04:59:31.442 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 117/171 2024-01-31T04:59:31.475 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : jq-1.6-16.el9.x86_64 118/171 2024-01-31T04:59:31.502 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : fuse-2.9.9-15.el9.x86_64 119/171 2024-01-31T04:59:31.649 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mon-2:19.0.0-885.g661946e7.el9.x86_64 106/171 2024-01-31T04:59:31.671 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mon-2:19.0.0-885.g661946e7.el9.x86_64 106/171 2024-01-31T04:59:31.671 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-31T04:59:31.671 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-01-31T04:59:31.672 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-01-31T04:59:31.672 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-01-31T04:59:31.672 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-31T04:59:31.779 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : automake-1.16.2-8.el9.noarch 107/171 2024-01-31T04:59:31.844 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-ply-3.11-14.el9.noarch 108/171 2024-01-31T04:59:31.850 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mon-2:19.0.0-885.g661946e7.el9.x86_64 106/171 2024-01-31T04:59:31.873 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mon-2:19.0.0-885.g661946e7.el9.x86_64 106/171 2024-01-31T04:59:31.874 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-31T04:59:31.874 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-01-31T04:59:31.874 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-01-31T04:59:31.874 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-01-31T04:59:31.874 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-01-31T04:59:31.908 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 109/171 2024-01-31T04:59:31.947 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: cephadm-2:19.0.0-885.g661946e7.el9.noarch 120/171 2024-01-31T04:59:31.975 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : cephadm-2:19.0.0-885.g661946e7.el9.noarch 120/171 2024-01-31T04:59:31.980 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : automake-1.16.2-8.el9.noarch 107/171 2024-01-31T04:59:32.022 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-885.g661946e7.el 121/171 2024-01-31T04:59:32.029 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ply-3.11-14.el9.noarch 108/171 2024-01-31T04:59:32.083 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-885.g661946e7.e 122/171 2024-01-31T04:59:32.084 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 109/171 2024-01-31T04:59:32.091 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 110/171 2024-01-31T04:59:32.115 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-885.g661946e7.el9.noar 123/171 2024-01-31T04:59:32.141 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 111/171 2024-01-31T04:59:32.227 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 112/171 2024-01-31T04:59:32.268 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 110/171 2024-01-31T04:59:32.317 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 111/171 2024-01-31T04:59:32.337 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-885.g661946e7.el9.noar 123/171 2024-01-31T04:59:32.340 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 113/171 2024-01-31T04:59:32.366 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-885.g661946e7.el9.no 124/171 2024-01-31T04:59:32.395 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 112/171 2024-01-31T04:59:32.470 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 114/171 2024-01-31T04:59:32.506 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 113/171 2024-01-31T04:59:32.508 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 115/171 2024-01-31T04:59:32.551 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 116/171 2024-01-31T04:59:32.581 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 117/171 2024-01-31T04:59:32.625 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : jq-1.6-16.el9.x86_64 118/171 2024-01-31T04:59:32.639 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 114/171 2024-01-31T04:59:32.661 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : fuse-2.9.9-15.el9.x86_64 119/171 2024-01-31T04:59:32.676 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 115/171 2024-01-31T04:59:32.709 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 116/171 2024-01-31T04:59:32.741 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 117/171 2024-01-31T04:59:32.776 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : jq-1.6-16.el9.x86_64 118/171 2024-01-31T04:59:32.804 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : fuse-2.9.9-15.el9.x86_64 119/171 2024-01-31T04:59:33.057 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: cephadm-2:19.0.0-885.g661946e7.el9.noarch 120/171 2024-01-31T04:59:33.084 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephadm-2:19.0.0-885.g661946e7.el9.noarch 120/171 2024-01-31T04:59:33.114 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-885.g661946e7.el 121/171 2024-01-31T04:59:33.174 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-885.g661946e7.e 122/171 2024-01-31T04:59:33.199 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-885.g661946e7.el9.noar 123/171 2024-01-31T04:59:33.207 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: cephadm-2:19.0.0-885.g661946e7.el9.noarch 120/171 2024-01-31T04:59:33.235 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephadm-2:19.0.0-885.g661946e7.el9.noarch 120/171 2024-01-31T04:59:33.265 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-885.g661946e7.el 121/171 2024-01-31T04:59:33.317 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-885.g661946e7.e 122/171 2024-01-31T04:59:33.327 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-885.g661946e7.el9.no 124/171 2024-01-31T04:59:33.342 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-885.g661946e7.el9.noar 123/171 2024-01-31T04:59:33.349 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-885.g6619 125/171 2024-01-31T04:59:33.420 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-885.g661946e7.el9.noar 123/171 2024-01-31T04:59:33.451 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-885.g6619 125/171 2024-01-31T04:59:33.458 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-885.g661946e7.el9.no 124/171 2024-01-31T04:59:33.562 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-885.g661946e7.el9.noar 123/171 2024-01-31T04:59:33.592 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-885.g661946e7.el9.no 124/171 2024-01-31T04:59:33.619 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-885.g661946e7.el9 126/171 2024-01-31T04:59:33.651 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-2:19.0.0-885.g661946e7.el9.x86_64 127/171 2024-01-31T04:59:33.675 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-2:19.0.0-885.g661946e7.el9.x86_64 127/171 2024-01-31T04:59:33.675 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-31T04:59:33.675 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-01-31T04:59:33.675 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-01-31T04:59:33.675 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-01-31T04:59:33.675 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T04:59:33.719 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-rook-2:19.0.0-885.g661946e7.el9.noarch 128/171 2024-01-31T04:59:33.730 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-885.g661946e7.el9.noarch 128/171 2024-01-31T04:59:33.827 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-2:19.0.0-885.g661946e7.el9.x86_64 129/171 2024-01-31T04:59:34.426 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-885.g661946e7.el9.no 124/171 2024-01-31T04:59:34.459 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-885.g6619 125/171 2024-01-31T04:59:34.557 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-885.g6619 125/171 2024-01-31T04:59:34.559 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-885.g661946e7.el9.no 124/171 2024-01-31T04:59:34.585 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-885.g6619 125/171 2024-01-31T04:59:34.683 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-885.g6619 125/171 2024-01-31T04:59:34.722 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-885.g661946e7.el9 126/171 2024-01-31T04:59:34.752 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-2:19.0.0-885.g661946e7.el9.x86_64 127/171 2024-01-31T04:59:34.775 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-2:19.0.0-885.g661946e7.el9.x86_64 127/171 2024-01-31T04:59:34.775 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-31T04:59:34.775 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-01-31T04:59:34.776 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-01-31T04:59:34.776 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-01-31T04:59:34.776 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-31T04:59:34.820 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-rook-2:19.0.0-885.g661946e7.el9.noarch 128/171 2024-01-31T04:59:34.831 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-885.g661946e7.el9.noarch 128/171 2024-01-31T04:59:34.847 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-885.g661946e7.el9 126/171 2024-01-31T04:59:34.879 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-2:19.0.0-885.g661946e7.el9.x86_64 127/171 2024-01-31T04:59:34.902 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-2:19.0.0-885.g661946e7.el9.x86_64 127/171 2024-01-31T04:59:34.903 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-31T04:59:34.903 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-01-31T04:59:34.903 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-01-31T04:59:34.903 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-01-31T04:59:34.903 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-01-31T04:59:34.928 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-2:19.0.0-885.g661946e7.el9.x86_64 129/171 2024-01-31T04:59:34.946 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-rook-2:19.0.0-885.g661946e7.el9.noarch 128/171 2024-01-31T04:59:34.957 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-885.g661946e7.el9.noarch 128/171 2024-01-31T04:59:35.054 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-2:19.0.0-885.g661946e7.el9.x86_64 129/171 2024-01-31T04:59:38.096 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-fuse-2:19.0.0-885.g661946e7.el9.x86_64 130/171 2024-01-31T04:59:38.170 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-test-2:19.0.0-885.g661946e7.el9.x86_64 131/171 2024-01-31T04:59:38.945 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libtool-2.4.6-45.el9.x86_64 132/171 2024-01-31T04:59:38.974 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-radosgw-2:19.0.0-885.g661946e7.el9.x86_64 133/171 2024-01-31T04:59:38.997 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-885.g661946e7.el9.x86_64 133/171 2024-01-31T04:59:38.997 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-31T04:59:38.997 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-01-31T04:59:38.997 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-01-31T04:59:38.997 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-01-31T04:59:38.997 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T04:59:39.041 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-885.g661946 134/171 2024-01-31T04:59:39.063 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-885.g661946 134/171 2024-01-31T04:59:39.063 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-31T04:59:39.063 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-01-31T04:59:39.063 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T04:59:39.108 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : cephfs-mirror-2:19.0.0-885.g661946e7.el9.x86_64 135/171 2024-01-31T04:59:39.131 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-885.g661946e7.el9.x86_64 135/171 2024-01-31T04:59:39.131 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-31T04:59:39.131 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-01-31T04:59:39.131 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-01-31T04:59:39.131 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-01-31T04:59:39.131 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T04:59:39.219 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-fuse-2:19.0.0-885.g661946e7.el9.x86_64 130/171 2024-01-31T04:59:39.288 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-test-2:19.0.0-885.g661946e7.el9.x86_64 131/171 2024-01-31T04:59:39.347 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-fuse-2:19.0.0-885.g661946e7.el9.x86_64 130/171 2024-01-31T04:59:39.405 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-test-2:19.0.0-885.g661946e7.el9.x86_64 131/171 2024-01-31T04:59:39.434 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-mirror-2:19.0.0-885.g661946e7.el9.x86_64 136/171 2024-01-31T04:59:39.456 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: rbd-mirror-2:19.0.0-885.g661946e7.el9.x86_64 136/171 2024-01-31T04:59:39.456 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-31T04:59:39.457 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-01-31T04:59:39.457 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-01-31T04:59:39.457 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-01-31T04:59:39.457 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T04:59:39.508 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-fuse-2:19.0.0-885.g661946e7.el9.x86_64 137/171 2024-01-31T04:59:39.550 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-nbd-2:19.0.0-885.g661946e7.el9.x86_64 138/171 2024-01-31T04:59:39.582 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 139/171 2024-01-31T04:59:39.608 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 140/171 2024-01-31T04:59:39.802 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : cephfs-shell-2:19.0.0-885.g661946e7.el9.x86_64 141/171 2024-01-31T04:59:39.847 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 142/171 2024-01-31T04:59:39.871 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephfs-devel-2:19.0.0-885.g661946e7.el9.x86_6 143/171 2024-01-31T04:59:39.895 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 144/171 2024-01-31T04:59:39.925 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : NetworkManager-team-1:1.45.10-1.el9.x86_64 145/171 2024-01-31T04:59:39.980 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : NetworkManager-tui-1:1.45.10-1.el9.x86_64 146/171 2024-01-31T04:59:40.049 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 147/171 2024-01-31T04:59:40.082 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 148/171 2024-01-31T04:59:40.085 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libtool-2.4.6-45.el9.x86_64 132/171 2024-01-31T04:59:40.128 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-radosgw-2:19.0.0-885.g661946e7.el9.x86_64 133/171 2024-01-31T04:59:40.149 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-885.g661946e7.el9.x86_64 133/171 2024-01-31T04:59:40.149 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-31T04:59:40.149 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-01-31T04:59:40.150 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-01-31T04:59:40.150 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-01-31T04:59:40.150 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-31T04:59:40.179 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libtool-2.4.6-45.el9.x86_64 132/171 2024-01-31T04:59:40.193 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-885.g661946 134/171 2024-01-31T04:59:40.210 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-radosgw-2:19.0.0-885.g661946e7.el9.x86_64 133/171 2024-01-31T04:59:40.215 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-885.g661946 134/171 2024-01-31T04:59:40.215 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-31T04:59:40.215 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-01-31T04:59:40.215 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-31T04:59:40.234 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-885.g661946e7.el9.x86_64 133/171 2024-01-31T04:59:40.234 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-31T04:59:40.234 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-01-31T04:59:40.234 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-01-31T04:59:40.234 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-01-31T04:59:40.234 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-01-31T04:59:40.261 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephfs-mirror-2:19.0.0-885.g661946e7.el9.x86_64 135/171 2024-01-31T04:59:40.278 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-885.g661946 134/171 2024-01-31T04:59:40.283 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-885.g661946e7.el9.x86_64 135/171 2024-01-31T04:59:40.283 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-31T04:59:40.283 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-01-31T04:59:40.283 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-01-31T04:59:40.283 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-01-31T04:59:40.283 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-31T04:59:40.299 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-885.g661946 134/171 2024-01-31T04:59:40.299 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-31T04:59:40.300 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-01-31T04:59:40.300 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-01-31T04:59:40.345 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephfs-mirror-2:19.0.0-885.g661946e7.el9.x86_64 135/171 2024-01-31T04:59:40.367 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-885.g661946e7.el9.x86_64 135/171 2024-01-31T04:59:40.367 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-31T04:59:40.368 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-01-31T04:59:40.368 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-01-31T04:59:40.368 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-01-31T04:59:40.368 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-01-31T04:59:40.595 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : rbd-mirror-2:19.0.0-885.g661946e7.el9.x86_64 136/171 2024-01-31T04:59:40.618 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: rbd-mirror-2:19.0.0-885.g661946e7.el9.x86_64 136/171 2024-01-31T04:59:40.618 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-31T04:59:40.618 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-01-31T04:59:40.618 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-01-31T04:59:40.618 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-01-31T04:59:40.618 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-31T04:59:40.670 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : rbd-fuse-2:19.0.0-885.g661946e7.el9.x86_64 137/171 2024-01-31T04:59:40.679 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-mirror-2:19.0.0-885.g661946e7.el9.x86_64 136/171 2024-01-31T04:59:40.701 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: rbd-mirror-2:19.0.0-885.g661946e7.el9.x86_64 136/171 2024-01-31T04:59:40.702 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-31T04:59:40.702 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-01-31T04:59:40.702 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-01-31T04:59:40.702 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-01-31T04:59:40.702 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-01-31T04:59:40.704 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/171 2024-01-31T04:59:40.718 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : rbd-nbd-2:19.0.0-885.g661946e7.el9.x86_64 138/171 2024-01-31T04:59:40.753 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-fuse-2:19.0.0-885.g661946e7.el9.x86_64 137/171 2024-01-31T04:59:40.759 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 139/171 2024-01-31T04:59:40.762 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 149/171 2024-01-31T04:59:40.786 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 140/171 2024-01-31T04:59:40.794 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-nbd-2:19.0.0-885.g661946e7.el9.x86_64 138/171 2024-01-31T04:59:40.803 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/171 2024-01-31T04:59:40.826 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 139/171 2024-01-31T04:59:40.854 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 140/171 2024-01-31T04:59:40.860 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 150/171 2024-01-31T04:59:40.965 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephfs-shell-2:19.0.0-885.g661946e7.el9.x86_64 141/171 2024-01-31T04:59:41.016 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 142/171 2024-01-31T04:59:41.033 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephfs-shell-2:19.0.0-885.g661946e7.el9.x86_64 141/171 2024-01-31T04:59:41.049 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcephfs-devel-2:19.0.0-885.g661946e7.el9.x86_6 143/171 2024-01-31T04:59:41.075 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 142/171 2024-01-31T04:59:41.081 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 144/171 2024-01-31T04:59:41.107 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephfs-devel-2:19.0.0-885.g661946e7.el9.x86_6 143/171 2024-01-31T04:59:41.119 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : NetworkManager-team-1:1.45.10-1.el9.x86_64 145/171 2024-01-31T04:59:41.148 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 144/171 2024-01-31T04:59:41.180 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : NetworkManager-team-1:1.45.10-1.el9.x86_64 145/171 2024-01-31T04:59:41.182 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : NetworkManager-tui-1:1.45.10-1.el9.x86_64 146/171 2024-01-31T04:59:41.232 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : NetworkManager-tui-1:1.45.10-1.el9.x86_64 146/171 2024-01-31T04:59:41.233 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 147/171 2024-01-31T04:59:41.268 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 148/171 2024-01-31T04:59:41.292 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 147/171 2024-01-31T04:59:41.326 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 148/171 2024-01-31T04:59:41.678 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : cephfs-top-2:19.0.0-885.g661946e7.el9.noarch 151/171 2024-01-31T04:59:41.784 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 152/171 2024-01-31T04:59:41.870 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flex-2.6.4-9.el9.x86_64 153/171 2024-01-31T04:59:41.876 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/171 2024-01-31T04:59:41.895 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/171 2024-01-31T04:59:41.903 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : bison-3.7.4-5.el9.x86_64 154/171 2024-01-31T04:59:41.918 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 149/171 2024-01-31T04:59:41.928 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 155/171 2024-01-31T04:59:41.933 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 149/171 2024-01-31T04:59:41.944 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/171 2024-01-31T04:59:41.959 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/171 2024-01-31T04:59:41.962 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 156/171 2024-01-31T04:59:41.988 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 157/171 2024-01-31T04:59:42.007 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 150/171 2024-01-31T04:59:42.017 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 158/171 2024-01-31T04:59:42.079 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/171 2024-01-31T04:59:42.080 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 150/171 2024-01-31T04:59:42.111 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/171 2024-01-31T04:59:42.147 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 160/171 2024-01-31T04:59:42.174 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 161/171 2024-01-31T04:59:42.199 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 162/171 2024-01-31T04:59:42.224 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 163/171 2024-01-31T04:59:42.224 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 164/171 2024-01-31T04:59:42.317 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 164/171 2024-01-31T04:59:42.342 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 165/171 2024-01-31T04:59:42.348 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2024-01-31T04:59:42.349 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2024-01-31T04:59:42.528 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2024-01-31T04:59:42.528 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 167/171 2024-01-31T04:59:42.620 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 167/171 2024-01-31T04:59:42.644 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 168/171 2024-01-31T04:59:42.671 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 169/171 2024-01-31T04:59:42.712 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 170/171 2024-01-31T04:59:42.778 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 171/171 2024-01-31T04:59:42.831 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephfs-top-2:19.0.0-885.g661946e7.el9.noarch 151/171 2024-01-31T04:59:42.841 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephfs-top-2:19.0.0-885.g661946e7.el9.noarch 151/171 2024-01-31T04:59:42.922 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 152/171 2024-01-31T04:59:42.962 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 152/171 2024-01-31T04:59:43.011 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : flex-2.6.4-9.el9.x86_64 153/171 2024-01-31T04:59:43.042 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flex-2.6.4-9.el9.x86_64 153/171 2024-01-31T04:59:43.042 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : bison-3.7.4-5.el9.x86_64 154/171 2024-01-31T04:59:43.068 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 155/171 2024-01-31T04:59:43.091 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : bison-3.7.4-5.el9.x86_64 154/171 2024-01-31T04:59:43.092 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 156/171 2024-01-31T04:59:43.116 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 155/171 2024-01-31T04:59:43.118 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 157/171 2024-01-31T04:59:43.141 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 156/171 2024-01-31T04:59:43.144 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 158/171 2024-01-31T04:59:43.144 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/171 2024-01-31T04:59:43.167 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 157/171 2024-01-31T04:59:43.193 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 158/171 2024-01-31T04:59:43.193 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/171 2024-01-31T04:59:43.235 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/171 2024-01-31T04:59:43.271 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 160/171 2024-01-31T04:59:43.272 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/171 2024-01-31T04:59:43.304 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 161/171 2024-01-31T04:59:43.310 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 160/171 2024-01-31T04:59:43.330 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 162/171 2024-01-31T04:59:43.336 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 161/171 2024-01-31T04:59:43.355 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 163/171 2024-01-31T04:59:43.355 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 164/171 2024-01-31T04:59:43.361 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 162/171 2024-01-31T04:59:43.412 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 163/171 2024-01-31T04:59:43.412 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 164/171 2024-01-31T04:59:43.423 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 164/171 2024-01-31T04:59:43.448 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 165/171 2024-01-31T04:59:43.454 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2024-01-31T04:59:43.454 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2024-01-31T04:59:43.479 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 164/171 2024-01-31T04:59:43.504 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 165/171 2024-01-31T04:59:43.511 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2024-01-31T04:59:43.511 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2024-01-31T04:59:43.634 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2024-01-31T04:59:43.634 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 167/171 2024-01-31T04:59:43.690 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2024-01-31T04:59:43.690 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 167/171 2024-01-31T04:59:43.718 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 167/171 2024-01-31T04:59:43.750 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 168/171 2024-01-31T04:59:43.777 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 169/171 2024-01-31T04:59:43.782 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 167/171 2024-01-31T04:59:43.807 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 168/171 2024-01-31T04:59:43.810 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 170/171 2024-01-31T04:59:43.833 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 169/171 2024-01-31T04:59:43.868 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 170/171 2024-01-31T04:59:43.873 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 171/171 2024-01-31T04:59:43.930 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 171/171 2024-01-31T04:59:47.798 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 171/171 2024-01-31T04:59:47.798 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-2:19.0.0-885.g661946e7.el9.x86_64 1/171 2024-01-31T04:59:47.798 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-base-2:19.0.0-885.g661946e7.el9.x86_64 2/171 2024-01-31T04:59:47.798 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 3/171 2024-01-31T04:59:47.799 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-fuse-2:19.0.0-885.g661946e7.el9.x86_64 4/171 2024-01-31T04:59:47.799 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-885.g661946 5/171 2024-01-31T04:59:47.799 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mds-2:19.0.0-885.g661946e7.el9.x86_64 6/171 2024-01-31T04:59:47.799 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-2:19.0.0-885.g661946e7.el9.x86_64 7/171 2024-01-31T04:59:47.799 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mon-2:19.0.0-885.g661946e7.el9.x86_64 8/171 2024-01-31T04:59:47.799 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-osd-2:19.0.0-885.g661946e7.el9.x86_64 9/171 2024-01-31T04:59:47.799 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-radosgw-2:19.0.0-885.g661946e7.el9.x86_64 10/171 2024-01-31T04:59:47.799 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-selinux-2:19.0.0-885.g661946e7.el9.x86_64 11/171 2024-01-31T04:59:47.799 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-test-2:19.0.0-885.g661946e7.el9.x86_64 12/171 2024-01-31T04:59:47.799 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : cephfs-mirror-2:19.0.0-885.g661946e7.el9.x86_64 13/171 2024-01-31T04:59:47.799 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : cephfs-shell-2:19.0.0-885.g661946e7.el9.x86_64 14/171 2024-01-31T04:59:47.799 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephfs-devel-2:19.0.0-885.g661946e7.el9.x86_6 15/171 2024-01-31T04:59:47.799 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephfs2-2:19.0.0-885.g661946e7.el9.x86_64 16/171 2024-01-31T04:59:47.800 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephsqlite-2:19.0.0-885.g661946e7.el9.x86_64 17/171 2024-01-31T04:59:47.800 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados-devel-2:19.0.0-885.g661946e7.el9.x86_64 18/171 2024-01-31T04:59:47.800 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libradosstriper1-2:19.0.0-885.g661946e7.el9.x86_ 19/171 2024-01-31T04:59:47.800 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librgw2-2:19.0.0-885.g661946e7.el9.x86_64 20/171 2024-01-31T04:59:47.800 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-ceph-argparse-2:19.0.0-885.g661946e7.el9 21/171 2024-01-31T04:59:47.800 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-ceph-common-2:19.0.0-885.g661946e7.el9.x 22/171 2024-01-31T04:59:47.800 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cephfs-2:19.0.0-885.g661946e7.el9.x86_64 23/171 2024-01-31T04:59:47.800 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rados-2:19.0.0-885.g661946e7.el9.x86_64 24/171 2024-01-31T04:59:47.800 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rbd-2:19.0.0-885.g661946e7.el9.x86_64 25/171 2024-01-31T04:59:47.800 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rgw-2:19.0.0-885.g661946e7.el9.x86_64 26/171 2024-01-31T04:59:47.800 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-fuse-2:19.0.0-885.g661946e7.el9.x86_64 27/171 2024-01-31T04:59:47.800 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-mirror-2:19.0.0-885.g661946e7.el9.x86_64 28/171 2024-01-31T04:59:47.800 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-nbd-2:19.0.0-885.g661946e7.el9.x86_64 29/171 2024-01-31T04:59:47.800 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-885.g661946e7.e 30/171 2024-01-31T04:59:47.817 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-885.g661946e7.el9.noar 31/171 2024-01-31T04:59:47.817 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-885.g661946e7.el9.no 32/171 2024-01-31T04:59:47.817 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-885.g6619 33/171 2024-01-31T04:59:47.817 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-885.g661946e7.el9 34/171 2024-01-31T04:59:47.817 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-rook-2:19.0.0-885.g661946e7.el9.noarch 35/171 2024-01-31T04:59:47.817 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-885.g661946e7.el 36/171 2024-01-31T04:59:47.818 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-volume-2:19.0.0-885.g661946e7.el9.noarch 37/171 2024-01-31T04:59:47.818 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : cephadm-2:19.0.0-885.g661946e7.el9.noarch 38/171 2024-01-31T04:59:47.818 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : cephfs-top-2:19.0.0-885.g661946e7.el9.noarch 39/171 2024-01-31T04:59:47.818 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 40/171 2024-01-31T04:59:47.818 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 41/171 2024-01-31T04:59:47.818 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : jq-1.6-16.el9.x86_64 42/171 2024-01-31T04:59:47.818 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 43/171 2024-01-31T04:59:47.818 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 44/171 2024-01-31T04:59:47.818 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 45/171 2024-01-31T04:59:47.818 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/171 2024-01-31T04:59:47.818 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/171 2024-01-31T04:59:47.818 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/171 2024-01-31T04:59:47.818 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/171 2024-01-31T04:59:47.818 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/171 2024-01-31T04:59:47.819 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 51/171 2024-01-31T04:59:47.819 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : automake-1.16.2-8.el9.noarch 52/171 2024-01-31T04:59:47.819 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : bison-3.7.4-5.el9.x86_64 53/171 2024-01-31T04:59:47.819 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 54/171 2024-01-31T04:59:47.819 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 55/171 2024-01-31T04:59:47.819 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flex-2.6.4-9.el9.x86_64 56/171 2024-01-31T04:59:47.819 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 57/171 2024-01-31T04:59:47.819 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 58/171 2024-01-31T04:59:47.819 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 59/171 2024-01-31T04:59:47.819 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 60/171 2024-01-31T04:59:47.819 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 61/171 2024-01-31T04:59:47.819 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 62/171 2024-01-31T04:59:47.819 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 63/171 2024-01-31T04:59:47.820 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 64/171 2024-01-31T04:59:47.820 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 65/171 2024-01-31T04:59:47.820 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 66/171 2024-01-31T04:59:47.820 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : lua-5.4.4-4.el9.x86_64 67/171 2024-01-31T04:59:47.820 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 68/171 2024-01-31T04:59:47.820 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 69/171 2024-01-31T04:59:47.820 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 70/171 2024-01-31T04:59:47.820 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : postgresql-13.11-1.el9.x86_64 71/171 2024-01-31T04:59:47.820 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 72/171 2024-01-31T04:59:47.820 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 73/171 2024-01-31T04:59:47.820 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 74/171 2024-01-31T04:59:47.820 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/171 2024-01-31T04:59:47.820 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/171 2024-01-31T04:59:47.821 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 77/171 2024-01-31T04:59:47.821 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 78/171 2024-01-31T04:59:47.821 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/171 2024-01-31T04:59:47.821 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/171 2024-01-31T04:59:47.821 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/171 2024-01-31T04:59:47.821 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/171 2024-01-31T04:59:47.821 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/171 2024-01-31T04:59:47.821 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/171 2024-01-31T04:59:47.822 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/171 2024-01-31T04:59:47.822 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/171 2024-01-31T04:59:47.822 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 87/171 2024-01-31T04:59:47.822 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 88/171 2024-01-31T04:59:47.822 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 89/171 2024-01-31T04:59:47.822 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 90/171 2024-01-31T04:59:47.822 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 91/171 2024-01-31T04:59:47.822 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 92/171 2024-01-31T04:59:47.822 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 93/171 2024-01-31T04:59:47.822 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 94/171 2024-01-31T04:59:47.822 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 95/171 2024-01-31T04:59:47.822 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 96/171 2024-01-31T04:59:47.822 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 97/171 2024-01-31T04:59:47.823 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 98/171 2024-01-31T04:59:47.823 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 99/171 2024-01-31T04:59:47.823 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 100/171 2024-01-31T04:59:47.823 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 101/171 2024-01-31T04:59:47.823 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 102/171 2024-01-31T04:59:47.823 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 103/171 2024-01-31T04:59:47.823 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 104/171 2024-01-31T04:59:47.823 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 105/171 2024-01-31T04:59:47.823 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 106/171 2024-01-31T04:59:47.823 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 107/171 2024-01-31T04:59:47.823 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 108/171 2024-01-31T04:59:47.823 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 109/171 2024-01-31T04:59:47.823 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 110/171 2024-01-31T04:59:47.823 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 111/171 2024-01-31T04:59:47.823 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 112/171 2024-01-31T04:59:47.824 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 113/171 2024-01-31T04:59:47.824 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 114/171 2024-01-31T04:59:47.824 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-google-auth-1:2.26.2-1.el9.noarch 115/171 2024-01-31T04:59:47.824 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 116/171 2024-01-31T04:59:47.824 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 117/171 2024-01-31T04:59:47.824 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 118/171 2024-01-31T04:59:47.824 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 119/171 2024-01-31T04:59:47.824 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 120/171 2024-01-31T04:59:47.824 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 121/171 2024-01-31T04:59:47.825 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 122/171 2024-01-31T04:59:47.825 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 123/171 2024-01-31T04:59:47.825 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 124/171 2024-01-31T04:59:47.825 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 125/171 2024-01-31T04:59:47.825 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 126/171 2024-01-31T04:59:47.825 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 127/171 2024-01-31T04:59:47.825 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 128/171 2024-01-31T04:59:47.825 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 129/171 2024-01-31T04:59:47.825 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 130/171 2024-01-31T04:59:47.825 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 131/171 2024-01-31T04:59:47.825 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 132/171 2024-01-31T04:59:47.825 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 133/171 2024-01-31T04:59:47.826 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 134/171 2024-01-31T04:59:47.826 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 135/171 2024-01-31T04:59:47.826 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 136/171 2024-01-31T04:59:47.826 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 137/171 2024-01-31T04:59:47.826 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : re2-1:20211101-3.el9.x86_64 138/171 2024-01-31T04:59:47.826 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 139/171 2024-01-31T04:59:47.826 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados2-2:19.0.0-885.g661946e7.el9.x86_64 140/171 2024-01-31T04:59:47.826 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 141/171 2024-01-31T04:59:47.826 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librbd1-2:19.0.0-885.g661946e7.el9.x86_64 142/171 2024-01-31T04:59:47.826 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 143/171 2024-01-31T04:59:47.826 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-1:1.45.10-1.el9.x86_64 144/171 2024-01-31T04:59:47.826 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 145/171 2024-01-31T04:59:47.826 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-libnm-1:1.45.10-1.el9.x86_64 146/171 2024-01-31T04:59:47.826 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 147/171 2024-01-31T04:59:47.827 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-team-1:1.45.10-1.el9.x86_64 148/171 2024-01-31T04:59:47.827 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 149/171 2024-01-31T04:59:47.827 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-tui-1:1.45.10-1.el9.x86_64 150/171 2024-01-31T04:59:47.827 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 151/171 2024-01-31T04:59:47.827 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : acl-2.3.1-4.el9.x86_64 152/171 2024-01-31T04:59:47.827 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : acl-2.3.1-3.el9.x86_64 153/171 2024-01-31T04:59:47.827 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 154/171 2024-01-31T04:59:47.827 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 155/171 2024-01-31T04:59:47.827 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 156/171 2024-01-31T04:59:47.827 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 157/171 2024-01-31T04:59:47.827 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 158/171 2024-01-31T04:59:47.827 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 159/171 2024-01-31T04:59:47.827 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 160/171 2024-01-31T04:59:47.827 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 161/171 2024-01-31T04:59:47.828 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 162/171 2024-01-31T04:59:47.828 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 163/171 2024-01-31T04:59:47.828 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 164/171 2024-01-31T04:59:47.828 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 165/171 2024-01-31T04:59:47.828 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 166/171 2024-01-31T04:59:47.828 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 167/171 2024-01-31T04:59:47.828 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 168/171 2024-01-31T04:59:47.828 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 169/171 2024-01-31T04:59:47.828 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 170/171 2024-01-31T04:59:48.805 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 171/171 2024-01-31T04:59:48.805 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-2:19.0.0-885.g661946e7.el9.x86_64 1/171 2024-01-31T04:59:48.805 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-base-2:19.0.0-885.g661946e7.el9.x86_64 2/171 2024-01-31T04:59:48.805 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 3/171 2024-01-31T04:59:48.805 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-fuse-2:19.0.0-885.g661946e7.el9.x86_64 4/171 2024-01-31T04:59:48.806 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-885.g661946 5/171 2024-01-31T04:59:48.806 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mds-2:19.0.0-885.g661946e7.el9.x86_64 6/171 2024-01-31T04:59:48.806 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-2:19.0.0-885.g661946e7.el9.x86_64 7/171 2024-01-31T04:59:48.806 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mon-2:19.0.0-885.g661946e7.el9.x86_64 8/171 2024-01-31T04:59:48.806 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-osd-2:19.0.0-885.g661946e7.el9.x86_64 9/171 2024-01-31T04:59:48.806 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-radosgw-2:19.0.0-885.g661946e7.el9.x86_64 10/171 2024-01-31T04:59:48.806 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-selinux-2:19.0.0-885.g661946e7.el9.x86_64 11/171 2024-01-31T04:59:48.806 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-test-2:19.0.0-885.g661946e7.el9.x86_64 12/171 2024-01-31T04:59:48.806 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephfs-mirror-2:19.0.0-885.g661946e7.el9.x86_64 13/171 2024-01-31T04:59:48.806 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephfs-shell-2:19.0.0-885.g661946e7.el9.x86_64 14/171 2024-01-31T04:59:48.806 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephfs-devel-2:19.0.0-885.g661946e7.el9.x86_6 15/171 2024-01-31T04:59:48.806 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephfs2-2:19.0.0-885.g661946e7.el9.x86_64 16/171 2024-01-31T04:59:48.806 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephsqlite-2:19.0.0-885.g661946e7.el9.x86_64 17/171 2024-01-31T04:59:48.807 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados-devel-2:19.0.0-885.g661946e7.el9.x86_64 18/171 2024-01-31T04:59:48.807 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libradosstriper1-2:19.0.0-885.g661946e7.el9.x86_ 19/171 2024-01-31T04:59:48.807 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librgw2-2:19.0.0-885.g661946e7.el9.x86_64 20/171 2024-01-31T04:59:48.807 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ceph-argparse-2:19.0.0-885.g661946e7.el9 21/171 2024-01-31T04:59:48.807 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ceph-common-2:19.0.0-885.g661946e7.el9.x 22/171 2024-01-31T04:59:48.807 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cephfs-2:19.0.0-885.g661946e7.el9.x86_64 23/171 2024-01-31T04:59:48.807 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rados-2:19.0.0-885.g661946e7.el9.x86_64 24/171 2024-01-31T04:59:48.807 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rbd-2:19.0.0-885.g661946e7.el9.x86_64 25/171 2024-01-31T04:59:48.807 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rgw-2:19.0.0-885.g661946e7.el9.x86_64 26/171 2024-01-31T04:59:48.807 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-fuse-2:19.0.0-885.g661946e7.el9.x86_64 27/171 2024-01-31T04:59:48.807 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-mirror-2:19.0.0-885.g661946e7.el9.x86_64 28/171 2024-01-31T04:59:48.807 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-nbd-2:19.0.0-885.g661946e7.el9.x86_64 29/171 2024-01-31T04:59:48.807 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-885.g661946e7.e 30/171 2024-01-31T04:59:48.826 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-885.g661946e7.el9.noar 31/171 2024-01-31T04:59:48.826 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-885.g661946e7.el9.no 32/171 2024-01-31T04:59:48.826 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-885.g6619 33/171 2024-01-31T04:59:48.827 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-885.g661946e7.el9 34/171 2024-01-31T04:59:48.827 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-rook-2:19.0.0-885.g661946e7.el9.noarch 35/171 2024-01-31T04:59:48.827 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-885.g661946e7.el 36/171 2024-01-31T04:59:48.827 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-volume-2:19.0.0-885.g661946e7.el9.noarch 37/171 2024-01-31T04:59:48.827 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephadm-2:19.0.0-885.g661946e7.el9.noarch 38/171 2024-01-31T04:59:48.827 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephfs-top-2:19.0.0-885.g661946e7.el9.noarch 39/171 2024-01-31T04:59:48.827 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 40/171 2024-01-31T04:59:48.827 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 41/171 2024-01-31T04:59:48.827 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : jq-1.6-16.el9.x86_64 42/171 2024-01-31T04:59:48.827 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 43/171 2024-01-31T04:59:48.827 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 44/171 2024-01-31T04:59:48.827 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 45/171 2024-01-31T04:59:48.827 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/171 2024-01-31T04:59:48.828 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/171 2024-01-31T04:59:48.828 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/171 2024-01-31T04:59:48.828 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/171 2024-01-31T04:59:48.828 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/171 2024-01-31T04:59:48.828 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 51/171 2024-01-31T04:59:48.828 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : automake-1.16.2-8.el9.noarch 52/171 2024-01-31T04:59:48.828 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : bison-3.7.4-5.el9.x86_64 53/171 2024-01-31T04:59:48.828 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 54/171 2024-01-31T04:59:48.828 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 55/171 2024-01-31T04:59:48.828 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flex-2.6.4-9.el9.x86_64 56/171 2024-01-31T04:59:48.828 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 57/171 2024-01-31T04:59:48.828 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 58/171 2024-01-31T04:59:48.828 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 59/171 2024-01-31T04:59:48.829 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 60/171 2024-01-31T04:59:48.829 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 61/171 2024-01-31T04:59:48.829 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 62/171 2024-01-31T04:59:48.829 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 63/171 2024-01-31T04:59:48.829 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 64/171 2024-01-31T04:59:48.829 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 65/171 2024-01-31T04:59:48.829 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 66/171 2024-01-31T04:59:48.829 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lua-5.4.4-4.el9.x86_64 67/171 2024-01-31T04:59:48.829 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 68/171 2024-01-31T04:59:48.829 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 69/171 2024-01-31T04:59:48.829 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 70/171 2024-01-31T04:59:48.829 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-13.11-1.el9.x86_64 71/171 2024-01-31T04:59:48.829 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 72/171 2024-01-31T04:59:48.829 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 73/171 2024-01-31T04:59:48.830 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 74/171 2024-01-31T04:59:48.830 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/171 2024-01-31T04:59:48.830 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/171 2024-01-31T04:59:48.830 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 77/171 2024-01-31T04:59:48.830 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 78/171 2024-01-31T04:59:48.830 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/171 2024-01-31T04:59:48.830 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/171 2024-01-31T04:59:48.830 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/171 2024-01-31T04:59:48.830 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/171 2024-01-31T04:59:48.830 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/171 2024-01-31T04:59:48.830 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/171 2024-01-31T04:59:48.830 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/171 2024-01-31T04:59:48.830 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/171 2024-01-31T04:59:48.830 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 87/171 2024-01-31T04:59:48.830 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 88/171 2024-01-31T04:59:48.831 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 89/171 2024-01-31T04:59:48.831 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 90/171 2024-01-31T04:59:48.831 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 91/171 2024-01-31T04:59:48.831 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 92/171 2024-01-31T04:59:48.831 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 93/171 2024-01-31T04:59:48.831 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 94/171 2024-01-31T04:59:48.831 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 95/171 2024-01-31T04:59:48.831 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 96/171 2024-01-31T04:59:48.831 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 97/171 2024-01-31T04:59:48.831 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 98/171 2024-01-31T04:59:48.831 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 99/171 2024-01-31T04:59:48.831 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 100/171 2024-01-31T04:59:48.831 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 101/171 2024-01-31T04:59:48.831 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 102/171 2024-01-31T04:59:48.832 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 103/171 2024-01-31T04:59:48.832 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 104/171 2024-01-31T04:59:48.832 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 105/171 2024-01-31T04:59:48.832 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 106/171 2024-01-31T04:59:48.832 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 107/171 2024-01-31T04:59:48.832 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 108/171 2024-01-31T04:59:48.832 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 109/171 2024-01-31T04:59:48.832 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 110/171 2024-01-31T04:59:48.832 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 111/171 2024-01-31T04:59:48.832 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 112/171 2024-01-31T04:59:48.832 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 113/171 2024-01-31T04:59:48.832 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 114/171 2024-01-31T04:59:48.832 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-google-auth-1:2.26.2-1.el9.noarch 115/171 2024-01-31T04:59:48.832 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 116/171 2024-01-31T04:59:48.833 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 117/171 2024-01-31T04:59:48.833 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 118/171 2024-01-31T04:59:48.833 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 119/171 2024-01-31T04:59:48.833 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 120/171 2024-01-31T04:59:48.833 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 121/171 2024-01-31T04:59:48.833 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 122/171 2024-01-31T04:59:48.833 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 123/171 2024-01-31T04:59:48.833 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 124/171 2024-01-31T04:59:48.833 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 125/171 2024-01-31T04:59:48.833 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 126/171 2024-01-31T04:59:48.834 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 127/171 2024-01-31T04:59:48.834 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 128/171 2024-01-31T04:59:48.834 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 129/171 2024-01-31T04:59:48.834 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 130/171 2024-01-31T04:59:48.834 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 131/171 2024-01-31T04:59:48.834 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 132/171 2024-01-31T04:59:48.834 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 133/171 2024-01-31T04:59:48.834 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 134/171 2024-01-31T04:59:48.834 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 135/171 2024-01-31T04:59:48.834 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 136/171 2024-01-31T04:59:48.834 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 137/171 2024-01-31T04:59:48.834 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : re2-1:20211101-3.el9.x86_64 138/171 2024-01-31T04:59:48.834 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 139/171 2024-01-31T04:59:48.835 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados2-2:19.0.0-885.g661946e7.el9.x86_64 140/171 2024-01-31T04:59:48.835 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 141/171 2024-01-31T04:59:48.835 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librbd1-2:19.0.0-885.g661946e7.el9.x86_64 142/171 2024-01-31T04:59:48.835 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 143/171 2024-01-31T04:59:48.835 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-1:1.45.10-1.el9.x86_64 144/171 2024-01-31T04:59:48.835 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 145/171 2024-01-31T04:59:48.835 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-libnm-1:1.45.10-1.el9.x86_64 146/171 2024-01-31T04:59:48.835 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 147/171 2024-01-31T04:59:48.835 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-team-1:1.45.10-1.el9.x86_64 148/171 2024-01-31T04:59:48.835 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 149/171 2024-01-31T04:59:48.835 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-tui-1:1.45.10-1.el9.x86_64 150/171 2024-01-31T04:59:48.835 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 151/171 2024-01-31T04:59:48.835 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : acl-2.3.1-4.el9.x86_64 152/171 2024-01-31T04:59:48.835 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : acl-2.3.1-3.el9.x86_64 153/171 2024-01-31T04:59:48.835 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 154/171 2024-01-31T04:59:48.836 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 155/171 2024-01-31T04:59:48.836 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 156/171 2024-01-31T04:59:48.836 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 157/171 2024-01-31T04:59:48.836 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 158/171 2024-01-31T04:59:48.836 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 159/171 2024-01-31T04:59:48.836 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 160/171 2024-01-31T04:59:48.836 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 161/171 2024-01-31T04:59:48.836 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 162/171 2024-01-31T04:59:48.836 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 163/171 2024-01-31T04:59:48.836 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 164/171 2024-01-31T04:59:48.836 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 165/171 2024-01-31T04:59:48.836 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 166/171 2024-01-31T04:59:48.836 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 167/171 2024-01-31T04:59:48.836 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 168/171 2024-01-31T04:59:48.837 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 169/171 2024-01-31T04:59:48.837 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 170/171 2024-01-31T04:59:48.857 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 171/171 2024-01-31T04:59:48.858 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-2:19.0.0-885.g661946e7.el9.x86_64 1/171 2024-01-31T04:59:48.858 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-base-2:19.0.0-885.g661946e7.el9.x86_64 2/171 2024-01-31T04:59:48.858 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 3/171 2024-01-31T04:59:48.858 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-fuse-2:19.0.0-885.g661946e7.el9.x86_64 4/171 2024-01-31T04:59:48.858 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-885.g661946 5/171 2024-01-31T04:59:48.858 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mds-2:19.0.0-885.g661946e7.el9.x86_64 6/171 2024-01-31T04:59:48.858 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-2:19.0.0-885.g661946e7.el9.x86_64 7/171 2024-01-31T04:59:48.859 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mon-2:19.0.0-885.g661946e7.el9.x86_64 8/171 2024-01-31T04:59:48.859 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-osd-2:19.0.0-885.g661946e7.el9.x86_64 9/171 2024-01-31T04:59:48.859 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-radosgw-2:19.0.0-885.g661946e7.el9.x86_64 10/171 2024-01-31T04:59:48.859 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-selinux-2:19.0.0-885.g661946e7.el9.x86_64 11/171 2024-01-31T04:59:48.859 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-test-2:19.0.0-885.g661946e7.el9.x86_64 12/171 2024-01-31T04:59:48.859 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephfs-mirror-2:19.0.0-885.g661946e7.el9.x86_64 13/171 2024-01-31T04:59:48.859 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephfs-shell-2:19.0.0-885.g661946e7.el9.x86_64 14/171 2024-01-31T04:59:48.859 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcephfs-devel-2:19.0.0-885.g661946e7.el9.x86_6 15/171 2024-01-31T04:59:48.859 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcephfs2-2:19.0.0-885.g661946e7.el9.x86_64 16/171 2024-01-31T04:59:48.859 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcephsqlite-2:19.0.0-885.g661946e7.el9.x86_64 17/171 2024-01-31T04:59:48.859 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librados-devel-2:19.0.0-885.g661946e7.el9.x86_64 18/171 2024-01-31T04:59:48.860 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libradosstriper1-2:19.0.0-885.g661946e7.el9.x86_ 19/171 2024-01-31T04:59:48.860 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librgw2-2:19.0.0-885.g661946e7.el9.x86_64 20/171 2024-01-31T04:59:48.860 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-ceph-argparse-2:19.0.0-885.g661946e7.el9 21/171 2024-01-31T04:59:48.860 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-ceph-common-2:19.0.0-885.g661946e7.el9.x 22/171 2024-01-31T04:59:48.860 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cephfs-2:19.0.0-885.g661946e7.el9.x86_64 23/171 2024-01-31T04:59:48.860 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rados-2:19.0.0-885.g661946e7.el9.x86_64 24/171 2024-01-31T04:59:48.860 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rbd-2:19.0.0-885.g661946e7.el9.x86_64 25/171 2024-01-31T04:59:48.860 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rgw-2:19.0.0-885.g661946e7.el9.x86_64 26/171 2024-01-31T04:59:48.860 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : rbd-fuse-2:19.0.0-885.g661946e7.el9.x86_64 27/171 2024-01-31T04:59:48.860 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : rbd-mirror-2:19.0.0-885.g661946e7.el9.x86_64 28/171 2024-01-31T04:59:48.860 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : rbd-nbd-2:19.0.0-885.g661946e7.el9.x86_64 29/171 2024-01-31T04:59:48.861 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-885.g661946e7.e 30/171 2024-01-31T04:59:48.861 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-885.g661946e7.el9.noar 31/171 2024-01-31T04:59:48.861 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-885.g661946e7.el9.no 32/171 2024-01-31T04:59:48.861 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-885.g6619 33/171 2024-01-31T04:59:48.861 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-885.g661946e7.el9 34/171 2024-01-31T04:59:48.861 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-rook-2:19.0.0-885.g661946e7.el9.noarch 35/171 2024-01-31T04:59:48.861 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-885.g661946e7.el 36/171 2024-01-31T04:59:48.861 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-volume-2:19.0.0-885.g661946e7.el9.noarch 37/171 2024-01-31T04:59:48.861 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephadm-2:19.0.0-885.g661946e7.el9.noarch 38/171 2024-01-31T04:59:48.861 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephfs-top-2:19.0.0-885.g661946e7.el9.noarch 39/171 2024-01-31T04:59:48.861 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 40/171 2024-01-31T04:59:48.861 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 41/171 2024-01-31T04:59:48.862 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : jq-1.6-16.el9.x86_64 42/171 2024-01-31T04:59:48.862 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 43/171 2024-01-31T04:59:48.862 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 44/171 2024-01-31T04:59:48.862 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 45/171 2024-01-31T04:59:48.862 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/171 2024-01-31T04:59:48.863 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/171 2024-01-31T04:59:48.864 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/171 2024-01-31T04:59:48.864 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/171 2024-01-31T04:59:48.864 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/171 2024-01-31T04:59:48.864 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 51/171 2024-01-31T04:59:48.864 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : automake-1.16.2-8.el9.noarch 52/171 2024-01-31T04:59:48.865 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : bison-3.7.4-5.el9.x86_64 53/171 2024-01-31T04:59:48.865 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 54/171 2024-01-31T04:59:48.865 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 55/171 2024-01-31T04:59:48.865 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : flex-2.6.4-9.el9.x86_64 56/171 2024-01-31T04:59:48.865 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 57/171 2024-01-31T04:59:48.865 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 58/171 2024-01-31T04:59:48.865 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 59/171 2024-01-31T04:59:48.865 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 60/171 2024-01-31T04:59:48.865 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 61/171 2024-01-31T04:59:48.865 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 62/171 2024-01-31T04:59:48.865 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 63/171 2024-01-31T04:59:48.865 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 64/171 2024-01-31T04:59:48.865 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 65/171 2024-01-31T04:59:48.865 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 66/171 2024-01-31T04:59:48.865 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : lua-5.4.4-4.el9.x86_64 67/171 2024-01-31T04:59:48.866 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 68/171 2024-01-31T04:59:48.867 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 69/171 2024-01-31T04:59:48.867 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 70/171 2024-01-31T04:59:48.867 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : postgresql-13.11-1.el9.x86_64 71/171 2024-01-31T04:59:48.867 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 72/171 2024-01-31T04:59:48.867 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 73/171 2024-01-31T04:59:48.867 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 74/171 2024-01-31T04:59:48.867 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/171 2024-01-31T04:59:48.867 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/171 2024-01-31T04:59:48.867 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 77/171 2024-01-31T04:59:48.867 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 78/171 2024-01-31T04:59:48.867 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/171 2024-01-31T04:59:48.867 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/171 2024-01-31T04:59:48.867 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/171 2024-01-31T04:59:48.868 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/171 2024-01-31T04:59:48.868 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/171 2024-01-31T04:59:48.868 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/171 2024-01-31T04:59:48.868 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/171 2024-01-31T04:59:48.868 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/171 2024-01-31T04:59:48.868 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 87/171 2024-01-31T04:59:48.868 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 88/171 2024-01-31T04:59:48.868 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 89/171 2024-01-31T04:59:48.868 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 90/171 2024-01-31T04:59:48.868 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 91/171 2024-01-31T04:59:48.868 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 92/171 2024-01-31T04:59:48.869 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 93/171 2024-01-31T04:59:48.869 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 94/171 2024-01-31T04:59:48.869 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 95/171 2024-01-31T04:59:48.869 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 96/171 2024-01-31T04:59:48.869 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 97/171 2024-01-31T04:59:48.869 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 98/171 2024-01-31T04:59:48.869 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 99/171 2024-01-31T04:59:48.869 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 100/171 2024-01-31T04:59:48.869 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 101/171 2024-01-31T04:59:48.869 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 102/171 2024-01-31T04:59:48.870 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 103/171 2024-01-31T04:59:48.870 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 104/171 2024-01-31T04:59:48.870 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 105/171 2024-01-31T04:59:48.870 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 106/171 2024-01-31T04:59:48.870 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 107/171 2024-01-31T04:59:48.870 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 108/171 2024-01-31T04:59:48.871 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 109/171 2024-01-31T04:59:48.871 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 110/171 2024-01-31T04:59:48.871 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 111/171 2024-01-31T04:59:48.871 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 112/171 2024-01-31T04:59:48.871 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 113/171 2024-01-31T04:59:48.871 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 114/171 2024-01-31T04:59:48.871 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-google-auth-1:2.26.2-1.el9.noarch 115/171 2024-01-31T04:59:48.871 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 116/171 2024-01-31T04:59:48.871 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 117/171 2024-01-31T04:59:48.871 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 118/171 2024-01-31T04:59:48.871 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 119/171 2024-01-31T04:59:48.871 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 120/171 2024-01-31T04:59:48.871 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 121/171 2024-01-31T04:59:48.871 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 122/171 2024-01-31T04:59:48.872 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 123/171 2024-01-31T04:59:48.872 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 124/171 2024-01-31T04:59:48.872 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 125/171 2024-01-31T04:59:48.872 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 126/171 2024-01-31T04:59:48.872 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 127/171 2024-01-31T04:59:48.873 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 128/171 2024-01-31T04:59:48.873 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 129/171 2024-01-31T04:59:48.873 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 130/171 2024-01-31T04:59:48.873 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 131/171 2024-01-31T04:59:48.873 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 132/171 2024-01-31T04:59:48.873 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 133/171 2024-01-31T04:59:48.873 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 134/171 2024-01-31T04:59:48.873 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 135/171 2024-01-31T04:59:48.873 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 136/171 2024-01-31T04:59:48.874 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 137/171 2024-01-31T04:59:48.874 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : re2-1:20211101-3.el9.x86_64 138/171 2024-01-31T04:59:48.874 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 139/171 2024-01-31T04:59:48.874 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librados2-2:19.0.0-885.g661946e7.el9.x86_64 140/171 2024-01-31T04:59:48.874 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 141/171 2024-01-31T04:59:48.874 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librbd1-2:19.0.0-885.g661946e7.el9.x86_64 142/171 2024-01-31T04:59:48.874 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 143/171 2024-01-31T04:59:48.874 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-1:1.45.10-1.el9.x86_64 144/171 2024-01-31T04:59:48.874 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 145/171 2024-01-31T04:59:48.874 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-libnm-1:1.45.10-1.el9.x86_64 146/171 2024-01-31T04:59:48.874 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 147/171 2024-01-31T04:59:48.874 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-team-1:1.45.10-1.el9.x86_64 148/171 2024-01-31T04:59:48.874 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 149/171 2024-01-31T04:59:48.875 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-tui-1:1.45.10-1.el9.x86_64 150/171 2024-01-31T04:59:48.875 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 151/171 2024-01-31T04:59:48.875 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : acl-2.3.1-4.el9.x86_64 152/171 2024-01-31T04:59:48.875 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : acl-2.3.1-3.el9.x86_64 153/171 2024-01-31T04:59:48.875 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 154/171 2024-01-31T04:59:48.875 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 155/171 2024-01-31T04:59:48.875 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 156/171 2024-01-31T04:59:48.875 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 157/171 2024-01-31T04:59:48.875 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 158/171 2024-01-31T04:59:48.875 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 159/171 2024-01-31T04:59:48.875 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 160/171 2024-01-31T04:59:48.875 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 161/171 2024-01-31T04:59:48.875 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 162/171 2024-01-31T04:59:48.876 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 163/171 2024-01-31T04:59:48.876 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 164/171 2024-01-31T04:59:48.876 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 165/171 2024-01-31T04:59:48.876 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 166/171 2024-01-31T04:59:48.876 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 167/171 2024-01-31T04:59:48.876 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 168/171 2024-01-31T04:59:48.876 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 169/171 2024-01-31T04:59:48.876 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 170/171 2024-01-31T04:59:50.424 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 171/171 2024-01-31T04:59:50.425 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T04:59:50.425 INFO:teuthology.orchestra.run.smithi099.stdout:Upgraded: 2024-01-31T04:59:50.425 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-1:1.45.10-1.el9.x86_64 2024-01-31T04:59:50.425 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-libnm-1:1.45.10-1.el9.x86_64 2024-01-31T04:59:50.425 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-team-1:1.45.10-1.el9.x86_64 2024-01-31T04:59:50.426 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-tui-1:1.45.10-1.el9.x86_64 2024-01-31T04:59:50.426 INFO:teuthology.orchestra.run.smithi099.stdout: acl-2.3.1-4.el9.x86_64 2024-01-31T04:59:50.426 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-01-31T04:59:50.426 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-01-31T04:59:50.426 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-01-31T04:59:50.426 INFO:teuthology.orchestra.run.smithi099.stdout: libacl-2.3.1-4.el9.x86_64 2024-01-31T04:59:50.427 INFO:teuthology.orchestra.run.smithi099.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-01-31T04:59:50.427 INFO:teuthology.orchestra.run.smithi099.stdout: librados2-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:50.427 INFO:teuthology.orchestra.run.smithi099.stdout: librbd1-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:50.427 INFO:teuthology.orchestra.run.smithi099.stdout: openssl-1:3.0.7-25.el9.x86_64 2024-01-31T04:59:50.427 INFO:teuthology.orchestra.run.smithi099.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2024-01-31T04:59:50.427 INFO:teuthology.orchestra.run.smithi099.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-01-31T04:59:50.428 INFO:teuthology.orchestra.run.smithi099.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-01-31T04:59:50.428 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-01-31T04:59:50.428 INFO:teuthology.orchestra.run.smithi099.stdout: automake-1.16.2-8.el9.noarch 2024-01-31T04:59:50.428 INFO:teuthology.orchestra.run.smithi099.stdout: bison-3.7.4-5.el9.x86_64 2024-01-31T04:59:50.428 INFO:teuthology.orchestra.run.smithi099.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-01-31T04:59:50.428 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:50.428 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-base-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:50.428 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:50.429 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-fuse-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:50.429 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-grafana-dashboards-2:19.0.0-885.g661946e7.el9.noarch 2024-01-31T04:59:50.429 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-immutable-object-cache-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:50.429 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mds-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:50.429 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:50.429 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-cephadm-2:19.0.0-885.g661946e7.el9.noarch 2024-01-31T04:59:50.429 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-dashboard-2:19.0.0-885.g661946e7.el9.noarch 2024-01-31T04:59:50.429 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-diskprediction-local-2:19.0.0-885.g661946e7.el9.noarch 2024-01-31T04:59:50.429 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-modules-core-2:19.0.0-885.g661946e7.el9.noarch 2024-01-31T04:59:50.429 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-rook-2:19.0.0-885.g661946e7.el9.noarch 2024-01-31T04:59:50.429 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mon-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:50.429 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-osd-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:50.430 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-prometheus-alerts-2:19.0.0-885.g661946e7.el9.noarch 2024-01-31T04:59:50.430 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-radosgw-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:50.430 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-selinux-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:50.430 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-test-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:50.430 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-volume-2:19.0.0-885.g661946e7.el9.noarch 2024-01-31T04:59:50.430 INFO:teuthology.orchestra.run.smithi099.stdout: cephadm-2:19.0.0-885.g661946e7.el9.noarch 2024-01-31T04:59:50.430 INFO:teuthology.orchestra.run.smithi099.stdout: cephfs-mirror-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:50.430 INFO:teuthology.orchestra.run.smithi099.stdout: cephfs-shell-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:50.430 INFO:teuthology.orchestra.run.smithi099.stdout: cephfs-top-2:19.0.0-885.g661946e7.el9.noarch 2024-01-31T04:59:50.430 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-01-31T04:59:50.430 INFO:teuthology.orchestra.run.smithi099.stdout: flex-2.6.4-9.el9.x86_64 2024-01-31T04:59:50.431 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-01-31T04:59:50.431 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-01-31T04:59:50.431 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-01-31T04:59:50.431 INFO:teuthology.orchestra.run.smithi099.stdout: fuse-2.9.9-15.el9.x86_64 2024-01-31T04:59:50.431 INFO:teuthology.orchestra.run.smithi099.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-01-31T04:59:50.431 INFO:teuthology.orchestra.run.smithi099.stdout: jq-1.6-16.el9.x86_64 2024-01-31T04:59:50.431 INFO:teuthology.orchestra.run.smithi099.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-01-31T04:59:50.431 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow-9.0.0-10.el9.x86_64 2024-01-31T04:59:50.431 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-01-31T04:59:50.432 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs-devel-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:50.432 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs2-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:50.432 INFO:teuthology.orchestra.run.smithi099.stdout: libcephsqlite-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:50.432 INFO:teuthology.orchestra.run.smithi099.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-01-31T04:59:50.433 INFO:teuthology.orchestra.run.smithi099.stdout: liboath-2.6.7-2.el9.x86_64 2024-01-31T04:59:50.433 INFO:teuthology.orchestra.run.smithi099.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-01-31T04:59:50.433 INFO:teuthology.orchestra.run.smithi099.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-01-31T04:59:50.434 INFO:teuthology.orchestra.run.smithi099.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-01-31T04:59:50.434 INFO:teuthology.orchestra.run.smithi099.stdout: librados-devel-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:50.434 INFO:teuthology.orchestra.run.smithi099.stdout: libradosstriper1-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:50.434 INFO:teuthology.orchestra.run.smithi099.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-01-31T04:59:50.434 INFO:teuthology.orchestra.run.smithi099.stdout: librgw2-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:50.434 INFO:teuthology.orchestra.run.smithi099.stdout: libtool-2.4.6-45.el9.x86_64 2024-01-31T04:59:50.434 INFO:teuthology.orchestra.run.smithi099.stdout: libunwind-1.6.2-1.el9.x86_64 2024-01-31T04:59:50.434 INFO:teuthology.orchestra.run.smithi099.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2024-01-31T04:59:50.434 INFO:teuthology.orchestra.run.smithi099.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-01-31T04:59:50.435 INFO:teuthology.orchestra.run.smithi099.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-01-31T04:59:50.435 INFO:teuthology.orchestra.run.smithi099.stdout: lua-5.4.4-4.el9.x86_64 2024-01-31T04:59:50.435 INFO:teuthology.orchestra.run.smithi099.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-01-31T04:59:50.435 INFO:teuthology.orchestra.run.smithi099.stdout: luarocks-3.9.2-1.el9.noarch 2024-01-31T04:59:50.435 INFO:teuthology.orchestra.run.smithi099.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-01-31T04:59:50.435 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-0.3.21-2.el9.x86_64 2024-01-31T04:59:50.435 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-01-31T04:59:50.435 INFO:teuthology.orchestra.run.smithi099.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2024-01-31T04:59:50.435 INFO:teuthology.orchestra.run.smithi099.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-01-31T04:59:50.435 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-13.11-1.el9.x86_64 2024-01-31T04:59:50.435 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-01-31T04:59:50.435 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-01-31T04:59:50.436 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-server-13.11-1.el9.x86_64 2024-01-31T04:59:50.436 INFO:teuthology.orchestra.run.smithi099.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2024-01-31T04:59:50.436 INFO:teuthology.orchestra.run.smithi099.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-01-31T04:59:50.436 INFO:teuthology.orchestra.run.smithi099.stdout: python3-babel-2.9.1-2.el9.noarch 2024-01-31T04:59:50.436 INFO:teuthology.orchestra.run.smithi099.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-01-31T04:59:50.436 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-01-31T04:59:50.436 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-argparse-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:50.436 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:50.436 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cephfs-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:50.436 INFO:teuthology.orchestra.run.smithi099.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-01-31T04:59:50.436 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-01-31T04:59:50.437 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-01-31T04:59:50.437 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-01-31T04:59:50.437 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-01-31T04:59:50.437 INFO:teuthology.orchestra.run.smithi099.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-01-31T04:59:50.437 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-01-31T04:59:50.437 INFO:teuthology.orchestra.run.smithi099.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-01-31T04:59:50.437 INFO:teuthology.orchestra.run.smithi099.stdout: python3-google-auth-1:2.26.2-1.el9.noarch 2024-01-31T04:59:50.437 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-01-31T04:59:50.437 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-01-31T04:59:50.437 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-01-31T04:59:50.437 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-01-31T04:59:50.437 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-01-31T04:59:50.437 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jinja2-2.11.3-4.el9.noarch 2024-01-31T04:59:50.437 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-01-31T04:59:50.438 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-01-31T04:59:50.438 INFO:teuthology.orchestra.run.smithi099.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-01-31T04:59:50.438 INFO:teuthology.orchestra.run.smithi099.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-01-31T04:59:50.438 INFO:teuthology.orchestra.run.smithi099.stdout: python3-mako-1.1.4-6.el9.noarch 2024-01-31T04:59:50.438 INFO:teuthology.orchestra.run.smithi099.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-01-31T04:59:50.438 INFO:teuthology.orchestra.run.smithi099.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-01-31T04:59:50.438 INFO:teuthology.orchestra.run.smithi099.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-01-31T04:59:50.438 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-01-31T04:59:50.438 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-01-31T04:59:50.438 INFO:teuthology.orchestra.run.smithi099.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-01-31T04:59:50.438 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-01-31T04:59:50.438 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ply-3.11-14.el9.noarch 2024-01-31T04:59:50.438 INFO:teuthology.orchestra.run.smithi099.stdout: python3-portend-3.1.0-2.el9.noarch 2024-01-31T04:59:50.439 INFO:teuthology.orchestra.run.smithi099.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-01-31T04:59:50.439 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-01-31T04:59:50.439 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-01-31T04:59:50.439 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-01-31T04:59:50.439 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pycparser-2.20-6.el9.noarch 2024-01-31T04:59:50.439 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-01-31T04:59:50.439 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pytz-2021.1-5.el9.noarch 2024-01-31T04:59:50.439 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rados-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:50.440 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rbd-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:50.440 INFO:teuthology.orchestra.run.smithi099.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-01-31T04:59:50.440 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-2.25.1-8.el9.noarch 2024-01-31T04:59:50.440 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-01-31T04:59:50.440 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rgw-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:50.440 INFO:teuthology.orchestra.run.smithi099.stdout: python3-routes-2.5.1-5.el9.noarch 2024-01-31T04:59:50.440 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rsa-4.9-2.el9.noarch 2024-01-31T04:59:50.440 INFO:teuthology.orchestra.run.smithi099.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-01-31T04:59:50.440 INFO:teuthology.orchestra.run.smithi099.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-01-31T04:59:50.440 INFO:teuthology.orchestra.run.smithi099.stdout: python3-toml-0.10.2-6.el9.noarch 2024-01-31T04:59:50.440 INFO:teuthology.orchestra.run.smithi099.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-01-31T04:59:50.441 INFO:teuthology.orchestra.run.smithi099.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-01-31T04:59:50.441 INFO:teuthology.orchestra.run.smithi099.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-01-31T04:59:50.441 INFO:teuthology.orchestra.run.smithi099.stdout: python3-webob-1.8.7-6.el9.noarch 2024-01-31T04:59:50.441 INFO:teuthology.orchestra.run.smithi099.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-01-31T04:59:50.441 INFO:teuthology.orchestra.run.smithi099.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-01-31T04:59:50.441 INFO:teuthology.orchestra.run.smithi099.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-01-31T04:59:50.441 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-fuse-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:50.441 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-mirror-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:50.441 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-nbd-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:50.441 INFO:teuthology.orchestra.run.smithi099.stdout: re2-1:20211101-3.el9.x86_64 2024-01-31T04:59:50.441 INFO:teuthology.orchestra.run.smithi099.stdout: socat-1.7.4.1-5.el9.x86_64 2024-01-31T04:59:50.441 INFO:teuthology.orchestra.run.smithi099.stdout: thrift-0.15.0-2.el9.x86_64 2024-01-31T04:59:50.441 INFO:teuthology.orchestra.run.smithi099.stdout: uuid-1.6.2-55.el9.x86_64 2024-01-31T04:59:50.442 INFO:teuthology.orchestra.run.smithi099.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-01-31T04:59:50.442 INFO:teuthology.orchestra.run.smithi099.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-01-31T04:59:50.442 INFO:teuthology.orchestra.run.smithi099.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-01-31T04:59:50.444 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T04:59:50.444 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-01-31T04:59:51.032 DEBUG:teuthology.parallel:result is None 2024-01-31T04:59:51.393 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 171/171 2024-01-31T04:59:51.393 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-01-31T04:59:51.393 INFO:teuthology.orchestra.run.smithi181.stdout:Upgraded: 2024-01-31T04:59:51.393 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-1:1.45.10-1.el9.x86_64 2024-01-31T04:59:51.393 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-libnm-1:1.45.10-1.el9.x86_64 2024-01-31T04:59:51.393 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-team-1:1.45.10-1.el9.x86_64 2024-01-31T04:59:51.393 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-tui-1:1.45.10-1.el9.x86_64 2024-01-31T04:59:51.393 INFO:teuthology.orchestra.run.smithi181.stdout: acl-2.3.1-4.el9.x86_64 2024-01-31T04:59:51.393 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-01-31T04:59:51.394 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-01-31T04:59:51.394 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-01-31T04:59:51.394 INFO:teuthology.orchestra.run.smithi181.stdout: libacl-2.3.1-4.el9.x86_64 2024-01-31T04:59:51.394 INFO:teuthology.orchestra.run.smithi181.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-01-31T04:59:51.394 INFO:teuthology.orchestra.run.smithi181.stdout: librados2-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.394 INFO:teuthology.orchestra.run.smithi181.stdout: librbd1-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.394 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-1:3.0.7-25.el9.x86_64 2024-01-31T04:59:51.394 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2024-01-31T04:59:51.394 INFO:teuthology.orchestra.run.smithi181.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-01-31T04:59:51.394 INFO:teuthology.orchestra.run.smithi181.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-01-31T04:59:51.394 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-01-31T04:59:51.395 INFO:teuthology.orchestra.run.smithi181.stdout: automake-1.16.2-8.el9.noarch 2024-01-31T04:59:51.395 INFO:teuthology.orchestra.run.smithi181.stdout: bison-3.7.4-5.el9.x86_64 2024-01-31T04:59:51.395 INFO:teuthology.orchestra.run.smithi181.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-01-31T04:59:51.395 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.395 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-base-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.395 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.395 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-fuse-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.395 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-grafana-dashboards-2:19.0.0-885.g661946e7.el9.noarch 2024-01-31T04:59:51.395 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-immutable-object-cache-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.395 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mds-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.395 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.395 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-cephadm-2:19.0.0-885.g661946e7.el9.noarch 2024-01-31T04:59:51.396 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-dashboard-2:19.0.0-885.g661946e7.el9.noarch 2024-01-31T04:59:51.396 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-diskprediction-local-2:19.0.0-885.g661946e7.el9.noarch 2024-01-31T04:59:51.396 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-modules-core-2:19.0.0-885.g661946e7.el9.noarch 2024-01-31T04:59:51.396 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-rook-2:19.0.0-885.g661946e7.el9.noarch 2024-01-31T04:59:51.396 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mon-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.396 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-osd-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.396 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-prometheus-alerts-2:19.0.0-885.g661946e7.el9.noarch 2024-01-31T04:59:51.396 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-radosgw-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.396 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-selinux-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.397 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-test-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.397 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-volume-2:19.0.0-885.g661946e7.el9.noarch 2024-01-31T04:59:51.397 INFO:teuthology.orchestra.run.smithi181.stdout: cephadm-2:19.0.0-885.g661946e7.el9.noarch 2024-01-31T04:59:51.397 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-mirror-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.397 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-shell-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.397 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-top-2:19.0.0-885.g661946e7.el9.noarch 2024-01-31T04:59:51.397 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-01-31T04:59:51.397 INFO:teuthology.orchestra.run.smithi181.stdout: flex-2.6.4-9.el9.x86_64 2024-01-31T04:59:51.397 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-01-31T04:59:51.397 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-01-31T04:59:51.398 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-01-31T04:59:51.398 INFO:teuthology.orchestra.run.smithi181.stdout: fuse-2.9.9-15.el9.x86_64 2024-01-31T04:59:51.398 INFO:teuthology.orchestra.run.smithi181.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-01-31T04:59:51.398 INFO:teuthology.orchestra.run.smithi181.stdout: jq-1.6-16.el9.x86_64 2024-01-31T04:59:51.398 INFO:teuthology.orchestra.run.smithi181.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-01-31T04:59:51.398 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow-9.0.0-10.el9.x86_64 2024-01-31T04:59:51.398 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-01-31T04:59:51.398 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs-devel-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.398 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs2-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.398 INFO:teuthology.orchestra.run.smithi181.stdout: libcephsqlite-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.398 INFO:teuthology.orchestra.run.smithi181.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-01-31T04:59:51.399 INFO:teuthology.orchestra.run.smithi181.stdout: liboath-2.6.7-2.el9.x86_64 2024-01-31T04:59:51.399 INFO:teuthology.orchestra.run.smithi181.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-01-31T04:59:51.399 INFO:teuthology.orchestra.run.smithi181.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-01-31T04:59:51.399 INFO:teuthology.orchestra.run.smithi181.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-01-31T04:59:51.399 INFO:teuthology.orchestra.run.smithi181.stdout: librados-devel-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.399 INFO:teuthology.orchestra.run.smithi181.stdout: libradosstriper1-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.399 INFO:teuthology.orchestra.run.smithi181.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-01-31T04:59:51.399 INFO:teuthology.orchestra.run.smithi181.stdout: librgw2-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.399 INFO:teuthology.orchestra.run.smithi181.stdout: libtool-2.4.6-45.el9.x86_64 2024-01-31T04:59:51.399 INFO:teuthology.orchestra.run.smithi181.stdout: libunwind-1.6.2-1.el9.x86_64 2024-01-31T04:59:51.399 INFO:teuthology.orchestra.run.smithi181.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2024-01-31T04:59:51.399 INFO:teuthology.orchestra.run.smithi181.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-01-31T04:59:51.400 INFO:teuthology.orchestra.run.smithi181.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-01-31T04:59:51.400 INFO:teuthology.orchestra.run.smithi181.stdout: lua-5.4.4-4.el9.x86_64 2024-01-31T04:59:51.400 INFO:teuthology.orchestra.run.smithi181.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-01-31T04:59:51.400 INFO:teuthology.orchestra.run.smithi181.stdout: luarocks-3.9.2-1.el9.noarch 2024-01-31T04:59:51.400 INFO:teuthology.orchestra.run.smithi181.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-01-31T04:59:51.400 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-0.3.21-2.el9.x86_64 2024-01-31T04:59:51.400 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-01-31T04:59:51.400 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2024-01-31T04:59:51.400 INFO:teuthology.orchestra.run.smithi181.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-01-31T04:59:51.400 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-13.11-1.el9.x86_64 2024-01-31T04:59:51.400 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-01-31T04:59:51.400 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-01-31T04:59:51.401 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-server-13.11-1.el9.x86_64 2024-01-31T04:59:51.401 INFO:teuthology.orchestra.run.smithi181.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2024-01-31T04:59:51.401 INFO:teuthology.orchestra.run.smithi181.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-01-31T04:59:51.401 INFO:teuthology.orchestra.run.smithi181.stdout: python3-babel-2.9.1-2.el9.noarch 2024-01-31T04:59:51.401 INFO:teuthology.orchestra.run.smithi181.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-01-31T04:59:51.401 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-01-31T04:59:51.401 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-argparse-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.401 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.401 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cephfs-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.401 INFO:teuthology.orchestra.run.smithi181.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-01-31T04:59:51.401 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-01-31T04:59:51.401 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-01-31T04:59:51.402 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-01-31T04:59:51.402 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-01-31T04:59:51.402 INFO:teuthology.orchestra.run.smithi181.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-01-31T04:59:51.402 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-01-31T04:59:51.402 INFO:teuthology.orchestra.run.smithi181.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-01-31T04:59:51.402 INFO:teuthology.orchestra.run.smithi181.stdout: python3-google-auth-1:2.26.2-1.el9.noarch 2024-01-31T04:59:51.403 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-01-31T04:59:51.403 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-01-31T04:59:51.403 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-01-31T04:59:51.403 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-01-31T04:59:51.403 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-01-31T04:59:51.403 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jinja2-2.11.3-4.el9.noarch 2024-01-31T04:59:51.403 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-01-31T04:59:51.403 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-01-31T04:59:51.403 INFO:teuthology.orchestra.run.smithi181.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-01-31T04:59:51.403 INFO:teuthology.orchestra.run.smithi181.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-01-31T04:59:51.403 INFO:teuthology.orchestra.run.smithi181.stdout: python3-mako-1.1.4-6.el9.noarch 2024-01-31T04:59:51.403 INFO:teuthology.orchestra.run.smithi181.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-01-31T04:59:51.404 INFO:teuthology.orchestra.run.smithi181.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-01-31T04:59:51.404 INFO:teuthology.orchestra.run.smithi181.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-01-31T04:59:51.404 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-01-31T04:59:51.404 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-01-31T04:59:51.404 INFO:teuthology.orchestra.run.smithi181.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-01-31T04:59:51.404 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-01-31T04:59:51.404 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ply-3.11-14.el9.noarch 2024-01-31T04:59:51.404 INFO:teuthology.orchestra.run.smithi181.stdout: python3-portend-3.1.0-2.el9.noarch 2024-01-31T04:59:51.405 INFO:teuthology.orchestra.run.smithi181.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-01-31T04:59:51.405 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-01-31T04:59:51.405 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-01-31T04:59:51.405 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-01-31T04:59:51.405 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pycparser-2.20-6.el9.noarch 2024-01-31T04:59:51.405 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-01-31T04:59:51.405 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pytz-2021.1-5.el9.noarch 2024-01-31T04:59:51.405 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rados-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.405 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rbd-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.405 INFO:teuthology.orchestra.run.smithi181.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-01-31T04:59:51.405 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-2.25.1-8.el9.noarch 2024-01-31T04:59:51.405 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-01-31T04:59:51.406 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rgw-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.406 INFO:teuthology.orchestra.run.smithi181.stdout: python3-routes-2.5.1-5.el9.noarch 2024-01-31T04:59:51.406 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rsa-4.9-2.el9.noarch 2024-01-31T04:59:51.406 INFO:teuthology.orchestra.run.smithi181.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-01-31T04:59:51.406 INFO:teuthology.orchestra.run.smithi181.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-01-31T04:59:51.406 INFO:teuthology.orchestra.run.smithi181.stdout: python3-toml-0.10.2-6.el9.noarch 2024-01-31T04:59:51.406 INFO:teuthology.orchestra.run.smithi181.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-01-31T04:59:51.406 INFO:teuthology.orchestra.run.smithi181.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-01-31T04:59:51.406 INFO:teuthology.orchestra.run.smithi181.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-01-31T04:59:51.406 INFO:teuthology.orchestra.run.smithi181.stdout: python3-webob-1.8.7-6.el9.noarch 2024-01-31T04:59:51.406 INFO:teuthology.orchestra.run.smithi181.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-01-31T04:59:51.406 INFO:teuthology.orchestra.run.smithi181.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-01-31T04:59:51.406 INFO:teuthology.orchestra.run.smithi181.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-01-31T04:59:51.407 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-fuse-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.407 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-mirror-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.407 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-nbd-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.407 INFO:teuthology.orchestra.run.smithi181.stdout: re2-1:20211101-3.el9.x86_64 2024-01-31T04:59:51.407 INFO:teuthology.orchestra.run.smithi181.stdout: socat-1.7.4.1-5.el9.x86_64 2024-01-31T04:59:51.407 INFO:teuthology.orchestra.run.smithi181.stdout: thrift-0.15.0-2.el9.x86_64 2024-01-31T04:59:51.407 INFO:teuthology.orchestra.run.smithi181.stdout: uuid-1.6.2-55.el9.x86_64 2024-01-31T04:59:51.407 INFO:teuthology.orchestra.run.smithi181.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-01-31T04:59:51.407 INFO:teuthology.orchestra.run.smithi181.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-01-31T04:59:51.407 INFO:teuthology.orchestra.run.smithi181.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-01-31T04:59:51.407 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-01-31T04:59:51.407 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-01-31T04:59:51.543 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 171/171 2024-01-31T04:59:51.544 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-31T04:59:51.544 INFO:teuthology.orchestra.run.smithi179.stdout:Upgraded: 2024-01-31T04:59:51.544 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-1:1.45.10-1.el9.x86_64 2024-01-31T04:59:51.544 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-libnm-1:1.45.10-1.el9.x86_64 2024-01-31T04:59:51.544 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-team-1:1.45.10-1.el9.x86_64 2024-01-31T04:59:51.544 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-tui-1:1.45.10-1.el9.x86_64 2024-01-31T04:59:51.544 INFO:teuthology.orchestra.run.smithi179.stdout: acl-2.3.1-4.el9.x86_64 2024-01-31T04:59:51.544 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-01-31T04:59:51.544 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-01-31T04:59:51.544 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-01-31T04:59:51.544 INFO:teuthology.orchestra.run.smithi179.stdout: libacl-2.3.1-4.el9.x86_64 2024-01-31T04:59:51.544 INFO:teuthology.orchestra.run.smithi179.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-01-31T04:59:51.544 INFO:teuthology.orchestra.run.smithi179.stdout: librados2-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.545 INFO:teuthology.orchestra.run.smithi179.stdout: librbd1-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.545 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-1:3.0.7-25.el9.x86_64 2024-01-31T04:59:51.545 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2024-01-31T04:59:51.545 INFO:teuthology.orchestra.run.smithi179.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-01-31T04:59:51.545 INFO:teuthology.orchestra.run.smithi179.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-01-31T04:59:51.545 INFO:teuthology.orchestra.run.smithi179.stdout:Installed: 2024-01-31T04:59:51.545 INFO:teuthology.orchestra.run.smithi179.stdout: automake-1.16.2-8.el9.noarch 2024-01-31T04:59:51.545 INFO:teuthology.orchestra.run.smithi179.stdout: bison-3.7.4-5.el9.x86_64 2024-01-31T04:59:51.545 INFO:teuthology.orchestra.run.smithi179.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-01-31T04:59:51.545 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.545 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-base-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.545 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.545 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-fuse-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.545 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-grafana-dashboards-2:19.0.0-885.g661946e7.el9.noarch 2024-01-31T04:59:51.546 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-immutable-object-cache-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.546 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mds-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.546 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.546 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-cephadm-2:19.0.0-885.g661946e7.el9.noarch 2024-01-31T04:59:51.546 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-dashboard-2:19.0.0-885.g661946e7.el9.noarch 2024-01-31T04:59:51.546 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-diskprediction-local-2:19.0.0-885.g661946e7.el9.noarch 2024-01-31T04:59:51.546 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-modules-core-2:19.0.0-885.g661946e7.el9.noarch 2024-01-31T04:59:51.546 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-rook-2:19.0.0-885.g661946e7.el9.noarch 2024-01-31T04:59:51.546 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mon-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.546 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-osd-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.546 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-prometheus-alerts-2:19.0.0-885.g661946e7.el9.noarch 2024-01-31T04:59:51.546 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-radosgw-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.546 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-selinux-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.546 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-test-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.547 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-volume-2:19.0.0-885.g661946e7.el9.noarch 2024-01-31T04:59:51.547 INFO:teuthology.orchestra.run.smithi179.stdout: cephadm-2:19.0.0-885.g661946e7.el9.noarch 2024-01-31T04:59:51.547 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-mirror-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.547 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-shell-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.547 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-top-2:19.0.0-885.g661946e7.el9.noarch 2024-01-31T04:59:51.547 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-01-31T04:59:51.547 INFO:teuthology.orchestra.run.smithi179.stdout: flex-2.6.4-9.el9.x86_64 2024-01-31T04:59:51.547 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-01-31T04:59:51.547 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-01-31T04:59:51.547 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-01-31T04:59:51.547 INFO:teuthology.orchestra.run.smithi179.stdout: fuse-2.9.9-15.el9.x86_64 2024-01-31T04:59:51.547 INFO:teuthology.orchestra.run.smithi179.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-01-31T04:59:51.547 INFO:teuthology.orchestra.run.smithi179.stdout: jq-1.6-16.el9.x86_64 2024-01-31T04:59:51.548 INFO:teuthology.orchestra.run.smithi179.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-01-31T04:59:51.548 INFO:teuthology.orchestra.run.smithi179.stdout: libarrow-9.0.0-10.el9.x86_64 2024-01-31T04:59:51.548 INFO:teuthology.orchestra.run.smithi179.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-01-31T04:59:51.548 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs-devel-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.548 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs2-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.548 INFO:teuthology.orchestra.run.smithi179.stdout: libcephsqlite-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.548 INFO:teuthology.orchestra.run.smithi179.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-01-31T04:59:51.548 INFO:teuthology.orchestra.run.smithi179.stdout: liboath-2.6.7-2.el9.x86_64 2024-01-31T04:59:51.548 INFO:teuthology.orchestra.run.smithi179.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-01-31T04:59:51.548 INFO:teuthology.orchestra.run.smithi179.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-01-31T04:59:51.548 INFO:teuthology.orchestra.run.smithi179.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-01-31T04:59:51.548 INFO:teuthology.orchestra.run.smithi179.stdout: librados-devel-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.548 INFO:teuthology.orchestra.run.smithi179.stdout: libradosstriper1-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.549 INFO:teuthology.orchestra.run.smithi179.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-01-31T04:59:51.549 INFO:teuthology.orchestra.run.smithi179.stdout: librgw2-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.549 INFO:teuthology.orchestra.run.smithi179.stdout: libtool-2.4.6-45.el9.x86_64 2024-01-31T04:59:51.549 INFO:teuthology.orchestra.run.smithi179.stdout: libunwind-1.6.2-1.el9.x86_64 2024-01-31T04:59:51.549 INFO:teuthology.orchestra.run.smithi179.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2024-01-31T04:59:51.549 INFO:teuthology.orchestra.run.smithi179.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-01-31T04:59:51.549 INFO:teuthology.orchestra.run.smithi179.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-01-31T04:59:51.549 INFO:teuthology.orchestra.run.smithi179.stdout: lua-5.4.4-4.el9.x86_64 2024-01-31T04:59:51.549 INFO:teuthology.orchestra.run.smithi179.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-01-31T04:59:51.549 INFO:teuthology.orchestra.run.smithi179.stdout: luarocks-3.9.2-1.el9.noarch 2024-01-31T04:59:51.549 INFO:teuthology.orchestra.run.smithi179.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-01-31T04:59:51.549 INFO:teuthology.orchestra.run.smithi179.stdout: openblas-0.3.21-2.el9.x86_64 2024-01-31T04:59:51.549 INFO:teuthology.orchestra.run.smithi179.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-01-31T04:59:51.549 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2024-01-31T04:59:51.550 INFO:teuthology.orchestra.run.smithi179.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-01-31T04:59:51.550 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-13.11-1.el9.x86_64 2024-01-31T04:59:51.550 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-01-31T04:59:51.550 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-01-31T04:59:51.550 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-server-13.11-1.el9.x86_64 2024-01-31T04:59:51.550 INFO:teuthology.orchestra.run.smithi179.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2024-01-31T04:59:51.550 INFO:teuthology.orchestra.run.smithi179.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-01-31T04:59:51.550 INFO:teuthology.orchestra.run.smithi179.stdout: python3-babel-2.9.1-2.el9.noarch 2024-01-31T04:59:51.550 INFO:teuthology.orchestra.run.smithi179.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-01-31T04:59:51.550 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-01-31T04:59:51.550 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-argparse-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.550 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.550 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cephfs-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.550 INFO:teuthology.orchestra.run.smithi179.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-01-31T04:59:51.550 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-01-31T04:59:51.551 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-01-31T04:59:51.551 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-01-31T04:59:51.551 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-01-31T04:59:51.551 INFO:teuthology.orchestra.run.smithi179.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-01-31T04:59:51.551 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-01-31T04:59:51.551 INFO:teuthology.orchestra.run.smithi179.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-01-31T04:59:51.551 INFO:teuthology.orchestra.run.smithi179.stdout: python3-google-auth-1:2.26.2-1.el9.noarch 2024-01-31T04:59:51.551 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-01-31T04:59:51.551 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-01-31T04:59:51.551 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-01-31T04:59:51.551 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-01-31T04:59:51.551 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-01-31T04:59:51.551 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jinja2-2.11.3-4.el9.noarch 2024-01-31T04:59:51.552 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-01-31T04:59:51.552 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-01-31T04:59:51.552 INFO:teuthology.orchestra.run.smithi179.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-01-31T04:59:51.552 INFO:teuthology.orchestra.run.smithi179.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-01-31T04:59:51.552 INFO:teuthology.orchestra.run.smithi179.stdout: python3-mako-1.1.4-6.el9.noarch 2024-01-31T04:59:51.552 INFO:teuthology.orchestra.run.smithi179.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-01-31T04:59:51.552 INFO:teuthology.orchestra.run.smithi179.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-01-31T04:59:51.552 INFO:teuthology.orchestra.run.smithi179.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-01-31T04:59:51.552 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-01-31T04:59:51.552 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-01-31T04:59:51.552 INFO:teuthology.orchestra.run.smithi179.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-01-31T04:59:51.552 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-01-31T04:59:51.552 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ply-3.11-14.el9.noarch 2024-01-31T04:59:51.552 INFO:teuthology.orchestra.run.smithi179.stdout: python3-portend-3.1.0-2.el9.noarch 2024-01-31T04:59:51.553 INFO:teuthology.orchestra.run.smithi179.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-01-31T04:59:51.553 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-01-31T04:59:51.553 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-01-31T04:59:51.553 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-01-31T04:59:51.553 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pycparser-2.20-6.el9.noarch 2024-01-31T04:59:51.553 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-01-31T04:59:51.553 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pytz-2021.1-5.el9.noarch 2024-01-31T04:59:51.553 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rados-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.553 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rbd-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.553 INFO:teuthology.orchestra.run.smithi179.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-01-31T04:59:51.553 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests-2.25.1-8.el9.noarch 2024-01-31T04:59:51.553 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-01-31T04:59:51.554 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rgw-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.554 INFO:teuthology.orchestra.run.smithi179.stdout: python3-routes-2.5.1-5.el9.noarch 2024-01-31T04:59:51.554 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rsa-4.9-2.el9.noarch 2024-01-31T04:59:51.554 INFO:teuthology.orchestra.run.smithi179.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-01-31T04:59:51.554 INFO:teuthology.orchestra.run.smithi179.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-01-31T04:59:51.554 INFO:teuthology.orchestra.run.smithi179.stdout: python3-toml-0.10.2-6.el9.noarch 2024-01-31T04:59:51.554 INFO:teuthology.orchestra.run.smithi179.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-01-31T04:59:51.554 INFO:teuthology.orchestra.run.smithi179.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-01-31T04:59:51.554 INFO:teuthology.orchestra.run.smithi179.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-01-31T04:59:51.554 INFO:teuthology.orchestra.run.smithi179.stdout: python3-webob-1.8.7-6.el9.noarch 2024-01-31T04:59:51.554 INFO:teuthology.orchestra.run.smithi179.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-01-31T04:59:51.555 INFO:teuthology.orchestra.run.smithi179.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-01-31T04:59:51.555 INFO:teuthology.orchestra.run.smithi179.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-01-31T04:59:51.555 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-fuse-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.555 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-mirror-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.556 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-nbd-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-31T04:59:51.556 INFO:teuthology.orchestra.run.smithi179.stdout: re2-1:20211101-3.el9.x86_64 2024-01-31T04:59:51.556 INFO:teuthology.orchestra.run.smithi179.stdout: socat-1.7.4.1-5.el9.x86_64 2024-01-31T04:59:51.556 INFO:teuthology.orchestra.run.smithi179.stdout: thrift-0.15.0-2.el9.x86_64 2024-01-31T04:59:51.556 INFO:teuthology.orchestra.run.smithi179.stdout: uuid-1.6.2-55.el9.x86_64 2024-01-31T04:59:51.556 INFO:teuthology.orchestra.run.smithi179.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-01-31T04:59:51.556 INFO:teuthology.orchestra.run.smithi179.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-01-31T04:59:51.557 INFO:teuthology.orchestra.run.smithi179.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-01-31T04:59:51.557 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-01-31T04:59:51.557 INFO:teuthology.orchestra.run.smithi179.stdout:Complete! 2024-01-31T04:59:51.932 DEBUG:teuthology.parallel:result is None 2024-01-31T04:59:52.130 DEBUG:teuthology.parallel:result is None 2024-01-31T04:59:52.131 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=661946e7044723130c03627323f6a879a9848cb5 2024-01-31T04:59:52.272 DEBUG:teuthology.orchestra.run.smithi099:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-01-31T04:59:52.299 INFO:teuthology.orchestra.run.smithi099.stdout:19.0.0-885.g661946e7.el9 2024-01-31T04:59:52.300 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-885.g661946e7.el9 2024-01-31T04:59:52.300 INFO:teuthology.task.install:The correct ceph version 19.0.0-885.g661946e7 is installed. 2024-01-31T04:59:52.302 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=661946e7044723130c03627323f6a879a9848cb5 2024-01-31T04:59:52.645 DEBUG:teuthology.orchestra.run.smithi179:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-01-31T04:59:52.668 INFO:teuthology.orchestra.run.smithi179.stdout:19.0.0-885.g661946e7.el9 2024-01-31T04:59:52.668 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-885.g661946e7.el9 2024-01-31T04:59:52.668 INFO:teuthology.task.install:The correct ceph version 19.0.0-885.g661946e7 is installed. 2024-01-31T04:59:52.670 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=661946e7044723130c03627323f6a879a9848cb5 2024-01-31T04:59:53.022 DEBUG:teuthology.orchestra.run.smithi181:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-01-31T04:59:53.047 INFO:teuthology.orchestra.run.smithi181.stdout:19.0.0-885.g661946e7.el9 2024-01-31T04:59:53.048 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-885.g661946e7.el9 2024-01-31T04:59:53.048 INFO:teuthology.task.install:The correct ceph version 19.0.0-885.g661946e7 is installed. 2024-01-31T04:59:53.050 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-01-31T04:59:53.050 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-31T04:59:53.050 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-31T04:59:53.080 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-31T04:59:53.080 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-31T04:59:53.115 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-01-31T04:59:53.115 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-31T04:59:53.149 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-01-31T04:59:53.149 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-31T04:59:53.149 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/daemon-helper 2024-01-31T04:59:53.176 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-31T04:59:53.243 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-31T04:59:53.243 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/daemon-helper 2024-01-31T04:59:53.276 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-31T04:59:53.346 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-01-31T04:59:53.346 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/daemon-helper 2024-01-31T04:59:53.375 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-31T04:59:53.445 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-01-31T04:59:53.446 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-31T04:59:53.446 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-31T04:59:53.472 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-31T04:59:53.539 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-31T04:59:53.540 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-31T04:59:53.570 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-31T04:59:53.640 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-01-31T04:59:53.640 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-31T04:59:53.673 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-31T04:59:53.743 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-01-31T04:59:53.743 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-31T04:59:53.743 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/stdin-killer 2024-01-31T04:59:53.769 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-31T04:59:53.837 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-31T04:59:53.837 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/stdin-killer 2024-01-31T04:59:53.867 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-31T04:59:53.937 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-01-31T04:59:53.937 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/stdin-killer 2024-01-31T04:59:53.968 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-31T04:59:54.039 INFO:teuthology.run_tasks:Running task cephadm... 2024-01-31T04:59:54.140 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '661946e7044723130c03627323f6a879a9848cb5', 'subvols': {'create': 2}} 2024-01-31T04:59:54.140 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 2024-01-31T04:59:54.141 INFO:tasks.cephadm:Cluster fsid is 9288ff44-bff5-11ee-95b3-87774f69a715 2024-01-31T04:59:54.142 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-01-31T04:59:54.142 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.99', 'mon.b': '172.21.15.179', 'mon.c': '172.21.15.181'} 2024-01-31T04:59:54.142 INFO:tasks.cephadm:First mon is mon.a on smithi099 2024-01-31T04:59:54.142 INFO:tasks.cephadm:First mgr is x 2024-01-31T04:59:54.142 INFO:tasks.cephadm:Normalizing hostnames... 2024-01-31T04:59:54.142 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname $(hostname -s) 2024-01-31T04:59:54.169 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname $(hostname -s) 2024-01-31T04:59:54.200 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname $(hostname -s) 2024-01-31T04:59:54.231 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-01-31T04:59:54.231 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=661946e7044723130c03627323f6a879a9848cb5 2024-01-31T04:59:54.467 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '661946e7044723130c03627323f6a879a9848cb5', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/76233/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-885-g661946e7', 'node_name': '172.21.5.36+adami06', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-885.g661946e7'}, 'url': 'https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-01-25 07:26:33.077331', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-vshankar-testing-20240125.044502', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-01-31T04:59:54.612 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref wip-vshankar-testing-20240125.044502, sha1 661946e7044723130c03627323f6a879a9848cb5 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=661946e7044723130c03627323f6a879a9848cb5 2024-01-31T04:59:54.614 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/centos/9/x86_64/flavors/default/cephadm 2024-01-31T04:59:54.614 DEBUG:teuthology.orchestra.run.smithi099:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-01-31T04:59:55.007 INFO:teuthology.orchestra.run.smithi099.stdout:-rw-r--r--. 1 ubuntu ubuntu 760779 Jan 31 04:59 /home/ubuntu/cephtest/cephadm 2024-01-31T04:59:55.008 DEBUG:teuthology.orchestra.run.smithi179:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-01-31T04:59:55.710 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r--. 1 ubuntu ubuntu 760779 Jan 31 04:59 /home/ubuntu/cephtest/cephadm 2024-01-31T04:59:55.711 DEBUG:teuthology.orchestra.run.smithi181:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-01-31T04:59:56.414 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r--. 1 ubuntu ubuntu 760779 Jan 31 04:59 /home/ubuntu/cephtest/cephadm 2024-01-31T04:59:56.414 DEBUG:teuthology.orchestra.run.smithi099:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-01-31T04:59:56.433 DEBUG:teuthology.orchestra.run.smithi179:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-01-31T04:59:56.453 DEBUG:teuthology.orchestra.run.smithi181:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-01-31T04:59:56.491 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 on all hosts... 2024-01-31T04:59:56.491 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 pull 2024-01-31T04:59:56.494 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 pull 2024-01-31T04:59:56.496 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 pull 2024-01-31T04:59:57.341 INFO:teuthology.orchestra.run.smithi181.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5... 2024-01-31T04:59:57.400 INFO:teuthology.orchestra.run.smithi179.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5... 2024-01-31T04:59:57.408 INFO:teuthology.orchestra.run.smithi099.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5... 2024-01-31T05:00:58.544 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-01-31T05:00:58.544 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_version": "ceph version 19.0.0-885-g661946e7 (661946e7044723130c03627323f6a879a9848cb5) squid (dev)", 2024-01-31T05:00:58.544 INFO:teuthology.orchestra.run.smithi099.stdout: "image_id": "0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775", 2024-01-31T05:00:58.544 INFO:teuthology.orchestra.run.smithi099.stdout: "repo_digests": [ 2024-01-31T05:00:58.544 INFO:teuthology.orchestra.run.smithi099.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06" 2024-01-31T05:00:58.544 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-01-31T05:00:58.545 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-01-31T05:00:59.912 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-01-31T05:00:59.912 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_version": "ceph version 19.0.0-885-g661946e7 (661946e7044723130c03627323f6a879a9848cb5) squid (dev)", 2024-01-31T05:00:59.912 INFO:teuthology.orchestra.run.smithi179.stdout: "image_id": "0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775", 2024-01-31T05:00:59.912 INFO:teuthology.orchestra.run.smithi179.stdout: "repo_digests": [ 2024-01-31T05:00:59.913 INFO:teuthology.orchestra.run.smithi179.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06" 2024-01-31T05:00:59.913 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-01-31T05:00:59.913 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-01-31T05:01:07.759 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-01-31T05:01:07.759 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_version": "ceph version 19.0.0-885-g661946e7 (661946e7044723130c03627323f6a879a9848cb5) squid (dev)", 2024-01-31T05:01:07.759 INFO:teuthology.orchestra.run.smithi181.stdout: "image_id": "0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775", 2024-01-31T05:01:07.759 INFO:teuthology.orchestra.run.smithi181.stdout: "repo_digests": [ 2024-01-31T05:01:07.759 INFO:teuthology.orchestra.run.smithi181.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06" 2024-01-31T05:01:07.759 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-01-31T05:01:07.759 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-01-31T05:01:07.785 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /etc/ceph 2024-01-31T05:01:07.821 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /etc/ceph 2024-01-31T05:01:07.857 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /etc/ceph 2024-01-31T05:01:07.888 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 777 /etc/ceph 2024-01-31T05:01:07.918 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 777 /etc/ceph 2024-01-31T05:01:07.947 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 777 /etc/ceph 2024-01-31T05:01:07.976 INFO:tasks.cephadm:Writing seed config... 2024-01-31T05:01:07.977 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-01-31T05:01:07.977 INFO:tasks.cephadm: override: [client] debug client = 20 2024-01-31T05:01:07.977 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-01-31T05:01:07.977 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-01-31T05:01:07.977 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-01-31T05:01:07.977 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-01-31T05:01:07.978 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-01-31T05:01:07.978 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-01-31T05:01:07.978 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-01-31T05:01:07.978 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-01-31T05:01:07.978 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-01-31T05:01:07.978 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-01-31T05:01:07.978 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-01-31T05:01:07.978 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-01-31T05:01:07.978 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-01-31T05:01:07.978 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-01-31T05:01:07.978 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-01-31T05:01:07.978 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-01-31T05:01:07.978 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-01-31T05:01:07.978 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-01-31T05:01:07.978 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-01-31T05:01:07.979 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-01-31T05:01:07.979 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-01-31T05:01:07.979 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-01-31T05:01:07.979 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-01-31T05:01:07.979 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-01-31T05:01:07.979 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-01-31T05:01:07.979 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-01-31T05:01:07.979 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-01-31T05:01:07.979 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-01-31T05:01:07.979 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-01-31T05:01:07.979 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-01-31T05:01:07.979 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-01-31T05:01:07.979 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-01-31T05:01:07.979 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-01-31T05:01:07.979 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-01-31T05:01:07.980 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-01-31T05:01:07.980 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-01-31T05:01:07.980 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-01-31T05:01:07.980 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-01-31T05:01:07.980 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-01-31T05:01:07.980 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-01-31T05:01:07.980 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-01-31T05:01:07.980 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-01-31T05:01:07.980 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-01-31T05:01:07.980 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-01-31T05:01:07.981 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-31T05:01:07.981 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-01-31T05:01:07.999 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 9288ff44-bff5-11ee-95b3-87774f69a715 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-01-31T05:01:07.999 DEBUG:teuthology.orchestra.run.smithi099:mon.a> sudo journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mon.a.service 2024-01-31T05:01:08.042 DEBUG:teuthology.orchestra.run.smithi099:mgr.x> sudo journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mgr.x.service 2024-01-31T05:01:08.085 INFO:tasks.cephadm:Bootstrapping... 2024-01-31T05:01:08.086 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 -v bootstrap --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.99 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-01-31T05:01:08.281 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-01-31T05:01:08.281 INFO:teuthology.orchestra.run.smithi099.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5', '-v', 'bootstrap', '--fsid', '9288ff44-bff5-11ee-95b3-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.99', '--skip-admin-label'] 2024-01-31T05:01:08.305 INFO:teuthology.orchestra.run.smithi099.stdout:/bin/podman: stdout 4.8.1 2024-01-31T05:01:08.305 INFO:teuthology.orchestra.run.smithi099.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-01-31T05:01:08.305 INFO:teuthology.orchestra.run.smithi099.stdout:Verifying podman|docker is present... 2024-01-31T05:01:08.329 INFO:teuthology.orchestra.run.smithi099.stdout:/bin/podman: stdout 4.8.1 2024-01-31T05:01:08.329 INFO:teuthology.orchestra.run.smithi099.stdout:Verifying lvm2 is present... 2024-01-31T05:01:08.329 INFO:teuthology.orchestra.run.smithi099.stdout:Verifying time synchronization is in place... 2024-01-31T05:01:08.336 INFO:teuthology.orchestra.run.smithi099.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-01-31T05:01:08.336 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-01-31T05:01:08.342 INFO:teuthology.orchestra.run.smithi099.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-01-31T05:01:08.342 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stdout inactive 2024-01-31T05:01:08.348 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stdout enabled 2024-01-31T05:01:08.354 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stdout active 2024-01-31T05:01:08.354 INFO:teuthology.orchestra.run.smithi099.stdout:Unit chronyd.service is enabled and running 2024-01-31T05:01:08.354 INFO:teuthology.orchestra.run.smithi099.stdout:Repeating the final host check... 2024-01-31T05:01:08.377 INFO:teuthology.orchestra.run.smithi099.stdout:/bin/podman: stdout 4.8.1 2024-01-31T05:01:08.377 INFO:teuthology.orchestra.run.smithi099.stdout:podman (/bin/podman) version 4.8.1 is present 2024-01-31T05:01:08.377 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl is present 2024-01-31T05:01:08.377 INFO:teuthology.orchestra.run.smithi099.stdout:lvcreate is present 2024-01-31T05:01:08.383 INFO:teuthology.orchestra.run.smithi099.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-01-31T05:01:08.383 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-01-31T05:01:08.389 INFO:teuthology.orchestra.run.smithi099.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-01-31T05:01:08.389 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stdout inactive 2024-01-31T05:01:08.395 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stdout enabled 2024-01-31T05:01:08.401 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stdout active 2024-01-31T05:01:08.401 INFO:teuthology.orchestra.run.smithi099.stdout:Unit chronyd.service is enabled and running 2024-01-31T05:01:08.401 INFO:teuthology.orchestra.run.smithi099.stdout:Host looks OK 2024-01-31T05:01:08.401 INFO:teuthology.orchestra.run.smithi099.stdout:Cluster fsid: 9288ff44-bff5-11ee-95b3-87774f69a715 2024-01-31T05:01:08.401 INFO:teuthology.orchestra.run.smithi099.stdout:Acquiring lock 140249524164832 on /run/cephadm/9288ff44-bff5-11ee-95b3-87774f69a715.lock 2024-01-31T05:01:08.401 INFO:teuthology.orchestra.run.smithi099.stdout:Lock 140249524164832 acquired on /run/cephadm/9288ff44-bff5-11ee-95b3-87774f69a715.lock 2024-01-31T05:01:08.402 INFO:teuthology.orchestra.run.smithi099.stdout:Verifying IP 172.21.15.99 port 3300 ... 2024-01-31T05:01:08.402 INFO:teuthology.orchestra.run.smithi099.stdout:Verifying IP 172.21.15.99 port 6789 ... 2024-01-31T05:01:08.402 INFO:teuthology.orchestra.run.smithi099.stdout:Base mon IP(s) is [172.21.15.99:3300, 172.21.15.99:6789], mon addrv is [v2:172.21.15.99:3300,v1:172.21.15.99:6789] 2024-01-31T05:01:08.405 INFO:teuthology.orchestra.run.smithi099.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.99 metric 100 2024-01-31T05:01:08.406 INFO:teuthology.orchestra.run.smithi099.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.99 metric 100 2024-01-31T05:01:08.408 INFO:teuthology.orchestra.run.smithi099.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-01-31T05:01:08.408 INFO:teuthology.orchestra.run.smithi099.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-01-31T05:01:08.408 INFO:teuthology.orchestra.run.smithi099.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1780sec hoplimit 64 pref medium 2024-01-31T05:01:08.410 INFO:teuthology.orchestra.run.smithi099.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-01-31T05:01:08.410 INFO:teuthology.orchestra.run.smithi099.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-01-31T05:01:08.410 INFO:teuthology.orchestra.run.smithi099.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-01-31T05:01:08.411 INFO:teuthology.orchestra.run.smithi099.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-01-31T05:01:08.411 INFO:teuthology.orchestra.run.smithi099.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d803/64 scope link 2024-01-31T05:01:08.411 INFO:teuthology.orchestra.run.smithi099.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-01-31T05:01:08.411 INFO:teuthology.orchestra.run.smithi099.stdout:Mon IP `172.21.15.99` is in CIDR network `172.21.0.0/20` 2024-01-31T05:01:08.411 INFO:teuthology.orchestra.run.smithi099.stdout:Mon IP `172.21.15.99` is in CIDR network `172.21.0.0/20` 2024-01-31T05:01:08.411 INFO:teuthology.orchestra.run.smithi099.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-01-31T05:01:08.412 INFO:teuthology.orchestra.run.smithi099.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-01-31T05:01:08.413 INFO:teuthology.orchestra.run.smithi099.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5... 2024-01-31T05:01:08.851 INFO:teuthology.orchestra.run.smithi099.stdout:/bin/podman: stdout 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 2024-01-31T05:01:08.851 INFO:teuthology.orchestra.run.smithi099.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5... 2024-01-31T05:01:08.851 INFO:teuthology.orchestra.run.smithi099.stdout:/bin/podman: stderr Getting image source signatures 2024-01-31T05:01:08.852 INFO:teuthology.orchestra.run.smithi099.stdout:/bin/podman: stderr Copying blob sha256:7526f7e228dfc90a8cd9a697e920af939ccb44066789c4e5461c5efe2a22fe5d 2024-01-31T05:01:08.852 INFO:teuthology.orchestra.run.smithi099.stdout:/bin/podman: stderr Copying blob sha256:ea3366b8a90265ae3f6d3736cb0de4b52da4ffec919b46c6cb5bc5be1372efe8 2024-01-31T05:01:08.852 INFO:teuthology.orchestra.run.smithi099.stdout:/bin/podman: stderr Copying config sha256:0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 2024-01-31T05:01:08.852 INFO:teuthology.orchestra.run.smithi099.stdout:/bin/podman: stderr Writing manifest to image destination 2024-01-31T05:01:09.764 INFO:teuthology.orchestra.run.smithi099.stdout:ceph: stdout ceph version 19.0.0-885-g661946e7 (661946e7044723130c03627323f6a879a9848cb5) squid (dev) 2024-01-31T05:01:09.765 INFO:teuthology.orchestra.run.smithi099.stdout:Ceph version: ceph version 19.0.0-885-g661946e7 (661946e7044723130c03627323f6a879a9848cb5) squid (dev) 2024-01-31T05:01:09.765 INFO:teuthology.orchestra.run.smithi099.stdout:Extracting ceph user uid/gid from container image... 2024-01-31T05:01:10.778 INFO:teuthology.orchestra.run.smithi099.stdout:stat: stdout 167 167 2024-01-31T05:01:10.778 INFO:teuthology.orchestra.run.smithi099.stdout:Creating initial keys... 2024-01-31T05:01:11.675 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph-authtool: stdout AQAX1LllYB0vBhAAEpKEnotMQ15Bh899ewcKQw== 2024-01-31T05:01:19.415 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph-authtool: stdout AQAY1LllwUThOhAAPnut7+bSBVy3PucYO+PGOw== 2024-01-31T05:01:22.574 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph-authtool: stdout AQAh1Llld2fOORAAYr4H2xjY3QUDjLFupMWmSg== 2024-01-31T05:01:22.575 INFO:teuthology.orchestra.run.smithi099.stdout:Creating initial monmap... 2024-01-31T05:01:23.629 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-01-31T05:01:23.629 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-01-31T05:01:23.630 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 9288ff44-bff5-11ee-95b3-87774f69a715 2024-01-31T05:01:23.630 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-01-31T05:01:23.630 INFO:teuthology.orchestra.run.smithi099.stdout:monmaptool for a [v2:172.21.15.99:3300,v1:172.21.15.99:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-01-31T05:01:23.630 INFO:teuthology.orchestra.run.smithi099.stdout:setting min_mon_release = quincy 2024-01-31T05:01:23.630 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/monmaptool: set fsid to 9288ff44-bff5-11ee-95b3-87774f69a715 2024-01-31T05:01:23.630 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-01-31T05:01:23.630 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:01:23.630 INFO:teuthology.orchestra.run.smithi099.stdout:Creating mon... 2024-01-31T05:01:24.526 INFO:teuthology.orchestra.run.smithi099.stdout:create mon.a on 2024-01-31T05:01:24.747 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-01-31T05:01:24.970 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-01-31T05:01:25.195 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-9288ff44-bff5-11ee-95b3-87774f69a715.target → /etc/systemd/system/ceph-9288ff44-bff5-11ee-95b3-87774f69a715.target. 2024-01-31T05:01:25.195 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-9288ff44-bff5-11ee-95b3-87774f69a715.target → /etc/systemd/system/ceph-9288ff44-bff5-11ee-95b3-87774f69a715.target. 2024-01-31T05:01:25.417 INFO:teuthology.orchestra.run.smithi099.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mon.a 2024-01-31T05:01:25.418 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stderr Failed to reset failed state of unit ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mon.a.service: Unit ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mon.a.service not loaded. 2024-01-31T05:01:25.578 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-9288ff44-bff5-11ee-95b3-87774f69a715.target.wants/ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mon.a.service → /etc/systemd/system/ceph-9288ff44-bff5-11ee-95b3-87774f69a715@.service. 2024-01-31T05:01:26.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:26 smithi099 podman[31227]: 2024-01-31 05:01:26.057255513 +0000 UTC m=+0.348243392 container start 8ae57287a8de9a7c5e237cc827191d05882c7cffb7c3faa15f1495272a68703f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mon-a, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.31.3, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240123, GIT_BRANCH=HEAD) 2024-01-31T05:01:26.158 INFO:teuthology.orchestra.run.smithi099.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-01-31T05:01:26.158 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stdout disabled 2024-01-31T05:01:26.165 INFO:teuthology.orchestra.run.smithi099.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-01-31T05:01:26.165 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stdout inactive 2024-01-31T05:01:26.165 INFO:teuthology.orchestra.run.smithi099.stdout:firewalld.service is not enabled 2024-01-31T05:01:26.165 INFO:teuthology.orchestra.run.smithi099.stdout:Not possible to enable service . firewalld.service is not available 2024-01-31T05:01:26.165 INFO:teuthology.orchestra.run.smithi099.stdout:Waiting for mon to start... 2024-01-31T05:01:26.166 INFO:teuthology.orchestra.run.smithi099.stdout:Waiting for mon... 2024-01-31T05:01:26.479 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:26 smithi099 ceph-mon[31246]: mkfs 9288ff44-bff5-11ee-95b3-87774f69a715 2024-01-31T05:01:26.479 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:26 smithi099 ceph-mon[31246]: mon.a is new leader, mons a in quorum (ranks 0) 2024-01-31T05:01:26.479 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:26 smithi099 bash[31227]: 8ae57287a8de9a7c5e237cc827191d05882c7cffb7c3faa15f1495272a68703f 2024-01-31T05:01:26.479 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:26 smithi099 systemd[1]: Started Ceph mon.a for 9288ff44-bff5-11ee-95b3-87774f69a715. 2024-01-31T05:01:27.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:27 smithi099 ceph-mon[31246]: mon.a is new leader, mons a in quorum (ranks 0) 2024-01-31T05:01:27.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:27 smithi099 ceph-mon[31246]: monmap e1: 1 mons at {a=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-31T05:01:27.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:27 smithi099 ceph-mon[31246]: fsmap 2024-01-31T05:01:27.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:27 smithi099 ceph-mon[31246]: osdmap e1: 0 total, 0 up, 0 in 2024-01-31T05:01:27.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:27 smithi099 ceph-mon[31246]: mgrmap e1: no daemons active 2024-01-31T05:01:27.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:27 smithi099 ceph-mon[31246]: from='client.? 172.21.15.99:0/3097931926' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-01-31T05:01:28.270 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout cluster: 2024-01-31T05:01:28.277 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout id: 9288ff44-bff5-11ee-95b3-87774f69a715 2024-01-31T05:01:28.277 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-01-31T05:01:28.277 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout 2024-01-31T05:01:28.277 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout services: 2024-01-31T05:01:28.277 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.760864s) 2024-01-31T05:01:28.278 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-01-31T05:01:28.278 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-01-31T05:01:28.278 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout 2024-01-31T05:01:28.278 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout data: 2024-01-31T05:01:28.278 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-01-31T05:01:28.278 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-01-31T05:01:28.278 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-01-31T05:01:28.278 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout pgs: 2024-01-31T05:01:28.278 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout 2024-01-31T05:01:28.278 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:26.815+0000 7f502da9d700 1 Processor -- start 2024-01-31T05:01:28.278 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:26.815+0000 7f502da9d700 1 -- start start 2024-01-31T05:01:28.278 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:26.815+0000 7f502da9d700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5028107bb0 0x7f5028109fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:01:28.278 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:26.815+0000 7f502da9d700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f502807ae70 con 0x7f5028107bb0 2024-01-31T05:01:28.278 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:26.816+0000 7f50277fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5028107bb0 0x7f5028109fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:01:28.279 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:26.816+0000 7f50277fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5028107bb0 0x7f5028109fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53122/0 (socket says 172.21.15.99:53122) 2024-01-31T05:01:28.279 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:26.816+0000 7f50277fe700 1 -- 172.21.15.99:0/2002151093 learned_addr learned my addr 172.21.15.99:0/2002151093 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:01:28.279 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:26.816+0000 7f50277fe700 1 -- 172.21.15.99:0/2002151093 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f502810a4e0 con 0x7f5028107bb0 2024-01-31T05:01:28.279 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:26.816+0000 7f50277fe700 1 --2- 172.21.15.99:0/2002151093 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5028107bb0 0x7f5028109fa0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f50180098a0 tx=0x7f5018009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d435b532d35e95f server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:01:28.279 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:26.816+0000 7f50267fc700 1 -- 172.21.15.99:0/2002151093 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5018004160 con 0x7f5028107bb0 2024-01-31T05:01:28.279 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:26.816+0000 7f50267fc700 1 -- 172.21.15.99:0/2002151093 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50180042c0 con 0x7f5028107bb0 2024-01-31T05:01:28.279 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:26.816+0000 7f50267fc700 1 -- 172.21.15.99:0/2002151093 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50180045a0 con 0x7f5028107bb0 2024-01-31T05:01:28.279 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:26.817+0000 7f502da9d700 1 -- 172.21.15.99:0/2002151093 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5028107bb0 msgr2=0x7f5028109fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:01:28.279 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:26.817+0000 7f502da9d700 1 --2- 172.21.15.99:0/2002151093 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5028107bb0 0x7f5028109fa0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f50180098a0 tx=0x7f5018009bb0 comp rx=0 tx=0).stop 2024-01-31T05:01:28.279 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:26.817+0000 7f502da9d700 1 -- 172.21.15.99:0/2002151093 shutdown_connections 2024-01-31T05:01:28.279 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:26.817+0000 7f502da9d700 1 --2- 172.21.15.99:0/2002151093 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5028107bb0 0x7f5028109fa0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:01:28.279 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:26.817+0000 7f502da9d700 1 -- 172.21.15.99:0/2002151093 >> 172.21.15.99:0/2002151093 conn(0x7f50281015e0 msgr2=0x7f5028103a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:01:28.279 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:26.817+0000 7f502da9d700 1 -- 172.21.15.99:0/2002151093 shutdown_connections 2024-01-31T05:01:28.280 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:26.817+0000 7f502da9d700 1 -- 172.21.15.99:0/2002151093 wait complete. 2024-01-31T05:01:28.280 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:26.817+0000 7f502da9d700 1 Processor -- start 2024-01-31T05:01:28.280 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:26.818+0000 7f502da9d700 1 -- start start 2024-01-31T05:01:28.280 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:26.818+0000 7f502da9d700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5028107bb0 0x7f5028107430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:01:28.280 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:26.818+0000 7f502da9d700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5028107970 con 0x7f5028107bb0 2024-01-31T05:01:28.280 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:26.818+0000 7f50277fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5028107bb0 0x7f5028107430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:01:28.280 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:26.818+0000 7f50277fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5028107bb0 0x7f5028107430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53136/0 (socket says 172.21.15.99:53136) 2024-01-31T05:01:28.280 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:26.818+0000 7f50277fe700 1 -- 172.21.15.99:0/3097931926 learned_addr learned my addr 172.21.15.99:0/3097931926 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:01:28.280 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:26.818+0000 7f50277fe700 1 -- 172.21.15.99:0/3097931926 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5018009550 con 0x7f5028107bb0 2024-01-31T05:01:28.280 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:26.818+0000 7f50277fe700 1 --2- 172.21.15.99:0/3097931926 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5028107bb0 0x7f5028107430 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f502807a2b0 tx=0x7f5018004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:01:28.280 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:26.818+0000 7f5024ff9700 1 -- 172.21.15.99:0/3097931926 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5018011630 con 0x7f5028107bb0 2024-01-31T05:01:28.280 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:26.818+0000 7f5024ff9700 1 -- 172.21.15.99:0/3097931926 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5018011790 con 0x7f5028107bb0 2024-01-31T05:01:28.281 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:26.818+0000 7f5024ff9700 1 -- 172.21.15.99:0/3097931926 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5018011a30 con 0x7f5028107bb0 2024-01-31T05:01:28.281 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:26.818+0000 7f502da9d700 1 -- 172.21.15.99:0/3097931926 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5028105b60 con 0x7f5028107bb0 2024-01-31T05:01:28.281 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:26.819+0000 7f502da9d700 1 -- 172.21.15.99:0/3097931926 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5028106000 con 0x7f5028107bb0 2024-01-31T05:01:28.281 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:26.819+0000 7f5024ff9700 1 -- 172.21.15.99:0/3097931926 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f5018022070 con 0x7f5028107bb0 2024-01-31T05:01:28.281 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:26.819+0000 7f5024ff9700 1 -- 172.21.15.99:0/3097931926 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f501801c450 con 0x7f5028107bb0 2024-01-31T05:01:28.281 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:26.819+0000 7f502da9d700 1 -- 172.21.15.99:0/3097931926 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5028106a10 con 0x7f5028107bb0 2024-01-31T05:01:28.281 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:26.822+0000 7f5024ff9700 1 -- 172.21.15.99:0/3097931926 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f5018011b90 con 0x7f5028107bb0 2024-01-31T05:01:28.281 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:26.890+0000 7f502da9d700 1 -- 172.21.15.99:0/3097931926 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f5028062e10 con 0x7f5028107bb0 2024-01-31T05:01:28.281 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:26.890+0000 7f5024ff9700 1 -- 172.21.15.99:0/3097931926 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7f5018011d30 con 0x7f5028107bb0 2024-01-31T05:01:28.281 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:26.890+0000 7f502da9d700 1 -- 172.21.15.99:0/3097931926 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5028107bb0 msgr2=0x7f5028107430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:01:28.281 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:26.890+0000 7f502da9d700 1 --2- 172.21.15.99:0/3097931926 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5028107bb0 0x7f5028107430 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f502807a2b0 tx=0x7f5018004750 comp rx=0 tx=0).stop 2024-01-31T05:01:28.281 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:26.891+0000 7f502da9d700 1 -- 172.21.15.99:0/3097931926 shutdown_connections 2024-01-31T05:01:28.281 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:26.891+0000 7f502da9d700 1 --2- 172.21.15.99:0/3097931926 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5028107bb0 0x7f5028107430 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:01:28.281 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:26.891+0000 7f502da9d700 1 -- 172.21.15.99:0/3097931926 >> 172.21.15.99:0/3097931926 conn(0x7f50281015e0 msgr2=0x7f50281038a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:01:28.282 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:26.891+0000 7f502da9d700 1 -- 172.21.15.99:0/3097931926 shutdown_connections 2024-01-31T05:01:28.282 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:26.891+0000 7f502da9d700 1 -- 172.21.15.99:0/3097931926 wait complete. 2024-01-31T05:01:28.282 INFO:teuthology.orchestra.run.smithi099.stdout:mon is available 2024-01-31T05:01:28.282 INFO:teuthology.orchestra.run.smithi099.stdout:Assimilating anything we can from ceph.conf... 2024-01-31T05:01:29.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:28 smithi099 ceph-mon[31246]: from='client.? 172.21.15.99:0/3420873313' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-01-31T05:01:29.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:28 smithi099 ceph-mon[31246]: from='client.? 172.21.15.99:0/3420873313' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-01-31T05:01:29.323 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout 2024-01-31T05:01:29.323 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout [global] 2024-01-31T05:01:29.323 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout fsid = 9288ff44-bff5-11ee-95b3-87774f69a715 2024-01-31T05:01:29.323 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.99:3300,v1:172.21.15.99:6789] 2024-01-31T05:01:29.323 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-01-31T05:01:29.323 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-01-31T05:01:29.323 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-01-31T05:01:29.323 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-01-31T05:01:29.323 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout 2024-01-31T05:01:29.323 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout [mgr] 2024-01-31T05:01:29.324 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-01-31T05:01:29.324 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout 2024-01-31T05:01:29.324 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout [osd] 2024-01-31T05:01:29.324 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-01-31T05:01:29.324 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-01-31T05:01:29.324 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-01-31T05:01:29.324 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-01-31T05:01:29.324 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-01-31T05:01:29.324 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:28.708+0000 7f49c2ee7700 1 Processor -- start 2024-01-31T05:01:29.324 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:28.708+0000 7f49c2ee7700 1 -- start start 2024-01-31T05:01:29.324 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:28.708+0000 7f49c2ee7700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49bc105940 0x7f49bc105d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:01:29.324 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:28.708+0000 7f49c2ee7700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49bc07aed0 con 0x7f49bc105940 2024-01-31T05:01:29.324 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:28.708+0000 7f49c0c83700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49bc105940 0x7f49bc105d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:01:29.325 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:28.708+0000 7f49c0c83700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49bc105940 0x7f49bc105d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53150/0 (socket says 172.21.15.99:53150) 2024-01-31T05:01:29.325 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:28.708+0000 7f49c0c83700 1 -- 172.21.15.99:0/4264031454 learned_addr learned my addr 172.21.15.99:0/4264031454 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:01:29.325 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:28.709+0000 7f49c0c83700 1 -- 172.21.15.99:0/4264031454 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49bc1062a0 con 0x7f49bc105940 2024-01-31T05:01:29.325 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:28.709+0000 7f49c0c83700 1 --2- 172.21.15.99:0/4264031454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49bc105940 0x7f49bc105d60 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f49b00098a0 tx=0x7f49b0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31a1a67410edd5 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:01:29.325 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:28.709+0000 7f49bb7fe700 1 -- 172.21.15.99:0/4264031454 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f49b0004160 con 0x7f49bc105940 2024-01-31T05:01:29.325 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:28.709+0000 7f49bb7fe700 1 -- 172.21.15.99:0/4264031454 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b00042c0 con 0x7f49bc105940 2024-01-31T05:01:29.325 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:28.709+0000 7f49bb7fe700 1 -- 172.21.15.99:0/4264031454 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f49b00045a0 con 0x7f49bc105940 2024-01-31T05:01:29.325 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:28.709+0000 7f49c2ee7700 1 -- 172.21.15.99:0/4264031454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49bc105940 msgr2=0x7f49bc105d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:01:29.325 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:28.709+0000 7f49c2ee7700 1 --2- 172.21.15.99:0/4264031454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49bc105940 0x7f49bc105d60 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f49b00098a0 tx=0x7f49b0009bb0 comp rx=0 tx=0).stop 2024-01-31T05:01:29.325 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:28.709+0000 7f49c2ee7700 1 -- 172.21.15.99:0/4264031454 shutdown_connections 2024-01-31T05:01:29.325 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:28.709+0000 7f49c2ee7700 1 --2- 172.21.15.99:0/4264031454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49bc105940 0x7f49bc105d60 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:01:29.325 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:28.709+0000 7f49c2ee7700 1 -- 172.21.15.99:0/4264031454 >> 172.21.15.99:0/4264031454 conn(0x7f49bc1015e0 msgr2=0x7f49bc103a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:01:29.325 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:28.709+0000 7f49c2ee7700 1 -- 172.21.15.99:0/4264031454 shutdown_connections 2024-01-31T05:01:29.325 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:28.710+0000 7f49c2ee7700 1 -- 172.21.15.99:0/4264031454 wait complete. 2024-01-31T05:01:29.326 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:28.710+0000 7f49c2ee7700 1 Processor -- start 2024-01-31T05:01:29.326 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:28.710+0000 7f49c2ee7700 1 -- start start 2024-01-31T05:01:29.326 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:28.710+0000 7f49c2ee7700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49bc105940 0x7f49bc19c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:01:29.326 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:28.710+0000 7f49c2ee7700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49bc19cd20 con 0x7f49bc105940 2024-01-31T05:01:29.326 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:28.710+0000 7f49c0c83700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49bc105940 0x7f49bc19c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:01:29.326 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:28.711+0000 7f49c0c83700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49bc105940 0x7f49bc19c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53164/0 (socket says 172.21.15.99:53164) 2024-01-31T05:01:29.326 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:28.711+0000 7f49c0c83700 1 -- 172.21.15.99:0/3420873313 learned_addr learned my addr 172.21.15.99:0/3420873313 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:01:29.326 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:28.711+0000 7f49c0c83700 1 -- 172.21.15.99:0/3420873313 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b0009550 con 0x7f49bc105940 2024-01-31T05:01:29.326 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:28.711+0000 7f49c0c83700 1 --2- 172.21.15.99:0/3420873313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49bc105940 0x7f49bc19c7e0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f49bc07a310 tx=0x7f49b0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:01:29.326 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:28.711+0000 7f49b9ffb700 1 -- 172.21.15.99:0/3420873313 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f49b0011630 con 0x7f49bc105940 2024-01-31T05:01:29.326 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:28.711+0000 7f49b9ffb700 1 -- 172.21.15.99:0/3420873313 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b0011790 con 0x7f49bc105940 2024-01-31T05:01:29.326 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:28.711+0000 7f49b9ffb700 1 -- 172.21.15.99:0/3420873313 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f49b0011a30 con 0x7f49bc105940 2024-01-31T05:01:29.326 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:28.711+0000 7f49c2ee7700 1 -- 172.21.15.99:0/3420873313 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49bc19cf20 con 0x7f49bc105940 2024-01-31T05:01:29.326 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:28.711+0000 7f49b9ffb700 1 -- 172.21.15.99:0/3420873313 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f49b0022070 con 0x7f49bc105940 2024-01-31T05:01:29.326 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:28.711+0000 7f49c2ee7700 1 -- 172.21.15.99:0/3420873313 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49bc19d3c0 con 0x7f49bc105940 2024-01-31T05:01:29.327 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:28.712+0000 7f49b9ffb700 1 -- 172.21.15.99:0/3420873313 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f49b001bd90 con 0x7f49bc105940 2024-01-31T05:01:29.327 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:28.712+0000 7f49c2ee7700 1 -- 172.21.15.99:0/3420873313 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49bc106610 con 0x7f49bc105940 2024-01-31T05:01:29.327 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:28.714+0000 7f49b9ffb700 1 -- 172.21.15.99:0/3420873313 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f49b001b450 con 0x7f49bc105940 2024-01-31T05:01:29.327 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:28.781+0000 7f49c2ee7700 1 -- 172.21.15.99:0/3420873313 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f49bc1067a0 con 0x7f49bc105940 2024-01-31T05:01:29.327 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:28.785+0000 7f49b9ffb700 1 -- 172.21.15.99:0/3420873313 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7f49b001b5f0 con 0x7f49bc105940 2024-01-31T05:01:29.327 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:28.786+0000 7f49b9ffb700 1 -- 172.21.15.99:0/3420873313 <== mon.0 v2:172.21.15.99:3300/0 8 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f49b001b790 con 0x7f49bc105940 2024-01-31T05:01:29.327 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:28.787+0000 7f49c2ee7700 1 -- 172.21.15.99:0/3420873313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49bc105940 msgr2=0x7f49bc19c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:01:29.327 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:28.787+0000 7f49c2ee7700 1 --2- 172.21.15.99:0/3420873313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49bc105940 0x7f49bc19c7e0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f49bc07a310 tx=0x7f49b0004750 comp rx=0 tx=0).stop 2024-01-31T05:01:29.327 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:28.787+0000 7f49c2ee7700 1 -- 172.21.15.99:0/3420873313 shutdown_connections 2024-01-31T05:01:29.327 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:28.787+0000 7f49c2ee7700 1 --2- 172.21.15.99:0/3420873313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49bc105940 0x7f49bc19c7e0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:01:29.327 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:28.787+0000 7f49c2ee7700 1 -- 172.21.15.99:0/3420873313 >> 172.21.15.99:0/3420873313 conn(0x7f49bc1015e0 msgr2=0x7f49bc192f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:01:29.327 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:28.787+0000 7f49c2ee7700 1 -- 172.21.15.99:0/3420873313 shutdown_connections 2024-01-31T05:01:29.327 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:28.787+0000 7f49c2ee7700 1 -- 172.21.15.99:0/3420873313 wait complete. 2024-01-31T05:01:29.328 INFO:teuthology.orchestra.run.smithi099.stdout:Generating new minimal ceph.conf... 2024-01-31T05:01:30.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:29 smithi099 ceph-mon[31246]: from='client.? 172.21.15.99:0/3999752059' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:01:30.420 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:29.740+0000 7f2a0eb40700 1 Processor -- start 2024-01-31T05:01:30.420 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:29.740+0000 7f2a0eb40700 1 -- start start 2024-01-31T05:01:30.420 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:29.740+0000 7f2a0eb40700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a08105fe0 0x7f2a08106400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:01:30.420 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:29.740+0000 7f2a0eb40700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a081069d0 con 0x7f2a08105fe0 2024-01-31T05:01:30.420 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:29.740+0000 7f2a0c8dc700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a08105fe0 0x7f2a08106400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:01:30.421 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:29.741+0000 7f2a0c8dc700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a08105fe0 0x7f2a08106400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53174/0 (socket says 172.21.15.99:53174) 2024-01-31T05:01:30.421 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:29.741+0000 7f2a0c8dc700 1 -- 172.21.15.99:0/2340295040 learned_addr learned my addr 172.21.15.99:0/2340295040 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:01:30.421 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:29.741+0000 7f2a0c8dc700 1 -- 172.21.15.99:0/2340295040 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a081071e0 con 0x7f2a08105fe0 2024-01-31T05:01:30.421 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:29.741+0000 7f2a0c8dc700 1 --2- 172.21.15.99:0/2340295040 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a08105fe0 0x7f2a08106400 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f29fc0098a0 tx=0x7f29fc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=254a959ff220c9cd server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:01:30.421 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:29.741+0000 7f2a077fe700 1 -- 172.21.15.99:0/2340295040 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29fc004160 con 0x7f2a08105fe0 2024-01-31T05:01:30.421 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:29.741+0000 7f2a077fe700 1 -- 172.21.15.99:0/2340295040 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f29fc0042c0 con 0x7f2a08105fe0 2024-01-31T05:01:30.421 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:29.741+0000 7f2a077fe700 1 -- 172.21.15.99:0/2340295040 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29fc011a00 con 0x7f2a08105fe0 2024-01-31T05:01:30.421 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:29.742+0000 7f2a0eb40700 1 -- 172.21.15.99:0/2340295040 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a08105fe0 msgr2=0x7f2a08106400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:01:30.421 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:29.742+0000 7f2a0eb40700 1 --2- 172.21.15.99:0/2340295040 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a08105fe0 0x7f2a08106400 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f29fc0098a0 tx=0x7f29fc009bb0 comp rx=0 tx=0).stop 2024-01-31T05:01:30.421 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:29.742+0000 7f2a0eb40700 1 -- 172.21.15.99:0/2340295040 shutdown_connections 2024-01-31T05:01:30.421 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:29.742+0000 7f2a0eb40700 1 --2- 172.21.15.99:0/2340295040 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a08105fe0 0x7f2a08106400 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:01:30.421 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:29.742+0000 7f2a0eb40700 1 -- 172.21.15.99:0/2340295040 >> 172.21.15.99:0/2340295040 conn(0x7f2a081015e0 msgr2=0x7f2a08103a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:01:30.422 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:29.742+0000 7f2a0eb40700 1 -- 172.21.15.99:0/2340295040 shutdown_connections 2024-01-31T05:01:30.422 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:29.742+0000 7f2a0eb40700 1 -- 172.21.15.99:0/2340295040 wait complete. 2024-01-31T05:01:30.422 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:29.742+0000 7f2a0eb40700 1 Processor -- start 2024-01-31T05:01:30.422 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:29.742+0000 7f2a0eb40700 1 -- start start 2024-01-31T05:01:30.422 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:29.742+0000 7f2a0eb40700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a08105fe0 0x7f2a08191040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:01:30.422 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:29.742+0000 7f2a0eb40700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a08191580 con 0x7f2a08105fe0 2024-01-31T05:01:30.422 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:29.743+0000 7f2a0c8dc700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a08105fe0 0x7f2a08191040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:01:30.422 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:29.743+0000 7f2a0c8dc700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a08105fe0 0x7f2a08191040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53186/0 (socket says 172.21.15.99:53186) 2024-01-31T05:01:30.422 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:29.743+0000 7f2a0c8dc700 1 -- 172.21.15.99:0/3999752059 learned_addr learned my addr 172.21.15.99:0/3999752059 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:01:30.422 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:29.743+0000 7f2a0c8dc700 1 -- 172.21.15.99:0/3999752059 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29fc009550 con 0x7f2a08105fe0 2024-01-31T05:01:30.422 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:29.743+0000 7f2a0c8dc700 1 --2- 172.21.15.99:0/3999752059 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a08105fe0 0x7f2a08191040 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f29fc009130 tx=0x7f29fc011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:01:30.422 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:29.743+0000 7f2a05ffb700 1 -- 172.21.15.99:0/3999752059 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29fc003ab0 con 0x7f2a08105fe0 2024-01-31T05:01:30.422 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:29.743+0000 7f2a05ffb700 1 -- 172.21.15.99:0/3999752059 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f29fc003c10 con 0x7f2a08105fe0 2024-01-31T05:01:30.423 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:29.743+0000 7f2a05ffb700 1 -- 172.21.15.99:0/3999752059 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29fc0247d0 con 0x7f2a08105fe0 2024-01-31T05:01:30.423 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:29.743+0000 7f2a0eb40700 1 -- 172.21.15.99:0/3999752059 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a0818f7c0 con 0x7f2a08105fe0 2024-01-31T05:01:30.423 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:29.743+0000 7f2a05ffb700 1 -- 172.21.15.99:0/3999752059 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f29fc024a50 con 0x7f2a08105fe0 2024-01-31T05:01:30.423 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:29.743+0000 7f2a0eb40700 1 -- 172.21.15.99:0/3999752059 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a0818fc60 con 0x7f2a08105fe0 2024-01-31T05:01:30.423 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:29.744+0000 7f2a05ffb700 1 -- 172.21.15.99:0/3999752059 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f29fc0193c0 con 0x7f2a08105fe0 2024-01-31T05:01:30.423 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:29.744+0000 7f2a0eb40700 1 -- 172.21.15.99:0/3999752059 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a08062e10 con 0x7f2a08105fe0 2024-01-31T05:01:30.423 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:29.747+0000 7f2a05ffb700 1 -- 172.21.15.99:0/3999752059 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f29fc01abb0 con 0x7f2a08105fe0 2024-01-31T05:01:30.423 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:29.814+0000 7f2a0eb40700 1 -- 172.21.15.99:0/3999752059 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f2a0810a410 con 0x7f2a08105fe0 2024-01-31T05:01:30.423 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:29.814+0000 7f2a05ffb700 1 -- 172.21.15.99:0/3999752059 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f2a0810a410 con 0x7f2a08105fe0 2024-01-31T05:01:30.423 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:29.815+0000 7f2a0eb40700 1 -- 172.21.15.99:0/3999752059 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a08105fe0 msgr2=0x7f2a08191040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:01:30.423 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:29.815+0000 7f2a0eb40700 1 --2- 172.21.15.99:0/3999752059 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a08105fe0 0x7f2a08191040 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f29fc009130 tx=0x7f29fc011ad0 comp rx=0 tx=0).stop 2024-01-31T05:01:30.423 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:29.815+0000 7f2a0eb40700 1 -- 172.21.15.99:0/3999752059 shutdown_connections 2024-01-31T05:01:30.424 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:29.815+0000 7f2a0eb40700 1 --2- 172.21.15.99:0/3999752059 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a08105fe0 0x7f2a08191040 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:01:30.424 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:29.815+0000 7f2a0eb40700 1 -- 172.21.15.99:0/3999752059 >> 172.21.15.99:0/3999752059 conn(0x7f2a081015e0 msgr2=0x7f2a081024d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:01:30.424 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:29.815+0000 7f2a0eb40700 1 -- 172.21.15.99:0/3999752059 shutdown_connections 2024-01-31T05:01:30.424 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:29.815+0000 7f2a0eb40700 1 -- 172.21.15.99:0/3999752059 wait complete. 2024-01-31T05:01:30.424 INFO:teuthology.orchestra.run.smithi099.stdout:Restarting the monitor... 2024-01-31T05:01:30.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:30 smithi099 systemd[1]: Stopping Ceph mon.a for 9288ff44-bff5-11ee-95b3-87774f69a715... 2024-01-31T05:01:30.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:30 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mon-a[31242]: 2024-01-31T05:01:30.658+0000 7fc7475d2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-01-31T05:01:30.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:30 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mon-a[31242]: 2024-01-31T05:01:30.658+0000 7fc7475d2700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-01-31T05:01:31.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:30 smithi099 podman[31490]: 2024-01-31 05:01:30.822033695 +0000 UTC m=+0.242597367 container died 8ae57287a8de9a7c5e237cc827191d05882c7cffb7c3faa15f1495272a68703f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mon-a, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240125.044502-661946e, io.buildah.version=1.31.3, org.label-schema.build-date=20240123, ceph=True, org.label-schema.vendor=CentOS) 2024-01-31T05:01:31.441 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:31 smithi099 podman[31490]: 2024-01-31 05:01:31.175072218 +0000 UTC m=+0.595635889 container cleanup 8ae57287a8de9a7c5e237cc827191d05882c7cffb7c3faa15f1495272a68703f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mon-a, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.build-date=20240123, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.31.3, org.label-schema.schema-version=1.0, ceph=True) 2024-01-31T05:01:31.441 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:31 smithi099 bash[31490]: ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mon-a 2024-01-31T05:01:31.807 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:31 smithi099 podman[31504]: 2024-01-31 05:01:31.442390576 +0000 UTC m=+0.613446247 container remove 8ae57287a8de9a7c5e237cc827191d05882c7cffb7c3faa15f1495272a68703f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mon-a, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240123, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.schema-version=1.0, io.buildah.version=1.31.3, org.label-schema.vendor=CentOS) 2024-01-31T05:01:31.807 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:31 smithi099 systemd[1]: ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mon.a.service: Deactivated successfully. 2024-01-31T05:01:31.807 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:31 smithi099 systemd[1]: Stopped Ceph mon.a for 9288ff44-bff5-11ee-95b3-87774f69a715. 2024-01-31T05:01:31.807 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:31 smithi099 systemd[1]: Starting Ceph mon.a for 9288ff44-bff5-11ee-95b3-87774f69a715... 2024-01-31T05:01:32.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:31 smithi099 podman[31596]: 2024-01-31 05:01:31.711231436 +0000 UTC m=+0.017258554 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 2024-01-31T05:01:32.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:31 smithi099 podman[31596]: 2024-01-31 05:01:31.809742868 +0000 UTC m=+0.115769977 container create c2448782b9b73a11a7c08f5cbea7acc3e9bdeb4d47f2405d8cea65483307b709 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mon-a, org.label-schema.build-date=20240123, org.label-schema.license=GPLv2, io.buildah.version=1.31.3, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-01-31T05:01:32.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 podman[31596]: 2024-01-31 05:01:32.012356334 +0000 UTC m=+0.318383443 container init c2448782b9b73a11a7c08f5cbea7acc3e9bdeb4d47f2405d8cea65483307b709 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mon-a, RELEASE=wip-vshankar-testing-20240125.044502-661946e, maintainer=Guillaume Abrioux , io.buildah.version=1.31.3, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240123, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-01-31T05:01:32.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 podman[31596]: 2024-01-31 05:01:32.015270132 +0000 UTC m=+0.321297244 container start c2448782b9b73a11a7c08f5cbea7acc3e9bdeb4d47f2405d8cea65483307b709 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mon-a, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.31.3, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240123, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183) 2024-01-31T05:01:32.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: set uid:gid to 167:167 (ceph:ceph) 2024-01-31T05:01:32.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: ceph version 19.0.0-885-g661946e7 (661946e7044723130c03627323f6a879a9848cb5) squid (dev), process ceph-mon, pid 2 2024-01-31T05:01:32.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: pidfile_write: ignore empty --pid-file 2024-01-31T05:01:32.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: load: jerasure load: lrc 2024-01-31T05:01:32.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: RocksDB version: 7.9.2 2024-01-31T05:01:32.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Git sha 0 2024-01-31T05:01:32.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Compile date 2024-01-25 05:03:27 2024-01-31T05:01:32.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: DB SUMMARY 2024-01-31T05:01:32.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: DB Session ID: Q4UITQDVTDZNKP3ZC8O6 2024-01-31T05:01:32.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: CURRENT file: CURRENT 2024-01-31T05:01:32.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: IDENTITY file: IDENTITY 2024-01-31T05:01:32.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-01-31T05:01:32.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-01-31T05:01:32.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 100166 ; 2024-01-31T05:01:32.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.error_if_exists: 0 2024-01-31T05:01:32.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.create_if_missing: 0 2024-01-31T05:01:32.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.paranoid_checks: 1 2024-01-31T05:01:32.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.flush_verify_memtable_count: 1 2024-01-31T05:01:32.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-01-31T05:01:32.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-01-31T05:01:32.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.env: 0x55d2a1649ae0 2024-01-31T05:01:32.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.fs: PosixFileSystem 2024-01-31T05:01:32.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.info_log: 0x55d2a30a7780 2024-01-31T05:01:32.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.max_file_opening_threads: 16 2024-01-31T05:01:32.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.statistics: (nil) 2024-01-31T05:01:32.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.use_fsync: 0 2024-01-31T05:01:32.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.max_log_file_size: 0 2024-01-31T05:01:32.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-01-31T05:01:32.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.log_file_time_to_roll: 0 2024-01-31T05:01:32.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.keep_log_file_num: 1000 2024-01-31T05:01:32.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.recycle_log_file_num: 0 2024-01-31T05:01:32.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.allow_fallocate: 1 2024-01-31T05:01:32.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.allow_mmap_reads: 0 2024-01-31T05:01:32.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.allow_mmap_writes: 0 2024-01-31T05:01:32.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.use_direct_reads: 0 2024-01-31T05:01:32.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-01-31T05:01:32.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.create_missing_column_families: 0 2024-01-31T05:01:32.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.db_log_dir: 2024-01-31T05:01:32.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.wal_dir: 2024-01-31T05:01:32.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.table_cache_numshardbits: 6 2024-01-31T05:01:32.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.WAL_ttl_seconds: 0 2024-01-31T05:01:32.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.WAL_size_limit_MB: 0 2024-01-31T05:01:32.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-01-31T05:01:32.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-01-31T05:01:32.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.is_fd_close_on_exec: 1 2024-01-31T05:01:32.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.advise_random_on_open: 1 2024-01-31T05:01:32.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.db_write_buffer_size: 0 2024-01-31T05:01:32.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.write_buffer_manager: 0x55d2a307b400 2024-01-31T05:01:32.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-01-31T05:01:32.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-01-31T05:01:32.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.use_adaptive_mutex: 0 2024-01-31T05:01:32.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.rate_limiter: (nil) 2024-01-31T05:01:32.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-01-31T05:01:32.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.wal_recovery_mode: 2 2024-01-31T05:01:32.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.enable_thread_tracking: 0 2024-01-31T05:01:32.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.enable_pipelined_write: 0 2024-01-31T05:01:32.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.unordered_write: 0 2024-01-31T05:01:32.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-01-31T05:01:32.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-01-31T05:01:32.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-01-31T05:01:32.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-01-31T05:01:32.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.row_cache: None 2024-01-31T05:01:32.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.wal_filter: None 2024-01-31T05:01:32.075 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-01-31T05:01:32.075 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.allow_ingest_behind: 0 2024-01-31T05:01:32.075 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.two_write_queues: 0 2024-01-31T05:01:32.075 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.manual_wal_flush: 0 2024-01-31T05:01:32.075 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.wal_compression: 0 2024-01-31T05:01:32.075 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.atomic_flush: 0 2024-01-31T05:01:32.075 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-01-31T05:01:32.075 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.persist_stats_to_disk: 0 2024-01-31T05:01:32.075 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.write_dbid_to_manifest: 0 2024-01-31T05:01:32.075 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.log_readahead_size: 0 2024-01-31T05:01:32.075 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-01-31T05:01:32.075 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.best_efforts_recovery: 0 2024-01-31T05:01:32.075 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-01-31T05:01:32.075 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-01-31T05:01:32.076 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.allow_data_in_errors: 0 2024-01-31T05:01:32.076 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.db_host_id: __hostname__ 2024-01-31T05:01:32.076 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.enforce_single_del_contracts: true 2024-01-31T05:01:32.076 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.max_background_jobs: 2 2024-01-31T05:01:32.076 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.max_background_compactions: -1 2024-01-31T05:01:32.076 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.max_subcompactions: 1 2024-01-31T05:01:32.076 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-01-31T05:01:32.076 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-01-31T05:01:32.076 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.delayed_write_rate : 16777216 2024-01-31T05:01:32.076 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.max_total_wal_size: 0 2024-01-31T05:01:32.076 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-01-31T05:01:32.076 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.stats_dump_period_sec: 600 2024-01-31T05:01:32.076 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.stats_persist_period_sec: 600 2024-01-31T05:01:32.076 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-01-31T05:01:32.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.max_open_files: -1 2024-01-31T05:01:32.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.bytes_per_sync: 0 2024-01-31T05:01:32.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.wal_bytes_per_sync: 0 2024-01-31T05:01:32.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.strict_bytes_per_sync: 0 2024-01-31T05:01:32.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.compaction_readahead_size: 0 2024-01-31T05:01:32.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.max_background_flushes: -1 2024-01-31T05:01:32.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Compression algorithms supported: 2024-01-31T05:01:32.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-01-31T05:01:32.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: kZSTD supported: 0 2024-01-31T05:01:32.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: kXpressCompression supported: 0 2024-01-31T05:01:32.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: kLZ4HCCompression supported: 1 2024-01-31T05:01:32.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: kZlibCompression supported: 1 2024-01-31T05:01:32.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: kSnappyCompression supported: 1 2024-01-31T05:01:32.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: kLZ4Compression supported: 1 2024-01-31T05:01:32.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: kBZip2Compression supported: 0 2024-01-31T05:01:32.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Fast CRC32 supported: Supported on x86 2024-01-31T05:01:32.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: DMutex implementation: pthread_mutex_t 2024-01-31T05:01:32.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-01-31T05:01:32.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-01-31T05:01:32.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-01-31T05:01:32.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.merge_operator: 2024-01-31T05:01:32.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.compaction_filter: None 2024-01-31T05:01:32.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.compaction_filter_factory: None 2024-01-31T05:01:32.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.sst_partitioner_factory: None 2024-01-31T05:01:32.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.memtable_factory: SkipListFactory 2024-01-31T05:01:32.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.table_factory: BlockBasedTable 2024-01-31T05:01:32.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d2a30a78a0) 2024-01-31T05:01:32.078 INFO:journalctl@ceph.mon.a.smithi099.stdout: cache_index_and_filter_blocks: 1 2024-01-31T05:01:32.078 INFO:journalctl@ceph.mon.a.smithi099.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-01-31T05:01:32.079 INFO:journalctl@ceph.mon.a.smithi099.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-01-31T05:01:32.079 INFO:journalctl@ceph.mon.a.smithi099.stdout: pin_top_level_index_and_filter: 1 2024-01-31T05:01:32.079 INFO:journalctl@ceph.mon.a.smithi099.stdout: index_type: 0 2024-01-31T05:01:32.079 INFO:journalctl@ceph.mon.a.smithi099.stdout: data_block_index_type: 0 2024-01-31T05:01:32.079 INFO:journalctl@ceph.mon.a.smithi099.stdout: index_shortening: 1 2024-01-31T05:01:32.079 INFO:journalctl@ceph.mon.a.smithi099.stdout: data_block_hash_table_util_ratio: 0.750000 2024-01-31T05:01:32.079 INFO:journalctl@ceph.mon.a.smithi099.stdout: checksum: 4 2024-01-31T05:01:32.079 INFO:journalctl@ceph.mon.a.smithi099.stdout: no_block_cache: 0 2024-01-31T05:01:32.079 INFO:journalctl@ceph.mon.a.smithi099.stdout: block_cache: 0x55d2a30ab090 2024-01-31T05:01:32.079 INFO:journalctl@ceph.mon.a.smithi099.stdout: block_cache_name: BinnedLRUCache 2024-01-31T05:01:32.079 INFO:journalctl@ceph.mon.a.smithi099.stdout: block_cache_options: 2024-01-31T05:01:32.079 INFO:journalctl@ceph.mon.a.smithi099.stdout: capacity : 536870912 2024-01-31T05:01:32.079 INFO:journalctl@ceph.mon.a.smithi099.stdout: num_shard_bits : 4 2024-01-31T05:01:32.079 INFO:journalctl@ceph.mon.a.smithi099.stdout: strict_capacity_limit : 0 2024-01-31T05:01:32.079 INFO:journalctl@ceph.mon.a.smithi099.stdout: high_pri_pool_ratio: 0.000 2024-01-31T05:01:32.080 INFO:journalctl@ceph.mon.a.smithi099.stdout: block_cache_compressed: (nil) 2024-01-31T05:01:32.080 INFO:journalctl@ceph.mon.a.smithi099.stdout: persistent_cache: (nil) 2024-01-31T05:01:32.080 INFO:journalctl@ceph.mon.a.smithi099.stdout: block_size: 4096 2024-01-31T05:01:32.080 INFO:journalctl@ceph.mon.a.smithi099.stdout: block_size_deviation: 10 2024-01-31T05:01:32.080 INFO:journalctl@ceph.mon.a.smithi099.stdout: block_restart_interval: 16 2024-01-31T05:01:32.080 INFO:journalctl@ceph.mon.a.smithi099.stdout: index_block_restart_interval: 1 2024-01-31T05:01:32.080 INFO:journalctl@ceph.mon.a.smithi099.stdout: metadata_block_size: 4096 2024-01-31T05:01:32.080 INFO:journalctl@ceph.mon.a.smithi099.stdout: partition_filters: 0 2024-01-31T05:01:32.080 INFO:journalctl@ceph.mon.a.smithi099.stdout: use_delta_encoding: 1 2024-01-31T05:01:32.080 INFO:journalctl@ceph.mon.a.smithi099.stdout: filter_policy: bloomfilter 2024-01-31T05:01:32.080 INFO:journalctl@ceph.mon.a.smithi099.stdout: whole_key_filtering: 1 2024-01-31T05:01:32.080 INFO:journalctl@ceph.mon.a.smithi099.stdout: verify_compression: 0 2024-01-31T05:01:32.080 INFO:journalctl@ceph.mon.a.smithi099.stdout: read_amp_bytes_per_bit: 0 2024-01-31T05:01:32.080 INFO:journalctl@ceph.mon.a.smithi099.stdout: format_version: 5 2024-01-31T05:01:32.081 INFO:journalctl@ceph.mon.a.smithi099.stdout: enable_index_compression: 1 2024-01-31T05:01:32.081 INFO:journalctl@ceph.mon.a.smithi099.stdout: block_align: 0 2024-01-31T05:01:32.081 INFO:journalctl@ceph.mon.a.smithi099.stdout: max_auto_readahead_size: 262144 2024-01-31T05:01:32.081 INFO:journalctl@ceph.mon.a.smithi099.stdout: prepopulate_block_cache: 0 2024-01-31T05:01:32.081 INFO:journalctl@ceph.mon.a.smithi099.stdout: initial_auto_readahead_size: 8192 2024-01-31T05:01:32.081 INFO:journalctl@ceph.mon.a.smithi099.stdout: num_file_reads_for_auto_readahead: 2 2024-01-31T05:01:32.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.write_buffer_size: 33554432 2024-01-31T05:01:32.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.max_write_buffer_number: 2 2024-01-31T05:01:32.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.compression: NoCompression 2024-01-31T05:01:32.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.bottommost_compression: Disabled 2024-01-31T05:01:32.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.prefix_extractor: nullptr 2024-01-31T05:01:32.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-01-31T05:01:32.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.num_levels: 7 2024-01-31T05:01:32.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-01-31T05:01:32.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-01-31T05:01:32.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-01-31T05:01:32.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-01-31T05:01:32.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-01-31T05:01:32.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-01-31T05:01:32.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-01-31T05:01:32.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-01-31T05:01:32.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-01-31T05:01:32.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-01-31T05:01:32.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-01-31T05:01:32.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-01-31T05:01:32.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.compression_opts.window_bits: -14 2024-01-31T05:01:32.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.compression_opts.level: 32767 2024-01-31T05:01:32.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.compression_opts.strategy: 0 2024-01-31T05:01:32.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-01-31T05:01:32.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-01-31T05:01:32.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-01-31T05:01:32.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-01-31T05:01:32.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.compression_opts.enabled: false 2024-01-31T05:01:32.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-01-31T05:01:32.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-01-31T05:01:32.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-01-31T05:01:32.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-01-31T05:01:32.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.target_file_size_base: 67108864 2024-01-31T05:01:32.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.target_file_size_multiplier: 1 2024-01-31T05:01:32.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-01-31T05:01:32.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-01-31T05:01:32.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-01-31T05:01:32.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-01-31T05:01:32.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-01-31T05:01:32.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-01-31T05:01:32.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-01-31T05:01:32.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-01-31T05:01:32.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-01-31T05:01:32.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-01-31T05:01:32.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-01-31T05:01:32.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-01-31T05:01:32.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-01-31T05:01:32.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.arena_block_size: 1048576 2024-01-31T05:01:32.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-01-31T05:01:32.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-01-31T05:01:32.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.disable_auto_compactions: 0 2024-01-31T05:01:32.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-01-31T05:01:32.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-01-31T05:01:32.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-01-31T05:01:32.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-01-31T05:01:32.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-01-31T05:01:32.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-01-31T05:01:32.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-01-31T05:01:32.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-01-31T05:01:32.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-01-31T05:01:32.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-01-31T05:01:32.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.table_properties_collectors: 2024-01-31T05:01:32.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.inplace_update_support: 0 2024-01-31T05:01:32.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.inplace_update_num_locks: 10000 2024-01-31T05:01:32.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-01-31T05:01:32.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-01-31T05:01:32.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.memtable_huge_page_size: 0 2024-01-31T05:01:32.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.bloom_locality: 0 2024-01-31T05:01:32.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.max_successive_merges: 0 2024-01-31T05:01:32.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.optimize_filters_for_hits: 0 2024-01-31T05:01:32.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.paranoid_file_checks: 0 2024-01-31T05:01:32.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.force_consistency_checks: 1 2024-01-31T05:01:32.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.report_bg_io_stats: 0 2024-01-31T05:01:32.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.ttl: 2592000 2024-01-31T05:01:32.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.periodic_compaction_seconds: 0 2024-01-31T05:01:32.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-01-31T05:01:32.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-01-31T05:01:32.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.enable_blob_files: false 2024-01-31T05:01:32.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.min_blob_size: 0 2024-01-31T05:01:32.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.blob_file_size: 268435456 2024-01-31T05:01:32.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.blob_compression_type: NoCompression 2024-01-31T05:01:32.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.enable_blob_garbage_collection: false 2024-01-31T05:01:32.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-01-31T05:01:32.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-01-31T05:01:32.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-01-31T05:01:32.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.blob_file_starting_level: 0 2024-01-31T05:01:32.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-01-31T05:01:32.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-01-31T05:01:32.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-01-31T05:01:32.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 02667f8f-c788-4264-9a45-df7245dc0c14 2024-01-31T05:01:32.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: EVENT_LOG_v1 {"time_micros": 1706677292043831, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-01-31T05:01:32.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-01-31T05:01:32.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: EVENT_LOG_v1 {"time_micros": 1706677292044869, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 95315, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 318, "table_properties": {"data_size": 93305, "index_size": 292, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13888, "raw_average_key_size": 50, "raw_value_size": 85749, "raw_average_value_size": 309, "num_data_blocks": 11, "num_entries": 277, "num_filter_entries": 277, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1706677292, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "02667f8f-c788-4264-9a45-df7245dc0c14", "db_session_id": "Q4UITQDVTDZNKP3ZC8O6", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-01-31T05:01:32.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: EVENT_LOG_v1 {"time_micros": 1706677292044951, "job": 1, "event": "recovery_finished"} 2024-01-31T05:01:32.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-01-31T05:01:32.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-01-31T05:01:32.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55d2a3198000 2024-01-31T05:01:32.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: DB pointer 0x55d2a3186000 2024-01-31T05:01:32.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-01-31T05:01:32.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-01-31T05:01:32.088 INFO:journalctl@ceph.mon.a.smithi099.stdout: ** DB Stats ** 2024-01-31T05:01:32.088 INFO:journalctl@ceph.mon.a.smithi099.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-01-31T05:01:32.088 INFO:journalctl@ceph.mon.a.smithi099.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-01-31T05:01:32.088 INFO:journalctl@ceph.mon.a.smithi099.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-01-31T05:01:32.088 INFO:journalctl@ceph.mon.a.smithi099.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-01-31T05:01:32.088 INFO:journalctl@ceph.mon.a.smithi099.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-01-31T05:01:32.088 INFO:journalctl@ceph.mon.a.smithi099.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-01-31T05:01:32.088 INFO:journalctl@ceph.mon.a.smithi099.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-01-31T05:01:32.088 INFO:journalctl@ceph.mon.a.smithi099.stdout: 2024-01-31T05:01:32.088 INFO:journalctl@ceph.mon.a.smithi099.stdout: ** Compaction Stats [default] ** 2024-01-31T05:01:32.089 INFO:journalctl@ceph.mon.a.smithi099.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-01-31T05:01:32.089 INFO:journalctl@ceph.mon.a.smithi099.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-01-31T05:01:32.089 INFO:journalctl@ceph.mon.a.smithi099.stdout: L0 2/0 94.92 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 134.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-01-31T05:01:32.089 INFO:journalctl@ceph.mon.a.smithi099.stdout: Sum 2/0 94.92 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 134.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-01-31T05:01:32.089 INFO:journalctl@ceph.mon.a.smithi099.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 134.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-01-31T05:01:32.089 INFO:journalctl@ceph.mon.a.smithi099.stdout: 2024-01-31T05:01:32.089 INFO:journalctl@ceph.mon.a.smithi099.stdout: ** Compaction Stats [default] ** 2024-01-31T05:01:32.089 INFO:journalctl@ceph.mon.a.smithi099.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-01-31T05:01:32.089 INFO:journalctl@ceph.mon.a.smithi099.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-01-31T05:01:32.089 INFO:journalctl@ceph.mon.a.smithi099.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 134.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-01-31T05:01:32.089 INFO:journalctl@ceph.mon.a.smithi099.stdout: 2024-01-31T05:01:32.089 INFO:journalctl@ceph.mon.a.smithi099.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-01-31T05:01:32.089 INFO:journalctl@ceph.mon.a.smithi099.stdout: 2024-01-31T05:01:32.089 INFO:journalctl@ceph.mon.a.smithi099.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-01-31T05:01:32.089 INFO:journalctl@ceph.mon.a.smithi099.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-01-31T05:01:32.090 INFO:journalctl@ceph.mon.a.smithi099.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-01-31T05:01:32.090 INFO:journalctl@ceph.mon.a.smithi099.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-01-31T05:01:32.090 INFO:journalctl@ceph.mon.a.smithi099.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-01-31T05:01:32.090 INFO:journalctl@ceph.mon.a.smithi099.stdout: AddFile(Keys): cumulative 0, interval 0 2024-01-31T05:01:32.090 INFO:journalctl@ceph.mon.a.smithi099.stdout: Cumulative compaction: 0.00 GB write, 29.93 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-31T05:01:32.090 INFO:journalctl@ceph.mon.a.smithi099.stdout: Interval compaction: 0.00 GB write, 29.93 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-31T05:01:32.090 INFO:journalctl@ceph.mon.a.smithi099.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-01-31T05:01:32.090 INFO:journalctl@ceph.mon.a.smithi099.stdout: Block cache BinnedLRUCache@0x55d2a30ab090#2 capacity: 512.00 MB usage: 1.39 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-01-31T05:01:32.090 INFO:journalctl@ceph.mon.a.smithi099.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-01-31T05:01:32.090 INFO:journalctl@ceph.mon.a.smithi099.stdout: 2024-01-31T05:01:32.090 INFO:journalctl@ceph.mon.a.smithi099.stdout: ** File Read Latency Histogram By Level [default] ** 2024-01-31T05:01:32.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: starting mon.a rank 0 at public addrs [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] at bind addrs [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 9288ff44-bff5-11ee-95b3-87774f69a715 2024-01-31T05:01:32.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: mon.a@-1(???) e1 preinit fsid 9288ff44-bff5-11ee-95b3-87774f69a715 2024-01-31T05:01:32.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: mon.a@-1(???).mds e1 new map 2024-01-31T05:01:32.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: mon.a@-1(???).mds e1 print_map 2024-01-31T05:01:32.091 INFO:journalctl@ceph.mon.a.smithi099.stdout: e1 2024-01-31T05:01:32.091 INFO:journalctl@ceph.mon.a.smithi099.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-01-31T05:01:32.091 INFO:journalctl@ceph.mon.a.smithi099.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-01-31T05:01:32.091 INFO:journalctl@ceph.mon.a.smithi099.stdout: legacy client fscid: -1 2024-01-31T05:01:32.091 INFO:journalctl@ceph.mon.a.smithi099.stdout: 2024-01-31T05:01:32.091 INFO:journalctl@ceph.mon.a.smithi099.stdout: No filesystems configured 2024-01-31T05:01:32.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-01-31T05:01:32.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-01-31T05:01:32.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-01-31T05:01:32.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-01-31T05:01:32.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-01-31T05:01:32.099 INFO:teuthology.orchestra.run.smithi099.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-01-31T05:01:32.422 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 bash[31596]: c2448782b9b73a11a7c08f5cbea7acc3e9bdeb4d47f2405d8cea65483307b709 2024-01-31T05:01:32.422 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 systemd[1]: Started Ceph mon.a for 9288ff44-bff5-11ee-95b3-87774f69a715. 2024-01-31T05:01:32.422 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: mon.a is new leader, mons a in quorum (ranks 0) 2024-01-31T05:01:32.422 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: monmap e1: 1 mons at {a=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-31T05:01:32.422 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: fsmap 2024-01-31T05:01:32.422 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: osdmap e1: 0 total, 0 up, 0 in 2024-01-31T05:01:32.422 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:32 smithi099 ceph-mon[31615]: mgrmap e1: no daemons active 2024-01-31T05:01:33.131 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:32.523+0000 7fa694831700 1 Processor -- start 2024-01-31T05:01:33.132 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:32.523+0000 7fa694831700 1 -- start start 2024-01-31T05:01:33.132 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:32.523+0000 7fa694831700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa69007cdd0 0x7fa69007b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:01:33.132 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:32.523+0000 7fa694831700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa69007b880 con 0x7fa69007cdd0 2024-01-31T05:01:33.132 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:32.524+0000 7fa68e59c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa69007cdd0 0x7fa69007b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:01:33.132 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:32.524+0000 7fa68e59c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa69007cdd0 0x7fa69007b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53200/0 (socket says 172.21.15.99:53200) 2024-01-31T05:01:33.132 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:32.524+0000 7fa68e59c700 1 -- 172.21.15.99:0/2751286812 learned_addr learned my addr 172.21.15.99:0/2751286812 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:01:33.132 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:32.524+0000 7fa68e59c700 1 -- 172.21.15.99:0/2751286812 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa69007b9c0 con 0x7fa69007cdd0 2024-01-31T05:01:33.132 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:32.524+0000 7fa68e59c700 1 --2- 172.21.15.99:0/2751286812 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa69007cdd0 0x7fa69007b340 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa6800098a0 tx=0x7fa680009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b57dd867dc28c23 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:01:33.132 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:32.524+0000 7fa68d59a700 1 -- 172.21.15.99:0/2751286812 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa680004160 con 0x7fa69007cdd0 2024-01-31T05:01:33.132 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:32.524+0000 7fa68d59a700 1 -- 172.21.15.99:0/2751286812 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa6800042c0 con 0x7fa69007cdd0 2024-01-31T05:01:33.132 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:32.524+0000 7fa68d59a700 1 -- 172.21.15.99:0/2751286812 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa680011a00 con 0x7fa69007cdd0 2024-01-31T05:01:33.132 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:32.525+0000 7fa694831700 1 -- 172.21.15.99:0/2751286812 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa69007cdd0 msgr2=0x7fa69007b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:01:33.133 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:32.525+0000 7fa694831700 1 --2- 172.21.15.99:0/2751286812 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa69007cdd0 0x7fa69007b340 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa6800098a0 tx=0x7fa680009bb0 comp rx=0 tx=0).stop 2024-01-31T05:01:33.133 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:32.525+0000 7fa694831700 1 -- 172.21.15.99:0/2751286812 shutdown_connections 2024-01-31T05:01:33.133 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:32.525+0000 7fa694831700 1 --2- 172.21.15.99:0/2751286812 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa69007cdd0 0x7fa69007b340 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:01:33.133 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:32.525+0000 7fa694831700 1 -- 172.21.15.99:0/2751286812 >> 172.21.15.99:0/2751286812 conn(0x7fa690102790 msgr2=0x7fa690104bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:01:33.133 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:32.525+0000 7fa694831700 1 -- 172.21.15.99:0/2751286812 shutdown_connections 2024-01-31T05:01:33.133 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:32.525+0000 7fa694831700 1 -- 172.21.15.99:0/2751286812 wait complete. 2024-01-31T05:01:33.133 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:32.526+0000 7fa694831700 1 Processor -- start 2024-01-31T05:01:33.133 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:32.526+0000 7fa694831700 1 -- start start 2024-01-31T05:01:33.133 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:32.526+0000 7fa694831700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa69007cdd0 0x7fa69019cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:01:33.133 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:32.526+0000 7fa694831700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa69019d510 con 0x7fa69007cdd0 2024-01-31T05:01:33.133 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:32.526+0000 7fa68e59c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa69007cdd0 0x7fa69019cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:01:33.133 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:32.526+0000 7fa68e59c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa69007cdd0 0x7fa69019cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53208/0 (socket says 172.21.15.99:53208) 2024-01-31T05:01:33.133 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:32.526+0000 7fa68e59c700 1 -- 172.21.15.99:0/3646697773 learned_addr learned my addr 172.21.15.99:0/3646697773 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:01:33.133 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:32.526+0000 7fa68e59c700 1 -- 172.21.15.99:0/3646697773 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa680009550 con 0x7fa69007cdd0 2024-01-31T05:01:33.134 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:32.527+0000 7fa68e59c700 1 --2- 172.21.15.99:0/3646697773 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa69007cdd0 0x7fa69019cfd0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fa680009fb0 tx=0x7fa680011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:01:33.134 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:32.527+0000 7fa67f7fe700 1 -- 172.21.15.99:0/3646697773 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa680003a40 con 0x7fa69007cdd0 2024-01-31T05:01:33.134 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:32.527+0000 7fa67f7fe700 1 -- 172.21.15.99:0/3646697773 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa680003ba0 con 0x7fa69007cdd0 2024-01-31T05:01:33.134 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:32.527+0000 7fa694831700 1 -- 172.21.15.99:0/3646697773 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa69019d710 con 0x7fa69007cdd0 2024-01-31T05:01:33.134 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:32.527+0000 7fa67f7fe700 1 -- 172.21.15.99:0/3646697773 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa68001a750 con 0x7fa69007cdd0 2024-01-31T05:01:33.134 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:32.527+0000 7fa694831700 1 -- 172.21.15.99:0/3646697773 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa69019dbb0 con 0x7fa69007cdd0 2024-01-31T05:01:33.134 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:32.527+0000 7fa67f7fe700 1 -- 172.21.15.99:0/3646697773 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fa68002d3f0 con 0x7fa69007cdd0 2024-01-31T05:01:33.134 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:32.527+0000 7fa67f7fe700 1 -- 172.21.15.99:0/3646697773 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa6800195f0 con 0x7fa69007cdd0 2024-01-31T05:01:33.134 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:32.528+0000 7fa694831700 1 -- 172.21.15.99:0/3646697773 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa69010d330 con 0x7fa69007cdd0 2024-01-31T05:01:33.134 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:32.530+0000 7fa67f7fe700 1 -- 172.21.15.99:0/3646697773 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7fa68001ad60 con 0x7fa69007cdd0 2024-01-31T05:01:33.134 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:32.596+0000 7fa694831700 1 -- 172.21.15.99:0/3646697773 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fa69010d4f0 con 0x7fa69007cdd0 2024-01-31T05:01:33.134 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:32.601+0000 7fa67f7fe700 1 -- 172.21.15.99:0/3646697773 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fa680024b60 con 0x7fa69007cdd0 2024-01-31T05:01:33.134 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:32.601+0000 7fa694831700 1 -- 172.21.15.99:0/3646697773 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa69007cdd0 msgr2=0x7fa69019cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:01:33.134 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:32.601+0000 7fa694831700 1 --2- 172.21.15.99:0/3646697773 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa69007cdd0 0x7fa69019cfd0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fa680009fb0 tx=0x7fa680011ad0 comp rx=0 tx=0).stop 2024-01-31T05:01:33.135 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:32.601+0000 7fa694831700 1 -- 172.21.15.99:0/3646697773 shutdown_connections 2024-01-31T05:01:33.135 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:32.601+0000 7fa694831700 1 --2- 172.21.15.99:0/3646697773 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa69007cdd0 0x7fa69019cfd0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:01:33.135 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:32.601+0000 7fa694831700 1 -- 172.21.15.99:0/3646697773 >> 172.21.15.99:0/3646697773 conn(0x7fa690102790 msgr2=0x7fa6901032d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:01:33.135 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:32.601+0000 7fa694831700 1 -- 172.21.15.99:0/3646697773 shutdown_connections 2024-01-31T05:01:33.135 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:32.601+0000 7fa694831700 1 -- 172.21.15.99:0/3646697773 wait complete. 2024-01-31T05:01:33.135 INFO:teuthology.orchestra.run.smithi099.stdout:Wrote config to /etc/ceph/ceph.conf 2024-01-31T05:01:33.150 INFO:teuthology.orchestra.run.smithi099.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-01-31T05:01:33.150 INFO:teuthology.orchestra.run.smithi099.stdout:Creating mgr... 2024-01-31T05:01:33.150 INFO:teuthology.orchestra.run.smithi099.stdout:Verifying port 0.0.0.0:9283 ... 2024-01-31T05:01:33.151 INFO:teuthology.orchestra.run.smithi099.stdout:Verifying port 0.0.0.0:8765 ... 2024-01-31T05:01:33.397 INFO:teuthology.orchestra.run.smithi099.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mgr.x 2024-01-31T05:01:33.397 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stderr Failed to reset failed state of unit ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mgr.x.service: Unit ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mgr.x.service not loaded. 2024-01-31T05:01:33.607 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-9288ff44-bff5-11ee-95b3-87774f69a715.target.wants/ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mgr.x.service → /etc/systemd/system/ceph-9288ff44-bff5-11ee-95b3-87774f69a715@.service. 2024-01-31T05:01:33.885 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:33 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/3646697773' entity='client.admin' 2024-01-31T05:01:33.886 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:33 smithi099 podman[31833]: 2024-01-31 05:01:33.887124174 +0000 UTC m=+0.153965527 container create 3ad20d70eb124d8d19f3882c28c7e779935dbe775daf0c74ea4e0adde2fcaffc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.31.3, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240123, ceph=True, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240125.044502-661946e) 2024-01-31T05:01:34.163 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:34 smithi099 podman[31833]: 2024-01-31 05:01:34.081056558 +0000 UTC m=+0.347897921 container init 3ad20d70eb124d8d19f3882c28c7e779935dbe775daf0c74ea4e0adde2fcaffc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.build-date=20240123, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.31.3) 2024-01-31T05:01:34.163 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:34 smithi099 podman[31833]: 2024-01-31 05:01:34.083708671 +0000 UTC m=+0.350550026 container start 3ad20d70eb124d8d19f3882c28c7e779935dbe775daf0c74ea4e0adde2fcaffc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x, org.label-schema.build-date=20240123, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.31.3, org.label-schema.schema-version=1.0, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, RELEASE=wip-vshankar-testing-20240125.044502-661946e) 2024-01-31T05:01:34.175 INFO:teuthology.orchestra.run.smithi099.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-01-31T05:01:34.175 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stdout disabled 2024-01-31T05:01:34.184 INFO:teuthology.orchestra.run.smithi099.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-01-31T05:01:34.184 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stdout inactive 2024-01-31T05:01:34.184 INFO:teuthology.orchestra.run.smithi099.stdout:firewalld.service is not enabled 2024-01-31T05:01:34.184 INFO:teuthology.orchestra.run.smithi099.stdout:Not possible to enable service . firewalld.service is not available 2024-01-31T05:01:34.192 INFO:teuthology.orchestra.run.smithi099.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-01-31T05:01:34.192 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stdout disabled 2024-01-31T05:01:34.199 INFO:teuthology.orchestra.run.smithi099.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-01-31T05:01:34.200 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stdout inactive 2024-01-31T05:01:34.200 INFO:teuthology.orchestra.run.smithi099.stdout:firewalld.service is not enabled 2024-01-31T05:01:34.200 INFO:teuthology.orchestra.run.smithi099.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-01-31T05:01:34.200 INFO:teuthology.orchestra.run.smithi099.stdout:Waiting for mgr to start... 2024-01-31T05:01:34.200 INFO:teuthology.orchestra.run.smithi099.stdout:Waiting for mgr... 2024-01-31T05:01:34.451 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:34 smithi099 bash[31833]: 3ad20d70eb124d8d19f3882c28c7e779935dbe775daf0c74ea4e0adde2fcaffc 2024-01-31T05:01:34.452 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:34 smithi099 systemd[1]: Started Ceph mgr.x for 9288ff44-bff5-11ee-95b3-87774f69a715. 2024-01-31T05:01:34.717 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:34 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:34.621+0000 7f27e4fb9200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-31T05:01:34.717 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:34 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:34.717+0000 7f27e4fb9200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-31T05:01:35.037 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:34 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/1031827079' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-01-31T05:01:35.359 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout 2024-01-31T05:01:35.359 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout { 2024-01-31T05:01:35.359 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "fsid": "9288ff44-bff5-11ee-95b3-87774f69a715", 2024-01-31T05:01:35.359 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "health": { 2024-01-31T05:01:35.359 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-01-31T05:01:35.360 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-01-31T05:01:35.360 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-01-31T05:01:35.360 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-01-31T05:01:35.360 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-01-31T05:01:35.360 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-01-31T05:01:35.360 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout 0 2024-01-31T05:01:35.360 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout ], 2024-01-31T05:01:35.360 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-01-31T05:01:35.360 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "a" 2024-01-31T05:01:35.360 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout ], 2024-01-31T05:01:35.360 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-01-31T05:01:35.360 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "monmap": { 2024-01-31T05:01:35.360 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-31T05:01:35.360 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-01-31T05:01:35.360 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-01-31T05:01:35.361 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-01-31T05:01:35.361 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-01-31T05:01:35.361 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-31T05:01:35.361 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-01-31T05:01:35.361 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-01-31T05:01:35.361 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-01-31T05:01:35.361 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-01-31T05:01:35.361 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-01-31T05:01:35.361 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-01-31T05:01:35.361 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-01-31T05:01:35.361 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-01-31T05:01:35.361 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-01-31T05:01:35.361 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-01-31T05:01:35.361 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-01-31T05:01:35.361 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-01-31T05:01:35.361 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-01-31T05:01:35.362 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-01-31T05:01:35.362 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-01-31T05:01:35.362 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-01-31T05:01:35.362 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-01-31T05:01:35.362 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-01-31T05:01:35.362 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-31T05:01:35.362 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-01-31T05:01:35.362 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-01-31T05:01:35.362 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-01-31T05:01:35.362 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-01-31T05:01:35.362 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "available": false, 2024-01-31T05:01:35.362 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-01-31T05:01:35.362 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "modules": [ 2024-01-31T05:01:35.362 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "iostat", 2024-01-31T05:01:35.362 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "nfs", 2024-01-31T05:01:35.362 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "restful" 2024-01-31T05:01:35.363 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout ], 2024-01-31T05:01:35.363 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "services": {} 2024-01-31T05:01:35.363 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-01-31T05:01:35.363 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-01-31T05:01:35.363 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-31T05:01:35.363 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "modified": "2024-01-31T05:01:26.131364+0000", 2024-01-31T05:01:35.363 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "services": {} 2024-01-31T05:01:35.363 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-01-31T05:01:35.363 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-01-31T05:01:35.363 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout } 2024-01-31T05:01:35.363 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:34.658+0000 7f930494c700 1 Processor -- start 2024-01-31T05:01:35.363 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:34.658+0000 7f930494c700 1 -- start start 2024-01-31T05:01:35.363 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:34.659+0000 7f930494c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9300107b90 0x7f9300109f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:01:35.363 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:34.659+0000 7f930494c700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930007ae90 con 0x7f9300107b90 2024-01-31T05:01:35.364 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:34.659+0000 7f92fe59c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9300107b90 0x7f9300109f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:01:35.364 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:34.659+0000 7f92fe59c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9300107b90 0x7f9300109f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53230/0 (socket says 172.21.15.99:53230) 2024-01-31T05:01:35.364 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:34.659+0000 7f92fe59c700 1 -- 172.21.15.99:0/2689770907 learned_addr learned my addr 172.21.15.99:0/2689770907 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:01:35.364 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:34.659+0000 7f92fe59c700 1 -- 172.21.15.99:0/2689770907 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f930010a4c0 con 0x7f9300107b90 2024-01-31T05:01:35.364 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:34.659+0000 7f92fe59c700 1 --2- 172.21.15.99:0/2689770907 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9300107b90 0x7f9300109f80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f92f00098a0 tx=0x7f92f0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bc4b994f1d6ab45 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:01:35.364 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:34.660+0000 7f92fd59a700 1 -- 172.21.15.99:0/2689770907 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92f0004160 con 0x7f9300107b90 2024-01-31T05:01:35.364 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:34.660+0000 7f92fd59a700 1 -- 172.21.15.99:0/2689770907 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f92f00042c0 con 0x7f9300107b90 2024-01-31T05:01:35.364 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:34.660+0000 7f92fd59a700 1 -- 172.21.15.99:0/2689770907 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92f0011a00 con 0x7f9300107b90 2024-01-31T05:01:35.364 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:34.661+0000 7f930494c700 1 -- 172.21.15.99:0/2689770907 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9300107b90 msgr2=0x7f9300109f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:01:35.364 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:34.661+0000 7f930494c700 1 --2- 172.21.15.99:0/2689770907 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9300107b90 0x7f9300109f80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f92f00098a0 tx=0x7f92f0009bb0 comp rx=0 tx=0).stop 2024-01-31T05:01:35.364 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:34.661+0000 7f930494c700 1 -- 172.21.15.99:0/2689770907 shutdown_connections 2024-01-31T05:01:35.364 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:34.661+0000 7f930494c700 1 --2- 172.21.15.99:0/2689770907 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9300107b90 0x7f9300109f80 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:01:35.364 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:34.661+0000 7f930494c700 1 -- 172.21.15.99:0/2689770907 >> 172.21.15.99:0/2689770907 conn(0x7f93001015e0 msgr2=0x7f9300103a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:01:35.364 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:34.661+0000 7f930494c700 1 -- 172.21.15.99:0/2689770907 shutdown_connections 2024-01-31T05:01:35.365 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:34.661+0000 7f930494c700 1 -- 172.21.15.99:0/2689770907 wait complete. 2024-01-31T05:01:35.365 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:34.661+0000 7f930494c700 1 Processor -- start 2024-01-31T05:01:35.365 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:34.662+0000 7f930494c700 1 -- start start 2024-01-31T05:01:35.365 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:34.662+0000 7f930494c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9300107b90 0x7f930019ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:01:35.365 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:34.662+0000 7f930494c700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930019b390 con 0x7f9300107b90 2024-01-31T05:01:35.365 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:34.662+0000 7f92fe59c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9300107b90 0x7f930019ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:01:35.365 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:34.662+0000 7f92fe59c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9300107b90 0x7f930019ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53246/0 (socket says 172.21.15.99:53246) 2024-01-31T05:01:35.365 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:34.662+0000 7f92fe59c700 1 -- 172.21.15.99:0/1031827079 learned_addr learned my addr 172.21.15.99:0/1031827079 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:01:35.365 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:34.662+0000 7f92fe59c700 1 -- 172.21.15.99:0/1031827079 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f0009550 con 0x7f9300107b90 2024-01-31T05:01:35.365 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:34.662+0000 7f92fe59c700 1 --2- 172.21.15.99:0/1031827079 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9300107b90 0x7f930019ae50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f92f0009130 tx=0x7f92f0011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:01:35.365 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:34.662+0000 7f92ef7fe700 1 -- 172.21.15.99:0/1031827079 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92f0003b70 con 0x7f9300107b90 2024-01-31T05:01:35.365 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:34.662+0000 7f930494c700 1 -- 172.21.15.99:0/1031827079 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f930019b590 con 0x7f9300107b90 2024-01-31T05:01:35.365 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:34.662+0000 7f92ef7fe700 1 -- 172.21.15.99:0/1031827079 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f92f0003cd0 con 0x7f9300107b90 2024-01-31T05:01:35.365 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:34.663+0000 7f92ef7fe700 1 -- 172.21.15.99:0/1031827079 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92f00197d0 con 0x7f9300107b90 2024-01-31T05:01:35.365 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:34.663+0000 7f930494c700 1 -- 172.21.15.99:0/1031827079 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f930019ba30 con 0x7f9300107b90 2024-01-31T05:01:35.366 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:34.663+0000 7f92ef7fe700 1 -- 172.21.15.99:0/1031827079 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f92f0019a90 con 0x7f9300107b90 2024-01-31T05:01:35.366 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:34.663+0000 7f92ef7fe700 1 -- 172.21.15.99:0/1031827079 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f92f000b9d0 con 0x7f9300107b90 2024-01-31T05:01:35.366 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:34.663+0000 7f930494c700 1 -- 172.21.15.99:0/1031827079 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f930010b260 con 0x7f9300107b90 2024-01-31T05:01:35.366 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:34.666+0000 7f92ef7fe700 1 -- 172.21.15.99:0/1031827079 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f92f0044db0 con 0x7f9300107b90 2024-01-31T05:01:35.366 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:34.742+0000 7f930494c700 1 -- 172.21.15.99:0/1031827079 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f930010b420 con 0x7f9300107b90 2024-01-31T05:01:35.366 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:34.742+0000 7f92ef7fe700 1 -- 172.21.15.99:0/1031827079 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1239 (secure 0 0 0) 0x7f92f0033030 con 0x7f9300107b90 2024-01-31T05:01:35.366 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:34.743+0000 7f930494c700 1 -- 172.21.15.99:0/1031827079 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9300107b90 msgr2=0x7f930019ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:01:35.366 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:34.743+0000 7f930494c700 1 --2- 172.21.15.99:0/1031827079 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9300107b90 0x7f930019ae50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f92f0009130 tx=0x7f92f0011ad0 comp rx=0 tx=0).stop 2024-01-31T05:01:35.366 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:34.743+0000 7f930494c700 1 -- 172.21.15.99:0/1031827079 shutdown_connections 2024-01-31T05:01:35.366 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:34.743+0000 7f930494c700 1 --2- 172.21.15.99:0/1031827079 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9300107b90 0x7f930019ae50 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:01:35.366 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:34.743+0000 7f930494c700 1 -- 172.21.15.99:0/1031827079 >> 172.21.15.99:0/1031827079 conn(0x7f93001015e0 msgr2=0x7f93001020f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:01:35.366 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:34.743+0000 7f930494c700 1 -- 172.21.15.99:0/1031827079 shutdown_connections 2024-01-31T05:01:35.366 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:34.743+0000 7f930494c700 1 -- 172.21.15.99:0/1031827079 wait complete. 2024-01-31T05:01:35.366 INFO:teuthology.orchestra.run.smithi099.stdout:mgr not available, waiting (1/15)... 2024-01-31T05:01:35.690 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:35 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:35.369+0000 7f27e4fb9200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-31T05:01:35.691 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:35 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:35.460+0000 7f27e4fb9200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-31T05:01:35.691 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:35 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:35.543+0000 7f27e4fb9200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-31T05:01:35.947 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:35 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:35.691+0000 7f27e4fb9200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-31T05:01:35.947 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:35 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:35.773+0000 7f27e4fb9200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-31T05:01:35.947 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:35 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:35.947+0000 7f27e4fb9200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-01-31T05:01:36.210 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:36 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:36.126+0000 7f27e4fb9200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-31T05:01:36.210 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:36 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:36.211+0000 7f27e4fb9200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-31T05:01:36.568 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:36 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:36.303+0000 7f27e4fb9200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-31T05:01:36.568 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:36 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:36.389+0000 7f27e4fb9200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-31T05:01:37.699 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:37 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:37.448+0000 7f27e4fb9200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-31T05:01:37.699 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:37 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:37.579+0000 7f27e4fb9200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-31T05:01:38.010 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:37 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:37.779+0000 7f27e4fb9200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-31T05:01:38.010 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:38 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:38.011+0000 7f27e4fb9200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-31T05:01:38.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:38 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/3966084131' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-01-31T05:01:38.318 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:38 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:38.212+0000 7f27e4fb9200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-31T05:01:38.509 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout 2024-01-31T05:01:38.509 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout { 2024-01-31T05:01:38.509 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "fsid": "9288ff44-bff5-11ee-95b3-87774f69a715", 2024-01-31T05:01:38.509 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "health": { 2024-01-31T05:01:38.510 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-01-31T05:01:38.510 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-01-31T05:01:38.510 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-01-31T05:01:38.510 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-01-31T05:01:38.510 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-01-31T05:01:38.510 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-01-31T05:01:38.510 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout 0 2024-01-31T05:01:38.510 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout ], 2024-01-31T05:01:38.510 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-01-31T05:01:38.510 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "a" 2024-01-31T05:01:38.510 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout ], 2024-01-31T05:01:38.510 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-01-31T05:01:38.510 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "monmap": { 2024-01-31T05:01:38.510 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-31T05:01:38.511 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-01-31T05:01:38.511 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-01-31T05:01:38.511 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-01-31T05:01:38.511 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-01-31T05:01:38.511 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-31T05:01:38.511 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-01-31T05:01:38.519 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-01-31T05:01:38.519 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-01-31T05:01:38.519 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-01-31T05:01:38.519 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-01-31T05:01:38.519 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-01-31T05:01:38.519 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-01-31T05:01:38.519 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-01-31T05:01:38.519 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-01-31T05:01:38.520 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-01-31T05:01:38.520 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-01-31T05:01:38.520 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-01-31T05:01:38.520 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-01-31T05:01:38.520 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-01-31T05:01:38.520 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-01-31T05:01:38.520 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-01-31T05:01:38.520 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-01-31T05:01:38.520 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-01-31T05:01:38.520 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-31T05:01:38.520 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-01-31T05:01:38.520 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-01-31T05:01:38.520 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-01-31T05:01:38.520 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-01-31T05:01:38.521 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "available": false, 2024-01-31T05:01:38.521 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-01-31T05:01:38.521 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "modules": [ 2024-01-31T05:01:38.521 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "iostat", 2024-01-31T05:01:38.521 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "nfs", 2024-01-31T05:01:38.521 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "restful" 2024-01-31T05:01:38.521 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout ], 2024-01-31T05:01:38.521 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "services": {} 2024-01-31T05:01:38.521 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-01-31T05:01:38.521 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-01-31T05:01:38.521 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-31T05:01:38.521 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "modified": "2024-01-31T05:01:26.131364+0000", 2024-01-31T05:01:38.521 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "services": {} 2024-01-31T05:01:38.521 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-01-31T05:01:38.521 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-01-31T05:01:38.522 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout } 2024-01-31T05:01:38.522 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:37.798+0000 7f9236931700 1 Processor -- start 2024-01-31T05:01:38.522 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:37.798+0000 7f9236931700 1 -- start start 2024-01-31T05:01:38.522 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:37.798+0000 7f9236931700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92301070d0 0x7f92301074f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:01:38.522 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:37.798+0000 7f9236931700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9230107a30 con 0x7f92301070d0 2024-01-31T05:01:38.522 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:37.798+0000 7f922ffff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92301070d0 0x7f92301074f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:01:38.522 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:37.798+0000 7f922ffff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92301070d0 0x7f92301074f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46384/0 (socket says 172.21.15.99:46384) 2024-01-31T05:01:38.522 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:37.798+0000 7f922ffff700 1 -- 172.21.15.99:0/1103970079 learned_addr learned my addr 172.21.15.99:0/1103970079 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:01:38.522 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:37.799+0000 7f922ffff700 1 -- 172.21.15.99:0/1103970079 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9230107b70 con 0x7f92301070d0 2024-01-31T05:01:38.522 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:37.799+0000 7f922ffff700 1 --2- 172.21.15.99:0/1103970079 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92301070d0 0x7f92301074f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f92240098a0 tx=0x7f9224009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ec8527e6821027b server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:01:38.522 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:37.799+0000 7f922effd700 1 -- 172.21.15.99:0/1103970079 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9224004160 con 0x7f92301070d0 2024-01-31T05:01:38.522 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:37.799+0000 7f922effd700 1 -- 172.21.15.99:0/1103970079 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f92240042c0 con 0x7f92301070d0 2024-01-31T05:01:38.522 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:37.799+0000 7f922effd700 1 -- 172.21.15.99:0/1103970079 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9224011a00 con 0x7f92301070d0 2024-01-31T05:01:38.522 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:37.800+0000 7f9236931700 1 -- 172.21.15.99:0/1103970079 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92301070d0 msgr2=0x7f92301074f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:01:38.523 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:37.800+0000 7f9236931700 1 --2- 172.21.15.99:0/1103970079 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92301070d0 0x7f92301074f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f92240098a0 tx=0x7f9224009bb0 comp rx=0 tx=0).stop 2024-01-31T05:01:38.523 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:37.800+0000 7f9236931700 1 -- 172.21.15.99:0/1103970079 shutdown_connections 2024-01-31T05:01:38.523 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:37.800+0000 7f9236931700 1 --2- 172.21.15.99:0/1103970079 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92301070d0 0x7f92301074f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:01:38.523 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:37.800+0000 7f9236931700 1 -- 172.21.15.99:0/1103970079 >> 172.21.15.99:0/1103970079 conn(0x7f9230102790 msgr2=0x7f9230104bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:01:38.523 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:37.800+0000 7f9236931700 1 -- 172.21.15.99:0/1103970079 shutdown_connections 2024-01-31T05:01:38.523 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:37.800+0000 7f9236931700 1 -- 172.21.15.99:0/1103970079 wait complete. 2024-01-31T05:01:38.523 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:37.800+0000 7f9236931700 1 Processor -- start 2024-01-31T05:01:38.523 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:37.800+0000 7f9236931700 1 -- start start 2024-01-31T05:01:38.523 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:37.801+0000 7f9236931700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92301070d0 0x7f923019ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:01:38.523 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:37.801+0000 7f9236931700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f923019b2e0 con 0x7f92301070d0 2024-01-31T05:01:38.523 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:37.801+0000 7f922ffff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92301070d0 0x7f923019ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:01:38.523 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:37.801+0000 7f922ffff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92301070d0 0x7f923019ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46390/0 (socket says 172.21.15.99:46390) 2024-01-31T05:01:38.523 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:37.801+0000 7f922ffff700 1 -- 172.21.15.99:0/3966084131 learned_addr learned my addr 172.21.15.99:0/3966084131 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:01:38.523 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:37.801+0000 7f922ffff700 1 -- 172.21.15.99:0/3966084131 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9224009550 con 0x7f92301070d0 2024-01-31T05:01:38.523 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:37.801+0000 7f922ffff700 1 --2- 172.21.15.99:0/3966084131 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92301070d0 0x7f923019ada0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9224009130 tx=0x7f9224011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:01:38.524 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:37.801+0000 7f922d7fa700 1 -- 172.21.15.99:0/3966084131 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9224003b70 con 0x7f92301070d0 2024-01-31T05:01:38.524 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:37.801+0000 7f9236931700 1 -- 172.21.15.99:0/3966084131 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f923019b4e0 con 0x7f92301070d0 2024-01-31T05:01:38.524 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:37.801+0000 7f922d7fa700 1 -- 172.21.15.99:0/3966084131 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9224003cd0 con 0x7f92301070d0 2024-01-31T05:01:38.524 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:37.801+0000 7f9236931700 1 -- 172.21.15.99:0/3966084131 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f923019b980 con 0x7f92301070d0 2024-01-31T05:01:38.524 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:37.801+0000 7f922d7fa700 1 -- 172.21.15.99:0/3966084131 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92240197d0 con 0x7f92301070d0 2024-01-31T05:01:38.524 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:37.802+0000 7f922d7fa700 1 -- 172.21.15.99:0/3966084131 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f9224019a30 con 0x7f92301070d0 2024-01-31T05:01:38.524 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:37.802+0000 7f922d7fa700 1 -- 172.21.15.99:0/3966084131 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f922400b7b0 con 0x7f92301070d0 2024-01-31T05:01:38.524 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:37.802+0000 7f9236931700 1 -- 172.21.15.99:0/3966084131 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9230062e10 con 0x7f92301070d0 2024-01-31T05:01:38.524 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:37.805+0000 7f922d7fa700 1 -- 172.21.15.99:0/3966084131 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f922402a060 con 0x7f92301070d0 2024-01-31T05:01:38.524 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:37.875+0000 7f9236931700 1 -- 172.21.15.99:0/3966084131 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f923019e510 con 0x7f92301070d0 2024-01-31T05:01:38.524 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:37.876+0000 7f922d7fa700 1 -- 172.21.15.99:0/3966084131 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1239 (secure 0 0 0) 0x7f922401abb0 con 0x7f92301070d0 2024-01-31T05:01:38.524 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:37.877+0000 7f9236931700 1 -- 172.21.15.99:0/3966084131 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92301070d0 msgr2=0x7f923019ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:01:38.524 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:37.877+0000 7f9236931700 1 --2- 172.21.15.99:0/3966084131 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92301070d0 0x7f923019ada0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9224009130 tx=0x7f9224011ad0 comp rx=0 tx=0).stop 2024-01-31T05:01:38.524 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:37.877+0000 7f9236931700 1 -- 172.21.15.99:0/3966084131 shutdown_connections 2024-01-31T05:01:38.525 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:37.877+0000 7f9236931700 1 --2- 172.21.15.99:0/3966084131 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92301070d0 0x7f923019ada0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:01:38.525 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:37.877+0000 7f9236931700 1 -- 172.21.15.99:0/3966084131 >> 172.21.15.99:0/3966084131 conn(0x7f9230102790 msgr2=0x7f9230103280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:01:38.525 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:37.877+0000 7f9236931700 1 -- 172.21.15.99:0/3966084131 shutdown_connections 2024-01-31T05:01:38.525 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:37.877+0000 7f9236931700 1 -- 172.21.15.99:0/3966084131 wait complete. 2024-01-31T05:01:38.525 INFO:teuthology.orchestra.run.smithi099.stdout:mgr not available, waiting (2/15)... 2024-01-31T05:01:38.665 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:38 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:38.396+0000 7f27e4fb9200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-31T05:01:39.068 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:38 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:38.666+0000 7f27e4fb9200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-31T05:01:39.071 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:38 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:38.751+0000 7f27e4fb9200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-31T05:01:39.568 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:39 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:39.168+0000 7f27e4fb9200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-31T05:01:40.318 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:39 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:39.960+0000 7f27e4fb9200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-31T05:01:40.818 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:40 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:40.560+0000 7f27e4fb9200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-31T05:01:40.818 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:40 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:40.657+0000 7f27e4fb9200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-31T05:01:41.318 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:40 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:40.859+0000 7f27e4fb9200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-31T05:01:41.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:40 smithi099 ceph-mon[31615]: Activating manager daemon x 2024-01-31T05:01:41.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:40 smithi099 ceph-mon[31615]: mgrmap e2: x(active, starting, since 0.00289854s) 2024-01-31T05:01:41.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:40 smithi099 ceph-mon[31615]: from='mgr.14100 172.21.15.99:0/1273084151' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-01-31T05:01:41.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:40 smithi099 ceph-mon[31615]: from='mgr.14100 172.21.15.99:0/1273084151' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-01-31T05:01:41.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:40 smithi099 ceph-mon[31615]: from='mgr.14100 172.21.15.99:0/1273084151' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-01-31T05:01:41.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:40 smithi099 ceph-mon[31615]: from='mgr.14100 172.21.15.99:0/1273084151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-31T05:01:41.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:40 smithi099 ceph-mon[31615]: from='mgr.14100 172.21.15.99:0/1273084151' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-01-31T05:01:41.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:40 smithi099 ceph-mon[31615]: Manager daemon x is now available 2024-01-31T05:01:41.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:40 smithi099 ceph-mon[31615]: from='mgr.14100 172.21.15.99:0/1273084151' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-01-31T05:01:41.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:40 smithi099 ceph-mon[31615]: from='mgr.14100 172.21.15.99:0/1273084151' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-01-31T05:01:41.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:40 smithi099 ceph-mon[31615]: from='mgr.14100 172.21.15.99:0/1273084151' entity='mgr.x' 2024-01-31T05:01:41.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:40 smithi099 ceph-mon[31615]: from='mgr.14100 172.21.15.99:0/1273084151' entity='mgr.x' 2024-01-31T05:01:41.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:40 smithi099 ceph-mon[31615]: from='mgr.14100 172.21.15.99:0/1273084151' entity='mgr.x' 2024-01-31T05:01:41.665 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout 2024-01-31T05:01:41.665 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout { 2024-01-31T05:01:41.665 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "fsid": "9288ff44-bff5-11ee-95b3-87774f69a715", 2024-01-31T05:01:41.666 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "health": { 2024-01-31T05:01:41.666 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-01-31T05:01:41.666 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-01-31T05:01:41.666 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-01-31T05:01:41.666 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-01-31T05:01:41.666 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-01-31T05:01:41.666 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-01-31T05:01:41.666 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout 0 2024-01-31T05:01:41.666 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout ], 2024-01-31T05:01:41.666 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-01-31T05:01:41.666 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "a" 2024-01-31T05:01:41.666 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout ], 2024-01-31T05:01:41.666 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-01-31T05:01:41.667 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "monmap": { 2024-01-31T05:01:41.667 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-31T05:01:41.667 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-01-31T05:01:41.667 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-01-31T05:01:41.667 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-01-31T05:01:41.667 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-01-31T05:01:41.667 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-31T05:01:41.667 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-01-31T05:01:41.667 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-01-31T05:01:41.667 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-01-31T05:01:41.675 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-01-31T05:01:41.675 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-01-31T05:01:41.675 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-01-31T05:01:41.675 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-01-31T05:01:41.676 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-01-31T05:01:41.676 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-01-31T05:01:41.676 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-01-31T05:01:41.676 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-01-31T05:01:41.676 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-01-31T05:01:41.676 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-01-31T05:01:41.676 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-01-31T05:01:41.676 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-01-31T05:01:41.676 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-01-31T05:01:41.676 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-01-31T05:01:41.676 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-01-31T05:01:41.676 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-31T05:01:41.676 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-01-31T05:01:41.676 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-01-31T05:01:41.677 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-01-31T05:01:41.677 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-01-31T05:01:41.677 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "available": false, 2024-01-31T05:01:41.677 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-01-31T05:01:41.677 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "modules": [ 2024-01-31T05:01:41.677 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "iostat", 2024-01-31T05:01:41.677 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "nfs", 2024-01-31T05:01:41.677 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "restful" 2024-01-31T05:01:41.677 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout ], 2024-01-31T05:01:41.677 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "services": {} 2024-01-31T05:01:41.677 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-01-31T05:01:41.677 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-01-31T05:01:41.677 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-31T05:01:41.677 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "modified": "2024-01-31T05:01:26.131364+0000", 2024-01-31T05:01:41.677 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "services": {} 2024-01-31T05:01:41.677 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-01-31T05:01:41.678 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-01-31T05:01:41.678 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout } 2024-01-31T05:01:41.678 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:40.983+0000 7f98a5b95700 1 Processor -- start 2024-01-31T05:01:41.678 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:40.984+0000 7f98a5b95700 1 -- start start 2024-01-31T05:01:41.678 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:40.984+0000 7f98a5b95700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98a007cdb0 0x7f98a007b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:01:41.678 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:40.984+0000 7f98a5b95700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a007d1d0 con 0x7f98a007cdb0 2024-01-31T05:01:41.678 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:40.984+0000 7f989f7fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98a007cdb0 0x7f98a007b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:01:41.678 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:40.984+0000 7f989f7fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98a007cdb0 0x7f98a007b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46462/0 (socket says 172.21.15.99:46462) 2024-01-31T05:01:41.678 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:40.984+0000 7f989f7fe700 1 -- 172.21.15.99:0/2994900751 learned_addr learned my addr 172.21.15.99:0/2994900751 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:01:41.678 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:40.984+0000 7f989f7fe700 1 -- 172.21.15.99:0/2994900751 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a007b860 con 0x7f98a007cdb0 2024-01-31T05:01:41.678 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:40.984+0000 7f989f7fe700 1 --2- 172.21.15.99:0/2994900751 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98a007cdb0 0x7f98a007b320 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f98900098a0 tx=0x7f9890009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a00939c27b3ba96c server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:01:41.678 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:40.984+0000 7f989e7fc700 1 -- 172.21.15.99:0/2994900751 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9890004160 con 0x7f98a007cdb0 2024-01-31T05:01:41.678 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:40.984+0000 7f989e7fc700 1 -- 172.21.15.99:0/2994900751 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f98900042c0 con 0x7f98a007cdb0 2024-01-31T05:01:41.678 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:40.984+0000 7f989e7fc700 1 -- 172.21.15.99:0/2994900751 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9890011a00 con 0x7f98a007cdb0 2024-01-31T05:01:41.679 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:40.985+0000 7f98a5b95700 1 -- 172.21.15.99:0/2994900751 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98a007cdb0 msgr2=0x7f98a007b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:01:41.679 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:40.985+0000 7f98a5b95700 1 --2- 172.21.15.99:0/2994900751 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98a007cdb0 0x7f98a007b320 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f98900098a0 tx=0x7f9890009bb0 comp rx=0 tx=0).stop 2024-01-31T05:01:41.679 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:40.985+0000 7f98a5b95700 1 -- 172.21.15.99:0/2994900751 shutdown_connections 2024-01-31T05:01:41.679 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:40.985+0000 7f98a5b95700 1 --2- 172.21.15.99:0/2994900751 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98a007cdb0 0x7f98a007b320 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:01:41.679 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:40.985+0000 7f98a5b95700 1 -- 172.21.15.99:0/2994900751 >> 172.21.15.99:0/2994900751 conn(0x7f98a0102790 msgr2=0x7f98a0104bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:01:41.679 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:40.985+0000 7f98a5b95700 1 -- 172.21.15.99:0/2994900751 shutdown_connections 2024-01-31T05:01:41.679 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:40.985+0000 7f98a5b95700 1 -- 172.21.15.99:0/2994900751 wait complete. 2024-01-31T05:01:41.679 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:40.986+0000 7f98a5b95700 1 Processor -- start 2024-01-31T05:01:41.679 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:40.986+0000 7f98a5b95700 1 -- start start 2024-01-31T05:01:41.679 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:40.986+0000 7f98a5b95700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98a007cdb0 0x7f98a019d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:01:41.679 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:40.986+0000 7f98a5b95700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a019d540 con 0x7f98a007cdb0 2024-01-31T05:01:41.679 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:40.986+0000 7f989f7fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98a007cdb0 0x7f98a019d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:01:41.679 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:40.986+0000 7f989f7fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98a007cdb0 0x7f98a019d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46472/0 (socket says 172.21.15.99:46472) 2024-01-31T05:01:41.679 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:40.986+0000 7f989f7fe700 1 -- 172.21.15.99:0/3987145713 learned_addr learned my addr 172.21.15.99:0/3987145713 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:01:41.679 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:40.986+0000 7f989f7fe700 1 -- 172.21.15.99:0/3987145713 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9890009550 con 0x7f98a007cdb0 2024-01-31T05:01:41.680 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:40.986+0000 7f989f7fe700 1 --2- 172.21.15.99:0/3987145713 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98a007cdb0 0x7f98a019d000 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9890009130 tx=0x7f9890011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:01:41.680 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:40.987+0000 7f989cff9700 1 -- 172.21.15.99:0/3987145713 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9890003b70 con 0x7f98a007cdb0 2024-01-31T05:01:41.680 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:40.987+0000 7f989cff9700 1 -- 172.21.15.99:0/3987145713 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9890003cd0 con 0x7f98a007cdb0 2024-01-31T05:01:41.680 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:40.987+0000 7f989cff9700 1 -- 172.21.15.99:0/3987145713 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f98900197d0 con 0x7f98a007cdb0 2024-01-31T05:01:41.680 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:40.987+0000 7f98a5b95700 1 -- 172.21.15.99:0/3987145713 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98a019d740 con 0x7f98a007cdb0 2024-01-31T05:01:41.680 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:40.987+0000 7f98a5b95700 1 -- 172.21.15.99:0/3987145713 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98a019dbe0 con 0x7f98a007cdb0 2024-01-31T05:01:41.680 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:40.988+0000 7f989cff9700 1 -- 172.21.15.99:0/3987145713 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 2) v1 ==== 45397+0+0 (secure 0 0 0) 0x7f989001abb0 con 0x7f98a007cdb0 2024-01-31T05:01:41.680 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:40.988+0000 7f98a5b95700 1 -- 172.21.15.99:0/3987145713 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98a010d350 con 0x7f98a007cdb0 2024-01-31T05:01:41.680 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:40.988+0000 7f989cff9700 1 -- 172.21.15.99:0/3987145713 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f989004c840 con 0x7f98a007cdb0 2024-01-31T05:01:41.680 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:40.990+0000 7f989cff9700 1 -- 172.21.15.99:0/3987145713 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f989001a430 con 0x7f98a007cdb0 2024-01-31T05:01:41.680 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:41.061+0000 7f98a5b95700 1 -- 172.21.15.99:0/3987145713 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f98a01a08f0 con 0x7f98a007cdb0 2024-01-31T05:01:41.680 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:41.061+0000 7f989cff9700 1 -- 172.21.15.99:0/3987145713 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1239 (secure 0 0 0) 0x7f9890023370 con 0x7f98a007cdb0 2024-01-31T05:01:41.680 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:41.062+0000 7f98a5b95700 1 -- 172.21.15.99:0/3987145713 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98a007cdb0 msgr2=0x7f98a019d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:01:41.680 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:41.062+0000 7f98a5b95700 1 --2- 172.21.15.99:0/3987145713 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98a007cdb0 0x7f98a019d000 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9890009130 tx=0x7f9890011ad0 comp rx=0 tx=0).stop 2024-01-31T05:01:41.681 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:41.062+0000 7f98a5b95700 1 -- 172.21.15.99:0/3987145713 shutdown_connections 2024-01-31T05:01:41.681 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:41.062+0000 7f98a5b95700 1 --2- 172.21.15.99:0/3987145713 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98a007cdb0 0x7f98a019d000 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:01:41.681 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:41.062+0000 7f98a5b95700 1 -- 172.21.15.99:0/3987145713 >> 172.21.15.99:0/3987145713 conn(0x7f98a0102790 msgr2=0x7f98a01032d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:01:41.681 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:41.062+0000 7f98a5b95700 1 -- 172.21.15.99:0/3987145713 shutdown_connections 2024-01-31T05:01:41.681 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:41.062+0000 7f98a5b95700 1 -- 172.21.15.99:0/3987145713 wait complete. 2024-01-31T05:01:41.681 INFO:teuthology.orchestra.run.smithi099.stdout:mgr not available, waiting (3/15)... 2024-01-31T05:01:42.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:41 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/3987145713' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-01-31T05:01:42.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:41 smithi099 ceph-mon[31615]: mgrmap e3: x(active, since 1.00756s) 2024-01-31T05:01:44.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:44 smithi099 ceph-mon[31615]: mgrmap e4: x(active, since 2s) 2024-01-31T05:01:44.998 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout 2024-01-31T05:01:44.998 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout { 2024-01-31T05:01:44.998 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "fsid": "9288ff44-bff5-11ee-95b3-87774f69a715", 2024-01-31T05:01:44.998 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "health": { 2024-01-31T05:01:44.998 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-01-31T05:01:44.998 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-01-31T05:01:44.998 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-01-31T05:01:44.998 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-01-31T05:01:44.998 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-01-31T05:01:44.999 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-01-31T05:01:44.999 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout 0 2024-01-31T05:01:44.999 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout ], 2024-01-31T05:01:44.999 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-01-31T05:01:44.999 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "a" 2024-01-31T05:01:44.999 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout ], 2024-01-31T05:01:44.999 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2024-01-31T05:01:44.999 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "monmap": { 2024-01-31T05:01:44.999 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-31T05:01:44.999 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-01-31T05:01:44.999 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-01-31T05:01:44.999 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-01-31T05:01:44.999 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-01-31T05:01:45.000 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-31T05:01:45.000 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-01-31T05:01:45.000 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-01-31T05:01:45.000 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-01-31T05:01:45.000 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-01-31T05:01:45.000 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-01-31T05:01:45.000 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-01-31T05:01:45.000 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-01-31T05:01:45.000 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-01-31T05:01:45.000 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-01-31T05:01:45.000 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-01-31T05:01:45.000 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-01-31T05:01:45.000 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-01-31T05:01:45.001 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-01-31T05:01:45.001 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-01-31T05:01:45.001 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-01-31T05:01:45.001 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-01-31T05:01:45.001 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-01-31T05:01:45.001 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-01-31T05:01:45.001 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-31T05:01:45.001 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-01-31T05:01:45.001 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-01-31T05:01:45.001 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-01-31T05:01:45.001 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-01-31T05:01:45.001 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "available": true, 2024-01-31T05:01:45.001 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-01-31T05:01:45.002 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "modules": [ 2024-01-31T05:01:45.002 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "iostat", 2024-01-31T05:01:45.002 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "nfs", 2024-01-31T05:01:45.002 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "restful" 2024-01-31T05:01:45.002 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout ], 2024-01-31T05:01:45.002 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "services": {} 2024-01-31T05:01:45.002 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-01-31T05:01:45.002 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-01-31T05:01:45.002 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-31T05:01:45.002 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "modified": "2024-01-31T05:01:26.131364+0000", 2024-01-31T05:01:45.002 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "services": {} 2024-01-31T05:01:45.002 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-01-31T05:01:45.003 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-01-31T05:01:45.003 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout } 2024-01-31T05:01:45.003 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.110+0000 7f931dffd700 1 Processor -- start 2024-01-31T05:01:45.003 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.110+0000 7f931dffd700 1 -- start start 2024-01-31T05:01:45.003 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.110+0000 7f931dffd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9318105380 0x7f93181057a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:01:45.003 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.110+0000 7f931dffd700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9318105d70 con 0x7f9318105380 2024-01-31T05:01:45.003 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.110+0000 7f93177fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9318105380 0x7f93181057a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:01:45.003 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.110+0000 7f93177fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9318105380 0x7f93181057a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46488/0 (socket says 172.21.15.99:46488) 2024-01-31T05:01:45.003 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.110+0000 7f93177fe700 1 -- 172.21.15.99:0/3804942941 learned_addr learned my addr 172.21.15.99:0/3804942941 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:01:45.003 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.111+0000 7f93177fe700 1 -- 172.21.15.99:0/3804942941 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9318105eb0 con 0x7f9318105380 2024-01-31T05:01:45.003 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.111+0000 7f93177fe700 1 --2- 172.21.15.99:0/3804942941 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9318105380 0x7f93181057a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f930c0098a0 tx=0x7f930c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b400ebc280eb738d server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:01:45.003 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.111+0000 7f93167fc700 1 -- 172.21.15.99:0/3804942941 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f930c004160 con 0x7f9318105380 2024-01-31T05:01:45.003 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.111+0000 7f93167fc700 1 -- 172.21.15.99:0/3804942941 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f930c0042c0 con 0x7f9318105380 2024-01-31T05:01:45.004 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.111+0000 7f93167fc700 1 -- 172.21.15.99:0/3804942941 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f930c011a00 con 0x7f9318105380 2024-01-31T05:01:45.004 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.111+0000 7f931dffd700 1 -- 172.21.15.99:0/3804942941 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9318105380 msgr2=0x7f93181057a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:01:45.004 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.111+0000 7f931dffd700 1 --2- 172.21.15.99:0/3804942941 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9318105380 0x7f93181057a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f930c0098a0 tx=0x7f930c009bb0 comp rx=0 tx=0).stop 2024-01-31T05:01:45.004 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.112+0000 7f931dffd700 1 -- 172.21.15.99:0/3804942941 shutdown_connections 2024-01-31T05:01:45.004 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.112+0000 7f931dffd700 1 --2- 172.21.15.99:0/3804942941 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9318105380 0x7f93181057a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:01:45.004 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.112+0000 7f931dffd700 1 -- 172.21.15.99:0/3804942941 >> 172.21.15.99:0/3804942941 conn(0x7f9318100da0 msgr2=0x7f93181031c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:01:45.004 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.112+0000 7f931dffd700 1 -- 172.21.15.99:0/3804942941 shutdown_connections 2024-01-31T05:01:45.004 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.112+0000 7f931dffd700 1 -- 172.21.15.99:0/3804942941 wait complete. 2024-01-31T05:01:45.004 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.112+0000 7f931dffd700 1 Processor -- start 2024-01-31T05:01:45.004 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.112+0000 7f931dffd700 1 -- start start 2024-01-31T05:01:45.004 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.113+0000 7f931dffd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9318105380 0x7f931819ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:01:45.004 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.113+0000 7f931dffd700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f931819b2a0 con 0x7f9318105380 2024-01-31T05:01:45.004 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.113+0000 7f93177fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9318105380 0x7f931819ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:01:45.004 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.113+0000 7f93177fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9318105380 0x7f931819ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46504/0 (socket says 172.21.15.99:46504) 2024-01-31T05:01:45.005 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.113+0000 7f93177fe700 1 -- 172.21.15.99:0/1242931435 learned_addr learned my addr 172.21.15.99:0/1242931435 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:01:45.005 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.113+0000 7f93177fe700 1 -- 172.21.15.99:0/1242931435 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f930c009550 con 0x7f9318105380 2024-01-31T05:01:45.005 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.113+0000 7f93177fe700 1 --2- 172.21.15.99:0/1242931435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9318105380 0x7f931819ad60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f930c009fb0 tx=0x7f930c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:01:45.005 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.113+0000 7f9314ff9700 1 -- 172.21.15.99:0/1242931435 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f930c003a40 con 0x7f9318105380 2024-01-31T05:01:45.005 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.113+0000 7f931dffd700 1 -- 172.21.15.99:0/1242931435 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f931819b500 con 0x7f9318105380 2024-01-31T05:01:45.005 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.113+0000 7f9314ff9700 1 -- 172.21.15.99:0/1242931435 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f930c003ba0 con 0x7f9318105380 2024-01-31T05:01:45.005 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.113+0000 7f9314ff9700 1 -- 172.21.15.99:0/1242931435 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f930c01a750 con 0x7f9318105380 2024-01-31T05:01:45.005 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.113+0000 7f931dffd700 1 -- 172.21.15.99:0/1242931435 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f931819e220 con 0x7f9318105380 2024-01-31T05:01:45.005 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.114+0000 7f9314ff9700 1 -- 172.21.15.99:0/1242931435 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 4) v1 ==== 45630+0+0 (secure 0 0 0) 0x7f930c01a9d0 con 0x7f9318105380 2024-01-31T05:01:45.005 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.114+0000 7f931dffd700 1 -- 172.21.15.99:0/1242931435 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9318062e10 con 0x7f9318105380 2024-01-31T05:01:45.005 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.114+0000 7f9314ff9700 1 --2- 172.21.15.99:0/1242931435 >> [v2:172.21.15.99:6800/1706888338,v1:172.21.15.99:6801/1706888338] conn(0x7f93000389a0 0x7f930003ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:01:45.005 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.115+0000 7f9314ff9700 1 -- 172.21.15.99:0/1242931435 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f930c04c7d0 con 0x7f9318105380 2024-01-31T05:01:45.005 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.115+0000 7f9316ffd700 1 --2- 172.21.15.99:0/1242931435 >> [v2:172.21.15.99:6800/1706888338,v1:172.21.15.99:6801/1706888338] conn(0x7f93000389a0 0x7f930003ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:01:45.006 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.115+0000 7f9316ffd700 1 --2- 172.21.15.99:0/1242931435 >> [v2:172.21.15.99:6800/1706888338,v1:172.21.15.99:6801/1706888338] conn(0x7f93000389a0 0x7f930003ae60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9308006fd0 tx=0x7f9308006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:01:45.006 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.120+0000 7f9314ff9700 1 -- 172.21.15.99:0/1242931435 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f930c018b80 con 0x7f9318105380 2024-01-31T05:01:45.006 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.390+0000 7f931dffd700 1 -- 172.21.15.99:0/1242931435 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f931819e6b0 con 0x7f9318105380 2024-01-31T05:01:45.006 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.390+0000 7f9314ff9700 1 -- 172.21.15.99:0/1242931435 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1239 (secure 0 0 0) 0x7f930c018350 con 0x7f9318105380 2024-01-31T05:01:45.006 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.392+0000 7f931dffd700 1 -- 172.21.15.99:0/1242931435 >> [v2:172.21.15.99:6800/1706888338,v1:172.21.15.99:6801/1706888338] conn(0x7f93000389a0 msgr2=0x7f930003ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:01:45.006 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.392+0000 7f931dffd700 1 --2- 172.21.15.99:0/1242931435 >> [v2:172.21.15.99:6800/1706888338,v1:172.21.15.99:6801/1706888338] conn(0x7f93000389a0 0x7f930003ae60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9308006fd0 tx=0x7f9308006e40 comp rx=0 tx=0).stop 2024-01-31T05:01:45.006 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.393+0000 7f931dffd700 1 -- 172.21.15.99:0/1242931435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9318105380 msgr2=0x7f931819ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:01:45.006 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.393+0000 7f931dffd700 1 --2- 172.21.15.99:0/1242931435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9318105380 0x7f931819ad60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f930c009fb0 tx=0x7f930c011ad0 comp rx=0 tx=0).stop 2024-01-31T05:01:45.006 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.393+0000 7f931dffd700 1 -- 172.21.15.99:0/1242931435 shutdown_connections 2024-01-31T05:01:45.006 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.393+0000 7f931dffd700 1 --2- 172.21.15.99:0/1242931435 >> [v2:172.21.15.99:6800/1706888338,v1:172.21.15.99:6801/1706888338] conn(0x7f93000389a0 0x7f930003ae60 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:01:45.006 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.393+0000 7f931dffd700 1 --2- 172.21.15.99:0/1242931435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9318105380 0x7f931819ad60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:01:45.006 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.393+0000 7f931dffd700 1 -- 172.21.15.99:0/1242931435 >> 172.21.15.99:0/1242931435 conn(0x7f9318100da0 msgr2=0x7f93181017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:01:45.006 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.393+0000 7f931dffd700 1 -- 172.21.15.99:0/1242931435 shutdown_connections 2024-01-31T05:01:45.007 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:44.393+0000 7f931dffd700 1 -- 172.21.15.99:0/1242931435 wait complete. 2024-01-31T05:01:45.007 INFO:teuthology.orchestra.run.smithi099.stdout:mgr is available 2024-01-31T05:01:45.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:45 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/1242931435' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-01-31T05:01:46.208 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout 2024-01-31T05:01:46.209 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout [global] 2024-01-31T05:01:46.209 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout fsid = 9288ff44-bff5-11ee-95b3-87774f69a715 2024-01-31T05:01:46.209 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-01-31T05:01:46.209 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-01-31T05:01:46.209 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-01-31T05:01:46.209 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-01-31T05:01:46.209 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout 2024-01-31T05:01:46.209 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout [mgr] 2024-01-31T05:01:46.209 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-01-31T05:01:46.209 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout 2024-01-31T05:01:46.209 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout [osd] 2024-01-31T05:01:46.210 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-01-31T05:01:46.210 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-01-31T05:01:46.210 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-01-31T05:01:46.210 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-01-31T05:01:46.210 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-01-31T05:01:46.210 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.464+0000 7fc28abfd700 1 Processor -- start 2024-01-31T05:01:46.210 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.464+0000 7fc28abfd700 1 -- start start 2024-01-31T05:01:46.210 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.464+0000 7fc28abfd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2841070f0 0x7fc284107510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:01:46.210 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.464+0000 7fc28abfd700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc284107a50 con 0x7fc2841070f0 2024-01-31T05:01:46.210 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.464+0000 7fc288999700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2841070f0 0x7fc284107510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:01:46.210 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.464+0000 7fc288999700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2841070f0 0x7fc284107510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54412/0 (socket says 172.21.15.99:54412) 2024-01-31T05:01:46.210 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.464+0000 7fc288999700 1 -- 172.21.15.99:0/928308999 learned_addr learned my addr 172.21.15.99:0/928308999 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:01:46.211 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.464+0000 7fc288999700 1 -- 172.21.15.99:0/928308999 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc284107b90 con 0x7fc2841070f0 2024-01-31T05:01:46.211 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.464+0000 7fc288999700 1 --2- 172.21.15.99:0/928308999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2841070f0 0x7fc284107510 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc2780098a0 tx=0x7fc278009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92cca1b1a5e6f3ee server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:01:46.211 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.465+0000 7fc2837fe700 1 -- 172.21.15.99:0/928308999 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc278004160 con 0x7fc2841070f0 2024-01-31T05:01:46.211 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.465+0000 7fc2837fe700 1 -- 172.21.15.99:0/928308999 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc2780042c0 con 0x7fc2841070f0 2024-01-31T05:01:46.211 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.465+0000 7fc2837fe700 1 -- 172.21.15.99:0/928308999 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc278011a00 con 0x7fc2841070f0 2024-01-31T05:01:46.211 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.465+0000 7fc28abfd700 1 -- 172.21.15.99:0/928308999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2841070f0 msgr2=0x7fc284107510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:01:46.211 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.465+0000 7fc28abfd700 1 --2- 172.21.15.99:0/928308999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2841070f0 0x7fc284107510 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc2780098a0 tx=0x7fc278009bb0 comp rx=0 tx=0).stop 2024-01-31T05:01:46.211 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.465+0000 7fc28abfd700 1 -- 172.21.15.99:0/928308999 shutdown_connections 2024-01-31T05:01:46.211 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.465+0000 7fc28abfd700 1 --2- 172.21.15.99:0/928308999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2841070f0 0x7fc284107510 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:01:46.211 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.465+0000 7fc28abfd700 1 -- 172.21.15.99:0/928308999 >> 172.21.15.99:0/928308999 conn(0x7fc284102790 msgr2=0x7fc284104bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:01:46.211 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.465+0000 7fc28abfd700 1 -- 172.21.15.99:0/928308999 shutdown_connections 2024-01-31T05:01:46.211 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.465+0000 7fc28abfd700 1 -- 172.21.15.99:0/928308999 wait complete. 2024-01-31T05:01:46.211 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.466+0000 7fc28abfd700 1 Processor -- start 2024-01-31T05:01:46.211 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.466+0000 7fc28abfd700 1 -- start start 2024-01-31T05:01:46.212 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.466+0000 7fc28abfd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2841070f0 0x7fc28419ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:01:46.212 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.466+0000 7fc28abfd700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28419b350 con 0x7fc2841070f0 2024-01-31T05:01:46.212 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.466+0000 7fc288999700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2841070f0 0x7fc28419ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:01:46.212 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.466+0000 7fc288999700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2841070f0 0x7fc28419ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54416/0 (socket says 172.21.15.99:54416) 2024-01-31T05:01:46.212 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.466+0000 7fc288999700 1 -- 172.21.15.99:0/3666762341 learned_addr learned my addr 172.21.15.99:0/3666762341 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:01:46.212 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.466+0000 7fc288999700 1 -- 172.21.15.99:0/3666762341 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc278009550 con 0x7fc2841070f0 2024-01-31T05:01:46.212 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.467+0000 7fc288999700 1 --2- 172.21.15.99:0/3666762341 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2841070f0 0x7fc28419ae10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc278009fb0 tx=0x7fc278011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:01:46.212 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.467+0000 7fc281ffb700 1 -- 172.21.15.99:0/3666762341 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc278003a40 con 0x7fc2841070f0 2024-01-31T05:01:46.212 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.467+0000 7fc28abfd700 1 -- 172.21.15.99:0/3666762341 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc28419b550 con 0x7fc2841070f0 2024-01-31T05:01:46.212 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.467+0000 7fc281ffb700 1 -- 172.21.15.99:0/3666762341 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc278003ba0 con 0x7fc2841070f0 2024-01-31T05:01:46.212 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.467+0000 7fc281ffb700 1 -- 172.21.15.99:0/3666762341 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc27801a750 con 0x7fc2841070f0 2024-01-31T05:01:46.212 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.467+0000 7fc28abfd700 1 -- 172.21.15.99:0/3666762341 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc28419b9f0 con 0x7fc2841070f0 2024-01-31T05:01:46.212 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.468+0000 7fc281ffb700 1 -- 172.21.15.99:0/3666762341 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 4) v1 ==== 45630+0+0 (secure 0 0 0) 0x7fc27801a9d0 con 0x7fc2841070f0 2024-01-31T05:01:46.212 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.468+0000 7fc28abfd700 1 -- 172.21.15.99:0/3666762341 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc284108f10 con 0x7fc2841070f0 2024-01-31T05:01:46.212 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.468+0000 7fc281ffb700 1 --2- 172.21.15.99:0/3666762341 >> [v2:172.21.15.99:6800/1706888338,v1:172.21.15.99:6801/1706888338] conn(0x7fc2740389a0 0x7fc27403ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:01:46.213 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.468+0000 7fc281ffb700 1 -- 172.21.15.99:0/3666762341 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc27804c6d0 con 0x7fc2841070f0 2024-01-31T05:01:46.213 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.468+0000 7fc283fff700 1 --2- 172.21.15.99:0/3666762341 >> [v2:172.21.15.99:6800/1706888338,v1:172.21.15.99:6801/1706888338] conn(0x7fc2740389a0 0x7fc27403ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:01:46.213 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.468+0000 7fc283fff700 1 --2- 172.21.15.99:0/3666762341 >> [v2:172.21.15.99:6800/1706888338,v1:172.21.15.99:6801/1706888338] conn(0x7fc2740389a0 0x7fc27403ae60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc270006fd0 tx=0x7fc270006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:01:46.213 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.473+0000 7fc281ffb700 1 -- 172.21.15.99:0/3666762341 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fc2780189a0 con 0x7fc2841070f0 2024-01-31T05:01:46.213 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.660+0000 7fc28abfd700 1 -- 172.21.15.99:0/3666762341 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fc28419e2d0 con 0x7fc2841070f0 2024-01-31T05:01:46.213 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.661+0000 7fc281ffb700 1 -- 172.21.15.99:0/3666762341 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7fc278018350 con 0x7fc2841070f0 2024-01-31T05:01:46.213 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.663+0000 7fc28abfd700 1 -- 172.21.15.99:0/3666762341 >> [v2:172.21.15.99:6800/1706888338,v1:172.21.15.99:6801/1706888338] conn(0x7fc2740389a0 msgr2=0x7fc27403ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:01:46.213 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.663+0000 7fc28abfd700 1 --2- 172.21.15.99:0/3666762341 >> [v2:172.21.15.99:6800/1706888338,v1:172.21.15.99:6801/1706888338] conn(0x7fc2740389a0 0x7fc27403ae60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc270006fd0 tx=0x7fc270006e40 comp rx=0 tx=0).stop 2024-01-31T05:01:46.213 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.663+0000 7fc28abfd700 1 -- 172.21.15.99:0/3666762341 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2841070f0 msgr2=0x7fc28419ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:01:46.213 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.663+0000 7fc28abfd700 1 --2- 172.21.15.99:0/3666762341 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2841070f0 0x7fc28419ae10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc278009fb0 tx=0x7fc278011ad0 comp rx=0 tx=0).stop 2024-01-31T05:01:46.213 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.663+0000 7fc28abfd700 1 -- 172.21.15.99:0/3666762341 shutdown_connections 2024-01-31T05:01:46.213 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.663+0000 7fc28abfd700 1 --2- 172.21.15.99:0/3666762341 >> [v2:172.21.15.99:6800/1706888338,v1:172.21.15.99:6801/1706888338] conn(0x7fc2740389a0 0x7fc27403ae60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:01:46.213 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.663+0000 7fc28abfd700 1 --2- 172.21.15.99:0/3666762341 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2841070f0 0x7fc28419ae10 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:01:46.213 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.663+0000 7fc28abfd700 1 -- 172.21.15.99:0/3666762341 >> 172.21.15.99:0/3666762341 conn(0x7fc284102790 msgr2=0x7fc284103260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:01:46.213 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.663+0000 7fc28abfd700 1 -- 172.21.15.99:0/3666762341 shutdown_connections 2024-01-31T05:01:46.214 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:45.663+0000 7fc28abfd700 1 -- 172.21.15.99:0/3666762341 wait complete. 2024-01-31T05:01:46.214 INFO:teuthology.orchestra.run.smithi099.stdout:Enabling cephadm module... 2024-01-31T05:01:46.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:46 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/3666762341' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-01-31T05:01:47.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:47 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/1661898228' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-01-31T05:01:47.318 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:47 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: ignoring --setuser ceph since I am not root 2024-01-31T05:01:47.318 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:47 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: ignoring --setgroup ceph since I am not root 2024-01-31T05:01:47.647 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:47 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:47.594+0000 7f0260514200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-31T05:01:47.655 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:46.621+0000 7f62a70a9700 1 Processor -- start 2024-01-31T05:01:47.655 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:46.621+0000 7f62a70a9700 1 -- start start 2024-01-31T05:01:47.655 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:46.622+0000 7f62a70a9700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62a0107530 0x7f62a0107950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:01:47.655 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:46.622+0000 7f62a70a9700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a0107f20 con 0x7f62a0107530 2024-01-31T05:01:47.656 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:46.622+0000 7f62a4e45700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62a0107530 0x7f62a0107950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:01:47.656 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:46.622+0000 7f62a4e45700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62a0107530 0x7f62a0107950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54428/0 (socket says 172.21.15.99:54428) 2024-01-31T05:01:47.656 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:46.622+0000 7f62a4e45700 1 -- 172.21.15.99:0/266853186 learned_addr learned my addr 172.21.15.99:0/266853186 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:01:47.656 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:46.622+0000 7f62a4e45700 1 -- 172.21.15.99:0/266853186 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a0108060 con 0x7f62a0107530 2024-01-31T05:01:47.656 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:46.622+0000 7f62a4e45700 1 --2- 172.21.15.99:0/266853186 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62a0107530 0x7f62a0107950 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f62940098a0 tx=0x7f6294009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=918d12904349b01d server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:01:47.656 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:46.622+0000 7f629f7fe700 1 -- 172.21.15.99:0/266853186 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6294004160 con 0x7f62a0107530 2024-01-31T05:01:47.656 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:46.622+0000 7f629f7fe700 1 -- 172.21.15.99:0/266853186 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f62940042c0 con 0x7f62a0107530 2024-01-31T05:01:47.656 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:46.622+0000 7f629f7fe700 1 -- 172.21.15.99:0/266853186 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6294011a00 con 0x7f62a0107530 2024-01-31T05:01:47.656 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:46.623+0000 7f62a70a9700 1 -- 172.21.15.99:0/266853186 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62a0107530 msgr2=0x7f62a0107950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:01:47.656 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:46.623+0000 7f62a70a9700 1 --2- 172.21.15.99:0/266853186 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62a0107530 0x7f62a0107950 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f62940098a0 tx=0x7f6294009bb0 comp rx=0 tx=0).stop 2024-01-31T05:01:47.656 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:46.623+0000 7f62a70a9700 1 -- 172.21.15.99:0/266853186 shutdown_connections 2024-01-31T05:01:47.656 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:46.623+0000 7f62a70a9700 1 --2- 172.21.15.99:0/266853186 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62a0107530 0x7f62a0107950 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:01:47.656 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:46.623+0000 7f62a70a9700 1 -- 172.21.15.99:0/266853186 >> 172.21.15.99:0/266853186 conn(0x7f62a0100da0 msgr2=0x7f62a01031c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:01:47.657 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:46.623+0000 7f62a70a9700 1 -- 172.21.15.99:0/266853186 shutdown_connections 2024-01-31T05:01:47.657 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:46.623+0000 7f62a70a9700 1 -- 172.21.15.99:0/266853186 wait complete. 2024-01-31T05:01:47.657 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:46.623+0000 7f62a70a9700 1 Processor -- start 2024-01-31T05:01:47.657 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:46.624+0000 7f62a70a9700 1 -- start start 2024-01-31T05:01:47.657 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:46.624+0000 7f62a70a9700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62a0107530 0x7f62a0105c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:01:47.657 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:46.624+0000 7f62a70a9700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a019dba0 con 0x7f62a0107530 2024-01-31T05:01:47.657 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:46.624+0000 7f62a4e45700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62a0107530 0x7f62a0105c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:01:47.657 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:46.624+0000 7f62a4e45700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62a0107530 0x7f62a0105c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54430/0 (socket says 172.21.15.99:54430) 2024-01-31T05:01:47.657 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:46.624+0000 7f62a4e45700 1 -- 172.21.15.99:0/1661898228 learned_addr learned my addr 172.21.15.99:0/1661898228 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:01:47.657 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:46.624+0000 7f62a4e45700 1 -- 172.21.15.99:0/1661898228 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6294009550 con 0x7f62a0107530 2024-01-31T05:01:47.657 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:46.624+0000 7f62a4e45700 1 --2- 172.21.15.99:0/1661898228 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62a0107530 0x7f62a0105c00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6294011710 tx=0x7f6294011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:01:47.657 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:46.624+0000 7f629dffb700 1 -- 172.21.15.99:0/1661898228 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6294003aa0 con 0x7f62a0107530 2024-01-31T05:01:47.657 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:46.624+0000 7f629dffb700 1 -- 172.21.15.99:0/1661898228 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6294003c00 con 0x7f62a0107530 2024-01-31T05:01:47.657 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:46.624+0000 7f62a70a9700 1 -- 172.21.15.99:0/1661898228 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62a019dce0 con 0x7f62a0107530 2024-01-31T05:01:47.658 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:46.624+0000 7f629dffb700 1 -- 172.21.15.99:0/1661898228 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6294024800 con 0x7f62a0107530 2024-01-31T05:01:47.658 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:46.625+0000 7f62a70a9700 1 -- 172.21.15.99:0/1661898228 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62a019e0c0 con 0x7f62a0107530 2024-01-31T05:01:47.658 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:46.625+0000 7f629dffb700 1 -- 172.21.15.99:0/1661898228 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 4) v1 ==== 45630+0+0 (secure 0 0 0) 0x7f629401a430 con 0x7f62a0107530 2024-01-31T05:01:47.658 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:46.625+0000 7f62a70a9700 1 -- 172.21.15.99:0/1661898228 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62a0106f40 con 0x7f62a0107530 2024-01-31T05:01:47.658 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:46.626+0000 7f629dffb700 1 --2- 172.21.15.99:0/1661898228 >> [v2:172.21.15.99:6800/1706888338,v1:172.21.15.99:6801/1706888338] conn(0x7f6290038a40 0x7f629003af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:01:47.658 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:46.626+0000 7f629dffb700 1 -- 172.21.15.99:0/1661898228 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f629404c5e0 con 0x7f62a0107530 2024-01-31T05:01:47.658 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:46.626+0000 7f629ffff700 1 --2- 172.21.15.99:0/1661898228 >> [v2:172.21.15.99:6800/1706888338,v1:172.21.15.99:6801/1706888338] conn(0x7f6290038a40 0x7f629003af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:01:47.658 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:46.626+0000 7f629ffff700 1 --2- 172.21.15.99:0/1661898228 >> [v2:172.21.15.99:6800/1706888338,v1:172.21.15.99:6801/1706888338] conn(0x7f6290038a40 0x7f629003af00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f628c006fd0 tx=0x7f628c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:01:47.658 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:46.630+0000 7f629dffb700 1 -- 172.21.15.99:0/1661898228 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f629402cb40 con 0x7f62a0107530 2024-01-31T05:01:47.658 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:46.873+0000 7f62a70a9700 1 -- 172.21.15.99:0/1661898228 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f62a019e6f0 con 0x7f62a0107530 2024-01-31T05:01:47.658 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:47.056+0000 7f629dffb700 1 -- 172.21.15.99:0/1661898228 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f629402cb40 con 0x7f62a0107530 2024-01-31T05:01:47.658 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:47.057+0000 7f629dffb700 1 -- 172.21.15.99:0/1661898228 <== mon.0 v2:172.21.15.99:3300/0 8 ==== mgrmap(e 5) v1 ==== 45641+0+0 (secure 0 0 0) 0x7f6294024960 con 0x7f62a0107530 2024-01-31T05:01:47.658 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:47.059+0000 7f62a70a9700 1 -- 172.21.15.99:0/1661898228 >> [v2:172.21.15.99:6800/1706888338,v1:172.21.15.99:6801/1706888338] conn(0x7f6290038a40 msgr2=0x7f629003af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:01:47.659 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:47.059+0000 7f62a70a9700 1 --2- 172.21.15.99:0/1661898228 >> [v2:172.21.15.99:6800/1706888338,v1:172.21.15.99:6801/1706888338] conn(0x7f6290038a40 0x7f629003af00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f628c006fd0 tx=0x7f628c006e40 comp rx=0 tx=0).stop 2024-01-31T05:01:47.659 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:47.059+0000 7f62a70a9700 1 -- 172.21.15.99:0/1661898228 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62a0107530 msgr2=0x7f62a0105c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:01:47.659 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:47.059+0000 7f62a70a9700 1 --2- 172.21.15.99:0/1661898228 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62a0107530 0x7f62a0105c00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6294011710 tx=0x7f6294011ad0 comp rx=0 tx=0).stop 2024-01-31T05:01:47.659 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:47.059+0000 7f62a70a9700 1 -- 172.21.15.99:0/1661898228 shutdown_connections 2024-01-31T05:01:47.659 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:47.059+0000 7f62a70a9700 1 --2- 172.21.15.99:0/1661898228 >> [v2:172.21.15.99:6800/1706888338,v1:172.21.15.99:6801/1706888338] conn(0x7f6290038a40 0x7f629003af00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:01:47.659 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:47.059+0000 7f62a70a9700 1 --2- 172.21.15.99:0/1661898228 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62a0107530 0x7f62a0105c00 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:01:47.659 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:47.059+0000 7f62a70a9700 1 -- 172.21.15.99:0/1661898228 >> 172.21.15.99:0/1661898228 conn(0x7f62a0100da0 msgr2=0x7f62a0101920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:01:47.659 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:47.059+0000 7f62a70a9700 1 -- 172.21.15.99:0/1661898228 shutdown_connections 2024-01-31T05:01:47.659 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:47.059+0000 7f62a70a9700 1 -- 172.21.15.99:0/1661898228 wait complete. 2024-01-31T05:01:47.984 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:47 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:47.689+0000 7f0260514200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-31T05:01:48.288 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:48 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/1661898228' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-01-31T05:01:48.288 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:48 smithi099 ceph-mon[31615]: mgrmap e5: x(active, since 6s) 2024-01-31T05:01:48.568 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:48 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:48.338+0000 7f0260514200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-31T05:01:48.568 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:48 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:48.435+0000 7f0260514200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-31T05:01:48.568 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:48 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:48.520+0000 7f0260514200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-31T05:01:48.938 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:48 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:48.676+0000 7f0260514200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-31T05:01:48.938 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:48 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:48.760+0000 7f0260514200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-31T05:01:48.938 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:48 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:48.937+0000 7f0260514200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-01-31T05:01:48.964 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout { 2024-01-31T05:01:48.964 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-01-31T05:01:48.964 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "available": true, 2024-01-31T05:01:48.964 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-01-31T05:01:48.964 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-01-31T05:01:48.964 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout } 2024-01-31T05:01:48.964 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.082+0000 7f76c7eee700 1 Processor -- start 2024-01-31T05:01:48.964 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.082+0000 7f76c7eee700 1 -- start start 2024-01-31T05:01:48.964 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.083+0000 7f76c7eee700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76c0105f80 0x7f76c01063a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:01:48.964 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.083+0000 7f76c7eee700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c0106970 con 0x7f76c0105f80 2024-01-31T05:01:48.964 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.083+0000 7f76c5c8a700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76c0105f80 0x7f76c01063a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:01:48.965 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.083+0000 7f76c5c8a700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76c0105f80 0x7f76c01063a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54446/0 (socket says 172.21.15.99:54446) 2024-01-31T05:01:48.965 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.083+0000 7f76c5c8a700 1 -- 172.21.15.99:0/2207309607 learned_addr learned my addr 172.21.15.99:0/2207309607 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:01:48.965 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.083+0000 7f76c5c8a700 1 -- 172.21.15.99:0/2207309607 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c0107180 con 0x7f76c0105f80 2024-01-31T05:01:48.965 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.083+0000 7f76c5c8a700 1 --2- 172.21.15.99:0/2207309607 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76c0105f80 0x7f76c01063a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f76bc0098a0 tx=0x7f76bc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56048b1f3082b470 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:01:48.965 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.083+0000 7f76c4c88700 1 -- 172.21.15.99:0/2207309607 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f76bc004160 con 0x7f76c0105f80 2024-01-31T05:01:48.965 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.083+0000 7f76c4c88700 1 -- 172.21.15.99:0/2207309607 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f76bc0042c0 con 0x7f76c0105f80 2024-01-31T05:01:48.965 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.084+0000 7f76c4c88700 1 -- 172.21.15.99:0/2207309607 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f76bc011a00 con 0x7f76c0105f80 2024-01-31T05:01:48.965 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.084+0000 7f76c7eee700 1 -- 172.21.15.99:0/2207309607 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76c0105f80 msgr2=0x7f76c01063a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:01:48.965 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.084+0000 7f76c7eee700 1 --2- 172.21.15.99:0/2207309607 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76c0105f80 0x7f76c01063a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f76bc0098a0 tx=0x7f76bc009bb0 comp rx=0 tx=0).stop 2024-01-31T05:01:48.965 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.084+0000 7f76c7eee700 1 -- 172.21.15.99:0/2207309607 shutdown_connections 2024-01-31T05:01:48.965 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.084+0000 7f76c7eee700 1 --2- 172.21.15.99:0/2207309607 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76c0105f80 0x7f76c01063a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:01:48.965 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.084+0000 7f76c7eee700 1 -- 172.21.15.99:0/2207309607 >> 172.21.15.99:0/2207309607 conn(0x7f76c0101580 msgr2=0x7f76c01039a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:01:48.965 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.084+0000 7f76c7eee700 1 -- 172.21.15.99:0/2207309607 shutdown_connections 2024-01-31T05:01:48.965 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.084+0000 7f76c7eee700 1 -- 172.21.15.99:0/2207309607 wait complete. 2024-01-31T05:01:48.966 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.085+0000 7f76c7eee700 1 Processor -- start 2024-01-31T05:01:48.966 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.085+0000 7f76c7eee700 1 -- start start 2024-01-31T05:01:48.966 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.085+0000 7f76c7eee700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76c0105f80 0x7f76c0199cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:01:48.966 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.085+0000 7f76c7eee700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c019a210 con 0x7f76c0105f80 2024-01-31T05:01:48.966 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.085+0000 7f76c5c8a700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76c0105f80 0x7f76c0199cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:01:48.966 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.085+0000 7f76c5c8a700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76c0105f80 0x7f76c0199cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54454/0 (socket says 172.21.15.99:54454) 2024-01-31T05:01:48.966 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.085+0000 7f76c5c8a700 1 -- 172.21.15.99:0/3204453451 learned_addr learned my addr 172.21.15.99:0/3204453451 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:01:48.966 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.085+0000 7f76c5c8a700 1 -- 172.21.15.99:0/3204453451 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76bc009550 con 0x7f76c0105f80 2024-01-31T05:01:48.966 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.086+0000 7f76c5c8a700 1 --2- 172.21.15.99:0/3204453451 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76c0105f80 0x7f76c0199cd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f76bc009fb0 tx=0x7f76bc011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:01:48.966 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.086+0000 7f76b6ffd700 1 -- 172.21.15.99:0/3204453451 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f76bc003a40 con 0x7f76c0105f80 2024-01-31T05:01:48.966 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.086+0000 7f76b6ffd700 1 -- 172.21.15.99:0/3204453451 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f76bc003ba0 con 0x7f76c0105f80 2024-01-31T05:01:48.966 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.086+0000 7f76c7eee700 1 -- 172.21.15.99:0/3204453451 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76c019a410 con 0x7f76c0105f80 2024-01-31T05:01:48.966 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.086+0000 7f76b6ffd700 1 -- 172.21.15.99:0/3204453451 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f76bc01a750 con 0x7f76c0105f80 2024-01-31T05:01:48.966 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.086+0000 7f76c7eee700 1 -- 172.21.15.99:0/3204453451 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76c019a8b0 con 0x7f76c0105f80 2024-01-31T05:01:48.967 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.087+0000 7f76b6ffd700 1 -- 172.21.15.99:0/3204453451 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 45641+0+0 (secure 0 0 0) 0x7f76bc01a980 con 0x7f76c0105f80 2024-01-31T05:01:48.967 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.087+0000 7f76b6ffd700 1 --2- 172.21.15.99:0/3204453451 >> [v2:172.21.15.99:6800/1706888338,v1:172.21.15.99:6801/1706888338] conn(0x7f76ac038a40 0x7f76ac03af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:01:48.967 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.087+0000 7f76b6ffd700 1 -- 172.21.15.99:0/3204453451 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f76bc04c6d0 con 0x7f76c0105f80 2024-01-31T05:01:48.967 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.087+0000 7f76c7eee700 1 -- 172.21.15.99:0/3204453451 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76c010a3b0 con 0x7f76c0105f80 2024-01-31T05:01:48.967 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.087+0000 7f76c5489700 1 -- 172.21.15.99:0/3204453451 >> [v2:172.21.15.99:6800/1706888338,v1:172.21.15.99:6801/1706888338] conn(0x7f76ac038a40 msgr2=0x7f76ac03af00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.99:6800/1706888338 2024-01-31T05:01:48.967 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.087+0000 7f76c5489700 1 --2- 172.21.15.99:0/3204453451 >> [v2:172.21.15.99:6800/1706888338,v1:172.21.15.99:6801/1706888338] conn(0x7f76ac038a40 0x7f76ac03af00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-31T05:01:48.967 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.092+0000 7f76b6ffd700 1 -- 172.21.15.99:0/3204453451 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f76bc01ac30 con 0x7f76c0105f80 2024-01-31T05:01:48.967 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.288+0000 7f76c5489700 1 -- 172.21.15.99:0/3204453451 >> [v2:172.21.15.99:6800/1706888338,v1:172.21.15.99:6801/1706888338] conn(0x7f76ac038a40 msgr2=0x7f76ac03af00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.99:6800/1706888338 2024-01-31T05:01:48.967 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.288+0000 7f76c5489700 1 --2- 172.21.15.99:0/3204453451 >> [v2:172.21.15.99:6800/1706888338,v1:172.21.15.99:6801/1706888338] conn(0x7f76ac038a40 0x7f76ac03af00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-31T05:01:48.967 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.339+0000 7f76c7eee700 1 -- 172.21.15.99:0/3204453451 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f76c007a750 con 0x7f76c0105f80 2024-01-31T05:01:48.967 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.340+0000 7f76b6ffd700 1 -- 172.21.15.99:0/3204453451 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7f76bc049070 con 0x7f76c0105f80 2024-01-31T05:01:48.967 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.342+0000 7f76c7eee700 1 -- 172.21.15.99:0/3204453451 >> [v2:172.21.15.99:6800/1706888338,v1:172.21.15.99:6801/1706888338] conn(0x7f76ac038a40 msgr2=0x7f76ac03af00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-31T05:01:48.967 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.342+0000 7f76c7eee700 1 --2- 172.21.15.99:0/3204453451 >> [v2:172.21.15.99:6800/1706888338,v1:172.21.15.99:6801/1706888338] conn(0x7f76ac038a40 0x7f76ac03af00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:01:48.967 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.342+0000 7f76c7eee700 1 -- 172.21.15.99:0/3204453451 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76c0105f80 msgr2=0x7f76c0199cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:01:48.967 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.342+0000 7f76c7eee700 1 --2- 172.21.15.99:0/3204453451 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76c0105f80 0x7f76c0199cd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f76bc009fb0 tx=0x7f76bc011ad0 comp rx=0 tx=0).stop 2024-01-31T05:01:48.968 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.342+0000 7f76c7eee700 1 -- 172.21.15.99:0/3204453451 shutdown_connections 2024-01-31T05:01:48.968 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.342+0000 7f76c7eee700 1 --2- 172.21.15.99:0/3204453451 >> [v2:172.21.15.99:6800/1706888338,v1:172.21.15.99:6801/1706888338] conn(0x7f76ac038a40 0x7f76ac03af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:01:48.968 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.342+0000 7f76c7eee700 1 --2- 172.21.15.99:0/3204453451 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76c0105f80 0x7f76c0199cd0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:01:48.968 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.342+0000 7f76c7eee700 1 -- 172.21.15.99:0/3204453451 >> 172.21.15.99:0/3204453451 conn(0x7f76c0101580 msgr2=0x7f76c0102120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:01:48.968 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.342+0000 7f76c7eee700 1 -- 172.21.15.99:0/3204453451 shutdown_connections 2024-01-31T05:01:48.968 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:48.342+0000 7f76c7eee700 1 -- 172.21.15.99:0/3204453451 wait complete. 2024-01-31T05:01:48.968 INFO:teuthology.orchestra.run.smithi099.stdout:Waiting for the mgr to restart... 2024-01-31T05:01:48.968 INFO:teuthology.orchestra.run.smithi099.stdout:Waiting for mgr epoch 5... 2024-01-31T05:01:49.214 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:49 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/3204453451' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-01-31T05:01:49.214 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:49 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:49.125+0000 7f0260514200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-31T05:01:49.214 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:49 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:49.213+0000 7f0260514200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-31T05:01:49.568 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:49 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:49.312+0000 7f0260514200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-31T05:01:49.568 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:49 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:49.403+0000 7f0260514200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-31T05:01:50.759 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:50 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:50.438+0000 7f0260514200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-31T05:01:50.759 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:50 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:50.567+0000 7f0260514200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-31T05:01:50.759 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:50 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:50.758+0000 7f0260514200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-31T05:01:51.068 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:50 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:50.985+0000 7f0260514200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-31T05:01:51.568 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:51 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:51.163+0000 7f0260514200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-31T05:01:51.569 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:51 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:51.344+0000 7f0260514200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-31T05:01:52.068 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:51 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:51.609+0000 7f0260514200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-31T05:01:52.068 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:51 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:51.694+0000 7f0260514200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-31T05:01:52.433 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:52 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:52.084+0000 7f0260514200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-31T05:01:53.318 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:52 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:52.869+0000 7f0260514200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-31T05:01:53.717 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:53 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:53.426+0000 7f0260514200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-31T05:01:53.717 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:53 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:53.521+0000 7f0260514200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-31T05:01:53.717 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:53 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:01:53.718+0000 7f0260514200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-31T05:01:54.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:53 smithi099 ceph-mon[31615]: Active manager daemon x restarted 2024-01-31T05:01:54.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:53 smithi099 ceph-mon[31615]: Activating manager daemon x 2024-01-31T05:01:54.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:53 smithi099 ceph-mon[31615]: osdmap e2: 0 total, 0 up, 0 in 2024-01-31T05:01:54.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:53 smithi099 ceph-mon[31615]: mgrmap e6: x(active, starting, since 0.00325057s) 2024-01-31T05:01:54.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:53 smithi099 ceph-mon[31615]: from='mgr.14120 172.21.15.99:0/3446643773' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-31T05:01:54.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:53 smithi099 ceph-mon[31615]: from='mgr.14120 172.21.15.99:0/3446643773' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-01-31T05:01:54.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:53 smithi099 ceph-mon[31615]: from='mgr.14120 172.21.15.99:0/3446643773' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-01-31T05:01:54.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:53 smithi099 ceph-mon[31615]: from='mgr.14120 172.21.15.99:0/3446643773' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-01-31T05:01:54.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:53 smithi099 ceph-mon[31615]: from='mgr.14120 172.21.15.99:0/3446643773' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-01-31T05:01:54.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:53 smithi099 ceph-mon[31615]: Manager daemon x is now available 2024-01-31T05:01:54.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:53 smithi099 ceph-mon[31615]: from='mgr.14120 172.21.15.99:0/3446643773' entity='mgr.x' 2024-01-31T05:01:54.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:53 smithi099 ceph-mon[31615]: from='mgr.14120 172.21.15.99:0/3446643773' entity='mgr.x' 2024-01-31T05:01:54.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:53 smithi099 ceph-mon[31615]: from='mgr.14120 172.21.15.99:0/3446643773' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:01:54.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:53 smithi099 ceph-mon[31615]: from='mgr.14120 172.21.15.99:0/3446643773' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:01:55.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:54 smithi099 ceph-mon[31615]: Found migration_current of "None". Setting to last migration. 2024-01-31T05:01:55.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:54 smithi099 ceph-mon[31615]: from='mgr.14120 172.21.15.99:0/3446643773' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:01:55.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:54 smithi099 ceph-mon[31615]: from='mgr.14120 172.21.15.99:0/3446643773' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-01-31T05:01:55.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:54 smithi099 ceph-mon[31615]: from='mgr.14120 172.21.15.99:0/3446643773' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-01-31T05:01:55.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:54 smithi099 ceph-mon[31615]: from='mgr.14120 172.21.15.99:0/3446643773' entity='mgr.x' 2024-01-31T05:01:55.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:54 smithi099 ceph-mon[31615]: from='mgr.14120 172.21.15.99:0/3446643773' entity='mgr.x' 2024-01-31T05:01:55.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:54 smithi099 ceph-mon[31615]: from='mgr.14120 172.21.15.99:0/3446643773' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:01:55.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:54 smithi099 ceph-mon[31615]: mgrmap e7: x(active, since 1.00636s) 2024-01-31T05:01:55.346 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout { 2024-01-31T05:01:55.346 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-01-31T05:01:55.346 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "initialized": true 2024-01-31T05:01:55.346 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout } 2024-01-31T05:01:55.346 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:49.423+0000 7fc1784c1700 1 Processor -- start 2024-01-31T05:01:55.346 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:49.423+0000 7fc1784c1700 1 -- start start 2024-01-31T05:01:55.346 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:49.423+0000 7fc1784c1700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc170107bd0 0x7fc170109fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:01:55.346 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:49.423+0000 7fc1784c1700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17007adf0 con 0x7fc170107bd0 2024-01-31T05:01:55.346 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:49.424+0000 7fc17625d700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc170107bd0 0x7fc170109fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:01:55.346 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:49.424+0000 7fc17625d700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc170107bd0 0x7fc170109fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54466/0 (socket says 172.21.15.99:54466) 2024-01-31T05:01:55.347 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:49.424+0000 7fc17625d700 1 -- 172.21.15.99:0/4167086313 learned_addr learned my addr 172.21.15.99:0/4167086313 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:01:55.347 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:49.424+0000 7fc17625d700 1 -- 172.21.15.99:0/4167086313 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc17007af30 con 0x7fc170107bd0 2024-01-31T05:01:55.347 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:49.424+0000 7fc17625d700 1 --2- 172.21.15.99:0/4167086313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc170107bd0 0x7fc170109fc0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc1600098a0 tx=0x7fc160009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c45425e7cfbd90e server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:01:55.347 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:49.424+0000 7fc17525b700 1 -- 172.21.15.99:0/4167086313 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc160004160 con 0x7fc170107bd0 2024-01-31T05:01:55.347 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:49.424+0000 7fc17525b700 1 -- 172.21.15.99:0/4167086313 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc1600042c0 con 0x7fc170107bd0 2024-01-31T05:01:55.347 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:49.424+0000 7fc17525b700 1 -- 172.21.15.99:0/4167086313 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc160011a00 con 0x7fc170107bd0 2024-01-31T05:01:55.347 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:49.425+0000 7fc1784c1700 1 -- 172.21.15.99:0/4167086313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc170107bd0 msgr2=0x7fc170109fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:01:55.347 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:49.425+0000 7fc1784c1700 1 --2- 172.21.15.99:0/4167086313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc170107bd0 0x7fc170109fc0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc1600098a0 tx=0x7fc160009bb0 comp rx=0 tx=0).stop 2024-01-31T05:01:55.347 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:49.425+0000 7fc1784c1700 1 -- 172.21.15.99:0/4167086313 shutdown_connections 2024-01-31T05:01:55.347 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:49.425+0000 7fc1784c1700 1 --2- 172.21.15.99:0/4167086313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc170107bd0 0x7fc170109fc0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:01:55.347 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:49.425+0000 7fc1784c1700 1 -- 172.21.15.99:0/4167086313 >> 172.21.15.99:0/4167086313 conn(0x7fc170101580 msgr2=0x7fc1701039a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:01:55.347 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:49.425+0000 7fc1784c1700 1 -- 172.21.15.99:0/4167086313 shutdown_connections 2024-01-31T05:01:55.347 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:49.425+0000 7fc1784c1700 1 -- 172.21.15.99:0/4167086313 wait complete. 2024-01-31T05:01:55.347 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:49.426+0000 7fc1784c1700 1 Processor -- start 2024-01-31T05:01:55.348 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:49.426+0000 7fc1784c1700 1 -- start start 2024-01-31T05:01:55.348 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:49.426+0000 7fc1784c1700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc170107bd0 0x7fc170107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:01:55.348 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:49.426+0000 7fc1784c1700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc170107990 con 0x7fc170107bd0 2024-01-31T05:01:55.348 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:49.426+0000 7fc17625d700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc170107bd0 0x7fc170107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:01:55.348 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:49.426+0000 7fc17625d700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc170107bd0 0x7fc170107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54468/0 (socket says 172.21.15.99:54468) 2024-01-31T05:01:55.348 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:49.426+0000 7fc17625d700 1 -- 172.21.15.99:0/1797915267 learned_addr learned my addr 172.21.15.99:0/1797915267 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:01:55.348 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:49.427+0000 7fc17625d700 1 -- 172.21.15.99:0/1797915267 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc160009550 con 0x7fc170107bd0 2024-01-31T05:01:55.348 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:49.427+0000 7fc17625d700 1 --2- 172.21.15.99:0/1797915267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc170107bd0 0x7fc170107450 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc160009130 tx=0x7fc160011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:01:55.348 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:49.427+0000 7fc1677fe700 1 -- 172.21.15.99:0/1797915267 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc160003b70 con 0x7fc170107bd0 2024-01-31T05:01:55.348 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:49.427+0000 7fc1677fe700 1 -- 172.21.15.99:0/1797915267 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc160003cd0 con 0x7fc170107bd0 2024-01-31T05:01:55.348 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:49.427+0000 7fc1784c1700 1 -- 172.21.15.99:0/1797915267 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc170105b80 con 0x7fc170107bd0 2024-01-31T05:01:55.348 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:49.427+0000 7fc1677fe700 1 -- 172.21.15.99:0/1797915267 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1600197d0 con 0x7fc170107bd0 2024-01-31T05:01:55.348 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:49.427+0000 7fc1784c1700 1 -- 172.21.15.99:0/1797915267 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc170106020 con 0x7fc170107bd0 2024-01-31T05:01:55.348 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:49.428+0000 7fc1677fe700 1 -- 172.21.15.99:0/1797915267 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 45641+0+0 (secure 0 0 0) 0x7fc16001a430 con 0x7fc170107bd0 2024-01-31T05:01:55.348 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:49.428+0000 7fc1677fe700 1 --2- 172.21.15.99:0/1797915267 >> [v2:172.21.15.99:6800/1706888338,v1:172.21.15.99:6801/1706888338] conn(0x7fc15c038a40 0x7fc15c03af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:01:55.349 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:49.428+0000 7fc1677fe700 1 -- 172.21.15.99:0/1797915267 --> [v2:172.21.15.99:6800/1706888338,v1:172.21.15.99:6801/1706888338] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc15c03b610 con 0x7fc15c038a40 2024-01-31T05:01:55.349 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:49.428+0000 7fc1677fe700 1 -- 172.21.15.99:0/1797915267 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc16004ccc0 con 0x7fc170107bd0 2024-01-31T05:01:55.349 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:49.428+0000 7fc175a5c700 1 -- 172.21.15.99:0/1797915267 >> [v2:172.21.15.99:6800/1706888338,v1:172.21.15.99:6801/1706888338] conn(0x7fc15c038a40 msgr2=0x7fc15c03af00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.99:6800/1706888338 2024-01-31T05:01:55.349 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:49.428+0000 7fc175a5c700 1 --2- 172.21.15.99:0/1797915267 >> [v2:172.21.15.99:6800/1706888338,v1:172.21.15.99:6801/1706888338] conn(0x7fc15c038a40 0x7fc15c03af00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-31T05:01:55.349 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:49.629+0000 7fc175a5c700 1 -- 172.21.15.99:0/1797915267 >> [v2:172.21.15.99:6800/1706888338,v1:172.21.15.99:6801/1706888338] conn(0x7fc15c038a40 msgr2=0x7fc15c03af00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.99:6800/1706888338 2024-01-31T05:01:55.349 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:49.629+0000 7fc175a5c700 1 --2- 172.21.15.99:0/1797915267 >> [v2:172.21.15.99:6800/1706888338,v1:172.21.15.99:6801/1706888338] conn(0x7fc15c038a40 0x7fc15c03af00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-31T05:01:55.349 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:50.030+0000 7fc175a5c700 1 -- 172.21.15.99:0/1797915267 >> [v2:172.21.15.99:6800/1706888338,v1:172.21.15.99:6801/1706888338] conn(0x7fc15c038a40 msgr2=0x7fc15c03af00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.99:6800/1706888338 2024-01-31T05:01:55.349 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:50.030+0000 7fc175a5c700 1 --2- 172.21.15.99:0/1797915267 >> [v2:172.21.15.99:6800/1706888338,v1:172.21.15.99:6801/1706888338] conn(0x7fc15c038a40 0x7fc15c03af00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-31T05:01:55.349 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:50.831+0000 7fc175a5c700 1 -- 172.21.15.99:0/1797915267 >> [v2:172.21.15.99:6800/1706888338,v1:172.21.15.99:6801/1706888338] conn(0x7fc15c038a40 msgr2=0x7fc15c03af00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.99:6800/1706888338 2024-01-31T05:01:55.349 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:50.831+0000 7fc175a5c700 1 --2- 172.21.15.99:0/1797915267 >> [v2:172.21.15.99:6800/1706888338,v1:172.21.15.99:6801/1706888338] conn(0x7fc15c038a40 0x7fc15c03af00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-31T05:01:55.349 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:52.432+0000 7fc175a5c700 1 -- 172.21.15.99:0/1797915267 >> [v2:172.21.15.99:6800/1706888338,v1:172.21.15.99:6801/1706888338] conn(0x7fc15c038a40 msgr2=0x7fc15c03af00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.99:6800/1706888338 2024-01-31T05:01:55.349 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:52.432+0000 7fc175a5c700 1 --2- 172.21.15.99:0/1797915267 >> [v2:172.21.15.99:6800/1706888338,v1:172.21.15.99:6801/1706888338] conn(0x7fc15c038a40 0x7fc15c03af00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-01-31T05:01:55.349 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:53.733+0000 7fc1677fe700 1 -- 172.21.15.99:0/1797915267 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mgrmap(e 6) v1 ==== 45408+0+0 (secure 0 0 0) 0x7fc16001a730 con 0x7fc170107bd0 2024-01-31T05:01:55.349 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:53.733+0000 7fc1677fe700 1 -- 172.21.15.99:0/1797915267 >> [v2:172.21.15.99:6800/1706888338,v1:172.21.15.99:6801/1706888338] conn(0x7fc15c038a40 msgr2=0x7fc15c03af00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-31T05:01:55.349 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:53.733+0000 7fc1677fe700 1 --2- 172.21.15.99:0/1797915267 >> [v2:172.21.15.99:6800/1706888338,v1:172.21.15.99:6801/1706888338] conn(0x7fc15c038a40 0x7fc15c03af00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:01:55.350 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:54.735+0000 7fc1677fe700 1 -- 172.21.15.99:0/1797915267 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mgrmap(e 7) v1 ==== 45535+0+0 (secure 0 0 0) 0x7fc16000fba0 con 0x7fc170107bd0 2024-01-31T05:01:55.350 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:54.735+0000 7fc1677fe700 1 --2- 172.21.15.99:0/1797915267 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7fc15c03c320 0x7fc15c03e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:01:55.350 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:54.735+0000 7fc1677fe700 1 -- 172.21.15.99:0/1797915267 --> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc15c03b610 con 0x7fc15c03c320 2024-01-31T05:01:55.350 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:54.735+0000 7fc175a5c700 1 --2- 172.21.15.99:0/1797915267 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7fc15c03c320 0x7fc15c03e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:01:55.350 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:54.736+0000 7fc175a5c700 1 --2- 172.21.15.99:0/1797915267 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7fc15c03c320 0x7fc15c03e710 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fc16c003a10 tx=0x7fc16c009290 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:01:55.350 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:54.737+0000 7fc1677fe700 1 -- 172.21.15.99:0/1797915267 <== mgr.14120 v2:172.21.15.99:6800/1993198206 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7fc15c03b610 con 0x7fc15c03c320 2024-01-31T05:01:55.350 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:54.743+0000 7fc1784c1700 1 -- 172.21.15.99:0/1797915267 --> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fc170062e10 con 0x7fc15c03c320 2024-01-31T05:01:55.350 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:54.744+0000 7fc1677fe700 1 -- 172.21.15.99:0/1797915267 <== mgr.14120 v2:172.21.15.99:6800/1993198206 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fc170062e10 con 0x7fc15c03c320 2024-01-31T05:01:55.350 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:54.744+0000 7fc1784c1700 1 -- 172.21.15.99:0/1797915267 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7fc15c03c320 msgr2=0x7fc15c03e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:01:55.350 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:54.744+0000 7fc1784c1700 1 --2- 172.21.15.99:0/1797915267 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7fc15c03c320 0x7fc15c03e710 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fc16c003a10 tx=0x7fc16c009290 comp rx=0 tx=0).stop 2024-01-31T05:01:55.350 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:54.744+0000 7fc1784c1700 1 -- 172.21.15.99:0/1797915267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc170107bd0 msgr2=0x7fc170107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:01:55.350 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:54.744+0000 7fc1784c1700 1 --2- 172.21.15.99:0/1797915267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc170107bd0 0x7fc170107450 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc160009130 tx=0x7fc160011ad0 comp rx=0 tx=0).stop 2024-01-31T05:01:55.350 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:54.744+0000 7fc1784c1700 1 -- 172.21.15.99:0/1797915267 shutdown_connections 2024-01-31T05:01:55.350 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:54.744+0000 7fc1784c1700 1 --2- 172.21.15.99:0/1797915267 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7fc15c03c320 0x7fc15c03e710 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:01:55.350 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:54.744+0000 7fc1784c1700 1 --2- 172.21.15.99:0/1797915267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc170107bd0 0x7fc170107450 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:01:55.351 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:54.744+0000 7fc1784c1700 1 --2- 172.21.15.99:0/1797915267 >> [v2:172.21.15.99:6800/1706888338,v1:172.21.15.99:6801/1706888338] conn(0x7fc15c038a40 0x7fc15c03af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:01:55.351 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:54.744+0000 7fc1784c1700 1 -- 172.21.15.99:0/1797915267 >> 172.21.15.99:0/1797915267 conn(0x7fc170101580 msgr2=0x7fc1701020e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:01:55.351 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:54.744+0000 7fc1784c1700 1 -- 172.21.15.99:0/1797915267 shutdown_connections 2024-01-31T05:01:55.351 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:54.744+0000 7fc1784c1700 1 -- 172.21.15.99:0/1797915267 wait complete. 2024-01-31T05:01:55.351 INFO:teuthology.orchestra.run.smithi099.stdout:mgr epoch 5 is available 2024-01-31T05:01:55.351 INFO:teuthology.orchestra.run.smithi099.stdout:Setting orchestrator backend to cephadm... 2024-01-31T05:01:55.960 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:55 smithi099 ceph-mon[31615]: [31/Jan/2024:05:01:54] ENGINE Bus STARTING 2024-01-31T05:01:55.960 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:55 smithi099 ceph-mon[31615]: [31/Jan/2024:05:01:54] ENGINE Serving on https://172.21.15.99:7150 2024-01-31T05:01:55.960 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:55 smithi099 ceph-mon[31615]: [31/Jan/2024:05:01:54] ENGINE Serving on http://172.21.15.99:8765 2024-01-31T05:01:55.960 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:55 smithi099 ceph-mon[31615]: [31/Jan/2024:05:01:54] ENGINE Bus STARTED 2024-01-31T05:01:55.960 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:55 smithi099 ceph-mon[31615]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-01-31T05:01:55.960 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:55 smithi099 ceph-mon[31615]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-01-31T05:01:56.501 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.738+0000 7f71c48ef700 1 Processor -- start 2024-01-31T05:01:56.501 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.738+0000 7f71c48ef700 1 -- start start 2024-01-31T05:01:56.501 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.738+0000 7f71c48ef700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71c0105f80 0x7f71c01063a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:01:56.501 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.738+0000 7f71c48ef700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c0106970 con 0x7f71c0105f80 2024-01-31T05:01:56.501 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.738+0000 7f71be59c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71c0105f80 0x7f71c01063a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:01:56.501 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.738+0000 7f71be59c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71c0105f80 0x7f71c01063a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59272/0 (socket says 172.21.15.99:59272) 2024-01-31T05:01:56.501 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.738+0000 7f71be59c700 1 -- 172.21.15.99:0/3777570774 learned_addr learned my addr 172.21.15.99:0/3777570774 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:01:56.501 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.739+0000 7f71be59c700 1 -- 172.21.15.99:0/3777570774 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c0107180 con 0x7f71c0105f80 2024-01-31T05:01:56.501 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.739+0000 7f71be59c700 1 --2- 172.21.15.99:0/3777570774 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71c0105f80 0x7f71c01063a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f71b00098a0 tx=0x7f71b0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a80b9fca062347f4 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:01:56.501 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.739+0000 7f71bdd9b700 1 -- 172.21.15.99:0/3777570774 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f71b0004160 con 0x7f71c0105f80 2024-01-31T05:01:56.502 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.739+0000 7f71bdd9b700 1 -- 172.21.15.99:0/3777570774 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f71b00042c0 con 0x7f71c0105f80 2024-01-31T05:01:56.502 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.739+0000 7f71bdd9b700 1 -- 172.21.15.99:0/3777570774 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f71b0011a00 con 0x7f71c0105f80 2024-01-31T05:01:56.502 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.739+0000 7f71c48ef700 1 -- 172.21.15.99:0/3777570774 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71c0105f80 msgr2=0x7f71c01063a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:01:56.502 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.739+0000 7f71c48ef700 1 --2- 172.21.15.99:0/3777570774 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71c0105f80 0x7f71c01063a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f71b00098a0 tx=0x7f71b0009bb0 comp rx=0 tx=0).stop 2024-01-31T05:01:56.502 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.739+0000 7f71c48ef700 1 -- 172.21.15.99:0/3777570774 shutdown_connections 2024-01-31T05:01:56.502 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.739+0000 7f71c48ef700 1 --2- 172.21.15.99:0/3777570774 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71c0105f80 0x7f71c01063a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:01:56.502 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.739+0000 7f71c48ef700 1 -- 172.21.15.99:0/3777570774 >> 172.21.15.99:0/3777570774 conn(0x7f71c0101580 msgr2=0x7f71c01039a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:01:56.502 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.740+0000 7f71c48ef700 1 -- 172.21.15.99:0/3777570774 shutdown_connections 2024-01-31T05:01:56.502 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.740+0000 7f71c48ef700 1 -- 172.21.15.99:0/3777570774 wait complete. 2024-01-31T05:01:56.502 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.740+0000 7f71c48ef700 1 Processor -- start 2024-01-31T05:01:56.502 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.740+0000 7f71c48ef700 1 -- start start 2024-01-31T05:01:56.502 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.741+0000 7f71c48ef700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71c0105f80 0x7f71c007aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:01:56.502 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.741+0000 7f71c48ef700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c019db00 con 0x7f71c0105f80 2024-01-31T05:01:56.502 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.741+0000 7f71be59c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71c0105f80 0x7f71c007aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:01:56.503 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.741+0000 7f71be59c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71c0105f80 0x7f71c007aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59282/0 (socket says 172.21.15.99:59282) 2024-01-31T05:01:56.503 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.741+0000 7f71be59c700 1 -- 172.21.15.99:0/1151040671 learned_addr learned my addr 172.21.15.99:0/1151040671 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:01:56.503 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.741+0000 7f71be59c700 1 -- 172.21.15.99:0/1151040671 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b0009550 con 0x7f71c0105f80 2024-01-31T05:01:56.503 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.741+0000 7f71be59c700 1 --2- 172.21.15.99:0/1151040671 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71c0105f80 0x7f71c007aad0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f71b0009fb0 tx=0x7f71b0011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:01:56.503 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.741+0000 7f71b7fff700 1 -- 172.21.15.99:0/1151040671 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f71b0003a40 con 0x7f71c0105f80 2024-01-31T05:01:56.503 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.741+0000 7f71b7fff700 1 -- 172.21.15.99:0/1151040671 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f71b0003ba0 con 0x7f71c0105f80 2024-01-31T05:01:56.503 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.741+0000 7f71c48ef700 1 -- 172.21.15.99:0/1151040671 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c019dc40 con 0x7f71c0105f80 2024-01-31T05:01:56.503 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.741+0000 7f71b7fff700 1 -- 172.21.15.99:0/1151040671 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f71b001a750 con 0x7f71c0105f80 2024-01-31T05:01:56.503 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.741+0000 7f71c48ef700 1 -- 172.21.15.99:0/1151040671 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c019e020 con 0x7f71c0105f80 2024-01-31T05:01:56.503 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.742+0000 7f71b7fff700 1 -- 172.21.15.99:0/1151040671 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 7) v1 ==== 45535+0+0 (secure 0 0 0) 0x7f71b001a9d0 con 0x7f71c0105f80 2024-01-31T05:01:56.503 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.742+0000 7f71b7fff700 1 --2- 172.21.15.99:0/1151040671 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7f71ac0388e0 0x7f71ac03ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:01:56.503 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.742+0000 7f71b7fff700 1 -- 172.21.15.99:0/1151040671 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f71b004d850 con 0x7f71c0105f80 2024-01-31T05:01:56.504 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.742+0000 7f71b5d9b700 1 --2- 172.21.15.99:0/1151040671 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7f71ac0388e0 0x7f71ac03ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:01:56.504 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.742+0000 7f71c48ef700 1 -- 172.21.15.99:0/1151040671 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71c0062e10 con 0x7f71c0105f80 2024-01-31T05:01:56.504 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.743+0000 7f71b5d9b700 1 --2- 172.21.15.99:0/1151040671 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7f71ac0388e0 0x7f71ac03ada0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f71a8006fd0 tx=0x7f71a8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:01:56.504 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.747+0000 7f71b7fff700 1 -- 172.21.15.99:0/1151040671 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f71b0023390 con 0x7f71c0105f80 2024-01-31T05:01:56.504 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.785+0000 7f71b7fff700 1 -- 172.21.15.99:0/1151040671 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mgrmap(e 8) v1 ==== 45641+0+0 (secure 0 0 0) 0x7f71b002d9b0 con 0x7f71c0105f80 2024-01-31T05:01:56.504 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.953+0000 7f71c48ef700 1 -- 172.21.15.99:0/1151040671 --> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f71c010a380 con 0x7f71ac0388e0 2024-01-31T05:01:56.504 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.960+0000 7f71b7fff700 1 -- 172.21.15.99:0/1151040671 <== mgr.14120 v2:172.21.15.99:6800/1993198206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f71c010a380 con 0x7f71ac0388e0 2024-01-31T05:01:56.504 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.963+0000 7f71c48ef700 1 -- 172.21.15.99:0/1151040671 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7f71ac0388e0 msgr2=0x7f71ac03ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:01:56.504 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.963+0000 7f71c48ef700 1 --2- 172.21.15.99:0/1151040671 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7f71ac0388e0 0x7f71ac03ada0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f71a8006fd0 tx=0x7f71a8006e40 comp rx=0 tx=0).stop 2024-01-31T05:01:56.504 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.963+0000 7f71c48ef700 1 -- 172.21.15.99:0/1151040671 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71c0105f80 msgr2=0x7f71c007aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:01:56.504 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.963+0000 7f71c48ef700 1 --2- 172.21.15.99:0/1151040671 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71c0105f80 0x7f71c007aad0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f71b0009fb0 tx=0x7f71b0011ad0 comp rx=0 tx=0).stop 2024-01-31T05:01:56.504 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.963+0000 7f71c48ef700 1 -- 172.21.15.99:0/1151040671 shutdown_connections 2024-01-31T05:01:56.504 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.963+0000 7f71c48ef700 1 --2- 172.21.15.99:0/1151040671 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7f71ac0388e0 0x7f71ac03ada0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:01:56.505 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.963+0000 7f71c48ef700 1 --2- 172.21.15.99:0/1151040671 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71c0105f80 0x7f71c007aad0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:01:56.505 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.963+0000 7f71c48ef700 1 -- 172.21.15.99:0/1151040671 >> 172.21.15.99:0/1151040671 conn(0x7f71c0101580 msgr2=0x7f71c0102150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:01:56.505 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.963+0000 7f71c48ef700 1 -- 172.21.15.99:0/1151040671 shutdown_connections 2024-01-31T05:01:56.505 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:55.963+0000 7f71c48ef700 1 -- 172.21.15.99:0/1151040671 wait complete. 2024-01-31T05:01:57.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:56 smithi099 ceph-mon[31615]: mgrmap e8: x(active, since 2s) 2024-01-31T05:01:57.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:56 smithi099 ceph-mon[31615]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:01:57.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:56 smithi099 ceph-mon[31615]: from='mgr.14120 172.21.15.99:0/3446643773' entity='mgr.x' 2024-01-31T05:01:57.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:56 smithi099 ceph-mon[31615]: from='mgr.14120 172.21.15.99:0/3446643773' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:01:57.691 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout value unchanged 2024-01-31T05:01:57.691 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:56.908+0000 7f1907606700 1 Processor -- start 2024-01-31T05:01:57.691 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:56.909+0000 7f1907606700 1 -- start start 2024-01-31T05:01:57.691 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:56.909+0000 7f1907606700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1900105fe0 0x7f1900106400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:01:57.691 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:56.909+0000 7f1907606700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19001069d0 con 0x7f1900105fe0 2024-01-31T05:01:57.691 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:56.909+0000 7f19053a2700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1900105fe0 0x7f1900106400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:01:57.691 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:56.909+0000 7f19053a2700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1900105fe0 0x7f1900106400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59292/0 (socket says 172.21.15.99:59292) 2024-01-31T05:01:57.691 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:56.909+0000 7f19053a2700 1 -- 172.21.15.99:0/2428285177 learned_addr learned my addr 172.21.15.99:0/2428285177 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:01:57.692 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:56.909+0000 7f19053a2700 1 -- 172.21.15.99:0/2428285177 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19001071e0 con 0x7f1900105fe0 2024-01-31T05:01:57.692 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:56.909+0000 7f19053a2700 1 --2- 172.21.15.99:0/2428285177 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1900105fe0 0x7f1900106400 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f18f00098a0 tx=0x7f18f0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c27583b558610946 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:01:57.692 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:56.909+0000 7f18f7fff700 1 -- 172.21.15.99:0/2428285177 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f18f0004160 con 0x7f1900105fe0 2024-01-31T05:01:57.692 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:56.909+0000 7f18f7fff700 1 -- 172.21.15.99:0/2428285177 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f18f00042c0 con 0x7f1900105fe0 2024-01-31T05:01:57.692 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:56.909+0000 7f18f7fff700 1 -- 172.21.15.99:0/2428285177 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f18f0011a00 con 0x7f1900105fe0 2024-01-31T05:01:57.692 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:56.910+0000 7f1907606700 1 -- 172.21.15.99:0/2428285177 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1900105fe0 msgr2=0x7f1900106400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:01:57.692 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:56.910+0000 7f1907606700 1 --2- 172.21.15.99:0/2428285177 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1900105fe0 0x7f1900106400 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f18f00098a0 tx=0x7f18f0009bb0 comp rx=0 tx=0).stop 2024-01-31T05:01:57.692 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:56.910+0000 7f1907606700 1 -- 172.21.15.99:0/2428285177 shutdown_connections 2024-01-31T05:01:57.692 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:56.910+0000 7f1907606700 1 --2- 172.21.15.99:0/2428285177 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1900105fe0 0x7f1900106400 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:01:57.692 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:56.910+0000 7f1907606700 1 -- 172.21.15.99:0/2428285177 >> 172.21.15.99:0/2428285177 conn(0x7f19001015e0 msgr2=0x7f1900103a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:01:57.692 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:56.910+0000 7f1907606700 1 -- 172.21.15.99:0/2428285177 shutdown_connections 2024-01-31T05:01:57.692 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:56.910+0000 7f1907606700 1 -- 172.21.15.99:0/2428285177 wait complete. 2024-01-31T05:01:57.692 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:56.911+0000 7f1907606700 1 Processor -- start 2024-01-31T05:01:57.692 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:56.911+0000 7f1907606700 1 -- start start 2024-01-31T05:01:57.693 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:56.911+0000 7f1907606700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1900105fe0 0x7f1900199d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:01:57.693 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:56.911+0000 7f1907606700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f190019a2a0 con 0x7f1900105fe0 2024-01-31T05:01:57.693 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:56.911+0000 7f19053a2700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1900105fe0 0x7f1900199d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:01:57.693 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:56.911+0000 7f19053a2700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1900105fe0 0x7f1900199d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59294/0 (socket says 172.21.15.99:59294) 2024-01-31T05:01:57.693 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:56.911+0000 7f19053a2700 1 -- 172.21.15.99:0/2752413316 learned_addr learned my addr 172.21.15.99:0/2752413316 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:01:57.693 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:56.911+0000 7f19053a2700 1 -- 172.21.15.99:0/2752413316 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f0009550 con 0x7f1900105fe0 2024-01-31T05:01:57.693 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:56.911+0000 7f19053a2700 1 --2- 172.21.15.99:0/2752413316 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1900105fe0 0x7f1900199d60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f18f0009130 tx=0x7f18f0011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:01:57.693 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:56.911+0000 7f18f67fc700 1 -- 172.21.15.99:0/2752413316 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f18f0003ab0 con 0x7f1900105fe0 2024-01-31T05:01:57.693 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:56.911+0000 7f18f67fc700 1 -- 172.21.15.99:0/2752413316 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f18f0003c10 con 0x7f1900105fe0 2024-01-31T05:01:57.693 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:56.911+0000 7f1907606700 1 -- 172.21.15.99:0/2752413316 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f190019a4a0 con 0x7f1900105fe0 2024-01-31T05:01:57.693 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:56.911+0000 7f18f67fc700 1 -- 172.21.15.99:0/2752413316 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f18f00247d0 con 0x7f1900105fe0 2024-01-31T05:01:57.693 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:56.912+0000 7f1907606700 1 -- 172.21.15.99:0/2752413316 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f190019a940 con 0x7f1900105fe0 2024-01-31T05:01:57.693 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:56.912+0000 7f18f67fc700 1 -- 172.21.15.99:0/2752413316 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 8) v1 ==== 45641+0+0 (secure 0 0 0) 0x7f18f002d3f0 con 0x7f1900105fe0 2024-01-31T05:01:57.693 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:56.912+0000 7f1907606700 1 -- 172.21.15.99:0/2752413316 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f190010a410 con 0x7f1900105fe0 2024-01-31T05:01:57.693 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:56.912+0000 7f18f67fc700 1 --2- 172.21.15.99:0/2752413316 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7f18ec038a90 0x7f18ec03af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:01:57.694 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:56.912+0000 7f18f67fc700 1 -- 172.21.15.99:0/2752413316 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f18f004cb20 con 0x7f1900105fe0 2024-01-31T05:01:57.694 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:56.913+0000 7f1904ba1700 1 --2- 172.21.15.99:0/2752413316 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7f18ec038a90 0x7f18ec03af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:01:57.694 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:56.913+0000 7f1904ba1700 1 --2- 172.21.15.99:0/2752413316 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7f18ec038a90 0x7f18ec03af50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f18fc006fd0 tx=0x7f18fc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:01:57.694 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:56.917+0000 7f18f67fc700 1 -- 172.21.15.99:0/2752413316 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f18f0010740 con 0x7f1900105fe0 2024-01-31T05:01:57.694 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:57.113+0000 7f1907606700 1 -- 172.21.15.99:0/2752413316 --> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f19001028a0 con 0x7f18ec038a90 2024-01-31T05:01:57.694 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:57.113+0000 7f18f67fc700 1 -- 172.21.15.99:0/2752413316 <== mgr.14120 v2:172.21.15.99:6800/1993198206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f19001028a0 con 0x7f18ec038a90 2024-01-31T05:01:57.694 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:57.115+0000 7f1907606700 1 -- 172.21.15.99:0/2752413316 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7f18ec038a90 msgr2=0x7f18ec03af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:01:57.694 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:57.115+0000 7f1907606700 1 --2- 172.21.15.99:0/2752413316 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7f18ec038a90 0x7f18ec03af50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f18fc006fd0 tx=0x7f18fc006e40 comp rx=0 tx=0).stop 2024-01-31T05:01:57.694 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:57.115+0000 7f1907606700 1 -- 172.21.15.99:0/2752413316 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1900105fe0 msgr2=0x7f1900199d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:01:57.694 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:57.115+0000 7f1907606700 1 --2- 172.21.15.99:0/2752413316 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1900105fe0 0x7f1900199d60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f18f0009130 tx=0x7f18f0011ad0 comp rx=0 tx=0).stop 2024-01-31T05:01:57.694 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:57.115+0000 7f1907606700 1 -- 172.21.15.99:0/2752413316 shutdown_connections 2024-01-31T05:01:57.694 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:57.116+0000 7f1907606700 1 --2- 172.21.15.99:0/2752413316 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7f18ec038a90 0x7f18ec03af50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:01:57.694 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:57.116+0000 7f1907606700 1 --2- 172.21.15.99:0/2752413316 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1900105fe0 0x7f1900199d60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:01:57.694 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:57.116+0000 7f1907606700 1 -- 172.21.15.99:0/2752413316 >> 172.21.15.99:0/2752413316 conn(0x7f19001015e0 msgr2=0x7f1900102190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:01:57.694 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:57.116+0000 7f1907606700 1 -- 172.21.15.99:0/2752413316 shutdown_connections 2024-01-31T05:01:57.695 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:57.116+0000 7f1907606700 1 -- 172.21.15.99:0/2752413316 wait complete. 2024-01-31T05:01:57.695 INFO:teuthology.orchestra.run.smithi099.stdout:Generating ssh key... 2024-01-31T05:01:58.300 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:58 smithi099 ceph-mon[31615]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:01:59.014 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:58 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: Generating public/private rsa key pair. 2024-01-31T05:01:59.014 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:58 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: Your identification has been saved in /tmp/tmpeq_i30si/key. 2024-01-31T05:01:59.014 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:58 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: Your public key has been saved in /tmp/tmpeq_i30si/key.pub. 2024-01-31T05:01:59.014 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:58 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: The key fingerprint is: 2024-01-31T05:01:59.015 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:58 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: SHA256:s3RLT818PcE4u2jF4SWHijtCgmVs3NWJhJEvNHqQDyk ceph-9288ff44-bff5-11ee-95b3-87774f69a715 2024-01-31T05:01:59.015 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:58 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: The key's randomart image is: 2024-01-31T05:01:59.015 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:58 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: +---[RSA 3072]----+ 2024-01-31T05:01:59.015 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:58 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: | o.=oo . | 2024-01-31T05:01:59.015 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:58 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: | Eo=.=.. o + | 2024-01-31T05:01:59.015 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:58 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: | .**.o * = | 2024-01-31T05:01:59.015 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:58 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: | =. + .. ++B o| 2024-01-31T05:01:59.015 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:58 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: | . ...S.o..=+.o| 2024-01-31T05:01:59.015 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:58 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: | o. =.+o ...| 2024-01-31T05:01:59.015 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:58 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: | ..o.o.. | 2024-01-31T05:01:59.015 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:58 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: | . o | 2024-01-31T05:01:59.015 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:58 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: | | 2024-01-31T05:01:59.015 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:01:58 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: +----[SHA256]-----+ 2024-01-31T05:01:59.298 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.168+0000 7f1713ef3700 1 Processor -- start 2024-01-31T05:01:59.298 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.168+0000 7f1713ef3700 1 -- start start 2024-01-31T05:01:59.298 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.169+0000 7f1713ef3700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f170c107b40 0x7f170c109f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:01:59.299 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.169+0000 7f1713ef3700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170c07aed0 con 0x7f170c107b40 2024-01-31T05:01:59.299 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.169+0000 7f1711c8f700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f170c107b40 0x7f170c109f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:01:59.299 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.169+0000 7f1711c8f700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f170c107b40 0x7f170c109f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59304/0 (socket says 172.21.15.99:59304) 2024-01-31T05:01:59.299 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.169+0000 7f1711c8f700 1 -- 172.21.15.99:0/2941843820 learned_addr learned my addr 172.21.15.99:0/2941843820 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:01:59.299 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.169+0000 7f1711c8f700 1 -- 172.21.15.99:0/2941843820 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f170c10a470 con 0x7f170c107b40 2024-01-31T05:01:59.299 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.169+0000 7f1711c8f700 1 --2- 172.21.15.99:0/2941843820 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f170c107b40 0x7f170c109f30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f17080098a0 tx=0x7f1708009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=853b6981ea2c1823 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:01:59.299 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.170+0000 7f1710c8d700 1 -- 172.21.15.99:0/2941843820 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1708004160 con 0x7f170c107b40 2024-01-31T05:01:59.299 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.170+0000 7f1710c8d700 1 -- 172.21.15.99:0/2941843820 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f17080042c0 con 0x7f170c107b40 2024-01-31T05:01:59.299 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.170+0000 7f1710c8d700 1 -- 172.21.15.99:0/2941843820 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1708011a00 con 0x7f170c107b40 2024-01-31T05:01:59.299 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.170+0000 7f1713ef3700 1 -- 172.21.15.99:0/2941843820 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f170c107b40 msgr2=0x7f170c109f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:01:59.299 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.170+0000 7f1713ef3700 1 --2- 172.21.15.99:0/2941843820 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f170c107b40 0x7f170c109f30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f17080098a0 tx=0x7f1708009bb0 comp rx=0 tx=0).stop 2024-01-31T05:01:59.299 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.170+0000 7f1713ef3700 1 -- 172.21.15.99:0/2941843820 shutdown_connections 2024-01-31T05:01:59.299 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.170+0000 7f1713ef3700 1 --2- 172.21.15.99:0/2941843820 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f170c107b40 0x7f170c109f30 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:01:59.300 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.170+0000 7f1713ef3700 1 -- 172.21.15.99:0/2941843820 >> 172.21.15.99:0/2941843820 conn(0x7f170c1015d0 msgr2=0x7f170c1039f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:01:59.300 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.170+0000 7f1713ef3700 1 -- 172.21.15.99:0/2941843820 shutdown_connections 2024-01-31T05:01:59.300 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.170+0000 7f1713ef3700 1 -- 172.21.15.99:0/2941843820 wait complete. 2024-01-31T05:01:59.300 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.171+0000 7f1713ef3700 1 Processor -- start 2024-01-31T05:01:59.300 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.171+0000 7f1713ef3700 1 -- start start 2024-01-31T05:01:59.300 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.171+0000 7f1713ef3700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f170c107b40 0x7f170c19ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:01:59.300 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.171+0000 7f1713ef3700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170c19b370 con 0x7f170c107b40 2024-01-31T05:01:59.300 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.171+0000 7f1711c8f700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f170c107b40 0x7f170c19ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:01:59.300 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.171+0000 7f1711c8f700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f170c107b40 0x7f170c19ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59308/0 (socket says 172.21.15.99:59308) 2024-01-31T05:01:59.300 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.171+0000 7f1711c8f700 1 -- 172.21.15.99:0/2034433013 learned_addr learned my addr 172.21.15.99:0/2034433013 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:01:59.300 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.172+0000 7f1711c8f700 1 -- 172.21.15.99:0/2034433013 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1708009550 con 0x7f170c107b40 2024-01-31T05:01:59.300 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.172+0000 7f1711c8f700 1 --2- 172.21.15.99:0/2034433013 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f170c107b40 0x7f170c19ae30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1708009130 tx=0x7f1708011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:01:59.300 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.172+0000 7f1702ffd700 1 -- 172.21.15.99:0/2034433013 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1708003b70 con 0x7f170c107b40 2024-01-31T05:01:59.301 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.172+0000 7f1702ffd700 1 -- 172.21.15.99:0/2034433013 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1708003cd0 con 0x7f170c107b40 2024-01-31T05:01:59.301 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.172+0000 7f1713ef3700 1 -- 172.21.15.99:0/2034433013 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f170c19b570 con 0x7f170c107b40 2024-01-31T05:01:59.301 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.172+0000 7f1702ffd700 1 -- 172.21.15.99:0/2034433013 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f17080197d0 con 0x7f170c107b40 2024-01-31T05:01:59.301 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.172+0000 7f1713ef3700 1 -- 172.21.15.99:0/2034433013 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f170c19ba10 con 0x7f170c107b40 2024-01-31T05:01:59.301 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.173+0000 7f1702ffd700 1 -- 172.21.15.99:0/2034433013 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 8) v1 ==== 45641+0+0 (secure 0 0 0) 0x7f1708019a40 con 0x7f170c107b40 2024-01-31T05:01:59.301 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.173+0000 7f1713ef3700 1 -- 172.21.15.99:0/2034433013 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f170c10b270 con 0x7f170c107b40 2024-01-31T05:01:59.301 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.173+0000 7f1702ffd700 1 --2- 172.21.15.99:0/2034433013 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7f16f8038a90 0x7f16f803af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:01:59.301 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.173+0000 7f1702ffd700 1 -- 172.21.15.99:0/2034433013 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f170804cda0 con 0x7f170c107b40 2024-01-31T05:01:59.301 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.173+0000 7f171148e700 1 --2- 172.21.15.99:0/2034433013 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7f16f8038a90 0x7f16f803af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:01:59.301 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.174+0000 7f171148e700 1 --2- 172.21.15.99:0/2034433013 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7f16f8038a90 0x7f16f803af50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f16fc006fd0 tx=0x7f16fc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:01:59.301 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.178+0000 7f1702ffd700 1 -- 172.21.15.99:0/2034433013 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f170801a610 con 0x7f170c107b40 2024-01-31T05:01:59.301 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.375+0000 7f1713ef3700 1 -- 172.21.15.99:0/2034433013 --> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f170c1027b0 con 0x7f16f8038a90 2024-01-31T05:01:59.301 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.665+0000 7f1702ffd700 1 -- 172.21.15.99:0/2034433013 <== mgr.14120 v2:172.21.15.99:6800/1993198206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f170c1027b0 con 0x7f16f8038a90 2024-01-31T05:01:59.302 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.668+0000 7f1713ef3700 1 -- 172.21.15.99:0/2034433013 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7f16f8038a90 msgr2=0x7f16f803af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:01:59.302 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.668+0000 7f1713ef3700 1 --2- 172.21.15.99:0/2034433013 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7f16f8038a90 0x7f16f803af50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f16fc006fd0 tx=0x7f16fc006e40 comp rx=0 tx=0).stop 2024-01-31T05:01:59.302 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.668+0000 7f1713ef3700 1 -- 172.21.15.99:0/2034433013 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f170c107b40 msgr2=0x7f170c19ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:01:59.302 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.668+0000 7f1713ef3700 1 --2- 172.21.15.99:0/2034433013 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f170c107b40 0x7f170c19ae30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1708009130 tx=0x7f1708011ad0 comp rx=0 tx=0).stop 2024-01-31T05:01:59.302 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.668+0000 7f1713ef3700 1 -- 172.21.15.99:0/2034433013 shutdown_connections 2024-01-31T05:01:59.302 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.668+0000 7f1713ef3700 1 --2- 172.21.15.99:0/2034433013 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7f16f8038a90 0x7f16f803af50 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:01:59.302 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.668+0000 7f1713ef3700 1 --2- 172.21.15.99:0/2034433013 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f170c107b40 0x7f170c19ae30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:01:59.302 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.668+0000 7f1713ef3700 1 -- 172.21.15.99:0/2034433013 >> 172.21.15.99:0/2034433013 conn(0x7f170c1015d0 msgr2=0x7f170c1020a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:01:59.302 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.668+0000 7f1713ef3700 1 -- 172.21.15.99:0/2034433013 shutdown_connections 2024-01-31T05:01:59.302 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:58.668+0000 7f1713ef3700 1 -- 172.21.15.99:0/2034433013 wait complete. 2024-01-31T05:01:59.913 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:59 smithi099 ceph-mon[31615]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:01:59.913 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:59 smithi099 ceph-mon[31615]: Generating ssh key... 2024-01-31T05:01:59.913 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:59 smithi099 ceph-mon[31615]: from='mgr.14120 172.21.15.99:0/3446643773' entity='mgr.x' 2024-01-31T05:01:59.913 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:01:59 smithi099 ceph-mon[31615]: from='mgr.14120 172.21.15.99:0/3446643773' entity='mgr.x' 2024-01-31T05:02:00.506 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCy+7Xf64pL8DRs/UOhTBoxHWeIih33Wzyp7uWhuUGJ78tXIIlzrV3xiDAvDN/o6FcqRmHKEtj/aH9fdIk86CoCroGmkyXVKs/HhgVpz/X8LlLzlwpgOE7WKym7n/cKAGkT9K2YNV7nZCWL9IIdWdW8TfdHhpxFTiscSmZwvFyoj1jmIUDhjE6LTEx6BSJM7g/2dFf5DyaMTj5o4if3hYpRP9WSCxJDYVBt4MFtvXD+ArJfKf3lul9L4JBt9CEOZo3jYMsJI3OTq0yYXChhFtpZVEH9NDH9v7LjWBS1vQL9SaK8hOVcFUdUINJH5ddn02kM95V8FesJXFlQatLDHis8LMur5/09lSTqsHAA0j7nlpod81pqgzz1BqOE40I4nSd//orQPmFCFWBAHVhvLDESj6TH3aG+8dOo7TLwWtQOlXRSCjZWMdsemxzC7K9xuBCz0MBjshnSiqUeRtKYWLp4/aW/USwRfoxx0II+jm2RY0bmYhcMJWhhH9xhgKnnrT0= ceph-9288ff44-bff5-11ee-95b3-87774f69a715 2024-01-31T05:02:00.506 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.711+0000 7f1e36bdc700 1 Processor -- start 2024-01-31T05:02:00.506 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.711+0000 7f1e36bdc700 1 -- start start 2024-01-31T05:02:00.506 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.711+0000 7f1e36bdc700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e30108670 0x7f1e30108a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:00.506 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.711+0000 7f1e36bdc700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e30109060 con 0x7f1e30108670 2024-01-31T05:02:00.506 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.711+0000 7f1e34978700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e30108670 0x7f1e30108a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:00.506 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.712+0000 7f1e34978700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e30108670 0x7f1e30108a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59324/0 (socket says 172.21.15.99:59324) 2024-01-31T05:02:00.506 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.712+0000 7f1e34978700 1 -- 172.21.15.99:0/3860957491 learned_addr learned my addr 172.21.15.99:0/3860957491 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:02:00.506 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.712+0000 7f1e34978700 1 -- 172.21.15.99:0/3860957491 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e301091a0 con 0x7f1e30108670 2024-01-31T05:02:00.506 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.712+0000 7f1e34978700 1 --2- 172.21.15.99:0/3860957491 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e30108670 0x7f1e30108a90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c0098a0 tx=0x7f1e2c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfcfa88ff54d69a server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:00.507 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.712+0000 7f1e277fe700 1 -- 172.21.15.99:0/3860957491 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1e2c004160 con 0x7f1e30108670 2024-01-31T05:02:00.507 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.712+0000 7f1e277fe700 1 -- 172.21.15.99:0/3860957491 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1e2c0042c0 con 0x7f1e30108670 2024-01-31T05:02:00.507 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.712+0000 7f1e277fe700 1 -- 172.21.15.99:0/3860957491 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1e2c011a00 con 0x7f1e30108670 2024-01-31T05:02:00.507 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.713+0000 7f1e36bdc700 1 -- 172.21.15.99:0/3860957491 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e30108670 msgr2=0x7f1e30108a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:00.507 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.713+0000 7f1e36bdc700 1 --2- 172.21.15.99:0/3860957491 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e30108670 0x7f1e30108a90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c0098a0 tx=0x7f1e2c009bb0 comp rx=0 tx=0).stop 2024-01-31T05:02:00.507 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.713+0000 7f1e36bdc700 1 -- 172.21.15.99:0/3860957491 shutdown_connections 2024-01-31T05:02:00.507 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.713+0000 7f1e36bdc700 1 --2- 172.21.15.99:0/3860957491 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e30108670 0x7f1e30108a90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:00.507 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.713+0000 7f1e36bdc700 1 -- 172.21.15.99:0/3860957491 >> 172.21.15.99:0/3860957491 conn(0x7f1e30100d70 msgr2=0x7f1e30103190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:02:00.507 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.713+0000 7f1e36bdc700 1 -- 172.21.15.99:0/3860957491 shutdown_connections 2024-01-31T05:02:00.507 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.713+0000 7f1e36bdc700 1 -- 172.21.15.99:0/3860957491 wait complete. 2024-01-31T05:02:00.507 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.713+0000 7f1e36bdc700 1 Processor -- start 2024-01-31T05:02:00.507 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.713+0000 7f1e36bdc700 1 -- start start 2024-01-31T05:02:00.507 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.714+0000 7f1e36bdc700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e30108670 0x7f1e3019ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:00.508 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.714+0000 7f1e36bdc700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3019b320 con 0x7f1e30108670 2024-01-31T05:02:00.508 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.714+0000 7f1e34978700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e30108670 0x7f1e3019ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:00.508 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.714+0000 7f1e34978700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e30108670 0x7f1e3019ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59328/0 (socket says 172.21.15.99:59328) 2024-01-31T05:02:00.508 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.714+0000 7f1e34978700 1 -- 172.21.15.99:0/105842572 learned_addr learned my addr 172.21.15.99:0/105842572 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:02:00.508 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.714+0000 7f1e34978700 1 -- 172.21.15.99:0/105842572 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e2c009550 con 0x7f1e30108670 2024-01-31T05:02:00.508 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.714+0000 7f1e34978700 1 --2- 172.21.15.99:0/105842572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e30108670 0x7f1e3019ade0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c009fb0 tx=0x7f1e2c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:00.508 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.714+0000 7f1e25ffb700 1 -- 172.21.15.99:0/105842572 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1e2c003a40 con 0x7f1e30108670 2024-01-31T05:02:00.508 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.714+0000 7f1e25ffb700 1 -- 172.21.15.99:0/105842572 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1e2c003ba0 con 0x7f1e30108670 2024-01-31T05:02:00.508 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.714+0000 7f1e36bdc700 1 -- 172.21.15.99:0/105842572 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e3019b520 con 0x7f1e30108670 2024-01-31T05:02:00.508 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.714+0000 7f1e25ffb700 1 -- 172.21.15.99:0/105842572 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1e2c01a750 con 0x7f1e30108670 2024-01-31T05:02:00.508 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.714+0000 7f1e36bdc700 1 -- 172.21.15.99:0/105842572 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e3019b9c0 con 0x7f1e30108670 2024-01-31T05:02:00.508 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.715+0000 7f1e25ffb700 1 -- 172.21.15.99:0/105842572 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 8) v1 ==== 45641+0+0 (secure 0 0 0) 0x7f1e2c024b60 con 0x7f1e30108670 2024-01-31T05:02:00.508 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.715+0000 7f1e36bdc700 1 -- 172.21.15.99:0/105842572 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e30105d10 con 0x7f1e30108670 2024-01-31T05:02:00.509 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.715+0000 7f1e25ffb700 1 --2- 172.21.15.99:0/105842572 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7f1e18038a40 0x7f1e1803af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:00.509 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.715+0000 7f1e25ffb700 1 -- 172.21.15.99:0/105842572 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f1e2c04ca40 con 0x7f1e30108670 2024-01-31T05:02:00.509 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.715+0000 7f1e27fff700 1 --2- 172.21.15.99:0/105842572 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7f1e18038a40 0x7f1e1803af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:00.509 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.716+0000 7f1e27fff700 1 --2- 172.21.15.99:0/105842572 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7f1e18038a40 0x7f1e1803af00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1e20006fd0 tx=0x7f1e20006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:00.509 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.720+0000 7f1e25ffb700 1 -- 172.21.15.99:0/105842572 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f1e2c024430 con 0x7f1e30108670 2024-01-31T05:02:00.509 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.914+0000 7f1e36bdc700 1 -- 172.21.15.99:0/105842572 --> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e30101f50 con 0x7f1e18038a40 2024-01-31T05:02:00.509 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.914+0000 7f1e25ffb700 1 -- 172.21.15.99:0/105842572 <== mgr.14120 v2:172.21.15.99:6800/1993198206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f1e30101f50 con 0x7f1e18038a40 2024-01-31T05:02:00.509 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.916+0000 7f1e36bdc700 1 -- 172.21.15.99:0/105842572 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7f1e18038a40 msgr2=0x7f1e1803af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:00.509 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.916+0000 7f1e36bdc700 1 --2- 172.21.15.99:0/105842572 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7f1e18038a40 0x7f1e1803af00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1e20006fd0 tx=0x7f1e20006e40 comp rx=0 tx=0).stop 2024-01-31T05:02:00.509 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.917+0000 7f1e36bdc700 1 -- 172.21.15.99:0/105842572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e30108670 msgr2=0x7f1e3019ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:00.509 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.917+0000 7f1e36bdc700 1 --2- 172.21.15.99:0/105842572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e30108670 0x7f1e3019ade0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c009fb0 tx=0x7f1e2c011ad0 comp rx=0 tx=0).stop 2024-01-31T05:02:00.509 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.917+0000 7f1e36bdc700 1 -- 172.21.15.99:0/105842572 shutdown_connections 2024-01-31T05:02:00.509 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.917+0000 7f1e36bdc700 1 --2- 172.21.15.99:0/105842572 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7f1e18038a40 0x7f1e1803af00 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:00.510 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.917+0000 7f1e36bdc700 1 --2- 172.21.15.99:0/105842572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e30108670 0x7f1e3019ade0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:00.510 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.917+0000 7f1e36bdc700 1 -- 172.21.15.99:0/105842572 >> 172.21.15.99:0/105842572 conn(0x7f1e30100d70 msgr2=0x7f1e30101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:02:00.510 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.917+0000 7f1e36bdc700 1 -- 172.21.15.99:0/105842572 shutdown_connections 2024-01-31T05:02:00.510 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:01:59.917+0000 7f1e36bdc700 1 -- 172.21.15.99:0/105842572 wait complete. 2024-01-31T05:02:00.510 INFO:teuthology.orchestra.run.smithi099.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-01-31T05:02:00.510 INFO:teuthology.orchestra.run.smithi099.stdout:Adding key to root@localhost authorized_keys... 2024-01-31T05:02:00.510 INFO:teuthology.orchestra.run.smithi099.stdout:Adding host smithi099... 2024-01-31T05:02:00.747 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:00 smithi099 ceph-mon[31615]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:02:03.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:03 smithi099 ceph-mon[31615]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi099", "addr": "172.21.15.99", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:02:03.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:03 smithi099 ceph-mon[31615]: Deploying cephadm binary to smithi099 2024-01-31T05:02:05.905 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout Added host 'smithi099' with addr '172.21.15.99' 2024-01-31T05:02:05.905 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:00.926+0000 7f3933b41700 1 Processor -- start 2024-01-31T05:02:05.905 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:00.926+0000 7f3933b41700 1 -- start start 2024-01-31T05:02:05.905 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:00.926+0000 7f3933b41700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f392c107ba0 0x7f392c109f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:05.905 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:00.926+0000 7f3933b41700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392c07ae70 con 0x7f392c107ba0 2024-01-31T05:02:05.905 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:00.926+0000 7f39318dd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f392c107ba0 0x7f392c109f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:05.905 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:00.926+0000 7f39318dd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f392c107ba0 0x7f392c109f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59330/0 (socket says 172.21.15.99:59330) 2024-01-31T05:02:05.905 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:00.926+0000 7f39318dd700 1 -- 172.21.15.99:0/2686832871 learned_addr learned my addr 172.21.15.99:0/2686832871 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:02:05.905 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:00.926+0000 7f39318dd700 1 -- 172.21.15.99:0/2686832871 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392c10a4d0 con 0x7f392c107ba0 2024-01-31T05:02:05.905 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:00.926+0000 7f39318dd700 1 --2- 172.21.15.99:0/2686832871 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f392c107ba0 0x7f392c109f90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f39280098a0 tx=0x7f3928009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faa017e85e86b5ec server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:05.905 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:00.927+0000 7f39308db700 1 -- 172.21.15.99:0/2686832871 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3928004160 con 0x7f392c107ba0 2024-01-31T05:02:05.905 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:00.927+0000 7f39308db700 1 -- 172.21.15.99:0/2686832871 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f39280042c0 con 0x7f392c107ba0 2024-01-31T05:02:05.906 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:00.927+0000 7f39308db700 1 -- 172.21.15.99:0/2686832871 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3928011a00 con 0x7f392c107ba0 2024-01-31T05:02:05.906 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:00.927+0000 7f3933b41700 1 -- 172.21.15.99:0/2686832871 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f392c107ba0 msgr2=0x7f392c109f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:05.906 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:00.927+0000 7f3933b41700 1 --2- 172.21.15.99:0/2686832871 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f392c107ba0 0x7f392c109f90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f39280098a0 tx=0x7f3928009bb0 comp rx=0 tx=0).stop 2024-01-31T05:02:05.906 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:00.927+0000 7f3933b41700 1 -- 172.21.15.99:0/2686832871 shutdown_connections 2024-01-31T05:02:05.906 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:00.927+0000 7f3933b41700 1 --2- 172.21.15.99:0/2686832871 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f392c107ba0 0x7f392c109f90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:05.906 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:00.927+0000 7f3933b41700 1 -- 172.21.15.99:0/2686832871 >> 172.21.15.99:0/2686832871 conn(0x7f392c1015d0 msgr2=0x7f392c1039f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:02:05.906 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:00.927+0000 7f3933b41700 1 -- 172.21.15.99:0/2686832871 shutdown_connections 2024-01-31T05:02:05.906 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:00.927+0000 7f3933b41700 1 -- 172.21.15.99:0/2686832871 wait complete. 2024-01-31T05:02:05.906 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:00.928+0000 7f3933b41700 1 Processor -- start 2024-01-31T05:02:05.906 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:00.928+0000 7f3933b41700 1 -- start start 2024-01-31T05:02:05.906 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:00.928+0000 7f3933b41700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f392c107ba0 0x7f392c1073d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:05.906 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:00.928+0000 7f3933b41700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392c107910 con 0x7f392c107ba0 2024-01-31T05:02:05.906 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:00.928+0000 7f39318dd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f392c107ba0 0x7f392c1073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:05.907 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:00.928+0000 7f39318dd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f392c107ba0 0x7f392c1073d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59344/0 (socket says 172.21.15.99:59344) 2024-01-31T05:02:05.907 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:00.928+0000 7f39318dd700 1 -- 172.21.15.99:0/4222797278 learned_addr learned my addr 172.21.15.99:0/4222797278 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:02:05.907 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:00.928+0000 7f39318dd700 1 -- 172.21.15.99:0/4222797278 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3928009550 con 0x7f392c107ba0 2024-01-31T05:02:05.907 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:00.929+0000 7f39318dd700 1 --2- 172.21.15.99:0/4222797278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f392c107ba0 0x7f392c1073d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3928009130 tx=0x7f3928011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:05.907 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:00.929+0000 7f3922ffd700 1 -- 172.21.15.99:0/4222797278 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3928003b70 con 0x7f392c107ba0 2024-01-31T05:02:05.907 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:00.929+0000 7f3922ffd700 1 -- 172.21.15.99:0/4222797278 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3928003cd0 con 0x7f392c107ba0 2024-01-31T05:02:05.907 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:00.929+0000 7f3922ffd700 1 -- 172.21.15.99:0/4222797278 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f39280197d0 con 0x7f392c107ba0 2024-01-31T05:02:05.907 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:00.929+0000 7f3933b41700 1 -- 172.21.15.99:0/4222797278 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f392c105b50 con 0x7f392c107ba0 2024-01-31T05:02:05.907 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:00.929+0000 7f3933b41700 1 -- 172.21.15.99:0/4222797278 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f392c105ff0 con 0x7f392c107ba0 2024-01-31T05:02:05.907 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:00.930+0000 7f3922ffd700 1 -- 172.21.15.99:0/4222797278 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 8) v1 ==== 45641+0+0 (secure 0 0 0) 0x7f392801a430 con 0x7f392c107ba0 2024-01-31T05:02:05.907 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:00.930+0000 7f3933b41700 1 -- 172.21.15.99:0/4222797278 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f392c062e10 con 0x7f392c107ba0 2024-01-31T05:02:05.907 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:00.930+0000 7f3922ffd700 1 --2- 172.21.15.99:0/4222797278 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7f3918038a90 0x7f391803af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:05.907 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:00.930+0000 7f3922ffd700 1 -- 172.21.15.99:0/4222797278 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f392804cc50 con 0x7f392c107ba0 2024-01-31T05:02:05.907 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:00.930+0000 7f39310dc700 1 --2- 172.21.15.99:0/4222797278 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7f3918038a90 0x7f391803af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:05.908 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:00.930+0000 7f39310dc700 1 --2- 172.21.15.99:0/4222797278 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7f3918038a90 0x7f391803af50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f391c006fd0 tx=0x7f391c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:05.908 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:00.935+0000 7f3922ffd700 1 -- 172.21.15.99:0/4222797278 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f392802d9a0 con 0x7f392c107ba0 2024-01-31T05:02:05.908 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:01.129+0000 7f3933b41700 1 -- 172.21.15.99:0/4222797278 --> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi099", "addr": "172.21.15.99", "target": ["mon-mgr", ""]}) v1 -- 0x7f392c1065d0 con 0x7f3918038a90 2024-01-31T05:02:05.908 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:05.301+0000 7f3922ffd700 1 -- 172.21.15.99:0/4222797278 <== mgr.14120 v2:172.21.15.99:6800/1993198206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f392c1065d0 con 0x7f3918038a90 2024-01-31T05:02:05.908 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:05.304+0000 7f3933b41700 1 -- 172.21.15.99:0/4222797278 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7f3918038a90 msgr2=0x7f391803af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:05.908 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:05.304+0000 7f3933b41700 1 --2- 172.21.15.99:0/4222797278 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7f3918038a90 0x7f391803af50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f391c006fd0 tx=0x7f391c006e40 comp rx=0 tx=0).stop 2024-01-31T05:02:05.908 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:05.304+0000 7f3933b41700 1 -- 172.21.15.99:0/4222797278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f392c107ba0 msgr2=0x7f392c1073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:05.908 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:05.304+0000 7f3933b41700 1 --2- 172.21.15.99:0/4222797278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f392c107ba0 0x7f392c1073d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3928009130 tx=0x7f3928011ad0 comp rx=0 tx=0).stop 2024-01-31T05:02:05.908 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:05.304+0000 7f3933b41700 1 -- 172.21.15.99:0/4222797278 shutdown_connections 2024-01-31T05:02:05.908 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:05.304+0000 7f3933b41700 1 --2- 172.21.15.99:0/4222797278 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7f3918038a90 0x7f391803af50 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:05.908 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:05.304+0000 7f3933b41700 1 --2- 172.21.15.99:0/4222797278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f392c107ba0 0x7f392c1073d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:05.908 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:05.304+0000 7f3933b41700 1 -- 172.21.15.99:0/4222797278 >> 172.21.15.99:0/4222797278 conn(0x7f392c1015d0 msgr2=0x7f392c1020a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:02:05.908 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:05.304+0000 7f3933b41700 1 -- 172.21.15.99:0/4222797278 shutdown_connections 2024-01-31T05:02:05.909 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:05.304+0000 7f3933b41700 1 -- 172.21.15.99:0/4222797278 wait complete. 2024-01-31T05:02:05.909 INFO:teuthology.orchestra.run.smithi099.stdout:Deploying unmanaged mon service... 2024-01-31T05:02:06.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:06 smithi099 ceph-mon[31615]: from='mgr.14120 172.21.15.99:0/3446643773' entity='mgr.x' 2024-01-31T05:02:06.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:06 smithi099 ceph-mon[31615]: Added host smithi099 2024-01-31T05:02:06.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:06 smithi099 ceph-mon[31615]: from='mgr.14120 172.21.15.99:0/3446643773' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:02:07.080 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-01-31T05:02:07.081 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.361+0000 7fb0a985f700 1 Processor -- start 2024-01-31T05:02:07.081 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.361+0000 7fb0a985f700 1 -- start start 2024-01-31T05:02:07.081 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.361+0000 7fb0a985f700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0a41070d0 0x7fb0a41074f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:07.081 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.361+0000 7fb0a985f700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a4107a30 con 0x7fb0a41070d0 2024-01-31T05:02:07.081 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.361+0000 7fb0a2ffd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0a41070d0 0x7fb0a41074f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:07.081 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.362+0000 7fb0a2ffd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0a41070d0 0x7fb0a41074f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54598/0 (socket says 172.21.15.99:54598) 2024-01-31T05:02:07.081 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.362+0000 7fb0a2ffd700 1 -- 172.21.15.99:0/2007403277 learned_addr learned my addr 172.21.15.99:0/2007403277 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:02:07.081 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.362+0000 7fb0a2ffd700 1 -- 172.21.15.99:0/2007403277 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a4107b70 con 0x7fb0a41070d0 2024-01-31T05:02:07.081 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.362+0000 7fb0a2ffd700 1 --2- 172.21.15.99:0/2007403277 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0a41070d0 0x7fb0a41074f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb0940098a0 tx=0x7fb094009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2c2b781b0340aab server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:07.081 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.362+0000 7fb0a27fc700 1 -- 172.21.15.99:0/2007403277 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb094004160 con 0x7fb0a41070d0 2024-01-31T05:02:07.081 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.362+0000 7fb0a27fc700 1 -- 172.21.15.99:0/2007403277 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb0940042c0 con 0x7fb0a41070d0 2024-01-31T05:02:07.082 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.362+0000 7fb0a27fc700 1 -- 172.21.15.99:0/2007403277 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb094011a00 con 0x7fb0a41070d0 2024-01-31T05:02:07.082 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.363+0000 7fb0a985f700 1 -- 172.21.15.99:0/2007403277 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0a41070d0 msgr2=0x7fb0a41074f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:07.082 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.363+0000 7fb0a985f700 1 --2- 172.21.15.99:0/2007403277 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0a41070d0 0x7fb0a41074f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb0940098a0 tx=0x7fb094009bb0 comp rx=0 tx=0).stop 2024-01-31T05:02:07.082 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.363+0000 7fb0a985f700 1 -- 172.21.15.99:0/2007403277 shutdown_connections 2024-01-31T05:02:07.082 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.363+0000 7fb0a985f700 1 --2- 172.21.15.99:0/2007403277 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0a41070d0 0x7fb0a41074f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:07.082 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.363+0000 7fb0a985f700 1 -- 172.21.15.99:0/2007403277 >> 172.21.15.99:0/2007403277 conn(0x7fb0a4102750 msgr2=0x7fb0a4104b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:02:07.082 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.363+0000 7fb0a985f700 1 -- 172.21.15.99:0/2007403277 shutdown_connections 2024-01-31T05:02:07.082 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.363+0000 7fb0a985f700 1 -- 172.21.15.99:0/2007403277 wait complete. 2024-01-31T05:02:07.082 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.363+0000 7fb0a985f700 1 Processor -- start 2024-01-31T05:02:07.082 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.363+0000 7fb0a985f700 1 -- start start 2024-01-31T05:02:07.082 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.364+0000 7fb0a985f700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0a41070d0 0x7fb0a419ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:07.082 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.364+0000 7fb0a985f700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a419b2e0 con 0x7fb0a41070d0 2024-01-31T05:02:07.082 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.364+0000 7fb0a2ffd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0a41070d0 0x7fb0a419ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:07.083 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.364+0000 7fb0a2ffd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0a41070d0 0x7fb0a419ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54612/0 (socket says 172.21.15.99:54612) 2024-01-31T05:02:07.083 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.364+0000 7fb0a2ffd700 1 -- 172.21.15.99:0/2967263819 learned_addr learned my addr 172.21.15.99:0/2967263819 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:02:07.083 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.364+0000 7fb0a2ffd700 1 -- 172.21.15.99:0/2967263819 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb094009550 con 0x7fb0a41070d0 2024-01-31T05:02:07.083 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.364+0000 7fb0a2ffd700 1 --2- 172.21.15.99:0/2967263819 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0a41070d0 0x7fb0a419ada0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb094009130 tx=0x7fb094011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:07.083 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.364+0000 7fb0a885d700 1 -- 172.21.15.99:0/2967263819 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb094003b70 con 0x7fb0a41070d0 2024-01-31T05:02:07.083 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.364+0000 7fb0a985f700 1 -- 172.21.15.99:0/2967263819 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0a419b4e0 con 0x7fb0a41070d0 2024-01-31T05:02:07.083 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.364+0000 7fb0a885d700 1 -- 172.21.15.99:0/2967263819 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb094003cd0 con 0x7fb0a41070d0 2024-01-31T05:02:07.083 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.364+0000 7fb0a885d700 1 -- 172.21.15.99:0/2967263819 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb0940197d0 con 0x7fb0a41070d0 2024-01-31T05:02:07.083 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.364+0000 7fb0a985f700 1 -- 172.21.15.99:0/2967263819 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0a419b980 con 0x7fb0a41070d0 2024-01-31T05:02:07.083 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.365+0000 7fb0a885d700 1 -- 172.21.15.99:0/2967263819 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 8) v1 ==== 45641+0+0 (secure 0 0 0) 0x7fb09401abb0 con 0x7fb0a41070d0 2024-01-31T05:02:07.083 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.365+0000 7fb0a985f700 1 -- 172.21.15.99:0/2967263819 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0a4108ef0 con 0x7fb0a41070d0 2024-01-31T05:02:07.083 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.365+0000 7fb0a885d700 1 --2- 172.21.15.99:0/2967263819 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7fb090038a40 0x7fb09003af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:07.083 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.365+0000 7fb0a885d700 1 -- 172.21.15.99:0/2967263819 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fb09404cd60 con 0x7fb0a41070d0 2024-01-31T05:02:07.084 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.365+0000 7fb09a7fc700 1 --2- 172.21.15.99:0/2967263819 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7fb090038a40 0x7fb09003af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:07.084 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.366+0000 7fb09a7fc700 1 --2- 172.21.15.99:0/2967263819 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7fb090038a40 0x7fb09003af00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb08c006fd0 tx=0x7fb08c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:07.084 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.370+0000 7fb0a885d700 1 -- 172.21.15.99:0/2967263819 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fb09401a430 con 0x7fb0a41070d0 2024-01-31T05:02:07.084 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.578+0000 7fb0a985f700 1 -- 172.21.15.99:0/2967263819 --> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fb0a4103930 con 0x7fb090038a40 2024-01-31T05:02:07.084 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.586+0000 7fb0a885d700 1 -- 172.21.15.99:0/2967263819 <== mgr.14120 v2:172.21.15.99:6800/1993198206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fb0a4103930 con 0x7fb090038a40 2024-01-31T05:02:07.084 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.588+0000 7fb0a985f700 1 -- 172.21.15.99:0/2967263819 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7fb090038a40 msgr2=0x7fb09003af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:07.084 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.588+0000 7fb0a985f700 1 --2- 172.21.15.99:0/2967263819 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7fb090038a40 0x7fb09003af00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb08c006fd0 tx=0x7fb08c006e40 comp rx=0 tx=0).stop 2024-01-31T05:02:07.084 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.588+0000 7fb0a985f700 1 -- 172.21.15.99:0/2967263819 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0a41070d0 msgr2=0x7fb0a419ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:07.084 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.588+0000 7fb0a985f700 1 --2- 172.21.15.99:0/2967263819 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0a41070d0 0x7fb0a419ada0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb094009130 tx=0x7fb094011ad0 comp rx=0 tx=0).stop 2024-01-31T05:02:07.084 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.588+0000 7fb0a985f700 1 -- 172.21.15.99:0/2967263819 shutdown_connections 2024-01-31T05:02:07.084 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.588+0000 7fb0a985f700 1 --2- 172.21.15.99:0/2967263819 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7fb090038a40 0x7fb09003af00 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:07.084 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.588+0000 7fb0a985f700 1 --2- 172.21.15.99:0/2967263819 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0a41070d0 0x7fb0a419ada0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:07.084 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.588+0000 7fb0a985f700 1 -- 172.21.15.99:0/2967263819 >> 172.21.15.99:0/2967263819 conn(0x7fb0a4102750 msgr2=0x7fb0a4103220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:02:07.085 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.588+0000 7fb0a985f700 1 -- 172.21.15.99:0/2967263819 shutdown_connections 2024-01-31T05:02:07.085 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:06.588+0000 7fb0a985f700 1 -- 172.21.15.99:0/2967263819 wait complete. 2024-01-31T05:02:07.085 INFO:teuthology.orchestra.run.smithi099.stdout:Deploying unmanaged mgr service... 2024-01-31T05:02:07.739 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:07 smithi099 ceph-mon[31615]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:02:07.739 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:07 smithi099 ceph-mon[31615]: Saving service mon spec with placement count:5 2024-01-31T05:02:07.739 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:07 smithi099 ceph-mon[31615]: from='mgr.14120 172.21.15.99:0/3446643773' entity='mgr.x' 2024-01-31T05:02:09.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:08 smithi099 ceph-mon[31615]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:02:09.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:08 smithi099 ceph-mon[31615]: Saving service mgr spec with placement count:2 2024-01-31T05:02:09.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:08 smithi099 ceph-mon[31615]: from='mgr.14120 172.21.15.99:0/3446643773' entity='mgr.x' 2024-01-31T05:02:09.126 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-01-31T05:02:09.126 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.501+0000 7fe08784e700 1 Processor -- start 2024-01-31T05:02:09.126 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.501+0000 7fe08784e700 1 -- start start 2024-01-31T05:02:09.126 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.501+0000 7fe08784e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe080105720 0x7fe080105b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:09.127 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.501+0000 7fe08784e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe080106110 con 0x7fe080105720 2024-01-31T05:02:09.127 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.501+0000 7fe0855ea700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe080105720 0x7fe080105b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:09.127 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.501+0000 7fe0855ea700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe080105720 0x7fe080105b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54622/0 (socket says 172.21.15.99:54622) 2024-01-31T05:02:09.127 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.501+0000 7fe0855ea700 1 -- 172.21.15.99:0/177847656 learned_addr learned my addr 172.21.15.99:0/177847656 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:02:09.127 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.502+0000 7fe0855ea700 1 -- 172.21.15.99:0/177847656 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe080106920 con 0x7fe080105720 2024-01-31T05:02:09.127 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.502+0000 7fe0855ea700 1 --2- 172.21.15.99:0/177847656 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe080105720 0x7fe080105b40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe07c00aa40 tx=0x7fe07c00ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=602a0a31cf5ff1b1 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:09.127 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.502+0000 7fe077fff700 1 -- 172.21.15.99:0/177847656 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe07c004160 con 0x7fe080105720 2024-01-31T05:02:09.127 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.502+0000 7fe077fff700 1 -- 172.21.15.99:0/177847656 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe07c00cd90 con 0x7fe080105720 2024-01-31T05:02:09.127 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.502+0000 7fe077fff700 1 -- 172.21.15.99:0/177847656 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe07c003c80 con 0x7fe080105720 2024-01-31T05:02:09.127 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.503+0000 7fe08784e700 1 -- 172.21.15.99:0/177847656 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe080105720 msgr2=0x7fe080105b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:09.127 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.503+0000 7fe08784e700 1 --2- 172.21.15.99:0/177847656 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe080105720 0x7fe080105b40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe07c00aa40 tx=0x7fe07c00ad50 comp rx=0 tx=0).stop 2024-01-31T05:02:09.127 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.503+0000 7fe08784e700 1 -- 172.21.15.99:0/177847656 shutdown_connections 2024-01-31T05:02:09.127 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.503+0000 7fe08784e700 1 --2- 172.21.15.99:0/177847656 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe080105720 0x7fe080105b40 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:09.127 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.503+0000 7fe08784e700 1 -- 172.21.15.99:0/177847656 >> 172.21.15.99:0/177847656 conn(0x7fe080100da0 msgr2=0x7fe0801031c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:02:09.128 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.503+0000 7fe08784e700 1 -- 172.21.15.99:0/177847656 shutdown_connections 2024-01-31T05:02:09.128 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.503+0000 7fe08784e700 1 -- 172.21.15.99:0/177847656 wait complete. 2024-01-31T05:02:09.128 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.503+0000 7fe08784e700 1 Processor -- start 2024-01-31T05:02:09.128 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.503+0000 7fe08784e700 1 -- start start 2024-01-31T05:02:09.128 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.503+0000 7fe08784e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe080105720 0x7fe08019ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:09.128 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.503+0000 7fe08784e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08019b370 con 0x7fe080105720 2024-01-31T05:02:09.128 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.503+0000 7fe0855ea700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe080105720 0x7fe08019ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:09.128 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.503+0000 7fe0855ea700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe080105720 0x7fe08019ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54630/0 (socket says 172.21.15.99:54630) 2024-01-31T05:02:09.128 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.503+0000 7fe0855ea700 1 -- 172.21.15.99:0/3988861151 learned_addr learned my addr 172.21.15.99:0/3988861151 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:02:09.128 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.504+0000 7fe0855ea700 1 -- 172.21.15.99:0/3988861151 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe07c00a6f0 con 0x7fe080105720 2024-01-31T05:02:09.128 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.504+0000 7fe0855ea700 1 --2- 172.21.15.99:0/3988861151 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe080105720 0x7fe08019ae30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe07c004170 tx=0x7fe07c004250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:09.128 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.504+0000 7fe0767fc700 1 -- 172.21.15.99:0/3988861151 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe07c010600 con 0x7fe080105720 2024-01-31T05:02:09.128 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.504+0000 7fe0767fc700 1 -- 172.21.15.99:0/3988861151 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe07c010c00 con 0x7fe080105720 2024-01-31T05:02:09.129 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.504+0000 7fe08784e700 1 -- 172.21.15.99:0/3988861151 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe08019b570 con 0x7fe080105720 2024-01-31T05:02:09.129 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.504+0000 7fe08784e700 1 -- 172.21.15.99:0/3988861151 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe08019ba10 con 0x7fe080105720 2024-01-31T05:02:09.129 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.504+0000 7fe0767fc700 1 -- 172.21.15.99:0/3988861151 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe07c020990 con 0x7fe080105720 2024-01-31T05:02:09.129 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.505+0000 7fe0767fc700 1 -- 172.21.15.99:0/3988861151 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 8) v1 ==== 45641+0+0 (secure 0 0 0) 0x7fe07c02a440 con 0x7fe080105720 2024-01-31T05:02:09.129 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.505+0000 7fe08784e700 1 -- 172.21.15.99:0/3988861151 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe080192940 con 0x7fe080105720 2024-01-31T05:02:09.129 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.505+0000 7fe0767fc700 1 --2- 172.21.15.99:0/3988861151 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7fe06c038a40 0x7fe06c03af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:09.129 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.505+0000 7fe0767fc700 1 -- 172.21.15.99:0/3988861151 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fe07c04c8e0 con 0x7fe080105720 2024-01-31T05:02:09.129 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.505+0000 7fe084de9700 1 --2- 172.21.15.99:0/3988861151 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7fe06c038a40 0x7fe06c03af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:09.129 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.505+0000 7fe084de9700 1 --2- 172.21.15.99:0/3988861151 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7fe06c038a40 0x7fe06c03af00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe070006fd0 tx=0x7fe070006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:09.129 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.510+0000 7fe0767fc700 1 -- 172.21.15.99:0/3988861151 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fe07c028570 con 0x7fe080105720 2024-01-31T05:02:09.129 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.719+0000 7fe08784e700 1 -- 172.21.15.99:0/3988861151 --> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fe08002d6a0 con 0x7fe06c038a40 2024-01-31T05:02:09.129 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.726+0000 7fe0767fc700 1 -- 172.21.15.99:0/3988861151 <== mgr.14120 v2:172.21.15.99:6800/1993198206 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fe08002d6a0 con 0x7fe06c038a40 2024-01-31T05:02:09.129 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.729+0000 7fe08784e700 1 -- 172.21.15.99:0/3988861151 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7fe06c038a40 msgr2=0x7fe06c03af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:09.129 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.729+0000 7fe08784e700 1 --2- 172.21.15.99:0/3988861151 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7fe06c038a40 0x7fe06c03af00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe070006fd0 tx=0x7fe070006e40 comp rx=0 tx=0).stop 2024-01-31T05:02:09.130 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.729+0000 7fe08784e700 1 -- 172.21.15.99:0/3988861151 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe080105720 msgr2=0x7fe08019ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:09.130 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.729+0000 7fe08784e700 1 --2- 172.21.15.99:0/3988861151 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe080105720 0x7fe08019ae30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe07c004170 tx=0x7fe07c004250 comp rx=0 tx=0).stop 2024-01-31T05:02:09.130 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.729+0000 7fe08784e700 1 -- 172.21.15.99:0/3988861151 shutdown_connections 2024-01-31T05:02:09.130 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.729+0000 7fe08784e700 1 --2- 172.21.15.99:0/3988861151 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7fe06c038a40 0x7fe06c03af00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:09.130 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.729+0000 7fe08784e700 1 --2- 172.21.15.99:0/3988861151 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe080105720 0x7fe08019ae30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:09.130 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.729+0000 7fe08784e700 1 -- 172.21.15.99:0/3988861151 >> 172.21.15.99:0/3988861151 conn(0x7fe080100da0 msgr2=0x7fe08018fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:02:09.130 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.729+0000 7fe08784e700 1 -- 172.21.15.99:0/3988861151 shutdown_connections 2024-01-31T05:02:09.130 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:07.729+0000 7fe08784e700 1 -- 172.21.15.99:0/3988861151 wait complete. 2024-01-31T05:02:10.066 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:09 smithi099 ceph-mon[31615]: from='mgr.14120 172.21.15.99:0/3446643773' entity='mgr.x' 2024-01-31T05:02:10.067 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:09 smithi099 ceph-mon[31615]: from='mgr.14120 172.21.15.99:0/3446643773' entity='mgr.x' 2024-01-31T05:02:10.308 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.549+0000 7f92683e1700 1 Processor -- start 2024-01-31T05:02:10.308 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.549+0000 7f92683e1700 1 -- start start 2024-01-31T05:02:10.308 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.549+0000 7f92683e1700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9260105fe0 0x7f9260106400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:10.308 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.549+0000 7f92683e1700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92601069d0 con 0x7f9260105fe0 2024-01-31T05:02:10.308 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.549+0000 7f926617d700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9260105fe0 0x7f9260106400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:10.308 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.549+0000 7f926617d700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9260105fe0 0x7f9260106400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54644/0 (socket says 172.21.15.99:54644) 2024-01-31T05:02:10.308 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.549+0000 7f926617d700 1 -- 172.21.15.99:0/3799228821 learned_addr learned my addr 172.21.15.99:0/3799228821 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:02:10.308 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.550+0000 7f926617d700 1 -- 172.21.15.99:0/3799228821 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92601071e0 con 0x7f9260105fe0 2024-01-31T05:02:10.308 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.550+0000 7f926617d700 1 --2- 172.21.15.99:0/3799228821 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9260105fe0 0x7f9260106400 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f92580098a0 tx=0x7f9258009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3319c14af35bf865 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:10.308 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.550+0000 7f926517b700 1 -- 172.21.15.99:0/3799228821 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9258004160 con 0x7f9260105fe0 2024-01-31T05:02:10.308 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.550+0000 7f926517b700 1 -- 172.21.15.99:0/3799228821 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f92580042c0 con 0x7f9260105fe0 2024-01-31T05:02:10.308 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.550+0000 7f926517b700 1 -- 172.21.15.99:0/3799228821 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92580119b0 con 0x7f9260105fe0 2024-01-31T05:02:10.309 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.550+0000 7f92683e1700 1 -- 172.21.15.99:0/3799228821 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9260105fe0 msgr2=0x7f9260106400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:10.309 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.550+0000 7f92683e1700 1 --2- 172.21.15.99:0/3799228821 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9260105fe0 0x7f9260106400 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f92580098a0 tx=0x7f9258009bb0 comp rx=0 tx=0).stop 2024-01-31T05:02:10.309 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.551+0000 7f92683e1700 1 -- 172.21.15.99:0/3799228821 shutdown_connections 2024-01-31T05:02:10.309 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.551+0000 7f92683e1700 1 --2- 172.21.15.99:0/3799228821 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9260105fe0 0x7f9260106400 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:10.309 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.551+0000 7f92683e1700 1 -- 172.21.15.99:0/3799228821 >> 172.21.15.99:0/3799228821 conn(0x7f92601015e0 msgr2=0x7f9260103a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:02:10.309 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.551+0000 7f92683e1700 1 -- 172.21.15.99:0/3799228821 shutdown_connections 2024-01-31T05:02:10.309 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.551+0000 7f92683e1700 1 -- 172.21.15.99:0/3799228821 wait complete. 2024-01-31T05:02:10.309 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.551+0000 7f92683e1700 1 Processor -- start 2024-01-31T05:02:10.309 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.551+0000 7f92683e1700 1 -- start start 2024-01-31T05:02:10.309 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.551+0000 7f92683e1700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9260105fe0 0x7f9260199da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:10.309 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.551+0000 7f92683e1700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926019a2e0 con 0x7f9260105fe0 2024-01-31T05:02:10.309 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.552+0000 7f926617d700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9260105fe0 0x7f9260199da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:10.309 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.552+0000 7f926617d700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9260105fe0 0x7f9260199da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54646/0 (socket says 172.21.15.99:54646) 2024-01-31T05:02:10.309 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.552+0000 7f926617d700 1 -- 172.21.15.99:0/2255462109 learned_addr learned my addr 172.21.15.99:0/2255462109 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:02:10.309 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.552+0000 7f926617d700 1 -- 172.21.15.99:0/2255462109 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9258009550 con 0x7f9260105fe0 2024-01-31T05:02:10.310 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.552+0000 7f926617d700 1 --2- 172.21.15.99:0/2255462109 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9260105fe0 0x7f9260199da0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9258006af0 tx=0x7f9258003980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:10.310 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.552+0000 7f92577fe700 1 -- 172.21.15.99:0/2255462109 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9258004570 con 0x7f9260105fe0 2024-01-31T05:02:10.310 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.552+0000 7f92577fe700 1 -- 172.21.15.99:0/2255462109 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9258020070 con 0x7f9260105fe0 2024-01-31T05:02:10.310 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.552+0000 7f92683e1700 1 -- 172.21.15.99:0/2255462109 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f926019a4e0 con 0x7f9260105fe0 2024-01-31T05:02:10.310 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.552+0000 7f92577fe700 1 -- 172.21.15.99:0/2255462109 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f925801c630 con 0x7f9260105fe0 2024-01-31T05:02:10.310 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.552+0000 7f92683e1700 1 -- 172.21.15.99:0/2255462109 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f926019a980 con 0x7f9260105fe0 2024-01-31T05:02:10.310 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.553+0000 7f92577fe700 1 -- 172.21.15.99:0/2255462109 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 8) v1 ==== 45641+0+0 (secure 0 0 0) 0x7f9258022030 con 0x7f9260105fe0 2024-01-31T05:02:10.310 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.553+0000 7f92683e1700 1 -- 172.21.15.99:0/2255462109 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f926010a410 con 0x7f9260105fe0 2024-01-31T05:02:10.310 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.553+0000 7f92577fe700 1 --2- 172.21.15.99:0/2255462109 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7f924c03ce50 0x7f924c03f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:10.310 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.553+0000 7f92577fe700 1 -- 172.21.15.99:0/2255462109 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f925804ca00 con 0x7f9260105fe0 2024-01-31T05:02:10.310 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.553+0000 7f926597c700 1 --2- 172.21.15.99:0/2255462109 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7f924c03ce50 0x7f924c03f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:10.310 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.554+0000 7f926597c700 1 --2- 172.21.15.99:0/2255462109 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7f924c03ce50 0x7f924c03f310 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9250006fd0 tx=0x7f9250006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:10.310 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.558+0000 7f92577fe700 1 -- 172.21.15.99:0/2255462109 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f9258003b60 con 0x7f9260105fe0 2024-01-31T05:02:10.310 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.758+0000 7f92683e1700 1 -- 172.21.15.99:0/2255462109 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f926007a230 con 0x7f9260105fe0 2024-01-31T05:02:10.310 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.763+0000 7f92577fe700 1 -- 172.21.15.99:0/2255462109 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f9258016260 con 0x7f9260105fe0 2024-01-31T05:02:10.310 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.766+0000 7f92683e1700 1 -- 172.21.15.99:0/2255462109 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7f924c03ce50 msgr2=0x7f924c03f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:10.311 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.766+0000 7f92683e1700 1 --2- 172.21.15.99:0/2255462109 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7f924c03ce50 0x7f924c03f310 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9250006fd0 tx=0x7f9250006e40 comp rx=0 tx=0).stop 2024-01-31T05:02:10.311 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.766+0000 7f92683e1700 1 -- 172.21.15.99:0/2255462109 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9260105fe0 msgr2=0x7f9260199da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:10.311 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.766+0000 7f92683e1700 1 --2- 172.21.15.99:0/2255462109 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9260105fe0 0x7f9260199da0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9258006af0 tx=0x7f9258003980 comp rx=0 tx=0).stop 2024-01-31T05:02:10.311 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.766+0000 7f92683e1700 1 -- 172.21.15.99:0/2255462109 shutdown_connections 2024-01-31T05:02:10.311 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.766+0000 7f92683e1700 1 --2- 172.21.15.99:0/2255462109 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7f924c03ce50 0x7f924c03f310 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:10.311 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.766+0000 7f92683e1700 1 --2- 172.21.15.99:0/2255462109 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9260105fe0 0x7f9260199da0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:10.311 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.766+0000 7f92683e1700 1 -- 172.21.15.99:0/2255462109 >> 172.21.15.99:0/2255462109 conn(0x7f92601015e0 msgr2=0x7f9260102150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:02:10.311 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.766+0000 7f92683e1700 1 -- 172.21.15.99:0/2255462109 shutdown_connections 2024-01-31T05:02:10.311 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:09.766+0000 7f92683e1700 1 -- 172.21.15.99:0/2255462109 wait complete. 2024-01-31T05:02:10.965 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:10 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/2255462109' entity='client.admin' 2024-01-31T05:02:12.052 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:11 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/2114806637' entity='client.admin' 2024-01-31T05:02:12.052 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:11 smithi099 ceph-mon[31615]: from='mgr.14120 172.21.15.99:0/3446643773' entity='mgr.x' 2024-01-31T05:02:12.059 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.742+0000 7feff92c4700 1 Processor -- start 2024-01-31T05:02:12.060 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.742+0000 7feff92c4700 1 -- start start 2024-01-31T05:02:12.060 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.743+0000 7feff92c4700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feff4107b90 0x7feff4109f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:12.060 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.743+0000 7feff92c4700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff407ae90 con 0x7feff4107b90 2024-01-31T05:02:12.060 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.743+0000 7feff2ffd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feff4107b90 0x7feff4109f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:12.060 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.743+0000 7feff2ffd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feff4107b90 0x7feff4109f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54650/0 (socket says 172.21.15.99:54650) 2024-01-31T05:02:12.060 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.743+0000 7feff2ffd700 1 -- 172.21.15.99:0/1129834217 learned_addr learned my addr 172.21.15.99:0/1129834217 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:02:12.060 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.743+0000 7feff2ffd700 1 -- 172.21.15.99:0/1129834217 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff410a4c0 con 0x7feff4107b90 2024-01-31T05:02:12.060 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.743+0000 7feff2ffd700 1 --2- 172.21.15.99:0/1129834217 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feff4107b90 0x7feff4109f80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fefe40098a0 tx=0x7fefe4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=905c4da5f66cc39b server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:12.060 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.743+0000 7feff1ffb700 1 -- 172.21.15.99:0/1129834217 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fefe4004160 con 0x7feff4107b90 2024-01-31T05:02:12.060 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.743+0000 7feff1ffb700 1 -- 172.21.15.99:0/1129834217 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fefe40042c0 con 0x7feff4107b90 2024-01-31T05:02:12.060 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.743+0000 7feff1ffb700 1 -- 172.21.15.99:0/1129834217 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fefe40119b0 con 0x7feff4107b90 2024-01-31T05:02:12.061 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.744+0000 7feff92c4700 1 -- 172.21.15.99:0/1129834217 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feff4107b90 msgr2=0x7feff4109f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:12.061 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.744+0000 7feff92c4700 1 --2- 172.21.15.99:0/1129834217 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feff4107b90 0x7feff4109f80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fefe40098a0 tx=0x7fefe4009bb0 comp rx=0 tx=0).stop 2024-01-31T05:02:12.061 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.744+0000 7feff92c4700 1 -- 172.21.15.99:0/1129834217 shutdown_connections 2024-01-31T05:02:12.061 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.744+0000 7feff92c4700 1 --2- 172.21.15.99:0/1129834217 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feff4107b90 0x7feff4109f80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:12.061 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.744+0000 7feff92c4700 1 -- 172.21.15.99:0/1129834217 >> 172.21.15.99:0/1129834217 conn(0x7feff41015c0 msgr2=0x7feff41039e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:02:12.061 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.744+0000 7feff92c4700 1 -- 172.21.15.99:0/1129834217 shutdown_connections 2024-01-31T05:02:12.061 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.744+0000 7feff92c4700 1 -- 172.21.15.99:0/1129834217 wait complete. 2024-01-31T05:02:12.061 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.745+0000 7feff92c4700 1 Processor -- start 2024-01-31T05:02:12.061 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.745+0000 7feff92c4700 1 -- start start 2024-01-31T05:02:12.061 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.745+0000 7feff92c4700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feff4107b90 0x7feff4107410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:12.061 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.745+0000 7feff92c4700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff4107950 con 0x7feff4107b90 2024-01-31T05:02:12.061 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.746+0000 7feff2ffd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feff4107b90 0x7feff4107410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:12.061 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.746+0000 7feff2ffd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feff4107b90 0x7feff4107410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54660/0 (socket says 172.21.15.99:54660) 2024-01-31T05:02:12.061 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.746+0000 7feff2ffd700 1 -- 172.21.15.99:0/2114806637 learned_addr learned my addr 172.21.15.99:0/2114806637 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:02:12.062 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.746+0000 7feff2ffd700 1 -- 172.21.15.99:0/2114806637 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe4009550 con 0x7feff4107b90 2024-01-31T05:02:12.062 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.746+0000 7feff2ffd700 1 --2- 172.21.15.99:0/2114806637 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feff4107b90 0x7feff4107410 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fefe4011980 tx=0x7fefe4011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:12.062 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.746+0000 7fefdbfff700 1 -- 172.21.15.99:0/2114806637 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fefe4003af0 con 0x7feff4107b90 2024-01-31T05:02:12.062 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.746+0000 7fefdbfff700 1 -- 172.21.15.99:0/2114806637 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fefe4003c50 con 0x7feff4107b90 2024-01-31T05:02:12.062 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.746+0000 7feff92c4700 1 -- 172.21.15.99:0/2114806637 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feff4105b40 con 0x7feff4107b90 2024-01-31T05:02:12.062 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.746+0000 7fefdbfff700 1 -- 172.21.15.99:0/2114806637 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fefe4019760 con 0x7feff4107b90 2024-01-31T05:02:12.062 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.746+0000 7feff92c4700 1 -- 172.21.15.99:0/2114806637 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feff4105fe0 con 0x7feff4107b90 2024-01-31T05:02:12.062 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.747+0000 7fefdbfff700 1 -- 172.21.15.99:0/2114806637 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 8) v1 ==== 45641+0+0 (secure 0 0 0) 0x7fefe40199a0 con 0x7feff4107b90 2024-01-31T05:02:12.062 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.747+0000 7feff92c4700 1 -- 172.21.15.99:0/2114806637 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feff410b2a0 con 0x7feff4107b90 2024-01-31T05:02:12.062 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.748+0000 7fefdbfff700 1 --2- 172.21.15.99:0/2114806637 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7fefdc038a40 0x7fefdc03af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:12.062 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.748+0000 7fefdbfff700 1 -- 172.21.15.99:0/2114806637 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fefe404ccf0 con 0x7feff4107b90 2024-01-31T05:02:12.062 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.748+0000 7feff27fc700 1 --2- 172.21.15.99:0/2114806637 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7fefdc038a40 0x7fefdc03af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:12.062 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.748+0000 7feff27fc700 1 --2- 172.21.15.99:0/2114806637 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7fefdc038a40 0x7fefdc03af00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fefe8006fd0 tx=0x7fefe8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:12.062 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.753+0000 7fefdbfff700 1 -- 172.21.15.99:0/2114806637 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fefe4051070 con 0x7feff4107b90 2024-01-31T05:02:12.063 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.966+0000 7feff92c4700 1 -- 172.21.15.99:0/2114806637 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7feff410b4b0 con 0x7feff4107b90 2024-01-31T05:02:12.063 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.969+0000 7fefdbfff700 1 -- 172.21.15.99:0/2114806637 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7fefe4018db0 con 0x7feff4107b90 2024-01-31T05:02:12.063 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.971+0000 7feff92c4700 1 -- 172.21.15.99:0/2114806637 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7fefdc038a40 msgr2=0x7fefdc03af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:12.063 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.971+0000 7feff92c4700 1 --2- 172.21.15.99:0/2114806637 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7fefdc038a40 0x7fefdc03af00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fefe8006fd0 tx=0x7fefe8006e40 comp rx=0 tx=0).stop 2024-01-31T05:02:12.063 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.971+0000 7feff92c4700 1 -- 172.21.15.99:0/2114806637 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feff4107b90 msgr2=0x7feff4107410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:12.063 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.971+0000 7feff92c4700 1 --2- 172.21.15.99:0/2114806637 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feff4107b90 0x7feff4107410 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fefe4011980 tx=0x7fefe4011a60 comp rx=0 tx=0).stop 2024-01-31T05:02:12.063 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.971+0000 7feff92c4700 1 -- 172.21.15.99:0/2114806637 shutdown_connections 2024-01-31T05:02:12.063 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.971+0000 7feff92c4700 1 --2- 172.21.15.99:0/2114806637 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7fefdc038a40 0x7fefdc03af00 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:12.063 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.971+0000 7feff92c4700 1 --2- 172.21.15.99:0/2114806637 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feff4107b90 0x7feff4107410 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:12.063 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.971+0000 7feff92c4700 1 -- 172.21.15.99:0/2114806637 >> 172.21.15.99:0/2114806637 conn(0x7feff41015c0 msgr2=0x7feff4102120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:02:12.063 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.971+0000 7feff92c4700 1 -- 172.21.15.99:0/2114806637 shutdown_connections 2024-01-31T05:02:12.063 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:10.971+0000 7feff92c4700 1 -- 172.21.15.99:0/2114806637 wait complete. 2024-01-31T05:02:12.063 INFO:teuthology.orchestra.run.smithi099.stdout:Enabling the dashboard module... 2024-01-31T05:02:14.047 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:13 smithi099 ceph-mon[31615]: from='mgr.14120 172.21.15.99:0/3446643773' entity='mgr.x' 2024-01-31T05:02:14.047 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:13 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/3712019609' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-01-31T05:02:14.047 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:02:13 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: ignoring --setuser ceph since I am not root 2024-01-31T05:02:14.047 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:02:13 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: ignoring --setgroup ceph since I am not root 2024-01-31T05:02:14.318 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:02:14 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:02:14.289+0000 7f49bf282200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-31T05:02:14.363 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:12.475+0000 7f56eb30f700 1 Processor -- start 2024-01-31T05:02:14.364 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:12.475+0000 7f56eb30f700 1 -- start start 2024-01-31T05:02:14.364 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:12.475+0000 7f56eb30f700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56e4107b50 0x7f56e4109f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:14.364 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:12.475+0000 7f56eb30f700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e407ae70 con 0x7f56e4107b50 2024-01-31T05:02:14.364 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:12.476+0000 7f56e90ab700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56e4107b50 0x7f56e4109f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:14.364 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:12.476+0000 7f56e90ab700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56e4107b50 0x7f56e4109f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54670/0 (socket says 172.21.15.99:54670) 2024-01-31T05:02:14.364 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:12.476+0000 7f56e90ab700 1 -- 172.21.15.99:0/4249952664 learned_addr learned my addr 172.21.15.99:0/4249952664 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:02:14.364 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:12.476+0000 7f56e90ab700 1 -- 172.21.15.99:0/4249952664 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e410a480 con 0x7f56e4107b50 2024-01-31T05:02:14.364 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:12.476+0000 7f56e90ab700 1 --2- 172.21.15.99:0/4249952664 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56e4107b50 0x7f56e4109f40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f56d40098a0 tx=0x7f56d4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8885369321715712 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:14.364 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:12.476+0000 7f56dbfff700 1 -- 172.21.15.99:0/4249952664 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56d4004160 con 0x7f56e4107b50 2024-01-31T05:02:14.364 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:12.476+0000 7f56dbfff700 1 -- 172.21.15.99:0/4249952664 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f56d40042c0 con 0x7f56e4107b50 2024-01-31T05:02:14.364 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:12.476+0000 7f56dbfff700 1 -- 172.21.15.99:0/4249952664 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56d40119b0 con 0x7f56e4107b50 2024-01-31T05:02:14.365 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:12.477+0000 7f56eb30f700 1 -- 172.21.15.99:0/4249952664 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56e4107b50 msgr2=0x7f56e4109f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:14.365 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:12.477+0000 7f56eb30f700 1 --2- 172.21.15.99:0/4249952664 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56e4107b50 0x7f56e4109f40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f56d40098a0 tx=0x7f56d4009bb0 comp rx=0 tx=0).stop 2024-01-31T05:02:14.365 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:12.477+0000 7f56eb30f700 1 -- 172.21.15.99:0/4249952664 shutdown_connections 2024-01-31T05:02:14.365 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:12.477+0000 7f56eb30f700 1 --2- 172.21.15.99:0/4249952664 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56e4107b50 0x7f56e4109f40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:14.365 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:12.477+0000 7f56eb30f700 1 -- 172.21.15.99:0/4249952664 >> 172.21.15.99:0/4249952664 conn(0x7f56e4101580 msgr2=0x7f56e41039a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:02:14.365 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:12.477+0000 7f56eb30f700 1 -- 172.21.15.99:0/4249952664 shutdown_connections 2024-01-31T05:02:14.365 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:12.477+0000 7f56eb30f700 1 -- 172.21.15.99:0/4249952664 wait complete. 2024-01-31T05:02:14.365 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:12.478+0000 7f56eb30f700 1 Processor -- start 2024-01-31T05:02:14.365 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:12.478+0000 7f56eb30f700 1 -- start start 2024-01-31T05:02:14.365 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:12.478+0000 7f56eb30f700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56e4107b50 0x7f56e419ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:14.365 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:12.478+0000 7f56eb30f700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e419b360 con 0x7f56e4107b50 2024-01-31T05:02:14.365 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:12.478+0000 7f56e90ab700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56e4107b50 0x7f56e419ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:14.365 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:12.478+0000 7f56e90ab700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56e4107b50 0x7f56e419ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54674/0 (socket says 172.21.15.99:54674) 2024-01-31T05:02:14.365 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:12.478+0000 7f56e90ab700 1 -- 172.21.15.99:0/3712019609 learned_addr learned my addr 172.21.15.99:0/3712019609 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:02:14.366 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:12.478+0000 7f56e90ab700 1 -- 172.21.15.99:0/3712019609 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d4009550 con 0x7f56e4107b50 2024-01-31T05:02:14.366 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:12.478+0000 7f56e90ab700 1 --2- 172.21.15.99:0/3712019609 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56e4107b50 0x7f56e419ae20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f56d4011670 tx=0x7f56d4011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:14.366 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:12.478+0000 7f56da7fc700 1 -- 172.21.15.99:0/3712019609 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56d4003b20 con 0x7f56e4107b50 2024-01-31T05:02:14.366 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:12.479+0000 7f56da7fc700 1 -- 172.21.15.99:0/3712019609 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f56d4003c80 con 0x7f56e4107b50 2024-01-31T05:02:14.366 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:12.479+0000 7f56eb30f700 1 -- 172.21.15.99:0/3712019609 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56e419b560 con 0x7f56e4107b50 2024-01-31T05:02:14.366 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:12.479+0000 7f56da7fc700 1 -- 172.21.15.99:0/3712019609 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56d4019770 con 0x7f56e4107b50 2024-01-31T05:02:14.366 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:12.479+0000 7f56eb30f700 1 -- 172.21.15.99:0/3712019609 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56e419b980 con 0x7f56e4107b50 2024-01-31T05:02:14.366 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:12.479+0000 7f56eb30f700 1 -- 172.21.15.99:0/3712019609 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56e410b260 con 0x7f56e4107b50 2024-01-31T05:02:14.366 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:12.480+0000 7f56da7fc700 1 -- 172.21.15.99:0/3712019609 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 8) v1 ==== 45641+0+0 (secure 0 0 0) 0x7f56d4019a30 con 0x7f56e4107b50 2024-01-31T05:02:14.366 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:12.480+0000 7f56da7fc700 1 --2- 172.21.15.99:0/3712019609 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7f56d003ce50 0x7f56d003f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:14.366 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:12.480+0000 7f56da7fc700 1 -- 172.21.15.99:0/3712019609 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f56d404cd00 con 0x7f56e4107b50 2024-01-31T05:02:14.366 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:12.480+0000 7f56e88aa700 1 --2- 172.21.15.99:0/3712019609 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7f56d003ce50 0x7f56d003f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:14.366 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:12.480+0000 7f56e88aa700 1 --2- 172.21.15.99:0/3712019609 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7f56d003ce50 0x7f56d003f310 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f56e0006fd0 tx=0x7f56e0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:14.367 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:12.485+0000 7f56da7fc700 1 -- 172.21.15.99:0/3712019609 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f56d4018db0 con 0x7f56e4107b50 2024-01-31T05:02:14.367 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:12.758+0000 7f56eb30f700 1 -- 172.21.15.99:0/3712019609 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f56e410b470 con 0x7f56e4107b50 2024-01-31T05:02:14.367 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:13.742+0000 7f56da7fc700 1 -- 172.21.15.99:0/3712019609 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f56d4018350 con 0x7f56e4107b50 2024-01-31T05:02:14.367 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:13.744+0000 7f56da7fc700 1 -- 172.21.15.99:0/3712019609 <== mon.0 v2:172.21.15.99:3300/0 8 ==== mgrmap(e 9) v1 ==== 45654+0+0 (secure 0 0 0) 0x7f56d400ed40 con 0x7f56e4107b50 2024-01-31T05:02:14.367 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:13.745+0000 7f56eb30f700 1 -- 172.21.15.99:0/3712019609 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7f56d003ce50 msgr2=0x7f56d003f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:14.367 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:13.745+0000 7f56eb30f700 1 --2- 172.21.15.99:0/3712019609 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7f56d003ce50 0x7f56d003f310 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f56e0006fd0 tx=0x7f56e0006e40 comp rx=0 tx=0).stop 2024-01-31T05:02:14.367 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:13.745+0000 7f56eb30f700 1 -- 172.21.15.99:0/3712019609 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56e4107b50 msgr2=0x7f56e419ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:14.367 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:13.745+0000 7f56eb30f700 1 --2- 172.21.15.99:0/3712019609 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56e4107b50 0x7f56e419ae20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f56d4011670 tx=0x7f56d4011a30 comp rx=0 tx=0).stop 2024-01-31T05:02:14.367 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:13.745+0000 7f56eb30f700 1 -- 172.21.15.99:0/3712019609 shutdown_connections 2024-01-31T05:02:14.367 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:13.745+0000 7f56eb30f700 1 --2- 172.21.15.99:0/3712019609 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7f56d003ce50 0x7f56d003f310 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:14.367 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:13.745+0000 7f56eb30f700 1 --2- 172.21.15.99:0/3712019609 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56e4107b50 0x7f56e419ae20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:14.367 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:13.745+0000 7f56eb30f700 1 -- 172.21.15.99:0/3712019609 >> 172.21.15.99:0/3712019609 conn(0x7f56e4101580 msgr2=0x7f56e41020e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:02:14.367 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:13.745+0000 7f56eb30f700 1 -- 172.21.15.99:0/3712019609 shutdown_connections 2024-01-31T05:02:14.367 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:13.745+0000 7f56eb30f700 1 -- 172.21.15.99:0/3712019609 wait complete. 2024-01-31T05:02:14.610 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:02:14 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:02:14.384+0000 7f49bf282200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-31T05:02:14.937 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:14 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/3712019609' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-01-31T05:02:14.937 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:14 smithi099 ceph-mon[31615]: mgrmap e9: x(active, since 20s) 2024-01-31T05:02:15.221 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:02:15 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:02:15.039+0000 7f49bf282200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-31T05:02:15.221 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:02:15 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:02:15.136+0000 7f49bf282200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-31T05:02:15.221 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:02:15 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:02:15.221+0000 7f49bf282200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-31T05:02:15.568 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:02:15 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:02:15.376+0000 7f49bf282200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-31T05:02:15.568 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:02:15 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:02:15.460+0000 7f49bf282200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-31T05:02:15.858 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout { 2024-01-31T05:02:15.858 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-01-31T05:02:15.858 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "available": true, 2024-01-31T05:02:15.858 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-01-31T05:02:15.858 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-01-31T05:02:15.858 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout } 2024-01-31T05:02:15.858 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:14.794+0000 7fef8845a700 1 Processor -- start 2024-01-31T05:02:15.858 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:14.794+0000 7fef8845a700 1 -- start start 2024-01-31T05:02:15.858 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:14.794+0000 7fef8845a700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef801086a0 0x7fef80108ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:15.858 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:14.794+0000 7fef8845a700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef80109090 con 0x7fef801086a0 2024-01-31T05:02:15.858 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:14.794+0000 7fef861f6700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef801086a0 0x7fef80108ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:15.858 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:14.794+0000 7fef861f6700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef801086a0 0x7fef80108ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54698/0 (socket says 172.21.15.99:54698) 2024-01-31T05:02:15.859 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:14.794+0000 7fef861f6700 1 -- 172.21.15.99:0/1057606932 learned_addr learned my addr 172.21.15.99:0/1057606932 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:02:15.859 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:14.795+0000 7fef861f6700 1 -- 172.21.15.99:0/1057606932 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef801091d0 con 0x7fef801086a0 2024-01-31T05:02:15.859 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:14.795+0000 7fef861f6700 1 --2- 172.21.15.99:0/1057606932 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef801086a0 0x7fef80108ac0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fef700098a0 tx=0x7fef70009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fd27e074958a3bd server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:15.859 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:14.795+0000 7fef851f4700 1 -- 172.21.15.99:0/1057606932 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef70004160 con 0x7fef801086a0 2024-01-31T05:02:15.859 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:14.795+0000 7fef851f4700 1 -- 172.21.15.99:0/1057606932 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fef700042c0 con 0x7fef801086a0 2024-01-31T05:02:15.859 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:14.795+0000 7fef851f4700 1 -- 172.21.15.99:0/1057606932 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef700119b0 con 0x7fef801086a0 2024-01-31T05:02:15.859 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:14.796+0000 7fef8845a700 1 -- 172.21.15.99:0/1057606932 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef801086a0 msgr2=0x7fef80108ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:15.859 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:14.796+0000 7fef8845a700 1 --2- 172.21.15.99:0/1057606932 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef801086a0 0x7fef80108ac0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fef700098a0 tx=0x7fef70009bb0 comp rx=0 tx=0).stop 2024-01-31T05:02:15.859 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:14.796+0000 7fef8845a700 1 -- 172.21.15.99:0/1057606932 shutdown_connections 2024-01-31T05:02:15.859 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:14.796+0000 7fef8845a700 1 --2- 172.21.15.99:0/1057606932 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef801086a0 0x7fef80108ac0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:15.859 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:14.796+0000 7fef8845a700 1 -- 172.21.15.99:0/1057606932 >> 172.21.15.99:0/1057606932 conn(0x7fef80100da0 msgr2=0x7fef801031c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:02:15.859 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:14.796+0000 7fef8845a700 1 -- 172.21.15.99:0/1057606932 shutdown_connections 2024-01-31T05:02:15.859 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:14.796+0000 7fef8845a700 1 -- 172.21.15.99:0/1057606932 wait complete. 2024-01-31T05:02:15.859 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:14.797+0000 7fef8845a700 1 Processor -- start 2024-01-31T05:02:15.860 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:14.797+0000 7fef8845a700 1 -- start start 2024-01-31T05:02:15.860 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:14.797+0000 7fef8845a700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef801086a0 0x7fef8019aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:15.860 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:14.797+0000 7fef8845a700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef8019b400 con 0x7fef801086a0 2024-01-31T05:02:15.860 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:14.797+0000 7fef861f6700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef801086a0 0x7fef8019aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:15.860 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:14.797+0000 7fef861f6700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef801086a0 0x7fef8019aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54708/0 (socket says 172.21.15.99:54708) 2024-01-31T05:02:15.860 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:14.797+0000 7fef861f6700 1 -- 172.21.15.99:0/163055577 learned_addr learned my addr 172.21.15.99:0/163055577 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:02:15.860 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:14.797+0000 7fef861f6700 1 -- 172.21.15.99:0/163055577 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef70009550 con 0x7fef801086a0 2024-01-31T05:02:15.860 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:14.797+0000 7fef861f6700 1 --2- 172.21.15.99:0/163055577 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef801086a0 0x7fef8019aec0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fef70011670 tx=0x7fef70011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:15.860 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:14.798+0000 7fef777fe700 1 -- 172.21.15.99:0/163055577 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef70003af0 con 0x7fef801086a0 2024-01-31T05:02:15.860 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:14.798+0000 7fef777fe700 1 -- 172.21.15.99:0/163055577 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fef70003c50 con 0x7fef801086a0 2024-01-31T05:02:15.860 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:14.798+0000 7fef8845a700 1 -- 172.21.15.99:0/163055577 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef8019b600 con 0x7fef801086a0 2024-01-31T05:02:15.860 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:14.798+0000 7fef8845a700 1 -- 172.21.15.99:0/163055577 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef8019baa0 con 0x7fef801086a0 2024-01-31T05:02:15.860 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:14.798+0000 7fef777fe700 1 -- 172.21.15.99:0/163055577 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef700196a0 con 0x7fef801086a0 2024-01-31T05:02:15.861 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:14.799+0000 7fef8845a700 1 -- 172.21.15.99:0/163055577 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef64005360 con 0x7fef801086a0 2024-01-31T05:02:15.861 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:14.799+0000 7fef777fe700 1 -- 172.21.15.99:0/163055577 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 9) v1 ==== 45654+0+0 (secure 0 0 0) 0x7fef70019970 con 0x7fef801086a0 2024-01-31T05:02:15.861 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:14.799+0000 7fef777fe700 1 --2- 172.21.15.99:0/163055577 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7fef6c038af0 0x7fef6c03afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:15.861 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:14.799+0000 7fef777fe700 1 -- 172.21.15.99:0/163055577 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fef7004ccb0 con 0x7fef801086a0 2024-01-31T05:02:15.861 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:14.799+0000 7fef859f5700 1 -- 172.21.15.99:0/163055577 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7fef6c038af0 msgr2=0x7fef6c03afb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.99:6800/1993198206 2024-01-31T05:02:15.861 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:14.799+0000 7fef859f5700 1 --2- 172.21.15.99:0/163055577 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7fef6c038af0 0x7fef6c03afb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-31T05:02:15.861 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:14.808+0000 7fef777fe700 1 -- 172.21.15.99:0/163055577 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fef70018db0 con 0x7fef801086a0 2024-01-31T05:02:15.861 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:15.000+0000 7fef859f5700 1 -- 172.21.15.99:0/163055577 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7fef6c038af0 msgr2=0x7fef6c03afb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.99:6800/1993198206 2024-01-31T05:02:15.861 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:15.000+0000 7fef859f5700 1 --2- 172.21.15.99:0/163055577 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7fef6c038af0 0x7fef6c03afb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-31T05:02:15.861 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:15.064+0000 7fef8845a700 1 -- 172.21.15.99:0/163055577 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fef64005e20 con 0x7fef801086a0 2024-01-31T05:02:15.861 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:15.065+0000 7fef777fe700 1 -- 172.21.15.99:0/163055577 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7fef70018350 con 0x7fef801086a0 2024-01-31T05:02:15.861 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:15.068+0000 7fef8845a700 1 -- 172.21.15.99:0/163055577 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7fef6c038af0 msgr2=0x7fef6c03afb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-31T05:02:15.861 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:15.068+0000 7fef8845a700 1 --2- 172.21.15.99:0/163055577 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7fef6c038af0 0x7fef6c03afb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:15.861 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:15.068+0000 7fef8845a700 1 -- 172.21.15.99:0/163055577 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef801086a0 msgr2=0x7fef8019aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:15.862 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:15.068+0000 7fef8845a700 1 --2- 172.21.15.99:0/163055577 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef801086a0 0x7fef8019aec0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fef70011670 tx=0x7fef70011a30 comp rx=0 tx=0).stop 2024-01-31T05:02:15.862 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:15.068+0000 7fef8845a700 1 -- 172.21.15.99:0/163055577 shutdown_connections 2024-01-31T05:02:15.862 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:15.068+0000 7fef8845a700 1 --2- 172.21.15.99:0/163055577 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7fef6c038af0 0x7fef6c03afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:15.862 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:15.068+0000 7fef8845a700 1 --2- 172.21.15.99:0/163055577 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef801086a0 0x7fef8019aec0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:15.862 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:15.068+0000 7fef8845a700 1 -- 172.21.15.99:0/163055577 >> 172.21.15.99:0/163055577 conn(0x7fef80100da0 msgr2=0x7fef80101910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:02:15.862 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:15.068+0000 7fef8845a700 1 -- 172.21.15.99:0/163055577 shutdown_connections 2024-01-31T05:02:15.862 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:15.068+0000 7fef8845a700 1 -- 172.21.15.99:0/163055577 wait complete. 2024-01-31T05:02:15.862 INFO:teuthology.orchestra.run.smithi099.stdout:Waiting for the mgr to restart... 2024-01-31T05:02:15.862 INFO:teuthology.orchestra.run.smithi099.stdout:Waiting for mgr epoch 9... 2024-01-31T05:02:15.913 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:15 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/163055577' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-01-31T05:02:15.913 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:02:15 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:02:15.640+0000 7f49bf282200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-01-31T05:02:15.913 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:02:15 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:02:15.823+0000 7f49bf282200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-31T05:02:15.913 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:02:15 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:02:15.914+0000 7f49bf282200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-31T05:02:16.193 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:02:16 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:02:16.008+0000 7f49bf282200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-31T05:02:16.194 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:02:16 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:02:16.098+0000 7f49bf282200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-31T05:02:17.282 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:02:17 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:02:17.150+0000 7f49bf282200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-31T05:02:17.282 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:02:17 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:02:17.283+0000 7f49bf282200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-31T05:02:17.571 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:02:17 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:02:17.478+0000 7f49bf282200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-31T05:02:18.068 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:02:17 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:02:17.706+0000 7f49bf282200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-31T05:02:18.068 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:02:17 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:02:17.887+0000 7f49bf282200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-31T05:02:18.344 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:02:18 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:02:18.073+0000 7f49bf282200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-31T05:02:18.818 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:02:18 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:02:18.345+0000 7f49bf282200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-31T05:02:18.818 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:02:18 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:02:18.432+0000 7f49bf282200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-31T05:02:19.304 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:02:18 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:02:18.847+0000 7f49bf282200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-31T05:02:20.068 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:02:19 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:02:19.636+0000 7f49bf282200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-31T05:02:20.496 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:02:20 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:02:20.197+0000 7f49bf282200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-31T05:02:20.496 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:02:20 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:02:20.294+0000 7f49bf282200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-31T05:02:20.496 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:02:20 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:02:20.496+0000 7f49bf282200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-31T05:02:20.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:20 smithi099 ceph-mon[31615]: Active manager daemon x restarted 2024-01-31T05:02:20.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:20 smithi099 ceph-mon[31615]: Activating manager daemon x 2024-01-31T05:02:20.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:20 smithi099 ceph-mon[31615]: osdmap e3: 0 total, 0 up, 0 in 2024-01-31T05:02:20.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:20 smithi099 ceph-mon[31615]: mgrmap e10: x(active, starting, since 0.00333285s) 2024-01-31T05:02:20.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:20 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-31T05:02:20.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:20 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-01-31T05:02:20.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:20 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-01-31T05:02:20.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:20 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-01-31T05:02:20.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:20 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-01-31T05:02:20.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:20 smithi099 ceph-mon[31615]: Manager daemon x is now available 2024-01-31T05:02:20.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:20 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:02:20.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:20 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:02:21.732 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:21 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-01-31T05:02:21.732 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:21 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-01-31T05:02:21.732 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:21 smithi099 ceph-mon[31615]: mgrmap e11: x(active, since 1.00555s) 2024-01-31T05:02:22.460 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout { 2024-01-31T05:02:22.460 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-01-31T05:02:22.460 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "initialized": true 2024-01-31T05:02:22.460 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout } 2024-01-31T05:02:22.460 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:16.295+0000 7feec8951700 1 Processor -- start 2024-01-31T05:02:22.460 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:16.295+0000 7feec8951700 1 -- start start 2024-01-31T05:02:22.461 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:16.295+0000 7feec8951700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feec4105f80 0x7feec41063a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:22.461 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:16.295+0000 7feec8951700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec4106970 con 0x7feec4105f80 2024-01-31T05:02:22.461 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:16.295+0000 7feec259c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feec4105f80 0x7feec41063a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:22.461 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:16.295+0000 7feec259c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feec4105f80 0x7feec41063a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58088/0 (socket says 172.21.15.99:58088) 2024-01-31T05:02:22.461 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:16.295+0000 7feec259c700 1 -- 172.21.15.99:0/2570967736 learned_addr learned my addr 172.21.15.99:0/2570967736 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:02:22.461 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:16.296+0000 7feec259c700 1 -- 172.21.15.99:0/2570967736 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec4107180 con 0x7feec4105f80 2024-01-31T05:02:22.461 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:16.296+0000 7feec259c700 1 --2- 172.21.15.99:0/2570967736 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feec4105f80 0x7feec41063a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feeb80098a0 tx=0x7feeb8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b3514c126f77268 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:22.461 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:16.296+0000 7feec159a700 1 -- 172.21.15.99:0/2570967736 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feeb8004160 con 0x7feec4105f80 2024-01-31T05:02:22.461 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:16.296+0000 7feec159a700 1 -- 172.21.15.99:0/2570967736 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feeb80042c0 con 0x7feec4105f80 2024-01-31T05:02:22.461 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:16.296+0000 7feec159a700 1 -- 172.21.15.99:0/2570967736 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feeb80119b0 con 0x7feec4105f80 2024-01-31T05:02:22.461 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:16.297+0000 7feec8951700 1 -- 172.21.15.99:0/2570967736 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feec4105f80 msgr2=0x7feec41063a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:22.461 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:16.297+0000 7feec8951700 1 --2- 172.21.15.99:0/2570967736 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feec4105f80 0x7feec41063a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feeb80098a0 tx=0x7feeb8009bb0 comp rx=0 tx=0).stop 2024-01-31T05:02:22.461 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:16.297+0000 7feec8951700 1 -- 172.21.15.99:0/2570967736 shutdown_connections 2024-01-31T05:02:22.461 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:16.297+0000 7feec8951700 1 --2- 172.21.15.99:0/2570967736 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feec4105f80 0x7feec41063a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:22.462 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:16.297+0000 7feec8951700 1 -- 172.21.15.99:0/2570967736 >> 172.21.15.99:0/2570967736 conn(0x7feec4101580 msgr2=0x7feec41039a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:02:22.462 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:16.297+0000 7feec8951700 1 -- 172.21.15.99:0/2570967736 shutdown_connections 2024-01-31T05:02:22.462 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:16.297+0000 7feec8951700 1 -- 172.21.15.99:0/2570967736 wait complete. 2024-01-31T05:02:22.462 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:16.297+0000 7feec8951700 1 Processor -- start 2024-01-31T05:02:22.462 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:16.298+0000 7feec8951700 1 -- start start 2024-01-31T05:02:22.462 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:16.298+0000 7feec8951700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feec4105f80 0x7feec419d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:22.462 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:16.298+0000 7feec8951700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec419d590 con 0x7feec4105f80 2024-01-31T05:02:22.462 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:16.298+0000 7feec259c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feec4105f80 0x7feec419d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:22.462 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:16.298+0000 7feec259c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feec4105f80 0x7feec419d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58098/0 (socket says 172.21.15.99:58098) 2024-01-31T05:02:22.462 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:16.298+0000 7feec259c700 1 -- 172.21.15.99:0/433054214 learned_addr learned my addr 172.21.15.99:0/433054214 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:02:22.462 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:16.298+0000 7feec259c700 1 -- 172.21.15.99:0/433054214 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb8009550 con 0x7feec4105f80 2024-01-31T05:02:22.462 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:16.298+0000 7feec259c700 1 --2- 172.21.15.99:0/433054214 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feec4105f80 0x7feec419d050 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7feeb8006af0 tx=0x7feeb8011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:22.462 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:16.298+0000 7feeb37fe700 1 -- 172.21.15.99:0/433054214 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feeb8003a40 con 0x7feec4105f80 2024-01-31T05:02:22.462 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:16.298+0000 7feeb37fe700 1 -- 172.21.15.99:0/433054214 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feeb8003ba0 con 0x7feec4105f80 2024-01-31T05:02:22.462 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:16.298+0000 7feec8951700 1 -- 172.21.15.99:0/433054214 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feec419d790 con 0x7feec4105f80 2024-01-31T05:02:22.462 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:16.299+0000 7feeb37fe700 1 -- 172.21.15.99:0/433054214 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feeb8019690 con 0x7feec4105f80 2024-01-31T05:02:22.463 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:16.299+0000 7feec8951700 1 -- 172.21.15.99:0/433054214 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec419dc30 con 0x7feec4105f80 2024-01-31T05:02:22.463 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:16.299+0000 7feeb37fe700 1 -- 172.21.15.99:0/433054214 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 9) v1 ==== 45654+0+0 (secure 0 0 0) 0x7feeb8019950 con 0x7feec4105f80 2024-01-31T05:02:22.463 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:16.300+0000 7feeb37fe700 1 --2- 172.21.15.99:0/433054214 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7feeac038a40 0x7feeac03af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:22.463 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:16.300+0000 7feeb37fe700 1 -- 172.21.15.99:0/433054214 --> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7feeac03b610 con 0x7feeac038a40 2024-01-31T05:02:22.463 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:16.300+0000 7feeb37fe700 1 -- 172.21.15.99:0/433054214 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7feeb804ca20 con 0x7feec4105f80 2024-01-31T05:02:22.463 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:16.300+0000 7feec1d9b700 1 -- 172.21.15.99:0/433054214 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7feeac038a40 msgr2=0x7feeac03af00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.99:6800/1993198206 2024-01-31T05:02:22.463 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:16.300+0000 7feec1d9b700 1 --2- 172.21.15.99:0/433054214 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7feeac038a40 0x7feeac03af00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-31T05:02:22.463 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:16.501+0000 7feec1d9b700 1 -- 172.21.15.99:0/433054214 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7feeac038a40 msgr2=0x7feeac03af00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.99:6800/1993198206 2024-01-31T05:02:22.463 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:16.501+0000 7feec1d9b700 1 --2- 172.21.15.99:0/433054214 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7feeac038a40 0x7feeac03af00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-31T05:02:22.463 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:16.902+0000 7feec1d9b700 1 -- 172.21.15.99:0/433054214 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7feeac038a40 msgr2=0x7feeac03af00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.99:6800/1993198206 2024-01-31T05:02:22.463 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:16.902+0000 7feec1d9b700 1 --2- 172.21.15.99:0/433054214 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7feeac038a40 0x7feeac03af00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-31T05:02:22.463 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:17.703+0000 7feec1d9b700 1 -- 172.21.15.99:0/433054214 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7feeac038a40 msgr2=0x7feeac03af00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.99:6800/1993198206 2024-01-31T05:02:22.463 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:17.703+0000 7feec1d9b700 1 --2- 172.21.15.99:0/433054214 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7feeac038a40 0x7feeac03af00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-31T05:02:22.463 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:19.304+0000 7feec1d9b700 1 -- 172.21.15.99:0/433054214 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7feeac038a40 msgr2=0x7feeac03af00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.99:6800/1993198206 2024-01-31T05:02:22.463 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:19.304+0000 7feec1d9b700 1 --2- 172.21.15.99:0/433054214 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7feeac038a40 0x7feeac03af00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-01-31T05:02:22.463 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:20.512+0000 7feeb37fe700 1 -- 172.21.15.99:0/433054214 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mgrmap(e 10) v1 ==== 45421+0+0 (secure 0 0 0) 0x7feeb8019cf0 con 0x7feec4105f80 2024-01-31T05:02:22.464 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:20.512+0000 7feeb37fe700 1 -- 172.21.15.99:0/433054214 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7feeac038a40 msgr2=0x7feeac03af00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-31T05:02:22.464 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:20.512+0000 7feeb37fe700 1 --2- 172.21.15.99:0/433054214 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7feeac038a40 0x7feeac03af00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:22.464 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:21.513+0000 7feeb37fe700 1 -- 172.21.15.99:0/433054214 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mgrmap(e 11) v1 ==== 45548+0+0 (secure 0 0 0) 0x7feeb8021d60 con 0x7feec4105f80 2024-01-31T05:02:22.464 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:21.513+0000 7feeb37fe700 1 --2- 172.21.15.99:0/433054214 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7feeac03c4b0 0x7feeac03e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:22.464 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:21.513+0000 7feeb37fe700 1 -- 172.21.15.99:0/433054214 --> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7feeac03b610 con 0x7feeac03c4b0 2024-01-31T05:02:22.464 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:21.514+0000 7feec1d9b700 1 --2- 172.21.15.99:0/433054214 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7feeac03c4b0 0x7feeac03e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:22.464 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:21.514+0000 7feec1d9b700 1 --2- 172.21.15.99:0/433054214 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7feeac03c4b0 0x7feeac03e8a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7feeb4003a10 tx=0x7feeb40092b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:22.464 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:21.515+0000 7feeb37fe700 1 -- 172.21.15.99:0/433054214 <== mgr.14152 v2:172.21.15.99:6800/3925720924 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7feeac03b610 con 0x7feeac03c4b0 2024-01-31T05:02:22.464 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:21.521+0000 7feec8951700 1 -- 172.21.15.99:0/433054214 --> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7feec4062e10 con 0x7feeac03c4b0 2024-01-31T05:02:22.464 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:21.522+0000 7feeb37fe700 1 -- 172.21.15.99:0/433054214 <== mgr.14152 v2:172.21.15.99:6800/3925720924 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7feec4062e10 con 0x7feeac03c4b0 2024-01-31T05:02:22.464 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:21.522+0000 7feec8951700 1 -- 172.21.15.99:0/433054214 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7feeac03c4b0 msgr2=0x7feeac03e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:22.464 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:21.522+0000 7feec8951700 1 --2- 172.21.15.99:0/433054214 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7feeac03c4b0 0x7feeac03e8a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7feeb4003a10 tx=0x7feeb40092b0 comp rx=0 tx=0).stop 2024-01-31T05:02:22.464 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:21.522+0000 7feec8951700 1 -- 172.21.15.99:0/433054214 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feec4105f80 msgr2=0x7feec419d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:22.464 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:21.522+0000 7feec8951700 1 --2- 172.21.15.99:0/433054214 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feec4105f80 0x7feec419d050 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7feeb8006af0 tx=0x7feeb8011a10 comp rx=0 tx=0).stop 2024-01-31T05:02:22.465 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:21.522+0000 7feec8951700 1 -- 172.21.15.99:0/433054214 shutdown_connections 2024-01-31T05:02:22.465 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:21.522+0000 7feec8951700 1 --2- 172.21.15.99:0/433054214 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7feeac03c4b0 0x7feeac03e8a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:22.465 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:21.522+0000 7feec8951700 1 --2- 172.21.15.99:0/433054214 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feec4105f80 0x7feec419d050 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:22.465 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:21.522+0000 7feec8951700 1 --2- 172.21.15.99:0/433054214 >> [v2:172.21.15.99:6800/1993198206,v1:172.21.15.99:6801/1993198206] conn(0x7feeac038a40 0x7feeac03af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:22.465 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:21.522+0000 7feec8951700 1 -- 172.21.15.99:0/433054214 >> 172.21.15.99:0/433054214 conn(0x7feec4101580 msgr2=0x7feec418f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:02:22.465 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:21.522+0000 7feec8951700 1 -- 172.21.15.99:0/433054214 shutdown_connections 2024-01-31T05:02:22.465 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:21.522+0000 7feec8951700 1 -- 172.21.15.99:0/433054214 wait complete. 2024-01-31T05:02:22.465 INFO:teuthology.orchestra.run.smithi099.stdout:mgr epoch 9 is available 2024-01-31T05:02:22.465 INFO:teuthology.orchestra.run.smithi099.stdout:Generating a dashboard self-signed certificate... 2024-01-31T05:02:22.727 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:22 smithi099 ceph-mon[31615]: [31/Jan/2024:05:02:21] ENGINE Bus STARTING 2024-01-31T05:02:22.727 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:22 smithi099 ceph-mon[31615]: [31/Jan/2024:05:02:21] ENGINE Serving on https://172.21.15.99:7150 2024-01-31T05:02:22.728 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:22 smithi099 ceph-mon[31615]: [31/Jan/2024:05:02:21] ENGINE Serving on http://172.21.15.99:8765 2024-01-31T05:02:22.728 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:22 smithi099 ceph-mon[31615]: [31/Jan/2024:05:02:21] ENGINE Bus STARTED 2024-01-31T05:02:22.728 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:22 smithi099 ceph-mon[31615]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-01-31T05:02:22.728 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:22 smithi099 ceph-mon[31615]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-01-31T05:02:22.728 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:22 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:02:23.848 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-01-31T05:02:23.848 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:22.937+0000 7f2a674af700 1 Processor -- start 2024-01-31T05:02:23.849 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:22.938+0000 7f2a674af700 1 -- start start 2024-01-31T05:02:23.849 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:22.938+0000 7f2a674af700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a601075a0 0x7f2a601079c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:23.849 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:22.938+0000 7f2a674af700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a60107f90 con 0x7f2a601075a0 2024-01-31T05:02:23.849 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:22.938+0000 7f2a6524b700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a601075a0 0x7f2a601079c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:23.849 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:22.938+0000 7f2a6524b700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a601075a0 0x7f2a601079c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58186/0 (socket says 172.21.15.99:58186) 2024-01-31T05:02:23.849 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:22.938+0000 7f2a6524b700 1 -- 172.21.15.99:0/1773616553 learned_addr learned my addr 172.21.15.99:0/1773616553 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:02:23.849 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:22.938+0000 7f2a6524b700 1 -- 172.21.15.99:0/1773616553 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a601080d0 con 0x7f2a601075a0 2024-01-31T05:02:23.849 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:22.939+0000 7f2a6524b700 1 --2- 172.21.15.99:0/1773616553 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a601075a0 0x7f2a601079c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c0098a0 tx=0x7f2a5c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d48b59c4bf54d15 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:23.849 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:22.939+0000 7f2a57fff700 1 -- 172.21.15.99:0/1773616553 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2a5c004160 con 0x7f2a601075a0 2024-01-31T05:02:23.849 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:22.939+0000 7f2a57fff700 1 -- 172.21.15.99:0/1773616553 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2a5c0042c0 con 0x7f2a601075a0 2024-01-31T05:02:23.849 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:22.939+0000 7f2a57fff700 1 -- 172.21.15.99:0/1773616553 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2a5c0119b0 con 0x7f2a601075a0 2024-01-31T05:02:23.849 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:22.940+0000 7f2a674af700 1 -- 172.21.15.99:0/1773616553 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a601075a0 msgr2=0x7f2a601079c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:23.849 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:22.940+0000 7f2a674af700 1 --2- 172.21.15.99:0/1773616553 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a601075a0 0x7f2a601079c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c0098a0 tx=0x7f2a5c009bb0 comp rx=0 tx=0).stop 2024-01-31T05:02:23.850 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:22.940+0000 7f2a674af700 1 -- 172.21.15.99:0/1773616553 shutdown_connections 2024-01-31T05:02:23.850 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:22.940+0000 7f2a674af700 1 --2- 172.21.15.99:0/1773616553 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a601075a0 0x7f2a601079c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:23.850 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:22.940+0000 7f2a674af700 1 -- 172.21.15.99:0/1773616553 >> 172.21.15.99:0/1773616553 conn(0x7f2a60100da0 msgr2=0x7f2a601031c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:02:23.850 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:22.940+0000 7f2a674af700 1 -- 172.21.15.99:0/1773616553 shutdown_connections 2024-01-31T05:02:23.850 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:22.940+0000 7f2a674af700 1 -- 172.21.15.99:0/1773616553 wait complete. 2024-01-31T05:02:23.850 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:22.940+0000 7f2a674af700 1 Processor -- start 2024-01-31T05:02:23.850 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:22.940+0000 7f2a674af700 1 -- start start 2024-01-31T05:02:23.850 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:22.941+0000 7f2a674af700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a601075a0 0x7f2a60199da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:23.850 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:22.941+0000 7f2a674af700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6019a2e0 con 0x7f2a601075a0 2024-01-31T05:02:23.850 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:22.941+0000 7f2a6524b700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a601075a0 0x7f2a60199da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:23.850 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:22.941+0000 7f2a6524b700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a601075a0 0x7f2a60199da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58198/0 (socket says 172.21.15.99:58198) 2024-01-31T05:02:23.850 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:22.941+0000 7f2a6524b700 1 -- 172.21.15.99:0/1435272174 learned_addr learned my addr 172.21.15.99:0/1435272174 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:02:23.850 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:22.941+0000 7f2a6524b700 1 -- 172.21.15.99:0/1435272174 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a5c009550 con 0x7f2a601075a0 2024-01-31T05:02:23.850 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:22.941+0000 7f2a6524b700 1 --2- 172.21.15.99:0/1435272174 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a601075a0 0x7f2a60199da0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c009fb0 tx=0x7f2a5c003980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:23.851 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:22.941+0000 7f2a567fc700 1 -- 172.21.15.99:0/1435272174 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2a5c004570 con 0x7f2a601075a0 2024-01-31T05:02:23.851 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:22.941+0000 7f2a674af700 1 -- 172.21.15.99:0/1435272174 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a6019a4e0 con 0x7f2a601075a0 2024-01-31T05:02:23.851 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:22.941+0000 7f2a567fc700 1 -- 172.21.15.99:0/1435272174 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2a5c020070 con 0x7f2a601075a0 2024-01-31T05:02:23.851 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:22.941+0000 7f2a567fc700 1 -- 172.21.15.99:0/1435272174 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2a5c01c5e0 con 0x7f2a601075a0 2024-01-31T05:02:23.851 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:22.941+0000 7f2a674af700 1 -- 172.21.15.99:0/1435272174 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a6019a980 con 0x7f2a601075a0 2024-01-31T05:02:23.851 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:22.942+0000 7f2a567fc700 1 -- 172.21.15.99:0/1435272174 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 11) v1 ==== 45548+0+0 (secure 0 0 0) 0x7f2a5c022030 con 0x7f2a601075a0 2024-01-31T05:02:23.851 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:22.942+0000 7f2a674af700 1 -- 172.21.15.99:0/1435272174 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a44005360 con 0x7f2a601075a0 2024-01-31T05:02:23.851 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:22.943+0000 7f2a567fc700 1 --2- 172.21.15.99:0/1435272174 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2a4c038970 0x7f2a4c03ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:23.851 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:22.943+0000 7f2a567fc700 1 -- 172.21.15.99:0/1435272174 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f2a5c04ee30 con 0x7f2a601075a0 2024-01-31T05:02:23.851 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:22.943+0000 7f2a64a4a700 1 --2- 172.21.15.99:0/1435272174 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2a4c038970 0x7f2a4c03ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:23.851 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:22.943+0000 7f2a64a4a700 1 --2- 172.21.15.99:0/1435272174 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2a4c038970 0x7f2a4c03ae30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2a5800ad30 tx=0x7f2a580093f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:23.851 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:22.948+0000 7f2a567fc700 1 -- 172.21.15.99:0/1435272174 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f2a5c024a20 con 0x7f2a601075a0 2024-01-31T05:02:23.851 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:23.131+0000 7f2a567fc700 1 -- 172.21.15.99:0/1435272174 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mgrmap(e 12) v1 ==== 45654+0+0 (secure 0 0 0) 0x7f2a5c01ccf0 con 0x7f2a601075a0 2024-01-31T05:02:23.851 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:23.149+0000 7f2a674af700 1 -- 172.21.15.99:0/1435272174 --> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a44000bf0 con 0x7f2a4c038970 2024-01-31T05:02:23.852 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:23.227+0000 7f2a567fc700 1 -- 172.21.15.99:0/1435272174 <== mgr.14152 v2:172.21.15.99:6800/3925720924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f2a44000bf0 con 0x7f2a4c038970 2024-01-31T05:02:23.852 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:23.229+0000 7f2a674af700 1 -- 172.21.15.99:0/1435272174 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2a4c038970 msgr2=0x7f2a4c03ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:23.852 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:23.229+0000 7f2a674af700 1 --2- 172.21.15.99:0/1435272174 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2a4c038970 0x7f2a4c03ae30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2a5800ad30 tx=0x7f2a580093f0 comp rx=0 tx=0).stop 2024-01-31T05:02:23.852 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:23.230+0000 7f2a674af700 1 -- 172.21.15.99:0/1435272174 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a601075a0 msgr2=0x7f2a60199da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:23.852 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:23.230+0000 7f2a674af700 1 --2- 172.21.15.99:0/1435272174 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a601075a0 0x7f2a60199da0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c009fb0 tx=0x7f2a5c003980 comp rx=0 tx=0).stop 2024-01-31T05:02:23.852 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:23.230+0000 7f2a674af700 1 -- 172.21.15.99:0/1435272174 shutdown_connections 2024-01-31T05:02:23.852 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:23.230+0000 7f2a674af700 1 --2- 172.21.15.99:0/1435272174 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2a4c038970 0x7f2a4c03ae30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:23.852 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:23.230+0000 7f2a674af700 1 --2- 172.21.15.99:0/1435272174 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a601075a0 0x7f2a60199da0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:23.852 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:23.230+0000 7f2a674af700 1 -- 172.21.15.99:0/1435272174 >> 172.21.15.99:0/1435272174 conn(0x7f2a60100da0 msgr2=0x7f2a60101920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:02:23.852 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:23.230+0000 7f2a674af700 1 -- 172.21.15.99:0/1435272174 shutdown_connections 2024-01-31T05:02:23.852 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:23.230+0000 7f2a674af700 1 -- 172.21.15.99:0/1435272174 wait complete. 2024-01-31T05:02:23.852 INFO:teuthology.orchestra.run.smithi099.stdout:Creating initial admin user... 2024-01-31T05:02:24.235 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:24 smithi099 ceph-mon[31615]: mgrmap e12: x(active, since 2s) 2024-01-31T05:02:24.235 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:24 smithi099 ceph-mon[31615]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:02:24.235 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:24 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:02:24.236 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:24 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:02:24.236 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:24 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:02:25.550 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$1heb0fex/KdHpZfLU6Ye5OTjjJtQ3/5jhhhtG42xwSNjavXYA6NtO", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1706677344, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-01-31T05:02:25.550 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.255+0000 7f6a61fbe700 1 Processor -- start 2024-01-31T05:02:25.550 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.255+0000 7f6a61fbe700 1 -- start start 2024-01-31T05:02:25.551 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.255+0000 7f6a61fbe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a5c107b30 0x7f6a5c109f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:25.551 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.255+0000 7f6a61fbe700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c07ae90 con 0x7f6a5c107b30 2024-01-31T05:02:25.551 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.255+0000 7f6a5b7fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a5c107b30 0x7f6a5c109f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:25.551 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.255+0000 7f6a5b7fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a5c107b30 0x7f6a5c109f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58202/0 (socket says 172.21.15.99:58202) 2024-01-31T05:02:25.551 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.255+0000 7f6a5b7fe700 1 -- 172.21.15.99:0/1182998023 learned_addr learned my addr 172.21.15.99:0/1182998023 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:02:25.551 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.255+0000 7f6a5b7fe700 1 -- 172.21.15.99:0/1182998023 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a5c10a460 con 0x7f6a5c107b30 2024-01-31T05:02:25.551 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.255+0000 7f6a5b7fe700 1 --2- 172.21.15.99:0/1182998023 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a5c107b30 0x7f6a5c109f20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c0098a0 tx=0x7f6a4c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc49624bfa8722e3 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:25.551 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.255+0000 7f6a5a7fc700 1 -- 172.21.15.99:0/1182998023 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6a4c004160 con 0x7f6a5c107b30 2024-01-31T05:02:25.551 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.256+0000 7f6a5a7fc700 1 -- 172.21.15.99:0/1182998023 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6a4c0042c0 con 0x7f6a5c107b30 2024-01-31T05:02:25.551 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.256+0000 7f6a5a7fc700 1 -- 172.21.15.99:0/1182998023 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6a4c0119b0 con 0x7f6a5c107b30 2024-01-31T05:02:25.551 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.256+0000 7f6a61fbe700 1 -- 172.21.15.99:0/1182998023 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a5c107b30 msgr2=0x7f6a5c109f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:25.551 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.256+0000 7f6a61fbe700 1 --2- 172.21.15.99:0/1182998023 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a5c107b30 0x7f6a5c109f20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c0098a0 tx=0x7f6a4c009bb0 comp rx=0 tx=0).stop 2024-01-31T05:02:25.551 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.256+0000 7f6a61fbe700 1 -- 172.21.15.99:0/1182998023 shutdown_connections 2024-01-31T05:02:25.551 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.256+0000 7f6a61fbe700 1 --2- 172.21.15.99:0/1182998023 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a5c107b30 0x7f6a5c109f20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:25.552 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.256+0000 7f6a61fbe700 1 -- 172.21.15.99:0/1182998023 >> 172.21.15.99:0/1182998023 conn(0x7f6a5c101580 msgr2=0x7f6a5c1039a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:02:25.552 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.256+0000 7f6a61fbe700 1 -- 172.21.15.99:0/1182998023 shutdown_connections 2024-01-31T05:02:25.552 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.256+0000 7f6a61fbe700 1 -- 172.21.15.99:0/1182998023 wait complete. 2024-01-31T05:02:25.552 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.257+0000 7f6a61fbe700 1 Processor -- start 2024-01-31T05:02:25.552 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.257+0000 7f6a61fbe700 1 -- start start 2024-01-31T05:02:25.552 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.257+0000 7f6a61fbe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a5c107b30 0x7f6a5c1073b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:25.552 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.257+0000 7f6a61fbe700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c1078f0 con 0x7f6a5c107b30 2024-01-31T05:02:25.552 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.257+0000 7f6a5b7fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a5c107b30 0x7f6a5c1073b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:25.552 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.257+0000 7f6a5b7fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a5c107b30 0x7f6a5c1073b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58206/0 (socket says 172.21.15.99:58206) 2024-01-31T05:02:25.552 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.257+0000 7f6a5b7fe700 1 -- 172.21.15.99:0/3895087992 learned_addr learned my addr 172.21.15.99:0/3895087992 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:02:25.552 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.257+0000 7f6a5b7fe700 1 -- 172.21.15.99:0/3895087992 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a4c009550 con 0x7f6a5c107b30 2024-01-31T05:02:25.552 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.258+0000 7f6a5b7fe700 1 --2- 172.21.15.99:0/3895087992 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a5c107b30 0x7f6a5c1073b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c006af0 tx=0x7f6a4c011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:25.552 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.258+0000 7f6a58ff9700 1 -- 172.21.15.99:0/3895087992 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6a4c003a40 con 0x7f6a5c107b30 2024-01-31T05:02:25.552 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.258+0000 7f6a61fbe700 1 -- 172.21.15.99:0/3895087992 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a5c105ae0 con 0x7f6a5c107b30 2024-01-31T05:02:25.553 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.258+0000 7f6a58ff9700 1 -- 172.21.15.99:0/3895087992 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6a4c003ba0 con 0x7f6a5c107b30 2024-01-31T05:02:25.553 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.258+0000 7f6a58ff9700 1 -- 172.21.15.99:0/3895087992 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6a4c0196c0 con 0x7f6a5c107b30 2024-01-31T05:02:25.553 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.258+0000 7f6a61fbe700 1 -- 172.21.15.99:0/3895087992 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a5c105f80 con 0x7f6a5c107b30 2024-01-31T05:02:25.553 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.258+0000 7f6a58ff9700 1 -- 172.21.15.99:0/3895087992 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 12) v1 ==== 45654+0+0 (secure 0 0 0) 0x7f6a4c019980 con 0x7f6a5c107b30 2024-01-31T05:02:25.553 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.259+0000 7f6a58ff9700 1 --2- 172.21.15.99:0/3895087992 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f6a44038a40 0x7f6a4403af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:25.553 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.259+0000 7f6a61fbe700 1 -- 172.21.15.99:0/3895087992 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a5c10b240 con 0x7f6a5c107b30 2024-01-31T05:02:25.553 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.259+0000 7f6a58ff9700 1 -- 172.21.15.99:0/3895087992 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f6a4c04ceb0 con 0x7f6a5c107b30 2024-01-31T05:02:25.553 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.259+0000 7f6a5affd700 1 --2- 172.21.15.99:0/3895087992 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f6a44038a40 0x7f6a4403af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:25.553 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.259+0000 7f6a5affd700 1 --2- 172.21.15.99:0/3895087992 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f6a44038a40 0x7f6a4403af00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6a50006fd0 tx=0x7f6a50006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:25.553 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.265+0000 7f6a58ff9700 1 -- 172.21.15.99:0/3895087992 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f6a4c07a600 con 0x7f6a5c107b30 2024-01-31T05:02:25.553 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.483+0000 7f6a61fbe700 1 -- 172.21.15.99:0/3895087992 --> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f6a5c106270 con 0x7f6a44038a40 2024-01-31T05:02:25.553 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.707+0000 7f6a58ff9700 1 -- 172.21.15.99:0/3895087992 <== mgr.14152 v2:172.21.15.99:6800/3925720924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f6a5c106270 con 0x7f6a44038a40 2024-01-31T05:02:25.553 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.709+0000 7f6a61fbe700 1 -- 172.21.15.99:0/3895087992 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f6a44038a40 msgr2=0x7f6a4403af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:25.554 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.709+0000 7f6a61fbe700 1 --2- 172.21.15.99:0/3895087992 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f6a44038a40 0x7f6a4403af00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6a50006fd0 tx=0x7f6a50006e40 comp rx=0 tx=0).stop 2024-01-31T05:02:25.554 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.709+0000 7f6a61fbe700 1 -- 172.21.15.99:0/3895087992 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a5c107b30 msgr2=0x7f6a5c1073b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:25.554 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.709+0000 7f6a61fbe700 1 --2- 172.21.15.99:0/3895087992 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a5c107b30 0x7f6a5c1073b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c006af0 tx=0x7f6a4c011a10 comp rx=0 tx=0).stop 2024-01-31T05:02:25.554 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.709+0000 7f6a61fbe700 1 -- 172.21.15.99:0/3895087992 shutdown_connections 2024-01-31T05:02:25.554 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.709+0000 7f6a61fbe700 1 --2- 172.21.15.99:0/3895087992 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f6a44038a40 0x7f6a4403af00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:25.554 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.709+0000 7f6a61fbe700 1 --2- 172.21.15.99:0/3895087992 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a5c107b30 0x7f6a5c1073b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:25.554 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.709+0000 7f6a61fbe700 1 -- 172.21.15.99:0/3895087992 >> 172.21.15.99:0/3895087992 conn(0x7f6a5c101580 msgr2=0x7f6a5c102050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:02:25.554 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.710+0000 7f6a61fbe700 1 -- 172.21.15.99:0/3895087992 shutdown_connections 2024-01-31T05:02:25.554 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:24.710+0000 7f6a61fbe700 1 -- 172.21.15.99:0/3895087992 wait complete. 2024-01-31T05:02:25.554 INFO:teuthology.orchestra.run.smithi099.stdout:Fetching dashboard port number... 2024-01-31T05:02:25.794 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:25 smithi099 ceph-mon[31615]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:02:25.794 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:25 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:02:27.052 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:26 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/201445416' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-01-31T05:02:27.060 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout 8443 2024-01-31T05:02:27.060 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:25.996+0000 7f5d91d84700 1 Processor -- start 2024-01-31T05:02:27.061 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:25.996+0000 7f5d91d84700 1 -- start start 2024-01-31T05:02:27.061 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:25.996+0000 7f5d91d84700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d8c105720 0x7f5d8c105b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:27.061 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:25.996+0000 7f5d91d84700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8c106110 con 0x7f5d8c105720 2024-01-31T05:02:27.061 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:25.997+0000 7f5d8b7fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d8c105720 0x7f5d8c105b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:27.061 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:25.997+0000 7f5d8b7fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d8c105720 0x7f5d8c105b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57720/0 (socket says 172.21.15.99:57720) 2024-01-31T05:02:27.061 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:25.997+0000 7f5d8b7fe700 1 -- 172.21.15.99:0/3596787519 learned_addr learned my addr 172.21.15.99:0/3596787519 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:02:27.061 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:25.997+0000 7f5d8b7fe700 1 -- 172.21.15.99:0/3596787519 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d8c106920 con 0x7f5d8c105720 2024-01-31T05:02:27.061 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:25.997+0000 7f5d8b7fe700 1 --2- 172.21.15.99:0/3596787519 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d8c105720 0x7f5d8c105b40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c0098a0 tx=0x7f5d7c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=895d49aa71ace9e server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:27.061 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:25.997+0000 7f5d8affd700 1 -- 172.21.15.99:0/3596787519 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5d7c004160 con 0x7f5d8c105720 2024-01-31T05:02:27.061 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:25.997+0000 7f5d8affd700 1 -- 172.21.15.99:0/3596787519 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5d7c0042c0 con 0x7f5d8c105720 2024-01-31T05:02:27.061 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:25.997+0000 7f5d8affd700 1 -- 172.21.15.99:0/3596787519 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5d7c0119b0 con 0x7f5d8c105720 2024-01-31T05:02:27.061 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:25.998+0000 7f5d91d84700 1 -- 172.21.15.99:0/3596787519 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d8c105720 msgr2=0x7f5d8c105b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:27.061 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:25.998+0000 7f5d91d84700 1 --2- 172.21.15.99:0/3596787519 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d8c105720 0x7f5d8c105b40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c0098a0 tx=0x7f5d7c009bb0 comp rx=0 tx=0).stop 2024-01-31T05:02:27.061 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:25.998+0000 7f5d91d84700 1 -- 172.21.15.99:0/3596787519 shutdown_connections 2024-01-31T05:02:27.061 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:25.998+0000 7f5d91d84700 1 --2- 172.21.15.99:0/3596787519 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d8c105720 0x7f5d8c105b40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:27.062 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:25.998+0000 7f5d91d84700 1 -- 172.21.15.99:0/3596787519 >> 172.21.15.99:0/3596787519 conn(0x7f5d8c100da0 msgr2=0x7f5d8c1031c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:02:27.062 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:25.998+0000 7f5d91d84700 1 -- 172.21.15.99:0/3596787519 shutdown_connections 2024-01-31T05:02:27.062 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:25.998+0000 7f5d91d84700 1 -- 172.21.15.99:0/3596787519 wait complete. 2024-01-31T05:02:27.062 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:25.998+0000 7f5d91d84700 1 Processor -- start 2024-01-31T05:02:27.062 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:25.998+0000 7f5d91d84700 1 -- start start 2024-01-31T05:02:27.062 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:25.999+0000 7f5d91d84700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d8c105720 0x7f5d8c19aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:27.062 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:25.999+0000 7f5d91d84700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8c19b400 con 0x7f5d8c105720 2024-01-31T05:02:27.062 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:25.999+0000 7f5d8b7fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d8c105720 0x7f5d8c19aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:27.062 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:25.999+0000 7f5d8b7fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d8c105720 0x7f5d8c19aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57726/0 (socket says 172.21.15.99:57726) 2024-01-31T05:02:27.062 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:25.999+0000 7f5d8b7fe700 1 -- 172.21.15.99:0/201445416 learned_addr learned my addr 172.21.15.99:0/201445416 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:02:27.062 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:25.999+0000 7f5d8b7fe700 1 -- 172.21.15.99:0/201445416 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d7c009550 con 0x7f5d8c105720 2024-01-31T05:02:27.062 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:25.999+0000 7f5d8b7fe700 1 --2- 172.21.15.99:0/201445416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d8c105720 0x7f5d8c19aec0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c011670 tx=0x7f5d7c011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:27.062 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:25.999+0000 7f5d897fa700 1 -- 172.21.15.99:0/201445416 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5d7c003af0 con 0x7f5d8c105720 2024-01-31T05:02:27.062 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:25.999+0000 7f5d897fa700 1 -- 172.21.15.99:0/201445416 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5d7c003c50 con 0x7f5d8c105720 2024-01-31T05:02:27.062 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:25.999+0000 7f5d91d84700 1 -- 172.21.15.99:0/201445416 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d8c19b600 con 0x7f5d8c105720 2024-01-31T05:02:27.062 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:26.000+0000 7f5d897fa700 1 -- 172.21.15.99:0/201445416 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5d7c024820 con 0x7f5d8c105720 2024-01-31T05:02:27.063 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:26.000+0000 7f5d91d84700 1 -- 172.21.15.99:0/201445416 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d8c19baa0 con 0x7f5d8c105720 2024-01-31T05:02:27.063 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:26.000+0000 7f5d897fa700 1 -- 172.21.15.99:0/201445416 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 12) v1 ==== 45654+0+0 (secure 0 0 0) 0x7f5d7c024a50 con 0x7f5d8c105720 2024-01-31T05:02:27.063 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:26.000+0000 7f5d91d84700 1 -- 172.21.15.99:0/201445416 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d8c194b50 con 0x7f5d8c105720 2024-01-31T05:02:27.063 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:26.001+0000 7f5d897fa700 1 --2- 172.21.15.99:0/201445416 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f5d78038ae0 0x7f5d7803afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:27.063 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:26.001+0000 7f5d897fa700 1 -- 172.21.15.99:0/201445416 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f5d7c04cbd0 con 0x7f5d8c105720 2024-01-31T05:02:27.063 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:26.001+0000 7f5d82ffd700 1 --2- 172.21.15.99:0/201445416 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f5d78038ae0 0x7f5d7803afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:27.063 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:26.001+0000 7f5d82ffd700 1 --2- 172.21.15.99:0/201445416 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f5d78038ae0 0x7f5d7803afa0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5d74006fd0 tx=0x7f5d74006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:27.063 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:26.005+0000 7f5d897fa700 1 -- 172.21.15.99:0/201445416 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f5d7c010790 con 0x7f5d8c105720 2024-01-31T05:02:27.063 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:26.199+0000 7f5d91d84700 1 -- 172.21.15.99:0/201445416 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f5d8c106f00 con 0x7f5d8c105720 2024-01-31T05:02:27.063 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:26.199+0000 7f5d897fa700 1 -- 172.21.15.99:0/201445416 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f5d7c02c350 con 0x7f5d8c105720 2024-01-31T05:02:27.063 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:26.201+0000 7f5d91d84700 1 -- 172.21.15.99:0/201445416 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f5d78038ae0 msgr2=0x7f5d7803afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:27.063 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:26.201+0000 7f5d91d84700 1 --2- 172.21.15.99:0/201445416 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f5d78038ae0 0x7f5d7803afa0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5d74006fd0 tx=0x7f5d74006e40 comp rx=0 tx=0).stop 2024-01-31T05:02:27.063 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:26.201+0000 7f5d91d84700 1 -- 172.21.15.99:0/201445416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d8c105720 msgr2=0x7f5d8c19aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:27.063 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:26.201+0000 7f5d91d84700 1 --2- 172.21.15.99:0/201445416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d8c105720 0x7f5d8c19aec0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c011670 tx=0x7f5d7c011a30 comp rx=0 tx=0).stop 2024-01-31T05:02:27.063 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:26.201+0000 7f5d91d84700 1 -- 172.21.15.99:0/201445416 shutdown_connections 2024-01-31T05:02:27.064 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:26.201+0000 7f5d91d84700 1 --2- 172.21.15.99:0/201445416 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f5d78038ae0 0x7f5d7803afa0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:27.064 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:26.201+0000 7f5d91d84700 1 --2- 172.21.15.99:0/201445416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d8c105720 0x7f5d8c19aec0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:27.064 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:26.201+0000 7f5d91d84700 1 -- 172.21.15.99:0/201445416 >> 172.21.15.99:0/201445416 conn(0x7f5d8c100da0 msgr2=0x7f5d8c191c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:02:27.064 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:26.201+0000 7f5d91d84700 1 -- 172.21.15.99:0/201445416 shutdown_connections 2024-01-31T05:02:27.064 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:26.201+0000 7f5d91d84700 1 -- 172.21.15.99:0/201445416 wait complete. 2024-01-31T05:02:27.069 INFO:teuthology.orchestra.run.smithi099.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-01-31T05:02:27.069 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stdout disabled 2024-01-31T05:02:27.077 INFO:teuthology.orchestra.run.smithi099.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-01-31T05:02:27.077 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stdout inactive 2024-01-31T05:02:27.077 INFO:teuthology.orchestra.run.smithi099.stdout:firewalld.service is not enabled 2024-01-31T05:02:27.077 INFO:teuthology.orchestra.run.smithi099.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-01-31T05:02:27.079 INFO:teuthology.orchestra.run.smithi099.stdout:Ceph Dashboard is now available at: 2024-01-31T05:02:27.079 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:02:27.079 INFO:teuthology.orchestra.run.smithi099.stdout: URL: https://smithi099.front.sepia.ceph.com:8443/ 2024-01-31T05:02:27.079 INFO:teuthology.orchestra.run.smithi099.stdout: User: admin 2024-01-31T05:02:27.079 INFO:teuthology.orchestra.run.smithi099.stdout: Password: j89mbich3m 2024-01-31T05:02:27.079 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:02:27.079 INFO:teuthology.orchestra.run.smithi099.stdout:Saving cluster configuration to /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/config directory 2024-01-31T05:02:27.080 INFO:teuthology.orchestra.run.smithi099.stdout:Enabling autotune for osd_memory_target 2024-01-31T05:02:28.017 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:27 smithi099 ceph-mon[31615]: mgrmap e13: x(active, since 6s) 2024-01-31T05:02:28.295 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.519+0000 7f035816d700 1 Processor -- start 2024-01-31T05:02:28.300 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.519+0000 7f035816d700 1 -- start start 2024-01-31T05:02:28.300 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.519+0000 7f035816d700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0350105f80 0x7f03501063a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:28.300 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.519+0000 7f035816d700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0350106970 con 0x7f0350105f80 2024-01-31T05:02:28.300 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.520+0000 7f0355f09700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0350105f80 0x7f03501063a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:28.300 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.520+0000 7f0355f09700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0350105f80 0x7f03501063a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57734/0 (socket says 172.21.15.99:57734) 2024-01-31T05:02:28.300 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.520+0000 7f0355f09700 1 -- 172.21.15.99:0/2326215893 learned_addr learned my addr 172.21.15.99:0/2326215893 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:02:28.300 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.520+0000 7f0355f09700 1 -- 172.21.15.99:0/2326215893 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0350107180 con 0x7f0350105f80 2024-01-31T05:02:28.300 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.520+0000 7f0355f09700 1 --2- 172.21.15.99:0/2326215893 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0350105f80 0x7f03501063a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f034c0098a0 tx=0x7f034c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc27ead8d0bac283 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:28.301 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.520+0000 7f0354f07700 1 -- 172.21.15.99:0/2326215893 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f034c004160 con 0x7f0350105f80 2024-01-31T05:02:28.301 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.520+0000 7f0354f07700 1 -- 172.21.15.99:0/2326215893 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f034c0042c0 con 0x7f0350105f80 2024-01-31T05:02:28.301 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.520+0000 7f0354f07700 1 -- 172.21.15.99:0/2326215893 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f034c0119b0 con 0x7f0350105f80 2024-01-31T05:02:28.301 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.521+0000 7f035816d700 1 -- 172.21.15.99:0/2326215893 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0350105f80 msgr2=0x7f03501063a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:28.301 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.521+0000 7f035816d700 1 --2- 172.21.15.99:0/2326215893 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0350105f80 0x7f03501063a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f034c0098a0 tx=0x7f034c009bb0 comp rx=0 tx=0).stop 2024-01-31T05:02:28.301 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.521+0000 7f035816d700 1 -- 172.21.15.99:0/2326215893 shutdown_connections 2024-01-31T05:02:28.301 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.521+0000 7f035816d700 1 --2- 172.21.15.99:0/2326215893 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0350105f80 0x7f03501063a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:28.301 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.521+0000 7f035816d700 1 -- 172.21.15.99:0/2326215893 >> 172.21.15.99:0/2326215893 conn(0x7f0350101580 msgr2=0x7f03501039a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:02:28.301 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.521+0000 7f035816d700 1 -- 172.21.15.99:0/2326215893 shutdown_connections 2024-01-31T05:02:28.301 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.521+0000 7f035816d700 1 -- 172.21.15.99:0/2326215893 wait complete. 2024-01-31T05:02:28.301 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.522+0000 7f035816d700 1 Processor -- start 2024-01-31T05:02:28.301 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.522+0000 7f035816d700 1 -- start start 2024-01-31T05:02:28.301 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.522+0000 7f035816d700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0350105f80 0x7f035019ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:28.302 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.522+0000 7f035816d700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f035019b380 con 0x7f0350105f80 2024-01-31T05:02:28.302 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.522+0000 7f0355f09700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0350105f80 0x7f035019ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:28.302 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.522+0000 7f0355f09700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0350105f80 0x7f035019ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57746/0 (socket says 172.21.15.99:57746) 2024-01-31T05:02:28.302 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.522+0000 7f0355f09700 1 -- 172.21.15.99:0/1748612820 learned_addr learned my addr 172.21.15.99:0/1748612820 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:02:28.302 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.522+0000 7f0355f09700 1 -- 172.21.15.99:0/1748612820 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f034c009550 con 0x7f0350105f80 2024-01-31T05:02:28.302 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.522+0000 7f0355f09700 1 --2- 172.21.15.99:0/1748612820 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0350105f80 0x7f035019ae40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f034c006af0 tx=0x7f034c011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:28.302 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.522+0000 7f0346ffd700 1 -- 172.21.15.99:0/1748612820 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f034c003a40 con 0x7f0350105f80 2024-01-31T05:02:28.302 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.522+0000 7f0346ffd700 1 -- 172.21.15.99:0/1748612820 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f034c003ba0 con 0x7f0350105f80 2024-01-31T05:02:28.302 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.522+0000 7f035816d700 1 -- 172.21.15.99:0/1748612820 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f035019b580 con 0x7f0350105f80 2024-01-31T05:02:28.302 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.522+0000 7f0346ffd700 1 -- 172.21.15.99:0/1748612820 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f034c019690 con 0x7f0350105f80 2024-01-31T05:02:28.302 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.523+0000 7f035816d700 1 -- 172.21.15.99:0/1748612820 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f035019ba20 con 0x7f0350105f80 2024-01-31T05:02:28.302 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.523+0000 7f0346ffd700 1 -- 172.21.15.99:0/1748612820 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 13) v1 ==== 45697+0+0 (secure 0 0 0) 0x7f034c019950 con 0x7f0350105f80 2024-01-31T05:02:28.302 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.523+0000 7f035816d700 1 -- 172.21.15.99:0/1748612820 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0350195020 con 0x7f0350105f80 2024-01-31T05:02:28.302 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.523+0000 7f0346ffd700 1 --2- 172.21.15.99:0/1748612820 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f033c038ae0 0x7f033c03afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:28.302 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.524+0000 7f0346ffd700 1 -- 172.21.15.99:0/1748612820 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f034c04cf00 con 0x7f0350105f80 2024-01-31T05:02:28.303 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.524+0000 7f0355708700 1 --2- 172.21.15.99:0/1748612820 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f033c038ae0 0x7f033c03afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:28.303 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.524+0000 7f0355708700 1 --2- 172.21.15.99:0/1748612820 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f033c038ae0 0x7f033c03afa0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0340006fd0 tx=0x7f0340006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:28.303 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.528+0000 7f0346ffd700 1 -- 172.21.15.99:0/1748612820 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f034c00bb90 con 0x7f0350105f80 2024-01-31T05:02:28.303 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.723+0000 7f035816d700 1 -- 172.21.15.99:0/1748612820 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f035010a380 con 0x7f0350105f80 2024-01-31T05:02:28.303 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.724+0000 7f0346ffd700 1 -- 172.21.15.99:0/1748612820 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f034c020240 con 0x7f0350105f80 2024-01-31T05:02:28.303 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.725+0000 7f035816d700 1 -- 172.21.15.99:0/1748612820 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f033c038ae0 msgr2=0x7f033c03afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:28.303 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.725+0000 7f035816d700 1 --2- 172.21.15.99:0/1748612820 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f033c038ae0 0x7f033c03afa0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0340006fd0 tx=0x7f0340006e40 comp rx=0 tx=0).stop 2024-01-31T05:02:28.303 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.725+0000 7f035816d700 1 -- 172.21.15.99:0/1748612820 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0350105f80 msgr2=0x7f035019ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:28.303 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.725+0000 7f035816d700 1 --2- 172.21.15.99:0/1748612820 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0350105f80 0x7f035019ae40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f034c006af0 tx=0x7f034c011a10 comp rx=0 tx=0).stop 2024-01-31T05:02:28.303 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.726+0000 7f035816d700 1 -- 172.21.15.99:0/1748612820 shutdown_connections 2024-01-31T05:02:28.303 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.726+0000 7f035816d700 1 --2- 172.21.15.99:0/1748612820 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f033c038ae0 0x7f033c03afa0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:28.303 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.726+0000 7f035816d700 1 --2- 172.21.15.99:0/1748612820 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0350105f80 0x7f035019ae40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:28.303 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.726+0000 7f035816d700 1 -- 172.21.15.99:0/1748612820 >> 172.21.15.99:0/1748612820 conn(0x7f0350101580 msgr2=0x7f0350102480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:02:28.303 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.726+0000 7f035816d700 1 -- 172.21.15.99:0/1748612820 shutdown_connections 2024-01-31T05:02:28.303 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:27.726+0000 7f035816d700 1 -- 172.21.15.99:0/1748612820 wait complete. 2024-01-31T05:02:29.599 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:28.715+0000 7f79fdff5700 1 Processor -- start 2024-01-31T05:02:29.599 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:28.715+0000 7f79fdff5700 1 -- start start 2024-01-31T05:02:29.599 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:28.715+0000 7f79fdff5700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79f8107610 0x7f79f8107a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:29.599 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:28.715+0000 7f79fdff5700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f8108000 con 0x7f79f8107610 2024-01-31T05:02:29.599 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:28.715+0000 7f79f77fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79f8107610 0x7f79f8107a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:29.599 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:28.715+0000 7f79f77fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79f8107610 0x7f79f8107a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57756/0 (socket says 172.21.15.99:57756) 2024-01-31T05:02:29.599 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:28.715+0000 7f79f77fe700 1 -- 172.21.15.99:0/3843153888 learned_addr learned my addr 172.21.15.99:0/3843153888 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:02:29.599 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:28.715+0000 7f79f77fe700 1 -- 172.21.15.99:0/3843153888 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f8108140 con 0x7f79f8107610 2024-01-31T05:02:29.599 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:28.716+0000 7f79f77fe700 1 --2- 172.21.15.99:0/3843153888 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79f8107610 0x7f79f8107a30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f79e80098a0 tx=0x7f79e8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad2981cc4b6de96d server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:29.600 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:28.716+0000 7f79f67fc700 1 -- 172.21.15.99:0/3843153888 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79e8004160 con 0x7f79f8107610 2024-01-31T05:02:29.600 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:28.716+0000 7f79f67fc700 1 -- 172.21.15.99:0/3843153888 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f79e80042c0 con 0x7f79f8107610 2024-01-31T05:02:29.600 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:28.716+0000 7f79f67fc700 1 -- 172.21.15.99:0/3843153888 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79e80119b0 con 0x7f79f8107610 2024-01-31T05:02:29.600 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:28.716+0000 7f79fdff5700 1 -- 172.21.15.99:0/3843153888 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79f8107610 msgr2=0x7f79f8107a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:29.600 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:28.716+0000 7f79fdff5700 1 --2- 172.21.15.99:0/3843153888 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79f8107610 0x7f79f8107a30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f79e80098a0 tx=0x7f79e8009bb0 comp rx=0 tx=0).stop 2024-01-31T05:02:29.600 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:28.716+0000 7f79fdff5700 1 -- 172.21.15.99:0/3843153888 shutdown_connections 2024-01-31T05:02:29.600 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:28.716+0000 7f79fdff5700 1 --2- 172.21.15.99:0/3843153888 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79f8107610 0x7f79f8107a30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:29.600 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:28.716+0000 7f79fdff5700 1 -- 172.21.15.99:0/3843153888 >> 172.21.15.99:0/3843153888 conn(0x7f79f8100d90 msgr2=0x7f79f81031b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:02:29.600 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:28.717+0000 7f79fdff5700 1 -- 172.21.15.99:0/3843153888 shutdown_connections 2024-01-31T05:02:29.600 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:28.717+0000 7f79fdff5700 1 -- 172.21.15.99:0/3843153888 wait complete. 2024-01-31T05:02:29.600 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:28.717+0000 7f79fdff5700 1 Processor -- start 2024-01-31T05:02:29.600 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:28.717+0000 7f79fdff5700 1 -- start start 2024-01-31T05:02:29.600 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:28.717+0000 7f79fdff5700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79f8107610 0x7f79f819d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:29.600 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:28.718+0000 7f79fdff5700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f819d5a0 con 0x7f79f8107610 2024-01-31T05:02:29.601 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:28.718+0000 7f79f77fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79f8107610 0x7f79f819d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:29.601 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:28.718+0000 7f79f77fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79f8107610 0x7f79f819d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57764/0 (socket says 172.21.15.99:57764) 2024-01-31T05:02:29.601 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:28.718+0000 7f79f77fe700 1 -- 172.21.15.99:0/1117805344 learned_addr learned my addr 172.21.15.99:0/1117805344 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:02:29.601 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:28.718+0000 7f79f77fe700 1 -- 172.21.15.99:0/1117805344 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e8009550 con 0x7f79f8107610 2024-01-31T05:02:29.601 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:28.718+0000 7f79f77fe700 1 --2- 172.21.15.99:0/1117805344 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79f8107610 0x7f79f819d060 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f79e8003e60 tx=0x7f79e8011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:29.601 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:28.718+0000 7f79f4ff9700 1 -- 172.21.15.99:0/1117805344 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79e80038b0 con 0x7f79f8107610 2024-01-31T05:02:29.601 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:28.718+0000 7f79fdff5700 1 -- 172.21.15.99:0/1117805344 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79f819d7a0 con 0x7f79f8107610 2024-01-31T05:02:29.601 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:28.718+0000 7f79f4ff9700 1 -- 172.21.15.99:0/1117805344 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f79e8003a10 con 0x7f79f8107610 2024-01-31T05:02:29.601 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:28.718+0000 7f79f4ff9700 1 -- 172.21.15.99:0/1117805344 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79e8019530 con 0x7f79f8107610 2024-01-31T05:02:29.601 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:28.718+0000 7f79fdff5700 1 -- 172.21.15.99:0/1117805344 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79f819dc40 con 0x7f79f8107610 2024-01-31T05:02:29.601 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:28.719+0000 7f79de7fc700 1 -- 172.21.15.99:0/1117805344 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79d8005330 con 0x7f79f8107610 2024-01-31T05:02:29.601 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:28.720+0000 7f79f4ff9700 1 -- 172.21.15.99:0/1117805344 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 13) v1 ==== 45697+0+0 (secure 0 0 0) 0x7f79e801a980 con 0x7f79f8107610 2024-01-31T05:02:29.601 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:28.720+0000 7f79f4ff9700 1 --2- 172.21.15.99:0/1117805344 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f79e0038ae0 0x7f79e003afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:29.601 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:28.720+0000 7f79f4ff9700 1 -- 172.21.15.99:0/1117805344 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f79e804d0a0 con 0x7f79f8107610 2024-01-31T05:02:29.602 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:28.721+0000 7f79f6ffd700 1 --2- 172.21.15.99:0/1117805344 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f79e0038ae0 0x7f79e003afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:29.602 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:28.721+0000 7f79f6ffd700 1 --2- 172.21.15.99:0/1117805344 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f79e0038ae0 0x7f79e003afa0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f79ec006fd0 tx=0x7f79ec006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:29.602 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:28.725+0000 7f79f4ff9700 1 -- 172.21.15.99:0/1117805344 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f79e80237a0 con 0x7f79f8107610 2024-01-31T05:02:29.602 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:29.032+0000 7f79de7fc700 1 -- 172.21.15.99:0/1117805344 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f79d80055e0 con 0x7f79f8107610 2024-01-31T05:02:29.602 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:29.035+0000 7f79f4ff9700 1 -- 172.21.15.99:0/1117805344 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) v1 ==== 153+0+0 (secure 0 0 0) 0x7f79e802c3a0 con 0x7f79f8107610 2024-01-31T05:02:29.602 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:29.038+0000 7f79de7fc700 1 -- 172.21.15.99:0/1117805344 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f79e0038ae0 msgr2=0x7f79e003afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:29.602 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:29.038+0000 7f79de7fc700 1 --2- 172.21.15.99:0/1117805344 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f79e0038ae0 0x7f79e003afa0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f79ec006fd0 tx=0x7f79ec006e40 comp rx=0 tx=0).stop 2024-01-31T05:02:29.602 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:29.038+0000 7f79de7fc700 1 -- 172.21.15.99:0/1117805344 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79f8107610 msgr2=0x7f79f819d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:29.602 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:29.038+0000 7f79de7fc700 1 --2- 172.21.15.99:0/1117805344 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79f8107610 0x7f79f819d060 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f79e8003e60 tx=0x7f79e8011a30 comp rx=0 tx=0).stop 2024-01-31T05:02:29.602 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:29.038+0000 7f79de7fc700 1 -- 172.21.15.99:0/1117805344 shutdown_connections 2024-01-31T05:02:29.602 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:29.038+0000 7f79de7fc700 1 --2- 172.21.15.99:0/1117805344 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f79e0038ae0 0x7f79e003afa0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:29.602 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:29.038+0000 7f79de7fc700 1 --2- 172.21.15.99:0/1117805344 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79f8107610 0x7f79f819d060 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:29.602 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:29.038+0000 7f79de7fc700 1 -- 172.21.15.99:0/1117805344 >> 172.21.15.99:0/1117805344 conn(0x7f79f8100d90 msgr2=0x7f79f81938c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:02:29.602 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:29.038+0000 7f79de7fc700 1 -- 172.21.15.99:0/1117805344 shutdown_connections 2024-01-31T05:02:29.603 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-01-31T05:02:29.038+0000 7f79de7fc700 1 -- 172.21.15.99:0/1117805344 wait complete. 2024-01-31T05:02:29.603 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-01-31T05:02:29.603 INFO:teuthology.orchestra.run.smithi099.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-01-31T05:02:29.603 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:02:29.603 INFO:teuthology.orchestra.run.smithi099.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-01-31T05:02:29.603 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:02:29.603 INFO:teuthology.orchestra.run.smithi099.stdout:Or, if you are only running a single cluster on this host: 2024-01-31T05:02:29.603 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:02:29.603 INFO:teuthology.orchestra.run.smithi099.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-01-31T05:02:29.603 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:02:29.603 INFO:teuthology.orchestra.run.smithi099.stdout:Please consider enabling telemetry to help improve Ceph: 2024-01-31T05:02:29.603 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:02:29.603 INFO:teuthology.orchestra.run.smithi099.stdout: ceph telemetry on 2024-01-31T05:02:29.603 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:02:29.603 INFO:teuthology.orchestra.run.smithi099.stdout:For more information see: 2024-01-31T05:02:29.603 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:02:29.604 INFO:teuthology.orchestra.run.smithi099.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-01-31T05:02:29.604 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:02:29.604 INFO:teuthology.orchestra.run.smithi099.stdout:Bootstrap complete. 2024-01-31T05:02:29.637 INFO:tasks.cephadm:Fetching config... 2024-01-31T05:02:29.637 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-31T05:02:29.637 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-01-31T05:02:29.652 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-01-31T05:02:29.652 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-31T05:02:29.652 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-01-31T05:02:29.708 INFO:tasks.cephadm:Fetching mon keyring... 2024-01-31T05:02:29.708 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-31T05:02:29.708 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/keyring of=/dev/stdout 2024-01-31T05:02:29.776 INFO:tasks.cephadm:Fetching pub ssh key... 2024-01-31T05:02:29.776 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-31T05:02:29.776 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-01-31T05:02:29.831 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-01-31T05:02:29.831 DEBUG:teuthology.orchestra.run.smithi099:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCy+7Xf64pL8DRs/UOhTBoxHWeIih33Wzyp7uWhuUGJ78tXIIlzrV3xiDAvDN/o6FcqRmHKEtj/aH9fdIk86CoCroGmkyXVKs/HhgVpz/X8LlLzlwpgOE7WKym7n/cKAGkT9K2YNV7nZCWL9IIdWdW8TfdHhpxFTiscSmZwvFyoj1jmIUDhjE6LTEx6BSJM7g/2dFf5DyaMTj5o4if3hYpRP9WSCxJDYVBt4MFtvXD+ArJfKf3lul9L4JBt9CEOZo3jYMsJI3OTq0yYXChhFtpZVEH9NDH9v7LjWBS1vQL9SaK8hOVcFUdUINJH5ddn02kM95V8FesJXFlQatLDHis8LMur5/09lSTqsHAA0j7nlpod81pqgzz1BqOE40I4nSd//orQPmFCFWBAHVhvLDESj6TH3aG+8dOo7TLwWtQOlXRSCjZWMdsemxzC7K9xuBCz0MBjshnSiqUeRtKYWLp4/aW/USwRfoxx0II+jm2RY0bmYhcMJWhhH9xhgKnnrT0= ceph-9288ff44-bff5-11ee-95b3-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-01-31T05:02:29.909 INFO:teuthology.orchestra.run.smithi099.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCy+7Xf64pL8DRs/UOhTBoxHWeIih33Wzyp7uWhuUGJ78tXIIlzrV3xiDAvDN/o6FcqRmHKEtj/aH9fdIk86CoCroGmkyXVKs/HhgVpz/X8LlLzlwpgOE7WKym7n/cKAGkT9K2YNV7nZCWL9IIdWdW8TfdHhpxFTiscSmZwvFyoj1jmIUDhjE6LTEx6BSJM7g/2dFf5DyaMTj5o4if3hYpRP9WSCxJDYVBt4MFtvXD+ArJfKf3lul9L4JBt9CEOZo3jYMsJI3OTq0yYXChhFtpZVEH9NDH9v7LjWBS1vQL9SaK8hOVcFUdUINJH5ddn02kM95V8FesJXFlQatLDHis8LMur5/09lSTqsHAA0j7nlpod81pqgzz1BqOE40I4nSd//orQPmFCFWBAHVhvLDESj6TH3aG+8dOo7TLwWtQOlXRSCjZWMdsemxzC7K9xuBCz0MBjshnSiqUeRtKYWLp4/aW/USwRfoxx0II+jm2RY0bmYhcMJWhhH9xhgKnnrT0= ceph-9288ff44-bff5-11ee-95b3-87774f69a715 2024-01-31T05:02:29.933 DEBUG:teuthology.orchestra.run.smithi179:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCy+7Xf64pL8DRs/UOhTBoxHWeIih33Wzyp7uWhuUGJ78tXIIlzrV3xiDAvDN/o6FcqRmHKEtj/aH9fdIk86CoCroGmkyXVKs/HhgVpz/X8LlLzlwpgOE7WKym7n/cKAGkT9K2YNV7nZCWL9IIdWdW8TfdHhpxFTiscSmZwvFyoj1jmIUDhjE6LTEx6BSJM7g/2dFf5DyaMTj5o4if3hYpRP9WSCxJDYVBt4MFtvXD+ArJfKf3lul9L4JBt9CEOZo3jYMsJI3OTq0yYXChhFtpZVEH9NDH9v7LjWBS1vQL9SaK8hOVcFUdUINJH5ddn02kM95V8FesJXFlQatLDHis8LMur5/09lSTqsHAA0j7nlpod81pqgzz1BqOE40I4nSd//orQPmFCFWBAHVhvLDESj6TH3aG+8dOo7TLwWtQOlXRSCjZWMdsemxzC7K9xuBCz0MBjshnSiqUeRtKYWLp4/aW/USwRfoxx0II+jm2RY0bmYhcMJWhhH9xhgKnnrT0= ceph-9288ff44-bff5-11ee-95b3-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-01-31T05:02:29.977 INFO:teuthology.orchestra.run.smithi179.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCy+7Xf64pL8DRs/UOhTBoxHWeIih33Wzyp7uWhuUGJ78tXIIlzrV3xiDAvDN/o6FcqRmHKEtj/aH9fdIk86CoCroGmkyXVKs/HhgVpz/X8LlLzlwpgOE7WKym7n/cKAGkT9K2YNV7nZCWL9IIdWdW8TfdHhpxFTiscSmZwvFyoj1jmIUDhjE6LTEx6BSJM7g/2dFf5DyaMTj5o4if3hYpRP9WSCxJDYVBt4MFtvXD+ArJfKf3lul9L4JBt9CEOZo3jYMsJI3OTq0yYXChhFtpZVEH9NDH9v7LjWBS1vQL9SaK8hOVcFUdUINJH5ddn02kM95V8FesJXFlQatLDHis8LMur5/09lSTqsHAA0j7nlpod81pqgzz1BqOE40I4nSd//orQPmFCFWBAHVhvLDESj6TH3aG+8dOo7TLwWtQOlXRSCjZWMdsemxzC7K9xuBCz0MBjshnSiqUeRtKYWLp4/aW/USwRfoxx0II+jm2RY0bmYhcMJWhhH9xhgKnnrT0= ceph-9288ff44-bff5-11ee-95b3-87774f69a715 2024-01-31T05:02:29.992 DEBUG:teuthology.orchestra.run.smithi181:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCy+7Xf64pL8DRs/UOhTBoxHWeIih33Wzyp7uWhuUGJ78tXIIlzrV3xiDAvDN/o6FcqRmHKEtj/aH9fdIk86CoCroGmkyXVKs/HhgVpz/X8LlLzlwpgOE7WKym7n/cKAGkT9K2YNV7nZCWL9IIdWdW8TfdHhpxFTiscSmZwvFyoj1jmIUDhjE6LTEx6BSJM7g/2dFf5DyaMTj5o4if3hYpRP9WSCxJDYVBt4MFtvXD+ArJfKf3lul9L4JBt9CEOZo3jYMsJI3OTq0yYXChhFtpZVEH9NDH9v7LjWBS1vQL9SaK8hOVcFUdUINJH5ddn02kM95V8FesJXFlQatLDHis8LMur5/09lSTqsHAA0j7nlpod81pqgzz1BqOE40I4nSd//orQPmFCFWBAHVhvLDESj6TH3aG+8dOo7TLwWtQOlXRSCjZWMdsemxzC7K9xuBCz0MBjshnSiqUeRtKYWLp4/aW/USwRfoxx0II+jm2RY0bmYhcMJWhhH9xhgKnnrT0= ceph-9288ff44-bff5-11ee-95b3-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-01-31T05:02:30.039 INFO:teuthology.orchestra.run.smithi181.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCy+7Xf64pL8DRs/UOhTBoxHWeIih33Wzyp7uWhuUGJ78tXIIlzrV3xiDAvDN/o6FcqRmHKEtj/aH9fdIk86CoCroGmkyXVKs/HhgVpz/X8LlLzlwpgOE7WKym7n/cKAGkT9K2YNV7nZCWL9IIdWdW8TfdHhpxFTiscSmZwvFyoj1jmIUDhjE6LTEx6BSJM7g/2dFf5DyaMTj5o4if3hYpRP9WSCxJDYVBt4MFtvXD+ArJfKf3lul9L4JBt9CEOZo3jYMsJI3OTq0yYXChhFtpZVEH9NDH9v7LjWBS1vQL9SaK8hOVcFUdUINJH5ddn02kM95V8FesJXFlQatLDHis8LMur5/09lSTqsHAA0j7nlpod81pqgzz1BqOE40I4nSd//orQPmFCFWBAHVhvLDESj6TH3aG+8dOo7TLwWtQOlXRSCjZWMdsemxzC7K9xuBCz0MBjshnSiqUeRtKYWLp4/aW/USwRfoxx0II+jm2RY0bmYhcMJWhhH9xhgKnnrT0= ceph-9288ff44-bff5-11ee-95b3-87774f69a715 2024-01-31T05:02:30.055 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-01-31T05:02:30.120 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:30 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/1117805344' entity='client.admin' 2024-01-31T05:02:30.297 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:02:32.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:32.580+0000 7f2fef51e700 1 -- 172.21.15.99:0/2698773716 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2fe8100110 msgr2=0x7f2fe8100530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:32.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:32.580+0000 7f2fef51e700 1 --2- 172.21.15.99:0/2698773716 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2fe8100110 0x7f2fe8100530 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0009910 tx=0x7f2fe0009c20 comp rx=0 tx=0).stop 2024-01-31T05:02:32.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:32.580+0000 7f2fef51e700 1 -- 172.21.15.99:0/2698773716 shutdown_connections 2024-01-31T05:02:32.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:32.580+0000 7f2fef51e700 1 --2- 172.21.15.99:0/2698773716 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2fe8100110 0x7f2fe8100530 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:32.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:32.580+0000 7f2fef51e700 1 -- 172.21.15.99:0/2698773716 >> 172.21.15.99:0/2698773716 conn(0x7f2fe80fb6d0 msgr2=0x7f2fe80fdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:02:32.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:32.580+0000 7f2fef51e700 1 -- 172.21.15.99:0/2698773716 shutdown_connections 2024-01-31T05:02:32.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:32.580+0000 7f2fef51e700 1 -- 172.21.15.99:0/2698773716 wait complete. 2024-01-31T05:02:32.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:32.581+0000 7f2fef51e700 1 Processor -- start 2024-01-31T05:02:32.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:32.581+0000 7f2fef51e700 1 -- start start 2024-01-31T05:02:32.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:32.581+0000 7f2fef51e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2fe8100110 0x7f2fe806a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:32.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:32.581+0000 7f2fef51e700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe806a620 con 0x7f2fe8100110 2024-01-31T05:02:32.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:32.581+0000 7f2fed2ba700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2fe8100110 0x7f2fe806a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:32.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:32.581+0000 7f2fed2ba700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2fe8100110 0x7f2fe806a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57778/0 (socket says 172.21.15.99:57778) 2024-01-31T05:02:32.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:32.581+0000 7f2fed2ba700 1 -- 172.21.15.99:0/1403625115 learned_addr learned my addr 172.21.15.99:0/1403625115 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:02:32.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:32.581+0000 7f2fed2ba700 1 -- 172.21.15.99:0/1403625115 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe00095f0 con 0x7f2fe8100110 2024-01-31T05:02:32.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:32.582+0000 7f2fed2ba700 1 --2- 172.21.15.99:0/1403625115 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2fe8100110 0x7f2fe806a0e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0004f70 tx=0x7f2fe0004fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:32.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:32.582+0000 7f2fe67fc700 1 -- 172.21.15.99:0/1403625115 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2fe001d070 con 0x7f2fe8100110 2024-01-31T05:02:32.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:32.582+0000 7f2fe67fc700 1 -- 172.21.15.99:0/1403625115 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2fe000be20 con 0x7f2fe8100110 2024-01-31T05:02:32.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:32.582+0000 7f2fe67fc700 1 -- 172.21.15.99:0/1403625115 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2fe0022df0 con 0x7f2fe8100110 2024-01-31T05:02:32.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:32.582+0000 7f2fef51e700 1 -- 172.21.15.99:0/1403625115 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fe8199370 con 0x7f2fe8100110 2024-01-31T05:02:32.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:32.582+0000 7f2fef51e700 1 -- 172.21.15.99:0/1403625115 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fe8199810 con 0x7f2fe8100110 2024-01-31T05:02:32.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:32.583+0000 7f2fe67fc700 1 -- 172.21.15.99:0/1403625115 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 13) v1 ==== 45697+0+0 (secure 0 0 0) 0x7f2fe000b960 con 0x7f2fe8100110 2024-01-31T05:02:32.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:32.583+0000 7f2fe67fc700 1 --2- 172.21.15.99:0/1403625115 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2fd0038b40 0x7f2fd003b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:32.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:32.583+0000 7f2fe67fc700 1 -- 172.21.15.99:0/1403625115 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f2fe004ccf0 con 0x7f2fe8100110 2024-01-31T05:02:32.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:32.583+0000 7f2fef51e700 1 -- 172.21.15.99:0/1403625115 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fe818ee30 con 0x7f2fe8100110 2024-01-31T05:02:32.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:32.583+0000 7f2fecab9700 1 --2- 172.21.15.99:0/1403625115 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2fd0038b40 0x7f2fd003b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:32.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:32.583+0000 7f2fecab9700 1 --2- 172.21.15.99:0/1403625115 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2fd0038b40 0x7f2fd003b000 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc00ad30 tx=0x7f2fdc0093f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:32.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:32.588+0000 7f2fe67fc700 1 -- 172.21.15.99:0/1403625115 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f2fe0027070 con 0x7f2fe8100110 2024-01-31T05:02:32.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:32.782+0000 7f2fef51e700 1 -- 172.21.15.99:0/1403625115 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f2fe8062e10 con 0x7f2fe8100110 2024-01-31T05:02:32.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:32.785+0000 7f2fe67fc700 1 -- 172.21.15.99:0/1403625115 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f2fe0013250 con 0x7f2fe8100110 2024-01-31T05:02:32.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:32.787+0000 7f2fef51e700 1 -- 172.21.15.99:0/1403625115 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2fd0038b40 msgr2=0x7f2fd003b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:32.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:32.787+0000 7f2fef51e700 1 --2- 172.21.15.99:0/1403625115 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2fd0038b40 0x7f2fd003b000 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc00ad30 tx=0x7f2fdc0093f0 comp rx=0 tx=0).stop 2024-01-31T05:02:32.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:32.787+0000 7f2fef51e700 1 -- 172.21.15.99:0/1403625115 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2fe8100110 msgr2=0x7f2fe806a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:32.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:32.787+0000 7f2fef51e700 1 --2- 172.21.15.99:0/1403625115 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2fe8100110 0x7f2fe806a0e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0004f70 tx=0x7f2fe0004fa0 comp rx=0 tx=0).stop 2024-01-31T05:02:32.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:32.787+0000 7f2fef51e700 1 -- 172.21.15.99:0/1403625115 shutdown_connections 2024-01-31T05:02:32.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:32.787+0000 7f2fef51e700 1 --2- 172.21.15.99:0/1403625115 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2fd0038b40 0x7f2fd003b000 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:32.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:32.787+0000 7f2fef51e700 1 --2- 172.21.15.99:0/1403625115 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2fe8100110 0x7f2fe806a0e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:32.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:32.787+0000 7f2fef51e700 1 -- 172.21.15.99:0/1403625115 >> 172.21.15.99:0/1403625115 conn(0x7f2fe80fb6d0 msgr2=0x7f2fe80fc170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:02:32.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:32.787+0000 7f2fef51e700 1 -- 172.21.15.99:0/1403625115 shutdown_connections 2024-01-31T05:02:32.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:32.787+0000 7f2fef51e700 1 -- 172.21.15.99:0/1403625115 wait complete. 2024-01-31T05:02:33.064 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:32 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:02:33.064 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:32 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:02:33.065 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:32 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi099", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:02:33.065 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:32 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:02:33.065 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:32 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:02:33.065 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:32 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:02:33.559 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-01-31T05:02:33.559 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-01-31T05:02:34.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:33 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/1403625115' entity='client.admin' 2024-01-31T05:02:34.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:33 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:02:34.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:33 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:02:34.338 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:02:35.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:35.979+0000 7fcf024a2700 1 -- 172.21.15.99:0/4121196636 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcefc102910 msgr2=0x7fcefc102d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:35.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:35.979+0000 7fcf024a2700 1 --2- 172.21.15.99:0/4121196636 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcefc102910 0x7fcefc102d30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fceec009910 tx=0x7fceec009c20 comp rx=0 tx=0).stop 2024-01-31T05:02:35.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:35.979+0000 7fcf024a2700 1 -- 172.21.15.99:0/4121196636 shutdown_connections 2024-01-31T05:02:35.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:35.979+0000 7fcf024a2700 1 --2- 172.21.15.99:0/4121196636 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcefc102910 0x7fcefc102d30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:35.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:35.979+0000 7fcf024a2700 1 -- 172.21.15.99:0/4121196636 >> 172.21.15.99:0/4121196636 conn(0x7fcefc0fc7d0 msgr2=0x7fcefc0fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:02:35.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:35.979+0000 7fcf024a2700 1 -- 172.21.15.99:0/4121196636 shutdown_connections 2024-01-31T05:02:35.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:35.979+0000 7fcf024a2700 1 -- 172.21.15.99:0/4121196636 wait complete. 2024-01-31T05:02:35.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:35.979+0000 7fcf024a2700 1 Processor -- start 2024-01-31T05:02:35.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:35.979+0000 7fcf024a2700 1 -- start start 2024-01-31T05:02:35.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:35.980+0000 7fcf024a2700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcefc102910 0x7fcefc19cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:35.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:35.980+0000 7fcf024a2700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcefc19d2f0 con 0x7fcefc102910 2024-01-31T05:02:35.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:35.980+0000 7fcefbfff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcefc102910 0x7fcefc19cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:35.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:35.980+0000 7fcefbfff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcefc102910 0x7fcefc19cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37438/0 (socket says 172.21.15.99:37438) 2024-01-31T05:02:35.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:35.980+0000 7fcefbfff700 1 -- 172.21.15.99:0/3665864340 learned_addr learned my addr 172.21.15.99:0/3665864340 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:02:35.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:35.980+0000 7fcefbfff700 1 -- 172.21.15.99:0/3665864340 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceec0095f0 con 0x7fcefc102910 2024-01-31T05:02:35.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:35.980+0000 7fcefbfff700 1 --2- 172.21.15.99:0/3665864340 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcefc102910 0x7fcefc19cdb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fceec005950 tx=0x7fceec0057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:35.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:35.980+0000 7fcef97fa700 1 -- 172.21.15.99:0/3665864340 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fceec01d070 con 0x7fcefc102910 2024-01-31T05:02:35.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:35.980+0000 7fcef97fa700 1 -- 172.21.15.99:0/3665864340 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fceec00bc10 con 0x7fcefc102910 2024-01-31T05:02:35.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:35.981+0000 7fcf024a2700 1 -- 172.21.15.99:0/3665864340 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcefc19d4f0 con 0x7fcefc102910 2024-01-31T05:02:35.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:35.981+0000 7fcef97fa700 1 -- 172.21.15.99:0/3665864340 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fceec003a10 con 0x7fcefc102910 2024-01-31T05:02:35.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:35.981+0000 7fcf024a2700 1 -- 172.21.15.99:0/3665864340 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcefc19d990 con 0x7fcefc102910 2024-01-31T05:02:35.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:35.981+0000 7fcef97fa700 1 -- 172.21.15.99:0/3665864340 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 13) v1 ==== 45697+0+0 (secure 0 0 0) 0x7fceec003cd0 con 0x7fcefc102910 2024-01-31T05:02:35.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:35.982+0000 7fcef97fa700 1 --2- 172.21.15.99:0/3665864340 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fcee4038ae0 0x7fcee403afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:35.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:35.982+0000 7fcef97fa700 1 -- 172.21.15.99:0/3665864340 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fceec00bd80 con 0x7fcefc102910 2024-01-31T05:02:35.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:35.982+0000 7fcf024a2700 1 -- 172.21.15.99:0/3665864340 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcefc18e040 con 0x7fcefc102910 2024-01-31T05:02:35.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:35.982+0000 7fcefb7fe700 1 --2- 172.21.15.99:0/3665864340 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fcee4038ae0 0x7fcee403afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:35.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:35.982+0000 7fcefb7fe700 1 --2- 172.21.15.99:0/3665864340 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fcee4038ae0 0x7fcee403afa0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcef0006fd0 tx=0x7fcef0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:35.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:35.987+0000 7fcef97fa700 1 -- 172.21.15.99:0/3665864340 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fceec026020 con 0x7fcefc102910 2024-01-31T05:02:36.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:36.181+0000 7fcf024a2700 1 -- 172.21.15.99:0/3665864340 --> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7fcefc061c20 con 0x7fcee4038ae0 2024-01-31T05:02:36.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:36.184+0000 7fcef97fa700 1 -- 172.21.15.99:0/3665864340 <== mgr.14152 v2:172.21.15.99:6800/3925720924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fcefc061c20 con 0x7fcee4038ae0 2024-01-31T05:02:36.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:36.186+0000 7fcf024a2700 1 -- 172.21.15.99:0/3665864340 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fcee4038ae0 msgr2=0x7fcee403afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:36.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:36.186+0000 7fcf024a2700 1 --2- 172.21.15.99:0/3665864340 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fcee4038ae0 0x7fcee403afa0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcef0006fd0 tx=0x7fcef0006e40 comp rx=0 tx=0).stop 2024-01-31T05:02:36.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:36.186+0000 7fcf024a2700 1 -- 172.21.15.99:0/3665864340 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcefc102910 msgr2=0x7fcefc19cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:36.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:36.186+0000 7fcf024a2700 1 --2- 172.21.15.99:0/3665864340 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcefc102910 0x7fcefc19cdb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fceec005950 tx=0x7fceec0057c0 comp rx=0 tx=0).stop 2024-01-31T05:02:36.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:36.186+0000 7fcf024a2700 1 -- 172.21.15.99:0/3665864340 shutdown_connections 2024-01-31T05:02:36.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:36.186+0000 7fcf024a2700 1 --2- 172.21.15.99:0/3665864340 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fcee4038ae0 0x7fcee403afa0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:36.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:36.186+0000 7fcf024a2700 1 --2- 172.21.15.99:0/3665864340 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcefc102910 0x7fcefc19cdb0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:36.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:36.186+0000 7fcf024a2700 1 -- 172.21.15.99:0/3665864340 >> 172.21.15.99:0/3665864340 conn(0x7fcefc0fc7d0 msgr2=0x7fcefc0fd360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:02:36.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:36.186+0000 7fcf024a2700 1 -- 172.21.15.99:0/3665864340 shutdown_connections 2024-01-31T05:02:36.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:36.186+0000 7fcf024a2700 1 -- 172.21.15.99:0/3665864340 wait complete. 2024-01-31T05:02:36.953 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi179 2024-01-31T05:02:36.953 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-31T05:02:36.953 DEBUG:teuthology.orchestra.run.smithi179:> dd of=/etc/ceph/ceph.conf 2024-01-31T05:02:36.972 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-31T05:02:36.972 DEBUG:teuthology.orchestra.run.smithi179:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-01-31T05:02:37.030 INFO:tasks.cephadm:Adding host smithi179 to orchestrator... 2024-01-31T05:02:37.030 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph orch host add smithi179 2024-01-31T05:02:37.266 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:02:37.476 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:37 smithi099 ceph-mon[31615]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:02:37.477 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:37 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:02:37.477 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:37 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:02:37.477 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:37 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:02:37.477 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:37 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:02:37.477 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:37 smithi099 ceph-mon[31615]: Updating smithi099:/etc/ceph/ceph.conf 2024-01-31T05:02:37.477 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:37 smithi099 ceph-mon[31615]: Updating smithi099:/var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/config/ceph.conf 2024-01-31T05:02:37.477 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:37 smithi099 ceph-mon[31615]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-01-31T05:02:37.477 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:37 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:02:37.477 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:37 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:02:37.477 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:37 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:02:38.447 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:38 smithi099 ceph-mon[31615]: Updating smithi099:/var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/config/ceph.client.admin.keyring 2024-01-31T05:02:38.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:38.750+0000 7f614a255700 1 -- 172.21.15.99:0/1248435414 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6144101420 msgr2=0x7f6144101800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:38.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:38.750+0000 7f614a255700 1 --2- 172.21.15.99:0/1248435414 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6144101420 0x7f6144101800 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6134009910 tx=0x7f6134009c20 comp rx=0 tx=0).stop 2024-01-31T05:02:38.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:38.750+0000 7f614a255700 1 -- 172.21.15.99:0/1248435414 shutdown_connections 2024-01-31T05:02:38.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:38.750+0000 7f614a255700 1 --2- 172.21.15.99:0/1248435414 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6144101420 0x7f6144101800 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:38.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:38.750+0000 7f614a255700 1 -- 172.21.15.99:0/1248435414 >> 172.21.15.99:0/1248435414 conn(0x7f61440fccd0 msgr2=0x7f61440ff0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:02:38.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:38.750+0000 7f614a255700 1 -- 172.21.15.99:0/1248435414 shutdown_connections 2024-01-31T05:02:38.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:38.750+0000 7f614a255700 1 -- 172.21.15.99:0/1248435414 wait complete. 2024-01-31T05:02:38.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:38.751+0000 7f614a255700 1 Processor -- start 2024-01-31T05:02:38.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:38.751+0000 7f614a255700 1 -- start start 2024-01-31T05:02:38.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:38.751+0000 7f614a255700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6144101420 0x7f614419c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:38.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:38.751+0000 7f614a255700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614419cc40 con 0x7f6144101420 2024-01-31T05:02:38.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:38.751+0000 7f61437fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6144101420 0x7f614419c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:38.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:38.751+0000 7f61437fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6144101420 0x7f614419c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37462/0 (socket says 172.21.15.99:37462) 2024-01-31T05:02:38.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:38.751+0000 7f61437fe700 1 -- 172.21.15.99:0/1983203632 learned_addr learned my addr 172.21.15.99:0/1983203632 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:02:38.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:38.752+0000 7f61437fe700 1 -- 172.21.15.99:0/1983203632 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61340095f0 con 0x7f6144101420 2024-01-31T05:02:38.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:38.752+0000 7f61437fe700 1 --2- 172.21.15.99:0/1983203632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6144101420 0x7f614419c700 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6134004f40 tx=0x7f6134005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:38.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:38.752+0000 7f61417fa700 1 -- 172.21.15.99:0/1983203632 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f613401d070 con 0x7f6144101420 2024-01-31T05:02:38.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:38.752+0000 7f61417fa700 1 -- 172.21.15.99:0/1983203632 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f613400bc10 con 0x7f6144101420 2024-01-31T05:02:38.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:38.752+0000 7f614a255700 1 -- 172.21.15.99:0/1983203632 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f614419ce40 con 0x7f6144101420 2024-01-31T05:02:38.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:38.752+0000 7f61417fa700 1 -- 172.21.15.99:0/1983203632 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61340037d0 con 0x7f6144101420 2024-01-31T05:02:38.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:38.752+0000 7f614a255700 1 -- 172.21.15.99:0/1983203632 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f614419d260 con 0x7f6144101420 2024-01-31T05:02:38.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:38.753+0000 7f61417fa700 1 -- 172.21.15.99:0/1983203632 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 13) v1 ==== 45697+0+0 (secure 0 0 0) 0x7f613400b6f0 con 0x7f6144101420 2024-01-31T05:02:38.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:38.753+0000 7f614a255700 1 -- 172.21.15.99:0/1983203632 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6144062e10 con 0x7f6144101420 2024-01-31T05:02:38.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:38.753+0000 7f61417fa700 1 --2- 172.21.15.99:0/1983203632 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f6130038b40 0x7f613003b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:38.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:38.753+0000 7f61417fa700 1 -- 172.21.15.99:0/1983203632 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f613404c6d0 con 0x7f6144101420 2024-01-31T05:02:38.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:38.753+0000 7f613affd700 1 --2- 172.21.15.99:0/1983203632 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f6130038b40 0x7f613003b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:38.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:38.753+0000 7f613affd700 1 --2- 172.21.15.99:0/1983203632 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f6130038b40 0x7f613003b000 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f612c006fd0 tx=0x7f612c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:38.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:38.758+0000 7f61417fa700 1 -- 172.21.15.99:0/1983203632 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f6134029540 con 0x7f6144101420 2024-01-31T05:02:38.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:38.951+0000 7f614a255700 1 -- 172.21.15.99:0/1983203632 --> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi179", "target": ["mon-mgr", ""]}) v1 -- 0x7f614410b580 con 0x7f6130038b40 2024-01-31T05:02:40.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:39 smithi099 ceph-mon[31615]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi179", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:02:40.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:39 smithi099 ceph-mon[31615]: Deploying cephadm binary to smithi179 2024-01-31T05:02:41.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:40 smithi099 ceph-mon[31615]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:02:43.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:43.005+0000 7f61417fa700 1 -- 172.21.15.99:0/1983203632 <== mgr.14152 v2:172.21.15.99:6800/3925720924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f614410b580 con 0x7f6130038b40 2024-01-31T05:02:43.006 INFO:teuthology.orchestra.run.smithi099.stdout:Added host 'smithi179' with addr '172.21.15.179' 2024-01-31T05:02:43.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:43.008+0000 7f614a255700 1 -- 172.21.15.99:0/1983203632 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f6130038b40 msgr2=0x7f613003b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:43.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:43.008+0000 7f614a255700 1 --2- 172.21.15.99:0/1983203632 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f6130038b40 0x7f613003b000 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f612c006fd0 tx=0x7f612c006e40 comp rx=0 tx=0).stop 2024-01-31T05:02:43.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:43.008+0000 7f614a255700 1 -- 172.21.15.99:0/1983203632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6144101420 msgr2=0x7f614419c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:43.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:43.008+0000 7f614a255700 1 --2- 172.21.15.99:0/1983203632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6144101420 0x7f614419c700 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6134004f40 tx=0x7f6134005020 comp rx=0 tx=0).stop 2024-01-31T05:02:43.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:43.008+0000 7f614a255700 1 -- 172.21.15.99:0/1983203632 shutdown_connections 2024-01-31T05:02:43.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:43.008+0000 7f614a255700 1 --2- 172.21.15.99:0/1983203632 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f6130038b40 0x7f613003b000 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:43.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:43.008+0000 7f614a255700 1 --2- 172.21.15.99:0/1983203632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6144101420 0x7f614419c700 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:43.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:43.008+0000 7f614a255700 1 -- 172.21.15.99:0/1983203632 >> 172.21.15.99:0/1983203632 conn(0x7f61440fccd0 msgr2=0x7f6144102df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:02:43.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:43.008+0000 7f614a255700 1 -- 172.21.15.99:0/1983203632 shutdown_connections 2024-01-31T05:02:43.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:43.008+0000 7f614a255700 1 -- 172.21.15.99:0/1983203632 wait complete. 2024-01-31T05:02:43.316 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:43 smithi099 ceph-mon[31615]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:02:43.316 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:43 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:02:43.316 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:43 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:02:43.663 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph orch host ls --format=json 2024-01-31T05:02:43.897 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:02:44.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:44 smithi099 ceph-mon[31615]: Added host smithi179 2024-01-31T05:02:44.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:44 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:02:44.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:44 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:02:45.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:45.438+0000 7f47fcd21700 1 -- 172.21.15.99:0/532179119 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47f8100320 msgr2=0x7f47f8100700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:45.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:45.438+0000 7f47fcd21700 1 --2- 172.21.15.99:0/532179119 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47f8100320 0x7f47f8100700 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f47ec009910 tx=0x7f47ec009c20 comp rx=0 tx=0).stop 2024-01-31T05:02:45.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:45.438+0000 7f47fcd21700 1 -- 172.21.15.99:0/532179119 shutdown_connections 2024-01-31T05:02:45.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:45.438+0000 7f47fcd21700 1 --2- 172.21.15.99:0/532179119 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47f8100320 0x7f47f8100700 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:45.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:45.438+0000 7f47fcd21700 1 -- 172.21.15.99:0/532179119 >> 172.21.15.99:0/532179119 conn(0x7f47f80fbbd0 msgr2=0x7f47f80fdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:02:45.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:45.438+0000 7f47fcd21700 1 -- 172.21.15.99:0/532179119 shutdown_connections 2024-01-31T05:02:45.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:45.439+0000 7f47fcd21700 1 -- 172.21.15.99:0/532179119 wait complete. 2024-01-31T05:02:45.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:45.439+0000 7f47fcd21700 1 Processor -- start 2024-01-31T05:02:45.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:45.439+0000 7f47fcd21700 1 -- start start 2024-01-31T05:02:45.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:45.439+0000 7f47fcd21700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47f8100320 0x7f47f8101dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:45.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:45.439+0000 7f47fcd21700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f8103cb0 con 0x7f47f8100320 2024-01-31T05:02:45.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:45.440+0000 7f47f659c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47f8100320 0x7f47f8101dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:45.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:45.440+0000 7f47f659c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47f8100320 0x7f47f8101dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48838/0 (socket says 172.21.15.99:48838) 2024-01-31T05:02:45.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:45.440+0000 7f47f659c700 1 -- 172.21.15.99:0/3391586924 learned_addr learned my addr 172.21.15.99:0/3391586924 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:02:45.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:45.440+0000 7f47f659c700 1 -- 172.21.15.99:0/3391586924 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47ec0095f0 con 0x7f47f8100320 2024-01-31T05:02:45.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:45.440+0000 7f47f659c700 1 --2- 172.21.15.99:0/3391586924 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47f8100320 0x7f47f8101dc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f47ec004f40 tx=0x7f47ec005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:45.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:45.440+0000 7f47e77fe700 1 -- 172.21.15.99:0/3391586924 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f47ec01d070 con 0x7f47f8100320 2024-01-31T05:02:45.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:45.440+0000 7f47fcd21700 1 -- 172.21.15.99:0/3391586924 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47f8102300 con 0x7f47f8100320 2024-01-31T05:02:45.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:45.440+0000 7f47e77fe700 1 -- 172.21.15.99:0/3391586924 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f47ec00bc10 con 0x7f47f8100320 2024-01-31T05:02:45.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:45.440+0000 7f47e77fe700 1 -- 172.21.15.99:0/3391586924 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f47ec0037d0 con 0x7f47f8100320 2024-01-31T05:02:45.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:45.440+0000 7f47fcd21700 1 -- 172.21.15.99:0/3391586924 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47f8102720 con 0x7f47f8100320 2024-01-31T05:02:45.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:45.441+0000 7f47e77fe700 1 -- 172.21.15.99:0/3391586924 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 13) v1 ==== 45697+0+0 (secure 0 0 0) 0x7f47ec003a90 con 0x7f47f8100320 2024-01-31T05:02:45.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:45.441+0000 7f47fcd21700 1 -- 172.21.15.99:0/3391586924 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47f8062e10 con 0x7f47f8100320 2024-01-31T05:02:45.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:45.441+0000 7f47e77fe700 1 --2- 172.21.15.99:0/3391586924 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f47e0038ae0 0x7f47e003afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:45.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:45.441+0000 7f47e77fe700 1 -- 172.21.15.99:0/3391586924 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f47ec04c8d0 con 0x7f47f8100320 2024-01-31T05:02:45.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:45.441+0000 7f47f5d9b700 1 --2- 172.21.15.99:0/3391586924 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f47e0038ae0 0x7f47e003afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:45.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:45.442+0000 7f47f5d9b700 1 --2- 172.21.15.99:0/3391586924 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f47e0038ae0 0x7f47e003afa0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f47e8006fd0 tx=0x7f47e8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:45.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:45.446+0000 7f47e77fe700 1 -- 172.21.15.99:0/3391586924 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f47ec029770 con 0x7f47f8100320 2024-01-31T05:02:45.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:45.654+0000 7f47fcd21700 1 -- 172.21.15.99:0/3391586924 --> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f47f810a520 con 0x7f47e0038ae0 2024-01-31T05:02:45.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:45.656+0000 7f47e77fe700 1 -- 172.21.15.99:0/3391586924 <== mgr.14152 v2:172.21.15.99:6800/3925720924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7f47f810a520 con 0x7f47e0038ae0 2024-01-31T05:02:45.655 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:02:45.655 INFO:teuthology.orchestra.run.smithi099.stdout:[{"addr": "172.21.15.99", "hostname": "smithi099", "labels": [], "status": ""}, {"addr": "172.21.15.179", "hostname": "smithi179", "labels": [], "status": ""}] 2024-01-31T05:02:45.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:45.658+0000 7f47fcd21700 1 -- 172.21.15.99:0/3391586924 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f47e0038ae0 msgr2=0x7f47e003afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:45.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:45.658+0000 7f47fcd21700 1 --2- 172.21.15.99:0/3391586924 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f47e0038ae0 0x7f47e003afa0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f47e8006fd0 tx=0x7f47e8006e40 comp rx=0 tx=0).stop 2024-01-31T05:02:45.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:45.658+0000 7f47fcd21700 1 -- 172.21.15.99:0/3391586924 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47f8100320 msgr2=0x7f47f8101dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:45.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:45.658+0000 7f47fcd21700 1 --2- 172.21.15.99:0/3391586924 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47f8100320 0x7f47f8101dc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f47ec004f40 tx=0x7f47ec005020 comp rx=0 tx=0).stop 2024-01-31T05:02:45.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:45.658+0000 7f47fcd21700 1 -- 172.21.15.99:0/3391586924 shutdown_connections 2024-01-31T05:02:45.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:45.658+0000 7f47fcd21700 1 --2- 172.21.15.99:0/3391586924 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f47e0038ae0 0x7f47e003afa0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:45.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:45.658+0000 7f47fcd21700 1 --2- 172.21.15.99:0/3391586924 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47f8100320 0x7f47f8101dc0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:45.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:45.658+0000 7f47fcd21700 1 -- 172.21.15.99:0/3391586924 >> 172.21.15.99:0/3391586924 conn(0x7f47f80fbbd0 msgr2=0x7f47f8069640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:02:45.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:45.658+0000 7f47fcd21700 1 -- 172.21.15.99:0/3391586924 shutdown_connections 2024-01-31T05:02:45.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:45.658+0000 7f47fcd21700 1 -- 172.21.15.99:0/3391586924 wait complete. 2024-01-31T05:02:45.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:45 smithi099 ceph-mon[31615]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:02:46.246 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi181 2024-01-31T05:02:46.246 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-01-31T05:02:46.246 DEBUG:teuthology.orchestra.run.smithi181:> dd of=/etc/ceph/ceph.conf 2024-01-31T05:02:46.265 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-01-31T05:02:46.265 DEBUG:teuthology.orchestra.run.smithi181:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-01-31T05:02:46.322 INFO:tasks.cephadm:Adding host smithi181 to orchestrator... 2024-01-31T05:02:46.323 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph orch host add smithi181 2024-01-31T05:02:46.555 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:02:46.893 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:46 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:02:46.893 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:46 smithi099 ceph-mon[31615]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-31T05:02:47.848 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:47 smithi099 ceph-mon[31615]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:02:48.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:48.059+0000 7f1b7a459700 1 -- 172.21.15.99:0/1939227497 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b74101420 msgr2=0x7f1b74101800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:48.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:48.059+0000 7f1b7a459700 1 --2- 172.21.15.99:0/1939227497 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b74101420 0x7f1b74101800 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1b64009910 tx=0x7f1b64009c20 comp rx=0 tx=0).stop 2024-01-31T05:02:48.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:48.059+0000 7f1b7a459700 1 -- 172.21.15.99:0/1939227497 shutdown_connections 2024-01-31T05:02:48.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:48.059+0000 7f1b7a459700 1 --2- 172.21.15.99:0/1939227497 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b74101420 0x7f1b74101800 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:48.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:48.059+0000 7f1b7a459700 1 -- 172.21.15.99:0/1939227497 >> 172.21.15.99:0/1939227497 conn(0x7f1b740fccf0 msgr2=0x7f1b740ff110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:02:48.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:48.059+0000 7f1b7a459700 1 -- 172.21.15.99:0/1939227497 shutdown_connections 2024-01-31T05:02:48.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:48.059+0000 7f1b7a459700 1 -- 172.21.15.99:0/1939227497 wait complete. 2024-01-31T05:02:48.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:48.060+0000 7f1b7a459700 1 Processor -- start 2024-01-31T05:02:48.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:48.060+0000 7f1b7a459700 1 -- start start 2024-01-31T05:02:48.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:48.060+0000 7f1b7a459700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b74101420 0x7f1b7419c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:48.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:48.060+0000 7f1b7a459700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7419cc00 con 0x7f1b74101420 2024-01-31T05:02:48.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:48.060+0000 7f1b73fff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b74101420 0x7f1b7419c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:48.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:48.060+0000 7f1b73fff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b74101420 0x7f1b7419c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48860/0 (socket says 172.21.15.99:48860) 2024-01-31T05:02:48.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:48.060+0000 7f1b73fff700 1 -- 172.21.15.99:0/2510284245 learned_addr learned my addr 172.21.15.99:0/2510284245 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:02:48.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:48.060+0000 7f1b73fff700 1 -- 172.21.15.99:0/2510284245 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b640095f0 con 0x7f1b74101420 2024-01-31T05:02:48.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:48.060+0000 7f1b73fff700 1 --2- 172.21.15.99:0/2510284245 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b74101420 0x7f1b7419c6c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1b64004f40 tx=0x7f1b64005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:48.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:48.061+0000 7f1b717fa700 1 -- 172.21.15.99:0/2510284245 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b6401d070 con 0x7f1b74101420 2024-01-31T05:02:48.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:48.061+0000 7f1b717fa700 1 -- 172.21.15.99:0/2510284245 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1b6400bc10 con 0x7f1b74101420 2024-01-31T05:02:48.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:48.061+0000 7f1b717fa700 1 -- 172.21.15.99:0/2510284245 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b640037d0 con 0x7f1b74101420 2024-01-31T05:02:48.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:48.061+0000 7f1b7a459700 1 -- 172.21.15.99:0/2510284245 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b7419ce00 con 0x7f1b74101420 2024-01-31T05:02:48.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:48.061+0000 7f1b7a459700 1 -- 172.21.15.99:0/2510284245 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b7419d220 con 0x7f1b74101420 2024-01-31T05:02:48.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:48.061+0000 7f1b717fa700 1 -- 172.21.15.99:0/2510284245 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 13) v1 ==== 45697+0+0 (secure 0 0 0) 0x7f1b64003a40 con 0x7f1b74101420 2024-01-31T05:02:48.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:48.062+0000 7f1b7a459700 1 -- 172.21.15.99:0/2510284245 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b74102900 con 0x7f1b74101420 2024-01-31T05:02:48.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:48.062+0000 7f1b717fa700 1 --2- 172.21.15.99:0/2510284245 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f1b5c038b40 0x7f1b5c03b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:48.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:48.062+0000 7f1b717fa700 1 -- 172.21.15.99:0/2510284245 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f1b6404c8a0 con 0x7f1b74101420 2024-01-31T05:02:48.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:48.062+0000 7f1b737fe700 1 --2- 172.21.15.99:0/2510284245 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f1b5c038b40 0x7f1b5c03b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:48.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:48.062+0000 7f1b737fe700 1 --2- 172.21.15.99:0/2510284245 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f1b5c038b40 0x7f1b5c03b000 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1b68006fd0 tx=0x7f1b68006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:48.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:48.067+0000 7f1b717fa700 1 -- 172.21.15.99:0/2510284245 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f1b6402be60 con 0x7f1b74101420 2024-01-31T05:02:48.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:48.261+0000 7f1b7a459700 1 -- 172.21.15.99:0/2510284245 --> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi181", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b7410b5f0 con 0x7f1b5c038b40 2024-01-31T05:02:50.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:49 smithi099 ceph-mon[31615]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi181", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:02:50.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:49 smithi099 ceph-mon[31615]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:02:50.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:49 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:02:50.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:49 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:02:50.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:49 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:02:50.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:49 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:02:50.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:49 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi179", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:02:50.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:49 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:02:50.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:49 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:02:50.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:49 smithi099 ceph-mon[31615]: Updating smithi179:/etc/ceph/ceph.conf 2024-01-31T05:02:51.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:50 smithi099 ceph-mon[31615]: Updating smithi179:/var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/config/ceph.conf 2024-01-31T05:02:51.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:50 smithi099 ceph-mon[31615]: Deploying cephadm binary to smithi181 2024-01-31T05:02:51.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:50 smithi099 ceph-mon[31615]: Updating smithi179:/etc/ceph/ceph.client.admin.keyring 2024-01-31T05:02:51.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:50 smithi099 ceph-mon[31615]: Updating smithi179:/var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/config/ceph.client.admin.keyring 2024-01-31T05:02:52.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:51 smithi099 ceph-mon[31615]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:02:52.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:52.522+0000 7f1b717fa700 1 -- 172.21.15.99:0/2510284245 <== mgr.14152 v2:172.21.15.99:6800/3925720924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f1b7410b5f0 con 0x7f1b5c038b40 2024-01-31T05:02:52.521 INFO:teuthology.orchestra.run.smithi099.stdout:Added host 'smithi181' with addr '172.21.15.181' 2024-01-31T05:02:52.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:52.524+0000 7f1b7a459700 1 -- 172.21.15.99:0/2510284245 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f1b5c038b40 msgr2=0x7f1b5c03b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:52.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:52.524+0000 7f1b7a459700 1 --2- 172.21.15.99:0/2510284245 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f1b5c038b40 0x7f1b5c03b000 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1b68006fd0 tx=0x7f1b68006e40 comp rx=0 tx=0).stop 2024-01-31T05:02:52.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:52.524+0000 7f1b7a459700 1 -- 172.21.15.99:0/2510284245 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b74101420 msgr2=0x7f1b7419c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:52.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:52.524+0000 7f1b7a459700 1 --2- 172.21.15.99:0/2510284245 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b74101420 0x7f1b7419c6c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1b64004f40 tx=0x7f1b64005020 comp rx=0 tx=0).stop 2024-01-31T05:02:52.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:52.524+0000 7f1b7a459700 1 -- 172.21.15.99:0/2510284245 shutdown_connections 2024-01-31T05:02:52.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:52.524+0000 7f1b7a459700 1 --2- 172.21.15.99:0/2510284245 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f1b5c038b40 0x7f1b5c03b000 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:52.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:52.524+0000 7f1b7a459700 1 --2- 172.21.15.99:0/2510284245 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b74101420 0x7f1b7419c6c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:52.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:52.524+0000 7f1b7a459700 1 -- 172.21.15.99:0/2510284245 >> 172.21.15.99:0/2510284245 conn(0x7f1b740fccf0 msgr2=0x7f1b74102df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:02:52.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:52.524+0000 7f1b7a459700 1 -- 172.21.15.99:0/2510284245 shutdown_connections 2024-01-31T05:02:52.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:52.524+0000 7f1b7a459700 1 -- 172.21.15.99:0/2510284245 wait complete. 2024-01-31T05:02:52.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:52 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:02:52.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:52 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:02:52.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:52 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:02:52.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:52 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:02:52.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:52 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:02:53.162 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph orch host ls --format=json 2024-01-31T05:02:53.400 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:02:53.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:53 smithi099 ceph-mon[31615]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:02:53.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:53 smithi099 ceph-mon[31615]: Added host smithi181 2024-01-31T05:02:53.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:53 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:02:53.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:53 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:02:54.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:54.964+0000 7f1063af2700 1 -- 172.21.15.99:0/1437547292 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f105c1061f0 msgr2=0x7f105c1065d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:54.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:54.964+0000 7f1063af2700 1 --2- 172.21.15.99:0/1437547292 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f105c1061f0 0x7f105c1065d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1054009910 tx=0x7f1054009c20 comp rx=0 tx=0).stop 2024-01-31T05:02:54.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:54.964+0000 7f1063af2700 1 -- 172.21.15.99:0/1437547292 shutdown_connections 2024-01-31T05:02:54.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:54.964+0000 7f1063af2700 1 --2- 172.21.15.99:0/1437547292 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f105c1061f0 0x7f105c1065d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:54.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:54.964+0000 7f1063af2700 1 -- 172.21.15.99:0/1437547292 >> 172.21.15.99:0/1437547292 conn(0x7f105c0fb330 msgr2=0x7f105c0fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:02:54.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:54.964+0000 7f1063af2700 1 -- 172.21.15.99:0/1437547292 shutdown_connections 2024-01-31T05:02:54.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:54.964+0000 7f1063af2700 1 -- 172.21.15.99:0/1437547292 wait complete. 2024-01-31T05:02:54.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:54.964+0000 7f1063af2700 1 Processor -- start 2024-01-31T05:02:54.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:54.964+0000 7f1063af2700 1 -- start start 2024-01-31T05:02:54.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:54.964+0000 7f1063af2700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f105c1061f0 0x7f105c19c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:54.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:54.964+0000 7f1063af2700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105c19cbf0 con 0x7f105c1061f0 2024-01-31T05:02:54.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:54.965+0000 7f106188e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f105c1061f0 0x7f105c19c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:54.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:54.965+0000 7f106188e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f105c1061f0 0x7f105c19c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48878/0 (socket says 172.21.15.99:48878) 2024-01-31T05:02:54.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:54.965+0000 7f106188e700 1 -- 172.21.15.99:0/496169374 learned_addr learned my addr 172.21.15.99:0/496169374 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:02:54.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:54.965+0000 7f106188e700 1 -- 172.21.15.99:0/496169374 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10540095f0 con 0x7f105c1061f0 2024-01-31T05:02:54.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:54.965+0000 7f106188e700 1 --2- 172.21.15.99:0/496169374 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f105c1061f0 0x7f105c19c6b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1054004f40 tx=0x7f1054005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:54.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:54.965+0000 7f105affd700 1 -- 172.21.15.99:0/496169374 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f105401d070 con 0x7f105c1061f0 2024-01-31T05:02:54.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:54.965+0000 7f105affd700 1 -- 172.21.15.99:0/496169374 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f105400bc10 con 0x7f105c1061f0 2024-01-31T05:02:54.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:54.965+0000 7f1063af2700 1 -- 172.21.15.99:0/496169374 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f105c19cdf0 con 0x7f105c1061f0 2024-01-31T05:02:54.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:54.965+0000 7f105affd700 1 -- 172.21.15.99:0/496169374 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f10540037d0 con 0x7f105c1061f0 2024-01-31T05:02:54.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:54.965+0000 7f1063af2700 1 -- 172.21.15.99:0/496169374 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f105c19d210 con 0x7f105c1061f0 2024-01-31T05:02:54.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:54.966+0000 7f105affd700 1 -- 172.21.15.99:0/496169374 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 13) v1 ==== 45697+0+0 (secure 0 0 0) 0x7f105400b6f0 con 0x7f105c1061f0 2024-01-31T05:02:54.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:54.966+0000 7f1063af2700 1 -- 172.21.15.99:0/496169374 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f105c062e10 con 0x7f105c1061f0 2024-01-31T05:02:54.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:54.966+0000 7f105affd700 1 --2- 172.21.15.99:0/496169374 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f1044038b40 0x7f104403b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:54.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:54.966+0000 7f105affd700 1 -- 172.21.15.99:0/496169374 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f105404c720 con 0x7f105c1061f0 2024-01-31T05:02:54.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:54.966+0000 7f106108d700 1 --2- 172.21.15.99:0/496169374 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f1044038b40 0x7f104403b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:54.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:54.967+0000 7f106108d700 1 --2- 172.21.15.99:0/496169374 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f1044038b40 0x7f104403b000 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f105000ad30 tx=0x7f10500093f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:54.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:54.971+0000 7f105affd700 1 -- 172.21.15.99:0/496169374 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f1054004440 con 0x7f105c1061f0 2024-01-31T05:02:55.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:55.168+0000 7f1063af2700 1 -- 172.21.15.99:0/496169374 --> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f105c10b710 con 0x7f1044038b40 2024-01-31T05:02:55.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:55.170+0000 7f105affd700 1 -- 172.21.15.99:0/496169374 <== mgr.14152 v2:172.21.15.99:6800/3925720924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+240 (secure 0 0 0) 0x7f105c10b710 con 0x7f1044038b40 2024-01-31T05:02:55.169 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:02:55.169 INFO:teuthology.orchestra.run.smithi099.stdout:[{"addr": "172.21.15.99", "hostname": "smithi099", "labels": [], "status": ""}, {"addr": "172.21.15.179", "hostname": "smithi179", "labels": [], "status": ""}, {"addr": "172.21.15.181", "hostname": "smithi181", "labels": [], "status": ""}] 2024-01-31T05:02:55.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:55.172+0000 7f1063af2700 1 -- 172.21.15.99:0/496169374 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f1044038b40 msgr2=0x7f104403b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:55.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:55.172+0000 7f1063af2700 1 --2- 172.21.15.99:0/496169374 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f1044038b40 0x7f104403b000 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f105000ad30 tx=0x7f10500093f0 comp rx=0 tx=0).stop 2024-01-31T05:02:55.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:55.172+0000 7f1063af2700 1 -- 172.21.15.99:0/496169374 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f105c1061f0 msgr2=0x7f105c19c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:55.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:55.172+0000 7f1063af2700 1 --2- 172.21.15.99:0/496169374 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f105c1061f0 0x7f105c19c6b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1054004f40 tx=0x7f1054005020 comp rx=0 tx=0).stop 2024-01-31T05:02:55.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:55.172+0000 7f1063af2700 1 -- 172.21.15.99:0/496169374 shutdown_connections 2024-01-31T05:02:55.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:55.172+0000 7f1063af2700 1 --2- 172.21.15.99:0/496169374 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f1044038b40 0x7f104403b000 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:55.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:55.172+0000 7f1063af2700 1 --2- 172.21.15.99:0/496169374 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f105c1061f0 0x7f105c19c6b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:55.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:55.172+0000 7f1063af2700 1 -- 172.21.15.99:0/496169374 >> 172.21.15.99:0/496169374 conn(0x7f105c0fb330 msgr2=0x7f105c108d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:02:55.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:55.172+0000 7f1063af2700 1 -- 172.21.15.99:0/496169374 shutdown_connections 2024-01-31T05:02:55.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:55.172+0000 7f1063af2700 1 -- 172.21.15.99:0/496169374 wait complete. 2024-01-31T05:02:55.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:55 smithi099 ceph-mon[31615]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:02:55.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:55 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:02:55.877 INFO:tasks.cephadm:Setting crush tunables to default 2024-01-31T05:02:55.878 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph osd crush tunables default 2024-01-31T05:02:56.108 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:02:56.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:56 smithi099 ceph-mon[31615]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-31T05:02:57.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:57.660+0000 7f3406a2b700 1 -- 172.21.15.99:0/1043555139 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3400100320 msgr2=0x7f3400100700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:57.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:57.660+0000 7f3406a2b700 1 --2- 172.21.15.99:0/1043555139 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3400100320 0x7f3400100700 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f33f0009910 tx=0x7f33f0009c20 comp rx=0 tx=0).stop 2024-01-31T05:02:57.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:57.660+0000 7f3406a2b700 1 -- 172.21.15.99:0/1043555139 shutdown_connections 2024-01-31T05:02:57.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:57.660+0000 7f3406a2b700 1 --2- 172.21.15.99:0/1043555139 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3400100320 0x7f3400100700 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:57.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:57.660+0000 7f3406a2b700 1 -- 172.21.15.99:0/1043555139 >> 172.21.15.99:0/1043555139 conn(0x7f34000fbbd0 msgr2=0x7f34000fdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:02:57.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:57.660+0000 7f3406a2b700 1 -- 172.21.15.99:0/1043555139 shutdown_connections 2024-01-31T05:02:57.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:57.660+0000 7f3406a2b700 1 -- 172.21.15.99:0/1043555139 wait complete. 2024-01-31T05:02:57.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:57.661+0000 7f3406a2b700 1 Processor -- start 2024-01-31T05:02:57.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:57.661+0000 7f3406a2b700 1 -- start start 2024-01-31T05:02:57.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:57.662+0000 7f3406a2b700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3400100320 0x7f3400101dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:57.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:57.662+0000 7f3406a2b700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3400103c60 con 0x7f3400100320 2024-01-31T05:02:57.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:57.662+0000 7f33fffff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3400100320 0x7f3400101dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:57.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:57.662+0000 7f33fffff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3400100320 0x7f3400101dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57528/0 (socket says 172.21.15.99:57528) 2024-01-31T05:02:57.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:57.662+0000 7f33fffff700 1 -- 172.21.15.99:0/3743365578 learned_addr learned my addr 172.21.15.99:0/3743365578 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:02:57.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:57.662+0000 7f33fffff700 1 -- 172.21.15.99:0/3743365578 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f00095f0 con 0x7f3400100320 2024-01-31T05:02:57.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:57.662+0000 7f33fffff700 1 --2- 172.21.15.99:0/3743365578 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3400100320 0x7f3400101dc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f33f0004f40 tx=0x7f33f0005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:57.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:57.662+0000 7f33fd7fa700 1 -- 172.21.15.99:0/3743365578 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f33f001d070 con 0x7f3400100320 2024-01-31T05:02:57.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:57.662+0000 7f3406a2b700 1 -- 172.21.15.99:0/3743365578 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3400102300 con 0x7f3400100320 2024-01-31T05:02:57.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:57.662+0000 7f33fd7fa700 1 -- 172.21.15.99:0/3743365578 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f33f000bc10 con 0x7f3400100320 2024-01-31T05:02:57.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:57.662+0000 7f33fd7fa700 1 -- 172.21.15.99:0/3743365578 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f33f00037d0 con 0x7f3400100320 2024-01-31T05:02:57.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:57.662+0000 7f3406a2b700 1 -- 172.21.15.99:0/3743365578 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3400102720 con 0x7f3400100320 2024-01-31T05:02:57.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:57.663+0000 7f33fd7fa700 1 -- 172.21.15.99:0/3743365578 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 13) v1 ==== 45697+0+0 (secure 0 0 0) 0x7f33f0003a90 con 0x7f3400100320 2024-01-31T05:02:57.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:57.663+0000 7f3406a2b700 1 -- 172.21.15.99:0/3743365578 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3400062e10 con 0x7f3400100320 2024-01-31T05:02:57.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:57.663+0000 7f33fd7fa700 1 --2- 172.21.15.99:0/3743365578 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f33e8038ae0 0x7f33e803afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:02:57.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:57.663+0000 7f33fd7fa700 1 -- 172.21.15.99:0/3743365578 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f33f004ca10 con 0x7f3400100320 2024-01-31T05:02:57.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:57.663+0000 7f33ff7fe700 1 --2- 172.21.15.99:0/3743365578 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f33e8038ae0 0x7f33e803afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:02:57.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:57.664+0000 7f33ff7fe700 1 --2- 172.21.15.99:0/3743365578 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f33e8038ae0 0x7f33e803afa0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f33f4006fd0 tx=0x7f33f4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:02:57.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:57.668+0000 7f33fd7fa700 1 -- 172.21.15.99:0/3743365578 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f33f0029360 con 0x7f3400100320 2024-01-31T05:02:57.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:57 smithi099 ceph-mon[31615]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:02:57.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:57.864+0000 7f3406a2b700 1 -- 172.21.15.99:0/3743365578 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f340010a440 con 0x7f3400100320 2024-01-31T05:02:58.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:58.658+0000 7f33fd7fa700 1 -- 172.21.15.99:0/3743365578 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f33f0026070 con 0x7f3400100320 2024-01-31T05:02:58.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:58.660+0000 7f3406a2b700 1 -- 172.21.15.99:0/3743365578 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f33e8038ae0 msgr2=0x7f33e803afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:58.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:58.660+0000 7f3406a2b700 1 --2- 172.21.15.99:0/3743365578 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f33e8038ae0 0x7f33e803afa0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f33f4006fd0 tx=0x7f33f4006e40 comp rx=0 tx=0).stop 2024-01-31T05:02:58.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:58.660+0000 7f3406a2b700 1 -- 172.21.15.99:0/3743365578 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3400100320 msgr2=0x7f3400101dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:02:58.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:58.660+0000 7f3406a2b700 1 --2- 172.21.15.99:0/3743365578 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3400100320 0x7f3400101dc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f33f0004f40 tx=0x7f33f0005020 comp rx=0 tx=0).stop 2024-01-31T05:02:58.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:58.660+0000 7f3406a2b700 1 -- 172.21.15.99:0/3743365578 shutdown_connections 2024-01-31T05:02:58.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:58.660+0000 7f3406a2b700 1 --2- 172.21.15.99:0/3743365578 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f33e8038ae0 0x7f33e803afa0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:58.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:58.660+0000 7f3406a2b700 1 --2- 172.21.15.99:0/3743365578 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3400100320 0x7f3400101dc0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:02:58.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:58.660+0000 7f3406a2b700 1 -- 172.21.15.99:0/3743365578 >> 172.21.15.99:0/3743365578 conn(0x7f34000fbbd0 msgr2=0x7f3400069660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:02:58.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:58.660+0000 7f3406a2b700 1 -- 172.21.15.99:0/3743365578 shutdown_connections 2024-01-31T05:02:58.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:02:58.660+0000 7f3406a2b700 1 -- 172.21.15.99:0/3743365578 wait complete. 2024-01-31T05:02:58.661 INFO:teuthology.orchestra.run.smithi099.stderr:adjusted tunables profile to default 2024-01-31T05:02:58.722 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:58 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/3743365578' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-01-31T05:02:58.723 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:58 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:02:58.723 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:58 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:02:58.723 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:58 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:02:58.723 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:58 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:02:58.723 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:58 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:02:58.723 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:58 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:02:58.723 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:58 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:02:59.358 INFO:tasks.cephadm:Adding mon.a on smithi099 2024-01-31T05:02:59.358 INFO:tasks.cephadm:Adding mon.b on smithi179 2024-01-31T05:02:59.358 INFO:tasks.cephadm:Adding mon.c on smithi181 2024-01-31T05:02:59.358 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph orch apply mon '3;smithi099:172.21.15.99=a;smithi179:172.21.15.179=b;smithi181:172.21.15.181=c' 2024-01-31T05:02:59.584 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/config/ceph.conf 2024-01-31T05:03:00.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:59 smithi099 ceph-mon[31615]: Updating smithi181:/etc/ceph/ceph.conf 2024-01-31T05:03:00.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:59 smithi099 ceph-mon[31615]: Updating smithi181:/var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/config/ceph.conf 2024-01-31T05:03:00.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:59 smithi099 ceph-mon[31615]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:00.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:59 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/3743365578' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-01-31T05:03:00.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:59 smithi099 ceph-mon[31615]: osdmap e4: 0 total, 0 up, 0 in 2024-01-31T05:03:00.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:59 smithi099 ceph-mon[31615]: Updating smithi181:/etc/ceph/ceph.client.admin.keyring 2024-01-31T05:03:00.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:59 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:00.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:59 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:00.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:02:59 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:00.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:00.959+0000 7ff549a4f700 1 -- 172.21.15.181:0/1854541474 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5441062e0 msgr2=0x7ff5441066c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:00.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:00.959+0000 7ff549a4f700 1 --2- 172.21.15.181:0/1854541474 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5441062e0 0x7ff5441066c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff534009910 tx=0x7ff534009c20 comp rx=0 tx=0).stop 2024-01-31T05:03:00.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:00.959+0000 7ff549a4f700 1 -- 172.21.15.181:0/1854541474 shutdown_connections 2024-01-31T05:03:00.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:00.959+0000 7ff549a4f700 1 --2- 172.21.15.181:0/1854541474 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5441062e0 0x7ff5441066c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:00.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:00.959+0000 7ff549a4f700 1 -- 172.21.15.181:0/1854541474 >> 172.21.15.181:0/1854541474 conn(0x7ff5440faf20 msgr2=0x7ff5440fd340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:03:00.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:00.959+0000 7ff549a4f700 1 -- 172.21.15.181:0/1854541474 shutdown_connections 2024-01-31T05:03:00.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:00.959+0000 7ff549a4f700 1 -- 172.21.15.181:0/1854541474 wait complete. 2024-01-31T05:03:00.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:00.960+0000 7ff549a4f700 1 Processor -- start 2024-01-31T05:03:00.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:00.960+0000 7ff549a4f700 1 -- start start 2024-01-31T05:03:00.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:00.960+0000 7ff549a4f700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5441062e0 0x7ff54419c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:00.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:00.960+0000 7ff549a4f700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff54419cbe0 con 0x7ff5441062e0 2024-01-31T05:03:00.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:00.960+0000 7ff542ffd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5441062e0 0x7ff54419c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:00.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:00.960+0000 7ff542ffd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5441062e0 0x7ff54419c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.181:40446/0 (socket says 172.21.15.181:40446) 2024-01-31T05:03:00.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:00.960+0000 7ff542ffd700 1 -- 172.21.15.181:0/3166703431 learned_addr learned my addr 172.21.15.181:0/3166703431 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-01-31T05:03:00.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:00.961+0000 7ff542ffd700 1 -- 172.21.15.181:0/3166703431 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5340095f0 con 0x7ff5441062e0 2024-01-31T05:03:00.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:00.961+0000 7ff542ffd700 1 --2- 172.21.15.181:0/3166703431 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5441062e0 0x7ff54419c6a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff534004f40 tx=0x7ff534005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:03:00.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:00.961+0000 7ff548a4d700 1 -- 172.21.15.181:0/3166703431 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff53401d070 con 0x7ff5441062e0 2024-01-31T05:03:00.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:00.961+0000 7ff549a4f700 1 -- 172.21.15.181:0/3166703431 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff54419cde0 con 0x7ff5441062e0 2024-01-31T05:03:00.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:00.961+0000 7ff548a4d700 1 -- 172.21.15.181:0/3166703431 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff53400b750 con 0x7ff5441062e0 2024-01-31T05:03:00.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:00.961+0000 7ff548a4d700 1 -- 172.21.15.181:0/3166703431 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff534003810 con 0x7ff5441062e0 2024-01-31T05:03:00.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:00.961+0000 7ff549a4f700 1 -- 172.21.15.181:0/3166703431 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff54419d280 con 0x7ff5441062e0 2024-01-31T05:03:00.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:00.962+0000 7ff548a4d700 1 -- 172.21.15.181:0/3166703431 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 13) v1 ==== 45697+0+0 (secure 0 0 0) 0x7ff534003ad0 con 0x7ff5441062e0 2024-01-31T05:03:00.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:00.962+0000 7ff548a4d700 1 --2- 172.21.15.181:0/3166703431 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff52c038ae0 0x7ff52c03afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:00.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:00.962+0000 7ff548a4d700 1 -- 172.21.15.181:0/3166703431 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ff53404c700 con 0x7ff5441062e0 2024-01-31T05:03:00.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:00.962+0000 7ff549a4f700 1 -- 172.21.15.181:0/3166703431 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5441006e0 con 0x7ff5441062e0 2024-01-31T05:03:00.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:00.962+0000 7ff5427fc700 1 --2- 172.21.15.181:0/3166703431 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff52c038ae0 0x7ff52c03afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:00.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:00.963+0000 7ff5427fc700 1 --2- 172.21.15.181:0/3166703431 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff52c038ae0 0x7ff52c03afa0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff538006fd0 tx=0x7ff538006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:03:00.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:00.967+0000 7ff548a4d700 1 -- 172.21.15.181:0/3166703431 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7ff534026020 con 0x7ff5441062e0 2024-01-31T05:03:01.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:00 smithi099 ceph-mon[31615]: Updating smithi181:/var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/config/ceph.client.admin.keyring 2024-01-31T05:03:01.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:01.169+0000 7ff549a4f700 1 -- 172.21.15.181:0/3166703431 --> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi099:172.21.15.99=a;smithi179:172.21.15.179=b;smithi181:172.21.15.181=c", "target": ["mon-mgr", ""]}) v1 -- 0x7ff54410b500 con 0x7ff52c038ae0 2024-01-31T05:03:01.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:01.178+0000 7ff548a4d700 1 -- 172.21.15.181:0/3166703431 <== mgr.14152 v2:172.21.15.99:6800/3925720924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7ff54410b500 con 0x7ff52c038ae0 2024-01-31T05:03:01.177 INFO:teuthology.orchestra.run.smithi181.stdout:Scheduled mon update... 2024-01-31T05:03:01.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:01.180+0000 7ff549a4f700 1 -- 172.21.15.181:0/3166703431 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff52c038ae0 msgr2=0x7ff52c03afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:01.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:01.180+0000 7ff549a4f700 1 --2- 172.21.15.181:0/3166703431 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff52c038ae0 0x7ff52c03afa0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff538006fd0 tx=0x7ff538006e40 comp rx=0 tx=0).stop 2024-01-31T05:03:01.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:01.180+0000 7ff549a4f700 1 -- 172.21.15.181:0/3166703431 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5441062e0 msgr2=0x7ff54419c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:01.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:01.180+0000 7ff549a4f700 1 --2- 172.21.15.181:0/3166703431 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5441062e0 0x7ff54419c6a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff534004f40 tx=0x7ff534005020 comp rx=0 tx=0).stop 2024-01-31T05:03:01.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:01.180+0000 7ff549a4f700 1 -- 172.21.15.181:0/3166703431 shutdown_connections 2024-01-31T05:03:01.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:01.180+0000 7ff549a4f700 1 --2- 172.21.15.181:0/3166703431 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff52c038ae0 0x7ff52c03afa0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:01.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:01.180+0000 7ff549a4f700 1 --2- 172.21.15.181:0/3166703431 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5441062e0 0x7ff54419c6a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:01.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:01.180+0000 7ff549a4f700 1 -- 172.21.15.181:0/3166703431 >> 172.21.15.181:0/3166703431 conn(0x7ff5440faf20 msgr2=0x7ff544106f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:03:01.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:01.180+0000 7ff549a4f700 1 -- 172.21.15.181:0/3166703431 shutdown_connections 2024-01-31T05:03:01.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:01.180+0000 7ff549a4f700 1 -- 172.21.15.181:0/3166703431 wait complete. 2024-01-31T05:03:01.740 DEBUG:teuthology.orchestra.run.smithi179:mon.b> sudo journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mon.b.service 2024-01-31T05:03:01.743 DEBUG:teuthology.orchestra.run.smithi181:mon.c> sudo journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mon.c.service 2024-01-31T05:03:01.745 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-01-31T05:03:01.745 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph mon dump -f json 2024-01-31T05:03:02.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:01 smithi099 ceph-mon[31615]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:02.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:01 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:02.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:01 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:03:02.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:01 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:02.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:01 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:03:02.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:01 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:02.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:01 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-31T05:03:02.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:01 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:03.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:02 smithi099 ceph-mon[31615]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi099:172.21.15.99=a;smithi179:172.21.15.179=b;smithi181:172.21.15.181=c", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:03:03.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:02 smithi099 ceph-mon[31615]: Saving service mon spec with placement smithi099:172.21.15.99=a;smithi179:172.21.15.179=b;smithi181:172.21.15.181=c;count:3 2024-01-31T05:03:03.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:02 smithi099 ceph-mon[31615]: Deploying daemon mon.c on smithi181 2024-01-31T05:03:03.780 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.c/config 2024-01-31T05:03:04.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:03 smithi099 ceph-mon[31615]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:05.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:05.443+0000 7f41206d4700 1 -- 172.21.15.181:0/489716599 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4118100420 msgr2=0x7f4118100800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:05.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:05.443+0000 7f41206d4700 1 --2- 172.21.15.181:0/489716599 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4118100420 0x7f4118100800 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f411000b0a0 tx=0x7f411000b3b0 comp rx=0 tx=0).stop 2024-01-31T05:03:05.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:05.443+0000 7f41206d4700 1 -- 172.21.15.181:0/489716599 shutdown_connections 2024-01-31T05:03:05.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:05.443+0000 7f41206d4700 1 --2- 172.21.15.181:0/489716599 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4118100420 0x7f4118100800 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:05.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:05.443+0000 7f41206d4700 1 -- 172.21.15.181:0/489716599 >> 172.21.15.181:0/489716599 conn(0x7f41180fbc90 msgr2=0x7f41180fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:03:05.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:05.444+0000 7f41206d4700 1 -- 172.21.15.181:0/489716599 shutdown_connections 2024-01-31T05:03:05.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:05.444+0000 7f41206d4700 1 -- 172.21.15.181:0/489716599 wait complete. 2024-01-31T05:03:05.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:05.444+0000 7f41206d4700 1 Processor -- start 2024-01-31T05:03:05.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:05.444+0000 7f41206d4700 1 -- start start 2024-01-31T05:03:05.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:05.444+0000 7f41206d4700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4118100420 0x7f4118101ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:05.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:05.444+0000 7f41206d4700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4118103db0 con 0x7f4118100420 2024-01-31T05:03:05.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:05.444+0000 7f411e470700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4118100420 0x7f4118101ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:05.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:05.444+0000 7f411e470700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4118100420 0x7f4118101ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.181:40468/0 (socket says 172.21.15.181:40468) 2024-01-31T05:03:05.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:05.444+0000 7f411e470700 1 -- 172.21.15.181:0/654628009 learned_addr learned my addr 172.21.15.181:0/654628009 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-01-31T05:03:05.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:05.445+0000 7f411e470700 1 -- 172.21.15.181:0/654628009 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4110009d00 con 0x7f4118100420 2024-01-31T05:03:05.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:05.445+0000 7f411e470700 1 --2- 172.21.15.181:0/654628009 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4118100420 0x7f4118101ec0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f41100062a0 tx=0x7f411000bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:03:05.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:05.445+0000 7f410f7fe700 1 -- 172.21.15.181:0/654628009 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f411000e040 con 0x7f4118100420 2024-01-31T05:03:05.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:05.445+0000 7f41206d4700 1 -- 172.21.15.181:0/654628009 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4118102400 con 0x7f4118100420 2024-01-31T05:03:05.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:05.445+0000 7f410f7fe700 1 -- 172.21.15.181:0/654628009 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4110003c10 con 0x7f4118100420 2024-01-31T05:03:05.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:05.445+0000 7f410f7fe700 1 -- 172.21.15.181:0/654628009 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f411001d470 con 0x7f4118100420 2024-01-31T05:03:05.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:05.445+0000 7f41206d4700 1 -- 172.21.15.181:0/654628009 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4118102820 con 0x7f4118100420 2024-01-31T05:03:05.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:05.446+0000 7f41206d4700 1 -- 172.21.15.181:0/654628009 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4118062e10 con 0x7f4118100420 2024-01-31T05:03:05.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:05.446+0000 7f410f7fe700 1 -- 172.21.15.181:0/654628009 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 13) v1 ==== 45697+0+0 (secure 0 0 0) 0x7f4110019070 con 0x7f4118100420 2024-01-31T05:03:05.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:05.446+0000 7f410f7fe700 1 --2- 172.21.15.181:0/654628009 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f4104038b30 0x7f410403aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:05.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:05.446+0000 7f410f7fe700 1 -- 172.21.15.181:0/654628009 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f411004cab0 con 0x7f4118100420 2024-01-31T05:03:05.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:05.446+0000 7f411dc6f700 1 --2- 172.21.15.181:0/654628009 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f4104038b30 0x7f410403aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:05.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:05.447+0000 7f411dc6f700 1 --2- 172.21.15.181:0/654628009 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f4104038b30 0x7f410403aff0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4108006fd0 tx=0x7f4108006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:03:05.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:05.452+0000 7f410f7fe700 1 -- 172.21.15.181:0/654628009 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f411001c5b0 con 0x7f4118100420 2024-01-31T05:03:05.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:05.738+0000 7f41206d4700 1 -- 172.21.15.181:0/654628009 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4118102ad0 con 0x7f4118100420 2024-01-31T05:03:05.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:05.739+0000 7f410f7fe700 1 -- 172.21.15.181:0/654628009 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+745 (secure 0 0 0) 0x7f4110017020 con 0x7f4118100420 2024-01-31T05:03:05.739 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-01-31T05:03:05.739 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":1,"fsid":"9288ff44-bff5-11ee-95b3-87774f69a715","modified":"2024-01-31T05:01:22.915485Z","created":"2024-01-31T05:01:22.915485Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:3300","nonce":0},{"type":"v1","addr":"172.21.15.99:6789","nonce":0}]},"addr":"172.21.15.99:6789/0","public_addr":"172.21.15.99:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-01-31T05:03:05.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:05.741+0000 7f41206d4700 1 -- 172.21.15.181:0/654628009 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f4104038b30 msgr2=0x7f410403aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:05.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:05.741+0000 7f41206d4700 1 --2- 172.21.15.181:0/654628009 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f4104038b30 0x7f410403aff0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4108006fd0 tx=0x7f4108006e40 comp rx=0 tx=0).stop 2024-01-31T05:03:05.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:05.741+0000 7f41206d4700 1 -- 172.21.15.181:0/654628009 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4118100420 msgr2=0x7f4118101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:05.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:05.741+0000 7f41206d4700 1 --2- 172.21.15.181:0/654628009 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4118100420 0x7f4118101ec0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f41100062a0 tx=0x7f411000bd40 comp rx=0 tx=0).stop 2024-01-31T05:03:05.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:05.741+0000 7f41206d4700 1 -- 172.21.15.181:0/654628009 shutdown_connections 2024-01-31T05:03:05.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:05.741+0000 7f41206d4700 1 --2- 172.21.15.181:0/654628009 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f4104038b30 0x7f410403aff0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:05.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:05.741+0000 7f41206d4700 1 --2- 172.21.15.181:0/654628009 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4118100420 0x7f4118101ec0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:05.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:05.741+0000 7f41206d4700 1 -- 172.21.15.181:0/654628009 >> 172.21.15.181:0/654628009 conn(0x7f41180fbc90 msgr2=0x7f41180699c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:03:05.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:05.741+0000 7f41206d4700 1 -- 172.21.15.181:0/654628009 shutdown_connections 2024-01-31T05:03:05.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:05.741+0000 7f41206d4700 1 -- 172.21.15.181:0/654628009 wait complete. 2024-01-31T05:03:05.741 INFO:teuthology.orchestra.run.smithi181.stderr:dumped monmap epoch 1 2024-01-31T05:03:06.055 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:05 smithi181 ceph-mon[36434]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-01-31T05:03:06.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:05 smithi099 ceph-mon[31615]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:06.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:06 smithi181 bash[36380]: 06764ffa8ade6e0c65798bd8e34763d7bf2738a456eb17789347f9e79d0fd32e 2024-01-31T05:03:06.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:06 smithi181 systemd[1]: Started Ceph mon.c for 9288ff44-bff5-11ee-95b3-87774f69a715. 2024-01-31T05:03:07.392 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-01-31T05:03:07.392 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph mon dump -f json 2024-01-31T05:03:07.637 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.c/config 2024-01-31T05:03:11.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:10 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-31T05:03:11.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:10 smithi099 ceph-mon[31615]: mon.a calling monitor election 2024-01-31T05:03:11.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:10 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-31T05:03:11.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:10 smithi099 ceph-mon[31615]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:11.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:10 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-31T05:03:11.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:10 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-31T05:03:11.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:10 smithi099 ceph-mon[31615]: mon.c calling monitor election 2024-01-31T05:03:11.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:10 smithi099 ceph-mon[31615]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:11.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:10 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-31T05:03:11.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:10 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-31T05:03:11.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:10 smithi099 ceph-mon[31615]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:11.320 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:10 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-31T05:03:11.320 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:10 smithi099 ceph-mon[31615]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-01-31T05:03:11.320 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:10 smithi099 ceph-mon[31615]: monmap e2: 2 mons at {a=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0],c=[v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-31T05:03:11.320 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:10 smithi099 ceph-mon[31615]: fsmap 2024-01-31T05:03:11.320 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:10 smithi099 ceph-mon[31615]: osdmap e4: 0 total, 0 up, 0 in 2024-01-31T05:03:11.320 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:10 smithi099 ceph-mon[31615]: mgrmap e13: x(active, since 50s) 2024-01-31T05:03:11.320 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:10 smithi099 ceph-mon[31615]: overall HEALTH_OK 2024-01-31T05:03:11.320 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:10 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:11.320 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:10 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:11.320 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:10 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:11.320 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:10 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-31T05:03:11.320 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:10 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:11.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:10 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-31T05:03:11.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:10 smithi181 ceph-mon[36434]: mon.a calling monitor election 2024-01-31T05:03:11.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:10 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-31T05:03:11.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:10 smithi181 ceph-mon[36434]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:11.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:10 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-31T05:03:11.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:10 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-31T05:03:11.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:10 smithi181 ceph-mon[36434]: mon.c calling monitor election 2024-01-31T05:03:11.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:10 smithi181 ceph-mon[36434]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:11.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:10 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-31T05:03:11.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:10 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-31T05:03:11.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:10 smithi181 ceph-mon[36434]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:11.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:10 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-31T05:03:11.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:10 smithi181 ceph-mon[36434]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-01-31T05:03:11.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:10 smithi181 ceph-mon[36434]: monmap e2: 2 mons at {a=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0],c=[v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-31T05:03:11.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:10 smithi181 ceph-mon[36434]: fsmap 2024-01-31T05:03:11.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:10 smithi181 ceph-mon[36434]: osdmap e4: 0 total, 0 up, 0 in 2024-01-31T05:03:11.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:10 smithi181 ceph-mon[36434]: mgrmap e13: x(active, since 50s) 2024-01-31T05:03:11.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:10 smithi181 ceph-mon[36434]: overall HEALTH_OK 2024-01-31T05:03:11.323 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:10 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:11.323 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:10 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:11.323 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:10 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:11.323 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:10 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-31T05:03:11.323 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:10 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:12.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.246+0000 7fc2aa66a700 1 -- 172.21.15.181:0/1029281781 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc28c0035c0 msgr2=0x7fc28c005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:12.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.246+0000 7fc2aa66a700 1 --2- 172.21.15.181:0/1029281781 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc28c0035c0 0x7fc28c005a50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4100110 tx=0x7fc29400feb0 comp rx=0 tx=0).stop 2024-01-31T05:03:12.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.246+0000 7fc2aa66a700 1 -- 172.21.15.181:0/1029281781 shutdown_connections 2024-01-31T05:03:12.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.246+0000 7fc2aa66a700 1 --2- 172.21.15.181:0/1029281781 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc28c0035c0 0x7fc28c005a50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:12.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.246+0000 7fc2aa66a700 1 -- 172.21.15.181:0/1029281781 >> 172.21.15.181:0/1029281781 conn(0x7fc2a40fbcf0 msgr2=0x7fc2a40fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:03:12.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.246+0000 7fc2aa66a700 1 -- 172.21.15.181:0/1029281781 shutdown_connections 2024-01-31T05:03:12.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.246+0000 7fc2aa66a700 1 -- 172.21.15.181:0/1029281781 wait complete. 2024-01-31T05:03:12.246 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:11 smithi181 ceph-mon[36434]: Deploying daemon mon.b on smithi179 2024-01-31T05:03:12.246 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:11 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-31T05:03:12.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.247+0000 7fc2aa66a700 1 Processor -- start 2024-01-31T05:03:12.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.247+0000 7fc2aa66a700 1 -- start start 2024-01-31T05:03:12.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.247+0000 7fc2aa66a700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc28c0035c0 0x7fc2a419c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:12.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.247+0000 7fc2aa66a700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2a419cdb0 0x7fc2a4196a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:12.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.247+0000 7fc2aa66a700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a419d340 con 0x7fc2a419cdb0 2024-01-31T05:03:12.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.247+0000 7fc2aa66a700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a419d4b0 con 0x7fc28c0035c0 2024-01-31T05:03:12.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.248+0000 7fc2a3fff700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc28c0035c0 0x7fc2a419c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:12.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.248+0000 7fc2a3fff700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc28c0035c0 0x7fc2a419c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41066/0 (socket says 172.21.15.181:41066) 2024-01-31T05:03:12.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.248+0000 7fc2a3fff700 1 -- 172.21.15.181:0/2686012387 learned_addr learned my addr 172.21.15.181:0/2686012387 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-01-31T05:03:12.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.248+0000 7fc2a3fff700 1 -- 172.21.15.181:0/2686012387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc28c0035c0 msgr2=0x7fc2a419c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-01-31T05:03:12.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.248+0000 7fc2a3fff700 1 -- 172.21.15.181:0/2686012387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc28c0035c0 msgr2=0x7fc2a419c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-01-31T05:03:12.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.248+0000 7fc2a3fff700 1 --2- 172.21.15.181:0/2686012387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc28c0035c0 0x7fc2a419c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-31T05:03:12.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.248+0000 7fc2a37fe700 1 --2- 172.21.15.181:0/2686012387 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2a419cdb0 0x7fc2a4196a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:12.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.248+0000 7fc2a3fff700 1 --2- 172.21.15.181:0/2686012387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc28c0035c0 0x7fc2a419c870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-31T05:03:12.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.248+0000 7fc2a37fe700 1 -- 172.21.15.181:0/2686012387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc28c0035c0 msgr2=0x7fc2a419c870 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-31T05:03:12.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.248+0000 7fc2a37fe700 1 --2- 172.21.15.181:0/2686012387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc28c0035c0 0x7fc2a419c870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:12.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.248+0000 7fc2a37fe700 1 -- 172.21.15.181:0/2686012387 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc29400f900 con 0x7fc2a419cdb0 2024-01-31T05:03:12.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.248+0000 7fc2a37fe700 1 --2- 172.21.15.181:0/2686012387 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2a419cdb0 0x7fc2a4196a30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc29800b4d0 tx=0x7fc29800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:03:12.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.248+0000 7fc2a17fa700 1 -- 172.21.15.181:0/2686012387 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7fc298011630 con 0x7fc2a419cdb0 2024-01-31T05:03:12.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.249+0000 7fc2a17fa700 1 -- 172.21.15.181:0/2686012387 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc298011c50 con 0x7fc2a419cdb0 2024-01-31T05:03:12.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.249+0000 7fc2aa66a700 1 -- 172.21.15.181:0/2686012387 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2a4197030 con 0x7fc2a419cdb0 2024-01-31T05:03:12.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.249+0000 7fc2a17fa700 1 -- 172.21.15.181:0/2686012387 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7fc298010d90 con 0x7fc2a419cdb0 2024-01-31T05:03:12.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.249+0000 7fc2aa66a700 1 -- 172.21.15.181:0/2686012387 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2a4197580 con 0x7fc2a419cdb0 2024-01-31T05:03:12.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.250+0000 7fc2a17fa700 1 -- 172.21.15.181:0/2686012387 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 13) v1 ==== 45697+0+0 (secure 0 0 0) 0x7fc29801a400 con 0x7fc2a419cdb0 2024-01-31T05:03:12.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.250+0000 7fc2aa66a700 1 -- 172.21.15.181:0/2686012387 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2a41908b0 con 0x7fc2a419cdb0 2024-01-31T05:03:12.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.250+0000 7fc2a17fa700 1 --2- 172.21.15.181:0/2686012387 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc2900388d0 0x7fc29003ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:12.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.250+0000 7fc2a17fa700 1 -- 172.21.15.181:0/2686012387 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fc29804b1d0 con 0x7fc2a419cdb0 2024-01-31T05:03:12.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.250+0000 7fc2a3fff700 1 --2- 172.21.15.181:0/2686012387 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc2900388d0 0x7fc29003ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:12.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.251+0000 7fc2a3fff700 1 --2- 172.21.15.181:0/2686012387 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc2900388d0 0x7fc29003ad90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc294011510 tx=0x7fc294005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:03:12.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.255+0000 7fc2a17fa700 1 -- 172.21.15.181:0/2686012387 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fc2980176d0 con 0x7fc2a419cdb0 2024-01-31T05:03:12.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:11 smithi099 ceph-mon[31615]: Deploying daemon mon.b on smithi179 2024-01-31T05:03:12.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:11 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-31T05:03:12.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.528+0000 7fc2aa66a700 1 -- 172.21.15.181:0/2686012387 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc2a4197f60 con 0x7fc2a419cdb0 2024-01-31T05:03:12.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.528+0000 7fc2a17fa700 1 -- 172.21.15.181:0/2686012387 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1015 (secure 0 0 0) 0x7fc2980172c0 con 0x7fc2a419cdb0 2024-01-31T05:03:12.528 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-01-31T05:03:12.528 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":2,"fsid":"9288ff44-bff5-11ee-95b3-87774f69a715","modified":"2024-01-31T05:03:05.864213Z","created":"2024-01-31T05:01:22.915485Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:3300","nonce":0},{"type":"v1","addr":"172.21.15.99:6789","nonce":0}]},"addr":"172.21.15.99:6789/0","public_addr":"172.21.15.99:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:3300","nonce":0},{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-01-31T05:03:12.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.531+0000 7fc2aa66a700 1 -- 172.21.15.181:0/2686012387 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc2900388d0 msgr2=0x7fc29003ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:12.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.531+0000 7fc2aa66a700 1 --2- 172.21.15.181:0/2686012387 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc2900388d0 0x7fc29003ad90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc294011510 tx=0x7fc294005960 comp rx=0 tx=0).stop 2024-01-31T05:03:12.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.531+0000 7fc2aa66a700 1 -- 172.21.15.181:0/2686012387 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2a419cdb0 msgr2=0x7fc2a4196a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:12.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.531+0000 7fc2aa66a700 1 --2- 172.21.15.181:0/2686012387 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2a419cdb0 0x7fc2a4196a30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc29800b4d0 tx=0x7fc29800b890 comp rx=0 tx=0).stop 2024-01-31T05:03:12.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.531+0000 7fc2aa66a700 1 -- 172.21.15.181:0/2686012387 shutdown_connections 2024-01-31T05:03:12.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.531+0000 7fc2aa66a700 1 --2- 172.21.15.181:0/2686012387 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc2900388d0 0x7fc29003ad90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:12.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.531+0000 7fc2aa66a700 1 --2- 172.21.15.181:0/2686012387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc28c0035c0 0x7fc2a419c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:12.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.531+0000 7fc2aa66a700 1 --2- 172.21.15.181:0/2686012387 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2a419cdb0 0x7fc2a4196a30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:12.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.531+0000 7fc2aa66a700 1 -- 172.21.15.181:0/2686012387 >> 172.21.15.181:0/2686012387 conn(0x7fc2a40fbcf0 msgr2=0x7fc2a406a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:03:12.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.531+0000 7fc2aa66a700 1 -- 172.21.15.181:0/2686012387 shutdown_connections 2024-01-31T05:03:12.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:12.531+0000 7fc2aa66a700 1 -- 172.21.15.181:0/2686012387 wait complete. 2024-01-31T05:03:12.531 INFO:teuthology.orchestra.run.smithi181.stderr:dumped monmap epoch 2 2024-01-31T05:03:13.145 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:13 smithi181 ceph-mon[36434]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:13.145 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:13 smithi181 ceph-mon[36434]: from='client.? 172.21.15.181:0/2686012387' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-01-31T05:03:13.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:13 smithi099 ceph-mon[31615]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:13.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:13 smithi099 ceph-mon[31615]: from='client.? 172.21.15.181:0/2686012387' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-01-31T05:03:14.173 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-01-31T05:03:14.173 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph mon dump -f json 2024-01-31T05:03:14.414 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.c/config 2024-01-31T05:03:14.866 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:14 smithi179 podman[35633]: 2024-01-31 05:03:14.736192885 +0000 UTC m=+0.120101772 container create 3f34d781cfae37c2c393c8dcde3cf43c2cb1aacda1948702c4a923a5012a9360 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mon-b, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240125.044502-661946e, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, io.buildah.version=1.31.3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240123, CEPH_POINT_RELEASE=) 2024-01-31T05:03:15.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:14 smithi179 podman[35633]: 2024-01-31 05:03:14.97229428 +0000 UTC m=+0.356203177 container init 3f34d781cfae37c2c393c8dcde3cf43c2cb1aacda1948702c4a923a5012a9360 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mon-b, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240123, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.31.3, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-01-31T05:03:15.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:14 smithi179 podman[35633]: 2024-01-31 05:03:14.975252037 +0000 UTC m=+0.359160925 container start 3f34d781cfae37c2c393c8dcde3cf43c2cb1aacda1948702c4a923a5012a9360 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mon-b, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240123, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.31.3, ceph=True, GIT_BRANCH=HEAD) 2024-01-31T05:03:15.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:14 smithi179 ceph-mon[35652]: set uid:gid to 167:167 (ceph:ceph) 2024-01-31T05:03:15.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:14 smithi179 ceph-mon[35652]: ceph version 19.0.0-885-g661946e7 (661946e7044723130c03627323f6a879a9848cb5) squid (dev), process ceph-mon, pid 2 2024-01-31T05:03:15.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:14 smithi179 ceph-mon[35652]: pidfile_write: ignore empty --pid-file 2024-01-31T05:03:15.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: load: jerasure load: lrc 2024-01-31T05:03:15.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: RocksDB version: 7.9.2 2024-01-31T05:03:15.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Git sha 0 2024-01-31T05:03:15.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Compile date 2024-01-25 05:03:27 2024-01-31T05:03:15.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: DB SUMMARY 2024-01-31T05:03:15.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: DB Session ID: B43NUGJEK1BAU7A4MVPF 2024-01-31T05:03:15.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: CURRENT file: CURRENT 2024-01-31T05:03:15.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: IDENTITY file: IDENTITY 2024-01-31T05:03:15.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-01-31T05:03:15.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-01-31T05:03:15.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-01-31T05:03:15.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.error_if_exists: 0 2024-01-31T05:03:15.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.create_if_missing: 0 2024-01-31T05:03:15.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.paranoid_checks: 1 2024-01-31T05:03:15.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.flush_verify_memtable_count: 1 2024-01-31T05:03:15.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-01-31T05:03:15.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-01-31T05:03:15.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.env: 0x55d4988a2ae0 2024-01-31T05:03:15.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.fs: PosixFileSystem 2024-01-31T05:03:15.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.info_log: 0x55d499af9780 2024-01-31T05:03:15.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.max_file_opening_threads: 16 2024-01-31T05:03:15.136 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.statistics: (nil) 2024-01-31T05:03:15.136 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.use_fsync: 0 2024-01-31T05:03:15.136 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.max_log_file_size: 0 2024-01-31T05:03:15.136 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-01-31T05:03:15.136 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.log_file_time_to_roll: 0 2024-01-31T05:03:15.137 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.keep_log_file_num: 1000 2024-01-31T05:03:15.137 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.recycle_log_file_num: 0 2024-01-31T05:03:15.137 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.allow_fallocate: 1 2024-01-31T05:03:15.137 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.allow_mmap_reads: 0 2024-01-31T05:03:15.137 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.allow_mmap_writes: 0 2024-01-31T05:03:15.137 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.use_direct_reads: 0 2024-01-31T05:03:15.137 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-01-31T05:03:15.137 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.create_missing_column_families: 0 2024-01-31T05:03:15.137 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.db_log_dir: 2024-01-31T05:03:15.137 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.wal_dir: 2024-01-31T05:03:15.137 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.table_cache_numshardbits: 6 2024-01-31T05:03:15.137 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.WAL_ttl_seconds: 0 2024-01-31T05:03:15.137 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.WAL_size_limit_MB: 0 2024-01-31T05:03:15.138 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-01-31T05:03:15.138 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-01-31T05:03:15.138 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.is_fd_close_on_exec: 1 2024-01-31T05:03:15.138 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.advise_random_on_open: 1 2024-01-31T05:03:15.138 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.db_write_buffer_size: 0 2024-01-31T05:03:15.138 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.write_buffer_manager: 0x55d499acd400 2024-01-31T05:03:15.138 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-01-31T05:03:15.138 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-01-31T05:03:15.138 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.use_adaptive_mutex: 0 2024-01-31T05:03:15.138 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.rate_limiter: (nil) 2024-01-31T05:03:15.138 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-01-31T05:03:15.138 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.wal_recovery_mode: 2 2024-01-31T05:03:15.138 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.enable_thread_tracking: 0 2024-01-31T05:03:15.138 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.enable_pipelined_write: 0 2024-01-31T05:03:15.139 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.unordered_write: 0 2024-01-31T05:03:15.139 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-01-31T05:03:15.139 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-01-31T05:03:15.139 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-01-31T05:03:15.139 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-01-31T05:03:15.139 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.row_cache: None 2024-01-31T05:03:15.139 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.wal_filter: None 2024-01-31T05:03:15.139 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-01-31T05:03:15.139 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.allow_ingest_behind: 0 2024-01-31T05:03:15.139 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.two_write_queues: 0 2024-01-31T05:03:15.139 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.manual_wal_flush: 0 2024-01-31T05:03:15.139 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.wal_compression: 0 2024-01-31T05:03:15.139 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.atomic_flush: 0 2024-01-31T05:03:15.139 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-01-31T05:03:15.140 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.persist_stats_to_disk: 0 2024-01-31T05:03:15.140 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.write_dbid_to_manifest: 0 2024-01-31T05:03:15.140 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.log_readahead_size: 0 2024-01-31T05:03:15.140 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-01-31T05:03:15.140 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.best_efforts_recovery: 0 2024-01-31T05:03:15.140 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-01-31T05:03:15.140 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-01-31T05:03:15.140 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.allow_data_in_errors: 0 2024-01-31T05:03:15.140 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.db_host_id: __hostname__ 2024-01-31T05:03:15.140 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.enforce_single_del_contracts: true 2024-01-31T05:03:15.140 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.max_background_jobs: 2 2024-01-31T05:03:15.140 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.max_background_compactions: -1 2024-01-31T05:03:15.140 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.max_subcompactions: 1 2024-01-31T05:03:15.140 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-01-31T05:03:15.140 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-01-31T05:03:15.141 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.delayed_write_rate : 16777216 2024-01-31T05:03:15.141 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.max_total_wal_size: 0 2024-01-31T05:03:15.141 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-01-31T05:03:15.141 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.stats_dump_period_sec: 600 2024-01-31T05:03:15.141 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.stats_persist_period_sec: 600 2024-01-31T05:03:15.141 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-01-31T05:03:15.141 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.max_open_files: -1 2024-01-31T05:03:15.141 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.bytes_per_sync: 0 2024-01-31T05:03:15.141 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.wal_bytes_per_sync: 0 2024-01-31T05:03:15.141 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.strict_bytes_per_sync: 0 2024-01-31T05:03:15.141 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.compaction_readahead_size: 0 2024-01-31T05:03:15.141 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.max_background_flushes: -1 2024-01-31T05:03:15.141 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Compression algorithms supported: 2024-01-31T05:03:15.141 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-01-31T05:03:15.141 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: kZSTD supported: 0 2024-01-31T05:03:15.141 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: kXpressCompression supported: 0 2024-01-31T05:03:15.142 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: kLZ4HCCompression supported: 1 2024-01-31T05:03:15.142 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: kZlibCompression supported: 1 2024-01-31T05:03:15.142 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: kSnappyCompression supported: 1 2024-01-31T05:03:15.142 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: kLZ4Compression supported: 1 2024-01-31T05:03:15.142 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: kBZip2Compression supported: 0 2024-01-31T05:03:15.142 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Fast CRC32 supported: Supported on x86 2024-01-31T05:03:15.142 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: DMutex implementation: pthread_mutex_t 2024-01-31T05:03:15.142 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-01-31T05:03:15.142 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-01-31T05:03:15.142 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-01-31T05:03:15.142 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.merge_operator: 2024-01-31T05:03:15.142 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.compaction_filter: None 2024-01-31T05:03:15.142 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.compaction_filter_factory: None 2024-01-31T05:03:15.142 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.sst_partitioner_factory: None 2024-01-31T05:03:15.143 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.memtable_factory: SkipListFactory 2024-01-31T05:03:15.143 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.table_factory: BlockBasedTable 2024-01-31T05:03:15.143 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d499af98a0) 2024-01-31T05:03:15.143 INFO:journalctl@ceph.mon.b.smithi179.stdout: cache_index_and_filter_blocks: 1 2024-01-31T05:03:15.143 INFO:journalctl@ceph.mon.b.smithi179.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-01-31T05:03:15.143 INFO:journalctl@ceph.mon.b.smithi179.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-01-31T05:03:15.143 INFO:journalctl@ceph.mon.b.smithi179.stdout: pin_top_level_index_and_filter: 1 2024-01-31T05:03:15.143 INFO:journalctl@ceph.mon.b.smithi179.stdout: index_type: 0 2024-01-31T05:03:15.143 INFO:journalctl@ceph.mon.b.smithi179.stdout: data_block_index_type: 0 2024-01-31T05:03:15.143 INFO:journalctl@ceph.mon.b.smithi179.stdout: index_shortening: 1 2024-01-31T05:03:15.143 INFO:journalctl@ceph.mon.b.smithi179.stdout: data_block_hash_table_util_ratio: 0.750000 2024-01-31T05:03:15.143 INFO:journalctl@ceph.mon.b.smithi179.stdout: checksum: 4 2024-01-31T05:03:15.143 INFO:journalctl@ceph.mon.b.smithi179.stdout: no_block_cache: 0 2024-01-31T05:03:15.143 INFO:journalctl@ceph.mon.b.smithi179.stdout: block_cache: 0x55d499afd090 2024-01-31T05:03:15.143 INFO:journalctl@ceph.mon.b.smithi179.stdout: block_cache_name: BinnedLRUCache 2024-01-31T05:03:15.143 INFO:journalctl@ceph.mon.b.smithi179.stdout: block_cache_options: 2024-01-31T05:03:15.144 INFO:journalctl@ceph.mon.b.smithi179.stdout: capacity : 536870912 2024-01-31T05:03:15.144 INFO:journalctl@ceph.mon.b.smithi179.stdout: num_shard_bits : 4 2024-01-31T05:03:15.144 INFO:journalctl@ceph.mon.b.smithi179.stdout: strict_capacity_limit : 0 2024-01-31T05:03:15.144 INFO:journalctl@ceph.mon.b.smithi179.stdout: high_pri_pool_ratio: 0.000 2024-01-31T05:03:15.144 INFO:journalctl@ceph.mon.b.smithi179.stdout: block_cache_compressed: (nil) 2024-01-31T05:03:15.144 INFO:journalctl@ceph.mon.b.smithi179.stdout: persistent_cache: (nil) 2024-01-31T05:03:15.144 INFO:journalctl@ceph.mon.b.smithi179.stdout: block_size: 4096 2024-01-31T05:03:15.144 INFO:journalctl@ceph.mon.b.smithi179.stdout: block_size_deviation: 10 2024-01-31T05:03:15.144 INFO:journalctl@ceph.mon.b.smithi179.stdout: block_restart_interval: 16 2024-01-31T05:03:15.144 INFO:journalctl@ceph.mon.b.smithi179.stdout: index_block_restart_interval: 1 2024-01-31T05:03:15.144 INFO:journalctl@ceph.mon.b.smithi179.stdout: metadata_block_size: 4096 2024-01-31T05:03:15.144 INFO:journalctl@ceph.mon.b.smithi179.stdout: partition_filters: 0 2024-01-31T05:03:15.144 INFO:journalctl@ceph.mon.b.smithi179.stdout: use_delta_encoding: 1 2024-01-31T05:03:15.144 INFO:journalctl@ceph.mon.b.smithi179.stdout: filter_policy: bloomfilter 2024-01-31T05:03:15.144 INFO:journalctl@ceph.mon.b.smithi179.stdout: whole_key_filtering: 1 2024-01-31T05:03:15.145 INFO:journalctl@ceph.mon.b.smithi179.stdout: verify_compression: 0 2024-01-31T05:03:15.145 INFO:journalctl@ceph.mon.b.smithi179.stdout: read_amp_bytes_per_bit: 0 2024-01-31T05:03:15.145 INFO:journalctl@ceph.mon.b.smithi179.stdout: format_version: 5 2024-01-31T05:03:15.145 INFO:journalctl@ceph.mon.b.smithi179.stdout: enable_index_compression: 1 2024-01-31T05:03:15.145 INFO:journalctl@ceph.mon.b.smithi179.stdout: block_align: 0 2024-01-31T05:03:15.145 INFO:journalctl@ceph.mon.b.smithi179.stdout: max_auto_readahead_size: 262144 2024-01-31T05:03:15.145 INFO:journalctl@ceph.mon.b.smithi179.stdout: prepopulate_block_cache: 0 2024-01-31T05:03:15.145 INFO:journalctl@ceph.mon.b.smithi179.stdout: initial_auto_readahead_size: 8192 2024-01-31T05:03:15.145 INFO:journalctl@ceph.mon.b.smithi179.stdout: num_file_reads_for_auto_readahead: 2 2024-01-31T05:03:15.145 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.write_buffer_size: 33554432 2024-01-31T05:03:15.145 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.max_write_buffer_number: 2 2024-01-31T05:03:15.145 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.compression: NoCompression 2024-01-31T05:03:15.145 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.bottommost_compression: Disabled 2024-01-31T05:03:15.145 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.prefix_extractor: nullptr 2024-01-31T05:03:15.145 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-01-31T05:03:15.145 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.num_levels: 7 2024-01-31T05:03:15.146 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-01-31T05:03:15.146 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-01-31T05:03:15.146 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-01-31T05:03:15.146 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-01-31T05:03:15.146 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-01-31T05:03:15.146 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-01-31T05:03:15.146 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-01-31T05:03:15.146 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-01-31T05:03:15.146 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-01-31T05:03:15.146 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-01-31T05:03:15.146 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-01-31T05:03:15.146 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-01-31T05:03:15.146 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.compression_opts.window_bits: -14 2024-01-31T05:03:15.146 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.compression_opts.level: 32767 2024-01-31T05:03:15.146 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.compression_opts.strategy: 0 2024-01-31T05:03:15.146 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-01-31T05:03:15.147 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-01-31T05:03:15.147 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-01-31T05:03:15.147 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-01-31T05:03:15.147 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.compression_opts.enabled: false 2024-01-31T05:03:15.147 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-01-31T05:03:15.147 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-01-31T05:03:15.147 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-01-31T05:03:15.147 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-01-31T05:03:15.147 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.target_file_size_base: 67108864 2024-01-31T05:03:15.147 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.target_file_size_multiplier: 1 2024-01-31T05:03:15.147 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-01-31T05:03:15.147 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-01-31T05:03:15.147 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-01-31T05:03:15.147 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-01-31T05:03:15.147 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-01-31T05:03:15.148 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-01-31T05:03:15.148 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-01-31T05:03:15.148 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-01-31T05:03:15.148 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-01-31T05:03:15.148 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-01-31T05:03:15.148 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-01-31T05:03:15.148 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-01-31T05:03:15.148 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-01-31T05:03:15.148 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.arena_block_size: 1048576 2024-01-31T05:03:15.148 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-01-31T05:03:15.148 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-01-31T05:03:15.148 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.disable_auto_compactions: 0 2024-01-31T05:03:15.148 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-01-31T05:03:15.148 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-01-31T05:03:15.148 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-01-31T05:03:15.149 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-01-31T05:03:15.149 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-01-31T05:03:15.149 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-01-31T05:03:15.149 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-01-31T05:03:15.149 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-01-31T05:03:15.149 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-01-31T05:03:15.149 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-01-31T05:03:15.149 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.table_properties_collectors: 2024-01-31T05:03:15.149 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.inplace_update_support: 0 2024-01-31T05:03:15.149 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.inplace_update_num_locks: 10000 2024-01-31T05:03:15.149 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-01-31T05:03:15.149 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-01-31T05:03:15.149 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.memtable_huge_page_size: 0 2024-01-31T05:03:15.149 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.bloom_locality: 0 2024-01-31T05:03:15.149 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.max_successive_merges: 0 2024-01-31T05:03:15.150 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.optimize_filters_for_hits: 0 2024-01-31T05:03:15.150 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.paranoid_file_checks: 0 2024-01-31T05:03:15.150 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.force_consistency_checks: 1 2024-01-31T05:03:15.150 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.report_bg_io_stats: 0 2024-01-31T05:03:15.150 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.ttl: 2592000 2024-01-31T05:03:15.150 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.periodic_compaction_seconds: 0 2024-01-31T05:03:15.150 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-01-31T05:03:15.150 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-01-31T05:03:15.150 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.enable_blob_files: false 2024-01-31T05:03:15.150 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.min_blob_size: 0 2024-01-31T05:03:15.150 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.blob_file_size: 268435456 2024-01-31T05:03:15.150 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.blob_compression_type: NoCompression 2024-01-31T05:03:15.150 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.enable_blob_garbage_collection: false 2024-01-31T05:03:15.150 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-01-31T05:03:15.150 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-01-31T05:03:15.151 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-01-31T05:03:15.151 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.blob_file_starting_level: 0 2024-01-31T05:03:15.151 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-01-31T05:03:15.151 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-01-31T05:03:15.151 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-01-31T05:03:15.151 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: d575ae01-68c9-4b7d-b96f-107b059b5599 2024-01-31T05:03:15.151 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: EVENT_LOG_v1 {"time_micros": 1706677395004704, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-01-31T05:03:15.151 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-01-31T05:03:15.151 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: EVENT_LOG_v1 {"time_micros": 1706677395005138, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1747, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1706677395, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d575ae01-68c9-4b7d-b96f-107b059b5599", "db_session_id": "B43NUGJEK1BAU7A4MVPF", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-01-31T05:03:15.151 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: EVENT_LOG_v1 {"time_micros": 1706677395005218, "job": 1, "event": "recovery_finished"} 2024-01-31T05:03:15.151 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-01-31T05:03:15.151 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-01-31T05:03:15.151 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55d499bea000 2024-01-31T05:03:15.151 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: DB pointer 0x55d499bd8000 2024-01-31T05:03:15.151 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-01-31T05:03:15.151 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-01-31T05:03:15.151 INFO:journalctl@ceph.mon.b.smithi179.stdout: ** DB Stats ** 2024-01-31T05:03:15.152 INFO:journalctl@ceph.mon.b.smithi179.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-01-31T05:03:15.152 INFO:journalctl@ceph.mon.b.smithi179.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-01-31T05:03:15.152 INFO:journalctl@ceph.mon.b.smithi179.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-01-31T05:03:15.152 INFO:journalctl@ceph.mon.b.smithi179.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-01-31T05:03:15.152 INFO:journalctl@ceph.mon.b.smithi179.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-01-31T05:03:15.152 INFO:journalctl@ceph.mon.b.smithi179.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-01-31T05:03:15.152 INFO:journalctl@ceph.mon.b.smithi179.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-01-31T05:03:15.152 INFO:journalctl@ceph.mon.b.smithi179.stdout: 2024-01-31T05:03:15.152 INFO:journalctl@ceph.mon.b.smithi179.stdout: ** Compaction Stats [default] ** 2024-01-31T05:03:15.152 INFO:journalctl@ceph.mon.b.smithi179.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-01-31T05:03:15.152 INFO:journalctl@ceph.mon.b.smithi179.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-01-31T05:03:15.152 INFO:journalctl@ceph.mon.b.smithi179.stdout: L0 1/0 1.71 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-01-31T05:03:15.152 INFO:journalctl@ceph.mon.b.smithi179.stdout: Sum 1/0 1.71 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-01-31T05:03:15.152 INFO:journalctl@ceph.mon.b.smithi179.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-01-31T05:03:15.153 INFO:journalctl@ceph.mon.b.smithi179.stdout: 2024-01-31T05:03:15.153 INFO:journalctl@ceph.mon.b.smithi179.stdout: ** Compaction Stats [default] ** 2024-01-31T05:03:15.153 INFO:journalctl@ceph.mon.b.smithi179.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-01-31T05:03:15.153 INFO:journalctl@ceph.mon.b.smithi179.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-01-31T05:03:15.153 INFO:journalctl@ceph.mon.b.smithi179.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-01-31T05:03:15.153 INFO:journalctl@ceph.mon.b.smithi179.stdout: 2024-01-31T05:03:15.153 INFO:journalctl@ceph.mon.b.smithi179.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-01-31T05:03:15.153 INFO:journalctl@ceph.mon.b.smithi179.stdout: 2024-01-31T05:03:15.153 INFO:journalctl@ceph.mon.b.smithi179.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-01-31T05:03:15.153 INFO:journalctl@ceph.mon.b.smithi179.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-01-31T05:03:15.153 INFO:journalctl@ceph.mon.b.smithi179.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-01-31T05:03:15.153 INFO:journalctl@ceph.mon.b.smithi179.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-01-31T05:03:15.153 INFO:journalctl@ceph.mon.b.smithi179.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-01-31T05:03:15.153 INFO:journalctl@ceph.mon.b.smithi179.stdout: AddFile(Keys): cumulative 0, interval 0 2024-01-31T05:03:15.153 INFO:journalctl@ceph.mon.b.smithi179.stdout: Cumulative compaction: 0.00 GB write, 0.71 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-31T05:03:15.153 INFO:journalctl@ceph.mon.b.smithi179.stdout: Interval compaction: 0.00 GB write, 0.71 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-31T05:03:15.153 INFO:journalctl@ceph.mon.b.smithi179.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-01-31T05:03:15.154 INFO:journalctl@ceph.mon.b.smithi179.stdout: Block cache BinnedLRUCache@0x55d499afd090#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-01-31T05:03:15.154 INFO:journalctl@ceph.mon.b.smithi179.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-01-31T05:03:15.154 INFO:journalctl@ceph.mon.b.smithi179.stdout: 2024-01-31T05:03:15.154 INFO:journalctl@ceph.mon.b.smithi179.stdout: ** File Read Latency Histogram By Level [default] ** 2024-01-31T05:03:15.154 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-01-31T05:03:15.154 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: using public_addr v2:172.21.15.179:0/0 -> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] 2024-01-31T05:03:15.154 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: starting mon.b rank -1 at public addrs [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] at bind addrs [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 9288ff44-bff5-11ee-95b3-87774f69a715 2024-01-31T05:03:15.154 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: mon.b@-1(???) e0 preinit fsid 9288ff44-bff5-11ee-95b3-87774f69a715 2024-01-31T05:03:15.154 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: mon.b@-1(synchronizing).mds e1 new map 2024-01-31T05:03:15.154 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: mon.b@-1(synchronizing).mds e1 print_map 2024-01-31T05:03:15.154 INFO:journalctl@ceph.mon.b.smithi179.stdout: e1 2024-01-31T05:03:15.154 INFO:journalctl@ceph.mon.b.smithi179.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-01-31T05:03:15.154 INFO:journalctl@ceph.mon.b.smithi179.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-01-31T05:03:15.154 INFO:journalctl@ceph.mon.b.smithi179.stdout: legacy client fscid: -1 2024-01-31T05:03:15.154 INFO:journalctl@ceph.mon.b.smithi179.stdout: 2024-01-31T05:03:15.154 INFO:journalctl@ceph.mon.b.smithi179.stdout: No filesystems configured 2024-01-31T05:03:15.155 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-01-31T05:03:15.155 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-01-31T05:03:15.155 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-01-31T05:03:15.155 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-01-31T05:03:15.155 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-01-31T05:03:15.155 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-01-31T05:03:15.155 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-01-31T05:03:15.155 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-01-31T05:03:15.155 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-01-31T05:03:15.155 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-01-31T05:03:15.155 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:15.155 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-31T05:03:15.155 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:15.155 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi181", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:03:15.155 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:15.155 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:15.156 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:15.156 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:15.156 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:15.156 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi179", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:03:15.156 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:15.156 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:03:15.156 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: Updating smithi179:/etc/ceph/ceph.conf 2024-01-31T05:03:15.156 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: Updating smithi179:/var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/config/ceph.conf 2024-01-31T05:03:15.156 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: Deploying cephadm binary to smithi181 2024-01-31T05:03:15.156 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: Updating smithi179:/etc/ceph/ceph.client.admin.keyring 2024-01-31T05:03:15.156 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: Updating smithi179:/var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/config/ceph.client.admin.keyring 2024-01-31T05:03:15.156 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:15.156 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:15.156 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:15.157 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:15.157 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:15.157 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:03:15.157 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:15.157 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: Added host smithi181 2024-01-31T05:03:15.157 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:15.157 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:15.157 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:15.157 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:15.157 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-31T05:03:15.157 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:15.157 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/3743365578' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-01-31T05:03:15.157 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:15.157 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:15.157 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:15.157 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:15.158 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:03:15.158 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:15.158 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:03:15.158 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: Updating smithi181:/etc/ceph/ceph.conf 2024-01-31T05:03:15.158 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: Updating smithi181:/var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/config/ceph.conf 2024-01-31T05:03:15.158 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:15.158 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/3743365578' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-01-31T05:03:15.158 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: osdmap e4: 0 total, 0 up, 0 in 2024-01-31T05:03:15.158 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: Updating smithi181:/etc/ceph/ceph.client.admin.keyring 2024-01-31T05:03:15.158 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:15.158 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:15.158 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:15.158 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: Updating smithi181:/var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/config/ceph.client.admin.keyring 2024-01-31T05:03:15.158 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:15.158 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:15.158 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:03:15.158 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:15.159 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:03:15.159 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:15.159 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-31T05:03:15.159 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:15.159 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi099:172.21.15.99=a;smithi179:172.21.15.179=b;smithi181:172.21.15.181=c", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:03:15.159 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: Saving service mon spec with placement smithi099:172.21.15.99=a;smithi179:172.21.15.179=b;smithi181:172.21.15.181=c;count:3 2024-01-31T05:03:15.159 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: Deploying daemon mon.c on smithi181 2024-01-31T05:03:15.159 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:15.159 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:15.159 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-31T05:03:15.159 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: mon.a calling monitor election 2024-01-31T05:03:15.159 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-31T05:03:15.159 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:15.159 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-31T05:03:15.159 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-31T05:03:15.159 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: mon.c calling monitor election 2024-01-31T05:03:15.160 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:15.160 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-31T05:03:15.160 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-31T05:03:15.160 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:15.160 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-31T05:03:15.160 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-01-31T05:03:15.160 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: monmap e2: 2 mons at {a=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0],c=[v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-31T05:03:15.160 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: fsmap 2024-01-31T05:03:15.160 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: osdmap e4: 0 total, 0 up, 0 in 2024-01-31T05:03:15.160 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: mgrmap e13: x(active, since 50s) 2024-01-31T05:03:15.160 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: overall HEALTH_OK 2024-01-31T05:03:15.160 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:15.160 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:15.160 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:15.160 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-31T05:03:15.161 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:15.161 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: Deploying daemon mon.b on smithi179 2024-01-31T05:03:15.161 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-31T05:03:15.161 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:15.161 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: from='client.? 172.21.15.181:0/2686012387' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-01-31T05:03:15.161 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 ceph-mon[35652]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-01-31T05:03:15.161 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 bash[35633]: 3f34d781cfae37c2c393c8dcde3cf43c2cb1aacda1948702c4a923a5012a9360 2024-01-31T05:03:15.161 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:15 smithi179 systemd[1]: Started Ceph mon.b for 9288ff44-bff5-11ee-95b3-87774f69a715. 2024-01-31T05:03:20.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.319+0000 7fcd767a8700 1 -- 172.21.15.181:0/3072782070 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd580035c0 msgr2=0x7fcd58005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:20.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.319+0000 7fcd767a8700 1 --2- 172.21.15.181:0/3072782070 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd580035c0 0x7fcd58005a50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcd7006abf0 tx=0x7fcd6400fe60 comp rx=0 tx=0).stop 2024-01-31T05:03:20.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.319+0000 7fcd767a8700 1 -- 172.21.15.181:0/3072782070 shutdown_connections 2024-01-31T05:03:20.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.319+0000 7fcd767a8700 1 --2- 172.21.15.181:0/3072782070 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd580035c0 0x7fcd58005a50 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:20.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.319+0000 7fcd767a8700 1 -- 172.21.15.181:0/3072782070 >> 172.21.15.181:0/3072782070 conn(0x7fcd700767d0 msgr2=0x7fcd70076be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:03:20.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.319+0000 7fcd767a8700 1 -- 172.21.15.181:0/3072782070 shutdown_connections 2024-01-31T05:03:20.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.319+0000 7fcd767a8700 1 -- 172.21.15.181:0/3072782070 wait complete. 2024-01-31T05:03:20.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.320+0000 7fcd767a8700 1 Processor -- start 2024-01-31T05:03:20.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.320+0000 7fcd767a8700 1 -- start start 2024-01-31T05:03:20.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.320+0000 7fcd767a8700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd580035c0 0x7fcd70101f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:20.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.320+0000 7fcd767a8700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd70102440 0x7fcd701028c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:20.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.320+0000 7fcd767a8700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd701a2e40 0x7fcd701a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:20.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.320+0000 7fcd767a8700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd701a5800 con 0x7fcd580035c0 2024-01-31T05:03:20.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.320+0000 7fcd767a8700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd701a5940 con 0x7fcd701a2e40 2024-01-31T05:03:20.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.320+0000 7fcd767a8700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd701a5b00 con 0x7fcd70102440 2024-01-31T05:03:20.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.320+0000 7fcd6f7fe700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd70102440 0x7fcd701028c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:20.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.320+0000 7fcd6ffff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd580035c0 0x7fcd70101f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:20.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.320+0000 7fcd6f7fe700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd70102440 0x7fcd701028c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:48460/0 (socket says 172.21.15.181:48460) 2024-01-31T05:03:20.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.320+0000 7fcd6ffff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd580035c0 0x7fcd70101f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.181:44030/0 (socket says 172.21.15.181:44030) 2024-01-31T05:03:20.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.320+0000 7fcd6f7fe700 1 -- 172.21.15.181:0/3802453053 learned_addr learned my addr 172.21.15.181:0/3802453053 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-01-31T05:03:20.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.321+0000 7fcd74d45700 1 --2- 172.21.15.181:0/3802453053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd701a2e40 0x7fcd701a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:20.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.321+0000 7fcd6f7fe700 1 -- 172.21.15.181:0/3802453053 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd70102440 msgr2=0x7fcd701028c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-01-31T05:03:20.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.321+0000 7fcd6f7fe700 1 -- 172.21.15.181:0/3802453053 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd70102440 msgr2=0x7fcd701028c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-01-31T05:03:20.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.321+0000 7fcd6f7fe700 1 --2- 172.21.15.181:0/3802453053 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd70102440 0x7fcd701028c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-31T05:03:20.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.321+0000 7fcd6f7fe700 1 --2- 172.21.15.181:0/3802453053 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd70102440 0x7fcd701028c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-31T05:03:20.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.321+0000 7fcd74d45700 1 -- 172.21.15.181:0/3802453053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd701a2e40 msgr2=0x7fcd701a5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-01-31T05:03:20.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.321+0000 7fcd74d45700 1 -- 172.21.15.181:0/3802453053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd701a2e40 msgr2=0x7fcd701a5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-01-31T05:03:20.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.321+0000 7fcd74d45700 1 --2- 172.21.15.181:0/3802453053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd701a2e40 0x7fcd701a5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-31T05:03:20.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.321+0000 7fcd74d45700 1 --2- 172.21.15.181:0/3802453053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd701a2e40 0x7fcd701a5230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-31T05:03:20.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.321+0000 7fcd6ffff700 1 -- 172.21.15.181:0/3802453053 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd70102440 msgr2=0x7fcd701028c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-31T05:03:20.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.321+0000 7fcd6ffff700 1 --2- 172.21.15.181:0/3802453053 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd70102440 0x7fcd701028c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:20.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.321+0000 7fcd6ffff700 1 -- 172.21.15.181:0/3802453053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd701a2e40 msgr2=0x7fcd701a5230 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-31T05:03:20.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.321+0000 7fcd6ffff700 1 --2- 172.21.15.181:0/3802453053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd701a2e40 0x7fcd701a5230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:20.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.321+0000 7fcd6ffff700 1 -- 172.21.15.181:0/3802453053 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd6400f8b0 con 0x7fcd580035c0 2024-01-31T05:03:20.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.321+0000 7fcd6ffff700 1 --2- 172.21.15.181:0/3802453053 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd580035c0 0x7fcd70101f00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcd64020040 tx=0x7fcd640056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:03:20.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.321+0000 7fcd6d7fa700 1 -- 172.21.15.181:0/3802453053 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd640040b0 con 0x7fcd580035c0 2024-01-31T05:03:20.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.321+0000 7fcd6d7fa700 1 -- 172.21.15.181:0/3802453053 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcd64004210 con 0x7fcd580035c0 2024-01-31T05:03:20.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.321+0000 7fcd767a8700 1 -- 172.21.15.181:0/3802453053 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd701a5d80 con 0x7fcd580035c0 2024-01-31T05:03:20.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.321+0000 7fcd6d7fa700 1 -- 172.21.15.181:0/3802453053 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd64027810 con 0x7fcd580035c0 2024-01-31T05:03:20.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.321+0000 7fcd767a8700 1 -- 172.21.15.181:0/3802453053 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd701a6210 con 0x7fcd580035c0 2024-01-31T05:03:20.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.322+0000 7fcd6d7fa700 1 -- 172.21.15.181:0/3802453053 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 13) v1 ==== 45697+0+0 (secure 0 0 0) 0x7fcd64024050 con 0x7fcd580035c0 2024-01-31T05:03:20.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.322+0000 7fcd767a8700 1 -- 172.21.15.181:0/3802453053 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd70062e10 con 0x7fcd580035c0 2024-01-31T05:03:20.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.323+0000 7fcd6d7fa700 1 --2- 172.21.15.181:0/3802453053 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fcd5c038f70 0x7fcd5c03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:20.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.323+0000 7fcd6d7fa700 1 -- 172.21.15.181:0/3802453053 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fcd64000e40 con 0x7fcd580035c0 2024-01-31T05:03:20.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.323+0000 7fcd6f7fe700 1 --2- 172.21.15.181:0/3802453053 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fcd5c038f70 0x7fcd5c03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:20.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.323+0000 7fcd6f7fe700 1 --2- 172.21.15.181:0/3802453053 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fcd5c038f70 0x7fcd5c03b430 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcd60009180 tx=0x7fcd60008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:03:20.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.328+0000 7fcd6d7fa700 1 -- 172.21.15.181:0/3802453053 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fcd64026730 con 0x7fcd580035c0 2024-01-31T05:03:20.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:20 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-31T05:03:20.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:20 smithi099 ceph-mon[31615]: mon.c calling monitor election 2024-01-31T05:03:20.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:20 smithi099 ceph-mon[31615]: mon.a calling monitor election 2024-01-31T05:03:20.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:20 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-31T05:03:20.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:20 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-31T05:03:20.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:20 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-31T05:03:20.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:20 smithi099 ceph-mon[31615]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:20.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:20 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-31T05:03:20.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:20 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-31T05:03:20.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:20 smithi099 ceph-mon[31615]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:20.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:20 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-31T05:03:20.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:20 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-31T05:03:20.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:20 smithi099 ceph-mon[31615]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-01-31T05:03:20.570 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:20 smithi099 ceph-mon[31615]: monmap e3: 3 mons at {a=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0],b=[v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0],c=[v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-31T05:03:20.570 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:20 smithi099 ceph-mon[31615]: fsmap 2024-01-31T05:03:20.570 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:20 smithi099 ceph-mon[31615]: osdmap e4: 0 total, 0 up, 0 in 2024-01-31T05:03:20.570 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:20 smithi099 ceph-mon[31615]: mgrmap e13: x(active, since 59s) 2024-01-31T05:03:20.570 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:20 smithi099 ceph-mon[31615]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-01-31T05:03:20.570 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:20 smithi099 ceph-mon[31615]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-01-31T05:03:20.570 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:20 smithi099 ceph-mon[31615]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-01-31T05:03:20.570 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:20 smithi099 ceph-mon[31615]: mon.b (rank 2) addr [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] is down (out of quorum) 2024-01-31T05:03:20.570 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:20 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:20.570 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:20 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:20.570 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:20 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:20.570 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:20 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:20.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:20 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-31T05:03:20.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:20 smithi181 ceph-mon[36434]: mon.c calling monitor election 2024-01-31T05:03:20.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:20 smithi181 ceph-mon[36434]: mon.a calling monitor election 2024-01-31T05:03:20.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:20 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-31T05:03:20.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:20 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-31T05:03:20.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:20 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-31T05:03:20.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:20 smithi181 ceph-mon[36434]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:20.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:20 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-31T05:03:20.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:20 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-31T05:03:20.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:20 smithi181 ceph-mon[36434]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:20.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:20 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-31T05:03:20.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:20 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-31T05:03:20.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:20 smithi181 ceph-mon[36434]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-01-31T05:03:20.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:20 smithi181 ceph-mon[36434]: monmap e3: 3 mons at {a=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0],b=[v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0],c=[v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-31T05:03:20.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:20 smithi181 ceph-mon[36434]: fsmap 2024-01-31T05:03:20.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:20 smithi181 ceph-mon[36434]: osdmap e4: 0 total, 0 up, 0 in 2024-01-31T05:03:20.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:20 smithi181 ceph-mon[36434]: mgrmap e13: x(active, since 59s) 2024-01-31T05:03:20.573 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:20 smithi181 ceph-mon[36434]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-01-31T05:03:20.573 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:20 smithi181 ceph-mon[36434]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-01-31T05:03:20.573 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:20 smithi181 ceph-mon[36434]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-01-31T05:03:20.573 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:20 smithi181 ceph-mon[36434]: mon.b (rank 2) addr [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] is down (out of quorum) 2024-01-31T05:03:20.573 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:20 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:20.573 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:20 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:20.573 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:20 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:20.573 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:20 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:20.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.609+0000 7fcd767a8700 1 -- 172.21.15.181:0/3802453053 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fcd70108140 con 0x7fcd580035c0 2024-01-31T05:03:20.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.610+0000 7fcd6d7fa700 1 -- 172.21.15.181:0/3802453053 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1283 (secure 0 0 0) 0x7fcd64022070 con 0x7fcd580035c0 2024-01-31T05:03:20.610 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-01-31T05:03:20.610 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":3,"fsid":"9288ff44-bff5-11ee-95b3-87774f69a715","modified":"2024-01-31T05:03:15.027585Z","created":"2024-01-31T05:01:22.915485Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:3300","nonce":0},{"type":"v1","addr":"172.21.15.99:6789","nonce":0}]},"addr":"172.21.15.99:6789/0","public_addr":"172.21.15.99:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:3300","nonce":0},{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:3300","nonce":0},{"type":"v1","addr":"172.21.15.179:6789","nonce":0}]},"addr":"172.21.15.179:6789/0","public_addr":"172.21.15.179:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-01-31T05:03:20.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.612+0000 7fcd767a8700 1 -- 172.21.15.181:0/3802453053 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fcd5c038f70 msgr2=0x7fcd5c03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:20.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.612+0000 7fcd767a8700 1 --2- 172.21.15.181:0/3802453053 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fcd5c038f70 0x7fcd5c03b430 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcd60009180 tx=0x7fcd60008040 comp rx=0 tx=0).stop 2024-01-31T05:03:20.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.612+0000 7fcd767a8700 1 -- 172.21.15.181:0/3802453053 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd580035c0 msgr2=0x7fcd70101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:20.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.612+0000 7fcd767a8700 1 --2- 172.21.15.181:0/3802453053 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd580035c0 0x7fcd70101f00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcd64020040 tx=0x7fcd640056e0 comp rx=0 tx=0).stop 2024-01-31T05:03:20.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.612+0000 7fcd767a8700 1 -- 172.21.15.181:0/3802453053 shutdown_connections 2024-01-31T05:03:20.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.612+0000 7fcd767a8700 1 --2- 172.21.15.181:0/3802453053 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fcd5c038f70 0x7fcd5c03b430 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:20.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.612+0000 7fcd767a8700 1 --2- 172.21.15.181:0/3802453053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd701a2e40 0x7fcd701a5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:20.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.612+0000 7fcd767a8700 1 --2- 172.21.15.181:0/3802453053 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd580035c0 0x7fcd70101f00 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:20.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.612+0000 7fcd767a8700 1 --2- 172.21.15.181:0/3802453053 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd70102440 0x7fcd701028c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:20.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.612+0000 7fcd767a8700 1 -- 172.21.15.181:0/3802453053 >> 172.21.15.181:0/3802453053 conn(0x7fcd700767d0 msgr2=0x7fcd701046d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:03:20.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.612+0000 7fcd767a8700 1 -- 172.21.15.181:0/3802453053 shutdown_connections 2024-01-31T05:03:20.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:20.612+0000 7fcd767a8700 1 -- 172.21.15.181:0/3802453053 wait complete. 2024-01-31T05:03:20.614 INFO:teuthology.orchestra.run.smithi181.stderr:dumped monmap epoch 3 2024-01-31T05:03:21.206 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:21 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:03:21.206 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:21 smithi181 ceph-mon[36434]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:21.207 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:21 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:21.207 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:21 smithi181 ceph-mon[36434]: from='client.? 172.21.15.181:0/3802453053' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-01-31T05:03:21.207 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:21 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-31T05:03:21.230 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-01-31T05:03:21.230 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph config generate-minimal-conf 2024-01-31T05:03:21.479 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:03:21.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:21 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:03:21.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:21 smithi099 ceph-mon[31615]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:21.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:21 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:21.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:21 smithi099 ceph-mon[31615]: from='client.? 172.21.15.181:0/3802453053' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-01-31T05:03:21.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:21 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-31T05:03:22.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:22 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-31T05:03:22.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:22 smithi179 ceph-mon[35652]: mon.c calling monitor election 2024-01-31T05:03:22.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:22 smithi179 ceph-mon[35652]: mon.a calling monitor election 2024-01-31T05:03:22.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:22 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-31T05:03:22.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:22 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-31T05:03:22.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:22 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-31T05:03:22.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:22 smithi179 ceph-mon[35652]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:22.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:22 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-31T05:03:22.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:22 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-31T05:03:22.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:22 smithi179 ceph-mon[35652]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:22.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:22 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-31T05:03:22.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:22 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-31T05:03:22.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:22 smithi179 ceph-mon[35652]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-01-31T05:03:22.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:22 smithi179 ceph-mon[35652]: monmap e3: 3 mons at {a=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0],b=[v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0],c=[v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-31T05:03:22.384 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:22 smithi179 ceph-mon[35652]: fsmap 2024-01-31T05:03:22.384 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:22 smithi179 ceph-mon[35652]: osdmap e4: 0 total, 0 up, 0 in 2024-01-31T05:03:22.384 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:22 smithi179 ceph-mon[35652]: mgrmap e13: x(active, since 59s) 2024-01-31T05:03:22.384 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:22 smithi179 ceph-mon[35652]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-01-31T05:03:22.384 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:22 smithi179 ceph-mon[35652]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-01-31T05:03:22.384 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:22 smithi179 ceph-mon[35652]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-01-31T05:03:22.384 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:22 smithi179 ceph-mon[35652]: mon.b (rank 2) addr [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] is down (out of quorum) 2024-01-31T05:03:22.384 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:22 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:22.384 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:22 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:22.384 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:22 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:22.384 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:22 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:22.384 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:22 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:03:22.384 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:22 smithi179 ceph-mon[35652]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:22.384 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:22 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:22.384 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:22 smithi179 ceph-mon[35652]: from='client.? 172.21.15.181:0/3802453053' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-01-31T05:03:22.385 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:22 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-31T05:03:23.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.143+0000 7f5fe80e3700 1 -- 172.21.15.99:0/1599803328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5fe00ff930 msgr2=0x7f5fe00ffd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:23.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.143+0000 7f5fe80e3700 1 --2- 172.21.15.99:0/1599803328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5fe00ff930 0x7f5fe00ffd10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0009910 tx=0x7f5fd0009c20 comp rx=0 tx=0).stop 2024-01-31T05:03:23.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.143+0000 7f5fe80e3700 1 -- 172.21.15.99:0/1599803328 shutdown_connections 2024-01-31T05:03:23.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.143+0000 7f5fe80e3700 1 --2- 172.21.15.99:0/1599803328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5fe00ff930 0x7f5fe00ffd10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:23.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.143+0000 7f5fe80e3700 1 -- 172.21.15.99:0/1599803328 >> 172.21.15.99:0/1599803328 conn(0x7f5fe00fb330 msgr2=0x7f5fe00fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:03:23.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.143+0000 7f5fe80e3700 1 -- 172.21.15.99:0/1599803328 shutdown_connections 2024-01-31T05:03:23.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.143+0000 7f5fe80e3700 1 -- 172.21.15.99:0/1599803328 wait complete. 2024-01-31T05:03:23.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.143+0000 7f5fe80e3700 1 Processor -- start 2024-01-31T05:03:23.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.143+0000 7f5fe80e3700 1 -- start start 2024-01-31T05:03:23.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.144+0000 7f5fe80e3700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5fe00ff930 0x7f5fe01008b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:23.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.144+0000 7f5fe80e3700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fe0100df0 0x7f5fe0101270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:23.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.144+0000 7f5fe80e3700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5fe01a2e70 0x7f5fe01a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:23.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.144+0000 7f5fe80e3700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe01a5860 con 0x7f5fe00ff930 2024-01-31T05:03:23.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.144+0000 7f5fe80e3700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe01a59d0 con 0x7f5fe0100df0 2024-01-31T05:03:23.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.144+0000 7f5fe80e3700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe01a5b90 con 0x7f5fe01a2e70 2024-01-31T05:03:23.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.144+0000 7f5fe5e7f700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5fe00ff930 0x7f5fe01008b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:23.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.144+0000 7f5fe5e7f700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5fe00ff930 0x7f5fe01008b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58944/0 (socket says 172.21.15.99:58944) 2024-01-31T05:03:23.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.144+0000 7f5fe5e7f700 1 -- 172.21.15.99:0/3320166926 learned_addr learned my addr 172.21.15.99:0/3320166926 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:03:23.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.144+0000 7f5fe567e700 1 --2- 172.21.15.99:0/3320166926 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fe0100df0 0x7f5fe0101270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:23.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.144+0000 7f5fe5e7f700 1 -- 172.21.15.99:0/3320166926 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5fe01a2e70 msgr2=0x7f5fe01a5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:23.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.144+0000 7f5fe5e7f700 1 --2- 172.21.15.99:0/3320166926 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5fe01a2e70 0x7f5fe01a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:23.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.144+0000 7f5fe5e7f700 1 -- 172.21.15.99:0/3320166926 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fe0100df0 msgr2=0x7f5fe0101270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:23.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.144+0000 7f5fe5e7f700 1 --2- 172.21.15.99:0/3320166926 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fe0100df0 0x7f5fe0101270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:23.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.144+0000 7f5fe5e7f700 1 -- 172.21.15.99:0/3320166926 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd00095f0 con 0x7f5fe00ff930 2024-01-31T05:03:23.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.144+0000 7f5fe5e7f700 1 --2- 172.21.15.99:0/3320166926 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5fe00ff930 0x7f5fe01008b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0004cb0 tx=0x7f5fd0004ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:03:23.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.144+0000 7f5fd6ffd700 1 -- 172.21.15.99:0/3320166926 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd001d070 con 0x7f5fe00ff930 2024-01-31T05:03:23.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.145+0000 7f5fd6ffd700 1 -- 172.21.15.99:0/3320166926 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5fd0005000 con 0x7f5fe00ff930 2024-01-31T05:03:23.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.145+0000 7f5fe80e3700 1 -- 172.21.15.99:0/3320166926 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fe01a5e10 con 0x7f5fe00ff930 2024-01-31T05:03:23.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.145+0000 7f5fd6ffd700 1 -- 172.21.15.99:0/3320166926 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd0022d50 con 0x7f5fe00ff930 2024-01-31T05:03:23.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.145+0000 7f5fe80e3700 1 -- 172.21.15.99:0/3320166926 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fe01a6210 con 0x7f5fe00ff930 2024-01-31T05:03:23.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.145+0000 7f5fd6ffd700 1 -- 172.21.15.99:0/3320166926 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 13) v1 ==== 45697+0+0 (secure 0 0 0) 0x7f5fd000f460 con 0x7f5fe00ff930 2024-01-31T05:03:23.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.146+0000 7f5fd6ffd700 1 --2- 172.21.15.99:0/3320166926 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f5fcc038f70 0x7f5fcc03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:23.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.146+0000 7f5fd6ffd700 1 -- 172.21.15.99:0/3320166926 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f5fd004cc10 con 0x7f5fe00ff930 2024-01-31T05:03:23.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.146+0000 7f5fe567e700 1 --2- 172.21.15.99:0/3320166926 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f5fcc038f70 0x7f5fcc03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:23.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.146+0000 7f5fe80e3700 1 -- 172.21.15.99:0/3320166926 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fe01029d0 con 0x7f5fe00ff930 2024-01-31T05:03:23.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.146+0000 7f5fe567e700 1 --2- 172.21.15.99:0/3320166926 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f5fcc038f70 0x7f5fcc03b430 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc009ad0 tx=0x7f5fdc009210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:03:23.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.152+0000 7f5fd6ffd700 1 -- 172.21.15.99:0/3320166926 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f5fd0027030 con 0x7f5fe00ff930 2024-01-31T05:03:23.274 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:23 smithi099 ceph-mon[31615]: mon.b calling monitor election 2024-01-31T05:03:23.274 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:23 smithi099 ceph-mon[31615]: Updating smithi099:/etc/ceph/ceph.conf 2024-01-31T05:03:23.274 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:23 smithi099 ceph-mon[31615]: Updating smithi179:/etc/ceph/ceph.conf 2024-01-31T05:03:23.274 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:23 smithi099 ceph-mon[31615]: Updating smithi181:/etc/ceph/ceph.conf 2024-01-31T05:03:23.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:23 smithi099 ceph-mon[31615]: mon.b calling monitor election 2024-01-31T05:03:23.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:23 smithi099 ceph-mon[31615]: mon.c calling monitor election 2024-01-31T05:03:23.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:23 smithi099 ceph-mon[31615]: mon.a calling monitor election 2024-01-31T05:03:23.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:23 smithi099 ceph-mon[31615]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-01-31T05:03:23.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:23 smithi099 ceph-mon[31615]: monmap e3: 3 mons at {a=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0],b=[v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0],c=[v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-31T05:03:23.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:23 smithi099 ceph-mon[31615]: fsmap 2024-01-31T05:03:23.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:23 smithi099 ceph-mon[31615]: osdmap e4: 0 total, 0 up, 0 in 2024-01-31T05:03:23.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:23 smithi099 ceph-mon[31615]: mgrmap e13: x(active, since 61s) 2024-01-31T05:03:23.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:23 smithi099 ceph-mon[31615]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-01-31T05:03:23.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:23 smithi099 ceph-mon[31615]: Cluster is now healthy 2024-01-31T05:03:23.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:23 smithi099 ceph-mon[31615]: overall HEALTH_OK 2024-01-31T05:03:23.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:23 smithi099 ceph-mon[31615]: Updating smithi181:/var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/config/ceph.conf 2024-01-31T05:03:23.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:23 smithi099 ceph-mon[31615]: Updating smithi179:/var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/config/ceph.conf 2024-01-31T05:03:23.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:23 smithi099 ceph-mon[31615]: Updating smithi099:/var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/config/ceph.conf 2024-01-31T05:03:23.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:23 smithi099 ceph-mon[31615]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:23.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:23 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:23.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:23 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:23.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:23 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:23.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:23 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:23.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:23 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:23.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:23 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:23.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:23 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:23.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:23 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:23.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:23 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:23.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:23 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:23.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:23 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:23.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:23 smithi099 ceph-mon[31615]: Reconfiguring mon.a (unknown last config time)... 2024-01-31T05:03:23.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:23 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-31T05:03:23.277 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:23 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-31T05:03:23.277 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:23 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:23.277 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:23 smithi099 ceph-mon[31615]: Reconfiguring daemon mon.a on smithi099 2024-01-31T05:03:23.277 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:23 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-31T05:03:23.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:23 smithi181 ceph-mon[36434]: mon.b calling monitor election 2024-01-31T05:03:23.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:23 smithi181 ceph-mon[36434]: Updating smithi099:/etc/ceph/ceph.conf 2024-01-31T05:03:23.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:23 smithi181 ceph-mon[36434]: Updating smithi179:/etc/ceph/ceph.conf 2024-01-31T05:03:23.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:23 smithi181 ceph-mon[36434]: Updating smithi181:/etc/ceph/ceph.conf 2024-01-31T05:03:23.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:23 smithi181 ceph-mon[36434]: mon.b calling monitor election 2024-01-31T05:03:23.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:23 smithi181 ceph-mon[36434]: mon.c calling monitor election 2024-01-31T05:03:23.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:23 smithi181 ceph-mon[36434]: mon.a calling monitor election 2024-01-31T05:03:23.323 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:23 smithi181 ceph-mon[36434]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-01-31T05:03:23.323 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:23 smithi181 ceph-mon[36434]: monmap e3: 3 mons at {a=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0],b=[v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0],c=[v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-31T05:03:23.323 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:23 smithi181 ceph-mon[36434]: fsmap 2024-01-31T05:03:23.323 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:23 smithi181 ceph-mon[36434]: osdmap e4: 0 total, 0 up, 0 in 2024-01-31T05:03:23.323 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:23 smithi181 ceph-mon[36434]: mgrmap e13: x(active, since 61s) 2024-01-31T05:03:23.323 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:23 smithi181 ceph-mon[36434]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-01-31T05:03:23.323 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:23 smithi181 ceph-mon[36434]: Cluster is now healthy 2024-01-31T05:03:23.323 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:23 smithi181 ceph-mon[36434]: overall HEALTH_OK 2024-01-31T05:03:23.323 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:23 smithi181 ceph-mon[36434]: Updating smithi181:/var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/config/ceph.conf 2024-01-31T05:03:23.323 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:23 smithi181 ceph-mon[36434]: Updating smithi179:/var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/config/ceph.conf 2024-01-31T05:03:23.323 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:23 smithi181 ceph-mon[36434]: Updating smithi099:/var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/config/ceph.conf 2024-01-31T05:03:23.323 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:23 smithi181 ceph-mon[36434]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:23.323 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:23 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:23.323 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:23 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:23.324 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:23 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:23.324 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:23 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:23.324 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:23 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:23.324 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:23 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:23.324 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:23 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:23.324 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:23 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:23.324 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:23 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:23.324 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:23 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:23.324 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:23 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:23.324 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:23 smithi181 ceph-mon[36434]: Reconfiguring mon.a (unknown last config time)... 2024-01-31T05:03:23.324 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:23 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-31T05:03:23.324 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:23 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-31T05:03:23.324 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:23 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:23.324 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:23 smithi181 ceph-mon[36434]: Reconfiguring daemon mon.a on smithi099 2024-01-31T05:03:23.324 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:23 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-31T05:03:23.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.351+0000 7f5fe80e3700 1 -- 172.21.15.99:0/3320166926 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f5fe010b510 con 0x7f5fe00ff930 2024-01-31T05:03:23.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.352+0000 7f5fd6ffd700 1 -- 172.21.15.99:0/3320166926 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+275 (secure 0 0 0) 0x7f5fd0027030 con 0x7f5fe00ff930 2024-01-31T05:03:23.351 INFO:teuthology.orchestra.run.smithi099.stdout:# minimal ceph.conf for 9288ff44-bff5-11ee-95b3-87774f69a715 2024-01-31T05:03:23.351 INFO:teuthology.orchestra.run.smithi099.stdout:[global] 2024-01-31T05:03:23.351 INFO:teuthology.orchestra.run.smithi099.stdout: fsid = 9288ff44-bff5-11ee-95b3-87774f69a715 2024-01-31T05:03:23.351 INFO:teuthology.orchestra.run.smithi099.stdout: mon_host = [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-01-31T05:03:23.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.354+0000 7f5fe80e3700 1 -- 172.21.15.99:0/3320166926 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f5fcc038f70 msgr2=0x7f5fcc03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:23.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.354+0000 7f5fe80e3700 1 --2- 172.21.15.99:0/3320166926 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f5fcc038f70 0x7f5fcc03b430 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc009ad0 tx=0x7f5fdc009210 comp rx=0 tx=0).stop 2024-01-31T05:03:23.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.354+0000 7f5fe80e3700 1 -- 172.21.15.99:0/3320166926 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5fe00ff930 msgr2=0x7f5fe01008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:23.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.354+0000 7f5fe80e3700 1 --2- 172.21.15.99:0/3320166926 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5fe00ff930 0x7f5fe01008b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0004cb0 tx=0x7f5fd0004ce0 comp rx=0 tx=0).stop 2024-01-31T05:03:23.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.354+0000 7f5fe80e3700 1 -- 172.21.15.99:0/3320166926 shutdown_connections 2024-01-31T05:03:23.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.354+0000 7f5fe80e3700 1 --2- 172.21.15.99:0/3320166926 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5fe01a2e70 0x7f5fe01a5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:23.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.354+0000 7f5fe80e3700 1 --2- 172.21.15.99:0/3320166926 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5fe00ff930 0x7f5fe01008b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:23.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.354+0000 7f5fe80e3700 1 --2- 172.21.15.99:0/3320166926 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f5fcc038f70 0x7f5fcc03b430 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:23.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.354+0000 7f5fe80e3700 1 --2- 172.21.15.99:0/3320166926 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fe0100df0 0x7f5fe0101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:23.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.354+0000 7f5fe80e3700 1 -- 172.21.15.99:0/3320166926 >> 172.21.15.99:0/3320166926 conn(0x7f5fe00fb330 msgr2=0x7f5fe0102f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:03:23.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.354+0000 7f5fe80e3700 1 -- 172.21.15.99:0/3320166926 shutdown_connections 2024-01-31T05:03:23.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:23.354+0000 7f5fe80e3700 1 -- 172.21.15.99:0/3320166926 wait complete. 2024-01-31T05:03:23.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:23 smithi179 ceph-mon[35652]: mon.b calling monitor election 2024-01-31T05:03:23.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:23 smithi179 ceph-mon[35652]: Updating smithi099:/etc/ceph/ceph.conf 2024-01-31T05:03:23.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:23 smithi179 ceph-mon[35652]: Updating smithi179:/etc/ceph/ceph.conf 2024-01-31T05:03:23.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:23 smithi179 ceph-mon[35652]: Updating smithi181:/etc/ceph/ceph.conf 2024-01-31T05:03:23.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:23 smithi179 ceph-mon[35652]: mon.b calling monitor election 2024-01-31T05:03:23.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:23 smithi179 ceph-mon[35652]: mon.c calling monitor election 2024-01-31T05:03:23.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:23 smithi179 ceph-mon[35652]: mon.a calling monitor election 2024-01-31T05:03:23.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:23 smithi179 ceph-mon[35652]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-01-31T05:03:23.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:23 smithi179 ceph-mon[35652]: monmap e3: 3 mons at {a=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0],b=[v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0],c=[v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-31T05:03:23.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:23 smithi179 ceph-mon[35652]: fsmap 2024-01-31T05:03:23.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:23 smithi179 ceph-mon[35652]: osdmap e4: 0 total, 0 up, 0 in 2024-01-31T05:03:23.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:23 smithi179 ceph-mon[35652]: mgrmap e13: x(active, since 61s) 2024-01-31T05:03:23.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:23 smithi179 ceph-mon[35652]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-01-31T05:03:23.384 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:23 smithi179 ceph-mon[35652]: Cluster is now healthy 2024-01-31T05:03:23.384 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:23 smithi179 ceph-mon[35652]: overall HEALTH_OK 2024-01-31T05:03:23.384 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:23 smithi179 ceph-mon[35652]: Updating smithi181:/var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/config/ceph.conf 2024-01-31T05:03:23.384 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:23 smithi179 ceph-mon[35652]: Updating smithi179:/var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/config/ceph.conf 2024-01-31T05:03:23.384 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:23 smithi179 ceph-mon[35652]: Updating smithi099:/var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/config/ceph.conf 2024-01-31T05:03:23.384 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:23 smithi179 ceph-mon[35652]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:23.384 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:23 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:23.384 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:23 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:23.384 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:23 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:23.384 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:23 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:23.384 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:23 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:23.384 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:23 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:23.384 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:23 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:23.384 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:23 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:23.385 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:23 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:23.385 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:23 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:23.385 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:23 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:23.385 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:23 smithi179 ceph-mon[35652]: Reconfiguring mon.a (unknown last config time)... 2024-01-31T05:03:23.385 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:23 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-31T05:03:23.385 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:23 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-31T05:03:23.385 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:23 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:23.385 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:23 smithi179 ceph-mon[35652]: Reconfiguring daemon mon.a on smithi099 2024-01-31T05:03:23.385 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:23 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-31T05:03:24.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:24 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/3320166926' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:24.467 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:24 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/3320166926' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:24.490 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-01-31T05:03:24.490 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-31T05:03:24.490 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/ceph/ceph.conf 2024-01-31T05:03:24.519 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-31T05:03:24.520 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-01-31T05:03:24.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:24 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/3320166926' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:24.587 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-31T05:03:24.587 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/ceph/ceph.conf 2024-01-31T05:03:24.620 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-31T05:03:24.621 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-01-31T05:03:24.690 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-01-31T05:03:24.691 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/ceph/ceph.conf 2024-01-31T05:03:24.725 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-01-31T05:03:24.725 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-01-31T05:03:24.794 INFO:tasks.cephadm:Adding mgr.x on smithi099 2024-01-31T05:03:24.794 INFO:tasks.cephadm:Adding mgr.y on smithi179 2024-01-31T05:03:24.795 INFO:tasks.cephadm:Adding mgr.z on smithi181 2024-01-31T05:03:24.795 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph orch apply mgr '3;smithi099=x;smithi179=y;smithi181=z' 2024-01-31T05:03:25.069 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.c/config 2024-01-31T05:03:25.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:25 smithi099 ceph-mon[31615]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:25.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:25 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:25.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:25 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:25.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:25 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-31T05:03:25.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:25 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-31T05:03:25.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:25 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:25.363 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:25 smithi181 ceph-mon[36434]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:25.363 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:25 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:25.363 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:25 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:25.363 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:25 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-31T05:03:25.363 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:25 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-31T05:03:25.363 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:25 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:25.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:25 smithi179 ceph-mon[35652]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:25.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:25 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:25.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:25 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:25.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:25 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-31T05:03:25.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:25 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-31T05:03:25.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:25 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:26.287 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:26 smithi181 ceph-mon[36434]: Reconfiguring mon.b (monmap changed)... 2024-01-31T05:03:26.287 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:26 smithi181 ceph-mon[36434]: Reconfiguring daemon mon.b on smithi179 2024-01-31T05:03:26.380 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:26 smithi179 ceph-mon[35652]: Reconfiguring mon.b (monmap changed)... 2024-01-31T05:03:26.380 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:26 smithi179 ceph-mon[35652]: Reconfiguring daemon mon.b on smithi179 2024-01-31T05:03:26.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.499+0000 7ff52f429700 1 -- 172.21.15.181:0/2889921947 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff528101de0 msgr2=0x7ff5281041d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:26.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.499+0000 7ff52f429700 1 --2- 172.21.15.181:0/2889921947 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff528101de0 0x7ff5281041d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff524009910 tx=0x7ff524009c20 comp rx=0 tx=0).stop 2024-01-31T05:03:26.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.499+0000 7ff52f429700 1 -- 172.21.15.181:0/2889921947 shutdown_connections 2024-01-31T05:03:26.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.499+0000 7ff52f429700 1 --2- 172.21.15.181:0/2889921947 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff528101de0 0x7ff5281041d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:26.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.499+0000 7ff52f429700 1 -- 172.21.15.181:0/2889921947 >> 172.21.15.181:0/2889921947 conn(0x7ff5280fb7f0 msgr2=0x7ff5280fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:03:26.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.500+0000 7ff52f429700 1 -- 172.21.15.181:0/2889921947 shutdown_connections 2024-01-31T05:03:26.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.500+0000 7ff52f429700 1 -- 172.21.15.181:0/2889921947 wait complete. 2024-01-31T05:03:26.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.500+0000 7ff52f429700 1 Processor -- start 2024-01-31T05:03:26.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.500+0000 7ff52f429700 1 -- start start 2024-01-31T05:03:26.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.500+0000 7ff52f429700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff528101de0 0x7ff5281967c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:26.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.500+0000 7ff52f429700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff528196d00 0x7ff52819bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:26.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.500+0000 7ff52f429700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff528197180 0x7ff52819e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:26.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.500+0000 7ff52f429700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff52819eaa0 con 0x7ff528101de0 2024-01-31T05:03:26.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.500+0000 7ff52f429700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff52819ec10 con 0x7ff528196d00 2024-01-31T05:03:26.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.500+0000 7ff52f429700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff52819edd0 con 0x7ff528197180 2024-01-31T05:03:26.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.500+0000 7ff52d9c6700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff528197180 0x7ff52819e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:26.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.500+0000 7ff52d1c5700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff528101de0 0x7ff5281967c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:26.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.500+0000 7ff52d9c6700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff528197180 0x7ff52819e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:48474/0 (socket says 172.21.15.181:48474) 2024-01-31T05:03:26.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.500+0000 7ff52d1c5700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff528101de0 0x7ff5281967c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.181:44060/0 (socket says 172.21.15.181:44060) 2024-01-31T05:03:26.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.500+0000 7ff52d9c6700 1 -- 172.21.15.181:0/3422847466 learned_addr learned my addr 172.21.15.181:0/3422847466 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-01-31T05:03:26.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.501+0000 7ff52c9c4700 1 --2- 172.21.15.181:0/3422847466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff528196d00 0x7ff52819bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:26.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.501+0000 7ff52d1c5700 1 -- 172.21.15.181:0/3422847466 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff528197180 msgr2=0x7ff52819e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:26.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.501+0000 7ff52d1c5700 1 --2- 172.21.15.181:0/3422847466 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff528197180 0x7ff52819e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:26.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.501+0000 7ff52d1c5700 1 -- 172.21.15.181:0/3422847466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff528196d00 msgr2=0x7ff52819bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:26.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.501+0000 7ff52d1c5700 1 --2- 172.21.15.181:0/3422847466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff528196d00 0x7ff52819bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:26.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.501+0000 7ff52d1c5700 1 -- 172.21.15.181:0/3422847466 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5240095f0 con 0x7ff528101de0 2024-01-31T05:03:26.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.501+0000 7ff52d9c6700 1 --2- 172.21.15.181:0/3422847466 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff528197180 0x7ff52819e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:03:26.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.501+0000 7ff52d1c5700 1 --2- 172.21.15.181:0/3422847466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff528101de0 0x7ff5281967c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff524006010 tx=0x7ff52401cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:03:26.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.501+0000 7ff51e7fc700 1 -- 172.21.15.181:0/3422847466 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff524021070 con 0x7ff528101de0 2024-01-31T05:03:26.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.501+0000 7ff51e7fc700 1 -- 172.21.15.181:0/3422847466 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff524004bd0 con 0x7ff528101de0 2024-01-31T05:03:26.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.501+0000 7ff52f429700 1 -- 172.21.15.181:0/3422847466 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5280ffbd0 con 0x7ff528101de0 2024-01-31T05:03:26.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.501+0000 7ff51e7fc700 1 -- 172.21.15.181:0/3422847466 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52400f460 con 0x7ff528101de0 2024-01-31T05:03:26.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.501+0000 7ff52f429700 1 -- 172.21.15.181:0/3422847466 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff528100140 con 0x7ff528101de0 2024-01-31T05:03:26.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.502+0000 7ff51e7fc700 1 -- 172.21.15.181:0/3422847466 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 13) v1 ==== 45697+0+0 (secure 0 0 0) 0x7ff524025070 con 0x7ff528101de0 2024-01-31T05:03:26.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.502+0000 7ff52f429700 1 -- 172.21.15.181:0/3422847466 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff528190020 con 0x7ff528101de0 2024-01-31T05:03:26.505 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.503+0000 7ff51e7fc700 1 --2- 172.21.15.181:0/3422847466 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff514038f70 0x7ff51403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:26.505 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.503+0000 7ff51e7fc700 1 -- 172.21.15.181:0/3422847466 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ff524050b60 con 0x7ff528101de0 2024-01-31T05:03:26.505 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.503+0000 7ff52c9c4700 1 --2- 172.21.15.181:0/3422847466 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff514038f70 0x7ff51403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:26.505 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.503+0000 7ff52c9c4700 1 --2- 172.21.15.181:0/3422847466 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff514038f70 0x7ff51403b430 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff518009ad0 tx=0x7ff518009210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:03:26.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.508+0000 7ff51e7fc700 1 -- 172.21.15.181:0/3422847466 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7ff52402fb90 con 0x7ff528101de0 2024-01-31T05:03:26.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:26 smithi099 ceph-mon[31615]: Reconfiguring mon.b (monmap changed)... 2024-01-31T05:03:26.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:26 smithi099 ceph-mon[31615]: Reconfiguring daemon mon.b on smithi179 2024-01-31T05:03:26.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.718+0000 7ff52f429700 1 -- 172.21.15.181:0/3422847466 --> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi099=x;smithi179=y;smithi181=z", "target": ["mon-mgr", ""]}) v1 -- 0x7ff52802d4a0 con 0x7ff514038f70 2024-01-31T05:03:26.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.724+0000 7ff51e7fc700 1 -- 172.21.15.181:0/3422847466 <== mgr.14152 v2:172.21.15.99:6800/3925720924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7ff52802d4a0 con 0x7ff514038f70 2024-01-31T05:03:26.724 INFO:teuthology.orchestra.run.smithi181.stdout:Scheduled mgr update... 2024-01-31T05:03:26.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.726+0000 7ff52f429700 1 -- 172.21.15.181:0/3422847466 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff514038f70 msgr2=0x7ff51403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:26.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.726+0000 7ff52f429700 1 --2- 172.21.15.181:0/3422847466 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff514038f70 0x7ff51403b430 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff518009ad0 tx=0x7ff518009210 comp rx=0 tx=0).stop 2024-01-31T05:03:26.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.726+0000 7ff52f429700 1 -- 172.21.15.181:0/3422847466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff528101de0 msgr2=0x7ff5281967c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:26.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.726+0000 7ff52f429700 1 --2- 172.21.15.181:0/3422847466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff528101de0 0x7ff5281967c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff524006010 tx=0x7ff52401cde0 comp rx=0 tx=0).stop 2024-01-31T05:03:26.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.726+0000 7ff52f429700 1 -- 172.21.15.181:0/3422847466 shutdown_connections 2024-01-31T05:03:26.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.726+0000 7ff52f429700 1 --2- 172.21.15.181:0/3422847466 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff528197180 0x7ff52819e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:26.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.726+0000 7ff52f429700 1 --2- 172.21.15.181:0/3422847466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff528101de0 0x7ff5281967c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:26.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.726+0000 7ff52f429700 1 --2- 172.21.15.181:0/3422847466 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff514038f70 0x7ff51403b430 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:26.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.726+0000 7ff52f429700 1 --2- 172.21.15.181:0/3422847466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff528196d00 0x7ff52819bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:26.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.726+0000 7ff52f429700 1 -- 172.21.15.181:0/3422847466 >> 172.21.15.181:0/3422847466 conn(0x7ff5280fb7f0 msgr2=0x7ff5280fc460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:03:26.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.726+0000 7ff52f429700 1 -- 172.21.15.181:0/3422847466 shutdown_connections 2024-01-31T05:03:26.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:03:26.727+0000 7ff52f429700 1 -- 172.21.15.181:0/3422847466 wait complete. 2024-01-31T05:03:27.323 DEBUG:teuthology.orchestra.run.smithi179:mgr.y> sudo journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mgr.y.service 2024-01-31T05:03:27.326 DEBUG:teuthology.orchestra.run.smithi181:mgr.z> sudo journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mgr.z.service 2024-01-31T05:03:27.329 INFO:tasks.cephadm:Deploying OSDs... 2024-01-31T05:03:27.329 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-31T05:03:27.329 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/scratch_devs of=/dev/stdout 2024-01-31T05:03:27.348 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-31T05:03:27.348 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_1 2024-01-31T05:03:27.405 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-31T05:03:27.406 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-31T05:03:27.406 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-01-31T05:03:27.406 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-31T05:03:27.406 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-01-31T05:03:27.406 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-01-31 05:02:33.544896543 +0000 2024-01-31T05:03:27.406 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-01-31 04:57:17.783495912 +0000 2024-01-31T05:03:27.406 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-01-31 04:57:17.783495912 +0000 2024-01-31T05:03:27.406 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2024-01-31 04:57:17.783495912 +0000 2024-01-31T05:03:27.406 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-31T05:03:27.474 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:27 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:27.474 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:27 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:27.474 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:27 smithi181 ceph-mon[36434]: Reconfiguring mon.c (monmap changed)... 2024-01-31T05:03:27.474 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:27 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-31T05:03:27.475 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:27 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-31T05:03:27.475 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:27 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:27.475 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:27 smithi181 ceph-mon[36434]: Reconfiguring daemon mon.c on smithi181 2024-01-31T05:03:27.475 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:27 smithi181 ceph-mon[36434]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:27.475 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:27 smithi181 ceph-mon[36434]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi099=x;smithi179=y;smithi181=z", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:03:27.475 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:27 smithi181 ceph-mon[36434]: Saving service mgr spec with placement smithi099=x;smithi179=y;smithi181=z;count:3 2024-01-31T05:03:27.475 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:27 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:27.476 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-01-31T05:03:27.476 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-01-31T05:03:27.476 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000221638 s, 2.3 MB/s 2024-01-31T05:03:27.478 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-31T05:03:27.535 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_2 2024-01-31T05:03:27.590 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-31T05:03:27.590 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-31T05:03:27.590 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-01-31T05:03:27.590 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-31T05:03:27.591 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-01-31T05:03:27.591 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-01-31 05:02:33.583895650 +0000 2024-01-31T05:03:27.591 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-01-31 04:57:18.140487730 +0000 2024-01-31T05:03:27.591 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-01-31 04:57:18.140487730 +0000 2024-01-31T05:03:27.591 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2024-01-31 04:57:18.140487730 +0000 2024-01-31T05:03:27.591 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-31T05:03:27.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:27 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:27.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:27 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:27.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:27 smithi179 ceph-mon[35652]: Reconfiguring mon.c (monmap changed)... 2024-01-31T05:03:27.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:27 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-31T05:03:27.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:27 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-31T05:03:27.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:27 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:27.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:27 smithi179 ceph-mon[35652]: Reconfiguring daemon mon.c on smithi181 2024-01-31T05:03:27.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:27 smithi179 ceph-mon[35652]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:27.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:27 smithi179 ceph-mon[35652]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi099=x;smithi179=y;smithi181=z", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:03:27.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:27 smithi179 ceph-mon[35652]: Saving service mgr spec with placement smithi099=x;smithi179=y;smithi181=z;count:3 2024-01-31T05:03:27.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:27 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:27.658 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-01-31T05:03:27.658 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-01-31T05:03:27.658 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.00024934 s, 2.1 MB/s 2024-01-31T05:03:27.659 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-31T05:03:27.716 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_3 2024-01-31T05:03:27.772 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-31T05:03:27.772 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-31T05:03:27.772 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-01-31T05:03:27.773 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-31T05:03:27.773 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-01-31T05:03:27.773 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-01-31 05:02:33.613894963 +0000 2024-01-31T05:03:27.773 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-01-31 04:57:18.475480053 +0000 2024-01-31T05:03:27.773 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-01-31 04:57:18.475480053 +0000 2024-01-31T05:03:27.773 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2024-01-31 04:57:18.475480053 +0000 2024-01-31T05:03:27.773 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-31T05:03:27.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:27 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:27.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:27 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:27.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:27 smithi099 ceph-mon[31615]: Reconfiguring mon.c (monmap changed)... 2024-01-31T05:03:27.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:27 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-31T05:03:27.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:27 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-31T05:03:27.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:27 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:27.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:27 smithi099 ceph-mon[31615]: Reconfiguring daemon mon.c on smithi181 2024-01-31T05:03:27.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:27 smithi099 ceph-mon[31615]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:27.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:27 smithi099 ceph-mon[31615]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi099=x;smithi179=y;smithi181=z", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:03:27.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:27 smithi099 ceph-mon[31615]: Saving service mgr spec with placement smithi099=x;smithi179=y;smithi181=z;count:3 2024-01-31T05:03:27.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:27 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:27.840 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-01-31T05:03:27.840 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-01-31T05:03:27.840 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000250575 s, 2.0 MB/s 2024-01-31T05:03:27.841 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-31T05:03:27.897 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_4 2024-01-31T05:03:27.952 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-31T05:03:27.952 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-31T05:03:27.952 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-01-31T05:03:27.953 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-31T05:03:27.953 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-01-31T05:03:27.953 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-01-31 05:02:33.643894276 +0000 2024-01-31T05:03:27.953 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-01-31 04:57:18.805472490 +0000 2024-01-31T05:03:27.953 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-01-31 04:57:18.805472490 +0000 2024-01-31T05:03:27.953 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2024-01-31 04:57:18.805472490 +0000 2024-01-31T05:03:27.953 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-31T05:03:28.018 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-01-31T05:03:28.018 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-01-31T05:03:28.018 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000194878 s, 2.6 MB/s 2024-01-31T05:03:28.020 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-31T05:03:28.075 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-01-31T05:03:28.075 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/scratch_devs of=/dev/stdout 2024-01-31T05:03:28.094 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-31T05:03:28.094 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_1 2024-01-31T05:03:28.155 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-31T05:03:28.155 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-31T05:03:28.155 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 663 Links: 1 2024-01-31T05:03:28.155 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-31T05:03:28.156 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2024-01-31T05:03:28.156 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-01-31 05:03:14.442279476 +0000 2024-01-31T05:03:28.156 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-01-31 04:57:40.540646814 +0000 2024-01-31T05:03:28.156 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-01-31 04:57:40.540646814 +0000 2024-01-31T05:03:28.156 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2024-01-31 04:57:40.540646814 +0000 2024-01-31T05:03:28.156 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-31T05:03:28.224 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-01-31T05:03:28.224 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-01-31T05:03:28.224 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000212883 s, 2.4 MB/s 2024-01-31T05:03:28.225 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-31T05:03:28.283 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_2 2024-01-31T05:03:28.339 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-31T05:03:28.339 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-31T05:03:28.340 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 682 Links: 1 2024-01-31T05:03:28.340 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-31T05:03:28.340 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2024-01-31T05:03:28.340 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-01-31 05:03:14.443279453 +0000 2024-01-31T05:03:28.340 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-01-31 04:57:40.897638460 +0000 2024-01-31T05:03:28.340 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-01-31 04:57:40.897638460 +0000 2024-01-31T05:03:28.340 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2024-01-31 04:57:40.897638460 +0000 2024-01-31T05:03:28.340 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-31T05:03:28.408 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-01-31T05:03:28.408 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-01-31T05:03:28.408 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000232566 s, 2.2 MB/s 2024-01-31T05:03:28.409 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-31T05:03:28.467 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_3 2024-01-31T05:03:28.524 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-31T05:03:28.524 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-31T05:03:28.524 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 701 Links: 1 2024-01-31T05:03:28.524 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-31T05:03:28.524 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2024-01-31T05:03:28.524 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-01-31 05:03:14.443279453 +0000 2024-01-31T05:03:28.524 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-01-31 04:57:41.253630128 +0000 2024-01-31T05:03:28.524 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-01-31 04:57:41.253630128 +0000 2024-01-31T05:03:28.524 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2024-01-31 04:57:41.253630128 +0000 2024-01-31T05:03:28.525 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-31T05:03:28.592 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-01-31T05:03:28.592 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-01-31T05:03:28.592 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000296326 s, 1.7 MB/s 2024-01-31T05:03:28.593 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-31T05:03:28.650 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_4 2024-01-31T05:03:28.706 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-31T05:03:28.706 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-31T05:03:28.706 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 718 Links: 1 2024-01-31T05:03:28.706 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-31T05:03:28.707 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2024-01-31T05:03:28.707 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-01-31 05:03:14.443279453 +0000 2024-01-31T05:03:28.707 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-01-31 04:57:41.590622242 +0000 2024-01-31T05:03:28.707 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-01-31 04:57:41.590622242 +0000 2024-01-31T05:03:28.707 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2024-01-31 04:57:41.590622242 +0000 2024-01-31T05:03:28.707 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-31T05:03:28.773 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-01-31T05:03:28.773 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-01-31T05:03:28.773 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000202359 s, 2.5 MB/s 2024-01-31T05:03:28.774 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-31T05:03:28.831 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-01-31T05:03:28.831 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/scratch_devs of=/dev/stdout 2024-01-31T05:03:28.847 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-31T05:03:28.847 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_1 2024-01-31T05:03:28.903 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-31T05:03:28.903 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-31T05:03:28.903 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 663 Links: 1 2024-01-31T05:03:28.904 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-31T05:03:28.904 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-01-31T05:03:28.904 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-01-31 05:03:04.784256818 +0000 2024-01-31T05:03:28.904 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-01-31 04:57:30.953871089 +0000 2024-01-31T05:03:28.904 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-01-31 04:57:30.953871089 +0000 2024-01-31T05:03:28.904 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-01-31 04:57:30.953871089 +0000 2024-01-31T05:03:28.904 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-31T05:03:28.971 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-01-31T05:03:28.972 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-01-31T05:03:28.972 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000272846 s, 1.9 MB/s 2024-01-31T05:03:28.972 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-31T05:03:29.027 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_2 2024-01-31T05:03:29.082 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-31T05:03:29.083 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-31T05:03:29.083 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 681 Links: 1 2024-01-31T05:03:29.083 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-31T05:03:29.083 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-01-31T05:03:29.083 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-01-31 05:03:04.784256818 +0000 2024-01-31T05:03:29.083 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-01-31 04:57:31.312863753 +0000 2024-01-31T05:03:29.083 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-01-31 04:57:31.312863753 +0000 2024-01-31T05:03:29.083 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-01-31 04:57:31.312863753 +0000 2024-01-31T05:03:29.083 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-31T05:03:29.148 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-01-31T05:03:29.148 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-01-31T05:03:29.148 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000215854 s, 2.4 MB/s 2024-01-31T05:03:29.150 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-31T05:03:29.205 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_3 2024-01-31T05:03:29.259 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-31T05:03:29.259 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-31T05:03:29.259 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-01-31T05:03:29.259 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-31T05:03:29.259 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-01-31T05:03:29.259 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-01-31 05:03:04.785256798 +0000 2024-01-31T05:03:29.259 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-01-31 04:57:31.658856681 +0000 2024-01-31T05:03:29.259 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-01-31 04:57:31.658856681 +0000 2024-01-31T05:03:29.259 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-01-31 04:57:31.658856681 +0000 2024-01-31T05:03:29.260 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-31T05:03:29.325 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-01-31T05:03:29.326 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-01-31T05:03:29.326 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000217917 s, 2.3 MB/s 2024-01-31T05:03:29.327 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-31T05:03:29.384 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_4 2024-01-31T05:03:29.439 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-31T05:03:29.439 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-31T05:03:29.440 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 719 Links: 1 2024-01-31T05:03:29.440 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-31T05:03:29.440 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-01-31T05:03:29.440 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-01-31 05:03:04.785256798 +0000 2024-01-31T05:03:29.440 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-01-31 04:57:31.991849877 +0000 2024-01-31T05:03:29.440 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-01-31 04:57:31.991849877 +0000 2024-01-31T05:03:29.440 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-01-31 04:57:31.991849877 +0000 2024-01-31T05:03:29.440 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-31T05:03:29.502 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:29 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:29.503 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:29 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:29.503 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:29 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:03:29.503 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:29 smithi181 ceph-mon[36434]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:29.503 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:29 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:29.503 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:29 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:03:29.503 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:29 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:29.503 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:29 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-31T05:03:29.503 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:29 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-01-31T05:03:29.503 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:29 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-31T05:03:29.503 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:29 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:29.505 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-01-31T05:03:29.505 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-01-31T05:03:29.505 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000184313 s, 2.8 MB/s 2024-01-31T05:03:29.506 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-31T05:03:29.561 INFO:tasks.cephadm:Deploying osd.0 on smithi099 with /dev/vg_nvme/lv_4... 2024-01-31T05:03:29.561 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-01-31T05:03:29.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:29 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:29.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:29 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:29.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:29 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:03:29.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:29 smithi099 ceph-mon[31615]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:29.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:29 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:29.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:29 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:03:29.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:29 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:29.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:29 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-31T05:03:29.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:29 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-01-31T05:03:29.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:29 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-31T05:03:29.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:29 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:29.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:29 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:29.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:29 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:29.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:29 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:03:29.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:29 smithi179 ceph-mon[35652]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:29.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:29 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:29.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:29 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:03:29.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:29 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:29.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:29 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-31T05:03:29.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:29 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-01-31T05:03:29.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:29 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-31T05:03:29.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:29 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:29.798 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:03:30.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:30 smithi099 ceph-mon[31615]: Deploying daemon mgr.z on smithi181 2024-01-31T05:03:30.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:30 smithi181 ceph-mon[36434]: Deploying daemon mgr.z on smithi181 2024-01-31T05:03:30.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:30 smithi179 ceph-mon[35652]: Deploying daemon mgr.z on smithi181 2024-01-31T05:03:31.015 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Jan 31 05:03:30 smithi181 systemd[1]: Starting Ceph mgr.z for 9288ff44-bff5-11ee-95b3-87774f69a715... 2024-01-31T05:03:31.282 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Jan 31 05:03:31 smithi181 podman[38281]: 2024-01-31 05:03:30.918417021 +0000 UTC m=+0.017657687 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-31T05:03:31.282 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Jan 31 05:03:31 smithi181 podman[38281]: 2024-01-31 05:03:31.028141721 +0000 UTC m=+0.127382377 container create 48f729b6ae87d48e3bd97bf9e5533a6b1a14d5fc7749b6d3e831227785a60544 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-z, org.label-schema.license=GPLv2, io.buildah.version=1.31.3, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240123, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-01-31T05:03:31.282 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Jan 31 05:03:31 smithi181 podman[38281]: 2024-01-31 05:03:31.249223428 +0000 UTC m=+0.348464095 container init 48f729b6ae87d48e3bd97bf9e5533a6b1a14d5fc7749b6d3e831227785a60544 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-z, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240123, CEPH_POINT_RELEASE=, io.buildah.version=1.31.3, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-01-31T05:03:31.282 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Jan 31 05:03:31 smithi181 podman[38281]: 2024-01-31 05:03:31.252096249 +0000 UTC m=+0.351336921 container start 48f729b6ae87d48e3bd97bf9e5533a6b1a14d5fc7749b6d3e831227785a60544 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-z, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240125.044502-661946e, io.buildah.version=1.31.3, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240123) 2024-01-31T05:03:31.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:31 smithi099 ceph-mon[31615]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:31.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:31 smithi181 ceph-mon[36434]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:31.571 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Jan 31 05:03:31 smithi181 bash[38281]: 48f729b6ae87d48e3bd97bf9e5533a6b1a14d5fc7749b6d3e831227785a60544 2024-01-31T05:03:31.571 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Jan 31 05:03:31 smithi181 systemd[1]: Started Ceph mgr.z for 9288ff44-bff5-11ee-95b3-87774f69a715. 2024-01-31T05:03:31.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:31 smithi179 ceph-mon[35652]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:31.784 INFO:teuthology.orchestra.run.smithi099.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-01-31T05:03:31.784 INFO:teuthology.orchestra.run.smithi099.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-01-31T05:03:31.784 INFO:teuthology.orchestra.run.smithi099.stderr: stderr: 10+0 records in 2024-01-31T05:03:31.784 INFO:teuthology.orchestra.run.smithi099.stderr:10+0 records out 2024-01-31T05:03:31.784 INFO:teuthology.orchestra.run.smithi099.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114897 s, 913 MB/s 2024-01-31T05:03:31.784 INFO:teuthology.orchestra.run.smithi099.stderr:--> Zapping successful for: 2024-01-31T05:03:31.895 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Jan 31 05:03:31 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-z[38296]: 2024-01-31T05:03:31.801+0000 7fc55b11c200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-31T05:03:31.896 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Jan 31 05:03:31 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-z[38296]: 2024-01-31T05:03:31.895+0000 7fc55b11c200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-31T05:03:32.379 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph orch daemon add osd smithi099:vg_nvme/lv_4 2024-01-31T05:03:32.652 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:03:32.708 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Jan 31 05:03:32 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-z[38296]: 2024-01-31T05:03:32.534+0000 7fc55b11c200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-31T05:03:32.708 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Jan 31 05:03:32 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-z[38296]: 2024-01-31T05:03:32.624+0000 7fc55b11c200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-31T05:03:32.708 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Jan 31 05:03:32 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-z[38296]: 2024-01-31T05:03:32.708+0000 7fc55b11c200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-31T05:03:32.708 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:32 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:32.709 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:32 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:32.709 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:32 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:32.709 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:32 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-31T05:03:32.709 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:32 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-01-31T05:03:32.709 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:32 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-31T05:03:32.709 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:32 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:32.709 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:32 smithi181 ceph-mon[36434]: Deploying daemon mgr.y on smithi179 2024-01-31T05:03:32.773 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:32 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:32.773 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:32 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:32.773 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:32 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:32.773 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:32 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-31T05:03:32.773 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:32 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-01-31T05:03:32.773 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:32 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-31T05:03:32.774 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:32 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:32.774 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:32 smithi099 ceph-mon[31615]: Deploying daemon mgr.y on smithi179 2024-01-31T05:03:32.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:32 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:32.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:32 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:32.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:32 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:32.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:32 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-31T05:03:32.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:32 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-01-31T05:03:32.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:32 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-31T05:03:32.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:32 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:32.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:32 smithi179 ceph-mon[35652]: Deploying daemon mgr.y on smithi179 2024-01-31T05:03:33.071 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Jan 31 05:03:32 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-z[38296]: 2024-01-31T05:03:32.857+0000 7fc55b11c200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-31T05:03:33.071 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Jan 31 05:03:32 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-z[38296]: 2024-01-31T05:03:32.938+0000 7fc55b11c200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-31T05:03:33.375 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Jan 31 05:03:33 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-z[38296]: 2024-01-31T05:03:33.111+0000 7fc55b11c200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-01-31T05:03:33.375 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Jan 31 05:03:33 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-z[38296]: 2024-01-31T05:03:33.290+0000 7fc55b11c200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-31T05:03:33.375 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Jan 31 05:03:33 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-z[38296]: 2024-01-31T05:03:33.374+0000 7fc55b11c200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-31T05:03:33.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:33 smithi179 ceph-mon[35652]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:33.633 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Jan 31 05:03:33 smithi179 systemd[1]: Starting Ceph mgr.y for 9288ff44-bff5-11ee-95b3-87774f69a715... 2024-01-31T05:03:33.745 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:33 smithi099 ceph-mon[31615]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:33.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:33 smithi181 ceph-mon[36434]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:33.821 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Jan 31 05:03:33 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-z[38296]: 2024-01-31T05:03:33.470+0000 7fc55b11c200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-31T05:03:33.821 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Jan 31 05:03:33 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-z[38296]: 2024-01-31T05:03:33.557+0000 7fc55b11c200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-31T05:03:33.926 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Jan 31 05:03:33 smithi179 podman[37019]: 2024-01-31 05:03:33.563424218 +0000 UTC m=+0.017765289 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-31T05:03:33.926 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Jan 31 05:03:33 smithi179 podman[37019]: 2024-01-31 05:03:33.689683329 +0000 UTC m=+0.144024401 container create 709d4d484e430061792bb5d303c42ab9e01c4a749260f7e94825316dee0aee9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-y, org.label-schema.build-date=20240123, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.31.3, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240125.044502-661946e, CEPH_POINT_RELEASE=) 2024-01-31T05:03:33.926 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Jan 31 05:03:33 smithi179 podman[37019]: 2024-01-31 05:03:33.900328615 +0000 UTC m=+0.354669675 container init 709d4d484e430061792bb5d303c42ab9e01c4a749260f7e94825316dee0aee9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-y, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240123, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, io.buildah.version=1.31.3, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240125.044502-661946e) 2024-01-31T05:03:33.926 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Jan 31 05:03:33 smithi179 podman[37019]: 2024-01-31 05:03:33.902845735 +0000 UTC m=+0.357186782 container start 709d4d484e430061792bb5d303c42ab9e01c4a749260f7e94825316dee0aee9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-y, GIT_CLEAN=True, io.buildah.version=1.31.3, ceph=True, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_BRANCH=HEAD, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240123, org.label-schema.vendor=CentOS) 2024-01-31T05:03:33.926 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Jan 31 05:03:33 smithi179 ceph-mgr[37037]: -- 172.21.15.179:0/1962550803 <== mon.2 v2:172.21.15.179:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561b48d6f520 con 0x561b48d44c00 2024-01-31T05:03:34.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:34.278+0000 7f1aa3e83700 1 -- 172.21.15.99:0/3736961926 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a9c102370 msgr2=0x7f1a9c104760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:34.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:34.278+0000 7f1aa3e83700 1 --2- 172.21.15.99:0/3736961926 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a9c102370 0x7f1a9c104760 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1a98009990 tx=0x7f1a98009ca0 comp rx=0 tx=0).stop 2024-01-31T05:03:34.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:34.279+0000 7f1aa3e83700 1 -- 172.21.15.99:0/3736961926 shutdown_connections 2024-01-31T05:03:34.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:34.279+0000 7f1aa3e83700 1 --2- 172.21.15.99:0/3736961926 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a9c1075d0 0x7f1a9c1099e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:34.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:34.279+0000 7f1aa3e83700 1 --2- 172.21.15.99:0/3736961926 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a9c102370 0x7f1a9c104760 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:34.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:34.279+0000 7f1aa3e83700 1 --2- 172.21.15.99:0/3736961926 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a9c104ca0 0x7f1a9c107090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:34.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:34.279+0000 7f1aa3e83700 1 -- 172.21.15.99:0/3736961926 >> 172.21.15.99:0/3736961926 conn(0x7f1a9c0fbd40 msgr2=0x7f1a9c0fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:03:34.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:34.279+0000 7f1aa3e83700 1 -- 172.21.15.99:0/3736961926 shutdown_connections 2024-01-31T05:03:34.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:34.279+0000 7f1aa3e83700 1 -- 172.21.15.99:0/3736961926 wait complete. 2024-01-31T05:03:34.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:34.279+0000 7f1aa3e83700 1 Processor -- start 2024-01-31T05:03:34.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:34.279+0000 7f1aa3e83700 1 -- start start 2024-01-31T05:03:34.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:34.279+0000 7f1aa3e83700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a9c102370 0x7f1a9c101cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:34.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:34.279+0000 7f1aa3e83700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a9c104ca0 0x7f1a9c100320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:34.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:34.279+0000 7f1aa3e83700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a9c1075d0 0x7f1a9c100860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:34.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:34.279+0000 7f1aa3e83700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9c100fe0 con 0x7f1a9c104ca0 2024-01-31T05:03:34.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:34.279+0000 7f1aa3e83700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9c101150 con 0x7f1a9c102370 2024-01-31T05:03:34.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:34.279+0000 7f1aa3e83700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9c1a1750 con 0x7f1a9c1075d0 2024-01-31T05:03:34.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:34.280+0000 7f1aa141e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a9c104ca0 0x7f1a9c100320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:34.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:34.280+0000 7f1aa1c1f700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a9c102370 0x7f1a9c101cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:34.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:34.280+0000 7f1aa1c1f700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a9c102370 0x7f1a9c101cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.99:57904/0 (socket says 172.21.15.99:57904) 2024-01-31T05:03:34.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:34.280+0000 7f1aa1c1f700 1 -- 172.21.15.99:0/125709507 learned_addr learned my addr 172.21.15.99:0/125709507 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:03:34.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:34.280+0000 7f1aa141e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a9c104ca0 0x7f1a9c100320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40986/0 (socket says 172.21.15.99:40986) 2024-01-31T05:03:34.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:34.280+0000 7f1aa2420700 1 --2- 172.21.15.99:0/125709507 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a9c1075d0 0x7f1a9c100860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:34.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:34.280+0000 7f1aa141e700 1 -- 172.21.15.99:0/125709507 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a9c1075d0 msgr2=0x7f1a9c100860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:34.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:34.280+0000 7f1aa141e700 1 --2- 172.21.15.99:0/125709507 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a9c1075d0 0x7f1a9c100860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:34.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:34.280+0000 7f1aa141e700 1 -- 172.21.15.99:0/125709507 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a9c102370 msgr2=0x7f1a9c101cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:34.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:34.280+0000 7f1aa141e700 1 --2- 172.21.15.99:0/125709507 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a9c102370 0x7f1a9c101cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:34.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:34.280+0000 7f1aa141e700 1 -- 172.21.15.99:0/125709507 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a980095f0 con 0x7f1a9c104ca0 2024-01-31T05:03:34.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:34.280+0000 7f1aa141e700 1 --2- 172.21.15.99:0/125709507 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a9c104ca0 0x7f1a9c100320 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c00d950 tx=0x7f1a8c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:03:34.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:34.280+0000 7f1a92ffd700 1 -- 172.21.15.99:0/125709507 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c00f890 con 0x7f1a9c104ca0 2024-01-31T05:03:34.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:34.280+0000 7f1a92ffd700 1 -- 172.21.15.99:0/125709507 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1a8c010460 con 0x7f1a9c104ca0 2024-01-31T05:03:34.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:34.280+0000 7f1aa3e83700 1 -- 172.21.15.99:0/125709507 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a9c1a1a30 con 0x7f1a9c104ca0 2024-01-31T05:03:34.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:34.280+0000 7f1a92ffd700 1 -- 172.21.15.99:0/125709507 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c00e610 con 0x7f1a9c104ca0 2024-01-31T05:03:34.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:34.280+0000 7f1aa3e83700 1 -- 172.21.15.99:0/125709507 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a9c1a1f80 con 0x7f1a9c104ca0 2024-01-31T05:03:34.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:34.281+0000 7f1a92ffd700 1 -- 172.21.15.99:0/125709507 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 13) v1 ==== 45697+0+0 (secure 0 0 0) 0x7f1a8c00e770 con 0x7f1a9c104ca0 2024-01-31T05:03:34.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:34.281+0000 7f1a92ffd700 1 --2- 172.21.15.99:0/125709507 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f1a88038d20 0x7f1a8803b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:34.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:34.281+0000 7f1a92ffd700 1 -- 172.21.15.99:0/125709507 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f1a8c04b260 con 0x7f1a9c104ca0 2024-01-31T05:03:34.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:34.281+0000 7f1aa3e83700 1 -- 172.21.15.99:0/125709507 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a9c0fd8c0 con 0x7f1a9c104ca0 2024-01-31T05:03:34.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:34.281+0000 7f1aa1c1f700 1 --2- 172.21.15.99:0/125709507 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f1a88038d20 0x7f1a8803b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:34.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:34.282+0000 7f1aa1c1f700 1 --2- 172.21.15.99:0/125709507 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f1a88038d20 0x7f1a8803b1e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1a9800b2e0 tx=0x7f1a9800b750 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:03:34.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:34.290+0000 7f1a92ffd700 1 -- 172.21.15.99:0/125709507 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f1a8c016070 con 0x7f1a9c104ca0 2024-01-31T05:03:34.316 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Jan 31 05:03:33 smithi179 bash[37019]: 709d4d484e430061792bb5d303c42ab9e01c4a749260f7e94825316dee0aee9a 2024-01-31T05:03:34.316 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Jan 31 05:03:33 smithi179 systemd[1]: Started Ceph mgr.y for 9288ff44-bff5-11ee-95b3-87774f69a715. 2024-01-31T05:03:34.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:34.495+0000 7f1aa3e83700 1 -- 172.21.15.99:0/125709507 --> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f1a9c061c20 con 0x7f1a88038d20 2024-01-31T05:03:34.632 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Jan 31 05:03:34 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-y[37033]: 2024-01-31T05:03:34.450+0000 7f2a478c0200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-31T05:03:34.632 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Jan 31 05:03:34 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-y[37033]: 2024-01-31T05:03:34.548+0000 7f2a478c0200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-31T05:03:34.983 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Jan 31 05:03:34 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-z[38296]: 2024-01-31T05:03:34.630+0000 7fc55b11c200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-31T05:03:34.983 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Jan 31 05:03:34 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-z[38296]: 2024-01-31T05:03:34.774+0000 7fc55b11c200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-31T05:03:34.983 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Jan 31 05:03:34 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-z[38296]: 2024-01-31T05:03:34.983+0000 7fc55b11c200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-31T05:03:35.304 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Jan 31 05:03:35 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-y[37033]: 2024-01-31T05:03:35.235+0000 7f2a478c0200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-31T05:03:35.304 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:35 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:35.304 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:35 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:35.304 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:35 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:35.304 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:35 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:35.304 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:35 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:03:35.304 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:35 smithi179 ceph-mon[35652]: from='client.14229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:03:35.304 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:35 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-31T05:03:35.304 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:35 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-31T05:03:35.305 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:35 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:35.305 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:35 smithi179 ceph-mon[35652]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:35.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:35 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:35.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:35 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:35.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:35 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:35.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:35 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:35.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:35 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:03:35.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:35 smithi099 ceph-mon[31615]: from='client.14229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:03:35.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:35 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-31T05:03:35.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:35 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-31T05:03:35.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:35 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:35.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:35 smithi099 ceph-mon[31615]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:35.321 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Jan 31 05:03:35 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-z[38296]: 2024-01-31T05:03:35.232+0000 7fc55b11c200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-31T05:03:35.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:35 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:35.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:35 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:35.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:35 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:35.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:35 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:35.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:35 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:03:35.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:35 smithi181 ceph-mon[36434]: from='client.14229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:03:35.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:35 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-31T05:03:35.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:35 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-31T05:03:35.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:35 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:35.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:35 smithi181 ceph-mon[36434]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:35.573 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Jan 31 05:03:35 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-y[37033]: 2024-01-31T05:03:35.329+0000 7f2a478c0200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-31T05:03:35.573 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Jan 31 05:03:35 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-y[37033]: 2024-01-31T05:03:35.413+0000 7f2a478c0200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-31T05:03:35.821 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Jan 31 05:03:35 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-z[38296]: 2024-01-31T05:03:35.408+0000 7fc55b11c200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-31T05:03:35.821 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Jan 31 05:03:35 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-z[38296]: 2024-01-31T05:03:35.602+0000 7fc55b11c200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-31T05:03:35.828 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Jan 31 05:03:35 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-y[37033]: 2024-01-31T05:03:35.573+0000 7f2a478c0200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-31T05:03:35.828 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Jan 31 05:03:35 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-y[37033]: 2024-01-31T05:03:35.657+0000 7f2a478c0200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-31T05:03:35.828 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Jan 31 05:03:35 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-y[37033]: 2024-01-31T05:03:35.828+0000 7f2a478c0200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-01-31T05:03:36.089 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Jan 31 05:03:36 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-y[37033]: 2024-01-31T05:03:36.006+0000 7f2a478c0200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-31T05:03:36.089 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Jan 31 05:03:36 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-y[37033]: 2024-01-31T05:03:36.089+0000 7f2a478c0200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-31T05:03:36.321 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Jan 31 05:03:35 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-z[38296]: 2024-01-31T05:03:35.865+0000 7fc55b11c200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-31T05:03:36.321 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Jan 31 05:03:35 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-z[38296]: 2024-01-31T05:03:35.949+0000 7fc55b11c200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-31T05:03:36.382 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Jan 31 05:03:36 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-y[37033]: 2024-01-31T05:03:36.180+0000 7f2a478c0200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-31T05:03:36.382 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Jan 31 05:03:36 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-y[37033]: 2024-01-31T05:03:36.266+0000 7f2a478c0200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-31T05:03:36.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:36 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:36.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:36 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:36.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:36 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:36.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:36 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:36.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:36 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:36.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:36 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:03:36.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:36 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:36.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:36 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:36.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:36 smithi099 ceph-mon[31615]: Reconfiguring mgr.x (unknown last config time)... 2024-01-31T05:03:36.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:36 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-31T05:03:36.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:36 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-31T05:03:36.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:36 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:36.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:36 smithi099 ceph-mon[31615]: Reconfiguring daemon mgr.x on smithi099 2024-01-31T05:03:36.821 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Jan 31 05:03:36 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-z[38296]: 2024-01-31T05:03:36.335+0000 7fc55b11c200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-31T05:03:36.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:36 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:36.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:36 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:36.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:36 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:36.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:36 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:36.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:36 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:36.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:36 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:03:36.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:36 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:36.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:36 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:36.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:36 smithi181 ceph-mon[36434]: Reconfiguring mgr.x (unknown last config time)... 2024-01-31T05:03:36.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:36 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-31T05:03:36.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:36 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-31T05:03:36.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:36 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:36.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:36 smithi181 ceph-mon[36434]: Reconfiguring daemon mgr.x on smithi099 2024-01-31T05:03:36.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:36 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:36.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:36 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:36.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:36 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:36.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:36 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:36.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:36 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:36.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:36 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:03:36.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:36 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:36.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:36 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:36.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:36 smithi179 ceph-mon[35652]: Reconfiguring mgr.x (unknown last config time)... 2024-01-31T05:03:36.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:36 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-31T05:03:36.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:36 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-31T05:03:36.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:36 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:36.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:36 smithi179 ceph-mon[35652]: Reconfiguring daemon mgr.x on smithi099 2024-01-31T05:03:37.528 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Jan 31 05:03:37 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-z[38296]: 2024-01-31T05:03:37.105+0000 7fc55b11c200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-31T05:03:37.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:37 smithi179 ceph-mon[35652]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:37.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:37 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/3062582347' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b45878d9-28f1-4821-ba72-26a32d3fc780"}]: dispatch 2024-01-31T05:03:37.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:37 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/3062582347' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b45878d9-28f1-4821-ba72-26a32d3fc780"}]': finished 2024-01-31T05:03:37.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:37 smithi179 ceph-mon[35652]: osdmap e5: 1 total, 0 up, 1 in 2024-01-31T05:03:37.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:37 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-31T05:03:37.632 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Jan 31 05:03:37 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-y[37033]: 2024-01-31T05:03:37.314+0000 7f2a478c0200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-31T05:03:37.633 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Jan 31 05:03:37 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-y[37033]: 2024-01-31T05:03:37.440+0000 7f2a478c0200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-31T05:03:37.633 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Jan 31 05:03:37 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-y[37033]: 2024-01-31T05:03:37.632+0000 7f2a478c0200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-31T05:03:37.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:37 smithi099 ceph-mon[31615]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:37.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:37 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/3062582347' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b45878d9-28f1-4821-ba72-26a32d3fc780"}]: dispatch 2024-01-31T05:03:37.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:37 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/3062582347' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b45878d9-28f1-4821-ba72-26a32d3fc780"}]': finished 2024-01-31T05:03:37.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:37 smithi099 ceph-mon[31615]: osdmap e5: 1 total, 0 up, 1 in 2024-01-31T05:03:37.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:37 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-31T05:03:37.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:37 smithi181 ceph-mon[36434]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:37.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:37 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/3062582347' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b45878d9-28f1-4821-ba72-26a32d3fc780"}]: dispatch 2024-01-31T05:03:37.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:37 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/3062582347' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b45878d9-28f1-4821-ba72-26a32d3fc780"}]': finished 2024-01-31T05:03:37.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:37 smithi181 ceph-mon[36434]: osdmap e5: 1 total, 0 up, 1 in 2024-01-31T05:03:37.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:37 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-31T05:03:37.821 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Jan 31 05:03:37 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-z[38296]: 2024-01-31T05:03:37.663+0000 7fc55b11c200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-31T05:03:37.822 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Jan 31 05:03:37 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-z[38296]: 2024-01-31T05:03:37.757+0000 7fc55b11c200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-31T05:03:37.882 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Jan 31 05:03:37 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-y[37033]: 2024-01-31T05:03:37.860+0000 7f2a478c0200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-31T05:03:38.321 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Jan 31 05:03:37 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-z[38296]: 2024-01-31T05:03:37.949+0000 7fc55b11c200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-31T05:03:38.382 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Jan 31 05:03:38 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-y[37033]: 2024-01-31T05:03:38.035+0000 7f2a478c0200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-31T05:03:38.382 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Jan 31 05:03:38 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-y[37033]: 2024-01-31T05:03:38.212+0000 7f2a478c0200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-31T05:03:38.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:38.543+0000 7f1a92ffd700 1 -- 172.21.15.99:0/125709507 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mgrmap(e 14) v1 ==== 90768+0+0 (secure 0 0 0) 0x7f1a8c0108d0 con 0x7f1a9c104ca0 2024-01-31T05:03:38.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:38 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/3548821631' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-31T05:03:38.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:38 smithi099 ceph-mon[31615]: Standby manager daemon z started 2024-01-31T05:03:38.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:38 smithi099 ceph-mon[31615]: from='mgr.? 172.21.15.181:0/2737473804' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-01-31T05:03:38.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:38 smithi099 ceph-mon[31615]: from='mgr.? 172.21.15.181:0/2737473804' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-31T05:03:38.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:38 smithi099 ceph-mon[31615]: from='mgr.? 172.21.15.181:0/2737473804' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-01-31T05:03:38.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:38 smithi099 ceph-mon[31615]: from='mgr.? 172.21.15.181:0/2737473804' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-31T05:03:38.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:38 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/3548821631' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-31T05:03:38.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:38 smithi181 ceph-mon[36434]: Standby manager daemon z started 2024-01-31T05:03:38.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:38 smithi181 ceph-mon[36434]: from='mgr.? 172.21.15.181:0/2737473804' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-01-31T05:03:38.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:38 smithi181 ceph-mon[36434]: from='mgr.? 172.21.15.181:0/2737473804' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-31T05:03:38.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:38 smithi181 ceph-mon[36434]: from='mgr.? 172.21.15.181:0/2737473804' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-01-31T05:03:38.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:38 smithi181 ceph-mon[36434]: from='mgr.? 172.21.15.181:0/2737473804' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-31T05:03:38.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:38 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/3548821631' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-31T05:03:38.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:38 smithi179 ceph-mon[35652]: Standby manager daemon z started 2024-01-31T05:03:38.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:38 smithi179 ceph-mon[35652]: from='mgr.? 172.21.15.181:0/2737473804' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-01-31T05:03:38.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:38 smithi179 ceph-mon[35652]: from='mgr.? 172.21.15.181:0/2737473804' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-31T05:03:38.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:38 smithi179 ceph-mon[35652]: from='mgr.? 172.21.15.181:0/2737473804' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-01-31T05:03:38.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:38 smithi179 ceph-mon[35652]: from='mgr.? 172.21.15.181:0/2737473804' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-31T05:03:38.883 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Jan 31 05:03:38 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-y[37033]: 2024-01-31T05:03:38.471+0000 7f2a478c0200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-31T05:03:38.883 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Jan 31 05:03:38 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-y[37033]: 2024-01-31T05:03:38.559+0000 7f2a478c0200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-31T05:03:39.382 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Jan 31 05:03:38 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-y[37033]: 2024-01-31T05:03:38.946+0000 7f2a478c0200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-31T05:03:39.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:39 smithi099 ceph-mon[31615]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:39.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:39 smithi099 ceph-mon[31615]: mgrmap e14: x(active, since 78s), standbys: z 2024-01-31T05:03:39.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:39 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-01-31T05:03:39.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:39 smithi181 ceph-mon[36434]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:39.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:39 smithi181 ceph-mon[36434]: mgrmap e14: x(active, since 78s), standbys: z 2024-01-31T05:03:39.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:39 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-01-31T05:03:39.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:39 smithi179 ceph-mon[35652]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:39.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:39 smithi179 ceph-mon[35652]: mgrmap e14: x(active, since 78s), standbys: z 2024-01-31T05:03:39.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:39 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-01-31T05:03:39.882 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Jan 31 05:03:39 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-y[37033]: 2024-01-31T05:03:39.717+0000 7f2a478c0200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-31T05:03:40.566 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Jan 31 05:03:40 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-y[37033]: 2024-01-31T05:03:40.277+0000 7f2a478c0200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-31T05:03:40.566 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Jan 31 05:03:40 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-y[37033]: 2024-01-31T05:03:40.372+0000 7f2a478c0200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-31T05:03:40.566 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Jan 31 05:03:40 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-y[37033]: 2024-01-31T05:03:40.566+0000 7f2a478c0200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-31T05:03:41.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:41.547+0000 7f1a92ffd700 1 -- 172.21.15.99:0/125709507 <== mon.0 v2:172.21.15.99:3300/0 8 ==== mgrmap(e 15) v1 ==== 135839+0+0 (secure 0 0 0) 0x7f1a8c0105d0 con 0x7f1a9c104ca0 2024-01-31T05:03:41.704 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:41 smithi099 ceph-mon[31615]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:41.704 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:41 smithi099 ceph-mon[31615]: Standby manager daemon y started 2024-01-31T05:03:41.704 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:41 smithi099 ceph-mon[31615]: from='mgr.? 172.21.15.179:0/1054105987' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-01-31T05:03:41.704 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:41 smithi099 ceph-mon[31615]: from='mgr.? 172.21.15.179:0/1054105987' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-31T05:03:41.704 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:41 smithi099 ceph-mon[31615]: from='mgr.? 172.21.15.179:0/1054105987' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-01-31T05:03:41.704 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:41 smithi099 ceph-mon[31615]: from='mgr.? 172.21.15.179:0/1054105987' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-31T05:03:41.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:41 smithi181 ceph-mon[36434]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:41.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:41 smithi181 ceph-mon[36434]: Standby manager daemon y started 2024-01-31T05:03:41.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:41 smithi181 ceph-mon[36434]: from='mgr.? 172.21.15.179:0/1054105987' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-01-31T05:03:41.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:41 smithi181 ceph-mon[36434]: from='mgr.? 172.21.15.179:0/1054105987' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-31T05:03:41.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:41 smithi181 ceph-mon[36434]: from='mgr.? 172.21.15.179:0/1054105987' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-01-31T05:03:41.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:41 smithi181 ceph-mon[36434]: from='mgr.? 172.21.15.179:0/1054105987' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-31T05:03:41.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:41 smithi179 ceph-mon[35652]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:41.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:41 smithi179 ceph-mon[35652]: Standby manager daemon y started 2024-01-31T05:03:41.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:41 smithi179 ceph-mon[35652]: from='mgr.? 172.21.15.179:0/1054105987' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-01-31T05:03:41.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:41 smithi179 ceph-mon[35652]: from='mgr.? 172.21.15.179:0/1054105987' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-31T05:03:41.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:41 smithi179 ceph-mon[35652]: from='mgr.? 172.21.15.179:0/1054105987' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-01-31T05:03:41.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:41 smithi179 ceph-mon[35652]: from='mgr.? 172.21.15.179:0/1054105987' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-31T05:03:42.710 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:42 smithi099 ceph-mon[31615]: mgrmap e15: x(active, since 81s), standbys: z, y 2024-01-31T05:03:42.710 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:42 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-01-31T05:03:42.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:42 smithi181 ceph-mon[36434]: mgrmap e15: x(active, since 81s), standbys: z, y 2024-01-31T05:03:42.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:42 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-01-31T05:03:42.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:42 smithi179 ceph-mon[35652]: mgrmap e15: x(active, since 81s), standbys: z, y 2024-01-31T05:03:42.884 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:42 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-01-31T05:03:43.894 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:43 smithi099 ceph-mon[31615]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:43.894 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:43 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:43.894 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:43 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:43.894 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:43 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:03:43.894 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:43 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:43.894 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:43 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:03:43.894 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:43 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:44.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:43 smithi181 ceph-mon[36434]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:44.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:43 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:44.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:43 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:44.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:43 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:03:44.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:43 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:44.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:43 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:03:44.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:43 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:44.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:43 smithi179 ceph-mon[35652]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:44.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:43 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:44.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:43 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:44.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:43 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:03:44.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:43 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:44.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:43 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:03:44.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:43 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:46.024 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:45 smithi099 ceph-mon[31615]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:46.024 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:45 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-01-31T05:03:46.024 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:45 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:46.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:45 smithi181 ceph-mon[36434]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:46.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:45 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-01-31T05:03:46.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:45 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:46.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:45 smithi179 ceph-mon[35652]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:46.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:45 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-01-31T05:03:46.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:45 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:47.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:46 smithi099 ceph-mon[31615]: Deploying daemon osd.0 on smithi099 2024-01-31T05:03:47.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:46 smithi181 ceph-mon[36434]: Deploying daemon osd.0 on smithi099 2024-01-31T05:03:47.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:46 smithi179 ceph-mon[35652]: Deploying daemon osd.0 on smithi099 2024-01-31T05:03:48.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:47 smithi099 ceph-mon[31615]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:48.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:47 smithi181 ceph-mon[36434]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:48.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:47 smithi179 ceph-mon[35652]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:50.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:49 smithi099 ceph-mon[31615]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:50.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:49 smithi181 ceph-mon[36434]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:50.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:49 smithi179 ceph-mon[35652]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:51.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:51 smithi179 ceph-mon[35652]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:51.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:51 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:51.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:51 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:51.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:51 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:03:52.029 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:51 smithi099 ceph-mon[31615]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:52.029 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:51 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:52.029 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:51 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:52.029 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:51 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:03:52.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:51 smithi181 ceph-mon[36434]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:52.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:51 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:52.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:51 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:52.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:51 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:03:53.353 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:53 smithi099 ceph-mon[31615]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:53.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:53 smithi179 ceph-mon[35652]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:53.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:53 smithi181 ceph-mon[36434]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:54.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:54.414+0000 7f1a92ffd700 1 -- 172.21.15.99:0/125709507 <== mgr.14152 v2:172.21.15.99:6800/3925720924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f1a9c061c20 con 0x7f1a88038d20 2024-01-31T05:03:54.415 INFO:teuthology.orchestra.run.smithi099.stdout:Created osd(s) 0 on host 'smithi099' 2024-01-31T05:03:54.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:54.418+0000 7f1aa3e83700 1 -- 172.21.15.99:0/125709507 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f1a88038d20 msgr2=0x7f1a8803b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:54.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:54.418+0000 7f1aa3e83700 1 --2- 172.21.15.99:0/125709507 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f1a88038d20 0x7f1a8803b1e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1a9800b2e0 tx=0x7f1a9800b750 comp rx=0 tx=0).stop 2024-01-31T05:03:54.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:54.418+0000 7f1aa3e83700 1 -- 172.21.15.99:0/125709507 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a9c104ca0 msgr2=0x7f1a9c100320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:54.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:54.418+0000 7f1aa3e83700 1 --2- 172.21.15.99:0/125709507 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a9c104ca0 0x7f1a9c100320 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c00d950 tx=0x7f1a8c00dc60 comp rx=0 tx=0).stop 2024-01-31T05:03:54.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:54.418+0000 7f1aa3e83700 1 -- 172.21.15.99:0/125709507 shutdown_connections 2024-01-31T05:03:54.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:54.418+0000 7f1aa3e83700 1 --2- 172.21.15.99:0/125709507 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a9c1075d0 0x7f1a9c100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:54.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:54.418+0000 7f1aa3e83700 1 --2- 172.21.15.99:0/125709507 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f1a88038d20 0x7f1a8803b1e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:54.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:54.418+0000 7f1aa3e83700 1 --2- 172.21.15.99:0/125709507 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a9c102370 0x7f1a9c101cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:54.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:54.418+0000 7f1aa3e83700 1 --2- 172.21.15.99:0/125709507 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a9c104ca0 0x7f1a9c100320 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:54.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:54.418+0000 7f1aa3e83700 1 -- 172.21.15.99:0/125709507 >> 172.21.15.99:0/125709507 conn(0x7f1a9c0fbd40 msgr2=0x7f1a9c102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:03:54.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:54.418+0000 7f1aa3e83700 1 -- 172.21.15.99:0/125709507 shutdown_connections 2024-01-31T05:03:54.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:03:54.418+0000 7f1aa3e83700 1 -- 172.21.15.99:0/125709507 wait complete. 2024-01-31T05:03:54.643 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:54 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:54.644 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:54 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:54.644 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:54 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:54.644 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:54 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:03:54.644 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:54 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:54.644 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:54 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:54.644 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:54 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:54.644 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:54 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:03:54.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:54 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:54.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:54 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:54.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:54 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:54.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:54 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:03:54.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:54 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:54.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:54 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:54.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:54 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:54.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:54 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:03:54.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:54 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:54.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:54 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:54.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:54 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:54.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:54 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:03:54.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:54 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:54.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:54 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:54.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:54 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:54.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:54 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:03:55.062 DEBUG:teuthology.orchestra.run.smithi099:osd.0> sudo journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@osd.0.service 2024-01-31T05:03:55.064 INFO:tasks.cephadm:Deploying osd.1 on smithi179 with /dev/vg_nvme/lv_4... 2024-01-31T05:03:55.064 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-01-31T05:03:55.309 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.b/config 2024-01-31T05:03:55.729 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:55 smithi179 ceph-mon[35652]: from='osd.0 [v2:172.21.15.99:6802/1213805280,v1:172.21.15.99:6803/1213805280]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-01-31T05:03:55.729 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:55 smithi179 ceph-mon[35652]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-01-31T05:03:55.730 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:55 smithi179 ceph-mon[35652]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:55.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:55 smithi099 ceph-mon[31615]: from='osd.0 [v2:172.21.15.99:6802/1213805280,v1:172.21.15.99:6803/1213805280]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-01-31T05:03:55.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:55 smithi099 ceph-mon[31615]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-01-31T05:03:55.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:55 smithi099 ceph-mon[31615]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:55.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:55 smithi181 ceph-mon[36434]: from='osd.0 [v2:172.21.15.99:6802/1213805280,v1:172.21.15.99:6803/1213805280]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-01-31T05:03:55.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:55 smithi181 ceph-mon[36434]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-01-31T05:03:55.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:55 smithi181 ceph-mon[36434]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:56.549 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:56 smithi099 ceph-mon[31615]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-01-31T05:03:56.549 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:56 smithi099 ceph-mon[31615]: osdmap e6: 1 total, 0 up, 1 in 2024-01-31T05:03:56.549 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:56 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-31T05:03:56.549 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:56 smithi099 ceph-mon[31615]: from='osd.0 [v2:172.21.15.99:6802/1213805280,v1:172.21.15.99:6803/1213805280]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-31T05:03:56.549 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:56 smithi099 ceph-mon[31615]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-31T05:03:56.549 INFO:journalctl@ceph.osd.0.smithi099.stdout:Jan 31 05:03:56 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-0[46680]: 2024-01-31T05:03:56.455+0000 7fc887eff700 -1 osd.0 0 waiting for initial osdmap 2024-01-31T05:03:56.549 INFO:journalctl@ceph.osd.0.smithi099.stdout:Jan 31 05:03:56 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-0[46680]: 2024-01-31T05:03:56.458+0000 7fc8844fa700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-31T05:03:56.597 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:56 smithi179 ceph-mon[35652]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-01-31T05:03:56.598 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:56 smithi179 ceph-mon[35652]: osdmap e6: 1 total, 0 up, 1 in 2024-01-31T05:03:56.598 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:56 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-31T05:03:56.598 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:56 smithi179 ceph-mon[35652]: from='osd.0 [v2:172.21.15.99:6802/1213805280,v1:172.21.15.99:6803/1213805280]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-31T05:03:56.598 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:56 smithi179 ceph-mon[35652]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-31T05:03:56.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:56 smithi181 ceph-mon[36434]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-01-31T05:03:56.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:56 smithi181 ceph-mon[36434]: osdmap e6: 1 total, 0 up, 1 in 2024-01-31T05:03:56.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:56 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-31T05:03:56.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:56 smithi181 ceph-mon[36434]: from='osd.0 [v2:172.21.15.99:6802/1213805280,v1:172.21.15.99:6803/1213805280]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-31T05:03:56.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:56 smithi181 ceph-mon[36434]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-31T05:03:57.129 INFO:teuthology.orchestra.run.smithi179.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-01-31T05:03:57.129 INFO:teuthology.orchestra.run.smithi179.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-01-31T05:03:57.129 INFO:teuthology.orchestra.run.smithi179.stderr: stderr: 10+0 records in 2024-01-31T05:03:57.130 INFO:teuthology.orchestra.run.smithi179.stderr:10+0 records out 2024-01-31T05:03:57.130 INFO:teuthology.orchestra.run.smithi179.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114028 s, 920 MB/s 2024-01-31T05:03:57.130 INFO:teuthology.orchestra.run.smithi179.stderr:--> Zapping successful for: 2024-01-31T05:03:57.707 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:57 smithi099 ceph-mon[31615]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-01-31T05:03:57.708 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:57 smithi099 ceph-mon[31615]: osdmap e7: 1 total, 0 up, 1 in 2024-01-31T05:03:57.708 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:57 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-31T05:03:57.708 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:57 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-31T05:03:57.708 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:57 smithi099 ceph-mon[31615]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:57.722 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:57 smithi179 ceph-mon[35652]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-01-31T05:03:57.722 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:57 smithi179 ceph-mon[35652]: osdmap e7: 1 total, 0 up, 1 in 2024-01-31T05:03:57.722 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:57 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-31T05:03:57.722 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:57 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-31T05:03:57.722 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:57 smithi179 ceph-mon[35652]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:57.749 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph orch daemon add osd smithi179:vg_nvme/lv_4 2024-01-31T05:03:57.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:57 smithi181 ceph-mon[36434]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-01-31T05:03:57.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:57 smithi181 ceph-mon[36434]: osdmap e7: 1 total, 0 up, 1 in 2024-01-31T05:03:57.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:57 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-31T05:03:57.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:57 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-31T05:03:57.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:57 smithi181 ceph-mon[36434]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-31T05:03:57.986 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.b/config 2024-01-31T05:03:58.786 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:58 smithi179 ceph-mon[35652]: purged_snaps scrub starts 2024-01-31T05:03:58.786 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:58 smithi179 ceph-mon[35652]: purged_snaps scrub ok 2024-01-31T05:03:58.787 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:58 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-31T05:03:58.787 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:58 smithi179 ceph-mon[35652]: osd.0 [v2:172.21.15.99:6802/1213805280,v1:172.21.15.99:6803/1213805280] boot 2024-01-31T05:03:58.787 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:58 smithi179 ceph-mon[35652]: osdmap e8: 1 total, 1 up, 1 in 2024-01-31T05:03:58.787 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:58 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-31T05:03:58.787 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:58 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:58.787 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:58 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:58.787 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:58 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:03:58.787 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:58 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:58.787 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:58 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:58.787 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:58 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:03:58.787 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:58 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:58.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:58 smithi099 ceph-mon[31615]: purged_snaps scrub starts 2024-01-31T05:03:58.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:58 smithi099 ceph-mon[31615]: purged_snaps scrub ok 2024-01-31T05:03:58.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:58 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-31T05:03:58.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:58 smithi099 ceph-mon[31615]: osd.0 [v2:172.21.15.99:6802/1213805280,v1:172.21.15.99:6803/1213805280] boot 2024-01-31T05:03:58.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:58 smithi099 ceph-mon[31615]: osdmap e8: 1 total, 1 up, 1 in 2024-01-31T05:03:58.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:58 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-31T05:03:58.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:58 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:58.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:58 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:58.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:58 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:03:58.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:58 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:58.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:58 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:58.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:58 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:03:58.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:58 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:58.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:58 smithi181 ceph-mon[36434]: purged_snaps scrub starts 2024-01-31T05:03:58.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:58 smithi181 ceph-mon[36434]: purged_snaps scrub ok 2024-01-31T05:03:58.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:58 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-31T05:03:58.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:58 smithi181 ceph-mon[36434]: osd.0 [v2:172.21.15.99:6802/1213805280,v1:172.21.15.99:6803/1213805280] boot 2024-01-31T05:03:58.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:58 smithi181 ceph-mon[36434]: osdmap e8: 1 total, 1 up, 1 in 2024-01-31T05:03:58.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:58 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-31T05:03:58.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:58 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:58.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:58 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:58.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:58 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:03:58.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:58 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:58.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:58 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:03:58.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:58 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:03:58.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:58 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:03:59.562 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:03:59.559+0000 7f6954309700 1 -- 172.21.15.179:0/2520846983 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f694c109710 msgr2=0x7f694c10bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:59.562 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:03:59.559+0000 7f6954309700 1 --2- 172.21.15.179:0/2520846983 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f694c109710 0x7f694c10bb80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f694400b0a0 tx=0x7f694400b3b0 comp rx=0 tx=0).stop 2024-01-31T05:03:59.562 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:03:59.560+0000 7f6954309700 1 -- 172.21.15.179:0/2520846983 shutdown_connections 2024-01-31T05:03:59.562 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:03:59.560+0000 7f6954309700 1 --2- 172.21.15.179:0/2520846983 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f694c109710 0x7f694c10bb80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:59.562 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:03:59.560+0000 7f6954309700 1 --2- 172.21.15.179:0/2520846983 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f694c075790 0x7f694c073bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:59.562 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:03:59.560+0000 7f6954309700 1 --2- 172.21.15.179:0/2520846983 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f694c0741c0 0x7f694c074640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:59.562 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:03:59.560+0000 7f6954309700 1 -- 172.21.15.179:0/2520846983 >> 172.21.15.179:0/2520846983 conn(0x7f694c0fcdf0 msgr2=0x7f694c0ff210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:03:59.562 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:03:59.560+0000 7f6954309700 1 -- 172.21.15.179:0/2520846983 shutdown_connections 2024-01-31T05:03:59.562 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:03:59.560+0000 7f6954309700 1 -- 172.21.15.179:0/2520846983 wait complete. 2024-01-31T05:03:59.562 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:03:59.560+0000 7f6954309700 1 Processor -- start 2024-01-31T05:03:59.562 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:03:59.560+0000 7f6954309700 1 -- start start 2024-01-31T05:03:59.563 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:03:59.560+0000 7f6954309700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f694c0741c0 0x7f694c1999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:59.563 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:03:59.560+0000 7f6954309700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f694c075790 0x7f694c199f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:59.563 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:03:59.560+0000 7f6954309700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f694c109710 0x7f694c1a0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:59.563 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:03:59.560+0000 7f6954309700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694c1a1570 con 0x7f694c109710 2024-01-31T05:03:59.563 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:03:59.560+0000 7f6954309700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694c1a16b0 con 0x7f694c075790 2024-01-31T05:03:59.563 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:03:59.560+0000 7f6954309700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694c1a1840 con 0x7f694c0741c0 2024-01-31T05:03:59.563 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:03:59.561+0000 7f69518a4700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f694c075790 0x7f694c199f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:59.563 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:03:59.561+0000 7f69518a4700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f694c075790 0x7f694c199f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:37104/0 (socket says 172.21.15.179:37104) 2024-01-31T05:03:59.563 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:03:59.561+0000 7f69518a4700 1 -- 172.21.15.179:0/3660186800 learned_addr learned my addr 172.21.15.179:0/3660186800 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-01-31T05:03:59.563 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:03:59.561+0000 7f69520a5700 1 --2- 172.21.15.179:0/3660186800 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f694c0741c0 0x7f694c1999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:59.563 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:03:59.561+0000 7f69528a6700 1 --2- 172.21.15.179:0/3660186800 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f694c109710 0x7f694c1a0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:59.563 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:03:59.561+0000 7f69518a4700 1 -- 172.21.15.179:0/3660186800 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f694c0741c0 msgr2=0x7f694c1999e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:59.563 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:03:59.561+0000 7f69518a4700 1 --2- 172.21.15.179:0/3660186800 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f694c0741c0 0x7f694c1999e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:59.563 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:03:59.561+0000 7f69518a4700 1 -- 172.21.15.179:0/3660186800 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f694c109710 msgr2=0x7f694c1a0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:03:59.564 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:03:59.561+0000 7f69518a4700 1 --2- 172.21.15.179:0/3660186800 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f694c109710 0x7f694c1a0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:03:59.564 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:03:59.561+0000 7f69518a4700 1 -- 172.21.15.179:0/3660186800 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6944009d00 con 0x7f694c075790 2024-01-31T05:03:59.564 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:03:59.561+0000 7f69518a4700 1 --2- 172.21.15.179:0/3660186800 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f694c075790 0x7f694c199f20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f693c00d950 tx=0x7f693c00dd10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:03:59.564 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:03:59.561+0000 7f69437fe700 1 -- 172.21.15.179:0/3660186800 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693c009b40 con 0x7f694c075790 2024-01-31T05:03:59.564 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:03:59.561+0000 7f69437fe700 1 -- 172.21.15.179:0/3660186800 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f693c009ca0 con 0x7f694c075790 2024-01-31T05:03:59.564 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:03:59.561+0000 7f69437fe700 1 -- 172.21.15.179:0/3660186800 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693c00f620 con 0x7f694c075790 2024-01-31T05:03:59.564 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:03:59.561+0000 7f6954309700 1 -- 172.21.15.179:0/3660186800 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f694c1a1b20 con 0x7f694c075790 2024-01-31T05:03:59.564 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:03:59.561+0000 7f6954309700 1 -- 172.21.15.179:0/3660186800 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f694c1a1fd0 con 0x7f694c075790 2024-01-31T05:03:59.564 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:03:59.562+0000 7f6954309700 1 -- 172.21.15.179:0/3660186800 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f694c108520 con 0x7f694c075790 2024-01-31T05:03:59.565 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:03:59.563+0000 7f69437fe700 1 -- 172.21.15.179:0/3660186800 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 15) v1 ==== 135839+0+0 (secure 0 0 0) 0x7f693c010460 con 0x7f694c075790 2024-01-31T05:03:59.565 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:03:59.564+0000 7f69437fe700 1 --2- 172.21.15.179:0/3660186800 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f69380a12e0 0x7f69380a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:03:59.565 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:03:59.564+0000 7f69437fe700 1 -- 172.21.15.179:0/3660186800 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1767+0+0 (secure 0 0 0) 0x7f693c0cb060 con 0x7f694c075790 2024-01-31T05:03:59.565 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:03:59.564+0000 7f69520a5700 1 --2- 172.21.15.179:0/3660186800 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f69380a12e0 0x7f69380a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:03:59.565 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:03:59.565+0000 7f69520a5700 1 --2- 172.21.15.179:0/3660186800 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f69380a12e0 0x7f69380a37a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6948005950 tx=0x7f6948005cf0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:03:59.568 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:03:59.568+0000 7f69437fe700 1 -- 172.21.15.179:0/3660186800 <== mon.2 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f693c095f50 con 0x7f694c075790 2024-01-31T05:03:59.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:59 smithi179 ceph-mon[35652]: Detected new or changed devices on smithi099 2024-01-31T05:03:59.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:59 smithi179 ceph-mon[35652]: Adjusting osd_memory_target on smithi099 to 17088M 2024-01-31T05:03:59.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:59 smithi179 ceph-mon[35652]: osdmap e9: 1 total, 1 up, 1 in 2024-01-31T05:03:59.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:03:59 smithi179 ceph-mon[35652]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-31T05:03:59.767 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:03:59.767+0000 7f6954309700 1 -- 172.21.15.179:0/3660186800 --> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f694c02d5e0 con 0x7f69380a12e0 2024-01-31T05:03:59.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:59 smithi099 ceph-mon[31615]: Detected new or changed devices on smithi099 2024-01-31T05:03:59.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:59 smithi099 ceph-mon[31615]: Adjusting osd_memory_target on smithi099 to 17088M 2024-01-31T05:03:59.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:59 smithi099 ceph-mon[31615]: osdmap e9: 1 total, 1 up, 1 in 2024-01-31T05:03:59.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:03:59 smithi099 ceph-mon[31615]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-31T05:03:59.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:59 smithi181 ceph-mon[36434]: Detected new or changed devices on smithi099 2024-01-31T05:03:59.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:59 smithi181 ceph-mon[36434]: Adjusting osd_memory_target on smithi099 to 17088M 2024-01-31T05:03:59.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:59 smithi181 ceph-mon[36434]: osdmap e9: 1 total, 1 up, 1 in 2024-01-31T05:03:59.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:03:59 smithi181 ceph-mon[36434]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-31T05:04:00.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:00 smithi179 ceph-mon[35652]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:04:00.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:00 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-31T05:04:00.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:00 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-31T05:04:00.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:00 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:04:00.722 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:00 smithi181 ceph-mon[36434]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:04:00.723 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:00 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-31T05:04:00.723 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:00 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-31T05:04:00.723 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:00 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:04:00.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:00 smithi099 ceph-mon[31615]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:04:00.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:00 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-31T05:04:00.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:00 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-31T05:04:00.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:00 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:04:01.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:01 smithi099 ceph-mon[31615]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-31T05:04:01.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:01 smithi181 ceph-mon[36434]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-31T05:04:01.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:01 smithi179 ceph-mon[35652]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-31T05:04:03.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:03 smithi099 ceph-mon[31615]: from='client.? 172.21.15.179:0/2135758887' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e0b71ff3-5d97-4659-8dea-4c9091e1beb3"}]: dispatch 2024-01-31T05:04:03.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:03 smithi099 ceph-mon[31615]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e0b71ff3-5d97-4659-8dea-4c9091e1beb3"}]: dispatch 2024-01-31T05:04:03.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:03 smithi099 ceph-mon[31615]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e0b71ff3-5d97-4659-8dea-4c9091e1beb3"}]': finished 2024-01-31T05:04:03.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:03 smithi099 ceph-mon[31615]: osdmap e10: 2 total, 1 up, 2 in 2024-01-31T05:04:03.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:03 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-31T05:04:03.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:03 smithi099 ceph-mon[31615]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-31T05:04:03.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:03 smithi099 ceph-mon[31615]: from='client.? 172.21.15.179:0/1934399170' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-31T05:04:03.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:03 smithi181 ceph-mon[36434]: from='client.? 172.21.15.179:0/2135758887' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e0b71ff3-5d97-4659-8dea-4c9091e1beb3"}]: dispatch 2024-01-31T05:04:03.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:03 smithi181 ceph-mon[36434]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e0b71ff3-5d97-4659-8dea-4c9091e1beb3"}]: dispatch 2024-01-31T05:04:03.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:03 smithi181 ceph-mon[36434]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e0b71ff3-5d97-4659-8dea-4c9091e1beb3"}]': finished 2024-01-31T05:04:03.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:03 smithi181 ceph-mon[36434]: osdmap e10: 2 total, 1 up, 2 in 2024-01-31T05:04:03.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:03 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-31T05:04:03.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:03 smithi181 ceph-mon[36434]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-31T05:04:03.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:03 smithi181 ceph-mon[36434]: from='client.? 172.21.15.179:0/1934399170' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-31T05:04:03.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:03 smithi179 ceph-mon[35652]: from='client.? 172.21.15.179:0/2135758887' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e0b71ff3-5d97-4659-8dea-4c9091e1beb3"}]: dispatch 2024-01-31T05:04:03.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:03 smithi179 ceph-mon[35652]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e0b71ff3-5d97-4659-8dea-4c9091e1beb3"}]: dispatch 2024-01-31T05:04:03.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:03 smithi179 ceph-mon[35652]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e0b71ff3-5d97-4659-8dea-4c9091e1beb3"}]': finished 2024-01-31T05:04:03.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:03 smithi179 ceph-mon[35652]: osdmap e10: 2 total, 1 up, 2 in 2024-01-31T05:04:03.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:03 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-31T05:04:03.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:03 smithi179 ceph-mon[35652]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-31T05:04:03.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:03 smithi179 ceph-mon[35652]: from='client.? 172.21.15.179:0/1934399170' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-31T05:04:05.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:05 smithi179 ceph-mon[35652]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-31T05:04:06.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:05 smithi099 ceph-mon[31615]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-31T05:04:06.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:05 smithi181 ceph-mon[36434]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-31T05:04:07.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:07 smithi179 ceph-mon[35652]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-31T05:04:07.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:07 smithi099 ceph-mon[31615]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-31T05:04:08.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:07 smithi181 ceph-mon[36434]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-31T05:04:09.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:09 smithi179 ceph-mon[35652]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-31T05:04:10.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:09 smithi099 ceph-mon[31615]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-31T05:04:10.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:09 smithi181 ceph-mon[36434]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-31T05:04:10.864 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:10 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-01-31T05:04:10.864 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:10 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:04:10.864 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:10 smithi179 ceph-mon[35652]: Deploying daemon osd.1 on smithi179 2024-01-31T05:04:11.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:10 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-01-31T05:04:11.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:10 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:04:11.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:10 smithi099 ceph-mon[31615]: Deploying daemon osd.1 on smithi179 2024-01-31T05:04:11.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:10 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-01-31T05:04:11.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:10 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:04:11.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:10 smithi181 ceph-mon[36434]: Deploying daemon osd.1 on smithi179 2024-01-31T05:04:11.800 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:11 smithi179 ceph-mon[35652]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-31T05:04:12.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:11 smithi099 ceph-mon[31615]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-31T05:04:12.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:11 smithi181 ceph-mon[36434]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-31T05:04:13.375 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:13 smithi179 ceph-mon[35652]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-31T05:04:13.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:13 smithi099 ceph-mon[31615]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-31T05:04:13.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:13 smithi181 ceph-mon[36434]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-31T05:04:15.780 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:15 smithi179 ceph-mon[35652]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-31T05:04:15.780 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:15.781 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:15.781 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:04:16.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:15 smithi099 ceph-mon[31615]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-31T05:04:16.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:15 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:16.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:15 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:16.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:15 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:04:16.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:15 smithi181 ceph-mon[36434]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-31T05:04:16.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:15 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:16.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:15 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:16.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:15 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:04:17.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:17 smithi179 ceph-mon[35652]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-31T05:04:18.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:17 smithi099 ceph-mon[31615]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-31T05:04:18.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:17 smithi181 ceph-mon[36434]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-31T05:04:18.440 INFO:teuthology.orchestra.run.smithi179.stdout:Created osd(s) 1 on host 'smithi179' 2024-01-31T05:04:18.440 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:04:18.439+0000 7f69437fe700 1 -- 172.21.15.179:0/3660186800 <== mgr.14152 v2:172.21.15.99:6800/3925720924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f694c02d5e0 con 0x7f69380a12e0 2024-01-31T05:04:18.441 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:04:18.441+0000 7f6954309700 1 -- 172.21.15.179:0/3660186800 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f69380a12e0 msgr2=0x7f69380a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:18.441 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:04:18.441+0000 7f6954309700 1 --2- 172.21.15.179:0/3660186800 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f69380a12e0 0x7f69380a37a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6948005950 tx=0x7f6948005cf0 comp rx=0 tx=0).stop 2024-01-31T05:04:18.442 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:04:18.442+0000 7f6954309700 1 -- 172.21.15.179:0/3660186800 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f694c075790 msgr2=0x7f694c199f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:18.442 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:04:18.442+0000 7f6954309700 1 --2- 172.21.15.179:0/3660186800 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f694c075790 0x7f694c199f20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f693c00d950 tx=0x7f693c00dd10 comp rx=0 tx=0).stop 2024-01-31T05:04:18.442 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:04:18.442+0000 7f6954309700 1 -- 172.21.15.179:0/3660186800 shutdown_connections 2024-01-31T05:04:18.442 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:04:18.442+0000 7f6954309700 1 --2- 172.21.15.179:0/3660186800 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f694c109710 0x7f694c1a0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:18.442 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:04:18.442+0000 7f6954309700 1 --2- 172.21.15.179:0/3660186800 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f694c0741c0 0x7f694c1999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:18.442 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:04:18.442+0000 7f6954309700 1 --2- 172.21.15.179:0/3660186800 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f69380a12e0 0x7f69380a37a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:18.442 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:04:18.442+0000 7f6954309700 1 --2- 172.21.15.179:0/3660186800 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f694c075790 0x7f694c199f20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:18.442 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:04:18.442+0000 7f6954309700 1 -- 172.21.15.179:0/3660186800 >> 172.21.15.179:0/3660186800 conn(0x7f694c0fcdf0 msgr2=0x7f694c105660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:18.442 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:04:18.442+0000 7f6954309700 1 -- 172.21.15.179:0/3660186800 shutdown_connections 2024-01-31T05:04:18.442 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:04:18.442+0000 7f6954309700 1 -- 172.21.15.179:0/3660186800 wait complete. 2024-01-31T05:04:19.026 DEBUG:teuthology.orchestra.run.smithi179:osd.1> sudo journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@osd.1.service 2024-01-31T05:04:19.029 INFO:tasks.cephadm:Deploying osd.2 on smithi181 with /dev/vg_nvme/lv_4... 2024-01-31T05:04:19.029 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-01-31T05:04:19.270 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.c/config 2024-01-31T05:04:19.278 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:19 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:19.278 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:19 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:19.278 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:19 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:04:19.278 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:19 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:04:19.278 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:19 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:19.278 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:19 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:19.278 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:19 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:19.279 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:19 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:04:19.279 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:19 smithi179 ceph-mon[35652]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-31T05:04:19.279 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:19 smithi179 ceph-mon[35652]: from='osd.1 [v2:172.21.15.179:6800/2019451677,v1:172.21.15.179:6801/2019451677]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-01-31T05:04:19.279 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:19 smithi179 ceph-mon[35652]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-01-31T05:04:19.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:19 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:19.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:19 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:19.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:19 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:04:19.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:19 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:04:19.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:19 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:19.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:19 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:19.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:19 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:19.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:19 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:04:19.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:19 smithi099 ceph-mon[31615]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-31T05:04:19.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:19 smithi099 ceph-mon[31615]: from='osd.1 [v2:172.21.15.179:6800/2019451677,v1:172.21.15.179:6801/2019451677]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-01-31T05:04:19.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:19 smithi099 ceph-mon[31615]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-01-31T05:04:19.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:19 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:19.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:19 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:19.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:19 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:04:19.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:19 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:04:19.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:19 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:19.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:19 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:19.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:19 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:19.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:19 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:04:19.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:19 smithi181 ceph-mon[36434]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-31T05:04:19.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:19 smithi181 ceph-mon[36434]: from='osd.1 [v2:172.21.15.179:6800/2019451677,v1:172.21.15.179:6801/2019451677]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-01-31T05:04:19.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:19 smithi181 ceph-mon[36434]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-01-31T05:04:20.529 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:20 smithi181 ceph-mon[36434]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-01-31T05:04:20.529 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:20 smithi181 ceph-mon[36434]: osdmap e11: 2 total, 1 up, 2 in 2024-01-31T05:04:20.529 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:20 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-31T05:04:20.530 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:20 smithi181 ceph-mon[36434]: from='osd.1 [v2:172.21.15.179:6800/2019451677,v1:172.21.15.179:6801/2019451677]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-01-31T05:04:20.530 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:20 smithi181 ceph-mon[36434]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-01-31T05:04:20.677 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:20 smithi179 ceph-mon[35652]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-01-31T05:04:20.677 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:20 smithi179 ceph-mon[35652]: osdmap e11: 2 total, 1 up, 2 in 2024-01-31T05:04:20.677 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:20 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-31T05:04:20.677 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:20 smithi179 ceph-mon[35652]: from='osd.1 [v2:172.21.15.179:6800/2019451677,v1:172.21.15.179:6801/2019451677]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-01-31T05:04:20.677 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:20 smithi179 ceph-mon[35652]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-01-31T05:04:20.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:20 smithi099 ceph-mon[31615]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-01-31T05:04:20.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:20 smithi099 ceph-mon[31615]: osdmap e11: 2 total, 1 up, 2 in 2024-01-31T05:04:20.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:20 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-31T05:04:20.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:20 smithi099 ceph-mon[31615]: from='osd.1 [v2:172.21.15.179:6800/2019451677,v1:172.21.15.179:6801/2019451677]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-01-31T05:04:20.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:20 smithi099 ceph-mon[31615]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-01-31T05:04:21.167 INFO:teuthology.orchestra.run.smithi181.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-01-31T05:04:21.167 INFO:teuthology.orchestra.run.smithi181.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-01-31T05:04:21.167 INFO:teuthology.orchestra.run.smithi181.stderr: stderr: 10+0 records in 2024-01-31T05:04:21.167 INFO:teuthology.orchestra.run.smithi181.stderr:10+0 records out 2024-01-31T05:04:21.167 INFO:teuthology.orchestra.run.smithi181.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112526 s, 932 MB/s 2024-01-31T05:04:21.167 INFO:teuthology.orchestra.run.smithi181.stderr:--> Zapping successful for: 2024-01-31T05:04:21.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:21 smithi179 ceph-mon[35652]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-01-31T05:04:21.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:21 smithi179 ceph-mon[35652]: osdmap e12: 2 total, 1 up, 2 in 2024-01-31T05:04:21.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:21 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-31T05:04:21.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:21 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-31T05:04:21.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:21 smithi179 ceph-mon[35652]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-31T05:04:21.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:21 smithi179 ceph-mon[35652]: from='osd.1 ' entity='osd.1' 2024-01-31T05:04:21.633 INFO:journalctl@ceph.osd.1.smithi179.stdout:Jan 31 05:04:21 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-1[40253]: 2024-01-31T05:04:21.270+0000 7f653f9b8700 -1 osd.1 0 waiting for initial osdmap 2024-01-31T05:04:21.633 INFO:journalctl@ceph.osd.1.smithi179.stdout:Jan 31 05:04:21 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-1[40253]: 2024-01-31T05:04:21.281+0000 7f6537fab700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-31T05:04:21.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:21 smithi181 ceph-mon[36434]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-01-31T05:04:21.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:21 smithi181 ceph-mon[36434]: osdmap e12: 2 total, 1 up, 2 in 2024-01-31T05:04:21.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:21 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-31T05:04:21.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:21 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-31T05:04:21.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:21 smithi181 ceph-mon[36434]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-31T05:04:21.794 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:21 smithi181 ceph-mon[36434]: from='osd.1 ' entity='osd.1' 2024-01-31T05:04:21.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:21 smithi099 ceph-mon[31615]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-01-31T05:04:21.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:21 smithi099 ceph-mon[31615]: osdmap e12: 2 total, 1 up, 2 in 2024-01-31T05:04:21.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:21 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-31T05:04:21.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:21 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-31T05:04:21.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:21 smithi099 ceph-mon[31615]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-31T05:04:21.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:21 smithi099 ceph-mon[31615]: from='osd.1 ' entity='osd.1' 2024-01-31T05:04:21.821 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph orch daemon add osd smithi181:vg_nvme/lv_4 2024-01-31T05:04:22.072 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.c/config 2024-01-31T05:04:22.445 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:22 smithi181 ceph-mon[36434]: purged_snaps scrub starts 2024-01-31T05:04:22.445 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:22 smithi181 ceph-mon[36434]: purged_snaps scrub ok 2024-01-31T05:04:22.445 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:22 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-31T05:04:22.445 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:22 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:22.445 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:22 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:22.445 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:22 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:04:22.445 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:22 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:22.445 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:22 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:04:22.445 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:22 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:04:22.446 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:22 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:22.446 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:22 smithi181 ceph-mon[36434]: osd.1 [v2:172.21.15.179:6800/2019451677,v1:172.21.15.179:6801/2019451677] boot 2024-01-31T05:04:22.446 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:22 smithi181 ceph-mon[36434]: osdmap e13: 2 total, 2 up, 2 in 2024-01-31T05:04:22.446 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:22 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-31T05:04:22.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:22 smithi099 ceph-mon[31615]: purged_snaps scrub starts 2024-01-31T05:04:22.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:22 smithi099 ceph-mon[31615]: purged_snaps scrub ok 2024-01-31T05:04:22.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:22 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-31T05:04:22.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:22 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:22.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:22 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:22.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:22 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:04:22.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:22 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:22.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:22 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:04:22.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:22 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:04:22.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:22 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:22.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:22 smithi099 ceph-mon[31615]: osd.1 [v2:172.21.15.179:6800/2019451677,v1:172.21.15.179:6801/2019451677] boot 2024-01-31T05:04:22.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:22 smithi099 ceph-mon[31615]: osdmap e13: 2 total, 2 up, 2 in 2024-01-31T05:04:22.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:22 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-31T05:04:22.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:22 smithi179 ceph-mon[35652]: purged_snaps scrub starts 2024-01-31T05:04:22.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:22 smithi179 ceph-mon[35652]: purged_snaps scrub ok 2024-01-31T05:04:22.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:22 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-31T05:04:22.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:22 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:22.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:22 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:22.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:22 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:04:22.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:22 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:22.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:22 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:04:22.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:22 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:04:22.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:22 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:22.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:22 smithi179 ceph-mon[35652]: osd.1 [v2:172.21.15.179:6800/2019451677,v1:172.21.15.179:6801/2019451677] boot 2024-01-31T05:04:22.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:22 smithi179 ceph-mon[35652]: osdmap e13: 2 total, 2 up, 2 in 2024-01-31T05:04:22.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:22 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-31T05:04:23.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:23.636+0000 7f7048fc9700 1 -- 172.21.15.181:0/833140463 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f70441034a0 msgr2=0x7f7044109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:23.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:23.636+0000 7f7048fc9700 1 --2- 172.21.15.181:0/833140463 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f70441034a0 0x7f7044109d50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f703c00b0a0 tx=0x7f703c00b3b0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:23.636+0000 7f7048fc9700 1 -- 172.21.15.181:0/833140463 shutdown_connections 2024-01-31T05:04:23.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:23.636+0000 7f7048fc9700 1 --2- 172.21.15.181:0/833140463 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f70441034a0 0x7f7044109d50 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:23.636+0000 7f7048fc9700 1 --2- 172.21.15.181:0/833140463 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f70440ffb20 0x7f70440fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:23.636+0000 7f7048fc9700 1 --2- 172.21.15.181:0/833140463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7044102b00 0x7f7044102f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:23.636+0000 7f7048fc9700 1 -- 172.21.15.181:0/833140463 >> 172.21.15.181:0/833140463 conn(0x7f70440fb480 msgr2=0x7f70440fd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:23.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:23.636+0000 7f7048fc9700 1 -- 172.21.15.181:0/833140463 shutdown_connections 2024-01-31T05:04:23.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:23.636+0000 7f7048fc9700 1 -- 172.21.15.181:0/833140463 wait complete. 2024-01-31T05:04:23.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:23.637+0000 7f7048fc9700 1 Processor -- start 2024-01-31T05:04:23.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:23.637+0000 7f7048fc9700 1 -- start start 2024-01-31T05:04:23.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:23.637+0000 7f7048fc9700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70440ffb20 0x7f7044102460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:23.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:23.637+0000 7f7048fc9700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7044102b00 0x7f7044100ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:23.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:23.637+0000 7f7048fc9700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f70441034a0 0x7f7044100ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:23.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:23.637+0000 7f7048fc9700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7044101770 con 0x7f7044102b00 2024-01-31T05:04:23.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:23.637+0000 7f7048fc9700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70441018e0 con 0x7f70440ffb20 2024-01-31T05:04:23.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:23.637+0000 7f7048fc9700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70441a19d0 con 0x7f70441034a0 2024-01-31T05:04:23.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:23.639+0000 7f7042d9d700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f70441034a0 0x7f7044100ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:23.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:23.639+0000 7f7042d9d700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f70441034a0 0x7f7044100ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:52054/0 (socket says 172.21.15.181:52054) 2024-01-31T05:04:23.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:23.639+0000 7f7042d9d700 1 -- 172.21.15.181:0/956064509 learned_addr learned my addr 172.21.15.181:0/956064509 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-01-31T05:04:23.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:23.639+0000 7f7041d9b700 1 --2- 172.21.15.181:0/956064509 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7044102b00 0x7f7044100ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:23.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:23.639+0000 7f704259c700 1 --2- 172.21.15.181:0/956064509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70440ffb20 0x7f7044102460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:23.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:23.639+0000 7f7042d9d700 1 -- 172.21.15.181:0/956064509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70440ffb20 msgr2=0x7f7044102460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:23.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:23.639+0000 7f7042d9d700 1 --2- 172.21.15.181:0/956064509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70440ffb20 0x7f7044102460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:23.639+0000 7f7042d9d700 1 -- 172.21.15.181:0/956064509 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7044102b00 msgr2=0x7f7044100ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:23.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:23.639+0000 7f7042d9d700 1 --2- 172.21.15.181:0/956064509 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7044102b00 0x7f7044100ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:23.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:23.639+0000 7f7042d9d700 1 -- 172.21.15.181:0/956064509 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f703c009d00 con 0x7f70441034a0 2024-01-31T05:04:23.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:23.639+0000 7f7041d9b700 1 --2- 172.21.15.181:0/956064509 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7044102b00 0x7f7044100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:04:23.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:23.639+0000 7f7042d9d700 1 --2- 172.21.15.181:0/956064509 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f70441034a0 0x7f7044100ff0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f703c004d00 tx=0x7f703c004de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:23.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:23.639+0000 7f70337fe700 1 -- 172.21.15.181:0/956064509 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703c00e040 con 0x7f70441034a0 2024-01-31T05:04:23.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:23.639+0000 7f70337fe700 1 -- 172.21.15.181:0/956064509 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f703c009440 con 0x7f70441034a0 2024-01-31T05:04:23.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:23.639+0000 7f70337fe700 1 -- 172.21.15.181:0/956064509 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703c01ba80 con 0x7f70441034a0 2024-01-31T05:04:23.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:23.639+0000 7f7048fc9700 1 -- 172.21.15.181:0/956064509 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70441a1c50 con 0x7f70441034a0 2024-01-31T05:04:23.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:23.639+0000 7f7048fc9700 1 -- 172.21.15.181:0/956064509 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70441a2110 con 0x7f70441034a0 2024-01-31T05:04:23.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:23.639+0000 7f7048fc9700 1 -- 172.21.15.181:0/956064509 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70440684a0 con 0x7f70441034a0 2024-01-31T05:04:23.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:23.640+0000 7f70337fe700 1 -- 172.21.15.181:0/956064509 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 15) v1 ==== 135839+0+0 (secure 0 0 0) 0x7f703c01bbe0 con 0x7f70441034a0 2024-01-31T05:04:23.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:23.641+0000 7f70337fe700 1 --2- 172.21.15.181:0/956064509 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f702c0a1360 0x7f702c0a3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:23.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:23.641+0000 7f70337fe700 1 -- 172.21.15.181:0/956064509 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2309+0+0 (secure 0 0 0) 0x7f703c0ccdf0 con 0x7f70441034a0 2024-01-31T05:04:23.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:23.641+0000 7f704259c700 1 --2- 172.21.15.181:0/956064509 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f702c0a1360 0x7f702c0a3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:23.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:23.641+0000 7f704259c700 1 --2- 172.21.15.181:0/956064509 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f702c0a1360 0x7f702c0a3820 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7038006fd0 tx=0x7f7038008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:23.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:23.646+0000 7f70337fe700 1 -- 172.21.15.181:0/956064509 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f703c097b50 con 0x7f70441034a0 2024-01-31T05:04:23.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:23 smithi099 ceph-mon[31615]: Detected new or changed devices on smithi179 2024-01-31T05:04:23.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:23 smithi099 ceph-mon[31615]: Adjusting osd_memory_target on smithi179 to 17080M 2024-01-31T05:04:23.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:23 smithi099 ceph-mon[31615]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-01-31T05:04:23.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:23 smithi181 ceph-mon[36434]: Detected new or changed devices on smithi179 2024-01-31T05:04:23.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:23 smithi181 ceph-mon[36434]: Adjusting osd_memory_target on smithi179 to 17080M 2024-01-31T05:04:23.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:23 smithi181 ceph-mon[36434]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-01-31T05:04:23.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:23.843+0000 7f7048fc9700 1 -- 172.21.15.181:0/956064509 --> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f704402d5e0 con 0x7f702c0a1360 2024-01-31T05:04:23.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:23 smithi179 ceph-mon[35652]: Detected new or changed devices on smithi179 2024-01-31T05:04:23.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:23 smithi179 ceph-mon[35652]: Adjusting osd_memory_target on smithi179 to 17080M 2024-01-31T05:04:23.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:23 smithi179 ceph-mon[35652]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-01-31T05:04:24.723 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:24 smithi181 ceph-mon[36434]: osdmap e14: 2 total, 2 up, 2 in 2024-01-31T05:04:24.723 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:24 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-31T05:04:24.723 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:24 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-31T05:04:24.723 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:24 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:04:24.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:24 smithi099 ceph-mon[31615]: osdmap e14: 2 total, 2 up, 2 in 2024-01-31T05:04:24.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:24 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-31T05:04:24.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:24 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-31T05:04:24.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:24 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:04:24.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:24 smithi179 ceph-mon[35652]: osdmap e14: 2 total, 2 up, 2 in 2024-01-31T05:04:24.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:24 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-31T05:04:24.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:24 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-31T05:04:24.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:24 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:04:25.703 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:25 smithi181 ceph-mon[36434]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:04:25.704 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:25 smithi181 ceph-mon[36434]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-01-31T05:04:25.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:25 smithi099 ceph-mon[31615]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:04:25.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:25 smithi099 ceph-mon[31615]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-01-31T05:04:25.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:25 smithi179 ceph-mon[35652]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:04:25.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:25 smithi179 ceph-mon[35652]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-01-31T05:04:26.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:26 smithi099 ceph-mon[31615]: from='client.? 172.21.15.181:0/866272027' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "11c919c8-19a9-48b0-8880-3002efcb64f3"}]: dispatch 2024-01-31T05:04:26.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:26 smithi099 ceph-mon[31615]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "11c919c8-19a9-48b0-8880-3002efcb64f3"}]: dispatch 2024-01-31T05:04:26.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:26 smithi099 ceph-mon[31615]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "11c919c8-19a9-48b0-8880-3002efcb64f3"}]': finished 2024-01-31T05:04:26.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:26 smithi099 ceph-mon[31615]: osdmap e15: 3 total, 2 up, 3 in 2024-01-31T05:04:26.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:26 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-31T05:04:26.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:26 smithi181 ceph-mon[36434]: from='client.? 172.21.15.181:0/866272027' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "11c919c8-19a9-48b0-8880-3002efcb64f3"}]: dispatch 2024-01-31T05:04:26.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:26 smithi181 ceph-mon[36434]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "11c919c8-19a9-48b0-8880-3002efcb64f3"}]: dispatch 2024-01-31T05:04:26.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:26 smithi181 ceph-mon[36434]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "11c919c8-19a9-48b0-8880-3002efcb64f3"}]': finished 2024-01-31T05:04:26.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:26 smithi181 ceph-mon[36434]: osdmap e15: 3 total, 2 up, 3 in 2024-01-31T05:04:26.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:26 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-31T05:04:26.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:26 smithi179 ceph-mon[35652]: from='client.? 172.21.15.181:0/866272027' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "11c919c8-19a9-48b0-8880-3002efcb64f3"}]: dispatch 2024-01-31T05:04:26.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:26 smithi179 ceph-mon[35652]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "11c919c8-19a9-48b0-8880-3002efcb64f3"}]: dispatch 2024-01-31T05:04:26.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:26 smithi179 ceph-mon[35652]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "11c919c8-19a9-48b0-8880-3002efcb64f3"}]': finished 2024-01-31T05:04:26.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:26 smithi179 ceph-mon[35652]: osdmap e15: 3 total, 2 up, 3 in 2024-01-31T05:04:26.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:26 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-31T05:04:27.719 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:27 smithi099 ceph-mon[31615]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-01-31T05:04:27.720 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:27 smithi099 ceph-mon[31615]: from='client.? 172.21.15.181:0/2927936016' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-31T05:04:27.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:27 smithi181 ceph-mon[36434]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-01-31T05:04:27.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:27 smithi181 ceph-mon[36434]: from='client.? 172.21.15.181:0/2927936016' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-31T05:04:27.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:27 smithi179 ceph-mon[35652]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-01-31T05:04:27.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:27 smithi179 ceph-mon[35652]: from='client.? 172.21.15.181:0/2927936016' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-31T05:04:29.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:29 smithi179 ceph-mon[35652]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-01-31T05:04:30.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:29 smithi099 ceph-mon[31615]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-01-31T05:04:30.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:29 smithi181 ceph-mon[36434]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-01-31T05:04:31.863 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:31 smithi181 ceph-mon[36434]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-01-31T05:04:31.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:31 smithi179 ceph-mon[35652]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-01-31T05:04:32.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:31 smithi099 ceph-mon[31615]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-01-31T05:04:33.312 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:33 smithi181 ceph-mon[36434]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-01-31T05:04:33.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:33 smithi179 ceph-mon[35652]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-01-31T05:04:33.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:33 smithi099 ceph-mon[31615]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-01-31T05:04:34.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:34 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-01-31T05:04:34.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:34 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:04:34.515 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:34 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-01-31T05:04:34.516 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:34 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:04:34.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:34 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-01-31T05:04:34.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:34 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:04:35.378 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:35 smithi181 ceph-mon[36434]: Deploying daemon osd.2 on smithi181 2024-01-31T05:04:35.378 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:35 smithi181 ceph-mon[36434]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-01-31T05:04:35.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:35 smithi179 ceph-mon[35652]: Deploying daemon osd.2 on smithi181 2024-01-31T05:04:35.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:35 smithi179 ceph-mon[35652]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-01-31T05:04:35.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:35 smithi099 ceph-mon[31615]: Deploying daemon osd.2 on smithi181 2024-01-31T05:04:35.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:35 smithi099 ceph-mon[31615]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-01-31T05:04:37.714 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:37 smithi181 ceph-mon[36434]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-01-31T05:04:37.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:37 smithi179 ceph-mon[35652]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-01-31T05:04:38.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:37 smithi099 ceph-mon[31615]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-01-31T05:04:39.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:39 smithi179 ceph-mon[35652]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-01-31T05:04:39.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:39 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:39.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:39 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:39.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:39 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:04:39.915 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:39 smithi181 ceph-mon[36434]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-01-31T05:04:39.915 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:39 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:39.915 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:39 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:39.915 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:39 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:04:40.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:39 smithi099 ceph-mon[31615]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-01-31T05:04:40.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:39 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:40.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:39 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:40.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:39 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:04:41.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:41 smithi179 ceph-mon[35652]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-01-31T05:04:41.996 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:41 smithi181 ceph-mon[36434]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-01-31T05:04:42.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:41 smithi099 ceph-mon[31615]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-01-31T05:04:42.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:42.358+0000 7f70337fe700 1 -- 172.21.15.181:0/956064509 <== mgr.14152 v2:172.21.15.99:6800/3925720924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f704402d5e0 con 0x7f702c0a1360 2024-01-31T05:04:42.357 INFO:teuthology.orchestra.run.smithi181.stdout:Created osd(s) 2 on host 'smithi181' 2024-01-31T05:04:42.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:42.360+0000 7f7048fc9700 1 -- 172.21.15.181:0/956064509 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f702c0a1360 msgr2=0x7f702c0a3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:42.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:42.360+0000 7f7048fc9700 1 --2- 172.21.15.181:0/956064509 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f702c0a1360 0x7f702c0a3820 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7038006fd0 tx=0x7f7038008040 comp rx=0 tx=0).stop 2024-01-31T05:04:42.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:42.360+0000 7f7048fc9700 1 -- 172.21.15.181:0/956064509 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f70441034a0 msgr2=0x7f7044100ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:42.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:42.360+0000 7f7048fc9700 1 --2- 172.21.15.181:0/956064509 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f70441034a0 0x7f7044100ff0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f703c004d00 tx=0x7f703c004de0 comp rx=0 tx=0).stop 2024-01-31T05:04:42.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:42.361+0000 7f7048fc9700 1 -- 172.21.15.181:0/956064509 shutdown_connections 2024-01-31T05:04:42.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:42.361+0000 7f7048fc9700 1 --2- 172.21.15.181:0/956064509 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f70441034a0 0x7f7044100ff0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:42.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:42.361+0000 7f7048fc9700 1 --2- 172.21.15.181:0/956064509 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f702c0a1360 0x7f702c0a3820 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:42.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:42.361+0000 7f7048fc9700 1 --2- 172.21.15.181:0/956064509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70440ffb20 0x7f7044102460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:42.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:42.361+0000 7f7048fc9700 1 --2- 172.21.15.181:0/956064509 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7044102b00 0x7f7044100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:42.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:42.361+0000 7f7048fc9700 1 -- 172.21.15.181:0/956064509 >> 172.21.15.181:0/956064509 conn(0x7f70440fb480 msgr2=0x7f7044105e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:42.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:42.361+0000 7f7048fc9700 1 -- 172.21.15.181:0/956064509 shutdown_connections 2024-01-31T05:04:42.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:04:42.361+0000 7f7048fc9700 1 -- 172.21.15.181:0/956064509 wait complete. 2024-01-31T05:04:42.951 DEBUG:teuthology.orchestra.run.smithi181:osd.2> sudo journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@osd.2.service 2024-01-31T05:04:42.953 INFO:tasks.cephadm:Deploying osd.3 on smithi099 with /dev/vg_nvme/lv_3... 2024-01-31T05:04:42.953 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-01-31T05:04:43.193 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:04:43.194 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:42 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:43.194 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:42 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:43.195 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:42 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:04:43.195 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:42 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:04:43.195 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:42 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:43.195 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:42 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:43.195 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:42 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:43.195 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:42 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:04:43.195 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:42 smithi181 ceph-mon[36434]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-01-31T05:04:43.195 INFO:journalctl@ceph.osd.2.smithi181.stdout:Jan 31 05:04:43 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-2[41611]: 2024-01-31T05:04:43.077+0000 7f2483de07c0 -1 osd.2 0 log_to_monitors true 2024-01-31T05:04:43.316 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:42 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:43.316 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:42 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:43.316 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:42 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:04:43.317 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:42 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:04:43.317 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:42 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:43.317 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:42 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:43.317 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:42 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:43.317 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:42 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:04:43.317 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:42 smithi099 ceph-mon[31615]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-01-31T05:04:43.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:42 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:43.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:42 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:43.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:42 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:04:43.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:42 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:04:43.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:42 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:43.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:42 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:43.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:42 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:43.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:42 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:04:43.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:42 smithi179 ceph-mon[35652]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-01-31T05:04:44.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:43 smithi181 ceph-mon[36434]: from='osd.2 [v2:172.21.15.181:6800/3934284457,v1:172.21.15.181:6801/3934284457]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-01-31T05:04:44.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:43 smithi181 ceph-mon[36434]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-01-31T05:04:44.257 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:43 smithi099 ceph-mon[31615]: from='osd.2 [v2:172.21.15.181:6800/3934284457,v1:172.21.15.181:6801/3934284457]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-01-31T05:04:44.257 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:43 smithi099 ceph-mon[31615]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-01-31T05:04:44.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:43 smithi179 ceph-mon[35652]: from='osd.2 [v2:172.21.15.181:6800/3934284457,v1:172.21.15.181:6801/3934284457]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-01-31T05:04:44.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:43 smithi179 ceph-mon[35652]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-01-31T05:04:45.066 INFO:teuthology.orchestra.run.smithi099.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-01-31T05:04:45.066 INFO:teuthology.orchestra.run.smithi099.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-01-31T05:04:45.066 INFO:teuthology.orchestra.run.smithi099.stderr: stderr: 10+0 records in 2024-01-31T05:04:45.066 INFO:teuthology.orchestra.run.smithi099.stderr:10+0 records out 2024-01-31T05:04:45.066 INFO:teuthology.orchestra.run.smithi099.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0115618 s, 907 MB/s 2024-01-31T05:04:45.066 INFO:teuthology.orchestra.run.smithi099.stderr:--> Zapping successful for: 2024-01-31T05:04:45.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:44 smithi099 ceph-mon[31615]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-01-31T05:04:45.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:44 smithi099 ceph-mon[31615]: from='osd.2 [v2:172.21.15.181:6800/3934284457,v1:172.21.15.181:6801/3934284457]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-01-31T05:04:45.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:44 smithi099 ceph-mon[31615]: osdmap e16: 3 total, 2 up, 3 in 2024-01-31T05:04:45.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:44 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-31T05:04:45.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:44 smithi099 ceph-mon[31615]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-01-31T05:04:45.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:44 smithi099 ceph-mon[31615]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-01-31T05:04:45.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:44 smithi099 ceph-mon[31615]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-01-31T05:04:45.229 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:44 smithi181 ceph-mon[36434]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-01-31T05:04:45.229 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:44 smithi181 ceph-mon[36434]: from='osd.2 [v2:172.21.15.181:6800/3934284457,v1:172.21.15.181:6801/3934284457]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-01-31T05:04:45.229 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:44 smithi181 ceph-mon[36434]: osdmap e16: 3 total, 2 up, 3 in 2024-01-31T05:04:45.229 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:44 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-31T05:04:45.229 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:44 smithi181 ceph-mon[36434]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-01-31T05:04:45.229 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:44 smithi181 ceph-mon[36434]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-01-31T05:04:45.229 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:44 smithi181 ceph-mon[36434]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-01-31T05:04:45.230 INFO:journalctl@ceph.osd.2.smithi181.stdout:Jan 31 05:04:44 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-2[41611]: 2024-01-31T05:04:44.965+0000 7f2478c45700 -1 osd.2 0 waiting for initial osdmap 2024-01-31T05:04:45.230 INFO:journalctl@ceph.osd.2.smithi181.stdout:Jan 31 05:04:44 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-2[41611]: 2024-01-31T05:04:44.970+0000 7f2475240700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-31T05:04:45.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:44 smithi179 ceph-mon[35652]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-01-31T05:04:45.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:44 smithi179 ceph-mon[35652]: from='osd.2 [v2:172.21.15.181:6800/3934284457,v1:172.21.15.181:6801/3934284457]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-01-31T05:04:45.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:44 smithi179 ceph-mon[35652]: osdmap e16: 3 total, 2 up, 3 in 2024-01-31T05:04:45.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:44 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-31T05:04:45.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:44 smithi179 ceph-mon[35652]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-01-31T05:04:45.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:44 smithi179 ceph-mon[35652]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-01-31T05:04:45.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:44 smithi179 ceph-mon[35652]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-01-31T05:04:45.809 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph orch daemon add osd smithi099:vg_nvme/lv_3 2024-01-31T05:04:46.054 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:04:46.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:45 smithi099 ceph-mon[31615]: osdmap e17: 3 total, 2 up, 3 in 2024-01-31T05:04:46.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:45 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-31T05:04:46.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:45 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-31T05:04:46.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:45 smithi099 ceph-mon[31615]: Detected new or changed devices on smithi181 2024-01-31T05:04:46.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:45 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:46.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:45 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:46.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:45 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:04:46.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:45 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:46.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:45 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:04:46.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:45 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:04:46.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:45 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:46.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:45 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-31T05:04:46.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:45 smithi181 ceph-mon[36434]: osdmap e17: 3 total, 2 up, 3 in 2024-01-31T05:04:46.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:45 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-31T05:04:46.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:45 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-31T05:04:46.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:45 smithi181 ceph-mon[36434]: Detected new or changed devices on smithi181 2024-01-31T05:04:46.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:45 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:46.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:45 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:46.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:45 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:04:46.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:45 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:46.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:45 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:04:46.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:45 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:04:46.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:45 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:46.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:45 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-31T05:04:46.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:45 smithi179 ceph-mon[35652]: osdmap e17: 3 total, 2 up, 3 in 2024-01-31T05:04:46.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:45 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-31T05:04:46.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:45 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-31T05:04:46.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:45 smithi179 ceph-mon[35652]: Detected new or changed devices on smithi181 2024-01-31T05:04:46.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:45 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:46.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:45 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:46.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:45 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:04:46.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:45 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:46.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:45 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:04:46.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:45 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:04:46.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:45 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:46.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:45 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-31T05:04:47.230 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:46 smithi099 ceph-mon[31615]: purged_snaps scrub starts 2024-01-31T05:04:47.230 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:46 smithi099 ceph-mon[31615]: purged_snaps scrub ok 2024-01-31T05:04:47.230 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:46 smithi099 ceph-mon[31615]: Adjusting osd_memory_target on smithi181 to 17080M 2024-01-31T05:04:47.230 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:46 smithi099 ceph-mon[31615]: osd.2 [v2:172.21.15.181:6800/3934284457,v1:172.21.15.181:6801/3934284457] boot 2024-01-31T05:04:47.230 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:46 smithi099 ceph-mon[31615]: osdmap e18: 3 total, 3 up, 3 in 2024-01-31T05:04:47.230 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:46 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-31T05:04:47.230 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:46 smithi099 ceph-mon[31615]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-01-31T05:04:47.231 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:46 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-01-31T05:04:47.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:46 smithi181 ceph-mon[36434]: purged_snaps scrub starts 2024-01-31T05:04:47.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:46 smithi181 ceph-mon[36434]: purged_snaps scrub ok 2024-01-31T05:04:47.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:46 smithi181 ceph-mon[36434]: Adjusting osd_memory_target on smithi181 to 17080M 2024-01-31T05:04:47.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:46 smithi181 ceph-mon[36434]: osd.2 [v2:172.21.15.181:6800/3934284457,v1:172.21.15.181:6801/3934284457] boot 2024-01-31T05:04:47.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:46 smithi181 ceph-mon[36434]: osdmap e18: 3 total, 3 up, 3 in 2024-01-31T05:04:47.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:46 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-31T05:04:47.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:46 smithi181 ceph-mon[36434]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-01-31T05:04:47.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:46 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-01-31T05:04:47.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:46 smithi179 ceph-mon[35652]: purged_snaps scrub starts 2024-01-31T05:04:47.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:46 smithi179 ceph-mon[35652]: purged_snaps scrub ok 2024-01-31T05:04:47.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:46 smithi179 ceph-mon[35652]: Adjusting osd_memory_target on smithi181 to 17080M 2024-01-31T05:04:47.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:46 smithi179 ceph-mon[35652]: osd.2 [v2:172.21.15.181:6800/3934284457,v1:172.21.15.181:6801/3934284457] boot 2024-01-31T05:04:47.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:46 smithi179 ceph-mon[35652]: osdmap e18: 3 total, 3 up, 3 in 2024-01-31T05:04:47.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:46 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-31T05:04:47.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:46 smithi179 ceph-mon[35652]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-01-31T05:04:47.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:46 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-01-31T05:04:47.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:04:47.743+0000 7f2091ebd700 1 -- 172.21.15.99:0/2435345824 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f208c100740 msgr2=0x7f208c100b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:47.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:04:47.743+0000 7f2091ebd700 1 --2- 172.21.15.99:0/2435345824 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f208c100740 0x7f208c100b60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f207c0099c0 tx=0x7f207c009cd0 comp rx=0 tx=0).stop 2024-01-31T05:04:47.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:04:47.744+0000 7f2091ebd700 1 -- 172.21.15.99:0/2435345824 shutdown_connections 2024-01-31T05:04:47.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:04:47.744+0000 7f2091ebd700 1 --2- 172.21.15.99:0/2435345824 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f208c1022e0 0x7f208c108b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:47.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:04:47.744+0000 7f2091ebd700 1 --2- 172.21.15.99:0/2435345824 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f208c100740 0x7f208c100b60 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:47.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:04:47.744+0000 7f2091ebd700 1 --2- 172.21.15.99:0/2435345824 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f208c101940 0x7f208c101da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:47.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:04:47.744+0000 7f2091ebd700 1 -- 172.21.15.99:0/2435345824 >> 172.21.15.99:0/2435345824 conn(0x7f208c0fbd00 msgr2=0x7f208c0fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:04:47.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:04:47.744+0000 7f2091ebd700 1 -- 172.21.15.99:0/2435345824 shutdown_connections 2024-01-31T05:04:47.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:04:47.744+0000 7f2091ebd700 1 -- 172.21.15.99:0/2435345824 wait complete. 2024-01-31T05:04:47.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:04:47.744+0000 7f2091ebd700 1 Processor -- start 2024-01-31T05:04:47.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:04:47.744+0000 7f2091ebd700 1 -- start start 2024-01-31T05:04:47.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:04:47.744+0000 7f2091ebd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f208c100740 0x7f208c1977d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:47.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:04:47.744+0000 7f2091ebd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f208c101940 0x7f208c197d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:47.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:04:47.744+0000 7f2091ebd700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f208c1022e0 0x7f208c19ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:47.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:04:47.745+0000 7f2091ebd700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f208c19f360 con 0x7f208c101940 2024-01-31T05:04:47.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:04:47.745+0000 7f2091ebd700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f208c19f4a0 con 0x7f208c100740 2024-01-31T05:04:47.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:04:47.745+0000 7f2091ebd700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f208c19f630 con 0x7f208c1022e0 2024-01-31T05:04:47.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:04:47.745+0000 7f208affd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f208c101940 0x7f208c197d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:47.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:04:47.745+0000 7f208affd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f208c101940 0x7f208c197d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46974/0 (socket says 172.21.15.99:46974) 2024-01-31T05:04:47.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:04:47.745+0000 7f208affd700 1 -- 172.21.15.99:0/3052377802 learned_addr learned my addr 172.21.15.99:0/3052377802 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:04:47.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:04:47.745+0000 7f208b7fe700 1 --2- 172.21.15.99:0/3052377802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f208c100740 0x7f208c1977d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:47.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:04:47.745+0000 7f208bfff700 1 --2- 172.21.15.99:0/3052377802 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f208c1022e0 0x7f208c19ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:47.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:04:47.745+0000 7f208affd700 1 -- 172.21.15.99:0/3052377802 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f208c1022e0 msgr2=0x7f208c19ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:47.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:04:47.745+0000 7f208affd700 1 --2- 172.21.15.99:0/3052377802 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f208c1022e0 0x7f208c19ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:47.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:04:47.745+0000 7f208affd700 1 -- 172.21.15.99:0/3052377802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f208c100740 msgr2=0x7f208c1977d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:04:47.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:04:47.745+0000 7f208affd700 1 --2- 172.21.15.99:0/3052377802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f208c100740 0x7f208c1977d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:04:47.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:04:47.745+0000 7f208affd700 1 -- 172.21.15.99:0/3052377802 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f207c0095f0 con 0x7f208c101940 2024-01-31T05:04:47.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:04:47.745+0000 7f208affd700 1 --2- 172.21.15.99:0/3052377802 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f208c101940 0x7f208c197d10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f208000b560 tx=0x7f208000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:47.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:04:47.745+0000 7f2088ff9700 1 -- 172.21.15.99:0/3052377802 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2080011830 con 0x7f208c101940 2024-01-31T05:04:47.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:04:47.745+0000 7f2088ff9700 1 -- 172.21.15.99:0/3052377802 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2080011e50 con 0x7f208c101940 2024-01-31T05:04:47.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:04:47.745+0000 7f2091ebd700 1 -- 172.21.15.99:0/3052377802 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f208c102bc0 con 0x7f208c101940 2024-01-31T05:04:47.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:04:47.745+0000 7f2088ff9700 1 -- 172.21.15.99:0/3052377802 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2080010e50 con 0x7f208c101940 2024-01-31T05:04:47.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:04:47.745+0000 7f2091ebd700 1 -- 172.21.15.99:0/3052377802 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f208c103140 con 0x7f208c101940 2024-01-31T05:04:47.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:04:47.746+0000 7f2091ebd700 1 -- 172.21.15.99:0/3052377802 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f208c0684a0 con 0x7f208c101940 2024-01-31T05:04:47.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:04:47.747+0000 7f2088ff9700 1 -- 172.21.15.99:0/3052377802 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 15) v1 ==== 135839+0+0 (secure 0 0 0) 0x7f20800104f0 con 0x7f208c101940 2024-01-31T05:04:47.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:04:47.748+0000 7f2088ff9700 1 --2- 172.21.15.99:0/3052377802 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f20740a12e0 0x7f20740a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:04:47.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:04:47.748+0000 7f208b7fe700 1 --2- 172.21.15.99:0/3052377802 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f20740a12e0 0x7f20740a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:04:47.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:04:47.748+0000 7f2088ff9700 1 -- 172.21.15.99:0/3052377802 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3226+0+0 (secure 0 0 0) 0x7f20800cb000 con 0x7f208c101940 2024-01-31T05:04:47.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:04:47.748+0000 7f208b7fe700 1 --2- 172.21.15.99:0/3052377802 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f20740a12e0 0x7f20740a37a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f207c006010 tx=0x7f207c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:04:47.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:04:47.752+0000 7f2088ff9700 1 -- 172.21.15.99:0/3052377802 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f20800fe600 con 0x7f208c101940 2024-01-31T05:04:47.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:04:47.953+0000 7f2091ebd700 1 -- 172.21.15.99:0/3052377802 --> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f208c0fdef0 con 0x7f20740a12e0 2024-01-31T05:04:48.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:47 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-01-31T05:04:48.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:47 smithi099 ceph-mon[31615]: osdmap e19: 3 total, 3 up, 3 in 2024-01-31T05:04:48.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:47 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-01-31T05:04:48.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:47 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-31T05:04:48.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:47 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-31T05:04:48.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:47 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:04:48.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:47 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-01-31T05:04:48.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:47 smithi181 ceph-mon[36434]: osdmap e19: 3 total, 3 up, 3 in 2024-01-31T05:04:48.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:47 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-01-31T05:04:48.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:47 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-31T05:04:48.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:47 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-31T05:04:48.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:47 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:04:48.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:47 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-01-31T05:04:48.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:47 smithi179 ceph-mon[35652]: osdmap e19: 3 total, 3 up, 3 in 2024-01-31T05:04:48.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:47 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-01-31T05:04:48.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:47 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-31T05:04:48.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:47 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-31T05:04:48.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:47 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:04:49.250 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:48 smithi099 ceph-mon[31615]: from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:04:49.251 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:48 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-01-31T05:04:49.251 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:48 smithi099 ceph-mon[31615]: osdmap e20: 3 total, 3 up, 3 in 2024-01-31T05:04:49.251 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:48 smithi099 ceph-mon[31615]: pgmap v84: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-01-31T05:04:49.251 INFO:journalctl@ceph.osd.0.smithi099.stdout:Jan 31 05:04:48 smithi099 sudo[51497]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-01-31T05:04:49.251 INFO:journalctl@ceph.osd.0.smithi099.stdout:Jan 31 05:04:48 smithi099 sudo[51497]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-31T05:04:49.251 INFO:journalctl@ceph.osd.0.smithi099.stdout:Jan 31 05:04:48 smithi099 sudo[51497]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-31T05:04:49.251 INFO:journalctl@ceph.osd.0.smithi099.stdout:Jan 31 05:04:49 smithi099 sudo[51497]: pam_unix(sudo:session): session closed for user root 2024-01-31T05:04:49.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:48 smithi181 ceph-mon[36434]: from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:04:49.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:48 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-01-31T05:04:49.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:48 smithi181 ceph-mon[36434]: osdmap e20: 3 total, 3 up, 3 in 2024-01-31T05:04:49.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:48 smithi181 ceph-mon[36434]: pgmap v84: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-01-31T05:04:49.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:48 smithi179 ceph-mon[35652]: from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:04:49.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:48 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-01-31T05:04:49.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:48 smithi179 ceph-mon[35652]: osdmap e20: 3 total, 3 up, 3 in 2024-01-31T05:04:49.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:48 smithi179 ceph-mon[35652]: pgmap v84: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-01-31T05:04:49.531 INFO:journalctl@ceph.osd.0.smithi099.stdout:Jan 31 05:04:49 smithi099 sudo[51502]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-01-31T05:04:49.531 INFO:journalctl@ceph.osd.0.smithi099.stdout:Jan 31 05:04:49 smithi099 sudo[51502]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-31T05:04:49.531 INFO:journalctl@ceph.osd.0.smithi099.stdout:Jan 31 05:04:49 smithi099 sudo[51502]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-31T05:04:49.531 INFO:journalctl@ceph.osd.0.smithi099.stdout:Jan 31 05:04:49 smithi099 sudo[51502]: pam_unix(sudo:session): session closed for user root 2024-01-31T05:04:49.771 INFO:journalctl@ceph.osd.1.smithi179.stdout:Jan 31 05:04:49 smithi179 sudo[44302]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-01-31T05:04:49.771 INFO:journalctl@ceph.osd.1.smithi179.stdout:Jan 31 05:04:49 smithi179 sudo[44302]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-31T05:04:49.771 INFO:journalctl@ceph.osd.1.smithi179.stdout:Jan 31 05:04:49 smithi179 sudo[44302]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-31T05:04:49.771 INFO:journalctl@ceph.osd.1.smithi179.stdout:Jan 31 05:04:49 smithi179 sudo[44302]: pam_unix(sudo:session): session closed for user root 2024-01-31T05:04:50.132 INFO:journalctl@ceph.osd.1.smithi179.stdout:Jan 31 05:04:49 smithi179 sudo[44305]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-01-31T05:04:50.132 INFO:journalctl@ceph.osd.1.smithi179.stdout:Jan 31 05:04:49 smithi179 sudo[44305]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-31T05:04:50.132 INFO:journalctl@ceph.osd.1.smithi179.stdout:Jan 31 05:04:49 smithi179 sudo[44305]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-31T05:04:50.133 INFO:journalctl@ceph.osd.1.smithi179.stdout:Jan 31 05:04:49 smithi179 sudo[44305]: pam_unix(sudo:session): session closed for user root 2024-01-31T05:04:50.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:49 smithi179 ceph-mon[35652]: osdmap e21: 3 total, 3 up, 3 in 2024-01-31T05:04:50.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:49 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:50.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:49 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:50.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:04:50.285+0000 7f2088ff9700 1 -- 172.21.15.99:0/3052377802 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f2080095d10 con 0x7f208c101940 2024-01-31T05:04:50.286 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:49 smithi099 ceph-mon[31615]: osdmap e21: 3 total, 3 up, 3 in 2024-01-31T05:04:50.286 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:49 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:50.286 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:49 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:50.290 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:49 smithi181 ceph-mon[36434]: osdmap e21: 3 total, 3 up, 3 in 2024-01-31T05:04:50.290 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:49 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:50.290 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:49 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:50.290 INFO:journalctl@ceph.osd.2.smithi181.stdout:Jan 31 05:04:50 smithi181 sudo[45713]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-01-31T05:04:50.290 INFO:journalctl@ceph.osd.2.smithi181.stdout:Jan 31 05:04:50 smithi181 sudo[45713]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-31T05:04:50.290 INFO:journalctl@ceph.osd.2.smithi181.stdout:Jan 31 05:04:50 smithi181 sudo[45713]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-31T05:04:50.290 INFO:journalctl@ceph.osd.2.smithi181.stdout:Jan 31 05:04:50 smithi181 sudo[45713]: pam_unix(sudo:session): session closed for user root 2024-01-31T05:04:50.571 INFO:journalctl@ceph.osd.2.smithi181.stdout:Jan 31 05:04:50 smithi181 sudo[45716]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-01-31T05:04:50.571 INFO:journalctl@ceph.osd.2.smithi181.stdout:Jan 31 05:04:50 smithi181 sudo[45716]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-31T05:04:50.571 INFO:journalctl@ceph.osd.2.smithi181.stdout:Jan 31 05:04:50 smithi181 sudo[45716]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-31T05:04:50.572 INFO:journalctl@ceph.osd.2.smithi181.stdout:Jan 31 05:04:50 smithi181 sudo[45716]: pam_unix(sudo:session): session closed for user root 2024-01-31T05:04:50.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:50 smithi099 sudo[51575]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-01-31T05:04:50.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:50 smithi099 sudo[51575]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-31T05:04:50.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:50 smithi099 sudo[51575]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-31T05:04:50.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:50 smithi099 sudo[51575]: pam_unix(sudo:session): session closed for user root 2024-01-31T05:04:51.311 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:51 smithi181 sudo[45719]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-01-31T05:04:51.311 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:51 smithi181 sudo[45719]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-31T05:04:51.311 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:51 smithi181 sudo[45719]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-31T05:04:51.311 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:51 smithi181 sudo[45719]: pam_unix(sudo:session): session closed for user root 2024-01-31T05:04:51.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:50 smithi099 sudo[51578]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-01-31T05:04:51.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:50 smithi099 sudo[51578]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-31T05:04:51.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:50 smithi099 sudo[51578]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-31T05:04:51.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:50 smithi099 sudo[51578]: pam_unix(sudo:session): session closed for user root 2024-01-31T05:04:51.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:51 smithi181 sudo[45722]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-01-31T05:04:51.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:51 smithi181 sudo[45722]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-31T05:04:51.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:51 smithi181 sudo[45722]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-31T05:04:51.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:51 smithi181 sudo[45722]: pam_unix(sudo:session): session closed for user root 2024-01-31T05:04:51.807 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:51 smithi179 sudo[44308]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-01-31T05:04:51.807 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:51 smithi179 sudo[44308]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-31T05:04:51.807 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:51 smithi179 sudo[44308]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-31T05:04:51.807 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:51 smithi179 sudo[44308]: pam_unix(sudo:session): session closed for user root 2024-01-31T05:04:52.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:51 smithi099 ceph-mon[31615]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-01-31T05:04:52.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:51 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:52.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:51 smithi099 ceph-mon[31615]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-01-31T05:04:52.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:51 smithi099 ceph-mon[31615]: pgmap v86: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-01-31T05:04:52.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:51 smithi099 ceph-mon[31615]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-01-31T05:04:52.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:51 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-31T05:04:52.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:51 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-31T05:04:52.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:51 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-31T05:04:52.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:51 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-31T05:04:52.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:51 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-31T05:04:52.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:51 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-31T05:04:52.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:51 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/3803497746' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bcab5135-a5d1-45ae-a9b8-674425d3999e"}]: dispatch 2024-01-31T05:04:52.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:51 smithi181 ceph-mon[36434]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-01-31T05:04:52.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:51 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:52.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:51 smithi181 ceph-mon[36434]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-01-31T05:04:52.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:51 smithi181 ceph-mon[36434]: pgmap v86: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-01-31T05:04:52.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:51 smithi181 ceph-mon[36434]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-01-31T05:04:52.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:51 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-31T05:04:52.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:51 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-31T05:04:52.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:51 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-31T05:04:52.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:51 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-31T05:04:52.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:51 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-31T05:04:52.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:51 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-31T05:04:52.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:51 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/3803497746' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bcab5135-a5d1-45ae-a9b8-674425d3999e"}]: dispatch 2024-01-31T05:04:52.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:51 smithi179 sudo[44311]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-01-31T05:04:52.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:51 smithi179 sudo[44311]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-31T05:04:52.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:51 smithi179 sudo[44311]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-31T05:04:52.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:51 smithi179 sudo[44311]: pam_unix(sudo:session): session closed for user root 2024-01-31T05:04:52.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:51 smithi179 ceph-mon[35652]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-01-31T05:04:52.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:51 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:04:52.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:51 smithi179 ceph-mon[35652]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-01-31T05:04:52.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:51 smithi179 ceph-mon[35652]: pgmap v86: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-01-31T05:04:52.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:51 smithi179 ceph-mon[35652]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-01-31T05:04:52.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:51 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-31T05:04:52.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:51 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-31T05:04:52.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:51 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-31T05:04:52.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:51 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-31T05:04:52.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:51 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-31T05:04:52.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:51 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-31T05:04:52.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:51 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/3803497746' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bcab5135-a5d1-45ae-a9b8-674425d3999e"}]: dispatch 2024-01-31T05:04:53.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:52 smithi099 ceph-mon[31615]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-01-31T05:04:53.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:52 smithi099 ceph-mon[31615]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-01-31T05:04:53.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:52 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/3803497746' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bcab5135-a5d1-45ae-a9b8-674425d3999e"}]': finished 2024-01-31T05:04:53.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:52 smithi099 ceph-mon[31615]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-01-31T05:04:53.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:52 smithi099 ceph-mon[31615]: osdmap e22: 4 total, 3 up, 4 in 2024-01-31T05:04:53.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:52 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-31T05:04:53.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:52 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-31T05:04:53.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:52 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-31T05:04:53.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:52 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-31T05:04:53.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:52 smithi099 ceph-mon[31615]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-01-31T05:04:53.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:52 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/636868952' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-31T05:04:53.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:52 smithi181 ceph-mon[36434]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-01-31T05:04:53.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:52 smithi181 ceph-mon[36434]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-01-31T05:04:53.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:52 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/3803497746' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bcab5135-a5d1-45ae-a9b8-674425d3999e"}]': finished 2024-01-31T05:04:53.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:52 smithi181 ceph-mon[36434]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-01-31T05:04:53.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:52 smithi181 ceph-mon[36434]: osdmap e22: 4 total, 3 up, 4 in 2024-01-31T05:04:53.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:52 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-31T05:04:53.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:52 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-31T05:04:53.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:52 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-31T05:04:53.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:52 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-31T05:04:53.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:52 smithi181 ceph-mon[36434]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-01-31T05:04:53.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:52 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/636868952' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-31T05:04:53.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:52 smithi179 ceph-mon[35652]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-01-31T05:04:53.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:52 smithi179 ceph-mon[35652]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-01-31T05:04:53.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:52 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/3803497746' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bcab5135-a5d1-45ae-a9b8-674425d3999e"}]': finished 2024-01-31T05:04:53.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:52 smithi179 ceph-mon[35652]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-01-31T05:04:53.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:52 smithi179 ceph-mon[35652]: osdmap e22: 4 total, 3 up, 4 in 2024-01-31T05:04:53.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:52 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-31T05:04:53.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:52 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-31T05:04:53.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:52 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-31T05:04:53.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:52 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-31T05:04:53.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:52 smithi179 ceph-mon[35652]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-01-31T05:04:53.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:52 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/636868952' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-31T05:04:54.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:53 smithi099 ceph-mon[31615]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-01-31T05:04:54.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:53 smithi181 ceph-mon[36434]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-01-31T05:04:54.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:53 smithi179 ceph-mon[35652]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-01-31T05:04:55.915 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:55 smithi099 ceph-mon[31615]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-01-31T05:04:56.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:55 smithi181 ceph-mon[36434]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-01-31T05:04:56.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:55 smithi179 ceph-mon[35652]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-01-31T05:04:58.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:57 smithi099 ceph-mon[31615]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-01-31T05:04:58.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:57 smithi179 ceph-mon[35652]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-01-31T05:04:58.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:57 smithi181 ceph-mon[36434]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-01-31T05:04:59.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:58 smithi179 ceph-mon[35652]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-01-31T05:04:59.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:58 smithi099 ceph-mon[31615]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-01-31T05:04:59.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:58 smithi181 ceph-mon[36434]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-01-31T05:05:00.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:59 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-01-31T05:05:00.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:59 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:05:00.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:04:59 smithi099 ceph-mon[31615]: Deploying daemon osd.3 on smithi099 2024-01-31T05:05:00.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:59 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-01-31T05:05:00.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:59 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:05:00.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:04:59 smithi179 ceph-mon[35652]: Deploying daemon osd.3 on smithi099 2024-01-31T05:05:00.222 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:59 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-01-31T05:05:00.222 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:59 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:05:00.222 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:04:59 smithi181 ceph-mon[36434]: Deploying daemon osd.3 on smithi099 2024-01-31T05:05:01.234 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:00 smithi099 ceph-mon[31615]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-01-31T05:05:01.236 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:00 smithi181 ceph-mon[36434]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-01-31T05:05:01.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:00 smithi179 ceph-mon[35652]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-01-31T05:05:03.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:03 smithi179 ceph-mon[35652]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-01-31T05:05:03.560 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:03 smithi099 ceph-mon[31615]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-01-31T05:05:03.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:03 smithi181 ceph-mon[36434]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-01-31T05:05:05.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:05 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:05.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:05 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:05.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:05 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:05:05.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:05 smithi099 ceph-mon[31615]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-01-31T05:05:05.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:05 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:05.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:05 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:05.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:05 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:05:05.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:05 smithi181 ceph-mon[36434]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-01-31T05:05:05.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:05 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:05.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:05 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:05.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:05 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:05:05.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:05 smithi179 ceph-mon[35652]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-01-31T05:05:07.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:07 smithi099 ceph-mon[31615]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-01-31T05:05:07.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:07 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:07.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:07 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:07.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:07 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:05:07.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:07 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:05:07.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:07 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:07.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:07 smithi179 ceph-mon[35652]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-01-31T05:05:07.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:07 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:07.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:07 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:07.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:07 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:05:07.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:07 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:05:07.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:07 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:08.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:07 smithi181 ceph-mon[36434]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-01-31T05:05:08.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:07 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:08.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:07 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:08.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:07 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:05:08.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:07 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:05:08.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:07 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:08.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:05:08.267+0000 7f2088ff9700 1 -- 172.21.15.99:0/3052377802 <== mgr.14152 v2:172.21.15.99:6800/3925720924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f208c0fdef0 con 0x7f20740a12e0 2024-01-31T05:05:08.267 INFO:teuthology.orchestra.run.smithi099.stdout:Created osd(s) 3 on host 'smithi099' 2024-01-31T05:05:08.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:05:08.269+0000 7f2091ebd700 1 -- 172.21.15.99:0/3052377802 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f20740a12e0 msgr2=0x7f20740a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:08.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:05:08.270+0000 7f2091ebd700 1 --2- 172.21.15.99:0/3052377802 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f20740a12e0 0x7f20740a37a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f207c006010 tx=0x7f207c000bc0 comp rx=0 tx=0).stop 2024-01-31T05:05:08.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:05:08.270+0000 7f2091ebd700 1 -- 172.21.15.99:0/3052377802 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f208c101940 msgr2=0x7f208c197d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:08.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:05:08.270+0000 7f2091ebd700 1 --2- 172.21.15.99:0/3052377802 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f208c101940 0x7f208c197d10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f208000b560 tx=0x7f208000b870 comp rx=0 tx=0).stop 2024-01-31T05:05:08.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:05:08.270+0000 7f2091ebd700 1 -- 172.21.15.99:0/3052377802 shutdown_connections 2024-01-31T05:05:08.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:05:08.270+0000 7f2091ebd700 1 --2- 172.21.15.99:0/3052377802 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f208c1022e0 0x7f208c19ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:08.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:05:08.270+0000 7f2091ebd700 1 --2- 172.21.15.99:0/3052377802 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f20740a12e0 0x7f20740a37a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:08.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:05:08.270+0000 7f2091ebd700 1 --2- 172.21.15.99:0/3052377802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f208c100740 0x7f208c1977d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:08.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:05:08.270+0000 7f2091ebd700 1 --2- 172.21.15.99:0/3052377802 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f208c101940 0x7f208c197d10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:08.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:05:08.270+0000 7f2091ebd700 1 -- 172.21.15.99:0/3052377802 >> 172.21.15.99:0/3052377802 conn(0x7f208c0fbd00 msgr2=0x7f208c0fd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:08.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:05:08.270+0000 7f2091ebd700 1 -- 172.21.15.99:0/3052377802 shutdown_connections 2024-01-31T05:05:08.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:05:08.270+0000 7f2091ebd700 1 -- 172.21.15.99:0/3052377802 wait complete. 2024-01-31T05:05:08.973 DEBUG:teuthology.orchestra.run.smithi099:osd.3> sudo journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@osd.3.service 2024-01-31T05:05:08.976 INFO:tasks.cephadm:Deploying osd.4 on smithi179 with /dev/vg_nvme/lv_3... 2024-01-31T05:05:08.976 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-01-31T05:05:09.220 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.b/config 2024-01-31T05:05:09.342 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:09 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:09.342 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:09 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:09.342 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:09 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:05:09.342 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:09 smithi179 ceph-mon[35652]: from='osd.3 [v2:172.21.15.99:6810/4207675427,v1:172.21.15.99:6811/4207675427]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-01-31T05:05:09.342 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:09 smithi179 ceph-mon[35652]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-01-31T05:05:09.342 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:09 smithi179 ceph-mon[35652]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-01-31T05:05:09.548 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:09 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:09.548 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:09 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:09.548 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:09 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:05:09.548 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:09 smithi099 ceph-mon[31615]: from='osd.3 [v2:172.21.15.99:6810/4207675427,v1:172.21.15.99:6811/4207675427]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-01-31T05:05:09.548 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:09 smithi099 ceph-mon[31615]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-01-31T05:05:09.548 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:09 smithi099 ceph-mon[31615]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-01-31T05:05:09.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:09 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:09.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:09 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:09.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:09 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:05:09.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:09 smithi181 ceph-mon[36434]: from='osd.3 [v2:172.21.15.99:6810/4207675427,v1:172.21.15.99:6811/4207675427]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-01-31T05:05:09.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:09 smithi181 ceph-mon[36434]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-01-31T05:05:09.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:09 smithi181 ceph-mon[36434]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-01-31T05:05:10.496 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:10 smithi099 ceph-mon[31615]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-01-31T05:05:10.497 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:10 smithi099 ceph-mon[31615]: from='osd.3 [v2:172.21.15.99:6810/4207675427,v1:172.21.15.99:6811/4207675427]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-31T05:05:10.497 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:10 smithi099 ceph-mon[31615]: osdmap e23: 4 total, 3 up, 4 in 2024-01-31T05:05:10.497 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:10 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-31T05:05:10.497 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:10 smithi099 ceph-mon[31615]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-31T05:05:10.497 INFO:journalctl@ceph.osd.3.smithi099.stdout:Jan 31 05:05:10 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-3[53638]: 2024-01-31T05:05:10.258+0000 7fc2ded9d700 -1 osd.3 0 waiting for initial osdmap 2024-01-31T05:05:10.497 INFO:journalctl@ceph.osd.3.smithi099.stdout:Jan 31 05:05:10 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-3[53638]: 2024-01-31T05:05:10.263+0000 7fc2db398700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-31T05:05:10.531 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:10 smithi179 ceph-mon[35652]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-01-31T05:05:10.531 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:10 smithi179 ceph-mon[35652]: from='osd.3 [v2:172.21.15.99:6810/4207675427,v1:172.21.15.99:6811/4207675427]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-31T05:05:10.531 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:10 smithi179 ceph-mon[35652]: osdmap e23: 4 total, 3 up, 4 in 2024-01-31T05:05:10.531 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:10 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-31T05:05:10.532 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:10 smithi179 ceph-mon[35652]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-31T05:05:10.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:10 smithi181 ceph-mon[36434]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-01-31T05:05:10.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:10 smithi181 ceph-mon[36434]: from='osd.3 [v2:172.21.15.99:6810/4207675427,v1:172.21.15.99:6811/4207675427]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-31T05:05:10.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:10 smithi181 ceph-mon[36434]: osdmap e23: 4 total, 3 up, 4 in 2024-01-31T05:05:10.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:10 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-31T05:05:10.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:10 smithi181 ceph-mon[36434]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-31T05:05:11.070 INFO:teuthology.orchestra.run.smithi179.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-01-31T05:05:11.070 INFO:teuthology.orchestra.run.smithi179.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-01-31T05:05:11.070 INFO:teuthology.orchestra.run.smithi179.stderr: stderr: 10+0 records in 2024-01-31T05:05:11.070 INFO:teuthology.orchestra.run.smithi179.stderr:10+0 records out 2024-01-31T05:05:11.070 INFO:teuthology.orchestra.run.smithi179.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0112948 s, 928 MB/s 2024-01-31T05:05:11.070 INFO:teuthology.orchestra.run.smithi179.stderr:--> Zapping successful for: 2024-01-31T05:05:11.540 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:11 smithi179 ceph-mon[35652]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-01-31T05:05:11.540 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:11 smithi179 ceph-mon[35652]: osdmap e24: 4 total, 3 up, 4 in 2024-01-31T05:05:11.540 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:11 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-31T05:05:11.540 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:11 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-31T05:05:11.540 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:11 smithi179 ceph-mon[35652]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-01-31T05:05:11.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:11 smithi099 ceph-mon[31615]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-01-31T05:05:11.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:11 smithi099 ceph-mon[31615]: osdmap e24: 4 total, 3 up, 4 in 2024-01-31T05:05:11.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:11 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-31T05:05:11.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:11 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-31T05:05:11.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:11 smithi099 ceph-mon[31615]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-01-31T05:05:11.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:11 smithi181 ceph-mon[36434]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-01-31T05:05:11.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:11 smithi181 ceph-mon[36434]: osdmap e24: 4 total, 3 up, 4 in 2024-01-31T05:05:11.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:11 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-31T05:05:11.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:11 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-31T05:05:11.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:11 smithi181 ceph-mon[36434]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-01-31T05:05:11.765 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph orch daemon add osd smithi179:vg_nvme/lv_3 2024-01-31T05:05:12.006 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.b/config 2024-01-31T05:05:12.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:12 smithi179 ceph-mon[35652]: purged_snaps scrub starts 2024-01-31T05:05:12.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:12 smithi179 ceph-mon[35652]: purged_snaps scrub ok 2024-01-31T05:05:12.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:12 smithi179 ceph-mon[35652]: osd.3 [v2:172.21.15.99:6810/4207675427,v1:172.21.15.99:6811/4207675427] boot 2024-01-31T05:05:12.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:12 smithi179 ceph-mon[35652]: osdmap e25: 4 total, 4 up, 4 in 2024-01-31T05:05:12.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:12 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-31T05:05:12.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:12 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:12.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:12 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:12.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:12 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:05:12.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:12 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:05:12.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:12 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:12.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:12 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:05:12.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:12 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:05:12.384 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:12 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:12.384 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:12 smithi179 ceph-mon[35652]: osdmap e26: 4 total, 4 up, 4 in 2024-01-31T05:05:12.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:12 smithi099 ceph-mon[31615]: purged_snaps scrub starts 2024-01-31T05:05:12.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:12 smithi099 ceph-mon[31615]: purged_snaps scrub ok 2024-01-31T05:05:12.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:12 smithi099 ceph-mon[31615]: osd.3 [v2:172.21.15.99:6810/4207675427,v1:172.21.15.99:6811/4207675427] boot 2024-01-31T05:05:12.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:12 smithi099 ceph-mon[31615]: osdmap e25: 4 total, 4 up, 4 in 2024-01-31T05:05:12.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:12 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-31T05:05:12.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:12 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:12.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:12 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:12.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:12 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:05:12.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:12 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:05:12.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:12 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:12.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:12 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:05:12.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:12 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:05:12.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:12 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:12.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:12 smithi099 ceph-mon[31615]: osdmap e26: 4 total, 4 up, 4 in 2024-01-31T05:05:12.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:12 smithi181 ceph-mon[36434]: purged_snaps scrub starts 2024-01-31T05:05:12.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:12 smithi181 ceph-mon[36434]: purged_snaps scrub ok 2024-01-31T05:05:12.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:12 smithi181 ceph-mon[36434]: osd.3 [v2:172.21.15.99:6810/4207675427,v1:172.21.15.99:6811/4207675427] boot 2024-01-31T05:05:12.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:12 smithi181 ceph-mon[36434]: osdmap e25: 4 total, 4 up, 4 in 2024-01-31T05:05:12.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:12 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-31T05:05:12.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:12 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:12.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:12 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:12.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:12 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:05:12.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:12 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:05:12.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:12 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:12.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:12 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:05:12.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:12 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:05:12.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:12 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:12.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:12 smithi181 ceph-mon[36434]: osdmap e26: 4 total, 4 up, 4 in 2024-01-31T05:05:13.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:13 smithi179 ceph-mon[35652]: Detected new or changed devices on smithi099 2024-01-31T05:05:13.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:13 smithi179 ceph-mon[35652]: Adjusting osd_memory_target on smithi099 to 8544M 2024-01-31T05:05:13.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:13 smithi179 ceph-mon[35652]: pgmap v102: 1 pgs: 1 remapped+peering; 577 KiB data, 113 MiB used, 357 GiB / 358 GiB avail 2024-01-31T05:05:13.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:13 smithi179 ceph-mon[35652]: osdmap e27: 4 total, 4 up, 4 in 2024-01-31T05:05:13.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:13 smithi099 ceph-mon[31615]: Detected new or changed devices on smithi099 2024-01-31T05:05:13.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:13 smithi099 ceph-mon[31615]: Adjusting osd_memory_target on smithi099 to 8544M 2024-01-31T05:05:13.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:13 smithi099 ceph-mon[31615]: pgmap v102: 1 pgs: 1 remapped+peering; 577 KiB data, 113 MiB used, 357 GiB / 358 GiB avail 2024-01-31T05:05:13.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:13 smithi099 ceph-mon[31615]: osdmap e27: 4 total, 4 up, 4 in 2024-01-31T05:05:13.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:13 smithi181 ceph-mon[36434]: Detected new or changed devices on smithi099 2024-01-31T05:05:13.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:13 smithi181 ceph-mon[36434]: Adjusting osd_memory_target on smithi099 to 8544M 2024-01-31T05:05:13.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:13 smithi181 ceph-mon[36434]: pgmap v102: 1 pgs: 1 remapped+peering; 577 KiB data, 113 MiB used, 357 GiB / 358 GiB avail 2024-01-31T05:05:13.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:13 smithi181 ceph-mon[36434]: osdmap e27: 4 total, 4 up, 4 in 2024-01-31T05:05:13.673 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:13.671+0000 7f0c57c10700 1 -- 172.21.15.179:0/256085410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c50101910 msgr2=0x7f0c50101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:13.673 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:13.671+0000 7f0c57c10700 1 --2- 172.21.15.179:0/256085410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c50101910 0x7f0c50101d70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0c400099c0 tx=0x7f0c40009cd0 comp rx=0 tx=0).stop 2024-01-31T05:05:13.673 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:13.671+0000 7f0c57c10700 1 -- 172.21.15.179:0/256085410 shutdown_connections 2024-01-31T05:05:13.673 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:13.671+0000 7f0c57c10700 1 --2- 172.21.15.179:0/256085410 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0c501022b0 0x7f0c50108b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:13.673 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:13.671+0000 7f0c57c10700 1 --2- 172.21.15.179:0/256085410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c50100710 0x7f0c50100b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:13.674 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:13.671+0000 7f0c57c10700 1 --2- 172.21.15.179:0/256085410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c50101910 0x7f0c50101d70 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:13.674 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:13.671+0000 7f0c57c10700 1 -- 172.21.15.179:0/256085410 >> 172.21.15.179:0/256085410 conn(0x7f0c500fbcb0 msgr2=0x7f0c500fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:13.674 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:13.671+0000 7f0c57c10700 1 -- 172.21.15.179:0/256085410 shutdown_connections 2024-01-31T05:05:13.674 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:13.671+0000 7f0c57c10700 1 -- 172.21.15.179:0/256085410 wait complete. 2024-01-31T05:05:13.674 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:13.672+0000 7f0c57c10700 1 Processor -- start 2024-01-31T05:05:13.674 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:13.672+0000 7f0c57c10700 1 -- start start 2024-01-31T05:05:13.674 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:13.672+0000 7f0c57c10700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0c50100710 0x7f0c5006a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:13.674 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:13.672+0000 7f0c57c10700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c50101910 0x7f0c5019c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:13.674 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:13.672+0000 7f0c57c10700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c501022b0 0x7f0c5019eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:13.674 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:13.672+0000 7f0c57c10700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5019f260 con 0x7f0c50101910 2024-01-31T05:05:13.674 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:13.672+0000 7f0c57c10700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5019f3d0 con 0x7f0c501022b0 2024-01-31T05:05:13.674 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:13.672+0000 7f0c57c10700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5019f590 con 0x7f0c50100710 2024-01-31T05:05:13.674 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:13.672+0000 7f0c561ad700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c501022b0 0x7f0c5019eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:13.675 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:13.672+0000 7f0c561ad700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c501022b0 0x7f0c5019eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40206/0 (socket says 172.21.15.179:40206) 2024-01-31T05:05:13.675 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:13.672+0000 7f0c561ad700 1 -- 172.21.15.179:0/475209234 learned_addr learned my addr 172.21.15.179:0/475209234 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-01-31T05:05:13.675 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:13.672+0000 7f0c559ac700 1 --2- 172.21.15.179:0/475209234 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0c50100710 0x7f0c5006a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:13.675 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:13.672+0000 7f0c551ab700 1 --2- 172.21.15.179:0/475209234 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c50101910 0x7f0c5019c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:13.675 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:13.672+0000 7f0c561ad700 1 -- 172.21.15.179:0/475209234 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0c50100710 msgr2=0x7f0c5006a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:13.675 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:13.672+0000 7f0c561ad700 1 --2- 172.21.15.179:0/475209234 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0c50100710 0x7f0c5006a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:13.675 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:13.672+0000 7f0c561ad700 1 -- 172.21.15.179:0/475209234 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c50101910 msgr2=0x7f0c5019c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:13.675 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:13.672+0000 7f0c561ad700 1 --2- 172.21.15.179:0/475209234 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c50101910 0x7f0c5019c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:13.675 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:13.672+0000 7f0c561ad700 1 -- 172.21.15.179:0/475209234 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c400095f0 con 0x7f0c501022b0 2024-01-31T05:05:13.675 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:13.672+0000 7f0c559ac700 1 --2- 172.21.15.179:0/475209234 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0c50100710 0x7f0c5006a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:05:13.675 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:13.672+0000 7f0c561ad700 1 --2- 172.21.15.179:0/475209234 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c501022b0 0x7f0c5019eac0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0c4800b550 tx=0x7f0c4800b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:13.675 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:13.672+0000 7f0c46ffd700 1 -- 172.21.15.179:0/475209234 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c48011830 con 0x7f0c501022b0 2024-01-31T05:05:13.675 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:13.673+0000 7f0c46ffd700 1 -- 172.21.15.179:0/475209234 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0c48011e50 con 0x7f0c501022b0 2024-01-31T05:05:13.675 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:13.673+0000 7f0c57c10700 1 -- 172.21.15.179:0/475209234 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c50196260 con 0x7f0c501022b0 2024-01-31T05:05:13.676 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:13.673+0000 7f0c46ffd700 1 -- 172.21.15.179:0/475209234 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c48010e70 con 0x7f0c501022b0 2024-01-31T05:05:13.676 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:13.673+0000 7f0c57c10700 1 -- 172.21.15.179:0/475209234 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c50196760 con 0x7f0c501022b0 2024-01-31T05:05:13.676 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:13.674+0000 7f0c57c10700 1 -- 172.21.15.179:0/475209234 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c50107b40 con 0x7f0c501022b0 2024-01-31T05:05:13.677 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:13.675+0000 7f0c46ffd700 1 -- 172.21.15.179:0/475209234 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f0c48010510 con 0x7f0c501022b0 2024-01-31T05:05:13.677 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:13.675+0000 7f0c46ffd700 1 --2- 172.21.15.179:0/475209234 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f0c3c0a1370 0x7f0c3c0a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:13.677 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:13.676+0000 7f0c46ffd700 1 -- 172.21.15.179:0/475209234 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 3698+0+0 (secure 0 0 0) 0x7f0c480cba20 con 0x7f0c501022b0 2024-01-31T05:05:13.677 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:13.676+0000 7f0c559ac700 1 --2- 172.21.15.179:0/475209234 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f0c3c0a1370 0x7f0c3c0a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:13.677 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:13.676+0000 7f0c559ac700 1 --2- 172.21.15.179:0/475209234 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f0c3c0a1370 0x7f0c3c0a3830 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0c50101770 tx=0x7f0c4c007c20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:13.679 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:13.679+0000 7f0c46ffd700 1 -- 172.21.15.179:0/475209234 <== mon.2 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f0c48096000 con 0x7f0c501022b0 2024-01-31T05:05:13.874 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:13.875+0000 7f0c57c10700 1 -- 172.21.15.179:0/475209234 --> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c5002d4d0 con 0x7f0c3c0a1370 2024-01-31T05:05:14.545 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:14 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-31T05:05:14.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:14 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-31T05:05:14.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:14 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:05:14.546 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:14 smithi179 ceph-mon[35652]: osdmap e28: 4 total, 4 up, 4 in 2024-01-31T05:05:14.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:14 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-31T05:05:14.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:14 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-31T05:05:14.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:14 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:05:14.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:14 smithi099 ceph-mon[31615]: osdmap e28: 4 total, 4 up, 4 in 2024-01-31T05:05:14.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:14 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-31T05:05:14.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:14 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-31T05:05:14.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:14 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:05:14.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:14 smithi181 ceph-mon[36434]: osdmap e28: 4 total, 4 up, 4 in 2024-01-31T05:05:15.548 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:15 smithi179 ceph-mon[35652]: from='client.24203 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:05:15.548 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:15 smithi179 ceph-mon[35652]: pgmap v105: 1 pgs: 1 remapped+peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-01-31T05:05:15.548 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:15 smithi179 ceph-mon[35652]: osdmap e29: 4 total, 4 up, 4 in 2024-01-31T05:05:15.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:15 smithi099 ceph-mon[31615]: from='client.24203 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:05:15.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:15 smithi099 ceph-mon[31615]: pgmap v105: 1 pgs: 1 remapped+peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-01-31T05:05:15.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:15 smithi099 ceph-mon[31615]: osdmap e29: 4 total, 4 up, 4 in 2024-01-31T05:05:15.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:15 smithi181 ceph-mon[36434]: from='client.24203 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:05:15.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:15 smithi181 ceph-mon[36434]: pgmap v105: 1 pgs: 1 remapped+peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-01-31T05:05:15.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:15 smithi181 ceph-mon[36434]: osdmap e29: 4 total, 4 up, 4 in 2024-01-31T05:05:18.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:17 smithi099 ceph-mon[31615]: pgmap v107: 1 pgs: 1 remapped+peering; 577 KiB data, 113 MiB used, 357 GiB / 358 GiB avail 2024-01-31T05:05:18.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:17 smithi099 ceph-mon[31615]: from='client.? 172.21.15.179:0/1280557080' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0250d7ac-3894-457a-9c04-cc7205d61eca"}]: dispatch 2024-01-31T05:05:18.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:17 smithi099 ceph-mon[31615]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0250d7ac-3894-457a-9c04-cc7205d61eca"}]: dispatch 2024-01-31T05:05:18.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:17 smithi099 ceph-mon[31615]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0250d7ac-3894-457a-9c04-cc7205d61eca"}]': finished 2024-01-31T05:05:18.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:17 smithi099 ceph-mon[31615]: osdmap e30: 5 total, 4 up, 5 in 2024-01-31T05:05:18.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:17 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-31T05:05:18.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:17 smithi099 ceph-mon[31615]: from='client.? 172.21.15.179:0/2246802868' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-31T05:05:18.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:17 smithi181 ceph-mon[36434]: pgmap v107: 1 pgs: 1 remapped+peering; 577 KiB data, 113 MiB used, 357 GiB / 358 GiB avail 2024-01-31T05:05:18.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:17 smithi181 ceph-mon[36434]: from='client.? 172.21.15.179:0/1280557080' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0250d7ac-3894-457a-9c04-cc7205d61eca"}]: dispatch 2024-01-31T05:05:18.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:17 smithi181 ceph-mon[36434]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0250d7ac-3894-457a-9c04-cc7205d61eca"}]: dispatch 2024-01-31T05:05:18.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:17 smithi181 ceph-mon[36434]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0250d7ac-3894-457a-9c04-cc7205d61eca"}]': finished 2024-01-31T05:05:18.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:17 smithi181 ceph-mon[36434]: osdmap e30: 5 total, 4 up, 5 in 2024-01-31T05:05:18.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:17 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-31T05:05:18.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:17 smithi181 ceph-mon[36434]: from='client.? 172.21.15.179:0/2246802868' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-31T05:05:18.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:17 smithi179 ceph-mon[35652]: pgmap v107: 1 pgs: 1 remapped+peering; 577 KiB data, 113 MiB used, 357 GiB / 358 GiB avail 2024-01-31T05:05:18.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:17 smithi179 ceph-mon[35652]: from='client.? 172.21.15.179:0/1280557080' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0250d7ac-3894-457a-9c04-cc7205d61eca"}]: dispatch 2024-01-31T05:05:18.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:17 smithi179 ceph-mon[35652]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0250d7ac-3894-457a-9c04-cc7205d61eca"}]: dispatch 2024-01-31T05:05:18.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:17 smithi179 ceph-mon[35652]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0250d7ac-3894-457a-9c04-cc7205d61eca"}]': finished 2024-01-31T05:05:18.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:17 smithi179 ceph-mon[35652]: osdmap e30: 5 total, 4 up, 5 in 2024-01-31T05:05:18.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:17 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-31T05:05:18.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:17 smithi179 ceph-mon[35652]: from='client.? 172.21.15.179:0/2246802868' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-31T05:05:19.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:19 smithi179 ceph-mon[35652]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-01-31T05:05:20.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:19 smithi099 ceph-mon[31615]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-01-31T05:05:20.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:19 smithi181 ceph-mon[36434]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-01-31T05:05:21.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:21 smithi179 ceph-mon[35652]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-01-31T05:05:22.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:21 smithi099 ceph-mon[31615]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-01-31T05:05:22.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:21 smithi181 ceph-mon[36434]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-01-31T05:05:23.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:23 smithi179 ceph-mon[35652]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-01-31T05:05:23.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:23 smithi099 ceph-mon[31615]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-01-31T05:05:23.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:23 smithi181 ceph-mon[36434]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-01-31T05:05:24.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:24 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-01-31T05:05:24.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:24 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:05:24.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:24 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-01-31T05:05:24.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:24 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:05:24.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:24 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-01-31T05:05:24.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:24 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:05:25.333 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:25 smithi179 ceph-mon[35652]: Deploying daemon osd.4 on smithi179 2024-01-31T05:05:25.333 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:25 smithi179 ceph-mon[35652]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-01-31T05:05:25.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:25 smithi099 ceph-mon[31615]: Deploying daemon osd.4 on smithi179 2024-01-31T05:05:25.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:25 smithi099 ceph-mon[31615]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-01-31T05:05:25.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:25 smithi181 ceph-mon[36434]: Deploying daemon osd.4 on smithi179 2024-01-31T05:05:25.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:25 smithi181 ceph-mon[36434]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-01-31T05:05:27.867 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:27 smithi179 ceph-mon[35652]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-01-31T05:05:28.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:27 smithi099 ceph-mon[31615]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-01-31T05:05:28.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:27 smithi181 ceph-mon[36434]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-01-31T05:05:29.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:29 smithi179 ceph-mon[35652]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-01-31T05:05:30.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:29 smithi099 ceph-mon[31615]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-01-31T05:05:30.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:29 smithi181 ceph-mon[36434]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-01-31T05:05:31.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:30 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:31.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:30 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:05:31.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:30 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:31.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:30 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:31.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:30 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:05:31.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:30 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:31.098 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:30 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:31.099 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:30 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:05:31.099 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:30 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:31.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:31 smithi179 ceph-mon[35652]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-01-31T05:05:32.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:31 smithi099 ceph-mon[31615]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-01-31T05:05:32.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:31 smithi181 ceph-mon[36434]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-01-31T05:05:33.541 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:33.542+0000 7f0c46ffd700 1 -- 172.21.15.179:0/475209234 <== mgr.14152 v2:172.21.15.99:6800/3925720924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f0c5002d4d0 con 0x7f0c3c0a1370 2024-01-31T05:05:33.542 INFO:teuthology.orchestra.run.smithi179.stdout:Created osd(s) 4 on host 'smithi179' 2024-01-31T05:05:33.544 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:33.544+0000 7f0c57c10700 1 -- 172.21.15.179:0/475209234 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f0c3c0a1370 msgr2=0x7f0c3c0a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:33.544 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:33.544+0000 7f0c57c10700 1 --2- 172.21.15.179:0/475209234 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f0c3c0a1370 0x7f0c3c0a3830 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0c50101770 tx=0x7f0c4c007c20 comp rx=0 tx=0).stop 2024-01-31T05:05:33.544 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:33.544+0000 7f0c57c10700 1 -- 172.21.15.179:0/475209234 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c501022b0 msgr2=0x7f0c5019eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:33.544 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:33.544+0000 7f0c57c10700 1 --2- 172.21.15.179:0/475209234 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c501022b0 0x7f0c5019eac0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0c4800b550 tx=0x7f0c4800b910 comp rx=0 tx=0).stop 2024-01-31T05:05:33.544 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:33.544+0000 7f0c57c10700 1 -- 172.21.15.179:0/475209234 shutdown_connections 2024-01-31T05:05:33.544 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:33.544+0000 7f0c57c10700 1 --2- 172.21.15.179:0/475209234 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f0c3c0a1370 0x7f0c3c0a3830 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:33.544 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:33.544+0000 7f0c57c10700 1 --2- 172.21.15.179:0/475209234 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c501022b0 0x7f0c5019eac0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:33.544 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:33.544+0000 7f0c57c10700 1 --2- 172.21.15.179:0/475209234 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0c50100710 0x7f0c5006a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:33.545 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:33.544+0000 7f0c57c10700 1 --2- 172.21.15.179:0/475209234 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c50101910 0x7f0c5019c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:33.545 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:33.544+0000 7f0c57c10700 1 -- 172.21.15.179:0/475209234 >> 172.21.15.179:0/475209234 conn(0x7f0c500fbcb0 msgr2=0x7f0c50104c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:33.545 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:33.544+0000 7f0c57c10700 1 -- 172.21.15.179:0/475209234 shutdown_connections 2024-01-31T05:05:33.545 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:05:33.544+0000 7f0c57c10700 1 -- 172.21.15.179:0/475209234 wait complete. 2024-01-31T05:05:33.853 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:33 smithi179 ceph-mon[35652]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-01-31T05:05:33.853 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:33 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:33.853 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:33 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:33.854 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:33 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:05:33.854 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:33 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:05:33.854 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:33 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:33.854 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:33 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:33.854 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:33 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:33.854 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:33 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:05:34.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:33 smithi099 ceph-mon[31615]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-01-31T05:05:34.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:33 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:34.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:33 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:34.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:33 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:05:34.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:33 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:05:34.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:33 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:34.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:33 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:34.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:33 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:34.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:33 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:05:34.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:33 smithi181 ceph-mon[36434]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-01-31T05:05:34.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:33 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:34.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:33 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:34.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:33 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:05:34.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:33 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:05:34.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:33 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:34.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:33 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:34.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:33 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:34.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:33 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:05:34.198 DEBUG:teuthology.orchestra.run.smithi179:osd.4> sudo journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@osd.4.service 2024-01-31T05:05:34.200 INFO:tasks.cephadm:Deploying osd.5 on smithi181 with /dev/vg_nvme/lv_3... 2024-01-31T05:05:34.201 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-01-31T05:05:34.445 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.c/config 2024-01-31T05:05:34.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:34 smithi181 ceph-mon[36434]: from='osd.4 [v2:172.21.15.179:6808/2861083896,v1:172.21.15.179:6809/2861083896]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-01-31T05:05:34.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:34 smithi181 ceph-mon[36434]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-01-31T05:05:34.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:34 smithi179 ceph-mon[35652]: from='osd.4 [v2:172.21.15.179:6808/2861083896,v1:172.21.15.179:6809/2861083896]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-01-31T05:05:34.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:34 smithi179 ceph-mon[35652]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-01-31T05:05:35.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:34 smithi099 ceph-mon[31615]: from='osd.4 [v2:172.21.15.179:6808/2861083896,v1:172.21.15.179:6809/2861083896]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-01-31T05:05:35.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:34 smithi099 ceph-mon[31615]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-01-31T05:05:35.777 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:35 smithi181 ceph-mon[36434]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-01-31T05:05:35.777 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:35 smithi181 ceph-mon[36434]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-01-31T05:05:35.777 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:35 smithi181 ceph-mon[36434]: osdmap e31: 5 total, 4 up, 5 in 2024-01-31T05:05:35.777 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:35 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-31T05:05:35.777 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:35 smithi181 ceph-mon[36434]: from='osd.4 [v2:172.21.15.179:6808/2861083896,v1:172.21.15.179:6809/2861083896]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-01-31T05:05:35.778 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:35 smithi181 ceph-mon[36434]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-01-31T05:05:35.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:35 smithi179 ceph-mon[35652]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-01-31T05:05:35.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:35 smithi179 ceph-mon[35652]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-01-31T05:05:35.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:35 smithi179 ceph-mon[35652]: osdmap e31: 5 total, 4 up, 5 in 2024-01-31T05:05:35.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:35 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-31T05:05:35.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:35 smithi179 ceph-mon[35652]: from='osd.4 [v2:172.21.15.179:6808/2861083896,v1:172.21.15.179:6809/2861083896]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-01-31T05:05:35.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:35 smithi179 ceph-mon[35652]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-01-31T05:05:36.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:35 smithi099 ceph-mon[31615]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-01-31T05:05:36.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:35 smithi099 ceph-mon[31615]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-01-31T05:05:36.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:35 smithi099 ceph-mon[31615]: osdmap e31: 5 total, 4 up, 5 in 2024-01-31T05:05:36.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:35 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-31T05:05:36.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:35 smithi099 ceph-mon[31615]: from='osd.4 [v2:172.21.15.179:6808/2861083896,v1:172.21.15.179:6809/2861083896]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-01-31T05:05:36.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:35 smithi099 ceph-mon[31615]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-01-31T05:05:36.347 INFO:teuthology.orchestra.run.smithi181.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-01-31T05:05:36.348 INFO:teuthology.orchestra.run.smithi181.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-01-31T05:05:36.348 INFO:teuthology.orchestra.run.smithi181.stderr: stderr: 10+0 records in 2024-01-31T05:05:36.348 INFO:teuthology.orchestra.run.smithi181.stderr:10+0 records out 2024-01-31T05:05:36.348 INFO:teuthology.orchestra.run.smithi181.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114115 s, 919 MB/s 2024-01-31T05:05:36.348 INFO:teuthology.orchestra.run.smithi181.stderr:--> Zapping successful for: 2024-01-31T05:05:36.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:36 smithi179 ceph-mon[35652]: purged_snaps scrub starts 2024-01-31T05:05:36.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:36 smithi179 ceph-mon[35652]: purged_snaps scrub ok 2024-01-31T05:05:36.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:36 smithi179 ceph-mon[35652]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-01-31T05:05:36.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:36 smithi179 ceph-mon[35652]: osdmap e32: 5 total, 4 up, 5 in 2024-01-31T05:05:36.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:36 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-31T05:05:36.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:36 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-31T05:05:36.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:36 smithi179 ceph-mon[35652]: from='osd.4 ' entity='osd.4' 2024-01-31T05:05:36.883 INFO:journalctl@ceph.osd.4.smithi179.stdout:Jan 31 05:05:36 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-4[47113]: 2024-01-31T05:05:36.447+0000 7f870b1e3700 -1 osd.4 0 waiting for initial osdmap 2024-01-31T05:05:36.883 INFO:journalctl@ceph.osd.4.smithi179.stdout:Jan 31 05:05:36 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-4[47113]: 2024-01-31T05:05:36.459+0000 7f87037d6700 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-31T05:05:36.947 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:36 smithi181 ceph-mon[36434]: purged_snaps scrub starts 2024-01-31T05:05:36.948 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:36 smithi181 ceph-mon[36434]: purged_snaps scrub ok 2024-01-31T05:05:36.948 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:36 smithi181 ceph-mon[36434]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-01-31T05:05:36.948 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:36 smithi181 ceph-mon[36434]: osdmap e32: 5 total, 4 up, 5 in 2024-01-31T05:05:36.948 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:36 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-31T05:05:36.948 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:36 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-31T05:05:36.948 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:36 smithi181 ceph-mon[36434]: from='osd.4 ' entity='osd.4' 2024-01-31T05:05:36.974 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph orch daemon add osd smithi181:vg_nvme/lv_3 2024-01-31T05:05:37.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:36 smithi099 ceph-mon[31615]: purged_snaps scrub starts 2024-01-31T05:05:37.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:36 smithi099 ceph-mon[31615]: purged_snaps scrub ok 2024-01-31T05:05:37.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:36 smithi099 ceph-mon[31615]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-01-31T05:05:37.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:36 smithi099 ceph-mon[31615]: osdmap e32: 5 total, 4 up, 5 in 2024-01-31T05:05:37.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:36 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-31T05:05:37.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:36 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-31T05:05:37.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:36 smithi099 ceph-mon[31615]: from='osd.4 ' entity='osd.4' 2024-01-31T05:05:37.222 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.c/config 2024-01-31T05:05:37.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:37 smithi179 ceph-mon[35652]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-01-31T05:05:37.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:37 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-31T05:05:37.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:37 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:37.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:37 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:37.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:37 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:05:37.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:37 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:05:37.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:37 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:37.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:37 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:05:37.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:37 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:05:37.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:37 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:37.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:37 smithi179 ceph-mon[35652]: osd.4 [v2:172.21.15.179:6808/2861083896,v1:172.21.15.179:6809/2861083896] boot 2024-01-31T05:05:37.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:37 smithi179 ceph-mon[35652]: osdmap e33: 5 total, 5 up, 5 in 2024-01-31T05:05:37.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:37 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-31T05:05:37.929 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:37 smithi181 ceph-mon[36434]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-01-31T05:05:37.929 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:37 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-31T05:05:37.929 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:37 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:37.929 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:37 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:37.929 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:37 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:05:37.929 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:37 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:05:37.929 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:37 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:37.930 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:37 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:05:37.930 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:37 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:05:37.930 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:37 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:37.930 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:37 smithi181 ceph-mon[36434]: osd.4 [v2:172.21.15.179:6808/2861083896,v1:172.21.15.179:6809/2861083896] boot 2024-01-31T05:05:37.930 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:37 smithi181 ceph-mon[36434]: osdmap e33: 5 total, 5 up, 5 in 2024-01-31T05:05:37.930 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:37 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-31T05:05:38.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:37 smithi099 ceph-mon[31615]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-01-31T05:05:38.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:37 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-31T05:05:38.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:37 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:38.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:37 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:38.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:37 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:05:38.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:37 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:05:38.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:37 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:38.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:37 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:05:38.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:37 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:05:38.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:37 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:38.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:37 smithi099 ceph-mon[31615]: osd.4 [v2:172.21.15.179:6808/2861083896,v1:172.21.15.179:6809/2861083896] boot 2024-01-31T05:05:38.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:37 smithi099 ceph-mon[31615]: osdmap e33: 5 total, 5 up, 5 in 2024-01-31T05:05:38.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:37 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-31T05:05:38.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:38.727+0000 7fcc045a9700 1 -- 172.21.15.181:0/223627895 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbfc100ac0 msgr2=0x7fcbfc100f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:38.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:38.727+0000 7fcc045a9700 1 --2- 172.21.15.181:0/223627895 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbfc100ac0 0x7fcbfc100f40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcbec009990 tx=0x7fcbec009ca0 comp rx=0 tx=0).stop 2024-01-31T05:05:38.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:38.727+0000 7fcc045a9700 1 -- 172.21.15.181:0/223627895 shutdown_connections 2024-01-31T05:05:38.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:38.727+0000 7fcc045a9700 1 --2- 172.21.15.181:0/223627895 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcbfc101480 0x7fcbfc101900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:38.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:38.727+0000 7fcc045a9700 1 --2- 172.21.15.181:0/223627895 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbfc100160 0x7fcbfc100580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:38.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:38.727+0000 7fcc045a9700 1 --2- 172.21.15.181:0/223627895 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbfc100ac0 0x7fcbfc100f40 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:38.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:38.727+0000 7fcc045a9700 1 -- 172.21.15.181:0/223627895 >> 172.21.15.181:0/223627895 conn(0x7fcbfc0fbd40 msgr2=0x7fcbfc0fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:38.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:38.728+0000 7fcc045a9700 1 -- 172.21.15.181:0/223627895 shutdown_connections 2024-01-31T05:05:38.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:38.728+0000 7fcc045a9700 1 -- 172.21.15.181:0/223627895 wait complete. 2024-01-31T05:05:38.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:38.728+0000 7fcc045a9700 1 Processor -- start 2024-01-31T05:05:38.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:38.728+0000 7fcc045a9700 1 -- start start 2024-01-31T05:05:38.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:38.728+0000 7fcc045a9700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbfc100160 0x7fcbfc105ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:38.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:38.728+0000 7fcc045a9700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbfc100ac0 0x7fcbfc106220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:38.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:38.728+0000 7fcc045a9700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcbfc101480 0x7fcbfc102860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:38.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:38.728+0000 7fcc045a9700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc103000 con 0x7fcbfc101480 2024-01-31T05:05:38.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:38.728+0000 7fcc045a9700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc103170 con 0x7fcbfc100160 2024-01-31T05:05:38.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:38.728+0000 7fcc045a9700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc103330 con 0x7fcbfc100ac0 2024-01-31T05:05:38.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:38.728+0000 7fcc01b44700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbfc100ac0 0x7fcbfc106220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:38.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:38.728+0000 7fcc01b44700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbfc100ac0 0x7fcbfc106220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:52184/0 (socket says 172.21.15.181:52184) 2024-01-31T05:05:38.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:38.728+0000 7fcc01b44700 1 -- 172.21.15.181:0/3220745034 learned_addr learned my addr 172.21.15.181:0/3220745034 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-01-31T05:05:38.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:38.728+0000 7fcc02345700 1 --2- 172.21.15.181:0/3220745034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbfc100160 0x7fcbfc105ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:38.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:38.729+0000 7fcc01b44700 1 -- 172.21.15.181:0/3220745034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbfc100160 msgr2=0x7fcbfc105ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:38.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:38.729+0000 7fcc01b44700 1 --2- 172.21.15.181:0/3220745034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbfc100160 0x7fcbfc105ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:38.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:38.729+0000 7fcc01b44700 1 -- 172.21.15.181:0/3220745034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcbfc101480 msgr2=0x7fcbfc102860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:38.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:38.729+0000 7fcc01b44700 1 --2- 172.21.15.181:0/3220745034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcbfc101480 0x7fcbfc102860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:38.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:38.729+0000 7fcc01b44700 1 -- 172.21.15.181:0/3220745034 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbec0095f0 con 0x7fcbfc100ac0 2024-01-31T05:05:38.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:38.729+0000 7fcc01b44700 1 --2- 172.21.15.181:0/3220745034 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbfc100ac0 0x7fcbfc106220 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcbec0036f0 tx=0x7fcbec00f7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:38.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:38.729+0000 7fcbf37fe700 1 -- 172.21.15.181:0/3220745034 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbec01d070 con 0x7fcbfc100ac0 2024-01-31T05:05:38.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:38.729+0000 7fcbf37fe700 1 -- 172.21.15.181:0/3220745034 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcbec00fcc0 con 0x7fcbfc100ac0 2024-01-31T05:05:38.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:38.729+0000 7fcc045a9700 1 -- 172.21.15.181:0/3220745034 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbfc1a5e70 con 0x7fcbfc100ac0 2024-01-31T05:05:38.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:38.729+0000 7fcbf37fe700 1 -- 172.21.15.181:0/3220745034 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbec017720 con 0x7fcbfc100ac0 2024-01-31T05:05:38.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:38.729+0000 7fcc045a9700 1 -- 172.21.15.181:0/3220745034 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbfc1a62a0 con 0x7fcbfc100ac0 2024-01-31T05:05:38.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:38.730+0000 7fcc045a9700 1 -- 172.21.15.181:0/3220745034 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbfc10af40 con 0x7fcbfc100ac0 2024-01-31T05:05:38.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:38.731+0000 7fcbf37fe700 1 -- 172.21.15.181:0/3220745034 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7fcbec003960 con 0x7fcbfc100ac0 2024-01-31T05:05:38.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:38.731+0000 7fcbf37fe700 1 --2- 172.21.15.181:0/3220745034 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fcbe80a13f0 0x7fcbe80a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:05:38.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:38.732+0000 7fcbf37fe700 1 -- 172.21.15.181:0/3220745034 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4101+0+0 (secure 0 0 0) 0x7fcbec0ccef0 con 0x7fcbfc100ac0 2024-01-31T05:05:38.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:38.732+0000 7fcc02345700 1 --2- 172.21.15.181:0/3220745034 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fcbe80a13f0 0x7fcbe80a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:05:38.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:38.732+0000 7fcc02345700 1 --2- 172.21.15.181:0/3220745034 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fcbe80a13f0 0x7fcbe80a38b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8005950 tx=0x7fcbf800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:05:38.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:38.735+0000 7fcbf37fe700 1 -- 172.21.15.181:0/3220745034 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fcbec05d600 con 0x7fcbfc100ac0 2024-01-31T05:05:38.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:38 smithi181 ceph-mon[36434]: Detected new or changed devices on smithi179 2024-01-31T05:05:38.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:38 smithi181 ceph-mon[36434]: Adjusting osd_memory_target on smithi179 to 8540M 2024-01-31T05:05:38.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:38 smithi179 ceph-mon[35652]: Detected new or changed devices on smithi179 2024-01-31T05:05:38.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:38 smithi179 ceph-mon[35652]: Adjusting osd_memory_target on smithi179 to 8540M 2024-01-31T05:05:38.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:38.933+0000 7fcc045a9700 1 -- 172.21.15.181:0/3220745034 --> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fcbfc02d680 con 0x7fcbe80a13f0 2024-01-31T05:05:39.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:38 smithi099 ceph-mon[31615]: Detected new or changed devices on smithi179 2024-01-31T05:05:39.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:38 smithi099 ceph-mon[31615]: Adjusting osd_memory_target on smithi179 to 8540M 2024-01-31T05:05:39.811 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:39 smithi181 ceph-mon[36434]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-01-31T05:05:39.811 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:39 smithi181 ceph-mon[36434]: osdmap e34: 5 total, 5 up, 5 in 2024-01-31T05:05:39.811 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:39 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-31T05:05:39.811 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:39 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-31T05:05:39.811 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:39 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:05:39.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:39 smithi179 ceph-mon[35652]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-01-31T05:05:39.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:39 smithi179 ceph-mon[35652]: osdmap e34: 5 total, 5 up, 5 in 2024-01-31T05:05:39.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:39 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-31T05:05:39.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:39 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-31T05:05:39.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:39 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:05:40.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:39 smithi099 ceph-mon[31615]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-01-31T05:05:40.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:39 smithi099 ceph-mon[31615]: osdmap e34: 5 total, 5 up, 5 in 2024-01-31T05:05:40.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:39 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-31T05:05:40.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:39 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-31T05:05:40.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:39 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:05:40.689 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:40 smithi181 ceph-mon[36434]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:05:41.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:40 smithi099 ceph-mon[31615]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:05:41.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:40 smithi179 ceph-mon[35652]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:05:42.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:41 smithi099 ceph-mon[31615]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-01-31T05:05:42.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:41 smithi099 ceph-mon[31615]: from='client.? 172.21.15.181:0/364067090' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5e19222a-c2a4-45bc-8445-1d302f26d11c"}]: dispatch 2024-01-31T05:05:42.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:41 smithi099 ceph-mon[31615]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5e19222a-c2a4-45bc-8445-1d302f26d11c"}]: dispatch 2024-01-31T05:05:42.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:41 smithi099 ceph-mon[31615]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5e19222a-c2a4-45bc-8445-1d302f26d11c"}]': finished 2024-01-31T05:05:42.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:41 smithi099 ceph-mon[31615]: osdmap e35: 6 total, 5 up, 6 in 2024-01-31T05:05:42.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:41 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-31T05:05:42.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:41 smithi181 ceph-mon[36434]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-01-31T05:05:42.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:41 smithi181 ceph-mon[36434]: from='client.? 172.21.15.181:0/364067090' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5e19222a-c2a4-45bc-8445-1d302f26d11c"}]: dispatch 2024-01-31T05:05:42.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:41 smithi181 ceph-mon[36434]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5e19222a-c2a4-45bc-8445-1d302f26d11c"}]: dispatch 2024-01-31T05:05:42.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:41 smithi181 ceph-mon[36434]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5e19222a-c2a4-45bc-8445-1d302f26d11c"}]': finished 2024-01-31T05:05:42.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:41 smithi181 ceph-mon[36434]: osdmap e35: 6 total, 5 up, 6 in 2024-01-31T05:05:42.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:41 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-31T05:05:42.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:41 smithi179 ceph-mon[35652]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-01-31T05:05:42.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:41 smithi179 ceph-mon[35652]: from='client.? 172.21.15.181:0/364067090' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5e19222a-c2a4-45bc-8445-1d302f26d11c"}]: dispatch 2024-01-31T05:05:42.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:41 smithi179 ceph-mon[35652]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5e19222a-c2a4-45bc-8445-1d302f26d11c"}]: dispatch 2024-01-31T05:05:42.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:41 smithi179 ceph-mon[35652]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5e19222a-c2a4-45bc-8445-1d302f26d11c"}]': finished 2024-01-31T05:05:42.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:41 smithi179 ceph-mon[35652]: osdmap e35: 6 total, 5 up, 6 in 2024-01-31T05:05:42.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:41 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-31T05:05:43.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:43 smithi179 ceph-mon[35652]: from='client.? 172.21.15.181:0/817346214' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-31T05:05:43.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:43 smithi179 ceph-mon[35652]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-01-31T05:05:43.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:43 smithi099 ceph-mon[31615]: from='client.? 172.21.15.181:0/817346214' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-31T05:05:43.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:43 smithi099 ceph-mon[31615]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-01-31T05:05:43.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:43 smithi181 ceph-mon[36434]: from='client.? 172.21.15.181:0/817346214' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-31T05:05:43.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:43 smithi181 ceph-mon[36434]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-01-31T05:05:45.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:45 smithi181 ceph-mon[36434]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-01-31T05:05:45.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:45 smithi179 ceph-mon[35652]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-01-31T05:05:46.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:45 smithi099 ceph-mon[31615]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-01-31T05:05:47.857 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:47 smithi181 ceph-mon[36434]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-01-31T05:05:47.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:47 smithi179 ceph-mon[35652]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-01-31T05:05:48.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:47 smithi099 ceph-mon[31615]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-01-31T05:05:49.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:49 smithi181 ceph-mon[36434]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-01-31T05:05:49.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:49 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-01-31T05:05:49.796 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:49 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:05:49.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:49 smithi179 ceph-mon[35652]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-01-31T05:05:49.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:49 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-01-31T05:05:49.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:49 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:05:50.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:49 smithi099 ceph-mon[31615]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-01-31T05:05:50.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:49 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-01-31T05:05:50.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:49 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:05:50.700 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:50 smithi181 ceph-mon[36434]: Deploying daemon osd.5 on smithi181 2024-01-31T05:05:50.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:50 smithi179 ceph-mon[35652]: Deploying daemon osd.5 on smithi181 2024-01-31T05:05:51.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:50 smithi099 ceph-mon[31615]: Deploying daemon osd.5 on smithi181 2024-01-31T05:05:51.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:51 smithi179 ceph-mon[35652]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-01-31T05:05:52.003 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:51 smithi181 ceph-mon[36434]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-01-31T05:05:52.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:51 smithi099 ceph-mon[31615]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-01-31T05:05:53.181 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:53 smithi181 ceph-mon[36434]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-01-31T05:05:53.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:53 smithi179 ceph-mon[35652]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-01-31T05:05:53.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:53 smithi099 ceph-mon[31615]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-01-31T05:05:55.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:54 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:55.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:54 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:55.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:54 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:05:55.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:54 smithi099 ceph-mon[31615]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-01-31T05:05:55.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:54 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:55.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:54 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:55.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:54 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:05:55.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:54 smithi181 ceph-mon[36434]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-01-31T05:05:55.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:54 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:55.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:54 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:55.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:54 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:05:55.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:54 smithi179 ceph-mon[35652]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-01-31T05:05:57.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:57.100+0000 7fcbf37fe700 1 -- 172.21.15.181:0/3220745034 <== mgr.14152 v2:172.21.15.99:6800/3925720924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fcbfc02d680 con 0x7fcbe80a13f0 2024-01-31T05:05:57.101 INFO:teuthology.orchestra.run.smithi181.stdout:Created osd(s) 5 on host 'smithi181' 2024-01-31T05:05:57.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:57.103+0000 7fcc045a9700 1 -- 172.21.15.181:0/3220745034 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fcbe80a13f0 msgr2=0x7fcbe80a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:57.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:57.103+0000 7fcc045a9700 1 --2- 172.21.15.181:0/3220745034 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fcbe80a13f0 0x7fcbe80a38b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8005950 tx=0x7fcbf800a300 comp rx=0 tx=0).stop 2024-01-31T05:05:57.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:57.103+0000 7fcc045a9700 1 -- 172.21.15.181:0/3220745034 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbfc100ac0 msgr2=0x7fcbfc106220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:05:57.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:57.103+0000 7fcc045a9700 1 --2- 172.21.15.181:0/3220745034 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbfc100ac0 0x7fcbfc106220 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcbec0036f0 tx=0x7fcbec00f7d0 comp rx=0 tx=0).stop 2024-01-31T05:05:57.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:57.103+0000 7fcc045a9700 1 -- 172.21.15.181:0/3220745034 shutdown_connections 2024-01-31T05:05:57.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:57.103+0000 7fcc045a9700 1 --2- 172.21.15.181:0/3220745034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcbfc101480 0x7fcbfc102860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:57.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:57.103+0000 7fcc045a9700 1 --2- 172.21.15.181:0/3220745034 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fcbe80a13f0 0x7fcbe80a38b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:57.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:57.103+0000 7fcc045a9700 1 --2- 172.21.15.181:0/3220745034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbfc100160 0x7fcbfc105ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:57.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:57.103+0000 7fcc045a9700 1 --2- 172.21.15.181:0/3220745034 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbfc100ac0 0x7fcbfc106220 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:05:57.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:57.103+0000 7fcc045a9700 1 -- 172.21.15.181:0/3220745034 >> 172.21.15.181:0/3220745034 conn(0x7fcbfc0fbd40 msgr2=0x7fcbfc0fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:05:57.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:57.103+0000 7fcc045a9700 1 -- 172.21.15.181:0/3220745034 shutdown_connections 2024-01-31T05:05:57.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:05:57.103+0000 7fcc045a9700 1 -- 172.21.15.181:0/3220745034 wait complete. 2024-01-31T05:05:57.695 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:57 smithi181 ceph-mon[36434]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-01-31T05:05:57.695 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:57 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:57.695 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:57 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:57.722 DEBUG:teuthology.orchestra.run.smithi181:osd.5> sudo journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@osd.5.service 2024-01-31T05:05:57.724 INFO:tasks.cephadm:Deploying osd.6 on smithi099 with /dev/vg_nvme/lv_2... 2024-01-31T05:05:57.724 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-01-31T05:05:57.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:57 smithi179 ceph-mon[35652]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-01-31T05:05:57.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:57 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:57.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:57 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:57.973 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:05:58.021 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:57 smithi099 ceph-mon[31615]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-01-31T05:05:58.021 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:57 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:58.021 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:57 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:58.071 INFO:journalctl@ceph.osd.5.smithi181.stdout:Jan 31 05:05:57 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-5[48622]: 2024-01-31T05:05:57.870+0000 7fe4ce33c7c0 -1 osd.5 0 log_to_monitors true 2024-01-31T05:05:58.790 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:58 smithi181 ceph-mon[36434]: from='osd.5 [v2:172.21.15.181:6808/1485017095,v1:172.21.15.181:6809/1485017095]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-01-31T05:05:58.790 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:58 smithi181 ceph-mon[36434]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-01-31T05:05:58.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:58 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:58.791 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:58 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:58.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:58 smithi179 ceph-mon[35652]: from='osd.5 [v2:172.21.15.181:6808/1485017095,v1:172.21.15.181:6809/1485017095]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-01-31T05:05:58.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:58 smithi179 ceph-mon[35652]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-01-31T05:05:58.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:58 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:58.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:58 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:59.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:58 smithi099 ceph-mon[31615]: from='osd.5 [v2:172.21.15.181:6808/1485017095,v1:172.21.15.181:6809/1485017095]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-01-31T05:05:59.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:58 smithi099 ceph-mon[31615]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-01-31T05:05:59.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:58 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:59.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:58 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:05:59.713 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:59 smithi181 ceph-mon[36434]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-01-31T05:05:59.713 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:59 smithi181 ceph-mon[36434]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-01-31T05:05:59.713 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:59 smithi181 ceph-mon[36434]: osdmap e36: 6 total, 5 up, 6 in 2024-01-31T05:05:59.713 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:59 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-31T05:05:59.713 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:59 smithi181 ceph-mon[36434]: from='osd.5 [v2:172.21.15.181:6808/1485017095,v1:172.21.15.181:6809/1485017095]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-01-31T05:05:59.713 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:05:59 smithi181 ceph-mon[36434]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-01-31T05:05:59.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:59 smithi099 ceph-mon[31615]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-01-31T05:05:59.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:59 smithi099 ceph-mon[31615]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-01-31T05:05:59.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:59 smithi099 ceph-mon[31615]: osdmap e36: 6 total, 5 up, 6 in 2024-01-31T05:05:59.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:59 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-31T05:05:59.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:59 smithi099 ceph-mon[31615]: from='osd.5 [v2:172.21.15.181:6808/1485017095,v1:172.21.15.181:6809/1485017095]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-01-31T05:05:59.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:05:59 smithi099 ceph-mon[31615]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-01-31T05:05:59.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:59 smithi179 ceph-mon[35652]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-01-31T05:05:59.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:59 smithi179 ceph-mon[35652]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-01-31T05:05:59.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:59 smithi179 ceph-mon[35652]: osdmap e36: 6 total, 5 up, 6 in 2024-01-31T05:05:59.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:59 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-31T05:05:59.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:59 smithi179 ceph-mon[35652]: from='osd.5 [v2:172.21.15.181:6808/1485017095,v1:172.21.15.181:6809/1485017095]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-01-31T05:05:59.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:05:59 smithi179 ceph-mon[35652]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-01-31T05:06:00.020 INFO:teuthology.orchestra.run.smithi099.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-01-31T05:06:00.020 INFO:teuthology.orchestra.run.smithi099.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-01-31T05:06:00.020 INFO:teuthology.orchestra.run.smithi099.stderr: stderr: 10+0 records in 2024-01-31T05:06:00.020 INFO:teuthology.orchestra.run.smithi099.stderr:10+0 records out 2024-01-31T05:06:00.020 INFO:teuthology.orchestra.run.smithi099.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0151685 s, 691 MB/s 2024-01-31T05:06:00.020 INFO:teuthology.orchestra.run.smithi099.stderr:--> Zapping successful for: 2024-01-31T05:06:00.685 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph orch daemon add osd smithi099:vg_nvme/lv_2 2024-01-31T05:06:00.734 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:00 smithi181 ceph-mon[36434]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-01-31T05:06:00.734 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:00 smithi181 ceph-mon[36434]: osdmap e37: 6 total, 5 up, 6 in 2024-01-31T05:06:00.734 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:00 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-31T05:06:00.734 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:00 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-31T05:06:00.734 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:00 smithi181 ceph-mon[36434]: from='osd.5 ' entity='osd.5' 2024-01-31T05:06:00.734 INFO:journalctl@ceph.osd.5.smithi181.stdout:Jan 31 05:06:00 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-5[48622]: 2024-01-31T05:06:00.469+0000 7fe4c31a1700 -1 osd.5 0 waiting for initial osdmap 2024-01-31T05:06:00.734 INFO:journalctl@ceph.osd.5.smithi181.stdout:Jan 31 05:06:00 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-5[48622]: 2024-01-31T05:06:00.482+0000 7fe4bb794700 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-31T05:06:00.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:00 smithi179 ceph-mon[35652]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-01-31T05:06:00.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:00 smithi179 ceph-mon[35652]: osdmap e37: 6 total, 5 up, 6 in 2024-01-31T05:06:00.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:00 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-31T05:06:00.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:00 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-31T05:06:00.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:00 smithi179 ceph-mon[35652]: from='osd.5 ' entity='osd.5' 2024-01-31T05:06:00.922 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:06:01.040 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:00 smithi099 ceph-mon[31615]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-01-31T05:06:01.040 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:00 smithi099 ceph-mon[31615]: osdmap e37: 6 total, 5 up, 6 in 2024-01-31T05:06:01.040 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:00 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-31T05:06:01.041 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:00 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-31T05:06:01.041 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:00 smithi099 ceph-mon[31615]: from='osd.5 ' entity='osd.5' 2024-01-31T05:06:01.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:01 smithi181 ceph-mon[36434]: purged_snaps scrub starts 2024-01-31T05:06:01.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:01 smithi181 ceph-mon[36434]: purged_snaps scrub ok 2024-01-31T05:06:01.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:01 smithi181 ceph-mon[36434]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-01-31T05:06:01.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:01 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-31T05:06:01.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:01 smithi181 ceph-mon[36434]: osd.5 [v2:172.21.15.181:6808/1485017095,v1:172.21.15.181:6809/1485017095] boot 2024-01-31T05:06:01.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:01 smithi181 ceph-mon[36434]: osdmap e38: 6 total, 6 up, 6 in 2024-01-31T05:06:01.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:01 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-31T05:06:01.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:01 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:01.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:01 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:01.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:01 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:06:01.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:01 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:06:01.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:01 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:01.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:01 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:06:01.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:01 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:06:01.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:01 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:01.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:01 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:06:01.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:01 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:06:01.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:01 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:06:01.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:01 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:01.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:01 smithi179 ceph-mon[35652]: purged_snaps scrub starts 2024-01-31T05:06:01.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:01 smithi179 ceph-mon[35652]: purged_snaps scrub ok 2024-01-31T05:06:01.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:01 smithi179 ceph-mon[35652]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-01-31T05:06:01.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:01 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-31T05:06:01.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:01 smithi179 ceph-mon[35652]: osd.5 [v2:172.21.15.181:6808/1485017095,v1:172.21.15.181:6809/1485017095] boot 2024-01-31T05:06:01.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:01 smithi179 ceph-mon[35652]: osdmap e38: 6 total, 6 up, 6 in 2024-01-31T05:06:01.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:01 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-31T05:06:01.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:01 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:01.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:01 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:01.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:01 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:06:01.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:01 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:06:01.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:01 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:01.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:01 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:06:01.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:01 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:06:01.884 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:01 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:01.884 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:01 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:06:01.884 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:01 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:06:01.884 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:01 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:06:01.884 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:01 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:02.014 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:01 smithi099 ceph-mon[31615]: purged_snaps scrub starts 2024-01-31T05:06:02.014 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:01 smithi099 ceph-mon[31615]: purged_snaps scrub ok 2024-01-31T05:06:02.014 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:01 smithi099 ceph-mon[31615]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-01-31T05:06:02.014 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:01 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-31T05:06:02.014 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:01 smithi099 ceph-mon[31615]: osd.5 [v2:172.21.15.181:6808/1485017095,v1:172.21.15.181:6809/1485017095] boot 2024-01-31T05:06:02.014 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:01 smithi099 ceph-mon[31615]: osdmap e38: 6 total, 6 up, 6 in 2024-01-31T05:06:02.014 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:01 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-31T05:06:02.014 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:01 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:02.014 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:01 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:02.014 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:01 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:06:02.015 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:01 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:06:02.015 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:01 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:02.015 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:01 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:06:02.015 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:01 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:06:02.015 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:01 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:02.015 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:01 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:06:02.015 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:01 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:06:02.015 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:01 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:06:02.015 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:01 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:02.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:02.553+0000 7fdd2f3b2700 1 -- 172.21.15.99:0/4008443605 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd280ff890 msgr2=0x7fdd280ffd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:06:02.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:02.553+0000 7fdd2f3b2700 1 --2- 172.21.15.99:0/4008443605 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd280ff890 0x7fdd280ffd10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdd18009990 tx=0x7fdd18009ca0 comp rx=0 tx=0).stop 2024-01-31T05:06:02.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:02.553+0000 7fdd2f3b2700 1 -- 172.21.15.99:0/4008443605 shutdown_connections 2024-01-31T05:06:02.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:02.553+0000 7fdd2f3b2700 1 --2- 172.21.15.99:0/4008443605 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdd28100250 0x7fdd28109e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:06:02.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:02.553+0000 7fdd2f3b2700 1 --2- 172.21.15.99:0/4008443605 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd28102e10 0x7fdd28103230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:06:02.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:02.553+0000 7fdd2f3b2700 1 --2- 172.21.15.99:0/4008443605 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd280ff890 0x7fdd280ffd10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:06:02.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:02.553+0000 7fdd2f3b2700 1 -- 172.21.15.99:0/4008443605 >> 172.21.15.99:0/4008443605 conn(0x7fdd280fb450 msgr2=0x7fdd280fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:06:02.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:02.553+0000 7fdd2f3b2700 1 -- 172.21.15.99:0/4008443605 shutdown_connections 2024-01-31T05:06:02.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:02.553+0000 7fdd2f3b2700 1 -- 172.21.15.99:0/4008443605 wait complete. 2024-01-31T05:06:02.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:02.554+0000 7fdd2f3b2700 1 Processor -- start 2024-01-31T05:06:02.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:02.554+0000 7fdd2f3b2700 1 -- start start 2024-01-31T05:06:02.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:02.554+0000 7fdd2f3b2700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd280ff890 0x7fdd28102510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:06:02.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:02.554+0000 7fdd2f3b2700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd28100250 0x7fdd28100b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:06:02.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:02.554+0000 7fdd2f3b2700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdd28102e10 0x7fdd281010a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:06:02.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:02.554+0000 7fdd2f3b2700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd28101820 con 0x7fdd280ff890 2024-01-31T05:06:02.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:02.554+0000 7fdd2f3b2700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd28101990 con 0x7fdd28100250 2024-01-31T05:06:02.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:02.554+0000 7fdd2f3b2700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd281a1760 con 0x7fdd28102e10 2024-01-31T05:06:02.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:02.554+0000 7fdd2d14e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd280ff890 0x7fdd28102510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:06:02.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:02.554+0000 7fdd2d14e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd280ff890 0x7fdd28102510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51640/0 (socket says 172.21.15.99:51640) 2024-01-31T05:06:02.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:02.554+0000 7fdd2d14e700 1 -- 172.21.15.99:0/740853857 learned_addr learned my addr 172.21.15.99:0/740853857 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:06:02.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:02.554+0000 7fdd2c94d700 1 --2- 172.21.15.99:0/740853857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd28100250 0x7fdd28100b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:06:02.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:02.554+0000 7fdd2d94f700 1 --2- 172.21.15.99:0/740853857 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdd28102e10 0x7fdd281010a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:06:02.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:02.554+0000 7fdd2d14e700 1 -- 172.21.15.99:0/740853857 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdd28102e10 msgr2=0x7fdd281010a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:06:02.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:02.554+0000 7fdd2d14e700 1 --2- 172.21.15.99:0/740853857 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdd28102e10 0x7fdd281010a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:06:02.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:02.554+0000 7fdd2d14e700 1 -- 172.21.15.99:0/740853857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd28100250 msgr2=0x7fdd28100b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:06:02.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:02.554+0000 7fdd2d14e700 1 --2- 172.21.15.99:0/740853857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd28100250 0x7fdd28100b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:06:02.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:02.555+0000 7fdd2d14e700 1 -- 172.21.15.99:0/740853857 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd180095f0 con 0x7fdd280ff890 2024-01-31T05:06:02.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:02.555+0000 7fdd2d14e700 1 --2- 172.21.15.99:0/740853857 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd280ff890 0x7fdd28102510 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdd2400c970 tx=0x7fdd2400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:06:02.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:02.555+0000 7fdd1e7fc700 1 -- 172.21.15.99:0/740853857 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd24004220 con 0x7fdd280ff890 2024-01-31T05:06:02.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:02.555+0000 7fdd1e7fc700 1 -- 172.21.15.99:0/740853857 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdd24004380 con 0x7fdd280ff890 2024-01-31T05:06:02.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:02.555+0000 7fdd1e7fc700 1 -- 172.21.15.99:0/740853857 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd24003b50 con 0x7fdd280ff890 2024-01-31T05:06:02.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:02.555+0000 7fdd2f3b2700 1 -- 172.21.15.99:0/740853857 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd281a1a40 con 0x7fdd280ff890 2024-01-31T05:06:02.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:02.555+0000 7fdd2f3b2700 1 -- 172.21.15.99:0/740853857 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd281a1ef0 con 0x7fdd280ff890 2024-01-31T05:06:02.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:02.556+0000 7fdd2f3b2700 1 -- 172.21.15.99:0/740853857 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd28108e90 con 0x7fdd280ff890 2024-01-31T05:06:02.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:02.557+0000 7fdd1e7fc700 1 -- 172.21.15.99:0/740853857 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7fdd24003cf0 con 0x7fdd280ff890 2024-01-31T05:06:02.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:02.557+0000 7fdd1e7fc700 1 --2- 172.21.15.99:0/740853857 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fdd140a13f0 0x7fdd140a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:06:02.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:02.557+0000 7fdd2c94d700 1 --2- 172.21.15.99:0/740853857 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fdd140a13f0 0x7fdd140a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:06:02.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:02.558+0000 7fdd1e7fc700 1 -- 172.21.15.99:0/740853857 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4562+0+0 (secure 0 0 0) 0x7fdd240cb6b0 con 0x7fdd280ff890 2024-01-31T05:06:02.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:02.558+0000 7fdd2c94d700 1 --2- 172.21.15.99:0/740853857 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fdd140a13f0 0x7fdd140a38b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdd1800b5c0 tx=0x7fdd18003790 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:06:02.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:02.562+0000 7fdd1e7fc700 1 -- 172.21.15.99:0/740853857 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fdd240959d0 con 0x7fdd280ff890 2024-01-31T05:06:02.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:02.764+0000 7fdd2f3b2700 1 -- 172.21.15.99:0/740853857 --> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fdd2802d540 con 0x7fdd140a13f0 2024-01-31T05:06:02.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:02 smithi179 ceph-mon[35652]: Detected new or changed devices on smithi181 2024-01-31T05:06:02.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:02 smithi179 ceph-mon[35652]: Adjusting osd_memory_target on smithi181 to 8540M 2024-01-31T05:06:02.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:02 smithi179 ceph-mon[35652]: osdmap e39: 6 total, 6 up, 6 in 2024-01-31T05:06:03.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:02 smithi099 ceph-mon[31615]: Detected new or changed devices on smithi181 2024-01-31T05:06:03.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:02 smithi099 ceph-mon[31615]: Adjusting osd_memory_target on smithi181 to 8540M 2024-01-31T05:06:03.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:02 smithi099 ceph-mon[31615]: osdmap e39: 6 total, 6 up, 6 in 2024-01-31T05:06:03.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:02 smithi181 ceph-mon[36434]: Detected new or changed devices on smithi181 2024-01-31T05:06:03.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:02 smithi181 ceph-mon[36434]: Adjusting osd_memory_target on smithi181 to 8540M 2024-01-31T05:06:03.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:02 smithi181 ceph-mon[36434]: osdmap e39: 6 total, 6 up, 6 in 2024-01-31T05:06:04.051 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:03 smithi179 ceph-mon[35652]: pgmap v140: 1 pgs: 1 remapped+peering; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-01-31T05:06:04.051 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:03 smithi179 ceph-mon[35652]: osdmap e40: 6 total, 6 up, 6 in 2024-01-31T05:06:04.051 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:03 smithi179 ceph-mon[35652]: from='client.14337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:06:04.051 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:03 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-31T05:06:04.051 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:03 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-31T05:06:04.051 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:03 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:06:04.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:03 smithi099 ceph-mon[31615]: pgmap v140: 1 pgs: 1 remapped+peering; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-01-31T05:06:04.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:03 smithi099 ceph-mon[31615]: osdmap e40: 6 total, 6 up, 6 in 2024-01-31T05:06:04.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:03 smithi099 ceph-mon[31615]: from='client.14337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:06:04.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:03 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-31T05:06:04.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:03 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-31T05:06:04.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:03 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:06:04.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:03 smithi181 ceph-mon[36434]: pgmap v140: 1 pgs: 1 remapped+peering; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-01-31T05:06:04.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:03 smithi181 ceph-mon[36434]: osdmap e40: 6 total, 6 up, 6 in 2024-01-31T05:06:04.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:03 smithi181 ceph-mon[36434]: from='client.14337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:06:04.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:03 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-31T05:06:04.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:03 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-31T05:06:04.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:03 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:06:04.964 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:04 smithi179 ceph-mon[35652]: osdmap e41: 6 total, 6 up, 6 in 2024-01-31T05:06:05.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:04 smithi099 ceph-mon[31615]: osdmap e41: 6 total, 6 up, 6 in 2024-01-31T05:06:05.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:04 smithi181 ceph-mon[36434]: osdmap e41: 6 total, 6 up, 6 in 2024-01-31T05:06:06.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:05 smithi099 ceph-mon[31615]: pgmap v143: 1 pgs: 1 remapped+peering; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-01-31T05:06:06.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:05 smithi099 ceph-mon[31615]: osdmap e42: 6 total, 6 up, 6 in 2024-01-31T05:06:06.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:05 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/1565923909' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "56555035-f9fc-4e91-96dd-caa632d58adb"}]: dispatch 2024-01-31T05:06:06.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:05 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/1565923909' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "56555035-f9fc-4e91-96dd-caa632d58adb"}]': finished 2024-01-31T05:06:06.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:05 smithi099 ceph-mon[31615]: osdmap e43: 7 total, 6 up, 7 in 2024-01-31T05:06:06.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:05 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-31T05:06:06.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:05 smithi181 ceph-mon[36434]: pgmap v143: 1 pgs: 1 remapped+peering; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-01-31T05:06:06.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:05 smithi181 ceph-mon[36434]: osdmap e42: 6 total, 6 up, 6 in 2024-01-31T05:06:06.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:05 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/1565923909' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "56555035-f9fc-4e91-96dd-caa632d58adb"}]: dispatch 2024-01-31T05:06:06.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:05 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/1565923909' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "56555035-f9fc-4e91-96dd-caa632d58adb"}]': finished 2024-01-31T05:06:06.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:05 smithi181 ceph-mon[36434]: osdmap e43: 7 total, 6 up, 7 in 2024-01-31T05:06:06.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:05 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-31T05:06:06.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:05 smithi179 ceph-mon[35652]: pgmap v143: 1 pgs: 1 remapped+peering; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-01-31T05:06:06.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:05 smithi179 ceph-mon[35652]: osdmap e42: 6 total, 6 up, 6 in 2024-01-31T05:06:06.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:05 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/1565923909' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "56555035-f9fc-4e91-96dd-caa632d58adb"}]: dispatch 2024-01-31T05:06:06.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:05 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/1565923909' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "56555035-f9fc-4e91-96dd-caa632d58adb"}]': finished 2024-01-31T05:06:06.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:05 smithi179 ceph-mon[35652]: osdmap e43: 7 total, 6 up, 7 in 2024-01-31T05:06:06.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:05 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-31T05:06:07.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:06 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/1115014488' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-31T05:06:07.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:06 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/1115014488' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-31T05:06:07.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:06 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/1115014488' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-31T05:06:08.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:07 smithi099 ceph-mon[31615]: pgmap v146: 1 pgs: 1 remapped+peering; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-01-31T05:06:08.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:07 smithi181 ceph-mon[36434]: pgmap v146: 1 pgs: 1 remapped+peering; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-01-31T05:06:08.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:07 smithi179 ceph-mon[35652]: pgmap v146: 1 pgs: 1 remapped+peering; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-01-31T05:06:10.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:09 smithi099 ceph-mon[31615]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-01-31T05:06:10.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:09 smithi181 ceph-mon[36434]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-01-31T05:06:10.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:09 smithi179 ceph-mon[35652]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-01-31T05:06:11.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:11 smithi181 ceph-mon[36434]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-01-31T05:06:12.065 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:11 smithi099 ceph-mon[31615]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-01-31T05:06:12.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:11 smithi179 ceph-mon[35652]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-01-31T05:06:13.256 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:13 smithi099 ceph-mon[31615]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-01-31T05:06:13.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:13 smithi179 ceph-mon[35652]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-01-31T05:06:13.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:13 smithi181 ceph-mon[36434]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-01-31T05:06:14.234 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:14 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-01-31T05:06:14.234 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:14 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:06:14.235 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:14 smithi099 ceph-mon[31615]: Deploying daemon osd.6 on smithi099 2024-01-31T05:06:14.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:14 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-01-31T05:06:14.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:14 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:06:14.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:14 smithi179 ceph-mon[35652]: Deploying daemon osd.6 on smithi099 2024-01-31T05:06:14.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:14 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-01-31T05:06:14.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:14 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:06:14.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:14 smithi181 ceph-mon[36434]: Deploying daemon osd.6 on smithi099 2024-01-31T05:06:15.157 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:15 smithi099 ceph-mon[31615]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-01-31T05:06:15.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:15 smithi179 ceph-mon[35652]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-01-31T05:06:15.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:15 smithi181 ceph-mon[36434]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-01-31T05:06:17.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:17 smithi179 ceph-mon[35652]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-01-31T05:06:18.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:17 smithi099 ceph-mon[31615]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-01-31T05:06:18.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:17 smithi181 ceph-mon[36434]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-01-31T05:06:19.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:19 smithi179 ceph-mon[35652]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-01-31T05:06:19.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:19 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:19.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:19 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:19.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:19 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:06:19.936 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:19 smithi099 ceph-mon[31615]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-01-31T05:06:19.936 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:19 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:19.936 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:19 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:19.936 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:19 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:06:20.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:19 smithi181 ceph-mon[36434]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-01-31T05:06:20.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:19 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:20.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:19 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:20.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:19 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:06:21.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:21 smithi099 ceph-mon[31615]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-01-31T05:06:21.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:21 smithi179 ceph-mon[35652]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-01-31T05:06:22.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:21 smithi181 ceph-mon[36434]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-01-31T05:06:22.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:22.781+0000 7fdd1e7fc700 1 -- 172.21.15.99:0/740853857 <== mgr.14152 v2:172.21.15.99:6800/3925720924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fdd2802d540 con 0x7fdd140a13f0 2024-01-31T05:06:22.781 INFO:teuthology.orchestra.run.smithi099.stdout:Created osd(s) 6 on host 'smithi099' 2024-01-31T05:06:22.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:22.783+0000 7fdd2f3b2700 1 -- 172.21.15.99:0/740853857 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fdd140a13f0 msgr2=0x7fdd140a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:06:22.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:22.783+0000 7fdd2f3b2700 1 --2- 172.21.15.99:0/740853857 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fdd140a13f0 0x7fdd140a38b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdd1800b5c0 tx=0x7fdd18003790 comp rx=0 tx=0).stop 2024-01-31T05:06:22.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:22.784+0000 7fdd2f3b2700 1 -- 172.21.15.99:0/740853857 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd280ff890 msgr2=0x7fdd28102510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:06:22.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:22.784+0000 7fdd2f3b2700 1 --2- 172.21.15.99:0/740853857 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd280ff890 0x7fdd28102510 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdd2400c970 tx=0x7fdd2400cc80 comp rx=0 tx=0).stop 2024-01-31T05:06:22.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:22.784+0000 7fdd2f3b2700 1 -- 172.21.15.99:0/740853857 shutdown_connections 2024-01-31T05:06:22.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:22.784+0000 7fdd2f3b2700 1 --2- 172.21.15.99:0/740853857 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdd28102e10 0x7fdd281010a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:06:22.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:22.784+0000 7fdd2f3b2700 1 --2- 172.21.15.99:0/740853857 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd280ff890 0x7fdd28102510 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:06:22.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:22.784+0000 7fdd2f3b2700 1 --2- 172.21.15.99:0/740853857 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fdd140a13f0 0x7fdd140a38b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:06:22.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:22.784+0000 7fdd2f3b2700 1 --2- 172.21.15.99:0/740853857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd28100250 0x7fdd28100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:06:22.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:22.784+0000 7fdd2f3b2700 1 -- 172.21.15.99:0/740853857 >> 172.21.15.99:0/740853857 conn(0x7fdd280fb450 msgr2=0x7fdd28105fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:06:22.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:22.784+0000 7fdd2f3b2700 1 -- 172.21.15.99:0/740853857 shutdown_connections 2024-01-31T05:06:22.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:06:22.784+0000 7fdd2f3b2700 1 -- 172.21.15.99:0/740853857 wait complete. 2024-01-31T05:06:23.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:22 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:23.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:22 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:23.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:22 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:06:23.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:22 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:06:23.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:22 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:23.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:22 smithi099 ceph-mon[31615]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-01-31T05:06:23.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:22 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:23.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:22 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:23.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:22 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:06:23.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:22 smithi099 ceph-mon[31615]: from='osd.6 [v2:172.21.15.99:6818/1534047839,v1:172.21.15.99:6819/1534047839]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-01-31T05:06:23.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:22 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:23.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:22 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:23.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:22 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:06:23.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:22 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:06:23.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:22 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:23.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:22 smithi179 ceph-mon[35652]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-01-31T05:06:23.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:22 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:23.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:22 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:23.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:22 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:06:23.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:22 smithi179 ceph-mon[35652]: from='osd.6 [v2:172.21.15.99:6818/1534047839,v1:172.21.15.99:6819/1534047839]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-01-31T05:06:23.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:22 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:23.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:22 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:23.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:22 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:06:23.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:22 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:06:23.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:22 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:23.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:22 smithi181 ceph-mon[36434]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-01-31T05:06:23.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:22 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:23.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:22 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:23.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:22 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:06:23.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:22 smithi181 ceph-mon[36434]: from='osd.6 [v2:172.21.15.99:6818/1534047839,v1:172.21.15.99:6819/1534047839]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-01-31T05:06:23.482 DEBUG:teuthology.orchestra.run.smithi099:osd.6> sudo journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@osd.6.service 2024-01-31T05:06:23.484 INFO:tasks.cephadm:Deploying osd.7 on smithi179 with /dev/vg_nvme/lv_2... 2024-01-31T05:06:23.484 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-01-31T05:06:23.729 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.b/config 2024-01-31T05:06:25.053 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:24 smithi099 ceph-mon[31615]: from='osd.6 [v2:172.21.15.99:6818/1534047839,v1:172.21.15.99:6819/1534047839]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-01-31T05:06:25.054 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:24 smithi099 ceph-mon[31615]: osdmap e44: 7 total, 6 up, 7 in 2024-01-31T05:06:25.054 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:24 smithi099 ceph-mon[31615]: from='osd.6 [v2:172.21.15.99:6818/1534047839,v1:172.21.15.99:6819/1534047839]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-31T05:06:25.054 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:24 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-31T05:06:25.054 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:06:24 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:06:24.784+0000 7f4059001700 -1 osd.6 0 waiting for initial osdmap 2024-01-31T05:06:25.054 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:06:24 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:06:24.795+0000 7f40555fc700 -1 osd.6 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-31T05:06:25.069 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:24 smithi179 ceph-mon[35652]: from='osd.6 [v2:172.21.15.99:6818/1534047839,v1:172.21.15.99:6819/1534047839]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-01-31T05:06:25.069 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:24 smithi179 ceph-mon[35652]: osdmap e44: 7 total, 6 up, 7 in 2024-01-31T05:06:25.070 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:24 smithi179 ceph-mon[35652]: from='osd.6 [v2:172.21.15.99:6818/1534047839,v1:172.21.15.99:6819/1534047839]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-31T05:06:25.070 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:24 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-31T05:06:25.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:24 smithi181 ceph-mon[36434]: from='osd.6 [v2:172.21.15.99:6818/1534047839,v1:172.21.15.99:6819/1534047839]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-01-31T05:06:25.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:24 smithi181 ceph-mon[36434]: osdmap e44: 7 total, 6 up, 7 in 2024-01-31T05:06:25.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:24 smithi181 ceph-mon[36434]: from='osd.6 [v2:172.21.15.99:6818/1534047839,v1:172.21.15.99:6819/1534047839]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-31T05:06:25.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:24 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-31T05:06:25.793 INFO:teuthology.orchestra.run.smithi179.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-01-31T05:06:25.793 INFO:teuthology.orchestra.run.smithi179.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-01-31T05:06:25.793 INFO:teuthology.orchestra.run.smithi179.stderr: stderr: 10+0 records in 2024-01-31T05:06:25.794 INFO:teuthology.orchestra.run.smithi179.stderr:10+0 records out 2024-01-31T05:06:25.794 INFO:teuthology.orchestra.run.smithi179.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0115847 s, 905 MB/s 2024-01-31T05:06:25.794 INFO:teuthology.orchestra.run.smithi179.stderr:--> Zapping successful for: 2024-01-31T05:06:26.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:25 smithi099 ceph-mon[31615]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-01-31T05:06:26.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:25 smithi099 ceph-mon[31615]: from='osd.6 [v2:172.21.15.99:6818/1534047839,v1:172.21.15.99:6819/1534047839]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-01-31T05:06:26.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:25 smithi099 ceph-mon[31615]: osdmap e45: 7 total, 6 up, 7 in 2024-01-31T05:06:26.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:25 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-31T05:06:26.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:25 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-31T05:06:26.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:25 smithi181 ceph-mon[36434]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-01-31T05:06:26.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:25 smithi181 ceph-mon[36434]: from='osd.6 [v2:172.21.15.99:6818/1534047839,v1:172.21.15.99:6819/1534047839]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-01-31T05:06:26.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:25 smithi181 ceph-mon[36434]: osdmap e45: 7 total, 6 up, 7 in 2024-01-31T05:06:26.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:25 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-31T05:06:26.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:25 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-31T05:06:26.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:25 smithi179 ceph-mon[35652]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-01-31T05:06:26.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:25 smithi179 ceph-mon[35652]: from='osd.6 [v2:172.21.15.99:6818/1534047839,v1:172.21.15.99:6819/1534047839]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-01-31T05:06:26.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:25 smithi179 ceph-mon[35652]: osdmap e45: 7 total, 6 up, 7 in 2024-01-31T05:06:26.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:25 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-31T05:06:26.100 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:25 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-31T05:06:26.401 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph orch daemon add osd smithi179:vg_nvme/lv_2 2024-01-31T05:06:26.644 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.b/config 2024-01-31T05:06:26.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:26 smithi099 ceph-mon[31615]: purged_snaps scrub starts 2024-01-31T05:06:26.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:26 smithi099 ceph-mon[31615]: purged_snaps scrub ok 2024-01-31T05:06:26.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:26 smithi099 ceph-mon[31615]: osd.6 [v2:172.21.15.99:6818/1534047839,v1:172.21.15.99:6819/1534047839] boot 2024-01-31T05:06:26.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:26 smithi099 ceph-mon[31615]: osdmap e46: 7 total, 7 up, 7 in 2024-01-31T05:06:26.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:26 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-31T05:06:26.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:26 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:26.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:26 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:26.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:26 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:06:26.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:26 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:06:26.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:26 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:06:26.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:26 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:26.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:26 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:06:26.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:26 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:06:26.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:26 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:26.987 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:26 smithi179 ceph-mon[35652]: purged_snaps scrub starts 2024-01-31T05:06:26.987 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:26 smithi179 ceph-mon[35652]: purged_snaps scrub ok 2024-01-31T05:06:26.987 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:26 smithi179 ceph-mon[35652]: osd.6 [v2:172.21.15.99:6818/1534047839,v1:172.21.15.99:6819/1534047839] boot 2024-01-31T05:06:26.987 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:26 smithi179 ceph-mon[35652]: osdmap e46: 7 total, 7 up, 7 in 2024-01-31T05:06:26.987 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:26 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-31T05:06:26.987 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:26 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:26.987 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:26 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:26.987 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:26 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:06:26.988 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:26 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:06:26.988 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:26 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:06:26.988 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:26 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:26.988 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:26 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:06:26.988 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:26 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:06:26.988 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:26 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:27.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:26 smithi181 ceph-mon[36434]: purged_snaps scrub starts 2024-01-31T05:06:27.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:26 smithi181 ceph-mon[36434]: purged_snaps scrub ok 2024-01-31T05:06:27.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:26 smithi181 ceph-mon[36434]: osd.6 [v2:172.21.15.99:6818/1534047839,v1:172.21.15.99:6819/1534047839] boot 2024-01-31T05:06:27.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:26 smithi181 ceph-mon[36434]: osdmap e46: 7 total, 7 up, 7 in 2024-01-31T05:06:27.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:26 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-31T05:06:27.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:26 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:27.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:26 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:27.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:26 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:06:27.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:26 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:06:27.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:26 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:06:27.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:26 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:27.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:26 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:06:27.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:26 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:06:27.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:26 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:28.034 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:27 smithi179 ceph-mon[35652]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-01-31T05:06:28.034 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:27 smithi179 ceph-mon[35652]: Detected new or changed devices on smithi099 2024-01-31T05:06:28.034 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:27 smithi179 ceph-mon[35652]: Adjusting osd_memory_target on smithi099 to 5696M 2024-01-31T05:06:28.034 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:27 smithi179 ceph-mon[35652]: osdmap e47: 7 total, 7 up, 7 in 2024-01-31T05:06:28.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:27 smithi099 ceph-mon[31615]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-01-31T05:06:28.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:27 smithi099 ceph-mon[31615]: Detected new or changed devices on smithi099 2024-01-31T05:06:28.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:27 smithi099 ceph-mon[31615]: Adjusting osd_memory_target on smithi099 to 5696M 2024-01-31T05:06:28.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:27 smithi099 ceph-mon[31615]: osdmap e47: 7 total, 7 up, 7 in 2024-01-31T05:06:28.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:27 smithi181 ceph-mon[36434]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-01-31T05:06:28.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:27 smithi181 ceph-mon[36434]: Detected new or changed devices on smithi099 2024-01-31T05:06:28.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:27 smithi181 ceph-mon[36434]: Adjusting osd_memory_target on smithi099 to 5696M 2024-01-31T05:06:28.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:27 smithi181 ceph-mon[36434]: osdmap e47: 7 total, 7 up, 7 in 2024-01-31T05:06:28.266 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:28.264+0000 7fa2b9611700 1 -- 172.21.15.179:0/574556447 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2b41022f0 msgr2=0x7fa2b4108ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:06:28.266 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:28.264+0000 7fa2b9611700 1 --2- 172.21.15.179:0/574556447 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2b41022f0 0x7fa2b4108ba0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac00b0d0 tx=0x7fa2ac00b3e0 comp rx=0 tx=0).stop 2024-01-31T05:06:28.266 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:28.264+0000 7fa2b9611700 1 -- 172.21.15.179:0/574556447 shutdown_connections 2024-01-31T05:06:28.266 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:28.264+0000 7fa2b9611700 1 --2- 172.21.15.179:0/574556447 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2b41022f0 0x7fa2b4108ba0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:06:28.266 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:28.264+0000 7fa2b9611700 1 --2- 172.21.15.179:0/574556447 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2b4100750 0x7fa2b4100b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:06:28.266 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:28.264+0000 7fa2b9611700 1 --2- 172.21.15.179:0/574556447 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2b4101950 0x7fa2b4101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:06:28.266 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:28.264+0000 7fa2b9611700 1 -- 172.21.15.179:0/574556447 >> 172.21.15.179:0/574556447 conn(0x7fa2b40fbcd0 msgr2=0x7fa2b40fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:06:28.266 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:28.264+0000 7fa2b9611700 1 -- 172.21.15.179:0/574556447 shutdown_connections 2024-01-31T05:06:28.266 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:28.264+0000 7fa2b9611700 1 -- 172.21.15.179:0/574556447 wait complete. 2024-01-31T05:06:28.266 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:28.265+0000 7fa2b9611700 1 Processor -- start 2024-01-31T05:06:28.266 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:28.265+0000 7fa2b9611700 1 -- start start 2024-01-31T05:06:28.266 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:28.265+0000 7fa2b9611700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2b4100750 0x7fa2b4104670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:06:28.267 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:28.265+0000 7fa2b9611700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2b4101950 0x7fa2b4102d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:06:28.267 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:28.265+0000 7fa2b9611700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2b41022f0 0x7fa2b4103270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:06:28.267 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:28.265+0000 7fa2b9611700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b4103980 con 0x7fa2b41022f0 2024-01-31T05:06:28.267 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:28.265+0000 7fa2b9611700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b4103af0 con 0x7fa2b4101950 2024-01-31T05:06:28.267 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:28.265+0000 7fa2b9611700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b41a1a10 con 0x7fa2b4100750 2024-01-31T05:06:28.267 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:28.265+0000 7fa2aa7fc700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2b4101950 0x7fa2b4102d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:06:28.267 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:28.265+0000 7fa2aa7fc700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2b4101950 0x7fa2b4102d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:60594/0 (socket says 172.21.15.179:60594) 2024-01-31T05:06:28.267 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:28.265+0000 7fa2aa7fc700 1 -- 172.21.15.179:0/1737181131 learned_addr learned my addr 172.21.15.179:0/1737181131 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-01-31T05:06:28.267 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:28.265+0000 7fa2b37fe700 1 --2- 172.21.15.179:0/1737181131 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2b41022f0 0x7fa2b4103270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:06:28.267 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:28.265+0000 7fa2b2ffd700 1 --2- 172.21.15.179:0/1737181131 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2b4100750 0x7fa2b4104670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:06:28.267 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:28.265+0000 7fa2aa7fc700 1 -- 172.21.15.179:0/1737181131 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2b4100750 msgr2=0x7fa2b4104670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:06:28.267 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:28.265+0000 7fa2aa7fc700 1 --2- 172.21.15.179:0/1737181131 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2b4100750 0x7fa2b4104670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:06:28.267 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:28.265+0000 7fa2aa7fc700 1 -- 172.21.15.179:0/1737181131 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2b41022f0 msgr2=0x7fa2b4103270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:06:28.267 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:28.265+0000 7fa2aa7fc700 1 --2- 172.21.15.179:0/1737181131 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2b41022f0 0x7fa2b4103270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:06:28.268 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:28.265+0000 7fa2aa7fc700 1 -- 172.21.15.179:0/1737181131 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ac009d00 con 0x7fa2b4101950 2024-01-31T05:06:28.268 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:28.265+0000 7fa2b2ffd700 1 --2- 172.21.15.179:0/1737181131 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2b4100750 0x7fa2b4104670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:06:28.268 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:28.266+0000 7fa2aa7fc700 1 --2- 172.21.15.179:0/1737181131 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2b4101950 0x7fa2b4102d30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa29c00b560 tx=0x7fa29c00b870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:06:28.268 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:28.266+0000 7fa2b0ff9700 1 -- 172.21.15.179:0/1737181131 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29c011830 con 0x7fa2b4101950 2024-01-31T05:06:28.268 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:28.266+0000 7fa2b0ff9700 1 -- 172.21.15.179:0/1737181131 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa29c011e50 con 0x7fa2b4101950 2024-01-31T05:06:28.268 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:28.266+0000 7fa2b9611700 1 -- 172.21.15.179:0/1737181131 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2b41a1c70 con 0x7fa2b4101950 2024-01-31T05:06:28.268 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:28.266+0000 7fa2b0ff9700 1 -- 172.21.15.179:0/1737181131 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29c00f2e0 con 0x7fa2b4101950 2024-01-31T05:06:28.268 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:28.266+0000 7fa2b9611700 1 -- 172.21.15.179:0/1737181131 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2b41a2170 con 0x7fa2b4101950 2024-01-31T05:06:28.269 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:28.267+0000 7fa2b9611700 1 -- 172.21.15.179:0/1737181131 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2b40684a0 con 0x7fa2b4101950 2024-01-31T05:06:28.269 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:28.268+0000 7fa2b0ff9700 1 -- 172.21.15.179:0/1737181131 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7fa29c010580 con 0x7fa2b4101950 2024-01-31T05:06:28.269 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:28.268+0000 7fa2b0ff9700 1 --2- 172.21.15.179:0/1737181131 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa2a00a1370 0x7fa2a00a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:06:28.269 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:28.268+0000 7fa2b0ff9700 1 -- 172.21.15.179:0/1737181131 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 4965+0+0 (secure 0 0 0) 0x7fa29c0cb890 con 0x7fa2b4101950 2024-01-31T05:06:28.269 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:28.268+0000 7fa2b2ffd700 1 --2- 172.21.15.179:0/1737181131 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa2a00a1370 0x7fa2a00a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:06:28.269 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:28.269+0000 7fa2b2ffd700 1 --2- 172.21.15.179:0/1737181131 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa2a00a1370 0x7fa2a00a3830 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa2b41017b0 tx=0x7fa2a4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:06:28.272 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:28.273+0000 7fa2b0ff9700 1 -- 172.21.15.179:0/1737181131 <== mon.2 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fa29c095a20 con 0x7fa2b4101950 2024-01-31T05:06:28.471 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:28.471+0000 7fa2b9611700 1 -- 172.21.15.179:0/1737181131 --> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fa2b40fded0 con 0x7fa2a00a1370 2024-01-31T05:06:29.065 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:28 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-31T05:06:29.065 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:28 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-31T05:06:29.065 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:28 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:06:29.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:28 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-31T05:06:29.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:28 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-31T05:06:29.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:28 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:06:29.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:28 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-31T05:06:29.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:28 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-31T05:06:29.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:28 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:06:29.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:29 smithi179 ceph-mon[35652]: from='client.24266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:06:29.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:29 smithi179 ceph-mon[35652]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-01-31T05:06:30.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:29 smithi099 ceph-mon[31615]: from='client.24266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:06:30.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:29 smithi099 ceph-mon[31615]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-01-31T05:06:30.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:29 smithi181 ceph-mon[36434]: from='client.24266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:06:30.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:29 smithi181 ceph-mon[36434]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-01-31T05:06:32.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:31 smithi179 ceph-mon[35652]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-01-31T05:06:32.218 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:31 smithi179 ceph-mon[35652]: from='client.? 172.21.15.179:0/559250897' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5e079cf5-1340-4599-88a6-df410ef0148e"}]: dispatch 2024-01-31T05:06:32.218 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:31 smithi179 ceph-mon[35652]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5e079cf5-1340-4599-88a6-df410ef0148e"}]: dispatch 2024-01-31T05:06:32.218 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:31 smithi179 ceph-mon[35652]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5e079cf5-1340-4599-88a6-df410ef0148e"}]': finished 2024-01-31T05:06:32.218 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:31 smithi179 ceph-mon[35652]: osdmap e48: 8 total, 7 up, 8 in 2024-01-31T05:06:32.218 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:31 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-31T05:06:32.218 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:31 smithi179 ceph-mon[35652]: from='client.? 172.21.15.179:0/2789239892' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-31T05:06:32.219 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:31 smithi181 ceph-mon[36434]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-01-31T05:06:32.219 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:31 smithi181 ceph-mon[36434]: from='client.? 172.21.15.179:0/559250897' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5e079cf5-1340-4599-88a6-df410ef0148e"}]: dispatch 2024-01-31T05:06:32.219 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:31 smithi181 ceph-mon[36434]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5e079cf5-1340-4599-88a6-df410ef0148e"}]: dispatch 2024-01-31T05:06:32.219 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:31 smithi181 ceph-mon[36434]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5e079cf5-1340-4599-88a6-df410ef0148e"}]': finished 2024-01-31T05:06:32.219 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:31 smithi181 ceph-mon[36434]: osdmap e48: 8 total, 7 up, 8 in 2024-01-31T05:06:32.219 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:31 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-31T05:06:32.219 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:31 smithi181 ceph-mon[36434]: from='client.? 172.21.15.179:0/2789239892' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-31T05:06:32.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:31 smithi099 ceph-mon[31615]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-01-31T05:06:32.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:31 smithi099 ceph-mon[31615]: from='client.? 172.21.15.179:0/559250897' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5e079cf5-1340-4599-88a6-df410ef0148e"}]: dispatch 2024-01-31T05:06:32.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:31 smithi099 ceph-mon[31615]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5e079cf5-1340-4599-88a6-df410ef0148e"}]: dispatch 2024-01-31T05:06:32.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:31 smithi099 ceph-mon[31615]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5e079cf5-1340-4599-88a6-df410ef0148e"}]': finished 2024-01-31T05:06:32.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:31 smithi099 ceph-mon[31615]: osdmap e48: 8 total, 7 up, 8 in 2024-01-31T05:06:32.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:31 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-31T05:06:32.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:31 smithi099 ceph-mon[31615]: from='client.? 172.21.15.179:0/2789239892' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-31T05:06:33.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:33 smithi181 ceph-mon[36434]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-01-31T05:06:33.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:33 smithi179 ceph-mon[35652]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-01-31T05:06:33.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:33 smithi099 ceph-mon[31615]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-01-31T05:06:35.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:35 smithi179 ceph-mon[35652]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-01-31T05:06:36.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:35 smithi099 ceph-mon[31615]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-01-31T05:06:36.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:35 smithi181 ceph-mon[36434]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-01-31T05:06:37.840 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:37 smithi179 ceph-mon[35652]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-01-31T05:06:38.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:37 smithi099 ceph-mon[31615]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-01-31T05:06:38.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:37 smithi181 ceph-mon[36434]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-01-31T05:06:38.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:38 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-01-31T05:06:38.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:38 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:06:39.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:38 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-01-31T05:06:39.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:38 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:06:39.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:38 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-01-31T05:06:39.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:38 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:06:39.818 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:39 smithi179 ceph-mon[35652]: Deploying daemon osd.7 on smithi179 2024-01-31T05:06:39.818 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:39 smithi179 ceph-mon[35652]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-01-31T05:06:40.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:39 smithi099 ceph-mon[31615]: Deploying daemon osd.7 on smithi179 2024-01-31T05:06:40.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:39 smithi099 ceph-mon[31615]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-01-31T05:06:40.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:39 smithi181 ceph-mon[36434]: Deploying daemon osd.7 on smithi179 2024-01-31T05:06:40.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:39 smithi181 ceph-mon[36434]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-01-31T05:06:41.868 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:41 smithi179 ceph-mon[35652]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-01-31T05:06:42.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:41 smithi099 ceph-mon[31615]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-01-31T05:06:42.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:41 smithi181 ceph-mon[36434]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-01-31T05:06:43.260 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:43 smithi179 ceph-mon[35652]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-01-31T05:06:43.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:43 smithi099 ceph-mon[31615]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-01-31T05:06:43.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:43 smithi181 ceph-mon[36434]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-01-31T05:06:45.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:45 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:45.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:45 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:06:45.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:45 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:45.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:45 smithi179 ceph-mon[35652]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-01-31T05:06:45.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:45 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:45.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:45 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:06:45.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:45 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:45.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:45 smithi099 ceph-mon[31615]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-01-31T05:06:45.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:45 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:45.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:45 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:06:45.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:45 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:45.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:45 smithi181 ceph-mon[36434]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-01-31T05:06:47.686 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:47.686+0000 7fa2b0ff9700 1 -- 172.21.15.179:0/1737181131 <== mgr.14152 v2:172.21.15.99:6800/3925720924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa2b40fded0 con 0x7fa2a00a1370 2024-01-31T05:06:47.686 INFO:teuthology.orchestra.run.smithi179.stdout:Created osd(s) 7 on host 'smithi179' 2024-01-31T05:06:47.688 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:47.688+0000 7fa2b9611700 1 -- 172.21.15.179:0/1737181131 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa2a00a1370 msgr2=0x7fa2a00a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:06:47.688 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:47.688+0000 7fa2b9611700 1 --2- 172.21.15.179:0/1737181131 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa2a00a1370 0x7fa2a00a3830 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa2b41017b0 tx=0x7fa2a4008040 comp rx=0 tx=0).stop 2024-01-31T05:06:47.688 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:47.688+0000 7fa2b9611700 1 -- 172.21.15.179:0/1737181131 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2b4101950 msgr2=0x7fa2b4102d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:06:47.688 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:47.688+0000 7fa2b9611700 1 --2- 172.21.15.179:0/1737181131 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2b4101950 0x7fa2b4102d30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa29c00b560 tx=0x7fa29c00b870 comp rx=0 tx=0).stop 2024-01-31T05:06:47.688 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:47.688+0000 7fa2b9611700 1 -- 172.21.15.179:0/1737181131 shutdown_connections 2024-01-31T05:06:47.688 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:47.688+0000 7fa2b9611700 1 --2- 172.21.15.179:0/1737181131 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2b41022f0 0x7fa2b4103270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:06:47.688 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:47.688+0000 7fa2b9611700 1 --2- 172.21.15.179:0/1737181131 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2b4100750 0x7fa2b4104670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:06:47.688 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:47.688+0000 7fa2b9611700 1 --2- 172.21.15.179:0/1737181131 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa2a00a1370 0x7fa2a00a3830 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:06:47.689 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:47.688+0000 7fa2b9611700 1 --2- 172.21.15.179:0/1737181131 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2b4101950 0x7fa2b4102d30 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:06:47.689 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:47.688+0000 7fa2b9611700 1 -- 172.21.15.179:0/1737181131 >> 172.21.15.179:0/1737181131 conn(0x7fa2b40fbcd0 msgr2=0x7fa2b40fd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:06:47.689 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:47.688+0000 7fa2b9611700 1 -- 172.21.15.179:0/1737181131 shutdown_connections 2024-01-31T05:06:47.689 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:06:47.688+0000 7fa2b9611700 1 -- 172.21.15.179:0/1737181131 wait complete. 2024-01-31T05:06:47.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:47 smithi179 ceph-mon[35652]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-01-31T05:06:48.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:47 smithi099 ceph-mon[31615]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-01-31T05:06:48.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:47 smithi181 ceph-mon[36434]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-01-31T05:06:48.307 DEBUG:teuthology.orchestra.run.smithi179:osd.7> sudo journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@osd.7.service 2024-01-31T05:06:48.309 INFO:tasks.cephadm:Deploying osd.8 on smithi181 with /dev/vg_nvme/lv_2... 2024-01-31T05:06:48.309 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-01-31T05:06:48.553 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.c/config 2024-01-31T05:06:48.933 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:48 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:48.933 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:48 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:48.934 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:48 smithi181 ceph-mon[36434]: from='osd.7 [v2:172.21.15.179:6816/3875950553,v1:172.21.15.179:6817/3875950553]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-01-31T05:06:48.934 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:48 smithi181 ceph-mon[36434]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-01-31T05:06:48.934 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:48 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:48.934 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:48 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:49.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:48 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:49.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:48 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:49.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:48 smithi099 ceph-mon[31615]: from='osd.7 [v2:172.21.15.179:6816/3875950553,v1:172.21.15.179:6817/3875950553]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-01-31T05:06:49.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:48 smithi099 ceph-mon[31615]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-01-31T05:06:49.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:48 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:49.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:48 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:49.085 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:48 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:49.085 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:48 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:49.085 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:48 smithi179 ceph-mon[35652]: from='osd.7 [v2:172.21.15.179:6816/3875950553,v1:172.21.15.179:6817/3875950553]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-01-31T05:06:49.085 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:48 smithi179 ceph-mon[35652]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-01-31T05:06:49.085 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:48 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:49.086 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:48 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:49.846 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:49 smithi181 ceph-mon[36434]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-01-31T05:06:49.846 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:49 smithi181 ceph-mon[36434]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-01-31T05:06:49.846 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:49 smithi181 ceph-mon[36434]: from='osd.7 [v2:172.21.15.179:6816/3875950553,v1:172.21.15.179:6817/3875950553]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-01-31T05:06:49.846 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:49 smithi181 ceph-mon[36434]: osdmap e49: 8 total, 7 up, 8 in 2024-01-31T05:06:49.846 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:49 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-31T05:06:49.846 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:49 smithi181 ceph-mon[36434]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-01-31T05:06:50.055 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:49 smithi179 ceph-mon[35652]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-01-31T05:06:50.056 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:49 smithi179 ceph-mon[35652]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-01-31T05:06:50.056 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:49 smithi179 ceph-mon[35652]: from='osd.7 [v2:172.21.15.179:6816/3875950553,v1:172.21.15.179:6817/3875950553]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-01-31T05:06:50.056 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:49 smithi179 ceph-mon[35652]: osdmap e49: 8 total, 7 up, 8 in 2024-01-31T05:06:50.056 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:49 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-31T05:06:50.056 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:49 smithi179 ceph-mon[35652]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-01-31T05:06:50.056 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:06:49 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:06:49.671+0000 7ffa0beb0700 -1 osd.7 0 waiting for initial osdmap 2024-01-31T05:06:50.056 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:06:49 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:06:49.684+0000 7ffa084ab700 -1 osd.7 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-31T05:06:50.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:49 smithi099 ceph-mon[31615]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-01-31T05:06:50.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:49 smithi099 ceph-mon[31615]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-01-31T05:06:50.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:49 smithi099 ceph-mon[31615]: from='osd.7 [v2:172.21.15.179:6816/3875950553,v1:172.21.15.179:6817/3875950553]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-01-31T05:06:50.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:49 smithi099 ceph-mon[31615]: osdmap e49: 8 total, 7 up, 8 in 2024-01-31T05:06:50.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:49 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-31T05:06:50.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:49 smithi099 ceph-mon[31615]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-01-31T05:06:50.395 INFO:teuthology.orchestra.run.smithi181.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-01-31T05:06:50.395 INFO:teuthology.orchestra.run.smithi181.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-01-31T05:06:50.396 INFO:teuthology.orchestra.run.smithi181.stderr: stderr: 10+0 records in 2024-01-31T05:06:50.396 INFO:teuthology.orchestra.run.smithi181.stderr:10+0 records out 2024-01-31T05:06:50.396 INFO:teuthology.orchestra.run.smithi181.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113365 s, 925 MB/s 2024-01-31T05:06:50.396 INFO:teuthology.orchestra.run.smithi181.stderr:--> Zapping successful for: 2024-01-31T05:06:51.035 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:50 smithi181 ceph-mon[36434]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-01-31T05:06:51.035 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:50 smithi181 ceph-mon[36434]: osdmap e50: 8 total, 7 up, 8 in 2024-01-31T05:06:51.035 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:50 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-31T05:06:51.036 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:50 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-31T05:06:51.064 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph orch daemon add osd smithi181:vg_nvme/lv_2 2024-01-31T05:06:51.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:50 smithi099 ceph-mon[31615]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-01-31T05:06:51.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:50 smithi099 ceph-mon[31615]: osdmap e50: 8 total, 7 up, 8 in 2024-01-31T05:06:51.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:50 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-31T05:06:51.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:50 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-31T05:06:51.123 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:50 smithi179 ceph-mon[35652]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-01-31T05:06:51.123 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:50 smithi179 ceph-mon[35652]: osdmap e50: 8 total, 7 up, 8 in 2024-01-31T05:06:51.123 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:50 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-31T05:06:51.123 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:50 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-31T05:06:51.307 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.c/config 2024-01-31T05:06:51.721 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:51 smithi179 ceph-mon[35652]: purged_snaps scrub starts 2024-01-31T05:06:51.721 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:51 smithi179 ceph-mon[35652]: purged_snaps scrub ok 2024-01-31T05:06:51.721 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:51 smithi179 ceph-mon[35652]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-01-31T05:06:51.721 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:51 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-31T05:06:51.721 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:51 smithi179 ceph-mon[35652]: osd.7 [v2:172.21.15.179:6816/3875950553,v1:172.21.15.179:6817/3875950553] boot 2024-01-31T05:06:51.721 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:51 smithi179 ceph-mon[35652]: osdmap e51: 8 total, 8 up, 8 in 2024-01-31T05:06:51.722 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:51 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-31T05:06:52.057 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:51 smithi181 ceph-mon[36434]: purged_snaps scrub starts 2024-01-31T05:06:52.057 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:51 smithi181 ceph-mon[36434]: purged_snaps scrub ok 2024-01-31T05:06:52.057 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:51 smithi181 ceph-mon[36434]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-01-31T05:06:52.057 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:51 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-31T05:06:52.057 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:51 smithi181 ceph-mon[36434]: osd.7 [v2:172.21.15.179:6816/3875950553,v1:172.21.15.179:6817/3875950553] boot 2024-01-31T05:06:52.057 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:51 smithi181 ceph-mon[36434]: osdmap e51: 8 total, 8 up, 8 in 2024-01-31T05:06:52.057 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:51 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-31T05:06:52.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:51 smithi099 ceph-mon[31615]: purged_snaps scrub starts 2024-01-31T05:06:52.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:51 smithi099 ceph-mon[31615]: purged_snaps scrub ok 2024-01-31T05:06:52.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:51 smithi099 ceph-mon[31615]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-01-31T05:06:52.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:51 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-31T05:06:52.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:51 smithi099 ceph-mon[31615]: osd.7 [v2:172.21.15.179:6816/3875950553,v1:172.21.15.179:6817/3875950553] boot 2024-01-31T05:06:52.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:51 smithi099 ceph-mon[31615]: osdmap e51: 8 total, 8 up, 8 in 2024-01-31T05:06:52.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:51 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-31T05:06:52.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:06:52.796+0000 7f9ceeb62700 1 -- 172.21.15.181:0/1309328390 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ce8102a10 msgr2=0x7f9ce8102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:06:52.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:06:52.796+0000 7f9ceeb62700 1 --2- 172.21.15.181:0/1309328390 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ce8102a10 0x7f9ce8102e70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9cd4009990 tx=0x7f9cd4009ca0 comp rx=0 tx=0).stop 2024-01-31T05:06:52.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:06:52.796+0000 7f9ceeb62700 1 -- 172.21.15.181:0/1309328390 shutdown_connections 2024-01-31T05:06:52.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:06:52.796+0000 7f9ceeb62700 1 --2- 172.21.15.181:0/1309328390 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ce81033b0 0x7f9ce8109c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:06:52.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:06:52.796+0000 7f9ceeb62700 1 --2- 172.21.15.181:0/1309328390 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ce8101810 0x7f9ce8101c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:06:52.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:06:52.796+0000 7f9ceeb62700 1 --2- 172.21.15.181:0/1309328390 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ce8102a10 0x7f9ce8102e70 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:06:52.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:06:52.796+0000 7f9ceeb62700 1 -- 172.21.15.181:0/1309328390 >> 172.21.15.181:0/1309328390 conn(0x7f9ce80fcdf0 msgr2=0x7f9ce80ff210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:06:52.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:06:52.796+0000 7f9ceeb62700 1 -- 172.21.15.181:0/1309328390 shutdown_connections 2024-01-31T05:06:52.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:06:52.796+0000 7f9ceeb62700 1 -- 172.21.15.181:0/1309328390 wait complete. 2024-01-31T05:06:52.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:06:52.796+0000 7f9ceeb62700 1 Processor -- start 2024-01-31T05:06:52.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:06:52.796+0000 7f9ceeb62700 1 -- start start 2024-01-31T05:06:52.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:06:52.796+0000 7f9ceeb62700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ce8101810 0x7f9ce81976b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:06:52.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:06:52.796+0000 7f9ceeb62700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ce8102a10 0x7f9ce8197bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:06:52.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:06:52.796+0000 7f9ceeb62700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ce81033b0 0x7f9ce819ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:06:52.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:06:52.796+0000 7f9ceeb62700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce819f240 con 0x7f9ce81033b0 2024-01-31T05:06:52.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:06:52.796+0000 7f9ceeb62700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce819f380 con 0x7f9ce8101810 2024-01-31T05:06:52.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:06:52.796+0000 7f9ceeb62700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce819f510 con 0x7f9ce8102a10 2024-01-31T05:06:52.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:06:52.797+0000 7f9ce7fff700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ce8102a10 0x7f9ce8197bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:06:52.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:06:52.797+0000 7f9ce7fff700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ce8102a10 0x7f9ce8197bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:54082/0 (socket says 172.21.15.181:54082) 2024-01-31T05:06:52.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:06:52.797+0000 7f9ce7fff700 1 -- 172.21.15.181:0/1542404703 learned_addr learned my addr 172.21.15.181:0/1542404703 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-01-31T05:06:52.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:06:52.797+0000 7f9cec8fe700 1 --2- 172.21.15.181:0/1542404703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ce8101810 0x7f9ce81976b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:06:52.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:06:52.797+0000 7f9ced0ff700 1 --2- 172.21.15.181:0/1542404703 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ce81033b0 0x7f9ce819ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:06:52.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:06:52.797+0000 7f9ce7fff700 1 -- 172.21.15.181:0/1542404703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ce8101810 msgr2=0x7f9ce81976b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:06:52.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:06:52.797+0000 7f9ce7fff700 1 --2- 172.21.15.181:0/1542404703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ce8101810 0x7f9ce81976b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:06:52.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:06:52.797+0000 7f9ce7fff700 1 -- 172.21.15.181:0/1542404703 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ce81033b0 msgr2=0x7f9ce819ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:06:52.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:06:52.797+0000 7f9ce7fff700 1 --2- 172.21.15.181:0/1542404703 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ce81033b0 0x7f9ce819ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:06:52.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:06:52.797+0000 7f9ce7fff700 1 -- 172.21.15.181:0/1542404703 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd40095f0 con 0x7f9ce8102a10 2024-01-31T05:06:52.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:06:52.797+0000 7f9ce7fff700 1 --2- 172.21.15.181:0/1542404703 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ce8102a10 0x7f9ce8197bf0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9cd400b5c0 tx=0x7f9cd400f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:06:52.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:06:52.797+0000 7f9ce5ffb700 1 -- 172.21.15.181:0/1542404703 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd401d070 con 0x7f9ce8102a10 2024-01-31T05:06:52.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:06:52.797+0000 7f9ce5ffb700 1 -- 172.21.15.181:0/1542404703 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9cd4003960 con 0x7f9ce8102a10 2024-01-31T05:06:52.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:06:52.797+0000 7f9ceeb62700 1 -- 172.21.15.181:0/1542404703 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ce819f790 con 0x7f9ce8102a10 2024-01-31T05:06:52.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:06:52.797+0000 7f9ce5ffb700 1 -- 172.21.15.181:0/1542404703 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd4005630 con 0x7f9ce8102a10 2024-01-31T05:06:52.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:06:52.797+0000 7f9ceeb62700 1 -- 172.21.15.181:0/1542404703 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ce819fba0 con 0x7f9ce8102a10 2024-01-31T05:06:52.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:06:52.798+0000 7f9ceeb62700 1 -- 172.21.15.181:0/1542404703 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ce8108cf0 con 0x7f9ce8102a10 2024-01-31T05:06:52.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:06:52.800+0000 7f9ce5ffb700 1 -- 172.21.15.181:0/1542404703 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f9cd4003ad0 con 0x7f9ce8102a10 2024-01-31T05:06:52.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:06:52.800+0000 7f9ce5ffb700 1 --2- 172.21.15.181:0/1542404703 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f9cd80a1370 0x7f9cd80a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:06:52.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:06:52.801+0000 7f9ce5ffb700 1 -- 172.21.15.181:0/1542404703 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5426+0+0 (secure 0 0 0) 0x7f9cd40cd470 con 0x7f9ce8102a10 2024-01-31T05:06:52.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:06:52.801+0000 7f9cec8fe700 1 --2- 172.21.15.181:0/1542404703 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f9cd80a1370 0x7f9cd80a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:06:52.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:06:52.801+0000 7f9cec8fe700 1 --2- 172.21.15.181:0/1542404703 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f9cd80a1370 0x7f9cd80a3830 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8102870 tx=0x7f9cdc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:06:52.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:06:52.804+0000 7f9ce5ffb700 1 -- 172.21.15.181:0/1542404703 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f9cd4097540 con 0x7f9ce8102a10 2024-01-31T05:06:53.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:06:53.004+0000 7f9ceeb62700 1 -- 172.21.15.181:0/1542404703 --> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ce802d5b0 con 0x7f9cd80a1370 2024-01-31T05:06:53.005 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:52 smithi181 ceph-mon[36434]: osdmap e52: 8 total, 8 up, 8 in 2024-01-31T05:06:53.005 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:52 smithi181 ceph-mon[36434]: Detected new or changed devices on smithi179 2024-01-31T05:06:53.005 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:52 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:53.005 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:52 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:53.005 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:52 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:06:53.005 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:52 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:06:53.005 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:52 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:06:53.005 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:52 smithi181 ceph-mon[36434]: Adjusting osd_memory_target on smithi179 to 5693M 2024-01-31T05:06:53.005 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:52 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:53.006 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:52 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:06:53.006 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:52 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:06:53.006 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:52 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:53.006 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:52 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:06:53.006 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:52 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:06:53.006 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:52 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:06:53.006 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:52 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:53.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:52 smithi099 ceph-mon[31615]: osdmap e52: 8 total, 8 up, 8 in 2024-01-31T05:06:53.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:52 smithi099 ceph-mon[31615]: Detected new or changed devices on smithi179 2024-01-31T05:06:53.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:52 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:53.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:52 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:53.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:52 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:06:53.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:52 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:06:53.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:52 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:06:53.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:52 smithi099 ceph-mon[31615]: Adjusting osd_memory_target on smithi179 to 5693M 2024-01-31T05:06:53.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:52 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:53.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:52 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:06:53.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:52 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:06:53.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:52 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:53.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:52 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:06:53.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:52 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:06:53.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:52 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:06:53.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:52 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:53.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:52 smithi179 ceph-mon[35652]: osdmap e52: 8 total, 8 up, 8 in 2024-01-31T05:06:53.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:52 smithi179 ceph-mon[35652]: Detected new or changed devices on smithi179 2024-01-31T05:06:53.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:52 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:53.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:52 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:53.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:52 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:06:53.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:52 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:06:53.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:52 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:06:53.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:52 smithi179 ceph-mon[35652]: Adjusting osd_memory_target on smithi179 to 5693M 2024-01-31T05:06:53.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:52 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:53.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:52 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:06:53.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:52 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:06:53.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:52 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:53.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:52 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:06:53.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:52 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:06:53.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:52 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:06:53.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:52 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:06:53.880 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:53 smithi181 ceph-mon[36434]: pgmap v178: 1 pgs: 1 remapped; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-01-31T05:06:53.880 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:53 smithi181 ceph-mon[36434]: osdmap e53: 8 total, 8 up, 8 in 2024-01-31T05:06:53.880 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:53 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-31T05:06:53.880 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:53 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-31T05:06:53.880 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:53 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:06:54.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:53 smithi099 ceph-mon[31615]: pgmap v178: 1 pgs: 1 remapped; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-01-31T05:06:54.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:53 smithi099 ceph-mon[31615]: osdmap e53: 8 total, 8 up, 8 in 2024-01-31T05:06:54.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:53 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-31T05:06:54.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:53 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-31T05:06:54.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:53 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:06:54.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:53 smithi179 ceph-mon[35652]: pgmap v178: 1 pgs: 1 remapped; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-01-31T05:06:54.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:53 smithi179 ceph-mon[35652]: osdmap e53: 8 total, 8 up, 8 in 2024-01-31T05:06:54.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:53 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-31T05:06:54.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:53 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-31T05:06:54.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:53 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:06:54.969 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:54 smithi181 ceph-mon[36434]: from='client.24271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:06:54.970 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:54 smithi181 ceph-mon[36434]: osdmap e54: 8 total, 8 up, 8 in 2024-01-31T05:06:55.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:54 smithi099 ceph-mon[31615]: from='client.24271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:06:55.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:54 smithi099 ceph-mon[31615]: osdmap e54: 8 total, 8 up, 8 in 2024-01-31T05:06:55.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:54 smithi179 ceph-mon[35652]: from='client.24271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:06:55.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:54 smithi179 ceph-mon[35652]: osdmap e54: 8 total, 8 up, 8 in 2024-01-31T05:06:55.958 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:55 smithi181 ceph-mon[36434]: pgmap v181: 1 pgs: 1 remapped; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-01-31T05:06:55.958 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:55 smithi181 ceph-mon[36434]: osdmap e55: 8 total, 8 up, 8 in 2024-01-31T05:06:55.958 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:55 smithi181 ceph-mon[36434]: from='client.? 172.21.15.181:0/1450403063' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "10a73592-4251-4492-b67d-ce9b9d7fff32"}]: dispatch 2024-01-31T05:06:55.958 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:55 smithi181 ceph-mon[36434]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "10a73592-4251-4492-b67d-ce9b9d7fff32"}]: dispatch 2024-01-31T05:06:55.958 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:55 smithi181 ceph-mon[36434]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "10a73592-4251-4492-b67d-ce9b9d7fff32"}]': finished 2024-01-31T05:06:55.958 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:55 smithi181 ceph-mon[36434]: osdmap e56: 9 total, 8 up, 9 in 2024-01-31T05:06:55.958 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:55 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-01-31T05:06:56.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:55 smithi099 ceph-mon[31615]: pgmap v181: 1 pgs: 1 remapped; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-01-31T05:06:56.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:55 smithi099 ceph-mon[31615]: osdmap e55: 8 total, 8 up, 8 in 2024-01-31T05:06:56.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:55 smithi099 ceph-mon[31615]: from='client.? 172.21.15.181:0/1450403063' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "10a73592-4251-4492-b67d-ce9b9d7fff32"}]: dispatch 2024-01-31T05:06:56.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:55 smithi099 ceph-mon[31615]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "10a73592-4251-4492-b67d-ce9b9d7fff32"}]: dispatch 2024-01-31T05:06:56.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:55 smithi099 ceph-mon[31615]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "10a73592-4251-4492-b67d-ce9b9d7fff32"}]': finished 2024-01-31T05:06:56.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:55 smithi099 ceph-mon[31615]: osdmap e56: 9 total, 8 up, 9 in 2024-01-31T05:06:56.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:55 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-01-31T05:06:56.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:55 smithi179 ceph-mon[35652]: pgmap v181: 1 pgs: 1 remapped; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-01-31T05:06:56.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:55 smithi179 ceph-mon[35652]: osdmap e55: 8 total, 8 up, 8 in 2024-01-31T05:06:56.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:55 smithi179 ceph-mon[35652]: from='client.? 172.21.15.181:0/1450403063' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "10a73592-4251-4492-b67d-ce9b9d7fff32"}]: dispatch 2024-01-31T05:06:56.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:55 smithi179 ceph-mon[35652]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "10a73592-4251-4492-b67d-ce9b9d7fff32"}]: dispatch 2024-01-31T05:06:56.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:55 smithi179 ceph-mon[35652]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "10a73592-4251-4492-b67d-ce9b9d7fff32"}]': finished 2024-01-31T05:06:56.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:55 smithi179 ceph-mon[35652]: osdmap e56: 9 total, 8 up, 9 in 2024-01-31T05:06:56.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:55 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-01-31T05:06:57.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:56 smithi099 ceph-mon[31615]: from='client.? 172.21.15.181:0/3248361487' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-31T05:06:57.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:56 smithi181 ceph-mon[36434]: from='client.? 172.21.15.181:0/3248361487' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-31T05:06:57.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:56 smithi179 ceph-mon[35652]: from='client.? 172.21.15.181:0/3248361487' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-31T05:06:58.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:57 smithi099 ceph-mon[31615]: pgmap v184: 1 pgs: 1 remapped; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-01-31T05:06:58.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:57 smithi181 ceph-mon[36434]: pgmap v184: 1 pgs: 1 remapped; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-01-31T05:06:58.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:57 smithi179 ceph-mon[35652]: pgmap v184: 1 pgs: 1 remapped; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-01-31T05:06:59.816 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:06:59 smithi181 ceph-mon[36434]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-01-31T05:07:00.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:06:59 smithi099 ceph-mon[31615]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-01-31T05:07:00.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:06:59 smithi179 ceph-mon[35652]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-01-31T05:07:01.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:01 smithi181 ceph-mon[36434]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-01-31T05:07:02.066 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:01 smithi099 ceph-mon[31615]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-01-31T05:07:02.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:01 smithi179 ceph-mon[35652]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-01-31T05:07:03.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:03 smithi179 ceph-mon[35652]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-01-31T05:07:03.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:03 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-01-31T05:07:03.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:03 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:07:03.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:03 smithi179 ceph-mon[35652]: Deploying daemon osd.8 on smithi181 2024-01-31T05:07:03.448 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:03 smithi181 ceph-mon[36434]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-01-31T05:07:03.448 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:03 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-01-31T05:07:03.449 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:03 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:07:03.449 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:03 smithi181 ceph-mon[36434]: Deploying daemon osd.8 on smithi181 2024-01-31T05:07:03.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:03 smithi099 ceph-mon[31615]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-01-31T05:07:03.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:03 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-01-31T05:07:03.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:03 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:07:03.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:03 smithi099 ceph-mon[31615]: Deploying daemon osd.8 on smithi181 2024-01-31T05:07:05.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:05 smithi179 ceph-mon[35652]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-01-31T05:07:05.985 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:05 smithi181 ceph-mon[36434]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-01-31T05:07:06.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:05 smithi099 ceph-mon[31615]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-01-31T05:07:07.745 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:07 smithi181 ceph-mon[36434]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-01-31T05:07:07.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:07 smithi179 ceph-mon[35652]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-01-31T05:07:08.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:07 smithi099 ceph-mon[31615]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-01-31T05:07:09.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:08 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:09.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:08 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:09.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:08 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:07:09.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:08 smithi099 ceph-mon[31615]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-01-31T05:07:09.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:08 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:09.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:08 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:09.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:08 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:07:09.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:08 smithi181 ceph-mon[36434]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-01-31T05:07:09.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:08 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:09.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:08 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:09.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:08 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:07:09.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:08 smithi179 ceph-mon[35652]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-01-31T05:07:11.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:07:11.168+0000 7f9ce5ffb700 1 -- 172.21.15.181:0/1542404703 <== mgr.14152 v2:172.21.15.99:6800/3925720924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f9ce802d5b0 con 0x7f9cd80a1370 2024-01-31T05:07:11.168 INFO:teuthology.orchestra.run.smithi181.stdout:Created osd(s) 8 on host 'smithi181' 2024-01-31T05:07:11.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:07:11.170+0000 7f9ceeb62700 1 -- 172.21.15.181:0/1542404703 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f9cd80a1370 msgr2=0x7f9cd80a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:07:11.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:07:11.170+0000 7f9ceeb62700 1 --2- 172.21.15.181:0/1542404703 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f9cd80a1370 0x7f9cd80a3830 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8102870 tx=0x7f9cdc00b410 comp rx=0 tx=0).stop 2024-01-31T05:07:11.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:07:11.170+0000 7f9ceeb62700 1 -- 172.21.15.181:0/1542404703 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ce8102a10 msgr2=0x7f9ce8197bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:07:11.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:07:11.170+0000 7f9ceeb62700 1 --2- 172.21.15.181:0/1542404703 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ce8102a10 0x7f9ce8197bf0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9cd400b5c0 tx=0x7f9cd400f690 comp rx=0 tx=0).stop 2024-01-31T05:07:11.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:07:11.170+0000 7f9ceeb62700 1 -- 172.21.15.181:0/1542404703 shutdown_connections 2024-01-31T05:07:11.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:07:11.170+0000 7f9ceeb62700 1 --2- 172.21.15.181:0/1542404703 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ce81033b0 0x7f9ce819ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:07:11.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:07:11.170+0000 7f9ceeb62700 1 --2- 172.21.15.181:0/1542404703 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f9cd80a1370 0x7f9cd80a3830 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:07:11.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:07:11.170+0000 7f9ceeb62700 1 --2- 172.21.15.181:0/1542404703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ce8101810 0x7f9ce81976b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:07:11.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:07:11.170+0000 7f9ceeb62700 1 --2- 172.21.15.181:0/1542404703 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ce8102a10 0x7f9ce8197bf0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:07:11.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:07:11.170+0000 7f9ceeb62700 1 -- 172.21.15.181:0/1542404703 >> 172.21.15.181:0/1542404703 conn(0x7f9ce80fcdf0 msgr2=0x7f9ce8105e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:07:11.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:07:11.171+0000 7f9ceeb62700 1 -- 172.21.15.181:0/1542404703 shutdown_connections 2024-01-31T05:07:11.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:07:11.171+0000 7f9ceeb62700 1 -- 172.21.15.181:0/1542404703 wait complete. 2024-01-31T05:07:11.721 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:11 smithi181 ceph-mon[36434]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-01-31T05:07:11.721 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:11 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:11.721 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:11 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:11.746 DEBUG:teuthology.orchestra.run.smithi181:osd.8> sudo journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@osd.8.service 2024-01-31T05:07:11.748 INFO:tasks.cephadm:Deploying osd.9 on smithi099 with /dev/vg_nvme/lv_1... 2024-01-31T05:07:11.749 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-01-31T05:07:11.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:11 smithi179 ceph-mon[35652]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-01-31T05:07:11.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:11 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:11.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:11 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:11.999 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:07:12.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:11 smithi099 ceph-mon[31615]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-01-31T05:07:12.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:11 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:12.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:11 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:12.071 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:07:11 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:07:11.858+0000 7f28b27187c0 -1 osd.8 0 log_to_monitors true 2024-01-31T05:07:12.808 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:12 smithi181 ceph-mon[36434]: from='osd.8 [v2:172.21.15.181:6816/179568936,v1:172.21.15.181:6817/179568936]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-01-31T05:07:12.808 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:12 smithi181 ceph-mon[36434]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-01-31T05:07:12.808 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:12 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:12.808 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:12 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:12.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:12 smithi099 ceph-mon[31615]: from='osd.8 [v2:172.21.15.181:6816/179568936,v1:172.21.15.181:6817/179568936]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-01-31T05:07:12.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:12 smithi099 ceph-mon[31615]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-01-31T05:07:12.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:12 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:12.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:12 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:12.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:12 smithi179 ceph-mon[35652]: from='osd.8 [v2:172.21.15.181:6816/179568936,v1:172.21.15.181:6817/179568936]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-01-31T05:07:12.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:12 smithi179 ceph-mon[35652]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-01-31T05:07:12.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:12 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:12.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:12 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:13.766 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:13 smithi099 ceph-mon[31615]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-01-31T05:07:13.766 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:13 smithi099 ceph-mon[31615]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-01-31T05:07:13.767 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:13 smithi099 ceph-mon[31615]: osdmap e57: 9 total, 8 up, 9 in 2024-01-31T05:07:13.767 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:13 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-01-31T05:07:13.767 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:13 smithi099 ceph-mon[31615]: from='osd.8 [v2:172.21.15.181:6816/179568936,v1:172.21.15.181:6817/179568936]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-01-31T05:07:13.767 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:13 smithi099 ceph-mon[31615]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-01-31T05:07:14.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:13 smithi181 ceph-mon[36434]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-01-31T05:07:14.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:13 smithi181 ceph-mon[36434]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-01-31T05:07:14.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:13 smithi181 ceph-mon[36434]: osdmap e57: 9 total, 8 up, 9 in 2024-01-31T05:07:14.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:13 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-01-31T05:07:14.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:13 smithi181 ceph-mon[36434]: from='osd.8 [v2:172.21.15.181:6816/179568936,v1:172.21.15.181:6817/179568936]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-01-31T05:07:14.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:13 smithi181 ceph-mon[36434]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-01-31T05:07:14.082 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:13 smithi179 ceph-mon[35652]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-01-31T05:07:14.082 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:13 smithi179 ceph-mon[35652]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-01-31T05:07:14.082 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:13 smithi179 ceph-mon[35652]: osdmap e57: 9 total, 8 up, 9 in 2024-01-31T05:07:14.082 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:13 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-01-31T05:07:14.082 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:13 smithi179 ceph-mon[35652]: from='osd.8 [v2:172.21.15.181:6816/179568936,v1:172.21.15.181:6817/179568936]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-01-31T05:07:14.082 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:13 smithi179 ceph-mon[35652]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-01-31T05:07:14.120 INFO:teuthology.orchestra.run.smithi099.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-01-31T05:07:14.120 INFO:teuthology.orchestra.run.smithi099.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-01-31T05:07:14.120 INFO:teuthology.orchestra.run.smithi099.stderr: stderr: 10+0 records in 2024-01-31T05:07:14.120 INFO:teuthology.orchestra.run.smithi099.stderr:10+0 records out 2024-01-31T05:07:14.120 INFO:teuthology.orchestra.run.smithi099.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0115293 s, 909 MB/s 2024-01-31T05:07:14.120 INFO:teuthology.orchestra.run.smithi099.stderr:--> Zapping successful for: 2024-01-31T05:07:14.780 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:14 smithi099 ceph-mon[31615]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-01-31T05:07:14.780 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:14 smithi099 ceph-mon[31615]: osdmap e58: 9 total, 8 up, 9 in 2024-01-31T05:07:14.780 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:14 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-01-31T05:07:14.780 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:14 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-01-31T05:07:14.780 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:14 smithi099 ceph-mon[31615]: from='osd.8 ' entity='osd.8' 2024-01-31T05:07:14.814 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph orch daemon add osd smithi099:vg_nvme/lv_1 2024-01-31T05:07:14.821 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:07:14 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:07:14.458+0000 7f28a757d700 -1 osd.8 0 waiting for initial osdmap 2024-01-31T05:07:14.821 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:07:14 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:07:14.473+0000 7f289fb70700 -1 osd.8 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-31T05:07:14.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:14 smithi181 ceph-mon[36434]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-01-31T05:07:14.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:14 smithi181 ceph-mon[36434]: osdmap e58: 9 total, 8 up, 9 in 2024-01-31T05:07:14.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:14 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-01-31T05:07:14.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:14 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-01-31T05:07:14.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:14 smithi181 ceph-mon[36434]: from='osd.8 ' entity='osd.8' 2024-01-31T05:07:15.056 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:07:15.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:14 smithi179 ceph-mon[35652]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-01-31T05:07:15.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:14 smithi179 ceph-mon[35652]: osdmap e58: 9 total, 8 up, 9 in 2024-01-31T05:07:15.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:14 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-01-31T05:07:15.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:14 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-01-31T05:07:15.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:14 smithi179 ceph-mon[35652]: from='osd.8 ' entity='osd.8' 2024-01-31T05:07:15.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:15 smithi099 ceph-mon[31615]: purged_snaps scrub starts 2024-01-31T05:07:15.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:15 smithi099 ceph-mon[31615]: purged_snaps scrub ok 2024-01-31T05:07:15.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:15 smithi099 ceph-mon[31615]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-01-31T05:07:15.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:15 smithi099 ceph-mon[31615]: osd.8 [v2:172.21.15.181:6816/179568936,v1:172.21.15.181:6817/179568936] boot 2024-01-31T05:07:15.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:15 smithi099 ceph-mon[31615]: osdmap e59: 9 total, 9 up, 9 in 2024-01-31T05:07:15.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:15 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-01-31T05:07:15.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:15 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:15.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:15 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:15.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:15 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:07:15.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:15 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:07:15.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:15 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:07:15.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:15 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:15.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:15 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:07:15.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:15 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:07:15.820 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:15 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:15.820 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:15 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:07:15.820 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:15 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:07:15.820 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:15 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:07:15.820 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:15 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:16.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:15 smithi181 ceph-mon[36434]: purged_snaps scrub starts 2024-01-31T05:07:16.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:15 smithi181 ceph-mon[36434]: purged_snaps scrub ok 2024-01-31T05:07:16.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:15 smithi181 ceph-mon[36434]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-01-31T05:07:16.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:15 smithi181 ceph-mon[36434]: osd.8 [v2:172.21.15.181:6816/179568936,v1:172.21.15.181:6817/179568936] boot 2024-01-31T05:07:16.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:15 smithi181 ceph-mon[36434]: osdmap e59: 9 total, 9 up, 9 in 2024-01-31T05:07:16.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:15 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-01-31T05:07:16.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:15 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:16.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:15 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:16.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:15 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:07:16.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:15 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:07:16.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:15 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:07:16.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:15 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:16.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:15 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:07:16.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:15 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:07:16.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:15 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:16.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:15 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:07:16.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:15 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:07:16.073 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:15 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:07:16.073 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:15 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:16.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:15 smithi179 ceph-mon[35652]: purged_snaps scrub starts 2024-01-31T05:07:16.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:15 smithi179 ceph-mon[35652]: purged_snaps scrub ok 2024-01-31T05:07:16.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:15 smithi179 ceph-mon[35652]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-01-31T05:07:16.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:15 smithi179 ceph-mon[35652]: osd.8 [v2:172.21.15.181:6816/179568936,v1:172.21.15.181:6817/179568936] boot 2024-01-31T05:07:16.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:15 smithi179 ceph-mon[35652]: osdmap e59: 9 total, 9 up, 9 in 2024-01-31T05:07:16.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-01-31T05:07:16.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:16.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:16.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:07:16.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:07:16.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:07:16.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:16.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:07:16.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:07:16.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:16.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:07:16.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:07:16.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:07:16.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:15 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:16.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:16.828+0000 7f2b0a3a7700 1 -- 172.21.15.99:0/2446805968 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b04100710 msgr2=0x7f2b04100b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:07:16.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:16.828+0000 7f2b0a3a7700 1 --2- 172.21.15.99:0/2446805968 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b04100710 0x7f2b04100b30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2af40099c0 tx=0x7f2af4009cd0 comp rx=0 tx=0).stop 2024-01-31T05:07:16.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:16.828+0000 7f2b0a3a7700 1 -- 172.21.15.99:0/2446805968 shutdown_connections 2024-01-31T05:07:16.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:16.828+0000 7f2b0a3a7700 1 --2- 172.21.15.99:0/2446805968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b041022b0 0x7f2b04108b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:07:16.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:16.828+0000 7f2b0a3a7700 1 --2- 172.21.15.99:0/2446805968 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b04100710 0x7f2b04100b30 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:07:16.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:16.828+0000 7f2b0a3a7700 1 --2- 172.21.15.99:0/2446805968 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b04101910 0x7f2b04101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:07:16.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:16.828+0000 7f2b0a3a7700 1 -- 172.21.15.99:0/2446805968 >> 172.21.15.99:0/2446805968 conn(0x7f2b040fbcb0 msgr2=0x7f2b040fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:07:16.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:16.828+0000 7f2b0a3a7700 1 -- 172.21.15.99:0/2446805968 shutdown_connections 2024-01-31T05:07:16.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:16.828+0000 7f2b0a3a7700 1 -- 172.21.15.99:0/2446805968 wait complete. 2024-01-31T05:07:16.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:16.829+0000 7f2b0a3a7700 1 Processor -- start 2024-01-31T05:07:16.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:16.829+0000 7f2b0a3a7700 1 -- start start 2024-01-31T05:07:16.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:16.829+0000 7f2b0a3a7700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b04100710 0x7f2b041046a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:07:16.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:16.829+0000 7f2b0a3a7700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b04101910 0x7f2b04102cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:07:16.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:16.829+0000 7f2b0a3a7700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b041022b0 0x7f2b04103230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:07:16.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:16.829+0000 7f2b0a3a7700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b041039b0 con 0x7f2b04101910 2024-01-31T05:07:16.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:16.829+0000 7f2b0a3a7700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b04103b20 con 0x7f2b04100710 2024-01-31T05:07:16.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:16.829+0000 7f2b0a3a7700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b041a17d0 con 0x7f2b041022b0 2024-01-31T05:07:16.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:16.829+0000 7f2b037fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b04101910 0x7f2b04102cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:07:16.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:16.829+0000 7f2b037fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b04101910 0x7f2b04102cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60858/0 (socket says 172.21.15.99:60858) 2024-01-31T05:07:16.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:16.829+0000 7f2b037fe700 1 -- 172.21.15.99:0/3146687031 learned_addr learned my addr 172.21.15.99:0/3146687031 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:07:16.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:16.829+0000 7f2b03fff700 1 --2- 172.21.15.99:0/3146687031 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b04100710 0x7f2b041046a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:07:16.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:16.829+0000 7f2b08944700 1 --2- 172.21.15.99:0/3146687031 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b041022b0 0x7f2b04103230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:07:16.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:16.829+0000 7f2b037fe700 1 -- 172.21.15.99:0/3146687031 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b041022b0 msgr2=0x7f2b04103230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:07:16.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:16.829+0000 7f2b037fe700 1 --2- 172.21.15.99:0/3146687031 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b041022b0 0x7f2b04103230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:07:16.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:16.829+0000 7f2b037fe700 1 -- 172.21.15.99:0/3146687031 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b04100710 msgr2=0x7f2b041046a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:07:16.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:16.829+0000 7f2b037fe700 1 --2- 172.21.15.99:0/3146687031 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b04100710 0x7f2b041046a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:07:16.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:16.830+0000 7f2b037fe700 1 -- 172.21.15.99:0/3146687031 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af40095f0 con 0x7f2b04101910 2024-01-31T05:07:16.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:16.830+0000 7f2b037fe700 1 --2- 172.21.15.99:0/3146687031 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b04101910 0x7f2b04102cf0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2af800c920 tx=0x7f2af800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:07:16.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:16.830+0000 7f2b017fa700 1 -- 172.21.15.99:0/3146687031 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af8007b00 con 0x7f2b04101910 2024-01-31T05:07:16.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:16.830+0000 7f2b0a3a7700 1 -- 172.21.15.99:0/3146687031 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b041a1ab0 con 0x7f2b04101910 2024-01-31T05:07:16.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:16.830+0000 7f2b017fa700 1 -- 172.21.15.99:0/3146687031 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2af800ce70 con 0x7f2b04101910 2024-01-31T05:07:16.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:16.830+0000 7f2b017fa700 1 -- 172.21.15.99:0/3146687031 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af8005460 con 0x7f2b04101910 2024-01-31T05:07:16.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:16.830+0000 7f2b0a3a7700 1 -- 172.21.15.99:0/3146687031 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b041a2000 con 0x7f2b04101910 2024-01-31T05:07:16.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:16.831+0000 7f2b0a3a7700 1 -- 172.21.15.99:0/3146687031 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b040684a0 con 0x7f2b04101910 2024-01-31T05:07:16.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:16.832+0000 7f2b017fa700 1 -- 172.21.15.99:0/3146687031 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f2af8004750 con 0x7f2b04101910 2024-01-31T05:07:16.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:16.832+0000 7f2b017fa700 1 --2- 172.21.15.99:0/3146687031 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2aec0a1370 0x7f2aec0a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:07:16.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:16.833+0000 7f2b03fff700 1 --2- 172.21.15.99:0/3146687031 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2aec0a1370 0x7f2aec0a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:07:16.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:16.833+0000 7f2b017fa700 1 -- 172.21.15.99:0/3146687031 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5858+0+0 (secure 0 0 0) 0x7f2af80cbdb0 con 0x7f2b04101910 2024-01-31T05:07:16.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:16.833+0000 7f2b03fff700 1 --2- 172.21.15.99:0/3146687031 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2aec0a1370 0x7f2aec0a3830 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2af4006010 tx=0x7f2af4005340 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:07:16.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:16.837+0000 7f2b017fa700 1 -- 172.21.15.99:0/3146687031 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f2af8095bc0 con 0x7f2b04101910 2024-01-31T05:07:17.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:17.038+0000 7f2b0a3a7700 1 -- 172.21.15.99:0/3146687031 --> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b040fdef0 con 0x7f2aec0a1370 2024-01-31T05:07:17.038 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:16 smithi099 ceph-mon[31615]: Detected new or changed devices on smithi181 2024-01-31T05:07:17.038 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:16 smithi099 ceph-mon[31615]: Adjusting osd_memory_target on smithi181 to 5693M 2024-01-31T05:07:17.039 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:16 smithi099 ceph-mon[31615]: osdmap e60: 9 total, 9 up, 9 in 2024-01-31T05:07:17.039 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:16 smithi099 ceph-mon[31615]: osdmap e61: 9 total, 9 up, 9 in 2024-01-31T05:07:17.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:16 smithi181 ceph-mon[36434]: Detected new or changed devices on smithi181 2024-01-31T05:07:17.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:16 smithi181 ceph-mon[36434]: Adjusting osd_memory_target on smithi181 to 5693M 2024-01-31T05:07:17.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:16 smithi181 ceph-mon[36434]: osdmap e60: 9 total, 9 up, 9 in 2024-01-31T05:07:17.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:16 smithi181 ceph-mon[36434]: osdmap e61: 9 total, 9 up, 9 in 2024-01-31T05:07:17.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:16 smithi179 ceph-mon[35652]: Detected new or changed devices on smithi181 2024-01-31T05:07:17.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:16 smithi179 ceph-mon[35652]: Adjusting osd_memory_target on smithi181 to 5693M 2024-01-31T05:07:17.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:16 smithi179 ceph-mon[35652]: osdmap e60: 9 total, 9 up, 9 in 2024-01-31T05:07:17.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:16 smithi179 ceph-mon[35652]: osdmap e61: 9 total, 9 up, 9 in 2024-01-31T05:07:17.945 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:17 smithi099 ceph-mon[31615]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-01-31T05:07:17.945 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:17 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-31T05:07:17.945 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:17 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-31T05:07:17.945 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:17 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:07:17.945 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:17 smithi099 ceph-mon[31615]: osdmap e62: 9 total, 9 up, 9 in 2024-01-31T05:07:18.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:17 smithi181 ceph-mon[36434]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-01-31T05:07:18.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:17 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-31T05:07:18.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:17 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-31T05:07:18.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:17 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:07:18.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:17 smithi181 ceph-mon[36434]: osdmap e62: 9 total, 9 up, 9 in 2024-01-31T05:07:18.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:17 smithi179 ceph-mon[35652]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-01-31T05:07:18.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:17 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-31T05:07:18.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:17 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-31T05:07:18.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:17 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:07:18.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:17 smithi179 ceph-mon[35652]: osdmap e62: 9 total, 9 up, 9 in 2024-01-31T05:07:18.872 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:18 smithi099 ceph-mon[31615]: from='client.14400 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:07:18.872 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:18 smithi099 ceph-mon[31615]: osdmap e63: 9 total, 9 up, 9 in 2024-01-31T05:07:19.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:18 smithi181 ceph-mon[36434]: from='client.14400 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:07:19.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:18 smithi181 ceph-mon[36434]: osdmap e63: 9 total, 9 up, 9 in 2024-01-31T05:07:19.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:18 smithi179 ceph-mon[35652]: from='client.14400 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:07:19.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:18 smithi179 ceph-mon[35652]: osdmap e63: 9 total, 9 up, 9 in 2024-01-31T05:07:20.054 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:19 smithi099 ceph-mon[31615]: pgmap v202: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 147 KiB/s, 0 objects/s recovering 2024-01-31T05:07:20.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:19 smithi181 ceph-mon[36434]: pgmap v202: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 147 KiB/s, 0 objects/s recovering 2024-01-31T05:07:20.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:19 smithi179 ceph-mon[35652]: pgmap v202: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 147 KiB/s, 0 objects/s recovering 2024-01-31T05:07:20.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:20 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/1523602983' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f6620e1e-f761-4f1c-917f-cbc748df32a8"}]: dispatch 2024-01-31T05:07:20.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:20 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/1523602983' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f6620e1e-f761-4f1c-917f-cbc748df32a8"}]': finished 2024-01-31T05:07:20.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:20 smithi099 ceph-mon[31615]: osdmap e64: 10 total, 9 up, 10 in 2024-01-31T05:07:20.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:20 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-31T05:07:20.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:20 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/3880664491' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-31T05:07:20.819 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:07:20 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:07:20.542+0000 7f494f237700 -1 calc_pg_upmaps abort due to max <= 0 2024-01-31T05:07:21.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:20 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/1523602983' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f6620e1e-f761-4f1c-917f-cbc748df32a8"}]: dispatch 2024-01-31T05:07:21.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:20 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/1523602983' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f6620e1e-f761-4f1c-917f-cbc748df32a8"}]': finished 2024-01-31T05:07:21.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:20 smithi181 ceph-mon[36434]: osdmap e64: 10 total, 9 up, 10 in 2024-01-31T05:07:21.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:20 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-31T05:07:21.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:20 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/3880664491' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-31T05:07:21.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:20 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/1523602983' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f6620e1e-f761-4f1c-917f-cbc748df32a8"}]: dispatch 2024-01-31T05:07:21.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:20 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/1523602983' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f6620e1e-f761-4f1c-917f-cbc748df32a8"}]': finished 2024-01-31T05:07:21.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:20 smithi179 ceph-mon[35652]: osdmap e64: 10 total, 9 up, 10 in 2024-01-31T05:07:21.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:20 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-31T05:07:21.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:20 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/3880664491' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-31T05:07:22.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:21 smithi099 ceph-mon[31615]: pgmap v204: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-01-31T05:07:22.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:21 smithi181 ceph-mon[36434]: pgmap v204: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-01-31T05:07:22.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:21 smithi179 ceph-mon[35652]: pgmap v204: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-01-31T05:07:23.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:23 smithi099 ceph-mon[31615]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-01-31T05:07:23.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:23 smithi181 ceph-mon[36434]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-01-31T05:07:23.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:23 smithi179 ceph-mon[35652]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-01-31T05:07:25.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:25 smithi099 ceph-mon[31615]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-01-31T05:07:25.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:25 smithi179 ceph-mon[35652]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-01-31T05:07:26.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:25 smithi181 ceph-mon[36434]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-01-31T05:07:27.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:27 smithi099 ceph-mon[31615]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-01-31T05:07:27.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:27 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-01-31T05:07:27.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:27 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:07:27.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:27 smithi179 ceph-mon[35652]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-01-31T05:07:27.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:27 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-01-31T05:07:27.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:27 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:07:28.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:27 smithi181 ceph-mon[36434]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-01-31T05:07:28.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:27 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-01-31T05:07:28.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:27 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:07:28.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:28 smithi099 ceph-mon[31615]: Deploying daemon osd.9 on smithi099 2024-01-31T05:07:28.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:28 smithi179 ceph-mon[35652]: Deploying daemon osd.9 on smithi099 2024-01-31T05:07:29.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:28 smithi181 ceph-mon[36434]: Deploying daemon osd.9 on smithi099 2024-01-31T05:07:29.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:29 smithi179 ceph-mon[35652]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-01-31T05:07:29.891 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:29 smithi099 ceph-mon[31615]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-01-31T05:07:30.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:29 smithi181 ceph-mon[36434]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-01-31T05:07:31.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:31 smithi099 ceph-mon[31615]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-01-31T05:07:32.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:31 smithi181 ceph-mon[36434]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-01-31T05:07:32.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:31 smithi179 ceph-mon[35652]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-01-31T05:07:33.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:33 smithi099 ceph-mon[31615]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-01-31T05:07:33.603 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:33 smithi181 ceph-mon[36434]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-01-31T05:07:33.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:33 smithi179 ceph-mon[35652]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-01-31T05:07:34.283 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:34 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:07:34.283 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:34 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:34.283 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:34 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:34.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:34 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:07:34.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:34 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:34.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:34 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:34.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:34 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:07:34.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:34 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:34.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:34 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:35.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:35 smithi099 ceph-mon[31615]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-01-31T05:07:35.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:35 smithi181 ceph-mon[36434]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-01-31T05:07:35.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:35 smithi179 ceph-mon[35652]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-01-31T05:07:37.398 INFO:teuthology.orchestra.run.smithi099.stdout:Created osd(s) 9 on host 'smithi099' 2024-01-31T05:07:37.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:37.397+0000 7f2b017fa700 1 -- 172.21.15.99:0/3146687031 <== mgr.14152 v2:172.21.15.99:6800/3925720924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f2b040fdef0 con 0x7f2aec0a1370 2024-01-31T05:07:37.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:37.400+0000 7f2b0a3a7700 1 -- 172.21.15.99:0/3146687031 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2aec0a1370 msgr2=0x7f2aec0a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:07:37.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:37.400+0000 7f2b0a3a7700 1 --2- 172.21.15.99:0/3146687031 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2aec0a1370 0x7f2aec0a3830 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2af4006010 tx=0x7f2af4005340 comp rx=0 tx=0).stop 2024-01-31T05:07:37.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:37.400+0000 7f2b0a3a7700 1 -- 172.21.15.99:0/3146687031 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b04101910 msgr2=0x7f2b04102cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:07:37.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:37.400+0000 7f2b0a3a7700 1 --2- 172.21.15.99:0/3146687031 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b04101910 0x7f2b04102cf0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2af800c920 tx=0x7f2af800cc30 comp rx=0 tx=0).stop 2024-01-31T05:07:37.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:37.400+0000 7f2b0a3a7700 1 -- 172.21.15.99:0/3146687031 shutdown_connections 2024-01-31T05:07:37.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:37.400+0000 7f2b0a3a7700 1 --2- 172.21.15.99:0/3146687031 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b041022b0 0x7f2b04103230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:07:37.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:37.400+0000 7f2b0a3a7700 1 --2- 172.21.15.99:0/3146687031 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2aec0a1370 0x7f2aec0a3830 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:07:37.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:37.400+0000 7f2b0a3a7700 1 --2- 172.21.15.99:0/3146687031 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b04100710 0x7f2b041046a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:07:37.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:37.400+0000 7f2b0a3a7700 1 --2- 172.21.15.99:0/3146687031 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b04101910 0x7f2b04102cf0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:07:37.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:37.400+0000 7f2b0a3a7700 1 -- 172.21.15.99:0/3146687031 >> 172.21.15.99:0/3146687031 conn(0x7f2b040fbcb0 msgr2=0x7f2b040fd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:07:37.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:37.400+0000 7f2b0a3a7700 1 -- 172.21.15.99:0/3146687031 shutdown_connections 2024-01-31T05:07:37.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:07:37.400+0000 7f2b0a3a7700 1 -- 172.21.15.99:0/3146687031 wait complete. 2024-01-31T05:07:37.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:37 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:37.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:37 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:37.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:37 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:07:37.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:37 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:07:37.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:37 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:37.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:37 smithi099 ceph-mon[31615]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-01-31T05:07:37.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:37 smithi099 ceph-mon[31615]: from='osd.9 [v2:172.21.15.99:6826/315759515,v1:172.21.15.99:6827/315759515]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-01-31T05:07:37.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:37 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:37.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:37 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:07:37.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:37 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:37.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:37 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:37.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:37 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:37.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:37 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:07:37.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:37 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:07:37.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:37 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:37.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:37 smithi181 ceph-mon[36434]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-01-31T05:07:37.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:37 smithi181 ceph-mon[36434]: from='osd.9 [v2:172.21.15.99:6826/315759515,v1:172.21.15.99:6827/315759515]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-01-31T05:07:37.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:37 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:37.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:37 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:07:37.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:37 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:37.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:37 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:37.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:37 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:37.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:37 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:07:37.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:37 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:07:37.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:37 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:37.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:37 smithi179 ceph-mon[35652]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-01-31T05:07:37.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:37 smithi179 ceph-mon[35652]: from='osd.9 [v2:172.21.15.99:6826/315759515,v1:172.21.15.99:6827/315759515]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-01-31T05:07:37.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:37 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:37.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:37 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:07:37.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:37 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:38.079 DEBUG:teuthology.orchestra.run.smithi099:osd.9> sudo journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@osd.9.service 2024-01-31T05:07:38.081 INFO:tasks.cephadm:Deploying osd.10 on smithi179 with /dev/vg_nvme/lv_1... 2024-01-31T05:07:38.081 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-01-31T05:07:38.326 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.b/config 2024-01-31T05:07:39.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:39 smithi099 ceph-mon[31615]: from='osd.9 [v2:172.21.15.99:6826/315759515,v1:172.21.15.99:6827/315759515]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-01-31T05:07:39.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:39 smithi099 ceph-mon[31615]: osdmap e65: 10 total, 9 up, 10 in 2024-01-31T05:07:39.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:39 smithi099 ceph-mon[31615]: from='osd.9 [v2:172.21.15.99:6826/315759515,v1:172.21.15.99:6827/315759515]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-31T05:07:39.320 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:39 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-31T05:07:39.320 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:39 smithi099 ceph-mon[31615]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-01-31T05:07:39.320 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:07:39 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:07:39.141+0000 7f23a3fef700 -1 osd.9 0 waiting for initial osdmap 2024-01-31T05:07:39.320 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:07:39 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:07:39.155+0000 7f23a05ea700 -1 osd.9 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-31T05:07:39.390 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:39 smithi179 ceph-mon[35652]: from='osd.9 [v2:172.21.15.99:6826/315759515,v1:172.21.15.99:6827/315759515]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-01-31T05:07:39.390 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:39 smithi179 ceph-mon[35652]: osdmap e65: 10 total, 9 up, 10 in 2024-01-31T05:07:39.390 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:39 smithi179 ceph-mon[35652]: from='osd.9 [v2:172.21.15.99:6826/315759515,v1:172.21.15.99:6827/315759515]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-31T05:07:39.390 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:39 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-31T05:07:39.390 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:39 smithi179 ceph-mon[35652]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-01-31T05:07:39.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:39 smithi181 ceph-mon[36434]: from='osd.9 [v2:172.21.15.99:6826/315759515,v1:172.21.15.99:6827/315759515]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-01-31T05:07:39.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:39 smithi181 ceph-mon[36434]: osdmap e65: 10 total, 9 up, 10 in 2024-01-31T05:07:39.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:39 smithi181 ceph-mon[36434]: from='osd.9 [v2:172.21.15.99:6826/315759515,v1:172.21.15.99:6827/315759515]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-01-31T05:07:39.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:39 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-31T05:07:39.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:39 smithi181 ceph-mon[36434]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-01-31T05:07:40.234 INFO:teuthology.orchestra.run.smithi179.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-01-31T05:07:40.234 INFO:teuthology.orchestra.run.smithi179.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-01-31T05:07:40.234 INFO:teuthology.orchestra.run.smithi179.stderr: stderr: 10+0 records in 2024-01-31T05:07:40.234 INFO:teuthology.orchestra.run.smithi179.stderr:10+0 records out 2024-01-31T05:07:40.234 INFO:teuthology.orchestra.run.smithi179.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0126541 s, 829 MB/s 2024-01-31T05:07:40.235 INFO:teuthology.orchestra.run.smithi179.stderr:--> Zapping successful for: 2024-01-31T05:07:40.403 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:40 smithi099 ceph-mon[31615]: from='osd.9 [v2:172.21.15.99:6826/315759515,v1:172.21.15.99:6827/315759515]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-01-31T05:07:40.403 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:40 smithi099 ceph-mon[31615]: osdmap e66: 10 total, 9 up, 10 in 2024-01-31T05:07:40.403 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:40 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-31T05:07:40.403 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:40 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-31T05:07:40.414 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:40 smithi179 ceph-mon[35652]: from='osd.9 [v2:172.21.15.99:6826/315759515,v1:172.21.15.99:6827/315759515]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-01-31T05:07:40.414 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:40 smithi179 ceph-mon[35652]: osdmap e66: 10 total, 9 up, 10 in 2024-01-31T05:07:40.414 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:40 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-31T05:07:40.414 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:40 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-31T05:07:40.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:40 smithi181 ceph-mon[36434]: from='osd.9 [v2:172.21.15.99:6826/315759515,v1:172.21.15.99:6827/315759515]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-01-31T05:07:40.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:40 smithi181 ceph-mon[36434]: osdmap e66: 10 total, 9 up, 10 in 2024-01-31T05:07:40.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:40 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-31T05:07:40.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:40 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-31T05:07:40.887 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph orch daemon add osd smithi179:vg_nvme/lv_1 2024-01-31T05:07:41.125 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.b/config 2024-01-31T05:07:41.496 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:41 smithi179 ceph-mon[35652]: purged_snaps scrub starts 2024-01-31T05:07:41.496 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:41 smithi179 ceph-mon[35652]: purged_snaps scrub ok 2024-01-31T05:07:41.497 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:41 smithi179 ceph-mon[35652]: osd.9 [v2:172.21.15.99:6826/315759515,v1:172.21.15.99:6827/315759515] boot 2024-01-31T05:07:41.497 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:41 smithi179 ceph-mon[35652]: osdmap e67: 10 total, 10 up, 10 in 2024-01-31T05:07:41.497 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:41 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-31T05:07:41.497 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:41 smithi179 ceph-mon[35652]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-01-31T05:07:41.497 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:41 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:41.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:41 smithi099 ceph-mon[31615]: purged_snaps scrub starts 2024-01-31T05:07:41.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:41 smithi099 ceph-mon[31615]: purged_snaps scrub ok 2024-01-31T05:07:41.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:41 smithi099 ceph-mon[31615]: osd.9 [v2:172.21.15.99:6826/315759515,v1:172.21.15.99:6827/315759515] boot 2024-01-31T05:07:41.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:41 smithi099 ceph-mon[31615]: osdmap e67: 10 total, 10 up, 10 in 2024-01-31T05:07:41.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:41 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-31T05:07:41.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:41 smithi099 ceph-mon[31615]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-01-31T05:07:41.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:41 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:41.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:41 smithi181 ceph-mon[36434]: purged_snaps scrub starts 2024-01-31T05:07:41.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:41 smithi181 ceph-mon[36434]: purged_snaps scrub ok 2024-01-31T05:07:41.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:41 smithi181 ceph-mon[36434]: osd.9 [v2:172.21.15.99:6826/315759515,v1:172.21.15.99:6827/315759515] boot 2024-01-31T05:07:41.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:41 smithi181 ceph-mon[36434]: osdmap e67: 10 total, 10 up, 10 in 2024-01-31T05:07:41.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:41 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-31T05:07:41.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:41 smithi181 ceph-mon[36434]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-01-31T05:07:41.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:41 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:42.243 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:42 smithi179 ceph-mon[35652]: Detected new or changed devices on smithi099 2024-01-31T05:07:42.243 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:42 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:42.243 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:42 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:07:42.244 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:42 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:07:42.244 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:42 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:07:42.244 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:42 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:07:42.244 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:42 smithi179 ceph-mon[35652]: Adjusting osd_memory_target on smithi099 to 4272M 2024-01-31T05:07:42.244 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:42 smithi179 ceph-mon[35652]: osdmap e68: 10 total, 10 up, 10 in 2024-01-31T05:07:42.244 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:42 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:42.244 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:42 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:07:42.244 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:42 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:07:42.244 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:42 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:42.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:42 smithi099 ceph-mon[31615]: Detected new or changed devices on smithi099 2024-01-31T05:07:42.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:42 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:42.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:42 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:07:42.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:42 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:07:42.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:42 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:07:42.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:42 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:07:42.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:42 smithi099 ceph-mon[31615]: Adjusting osd_memory_target on smithi099 to 4272M 2024-01-31T05:07:42.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:42 smithi099 ceph-mon[31615]: osdmap e68: 10 total, 10 up, 10 in 2024-01-31T05:07:42.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:42 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:42.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:42 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:07:42.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:42 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:07:42.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:42 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:42.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:42 smithi181 ceph-mon[36434]: Detected new or changed devices on smithi099 2024-01-31T05:07:42.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:42 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:42.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:42 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:07:42.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:42 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:07:42.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:42 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:07:42.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:42 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:07:42.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:42 smithi181 ceph-mon[36434]: Adjusting osd_memory_target on smithi099 to 4272M 2024-01-31T05:07:42.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:42 smithi181 ceph-mon[36434]: osdmap e68: 10 total, 10 up, 10 in 2024-01-31T05:07:42.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:42 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:42.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:42 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:07:42.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:42 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:07:42.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:42 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:42.775 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:07:42.774+0000 7fe38e7aa700 1 -- 172.21.15.179:0/3076098351 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe388100980 msgr2=0x7fe388100e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:07:42.776 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:07:42.774+0000 7fe38e7aa700 1 --2- 172.21.15.179:0/3076098351 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe388100980 0x7fe388100e00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe37c009990 tx=0x7fe37c009ca0 comp rx=0 tx=0).stop 2024-01-31T05:07:42.776 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:07:42.774+0000 7fe38e7aa700 1 -- 172.21.15.179:0/3076098351 shutdown_connections 2024-01-31T05:07:42.776 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:07:42.774+0000 7fe38e7aa700 1 --2- 172.21.15.179:0/3076098351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe388101340 0x7fe388108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:07:42.776 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:07:42.774+0000 7fe38e7aa700 1 --2- 172.21.15.179:0/3076098351 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe388101d20 0x7fe388102140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:07:42.776 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:07:42.774+0000 7fe38e7aa700 1 --2- 172.21.15.179:0/3076098351 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe388100980 0x7fe388100e00 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:07:42.776 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:07:42.774+0000 7fe38e7aa700 1 -- 172.21.15.179:0/3076098351 >> 172.21.15.179:0/3076098351 conn(0x7fe3880fb450 msgr2=0x7fe3880fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:07:42.776 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:07:42.774+0000 7fe38e7aa700 1 -- 172.21.15.179:0/3076098351 shutdown_connections 2024-01-31T05:07:42.776 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:07:42.774+0000 7fe38e7aa700 1 -- 172.21.15.179:0/3076098351 wait complete. 2024-01-31T05:07:42.776 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:07:42.774+0000 7fe38e7aa700 1 Processor -- start 2024-01-31T05:07:42.777 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:07:42.775+0000 7fe38e7aa700 1 -- start start 2024-01-31T05:07:42.777 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:07:42.775+0000 7fe38e7aa700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe388100980 0x7fe388197730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:07:42.777 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:07:42.775+0000 7fe38e7aa700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe388101340 0x7fe388197c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:07:42.777 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:07:42.775+0000 7fe38e7aa700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe388101d20 0x7fe38819ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:07:42.777 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:07:42.775+0000 7fe38e7aa700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe38819f2c0 con 0x7fe388101340 2024-01-31T05:07:42.777 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:07:42.775+0000 7fe38e7aa700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe38819f400 con 0x7fe388101d20 2024-01-31T05:07:42.777 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:07:42.775+0000 7fe38e7aa700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe38819f590 con 0x7fe388100980 2024-01-31T05:07:42.777 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:07:42.775+0000 7fe38cd47700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe388101d20 0x7fe38819ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:07:42.777 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:07:42.775+0000 7fe38cd47700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe388101d20 0x7fe38819ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:55106/0 (socket says 172.21.15.179:55106) 2024-01-31T05:07:42.777 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:07:42.775+0000 7fe38cd47700 1 -- 172.21.15.179:0/2838389614 learned_addr learned my addr 172.21.15.179:0/2838389614 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-01-31T05:07:42.777 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:07:42.775+0000 7fe3877fe700 1 --2- 172.21.15.179:0/2838389614 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe388101340 0x7fe388197c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:07:42.777 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:07:42.775+0000 7fe38cd47700 1 -- 172.21.15.179:0/2838389614 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe388100980 msgr2=0x7fe388197730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:07:42.777 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:07:42.775+0000 7fe387fff700 1 --2- 172.21.15.179:0/2838389614 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe388100980 0x7fe388197730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:07:42.778 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:07:42.775+0000 7fe38cd47700 1 --2- 172.21.15.179:0/2838389614 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe388100980 0x7fe388197730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:07:42.778 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:07:42.775+0000 7fe38cd47700 1 -- 172.21.15.179:0/2838389614 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe388101340 msgr2=0x7fe388197c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:07:42.778 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:07:42.775+0000 7fe38cd47700 1 --2- 172.21.15.179:0/2838389614 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe388101340 0x7fe388197c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:07:42.778 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:07:42.775+0000 7fe38cd47700 1 -- 172.21.15.179:0/2838389614 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe37c0095f0 con 0x7fe388101d20 2024-01-31T05:07:42.778 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:07:42.775+0000 7fe3877fe700 1 --2- 172.21.15.179:0/2838389614 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe388101340 0x7fe388197c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:07:42.778 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:07:42.775+0000 7fe38cd47700 1 --2- 172.21.15.179:0/2838389614 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe388101d20 0x7fe38819ecf0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe38000b970 tx=0x7fe38000bd30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:07:42.778 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:07:42.776+0000 7fe3857fa700 1 -- 172.21.15.179:0/2838389614 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38000c9b0 con 0x7fe388101d20 2024-01-31T05:07:42.778 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:07:42.776+0000 7fe3857fa700 1 -- 172.21.15.179:0/2838389614 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe380014440 con 0x7fe388101d20 2024-01-31T05:07:42.778 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:07:42.776+0000 7fe38e7aa700 1 -- 172.21.15.179:0/2838389614 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe38819f870 con 0x7fe388101d20 2024-01-31T05:07:42.778 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:07:42.776+0000 7fe3857fa700 1 -- 172.21.15.179:0/2838389614 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3800075d0 con 0x7fe388101d20 2024-01-31T05:07:42.778 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:07:42.776+0000 7fe38e7aa700 1 -- 172.21.15.179:0/2838389614 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe38819fd20 con 0x7fe388101d20 2024-01-31T05:07:42.779 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:07:42.777+0000 7fe38e7aa700 1 -- 172.21.15.179:0/2838389614 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe388107c20 con 0x7fe388101d20 2024-01-31T05:07:42.779 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:07:42.778+0000 7fe3857fa700 1 -- 172.21.15.179:0/2838389614 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7fe3800148d0 con 0x7fe388101d20 2024-01-31T05:07:42.780 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:07:42.778+0000 7fe3857fa700 1 --2- 172.21.15.179:0/2838389614 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe3700a1370 0x7fe3700a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:07:42.780 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:07:42.778+0000 7fe3857fa700 1 -- 172.21.15.179:0/2838389614 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6261+0+0 (secure 0 0 0) 0x7fe380006e40 con 0x7fe388101d20 2024-01-31T05:07:42.781 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:07:42.778+0000 7fe387fff700 1 --2- 172.21.15.179:0/2838389614 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe3700a1370 0x7fe3700a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:07:42.781 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:07:42.779+0000 7fe387fff700 1 --2- 172.21.15.179:0/2838389614 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe3700a1370 0x7fe3700a3830 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe378005950 tx=0x7fe378005d10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:07:42.781 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:07:42.782+0000 7fe3857fa700 1 -- 172.21.15.179:0/2838389614 <== mon.2 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fe380095b60 con 0x7fe388101d20 2024-01-31T05:07:42.978 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:07:42.979+0000 7fe38e7aa700 1 -- 172.21.15.179:0/2838389614 --> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fe38802d540 con 0x7fe3700a1370 2024-01-31T05:07:43.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:43 smithi179 ceph-mon[35652]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-01-31T05:07:43.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:43 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-31T05:07:43.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:43 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-31T05:07:43.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:43 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:07:43.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:43 smithi099 ceph-mon[31615]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-01-31T05:07:43.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:43 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-31T05:07:43.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:43 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-31T05:07:43.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:43 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:07:43.569 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:43 smithi181 ceph-mon[36434]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-01-31T05:07:43.569 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:43 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-31T05:07:43.569 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:43 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-31T05:07:43.569 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:43 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:07:44.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:44 smithi179 ceph-mon[35652]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:07:44.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:44 smithi099 ceph-mon[31615]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:07:44.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:44 smithi181 ceph-mon[36434]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:07:45.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:45 smithi099 ceph-mon[31615]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-01-31T05:07:45.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:45 smithi181 ceph-mon[36434]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-01-31T05:07:45.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:45 smithi179 ceph-mon[35652]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-01-31T05:07:46.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:46 smithi179 ceph-mon[35652]: from='client.? 172.21.15.179:0/3712736472' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ee86af7d-66f8-4795-bcc3-dfec79e4680c"}]: dispatch 2024-01-31T05:07:46.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:46 smithi179 ceph-mon[35652]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ee86af7d-66f8-4795-bcc3-dfec79e4680c"}]: dispatch 2024-01-31T05:07:46.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:46 smithi179 ceph-mon[35652]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ee86af7d-66f8-4795-bcc3-dfec79e4680c"}]': finished 2024-01-31T05:07:46.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:46 smithi179 ceph-mon[35652]: osdmap e69: 11 total, 10 up, 11 in 2024-01-31T05:07:46.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:46 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-31T05:07:46.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:46 smithi099 ceph-mon[31615]: from='client.? 172.21.15.179:0/3712736472' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ee86af7d-66f8-4795-bcc3-dfec79e4680c"}]: dispatch 2024-01-31T05:07:46.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:46 smithi099 ceph-mon[31615]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ee86af7d-66f8-4795-bcc3-dfec79e4680c"}]: dispatch 2024-01-31T05:07:46.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:46 smithi099 ceph-mon[31615]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ee86af7d-66f8-4795-bcc3-dfec79e4680c"}]': finished 2024-01-31T05:07:46.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:46 smithi099 ceph-mon[31615]: osdmap e69: 11 total, 10 up, 11 in 2024-01-31T05:07:46.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:46 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-31T05:07:46.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:46 smithi181 ceph-mon[36434]: from='client.? 172.21.15.179:0/3712736472' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ee86af7d-66f8-4795-bcc3-dfec79e4680c"}]: dispatch 2024-01-31T05:07:46.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:46 smithi181 ceph-mon[36434]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ee86af7d-66f8-4795-bcc3-dfec79e4680c"}]: dispatch 2024-01-31T05:07:46.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:46 smithi181 ceph-mon[36434]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ee86af7d-66f8-4795-bcc3-dfec79e4680c"}]': finished 2024-01-31T05:07:46.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:46 smithi181 ceph-mon[36434]: osdmap e69: 11 total, 10 up, 11 in 2024-01-31T05:07:46.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:46 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-31T05:07:47.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:47 smithi099 ceph-mon[31615]: from='client.? 172.21.15.179:0/3915334838' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-31T05:07:47.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:47 smithi099 ceph-mon[31615]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-01-31T05:07:47.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:47 smithi181 ceph-mon[36434]: from='client.? 172.21.15.179:0/3915334838' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-31T05:07:47.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:47 smithi181 ceph-mon[36434]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-01-31T05:07:47.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:47 smithi179 ceph-mon[35652]: from='client.? 172.21.15.179:0/3915334838' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-31T05:07:47.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:47 smithi179 ceph-mon[35652]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-01-31T05:07:49.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:49 smithi179 ceph-mon[35652]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-01-31T05:07:50.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:49 smithi099 ceph-mon[31615]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-01-31T05:07:50.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:49 smithi181 ceph-mon[36434]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-01-31T05:07:51.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:51 smithi179 ceph-mon[35652]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-01-31T05:07:52.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:51 smithi099 ceph-mon[31615]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-01-31T05:07:52.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:51 smithi181 ceph-mon[36434]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-01-31T05:07:53.465 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:53 smithi179 ceph-mon[35652]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-01-31T05:07:53.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:53 smithi099 ceph-mon[31615]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-01-31T05:07:53.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:53 smithi181 ceph-mon[36434]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-01-31T05:07:54.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:54 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-01-31T05:07:54.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:54 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:07:54.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:54 smithi179 ceph-mon[35652]: Deploying daemon osd.10 on smithi179 2024-01-31T05:07:54.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:54 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-01-31T05:07:54.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:54 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:07:54.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:54 smithi099 ceph-mon[31615]: Deploying daemon osd.10 on smithi179 2024-01-31T05:07:54.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:54 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-01-31T05:07:54.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:54 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:07:54.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:54 smithi181 ceph-mon[36434]: Deploying daemon osd.10 on smithi179 2024-01-31T05:07:55.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:55 smithi179 ceph-mon[35652]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-01-31T05:07:55.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:55 smithi099 ceph-mon[31615]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-01-31T05:07:55.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:55 smithi181 ceph-mon[36434]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-01-31T05:07:57.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:57 smithi179 ceph-mon[35652]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-01-31T05:07:58.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:57 smithi099 ceph-mon[31615]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-01-31T05:07:58.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:57 smithi181 ceph-mon[36434]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-01-31T05:07:59.678 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:59 smithi179 ceph-mon[35652]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-01-31T05:07:59.679 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:59 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:59.679 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:59 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:07:59.679 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:07:59 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:08:00.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:59 smithi099 ceph-mon[31615]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-01-31T05:08:00.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:59 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:00.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:59 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:00.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:07:59 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:08:00.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:59 smithi181 ceph-mon[36434]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-01-31T05:08:00.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:59 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:00.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:59 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:00.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:07:59 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:08:01.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:01 smithi179 ceph-mon[35652]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-01-31T05:08:02.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:01 smithi099 ceph-mon[31615]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-01-31T05:08:02.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:01 smithi181 ceph-mon[36434]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-01-31T05:08:02.702 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:08:02.702+0000 7fe3857fa700 1 -- 172.21.15.179:0/2838389614 <== mgr.14152 v2:172.21.15.99:6800/3925720924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7fe38802d540 con 0x7fe3700a1370 2024-01-31T05:08:02.702 INFO:teuthology.orchestra.run.smithi179.stdout:Created osd(s) 10 on host 'smithi179' 2024-01-31T05:08:02.705 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:08:02.705+0000 7fe38e7aa700 1 -- 172.21.15.179:0/2838389614 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe3700a1370 msgr2=0x7fe3700a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:02.705 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:08:02.705+0000 7fe38e7aa700 1 --2- 172.21.15.179:0/2838389614 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe3700a1370 0x7fe3700a3830 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe378005950 tx=0x7fe378005d10 comp rx=0 tx=0).stop 2024-01-31T05:08:02.705 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:08:02.705+0000 7fe38e7aa700 1 -- 172.21.15.179:0/2838389614 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe388101d20 msgr2=0x7fe38819ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:02.705 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:08:02.705+0000 7fe38e7aa700 1 --2- 172.21.15.179:0/2838389614 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe388101d20 0x7fe38819ecf0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe38000b970 tx=0x7fe38000bd30 comp rx=0 tx=0).stop 2024-01-31T05:08:02.705 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:08:02.705+0000 7fe38e7aa700 1 -- 172.21.15.179:0/2838389614 shutdown_connections 2024-01-31T05:08:02.705 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:08:02.705+0000 7fe38e7aa700 1 --2- 172.21.15.179:0/2838389614 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe3700a1370 0x7fe3700a3830 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:02.705 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:08:02.705+0000 7fe38e7aa700 1 --2- 172.21.15.179:0/2838389614 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe388101d20 0x7fe38819ecf0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:02.705 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:08:02.705+0000 7fe38e7aa700 1 --2- 172.21.15.179:0/2838389614 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe388100980 0x7fe388197730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:02.705 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:08:02.705+0000 7fe38e7aa700 1 --2- 172.21.15.179:0/2838389614 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe388101340 0x7fe388197c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:02.705 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:08:02.705+0000 7fe38e7aa700 1 -- 172.21.15.179:0/2838389614 >> 172.21.15.179:0/2838389614 conn(0x7fe3880fb450 msgr2=0x7fe388104d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:08:02.706 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:08:02.705+0000 7fe38e7aa700 1 -- 172.21.15.179:0/2838389614 shutdown_connections 2024-01-31T05:08:02.706 INFO:teuthology.orchestra.run.smithi179.stderr:2024-01-31T05:08:02.705+0000 7fe38e7aa700 1 -- 172.21.15.179:0/2838389614 wait complete. 2024-01-31T05:08:03.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:02 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:03.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:02 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:03.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:02 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:08:03.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:02 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:08:03.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:02 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:03.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:02 smithi099 ceph-mon[31615]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-01-31T05:08:03.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:02 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:03.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:02 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:03.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:02 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:08:03.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:02 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:03.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:02 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:03.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:02 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:08:03.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:02 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:08:03.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:02 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:03.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:02 smithi181 ceph-mon[36434]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-01-31T05:08:03.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:02 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:03.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:02 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:03.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:02 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:08:03.328 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:02 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:03.328 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:02 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:03.328 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:02 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:08:03.328 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:02 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:08:03.328 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:02 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:03.329 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:02 smithi179 ceph-mon[35652]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-01-31T05:08:03.329 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:02 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:03.329 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:02 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:03.329 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:02 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:08:03.355 DEBUG:teuthology.orchestra.run.smithi179:osd.10> sudo journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@osd.10.service 2024-01-31T05:08:03.357 INFO:tasks.cephadm:Deploying osd.11 on smithi181 with /dev/vg_nvme/lv_1... 2024-01-31T05:08:03.358 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-01-31T05:08:03.601 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.c/config 2024-01-31T05:08:04.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:03 smithi181 ceph-mon[36434]: from='osd.10 [v2:172.21.15.179:6824/2985063934,v1:172.21.15.179:6825/2985063934]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-01-31T05:08:04.034 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:03 smithi181 ceph-mon[36434]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-01-31T05:08:04.175 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:03 smithi179 ceph-mon[35652]: from='osd.10 [v2:172.21.15.179:6824/2985063934,v1:172.21.15.179:6825/2985063934]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-01-31T05:08:04.175 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:03 smithi179 ceph-mon[35652]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-01-31T05:08:04.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:03 smithi099 ceph-mon[31615]: from='osd.10 [v2:172.21.15.179:6824/2985063934,v1:172.21.15.179:6825/2985063934]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-01-31T05:08:04.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:03 smithi099 ceph-mon[31615]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-01-31T05:08:05.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:04 smithi179 ceph-mon[35652]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-01-31T05:08:05.046 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:04 smithi179 ceph-mon[35652]: osdmap e70: 11 total, 10 up, 11 in 2024-01-31T05:08:05.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:04 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-31T05:08:05.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:04 smithi179 ceph-mon[35652]: from='osd.10 [v2:172.21.15.179:6824/2985063934,v1:172.21.15.179:6825/2985063934]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-01-31T05:08:05.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:04 smithi179 ceph-mon[35652]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-01-31T05:08:05.047 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:04 smithi179 ceph-mon[35652]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-01-31T05:08:05.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:04 smithi099 ceph-mon[31615]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-01-31T05:08:05.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:04 smithi099 ceph-mon[31615]: osdmap e70: 11 total, 10 up, 11 in 2024-01-31T05:08:05.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:04 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-31T05:08:05.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:04 smithi099 ceph-mon[31615]: from='osd.10 [v2:172.21.15.179:6824/2985063934,v1:172.21.15.179:6825/2985063934]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-01-31T05:08:05.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:04 smithi099 ceph-mon[31615]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-01-31T05:08:05.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:04 smithi099 ceph-mon[31615]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-01-31T05:08:05.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:04 smithi181 ceph-mon[36434]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-01-31T05:08:05.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:04 smithi181 ceph-mon[36434]: osdmap e70: 11 total, 10 up, 11 in 2024-01-31T05:08:05.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:04 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-31T05:08:05.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:04 smithi181 ceph-mon[36434]: from='osd.10 [v2:172.21.15.179:6824/2985063934,v1:172.21.15.179:6825/2985063934]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-01-31T05:08:05.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:04 smithi181 ceph-mon[36434]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-01-31T05:08:05.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:04 smithi181 ceph-mon[36434]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-01-31T05:08:05.491 INFO:teuthology.orchestra.run.smithi181.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-01-31T05:08:05.491 INFO:teuthology.orchestra.run.smithi181.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-01-31T05:08:05.491 INFO:teuthology.orchestra.run.smithi181.stderr: stderr: 10+0 records in 2024-01-31T05:08:05.491 INFO:teuthology.orchestra.run.smithi181.stderr:10+0 records out 2024-01-31T05:08:05.491 INFO:teuthology.orchestra.run.smithi181.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.015689 s, 668 MB/s 2024-01-31T05:08:05.491 INFO:teuthology.orchestra.run.smithi181.stderr: stderr: 2024-01-31T05:08:05.491 INFO:teuthology.orchestra.run.smithi181.stderr:--> Zapping successful for: 2024-01-31T05:08:06.122 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph orch daemon add osd smithi181:vg_nvme/lv_1 2024-01-31T05:08:06.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:05 smithi179 ceph-mon[35652]: purged_snaps scrub starts 2024-01-31T05:08:06.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:05 smithi179 ceph-mon[35652]: purged_snaps scrub ok 2024-01-31T05:08:06.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:05 smithi179 ceph-mon[35652]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-01-31T05:08:06.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:05 smithi179 ceph-mon[35652]: osdmap e71: 11 total, 10 up, 11 in 2024-01-31T05:08:06.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:05 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-31T05:08:06.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:05 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-31T05:08:06.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:05 smithi179 ceph-mon[35652]: from='osd.10 ' entity='osd.10' 2024-01-31T05:08:06.133 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:08:05 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:08:05.912+0000 7fc529e10700 -1 osd.10 0 waiting for initial osdmap 2024-01-31T05:08:06.133 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:08:05 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:08:05.938+0000 7fc520c00700 -1 osd.10 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-31T05:08:06.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:05 smithi099 ceph-mon[31615]: purged_snaps scrub starts 2024-01-31T05:08:06.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:05 smithi099 ceph-mon[31615]: purged_snaps scrub ok 2024-01-31T05:08:06.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:05 smithi099 ceph-mon[31615]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-01-31T05:08:06.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:05 smithi099 ceph-mon[31615]: osdmap e71: 11 total, 10 up, 11 in 2024-01-31T05:08:06.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:05 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-31T05:08:06.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:05 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-31T05:08:06.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:05 smithi099 ceph-mon[31615]: from='osd.10 ' entity='osd.10' 2024-01-31T05:08:06.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:05 smithi181 ceph-mon[36434]: purged_snaps scrub starts 2024-01-31T05:08:06.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:05 smithi181 ceph-mon[36434]: purged_snaps scrub ok 2024-01-31T05:08:06.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:05 smithi181 ceph-mon[36434]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-01-31T05:08:06.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:05 smithi181 ceph-mon[36434]: osdmap e71: 11 total, 10 up, 11 in 2024-01-31T05:08:06.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:05 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-31T05:08:06.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:05 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-31T05:08:06.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:05 smithi181 ceph-mon[36434]: from='osd.10 ' entity='osd.10' 2024-01-31T05:08:06.363 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.c/config 2024-01-31T05:08:07.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:06 smithi181 ceph-mon[36434]: osdmap e72: 11 total, 10 up, 11 in 2024-01-31T05:08:07.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:06 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-31T05:08:07.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:06 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-31T05:08:07.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:06 smithi181 ceph-mon[36434]: Detected new or changed devices on smithi179 2024-01-31T05:08:07.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:06 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:07.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:06 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:07.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:06 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:08:07.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:06 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:08:07.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:06 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:08:07.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:06 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:08:07.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:06 smithi181 ceph-mon[36434]: Adjusting osd_memory_target on smithi179 to 4270M 2024-01-31T05:08:07.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:06 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:07.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:06 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:08:07.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:06 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:08:07.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:06 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:07.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:06 smithi181 ceph-mon[36434]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-01-31T05:08:07.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:06 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-31T05:08:07.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:06 smithi099 ceph-mon[31615]: osdmap e72: 11 total, 10 up, 11 in 2024-01-31T05:08:07.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:06 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-31T05:08:07.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:06 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-31T05:08:07.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:06 smithi099 ceph-mon[31615]: Detected new or changed devices on smithi179 2024-01-31T05:08:07.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:06 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:07.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:06 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:07.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:06 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:08:07.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:06 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:08:07.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:06 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:08:07.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:06 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:08:07.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:06 smithi099 ceph-mon[31615]: Adjusting osd_memory_target on smithi179 to 4270M 2024-01-31T05:08:07.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:06 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:07.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:06 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:08:07.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:06 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:08:07.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:06 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:07.320 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:06 smithi099 ceph-mon[31615]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-01-31T05:08:07.320 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:06 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-31T05:08:07.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:06 smithi179 ceph-mon[35652]: osdmap e72: 11 total, 10 up, 11 in 2024-01-31T05:08:07.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:06 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-31T05:08:07.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:06 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-31T05:08:07.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:06 smithi179 ceph-mon[35652]: Detected new or changed devices on smithi179 2024-01-31T05:08:07.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:06 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:07.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:06 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:07.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:06 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:08:07.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:06 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:08:07.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:06 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:08:07.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:06 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:08:07.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:06 smithi179 ceph-mon[35652]: Adjusting osd_memory_target on smithi179 to 4270M 2024-01-31T05:08:07.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:06 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:07.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:06 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:08:07.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:06 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:08:07.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:06 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:07.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:06 smithi179 ceph-mon[35652]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-01-31T05:08:07.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:06 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-31T05:08:07.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:07.934+0000 7f6c3a44f700 1 -- 172.21.15.181:0/2588834451 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6c341034a0 msgr2=0x7f6c34109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:07.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:07.934+0000 7f6c3a44f700 1 --2- 172.21.15.181:0/2588834451 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6c341034a0 0x7f6c34109d50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c00b0a0 tx=0x7f6c2c00b3b0 comp rx=0 tx=0).stop 2024-01-31T05:08:07.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:07.934+0000 7f6c3a44f700 1 -- 172.21.15.181:0/2588834451 shutdown_connections 2024-01-31T05:08:07.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:07.934+0000 7f6c3a44f700 1 --2- 172.21.15.181:0/2588834451 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6c341034a0 0x7f6c34109d50 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:07.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:07.934+0000 7f6c3a44f700 1 --2- 172.21.15.181:0/2588834451 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c340ffb20 0x7f6c340fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:07.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:07.934+0000 7f6c3a44f700 1 --2- 172.21.15.181:0/2588834451 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c34102b00 0x7f6c34102f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:07.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:07.934+0000 7f6c3a44f700 1 -- 172.21.15.181:0/2588834451 >> 172.21.15.181:0/2588834451 conn(0x7f6c340fb480 msgr2=0x7f6c340fd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:08:07.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:07.934+0000 7f6c3a44f700 1 -- 172.21.15.181:0/2588834451 shutdown_connections 2024-01-31T05:08:07.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:07.934+0000 7f6c3a44f700 1 -- 172.21.15.181:0/2588834451 wait complete. 2024-01-31T05:08:07.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:07.934+0000 7f6c3a44f700 1 Processor -- start 2024-01-31T05:08:07.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:07.934+0000 7f6c3a44f700 1 -- start start 2024-01-31T05:08:07.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:07.935+0000 7f6c3a44f700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6c340ffb20 0x7f6c34102460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:07.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:07.935+0000 7f6c3a44f700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c34102b00 0x7f6c34100ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:07.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:07.935+0000 7f6c3a44f700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c341034a0 0x7f6c34100ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:07.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:07.935+0000 7f6c3a44f700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c34101770 con 0x7f6c34102b00 2024-01-31T05:08:07.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:07.935+0000 7f6c3a44f700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c341018e0 con 0x7f6c341034a0 2024-01-31T05:08:07.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:07.935+0000 7f6c3a44f700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c341a1850 con 0x7f6c340ffb20 2024-01-31T05:08:07.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:07.935+0000 7f6c33fff700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6c340ffb20 0x7f6c34102460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:07.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:07.935+0000 7f6c33fff700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6c340ffb20 0x7f6c34102460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:52800/0 (socket says 172.21.15.181:52800) 2024-01-31T05:08:07.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:07.935+0000 7f6c33fff700 1 -- 172.21.15.181:0/2937267591 learned_addr learned my addr 172.21.15.181:0/2937267591 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-01-31T05:08:07.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:07.935+0000 7f6c337fe700 1 --2- 172.21.15.181:0/2937267591 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c34102b00 0x7f6c34100ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:07.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:07.935+0000 7f6c33fff700 1 -- 172.21.15.181:0/2937267591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c341034a0 msgr2=0x7f6c34100ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:07.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:07.935+0000 7f6c33fff700 1 --2- 172.21.15.181:0/2937267591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c341034a0 0x7f6c34100ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:07.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:07.935+0000 7f6c33fff700 1 -- 172.21.15.181:0/2937267591 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c34102b00 msgr2=0x7f6c34100ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:07.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:07.935+0000 7f6c33fff700 1 --2- 172.21.15.181:0/2937267591 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c34102b00 0x7f6c34100ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:07.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:07.935+0000 7f6c33fff700 1 -- 172.21.15.181:0/2937267591 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c2c009d00 con 0x7f6c340ffb20 2024-01-31T05:08:07.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:07.935+0000 7f6c337fe700 1 --2- 172.21.15.181:0/2937267591 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c34102b00 0x7f6c34100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:08:07.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:07.935+0000 7f6c33fff700 1 --2- 172.21.15.181:0/2937267591 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6c340ffb20 0x7f6c34102460 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6c2400d980 tx=0x7f6c2400dd40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:08:07.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:07.935+0000 7f6c317fa700 1 -- 172.21.15.181:0/2937267591 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2400de60 con 0x7f6c340ffb20 2024-01-31T05:08:07.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:07.935+0000 7f6c3a44f700 1 -- 172.21.15.181:0/2937267591 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c341a1b30 con 0x7f6c340ffb20 2024-01-31T05:08:07.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:07.935+0000 7f6c317fa700 1 -- 172.21.15.181:0/2937267591 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6c240044e0 con 0x7f6c340ffb20 2024-01-31T05:08:07.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:07.936+0000 7f6c317fa700 1 -- 172.21.15.181:0/2937267591 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c24003be0 con 0x7f6c340ffb20 2024-01-31T05:08:07.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:07.936+0000 7f6c3a44f700 1 -- 172.21.15.181:0/2937267591 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c341a2080 con 0x7f6c340ffb20 2024-01-31T05:08:07.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:07.937+0000 7f6c3a44f700 1 -- 172.21.15.181:0/2937267591 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c34108cc0 con 0x7f6c340ffb20 2024-01-31T05:08:07.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:07.937+0000 7f6c317fa700 1 -- 172.21.15.181:0/2937267591 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f6c24009bb0 con 0x7f6c340ffb20 2024-01-31T05:08:07.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:07.938+0000 7f6c317fa700 1 --2- 172.21.15.181:0/2937267591 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f6c1c0a1370 0x7f6c1c0a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:07.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:07.938+0000 7f6c317fa700 1 -- 172.21.15.181:0/2937267591 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6723+0+0 (secure 0 0 0) 0x7f6c240cc290 con 0x7f6c340ffb20 2024-01-31T05:08:07.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:07.938+0000 7f6c337fe700 1 --2- 172.21.15.181:0/2937267591 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f6c1c0a1370 0x7f6c1c0a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:07.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:07.939+0000 7f6c337fe700 1 --2- 172.21.15.181:0/2937267591 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f6c1c0a1370 0x7f6c1c0a3830 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6c28007900 tx=0x7f6c28008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:08:07.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:07.942+0000 7f6c317fa700 1 -- 172.21.15.181:0/2937267591 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f6c24095d40 con 0x7f6c340ffb20 2024-01-31T05:08:08.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:07 smithi181 ceph-mon[36434]: osd.10 [v2:172.21.15.179:6824/2985063934,v1:172.21.15.179:6825/2985063934] boot 2024-01-31T05:08:08.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:07 smithi181 ceph-mon[36434]: osdmap e73: 11 total, 11 up, 11 in 2024-01-31T05:08:08.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:07 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-31T05:08:08.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:07 smithi181 ceph-mon[36434]: osdmap e74: 11 total, 11 up, 11 in 2024-01-31T05:08:08.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:08.146+0000 7f6c3a44f700 1 -- 172.21.15.181:0/2937267591 --> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c3402d540 con 0x7f6c1c0a1370 2024-01-31T05:08:08.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:07 smithi099 ceph-mon[31615]: osd.10 [v2:172.21.15.179:6824/2985063934,v1:172.21.15.179:6825/2985063934] boot 2024-01-31T05:08:08.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:07 smithi099 ceph-mon[31615]: osdmap e73: 11 total, 11 up, 11 in 2024-01-31T05:08:08.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:07 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-31T05:08:08.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:07 smithi099 ceph-mon[31615]: osdmap e74: 11 total, 11 up, 11 in 2024-01-31T05:08:08.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:07 smithi179 ceph-mon[35652]: osd.10 [v2:172.21.15.179:6824/2985063934,v1:172.21.15.179:6825/2985063934] boot 2024-01-31T05:08:08.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:07 smithi179 ceph-mon[35652]: osdmap e73: 11 total, 11 up, 11 in 2024-01-31T05:08:08.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:07 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-31T05:08:08.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:07 smithi179 ceph-mon[35652]: osdmap e74: 11 total, 11 up, 11 in 2024-01-31T05:08:09.007 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:08 smithi181 ceph-mon[36434]: from='client.24322 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:08:09.007 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:08 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-31T05:08:09.007 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:08 smithi181 ceph-mon[36434]: osdmap e75: 11 total, 11 up, 11 in 2024-01-31T05:08:09.007 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:08 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-31T05:08:09.007 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:08 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:08:09.007 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:08 smithi181 ceph-mon[36434]: pgmap v239: 1 pgs: 1 remapped+peering; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-01-31T05:08:09.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:08 smithi099 ceph-mon[31615]: from='client.24322 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:08:09.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:08 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-31T05:08:09.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:08 smithi099 ceph-mon[31615]: osdmap e75: 11 total, 11 up, 11 in 2024-01-31T05:08:09.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:08 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-31T05:08:09.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:08 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:08:09.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:08 smithi099 ceph-mon[31615]: pgmap v239: 1 pgs: 1 remapped+peering; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-01-31T05:08:09.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:08 smithi179 ceph-mon[35652]: from='client.24322 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:08:09.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:08 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-31T05:08:09.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:08 smithi179 ceph-mon[35652]: osdmap e75: 11 total, 11 up, 11 in 2024-01-31T05:08:09.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:08 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-31T05:08:09.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:08 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:08:09.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:08 smithi179 ceph-mon[35652]: pgmap v239: 1 pgs: 1 remapped+peering; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-01-31T05:08:10.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:10 smithi181 ceph-mon[36434]: osdmap e76: 11 total, 11 up, 11 in 2024-01-31T05:08:10.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:10 smithi099 ceph-mon[31615]: osdmap e76: 11 total, 11 up, 11 in 2024-01-31T05:08:10.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:10 smithi179 ceph-mon[35652]: osdmap e76: 11 total, 11 up, 11 in 2024-01-31T05:08:11.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:11 smithi099 ceph-mon[31615]: osdmap e77: 11 total, 11 up, 11 in 2024-01-31T05:08:11.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:11 smithi099 ceph-mon[31615]: pgmap v242: 1 pgs: 1 remapped+peering; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-01-31T05:08:11.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:11 smithi099 ceph-mon[31615]: from='client.? 172.21.15.181:0/2069461744' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "82f04fee-f6ae-4630-a75b-b12a9c4ab2e7"}]: dispatch 2024-01-31T05:08:11.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:11 smithi099 ceph-mon[31615]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "82f04fee-f6ae-4630-a75b-b12a9c4ab2e7"}]: dispatch 2024-01-31T05:08:11.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:11 smithi099 ceph-mon[31615]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "82f04fee-f6ae-4630-a75b-b12a9c4ab2e7"}]': finished 2024-01-31T05:08:11.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:11 smithi099 ceph-mon[31615]: osdmap e78: 12 total, 11 up, 12 in 2024-01-31T05:08:11.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:11 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-31T05:08:11.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:11 smithi181 ceph-mon[36434]: osdmap e77: 11 total, 11 up, 11 in 2024-01-31T05:08:11.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:11 smithi181 ceph-mon[36434]: pgmap v242: 1 pgs: 1 remapped+peering; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-01-31T05:08:11.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:11 smithi181 ceph-mon[36434]: from='client.? 172.21.15.181:0/2069461744' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "82f04fee-f6ae-4630-a75b-b12a9c4ab2e7"}]: dispatch 2024-01-31T05:08:11.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:11 smithi181 ceph-mon[36434]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "82f04fee-f6ae-4630-a75b-b12a9c4ab2e7"}]: dispatch 2024-01-31T05:08:11.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:11 smithi181 ceph-mon[36434]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "82f04fee-f6ae-4630-a75b-b12a9c4ab2e7"}]': finished 2024-01-31T05:08:11.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:11 smithi181 ceph-mon[36434]: osdmap e78: 12 total, 11 up, 12 in 2024-01-31T05:08:11.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:11 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-31T05:08:11.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:11 smithi179 ceph-mon[35652]: osdmap e77: 11 total, 11 up, 11 in 2024-01-31T05:08:11.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:11 smithi179 ceph-mon[35652]: pgmap v242: 1 pgs: 1 remapped+peering; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-01-31T05:08:11.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:11 smithi179 ceph-mon[35652]: from='client.? 172.21.15.181:0/2069461744' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "82f04fee-f6ae-4630-a75b-b12a9c4ab2e7"}]: dispatch 2024-01-31T05:08:11.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:11 smithi179 ceph-mon[35652]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "82f04fee-f6ae-4630-a75b-b12a9c4ab2e7"}]: dispatch 2024-01-31T05:08:11.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:11 smithi179 ceph-mon[35652]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "82f04fee-f6ae-4630-a75b-b12a9c4ab2e7"}]': finished 2024-01-31T05:08:11.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:11 smithi179 ceph-mon[35652]: osdmap e78: 12 total, 11 up, 12 in 2024-01-31T05:08:11.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:11 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-31T05:08:12.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:12 smithi099 ceph-mon[31615]: from='client.? 172.21.15.181:0/3874487311' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-31T05:08:12.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:12 smithi181 ceph-mon[36434]: from='client.? 172.21.15.181:0/3874487311' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-31T05:08:12.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:12 smithi179 ceph-mon[35652]: from='client.? 172.21.15.181:0/3874487311' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-31T05:08:13.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:13 smithi099 ceph-mon[31615]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 130 KiB/s, 0 objects/s recovering 2024-01-31T05:08:13.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:13 smithi181 ceph-mon[36434]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 130 KiB/s, 0 objects/s recovering 2024-01-31T05:08:13.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:13 smithi179 ceph-mon[35652]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 130 KiB/s, 0 objects/s recovering 2024-01-31T05:08:15.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:15 smithi179 ceph-mon[35652]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-01-31T05:08:15.981 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:15 smithi181 ceph-mon[36434]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-01-31T05:08:16.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:15 smithi099 ceph-mon[31615]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-01-31T05:08:18.049 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:17 smithi181 ceph-mon[36434]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-01-31T05:08:18.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:17 smithi099 ceph-mon[31615]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-01-31T05:08:18.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:17 smithi179 ceph-mon[35652]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-01-31T05:08:18.894 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:18 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-01-31T05:08:18.894 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:18 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:08:19.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:18 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-01-31T05:08:19.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:18 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:08:19.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:18 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-01-31T05:08:19.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:18 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:08:19.928 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:19 smithi181 ceph-mon[36434]: Deploying daemon osd.11 on smithi181 2024-01-31T05:08:19.928 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:19 smithi181 ceph-mon[36434]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-01-31T05:08:20.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:19 smithi099 ceph-mon[31615]: Deploying daemon osd.11 on smithi181 2024-01-31T05:08:20.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:19 smithi099 ceph-mon[31615]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-01-31T05:08:20.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:19 smithi179 ceph-mon[35652]: Deploying daemon osd.11 on smithi181 2024-01-31T05:08:20.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:19 smithi179 ceph-mon[35652]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-01-31T05:08:21.727 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:21 smithi181 ceph-mon[36434]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-01-31T05:08:22.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:21 smithi099 ceph-mon[31615]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-01-31T05:08:22.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:21 smithi179 ceph-mon[35652]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-01-31T05:08:23.391 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:23 smithi181 ceph-mon[36434]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-01-31T05:08:23.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:23 smithi099 ceph-mon[31615]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-01-31T05:08:23.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:23 smithi179 ceph-mon[35652]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-01-31T05:08:24.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:24 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:24.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:24 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:24.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:24 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:08:24.823 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:24 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:24.823 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:24 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:24.823 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:24 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:08:24.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:24 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:24.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:24 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:24.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:24 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:08:25.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:25 smithi099 ceph-mon[31615]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-01-31T05:08:25.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:25 smithi181 ceph-mon[36434]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-01-31T05:08:25.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:25 smithi179 ceph-mon[35652]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-01-31T05:08:27.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:27.312+0000 7f6c317fa700 1 -- 172.21.15.181:0/2937267591 <== mgr.14152 v2:172.21.15.99:6800/3925720924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f6c3402d540 con 0x7f6c1c0a1370 2024-01-31T05:08:27.313 INFO:teuthology.orchestra.run.smithi181.stdout:Created osd(s) 11 on host 'smithi181' 2024-01-31T05:08:27.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:27.314+0000 7f6c3a44f700 1 -- 172.21.15.181:0/2937267591 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f6c1c0a1370 msgr2=0x7f6c1c0a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:27.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:27.314+0000 7f6c3a44f700 1 --2- 172.21.15.181:0/2937267591 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f6c1c0a1370 0x7f6c1c0a3830 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6c28007900 tx=0x7f6c28008040 comp rx=0 tx=0).stop 2024-01-31T05:08:27.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:27.314+0000 7f6c3a44f700 1 -- 172.21.15.181:0/2937267591 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6c340ffb20 msgr2=0x7f6c34102460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:27.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:27.314+0000 7f6c3a44f700 1 --2- 172.21.15.181:0/2937267591 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6c340ffb20 0x7f6c34102460 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6c2400d980 tx=0x7f6c2400dd40 comp rx=0 tx=0).stop 2024-01-31T05:08:27.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:27.314+0000 7f6c3a44f700 1 -- 172.21.15.181:0/2937267591 shutdown_connections 2024-01-31T05:08:27.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:27.314+0000 7f6c3a44f700 1 --2- 172.21.15.181:0/2937267591 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f6c1c0a1370 0x7f6c1c0a3830 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:27.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:27.314+0000 7f6c3a44f700 1 --2- 172.21.15.181:0/2937267591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c341034a0 0x7f6c34100ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:27.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:27.314+0000 7f6c3a44f700 1 --2- 172.21.15.181:0/2937267591 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6c340ffb20 0x7f6c34102460 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:27.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:27.314+0000 7f6c3a44f700 1 --2- 172.21.15.181:0/2937267591 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c34102b00 0x7f6c34100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:27.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:27.314+0000 7f6c3a44f700 1 -- 172.21.15.181:0/2937267591 >> 172.21.15.181:0/2937267591 conn(0x7f6c340fb480 msgr2=0x7f6c34105e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:08:27.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:27.315+0000 7f6c3a44f700 1 -- 172.21.15.181:0/2937267591 shutdown_connections 2024-01-31T05:08:27.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:27.315+0000 7f6c3a44f700 1 -- 172.21.15.181:0/2937267591 wait complete. 2024-01-31T05:08:27.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:27 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:27.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:27 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:27.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:27 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:08:27.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:27 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:08:27.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:27 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:27.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:27 smithi181 ceph-mon[36434]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-01-31T05:08:27.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:27 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:27.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:27 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:27.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:27 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:08:27.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:27 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:27.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:27 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:27.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:27 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:08:27.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:27 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:08:27.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:27 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:27.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:27 smithi179 ceph-mon[35652]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-01-31T05:08:27.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:27 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:27.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:27 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:27.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:27 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:08:27.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:27 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:27.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:27 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:27.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:27 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:08:27.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:27 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:08:27.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:27 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:27.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:27 smithi099 ceph-mon[31615]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-01-31T05:08:27.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:27 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:27.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:27 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:27.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:27 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:08:28.004 DEBUG:teuthology.orchestra.run.smithi181:osd.11> sudo journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@osd.11.service 2024-01-31T05:08:28.006 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-01-31T05:08:28.006 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph osd stat -f json 2024-01-31T05:08:28.255 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:08:28.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:28 smithi181 ceph-mon[36434]: from='osd.11 [v2:172.21.15.181:6824/1858219600,v1:172.21.15.181:6825/1858219600]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-01-31T05:08:28.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:28 smithi181 ceph-mon[36434]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-01-31T05:08:28.648 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:28 smithi099 ceph-mon[31615]: from='osd.11 [v2:172.21.15.181:6824/1858219600,v1:172.21.15.181:6825/1858219600]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-01-31T05:08:28.648 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:28 smithi099 ceph-mon[31615]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-01-31T05:08:28.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:28 smithi179 ceph-mon[35652]: from='osd.11 [v2:172.21.15.181:6824/1858219600,v1:172.21.15.181:6825/1858219600]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-01-31T05:08:28.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:28 smithi179 ceph-mon[35652]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-01-31T05:08:29.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:29 smithi181 ceph-mon[36434]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-01-31T05:08:29.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:29 smithi181 ceph-mon[36434]: osdmap e79: 12 total, 11 up, 12 in 2024-01-31T05:08:29.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:29 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-31T05:08:29.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:29 smithi181 ceph-mon[36434]: from='osd.11 [v2:172.21.15.181:6824/1858219600,v1:172.21.15.181:6825/1858219600]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-01-31T05:08:29.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:29 smithi181 ceph-mon[36434]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-01-31T05:08:29.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:29 smithi181 ceph-mon[36434]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-01-31T05:08:29.693 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:29 smithi099 ceph-mon[31615]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-01-31T05:08:29.693 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:29 smithi099 ceph-mon[31615]: osdmap e79: 12 total, 11 up, 12 in 2024-01-31T05:08:29.693 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:29 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-31T05:08:29.694 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:29 smithi099 ceph-mon[31615]: from='osd.11 [v2:172.21.15.181:6824/1858219600,v1:172.21.15.181:6825/1858219600]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-01-31T05:08:29.694 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:29 smithi099 ceph-mon[31615]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-01-31T05:08:29.694 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:29 smithi099 ceph-mon[31615]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-01-31T05:08:29.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:29 smithi179 ceph-mon[35652]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-01-31T05:08:29.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:29 smithi179 ceph-mon[35652]: osdmap e79: 12 total, 11 up, 12 in 2024-01-31T05:08:29.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:29 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-31T05:08:29.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:29 smithi179 ceph-mon[35652]: from='osd.11 [v2:172.21.15.181:6824/1858219600,v1:172.21.15.181:6825/1858219600]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-01-31T05:08:29.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:29 smithi179 ceph-mon[35652]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-01-31T05:08:29.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:29 smithi179 ceph-mon[35652]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-01-31T05:08:30.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.050+0000 7f45f3245700 1 -- 172.21.15.99:0/2560051613 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45ec100710 msgr2=0x7f45ec100b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:30.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.050+0000 7f45f3245700 1 --2- 172.21.15.99:0/2560051613 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45ec100710 0x7f45ec100b30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f45e00099c0 tx=0x7f45e0009cd0 comp rx=0 tx=0).stop 2024-01-31T05:08:30.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.051+0000 7f45f3245700 1 -- 172.21.15.99:0/2560051613 shutdown_connections 2024-01-31T05:08:30.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.051+0000 7f45f3245700 1 --2- 172.21.15.99:0/2560051613 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45ec1022b0 0x7f45ec108b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:30.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.051+0000 7f45f3245700 1 --2- 172.21.15.99:0/2560051613 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45ec100710 0x7f45ec100b30 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:30.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.051+0000 7f45f3245700 1 --2- 172.21.15.99:0/2560051613 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45ec101910 0x7f45ec101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:30.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.051+0000 7f45f3245700 1 -- 172.21.15.99:0/2560051613 >> 172.21.15.99:0/2560051613 conn(0x7f45ec0fbcd0 msgr2=0x7f45ec0fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:08:30.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.051+0000 7f45f3245700 1 -- 172.21.15.99:0/2560051613 shutdown_connections 2024-01-31T05:08:30.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.051+0000 7f45f3245700 1 -- 172.21.15.99:0/2560051613 wait complete. 2024-01-31T05:08:30.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.051+0000 7f45f3245700 1 Processor -- start 2024-01-31T05:08:30.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.051+0000 7f45f3245700 1 -- start start 2024-01-31T05:08:30.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.051+0000 7f45f3245700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45ec100710 0x7f45ec1046a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:30.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.051+0000 7f45f3245700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45ec101910 0x7f45ec102cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:30.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.051+0000 7f45f3245700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45ec1022b0 0x7f45ec103230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:30.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.051+0000 7f45f3245700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ec1039b0 con 0x7f45ec101910 2024-01-31T05:08:30.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.051+0000 7f45f3245700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ec103b20 con 0x7f45ec1022b0 2024-01-31T05:08:30.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.051+0000 7f45f3245700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ec1a1740 con 0x7f45ec100710 2024-01-31T05:08:30.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.051+0000 7f45ebfff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45ec101910 0x7f45ec102cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:30.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.051+0000 7f45ebfff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45ec101910 0x7f45ec102cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33470/0 (socket says 172.21.15.99:33470) 2024-01-31T05:08:30.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.052+0000 7f45f0fe1700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45ec100710 0x7f45ec1046a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:30.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.052+0000 7f45ebfff700 1 -- 172.21.15.99:0/1165438701 learned_addr learned my addr 172.21.15.99:0/1165438701 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:08:30.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.052+0000 7f45f17e2700 1 --2- 172.21.15.99:0/1165438701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45ec1022b0 0x7f45ec103230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:30.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.052+0000 7f45ebfff700 1 -- 172.21.15.99:0/1165438701 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45ec100710 msgr2=0x7f45ec1046a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:30.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.052+0000 7f45ebfff700 1 --2- 172.21.15.99:0/1165438701 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45ec100710 0x7f45ec1046a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:30.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.052+0000 7f45ebfff700 1 -- 172.21.15.99:0/1165438701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45ec1022b0 msgr2=0x7f45ec103230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:30.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.052+0000 7f45ebfff700 1 --2- 172.21.15.99:0/1165438701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45ec1022b0 0x7f45ec103230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:30.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.052+0000 7f45ebfff700 1 -- 172.21.15.99:0/1165438701 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e00095f0 con 0x7f45ec101910 2024-01-31T05:08:30.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.052+0000 7f45ebfff700 1 --2- 172.21.15.99:0/1165438701 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45ec101910 0x7f45ec102cf0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f45d800d980 tx=0x7f45d800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:08:30.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.052+0000 7f45e9ffb700 1 -- 172.21.15.99:0/1165438701 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d8004220 con 0x7f45ec101910 2024-01-31T05:08:30.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.052+0000 7f45f3245700 1 -- 172.21.15.99:0/1165438701 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45ec1a1a20 con 0x7f45ec101910 2024-01-31T05:08:30.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.052+0000 7f45e9ffb700 1 -- 172.21.15.99:0/1165438701 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f45d8007640 con 0x7f45ec101910 2024-01-31T05:08:30.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.052+0000 7f45e9ffb700 1 -- 172.21.15.99:0/1165438701 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d8005610 con 0x7f45ec101910 2024-01-31T05:08:30.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.052+0000 7f45f3245700 1 -- 172.21.15.99:0/1165438701 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45ec1a1f70 con 0x7f45ec101910 2024-01-31T05:08:30.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.053+0000 7f45f3245700 1 -- 172.21.15.99:0/1165438701 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45ec0684a0 con 0x7f45ec101910 2024-01-31T05:08:30.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.054+0000 7f45e9ffb700 1 -- 172.21.15.99:0/1165438701 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f45d8004750 con 0x7f45ec101910 2024-01-31T05:08:30.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.055+0000 7f45e9ffb700 1 --2- 172.21.15.99:0/1165438701 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f45dc0a1370 0x7f45dc0a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:30.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.055+0000 7f45f0fe1700 1 --2- 172.21.15.99:0/1165438701 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f45dc0a1370 0x7f45dc0a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:30.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.055+0000 7f45e9ffb700 1 -- 172.21.15.99:0/1165438701 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f45d80cc440 con 0x7f45ec101910 2024-01-31T05:08:30.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.055+0000 7f45f0fe1700 1 --2- 172.21.15.99:0/1165438701 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f45dc0a1370 0x7f45dc0a3830 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f45e0009f50 tx=0x7f45e00037f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:08:30.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.059+0000 7f45e9ffb700 1 -- 172.21.15.99:0/1165438701 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f45d8095e80 con 0x7f45ec101910 2024-01-31T05:08:30.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.249+0000 7f45f3245700 1 -- 172.21.15.99:0/1165438701 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f45ec10c130 con 0x7f45ec101910 2024-01-31T05:08:30.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.249+0000 7f45e9ffb700 1 -- 172.21.15.99:0/1165438701 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v80) v1 ==== 74+0+133 (secure 0 0 0) 0x7f45d8084090 con 0x7f45ec101910 2024-01-31T05:08:30.249 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:08:30.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.252+0000 7f45f3245700 1 -- 172.21.15.99:0/1165438701 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f45dc0a1370 msgr2=0x7f45dc0a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:30.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.252+0000 7f45f3245700 1 --2- 172.21.15.99:0/1165438701 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f45dc0a1370 0x7f45dc0a3830 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f45e0009f50 tx=0x7f45e00037f0 comp rx=0 tx=0).stop 2024-01-31T05:08:30.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.252+0000 7f45f3245700 1 -- 172.21.15.99:0/1165438701 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45ec101910 msgr2=0x7f45ec102cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:30.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.252+0000 7f45f3245700 1 --2- 172.21.15.99:0/1165438701 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45ec101910 0x7f45ec102cf0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f45d800d980 tx=0x7f45d800dc90 comp rx=0 tx=0).stop 2024-01-31T05:08:30.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.252+0000 7f45f3245700 1 -- 172.21.15.99:0/1165438701 shutdown_connections 2024-01-31T05:08:30.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.252+0000 7f45f3245700 1 --2- 172.21.15.99:0/1165438701 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f45dc0a1370 0x7f45dc0a3830 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:30.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.252+0000 7f45f3245700 1 --2- 172.21.15.99:0/1165438701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45ec1022b0 0x7f45ec103230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:30.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.252+0000 7f45f3245700 1 --2- 172.21.15.99:0/1165438701 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f45ec100710 0x7f45ec1046a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:30.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.252+0000 7f45f3245700 1 --2- 172.21.15.99:0/1165438701 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45ec101910 0x7f45ec102cf0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:30.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.252+0000 7f45f3245700 1 -- 172.21.15.99:0/1165438701 >> 172.21.15.99:0/1165438701 conn(0x7f45ec0fbcd0 msgr2=0x7f45ec069f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:08:30.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.252+0000 7f45f3245700 1 -- 172.21.15.99:0/1165438701 shutdown_connections 2024-01-31T05:08:30.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:30.252+0000 7f45f3245700 1 -- 172.21.15.99:0/1165438701 wait complete. 2024-01-31T05:08:30.541 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:30 smithi099 ceph-mon[31615]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-01-31T05:08:30.541 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:30 smithi099 ceph-mon[31615]: osdmap e80: 12 total, 11 up, 12 in 2024-01-31T05:08:30.541 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:30 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-31T05:08:30.541 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:30 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-31T05:08:30.541 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:30 smithi099 ceph-mon[31615]: from='osd.11 ' entity='osd.11' 2024-01-31T05:08:30.541 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:30 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/1165438701' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-01-31T05:08:30.544 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:30 smithi181 ceph-mon[36434]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-01-31T05:08:30.544 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:30 smithi181 ceph-mon[36434]: osdmap e80: 12 total, 11 up, 12 in 2024-01-31T05:08:30.544 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:30 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-31T05:08:30.544 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:30 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-31T05:08:30.544 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:30 smithi181 ceph-mon[36434]: from='osd.11 ' entity='osd.11' 2024-01-31T05:08:30.544 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:30 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/1165438701' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-01-31T05:08:30.544 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:08:30 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:08:30.225+0000 7ffb8a557700 -1 osd.11 0 waiting for initial osdmap 2024-01-31T05:08:30.545 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:08:30 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:08:30.245+0000 7ffb82b4a700 -1 osd.11 80 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-31T05:08:30.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:30 smithi179 ceph-mon[35652]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-01-31T05:08:30.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:30 smithi179 ceph-mon[35652]: osdmap e80: 12 total, 11 up, 12 in 2024-01-31T05:08:30.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:30 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-31T05:08:30.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:30 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-31T05:08:30.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:30 smithi179 ceph-mon[35652]: from='osd.11 ' entity='osd.11' 2024-01-31T05:08:30.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:30 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/1165438701' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-01-31T05:08:30.980 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":80,"num_osds":12,"num_up_osds":11,"osd_up_since":1706677686,"num_in_osds":12,"osd_in_since":1706677690,"num_remapped_pgs":0} 2024-01-31T05:08:31.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:31 smithi099 ceph-mon[31615]: purged_snaps scrub starts 2024-01-31T05:08:31.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:31 smithi099 ceph-mon[31615]: purged_snaps scrub ok 2024-01-31T05:08:31.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:31 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-31T05:08:31.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:31 smithi099 ceph-mon[31615]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-01-31T05:08:31.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:31 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:31.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:31 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:31.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:31 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:08:31.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:31 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:08:31.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:31 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:08:31.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:31 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:08:31.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:31 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:31.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:31 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:08:31.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:31 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:08:31.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:31 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:31.820 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:31 smithi099 ceph-mon[31615]: osd.11 [v2:172.21.15.181:6824/1858219600,v1:172.21.15.181:6825/1858219600] boot 2024-01-31T05:08:31.820 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:31 smithi099 ceph-mon[31615]: osdmap e81: 12 total, 12 up, 12 in 2024-01-31T05:08:31.820 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:31 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-31T05:08:31.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:31 smithi181 ceph-mon[36434]: purged_snaps scrub starts 2024-01-31T05:08:31.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:31 smithi181 ceph-mon[36434]: purged_snaps scrub ok 2024-01-31T05:08:31.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:31 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-31T05:08:31.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:31 smithi181 ceph-mon[36434]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-01-31T05:08:31.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:31 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:31.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:31 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:31.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:31 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:08:31.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:31 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:08:31.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:31 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:08:31.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:31 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:08:31.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:31 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:31.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:31 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:08:31.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:31 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:08:31.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:31 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:31.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:31 smithi181 ceph-mon[36434]: osd.11 [v2:172.21.15.181:6824/1858219600,v1:172.21.15.181:6825/1858219600] boot 2024-01-31T05:08:31.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:31 smithi181 ceph-mon[36434]: osdmap e81: 12 total, 12 up, 12 in 2024-01-31T05:08:31.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:31 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-31T05:08:31.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:31 smithi179 ceph-mon[35652]: purged_snaps scrub starts 2024-01-31T05:08:31.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:31 smithi179 ceph-mon[35652]: purged_snaps scrub ok 2024-01-31T05:08:31.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:31 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-31T05:08:31.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:31 smithi179 ceph-mon[35652]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-01-31T05:08:31.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:31 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:31.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:31 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:31.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:31 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:08:31.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:31 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:08:31.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:31 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:08:31.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:31 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-01-31T05:08:31.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:31 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:31.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:31 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:08:31.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:31 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:08:31.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:31 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:31.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:31 smithi179 ceph-mon[35652]: osd.11 [v2:172.21.15.181:6824/1858219600,v1:172.21.15.181:6825/1858219600] boot 2024-01-31T05:08:31.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:31 smithi179 ceph-mon[35652]: osdmap e81: 12 total, 12 up, 12 in 2024-01-31T05:08:31.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:31 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-31T05:08:31.981 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph osd stat -f json 2024-01-31T05:08:32.221 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:08:32.635 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:32 smithi181 ceph-mon[36434]: Detected new or changed devices on smithi181 2024-01-31T05:08:32.635 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:32 smithi181 ceph-mon[36434]: Adjusting osd_memory_target on smithi181 to 4270M 2024-01-31T05:08:32.665 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:32 smithi099 ceph-mon[31615]: Detected new or changed devices on smithi181 2024-01-31T05:08:32.665 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:32 smithi099 ceph-mon[31615]: Adjusting osd_memory_target on smithi181 to 4270M 2024-01-31T05:08:32.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:32 smithi179 ceph-mon[35652]: Detected new or changed devices on smithi181 2024-01-31T05:08:32.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:32 smithi179 ceph-mon[35652]: Adjusting osd_memory_target on smithi181 to 4270M 2024-01-31T05:08:33.691 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:33 smithi099 ceph-mon[31615]: osdmap e82: 12 total, 12 up, 12 in 2024-01-31T05:08:33.691 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:33 smithi099 ceph-mon[31615]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:08:33.783 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:33 smithi179 ceph-mon[35652]: osdmap e82: 12 total, 12 up, 12 in 2024-01-31T05:08:33.784 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:33 smithi179 ceph-mon[35652]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:08:33.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:33 smithi181 ceph-mon[36434]: osdmap e82: 12 total, 12 up, 12 in 2024-01-31T05:08:33.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:33 smithi181 ceph-mon[36434]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:08:33.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:33.908+0000 7f4cb2285700 1 -- 172.21.15.99:0/1395339062 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4cac107500 msgr2=0x7f4cac109970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:33.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:33.908+0000 7f4cb2285700 1 --2- 172.21.15.99:0/1395339062 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4cac107500 0x7f4cac109970 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4ca400b0a0 tx=0x7f4ca400b3b0 comp rx=0 tx=0).stop 2024-01-31T05:08:33.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:33.908+0000 7f4cb2285700 1 -- 172.21.15.99:0/1395339062 shutdown_connections 2024-01-31T05:08:33.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:33.908+0000 7f4cb2285700 1 --2- 172.21.15.99:0/1395339062 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4cac107500 0x7f4cac109970 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:33.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:33.908+0000 7f4cb2285700 1 --2- 172.21.15.99:0/1395339062 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cac1022a0 0x7f4cac104690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:33.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:33.908+0000 7f4cb2285700 1 --2- 172.21.15.99:0/1395339062 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4cac104bd0 0x7f4cac106fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:33.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:33.908+0000 7f4cb2285700 1 -- 172.21.15.99:0/1395339062 >> 172.21.15.99:0/1395339062 conn(0x7f4cac0fbcd0 msgr2=0x7f4cac0fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:08:33.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:33.908+0000 7f4cb2285700 1 -- 172.21.15.99:0/1395339062 shutdown_connections 2024-01-31T05:08:33.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:33.908+0000 7f4cb2285700 1 -- 172.21.15.99:0/1395339062 wait complete. 2024-01-31T05:08:33.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:33.908+0000 7f4cb2285700 1 Processor -- start 2024-01-31T05:08:33.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:33.908+0000 7f4cb2285700 1 -- start start 2024-01-31T05:08:33.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:33.909+0000 7f4cb2285700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cac1022a0 0x7f4cac101c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:33.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:33.909+0000 7f4cb2285700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4cac104bd0 0x7f4cac100250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:33.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:33.909+0000 7f4cb2285700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4cac107500 0x7f4cac100790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:33.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:33.909+0000 7f4cb2285700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cac100f10 con 0x7f4cac104bd0 2024-01-31T05:08:33.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:33.909+0000 7f4cb2285700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cac101080 con 0x7f4cac1022a0 2024-01-31T05:08:33.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:33.909+0000 7f4cb2285700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cac1a1a40 con 0x7f4cac107500 2024-01-31T05:08:33.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:33.909+0000 7f4cab7fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4cac104bd0 0x7f4cac100250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:33.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:33.909+0000 7f4cab7fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4cac104bd0 0x7f4cac100250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33478/0 (socket says 172.21.15.99:33478) 2024-01-31T05:08:33.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:33.909+0000 7f4cab7fe700 1 -- 172.21.15.99:0/2581633775 learned_addr learned my addr 172.21.15.99:0/2581633775 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:08:33.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:33.909+0000 7f4cabfff700 1 --2- 172.21.15.99:0/2581633775 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cac1022a0 0x7f4cac101c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:33.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:33.909+0000 7f4cb0822700 1 --2- 172.21.15.99:0/2581633775 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4cac107500 0x7f4cac100790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:33.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:33.909+0000 7f4cab7fe700 1 -- 172.21.15.99:0/2581633775 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4cac107500 msgr2=0x7f4cac100790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:33.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:33.909+0000 7f4cab7fe700 1 --2- 172.21.15.99:0/2581633775 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4cac107500 0x7f4cac100790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:33.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:33.909+0000 7f4cab7fe700 1 -- 172.21.15.99:0/2581633775 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cac1022a0 msgr2=0x7f4cac101c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:33.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:33.909+0000 7f4cab7fe700 1 --2- 172.21.15.99:0/2581633775 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cac1022a0 0x7f4cac101c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:33.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:33.909+0000 7f4cab7fe700 1 -- 172.21.15.99:0/2581633775 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca4009d00 con 0x7f4cac104bd0 2024-01-31T05:08:33.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:33.909+0000 7f4cb0822700 1 --2- 172.21.15.99:0/2581633775 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4cac107500 0x7f4cac100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:08:33.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:33.909+0000 7f4cab7fe700 1 --2- 172.21.15.99:0/2581633775 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4cac104bd0 0x7f4cac100250 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4ca000b530 tx=0x7f4ca000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:08:33.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:33.909+0000 7f4ca97fa700 1 -- 172.21.15.99:0/2581633775 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca0011830 con 0x7f4cac104bd0 2024-01-31T05:08:33.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:33.910+0000 7f4ca97fa700 1 -- 172.21.15.99:0/2581633775 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4ca0011e50 con 0x7f4cac104bd0 2024-01-31T05:08:33.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:33.910+0000 7f4ca97fa700 1 -- 172.21.15.99:0/2581633775 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca000f2e0 con 0x7f4cac104bd0 2024-01-31T05:08:33.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:33.910+0000 7f4cb2285700 1 -- 172.21.15.99:0/2581633775 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cac1a1d20 con 0x7f4cac104bd0 2024-01-31T05:08:33.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:33.910+0000 7f4cb2285700 1 -- 172.21.15.99:0/2581633775 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cac1a2290 con 0x7f4cac104bd0 2024-01-31T05:08:33.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:33.911+0000 7f4cb2285700 1 -- 172.21.15.99:0/2581633775 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cac0fd850 con 0x7f4cac104bd0 2024-01-31T05:08:33.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:33.912+0000 7f4ca97fa700 1 -- 172.21.15.99:0/2581633775 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f4ca0010580 con 0x7f4cac104bd0 2024-01-31T05:08:33.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:33.912+0000 7f4ca97fa700 1 --2- 172.21.15.99:0/2581633775 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f4c940a13f0 0x7f4c940a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:33.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:33.912+0000 7f4cabfff700 1 --2- 172.21.15.99:0/2581633775 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f4c940a13f0 0x7f4c940a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:33.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:33.912+0000 7f4ca97fa700 1 -- 172.21.15.99:0/2581633775 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f4ca00cc110 con 0x7f4cac104bd0 2024-01-31T05:08:33.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:33.913+0000 7f4cabfff700 1 --2- 172.21.15.99:0/2581633775 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f4c940a13f0 0x7f4c940a38b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c006fd0 tx=0x7f4c9c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:08:33.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:33.917+0000 7f4ca97fa700 1 -- 172.21.15.99:0/2581633775 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f4ca0095a30 con 0x7f4cac104bd0 2024-01-31T05:08:34.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:34.107+0000 7f4cb2285700 1 -- 172.21.15.99:0/2581633775 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f4cac10d1a0 con 0x7f4cac104bd0 2024-01-31T05:08:34.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:34.108+0000 7f4ca97fa700 1 -- 172.21.15.99:0/2581633775 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v82) v1 ==== 74+0+133 (secure 0 0 0) 0x7f4ca0099050 con 0x7f4cac104bd0 2024-01-31T05:08:34.107 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:08:34.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:34.110+0000 7f4cb2285700 1 -- 172.21.15.99:0/2581633775 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f4c940a13f0 msgr2=0x7f4c940a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:34.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:34.110+0000 7f4cb2285700 1 --2- 172.21.15.99:0/2581633775 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f4c940a13f0 0x7f4c940a38b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c006fd0 tx=0x7f4c9c008040 comp rx=0 tx=0).stop 2024-01-31T05:08:34.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:34.110+0000 7f4cb2285700 1 -- 172.21.15.99:0/2581633775 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4cac104bd0 msgr2=0x7f4cac100250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:34.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:34.110+0000 7f4cb2285700 1 --2- 172.21.15.99:0/2581633775 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4cac104bd0 0x7f4cac100250 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4ca000b530 tx=0x7f4ca000b8f0 comp rx=0 tx=0).stop 2024-01-31T05:08:34.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:34.110+0000 7f4cb2285700 1 -- 172.21.15.99:0/2581633775 shutdown_connections 2024-01-31T05:08:34.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:34.110+0000 7f4cb2285700 1 --2- 172.21.15.99:0/2581633775 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4cac107500 0x7f4cac100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:34.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:34.110+0000 7f4cb2285700 1 --2- 172.21.15.99:0/2581633775 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f4c940a13f0 0x7f4c940a38b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:34.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:34.110+0000 7f4cb2285700 1 --2- 172.21.15.99:0/2581633775 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cac1022a0 0x7f4cac101c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:34.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:34.110+0000 7f4cb2285700 1 --2- 172.21.15.99:0/2581633775 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4cac104bd0 0x7f4cac100250 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:34.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:34.110+0000 7f4cb2285700 1 -- 172.21.15.99:0/2581633775 >> 172.21.15.99:0/2581633775 conn(0x7f4cac0fbcd0 msgr2=0x7f4cac102cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:08:34.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:34.110+0000 7f4cb2285700 1 -- 172.21.15.99:0/2581633775 shutdown_connections 2024-01-31T05:08:34.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:34.110+0000 7f4cb2285700 1 -- 172.21.15.99:0/2581633775 wait complete. 2024-01-31T05:08:34.702 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:34 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/2581633775' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-01-31T05:08:34.730 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":82,"num_osds":12,"num_up_osds":12,"osd_up_since":1706677711,"num_in_osds":12,"osd_in_since":1706677690,"num_remapped_pgs":0} 2024-01-31T05:08:34.730 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph osd dump --format=json 2024-01-31T05:08:34.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:34 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/2581633775' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-01-31T05:08:34.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:34 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/2581633775' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-01-31T05:08:34.968 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:08:35.817 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:35 smithi099 ceph-mon[31615]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:08:35.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:35 smithi181 ceph-mon[36434]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:08:35.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:35 smithi179 ceph-mon[35652]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:08:36.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.739+0000 7fbdbff5a700 1 -- 172.21.15.99:0/3590890692 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdb81066d0 msgr2=0x7fbdb8106ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:36.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.739+0000 7fbdbff5a700 1 --2- 172.21.15.99:0/3590890692 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdb81066d0 0x7fbdb8106ab0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbdb000b0a0 tx=0x7fbdb000b3b0 comp rx=0 tx=0).stop 2024-01-31T05:08:36.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.739+0000 7fbdbff5a700 1 -- 172.21.15.99:0/3590890692 shutdown_connections 2024-01-31T05:08:36.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.739+0000 7fbdbff5a700 1 --2- 172.21.15.99:0/3590890692 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbdb81010d0 0x7fbdb810d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:36.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.739+0000 7fbdbff5a700 1 --2- 172.21.15.99:0/3590890692 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdb81066d0 0x7fbdb8106ab0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:36.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.739+0000 7fbdbff5a700 1 --2- 172.21.15.99:0/3590890692 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdb8100710 0x7fbdb8100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:36.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.739+0000 7fbdbff5a700 1 -- 172.21.15.99:0/3590890692 >> 172.21.15.99:0/3590890692 conn(0x7fbdb8076700 msgr2=0x7fbdb8076b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:08:36.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.739+0000 7fbdbff5a700 1 -- 172.21.15.99:0/3590890692 shutdown_connections 2024-01-31T05:08:36.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.739+0000 7fbdbff5a700 1 -- 172.21.15.99:0/3590890692 wait complete. 2024-01-31T05:08:36.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.740+0000 7fbdbff5a700 1 Processor -- start 2024-01-31T05:08:36.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.740+0000 7fbdbff5a700 1 -- start start 2024-01-31T05:08:36.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.740+0000 7fbdbff5a700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdb8100710 0x7fbdb8197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:36.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.740+0000 7fbdbff5a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdb81010d0 0x7fbdb81982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:36.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.740+0000 7fbdbff5a700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbdb81066d0 0x7fbdb819c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:36.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.740+0000 7fbdbff5a700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb819cbf0 con 0x7fbdb8100710 2024-01-31T05:08:36.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.740+0000 7fbdbff5a700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb819cd60 con 0x7fbdb81010d0 2024-01-31T05:08:36.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.740+0000 7fbdbff5a700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb819cf20 con 0x7fbdb81066d0 2024-01-31T05:08:36.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.740+0000 7fbdbdcf6700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdb8100710 0x7fbdb8197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:36.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.740+0000 7fbdbdcf6700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdb8100710 0x7fbdb8197d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33512/0 (socket says 172.21.15.99:33512) 2024-01-31T05:08:36.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.740+0000 7fbdbdcf6700 1 -- 172.21.15.99:0/3687940915 learned_addr learned my addr 172.21.15.99:0/3687940915 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:08:36.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.740+0000 7fbdbdcf6700 1 -- 172.21.15.99:0/3687940915 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbdb81066d0 msgr2=0x7fbdb819c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:36.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.740+0000 7fbdbe4f7700 1 --2- 172.21.15.99:0/3687940915 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbdb81066d0 0x7fbdb819c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:36.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.740+0000 7fbdbd4f5700 1 --2- 172.21.15.99:0/3687940915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdb81010d0 0x7fbdb81982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:36.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.740+0000 7fbdbdcf6700 1 --2- 172.21.15.99:0/3687940915 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbdb81066d0 0x7fbdb819c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:36.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.740+0000 7fbdbdcf6700 1 -- 172.21.15.99:0/3687940915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdb81010d0 msgr2=0x7fbdb81982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:36.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.740+0000 7fbdbdcf6700 1 --2- 172.21.15.99:0/3687940915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdb81010d0 0x7fbdb81982a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:36.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.740+0000 7fbdbdcf6700 1 -- 172.21.15.99:0/3687940915 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb0009d00 con 0x7fbdb8100710 2024-01-31T05:08:36.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.740+0000 7fbdbe4f7700 1 --2- 172.21.15.99:0/3687940915 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbdb81066d0 0x7fbdb819c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:08:36.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.741+0000 7fbdbdcf6700 1 --2- 172.21.15.99:0/3687940915 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdb8100710 0x7fbdb8197d60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbdb00062a0 tx=0x7fbdb0007920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:08:36.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.741+0000 7fbdb6ffd700 1 -- 172.21.15.99:0/3687940915 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb000e040 con 0x7fbdb8100710 2024-01-31T05:08:36.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.741+0000 7fbdbff5a700 1 -- 172.21.15.99:0/3687940915 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdb819d1a0 con 0x7fbdb8100710 2024-01-31T05:08:36.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.741+0000 7fbdb6ffd700 1 -- 172.21.15.99:0/3687940915 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbdb0004e60 con 0x7fbdb8100710 2024-01-31T05:08:36.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.741+0000 7fbdb6ffd700 1 -- 172.21.15.99:0/3687940915 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb00053b0 con 0x7fbdb8100710 2024-01-31T05:08:36.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.741+0000 7fbdbff5a700 1 -- 172.21.15.99:0/3687940915 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdb81a4a60 con 0x7fbdb8100710 2024-01-31T05:08:36.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.742+0000 7fbdbff5a700 1 -- 172.21.15.99:0/3687940915 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdb8101e00 con 0x7fbdb8100710 2024-01-31T05:08:36.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.743+0000 7fbdb6ffd700 1 -- 172.21.15.99:0/3687940915 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7fbdb001ba10 con 0x7fbdb8100710 2024-01-31T05:08:36.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.743+0000 7fbdb6ffd700 1 --2- 172.21.15.99:0/3687940915 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fbda00a1370 0x7fbda00a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:36.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.743+0000 7fbdbd4f5700 1 --2- 172.21.15.99:0/3687940915 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fbda00a1370 0x7fbda00a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:36.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.743+0000 7fbdb6ffd700 1 -- 172.21.15.99:0/3687940915 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fbdb00cdf20 con 0x7fbdb8100710 2024-01-31T05:08:36.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.744+0000 7fbdbd4f5700 1 --2- 172.21.15.99:0/3687940915 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fbda00a1370 0x7fbda00a3830 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbdac005950 tx=0x7fbdac0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:08:36.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.748+0000 7fbdb6ffd700 1 -- 172.21.15.99:0/3687940915 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fbdb00978d0 con 0x7fbdb8100710 2024-01-31T05:08:36.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.941+0000 7fbdbff5a700 1 -- 172.21.15.99:0/3687940915 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbdb80684a0 con 0x7fbdb8100710 2024-01-31T05:08:36.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.942+0000 7fbdb6ffd700 1 -- 172.21.15.99:0/3687940915 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18435 (secure 0 0 0) 0x7fbdb80684a0 con 0x7fbdb8100710 2024-01-31T05:08:36.941 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:08:36.941 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":82,"fsid":"9288ff44-bff5-11ee-95b3-87774f69a715","created":"2024-01-31T05:01:26.130917+0000","modified":"2024-01-31T05:08:32.416444+0000","last_up_change":"2024-01-31T05:08:31.228478+0000","last_in_change":"2024-01-31T05:08:10.799511+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:46.842423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b45878d9-28f1-4821-ba72-26a32d3fc780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6803","nonce":1213805280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6805","nonce":1213805280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6809","nonce":1213805280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6807","nonce":1213805280}]},"public_addr":"172.21.15.99:6803/1213805280","cluster_addr":"172.21.15.99:6805/1213805280","heartbeat_back_addr":"172.21.15.99:6809/1213805280","heartbeat_front_addr":"172.21.15.99:6807/1213805280","state":["exists","up"]},{"osd":1,"uuid":"e0b71ff3-5d97-4659-8dea-4c9091e1beb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6801","nonce":2019451677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6803","nonce":2019451677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6807","nonce":2019451677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6805","nonce":2019451677}]},"public_addr":"172.21.15.179:6801/2019451677","cluster_addr":"172.21.15.179:6803/2019451677","heartbeat_back_addr":"172.21.15.179:6807/2019451677","heartbeat_front_addr":"172.21.15.179:6805/2019451677","state":["exists","up"]},{"osd":2,"uuid":"11c919c8-19a9-48b0-8880-3002efcb64f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6801","nonce":3934284457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6803","nonce":3934284457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6807","nonce":3934284457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6805","nonce":3934284457}]},"public_addr":"172.21.15.181:6801/3934284457","cluster_addr":"172.21.15.181:6803/3934284457","heartbeat_back_addr":"172.21.15.181:6807/3934284457","heartbeat_front_addr":"172.21.15.181:6805/3934284457","state":["exists","up"]},{"osd":3,"uuid":"bcab5135-a5d1-45ae-a9b8-674425d3999e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6811","nonce":4207675427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6813","nonce":4207675427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6817","nonce":4207675427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6815","nonce":4207675427}]},"public_addr":"172.21.15.99:6811/4207675427","cluster_addr":"172.21.15.99:6813/4207675427","heartbeat_back_addr":"172.21.15.99:6817/4207675427","heartbeat_front_addr":"172.21.15.99:6815/4207675427","state":["exists","up"]},{"osd":4,"uuid":"0250d7ac-3894-457a-9c04-cc7205d61eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6809","nonce":2861083896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6811","nonce":2861083896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6815","nonce":2861083896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6813","nonce":2861083896}]},"public_addr":"172.21.15.179:6809/2861083896","cluster_addr":"172.21.15.179:6811/2861083896","heartbeat_back_addr":"172.21.15.179:6815/2861083896","heartbeat_front_addr":"172.21.15.179:6813/2861083896","state":["exists","up"]},{"osd":5,"uuid":"5e19222a-c2a4-45bc-8445-1d302f26d11c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6809","nonce":1485017095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6811","nonce":1485017095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6815","nonce":1485017095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6813","nonce":1485017095}]},"public_addr":"172.21.15.181:6809/1485017095","cluster_addr":"172.21.15.181:6811/1485017095","heartbeat_back_addr":"172.21.15.181:6815/1485017095","heartbeat_front_addr":"172.21.15.181:6813/1485017095","state":["exists","up"]},{"osd":6,"uuid":"56555035-f9fc-4e91-96dd-caa632d58adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6819","nonce":1534047839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6821","nonce":1534047839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6825","nonce":1534047839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6823","nonce":1534047839}]},"public_addr":"172.21.15.99:6819/1534047839","cluster_addr":"172.21.15.99:6821/1534047839","heartbeat_back_addr":"172.21.15.99:6825/1534047839","heartbeat_front_addr":"172.21.15.99:6823/1534047839","state":["exists","up"]},{"osd":7,"uuid":"5e079cf5-1340-4599-88a6-df410ef0148e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6817","nonce":3875950553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6819","nonce":3875950553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6823","nonce":3875950553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6821","nonce":3875950553}]},"public_addr":"172.21.15.179:6817/3875950553","cluster_addr":"172.21.15.179:6819/3875950553","heartbeat_back_addr":"172.21.15.179:6823/3875950553","heartbeat_front_addr":"172.21.15.179:6821/3875950553","state":["exists","up"]},{"osd":8,"uuid":"10a73592-4251-4492-b67d-ce9b9d7fff32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6817","nonce":179568936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6819","nonce":179568936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6823","nonce":179568936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6821","nonce":179568936}]},"public_addr":"172.21.15.181:6817/179568936","cluster_addr":"172.21.15.181:6819/179568936","heartbeat_back_addr":"172.21.15.181:6823/179568936","heartbeat_front_addr":"172.21.15.181:6821/179568936","state":["exists","up"]},{"osd":9,"uuid":"f6620e1e-f761-4f1c-917f-cbc748df32a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6827","nonce":315759515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6829","nonce":315759515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6833","nonce":315759515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6831","nonce":315759515}]},"public_addr":"172.21.15.99:6827/315759515","cluster_addr":"172.21.15.99:6829/315759515","heartbeat_back_addr":"172.21.15.99:6833/315759515","heartbeat_front_addr":"172.21.15.99:6831/315759515","state":["exists","up"]},{"osd":10,"uuid":"ee86af7d-66f8-4795-bcc3-dfec79e4680c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6825","nonce":2985063934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6827","nonce":2985063934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6831","nonce":2985063934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6829","nonce":2985063934}]},"public_addr":"172.21.15.179:6825/2985063934","cluster_addr":"172.21.15.179:6827/2985063934","heartbeat_back_addr":"172.21.15.179:6831/2985063934","heartbeat_front_addr":"172.21.15.179:6829/2985063934","state":["exists","up"]},{"osd":11,"uuid":"82f04fee-f6ae-4630-a75b-b12a9c4ab2e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6825","nonce":1858219600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6827","nonce":1858219600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6831","nonce":1858219600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6829","nonce":1858219600}]},"public_addr":"172.21.15.181:6825/1858219600","cluster_addr":"172.21.15.181:6827/1858219600","heartbeat_back_addr":"172.21.15.181:6831/1858219600","heartbeat_front_addr":"172.21.15.181:6829/1858219600","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:55.518970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:04:19.936339+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:04:44.064814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:09.331683+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:34.616774+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:58.881810+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:06:23.869838+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:06:49.127331+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:07:12.847187+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:07:38.231045+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:08:03.949162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:08:28.471802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:0/401101729":"2024-02-01T05:02:20.510858+0000","172.21.15.99:6801/1993198206":"2024-02-01T05:02:20.510858+0000","172.21.15.99:0/3819754569":"2024-02-01T05:02:20.510858+0000","172.21.15.99:0/475390265":"2024-02-01T05:01:53.732026+0000","172.21.15.99:6800/1993198206":"2024-02-01T05:02:20.510858+0000","172.21.15.99:6800/1706888338":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/4150146075":"2024-02-01T05:01:53.732026+0000","172.21.15.99:6801/1706888338":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/2851066598":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/1865156424":"2024-02-01T05:02:20.510858+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:08:36.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.944+0000 7fbdbff5a700 1 -- 172.21.15.99:0/3687940915 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fbda00a1370 msgr2=0x7fbda00a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:36.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.944+0000 7fbdbff5a700 1 --2- 172.21.15.99:0/3687940915 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fbda00a1370 0x7fbda00a3830 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbdac005950 tx=0x7fbdac0058e0 comp rx=0 tx=0).stop 2024-01-31T05:08:36.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.944+0000 7fbdbff5a700 1 -- 172.21.15.99:0/3687940915 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdb8100710 msgr2=0x7fbdb8197d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:36.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.944+0000 7fbdbff5a700 1 --2- 172.21.15.99:0/3687940915 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdb8100710 0x7fbdb8197d60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbdb00062a0 tx=0x7fbdb0007920 comp rx=0 tx=0).stop 2024-01-31T05:08:36.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.944+0000 7fbdbff5a700 1 -- 172.21.15.99:0/3687940915 shutdown_connections 2024-01-31T05:08:36.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.944+0000 7fbdbff5a700 1 --2- 172.21.15.99:0/3687940915 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbdb81066d0 0x7fbdb819c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:36.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.944+0000 7fbdbff5a700 1 --2- 172.21.15.99:0/3687940915 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdb8100710 0x7fbdb8197d60 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:36.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.944+0000 7fbdbff5a700 1 --2- 172.21.15.99:0/3687940915 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fbda00a1370 0x7fbda00a3830 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:36.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.944+0000 7fbdbff5a700 1 --2- 172.21.15.99:0/3687940915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdb81010d0 0x7fbdb81982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:36.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.944+0000 7fbdbff5a700 1 -- 172.21.15.99:0/3687940915 >> 172.21.15.99:0/3687940915 conn(0x7fbdb8076700 msgr2=0x7fbdb806a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:08:36.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.944+0000 7fbdbff5a700 1 -- 172.21.15.99:0/3687940915 shutdown_connections 2024-01-31T05:08:36.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:36.944+0000 7fbdbff5a700 1 -- 172.21.15.99:0/3687940915 wait complete. 2024-01-31T05:08:37.646 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-31T05:04:46.842423+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-31T05:08:37.647 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph osd pool get .mgr pg_num 2024-01-31T05:08:37.883 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:08:38.005 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:37 smithi099 ceph-mon[31615]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:08:38.005 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:37 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/3687940915' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:08:38.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:37 smithi181 ceph-mon[36434]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:08:38.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:37 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/3687940915' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:08:38.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:37 smithi179 ceph-mon[35652]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:08:38.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:37 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/3687940915' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:08:39.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.524+0000 7fa19b08f700 1 -- 172.21.15.99:0/2230993177 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa1941006c0 msgr2=0x7fa194100b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:39.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.524+0000 7fa19b08f700 1 --2- 172.21.15.99:0/2230993177 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa1941006c0 0x7fa194100b40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa180009990 tx=0x7fa180009ca0 comp rx=0 tx=0).stop 2024-01-31T05:08:39.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.524+0000 7fa19b08f700 1 -- 172.21.15.99:0/2230993177 shutdown_connections 2024-01-31T05:08:39.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.524+0000 7fa19b08f700 1 --2- 172.21.15.99:0/2230993177 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa194101080 0x7fa19410d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:39.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.524+0000 7fa19b08f700 1 --2- 172.21.15.99:0/2230993177 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa194105590 0x7fa194105970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:39.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.524+0000 7fa19b08f700 1 --2- 172.21.15.99:0/2230993177 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa1941006c0 0x7fa194100b40 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:39.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.524+0000 7fa19b08f700 1 -- 172.21.15.99:0/2230993177 >> 172.21.15.99:0/2230993177 conn(0x7fa1940776f0 msgr2=0x7fa194077b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:08:39.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.524+0000 7fa19b08f700 1 -- 172.21.15.99:0/2230993177 shutdown_connections 2024-01-31T05:08:39.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.524+0000 7fa19b08f700 1 -- 172.21.15.99:0/2230993177 wait complete. 2024-01-31T05:08:39.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.525+0000 7fa19b08f700 1 Processor -- start 2024-01-31T05:08:39.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.525+0000 7fa19b08f700 1 -- start start 2024-01-31T05:08:39.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.525+0000 7fa19b08f700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1941006c0 0x7fa194199f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:39.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.525+0000 7fa19b08f700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa194101080 0x7fa19419a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:39.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.525+0000 7fa19b08f700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa194105590 0x7fa19419e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:39.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.525+0000 7fa19b08f700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19419ee30 con 0x7fa194101080 2024-01-31T05:08:39.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.525+0000 7fa19b08f700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19419efa0 con 0x7fa1941006c0 2024-01-31T05:08:39.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.525+0000 7fa19b08f700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19419f160 con 0x7fa194105590 2024-01-31T05:08:39.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.525+0000 7fa193fff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa194101080 0x7fa19419a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:39.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.525+0000 7fa193fff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa194101080 0x7fa19419a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33528/0 (socket says 172.21.15.99:33528) 2024-01-31T05:08:39.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.525+0000 7fa193fff700 1 -- 172.21.15.99:0/2217853557 learned_addr learned my addr 172.21.15.99:0/2217853557 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:08:39.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.525+0000 7fa19962c700 1 --2- 172.21.15.99:0/2217853557 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa194105590 0x7fa19419e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:39.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.526+0000 7fa198e2b700 1 --2- 172.21.15.99:0/2217853557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1941006c0 0x7fa194199f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:39.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.526+0000 7fa193fff700 1 -- 172.21.15.99:0/2217853557 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa194105590 msgr2=0x7fa19419e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:39.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.526+0000 7fa193fff700 1 --2- 172.21.15.99:0/2217853557 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa194105590 0x7fa19419e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:39.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.526+0000 7fa193fff700 1 -- 172.21.15.99:0/2217853557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1941006c0 msgr2=0x7fa194199f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:39.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.526+0000 7fa193fff700 1 --2- 172.21.15.99:0/2217853557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1941006c0 0x7fa194199f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:39.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.526+0000 7fa193fff700 1 -- 172.21.15.99:0/2217853557 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1800095f0 con 0x7fa194101080 2024-01-31T05:08:39.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.526+0000 7fa198e2b700 1 --2- 172.21.15.99:0/2217853557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1941006c0 0x7fa194199f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:08:39.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.526+0000 7fa193fff700 1 --2- 172.21.15.99:0/2217853557 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa194101080 0x7fa19419a490 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa180000c00 tx=0x7fa18000f880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:08:39.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.526+0000 7fa191ffb700 1 -- 172.21.15.99:0/2217853557 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18001d070 con 0x7fa194101080 2024-01-31T05:08:39.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.526+0000 7fa19b08f700 1 -- 172.21.15.99:0/2217853557 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa19419f3e0 con 0x7fa194101080 2024-01-31T05:08:39.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.526+0000 7fa191ffb700 1 -- 172.21.15.99:0/2217853557 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa18000fde0 con 0x7fa194101080 2024-01-31T05:08:39.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.526+0000 7fa191ffb700 1 -- 172.21.15.99:0/2217853557 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa180017770 con 0x7fa194101080 2024-01-31T05:08:39.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.526+0000 7fa19b08f700 1 -- 172.21.15.99:0/2217853557 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1941a6ca0 con 0x7fa194101080 2024-01-31T05:08:39.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.527+0000 7fa19b08f700 1 -- 172.21.15.99:0/2217853557 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa194103910 con 0x7fa194101080 2024-01-31T05:08:39.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.528+0000 7fa191ffb700 1 -- 172.21.15.99:0/2217853557 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7fa180022aa0 con 0x7fa194101080 2024-01-31T05:08:39.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.529+0000 7fa191ffb700 1 --2- 172.21.15.99:0/2217853557 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa1840a1370 0x7fa1840a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:39.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.529+0000 7fa198e2b700 1 --2- 172.21.15.99:0/2217853557 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa1840a1370 0x7fa1840a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:39.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.529+0000 7fa191ffb700 1 -- 172.21.15.99:0/2217853557 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fa1800cdb90 con 0x7fa194101080 2024-01-31T05:08:39.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.529+0000 7fa198e2b700 1 --2- 172.21.15.99:0/2217853557 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa1840a1370 0x7fa1840a3830 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa188007900 tx=0x7fa188008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:08:39.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.533+0000 7fa191ffb700 1 -- 172.21.15.99:0/2217853557 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fa18005d600 con 0x7fa194101080 2024-01-31T05:08:39.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.722+0000 7fa19b08f700 1 -- 172.21.15.99:0/2217853557 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa19419b2b0 con 0x7fa194101080 2024-01-31T05:08:39.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.723+0000 7fa191ffb700 1 -- 172.21.15.99:0/2217853557 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa180097540 con 0x7fa194101080 2024-01-31T05:08:39.722 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-01-31T05:08:39.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.725+0000 7fa19b08f700 1 -- 172.21.15.99:0/2217853557 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa1840a1370 msgr2=0x7fa1840a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:39.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.725+0000 7fa19b08f700 1 --2- 172.21.15.99:0/2217853557 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa1840a1370 0x7fa1840a3830 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa188007900 tx=0x7fa188008040 comp rx=0 tx=0).stop 2024-01-31T05:08:39.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.725+0000 7fa19b08f700 1 -- 172.21.15.99:0/2217853557 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa194101080 msgr2=0x7fa19419a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:39.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.725+0000 7fa19b08f700 1 --2- 172.21.15.99:0/2217853557 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa194101080 0x7fa19419a490 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa180000c00 tx=0x7fa18000f880 comp rx=0 tx=0).stop 2024-01-31T05:08:39.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.725+0000 7fa19b08f700 1 -- 172.21.15.99:0/2217853557 shutdown_connections 2024-01-31T05:08:39.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.725+0000 7fa19b08f700 1 --2- 172.21.15.99:0/2217853557 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa194105590 0x7fa19419e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:39.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.725+0000 7fa19b08f700 1 --2- 172.21.15.99:0/2217853557 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa1840a1370 0x7fa1840a3830 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:39.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.725+0000 7fa19b08f700 1 --2- 172.21.15.99:0/2217853557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1941006c0 0x7fa194199f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:39.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.725+0000 7fa19b08f700 1 --2- 172.21.15.99:0/2217853557 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa194101080 0x7fa19419a490 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:39.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.725+0000 7fa19b08f700 1 -- 172.21.15.99:0/2217853557 >> 172.21.15.99:0/2217853557 conn(0x7fa1940776f0 msgr2=0x7fa1940fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:08:39.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.725+0000 7fa19b08f700 1 -- 172.21.15.99:0/2217853557 shutdown_connections 2024-01-31T05:08:39.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:39.725+0000 7fa19b08f700 1 -- 172.21.15.99:0/2217853557 wait complete. 2024-01-31T05:08:40.040 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:39 smithi099 ceph-mon[31615]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:08:40.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:39 smithi181 ceph-mon[36434]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:08:40.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:39 smithi179 ceph-mon[35652]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:08:40.353 INFO:tasks.cephadm:Adding mds.a on smithi099 2024-01-31T05:08:40.353 INFO:tasks.cephadm:Adding mds.d on smithi099 2024-01-31T05:08:40.353 INFO:tasks.cephadm:Adding mds.g on smithi099 2024-01-31T05:08:40.353 INFO:tasks.cephadm:Adding mds.j on smithi099 2024-01-31T05:08:40.353 INFO:tasks.cephadm:Adding mds.b on smithi179 2024-01-31T05:08:40.353 INFO:tasks.cephadm:Adding mds.e on smithi179 2024-01-31T05:08:40.353 INFO:tasks.cephadm:Adding mds.h on smithi179 2024-01-31T05:08:40.353 INFO:tasks.cephadm:Adding mds.k on smithi179 2024-01-31T05:08:40.353 INFO:tasks.cephadm:Adding mds.c on smithi181 2024-01-31T05:08:40.354 INFO:tasks.cephadm:Adding mds.f on smithi181 2024-01-31T05:08:40.354 INFO:tasks.cephadm:Adding mds.i on smithi181 2024-01-31T05:08:40.354 INFO:tasks.cephadm:Adding mds.l on smithi181 2024-01-31T05:08:40.354 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph orch apply mds all '12;smithi099=a;smithi099=d;smithi099=g;smithi099=j;smithi179=b;smithi179=e;smithi179=h;smithi179=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l' 2024-01-31T05:08:40.603 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.c/config 2024-01-31T05:08:40.945 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:40 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/2217853557' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-31T05:08:40.973 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:40 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/2217853557' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-31T05:08:41.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:40 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/2217853557' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-31T05:08:41.810 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:41 smithi181 ceph-mon[36434]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:08:42.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.004+0000 7fa9b0571700 1 -- 172.21.15.181:0/2408731286 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9a80ffaf0 msgr2=0x7fa9a80fff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:42.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.004+0000 7fa9b0571700 1 --2- 172.21.15.181:0/2408731286 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9a80ffaf0 0x7fa9a80fff10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa9a4009990 tx=0x7fa9a4009ca0 comp rx=0 tx=0).stop 2024-01-31T05:08:42.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.004+0000 7fa9b0571700 1 -- 172.21.15.181:0/2408731286 shutdown_connections 2024-01-31T05:08:42.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.004+0000 7fa9b0571700 1 --2- 172.21.15.181:0/2408731286 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa9a8103470 0x7fa9a8109d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:42.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.004+0000 7fa9b0571700 1 --2- 172.21.15.181:0/2408731286 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9a80ffaf0 0x7fa9a80fff10 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:42.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.004+0000 7fa9b0571700 1 --2- 172.21.15.181:0/2408731286 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9a8102ad0 0x7fa9a8102f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:42.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.004+0000 7fa9b0571700 1 -- 172.21.15.181:0/2408731286 >> 172.21.15.181:0/2408731286 conn(0x7fa9a80fb430 msgr2=0x7fa9a80fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:08:42.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.004+0000 7fa9b0571700 1 -- 172.21.15.181:0/2408731286 shutdown_connections 2024-01-31T05:08:42.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.004+0000 7fa9b0571700 1 -- 172.21.15.181:0/2408731286 wait complete. 2024-01-31T05:08:42.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.004+0000 7fa9b0571700 1 Processor -- start 2024-01-31T05:08:42.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.005+0000 7fa9b0571700 1 -- start start 2024-01-31T05:08:42.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.005+0000 7fa9b0571700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9a80ffaf0 0x7fa9a8197770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:42.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.005+0000 7fa9b0571700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa9a8102ad0 0x7fa9a8197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:42.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.005+0000 7fa9b0571700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9a8103470 0x7fa9a819ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:42.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.005+0000 7fa9b0571700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a819f300 con 0x7fa9a80ffaf0 2024-01-31T05:08:42.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.005+0000 7fa9b0571700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a819f440 con 0x7fa9a8102ad0 2024-01-31T05:08:42.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.005+0000 7fa9b0571700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a819f5d0 con 0x7fa9a8103470 2024-01-31T05:08:42.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.005+0000 7fa9aeb0e700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9a8103470 0x7fa9a819ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:42.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.005+0000 7fa9aeb0e700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9a8103470 0x7fa9a819ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:34238/0 (socket says 172.21.15.181:34238) 2024-01-31T05:08:42.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.005+0000 7fa9aeb0e700 1 -- 172.21.15.181:0/225930092 learned_addr learned my addr 172.21.15.181:0/225930092 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-01-31T05:08:42.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.005+0000 7fa9ae30d700 1 --2- 172.21.15.181:0/225930092 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9a80ffaf0 0x7fa9a8197770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:42.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.005+0000 7fa9adb0c700 1 --2- 172.21.15.181:0/225930092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa9a8102ad0 0x7fa9a8197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:42.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.005+0000 7fa9aeb0e700 1 -- 172.21.15.181:0/225930092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa9a8102ad0 msgr2=0x7fa9a8197cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:42.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.005+0000 7fa9aeb0e700 1 --2- 172.21.15.181:0/225930092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa9a8102ad0 0x7fa9a8197cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:42.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.005+0000 7fa9aeb0e700 1 -- 172.21.15.181:0/225930092 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9a80ffaf0 msgr2=0x7fa9a8197770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:42.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.005+0000 7fa9aeb0e700 1 --2- 172.21.15.181:0/225930092 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9a80ffaf0 0x7fa9a8197770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:42.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.005+0000 7fa9aeb0e700 1 -- 172.21.15.181:0/225930092 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a40095f0 con 0x7fa9a8103470 2024-01-31T05:08:42.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.005+0000 7fa9aeb0e700 1 --2- 172.21.15.181:0/225930092 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9a8103470 0x7fa9a819ed30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0007f10 tx=0x7fa9a000d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:08:42.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.005+0000 7fa99f7fe700 1 -- 172.21.15.181:0/225930092 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a0017070 con 0x7fa9a8103470 2024-01-31T05:08:42.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.005+0000 7fa99f7fe700 1 -- 172.21.15.181:0/225930092 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa9a000f040 con 0x7fa9a8103470 2024-01-31T05:08:42.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.005+0000 7fa9b0571700 1 -- 172.21.15.181:0/225930092 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9a819f8b0 con 0x7fa9a8103470 2024-01-31T05:08:42.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.006+0000 7fa99f7fe700 1 -- 172.21.15.181:0/225930092 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a0005740 con 0x7fa9a8103470 2024-01-31T05:08:42.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.006+0000 7fa9b0571700 1 -- 172.21.15.181:0/225930092 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9a819fdb0 con 0x7fa9a8103470 2024-01-31T05:08:42.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.006+0000 7fa9b0571700 1 -- 172.21.15.181:0/225930092 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9a8108d30 con 0x7fa9a8103470 2024-01-31T05:08:42.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.007+0000 7fa99f7fe700 1 -- 172.21.15.181:0/225930092 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7fa9a00058a0 con 0x7fa9a8103470 2024-01-31T05:08:42.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.008+0000 7fa99f7fe700 1 --2- 172.21.15.181:0/225930092 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa9940a1370 0x7fa9940a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:42.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.008+0000 7fa99f7fe700 1 -- 172.21.15.181:0/225930092 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fa9a00cbe80 con 0x7fa9a8103470 2024-01-31T05:08:42.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.008+0000 7fa9ae30d700 1 --2- 172.21.15.181:0/225930092 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa9940a1370 0x7fa9940a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:42.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.009+0000 7fa9ae30d700 1 --2- 172.21.15.181:0/225930092 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa9940a1370 0x7fa9940a3830 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa9a400b5c0 tx=0x7fa9a4003790 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:08:42.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.012+0000 7fa99f7fe700 1 -- 172.21.15.181:0/225930092 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fa9a00957a0 con 0x7fa9a8103470 2024-01-31T05:08:42.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:41 smithi099 ceph-mon[31615]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:08:42.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:41 smithi179 ceph-mon[35652]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:08:42.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.216+0000 7fa9b0571700 1 -- 172.21.15.181:0/225930092 --> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi099=a;smithi099=d;smithi099=g;smithi099=j;smithi179=b;smithi179=e;smithi179=h;smithi179=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l", "target": ["mon-mgr", ""]}) v1 -- 0x7fa9a802d640 con 0x7fa9940a1370 2024-01-31T05:08:42.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.224+0000 7fa99f7fe700 1 -- 172.21.15.181:0/225930092 <== mgr.14152 v2:172.21.15.99:6800/3925720924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fa9a802d640 con 0x7fa9940a1370 2024-01-31T05:08:42.223 INFO:teuthology.orchestra.run.smithi181.stdout:Scheduled mds.all update... 2024-01-31T05:08:42.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.226+0000 7fa9b0571700 1 -- 172.21.15.181:0/225930092 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa9940a1370 msgr2=0x7fa9940a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:42.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.226+0000 7fa9b0571700 1 --2- 172.21.15.181:0/225930092 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa9940a1370 0x7fa9940a3830 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa9a400b5c0 tx=0x7fa9a4003790 comp rx=0 tx=0).stop 2024-01-31T05:08:42.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.226+0000 7fa9b0571700 1 -- 172.21.15.181:0/225930092 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9a8103470 msgr2=0x7fa9a819ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:42.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.226+0000 7fa9b0571700 1 --2- 172.21.15.181:0/225930092 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9a8103470 0x7fa9a819ed30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0007f10 tx=0x7fa9a000d3b0 comp rx=0 tx=0).stop 2024-01-31T05:08:42.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.226+0000 7fa9b0571700 1 -- 172.21.15.181:0/225930092 shutdown_connections 2024-01-31T05:08:42.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.226+0000 7fa9b0571700 1 --2- 172.21.15.181:0/225930092 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9a8103470 0x7fa9a819ed30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:42.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.226+0000 7fa9b0571700 1 --2- 172.21.15.181:0/225930092 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9a80ffaf0 0x7fa9a8197770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:42.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.226+0000 7fa9b0571700 1 --2- 172.21.15.181:0/225930092 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa9940a1370 0x7fa9940a3830 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:42.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.226+0000 7fa9b0571700 1 --2- 172.21.15.181:0/225930092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa9a8102ad0 0x7fa9a8197cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:42.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.226+0000 7fa9b0571700 1 -- 172.21.15.181:0/225930092 >> 172.21.15.181:0/225930092 conn(0x7fa9a80fb430 msgr2=0x7fa9a8105e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:08:42.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.227+0000 7fa9b0571700 1 -- 172.21.15.181:0/225930092 shutdown_connections 2024-01-31T05:08:42.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-01-31T05:08:42.227+0000 7fa9b0571700 1 -- 172.21.15.181:0/225930092 wait complete. 2024-01-31T05:08:42.830 DEBUG:teuthology.orchestra.run.smithi099:mds.a> sudo journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mds.a.service 2024-01-31T05:08:42.833 DEBUG:teuthology.orchestra.run.smithi099:mds.d> sudo journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mds.d.service 2024-01-31T05:08:42.877 DEBUG:teuthology.orchestra.run.smithi099:mds.g> sudo journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mds.g.service 2024-01-31T05:08:42.920 DEBUG:teuthology.orchestra.run.smithi099:mds.j> sudo journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mds.j.service 2024-01-31T05:08:42.964 DEBUG:teuthology.orchestra.run.smithi179:mds.b> sudo journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mds.b.service 2024-01-31T05:08:42.966 DEBUG:teuthology.orchestra.run.smithi179:mds.e> sudo journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mds.e.service 2024-01-31T05:08:43.009 DEBUG:teuthology.orchestra.run.smithi179:mds.h> sudo journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mds.h.service 2024-01-31T05:08:43.053 DEBUG:teuthology.orchestra.run.smithi179:mds.k> sudo journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mds.k.service 2024-01-31T05:08:43.096 DEBUG:teuthology.orchestra.run.smithi181:mds.c> sudo journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mds.c.service 2024-01-31T05:08:43.099 DEBUG:teuthology.orchestra.run.smithi181:mds.f> sudo journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mds.f.service 2024-01-31T05:08:43.142 DEBUG:teuthology.orchestra.run.smithi181:mds.i> sudo journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mds.i.service 2024-01-31T05:08:43.185 DEBUG:teuthology.orchestra.run.smithi181:mds.l> sudo journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mds.l.service 2024-01-31T05:08:43.228 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-01-31T05:08:43.228 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:08:43.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.336+0000 7f92ea7e1640 1 -- 172.21.15.99:0/4042723841 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92e41028c0 msgr2=0x7f92e4109150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:43.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.336+0000 7f92ea7e1640 1 --2- 172.21.15.99:0/4042723841 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92e41028c0 0x7f92e4109150 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f92dc009ca0 tx=0x7f92dc02c0f0 comp rx=0 tx=0).stop 2024-01-31T05:08:43.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.336+0000 7f92ea7e1640 1 -- 172.21.15.99:0/4042723841 shutdown_connections 2024-01-31T05:08:43.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.336+0000 7f92ea7e1640 1 --2- 172.21.15.99:0/4042723841 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92e41028c0 0x7f92e4109150 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:43.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.336+0000 7f92ea7e1640 1 --2- 172.21.15.99:0/4042723841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92e4101f00 0x7f92e4102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:43.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.336+0000 7f92ea7e1640 1 --2- 172.21.15.99:0/4042723841 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92e4100d10 0x7f92e4101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:43.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.336+0000 7f92ea7e1640 1 -- 172.21.15.99:0/4042723841 >> 172.21.15.99:0/4042723841 conn(0x7f92e40fc2a0 msgr2=0x7f92e40fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:08:43.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.336+0000 7f92ea7e1640 1 -- 172.21.15.99:0/4042723841 shutdown_connections 2024-01-31T05:08:43.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.336+0000 7f92ea7e1640 1 -- 172.21.15.99:0/4042723841 wait complete. 2024-01-31T05:08:43.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.337+0000 7f92ea7e1640 1 Processor -- start 2024-01-31T05:08:43.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.337+0000 7f92ea7e1640 1 -- start start 2024-01-31T05:08:43.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.337+0000 7f92ea7e1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92e4100d10 0x7f92e4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:43.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.337+0000 7f92ea7e1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92e4101f00 0x7f92e40730e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:43.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.337+0000 7f92ea7e1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92e41028c0 0x7f92e4073620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:43.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.337+0000 7f92ea7e1640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e4073d80 con 0x7f92e4100d10 2024-01-31T05:08:43.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.337+0000 7f92ea7e1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e4073ef0 con 0x7f92e4101f00 2024-01-31T05:08:43.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.337+0000 7f92ea7e1640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e41a0c30 con 0x7f92e41028c0 2024-01-31T05:08:43.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.337+0000 7f92e3fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92e4100d10 0x7f92e4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:43.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.337+0000 7f92e3fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92e4100d10 0x7f92e4074aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33554/0 (socket says 172.21.15.99:33554) 2024-01-31T05:08:43.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.337+0000 7f92e3fff640 1 -- 172.21.15.99:0/2341331527 learned_addr learned my addr 172.21.15.99:0/2341331527 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:08:43.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.337+0000 7f92e8d7e640 1 --2- 172.21.15.99:0/2341331527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92e41028c0 0x7f92e4073620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:43.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.337+0000 7f92e37fe640 1 --2- 172.21.15.99:0/2341331527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92e4101f00 0x7f92e40730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:43.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.337+0000 7f92e3fff640 1 -- 172.21.15.99:0/2341331527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92e41028c0 msgr2=0x7f92e4073620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:43.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.337+0000 7f92e3fff640 1 --2- 172.21.15.99:0/2341331527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92e41028c0 0x7f92e4073620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:43.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.337+0000 7f92e3fff640 1 -- 172.21.15.99:0/2341331527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92e4101f00 msgr2=0x7f92e40730e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:43.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.337+0000 7f92e3fff640 1 --2- 172.21.15.99:0/2341331527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92e4101f00 0x7f92e40730e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:43.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.337+0000 7f92e3fff640 1 -- 172.21.15.99:0/2341331527 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92dc009900 con 0x7f92e4100d10 2024-01-31T05:08:43.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.338+0000 7f92e3fff640 1 --2- 172.21.15.99:0/2341331527 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92e4100d10 0x7f92e4074aa0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f92d400d980 tx=0x7f92d400dd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:08:43.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.338+0000 7f92e17fa640 1 -- 172.21.15.99:0/2341331527 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d400bea0 con 0x7f92e4100d10 2024-01-31T05:08:43.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.338+0000 7f92e17fa640 1 -- 172.21.15.99:0/2341331527 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f92d4009c30 con 0x7f92e4100d10 2024-01-31T05:08:43.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.338+0000 7f92ea7e1640 1 -- 172.21.15.99:0/2341331527 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92e41a0ee0 con 0x7f92e4100d10 2024-01-31T05:08:43.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.338+0000 7f92e17fa640 1 -- 172.21.15.99:0/2341331527 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d400f6b0 con 0x7f92e4100d10 2024-01-31T05:08:43.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.338+0000 7f92ea7e1640 1 -- 172.21.15.99:0/2341331527 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92e41a1300 con 0x7f92e4100d10 2024-01-31T05:08:43.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.339+0000 7f92ea7e1640 1 -- 172.21.15.99:0/2341331527 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92e4107fd0 con 0x7f92e4100d10 2024-01-31T05:08:43.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.340+0000 7f92e17fa640 1 -- 172.21.15.99:0/2341331527 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f92d40109b0 con 0x7f92e4100d10 2024-01-31T05:08:43.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.341+0000 7f92e17fa640 1 --2- 172.21.15.99:0/2341331527 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f92cc0a12e0 0x7f92cc0a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:43.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.341+0000 7f92e37fe640 1 --2- 172.21.15.99:0/2341331527 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f92cc0a12e0 0x7f92cc0a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:43.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.341+0000 7f92e17fa640 1 -- 172.21.15.99:0/2341331527 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f92d40cc5a0 con 0x7f92e4100d10 2024-01-31T05:08:43.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.341+0000 7f92e37fe640 1 --2- 172.21.15.99:0/2341331527 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f92cc0a12e0 0x7f92cc0a37a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f92e4074810 tx=0x7f92d800a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:08:43.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.345+0000 7f92e17fa640 1 -- 172.21.15.99:0/2341331527 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f92d4095ec0 con 0x7f92e4100d10 2024-01-31T05:08:43.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:43 smithi179 ceph-mon[35652]: from='client.24358 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi099=a;smithi099=d;smithi099=g;smithi099=j;smithi179=b;smithi179=e;smithi179=h;smithi179=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:08:43.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:43 smithi179 ceph-mon[35652]: Saving service mds.all spec with placement smithi099=a;smithi099=d;smithi099=g;smithi099=j;smithi179=b;smithi179=e;smithi179=h;smithi179=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l;count:12 2024-01-31T05:08:43.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:43 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:43.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:43 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:08:43.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:43 smithi179 ceph-mon[35652]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:08:43.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:43 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:08:43.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:43 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:08:43.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:43 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:43.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:43 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-31T05:08:43.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:43 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-31T05:08:43.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:43 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:08:43.472 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:43 smithi181 ceph-mon[36434]: from='client.24358 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi099=a;smithi099=d;smithi099=g;smithi099=j;smithi179=b;smithi179=e;smithi179=h;smithi179=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:08:43.473 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:43 smithi181 ceph-mon[36434]: Saving service mds.all spec with placement smithi099=a;smithi099=d;smithi099=g;smithi099=j;smithi179=b;smithi179=e;smithi179=h;smithi179=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l;count:12 2024-01-31T05:08:43.473 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:43 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:43.473 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:43 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:08:43.473 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:43 smithi181 ceph-mon[36434]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:08:43.473 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:43 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:08:43.473 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:43 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:08:43.473 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:43 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:43.473 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:43 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-31T05:08:43.473 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:43 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-31T05:08:43.473 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:43 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:08:43.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.518+0000 7f92ea7e1640 1 -- 172.21.15.99:0/2341331527 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f92e410c860 con 0x7f92e4100d10 2024-01-31T05:08:43.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.519+0000 7f92e17fa640 1 -- 172.21.15.99:0/2341331527 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18435 (secure 0 0 0) 0x7f92d40994e0 con 0x7f92e4100d10 2024-01-31T05:08:43.519 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:08:43.519 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":82,"fsid":"9288ff44-bff5-11ee-95b3-87774f69a715","created":"2024-01-31T05:01:26.130917+0000","modified":"2024-01-31T05:08:32.416444+0000","last_up_change":"2024-01-31T05:08:31.228478+0000","last_in_change":"2024-01-31T05:08:10.799511+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:46.842423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b45878d9-28f1-4821-ba72-26a32d3fc780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6803","nonce":1213805280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6805","nonce":1213805280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6809","nonce":1213805280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6807","nonce":1213805280}]},"public_addr":"172.21.15.99:6803/1213805280","cluster_addr":"172.21.15.99:6805/1213805280","heartbeat_back_addr":"172.21.15.99:6809/1213805280","heartbeat_front_addr":"172.21.15.99:6807/1213805280","state":["exists","up"]},{"osd":1,"uuid":"e0b71ff3-5d97-4659-8dea-4c9091e1beb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6801","nonce":2019451677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6803","nonce":2019451677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6807","nonce":2019451677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6805","nonce":2019451677}]},"public_addr":"172.21.15.179:6801/2019451677","cluster_addr":"172.21.15.179:6803/2019451677","heartbeat_back_addr":"172.21.15.179:6807/2019451677","heartbeat_front_addr":"172.21.15.179:6805/2019451677","state":["exists","up"]},{"osd":2,"uuid":"11c919c8-19a9-48b0-8880-3002efcb64f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6801","nonce":3934284457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6803","nonce":3934284457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6807","nonce":3934284457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6805","nonce":3934284457}]},"public_addr":"172.21.15.181:6801/3934284457","cluster_addr":"172.21.15.181:6803/3934284457","heartbeat_back_addr":"172.21.15.181:6807/3934284457","heartbeat_front_addr":"172.21.15.181:6805/3934284457","state":["exists","up"]},{"osd":3,"uuid":"bcab5135-a5d1-45ae-a9b8-674425d3999e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6811","nonce":4207675427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6813","nonce":4207675427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6817","nonce":4207675427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6815","nonce":4207675427}]},"public_addr":"172.21.15.99:6811/4207675427","cluster_addr":"172.21.15.99:6813/4207675427","heartbeat_back_addr":"172.21.15.99:6817/4207675427","heartbeat_front_addr":"172.21.15.99:6815/4207675427","state":["exists","up"]},{"osd":4,"uuid":"0250d7ac-3894-457a-9c04-cc7205d61eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6809","nonce":2861083896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6811","nonce":2861083896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6815","nonce":2861083896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6813","nonce":2861083896}]},"public_addr":"172.21.15.179:6809/2861083896","cluster_addr":"172.21.15.179:6811/2861083896","heartbeat_back_addr":"172.21.15.179:6815/2861083896","heartbeat_front_addr":"172.21.15.179:6813/2861083896","state":["exists","up"]},{"osd":5,"uuid":"5e19222a-c2a4-45bc-8445-1d302f26d11c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6809","nonce":1485017095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6811","nonce":1485017095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6815","nonce":1485017095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6813","nonce":1485017095}]},"public_addr":"172.21.15.181:6809/1485017095","cluster_addr":"172.21.15.181:6811/1485017095","heartbeat_back_addr":"172.21.15.181:6815/1485017095","heartbeat_front_addr":"172.21.15.181:6813/1485017095","state":["exists","up"]},{"osd":6,"uuid":"56555035-f9fc-4e91-96dd-caa632d58adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6819","nonce":1534047839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6821","nonce":1534047839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6825","nonce":1534047839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6823","nonce":1534047839}]},"public_addr":"172.21.15.99:6819/1534047839","cluster_addr":"172.21.15.99:6821/1534047839","heartbeat_back_addr":"172.21.15.99:6825/1534047839","heartbeat_front_addr":"172.21.15.99:6823/1534047839","state":["exists","up"]},{"osd":7,"uuid":"5e079cf5-1340-4599-88a6-df410ef0148e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6817","nonce":3875950553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6819","nonce":3875950553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6823","nonce":3875950553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6821","nonce":3875950553}]},"public_addr":"172.21.15.179:6817/3875950553","cluster_addr":"172.21.15.179:6819/3875950553","heartbeat_back_addr":"172.21.15.179:6823/3875950553","heartbeat_front_addr":"172.21.15.179:6821/3875950553","state":["exists","up"]},{"osd":8,"uuid":"10a73592-4251-4492-b67d-ce9b9d7fff32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6817","nonce":179568936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6819","nonce":179568936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6823","nonce":179568936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6821","nonce":179568936}]},"public_addr":"172.21.15.181:6817/179568936","cluster_addr":"172.21.15.181:6819/179568936","heartbeat_back_addr":"172.21.15.181:6823/179568936","heartbeat_front_addr":"172.21.15.181:6821/179568936","state":["exists","up"]},{"osd":9,"uuid":"f6620e1e-f761-4f1c-917f-cbc748df32a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6827","nonce":315759515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6829","nonce":315759515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6833","nonce":315759515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6831","nonce":315759515}]},"public_addr":"172.21.15.99:6827/315759515","cluster_addr":"172.21.15.99:6829/315759515","heartbeat_back_addr":"172.21.15.99:6833/315759515","heartbeat_front_addr":"172.21.15.99:6831/315759515","state":["exists","up"]},{"osd":10,"uuid":"ee86af7d-66f8-4795-bcc3-dfec79e4680c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6825","nonce":2985063934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6827","nonce":2985063934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6831","nonce":2985063934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6829","nonce":2985063934}]},"public_addr":"172.21.15.179:6825/2985063934","cluster_addr":"172.21.15.179:6827/2985063934","heartbeat_back_addr":"172.21.15.179:6831/2985063934","heartbeat_front_addr":"172.21.15.179:6829/2985063934","state":["exists","up"]},{"osd":11,"uuid":"82f04fee-f6ae-4630-a75b-b12a9c4ab2e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6825","nonce":1858219600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6827","nonce":1858219600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6831","nonce":1858219600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6829","nonce":1858219600}]},"public_addr":"172.21.15.181:6825/1858219600","cluster_addr":"172.21.15.181:6827/1858219600","heartbeat_back_addr":"172.21.15.181:6831/1858219600","heartbeat_front_addr":"172.21.15.181:6829/1858219600","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:55.518970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:04:19.936339+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:04:44.064814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:09.331683+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:34.616774+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:58.881810+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:06:23.869838+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:06:49.127331+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:07:12.847187+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:07:38.231045+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:08:03.949162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:08:28.471802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:0/401101729":"2024-02-01T05:02:20.510858+0000","172.21.15.99:6801/1993198206":"2024-02-01T05:02:20.510858+0000","172.21.15.99:0/3819754569":"2024-02-01T05:02:20.510858+0000","172.21.15.99:0/475390265":"2024-02-01T05:01:53.732026+0000","172.21.15.99:6800/1993198206":"2024-02-01T05:02:20.510858+0000","172.21.15.99:6800/1706888338":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/4150146075":"2024-02-01T05:01:53.732026+0000","172.21.15.99:6801/1706888338":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/2851066598":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/1865156424":"2024-02-01T05:02:20.510858+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:08:43.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.521+0000 7f92ea7e1640 1 -- 172.21.15.99:0/2341331527 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f92cc0a12e0 msgr2=0x7f92cc0a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:43.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.521+0000 7f92ea7e1640 1 --2- 172.21.15.99:0/2341331527 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f92cc0a12e0 0x7f92cc0a37a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f92e4074810 tx=0x7f92d800a2d0 comp rx=0 tx=0).stop 2024-01-31T05:08:43.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.521+0000 7f92ea7e1640 1 -- 172.21.15.99:0/2341331527 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92e4100d10 msgr2=0x7f92e4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:43.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.521+0000 7f92ea7e1640 1 --2- 172.21.15.99:0/2341331527 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92e4100d10 0x7f92e4074aa0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f92d400d980 tx=0x7f92d400dd80 comp rx=0 tx=0).stop 2024-01-31T05:08:43.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.521+0000 7f92ea7e1640 1 -- 172.21.15.99:0/2341331527 shutdown_connections 2024-01-31T05:08:43.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.522+0000 7f92ea7e1640 1 --2- 172.21.15.99:0/2341331527 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f92cc0a12e0 0x7f92cc0a37a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:43.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.522+0000 7f92ea7e1640 1 --2- 172.21.15.99:0/2341331527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f92e41028c0 0x7f92e4073620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:43.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.522+0000 7f92ea7e1640 1 --2- 172.21.15.99:0/2341331527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92e4101f00 0x7f92e40730e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:43.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.522+0000 7f92ea7e1640 1 --2- 172.21.15.99:0/2341331527 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92e4100d10 0x7f92e4074aa0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:43.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.522+0000 7f92ea7e1640 1 -- 172.21.15.99:0/2341331527 >> 172.21.15.99:0/2341331527 conn(0x7f92e40fc2a0 msgr2=0x7f92e41051a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:08:43.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.522+0000 7f92ea7e1640 1 -- 172.21.15.99:0/2341331527 shutdown_connections 2024-01-31T05:08:43.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.522+0000 7f92ea7e1640 1 -- 172.21.15.99:0/2341331527 wait complete. 2024-01-31T05:08:43.531 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:43 smithi099 ceph-mon[31615]: from='client.24358 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi099=a;smithi099=d;smithi099=g;smithi099=j;smithi179=b;smithi179=e;smithi179=h;smithi179=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:08:43.531 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:43 smithi099 ceph-mon[31615]: Saving service mds.all spec with placement smithi099=a;smithi099=d;smithi099=g;smithi099=j;smithi179=b;smithi179=e;smithi179=h;smithi179=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l;count:12 2024-01-31T05:08:43.531 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:43 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:43.531 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:43 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:08:43.531 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:43 smithi099 ceph-mon[31615]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:08:43.531 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:43 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:08:43.531 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:43 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:08:43.531 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:43 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:43.531 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:43 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-31T05:08:43.531 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:43 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-31T05:08:43.531 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:43 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:08:43.533 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-31T05:04:46.842423+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-31T05:08:43.533 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-31T05:08:43.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.638+0000 7ff954d1f640 1 -- 172.21.15.99:0/4168026120 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9501017c0 msgr2=0x7ff950108050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:43.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.638+0000 7ff954d1f640 1 --2- 172.21.15.99:0/4168026120 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9501017c0 0x7ff950108050 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff948009ca0 tx=0x7ff94802c0f0 comp rx=0 tx=0).stop 2024-01-31T05:08:43.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.638+0000 7ff954d1f640 1 -- 172.21.15.99:0/4168026120 shutdown_connections 2024-01-31T05:08:43.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.638+0000 7ff954d1f640 1 --2- 172.21.15.99:0/4168026120 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9501017c0 0x7ff950108050 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:43.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.638+0000 7ff954d1f640 1 --2- 172.21.15.99:0/4168026120 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff950100e00 0x7ff950101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:43.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.638+0000 7ff954d1f640 1 --2- 172.21.15.99:0/4168026120 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9500ffc10 0x7ff950100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:43.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.638+0000 7ff954d1f640 1 -- 172.21.15.99:0/4168026120 >> 172.21.15.99:0/4168026120 conn(0x7ff9500fb1a0 msgr2=0x7ff9500fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:08:43.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.638+0000 7ff954d1f640 1 -- 172.21.15.99:0/4168026120 shutdown_connections 2024-01-31T05:08:43.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.638+0000 7ff954d1f640 1 -- 172.21.15.99:0/4168026120 wait complete. 2024-01-31T05:08:43.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.639+0000 7ff954d1f640 1 Processor -- start 2024-01-31T05:08:43.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.639+0000 7ff954d1f640 1 -- start start 2024-01-31T05:08:43.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.639+0000 7ff954d1f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff9500ffc10 0x7ff950196bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:43.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.639+0000 7ff954d1f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff950100e00 0x7ff9501970f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:43.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.639+0000 7ff954d1f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9501017c0 0x7ff95019e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:43.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.639+0000 7ff954d1f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95019e6a0 con 0x7ff950100e00 2024-01-31T05:08:43.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.639+0000 7ff954d1f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95019e810 con 0x7ff9501017c0 2024-01-31T05:08:43.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.639+0000 7ff954d1f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95019e9d0 con 0x7ff9500ffc10 2024-01-31T05:08:43.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.639+0000 7ff94dd9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff950100e00 0x7ff9501970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:43.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.639+0000 7ff94dd9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff950100e00 0x7ff9501970f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33560/0 (socket says 172.21.15.99:33560) 2024-01-31T05:08:43.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.639+0000 7ff94dd9b640 1 -- 172.21.15.99:0/2213361945 learned_addr learned my addr 172.21.15.99:0/2213361945 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:08:43.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.639+0000 7ff94e59c640 1 --2- 172.21.15.99:0/2213361945 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff9500ffc10 0x7ff950196bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:43.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.639+0000 7ff94ed9d640 1 --2- 172.21.15.99:0/2213361945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9501017c0 0x7ff95019e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:43.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.639+0000 7ff94dd9b640 1 -- 172.21.15.99:0/2213361945 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff9500ffc10 msgr2=0x7ff950196bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:43.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.639+0000 7ff94dd9b640 1 --2- 172.21.15.99:0/2213361945 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff9500ffc10 0x7ff950196bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:43.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.639+0000 7ff94dd9b640 1 -- 172.21.15.99:0/2213361945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9501017c0 msgr2=0x7ff95019e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:43.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.639+0000 7ff94dd9b640 1 --2- 172.21.15.99:0/2213361945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9501017c0 0x7ff95019e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:43.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.639+0000 7ff94dd9b640 1 -- 172.21.15.99:0/2213361945 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff948009900 con 0x7ff950100e00 2024-01-31T05:08:43.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.639+0000 7ff94dd9b640 1 --2- 172.21.15.99:0/2213361945 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff950100e00 0x7ff9501970f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff93800c920 tx=0x7ff93800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:08:43.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.640+0000 7ff9477fe640 1 -- 172.21.15.99:0/2213361945 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff938007c70 con 0x7ff950100e00 2024-01-31T05:08:43.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.640+0000 7ff954d1f640 1 -- 172.21.15.99:0/2213361945 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff95019ecb0 con 0x7ff950100e00 2024-01-31T05:08:43.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.640+0000 7ff9477fe640 1 -- 172.21.15.99:0/2213361945 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff938007dd0 con 0x7ff950100e00 2024-01-31T05:08:43.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.640+0000 7ff9477fe640 1 -- 172.21.15.99:0/2213361945 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9380187c0 con 0x7ff950100e00 2024-01-31T05:08:43.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.640+0000 7ff954d1f640 1 -- 172.21.15.99:0/2213361945 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff95019f1c0 con 0x7ff950100e00 2024-01-31T05:08:43.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.640+0000 7ff954d1f640 1 -- 172.21.15.99:0/2213361945 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff950106ed0 con 0x7ff950100e00 2024-01-31T05:08:43.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.642+0000 7ff9477fe640 1 -- 172.21.15.99:0/2213361945 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7ff93800f450 con 0x7ff950100e00 2024-01-31T05:08:43.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.642+0000 7ff9477fe640 1 --2- 172.21.15.99:0/2213361945 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff93c0a12e0 0x7ff93c0a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:43.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.642+0000 7ff94e59c640 1 --2- 172.21.15.99:0/2213361945 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff93c0a12e0 0x7ff93c0a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:43.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.642+0000 7ff9477fe640 1 -- 172.21.15.99:0/2213361945 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff9380ccb40 con 0x7ff950100e00 2024-01-31T05:08:43.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.643+0000 7ff94e59c640 1 --2- 172.21.15.99:0/2213361945 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff93c0a12e0 0x7ff93c0a37a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff950100c60 tx=0x7ff940005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:08:43.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.646+0000 7ff9477fe640 1 -- 172.21.15.99:0/2213361945 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7ff9380964f0 con 0x7ff950100e00 2024-01-31T05:08:43.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.816+0000 7ff954d1f640 1 -- 172.21.15.99:0/2213361945 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff95010c600 con 0x7ff950100e00 2024-01-31T05:08:43.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.816+0000 7ff9477fe640 1 -- 172.21.15.99:0/2213361945 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff938099b10 con 0x7ff950100e00 2024-01-31T05:08:43.815 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-01-31T05:08:43.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.818+0000 7ff954d1f640 1 -- 172.21.15.99:0/2213361945 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff93c0a12e0 msgr2=0x7ff93c0a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:43.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.818+0000 7ff954d1f640 1 --2- 172.21.15.99:0/2213361945 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff93c0a12e0 0x7ff93c0a37a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff950100c60 tx=0x7ff940005f90 comp rx=0 tx=0).stop 2024-01-31T05:08:43.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.818+0000 7ff954d1f640 1 -- 172.21.15.99:0/2213361945 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff950100e00 msgr2=0x7ff9501970f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:43.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.818+0000 7ff954d1f640 1 --2- 172.21.15.99:0/2213361945 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff950100e00 0x7ff9501970f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff93800c920 tx=0x7ff93800cde0 comp rx=0 tx=0).stop 2024-01-31T05:08:43.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.818+0000 7ff954d1f640 1 -- 172.21.15.99:0/2213361945 shutdown_connections 2024-01-31T05:08:43.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.818+0000 7ff954d1f640 1 --2- 172.21.15.99:0/2213361945 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff93c0a12e0 0x7ff93c0a37a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:43.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.818+0000 7ff954d1f640 1 --2- 172.21.15.99:0/2213361945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9501017c0 0x7ff95019e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:43.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.818+0000 7ff954d1f640 1 --2- 172.21.15.99:0/2213361945 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff950100e00 0x7ff9501970f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:43.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.818+0000 7ff954d1f640 1 --2- 172.21.15.99:0/2213361945 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff9500ffc10 0x7ff950196bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:43.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.818+0000 7ff954d1f640 1 -- 172.21.15.99:0/2213361945 >> 172.21.15.99:0/2213361945 conn(0x7ff9500fb1a0 msgr2=0x7ff9501040a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:08:43.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.818+0000 7ff954d1f640 1 -- 172.21.15.99:0/2213361945 shutdown_connections 2024-01-31T05:08:43.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.818+0000 7ff954d1f640 1 -- 172.21.15.99:0/2213361945 wait complete. 2024-01-31T05:08:43.828 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T05:08:43.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.930+0000 7f3f9e3c9640 1 -- 172.21.15.99:0/3135863530 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f981017d0 msgr2=0x7f3f98108060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:43.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.930+0000 7f3f9e3c9640 1 --2- 172.21.15.99:0/3135863530 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f981017d0 0x7f3f98108060 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3f90009ca0 tx=0x7f3f9002c0f0 comp rx=0 tx=0).stop 2024-01-31T05:08:43.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.930+0000 7f3f9e3c9640 1 -- 172.21.15.99:0/3135863530 shutdown_connections 2024-01-31T05:08:43.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.930+0000 7f3f9e3c9640 1 --2- 172.21.15.99:0/3135863530 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f981017d0 0x7f3f98108060 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:43.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.930+0000 7f3f9e3c9640 1 --2- 172.21.15.99:0/3135863530 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f98100e10 0x7f3f98101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:43.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.930+0000 7f3f9e3c9640 1 --2- 172.21.15.99:0/3135863530 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f980ffc20 0x7f3f98100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:43.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.930+0000 7f3f9e3c9640 1 -- 172.21.15.99:0/3135863530 >> 172.21.15.99:0/3135863530 conn(0x7f3f980fb1d0 msgr2=0x7f3f980fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:08:43.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.930+0000 7f3f9e3c9640 1 -- 172.21.15.99:0/3135863530 shutdown_connections 2024-01-31T05:08:43.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.930+0000 7f3f9e3c9640 1 -- 172.21.15.99:0/3135863530 wait complete. 2024-01-31T05:08:43.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.930+0000 7f3f9e3c9640 1 Processor -- start 2024-01-31T05:08:43.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.930+0000 7f3f9e3c9640 1 -- start start 2024-01-31T05:08:43.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.931+0000 7f3f9e3c9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f980ffc20 0x7f3f98069ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:43.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.931+0000 7f3f9e3c9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f98100e10 0x7f3f9819b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:43.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.931+0000 7f3f9e3c9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f981017d0 0x7f3f9819dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:43.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.931+0000 7f3f9e3c9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9819e7b0 con 0x7f3f98100e10 2024-01-31T05:08:43.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.931+0000 7f3f9e3c9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9819e920 con 0x7f3f980ffc20 2024-01-31T05:08:43.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.931+0000 7f3f9e3c9640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9819eae0 con 0x7f3f981017d0 2024-01-31T05:08:43.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.931+0000 7f3f977fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f98100e10 0x7f3f9819b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:43.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.931+0000 7f3f977fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f98100e10 0x7f3f9819b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33580/0 (socket says 172.21.15.99:33580) 2024-01-31T05:08:43.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.931+0000 7f3f977fe640 1 -- 172.21.15.99:0/101646466 learned_addr learned my addr 172.21.15.99:0/101646466 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:08:43.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.931+0000 7f3f97fff640 1 --2- 172.21.15.99:0/101646466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f980ffc20 0x7f3f98069ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:43.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.931+0000 7f3f9c966640 1 --2- 172.21.15.99:0/101646466 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f981017d0 0x7f3f9819dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:43.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.931+0000 7f3f977fe640 1 -- 172.21.15.99:0/101646466 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f981017d0 msgr2=0x7f3f9819dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:43.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.931+0000 7f3f977fe640 1 --2- 172.21.15.99:0/101646466 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f981017d0 0x7f3f9819dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:43.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.931+0000 7f3f977fe640 1 -- 172.21.15.99:0/101646466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f980ffc20 msgr2=0x7f3f98069ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:43.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.931+0000 7f3f977fe640 1 --2- 172.21.15.99:0/101646466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f980ffc20 0x7f3f98069ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:43.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.931+0000 7f3f977fe640 1 -- 172.21.15.99:0/101646466 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f90009900 con 0x7f3f98100e10 2024-01-31T05:08:43.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.931+0000 7f3f97fff640 1 --2- 172.21.15.99:0/101646466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f980ffc20 0x7f3f98069ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:08:43.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.931+0000 7f3f977fe640 1 --2- 172.21.15.99:0/101646466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f98100e10 0x7f3f9819b9b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c00d950 tx=0x7f3f8c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:08:43.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.931+0000 7f3f957fa640 1 -- 172.21.15.99:0/101646466 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c009c30 con 0x7f3f98100e10 2024-01-31T05:08:43.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.931+0000 7f3f9e3c9640 1 -- 172.21.15.99:0/101646466 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f9819ed60 con 0x7f3f98100e10 2024-01-31T05:08:43.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.931+0000 7f3f957fa640 1 -- 172.21.15.99:0/101646466 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3f8c009d90 con 0x7f3f98100e10 2024-01-31T05:08:43.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.931+0000 7f3f957fa640 1 -- 172.21.15.99:0/101646466 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c00f740 con 0x7f3f98100e10 2024-01-31T05:08:43.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.932+0000 7f3f9e3c9640 1 -- 172.21.15.99:0/101646466 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f9819f210 con 0x7f3f98100e10 2024-01-31T05:08:43.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.932+0000 7f3f9e3c9640 1 -- 172.21.15.99:0/101646466 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f98106fc0 con 0x7f3f98100e10 2024-01-31T05:08:43.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.933+0000 7f3f957fa640 1 -- 172.21.15.99:0/101646466 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f3f8c010a20 con 0x7f3f98100e10 2024-01-31T05:08:43.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.934+0000 7f3f957fa640 1 --2- 172.21.15.99:0/101646466 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f3f800a12e0 0x7f3f800a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:43.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.934+0000 7f3f97fff640 1 --2- 172.21.15.99:0/101646466 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f3f800a12e0 0x7f3f800a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:43.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.934+0000 7f3f957fa640 1 -- 172.21.15.99:0/101646466 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f3f8c0cc320 con 0x7f3f98100e10 2024-01-31T05:08:43.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.934+0000 7f3f97fff640 1 --2- 172.21.15.99:0/101646466 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f3f800a12e0 0x7f3f800a37a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3f880058c0 tx=0x7f3f88005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:08:43.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:43.938+0000 7f3f957fa640 1 -- 172.21.15.99:0/101646466 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f3f8c095c40 con 0x7f3f98100e10 2024-01-31T05:08:44.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:44.144+0000 7f3f9e3c9640 1 -- 172.21.15.99:0/101646466 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3f9802cc00 con 0x7f3f98100e10 2024-01-31T05:08:44.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:44.145+0000 7f3f957fa640 1 -- 172.21.15.99:0/101646466 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f3f8c099260 con 0x7f3f98100e10 2024-01-31T05:08:44.144 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:08:44.144 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-01-31T05:08:44.144 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 1 2024-01-31T05:08:44.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:44.146+0000 7f3f9e3c9640 1 -- 172.21.15.99:0/101646466 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f3f800a12e0 msgr2=0x7f3f800a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:44.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:44.146+0000 7f3f9e3c9640 1 --2- 172.21.15.99:0/101646466 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f3f800a12e0 0x7f3f800a37a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3f880058c0 tx=0x7f3f88005850 comp rx=0 tx=0).stop 2024-01-31T05:08:44.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:44.146+0000 7f3f9e3c9640 1 -- 172.21.15.99:0/101646466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f98100e10 msgr2=0x7f3f9819b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:44.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:44.146+0000 7f3f9e3c9640 1 --2- 172.21.15.99:0/101646466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f98100e10 0x7f3f9819b9b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c00d950 tx=0x7f3f8c00de10 comp rx=0 tx=0).stop 2024-01-31T05:08:44.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:44.147+0000 7f3f9e3c9640 1 -- 172.21.15.99:0/101646466 shutdown_connections 2024-01-31T05:08:44.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:44.147+0000 7f3f9e3c9640 1 --2- 172.21.15.99:0/101646466 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f3f800a12e0 0x7f3f800a37a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:44.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:44.147+0000 7f3f9e3c9640 1 --2- 172.21.15.99:0/101646466 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f981017d0 0x7f3f9819dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:44.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:44.147+0000 7f3f9e3c9640 1 --2- 172.21.15.99:0/101646466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f98100e10 0x7f3f9819b9b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:44.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:44.147+0000 7f3f9e3c9640 1 --2- 172.21.15.99:0/101646466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f980ffc20 0x7f3f98069ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:44.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:44.147+0000 7f3f9e3c9640 1 -- 172.21.15.99:0/101646466 >> 172.21.15.99:0/101646466 conn(0x7f3f980fb1d0 msgr2=0x7f3f98104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:08:44.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:44.147+0000 7f3f9e3c9640 1 -- 172.21.15.99:0/101646466 shutdown_connections 2024-01-31T05:08:44.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:44.147+0000 7f3f9e3c9640 1 -- 172.21.15.99:0/101646466 wait complete. 2024-01-31T05:08:44.487 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:44 smithi181 ceph-mon[36434]: Deploying daemon mds.l on smithi181 2024-01-31T05:08:44.487 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:44 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/2341331527' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:08:44.487 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:44 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/2213361945' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-31T05:08:44.487 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:44 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/101646466' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:08:44.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:44 smithi099 ceph-mon[31615]: Deploying daemon mds.l on smithi181 2024-01-31T05:08:44.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:44 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/2341331527' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:08:44.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:44 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/2213361945' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-31T05:08:44.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:44 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/101646466' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:08:44.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:44 smithi179 ceph-mon[35652]: Deploying daemon mds.l on smithi181 2024-01-31T05:08:44.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:44 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/2341331527' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:08:44.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:44 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/2213361945' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-31T05:08:44.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:44 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/101646466' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:08:45.072 INFO:journalctl@ceph.mds.l.smithi181.stdout:Jan 31 05:08:44 smithi181 systemd[1]: Starting Ceph mds.l for 9288ff44-bff5-11ee-95b3-87774f69a715... 2024-01-31T05:08:45.465 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:45 smithi181 ceph-mon[36434]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:08:45.465 INFO:journalctl@ceph.mds.l.smithi181.stdout:Jan 31 05:08:45 smithi181 podman[67526]: 2024-01-31 05:08:45.189471052 +0000 UTC m=+0.113440372 container create 377206dd4be8e65cf676099a756b168c8b6aa3d505a7531a6fad832dfb2f1050 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-l, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240125.044502-661946e, io.buildah.version=1.31.3, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240123, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.name=CentOS Stream 8 Base Image) 2024-01-31T05:08:45.466 INFO:journalctl@ceph.mds.l.smithi181.stdout:Jan 31 05:08:45 smithi181 podman[67526]: 2024-01-31 05:08:45.094609774 +0000 UTC m=+0.018579094 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-31T05:08:45.466 INFO:journalctl@ceph.mds.l.smithi181.stdout:Jan 31 05:08:45 smithi181 podman[67526]: 2024-01-31 05:08:45.400314729 +0000 UTC m=+0.324284040 container init 377206dd4be8e65cf676099a756b168c8b6aa3d505a7531a6fad832dfb2f1050 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-l, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240123, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, io.buildah.version=1.31.3, ceph=True, org.label-schema.license=GPLv2) 2024-01-31T05:08:45.466 INFO:journalctl@ceph.mds.l.smithi181.stdout:Jan 31 05:08:45 smithi181 podman[67526]: 2024-01-31 05:08:45.403140927 +0000 UTC m=+0.327110232 container start 377206dd4be8e65cf676099a756b168c8b6aa3d505a7531a6fad832dfb2f1050 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-l, org.label-schema.build-date=20240123, ceph=True, GIT_CLEAN=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.name=CentOS Stream 8 Base Image) 2024-01-31T05:08:45.466 INFO:journalctl@ceph.mds.l.smithi181.stdout:Jan 31 05:08:45 smithi181 ceph-mds[67545]: -- 172.21.15.181:0/3240620788 <== mon.1 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5618d20d1520 con 0x5618d20a7000 2024-01-31T05:08:45.466 INFO:journalctl@ceph.mds.l.smithi181.stdout:Jan 31 05:08:45 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-l[67541]: starting mds.l at 2024-01-31T05:08:45.466 INFO:journalctl@ceph.mds.l.smithi181.stdout:Jan 31 05:08:45 smithi181 bash[67526]: 377206dd4be8e65cf676099a756b168c8b6aa3d505a7531a6fad832dfb2f1050 2024-01-31T05:08:45.487 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:45 smithi179 ceph-mon[35652]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:08:45.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:45 smithi099 ceph-mon[31615]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:08:45.821 INFO:journalctl@ceph.mds.l.smithi181.stdout:Jan 31 05:08:45 smithi181 systemd[1]: Started Ceph mds.l for 9288ff44-bff5-11ee-95b3-87774f69a715. 2024-01-31T05:08:46.158 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T05:08:46.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.272+0000 7f334c819640 1 -- 172.21.15.99:0/4245713337 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3348101f00 msgr2=0x7f3348102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:46.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.272+0000 7f334c819640 1 --2- 172.21.15.99:0/4245713337 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3348101f00 0x7f3348102380 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f333c009900 tx=0x7f333c02bc30 comp rx=0 tx=0).stop 2024-01-31T05:08:46.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.272+0000 7f334c819640 1 -- 172.21.15.99:0/4245713337 shutdown_connections 2024-01-31T05:08:46.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.272+0000 7f334c819640 1 --2- 172.21.15.99:0/4245713337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33481028c0 0x7f3348109150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:46.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.272+0000 7f334c819640 1 --2- 172.21.15.99:0/4245713337 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3348101f00 0x7f3348102380 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:46.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.272+0000 7f334c819640 1 --2- 172.21.15.99:0/4245713337 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3348100d10 0x7f3348101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:46.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.272+0000 7f334c819640 1 -- 172.21.15.99:0/4245713337 >> 172.21.15.99:0/4245713337 conn(0x7f33480fc2a0 msgr2=0x7f33480fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:08:46.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.272+0000 7f334c819640 1 -- 172.21.15.99:0/4245713337 shutdown_connections 2024-01-31T05:08:46.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.272+0000 7f334c819640 1 -- 172.21.15.99:0/4245713337 wait complete. 2024-01-31T05:08:46.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.273+0000 7f334c819640 1 Processor -- start 2024-01-31T05:08:46.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.273+0000 7f334c819640 1 -- start start 2024-01-31T05:08:46.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.273+0000 7f334c819640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3348100d10 0x7f3348196d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:46.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.273+0000 7f334c819640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3348101f00 0x7f3348197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:46.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.273+0000 7f334c819640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33481028c0 0x7f334819e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:46.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.273+0000 7f334c819640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f334819e7e0 con 0x7f3348100d10 2024-01-31T05:08:46.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.273+0000 7f334c819640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f334819e950 con 0x7f33481028c0 2024-01-31T05:08:46.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.273+0000 7f334c819640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f334819eb10 con 0x7f3348101f00 2024-01-31T05:08:46.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.273+0000 7f334659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3348100d10 0x7f3348196d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:46.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.274+0000 7f334659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3348100d10 0x7f3348196d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36610/0 (socket says 172.21.15.99:36610) 2024-01-31T05:08:46.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.274+0000 7f334659c640 1 -- 172.21.15.99:0/1422487656 learned_addr learned my addr 172.21.15.99:0/1422487656 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:08:46.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.274+0000 7f3346d9d640 1 --2- 172.21.15.99:0/1422487656 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33481028c0 0x7f334819e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:46.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.274+0000 7f3345d9b640 1 --2- 172.21.15.99:0/1422487656 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3348101f00 0x7f3348197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:46.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.274+0000 7f334659c640 1 -- 172.21.15.99:0/1422487656 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3348101f00 msgr2=0x7f3348197240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:46.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.274+0000 7f334659c640 1 --2- 172.21.15.99:0/1422487656 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3348101f00 0x7f3348197240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:46.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.274+0000 7f334659c640 1 -- 172.21.15.99:0/1422487656 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33481028c0 msgr2=0x7f334819e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:46.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.274+0000 7f334659c640 1 --2- 172.21.15.99:0/1422487656 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33481028c0 0x7f334819e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:46.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.274+0000 7f334659c640 1 -- 172.21.15.99:0/1422487656 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f333c009560 con 0x7f3348100d10 2024-01-31T05:08:46.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.274+0000 7f3346d9d640 1 --2- 172.21.15.99:0/1422487656 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33481028c0 0x7f334819e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:08:46.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.274+0000 7f334659c640 1 --2- 172.21.15.99:0/1422487656 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3348100d10 0x7f3348196d00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f333800c970 tx=0x7f333800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:08:46.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.274+0000 7f33377fe640 1 -- 172.21.15.99:0/1422487656 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3338004220 con 0x7f3348100d10 2024-01-31T05:08:46.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.274+0000 7f334c819640 1 -- 172.21.15.99:0/1422487656 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f334819edf0 con 0x7f3348100d10 2024-01-31T05:08:46.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.274+0000 7f33377fe640 1 -- 172.21.15.99:0/1422487656 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3338007e70 con 0x7f3348100d10 2024-01-31T05:08:46.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.274+0000 7f33377fe640 1 -- 172.21.15.99:0/1422487656 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3338003e60 con 0x7f3348100d10 2024-01-31T05:08:46.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.274+0000 7f334c819640 1 -- 172.21.15.99:0/1422487656 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f334819f220 con 0x7f3348100d10 2024-01-31T05:08:46.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.275+0000 7f334c819640 1 -- 172.21.15.99:0/1422487656 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33481080a0 con 0x7f3348100d10 2024-01-31T05:08:46.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.276+0000 7f33377fe640 1 -- 172.21.15.99:0/1422487656 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f33380079b0 con 0x7f3348100d10 2024-01-31T05:08:46.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.277+0000 7f33377fe640 1 --2- 172.21.15.99:0/1422487656 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f33300a12e0 0x7f33300a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:46.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.277+0000 7f3345d9b640 1 --2- 172.21.15.99:0/1422487656 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f33300a12e0 0x7f33300a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:46.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.277+0000 7f33377fe640 1 -- 172.21.15.99:0/1422487656 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f33380cc4c0 con 0x7f3348100d10 2024-01-31T05:08:46.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.277+0000 7f3345d9b640 1 --2- 172.21.15.99:0/1422487656 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f33300a12e0 0x7f33300a37a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f333c006010 tx=0x7f333c02c5d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:08:46.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.281+0000 7f33377fe640 1 -- 172.21.15.99:0/1422487656 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f3338095d50 con 0x7f3348100d10 2024-01-31T05:08:46.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.488+0000 7f334c819640 1 -- 172.21.15.99:0/1422487656 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f334810c810 con 0x7f3348100d10 2024-01-31T05:08:46.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.489+0000 7f33377fe640 1 -- 172.21.15.99:0/1422487656 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1325 (secure 0 0 0) 0x7f3338097c80 con 0x7f3348100d10 2024-01-31T05:08:46.488 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:08:46.489 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24376,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/427201290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":427201290},{"type":"v1","addr":"172.21.15.181:6833","nonce":427201290}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-01-31T05:08:46.489 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 2 2024-01-31T05:08:46.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.491+0000 7f334c819640 1 -- 172.21.15.99:0/1422487656 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f33300a12e0 msgr2=0x7f33300a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:46.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.491+0000 7f334c819640 1 --2- 172.21.15.99:0/1422487656 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f33300a12e0 0x7f33300a37a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f333c006010 tx=0x7f333c02c5d0 comp rx=0 tx=0).stop 2024-01-31T05:08:46.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.491+0000 7f334c819640 1 -- 172.21.15.99:0/1422487656 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3348100d10 msgr2=0x7f3348196d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:46.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.491+0000 7f334c819640 1 --2- 172.21.15.99:0/1422487656 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3348100d10 0x7f3348196d00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f333800c970 tx=0x7f333800ce30 comp rx=0 tx=0).stop 2024-01-31T05:08:46.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.491+0000 7f334c819640 1 -- 172.21.15.99:0/1422487656 shutdown_connections 2024-01-31T05:08:46.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.491+0000 7f334c819640 1 --2- 172.21.15.99:0/1422487656 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f33300a12e0 0x7f33300a37a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:46.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.491+0000 7f334c819640 1 --2- 172.21.15.99:0/1422487656 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33481028c0 0x7f334819e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:46.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.491+0000 7f334c819640 1 --2- 172.21.15.99:0/1422487656 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3348101f00 0x7f3348197240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:46.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.491+0000 7f334c819640 1 --2- 172.21.15.99:0/1422487656 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3348100d10 0x7f3348196d00 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:46.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.491+0000 7f334c819640 1 -- 172.21.15.99:0/1422487656 >> 172.21.15.99:0/1422487656 conn(0x7f33480fc2a0 msgr2=0x7f3348105270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:08:46.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.491+0000 7f334c819640 1 -- 172.21.15.99:0/1422487656 shutdown_connections 2024-01-31T05:08:46.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:46.491+0000 7f334c819640 1 -- 172.21.15.99:0/1422487656 wait complete. 2024-01-31T05:08:46.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:46 smithi099 ceph-mon[31615]: mds.? [v2:172.21.15.181:6832/427201290,v1:172.21.15.181:6833/427201290] up:boot 2024-01-31T05:08:46.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:46 smithi099 ceph-mon[31615]: fsmap 1 up:standby 2024-01-31T05:08:46.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:46 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-01-31T05:08:46.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:46 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:46.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:46 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:46.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:46 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:46.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:46 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-31T05:08:46.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:46 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-31T05:08:46.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:46 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:08:46.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:46 smithi099 ceph-mon[31615]: Deploying daemon mds.k on smithi179 2024-01-31T05:08:46.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:46 smithi181 ceph-mon[36434]: mds.? [v2:172.21.15.181:6832/427201290,v1:172.21.15.181:6833/427201290] up:boot 2024-01-31T05:08:46.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:46 smithi181 ceph-mon[36434]: fsmap 1 up:standby 2024-01-31T05:08:46.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:46 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-01-31T05:08:46.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:46 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:46.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:46 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:46.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:46 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:46.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:46 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-31T05:08:46.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:46 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-31T05:08:46.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:46 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:08:46.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:46 smithi181 ceph-mon[36434]: Deploying daemon mds.k on smithi179 2024-01-31T05:08:46.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:46 smithi179 ceph-mon[35652]: mds.? [v2:172.21.15.181:6832/427201290,v1:172.21.15.181:6833/427201290] up:boot 2024-01-31T05:08:46.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:46 smithi179 ceph-mon[35652]: fsmap 1 up:standby 2024-01-31T05:08:46.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:46 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-01-31T05:08:46.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:46 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:46.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:46 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:46.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:46 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:46.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:46 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-31T05:08:46.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:46 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-31T05:08:46.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:46 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:08:46.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:46 smithi179 ceph-mon[35652]: Deploying daemon mds.k on smithi179 2024-01-31T05:08:47.762 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:47 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/1422487656' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:08:47.762 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:47 smithi179 ceph-mon[35652]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:08:47.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:47 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/1422487656' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:08:47.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:47 smithi099 ceph-mon[31615]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:08:47.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:47 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/1422487656' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:08:47.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:47 smithi181 ceph-mon[36434]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:08:48.382 INFO:journalctl@ceph.mds.k.smithi179.stdout:Jan 31 05:08:48 smithi179 systemd[1]: Started Ceph mds.k for 9288ff44-bff5-11ee-95b3-87774f69a715. 2024-01-31T05:08:48.502 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T05:08:48.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.607+0000 7fe1751e1640 1 -- 172.21.15.99:0/1404949044 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1701017c0 msgr2=0x7fe170108050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:48.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.607+0000 7fe1751e1640 1 --2- 172.21.15.99:0/1404949044 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1701017c0 0x7fe170108050 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe168009ca0 tx=0x7fe16802c0f0 comp rx=0 tx=0).stop 2024-01-31T05:08:48.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.607+0000 7fe1751e1640 1 -- 172.21.15.99:0/1404949044 shutdown_connections 2024-01-31T05:08:48.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.607+0000 7fe1751e1640 1 --2- 172.21.15.99:0/1404949044 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1701017c0 0x7fe170108050 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:48.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.607+0000 7fe1751e1640 1 --2- 172.21.15.99:0/1404949044 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe170100e00 0x7fe170101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:48.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.607+0000 7fe1751e1640 1 --2- 172.21.15.99:0/1404949044 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe1700ffc10 0x7fe170100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:48.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.607+0000 7fe1751e1640 1 -- 172.21.15.99:0/1404949044 >> 172.21.15.99:0/1404949044 conn(0x7fe1700fb180 msgr2=0x7fe1700fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:08:48.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.607+0000 7fe1751e1640 1 -- 172.21.15.99:0/1404949044 shutdown_connections 2024-01-31T05:08:48.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.607+0000 7fe1751e1640 1 -- 172.21.15.99:0/1404949044 wait complete. 2024-01-31T05:08:48.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.608+0000 7fe1751e1640 1 Processor -- start 2024-01-31T05:08:48.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.608+0000 7fe1751e1640 1 -- start start 2024-01-31T05:08:48.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.608+0000 7fe1751e1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe1700ffc10 0x7fe170196c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:48.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.608+0000 7fe1751e1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe170100e00 0x7fe1701971d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:48.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.608+0000 7fe1751e1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1701017c0 0x7fe17019e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:48.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.608+0000 7fe1751e1640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17019e7a0 con 0x7fe1701017c0 2024-01-31T05:08:48.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.608+0000 7fe1751e1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17019e910 con 0x7fe170100e00 2024-01-31T05:08:48.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.608+0000 7fe1751e1640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17019ead0 con 0x7fe1700ffc10 2024-01-31T05:08:48.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.609+0000 7fe16f59e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1701017c0 0x7fe17019e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:48.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.609+0000 7fe16f59e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1701017c0 0x7fe17019e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36620/0 (socket says 172.21.15.99:36620) 2024-01-31T05:08:48.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.609+0000 7fe16f59e640 1 -- 172.21.15.99:0/630547345 learned_addr learned my addr 172.21.15.99:0/630547345 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:08:48.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.609+0000 7fe16ed9d640 1 --2- 172.21.15.99:0/630547345 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe1700ffc10 0x7fe170196c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:48.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.609+0000 7fe16e59c640 1 --2- 172.21.15.99:0/630547345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe170100e00 0x7fe1701971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:48.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.609+0000 7fe16f59e640 1 -- 172.21.15.99:0/630547345 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe1700ffc10 msgr2=0x7fe170196c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:48.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.609+0000 7fe16f59e640 1 --2- 172.21.15.99:0/630547345 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe1700ffc10 0x7fe170196c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:48.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.609+0000 7fe16f59e640 1 -- 172.21.15.99:0/630547345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe170100e00 msgr2=0x7fe1701971d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:48.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.609+0000 7fe16f59e640 1 --2- 172.21.15.99:0/630547345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe170100e00 0x7fe1701971d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:48.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.609+0000 7fe16f59e640 1 -- 172.21.15.99:0/630547345 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe168009900 con 0x7fe1701017c0 2024-01-31T05:08:48.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.609+0000 7fe16f59e640 1 --2- 172.21.15.99:0/630547345 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1701017c0 0x7fe17019e230 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe168037040 tx=0x7fe168032810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:08:48.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.609+0000 7fe157fff640 1 -- 172.21.15.99:0/630547345 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe168034e80 con 0x7fe1701017c0 2024-01-31T05:08:48.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.609+0000 7fe157fff640 1 -- 172.21.15.99:0/630547345 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe168003e30 con 0x7fe1701017c0 2024-01-31T05:08:48.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.609+0000 7fe1751e1640 1 -- 172.21.15.99:0/630547345 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe17019ed50 con 0x7fe1701017c0 2024-01-31T05:08:48.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.609+0000 7fe157fff640 1 -- 172.21.15.99:0/630547345 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16803d3f0 con 0x7fe1701017c0 2024-01-31T05:08:48.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.609+0000 7fe1751e1640 1 -- 172.21.15.99:0/630547345 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe17019f1b0 con 0x7fe1701017c0 2024-01-31T05:08:48.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.610+0000 7fe1751e1640 1 -- 172.21.15.99:0/630547345 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe17010b4d0 con 0x7fe1701017c0 2024-01-31T05:08:48.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.611+0000 7fe157fff640 1 -- 172.21.15.99:0/630547345 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7fe16803b040 con 0x7fe1701017c0 2024-01-31T05:08:48.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.612+0000 7fe157fff640 1 --2- 172.21.15.99:0/630547345 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe1580a12e0 0x7fe1580a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:48.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.612+0000 7fe16ed9d640 1 --2- 172.21.15.99:0/630547345 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe1580a12e0 0x7fe1580a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:48.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.612+0000 7fe157fff640 1 -- 172.21.15.99:0/630547345 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fe1680ef270 con 0x7fe1701017c0 2024-01-31T05:08:48.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.612+0000 7fe16ed9d640 1 --2- 172.21.15.99:0/630547345 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe1580a12e0 0x7fe1580a37a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe170197b60 tx=0x7fe16400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:08:48.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.616+0000 7fe157fff640 1 -- 172.21.15.99:0/630547345 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fe1680b8b90 con 0x7fe1701017c0 2024-01-31T05:08:48.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.829+0000 7fe1751e1640 1 -- 172.21.15.99:0/630547345 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe17019f3a0 con 0x7fe1701017c0 2024-01-31T05:08:48.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.830+0000 7fe157fff640 1 -- 172.21.15.99:0/630547345 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2116 (secure 0 0 0) 0x7fe1680bc1b0 con 0x7fe1701017c0 2024-01-31T05:08:48.830 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:08:48.830 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24376,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/427201290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":427201290},{"type":"v1","addr":"172.21.15.181:6833","nonce":427201290}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/472161020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":472161020},{"type":"v1","addr":"172.21.15.179:6833","nonce":472161020}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-01-31T05:08:48.830 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 3 2024-01-31T05:08:48.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.833+0000 7fe1751e1640 1 -- 172.21.15.99:0/630547345 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe1580a12e0 msgr2=0x7fe1580a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:48.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.833+0000 7fe1751e1640 1 --2- 172.21.15.99:0/630547345 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe1580a12e0 0x7fe1580a37a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe170197b60 tx=0x7fe16400b390 comp rx=0 tx=0).stop 2024-01-31T05:08:48.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.833+0000 7fe1751e1640 1 -- 172.21.15.99:0/630547345 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1701017c0 msgr2=0x7fe17019e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:48.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.833+0000 7fe1751e1640 1 --2- 172.21.15.99:0/630547345 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1701017c0 0x7fe17019e230 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe168037040 tx=0x7fe168032810 comp rx=0 tx=0).stop 2024-01-31T05:08:48.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.833+0000 7fe1751e1640 1 -- 172.21.15.99:0/630547345 shutdown_connections 2024-01-31T05:08:48.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.833+0000 7fe1751e1640 1 --2- 172.21.15.99:0/630547345 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe1580a12e0 0x7fe1580a37a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:48.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.833+0000 7fe1751e1640 1 --2- 172.21.15.99:0/630547345 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1701017c0 0x7fe17019e230 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:48.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.833+0000 7fe1751e1640 1 --2- 172.21.15.99:0/630547345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe170100e00 0x7fe1701971d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:48.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.833+0000 7fe1751e1640 1 --2- 172.21.15.99:0/630547345 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe1700ffc10 0x7fe170196c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:48.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.833+0000 7fe1751e1640 1 -- 172.21.15.99:0/630547345 >> 172.21.15.99:0/630547345 conn(0x7fe1700fb180 msgr2=0x7fe1700fcc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:08:48.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.833+0000 7fe1751e1640 1 -- 172.21.15.99:0/630547345 shutdown_connections 2024-01-31T05:08:48.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:48.833+0000 7fe1751e1640 1 -- 172.21.15.99:0/630547345 wait complete. 2024-01-31T05:08:49.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:49 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:49.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:49 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:49.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:49 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:49.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:49 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-31T05:08:49.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:49 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-31T05:08:49.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:49 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:08:49.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:49 smithi099 ceph-mon[31615]: Deploying daemon mds.j on smithi099 2024-01-31T05:08:49.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:49 smithi099 ceph-mon[31615]: mds.? [v2:172.21.15.179:6832/472161020,v1:172.21.15.179:6833/472161020] up:boot 2024-01-31T05:08:49.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:49 smithi099 ceph-mon[31615]: fsmap 2 up:standby 2024-01-31T05:08:49.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:49 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-01-31T05:08:49.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:49 smithi099 ceph-mon[31615]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:08:49.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:49 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/630547345' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:08:49.596 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:49 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:49.596 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:49 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:49.596 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:49 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:49.596 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:49 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-31T05:08:49.597 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:49 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-31T05:08:49.597 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:49 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:08:49.597 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:49 smithi179 ceph-mon[35652]: Deploying daemon mds.j on smithi099 2024-01-31T05:08:49.597 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:49 smithi179 ceph-mon[35652]: mds.? [v2:172.21.15.179:6832/472161020,v1:172.21.15.179:6833/472161020] up:boot 2024-01-31T05:08:49.597 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:49 smithi179 ceph-mon[35652]: fsmap 2 up:standby 2024-01-31T05:08:49.597 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:49 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-01-31T05:08:49.597 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:49 smithi179 ceph-mon[35652]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:08:49.597 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:49 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/630547345' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:08:49.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:49 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:49.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:49 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:49.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:49 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:49.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:49 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-31T05:08:49.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:49 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-31T05:08:49.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:49 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:08:49.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:49 smithi181 ceph-mon[36434]: Deploying daemon mds.j on smithi099 2024-01-31T05:08:49.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:49 smithi181 ceph-mon[36434]: mds.? [v2:172.21.15.179:6832/472161020,v1:172.21.15.179:6833/472161020] up:boot 2024-01-31T05:08:49.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:49 smithi181 ceph-mon[36434]: fsmap 2 up:standby 2024-01-31T05:08:49.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:49 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-01-31T05:08:49.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:49 smithi181 ceph-mon[36434]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:08:49.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:49 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/630547345' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:08:50.732 INFO:journalctl@ceph.mds.j.smithi099.stdout:Jan 31 05:08:50 smithi099 systemd[1]: Starting Ceph mds.j for 9288ff44-bff5-11ee-95b3-87774f69a715... 2024-01-31T05:08:50.847 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T05:08:50.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:50.953+0000 7f9bbadee640 1 -- 172.21.15.99:0/3375368244 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9bb4100e20 msgr2=0x7f9bb41012a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:50.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:50.953+0000 7f9bbadee640 1 --2- 172.21.15.99:0/3375368244 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9bb4100e20 0x7f9bb41012a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9ba0009900 tx=0x7f9ba002bc30 comp rx=0 tx=0).stop 2024-01-31T05:08:50.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:50.953+0000 7f9bbadee640 1 -- 172.21.15.99:0/3375368244 shutdown_connections 2024-01-31T05:08:50.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:50.953+0000 7f9bbadee640 1 --2- 172.21.15.99:0/3375368244 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9bb41017e0 0x7f9bb4108070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:50.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:50.953+0000 7f9bbadee640 1 --2- 172.21.15.99:0/3375368244 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9bb4100e20 0x7f9bb41012a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:50.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:50.953+0000 7f9bbadee640 1 --2- 172.21.15.99:0/3375368244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bb40ffc30 0x7f9bb4100050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:50.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:50.953+0000 7f9bbadee640 1 -- 172.21.15.99:0/3375368244 >> 172.21.15.99:0/3375368244 conn(0x7f9bb40fb1a0 msgr2=0x7f9bb40fd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:08:50.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:50.953+0000 7f9bbadee640 1 -- 172.21.15.99:0/3375368244 shutdown_connections 2024-01-31T05:08:50.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:50.953+0000 7f9bbadee640 1 -- 172.21.15.99:0/3375368244 wait complete. 2024-01-31T05:08:50.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:50.954+0000 7f9bbadee640 1 Processor -- start 2024-01-31T05:08:50.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:50.954+0000 7f9bbadee640 1 -- start start 2024-01-31T05:08:50.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:50.954+0000 7f9bbadee640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9bb40ffc30 0x7f9bb4195bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:50.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:50.954+0000 7f9bbadee640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bb4100e20 0x7f9bb4196110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:50.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:50.954+0000 7f9bbadee640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9bb41017e0 0x7f9bb419d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:50.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:50.954+0000 7f9bbadee640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb419d6c0 con 0x7f9bb40ffc30 2024-01-31T05:08:50.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:50.954+0000 7f9bbadee640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb419d830 con 0x7f9bb4100e20 2024-01-31T05:08:50.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:50.954+0000 7f9bbadee640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb419d9f0 con 0x7f9bb41017e0 2024-01-31T05:08:50.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:50.954+0000 7f9bb8b8a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9bb40ffc30 0x7f9bb4195bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:50.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:50.954+0000 7f9bb8b8a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9bb40ffc30 0x7f9bb4195bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36634/0 (socket says 172.21.15.99:36634) 2024-01-31T05:08:50.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:50.954+0000 7f9bb8b8a640 1 -- 172.21.15.99:0/2626039623 learned_addr learned my addr 172.21.15.99:0/2626039623 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:08:50.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:50.955+0000 7f9bb938b640 1 --2- 172.21.15.99:0/2626039623 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9bb41017e0 0x7f9bb419d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:50.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:50.955+0000 7f9bb3fff640 1 --2- 172.21.15.99:0/2626039623 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bb4100e20 0x7f9bb4196110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:50.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:50.955+0000 7f9bb8b8a640 1 -- 172.21.15.99:0/2626039623 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9bb41017e0 msgr2=0x7f9bb419d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:50.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:50.955+0000 7f9bb8b8a640 1 --2- 172.21.15.99:0/2626039623 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9bb41017e0 0x7f9bb419d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:50.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:50.955+0000 7f9bb8b8a640 1 -- 172.21.15.99:0/2626039623 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bb4100e20 msgr2=0x7f9bb4196110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:50.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:50.955+0000 7f9bb8b8a640 1 --2- 172.21.15.99:0/2626039623 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bb4100e20 0x7f9bb4196110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:50.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:50.955+0000 7f9bb8b8a640 1 -- 172.21.15.99:0/2626039623 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba0009560 con 0x7f9bb40ffc30 2024-01-31T05:08:50.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:50.955+0000 7f9bb8b8a640 1 --2- 172.21.15.99:0/2626039623 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9bb40ffc30 0x7f9bb4195bd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8009f20 tx=0x7f9ba800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:08:50.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:50.955+0000 7f9bb1ffb640 1 -- 172.21.15.99:0/2626039623 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba8009700 con 0x7f9bb40ffc30 2024-01-31T05:08:50.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:50.955+0000 7f9bb1ffb640 1 -- 172.21.15.99:0/2626039623 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9ba80044e0 con 0x7f9bb40ffc30 2024-01-31T05:08:50.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:50.955+0000 7f9bb1ffb640 1 -- 172.21.15.99:0/2626039623 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba80115d0 con 0x7f9bb40ffc30 2024-01-31T05:08:50.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:50.955+0000 7f9bbadee640 1 -- 172.21.15.99:0/2626039623 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bb4069380 con 0x7f9bb40ffc30 2024-01-31T05:08:50.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:50.955+0000 7f9bbadee640 1 -- 172.21.15.99:0/2626039623 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb4069810 con 0x7f9bb40ffc30 2024-01-31T05:08:50.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:50.957+0000 7f9bbadee640 1 -- 172.21.15.99:0/2626039623 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bb410be30 con 0x7f9bb40ffc30 2024-01-31T05:08:50.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:50.959+0000 7f9bb1ffb640 1 -- 172.21.15.99:0/2626039623 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f9ba80035f0 con 0x7f9bb40ffc30 2024-01-31T05:08:50.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:50.959+0000 7f9bb1ffb640 1 --2- 172.21.15.99:0/2626039623 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f9ba40a1360 0x7f9ba40a3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:50.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:50.959+0000 7f9bb3fff640 1 --2- 172.21.15.99:0/2626039623 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f9ba40a1360 0x7f9ba40a3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:50.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:50.959+0000 7f9bb1ffb640 1 -- 172.21.15.99:0/2626039623 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f9ba80cf050 con 0x7f9bb40ffc30 2024-01-31T05:08:50.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:50.960+0000 7f9bb3fff640 1 --2- 172.21.15.99:0/2626039623 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f9ba40a1360 0x7f9ba40a3820 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9ba0005ab0 tx=0x7f9ba002c5d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:08:50.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:50.963+0000 7f9bb1ffb640 1 -- 172.21.15.99:0/2626039623 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f9ba8098970 con 0x7f9bb40ffc30 2024-01-31T05:08:51.061 INFO:journalctl@ceph.mds.j.smithi099.stdout:Jan 31 05:08:50 smithi099 podman[72543]: 2024-01-31 05:08:50.635808392 +0000 UTC m=+0.017948346 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-31T05:08:51.061 INFO:journalctl@ceph.mds.j.smithi099.stdout:Jan 31 05:08:50 smithi099 podman[72543]: 2024-01-31 05:08:50.742941648 +0000 UTC m=+0.125081604 container create f70d8b2a2333e93a6a06584d08d7c53381c44833254b200712c22fdcb6756f75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-j, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.license=GPLv2, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.31.3, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240123, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-01-31T05:08:51.062 INFO:journalctl@ceph.mds.j.smithi099.stdout:Jan 31 05:08:50 smithi099 podman[72543]: 2024-01-31 05:08:50.954265508 +0000 UTC m=+0.336405465 container init f70d8b2a2333e93a6a06584d08d7c53381c44833254b200712c22fdcb6756f75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-j, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240123, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.31.3, ceph=True) 2024-01-31T05:08:51.062 INFO:journalctl@ceph.mds.j.smithi099.stdout:Jan 31 05:08:50 smithi099 podman[72543]: 2024-01-31 05:08:50.95844015 +0000 UTC m=+0.340580106 container start f70d8b2a2333e93a6a06584d08d7c53381c44833254b200712c22fdcb6756f75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-j, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.31.3, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240123, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.license=GPLv2) 2024-01-31T05:08:51.062 INFO:journalctl@ceph.mds.j.smithi099.stdout:Jan 31 05:08:50 smithi099 ceph-mds[72601]: -- 172.21.15.99:0/1063185316 <== mon.0 v2:172.21.15.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56466690b520 con 0x5646668e0800 2024-01-31T05:08:51.062 INFO:journalctl@ceph.mds.j.smithi099.stdout:Jan 31 05:08:50 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-j[72558]: starting mds.j at 2024-01-31T05:08:51.062 INFO:journalctl@ceph.mds.j.smithi099.stdout:Jan 31 05:08:51 smithi099 bash[72543]: f70d8b2a2333e93a6a06584d08d7c53381c44833254b200712c22fdcb6756f75 2024-01-31T05:08:51.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:51.179+0000 7f9bbadee640 1 -- 172.21.15.99:0/2626039623 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9bb410b570 con 0x7f9bb40ffc30 2024-01-31T05:08:51.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:51.179+0000 7f9bb1ffb640 1 -- 172.21.15.99:0/2626039623 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2116 (secure 0 0 0) 0x7f9ba809bf90 con 0x7f9bb40ffc30 2024-01-31T05:08:51.179 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:08:51.179 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24376,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/427201290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":427201290},{"type":"v1","addr":"172.21.15.181:6833","nonce":427201290}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/472161020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":472161020},{"type":"v1","addr":"172.21.15.179:6833","nonce":472161020}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-01-31T05:08:51.179 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 3 2024-01-31T05:08:51.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:51.181+0000 7f9bbadee640 1 -- 172.21.15.99:0/2626039623 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f9ba40a1360 msgr2=0x7f9ba40a3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:51.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:51.181+0000 7f9bbadee640 1 --2- 172.21.15.99:0/2626039623 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f9ba40a1360 0x7f9ba40a3820 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9ba0005ab0 tx=0x7f9ba002c5d0 comp rx=0 tx=0).stop 2024-01-31T05:08:51.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:51.181+0000 7f9bbadee640 1 -- 172.21.15.99:0/2626039623 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9bb40ffc30 msgr2=0x7f9bb4195bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:51.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:51.181+0000 7f9bbadee640 1 --2- 172.21.15.99:0/2626039623 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9bb40ffc30 0x7f9bb4195bd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8009f20 tx=0x7f9ba800ee50 comp rx=0 tx=0).stop 2024-01-31T05:08:51.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:51.181+0000 7f9bbadee640 1 -- 172.21.15.99:0/2626039623 shutdown_connections 2024-01-31T05:08:51.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:51.181+0000 7f9bbadee640 1 --2- 172.21.15.99:0/2626039623 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f9ba40a1360 0x7f9ba40a3820 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:51.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:51.181+0000 7f9bbadee640 1 --2- 172.21.15.99:0/2626039623 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9bb41017e0 0x7f9bb419d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:51.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:51.181+0000 7f9bbadee640 1 --2- 172.21.15.99:0/2626039623 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bb4100e20 0x7f9bb4196110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:51.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:51.181+0000 7f9bbadee640 1 --2- 172.21.15.99:0/2626039623 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9bb40ffc30 0x7f9bb4195bd0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:51.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:51.181+0000 7f9bbadee640 1 -- 172.21.15.99:0/2626039623 >> 172.21.15.99:0/2626039623 conn(0x7f9bb40fb1a0 msgr2=0x7f9bb4104120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:08:51.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:51.181+0000 7f9bbadee640 1 -- 172.21.15.99:0/2626039623 shutdown_connections 2024-01-31T05:08:51.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:51.181+0000 7f9bbadee640 1 -- 172.21.15.99:0/2626039623 wait complete. 2024-01-31T05:08:51.318 INFO:journalctl@ceph.mds.j.smithi099.stdout:Jan 31 05:08:51 smithi099 systemd[1]: Started Ceph mds.j for 9288ff44-bff5-11ee-95b3-87774f69a715. 2024-01-31T05:08:51.906 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:51 smithi099 ceph-mon[31615]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:08:51.907 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:51 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:51.907 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:51 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:51.907 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:51 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:51.907 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:51 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-31T05:08:51.907 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:51 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-31T05:08:51.907 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:51 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:08:51.907 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:51 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/2626039623' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:08:52.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:51 smithi181 ceph-mon[36434]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:08:52.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:51 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:52.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:51 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:52.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:51 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:52.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:51 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-31T05:08:52.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:51 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-31T05:08:52.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:51 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:08:52.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:51 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/2626039623' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:08:52.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:51 smithi179 ceph-mon[35652]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:08:52.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:51 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:52.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:51 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:52.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:51 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:52.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:51 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-31T05:08:52.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:51 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-31T05:08:52.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:51 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:08:52.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:51 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/2626039623' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:08:52.969 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:52 smithi099 ceph-mon[31615]: Deploying daemon mds.d on smithi099 2024-01-31T05:08:52.969 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:52 smithi099 ceph-mon[31615]: mds.? [v2:172.21.15.99:6834/1488539026,v1:172.21.15.99:6835/1488539026] up:boot 2024-01-31T05:08:52.969 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:52 smithi099 ceph-mon[31615]: fsmap 3 up:standby 2024-01-31T05:08:52.969 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:52 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-01-31T05:08:53.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:52 smithi181 ceph-mon[36434]: Deploying daemon mds.d on smithi099 2024-01-31T05:08:53.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:52 smithi181 ceph-mon[36434]: mds.? [v2:172.21.15.99:6834/1488539026,v1:172.21.15.99:6835/1488539026] up:boot 2024-01-31T05:08:53.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:52 smithi181 ceph-mon[36434]: fsmap 3 up:standby 2024-01-31T05:08:53.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:52 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-01-31T05:08:53.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:52 smithi179 ceph-mon[35652]: Deploying daemon mds.d on smithi099 2024-01-31T05:08:53.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:52 smithi179 ceph-mon[35652]: mds.? [v2:172.21.15.99:6834/1488539026,v1:172.21.15.99:6835/1488539026] up:boot 2024-01-31T05:08:53.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:52 smithi179 ceph-mon[35652]: fsmap 3 up:standby 2024-01-31T05:08:53.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:52 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-01-31T05:08:53.193 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T05:08:53.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.397+0000 7f88d8da7640 1 -- 172.21.15.99:0/2889745719 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88d41017c0 msgr2=0x7f88d4108050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:53.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.397+0000 7f88d8da7640 1 --2- 172.21.15.99:0/2889745719 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88d41017c0 0x7f88d4108050 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f88cc009ca0 tx=0x7f88cc02c0f0 comp rx=0 tx=0).stop 2024-01-31T05:08:53.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.397+0000 7f88d8da7640 1 -- 172.21.15.99:0/2889745719 shutdown_connections 2024-01-31T05:08:53.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.397+0000 7f88d8da7640 1 --2- 172.21.15.99:0/2889745719 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88d41017c0 0x7f88d4108050 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:53.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.397+0000 7f88d8da7640 1 --2- 172.21.15.99:0/2889745719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88d4100e00 0x7f88d4101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:53.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.397+0000 7f88d8da7640 1 --2- 172.21.15.99:0/2889745719 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88d40ffc10 0x7f88d4100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:53.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.397+0000 7f88d8da7640 1 -- 172.21.15.99:0/2889745719 >> 172.21.15.99:0/2889745719 conn(0x7f88d40fb180 msgr2=0x7f88d40fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:08:53.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.397+0000 7f88d8da7640 1 -- 172.21.15.99:0/2889745719 shutdown_connections 2024-01-31T05:08:53.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.397+0000 7f88d8da7640 1 -- 172.21.15.99:0/2889745719 wait complete. 2024-01-31T05:08:53.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.398+0000 7f88d8da7640 1 Processor -- start 2024-01-31T05:08:53.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.398+0000 7f88d8da7640 1 -- start start 2024-01-31T05:08:53.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.398+0000 7f88d8da7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88d40ffc10 0x7f88d40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:53.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.398+0000 7f88d8da7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88d4100e00 0x7f88d419b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:53.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.398+0000 7f88d8da7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88d41017c0 0x7f88d419e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:53.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.398+0000 7f88d8da7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d419e7f0 con 0x7f88d41017c0 2024-01-31T05:08:53.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.398+0000 7f88d8da7640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d419e960 con 0x7f88d4100e00 2024-01-31T05:08:53.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.398+0000 7f88d8da7640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d419eb20 con 0x7f88d40ffc10 2024-01-31T05:08:53.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.398+0000 7f88d2d9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88d41017c0 0x7f88d419e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:53.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.398+0000 7f88d2d9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88d41017c0 0x7f88d419e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36664/0 (socket says 172.21.15.99:36664) 2024-01-31T05:08:53.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.398+0000 7f88d2d9d640 1 -- 172.21.15.99:0/3195967730 learned_addr learned my addr 172.21.15.99:0/3195967730 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:08:53.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.398+0000 7f88d1d9b640 1 --2- 172.21.15.99:0/3195967730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88d4100e00 0x7f88d419b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:53.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.398+0000 7f88d259c640 1 --2- 172.21.15.99:0/3195967730 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88d40ffc10 0x7f88d40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:53.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.398+0000 7f88d2d9d640 1 -- 172.21.15.99:0/3195967730 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88d40ffc10 msgr2=0x7f88d40689c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:53.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.398+0000 7f88d2d9d640 1 --2- 172.21.15.99:0/3195967730 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88d40ffc10 0x7f88d40689c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:53.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.398+0000 7f88d2d9d640 1 -- 172.21.15.99:0/3195967730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88d4100e00 msgr2=0x7f88d419b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:53.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.398+0000 7f88d2d9d640 1 --2- 172.21.15.99:0/3195967730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88d4100e00 0x7f88d419b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:53.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.398+0000 7f88d2d9d640 1 -- 172.21.15.99:0/3195967730 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88cc009900 con 0x7f88d41017c0 2024-01-31T05:08:53.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.398+0000 7f88d2d9d640 1 --2- 172.21.15.99:0/3195967730 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88d41017c0 0x7f88d419e010 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f88cc037040 tx=0x7f88cc032810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:08:53.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.399+0000 7f88c37fe640 1 -- 172.21.15.99:0/3195967730 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88cc034e80 con 0x7f88d41017c0 2024-01-31T05:08:53.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.399+0000 7f88c37fe640 1 -- 172.21.15.99:0/3195967730 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f88cc003e30 con 0x7f88d41017c0 2024-01-31T05:08:53.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.399+0000 7f88d8da7640 1 -- 172.21.15.99:0/3195967730 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88d419ed40 con 0x7f88d41017c0 2024-01-31T05:08:53.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.399+0000 7f88c37fe640 1 -- 172.21.15.99:0/3195967730 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88cc03d3f0 con 0x7f88d41017c0 2024-01-31T05:08:53.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.399+0000 7f88d8da7640 1 -- 172.21.15.99:0/3195967730 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88d419f1a0 con 0x7f88d41017c0 2024-01-31T05:08:53.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.400+0000 7f88d8da7640 1 -- 172.21.15.99:0/3195967730 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88d4106f30 con 0x7f88d41017c0 2024-01-31T05:08:53.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.401+0000 7f88c37fe640 1 -- 172.21.15.99:0/3195967730 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f88cc03b040 con 0x7f88d41017c0 2024-01-31T05:08:53.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.402+0000 7f88c37fe640 1 --2- 172.21.15.99:0/3195967730 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f88bc0a12e0 0x7f88bc0a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:53.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.402+0000 7f88d259c640 1 --2- 172.21.15.99:0/3195967730 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f88bc0a12e0 0x7f88bc0a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:53.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.402+0000 7f88c37fe640 1 -- 172.21.15.99:0/3195967730 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f88cc0ef270 con 0x7f88d41017c0 2024-01-31T05:08:53.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.402+0000 7f88d259c640 1 --2- 172.21.15.99:0/3195967730 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f88bc0a12e0 0x7f88bc0a37a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f88c4005fd0 tx=0x7f88c4005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:08:53.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.409+0000 7f88c37fe640 1 -- 172.21.15.99:0/3195967730 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f88cc0b8b90 con 0x7f88d41017c0 2024-01-31T05:08:53.563 INFO:journalctl@ceph.mds.d.smithi099.stdout:Jan 31 05:08:53 smithi099 systemd[1]: Starting Ceph mds.d for 9288ff44-bff5-11ee-95b3-87774f69a715... 2024-01-31T05:08:53.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.636+0000 7f88d8da7640 1 -- 172.21.15.99:0/3195967730 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88d410b4d0 con 0x7f88d41017c0 2024-01-31T05:08:53.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.637+0000 7f88c37fe640 1 -- 172.21.15.99:0/3195967730 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2907 (secure 0 0 0) 0x7f88cc0bc1b0 con 0x7f88d41017c0 2024-01-31T05:08:53.636 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:08:53.636 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/1488539026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1488539026},{"type":"v1","addr":"172.21.15.99:6835","nonce":1488539026}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24376,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/427201290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":427201290},{"type":"v1","addr":"172.21.15.181:6833","nonce":427201290}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/472161020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":472161020},{"type":"v1","addr":"172.21.15.179:6833","nonce":472161020}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-01-31T05:08:53.637 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 4 2024-01-31T05:08:53.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.639+0000 7f88d8da7640 1 -- 172.21.15.99:0/3195967730 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f88bc0a12e0 msgr2=0x7f88bc0a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:53.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.639+0000 7f88d8da7640 1 --2- 172.21.15.99:0/3195967730 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f88bc0a12e0 0x7f88bc0a37a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f88c4005fd0 tx=0x7f88c4005850 comp rx=0 tx=0).stop 2024-01-31T05:08:53.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.639+0000 7f88d8da7640 1 -- 172.21.15.99:0/3195967730 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88d41017c0 msgr2=0x7f88d419e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:53.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.639+0000 7f88d8da7640 1 --2- 172.21.15.99:0/3195967730 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88d41017c0 0x7f88d419e010 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f88cc037040 tx=0x7f88cc032810 comp rx=0 tx=0).stop 2024-01-31T05:08:53.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.639+0000 7f88d8da7640 1 -- 172.21.15.99:0/3195967730 shutdown_connections 2024-01-31T05:08:53.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.639+0000 7f88d8da7640 1 --2- 172.21.15.99:0/3195967730 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f88bc0a12e0 0x7f88bc0a37a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:53.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.639+0000 7f88d8da7640 1 --2- 172.21.15.99:0/3195967730 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88d41017c0 0x7f88d419e010 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:53.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.639+0000 7f88d8da7640 1 --2- 172.21.15.99:0/3195967730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88d4100e00 0x7f88d419b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:53.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.639+0000 7f88d8da7640 1 --2- 172.21.15.99:0/3195967730 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88d40ffc10 0x7f88d40689c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:53.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.639+0000 7f88d8da7640 1 -- 172.21.15.99:0/3195967730 >> 172.21.15.99:0/3195967730 conn(0x7f88d40fb180 msgr2=0x7f88d4104100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:08:53.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.639+0000 7f88d8da7640 1 -- 172.21.15.99:0/3195967730 shutdown_connections 2024-01-31T05:08:53.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:53.639+0000 7f88d8da7640 1 -- 172.21.15.99:0/3195967730 wait complete. 2024-01-31T05:08:53.816 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:53 smithi099 ceph-mon[31615]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:08:53.817 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:53 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/3195967730' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:08:53.817 INFO:journalctl@ceph.mds.d.smithi099.stdout:Jan 31 05:08:53 smithi099 podman[72930]: 2024-01-31 05:08:53.467350237 +0000 UTC m=+0.017305286 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-31T05:08:53.817 INFO:journalctl@ceph.mds.d.smithi099.stdout:Jan 31 05:08:53 smithi099 podman[72930]: 2024-01-31 05:08:53.590275635 +0000 UTC m=+0.140230673 container create fd036ce99dc8b9e86bb24994d13ad8f1b4c1d210fb78e854159c070cf678be94 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-d, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.build-date=20240123, io.buildah.version=1.31.3, GIT_BRANCH=HEAD, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, ceph=True, org.label-schema.vendor=CentOS) 2024-01-31T05:08:53.817 INFO:journalctl@ceph.mds.d.smithi099.stdout:Jan 31 05:08:53 smithi099 podman[72930]: 2024-01-31 05:08:53.818104122 +0000 UTC m=+0.368059157 container init fd036ce99dc8b9e86bb24994d13ad8f1b4c1d210fb78e854159c070cf678be94 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-d, GIT_BRANCH=HEAD, org.label-schema.build-date=20240123, io.buildah.version=1.31.3, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-01-31T05:08:54.068 INFO:journalctl@ceph.mds.d.smithi099.stdout:Jan 31 05:08:53 smithi099 podman[72930]: 2024-01-31 05:08:53.820873134 +0000 UTC m=+0.370828178 container start fd036ce99dc8b9e86bb24994d13ad8f1b4c1d210fb78e854159c070cf678be94 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-d, ceph=True, org.label-schema.build-date=20240123, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.31.3, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-01-31T05:08:54.068 INFO:journalctl@ceph.mds.d.smithi099.stdout:Jan 31 05:08:53 smithi099 ceph-mds[72951]: -- 172.21.15.99:0/1376996765 <== mon.0 v2:172.21.15.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5565ccc87520 con 0x5565ccc5d000 2024-01-31T05:08:54.068 INFO:journalctl@ceph.mds.d.smithi099.stdout:Jan 31 05:08:53 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-d[72947]: starting mds.d at 2024-01-31T05:08:54.068 INFO:journalctl@ceph.mds.d.smithi099.stdout:Jan 31 05:08:53 smithi099 bash[72930]: fd036ce99dc8b9e86bb24994d13ad8f1b4c1d210fb78e854159c070cf678be94 2024-01-31T05:08:54.069 INFO:journalctl@ceph.mds.d.smithi099.stdout:Jan 31 05:08:53 smithi099 systemd[1]: Started Ceph mds.d for 9288ff44-bff5-11ee-95b3-87774f69a715. 2024-01-31T05:08:54.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:53 smithi181 ceph-mon[36434]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:08:54.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:53 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/3195967730' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:08:54.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:53 smithi179 ceph-mon[35652]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:08:54.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:53 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/3195967730' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:08:55.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:54 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:55.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:54 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:55.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:54 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:55.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:54 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-31T05:08:55.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:54 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-31T05:08:55.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:54 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:08:55.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:54 smithi099 ceph-mon[31615]: Deploying daemon mds.e on smithi179 2024-01-31T05:08:55.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:54 smithi099 ceph-mon[31615]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:08:55.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:54 smithi099 ceph-mon[31615]: mds.? [v2:172.21.15.99:6836/1649552652,v1:172.21.15.99:6837/1649552652] up:boot 2024-01-31T05:08:55.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:54 smithi099 ceph-mon[31615]: fsmap 4 up:standby 2024-01-31T05:08:55.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:54 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-01-31T05:08:55.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:54 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:55.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:54 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:55.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:54 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:55.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:54 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-31T05:08:55.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:54 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-31T05:08:55.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:54 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:08:55.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:54 smithi181 ceph-mon[36434]: Deploying daemon mds.e on smithi179 2024-01-31T05:08:55.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:54 smithi181 ceph-mon[36434]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:08:55.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:54 smithi181 ceph-mon[36434]: mds.? [v2:172.21.15.99:6836/1649552652,v1:172.21.15.99:6837/1649552652] up:boot 2024-01-31T05:08:55.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:54 smithi181 ceph-mon[36434]: fsmap 4 up:standby 2024-01-31T05:08:55.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:54 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-01-31T05:08:55.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:54 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:55.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:54 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:55.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:54 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:55.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:54 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-31T05:08:55.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:54 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-31T05:08:55.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:54 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:08:55.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:54 smithi179 ceph-mon[35652]: Deploying daemon mds.e on smithi179 2024-01-31T05:08:55.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:54 smithi179 ceph-mon[35652]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:08:55.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:54 smithi179 ceph-mon[35652]: mds.? [v2:172.21.15.99:6836/1649552652,v1:172.21.15.99:6837/1649552652] up:boot 2024-01-31T05:08:55.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:54 smithi179 ceph-mon[35652]: fsmap 4 up:standby 2024-01-31T05:08:55.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:54 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-01-31T05:08:55.650 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T05:08:55.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.766+0000 7f2bd759a640 1 -- 172.21.15.99:0/4043702067 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2bd0104920 msgr2=0x7f2bd0104da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:55.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.766+0000 7f2bd759a640 1 --2- 172.21.15.99:0/4043702067 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2bd0104920 0x7f2bd0104da0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8009ca0 tx=0x7f2bc802c0f0 comp rx=0 tx=0).stop 2024-01-31T05:08:55.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.766+0000 7f2bd759a640 1 -- 172.21.15.99:0/4043702067 shutdown_connections 2024-01-31T05:08:55.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.766+0000 7f2bd759a640 1 --2- 172.21.15.99:0/4043702067 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2bd0104920 0x7f2bd0104da0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:55.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.766+0000 7f2bd759a640 1 --2- 172.21.15.99:0/4043702067 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2bd0101f70 0x7f2bd01043e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:55.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.766+0000 7f2bd759a640 1 --2- 172.21.15.99:0/4043702067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2bd00ff600 0x7f2bd0101a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:55.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.766+0000 7f2bd759a640 1 -- 172.21.15.99:0/4043702067 >> 172.21.15.99:0/4043702067 conn(0x7f2bd00fb220 msgr2=0x7f2bd00fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:08:55.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.766+0000 7f2bd759a640 1 -- 172.21.15.99:0/4043702067 shutdown_connections 2024-01-31T05:08:55.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.766+0000 7f2bd759a640 1 -- 172.21.15.99:0/4043702067 wait complete. 2024-01-31T05:08:55.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.766+0000 7f2bd759a640 1 Processor -- start 2024-01-31T05:08:55.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.766+0000 7f2bd759a640 1 -- start start 2024-01-31T05:08:55.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.767+0000 7f2bd759a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2bd00ff600 0x7f2bd019d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:55.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.767+0000 7f2bd759a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2bd0101f70 0x7f2bd019d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:55.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.767+0000 7f2bd759a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2bd0104920 0x7f2bd01a47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:55.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.767+0000 7f2bd759a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd01a4d30 con 0x7f2bd0101f70 2024-01-31T05:08:55.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.767+0000 7f2bd759a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd01a4ea0 con 0x7f2bd0104920 2024-01-31T05:08:55.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.767+0000 7f2bd759a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd01a5060 con 0x7f2bd00ff600 2024-01-31T05:08:55.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.767+0000 7f2bd4b35640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2bd0101f70 0x7f2bd019d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:55.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.767+0000 7f2bd4b35640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2bd0101f70 0x7f2bd019d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52488/0 (socket says 172.21.15.99:52488) 2024-01-31T05:08:55.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.767+0000 7f2bd4b35640 1 -- 172.21.15.99:0/2424493951 learned_addr learned my addr 172.21.15.99:0/2424493951 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:08:55.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.767+0000 7f2bd5336640 1 --2- 172.21.15.99:0/2424493951 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2bd00ff600 0x7f2bd019d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:55.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.767+0000 7f2bd5b37640 1 --2- 172.21.15.99:0/2424493951 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2bd0104920 0x7f2bd01a47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:55.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.767+0000 7f2bd4b35640 1 -- 172.21.15.99:0/2424493951 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2bd00ff600 msgr2=0x7f2bd019d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:55.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.767+0000 7f2bd4b35640 1 --2- 172.21.15.99:0/2424493951 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2bd00ff600 0x7f2bd019d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:55.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.767+0000 7f2bd4b35640 1 -- 172.21.15.99:0/2424493951 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2bd0104920 msgr2=0x7f2bd01a47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:55.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.767+0000 7f2bd4b35640 1 --2- 172.21.15.99:0/2424493951 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2bd0104920 0x7f2bd01a47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:55.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.767+0000 7f2bd4b35640 1 -- 172.21.15.99:0/2424493951 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc8009900 con 0x7f2bd0101f70 2024-01-31T05:08:55.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.767+0000 7f2bd5b37640 1 --2- 172.21.15.99:0/2424493951 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2bd0104920 0x7f2bd01a47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:08:55.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.767+0000 7f2bd4b35640 1 --2- 172.21.15.99:0/2424493951 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2bd0101f70 0x7f2bd019d780 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc00d950 tx=0x7f2bcc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:08:55.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.767+0000 7f2bc67fc640 1 -- 172.21.15.99:0/2424493951 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc009c30 con 0x7f2bd0101f70 2024-01-31T05:08:55.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.767+0000 7f2bd759a640 1 -- 172.21.15.99:0/2424493951 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bd01a5340 con 0x7f2bd0101f70 2024-01-31T05:08:55.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.767+0000 7f2bc67fc640 1 -- 172.21.15.99:0/2424493951 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2bcc009d90 con 0x7f2bd0101f70 2024-01-31T05:08:55.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.767+0000 7f2bc67fc640 1 -- 172.21.15.99:0/2424493951 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc00f740 con 0x7f2bd0101f70 2024-01-31T05:08:55.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.767+0000 7f2bd759a640 1 -- 172.21.15.99:0/2424493951 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bd01a5850 con 0x7f2bd0101f70 2024-01-31T05:08:55.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.768+0000 7f2bd759a640 1 -- 172.21.15.99:0/2424493951 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bd00fcd10 con 0x7f2bd0101f70 2024-01-31T05:08:55.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.771+0000 7f2bc67fc640 1 -- 172.21.15.99:0/2424493951 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f2bcc010a20 con 0x7f2bd0101f70 2024-01-31T05:08:55.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.771+0000 7f2bc67fc640 1 --2- 172.21.15.99:0/2424493951 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2bbc0a12e0 0x7f2bbc0a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:55.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.771+0000 7f2bd5336640 1 --2- 172.21.15.99:0/2424493951 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2bbc0a12e0 0x7f2bbc0a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:55.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.771+0000 7f2bc67fc640 1 -- 172.21.15.99:0/2424493951 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f2bcc0cc8d0 con 0x7f2bd0101f70 2024-01-31T05:08:55.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.772+0000 7f2bd5336640 1 --2- 172.21.15.99:0/2424493951 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2bbc0a12e0 0x7f2bbc0a37a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0005fd0 tx=0x7f2bc0005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:08:55.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.774+0000 7f2bc67fc640 1 -- 172.21.15.99:0/2424493951 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f2bcc0961f0 con 0x7f2bd0101f70 2024-01-31T05:08:55.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.982+0000 7f2bd759a640 1 -- 172.21.15.99:0/2424493951 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2bd0112c20 con 0x7f2bd0101f70 2024-01-31T05:08:55.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.983+0000 7f2bc67fc640 1 -- 172.21.15.99:0/2424493951 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3698 (secure 0 0 0) 0x7f2bcc017090 con 0x7f2bd0101f70 2024-01-31T05:08:55.982 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:08:55.982 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/1488539026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1488539026},{"type":"v1","addr":"172.21.15.99:6835","nonce":1488539026}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/1649552652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1649552652},{"type":"v1","addr":"172.21.15.99:6837","nonce":1649552652}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24376,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/427201290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":427201290},{"type":"v1","addr":"172.21.15.181:6833","nonce":427201290}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/472161020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":472161020},{"type":"v1","addr":"172.21.15.179:6833","nonce":472161020}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-01-31T05:08:55.982 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 5 2024-01-31T05:08:55.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.985+0000 7f2bd759a640 1 -- 172.21.15.99:0/2424493951 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2bbc0a12e0 msgr2=0x7f2bbc0a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:55.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.985+0000 7f2bd759a640 1 --2- 172.21.15.99:0/2424493951 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2bbc0a12e0 0x7f2bbc0a37a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0005fd0 tx=0x7f2bc0005850 comp rx=0 tx=0).stop 2024-01-31T05:08:55.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.985+0000 7f2bd759a640 1 -- 172.21.15.99:0/2424493951 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2bd0101f70 msgr2=0x7f2bd019d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:55.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.985+0000 7f2bd759a640 1 --2- 172.21.15.99:0/2424493951 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2bd0101f70 0x7f2bd019d780 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc00d950 tx=0x7f2bcc00de10 comp rx=0 tx=0).stop 2024-01-31T05:08:55.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.985+0000 7f2bd759a640 1 -- 172.21.15.99:0/2424493951 shutdown_connections 2024-01-31T05:08:55.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.985+0000 7f2bd759a640 1 --2- 172.21.15.99:0/2424493951 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2bbc0a12e0 0x7f2bbc0a37a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:55.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.985+0000 7f2bd759a640 1 --2- 172.21.15.99:0/2424493951 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2bd0104920 0x7f2bd01a47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:55.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.985+0000 7f2bd759a640 1 --2- 172.21.15.99:0/2424493951 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2bd0101f70 0x7f2bd019d780 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:55.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.985+0000 7f2bd759a640 1 --2- 172.21.15.99:0/2424493951 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2bd00ff600 0x7f2bd019d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:55.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.985+0000 7f2bd759a640 1 -- 172.21.15.99:0/2424493951 >> 172.21.15.99:0/2424493951 conn(0x7f2bd00fb220 msgr2=0x7f2bd0102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:08:55.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.985+0000 7f2bd759a640 1 -- 172.21.15.99:0/2424493951 shutdown_connections 2024-01-31T05:08:55.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:55.985+0000 7f2bd759a640 1 -- 172.21.15.99:0/2424493951 wait complete. 2024-01-31T05:08:56.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:56 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/2424493951' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:08:56.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:56 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/2424493951' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:08:56.340 INFO:journalctl@ceph.mds.e.smithi179.stdout:Jan 31 05:08:56 smithi179 systemd[1]: Starting Ceph mds.e for 9288ff44-bff5-11ee-95b3-87774f69a715... 2024-01-31T05:08:56.340 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:56 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/2424493951' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:08:56.632 INFO:journalctl@ceph.mds.e.smithi179.stdout:Jan 31 05:08:56 smithi179 podman[65817]: 2024-01-31 05:08:56.460028941 +0000 UTC m=+0.018411770 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-31T05:08:56.632 INFO:journalctl@ceph.mds.e.smithi179.stdout:Jan 31 05:08:56 smithi179 podman[65817]: 2024-01-31 05:08:56.5799329 +0000 UTC m=+0.138315707 container create fe8e57110bfbc9ae478b98cf69f303fb859b2b50ddf5648194605c949d917a89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-e, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.31.3, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.build-date=20240123, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-01-31T05:08:57.037 INFO:journalctl@ceph.mds.e.smithi179.stdout:Jan 31 05:08:56 smithi179 podman[65817]: 2024-01-31 05:08:56.80764189 +0000 UTC m=+0.366024706 container init fe8e57110bfbc9ae478b98cf69f303fb859b2b50ddf5648194605c949d917a89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.31.3, GIT_BRANCH=HEAD, org.label-schema.build-date=20240123, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True) 2024-01-31T05:08:57.038 INFO:journalctl@ceph.mds.e.smithi179.stdout:Jan 31 05:08:56 smithi179 podman[65817]: 2024-01-31 05:08:56.810438199 +0000 UTC m=+0.368821021 container start fe8e57110bfbc9ae478b98cf69f303fb859b2b50ddf5648194605c949d917a89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240125.044502-661946e, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240123, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.31.3, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.vendor=CentOS) 2024-01-31T05:08:57.038 INFO:journalctl@ceph.mds.e.smithi179.stdout:Jan 31 05:08:56 smithi179 ceph-mds[65836]: -- 172.21.15.179:0/1489720965 <== mon.2 v2:172.21.15.179:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b793bed520 con 0x55b793bc2c00 2024-01-31T05:08:57.038 INFO:journalctl@ceph.mds.e.smithi179.stdout:Jan 31 05:08:56 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-e[65832]: starting mds.e at 2024-01-31T05:08:57.038 INFO:journalctl@ceph.mds.e.smithi179.stdout:Jan 31 05:08:56 smithi179 bash[65817]: fe8e57110bfbc9ae478b98cf69f303fb859b2b50ddf5648194605c949d917a89 2024-01-31T05:08:57.038 INFO:journalctl@ceph.mds.e.smithi179.stdout:Jan 31 05:08:56 smithi179 systemd[1]: Started Ceph mds.e for 9288ff44-bff5-11ee-95b3-87774f69a715. 2024-01-31T05:08:57.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:57 smithi099 ceph-mon[31615]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:08:57.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:57 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:57.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:57 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:57.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:57 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:57.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:57 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-31T05:08:57.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:57 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-31T05:08:57.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:57 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:08:57.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:57 smithi181 ceph-mon[36434]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:08:57.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:57 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:57.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:57 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:57.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:57 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:57.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:57 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-31T05:08:57.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:57 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-31T05:08:57.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:57 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:08:57.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:57 smithi179 ceph-mon[35652]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:08:57.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:57 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:57.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:57 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:57.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:57 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:08:57.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:57 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-31T05:08:57.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:57 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-31T05:08:57.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:57 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:08:57.996 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T05:08:58.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.112+0000 7f35ba99a640 1 -- 172.21.15.99:0/658869238 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35b4102970 msgr2=0x7f35b4109200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:58.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.112+0000 7f35ba99a640 1 --2- 172.21.15.99:0/658869238 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35b4102970 0x7f35b4109200 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f35ac009ca0 tx=0x7f35ac02c0f0 comp rx=0 tx=0).stop 2024-01-31T05:08:58.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.112+0000 7f35ba99a640 1 -- 172.21.15.99:0/658869238 shutdown_connections 2024-01-31T05:08:58.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.112+0000 7f35ba99a640 1 --2- 172.21.15.99:0/658869238 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35b4102970 0x7f35b4109200 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:58.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.112+0000 7f35ba99a640 1 --2- 172.21.15.99:0/658869238 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35b4101fb0 0x7f35b4102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:58.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.112+0000 7f35ba99a640 1 --2- 172.21.15.99:0/658869238 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f35b40fefe0 0x7f35b40ff400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:58.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.112+0000 7f35ba99a640 1 -- 172.21.15.99:0/658869238 >> 172.21.15.99:0/658869238 conn(0x7f35b40fa910 msgr2=0x7f35b40fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:08:58.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.112+0000 7f35ba99a640 1 -- 172.21.15.99:0/658869238 shutdown_connections 2024-01-31T05:08:58.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.112+0000 7f35ba99a640 1 -- 172.21.15.99:0/658869238 wait complete. 2024-01-31T05:08:58.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.113+0000 7f35ba99a640 1 Processor -- start 2024-01-31T05:08:58.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.113+0000 7f35ba99a640 1 -- start start 2024-01-31T05:08:58.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.113+0000 7f35ba99a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f35b40fefe0 0x7f35b4196c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:58.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.113+0000 7f35ba99a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35b4101fb0 0x7f35b41971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:58.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.113+0000 7f35ba99a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35b4102970 0x7f35b419e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:58.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.113+0000 7f35ba99a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b419e750 con 0x7f35b4101fb0 2024-01-31T05:08:58.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.113+0000 7f35ba99a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b419e8c0 con 0x7f35b4102970 2024-01-31T05:08:58.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.113+0000 7f35ba99a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b419ea80 con 0x7f35b40fefe0 2024-01-31T05:08:58.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.113+0000 7f35b37fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35b4101fb0 0x7f35b41971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:58.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.113+0000 7f35b37fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35b4101fb0 0x7f35b41971b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52498/0 (socket says 172.21.15.99:52498) 2024-01-31T05:08:58.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.113+0000 7f35b37fe640 1 -- 172.21.15.99:0/87009267 learned_addr learned my addr 172.21.15.99:0/87009267 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:08:58.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.113+0000 7f35b8f37640 1 --2- 172.21.15.99:0/87009267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35b4102970 0x7f35b419e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:58.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.113+0000 7f35b3fff640 1 --2- 172.21.15.99:0/87009267 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f35b40fefe0 0x7f35b4196c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:58.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.113+0000 7f35b37fe640 1 -- 172.21.15.99:0/87009267 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f35b40fefe0 msgr2=0x7f35b4196c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:58.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.113+0000 7f35b37fe640 1 --2- 172.21.15.99:0/87009267 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f35b40fefe0 0x7f35b4196c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:58.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.113+0000 7f35b37fe640 1 -- 172.21.15.99:0/87009267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35b4102970 msgr2=0x7f35b419e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:58.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.113+0000 7f35b37fe640 1 --2- 172.21.15.99:0/87009267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35b4102970 0x7f35b419e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:58.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.113+0000 7f35b37fe640 1 -- 172.21.15.99:0/87009267 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35ac009900 con 0x7f35b4101fb0 2024-01-31T05:08:58.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.113+0000 7f35b8f37640 1 --2- 172.21.15.99:0/87009267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35b4102970 0x7f35b419e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:08:58.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.114+0000 7f35b37fe640 1 --2- 172.21.15.99:0/87009267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35b4101fb0 0x7f35b41971b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f35a800e9f0 tx=0x7f35a800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:08:58.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.114+0000 7f35b17fa640 1 -- 172.21.15.99:0/87009267 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a8009700 con 0x7f35b4101fb0 2024-01-31T05:08:58.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.114+0000 7f35ba99a640 1 -- 172.21.15.99:0/87009267 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35b419ed60 con 0x7f35b4101fb0 2024-01-31T05:08:58.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.114+0000 7f35b17fa640 1 -- 172.21.15.99:0/87009267 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f35a800cd80 con 0x7f35b4101fb0 2024-01-31T05:08:58.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.114+0000 7f35b17fa640 1 -- 172.21.15.99:0/87009267 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a8018860 con 0x7f35b4101fb0 2024-01-31T05:08:58.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.114+0000 7f35ba99a640 1 -- 172.21.15.99:0/87009267 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35b419f1c0 con 0x7f35b4101fb0 2024-01-31T05:08:58.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.115+0000 7f35ba99a640 1 -- 172.21.15.99:0/87009267 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35b4108160 con 0x7f35b4101fb0 2024-01-31T05:08:58.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.116+0000 7f35b17fa640 1 -- 172.21.15.99:0/87009267 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f35a80189c0 con 0x7f35b4101fb0 2024-01-31T05:08:58.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.116+0000 7f35b17fa640 1 --2- 172.21.15.99:0/87009267 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f359c0a12e0 0x7f359c0a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:08:58.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.116+0000 7f35b3fff640 1 --2- 172.21.15.99:0/87009267 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f359c0a12e0 0x7f359c0a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:08:58.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.116+0000 7f35b17fa640 1 -- 172.21.15.99:0/87009267 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f35a8014070 con 0x7f35b4101fb0 2024-01-31T05:08:58.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.117+0000 7f35b3fff640 1 --2- 172.21.15.99:0/87009267 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f359c0a12e0 0x7f359c0a37a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f35a4005fd0 tx=0x7f35a4005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:08:58.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.121+0000 7f35b17fa640 1 -- 172.21.15.99:0/87009267 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f35a8052600 con 0x7f35b4101fb0 2024-01-31T05:08:58.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:58 smithi099 ceph-mon[31615]: Deploying daemon mds.f on smithi181 2024-01-31T05:08:58.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:58 smithi099 ceph-mon[31615]: mds.? [v2:172.21.15.179:6834/966976592,v1:172.21.15.179:6835/966976592] up:boot 2024-01-31T05:08:58.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:58 smithi099 ceph-mon[31615]: fsmap 5 up:standby 2024-01-31T05:08:58.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:58 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-01-31T05:08:58.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:58 smithi181 ceph-mon[36434]: Deploying daemon mds.f on smithi181 2024-01-31T05:08:58.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:58 smithi181 ceph-mon[36434]: mds.? [v2:172.21.15.179:6834/966976592,v1:172.21.15.179:6835/966976592] up:boot 2024-01-31T05:08:58.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:58 smithi181 ceph-mon[36434]: fsmap 5 up:standby 2024-01-31T05:08:58.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:58 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-01-31T05:08:58.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.328+0000 7f35ba99a640 1 -- 172.21.15.99:0/87009267 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35b410c5e0 con 0x7f35b4101fb0 2024-01-31T05:08:58.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.328+0000 7f35b17fa640 1 -- 172.21.15.99:0/87009267 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4489 (secure 0 0 0) 0x7f35a8096450 con 0x7f35b4101fb0 2024-01-31T05:08:58.328 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:08:58.328 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/1488539026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1488539026},{"type":"v1","addr":"172.21.15.99:6835","nonce":1488539026}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/1649552652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1649552652},{"type":"v1","addr":"172.21.15.99:6837","nonce":1649552652}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24376,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/427201290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":427201290},{"type":"v1","addr":"172.21.15.181:6833","nonce":427201290}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/472161020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":472161020},{"type":"v1","addr":"172.21.15.179:6833","nonce":472161020}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/966976592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":966976592},{"type":"v1","addr":"172.21.15.179:6835","nonce":966976592}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[]} 2024-01-31T05:08:58.328 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 6 2024-01-31T05:08:58.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.330+0000 7f35ba99a640 1 -- 172.21.15.99:0/87009267 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f359c0a12e0 msgr2=0x7f359c0a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:58.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.330+0000 7f35ba99a640 1 --2- 172.21.15.99:0/87009267 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f359c0a12e0 0x7f359c0a37a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f35a4005fd0 tx=0x7f35a4005850 comp rx=0 tx=0).stop 2024-01-31T05:08:58.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.330+0000 7f35ba99a640 1 -- 172.21.15.99:0/87009267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35b4101fb0 msgr2=0x7f35b41971b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:08:58.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.330+0000 7f35ba99a640 1 --2- 172.21.15.99:0/87009267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35b4101fb0 0x7f35b41971b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f35a800e9f0 tx=0x7f35a800eeb0 comp rx=0 tx=0).stop 2024-01-31T05:08:58.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.331+0000 7f35ba99a640 1 -- 172.21.15.99:0/87009267 shutdown_connections 2024-01-31T05:08:58.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.331+0000 7f35ba99a640 1 --2- 172.21.15.99:0/87009267 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f359c0a12e0 0x7f359c0a37a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:58.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.331+0000 7f35ba99a640 1 --2- 172.21.15.99:0/87009267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35b4102970 0x7f35b419e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:58.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.331+0000 7f35ba99a640 1 --2- 172.21.15.99:0/87009267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35b4101fb0 0x7f35b41971b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:58.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.331+0000 7f35ba99a640 1 --2- 172.21.15.99:0/87009267 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f35b40fefe0 0x7f35b4196c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:08:58.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.331+0000 7f35ba99a640 1 -- 172.21.15.99:0/87009267 >> 172.21.15.99:0/87009267 conn(0x7f35b40fa910 msgr2=0x7f35b4105330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:08:58.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.331+0000 7f35ba99a640 1 -- 172.21.15.99:0/87009267 shutdown_connections 2024-01-31T05:08:58.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:08:58.331+0000 7f35ba99a640 1 -- 172.21.15.99:0/87009267 wait complete. 2024-01-31T05:08:58.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:58 smithi179 ceph-mon[35652]: Deploying daemon mds.f on smithi181 2024-01-31T05:08:58.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:58 smithi179 ceph-mon[35652]: mds.? [v2:172.21.15.179:6834/966976592,v1:172.21.15.179:6835/966976592] up:boot 2024-01-31T05:08:58.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:58 smithi179 ceph-mon[35652]: fsmap 5 up:standby 2024-01-31T05:08:58.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:58 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-01-31T05:08:59.236 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:59 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/87009267' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:08:59.237 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:08:59 smithi181 ceph-mon[36434]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:08:59.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:59 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/87009267' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:08:59.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:08:59 smithi099 ceph-mon[31615]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:08:59.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:59 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/87009267' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:08:59.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:08:59 smithi179 ceph-mon[35652]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:08:59.509 INFO:journalctl@ceph.mds.f.smithi181.stdout:Jan 31 05:08:59 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-f[67853]: starting mds.f at 2024-01-31T05:08:59.821 INFO:journalctl@ceph.mds.f.smithi181.stdout:Jan 31 05:08:59 smithi181 bash[67838]: c4b143c29662619216dc466014e008afcef1640152d57d25fb618827995352a0 2024-01-31T05:08:59.821 INFO:journalctl@ceph.mds.f.smithi181.stdout:Jan 31 05:08:59 smithi181 systemd[1]: Started Ceph mds.f for 9288ff44-bff5-11ee-95b3-87774f69a715. 2024-01-31T05:09:00.341 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T05:09:00.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.446+0000 7f1c3a15a640 1 -- 172.21.15.99:0/591307550 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c340ffc10 msgr2=0x7f1c34100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:00.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.446+0000 7f1c3a15a640 1 --2- 172.21.15.99:0/591307550 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c340ffc10 0x7f1c34100030 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1c28009900 tx=0x7f1c2802bc30 comp rx=0 tx=0).stop 2024-01-31T05:09:00.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.446+0000 7f1c3a15a640 1 -- 172.21.15.99:0/591307550 shutdown_connections 2024-01-31T05:09:00.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.446+0000 7f1c3a15a640 1 --2- 172.21.15.99:0/591307550 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c341017c0 0x7f1c34108050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:00.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.446+0000 7f1c3a15a640 1 --2- 172.21.15.99:0/591307550 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c34100e00 0x7f1c34101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:00.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.446+0000 7f1c3a15a640 1 --2- 172.21.15.99:0/591307550 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c340ffc10 0x7f1c34100030 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:00.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.447+0000 7f1c3a15a640 1 -- 172.21.15.99:0/591307550 >> 172.21.15.99:0/591307550 conn(0x7f1c340fb180 msgr2=0x7f1c340fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:00.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.447+0000 7f1c3a15a640 1 -- 172.21.15.99:0/591307550 shutdown_connections 2024-01-31T05:09:00.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.447+0000 7f1c3a15a640 1 -- 172.21.15.99:0/591307550 wait complete. 2024-01-31T05:09:00.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.447+0000 7f1c3a15a640 1 Processor -- start 2024-01-31T05:09:00.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.447+0000 7f1c3a15a640 1 -- start start 2024-01-31T05:09:00.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.447+0000 7f1c3a15a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c340ffc10 0x7f1c34103ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:00.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.447+0000 7f1c3a15a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c34100e00 0x7f1c341021e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:00.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.447+0000 7f1c3a15a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c341017c0 0x7f1c34102720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:00.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.447+0000 7f1c3a15a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c34102e80 con 0x7f1c34100e00 2024-01-31T05:09:00.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.447+0000 7f1c3a15a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c34102ff0 con 0x7f1c341017c0 2024-01-31T05:09:00.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.447+0000 7f1c3a15a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c341a0de0 con 0x7f1c340ffc10 2024-01-31T05:09:00.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.448+0000 7f1c32ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c34100e00 0x7f1c341021e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:00.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.448+0000 7f1c32ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c34100e00 0x7f1c341021e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52518/0 (socket says 172.21.15.99:52518) 2024-01-31T05:09:00.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.448+0000 7f1c337fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c340ffc10 0x7f1c34103ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:00.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.448+0000 7f1c32ffd640 1 -- 172.21.15.99:0/3603165528 learned_addr learned my addr 172.21.15.99:0/3603165528 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:09:00.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.448+0000 7f1c33fff640 1 --2- 172.21.15.99:0/3603165528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c341017c0 0x7f1c34102720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:00.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.448+0000 7f1c32ffd640 1 -- 172.21.15.99:0/3603165528 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c340ffc10 msgr2=0x7f1c34103ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:00.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.448+0000 7f1c32ffd640 1 --2- 172.21.15.99:0/3603165528 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c340ffc10 0x7f1c34103ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:00.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.448+0000 7f1c32ffd640 1 -- 172.21.15.99:0/3603165528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c341017c0 msgr2=0x7f1c34102720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:00.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.448+0000 7f1c32ffd640 1 --2- 172.21.15.99:0/3603165528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c341017c0 0x7f1c34102720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:00.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.448+0000 7f1c32ffd640 1 -- 172.21.15.99:0/3603165528 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c28009560 con 0x7f1c34100e00 2024-01-31T05:09:00.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.448+0000 7f1c33fff640 1 --2- 172.21.15.99:0/3603165528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c341017c0 0x7f1c34102720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:09:00.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.448+0000 7f1c337fe640 1 --2- 172.21.15.99:0/3603165528 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c340ffc10 0x7f1c34103ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:09:00.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.448+0000 7f1c32ffd640 1 --2- 172.21.15.99:0/3603165528 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c34100e00 0x7f1c341021e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1c2400ea20 tx=0x7f1c2400eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:00.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.448+0000 7f1c30ff9640 1 -- 172.21.15.99:0/3603165528 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c24009700 con 0x7f1c34100e00 2024-01-31T05:09:00.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.448+0000 7f1c30ff9640 1 -- 172.21.15.99:0/3603165528 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1c2400cd80 con 0x7f1c34100e00 2024-01-31T05:09:00.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.448+0000 7f1c3a15a640 1 -- 172.21.15.99:0/3603165528 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c341a1090 con 0x7f1c34100e00 2024-01-31T05:09:00.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.448+0000 7f1c30ff9640 1 -- 172.21.15.99:0/3603165528 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c240187e0 con 0x7f1c34100e00 2024-01-31T05:09:00.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.448+0000 7f1c3a15a640 1 -- 172.21.15.99:0/3603165528 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c341a15a0 con 0x7f1c34100e00 2024-01-31T05:09:00.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.449+0000 7f1c3a15a640 1 -- 172.21.15.99:0/3603165528 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c3410b4a0 con 0x7f1c34100e00 2024-01-31T05:09:00.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.450+0000 7f1c30ff9640 1 -- 172.21.15.99:0/3603165528 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f1c24018940 con 0x7f1c34100e00 2024-01-31T05:09:00.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.451+0000 7f1c30ff9640 1 --2- 172.21.15.99:0/3603165528 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f1c1c0a12e0 0x7f1c1c0a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:00.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.451+0000 7f1c337fe640 1 --2- 172.21.15.99:0/3603165528 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f1c1c0a12e0 0x7f1c1c0a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:00.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.451+0000 7f1c30ff9640 1 -- 172.21.15.99:0/3603165528 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f1c24014070 con 0x7f1c34100e00 2024-01-31T05:09:00.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.451+0000 7f1c337fe640 1 --2- 172.21.15.99:0/3603165528 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f1c1c0a12e0 0x7f1c1c0a37a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1c28000c00 tx=0x7f1c2802c5d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:00.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.455+0000 7f1c30ff9640 1 -- 172.21.15.99:0/3603165528 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f1c24052600 con 0x7f1c34100e00 2024-01-31T05:09:00.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.682+0000 7f1c3a15a640 1 -- 172.21.15.99:0/3603165528 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1c3410b630 con 0x7f1c34100e00 2024-01-31T05:09:00.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.682+0000 7f1c30ff9640 1 -- 172.21.15.99:0/3603165528 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5283 (secure 0 0 0) 0x7f1c240963c0 con 0x7f1c34100e00 2024-01-31T05:09:00.681 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:09:00.682 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/1488539026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1488539026},{"type":"v1","addr":"172.21.15.99:6835","nonce":1488539026}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/1649552652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1649552652},{"type":"v1","addr":"172.21.15.99:6837","nonce":1649552652}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24376,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/427201290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":427201290},{"type":"v1","addr":"172.21.15.181:6833","nonce":427201290}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/472161020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":472161020},{"type":"v1","addr":"172.21.15.179:6833","nonce":472161020}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24427,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/1038715471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1038715471},{"type":"v1","addr":"172.21.15.181:6835","nonce":1038715471}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/966976592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":966976592},{"type":"v1","addr":"172.21.15.179:6835","nonce":966976592}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[]} 2024-01-31T05:09:00.682 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 7 2024-01-31T05:09:00.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.684+0000 7f1c3a15a640 1 -- 172.21.15.99:0/3603165528 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f1c1c0a12e0 msgr2=0x7f1c1c0a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:00.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.684+0000 7f1c3a15a640 1 --2- 172.21.15.99:0/3603165528 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f1c1c0a12e0 0x7f1c1c0a37a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1c28000c00 tx=0x7f1c2802c5d0 comp rx=0 tx=0).stop 2024-01-31T05:09:00.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.684+0000 7f1c3a15a640 1 -- 172.21.15.99:0/3603165528 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c34100e00 msgr2=0x7f1c341021e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:00.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.684+0000 7f1c3a15a640 1 --2- 172.21.15.99:0/3603165528 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c34100e00 0x7f1c341021e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1c2400ea20 tx=0x7f1c2400eee0 comp rx=0 tx=0).stop 2024-01-31T05:09:00.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.684+0000 7f1c3a15a640 1 -- 172.21.15.99:0/3603165528 shutdown_connections 2024-01-31T05:09:00.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.684+0000 7f1c3a15a640 1 --2- 172.21.15.99:0/3603165528 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f1c1c0a12e0 0x7f1c1c0a37a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:00.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.684+0000 7f1c3a15a640 1 --2- 172.21.15.99:0/3603165528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c341017c0 0x7f1c34102720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:00.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.684+0000 7f1c3a15a640 1 --2- 172.21.15.99:0/3603165528 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c34100e00 0x7f1c341021e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:00.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.684+0000 7f1c3a15a640 1 --2- 172.21.15.99:0/3603165528 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c340ffc10 0x7f1c34103ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:00.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.684+0000 7f1c3a15a640 1 -- 172.21.15.99:0/3603165528 >> 172.21.15.99:0/3603165528 conn(0x7f1c340fb180 msgr2=0x7f1c34067f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:00.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.684+0000 7f1c3a15a640 1 -- 172.21.15.99:0/3603165528 shutdown_connections 2024-01-31T05:09:00.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:00.685+0000 7f1c3a15a640 1 -- 172.21.15.99:0/3603165528 wait complete. 2024-01-31T05:09:00.693 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:00 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:00.693 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:00 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:00.693 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:00 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:00.693 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:00 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-31T05:09:00.693 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:00 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-31T05:09:00.694 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:00 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:09:00.694 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:00 smithi099 ceph-mon[31615]: Deploying daemon mds.c on smithi181 2024-01-31T05:09:00.694 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:00 smithi099 ceph-mon[31615]: mds.? [v2:172.21.15.181:6834/1038715471,v1:172.21.15.181:6835/1038715471] up:boot 2024-01-31T05:09:00.694 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:00 smithi099 ceph-mon[31615]: fsmap 6 up:standby 2024-01-31T05:09:00.694 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:00 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-01-31T05:09:00.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:00 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:00.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:00 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:00.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:00 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:00.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:00 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-31T05:09:00.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:00 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-31T05:09:00.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:00 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:09:00.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:00 smithi181 ceph-mon[36434]: Deploying daemon mds.c on smithi181 2024-01-31T05:09:00.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:00 smithi181 ceph-mon[36434]: mds.? [v2:172.21.15.181:6834/1038715471,v1:172.21.15.181:6835/1038715471] up:boot 2024-01-31T05:09:00.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:00 smithi181 ceph-mon[36434]: fsmap 6 up:standby 2024-01-31T05:09:00.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:00 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-01-31T05:09:00.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:00 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:00.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:00 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:00.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:00 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:00.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:00 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-31T05:09:00.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:00 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-31T05:09:00.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:00 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:09:00.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:00 smithi179 ceph-mon[35652]: Deploying daemon mds.c on smithi181 2024-01-31T05:09:00.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:00 smithi179 ceph-mon[35652]: mds.? [v2:172.21.15.181:6834/1038715471,v1:172.21.15.181:6835/1038715471] up:boot 2024-01-31T05:09:00.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:00 smithi179 ceph-mon[35652]: fsmap 6 up:standby 2024-01-31T05:09:00.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:00 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-01-31T05:09:01.801 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:01 smithi181 ceph-mon[36434]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:09:01.801 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:01 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/3603165528' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:09:01.802 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:09:01 smithi181 systemd[1]: Starting Ceph mds.c for 9288ff44-bff5-11ee-95b3-87774f69a715... 2024-01-31T05:09:01.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:01 smithi099 ceph-mon[31615]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:09:01.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:01 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/3603165528' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:09:01.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:01 smithi179 ceph-mon[35652]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:09:01.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:01 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/3603165528' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:09:02.054 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:09:01 smithi181 podman[68145]: 2024-01-31 05:09:01.70539185 +0000 UTC m=+0.018560514 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-31T05:09:02.054 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:09:01 smithi181 podman[68145]: 2024-01-31 05:09:01.802360252 +0000 UTC m=+0.115528936 container create f7610ed57c6dd9de3de9dc683a27bf1a4ff8528c90a6b6c559ddfd69ef5c62f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c, io.buildah.version=1.31.3, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.build-date=20240123, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-01-31T05:09:02.054 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:09:02 smithi181 podman[68145]: 2024-01-31 05:09:02.05502244 +0000 UTC m=+0.368191087 container init f7610ed57c6dd9de3de9dc683a27bf1a4ff8528c90a6b6c559ddfd69ef5c62f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240125.044502-661946e, io.buildah.version=1.31.3, ceph=True, GIT_CLEAN=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240123, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-01-31T05:09:02.321 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:09:02 smithi181 podman[68145]: 2024-01-31 05:09:02.057794416 +0000 UTC m=+0.370963053 container start f7610ed57c6dd9de3de9dc683a27bf1a4ff8528c90a6b6c559ddfd69ef5c62f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_CLEAN=True, io.buildah.version=1.31.3, org.label-schema.build-date=20240123, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183) 2024-01-31T05:09:02.321 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:09:02 smithi181 ceph-mds[68164]: -- 172.21.15.181:0/2289456152 <== mon.1 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e84fbe7520 con 0x55e84fbbd000 2024-01-31T05:09:02.321 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:09:02 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: starting mds.c at 2024-01-31T05:09:02.321 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:09:02 smithi181 bash[68145]: f7610ed57c6dd9de3de9dc683a27bf1a4ff8528c90a6b6c559ddfd69ef5c62f6 2024-01-31T05:09:02.321 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:09:02 smithi181 systemd[1]: Started Ceph mds.c for 9288ff44-bff5-11ee-95b3-87774f69a715. 2024-01-31T05:09:02.695 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T05:09:02.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:02.809+0000 7f64cefae640 1 -- 172.21.15.99:0/4288786415 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f64c8100f50 msgr2=0x7f64c81077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:02.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:02.809+0000 7f64cefae640 1 --2- 172.21.15.99:0/4288786415 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f64c8100f50 0x7f64c81077e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f64c0009ca0 tx=0x7f64c002c0f0 comp rx=0 tx=0).stop 2024-01-31T05:09:02.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:02.809+0000 7f64cefae640 1 -- 172.21.15.99:0/4288786415 shutdown_connections 2024-01-31T05:09:02.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:02.809+0000 7f64cefae640 1 --2- 172.21.15.99:0/4288786415 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f64c8100f50 0x7f64c81077e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:02.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:02.809+0000 7f64cefae640 1 --2- 172.21.15.99:0/4288786415 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64c8100590 0x7f64c8100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:02.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:02.809+0000 7f64cefae640 1 --2- 172.21.15.99:0/4288786415 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f64c80ff3a0 0x7f64c80ff7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:02.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:02.809+0000 7f64cefae640 1 -- 172.21.15.99:0/4288786415 >> 172.21.15.99:0/4288786415 conn(0x7f64c80fa910 msgr2=0x7f64c80fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:02.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:02.809+0000 7f64cefae640 1 -- 172.21.15.99:0/4288786415 shutdown_connections 2024-01-31T05:09:02.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:02.809+0000 7f64cefae640 1 -- 172.21.15.99:0/4288786415 wait complete. 2024-01-31T05:09:02.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:02.810+0000 7f64cefae640 1 Processor -- start 2024-01-31T05:09:02.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:02.810+0000 7f64cefae640 1 -- start start 2024-01-31T05:09:02.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:02.810+0000 7f64cefae640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f64c80ff3a0 0x7f64c8195c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:02.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:02.810+0000 7f64cefae640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64c8100590 0x7f64c8196170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:02.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:02.810+0000 7f64cefae640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f64c8100f50 0x7f64c819d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:02.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:02.810+0000 7f64cefae640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c819d6d0 con 0x7f64c8100f50 2024-01-31T05:09:02.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:02.810+0000 7f64cefae640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c819d840 con 0x7f64c8100590 2024-01-31T05:09:02.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:02.810+0000 7f64cefae640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c819da00 con 0x7f64c80ff3a0 2024-01-31T05:09:02.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:02.810+0000 7f64cd54b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f64c8100f50 0x7f64c819d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:02.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:02.810+0000 7f64cd54b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f64c8100f50 0x7f64c819d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52548/0 (socket says 172.21.15.99:52548) 2024-01-31T05:09:02.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:02.810+0000 7f64cd54b640 1 -- 172.21.15.99:0/4052116767 learned_addr learned my addr 172.21.15.99:0/4052116767 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:09:02.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:02.810+0000 7f64ccd4a640 1 --2- 172.21.15.99:0/4052116767 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f64c80ff3a0 0x7f64c8195c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:02.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:02.810+0000 7f64c7fff640 1 --2- 172.21.15.99:0/4052116767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64c8100590 0x7f64c8196170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:02.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:02.810+0000 7f64cd54b640 1 -- 172.21.15.99:0/4052116767 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f64c80ff3a0 msgr2=0x7f64c8195c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:02.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:02.810+0000 7f64cd54b640 1 --2- 172.21.15.99:0/4052116767 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f64c80ff3a0 0x7f64c8195c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:02.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:02.810+0000 7f64cd54b640 1 -- 172.21.15.99:0/4052116767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64c8100590 msgr2=0x7f64c8196170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:02.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:02.810+0000 7f64cd54b640 1 --2- 172.21.15.99:0/4052116767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64c8100590 0x7f64c8196170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:02.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:02.810+0000 7f64cd54b640 1 -- 172.21.15.99:0/4052116767 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c0009900 con 0x7f64c8100f50 2024-01-31T05:09:02.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:02.810+0000 7f64cd54b640 1 --2- 172.21.15.99:0/4052116767 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f64c8100f50 0x7f64c819d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f64c002c630 tx=0x7f64c00329c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:02.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:02.811+0000 7f64c5ffb640 1 -- 172.21.15.99:0/4052116767 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c0034e80 con 0x7f64c8100f50 2024-01-31T05:09:02.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:02.811+0000 7f64c5ffb640 1 -- 172.21.15.99:0/4052116767 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f64c0032e90 con 0x7f64c8100f50 2024-01-31T05:09:02.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:02.811+0000 7f64cefae640 1 -- 172.21.15.99:0/4052116767 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64c819dc80 con 0x7f64c8100f50 2024-01-31T05:09:02.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:02.811+0000 7f64c5ffb640 1 -- 172.21.15.99:0/4052116767 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c00047a0 con 0x7f64c8100f50 2024-01-31T05:09:02.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:02.811+0000 7f64cefae640 1 -- 172.21.15.99:0/4052116767 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64c819e130 con 0x7f64c8100f50 2024-01-31T05:09:02.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:02.812+0000 7f64cefae640 1 -- 172.21.15.99:0/4052116767 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64c8106e80 con 0x7f64c8100f50 2024-01-31T05:09:02.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:02.813+0000 7f64c5ffb640 1 -- 172.21.15.99:0/4052116767 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f64c003b040 con 0x7f64c8100f50 2024-01-31T05:09:02.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:02.813+0000 7f64c5ffb640 1 --2- 172.21.15.99:0/4052116767 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f64b80a12e0 0x7f64b80a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:02.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:02.813+0000 7f64c5ffb640 1 -- 172.21.15.99:0/4052116767 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f64c00eed20 con 0x7f64c8100f50 2024-01-31T05:09:02.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:02.813+0000 7f64ccd4a640 1 --2- 172.21.15.99:0/4052116767 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f64b80a12e0 0x7f64b80a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:02.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:02.814+0000 7f64ccd4a640 1 --2- 172.21.15.99:0/4052116767 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f64b80a12e0 0x7f64b80a37a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f64bc005fd0 tx=0x7f64bc00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:02.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:02.818+0000 7f64c5ffb640 1 -- 172.21.15.99:0/4052116767 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f64c00b8640 con 0x7f64c8100f50 2024-01-31T05:09:03.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:03.028+0000 7f64cefae640 1 -- 172.21.15.99:0/4052116767 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f64c810af20 con 0x7f64c8100f50 2024-01-31T05:09:03.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:03.028+0000 7f64c5ffb640 1 -- 172.21.15.99:0/4052116767 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6077 (secure 0 0 0) 0x7f64c00bbc60 con 0x7f64c8100f50 2024-01-31T05:09:03.029 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:09:03.029 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/1488539026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1488539026},{"type":"v1","addr":"172.21.15.99:6835","nonce":1488539026}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/1649552652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1649552652},{"type":"v1","addr":"172.21.15.99:6837","nonce":1649552652}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24376,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/427201290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":427201290},{"type":"v1","addr":"172.21.15.181:6833","nonce":427201290}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/472161020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":472161020},{"type":"v1","addr":"172.21.15.179:6833","nonce":472161020}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24427,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/1038715471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1038715471},{"type":"v1","addr":"172.21.15.181:6835","nonce":1038715471}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/966976592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":966976592},{"type":"v1","addr":"172.21.15.179:6835","nonce":966976592}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24439,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/3875964154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3875964154},{"type":"v1","addr":"172.21.15.181:6837","nonce":3875964154}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[]} 2024-01-31T05:09:03.029 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 8 2024-01-31T05:09:03.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:03.030+0000 7f64cefae640 1 -- 172.21.15.99:0/4052116767 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f64b80a12e0 msgr2=0x7f64b80a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:03.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:03.030+0000 7f64cefae640 1 --2- 172.21.15.99:0/4052116767 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f64b80a12e0 0x7f64b80a37a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f64bc005fd0 tx=0x7f64bc00b390 comp rx=0 tx=0).stop 2024-01-31T05:09:03.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:03.030+0000 7f64cefae640 1 -- 172.21.15.99:0/4052116767 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f64c8100f50 msgr2=0x7f64c819d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:03.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:03.030+0000 7f64cefae640 1 --2- 172.21.15.99:0/4052116767 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f64c8100f50 0x7f64c819d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f64c002c630 tx=0x7f64c00329c0 comp rx=0 tx=0).stop 2024-01-31T05:09:03.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:03.030+0000 7f64cefae640 1 -- 172.21.15.99:0/4052116767 shutdown_connections 2024-01-31T05:09:03.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:03.030+0000 7f64cefae640 1 --2- 172.21.15.99:0/4052116767 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f64b80a12e0 0x7f64b80a37a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:03.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:03.030+0000 7f64cefae640 1 --2- 172.21.15.99:0/4052116767 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f64c8100f50 0x7f64c819d190 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:03.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:03.030+0000 7f64cefae640 1 --2- 172.21.15.99:0/4052116767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64c8100590 0x7f64c8196170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:03.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:03.030+0000 7f64cefae640 1 --2- 172.21.15.99:0/4052116767 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f64c80ff3a0 0x7f64c8195c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:03.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:03.030+0000 7f64cefae640 1 -- 172.21.15.99:0/4052116767 >> 172.21.15.99:0/4052116767 conn(0x7f64c80fa910 msgr2=0x7f64c8104050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:03.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:03.030+0000 7f64cefae640 1 -- 172.21.15.99:0/4052116767 shutdown_connections 2024-01-31T05:09:03.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:03.030+0000 7f64cefae640 1 -- 172.21.15.99:0/4052116767 wait complete. 2024-01-31T05:09:03.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:03 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:03.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:03 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:03.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:03 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:03.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:03 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-31T05:09:03.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:03 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-31T05:09:03.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:03 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:09:03.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:03 smithi099 ceph-mon[31615]: Deploying daemon mds.h on smithi179 2024-01-31T05:09:03.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:03 smithi099 ceph-mon[31615]: mds.? [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] up:boot 2024-01-31T05:09:03.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:03 smithi099 ceph-mon[31615]: fsmap 7 up:standby 2024-01-31T05:09:03.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:03 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-01-31T05:09:03.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:03 smithi099 ceph-mon[31615]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:09:03.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:03 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/4052116767' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:09:03.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:03 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:03.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:03 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:03.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:03 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:03.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:03 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-31T05:09:03.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:03 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-31T05:09:03.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:03 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:09:03.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:03 smithi181 ceph-mon[36434]: Deploying daemon mds.h on smithi179 2024-01-31T05:09:03.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:03 smithi181 ceph-mon[36434]: mds.? [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] up:boot 2024-01-31T05:09:03.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:03 smithi181 ceph-mon[36434]: fsmap 7 up:standby 2024-01-31T05:09:03.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:03 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-01-31T05:09:03.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:03 smithi181 ceph-mon[36434]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:09:03.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:03 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/4052116767' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:09:03.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:03 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:03.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:03 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:03.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:03 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:03.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:03 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-31T05:09:03.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:03 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-31T05:09:03.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:03 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:09:03.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:03 smithi179 ceph-mon[35652]: Deploying daemon mds.h on smithi179 2024-01-31T05:09:03.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:03 smithi179 ceph-mon[35652]: mds.? [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] up:boot 2024-01-31T05:09:03.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:03 smithi179 ceph-mon[35652]: fsmap 7 up:standby 2024-01-31T05:09:03.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:03 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-01-31T05:09:03.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:03 smithi179 ceph-mon[35652]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:09:03.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:03 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/4052116767' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:09:04.609 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:09:04 smithi179 systemd[1]: Starting Ceph mds.h for 9288ff44-bff5-11ee-95b3-87774f69a715... 2024-01-31T05:09:04.883 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:09:04 smithi179 podman[66124]: 2024-01-31 05:09:04.610706789 +0000 UTC m=+0.109285927 container create c01094228e2ecd33c593f5ff44881522a233ac88c842addd9674e70eff06ad10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240123, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.31.3) 2024-01-31T05:09:04.883 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:09:04 smithi179 podman[66124]: 2024-01-31 05:09:04.519296134 +0000 UTC m=+0.017875290 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-31T05:09:04.883 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:09:04 smithi179 podman[66124]: 2024-01-31 05:09:04.830570611 +0000 UTC m=+0.329149756 container init c01094228e2ecd33c593f5ff44881522a233ac88c842addd9674e70eff06ad10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.31.3, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240123, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240125.044502-661946e, maintainer=Guillaume Abrioux , ceph=True) 2024-01-31T05:09:04.883 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:09:04 smithi179 podman[66124]: 2024-01-31 05:09:04.833114472 +0000 UTC m=+0.331693629 container start c01094228e2ecd33c593f5ff44881522a233ac88c842addd9674e70eff06ad10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h, GIT_BRANCH=HEAD, org.label-schema.build-date=20240123, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.31.3, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240125.044502-661946e) 2024-01-31T05:09:04.883 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:09:04 smithi179 ceph-mds[66144]: -- 172.21.15.179:0/1169691889 <== mon.2 v2:172.21.15.179:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55dd9c0ab520 con 0x55dd9c081000 2024-01-31T05:09:04.883 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:09:04 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: starting mds.h at 2024-01-31T05:09:05.042 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T05:09:05.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.155+0000 7f36ca51f640 1 -- 172.21.15.99:0/818389916 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36c41017c0 msgr2=0x7f36c4108050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:05.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.155+0000 7f36ca51f640 1 --2- 172.21.15.99:0/818389916 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36c41017c0 0x7f36c4108050 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f36bc009ca0 tx=0x7f36bc02c0f0 comp rx=0 tx=0).stop 2024-01-31T05:09:05.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.155+0000 7f36ca51f640 1 -- 172.21.15.99:0/818389916 shutdown_connections 2024-01-31T05:09:05.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.155+0000 7f36ca51f640 1 --2- 172.21.15.99:0/818389916 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36c41017c0 0x7f36c4108050 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:05.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.155+0000 7f36ca51f640 1 --2- 172.21.15.99:0/818389916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36c4100e00 0x7f36c4101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:05.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.155+0000 7f36ca51f640 1 --2- 172.21.15.99:0/818389916 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36c40ffc10 0x7f36c4100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:05.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.155+0000 7f36ca51f640 1 -- 172.21.15.99:0/818389916 >> 172.21.15.99:0/818389916 conn(0x7f36c40fb180 msgr2=0x7f36c40fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:05.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.155+0000 7f36ca51f640 1 -- 172.21.15.99:0/818389916 shutdown_connections 2024-01-31T05:09:05.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.155+0000 7f36ca51f640 1 -- 172.21.15.99:0/818389916 wait complete. 2024-01-31T05:09:05.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.155+0000 7f36ca51f640 1 Processor -- start 2024-01-31T05:09:05.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.155+0000 7f36ca51f640 1 -- start start 2024-01-31T05:09:05.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.156+0000 7f36ca51f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36c40ffc10 0x7f36c40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:05.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.156+0000 7f36ca51f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36c4100e00 0x7f36c419b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:05.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.156+0000 7f36ca51f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36c41017c0 0x7f36c419dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:05.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.156+0000 7f36ca51f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c419e7d0 con 0x7f36c40ffc10 2024-01-31T05:09:05.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.156+0000 7f36ca51f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c419e940 con 0x7f36c4100e00 2024-01-31T05:09:05.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.156+0000 7f36ca51f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c419eb00 con 0x7f36c41017c0 2024-01-31T05:09:05.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.156+0000 7f36c3fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36c40ffc10 0x7f36c40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:05.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.156+0000 7f36c3fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36c40ffc10 0x7f36c40689c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52576/0 (socket says 172.21.15.99:52576) 2024-01-31T05:09:05.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.156+0000 7f36c3fff640 1 -- 172.21.15.99:0/2968508669 learned_addr learned my addr 172.21.15.99:0/2968508669 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:09:05.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.156+0000 7f36c8abc640 1 --2- 172.21.15.99:0/2968508669 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36c41017c0 0x7f36c419dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:05.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.156+0000 7f36c37fe640 1 --2- 172.21.15.99:0/2968508669 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36c4100e00 0x7f36c419b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:05.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.156+0000 7f36c3fff640 1 -- 172.21.15.99:0/2968508669 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36c41017c0 msgr2=0x7f36c419dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:05.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.156+0000 7f36c3fff640 1 --2- 172.21.15.99:0/2968508669 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36c41017c0 0x7f36c419dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:05.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.156+0000 7f36c3fff640 1 -- 172.21.15.99:0/2968508669 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36c4100e00 msgr2=0x7f36c419b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:05.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.156+0000 7f36c3fff640 1 --2- 172.21.15.99:0/2968508669 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36c4100e00 0x7f36c419b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:05.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.156+0000 7f36c3fff640 1 -- 172.21.15.99:0/2968508669 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36bc009900 con 0x7f36c40ffc10 2024-01-31T05:09:05.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.156+0000 7f36c8abc640 1 --2- 172.21.15.99:0/2968508669 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36c41017c0 0x7f36c419dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:09:05.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.156+0000 7f36c37fe640 1 --2- 172.21.15.99:0/2968508669 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36c4100e00 0x7f36c419b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:09:05.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.156+0000 7f36c3fff640 1 --2- 172.21.15.99:0/2968508669 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36c40ffc10 0x7f36c40689c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f36b400d770 tx=0x7f36b400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:05.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.156+0000 7f36c17fa640 1 -- 172.21.15.99:0/2968508669 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b4009c30 con 0x7f36c40ffc10 2024-01-31T05:09:05.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.156+0000 7f36c17fa640 1 -- 172.21.15.99:0/2968508669 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f36b400de80 con 0x7f36c40ffc10 2024-01-31T05:09:05.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.156+0000 7f36ca51f640 1 -- 172.21.15.99:0/2968508669 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36c419ed80 con 0x7f36c40ffc10 2024-01-31T05:09:05.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.156+0000 7f36c17fa640 1 -- 172.21.15.99:0/2968508669 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b4003e20 con 0x7f36c40ffc10 2024-01-31T05:09:05.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.157+0000 7f36ca51f640 1 -- 172.21.15.99:0/2968508669 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36c419f1d0 con 0x7f36c40ffc10 2024-01-31T05:09:05.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.157+0000 7f36ca51f640 1 -- 172.21.15.99:0/2968508669 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36c4106f30 con 0x7f36c40ffc10 2024-01-31T05:09:05.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.158+0000 7f36c17fa640 1 -- 172.21.15.99:0/2968508669 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f36b4003f80 con 0x7f36c40ffc10 2024-01-31T05:09:05.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.159+0000 7f36c17fa640 1 --2- 172.21.15.99:0/2968508669 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f36ac0a12e0 0x7f36ac0a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:05.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.159+0000 7f36c37fe640 1 --2- 172.21.15.99:0/2968508669 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f36ac0a12e0 0x7f36ac0a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:05.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.159+0000 7f36c17fa640 1 -- 172.21.15.99:0/2968508669 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f36b40cc170 con 0x7f36c40ffc10 2024-01-31T05:09:05.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.160+0000 7f36c37fe640 1 --2- 172.21.15.99:0/2968508669 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f36ac0a12e0 0x7f36ac0a37a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f36c4068730 tx=0x7f36b8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:05.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.164+0000 7f36c17fa640 1 -- 172.21.15.99:0/2968508669 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f36b4095a90 con 0x7f36c40ffc10 2024-01-31T05:09:05.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.370+0000 7f36ca51f640 1 -- 172.21.15.99:0/2968508669 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36c410b6e0 con 0x7f36c40ffc10 2024-01-31T05:09:05.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.370+0000 7f36c17fa640 1 -- 172.21.15.99:0/2968508669 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6077 (secure 0 0 0) 0x7f36b40990b0 con 0x7f36c40ffc10 2024-01-31T05:09:05.371 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:09:05.371 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/1488539026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1488539026},{"type":"v1","addr":"172.21.15.99:6835","nonce":1488539026}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/1649552652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1649552652},{"type":"v1","addr":"172.21.15.99:6837","nonce":1649552652}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24376,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/427201290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":427201290},{"type":"v1","addr":"172.21.15.181:6833","nonce":427201290}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/472161020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":472161020},{"type":"v1","addr":"172.21.15.179:6833","nonce":472161020}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24427,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/1038715471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1038715471},{"type":"v1","addr":"172.21.15.181:6835","nonce":1038715471}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/966976592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":966976592},{"type":"v1","addr":"172.21.15.179:6835","nonce":966976592}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24439,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/3875964154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3875964154},{"type":"v1","addr":"172.21.15.181:6837","nonce":3875964154}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[]} 2024-01-31T05:09:05.371 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 8 2024-01-31T05:09:05.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.372+0000 7f36ca51f640 1 -- 172.21.15.99:0/2968508669 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f36ac0a12e0 msgr2=0x7f36ac0a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:05.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.372+0000 7f36ca51f640 1 --2- 172.21.15.99:0/2968508669 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f36ac0a12e0 0x7f36ac0a37a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f36c4068730 tx=0x7f36b8005f90 comp rx=0 tx=0).stop 2024-01-31T05:09:05.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.372+0000 7f36ca51f640 1 -- 172.21.15.99:0/2968508669 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36c40ffc10 msgr2=0x7f36c40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:05.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.372+0000 7f36ca51f640 1 --2- 172.21.15.99:0/2968508669 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36c40ffc10 0x7f36c40689c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f36b400d770 tx=0x7f36b400dc30 comp rx=0 tx=0).stop 2024-01-31T05:09:05.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.372+0000 7f36ca51f640 1 -- 172.21.15.99:0/2968508669 shutdown_connections 2024-01-31T05:09:05.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.372+0000 7f36ca51f640 1 --2- 172.21.15.99:0/2968508669 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f36ac0a12e0 0x7f36ac0a37a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:05.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.372+0000 7f36ca51f640 1 --2- 172.21.15.99:0/2968508669 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36c41017c0 0x7f36c419dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:05.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.372+0000 7f36ca51f640 1 --2- 172.21.15.99:0/2968508669 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36c4100e00 0x7f36c419b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:05.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.372+0000 7f36ca51f640 1 --2- 172.21.15.99:0/2968508669 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36c40ffc10 0x7f36c40689c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:05.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.372+0000 7f36ca51f640 1 -- 172.21.15.99:0/2968508669 >> 172.21.15.99:0/2968508669 conn(0x7f36c40fb180 msgr2=0x7f36c4104100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:05.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.372+0000 7f36ca51f640 1 -- 172.21.15.99:0/2968508669 shutdown_connections 2024-01-31T05:09:05.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:05.372+0000 7f36ca51f640 1 -- 172.21.15.99:0/2968508669 wait complete. 2024-01-31T05:09:05.382 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:09:04 smithi179 bash[66124]: c01094228e2ecd33c593f5ff44881522a233ac88c842addd9674e70eff06ad10 2024-01-31T05:09:05.382 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:09:04 smithi179 systemd[1]: Started Ceph mds.h for 9288ff44-bff5-11ee-95b3-87774f69a715. 2024-01-31T05:09:05.957 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:05 smithi181 ceph-mon[36434]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:09:05.957 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:05 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:05.957 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:05 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:05.957 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:05 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:05.957 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:05 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-31T05:09:05.957 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:05 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-31T05:09:05.957 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:05 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:09:05.957 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:05 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/2968508669' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:09:06.005 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:05 smithi179 ceph-mon[35652]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:09:06.005 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:05 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:06.005 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:05 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:06.005 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:05 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:06.005 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:05 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-31T05:09:06.005 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:05 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-31T05:09:06.005 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:05 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:09:06.005 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:05 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/2968508669' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:09:06.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:05 smithi099 ceph-mon[31615]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:09:06.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:05 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:06.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:05 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:06.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:05 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:06.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:05 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-31T05:09:06.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:05 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-31T05:09:06.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:05 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:09:06.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:05 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/2968508669' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:09:06.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:06 smithi181 ceph-mon[36434]: Deploying daemon mds.i on smithi181 2024-01-31T05:09:06.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:06 smithi181 ceph-mon[36434]: mds.? [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] up:boot 2024-01-31T05:09:06.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:06 smithi181 ceph-mon[36434]: fsmap 8 up:standby 2024-01-31T05:09:06.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:06 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-01-31T05:09:07.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:06 smithi099 ceph-mon[31615]: Deploying daemon mds.i on smithi181 2024-01-31T05:09:07.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:06 smithi099 ceph-mon[31615]: mds.? [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] up:boot 2024-01-31T05:09:07.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:06 smithi099 ceph-mon[31615]: fsmap 8 up:standby 2024-01-31T05:09:07.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:06 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-01-31T05:09:07.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:06 smithi179 ceph-mon[35652]: Deploying daemon mds.i on smithi181 2024-01-31T05:09:07.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:06 smithi179 ceph-mon[35652]: mds.? [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] up:boot 2024-01-31T05:09:07.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:06 smithi179 ceph-mon[35652]: fsmap 8 up:standby 2024-01-31T05:09:07.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:06 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-01-31T05:09:07.238 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:09:07 smithi181 systemd[1]: Starting Ceph mds.i for 9288ff44-bff5-11ee-95b3-87774f69a715... 2024-01-31T05:09:07.384 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T05:09:07.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.497+0000 7f2b64bd0640 1 -- 172.21.15.99:0/969359625 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b60104170 msgr2=0x7f2b60106560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:07.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.497+0000 7f2b64bd0640 1 --2- 172.21.15.99:0/969359625 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b60104170 0x7f2b60106560 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2b48009900 tx=0x7f2b4802bc30 comp rx=0 tx=0).stop 2024-01-31T05:09:07.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.497+0000 7f2b64bd0640 1 -- 172.21.15.99:0/969359625 shutdown_connections 2024-01-31T05:09:07.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.497+0000 7f2b64bd0640 1 --2- 172.21.15.99:0/969359625 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b60106aa0 0x7f2b60108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:07.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.497+0000 7f2b64bd0640 1 --2- 172.21.15.99:0/969359625 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b60104170 0x7f2b60106560 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:07.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.497+0000 7f2b64bd0640 1 --2- 172.21.15.99:0/969359625 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b60101840 0x7f2b60103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:07.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.497+0000 7f2b64bd0640 1 -- 172.21.15.99:0/969359625 >> 172.21.15.99:0/969359625 conn(0x7f2b600fb1d0 msgr2=0x7f2b600fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:07.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.497+0000 7f2b64bd0640 1 -- 172.21.15.99:0/969359625 shutdown_connections 2024-01-31T05:09:07.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.497+0000 7f2b64bd0640 1 -- 172.21.15.99:0/969359625 wait complete. 2024-01-31T05:09:07.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.498+0000 7f2b64bd0640 1 Processor -- start 2024-01-31T05:09:07.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.498+0000 7f2b64bd0640 1 -- start start 2024-01-31T05:09:07.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.498+0000 7f2b64bd0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b60101840 0x7f2b601011b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:07.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.498+0000 7f2b64bd0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b60104170 0x7f2b600ff7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:07.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.498+0000 7f2b64bd0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b60106aa0 0x7f2b600ffd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:07.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.498+0000 7f2b64bd0640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b60100490 con 0x7f2b60104170 2024-01-31T05:09:07.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.498+0000 7f2b64bd0640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b60100600 con 0x7f2b60101840 2024-01-31T05:09:07.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.498+0000 7f2b64bd0640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b601a0d70 con 0x7f2b60106aa0 2024-01-31T05:09:07.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.498+0000 7f2b57fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b60104170 0x7f2b600ff7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:07.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.498+0000 7f2b57fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b60104170 0x7f2b600ff7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46008/0 (socket says 172.21.15.99:46008) 2024-01-31T05:09:07.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.498+0000 7f2b57fff640 1 -- 172.21.15.99:0/557853852 learned_addr learned my addr 172.21.15.99:0/557853852 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:09:07.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.498+0000 7f2b5e59c640 1 --2- 172.21.15.99:0/557853852 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b60101840 0x7f2b601011b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:07.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.498+0000 7f2b5ed9d640 1 --2- 172.21.15.99:0/557853852 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b60106aa0 0x7f2b600ffd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:07.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.498+0000 7f2b57fff640 1 -- 172.21.15.99:0/557853852 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b60106aa0 msgr2=0x7f2b600ffd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:07.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.498+0000 7f2b57fff640 1 --2- 172.21.15.99:0/557853852 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b60106aa0 0x7f2b600ffd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:07.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.498+0000 7f2b57fff640 1 -- 172.21.15.99:0/557853852 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b60101840 msgr2=0x7f2b601011b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:07.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.498+0000 7f2b57fff640 1 --2- 172.21.15.99:0/557853852 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b60101840 0x7f2b601011b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:07.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.498+0000 7f2b57fff640 1 -- 172.21.15.99:0/557853852 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b48009560 con 0x7f2b60104170 2024-01-31T05:09:07.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.499+0000 7f2b57fff640 1 --2- 172.21.15.99:0/557853852 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b60104170 0x7f2b600ff7f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2b48036040 tx=0x7f2b48004f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:07.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.499+0000 7f2b577fe640 1 -- 172.21.15.99:0/557853852 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b480043d0 con 0x7f2b60104170 2024-01-31T05:09:07.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.499+0000 7f2b577fe640 1 -- 172.21.15.99:0/557853852 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2b480054c0 con 0x7f2b60104170 2024-01-31T05:09:07.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.499+0000 7f2b64bd0640 1 -- 172.21.15.99:0/557853852 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b601a0fc0 con 0x7f2b60104170 2024-01-31T05:09:07.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.499+0000 7f2b577fe640 1 -- 172.21.15.99:0/557853852 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4803e450 con 0x7f2b60104170 2024-01-31T05:09:07.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.499+0000 7f2b64bd0640 1 -- 172.21.15.99:0/557853852 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b601a1440 con 0x7f2b60104170 2024-01-31T05:09:07.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.500+0000 7f2b64bd0640 1 -- 172.21.15.99:0/557853852 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b600fccc0 con 0x7f2b60104170 2024-01-31T05:09:07.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.501+0000 7f2b577fe640 1 -- 172.21.15.99:0/557853852 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f2b480035f0 con 0x7f2b60104170 2024-01-31T05:09:07.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.502+0000 7f2b577fe640 1 --2- 172.21.15.99:0/557853852 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2b4c0a12e0 0x7f2b4c0a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:07.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.502+0000 7f2b5e59c640 1 --2- 172.21.15.99:0/557853852 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2b4c0a12e0 0x7f2b4c0a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:07.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.502+0000 7f2b577fe640 1 -- 172.21.15.99:0/557853852 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f2b480ee970 con 0x7f2b60104170 2024-01-31T05:09:07.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.502+0000 7f2b5e59c640 1 --2- 172.21.15.99:0/557853852 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2b4c0a12e0 0x7f2b4c0a37a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2b50005fd0 tx=0x7f2b5000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:07.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.506+0000 7f2b577fe640 1 -- 172.21.15.99:0/557853852 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f2b480b8290 con 0x7f2b60104170 2024-01-31T05:09:07.514 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:09:07 smithi181 podman[68464]: 2024-01-31 05:09:07.141792089 +0000 UTC m=+0.018056590 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-31T05:09:07.514 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:09:07 smithi181 podman[68464]: 2024-01-31 05:09:07.246569045 +0000 UTC m=+0.122833534 container create 2ad233c1f567fbeb7524a54ea748c8a273fcc7a5b69e106b43fbc871d7ab73ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240123, CEPH_POINT_RELEASE=, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, RELEASE=wip-vshankar-testing-20240125.044502-661946e, io.buildah.version=1.31.3, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True) 2024-01-31T05:09:07.514 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:09:07 smithi181 podman[68464]: 2024-01-31 05:09:07.440862081 +0000 UTC m=+0.317126573 container init 2ad233c1f567fbeb7524a54ea748c8a273fcc7a5b69e106b43fbc871d7ab73ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.31.3, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.build-date=20240123, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, maintainer=Guillaume Abrioux ) 2024-01-31T05:09:07.514 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:09:07 smithi181 podman[68464]: 2024-01-31 05:09:07.443723158 +0000 UTC m=+0.319987644 container start 2ad233c1f567fbeb7524a54ea748c8a273fcc7a5b69e106b43fbc871d7ab73ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240125.044502-661946e, io.buildah.version=1.31.3, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240123, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS) 2024-01-31T05:09:07.514 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:09:07 smithi181 ceph-mds[68484]: -- 172.21.15.181:0/1921185192 <== mon.1 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56120d26d520 con 0x56120d242800 2024-01-31T05:09:07.514 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:09:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: starting mds.i at 2024-01-31T05:09:07.514 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:09:07 smithi181 bash[68464]: 2ad233c1f567fbeb7524a54ea748c8a273fcc7a5b69e106b43fbc871d7ab73ea 2024-01-31T05:09:07.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.723+0000 7f2b64bd0640 1 -- 172.21.15.99:0/557853852 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b6010c7d0 con 0x7f2b60104170 2024-01-31T05:09:07.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.723+0000 7f2b577fe640 1 -- 172.21.15.99:0/557853852 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6868 (secure 0 0 0) 0x7f2b480bb8b0 con 0x7f2b60104170 2024-01-31T05:09:07.724 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:09:07.724 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/1488539026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1488539026},{"type":"v1","addr":"172.21.15.99:6835","nonce":1488539026}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/1649552652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1649552652},{"type":"v1","addr":"172.21.15.99:6837","nonce":1649552652}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24376,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/427201290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":427201290},{"type":"v1","addr":"172.21.15.181:6833","nonce":427201290}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/472161020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":472161020},{"type":"v1","addr":"172.21.15.179:6833","nonce":472161020}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24427,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/1038715471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1038715471},{"type":"v1","addr":"172.21.15.181:6835","nonce":1038715471}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/966976592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":966976592},{"type":"v1","addr":"172.21.15.179:6835","nonce":966976592}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24439,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/3875964154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3875964154},{"type":"v1","addr":"172.21.15.181:6837","nonce":3875964154}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/837402830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":837402830},{"type":"v1","addr":"172.21.15.179:6837","nonce":837402830}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[]} 2024-01-31T05:09:07.724 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 9 2024-01-31T05:09:07.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.725+0000 7f2b64bd0640 1 -- 172.21.15.99:0/557853852 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2b4c0a12e0 msgr2=0x7f2b4c0a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:07.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.725+0000 7f2b64bd0640 1 --2- 172.21.15.99:0/557853852 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2b4c0a12e0 0x7f2b4c0a37a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2b50005fd0 tx=0x7f2b5000b390 comp rx=0 tx=0).stop 2024-01-31T05:09:07.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.725+0000 7f2b64bd0640 1 -- 172.21.15.99:0/557853852 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b60104170 msgr2=0x7f2b600ff7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:07.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.725+0000 7f2b64bd0640 1 --2- 172.21.15.99:0/557853852 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b60104170 0x7f2b600ff7f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2b48036040 tx=0x7f2b48004f40 comp rx=0 tx=0).stop 2024-01-31T05:09:07.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.725+0000 7f2b64bd0640 1 -- 172.21.15.99:0/557853852 shutdown_connections 2024-01-31T05:09:07.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.725+0000 7f2b64bd0640 1 --2- 172.21.15.99:0/557853852 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2b4c0a12e0 0x7f2b4c0a37a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:07.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.725+0000 7f2b64bd0640 1 --2- 172.21.15.99:0/557853852 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b60106aa0 0x7f2b600ffd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:07.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.725+0000 7f2b64bd0640 1 --2- 172.21.15.99:0/557853852 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b60104170 0x7f2b600ff7f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:07.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.725+0000 7f2b64bd0640 1 --2- 172.21.15.99:0/557853852 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b60101840 0x7f2b601011b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:07.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.725+0000 7f2b64bd0640 1 -- 172.21.15.99:0/557853852 >> 172.21.15.99:0/557853852 conn(0x7f2b600fb1d0 msgr2=0x7f2b60102260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:07.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.725+0000 7f2b64bd0640 1 -- 172.21.15.99:0/557853852 shutdown_connections 2024-01-31T05:09:07.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:07.725+0000 7f2b64bd0640 1 -- 172.21.15.99:0/557853852 wait complete. 2024-01-31T05:09:07.735 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:07 smithi099 ceph-mon[31615]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:09:07.736 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:07 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:07.736 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:07 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:07.736 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:07 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:07.736 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:07 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-31T05:09:07.736 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:07 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-31T05:09:07.736 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:07 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:09:07.821 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:09:07 smithi181 systemd[1]: Started Ceph mds.i for 9288ff44-bff5-11ee-95b3-87774f69a715. 2024-01-31T05:09:07.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:07 smithi181 ceph-mon[36434]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:09:07.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:07 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:07.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:07 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:07.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:07 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:07.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:07 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-31T05:09:07.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:07 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-31T05:09:07.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:07 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:09:08.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:07 smithi179 ceph-mon[35652]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:09:08.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:07 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:08.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:07 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:08.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:07 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:08.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:07 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-31T05:09:08.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:07 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-31T05:09:08.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:07 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:09:08.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:08 smithi099 ceph-mon[31615]: Deploying daemon mds.g on smithi099 2024-01-31T05:09:08.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:08 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/557853852' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:09:08.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:08 smithi099 ceph-mon[31615]: mds.? [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] up:boot 2024-01-31T05:09:08.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:08 smithi099 ceph-mon[31615]: fsmap 9 up:standby 2024-01-31T05:09:08.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:08 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-01-31T05:09:09.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:08 smithi181 ceph-mon[36434]: Deploying daemon mds.g on smithi099 2024-01-31T05:09:09.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:08 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/557853852' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:09:09.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:08 smithi181 ceph-mon[36434]: mds.? [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] up:boot 2024-01-31T05:09:09.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:08 smithi181 ceph-mon[36434]: fsmap 9 up:standby 2024-01-31T05:09:09.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:08 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-01-31T05:09:09.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:08 smithi179 ceph-mon[35652]: Deploying daemon mds.g on smithi099 2024-01-31T05:09:09.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:08 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/557853852' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:09:09.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:08 smithi179 ceph-mon[35652]: mds.? [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] up:boot 2024-01-31T05:09:09.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:08 smithi179 ceph-mon[35652]: fsmap 9 up:standby 2024-01-31T05:09:09.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:08 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-01-31T05:09:09.738 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T05:09:09.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:09.863+0000 7f053d8d2640 1 -- 172.21.15.99:0/1271848970 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0538100e00 msgr2=0x7f0538101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:09.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:09.863+0000 7f053d8d2640 1 --2- 172.21.15.99:0/1271848970 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0538100e00 0x7f0538101280 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f052c009900 tx=0x7f052c02bc30 comp rx=0 tx=0).stop 2024-01-31T05:09:09.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:09.863+0000 7f053d8d2640 1 -- 172.21.15.99:0/1271848970 shutdown_connections 2024-01-31T05:09:09.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:09.863+0000 7f053d8d2640 1 --2- 172.21.15.99:0/1271848970 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f05381017c0 0x7f0538108050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:09.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:09.863+0000 7f053d8d2640 1 --2- 172.21.15.99:0/1271848970 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0538100e00 0x7f0538101280 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:09.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:09.863+0000 7f053d8d2640 1 --2- 172.21.15.99:0/1271848970 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05380ffc10 0x7f0538100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:09.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:09.863+0000 7f053d8d2640 1 -- 172.21.15.99:0/1271848970 >> 172.21.15.99:0/1271848970 conn(0x7f05380fb180 msgr2=0x7f05380fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:09.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:09.863+0000 7f053d8d2640 1 -- 172.21.15.99:0/1271848970 shutdown_connections 2024-01-31T05:09:09.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:09.863+0000 7f053d8d2640 1 -- 172.21.15.99:0/1271848970 wait complete. 2024-01-31T05:09:09.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:09.864+0000 7f053d8d2640 1 Processor -- start 2024-01-31T05:09:09.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:09.864+0000 7f053d8d2640 1 -- start start 2024-01-31T05:09:09.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:09.864+0000 7f053d8d2640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f05380ffc10 0x7f05380689e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:09.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:09.864+0000 7f053d8d2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0538100e00 0x7f053819ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:09.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:09.864+0000 7f053d8d2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f05381017c0 0x7f053819e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:09.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:09.864+0000 7f053d8d2640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053819e7f0 con 0x7f05381017c0 2024-01-31T05:09:09.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:09.864+0000 7f053d8d2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053819e960 con 0x7f0538100e00 2024-01-31T05:09:09.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:09.864+0000 7f053d8d2640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053819eb20 con 0x7f05380ffc10 2024-01-31T05:09:09.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:09.864+0000 7f05377fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f05381017c0 0x7f053819e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:09.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:09.864+0000 7f05377fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f05381017c0 0x7f053819e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46030/0 (socket says 172.21.15.99:46030) 2024-01-31T05:09:09.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:09.864+0000 7f05377fe640 1 -- 172.21.15.99:0/4208688387 learned_addr learned my addr 172.21.15.99:0/4208688387 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:09:09.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:09.864+0000 7f05367fc640 1 --2- 172.21.15.99:0/4208688387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0538100e00 0x7f053819ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:09.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:09.865+0000 7f0536ffd640 1 --2- 172.21.15.99:0/4208688387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f05380ffc10 0x7f05380689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:09.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:09.865+0000 7f05377fe640 1 -- 172.21.15.99:0/4208688387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f05380ffc10 msgr2=0x7f05380689e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:09.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:09.865+0000 7f05377fe640 1 --2- 172.21.15.99:0/4208688387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f05380ffc10 0x7f05380689e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:09.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:09.865+0000 7f05377fe640 1 -- 172.21.15.99:0/4208688387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0538100e00 msgr2=0x7f053819ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:09.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:09.865+0000 7f05377fe640 1 --2- 172.21.15.99:0/4208688387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0538100e00 0x7f053819ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:09.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:09.865+0000 7f05377fe640 1 -- 172.21.15.99:0/4208688387 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f052c009560 con 0x7f05381017c0 2024-01-31T05:09:09.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:09.865+0000 7f0536ffd640 1 --2- 172.21.15.99:0/4208688387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f05380ffc10 0x7f05380689e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:09:09.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:09.865+0000 7f05367fc640 1 --2- 172.21.15.99:0/4208688387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0538100e00 0x7f053819ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:09:09.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:09.865+0000 7f05377fe640 1 --2- 172.21.15.99:0/4208688387 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f05381017c0 0x7f053819e060 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f053000cad0 tx=0x7f053000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:09.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:09.865+0000 7f053c8d0640 1 -- 172.21.15.99:0/4208688387 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053000ae20 con 0x7f05381017c0 2024-01-31T05:09:09.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:09.865+0000 7f053c8d0640 1 -- 172.21.15.99:0/4208688387 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0530005020 con 0x7f05381017c0 2024-01-31T05:09:09.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:09.865+0000 7f053d8d2640 1 -- 172.21.15.99:0/4208688387 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f053819ee00 con 0x7f05381017c0 2024-01-31T05:09:09.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:09.865+0000 7f053c8d0640 1 -- 172.21.15.99:0/4208688387 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053000f6b0 con 0x7f05381017c0 2024-01-31T05:09:09.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:09.865+0000 7f053d8d2640 1 -- 172.21.15.99:0/4208688387 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f053819f2e0 con 0x7f05381017c0 2024-01-31T05:09:09.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:09.866+0000 7f053d8d2640 1 -- 172.21.15.99:0/4208688387 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0538106f30 con 0x7f05381017c0 2024-01-31T05:09:09.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:09.868+0000 7f053c8d0640 1 -- 172.21.15.99:0/4208688387 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f0530005190 con 0x7f05381017c0 2024-01-31T05:09:09.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:09.869+0000 7f053c8d0640 1 --2- 172.21.15.99:0/4208688387 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f05200a12e0 0x7f05200a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:09.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:09.869+0000 7f0536ffd640 1 --2- 172.21.15.99:0/4208688387 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f05200a12e0 0x7f05200a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:09.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:09.869+0000 7f053c8d0640 1 -- 172.21.15.99:0/4208688387 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f05300cca90 con 0x7f05381017c0 2024-01-31T05:09:09.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:09.869+0000 7f0536ffd640 1 --2- 172.21.15.99:0/4208688387 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f05200a12e0 0x7f05200a37a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0538100c60 tx=0x7f052800a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:09.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:09.872+0000 7f053c8d0640 1 -- 172.21.15.99:0/4208688387 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f05300963b0 con 0x7f05381017c0 2024-01-31T05:09:10.028 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:09 smithi099 ceph-mon[31615]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:09:10.028 INFO:journalctl@ceph.mds.g.smithi099.stdout:Jan 31 05:09:09 smithi099 systemd[1]: Starting Ceph mds.g for 9288ff44-bff5-11ee-95b3-87774f69a715... 2024-01-31T05:09:10.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:09 smithi181 ceph-mon[36434]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:09:10.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:10.098+0000 7f053d8d2640 1 -- 172.21.15.99:0/4208688387 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f053810b520 con 0x7f05381017c0 2024-01-31T05:09:10.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:10.099+0000 7f053c8d0640 1 -- 172.21.15.99:0/4208688387 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7661 (secure 0 0 0) 0x7f05300999d0 con 0x7f05381017c0 2024-01-31T05:09:10.100 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:09:10.100 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/1488539026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1488539026},{"type":"v1","addr":"172.21.15.99:6835","nonce":1488539026}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/1649552652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1649552652},{"type":"v1","addr":"172.21.15.99:6837","nonce":1649552652}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24376,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/427201290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":427201290},{"type":"v1","addr":"172.21.15.181:6833","nonce":427201290}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/472161020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":472161020},{"type":"v1","addr":"172.21.15.179:6833","nonce":472161020}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24427,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/1038715471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1038715471},{"type":"v1","addr":"172.21.15.181:6835","nonce":1038715471}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/966976592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":966976592},{"type":"v1","addr":"172.21.15.179:6835","nonce":966976592}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24439,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/3875964154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3875964154},{"type":"v1","addr":"172.21.15.181:6837","nonce":3875964154}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24457,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6839/996120687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":996120687},{"type":"v1","addr":"172.21.15.181:6839","nonce":996120687}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/837402830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":837402830},{"type":"v1","addr":"172.21.15.179:6837","nonce":837402830}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[]} 2024-01-31T05:09:10.100 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 10 2024-01-31T05:09:10.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:10.102+0000 7f053d8d2640 1 -- 172.21.15.99:0/4208688387 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f05200a12e0 msgr2=0x7f05200a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:10.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:10.102+0000 7f053d8d2640 1 --2- 172.21.15.99:0/4208688387 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f05200a12e0 0x7f05200a37a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0538100c60 tx=0x7f052800a560 comp rx=0 tx=0).stop 2024-01-31T05:09:10.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:10.102+0000 7f053d8d2640 1 -- 172.21.15.99:0/4208688387 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f05381017c0 msgr2=0x7f053819e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:10.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:10.102+0000 7f053d8d2640 1 --2- 172.21.15.99:0/4208688387 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f05381017c0 0x7f053819e060 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f053000cad0 tx=0x7f053000cf90 comp rx=0 tx=0).stop 2024-01-31T05:09:10.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:10.102+0000 7f053d8d2640 1 -- 172.21.15.99:0/4208688387 shutdown_connections 2024-01-31T05:09:10.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:10.102+0000 7f053d8d2640 1 --2- 172.21.15.99:0/4208688387 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f05200a12e0 0x7f05200a37a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:10.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:10.102+0000 7f053d8d2640 1 --2- 172.21.15.99:0/4208688387 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f05381017c0 0x7f053819e060 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:10.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:10.102+0000 7f053d8d2640 1 --2- 172.21.15.99:0/4208688387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0538100e00 0x7f053819ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:10.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:10.102+0000 7f053d8d2640 1 --2- 172.21.15.99:0/4208688387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f05380ffc10 0x7f05380689e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:10.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:10.102+0000 7f053d8d2640 1 -- 172.21.15.99:0/4208688387 >> 172.21.15.99:0/4208688387 conn(0x7f05380fb180 msgr2=0x7f0538104100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:10.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:10.102+0000 7f053d8d2640 1 -- 172.21.15.99:0/4208688387 shutdown_connections 2024-01-31T05:09:10.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:10.102+0000 7f053d8d2640 1 -- 172.21.15.99:0/4208688387 wait complete. 2024-01-31T05:09:10.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:09 smithi179 ceph-mon[35652]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:09:10.307 INFO:journalctl@ceph.mds.g.smithi099.stdout:Jan 31 05:09:10 smithi099 podman[73535]: 2024-01-31 05:09:09.933271854 +0000 UTC m=+0.020997695 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-31T05:09:10.307 INFO:journalctl@ceph.mds.g.smithi099.stdout:Jan 31 05:09:10 smithi099 podman[73535]: 2024-01-31 05:09:10.06369662 +0000 UTC m=+0.151422434 container create 29817ee4f467e29f47311a0f1a1fc90f5155f5cdd1a14610f05577492e4d2ccc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-g, org.label-schema.build-date=20240123, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.31.3, GIT_CLEAN=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240125.044502-661946e, maintainer=Guillaume Abrioux ) 2024-01-31T05:09:10.307 INFO:journalctl@ceph.mds.g.smithi099.stdout:Jan 31 05:09:10 smithi099 podman[73535]: 2024-01-31 05:09:10.308265318 +0000 UTC m=+0.395991134 container init 29817ee4f467e29f47311a0f1a1fc90f5155f5cdd1a14610f05577492e4d2ccc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-g, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240123, RELEASE=wip-vshankar-testing-20240125.044502-661946e, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-01-31T05:09:10.568 INFO:journalctl@ceph.mds.g.smithi099.stdout:Jan 31 05:09:10 smithi099 podman[73535]: 2024-01-31 05:09:10.311064247 +0000 UTC m=+0.398790063 container start 29817ee4f467e29f47311a0f1a1fc90f5155f5cdd1a14610f05577492e4d2ccc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-g, io.buildah.version=1.31.3, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240123, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_CLEAN=True) 2024-01-31T05:09:10.568 INFO:journalctl@ceph.mds.g.smithi099.stdout:Jan 31 05:09:10 smithi099 ceph-mds[73556]: -- 172.21.15.99:0/1455037453 <== mon.0 v2:172.21.15.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560746c6f520 con 0x560746c44c00 2024-01-31T05:09:10.568 INFO:journalctl@ceph.mds.g.smithi099.stdout:Jan 31 05:09:10 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-g[73552]: starting mds.g at 2024-01-31T05:09:10.568 INFO:journalctl@ceph.mds.g.smithi099.stdout:Jan 31 05:09:10 smithi099 bash[73535]: 29817ee4f467e29f47311a0f1a1fc90f5155f5cdd1a14610f05577492e4d2ccc 2024-01-31T05:09:10.569 INFO:journalctl@ceph.mds.g.smithi099.stdout:Jan 31 05:09:10 smithi099 systemd[1]: Started Ceph mds.g for 9288ff44-bff5-11ee-95b3-87774f69a715. 2024-01-31T05:09:11.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:10 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/4208688387' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:09:11.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:10 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:11.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:10 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:11.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:10 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:11.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:10 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-31T05:09:11.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:10 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-31T05:09:11.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:10 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:09:11.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:10 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/4208688387' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:09:11.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:10 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:11.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:10 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:11.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:10 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:11.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:10 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-31T05:09:11.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:10 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-31T05:09:11.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:10 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:09:11.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:10 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/4208688387' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:09:11.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:10 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:11.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:10 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:11.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:10 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:11.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:10 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-31T05:09:11.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:10 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-31T05:09:11.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:10 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:09:12.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:11 smithi099 ceph-mon[31615]: Deploying daemon mds.a on smithi099 2024-01-31T05:09:12.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:11 smithi099 ceph-mon[31615]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:09:12.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:11 smithi099 ceph-mon[31615]: mds.? [v2:172.21.15.99:6838/4070477446,v1:172.21.15.99:6839/4070477446] up:boot 2024-01-31T05:09:12.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:11 smithi099 ceph-mon[31615]: fsmap 10 up:standby 2024-01-31T05:09:12.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:11 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-01-31T05:09:12.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:11 smithi181 ceph-mon[36434]: Deploying daemon mds.a on smithi099 2024-01-31T05:09:12.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:11 smithi181 ceph-mon[36434]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:09:12.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:11 smithi181 ceph-mon[36434]: mds.? [v2:172.21.15.99:6838/4070477446,v1:172.21.15.99:6839/4070477446] up:boot 2024-01-31T05:09:12.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:11 smithi181 ceph-mon[36434]: fsmap 10 up:standby 2024-01-31T05:09:12.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:11 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-01-31T05:09:12.114 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T05:09:12.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:11 smithi179 ceph-mon[35652]: Deploying daemon mds.a on smithi099 2024-01-31T05:09:12.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:11 smithi179 ceph-mon[35652]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:09:12.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:11 smithi179 ceph-mon[35652]: mds.? [v2:172.21.15.99:6838/4070477446,v1:172.21.15.99:6839/4070477446] up:boot 2024-01-31T05:09:12.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:11 smithi179 ceph-mon[35652]: fsmap 10 up:standby 2024-01-31T05:09:12.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:11 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-01-31T05:09:12.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.222+0000 7f44ffa1d640 1 -- 172.21.15.99:0/3317376940 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44f81017c0 msgr2=0x7f44f8108050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:12.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.222+0000 7f44ffa1d640 1 --2- 172.21.15.99:0/3317376940 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44f81017c0 0x7f44f8108050 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f44f4009ca0 tx=0x7f44f402c0f0 comp rx=0 tx=0).stop 2024-01-31T05:09:12.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.222+0000 7f44ffa1d640 1 -- 172.21.15.99:0/3317376940 shutdown_connections 2024-01-31T05:09:12.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.222+0000 7f44ffa1d640 1 --2- 172.21.15.99:0/3317376940 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44f81017c0 0x7f44f8108050 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:12.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.222+0000 7f44ffa1d640 1 --2- 172.21.15.99:0/3317376940 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f44f8100e00 0x7f44f8101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:12.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.222+0000 7f44ffa1d640 1 --2- 172.21.15.99:0/3317376940 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44f80ffc10 0x7f44f8100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:12.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.222+0000 7f44ffa1d640 1 -- 172.21.15.99:0/3317376940 >> 172.21.15.99:0/3317376940 conn(0x7f44f80fb180 msgr2=0x7f44f80fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:12.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.222+0000 7f44ffa1d640 1 -- 172.21.15.99:0/3317376940 shutdown_connections 2024-01-31T05:09:12.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.222+0000 7f44ffa1d640 1 -- 172.21.15.99:0/3317376940 wait complete. 2024-01-31T05:09:12.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.223+0000 7f44ffa1d640 1 Processor -- start 2024-01-31T05:09:12.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.223+0000 7f44ffa1d640 1 -- start start 2024-01-31T05:09:12.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.223+0000 7f44ffa1d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44f80ffc10 0x7f44f8195af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:12.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.223+0000 7f44ffa1d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44f8100e00 0x7f44f8196030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:12.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.223+0000 7f44ffa1d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f44f81017c0 0x7f44f819d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:12.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.223+0000 7f44ffa1d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f819d5e0 con 0x7f44f8100e00 2024-01-31T05:09:12.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.223+0000 7f44ffa1d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f819d750 con 0x7f44f80ffc10 2024-01-31T05:09:12.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.223+0000 7f44ffa1d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f819d910 con 0x7f44f81017c0 2024-01-31T05:09:12.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.223+0000 7f44fcfb8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44f8100e00 0x7f44f8196030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:12.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.223+0000 7f44fcfb8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44f8100e00 0x7f44f8196030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46080/0 (socket says 172.21.15.99:46080) 2024-01-31T05:09:12.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.223+0000 7f44fcfb8640 1 -- 172.21.15.99:0/3224206736 learned_addr learned my addr 172.21.15.99:0/3224206736 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:09:12.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.223+0000 7f44fd7b9640 1 --2- 172.21.15.99:0/3224206736 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44f80ffc10 0x7f44f8195af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:12.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.223+0000 7f44fdfba640 1 --2- 172.21.15.99:0/3224206736 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f44f81017c0 0x7f44f819d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:12.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.224+0000 7f44fcfb8640 1 -- 172.21.15.99:0/3224206736 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f44f81017c0 msgr2=0x7f44f819d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:12.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.224+0000 7f44fcfb8640 1 --2- 172.21.15.99:0/3224206736 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f44f81017c0 0x7f44f819d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:12.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.224+0000 7f44fcfb8640 1 -- 172.21.15.99:0/3224206736 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44f80ffc10 msgr2=0x7f44f8195af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:12.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.224+0000 7f44fcfb8640 1 --2- 172.21.15.99:0/3224206736 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44f80ffc10 0x7f44f8195af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:12.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.224+0000 7f44fcfb8640 1 -- 172.21.15.99:0/3224206736 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f4009900 con 0x7f44f8100e00 2024-01-31T05:09:12.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.224+0000 7f44fdfba640 1 --2- 172.21.15.99:0/3224206736 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f44f81017c0 0x7f44f819d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:09:12.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.224+0000 7f44fcfb8640 1 --2- 172.21.15.99:0/3224206736 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44f8100e00 0x7f44f8196030 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f44e800c970 tx=0x7f44e800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:12.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.224+0000 7f44ee7fc640 1 -- 172.21.15.99:0/3224206736 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e8007bb0 con 0x7f44f8100e00 2024-01-31T05:09:12.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.224+0000 7f44ee7fc640 1 -- 172.21.15.99:0/3224206736 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f44e8007d10 con 0x7f44f8100e00 2024-01-31T05:09:12.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.224+0000 7f44ffa1d640 1 -- 172.21.15.99:0/3224206736 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44f819dbf0 con 0x7f44f8100e00 2024-01-31T05:09:12.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.224+0000 7f44ee7fc640 1 -- 172.21.15.99:0/3224206736 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e8004e40 con 0x7f44f8100e00 2024-01-31T05:09:12.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.224+0000 7f44ffa1d640 1 -- 172.21.15.99:0/3224206736 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44f819e100 con 0x7f44f8100e00 2024-01-31T05:09:12.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.226+0000 7f44ffa1d640 1 -- 172.21.15.99:0/3224206736 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44f8106ed0 con 0x7f44f8100e00 2024-01-31T05:09:12.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.226+0000 7f44ee7fc640 1 -- 172.21.15.99:0/3224206736 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f44e8005020 con 0x7f44f8100e00 2024-01-31T05:09:12.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.227+0000 7f44ee7fc640 1 --2- 172.21.15.99:0/3224206736 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f44e40a1360 0x7f44e40a3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:12.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.227+0000 7f44fd7b9640 1 --2- 172.21.15.99:0/3224206736 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f44e40a1360 0x7f44e40a3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:12.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.227+0000 7f44ee7fc640 1 -- 172.21.15.99:0/3224206736 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f44e80cc420 con 0x7f44f8100e00 2024-01-31T05:09:12.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.227+0000 7f44fd7b9640 1 --2- 172.21.15.99:0/3224206736 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f44e40a1360 0x7f44e40a3820 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f44f00058c0 tx=0x7f44f0005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:12.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.232+0000 7f44ee7fc640 1 -- 172.21.15.99:0/3224206736 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f44e8095d40 con 0x7f44f8100e00 2024-01-31T05:09:12.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.480+0000 7f44ffa1d640 1 -- 172.21.15.99:0/3224206736 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f44f810b4d0 con 0x7f44f8100e00 2024-01-31T05:09:12.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.481+0000 7f44ee7fc640 1 -- 172.21.15.99:0/3224206736 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8453 (secure 0 0 0) 0x7f44f810b4d0 con 0x7f44f8100e00 2024-01-31T05:09:12.480 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:09:12.481 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/1488539026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1488539026},{"type":"v1","addr":"172.21.15.99:6835","nonce":1488539026}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/1649552652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1649552652},{"type":"v1","addr":"172.21.15.99:6837","nonce":1649552652}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6839/4070477446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4070477446},{"type":"v1","addr":"172.21.15.99:6839","nonce":4070477446}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24376,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/427201290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":427201290},{"type":"v1","addr":"172.21.15.181:6833","nonce":427201290}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/472161020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":472161020},{"type":"v1","addr":"172.21.15.179:6833","nonce":472161020}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24427,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/1038715471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1038715471},{"type":"v1","addr":"172.21.15.181:6835","nonce":1038715471}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/966976592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":966976592},{"type":"v1","addr":"172.21.15.179:6835","nonce":966976592}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24439,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/3875964154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3875964154},{"type":"v1","addr":"172.21.15.181:6837","nonce":3875964154}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24457,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6839/996120687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":996120687},{"type":"v1","addr":"172.21.15.181:6839","nonce":996120687}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/837402830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":837402830},{"type":"v1","addr":"172.21.15.179:6837","nonce":837402830}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[]} 2024-01-31T05:09:12.481 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 11 2024-01-31T05:09:12.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.484+0000 7f44ffa1d640 1 -- 172.21.15.99:0/3224206736 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f44e40a1360 msgr2=0x7f44e40a3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:12.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.484+0000 7f44ffa1d640 1 --2- 172.21.15.99:0/3224206736 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f44e40a1360 0x7f44e40a3820 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f44f00058c0 tx=0x7f44f0005850 comp rx=0 tx=0).stop 2024-01-31T05:09:12.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.484+0000 7f44ffa1d640 1 -- 172.21.15.99:0/3224206736 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44f8100e00 msgr2=0x7f44f8196030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:12.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.484+0000 7f44ffa1d640 1 --2- 172.21.15.99:0/3224206736 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44f8100e00 0x7f44f8196030 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f44e800c970 tx=0x7f44e800ce30 comp rx=0 tx=0).stop 2024-01-31T05:09:12.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.484+0000 7f44ffa1d640 1 -- 172.21.15.99:0/3224206736 shutdown_connections 2024-01-31T05:09:12.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.484+0000 7f44ffa1d640 1 --2- 172.21.15.99:0/3224206736 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f44e40a1360 0x7f44e40a3820 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:12.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.484+0000 7f44ffa1d640 1 --2- 172.21.15.99:0/3224206736 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f44f81017c0 0x7f44f819d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:12.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.484+0000 7f44ffa1d640 1 --2- 172.21.15.99:0/3224206736 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44f8100e00 0x7f44f8196030 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:12.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.484+0000 7f44ffa1d640 1 --2- 172.21.15.99:0/3224206736 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44f80ffc10 0x7f44f8195af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:12.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.484+0000 7f44ffa1d640 1 -- 172.21.15.99:0/3224206736 >> 172.21.15.99:0/3224206736 conn(0x7f44f80fb180 msgr2=0x7f44f81040a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:12.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.484+0000 7f44ffa1d640 1 -- 172.21.15.99:0/3224206736 shutdown_connections 2024-01-31T05:09:12.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:12.484+0000 7f44ffa1d640 1 -- 172.21.15.99:0/3224206736 wait complete. 2024-01-31T05:09:12.818 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:09:12 smithi099 systemd[1]: Starting Ceph mds.a for 9288ff44-bff5-11ee-95b3-87774f69a715... 2024-01-31T05:09:13.139 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:09:12 smithi099 podman[73899]: 2024-01-31 05:09:12.756021747 +0000 UTC m=+0.018596577 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-31T05:09:13.139 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:09:12 smithi099 podman[73899]: 2024-01-31 05:09:12.879484615 +0000 UTC m=+0.142059478 container create f5357530e711151c53fa94f7727cbd135754c0bd892b2d1b981d91c2fed4b996 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a, CEPH_POINT_RELEASE=, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.build-date=20240123, io.buildah.version=1.31.3, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-01-31T05:09:13.139 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:09:13 smithi099 podman[73899]: 2024-01-31 05:09:13.140357708 +0000 UTC m=+0.402932529 container init f5357530e711151c53fa94f7727cbd135754c0bd892b2d1b981d91c2fed4b996 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.31.3, ceph=True, org.label-schema.build-date=20240123, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-01-31T05:09:13.416 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:13 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/3224206736' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:09:13.416 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:13 smithi181 ceph-mon[36434]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:09:13.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:13 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/3224206736' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:09:13.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:13 smithi099 ceph-mon[31615]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:09:13.569 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:09:13 smithi099 podman[73899]: 2024-01-31 05:09:13.14315972 +0000 UTC m=+0.405734551 container start f5357530e711151c53fa94f7727cbd135754c0bd892b2d1b981d91c2fed4b996 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.vendor=CentOS, io.buildah.version=1.31.3, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240123, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-01-31T05:09:13.569 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:09:13 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: starting mds.a at 2024-01-31T05:09:13.569 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:09:13 smithi099 bash[73899]: f5357530e711151c53fa94f7727cbd135754c0bd892b2d1b981d91c2fed4b996 2024-01-31T05:09:13.569 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:09:13 smithi099 systemd[1]: Started Ceph mds.a for 9288ff44-bff5-11ee-95b3-87774f69a715. 2024-01-31T05:09:13.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:13 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/3224206736' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:09:13.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:13 smithi179 ceph-mon[35652]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:09:14.499 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T05:09:14.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:14 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:14.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:14 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:14.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:14 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:14.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:14 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-31T05:09:14.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:14 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-31T05:09:14.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:14 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:09:14.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:14 smithi099 ceph-mon[31615]: Deploying daemon mds.b on smithi179 2024-01-31T05:09:14.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:14 smithi099 ceph-mon[31615]: mds.? [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] up:boot 2024-01-31T05:09:14.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:14 smithi099 ceph-mon[31615]: fsmap 11 up:standby 2024-01-31T05:09:14.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:14 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-01-31T05:09:14.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:14 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:14.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:14 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:14.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:14 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:14.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:14 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-31T05:09:14.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:14 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-31T05:09:14.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:14 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:09:14.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:14 smithi181 ceph-mon[36434]: Deploying daemon mds.b on smithi179 2024-01-31T05:09:14.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:14 smithi181 ceph-mon[36434]: mds.? [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] up:boot 2024-01-31T05:09:14.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:14 smithi181 ceph-mon[36434]: fsmap 11 up:standby 2024-01-31T05:09:14.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:14 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-01-31T05:09:14.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.617+0000 7fd03217c640 1 -- 172.21.15.99:0/728418197 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd02c104160 msgr2=0x7fd02c106550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:14.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.617+0000 7fd03217c640 1 --2- 172.21.15.99:0/728418197 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd02c104160 0x7fd02c106550 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd014009900 tx=0x7fd01402bc30 comp rx=0 tx=0).stop 2024-01-31T05:09:14.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.617+0000 7fd03217c640 1 -- 172.21.15.99:0/728418197 shutdown_connections 2024-01-31T05:09:14.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.617+0000 7fd03217c640 1 --2- 172.21.15.99:0/728418197 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd02c106a90 0x7fd02c108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:14.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.617+0000 7fd03217c640 1 --2- 172.21.15.99:0/728418197 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd02c104160 0x7fd02c106550 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:14.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.617+0000 7fd03217c640 1 --2- 172.21.15.99:0/728418197 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd02c101830 0x7fd02c103c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:14.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.617+0000 7fd03217c640 1 -- 172.21.15.99:0/728418197 >> 172.21.15.99:0/728418197 conn(0x7fd02c0fb180 msgr2=0x7fd02c0fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:14.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.617+0000 7fd03217c640 1 -- 172.21.15.99:0/728418197 shutdown_connections 2024-01-31T05:09:14.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.617+0000 7fd03217c640 1 -- 172.21.15.99:0/728418197 wait complete. 2024-01-31T05:09:14.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.617+0000 7fd03217c640 1 Processor -- start 2024-01-31T05:09:14.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.618+0000 7fd03217c640 1 -- start start 2024-01-31T05:09:14.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.618+0000 7fd03217c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd02c101830 0x7fd02c196c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:14.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.618+0000 7fd03217c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd02c104160 0x7fd02c1971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:14.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.618+0000 7fd03217c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd02c106a90 0x7fd02c19e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:14.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.618+0000 7fd03217c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd02c19e790 con 0x7fd02c101830 2024-01-31T05:09:14.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.618+0000 7fd03217c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd02c19e900 con 0x7fd02c106a90 2024-01-31T05:09:14.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.618+0000 7fd03217c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd02c19eac0 con 0x7fd02c104160 2024-01-31T05:09:14.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.618+0000 7fd02b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd02c101830 0x7fd02c196c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:14.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.618+0000 7fd02b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd02c101830 0x7fd02c196c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46096/0 (socket says 172.21.15.99:46096) 2024-01-31T05:09:14.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.618+0000 7fd02b7fe640 1 -- 172.21.15.99:0/3990960233 learned_addr learned my addr 172.21.15.99:0/3990960233 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:09:14.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.618+0000 7fd02bfff640 1 --2- 172.21.15.99:0/3990960233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd02c106a90 0x7fd02c19e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:14.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.618+0000 7fd022ffd640 1 --2- 172.21.15.99:0/3990960233 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd02c104160 0x7fd02c1971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:14.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.618+0000 7fd02b7fe640 1 -- 172.21.15.99:0/3990960233 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd02c104160 msgr2=0x7fd02c1971c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:14.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.618+0000 7fd02b7fe640 1 --2- 172.21.15.99:0/3990960233 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd02c104160 0x7fd02c1971c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:14.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.618+0000 7fd02b7fe640 1 -- 172.21.15.99:0/3990960233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd02c106a90 msgr2=0x7fd02c19e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:14.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.618+0000 7fd02b7fe640 1 --2- 172.21.15.99:0/3990960233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd02c106a90 0x7fd02c19e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:14.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.618+0000 7fd02b7fe640 1 -- 172.21.15.99:0/3990960233 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd014009560 con 0x7fd02c101830 2024-01-31T05:09:14.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.618+0000 7fd022ffd640 1 --2- 172.21.15.99:0/3990960233 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd02c104160 0x7fd02c1971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:09:14.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.618+0000 7fd02b7fe640 1 --2- 172.21.15.99:0/3990960233 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd02c101830 0x7fd02c196c80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd01c00c920 tx=0x7fd01c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:14.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.619+0000 7fd0297fa640 1 -- 172.21.15.99:0/3990960233 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01c007c70 con 0x7fd02c101830 2024-01-31T05:09:14.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.619+0000 7fd0297fa640 1 -- 172.21.15.99:0/3990960233 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd01c007dd0 con 0x7fd02c101830 2024-01-31T05:09:14.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.619+0000 7fd03217c640 1 -- 172.21.15.99:0/3990960233 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd02c19eda0 con 0x7fd02c101830 2024-01-31T05:09:14.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.619+0000 7fd0297fa640 1 -- 172.21.15.99:0/3990960233 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01c0187c0 con 0x7fd02c101830 2024-01-31T05:09:14.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.619+0000 7fd03217c640 1 -- 172.21.15.99:0/3990960233 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd02c19f1d0 con 0x7fd02c101830 2024-01-31T05:09:14.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.620+0000 7fd03217c640 1 -- 172.21.15.99:0/3990960233 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd02c0fcc70 con 0x7fd02c101830 2024-01-31T05:09:14.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.621+0000 7fd0297fa640 1 -- 172.21.15.99:0/3990960233 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7fd01c00f450 con 0x7fd02c101830 2024-01-31T05:09:14.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.621+0000 7fd0297fa640 1 --2- 172.21.15.99:0/3990960233 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd0180a12e0 0x7fd0180a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:14.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.621+0000 7fd022ffd640 1 --2- 172.21.15.99:0/3990960233 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd0180a12e0 0x7fd0180a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:14.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.621+0000 7fd0297fa640 1 -- 172.21.15.99:0/3990960233 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fd01c0cc810 con 0x7fd02c101830 2024-01-31T05:09:14.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.622+0000 7fd022ffd640 1 --2- 172.21.15.99:0/3990960233 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd0180a12e0 0x7fd0180a37a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd01402c6b0 tx=0x7fd014005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:14.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.626+0000 7fd0297fa640 1 -- 172.21.15.99:0/3990960233 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fd01c096130 con 0x7fd02c101830 2024-01-31T05:09:14.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:14 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:14.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:14 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:14.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:14 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:14.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:14 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-31T05:09:14.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:14 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-31T05:09:14.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:14 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:09:14.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:14 smithi179 ceph-mon[35652]: Deploying daemon mds.b on smithi179 2024-01-31T05:09:14.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:14 smithi179 ceph-mon[35652]: mds.? [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] up:boot 2024-01-31T05:09:14.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:14 smithi179 ceph-mon[35652]: fsmap 11 up:standby 2024-01-31T05:09:14.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:14 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-01-31T05:09:14.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.832+0000 7fd03217c640 1 -- 172.21.15.99:0/3990960233 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd02c10c5d0 con 0x7fd02c101830 2024-01-31T05:09:14.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.833+0000 7fd0297fa640 1 -- 172.21.15.99:0/3990960233 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+9245 (secure 0 0 0) 0x7fd02c10c5d0 con 0x7fd02c101830 2024-01-31T05:09:14.832 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:09:14.832 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/1488539026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1488539026},{"type":"v1","addr":"172.21.15.99:6835","nonce":1488539026}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/1649552652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1649552652},{"type":"v1","addr":"172.21.15.99:6837","nonce":1649552652}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6839/4070477446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4070477446},{"type":"v1","addr":"172.21.15.99:6839","nonce":4070477446}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6841/3069939345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6840","nonce":3069939345},{"type":"v1","addr":"172.21.15.99:6841","nonce":3069939345}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24376,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/427201290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":427201290},{"type":"v1","addr":"172.21.15.181:6833","nonce":427201290}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/472161020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":472161020},{"type":"v1","addr":"172.21.15.179:6833","nonce":472161020}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24427,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/1038715471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1038715471},{"type":"v1","addr":"172.21.15.181:6835","nonce":1038715471}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/966976592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":966976592},{"type":"v1","addr":"172.21.15.179:6835","nonce":966976592}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24439,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/3875964154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3875964154},{"type":"v1","addr":"172.21.15.181:6837","nonce":3875964154}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24457,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6839/996120687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":996120687},{"type":"v1","addr":"172.21.15.181:6839","nonce":996120687}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/837402830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":837402830},{"type":"v1","addr":"172.21.15.179:6837","nonce":837402830}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[]} 2024-01-31T05:09:14.832 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 12 2024-01-31T05:09:14.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.834+0000 7fd03217c640 1 -- 172.21.15.99:0/3990960233 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd0180a12e0 msgr2=0x7fd0180a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:14.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.834+0000 7fd03217c640 1 --2- 172.21.15.99:0/3990960233 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd0180a12e0 0x7fd0180a37a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd01402c6b0 tx=0x7fd014005fd0 comp rx=0 tx=0).stop 2024-01-31T05:09:14.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.834+0000 7fd03217c640 1 -- 172.21.15.99:0/3990960233 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd02c101830 msgr2=0x7fd02c196c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:14.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.834+0000 7fd03217c640 1 --2- 172.21.15.99:0/3990960233 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd02c101830 0x7fd02c196c80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd01c00c920 tx=0x7fd01c00cde0 comp rx=0 tx=0).stop 2024-01-31T05:09:14.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.834+0000 7fd03217c640 1 -- 172.21.15.99:0/3990960233 shutdown_connections 2024-01-31T05:09:14.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.834+0000 7fd03217c640 1 --2- 172.21.15.99:0/3990960233 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd0180a12e0 0x7fd0180a37a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:14.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.834+0000 7fd03217c640 1 --2- 172.21.15.99:0/3990960233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd02c106a90 0x7fd02c19e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:14.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.835+0000 7fd03217c640 1 --2- 172.21.15.99:0/3990960233 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd02c104160 0x7fd02c1971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:14.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.835+0000 7fd03217c640 1 --2- 172.21.15.99:0/3990960233 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd02c101830 0x7fd02c196c80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:14.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.835+0000 7fd03217c640 1 -- 172.21.15.99:0/3990960233 >> 172.21.15.99:0/3990960233 conn(0x7fd02c0fb180 msgr2=0x7fd02c1020d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:14.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.835+0000 7fd03217c640 1 -- 172.21.15.99:0/3990960233 shutdown_connections 2024-01-31T05:09:14.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:14.835+0000 7fd03217c640 1 -- 172.21.15.99:0/3990960233 wait complete. 2024-01-31T05:09:15.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:15 smithi099 ceph-mon[31615]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:09:15.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:15 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/3990960233' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:09:15.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:15 smithi181 ceph-mon[36434]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:09:15.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:15 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/3990960233' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:09:15.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:15 smithi179 ceph-mon[35652]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:09:15.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:15 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/3990960233' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:09:15.633 INFO:journalctl@ceph.mds.b.smithi179.stdout:Jan 31 05:09:15 smithi179 systemd[1]: Starting Ceph mds.b for 9288ff44-bff5-11ee-95b3-87774f69a715... 2024-01-31T05:09:16.060 INFO:journalctl@ceph.mds.b.smithi179.stdout:Jan 31 05:09:15 smithi179 podman[66442]: 2024-01-31 05:09:15.641495262 +0000 UTC m=+0.017909120 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-31T05:09:16.061 INFO:journalctl@ceph.mds.b.smithi179.stdout:Jan 31 05:09:15 smithi179 podman[66442]: 2024-01-31 05:09:15.750671063 +0000 UTC m=+0.127084902 container create 95f2ec3f19ea0106236866e20c8dc1b322fae0444e23f46c9c1ea72de571cf12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-b, GIT_CLEAN=True, io.buildah.version=1.31.3, GIT_BRANCH=HEAD, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240125.044502-661946e, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240123, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-01-31T05:09:16.061 INFO:journalctl@ceph.mds.b.smithi179.stdout:Jan 31 05:09:15 smithi179 podman[66442]: 2024-01-31 05:09:15.961600657 +0000 UTC m=+0.338014503 container init 95f2ec3f19ea0106236866e20c8dc1b322fae0444e23f46c9c1ea72de571cf12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-b, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.build-date=20240123, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.31.3, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-01-31T05:09:16.061 INFO:journalctl@ceph.mds.b.smithi179.stdout:Jan 31 05:09:15 smithi179 podman[66442]: 2024-01-31 05:09:15.964189112 +0000 UTC m=+0.340602957 container start 95f2ec3f19ea0106236866e20c8dc1b322fae0444e23f46c9c1ea72de571cf12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-b, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240123, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.31.3, CEPH_POINT_RELEASE=, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183) 2024-01-31T05:09:16.061 INFO:journalctl@ceph.mds.b.smithi179.stdout:Jan 31 05:09:15 smithi179 ceph-mds[66461]: -- 172.21.15.179:0/2763666981 <== mon.2 v2:172.21.15.179:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ad0ddb1520 con 0x55ad0dd86800 2024-01-31T05:09:16.061 INFO:journalctl@ceph.mds.b.smithi179.stdout:Jan 31 05:09:15 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-b[66457]: starting mds.b at 2024-01-31T05:09:16.061 INFO:journalctl@ceph.mds.b.smithi179.stdout:Jan 31 05:09:16 smithi179 bash[66442]: 95f2ec3f19ea0106236866e20c8dc1b322fae0444e23f46c9c1ea72de571cf12 2024-01-31T05:09:16.382 INFO:journalctl@ceph.mds.b.smithi179.stdout:Jan 31 05:09:16 smithi179 systemd[1]: Started Ceph mds.b for 9288ff44-bff5-11ee-95b3-87774f69a715. 2024-01-31T05:09:16.847 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T05:09:16.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:16.956+0000 7f899ead6640 1 -- 172.21.15.99:0/3424533202 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89981017e0 msgr2=0x7f8998108070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:16.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:16.956+0000 7f899ead6640 1 --2- 172.21.15.99:0/3424533202 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89981017e0 0x7f8998108070 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8990009ca0 tx=0x7f899002c0f0 comp rx=0 tx=0).stop 2024-01-31T05:09:16.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:16.956+0000 7f899ead6640 1 -- 172.21.15.99:0/3424533202 shutdown_connections 2024-01-31T05:09:16.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:16.956+0000 7f899ead6640 1 --2- 172.21.15.99:0/3424533202 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89981017e0 0x7f8998108070 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:16.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:16.956+0000 7f899ead6640 1 --2- 172.21.15.99:0/3424533202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8998100e20 0x7f89981012a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:16.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:16.956+0000 7f899ead6640 1 --2- 172.21.15.99:0/3424533202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89980ffc30 0x7f8998100050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:16.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:16.956+0000 7f899ead6640 1 -- 172.21.15.99:0/3424533202 >> 172.21.15.99:0/3424533202 conn(0x7f89980fb1a0 msgr2=0x7f89980fd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:16.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:16.956+0000 7f899ead6640 1 -- 172.21.15.99:0/3424533202 shutdown_connections 2024-01-31T05:09:16.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:16.956+0000 7f899ead6640 1 -- 172.21.15.99:0/3424533202 wait complete. 2024-01-31T05:09:16.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:16.957+0000 7f899ead6640 1 Processor -- start 2024-01-31T05:09:16.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:16.957+0000 7f899ead6640 1 -- start start 2024-01-31T05:09:16.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:16.957+0000 7f899ead6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89980ffc30 0x7f899810a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:16.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:16.957+0000 7f899ead6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8998100e20 0x7f8998108b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:16.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:16.957+0000 7f899ead6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89981017e0 0x7f8998109070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:16.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:16.957+0000 7f899ead6640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89981097d0 con 0x7f8998100e20 2024-01-31T05:09:16.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:16.957+0000 7f899ead6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8998109940 con 0x7f89980ffc30 2024-01-31T05:09:16.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:16.957+0000 7f899ead6640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89981a0cb0 con 0x7f89981017e0 2024-01-31T05:09:16.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:16.957+0000 7f8997fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8998100e20 0x7f8998108b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:16.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:16.957+0000 7f8997fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8998100e20 0x7f8998108b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52204/0 (socket says 172.21.15.99:52204) 2024-01-31T05:09:16.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:16.957+0000 7f8997fff640 1 -- 172.21.15.99:0/2572648563 learned_addr learned my addr 172.21.15.99:0/2572648563 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:09:16.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:16.957+0000 7f899d073640 1 --2- 172.21.15.99:0/2572648563 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89981017e0 0x7f8998109070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:16.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:16.957+0000 7f899c872640 1 --2- 172.21.15.99:0/2572648563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89980ffc30 0x7f899810a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:16.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:16.957+0000 7f8997fff640 1 -- 172.21.15.99:0/2572648563 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89981017e0 msgr2=0x7f8998109070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:16.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:16.957+0000 7f8997fff640 1 --2- 172.21.15.99:0/2572648563 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89981017e0 0x7f8998109070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:16.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:16.957+0000 7f8997fff640 1 -- 172.21.15.99:0/2572648563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89980ffc30 msgr2=0x7f899810a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:16.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:16.957+0000 7f8997fff640 1 --2- 172.21.15.99:0/2572648563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89980ffc30 0x7f899810a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:16.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:16.957+0000 7f8997fff640 1 -- 172.21.15.99:0/2572648563 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8990009900 con 0x7f8998100e20 2024-01-31T05:09:16.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:16.958+0000 7f8997fff640 1 --2- 172.21.15.99:0/2572648563 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8998100e20 0x7f8998108b30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f898000ea20 tx=0x7f898000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:16.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:16.958+0000 7f8995ffb640 1 -- 172.21.15.99:0/2572648563 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8980009720 con 0x7f8998100e20 2024-01-31T05:09:16.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:16.958+0000 7f8995ffb640 1 -- 172.21.15.99:0/2572648563 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f898000cd80 con 0x7f8998100e20 2024-01-31T05:09:16.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:16.958+0000 7f899ead6640 1 -- 172.21.15.99:0/2572648563 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89981a0f60 con 0x7f8998100e20 2024-01-31T05:09:16.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:16.958+0000 7f8995ffb640 1 -- 172.21.15.99:0/2572648563 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8980010430 con 0x7f8998100e20 2024-01-31T05:09:16.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:16.958+0000 7f899ead6640 1 -- 172.21.15.99:0/2572648563 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89981a13e0 con 0x7f8998100e20 2024-01-31T05:09:16.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:16.959+0000 7f899ead6640 1 -- 172.21.15.99:0/2572648563 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8998106fd0 con 0x7f8998100e20 2024-01-31T05:09:16.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:16.960+0000 7f8995ffb640 1 -- 172.21.15.99:0/2572648563 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f8980005020 con 0x7f8998100e20 2024-01-31T05:09:16.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:16.960+0000 7f8995ffb640 1 --2- 172.21.15.99:0/2572648563 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f89840a1360 0x7f89840a3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:16.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:16.960+0000 7f899c872640 1 --2- 172.21.15.99:0/2572648563 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f89840a1360 0x7f89840a3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:16.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:16.960+0000 7f8995ffb640 1 -- 172.21.15.99:0/2572648563 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f8980014070 con 0x7f8998100e20 2024-01-31T05:09:16.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:16.961+0000 7f899c872640 1 --2- 172.21.15.99:0/2572648563 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f89840a1360 0x7f89840a3820 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8998100c80 tx=0x7f898800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:16.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:16.965+0000 7f8995ffb640 1 -- 172.21.15.99:0/2572648563 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f8980096440 con 0x7f8998100e20 2024-01-31T05:09:17.137 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:17 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:17.137 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:17 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:17.137 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:17 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:17.137 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:17 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:17.137 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:17 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:17.137 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:17 smithi099 ceph-mon[31615]: mds.? [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] up:boot 2024-01-31T05:09:17.138 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:17 smithi099 ceph-mon[31615]: fsmap 12 up:standby 2024-01-31T05:09:17.138 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:17 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-01-31T05:09:17.138 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:17 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:09:17.138 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:17 smithi099 ceph-mon[31615]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:09:17.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.180+0000 7f899ead6640 1 -- 172.21.15.99:0/2572648563 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f899810c870 con 0x7f8998100e20 2024-01-31T05:09:17.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.181+0000 7f8995ffb640 1 -- 172.21.15.99:0/2572648563 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+10037 (secure 0 0 0) 0x7f8980099a60 con 0x7f8998100e20 2024-01-31T05:09:17.180 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:09:17.180 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/1488539026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1488539026},{"type":"v1","addr":"172.21.15.99:6835","nonce":1488539026}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/1649552652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1649552652},{"type":"v1","addr":"172.21.15.99:6837","nonce":1649552652}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6839/4070477446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4070477446},{"type":"v1","addr":"172.21.15.99:6839","nonce":4070477446}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6841/3069939345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6840","nonce":3069939345},{"type":"v1","addr":"172.21.15.99:6841","nonce":3069939345}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24376,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/427201290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":427201290},{"type":"v1","addr":"172.21.15.181:6833","nonce":427201290}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/472161020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":472161020},{"type":"v1","addr":"172.21.15.179:6833","nonce":472161020}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24427,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/1038715471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1038715471},{"type":"v1","addr":"172.21.15.181:6835","nonce":1038715471}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/966976592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":966976592},{"type":"v1","addr":"172.21.15.179:6835","nonce":966976592}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24439,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/3875964154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3875964154},{"type":"v1","addr":"172.21.15.181:6837","nonce":3875964154}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24457,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6839/996120687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":996120687},{"type":"v1","addr":"172.21.15.181:6839","nonce":996120687}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/837402830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":837402830},{"type":"v1","addr":"172.21.15.179:6837","nonce":837402830}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6839/754762785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":754762785},{"type":"v1","addr":"172.21.15.179:6839","nonce":754762785}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[]} 2024-01-31T05:09:17.181 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 13 2024-01-31T05:09:17.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.183+0000 7f899ead6640 1 -- 172.21.15.99:0/2572648563 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f89840a1360 msgr2=0x7f89840a3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:17.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.183+0000 7f899ead6640 1 --2- 172.21.15.99:0/2572648563 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f89840a1360 0x7f89840a3820 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8998100c80 tx=0x7f898800b390 comp rx=0 tx=0).stop 2024-01-31T05:09:17.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.183+0000 7f899ead6640 1 -- 172.21.15.99:0/2572648563 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8998100e20 msgr2=0x7f8998108b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:17.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.183+0000 7f899ead6640 1 --2- 172.21.15.99:0/2572648563 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8998100e20 0x7f8998108b30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f898000ea20 tx=0x7f898000ee20 comp rx=0 tx=0).stop 2024-01-31T05:09:17.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.183+0000 7f899ead6640 1 -- 172.21.15.99:0/2572648563 shutdown_connections 2024-01-31T05:09:17.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.183+0000 7f899ead6640 1 --2- 172.21.15.99:0/2572648563 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f89840a1360 0x7f89840a3820 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:17.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.183+0000 7f899ead6640 1 --2- 172.21.15.99:0/2572648563 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89981017e0 0x7f8998109070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:17.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.183+0000 7f899ead6640 1 --2- 172.21.15.99:0/2572648563 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8998100e20 0x7f8998108b30 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:17.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.183+0000 7f899ead6640 1 --2- 172.21.15.99:0/2572648563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89980ffc30 0x7f899810a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:17.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.183+0000 7f899ead6640 1 -- 172.21.15.99:0/2572648563 >> 172.21.15.99:0/2572648563 conn(0x7f89980fb1a0 msgr2=0x7f89981041a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:17.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.183+0000 7f899ead6640 1 -- 172.21.15.99:0/2572648563 shutdown_connections 2024-01-31T05:09:17.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.183+0000 7f899ead6640 1 -- 172.21.15.99:0/2572648563 wait complete. 2024-01-31T05:09:17.194 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:09:17.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.301+0000 7fb44d662640 1 -- 172.21.15.99:0/1806601458 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb448100e00 msgr2=0x7fb448101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:17.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.301+0000 7fb44d662640 1 --2- 172.21.15.99:0/1806601458 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb448100e00 0x7fb448101280 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb43c009900 tx=0x7fb43c02bc30 comp rx=0 tx=0).stop 2024-01-31T05:09:17.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.301+0000 7fb44d662640 1 -- 172.21.15.99:0/1806601458 shutdown_connections 2024-01-31T05:09:17.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.301+0000 7fb44d662640 1 --2- 172.21.15.99:0/1806601458 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb4481017c0 0x7fb448108050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:17.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.301+0000 7fb44d662640 1 --2- 172.21.15.99:0/1806601458 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb448100e00 0x7fb448101280 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:17.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.301+0000 7fb44d662640 1 --2- 172.21.15.99:0/1806601458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4480ffc10 0x7fb448100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:17.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.301+0000 7fb44d662640 1 -- 172.21.15.99:0/1806601458 >> 172.21.15.99:0/1806601458 conn(0x7fb4480fb180 msgr2=0x7fb4480fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:17.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.301+0000 7fb44d662640 1 -- 172.21.15.99:0/1806601458 shutdown_connections 2024-01-31T05:09:17.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.301+0000 7fb44d662640 1 -- 172.21.15.99:0/1806601458 wait complete. 2024-01-31T05:09:17.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.302+0000 7fb44d662640 1 Processor -- start 2024-01-31T05:09:17.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.302+0000 7fb44d662640 1 -- start start 2024-01-31T05:09:17.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.302+0000 7fb44d662640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb4480ffc10 0x7fb4480689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:17.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.302+0000 7fb44d662640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb448100e00 0x7fb44819b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:17.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.302+0000 7fb44d662640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4481017c0 0x7fb44819dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:17.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.302+0000 7fb44d662640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44819e7d0 con 0x7fb4481017c0 2024-01-31T05:09:17.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.302+0000 7fb44d662640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44819e940 con 0x7fb448100e00 2024-01-31T05:09:17.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.302+0000 7fb44d662640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44819eb00 con 0x7fb4480ffc10 2024-01-31T05:09:17.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.302+0000 7fb4477fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4481017c0 0x7fb44819dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:17.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.302+0000 7fb4477fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4481017c0 0x7fb44819dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52216/0 (socket says 172.21.15.99:52216) 2024-01-31T05:09:17.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.302+0000 7fb4477fe640 1 -- 172.21.15.99:0/1257387008 learned_addr learned my addr 172.21.15.99:0/1257387008 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:09:17.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.302+0000 7fb4467fc640 1 --2- 172.21.15.99:0/1257387008 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb448100e00 0x7fb44819b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:17.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.302+0000 7fb446ffd640 1 --2- 172.21.15.99:0/1257387008 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb4480ffc10 0x7fb4480689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:17.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.302+0000 7fb4477fe640 1 -- 172.21.15.99:0/1257387008 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb4480ffc10 msgr2=0x7fb4480689c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:17.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.302+0000 7fb4477fe640 1 --2- 172.21.15.99:0/1257387008 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb4480ffc10 0x7fb4480689c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:17.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.302+0000 7fb4477fe640 1 -- 172.21.15.99:0/1257387008 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb448100e00 msgr2=0x7fb44819b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:17.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.302+0000 7fb4477fe640 1 --2- 172.21.15.99:0/1257387008 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb448100e00 0x7fb44819b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:17.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.302+0000 7fb4477fe640 1 -- 172.21.15.99:0/1257387008 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43c009560 con 0x7fb4481017c0 2024-01-31T05:09:17.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.303+0000 7fb4477fe640 1 --2- 172.21.15.99:0/1257387008 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4481017c0 0x7fb44819dff0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb44000cad0 tx=0x7fb44000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:17.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.303+0000 7fb42ffff640 1 -- 172.21.15.99:0/1257387008 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44000ae20 con 0x7fb4481017c0 2024-01-31T05:09:17.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.303+0000 7fb42ffff640 1 -- 172.21.15.99:0/1257387008 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb440005020 con 0x7fb4481017c0 2024-01-31T05:09:17.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.303+0000 7fb42ffff640 1 -- 172.21.15.99:0/1257387008 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44000f6b0 con 0x7fb4481017c0 2024-01-31T05:09:17.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.303+0000 7fb44d662640 1 -- 172.21.15.99:0/1257387008 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb44819ed80 con 0x7fb4481017c0 2024-01-31T05:09:17.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.303+0000 7fb44d662640 1 -- 172.21.15.99:0/1257387008 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb44819f1b0 con 0x7fb4481017c0 2024-01-31T05:09:17.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.304+0000 7fb44d662640 1 -- 172.21.15.99:0/1257387008 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb448106f30 con 0x7fb4481017c0 2024-01-31T05:09:17.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.305+0000 7fb42ffff640 1 -- 172.21.15.99:0/1257387008 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7fb440005190 con 0x7fb4481017c0 2024-01-31T05:09:17.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.305+0000 7fb42ffff640 1 --2- 172.21.15.99:0/1257387008 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb4300a12e0 0x7fb4300a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:17.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.305+0000 7fb446ffd640 1 --2- 172.21.15.99:0/1257387008 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb4300a12e0 0x7fb4300a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:17.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.306+0000 7fb42ffff640 1 -- 172.21.15.99:0/1257387008 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fb4400cc770 con 0x7fb4481017c0 2024-01-31T05:09:17.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.306+0000 7fb446ffd640 1 --2- 172.21.15.99:0/1257387008 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb4300a12e0 0x7fb4300a37a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb438005fd0 tx=0x7fb438005ce0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:17.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.310+0000 7fb42ffff640 1 -- 172.21.15.99:0/1257387008 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fb440096090 con 0x7fb4481017c0 2024-01-31T05:09:17.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:17 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:17.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:17 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:17.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:17 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:17.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:17 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:17.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:17 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:17.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:17 smithi179 ceph-mon[35652]: mds.? [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] up:boot 2024-01-31T05:09:17.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:17 smithi179 ceph-mon[35652]: fsmap 12 up:standby 2024-01-31T05:09:17.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:17 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-01-31T05:09:17.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:17 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:09:17.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:17 smithi179 ceph-mon[35652]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:09:17.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.485+0000 7fb44d662640 1 -- 172.21.15.99:0/1257387008 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb44802cb90 con 0x7fb4481017c0 2024-01-31T05:09:17.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.486+0000 7fb42ffff640 1 -- 172.21.15.99:0/1257387008 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18435 (secure 0 0 0) 0x7fb4400996b0 con 0x7fb4481017c0 2024-01-31T05:09:17.486 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:09:17.486 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":82,"fsid":"9288ff44-bff5-11ee-95b3-87774f69a715","created":"2024-01-31T05:01:26.130917+0000","modified":"2024-01-31T05:08:32.416444+0000","last_up_change":"2024-01-31T05:08:31.228478+0000","last_in_change":"2024-01-31T05:08:10.799511+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:46.842423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b45878d9-28f1-4821-ba72-26a32d3fc780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6803","nonce":1213805280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6805","nonce":1213805280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6809","nonce":1213805280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6807","nonce":1213805280}]},"public_addr":"172.21.15.99:6803/1213805280","cluster_addr":"172.21.15.99:6805/1213805280","heartbeat_back_addr":"172.21.15.99:6809/1213805280","heartbeat_front_addr":"172.21.15.99:6807/1213805280","state":["exists","up"]},{"osd":1,"uuid":"e0b71ff3-5d97-4659-8dea-4c9091e1beb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6801","nonce":2019451677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6803","nonce":2019451677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6807","nonce":2019451677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6805","nonce":2019451677}]},"public_addr":"172.21.15.179:6801/2019451677","cluster_addr":"172.21.15.179:6803/2019451677","heartbeat_back_addr":"172.21.15.179:6807/2019451677","heartbeat_front_addr":"172.21.15.179:6805/2019451677","state":["exists","up"]},{"osd":2,"uuid":"11c919c8-19a9-48b0-8880-3002efcb64f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6801","nonce":3934284457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6803","nonce":3934284457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6807","nonce":3934284457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6805","nonce":3934284457}]},"public_addr":"172.21.15.181:6801/3934284457","cluster_addr":"172.21.15.181:6803/3934284457","heartbeat_back_addr":"172.21.15.181:6807/3934284457","heartbeat_front_addr":"172.21.15.181:6805/3934284457","state":["exists","up"]},{"osd":3,"uuid":"bcab5135-a5d1-45ae-a9b8-674425d3999e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6811","nonce":4207675427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6813","nonce":4207675427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6817","nonce":4207675427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6815","nonce":4207675427}]},"public_addr":"172.21.15.99:6811/4207675427","cluster_addr":"172.21.15.99:6813/4207675427","heartbeat_back_addr":"172.21.15.99:6817/4207675427","heartbeat_front_addr":"172.21.15.99:6815/4207675427","state":["exists","up"]},{"osd":4,"uuid":"0250d7ac-3894-457a-9c04-cc7205d61eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6809","nonce":2861083896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6811","nonce":2861083896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6815","nonce":2861083896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6813","nonce":2861083896}]},"public_addr":"172.21.15.179:6809/2861083896","cluster_addr":"172.21.15.179:6811/2861083896","heartbeat_back_addr":"172.21.15.179:6815/2861083896","heartbeat_front_addr":"172.21.15.179:6813/2861083896","state":["exists","up"]},{"osd":5,"uuid":"5e19222a-c2a4-45bc-8445-1d302f26d11c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6809","nonce":1485017095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6811","nonce":1485017095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6815","nonce":1485017095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6813","nonce":1485017095}]},"public_addr":"172.21.15.181:6809/1485017095","cluster_addr":"172.21.15.181:6811/1485017095","heartbeat_back_addr":"172.21.15.181:6815/1485017095","heartbeat_front_addr":"172.21.15.181:6813/1485017095","state":["exists","up"]},{"osd":6,"uuid":"56555035-f9fc-4e91-96dd-caa632d58adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6819","nonce":1534047839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6821","nonce":1534047839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6825","nonce":1534047839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6823","nonce":1534047839}]},"public_addr":"172.21.15.99:6819/1534047839","cluster_addr":"172.21.15.99:6821/1534047839","heartbeat_back_addr":"172.21.15.99:6825/1534047839","heartbeat_front_addr":"172.21.15.99:6823/1534047839","state":["exists","up"]},{"osd":7,"uuid":"5e079cf5-1340-4599-88a6-df410ef0148e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6817","nonce":3875950553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6819","nonce":3875950553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6823","nonce":3875950553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6821","nonce":3875950553}]},"public_addr":"172.21.15.179:6817/3875950553","cluster_addr":"172.21.15.179:6819/3875950553","heartbeat_back_addr":"172.21.15.179:6823/3875950553","heartbeat_front_addr":"172.21.15.179:6821/3875950553","state":["exists","up"]},{"osd":8,"uuid":"10a73592-4251-4492-b67d-ce9b9d7fff32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6817","nonce":179568936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6819","nonce":179568936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6823","nonce":179568936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6821","nonce":179568936}]},"public_addr":"172.21.15.181:6817/179568936","cluster_addr":"172.21.15.181:6819/179568936","heartbeat_back_addr":"172.21.15.181:6823/179568936","heartbeat_front_addr":"172.21.15.181:6821/179568936","state":["exists","up"]},{"osd":9,"uuid":"f6620e1e-f761-4f1c-917f-cbc748df32a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6827","nonce":315759515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6829","nonce":315759515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6833","nonce":315759515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6831","nonce":315759515}]},"public_addr":"172.21.15.99:6827/315759515","cluster_addr":"172.21.15.99:6829/315759515","heartbeat_back_addr":"172.21.15.99:6833/315759515","heartbeat_front_addr":"172.21.15.99:6831/315759515","state":["exists","up"]},{"osd":10,"uuid":"ee86af7d-66f8-4795-bcc3-dfec79e4680c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6825","nonce":2985063934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6827","nonce":2985063934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6831","nonce":2985063934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6829","nonce":2985063934}]},"public_addr":"172.21.15.179:6825/2985063934","cluster_addr":"172.21.15.179:6827/2985063934","heartbeat_back_addr":"172.21.15.179:6831/2985063934","heartbeat_front_addr":"172.21.15.179:6829/2985063934","state":["exists","up"]},{"osd":11,"uuid":"82f04fee-f6ae-4630-a75b-b12a9c4ab2e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6825","nonce":1858219600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6827","nonce":1858219600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6831","nonce":1858219600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6829","nonce":1858219600}]},"public_addr":"172.21.15.181:6825/1858219600","cluster_addr":"172.21.15.181:6827/1858219600","heartbeat_back_addr":"172.21.15.181:6831/1858219600","heartbeat_front_addr":"172.21.15.181:6829/1858219600","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:55.518970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:04:19.936339+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:04:44.064814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:09.331683+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:34.616774+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:58.881810+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:06:23.869838+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:06:49.127331+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:07:12.847187+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:07:38.231045+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:08:03.949162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:08:28.471802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:0/401101729":"2024-02-01T05:02:20.510858+0000","172.21.15.99:6801/1993198206":"2024-02-01T05:02:20.510858+0000","172.21.15.99:0/3819754569":"2024-02-01T05:02:20.510858+0000","172.21.15.99:0/475390265":"2024-02-01T05:01:53.732026+0000","172.21.15.99:6800/1993198206":"2024-02-01T05:02:20.510858+0000","172.21.15.99:6800/1706888338":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/4150146075":"2024-02-01T05:01:53.732026+0000","172.21.15.99:6801/1706888338":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/2851066598":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/1865156424":"2024-02-01T05:02:20.510858+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:09:17.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.488+0000 7fb44d662640 1 -- 172.21.15.99:0/1257387008 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb4300a12e0 msgr2=0x7fb4300a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:17.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.488+0000 7fb44d662640 1 --2- 172.21.15.99:0/1257387008 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb4300a12e0 0x7fb4300a37a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb438005fd0 tx=0x7fb438005ce0 comp rx=0 tx=0).stop 2024-01-31T05:09:17.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.488+0000 7fb44d662640 1 -- 172.21.15.99:0/1257387008 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4481017c0 msgr2=0x7fb44819dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:17.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.488+0000 7fb44d662640 1 --2- 172.21.15.99:0/1257387008 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4481017c0 0x7fb44819dff0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb44000cad0 tx=0x7fb44000cf90 comp rx=0 tx=0).stop 2024-01-31T05:09:17.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.488+0000 7fb44d662640 1 -- 172.21.15.99:0/1257387008 shutdown_connections 2024-01-31T05:09:17.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.488+0000 7fb44d662640 1 --2- 172.21.15.99:0/1257387008 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb4300a12e0 0x7fb4300a37a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:17.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.488+0000 7fb44d662640 1 --2- 172.21.15.99:0/1257387008 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4481017c0 0x7fb44819dff0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:17.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.488+0000 7fb44d662640 1 --2- 172.21.15.99:0/1257387008 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb448100e00 0x7fb44819b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:17.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.488+0000 7fb44d662640 1 --2- 172.21.15.99:0/1257387008 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb4480ffc10 0x7fb4480689c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:17.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.488+0000 7fb44d662640 1 -- 172.21.15.99:0/1257387008 >> 172.21.15.99:0/1257387008 conn(0x7fb4480fb180 msgr2=0x7fb448104100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:17.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.489+0000 7fb44d662640 1 -- 172.21.15.99:0/1257387008 shutdown_connections 2024-01-31T05:09:17.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.489+0000 7fb44d662640 1 -- 172.21.15.99:0/1257387008 wait complete. 2024-01-31T05:09:17.499 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-31T05:04:46.842423+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-31T05:09:17.499 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-31T05:09:17.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:17 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:17.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:17 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:17.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:17 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:17.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:17 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:17.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:17 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:17.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:17 smithi181 ceph-mon[36434]: mds.? [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] up:boot 2024-01-31T05:09:17.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:17 smithi181 ceph-mon[36434]: fsmap 12 up:standby 2024-01-31T05:09:17.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:17 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-01-31T05:09:17.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:17 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:09:17.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:17 smithi181 ceph-mon[36434]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:09:17.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.605+0000 7fe9300b8640 1 -- 172.21.15.99:0/6021302 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9280ff5e0 msgr2=0x7fe9280ffa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:17.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.605+0000 7fe9300b8640 1 --2- 172.21.15.99:0/6021302 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9280ff5e0 0x7fe9280ffa00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe924009900 tx=0x7fe92402bcd0 comp rx=0 tx=0).stop 2024-01-31T05:09:17.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.605+0000 7fe9300b8640 1 -- 172.21.15.99:0/6021302 shutdown_connections 2024-01-31T05:09:17.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.605+0000 7fe9300b8640 1 --2- 172.21.15.99:0/6021302 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9281008e0 0x7fe928100d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:17.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.605+0000 7fe9300b8640 1 --2- 172.21.15.99:0/6021302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9280fff40 0x7fe9281003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:17.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.605+0000 7fe9300b8640 1 --2- 172.21.15.99:0/6021302 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9280ff5e0 0x7fe9280ffa00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:17.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.605+0000 7fe9300b8640 1 -- 172.21.15.99:0/6021302 >> 172.21.15.99:0/6021302 conn(0x7fe9280fb180 msgr2=0x7fe9280fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:17.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.605+0000 7fe9300b8640 1 -- 172.21.15.99:0/6021302 shutdown_connections 2024-01-31T05:09:17.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.605+0000 7fe9300b8640 1 -- 172.21.15.99:0/6021302 wait complete. 2024-01-31T05:09:17.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.606+0000 7fe9300b8640 1 Processor -- start 2024-01-31T05:09:17.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.606+0000 7fe9300b8640 1 -- start start 2024-01-31T05:09:17.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.606+0000 7fe9300b8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9280ff5e0 0x7fe928198ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:17.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.606+0000 7fe9300b8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9280fff40 0x7fe928199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:17.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.606+0000 7fe9300b8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9281008e0 0x7fe9281a0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:17.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.606+0000 7fe9300b8640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9281a09c0 con 0x7fe9281008e0 2024-01-31T05:09:17.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.606+0000 7fe9300b8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9281a0b30 con 0x7fe9280ff5e0 2024-01-31T05:09:17.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.606+0000 7fe9300b8640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9281a0cf0 con 0x7fe9280fff40 2024-01-31T05:09:17.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.606+0000 7fe92e655640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9281008e0 0x7fe9281a0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:17.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.606+0000 7fe92de54640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9280ff5e0 0x7fe928198ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:17.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.606+0000 7fe92d653640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9280fff40 0x7fe928199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:17.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.606+0000 7fe92e655640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9281008e0 0x7fe9281a0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52248/0 (socket says 172.21.15.99:52248) 2024-01-31T05:09:17.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.606+0000 7fe92e655640 1 -- 172.21.15.99:0/2848707833 learned_addr learned my addr 172.21.15.99:0/2848707833 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:09:17.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.607+0000 7fe92e655640 1 -- 172.21.15.99:0/2848707833 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9280fff40 msgr2=0x7fe928199410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:17.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.607+0000 7fe92e655640 1 --2- 172.21.15.99:0/2848707833 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9280fff40 0x7fe928199410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:17.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.607+0000 7fe92e655640 1 -- 172.21.15.99:0/2848707833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9280ff5e0 msgr2=0x7fe928198ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:17.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.607+0000 7fe92e655640 1 --2- 172.21.15.99:0/2848707833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9280ff5e0 0x7fe928198ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:17.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.607+0000 7fe92e655640 1 -- 172.21.15.99:0/2848707833 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe924009560 con 0x7fe9281008e0 2024-01-31T05:09:17.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.607+0000 7fe92de54640 1 --2- 172.21.15.99:0/2848707833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9280ff5e0 0x7fe928198ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:09:17.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.607+0000 7fe92e655640 1 --2- 172.21.15.99:0/2848707833 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9281008e0 0x7fe9281a0480 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe92000eb10 tx=0x7fe92000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:17.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.607+0000 7fe91effd640 1 -- 172.21.15.99:0/2848707833 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe920004b20 con 0x7fe9281008e0 2024-01-31T05:09:17.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.607+0000 7fe9300b8640 1 -- 172.21.15.99:0/2848707833 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9281a0fd0 con 0x7fe9281008e0 2024-01-31T05:09:17.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.607+0000 7fe91effd640 1 -- 172.21.15.99:0/2848707833 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe920004c80 con 0x7fe9281008e0 2024-01-31T05:09:17.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.607+0000 7fe91effd640 1 -- 172.21.15.99:0/2848707833 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe920010690 con 0x7fe9281008e0 2024-01-31T05:09:17.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.607+0000 7fe9300b8640 1 -- 172.21.15.99:0/2848707833 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9281a1450 con 0x7fe9281008e0 2024-01-31T05:09:17.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.608+0000 7fe9300b8640 1 -- 172.21.15.99:0/2848707833 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe92810a5b0 con 0x7fe9281008e0 2024-01-31T05:09:17.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.609+0000 7fe91effd640 1 -- 172.21.15.99:0/2848707833 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7fe920005020 con 0x7fe9281008e0 2024-01-31T05:09:17.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.610+0000 7fe91effd640 1 --2- 172.21.15.99:0/2848707833 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe9140a12e0 0x7fe9140a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:17.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.610+0000 7fe91effd640 1 -- 172.21.15.99:0/2848707833 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fe920014070 con 0x7fe9281008e0 2024-01-31T05:09:17.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.610+0000 7fe92de54640 1 --2- 172.21.15.99:0/2848707833 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe9140a12e0 0x7fe9140a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:17.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.610+0000 7fe92de54640 1 --2- 172.21.15.99:0/2848707833 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe9140a12e0 0x7fe9140a37a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe924005ab0 tx=0x7fe92402c670 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:17.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.614+0000 7fe91effd640 1 -- 172.21.15.99:0/2848707833 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fe9200964e0 con 0x7fe9281008e0 2024-01-31T05:09:17.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.817+0000 7fe9300b8640 1 -- 172.21.15.99:0/2848707833 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe92810e9f0 con 0x7fe9281008e0 2024-01-31T05:09:17.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.817+0000 7fe91effd640 1 -- 172.21.15.99:0/2848707833 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe920099b00 con 0x7fe9281008e0 2024-01-31T05:09:17.817 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-01-31T05:09:17.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.819+0000 7fe9300b8640 1 -- 172.21.15.99:0/2848707833 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe9140a12e0 msgr2=0x7fe9140a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:17.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.819+0000 7fe9300b8640 1 --2- 172.21.15.99:0/2848707833 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe9140a12e0 0x7fe9140a37a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe924005ab0 tx=0x7fe92402c670 comp rx=0 tx=0).stop 2024-01-31T05:09:17.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.819+0000 7fe9300b8640 1 -- 172.21.15.99:0/2848707833 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9281008e0 msgr2=0x7fe9281a0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:17.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.819+0000 7fe9300b8640 1 --2- 172.21.15.99:0/2848707833 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9281008e0 0x7fe9281a0480 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe92000eb10 tx=0x7fe92000c2d0 comp rx=0 tx=0).stop 2024-01-31T05:09:17.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.819+0000 7fe9300b8640 1 -- 172.21.15.99:0/2848707833 shutdown_connections 2024-01-31T05:09:17.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.819+0000 7fe9300b8640 1 --2- 172.21.15.99:0/2848707833 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe9140a12e0 0x7fe9140a37a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:17.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.819+0000 7fe9300b8640 1 --2- 172.21.15.99:0/2848707833 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9281008e0 0x7fe9281a0480 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:17.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.819+0000 7fe9300b8640 1 --2- 172.21.15.99:0/2848707833 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9280fff40 0x7fe928199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:17.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.819+0000 7fe9300b8640 1 --2- 172.21.15.99:0/2848707833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9280ff5e0 0x7fe928198ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:17.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.819+0000 7fe9300b8640 1 -- 172.21.15.99:0/2848707833 >> 172.21.15.99:0/2848707833 conn(0x7fe9280fb180 msgr2=0x7fe9280fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:17.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.819+0000 7fe9300b8640 1 -- 172.21.15.99:0/2848707833 shutdown_connections 2024-01-31T05:09:17.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.819+0000 7fe9300b8640 1 -- 172.21.15.99:0/2848707833 wait complete. 2024-01-31T05:09:17.830 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-31T05:09:17.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.954+0000 7ffa84a6e640 1 -- 172.21.15.99:0/1471548462 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa800fff60 msgr2=0x7ffa801003c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:17.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.954+0000 7ffa84a6e640 1 --2- 172.21.15.99:0/1471548462 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa800fff60 0x7ffa801003c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ffa74009900 tx=0x7ffa7402bcd0 comp rx=0 tx=0).stop 2024-01-31T05:09:17.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.955+0000 7ffa84a6e640 1 -- 172.21.15.99:0/1471548462 shutdown_connections 2024-01-31T05:09:17.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.955+0000 7ffa84a6e640 1 --2- 172.21.15.99:0/1471548462 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa80100900 0x7ffa80100d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:17.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.955+0000 7ffa84a6e640 1 --2- 172.21.15.99:0/1471548462 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa800fff60 0x7ffa801003c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:17.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.955+0000 7ffa84a6e640 1 --2- 172.21.15.99:0/1471548462 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa800ff600 0x7ffa800ffa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:17.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.955+0000 7ffa84a6e640 1 -- 172.21.15.99:0/1471548462 >> 172.21.15.99:0/1471548462 conn(0x7ffa800fb180 msgr2=0x7ffa800fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:17.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.955+0000 7ffa84a6e640 1 -- 172.21.15.99:0/1471548462 shutdown_connections 2024-01-31T05:09:17.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.955+0000 7ffa84a6e640 1 -- 172.21.15.99:0/1471548462 wait complete. 2024-01-31T05:09:17.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.955+0000 7ffa84a6e640 1 Processor -- start 2024-01-31T05:09:17.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.955+0000 7ffa84a6e640 1 -- start start 2024-01-31T05:09:17.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.956+0000 7ffa84a6e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa800ff600 0x7ffa80198f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:17.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.956+0000 7ffa84a6e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa800fff60 0x7ffa80199480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:17.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.956+0000 7ffa84a6e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa80100900 0x7ffa801a04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:17.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.956+0000 7ffa84a6e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa801a0a30 con 0x7ffa80100900 2024-01-31T05:09:17.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.956+0000 7ffa84a6e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa801a0ba0 con 0x7ffa800fff60 2024-01-31T05:09:17.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.956+0000 7ffa84a6e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa801a0d60 con 0x7ffa800ff600 2024-01-31T05:09:17.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.956+0000 7ffa7ed9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa80100900 0x7ffa801a04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:17.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.956+0000 7ffa7ed9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa80100900 0x7ffa801a04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52268/0 (socket says 172.21.15.99:52268) 2024-01-31T05:09:17.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.956+0000 7ffa7ed9d640 1 -- 172.21.15.99:0/2146432011 learned_addr learned my addr 172.21.15.99:0/2146432011 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:09:17.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.956+0000 7ffa7dd9b640 1 --2- 172.21.15.99:0/2146432011 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa800fff60 0x7ffa80199480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:17.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.956+0000 7ffa7e59c640 1 --2- 172.21.15.99:0/2146432011 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa800ff600 0x7ffa80198f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:17.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.956+0000 7ffa7ed9d640 1 -- 172.21.15.99:0/2146432011 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa800ff600 msgr2=0x7ffa80198f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:17.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.956+0000 7ffa7ed9d640 1 --2- 172.21.15.99:0/2146432011 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa800ff600 0x7ffa80198f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:17.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.956+0000 7ffa7ed9d640 1 -- 172.21.15.99:0/2146432011 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa800fff60 msgr2=0x7ffa80199480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:17.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.956+0000 7ffa7ed9d640 1 --2- 172.21.15.99:0/2146432011 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa800fff60 0x7ffa80199480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:17.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.956+0000 7ffa7ed9d640 1 -- 172.21.15.99:0/2146432011 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa74009560 con 0x7ffa80100900 2024-01-31T05:09:17.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.956+0000 7ffa7dd9b640 1 --2- 172.21.15.99:0/2146432011 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa800fff60 0x7ffa80199480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:09:17.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.956+0000 7ffa7ed9d640 1 --2- 172.21.15.99:0/2146432011 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa80100900 0x7ffa801a04f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ffa7800eb10 tx=0x7ffa7800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:17.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.958+0000 7ffa6f7fe640 1 -- 172.21.15.99:0/2146432011 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7800ce20 con 0x7ffa80100900 2024-01-31T05:09:17.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.958+0000 7ffa84a6e640 1 -- 172.21.15.99:0/2146432011 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa801a0fe0 con 0x7ffa80100900 2024-01-31T05:09:17.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.958+0000 7ffa84a6e640 1 -- 172.21.15.99:0/2146432011 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa801a1540 con 0x7ffa80100900 2024-01-31T05:09:17.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.959+0000 7ffa6f7fe640 1 -- 172.21.15.99:0/2146432011 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffa78005020 con 0x7ffa80100900 2024-01-31T05:09:17.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.959+0000 7ffa6f7fe640 1 -- 172.21.15.99:0/2146432011 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa780216a0 con 0x7ffa80100900 2024-01-31T05:09:17.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.960+0000 7ffa84a6e640 1 -- 172.21.15.99:0/2146432011 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa600052c0 con 0x7ffa80100900 2024-01-31T05:09:17.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.961+0000 7ffa6f7fe640 1 -- 172.21.15.99:0/2146432011 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7ffa78021800 con 0x7ffa80100900 2024-01-31T05:09:17.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.961+0000 7ffa6f7fe640 1 --2- 172.21.15.99:0/2146432011 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ffa680a12e0 0x7ffa680a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:17.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.961+0000 7ffa7e59c640 1 --2- 172.21.15.99:0/2146432011 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ffa680a12e0 0x7ffa680a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:17.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.962+0000 7ffa7e59c640 1 --2- 172.21.15.99:0/2146432011 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ffa680a12e0 0x7ffa680a37a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ffa70009990 tx=0x7ffa70009110 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:17.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.963+0000 7ffa6f7fe640 1 -- 172.21.15.99:0/2146432011 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ffa78014070 con 0x7ffa80100900 2024-01-31T05:09:17.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:17.968+0000 7ffa6f7fe640 1 -- 172.21.15.99:0/2146432011 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7ffa78096440 con 0x7ffa80100900 2024-01-31T05:09:18.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.147+0000 7ffa84a6e640 1 -- 172.21.15.99:0/2146432011 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ffa60005570 con 0x7ffa80100900 2024-01-31T05:09:18.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.148+0000 7ffa6f7fe640 1 -- 172.21.15.99:0/2146432011 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v82) v1 ==== 84+0+65 (secure 0 0 0) 0x7ffa78099a60 con 0x7ffa80100900 2024-01-31T05:09:18.147 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:09:18.147 INFO:teuthology.orchestra.run.smithi099.stdout:[ 2024-01-31T05:09:18.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:09:18.147 INFO:teuthology.orchestra.run.smithi099.stdout: "poolnum": 1, 2024-01-31T05:09:18.148 INFO:teuthology.orchestra.run.smithi099.stdout: "poolname": ".mgr" 2024-01-31T05:09:18.148 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:09:18.148 INFO:teuthology.orchestra.run.smithi099.stdout:] 2024-01-31T05:09:18.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.150+0000 7ffa84a6e640 1 -- 172.21.15.99:0/2146432011 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ffa680a12e0 msgr2=0x7ffa680a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:18.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.150+0000 7ffa84a6e640 1 --2- 172.21.15.99:0/2146432011 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ffa680a12e0 0x7ffa680a37a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ffa70009990 tx=0x7ffa70009110 comp rx=0 tx=0).stop 2024-01-31T05:09:18.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.150+0000 7ffa84a6e640 1 -- 172.21.15.99:0/2146432011 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa80100900 msgr2=0x7ffa801a04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:18.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.150+0000 7ffa84a6e640 1 --2- 172.21.15.99:0/2146432011 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa80100900 0x7ffa801a04f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ffa7800eb10 tx=0x7ffa7800ef10 comp rx=0 tx=0).stop 2024-01-31T05:09:18.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.150+0000 7ffa84a6e640 1 -- 172.21.15.99:0/2146432011 shutdown_connections 2024-01-31T05:09:18.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.150+0000 7ffa84a6e640 1 --2- 172.21.15.99:0/2146432011 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ffa680a12e0 0x7ffa680a37a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:18.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.150+0000 7ffa84a6e640 1 --2- 172.21.15.99:0/2146432011 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa80100900 0x7ffa801a04f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:18.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.150+0000 7ffa84a6e640 1 --2- 172.21.15.99:0/2146432011 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa800fff60 0x7ffa80199480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:18.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.150+0000 7ffa84a6e640 1 --2- 172.21.15.99:0/2146432011 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa800ff600 0x7ffa80198f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:18.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.150+0000 7ffa84a6e640 1 -- 172.21.15.99:0/2146432011 >> 172.21.15.99:0/2146432011 conn(0x7ffa800fb180 msgr2=0x7ffa800fc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:18.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.150+0000 7ffa84a6e640 1 -- 172.21.15.99:0/2146432011 shutdown_connections 2024-01-31T05:09:18.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.150+0000 7ffa84a6e640 1 -- 172.21.15.99:0/2146432011 wait complete. 2024-01-31T05:09:18.160 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-31T05:09:18.160 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-01-31T05:09:18.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.266+0000 7f24080c9640 1 -- 172.21.15.99:0/4107987521 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2400101790 msgr2=0x7f2400103b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:18.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.266+0000 7f24080c9640 1 --2- 172.21.15.99:0/4107987521 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2400101790 0x7f2400103b80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f23fc009900 tx=0x7f23fc02bc30 comp rx=0 tx=0).stop 2024-01-31T05:09:18.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.266+0000 7f24080c9640 1 -- 172.21.15.99:0/4107987521 shutdown_connections 2024-01-31T05:09:18.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.266+0000 7f24080c9640 1 --2- 172.21.15.99:0/4107987521 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24001069f0 0x7f2400108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:18.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.266+0000 7f24080c9640 1 --2- 172.21.15.99:0/4107987521 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24001040c0 0x7f24001064b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:18.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.266+0000 7f24080c9640 1 --2- 172.21.15.99:0/4107987521 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2400101790 0x7f2400103b80 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:18.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.266+0000 7f24080c9640 1 -- 172.21.15.99:0/4107987521 >> 172.21.15.99:0/4107987521 conn(0x7f24000fb1a0 msgr2=0x7f24000fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:18.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.266+0000 7f24080c9640 1 -- 172.21.15.99:0/4107987521 shutdown_connections 2024-01-31T05:09:18.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.266+0000 7f24080c9640 1 -- 172.21.15.99:0/4107987521 wait complete. 2024-01-31T05:09:18.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.267+0000 7f24080c9640 1 Processor -- start 2024-01-31T05:09:18.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.267+0000 7f24080c9640 1 -- start start 2024-01-31T05:09:18.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.267+0000 7f24080c9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2400101790 0x7f2400196d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:18.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.267+0000 7f24080c9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24001040c0 0x7f2400197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:18.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.267+0000 7f24080c9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24001069f0 0x7f240019e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:18.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.267+0000 7f24080c9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240019e820 con 0x7f2400101790 2024-01-31T05:09:18.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.267+0000 7f24080c9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240019e990 con 0x7f24001040c0 2024-01-31T05:09:18.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.267+0000 7f24080c9640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240019eb50 con 0x7f24001069f0 2024-01-31T05:09:18.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.267+0000 7f2405e65640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2400101790 0x7f2400196d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:18.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.267+0000 7f2405e65640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2400101790 0x7f2400196d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52286/0 (socket says 172.21.15.99:52286) 2024-01-31T05:09:18.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.267+0000 7f2405e65640 1 -- 172.21.15.99:0/3770479941 learned_addr learned my addr 172.21.15.99:0/3770479941 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:09:18.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.267+0000 7f2406666640 1 --2- 172.21.15.99:0/3770479941 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24001069f0 0x7f240019e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:18.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.267+0000 7f2405e65640 1 -- 172.21.15.99:0/3770479941 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24001069f0 msgr2=0x7f240019e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:18.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.267+0000 7f2405e65640 1 --2- 172.21.15.99:0/3770479941 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24001069f0 0x7f240019e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:18.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.267+0000 7f2405e65640 1 -- 172.21.15.99:0/3770479941 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24001040c0 msgr2=0x7f2400197280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:18.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.267+0000 7f2405e65640 1 --2- 172.21.15.99:0/3770479941 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24001040c0 0x7f2400197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:18.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.267+0000 7f2405e65640 1 -- 172.21.15.99:0/3770479941 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23fc009560 con 0x7f2400101790 2024-01-31T05:09:18.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.267+0000 7f2406666640 1 --2- 172.21.15.99:0/3770479941 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24001069f0 0x7f240019e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:09:18.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.267+0000 7f2405e65640 1 --2- 172.21.15.99:0/3770479941 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2400101790 0x7f2400196d40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f23fc009230 tx=0x7f23fc004ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:18.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.268+0000 7f23f6ffd640 1 -- 172.21.15.99:0/3770479941 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23fc0043d0 con 0x7f2400101790 2024-01-31T05:09:18.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.268+0000 7f23f6ffd640 1 -- 172.21.15.99:0/3770479941 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f23fc0054c0 con 0x7f2400101790 2024-01-31T05:09:18.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.268+0000 7f24080c9640 1 -- 172.21.15.99:0/3770479941 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f240019edd0 con 0x7f2400101790 2024-01-31T05:09:18.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.268+0000 7f23f6ffd640 1 -- 172.21.15.99:0/3770479941 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23fc03e450 con 0x7f2400101790 2024-01-31T05:09:18.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.268+0000 7f24080c9640 1 -- 172.21.15.99:0/3770479941 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f240019f220 con 0x7f2400101790 2024-01-31T05:09:18.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.268+0000 7f24080c9640 1 -- 172.21.15.99:0/3770479941 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24000fcc90 con 0x7f2400101790 2024-01-31T05:09:18.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.270+0000 7f23f6ffd640 1 -- 172.21.15.99:0/3770479941 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f23fc0035f0 con 0x7f2400101790 2024-01-31T05:09:18.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.270+0000 7f23f6ffd640 1 --2- 172.21.15.99:0/3770479941 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f23ec0a12e0 0x7f23ec0a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:18.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.270+0000 7f2405664640 1 --2- 172.21.15.99:0/3770479941 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f23ec0a12e0 0x7f23ec0a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:18.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.270+0000 7f23f6ffd640 1 -- 172.21.15.99:0/3770479941 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f23fc0ef620 con 0x7f2400101790 2024-01-31T05:09:18.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.271+0000 7f2405664640 1 --2- 172.21.15.99:0/3770479941 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f23ec0a12e0 0x7f23ec0a37a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f23f0005fd0 tx=0x7f23f0005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:18.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.274+0000 7f23f6ffd640 1 -- 172.21.15.99:0/3770479941 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f23fc0b8eb0 con 0x7f2400101790 2024-01-31T05:09:18.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:18.446+0000 7f24080c9640 1 -- 172.21.15.99:0/3770479941 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f240010c5f0 con 0x7f2400101790 2024-01-31T05:09:18.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:18 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/2572648563' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:09:18.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:18 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/1257387008' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:09:18.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:18 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/2848707833' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-31T05:09:18.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:18 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:18.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:18 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:18.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:18 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:18.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:18 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:18.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:18 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:18.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:18 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:18.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:18 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/2146432011' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-01-31T05:09:18.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:18 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/2572648563' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:09:18.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:18 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/1257387008' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:09:18.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:18 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/2848707833' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-31T05:09:18.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:18 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:18.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:18 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:18.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:18 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:18.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:18 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:18.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:18 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:18.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:18 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:18.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:18 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/2146432011' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-01-31T05:09:18.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:18 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/2572648563' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:09:18.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:18 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/1257387008' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:09:18.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:18 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/2848707833' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-31T05:09:18.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:18 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:18.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:18 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:18.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:18 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:18.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:18 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:18.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:18 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:18.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:18 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:18.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:18 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/2146432011' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-01-31T05:09:19.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.165+0000 7f23f6ffd640 1 -- 172.21.15.99:0/3770479941 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v83) v1 ==== 138+0+0 (secure 0 0 0) 0x7f23fc0bade0 con 0x7f2400101790 2024-01-31T05:09:19.164 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_metadata' created 2024-01-31T05:09:19.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.167+0000 7f24080c9640 1 -- 172.21.15.99:0/3770479941 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f23ec0a12e0 msgr2=0x7f23ec0a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:19.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.167+0000 7f24080c9640 1 --2- 172.21.15.99:0/3770479941 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f23ec0a12e0 0x7f23ec0a37a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f23f0005fd0 tx=0x7f23f0005850 comp rx=0 tx=0).stop 2024-01-31T05:09:19.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.167+0000 7f24080c9640 1 -- 172.21.15.99:0/3770479941 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2400101790 msgr2=0x7f2400196d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:19.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.167+0000 7f24080c9640 1 --2- 172.21.15.99:0/3770479941 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2400101790 0x7f2400196d40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f23fc009230 tx=0x7f23fc004ee0 comp rx=0 tx=0).stop 2024-01-31T05:09:19.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.167+0000 7f24080c9640 1 -- 172.21.15.99:0/3770479941 shutdown_connections 2024-01-31T05:09:19.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.167+0000 7f24080c9640 1 --2- 172.21.15.99:0/3770479941 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f23ec0a12e0 0x7f23ec0a37a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:19.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.167+0000 7f24080c9640 1 --2- 172.21.15.99:0/3770479941 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24001069f0 0x7f240019e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:19.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.167+0000 7f24080c9640 1 --2- 172.21.15.99:0/3770479941 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24001040c0 0x7f2400197280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:19.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.167+0000 7f24080c9640 1 --2- 172.21.15.99:0/3770479941 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2400101790 0x7f2400196d40 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:19.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.167+0000 7f24080c9640 1 -- 172.21.15.99:0/3770479941 >> 172.21.15.99:0/3770479941 conn(0x7f24000fb1a0 msgr2=0x7f2400102290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:19.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.167+0000 7f24080c9640 1 -- 172.21.15.99:0/3770479941 shutdown_connections 2024-01-31T05:09:19.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.168+0000 7f24080c9640 1 -- 172.21.15.99:0/3770479941 wait complete. 2024-01-31T05:09:19.182 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-31T05:09:19.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.297+0000 7efc847fb640 1 -- 172.21.15.99:0/2537295326 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc7c101f80 msgr2=0x7efc7c102400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:19.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.297+0000 7efc847fb640 1 --2- 172.21.15.99:0/2537295326 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc7c101f80 0x7efc7c102400 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efc6c009900 tx=0x7efc6c02bc30 comp rx=0 tx=0).stop 2024-01-31T05:09:19.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.298+0000 7efc847fb640 1 -- 172.21.15.99:0/2537295326 shutdown_connections 2024-01-31T05:09:19.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.298+0000 7efc847fb640 1 --2- 172.21.15.99:0/2537295326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc7c102940 0x7efc7c1091d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:19.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.298+0000 7efc847fb640 1 --2- 172.21.15.99:0/2537295326 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc7c101f80 0x7efc7c102400 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:19.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.298+0000 7efc847fb640 1 --2- 172.21.15.99:0/2537295326 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc7c0fefb0 0x7efc7c0ff3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:19.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.298+0000 7efc847fb640 1 -- 172.21.15.99:0/2537295326 >> 172.21.15.99:0/2537295326 conn(0x7efc7c0fa8e0 msgr2=0x7efc7c0fcd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:19.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.298+0000 7efc847fb640 1 -- 172.21.15.99:0/2537295326 shutdown_connections 2024-01-31T05:09:19.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.298+0000 7efc847fb640 1 -- 172.21.15.99:0/2537295326 wait complete. 2024-01-31T05:09:19.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.298+0000 7efc847fb640 1 Processor -- start 2024-01-31T05:09:19.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.298+0000 7efc847fb640 1 -- start start 2024-01-31T05:09:19.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.299+0000 7efc847fb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc7c0fefb0 0x7efc7c196cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:19.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.299+0000 7efc847fb640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc7c101f80 0x7efc7c197230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:19.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.299+0000 7efc847fb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc7c102940 0x7efc7c19e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:19.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.299+0000 7efc847fb640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c19e7d0 con 0x7efc7c102940 2024-01-31T05:09:19.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.299+0000 7efc847fb640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c19e940 con 0x7efc7c101f80 2024-01-31T05:09:19.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.299+0000 7efc847fb640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c19eb00 con 0x7efc7c0fefb0 2024-01-31T05:09:19.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.299+0000 7efc82d98640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc7c102940 0x7efc7c19e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:19.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.299+0000 7efc82d98640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc7c102940 0x7efc7c19e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52298/0 (socket says 172.21.15.99:52298) 2024-01-31T05:09:19.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.299+0000 7efc82d98640 1 -- 172.21.15.99:0/4235056882 learned_addr learned my addr 172.21.15.99:0/4235056882 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:09:19.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.299+0000 7efc82597640 1 --2- 172.21.15.99:0/4235056882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc7c0fefb0 0x7efc7c196cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:19.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.299+0000 7efc81d96640 1 --2- 172.21.15.99:0/4235056882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc7c101f80 0x7efc7c197230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:19.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.299+0000 7efc82d98640 1 -- 172.21.15.99:0/4235056882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc7c0fefb0 msgr2=0x7efc7c196cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:19.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.299+0000 7efc82d98640 1 --2- 172.21.15.99:0/4235056882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc7c0fefb0 0x7efc7c196cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:19.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.299+0000 7efc82d98640 1 -- 172.21.15.99:0/4235056882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc7c101f80 msgr2=0x7efc7c197230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:19.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.299+0000 7efc82d98640 1 --2- 172.21.15.99:0/4235056882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc7c101f80 0x7efc7c197230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:19.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.299+0000 7efc82d98640 1 -- 172.21.15.99:0/4235056882 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc6c009560 con 0x7efc7c102940 2024-01-31T05:09:19.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.299+0000 7efc82d98640 1 --2- 172.21.15.99:0/4235056882 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc7c102940 0x7efc7c19e260 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7efc7400eb10 tx=0x7efc7400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:19.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.299+0000 7efc737fe640 1 -- 172.21.15.99:0/4235056882 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc74004b20 con 0x7efc7c102940 2024-01-31T05:09:19.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.299+0000 7efc737fe640 1 -- 172.21.15.99:0/4235056882 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efc74004c80 con 0x7efc7c102940 2024-01-31T05:09:19.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.299+0000 7efc847fb640 1 -- 172.21.15.99:0/4235056882 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc7c19ede0 con 0x7efc7c102940 2024-01-31T05:09:19.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.299+0000 7efc737fe640 1 -- 172.21.15.99:0/4235056882 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc74010690 con 0x7efc7c102940 2024-01-31T05:09:19.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.300+0000 7efc847fb640 1 -- 172.21.15.99:0/4235056882 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc7c19f1b0 con 0x7efc7c102940 2024-01-31T05:09:19.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.300+0000 7efc847fb640 1 -- 172.21.15.99:0/4235056882 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc7c108180 con 0x7efc7c102940 2024-01-31T05:09:19.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.302+0000 7efc737fe640 1 -- 172.21.15.99:0/4235056882 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7efc74004fd0 con 0x7efc7c102940 2024-01-31T05:09:19.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.302+0000 7efc737fe640 1 --2- 172.21.15.99:0/4235056882 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7efc680a12e0 0x7efc680a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:19.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.302+0000 7efc737fe640 1 -- 172.21.15.99:0/4235056882 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7497+0+0 (secure 0 0 0) 0x7efc74014070 con 0x7efc7c102940 2024-01-31T05:09:19.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.302+0000 7efc82597640 1 --2- 172.21.15.99:0/4235056882 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7efc680a12e0 0x7efc680a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:19.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.303+0000 7efc82597640 1 --2- 172.21.15.99:0/4235056882 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7efc680a12e0 0x7efc680a37a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efc7c1981c0 tx=0x7efc7800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:19.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.309+0000 7efc737fe640 1 -- 172.21.15.99:0/4235056882 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7efc74096600 con 0x7efc7c102940 2024-01-31T05:09:19.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:19.492+0000 7efc847fb640 1 -- 172.21.15.99:0/4235056882 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7efc7c10c5a0 con 0x7efc7c102940 2024-01-31T05:09:19.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:19 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/3770479941' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-01-31T05:09:19.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:19 smithi099 ceph-mon[31615]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:09:19.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:19 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:09:19.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:19 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:09:19.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:19 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:19.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:19 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:09:19.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:19 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/3770479941' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-01-31T05:09:19.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:19 smithi181 ceph-mon[36434]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:09:19.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:19 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:09:19.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:19 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:09:19.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:19 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:19.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:19 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:09:19.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:19 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/3770479941' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-01-31T05:09:19.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:19 smithi179 ceph-mon[35652]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:09:19.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:19 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:09:19.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:19 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:09:19.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:19 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:19.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:19 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:09:20.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.167+0000 7efc737fe640 1 -- 172.21.15.99:0/4235056882 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v84) v1 ==== 170+0+0 (secure 0 0 0) 0x7efc74098530 con 0x7efc7c102940 2024-01-31T05:09:20.166 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_data' created 2024-01-31T05:09:20.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.174+0000 7efc847fb640 1 -- 172.21.15.99:0/4235056882 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7efc680a12e0 msgr2=0x7efc680a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:20.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.174+0000 7efc847fb640 1 --2- 172.21.15.99:0/4235056882 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7efc680a12e0 0x7efc680a37a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efc7c1981c0 tx=0x7efc7800b410 comp rx=0 tx=0).stop 2024-01-31T05:09:20.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.174+0000 7efc847fb640 1 -- 172.21.15.99:0/4235056882 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc7c102940 msgr2=0x7efc7c19e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:20.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.174+0000 7efc847fb640 1 --2- 172.21.15.99:0/4235056882 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc7c102940 0x7efc7c19e260 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7efc7400eb10 tx=0x7efc7400c2d0 comp rx=0 tx=0).stop 2024-01-31T05:09:20.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.176+0000 7efc847fb640 1 -- 172.21.15.99:0/4235056882 shutdown_connections 2024-01-31T05:09:20.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.176+0000 7efc847fb640 1 --2- 172.21.15.99:0/4235056882 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7efc680a12e0 0x7efc680a37a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:20.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.176+0000 7efc847fb640 1 --2- 172.21.15.99:0/4235056882 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc7c102940 0x7efc7c19e260 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:20.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.176+0000 7efc847fb640 1 --2- 172.21.15.99:0/4235056882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efc7c101f80 0x7efc7c197230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:20.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.176+0000 7efc847fb640 1 --2- 172.21.15.99:0/4235056882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc7c0fefb0 0x7efc7c196cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:20.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.176+0000 7efc847fb640 1 -- 172.21.15.99:0/4235056882 >> 172.21.15.99:0/4235056882 conn(0x7efc7c0fa8e0 msgr2=0x7efc7c105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:20.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.177+0000 7efc847fb640 1 -- 172.21.15.99:0/4235056882 shutdown_connections 2024-01-31T05:09:20.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.177+0000 7efc847fb640 1 -- 172.21.15.99:0/4235056882 wait complete. 2024-01-31T05:09:20.196 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-31T05:09:20.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.308+0000 7f01a07d0640 1 -- 172.21.15.99:0/1338073269 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0198100d00 msgr2=0x7f0198101120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:20.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.308+0000 7f01a07d0640 1 --2- 172.21.15.99:0/1338073269 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0198100d00 0x7f0198101120 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0194009900 tx=0x7f019402bc30 comp rx=0 tx=0).stop 2024-01-31T05:09:20.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.308+0000 7f01a07d0640 1 -- 172.21.15.99:0/1338073269 shutdown_connections 2024-01-31T05:09:20.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.308+0000 7f01a07d0640 1 --2- 172.21.15.99:0/1338073269 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01981028b0 0x7f0198109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:20.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.308+0000 7f01a07d0640 1 --2- 172.21.15.99:0/1338073269 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0198101ef0 0x7f0198102370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:20.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.308+0000 7f01a07d0640 1 --2- 172.21.15.99:0/1338073269 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0198100d00 0x7f0198101120 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:20.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.308+0000 7f01a07d0640 1 -- 172.21.15.99:0/1338073269 >> 172.21.15.99:0/1338073269 conn(0x7f01980fc250 msgr2=0x7f01980fe6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:20.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.308+0000 7f01a07d0640 1 -- 172.21.15.99:0/1338073269 shutdown_connections 2024-01-31T05:09:20.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.308+0000 7f01a07d0640 1 -- 172.21.15.99:0/1338073269 wait complete. 2024-01-31T05:09:20.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.309+0000 7f01a07d0640 1 Processor -- start 2024-01-31T05:09:20.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.309+0000 7f01a07d0640 1 -- start start 2024-01-31T05:09:20.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.309+0000 7f01a07d0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0198100d00 0x7f0198196d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:20.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.309+0000 7f01a07d0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0198101ef0 0x7f0198197290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:20.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.309+0000 7f01a07d0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01981028b0 0x7f019819e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:20.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.309+0000 7f01a07d0640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019819e830 con 0x7f0198101ef0 2024-01-31T05:09:20.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.309+0000 7f01a07d0640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019819e9a0 con 0x7f01981028b0 2024-01-31T05:09:20.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.309+0000 7f01a07d0640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019819eb60 con 0x7f0198100d00 2024-01-31T05:09:20.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.309+0000 7f019dd6b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0198101ef0 0x7f0198197290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:20.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.309+0000 7f019dd6b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0198101ef0 0x7f0198197290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52316/0 (socket says 172.21.15.99:52316) 2024-01-31T05:09:20.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.309+0000 7f019dd6b640 1 -- 172.21.15.99:0/960855348 learned_addr learned my addr 172.21.15.99:0/960855348 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:09:20.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.309+0000 7f019ed6d640 1 --2- 172.21.15.99:0/960855348 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01981028b0 0x7f019819e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:20.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.309+0000 7f019e56c640 1 --2- 172.21.15.99:0/960855348 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0198100d00 0x7f0198196d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:20.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.309+0000 7f019dd6b640 1 -- 172.21.15.99:0/960855348 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0198100d00 msgr2=0x7f0198196d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:20.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.309+0000 7f019dd6b640 1 --2- 172.21.15.99:0/960855348 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0198100d00 0x7f0198196d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:20.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.309+0000 7f019dd6b640 1 -- 172.21.15.99:0/960855348 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01981028b0 msgr2=0x7f019819e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:20.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.309+0000 7f019dd6b640 1 --2- 172.21.15.99:0/960855348 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01981028b0 0x7f019819e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:20.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.309+0000 7f019dd6b640 1 -- 172.21.15.99:0/960855348 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0194009560 con 0x7f0198101ef0 2024-01-31T05:09:20.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.310+0000 7f019dd6b640 1 --2- 172.21.15.99:0/960855348 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0198101ef0 0x7f0198197290 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f018800d950 tx=0x7f018800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:20.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.310+0000 7f018f7fe640 1 -- 172.21.15.99:0/960855348 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0188009a30 con 0x7f0198101ef0 2024-01-31T05:09:20.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.310+0000 7f01a07d0640 1 -- 172.21.15.99:0/960855348 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f019819ee40 con 0x7f0198101ef0 2024-01-31T05:09:20.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.310+0000 7f018f7fe640 1 -- 172.21.15.99:0/960855348 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0188009b90 con 0x7f0198101ef0 2024-01-31T05:09:20.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.310+0000 7f018f7fe640 1 -- 172.21.15.99:0/960855348 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01880047a0 con 0x7f0198101ef0 2024-01-31T05:09:20.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.310+0000 7f01a07d0640 1 -- 172.21.15.99:0/960855348 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f019819f260 con 0x7f0198101ef0 2024-01-31T05:09:20.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.311+0000 7f01a07d0640 1 -- 172.21.15.99:0/960855348 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0198108200 con 0x7f0198101ef0 2024-01-31T05:09:20.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.312+0000 7f018f7fe640 1 -- 172.21.15.99:0/960855348 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f0188009d00 con 0x7f0198101ef0 2024-01-31T05:09:20.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.313+0000 7f018f7fe640 1 --2- 172.21.15.99:0/960855348 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f01840a12e0 0x7f01840a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:20.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.313+0000 7f019e56c640 1 --2- 172.21.15.99:0/960855348 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f01840a12e0 0x7f01840a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:20.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.313+0000 7f018f7fe640 1 -- 172.21.15.99:0/960855348 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7879+0+0 (secure 0 0 0) 0x7f01880ccaf0 con 0x7f0198101ef0 2024-01-31T05:09:20.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.313+0000 7f019e56c640 1 --2- 172.21.15.99:0/960855348 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f01840a12e0 0x7f01840a37a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0194000c00 tx=0x7f019402c5d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:20.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.316+0000 7f018f7fe640 1 -- 172.21.15.99:0/960855348 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f0188096090 con 0x7f0198101ef0 2024-01-31T05:09:20.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:20.561+0000 7f01a07d0640 1 -- 172.21.15.99:0/960855348 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f019810c590 con 0x7f0198101ef0 2024-01-31T05:09:20.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:20 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/3770479941' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-01-31T05:09:20.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:20 smithi099 ceph-mon[31615]: osdmap e83: 12 total, 12 up, 12 in 2024-01-31T05:09:20.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:20 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/4235056882' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-01-31T05:09:20.573 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:20 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/3770479941' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-01-31T05:09:20.574 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:20 smithi181 ceph-mon[36434]: osdmap e83: 12 total, 12 up, 12 in 2024-01-31T05:09:20.574 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:20 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/4235056882' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-01-31T05:09:20.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:20 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/3770479941' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-01-31T05:09:20.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:20 smithi179 ceph-mon[35652]: osdmap e83: 12 total, 12 up, 12 in 2024-01-31T05:09:20.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:20 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/4235056882' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-01-31T05:09:21.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.562+0000 7f018f7fe640 1 -- 172.21.15.99:0/960855348 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f0188017020 con 0x7f0198101ef0 2024-01-31T05:09:21.562 INFO:teuthology.orchestra.run.smithi099.stderr:new fs with metadata pool 2 and data pool 3 2024-01-31T05:09:21.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.565+0000 7f01a07d0640 1 -- 172.21.15.99:0/960855348 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f01840a12e0 msgr2=0x7f01840a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:21.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.565+0000 7f01a07d0640 1 --2- 172.21.15.99:0/960855348 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f01840a12e0 0x7f01840a37a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0194000c00 tx=0x7f019402c5d0 comp rx=0 tx=0).stop 2024-01-31T05:09:21.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.565+0000 7f01a07d0640 1 -- 172.21.15.99:0/960855348 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0198101ef0 msgr2=0x7f0198197290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:21.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.565+0000 7f01a07d0640 1 --2- 172.21.15.99:0/960855348 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0198101ef0 0x7f0198197290 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f018800d950 tx=0x7f018800de10 comp rx=0 tx=0).stop 2024-01-31T05:09:21.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.565+0000 7f01a07d0640 1 -- 172.21.15.99:0/960855348 shutdown_connections 2024-01-31T05:09:21.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.565+0000 7f01a07d0640 1 --2- 172.21.15.99:0/960855348 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f01840a12e0 0x7f01840a37a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:21.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.565+0000 7f01a07d0640 1 --2- 172.21.15.99:0/960855348 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01981028b0 0x7f019819e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:21.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.565+0000 7f01a07d0640 1 --2- 172.21.15.99:0/960855348 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0198101ef0 0x7f0198197290 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:21.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.565+0000 7f01a07d0640 1 --2- 172.21.15.99:0/960855348 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0198100d00 0x7f0198196d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:21.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.565+0000 7f01a07d0640 1 -- 172.21.15.99:0/960855348 >> 172.21.15.99:0/960855348 conn(0x7f01980fc250 msgr2=0x7f01981053d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:21.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.565+0000 7f01a07d0640 1 -- 172.21.15.99:0/960855348 shutdown_connections 2024-01-31T05:09:21.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.565+0000 7f01a07d0640 1 -- 172.21.15.99:0/960855348 wait complete. 2024-01-31T05:09:21.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:21 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/4235056882' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-01-31T05:09:21.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:21 smithi099 ceph-mon[31615]: osdmap e84: 12 total, 12 up, 12 in 2024-01-31T05:09:21.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:21 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:21.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:21 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:21.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:21 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:21.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:21 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:21.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:21 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:21.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:21 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/960855348' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-01-31T05:09:21.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:21 smithi099 ceph-mon[31615]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-01-31T05:09:21.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:21 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:21.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:21 smithi099 ceph-mon[31615]: osdmap e85: 12 total, 12 up, 12 in 2024-01-31T05:09:21.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:21 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:09:21.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:21 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:09:21.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:21 smithi099 ceph-mon[31615]: pgmap v285: 97 pgs: 96 unknown, 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:09:21.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:21 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:21.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:21 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:21.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:21 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/4235056882' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-01-31T05:09:21.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:21 smithi181 ceph-mon[36434]: osdmap e84: 12 total, 12 up, 12 in 2024-01-31T05:09:21.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:21 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:21.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:21 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:21.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:21 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:21.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:21 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:21.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:21 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:21.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:21 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/960855348' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-01-31T05:09:21.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:21 smithi181 ceph-mon[36434]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-01-31T05:09:21.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:21 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:21.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:21 smithi181 ceph-mon[36434]: osdmap e85: 12 total, 12 up, 12 in 2024-01-31T05:09:21.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:21 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:09:21.575 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:21 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:09:21.576 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:21 smithi181 ceph-mon[36434]: pgmap v285: 97 pgs: 96 unknown, 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:09:21.576 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:21 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:21.576 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:21 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:21.580 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:09:21.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:21 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/4235056882' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-01-31T05:09:21.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:21 smithi179 ceph-mon[35652]: osdmap e84: 12 total, 12 up, 12 in 2024-01-31T05:09:21.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:21 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:21.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:21 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:21.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:21 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:21.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:21 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:21.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:21 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:21.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:21 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/960855348' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-01-31T05:09:21.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:21 smithi179 ceph-mon[35652]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-01-31T05:09:21.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:21 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:21.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:21 smithi179 ceph-mon[35652]: osdmap e85: 12 total, 12 up, 12 in 2024-01-31T05:09:21.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:21 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:09:21.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:21 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:09:21.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:21 smithi179 ceph-mon[35652]: pgmap v285: 97 pgs: 96 unknown, 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:09:21.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:21 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:21.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:21 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:09:21.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.684+0000 7fab4b372640 1 -- 172.21.15.99:0/2138000132 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab44100d20 msgr2=0x7fab44101140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:21.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.684+0000 7fab4b372640 1 --2- 172.21.15.99:0/2138000132 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab44100d20 0x7fab44101140 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fab40009900 tx=0x7fab4002bc30 comp rx=0 tx=0).stop 2024-01-31T05:09:21.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.684+0000 7fab4b372640 1 -- 172.21.15.99:0/2138000132 shutdown_connections 2024-01-31T05:09:21.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.684+0000 7fab4b372640 1 --2- 172.21.15.99:0/2138000132 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab441028d0 0x7fab44109160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:21.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.684+0000 7fab4b372640 1 --2- 172.21.15.99:0/2138000132 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fab44101f10 0x7fab44102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:21.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.684+0000 7fab4b372640 1 --2- 172.21.15.99:0/2138000132 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab44100d20 0x7fab44101140 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:21.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.684+0000 7fab4b372640 1 -- 172.21.15.99:0/2138000132 >> 172.21.15.99:0/2138000132 conn(0x7fab440fc290 msgr2=0x7fab440fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:21.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.684+0000 7fab4b372640 1 -- 172.21.15.99:0/2138000132 shutdown_connections 2024-01-31T05:09:21.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.684+0000 7fab4b372640 1 -- 172.21.15.99:0/2138000132 wait complete. 2024-01-31T05:09:21.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.685+0000 7fab4b372640 1 Processor -- start 2024-01-31T05:09:21.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.685+0000 7fab4b372640 1 -- start start 2024-01-31T05:09:21.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.685+0000 7fab4b372640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fab44100d20 0x7fab44196db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:21.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.685+0000 7fab4b372640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab44101f10 0x7fab441972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:21.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.685+0000 7fab4b372640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab441028d0 0x7fab4419e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:21.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.685+0000 7fab4b372640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4419e890 con 0x7fab441028d0 2024-01-31T05:09:21.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.685+0000 7fab4b372640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4419ea00 con 0x7fab44101f10 2024-01-31T05:09:21.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.685+0000 7fab4b372640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4419ebc0 con 0x7fab44100d20 2024-01-31T05:09:21.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.685+0000 7fab4990f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab441028d0 0x7fab4419e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:21.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.685+0000 7fab4990f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab441028d0 0x7fab4419e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52344/0 (socket says 172.21.15.99:52344) 2024-01-31T05:09:21.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.685+0000 7fab4990f640 1 -- 172.21.15.99:0/652075496 learned_addr learned my addr 172.21.15.99:0/652075496 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:09:21.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.685+0000 7fab4910e640 1 --2- 172.21.15.99:0/652075496 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fab44100d20 0x7fab44196db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:21.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.685+0000 7fab4890d640 1 --2- 172.21.15.99:0/652075496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab44101f10 0x7fab441972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:21.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.685+0000 7fab4990f640 1 -- 172.21.15.99:0/652075496 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fab44100d20 msgr2=0x7fab44196db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:21.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.685+0000 7fab4990f640 1 --2- 172.21.15.99:0/652075496 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fab44100d20 0x7fab44196db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:21.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.685+0000 7fab4990f640 1 -- 172.21.15.99:0/652075496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab44101f10 msgr2=0x7fab441972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:21.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.685+0000 7fab4990f640 1 --2- 172.21.15.99:0/652075496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab44101f10 0x7fab441972f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:21.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.685+0000 7fab4990f640 1 -- 172.21.15.99:0/652075496 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab40009560 con 0x7fab441028d0 2024-01-31T05:09:21.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.685+0000 7fab4990f640 1 --2- 172.21.15.99:0/652075496 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab441028d0 0x7fab4419e320 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fab3c00b970 tx=0x7fab3c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:21.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.686+0000 7fab3a7fc640 1 -- 172.21.15.99:0/652075496 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3c00cb40 con 0x7fab441028d0 2024-01-31T05:09:21.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.686+0000 7fab3a7fc640 1 -- 172.21.15.99:0/652075496 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fab3c00cca0 con 0x7fab441028d0 2024-01-31T05:09:21.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.686+0000 7fab4b372640 1 -- 172.21.15.99:0/652075496 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab4419eea0 con 0x7fab441028d0 2024-01-31T05:09:21.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.686+0000 7fab3a7fc640 1 -- 172.21.15.99:0/652075496 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3c007770 con 0x7fab441028d0 2024-01-31T05:09:21.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.686+0000 7fab4b372640 1 -- 172.21.15.99:0/652075496 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab4419f2f0 con 0x7fab441028d0 2024-01-31T05:09:21.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.687+0000 7fab4b372640 1 -- 172.21.15.99:0/652075496 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab44108110 con 0x7fab441028d0 2024-01-31T05:09:21.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.688+0000 7fab3a7fc640 1 -- 172.21.15.99:0/652075496 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7fab3c014440 con 0x7fab441028d0 2024-01-31T05:09:21.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.688+0000 7fab3a7fc640 1 --2- 172.21.15.99:0/652075496 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fab300a12e0 0x7fab300a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:21.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.688+0000 7fab4910e640 1 --2- 172.21.15.99:0/652075496 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fab300a12e0 0x7fab300a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:21.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.689+0000 7fab3a7fc640 1 -- 172.21.15.99:0/652075496 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fab3c0cc350 con 0x7fab441028d0 2024-01-31T05:09:21.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.689+0000 7fab4910e640 1 --2- 172.21.15.99:0/652075496 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fab300a12e0 0x7fab300a37a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fab40000c00 tx=0x7fab4002c5d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:21.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.693+0000 7fab3a7fc640 1 -- 172.21.15.99:0/652075496 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fab3c04f600 con 0x7fab441028d0 2024-01-31T05:09:21.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.865+0000 7fab4b372640 1 -- 172.21.15.99:0/652075496 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab4410c850 con 0x7fab441028d0 2024-01-31T05:09:21.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.866+0000 7fab3a7fc640 1 -- 172.21.15.99:0/652075496 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22132 (secure 0 0 0) 0x7fab3c095940 con 0x7fab441028d0 2024-01-31T05:09:21.866 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:09:21.866 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":86,"fsid":"9288ff44-bff5-11ee-95b3-87774f69a715","created":"2024-01-31T05:01:26.130917+0000","modified":"2024-01-31T05:09:21.567593+0000","last_up_change":"2024-01-31T05:08:31.228478+0000","last_in_change":"2024-01-31T05:08:10.799511+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:46.842423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:09:18.693558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-31T05:09:19.734003+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b45878d9-28f1-4821-ba72-26a32d3fc780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6803","nonce":1213805280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6805","nonce":1213805280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6809","nonce":1213805280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6807","nonce":1213805280}]},"public_addr":"172.21.15.99:6803/1213805280","cluster_addr":"172.21.15.99:6805/1213805280","heartbeat_back_addr":"172.21.15.99:6809/1213805280","heartbeat_front_addr":"172.21.15.99:6807/1213805280","state":["exists","up"]},{"osd":1,"uuid":"e0b71ff3-5d97-4659-8dea-4c9091e1beb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6801","nonce":2019451677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6803","nonce":2019451677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6807","nonce":2019451677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6805","nonce":2019451677}]},"public_addr":"172.21.15.179:6801/2019451677","cluster_addr":"172.21.15.179:6803/2019451677","heartbeat_back_addr":"172.21.15.179:6807/2019451677","heartbeat_front_addr":"172.21.15.179:6805/2019451677","state":["exists","up"]},{"osd":2,"uuid":"11c919c8-19a9-48b0-8880-3002efcb64f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6801","nonce":3934284457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6803","nonce":3934284457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6807","nonce":3934284457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6805","nonce":3934284457}]},"public_addr":"172.21.15.181:6801/3934284457","cluster_addr":"172.21.15.181:6803/3934284457","heartbeat_back_addr":"172.21.15.181:6807/3934284457","heartbeat_front_addr":"172.21.15.181:6805/3934284457","state":["exists","up"]},{"osd":3,"uuid":"bcab5135-a5d1-45ae-a9b8-674425d3999e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6811","nonce":4207675427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6813","nonce":4207675427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6817","nonce":4207675427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6815","nonce":4207675427}]},"public_addr":"172.21.15.99:6811/4207675427","cluster_addr":"172.21.15.99:6813/4207675427","heartbeat_back_addr":"172.21.15.99:6817/4207675427","heartbeat_front_addr":"172.21.15.99:6815/4207675427","state":["exists","up"]},{"osd":4,"uuid":"0250d7ac-3894-457a-9c04-cc7205d61eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6809","nonce":2861083896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6811","nonce":2861083896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6815","nonce":2861083896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6813","nonce":2861083896}]},"public_addr":"172.21.15.179:6809/2861083896","cluster_addr":"172.21.15.179:6811/2861083896","heartbeat_back_addr":"172.21.15.179:6815/2861083896","heartbeat_front_addr":"172.21.15.179:6813/2861083896","state":["exists","up"]},{"osd":5,"uuid":"5e19222a-c2a4-45bc-8445-1d302f26d11c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6809","nonce":1485017095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6811","nonce":1485017095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6815","nonce":1485017095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6813","nonce":1485017095}]},"public_addr":"172.21.15.181:6809/1485017095","cluster_addr":"172.21.15.181:6811/1485017095","heartbeat_back_addr":"172.21.15.181:6815/1485017095","heartbeat_front_addr":"172.21.15.181:6813/1485017095","state":["exists","up"]},{"osd":6,"uuid":"56555035-f9fc-4e91-96dd-caa632d58adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6819","nonce":1534047839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6821","nonce":1534047839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6825","nonce":1534047839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6823","nonce":1534047839}]},"public_addr":"172.21.15.99:6819/1534047839","cluster_addr":"172.21.15.99:6821/1534047839","heartbeat_back_addr":"172.21.15.99:6825/1534047839","heartbeat_front_addr":"172.21.15.99:6823/1534047839","state":["exists","up"]},{"osd":7,"uuid":"5e079cf5-1340-4599-88a6-df410ef0148e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6817","nonce":3875950553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6819","nonce":3875950553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6823","nonce":3875950553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6821","nonce":3875950553}]},"public_addr":"172.21.15.179:6817/3875950553","cluster_addr":"172.21.15.179:6819/3875950553","heartbeat_back_addr":"172.21.15.179:6823/3875950553","heartbeat_front_addr":"172.21.15.179:6821/3875950553","state":["exists","up"]},{"osd":8,"uuid":"10a73592-4251-4492-b67d-ce9b9d7fff32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6817","nonce":179568936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6819","nonce":179568936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6823","nonce":179568936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6821","nonce":179568936}]},"public_addr":"172.21.15.181:6817/179568936","cluster_addr":"172.21.15.181:6819/179568936","heartbeat_back_addr":"172.21.15.181:6823/179568936","heartbeat_front_addr":"172.21.15.181:6821/179568936","state":["exists","up"]},{"osd":9,"uuid":"f6620e1e-f761-4f1c-917f-cbc748df32a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6827","nonce":315759515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6829","nonce":315759515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6833","nonce":315759515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6831","nonce":315759515}]},"public_addr":"172.21.15.99:6827/315759515","cluster_addr":"172.21.15.99:6829/315759515","heartbeat_back_addr":"172.21.15.99:6833/315759515","heartbeat_front_addr":"172.21.15.99:6831/315759515","state":["exists","up"]},{"osd":10,"uuid":"ee86af7d-66f8-4795-bcc3-dfec79e4680c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6825","nonce":2985063934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6827","nonce":2985063934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6831","nonce":2985063934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6829","nonce":2985063934}]},"public_addr":"172.21.15.179:6825/2985063934","cluster_addr":"172.21.15.179:6827/2985063934","heartbeat_back_addr":"172.21.15.179:6831/2985063934","heartbeat_front_addr":"172.21.15.179:6829/2985063934","state":["exists","up"]},{"osd":11,"uuid":"82f04fee-f6ae-4630-a75b-b12a9c4ab2e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6825","nonce":1858219600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6827","nonce":1858219600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6831","nonce":1858219600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6829","nonce":1858219600}]},"public_addr":"172.21.15.181:6825/1858219600","cluster_addr":"172.21.15.181:6827/1858219600","heartbeat_back_addr":"172.21.15.181:6831/1858219600","heartbeat_front_addr":"172.21.15.181:6829/1858219600","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:55.518970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:04:19.936339+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:04:44.064814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:09.331683+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:34.616774+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:58.881810+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:06:23.869838+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:06:49.127331+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:07:12.847187+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:07:38.231045+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:08:03.949162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:08:28.471802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:0/401101729":"2024-02-01T05:02:20.510858+0000","172.21.15.99:6801/1993198206":"2024-02-01T05:02:20.510858+0000","172.21.15.99:0/3819754569":"2024-02-01T05:02:20.510858+0000","172.21.15.99:0/475390265":"2024-02-01T05:01:53.732026+0000","172.21.15.99:6800/1993198206":"2024-02-01T05:02:20.510858+0000","172.21.15.99:6800/1706888338":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/4150146075":"2024-02-01T05:01:53.732026+0000","172.21.15.99:6801/1706888338":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/2851066598":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/1865156424":"2024-02-01T05:02:20.510858+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:09:21.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.868+0000 7fab4b372640 1 -- 172.21.15.99:0/652075496 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fab300a12e0 msgr2=0x7fab300a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:21.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.868+0000 7fab4b372640 1 --2- 172.21.15.99:0/652075496 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fab300a12e0 0x7fab300a37a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fab40000c00 tx=0x7fab4002c5d0 comp rx=0 tx=0).stop 2024-01-31T05:09:21.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.868+0000 7fab4b372640 1 -- 172.21.15.99:0/652075496 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab441028d0 msgr2=0x7fab4419e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:21.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.868+0000 7fab4b372640 1 --2- 172.21.15.99:0/652075496 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab441028d0 0x7fab4419e320 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fab3c00b970 tx=0x7fab3c00be30 comp rx=0 tx=0).stop 2024-01-31T05:09:21.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.868+0000 7fab4b372640 1 -- 172.21.15.99:0/652075496 shutdown_connections 2024-01-31T05:09:21.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.868+0000 7fab4b372640 1 --2- 172.21.15.99:0/652075496 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fab300a12e0 0x7fab300a37a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:21.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.868+0000 7fab4b372640 1 --2- 172.21.15.99:0/652075496 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab441028d0 0x7fab4419e320 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:21.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.868+0000 7fab4b372640 1 --2- 172.21.15.99:0/652075496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab44101f10 0x7fab441972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:21.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.868+0000 7fab4b372640 1 --2- 172.21.15.99:0/652075496 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fab44100d20 0x7fab44196db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:21.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.868+0000 7fab4b372640 1 -- 172.21.15.99:0/652075496 >> 172.21.15.99:0/652075496 conn(0x7fab440fc290 msgr2=0x7fab441052e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:21.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.868+0000 7fab4b372640 1 -- 172.21.15.99:0/652075496 shutdown_connections 2024-01-31T05:09:21.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.868+0000 7fab4b372640 1 -- 172.21.15.99:0/652075496 wait complete. 2024-01-31T05:09:21.879 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:09:21.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.983+0000 7fbb6c91f640 1 -- 172.21.15.99:0/1224161831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb680ffe40 msgr2=0x7fbb681002c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:21.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.983+0000 7fbb6c91f640 1 --2- 172.21.15.99:0/1224161831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb680ffe40 0x7fbb681002c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c009900 tx=0x7fbb5c02bc80 comp rx=0 tx=0).stop 2024-01-31T05:09:21.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.983+0000 7fbb6c91f640 1 -- 172.21.15.99:0/1224161831 shutdown_connections 2024-01-31T05:09:21.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.983+0000 7fbb6c91f640 1 --2- 172.21.15.99:0/1224161831 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb68100800 0x7fbb681080a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:21.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.983+0000 7fbb6c91f640 1 --2- 172.21.15.99:0/1224161831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb680ffe40 0x7fbb681002c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:21.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.983+0000 7fbb6c91f640 1 --2- 172.21.15.99:0/1224161831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb68101280 0x7fbb681016a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:21.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.983+0000 7fbb6c91f640 1 -- 172.21.15.99:0/1224161831 >> 172.21.15.99:0/1224161831 conn(0x7fbb680fa8f0 msgr2=0x7fbb680fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:21.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.983+0000 7fbb6c91f640 1 -- 172.21.15.99:0/1224161831 shutdown_connections 2024-01-31T05:09:21.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.983+0000 7fbb6c91f640 1 -- 172.21.15.99:0/1224161831 wait complete. 2024-01-31T05:09:21.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.984+0000 7fbb6c91f640 1 Processor -- start 2024-01-31T05:09:21.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.984+0000 7fbb6c91f640 1 -- start start 2024-01-31T05:09:21.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.984+0000 7fbb6c91f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb680ffe40 0x7fbb680ff8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:21.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.984+0000 7fbb6c91f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb68100800 0x7fbb6819b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:21.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.984+0000 7fbb6c91f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb68101280 0x7fbb6819e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:21.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.984+0000 7fbb6c91f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6819e7e0 con 0x7fbb68100800 2024-01-31T05:09:21.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.984+0000 7fbb6c91f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6819e950 con 0x7fbb680ffe40 2024-01-31T05:09:21.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.984+0000 7fbb6c91f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6819eb10 con 0x7fbb68101280 2024-01-31T05:09:21.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.984+0000 7fbb65d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb68100800 0x7fbb6819b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:21.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.984+0000 7fbb65d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb68100800 0x7fbb6819b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52360/0 (socket says 172.21.15.99:52360) 2024-01-31T05:09:21.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.984+0000 7fbb65d9b640 1 -- 172.21.15.99:0/4195303022 learned_addr learned my addr 172.21.15.99:0/4195303022 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:09:21.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.984+0000 7fbb6659c640 1 --2- 172.21.15.99:0/4195303022 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb680ffe40 0x7fbb680ff8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:21.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.984+0000 7fbb66d9d640 1 --2- 172.21.15.99:0/4195303022 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb68101280 0x7fbb6819e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:21.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.984+0000 7fbb65d9b640 1 -- 172.21.15.99:0/4195303022 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb68101280 msgr2=0x7fbb6819e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:21.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.984+0000 7fbb65d9b640 1 --2- 172.21.15.99:0/4195303022 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb68101280 0x7fbb6819e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:21.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.984+0000 7fbb65d9b640 1 -- 172.21.15.99:0/4195303022 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb680ffe40 msgr2=0x7fbb680ff8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:21.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.984+0000 7fbb65d9b640 1 --2- 172.21.15.99:0/4195303022 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb680ffe40 0x7fbb680ff8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:21.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.984+0000 7fbb65d9b640 1 -- 172.21.15.99:0/4195303022 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb5c009560 con 0x7fbb68100800 2024-01-31T05:09:21.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.985+0000 7fbb65d9b640 1 --2- 172.21.15.99:0/4195303022 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb68100800 0x7fbb6819b9e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c009230 tx=0x7fbb5c0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:21.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.985+0000 7fbb577fe640 1 -- 172.21.15.99:0/4195303022 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c0044c0 con 0x7fbb68100800 2024-01-31T05:09:21.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.985+0000 7fbb6c91f640 1 -- 172.21.15.99:0/4195303022 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb6819ed30 con 0x7fbb68100800 2024-01-31T05:09:21.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.985+0000 7fbb577fe640 1 -- 172.21.15.99:0/4195303022 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbb5c0054c0 con 0x7fbb68100800 2024-01-31T05:09:21.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.985+0000 7fbb6c91f640 1 -- 172.21.15.99:0/4195303022 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb6819f1d0 con 0x7fbb68100800 2024-01-31T05:09:21.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.985+0000 7fbb577fe640 1 -- 172.21.15.99:0/4195303022 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c03e450 con 0x7fbb68100800 2024-01-31T05:09:21.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.986+0000 7fbb6c91f640 1 -- 172.21.15.99:0/4195303022 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb68106fa0 con 0x7fbb68100800 2024-01-31T05:09:21.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.988+0000 7fbb577fe640 1 -- 172.21.15.99:0/4195303022 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7fbb5c003680 con 0x7fbb68100800 2024-01-31T05:09:21.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.988+0000 7fbb577fe640 1 --2- 172.21.15.99:0/4195303022 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fbb500a12e0 0x7fbb500a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:21.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.988+0000 7fbb577fe640 1 -- 172.21.15.99:0/4195303022 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fbb5c02de40 con 0x7fbb68100800 2024-01-31T05:09:21.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.988+0000 7fbb6659c640 1 --2- 172.21.15.99:0/4195303022 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fbb500a12e0 0x7fbb500a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:21.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.989+0000 7fbb6659c640 1 --2- 172.21.15.99:0/4195303022 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fbb500a12e0 0x7fbb500a37a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbb5800abe0 tx=0x7fbb5800a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:21.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:21.991+0000 7fbb577fe640 1 -- 172.21.15.99:0/4195303022 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fbb5c0b8dd0 con 0x7fbb68100800 2024-01-31T05:09:22.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.171+0000 7fbb6c91f640 1 -- 172.21.15.99:0/4195303022 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb6810b6d0 con 0x7fbb68100800 2024-01-31T05:09:22.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.173+0000 7fbb577fe640 1 -- 172.21.15.99:0/4195303022 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22132 (secure 0 0 0) 0x7fbb5c0bc3f0 con 0x7fbb68100800 2024-01-31T05:09:22.172 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:09:22.172 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":86,"fsid":"9288ff44-bff5-11ee-95b3-87774f69a715","created":"2024-01-31T05:01:26.130917+0000","modified":"2024-01-31T05:09:21.567593+0000","last_up_change":"2024-01-31T05:08:31.228478+0000","last_in_change":"2024-01-31T05:08:10.799511+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:46.842423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:09:18.693558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-31T05:09:19.734003+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b45878d9-28f1-4821-ba72-26a32d3fc780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6803","nonce":1213805280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6805","nonce":1213805280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6809","nonce":1213805280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6807","nonce":1213805280}]},"public_addr":"172.21.15.99:6803/1213805280","cluster_addr":"172.21.15.99:6805/1213805280","heartbeat_back_addr":"172.21.15.99:6809/1213805280","heartbeat_front_addr":"172.21.15.99:6807/1213805280","state":["exists","up"]},{"osd":1,"uuid":"e0b71ff3-5d97-4659-8dea-4c9091e1beb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6801","nonce":2019451677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6803","nonce":2019451677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6807","nonce":2019451677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6805","nonce":2019451677}]},"public_addr":"172.21.15.179:6801/2019451677","cluster_addr":"172.21.15.179:6803/2019451677","heartbeat_back_addr":"172.21.15.179:6807/2019451677","heartbeat_front_addr":"172.21.15.179:6805/2019451677","state":["exists","up"]},{"osd":2,"uuid":"11c919c8-19a9-48b0-8880-3002efcb64f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6801","nonce":3934284457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6803","nonce":3934284457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6807","nonce":3934284457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6805","nonce":3934284457}]},"public_addr":"172.21.15.181:6801/3934284457","cluster_addr":"172.21.15.181:6803/3934284457","heartbeat_back_addr":"172.21.15.181:6807/3934284457","heartbeat_front_addr":"172.21.15.181:6805/3934284457","state":["exists","up"]},{"osd":3,"uuid":"bcab5135-a5d1-45ae-a9b8-674425d3999e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6811","nonce":4207675427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6813","nonce":4207675427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6817","nonce":4207675427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6815","nonce":4207675427}]},"public_addr":"172.21.15.99:6811/4207675427","cluster_addr":"172.21.15.99:6813/4207675427","heartbeat_back_addr":"172.21.15.99:6817/4207675427","heartbeat_front_addr":"172.21.15.99:6815/4207675427","state":["exists","up"]},{"osd":4,"uuid":"0250d7ac-3894-457a-9c04-cc7205d61eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6809","nonce":2861083896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6811","nonce":2861083896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6815","nonce":2861083896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6813","nonce":2861083896}]},"public_addr":"172.21.15.179:6809/2861083896","cluster_addr":"172.21.15.179:6811/2861083896","heartbeat_back_addr":"172.21.15.179:6815/2861083896","heartbeat_front_addr":"172.21.15.179:6813/2861083896","state":["exists","up"]},{"osd":5,"uuid":"5e19222a-c2a4-45bc-8445-1d302f26d11c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6809","nonce":1485017095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6811","nonce":1485017095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6815","nonce":1485017095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6813","nonce":1485017095}]},"public_addr":"172.21.15.181:6809/1485017095","cluster_addr":"172.21.15.181:6811/1485017095","heartbeat_back_addr":"172.21.15.181:6815/1485017095","heartbeat_front_addr":"172.21.15.181:6813/1485017095","state":["exists","up"]},{"osd":6,"uuid":"56555035-f9fc-4e91-96dd-caa632d58adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6819","nonce":1534047839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6821","nonce":1534047839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6825","nonce":1534047839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6823","nonce":1534047839}]},"public_addr":"172.21.15.99:6819/1534047839","cluster_addr":"172.21.15.99:6821/1534047839","heartbeat_back_addr":"172.21.15.99:6825/1534047839","heartbeat_front_addr":"172.21.15.99:6823/1534047839","state":["exists","up"]},{"osd":7,"uuid":"5e079cf5-1340-4599-88a6-df410ef0148e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6817","nonce":3875950553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6819","nonce":3875950553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6823","nonce":3875950553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6821","nonce":3875950553}]},"public_addr":"172.21.15.179:6817/3875950553","cluster_addr":"172.21.15.179:6819/3875950553","heartbeat_back_addr":"172.21.15.179:6823/3875950553","heartbeat_front_addr":"172.21.15.179:6821/3875950553","state":["exists","up"]},{"osd":8,"uuid":"10a73592-4251-4492-b67d-ce9b9d7fff32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6817","nonce":179568936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6819","nonce":179568936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6823","nonce":179568936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6821","nonce":179568936}]},"public_addr":"172.21.15.181:6817/179568936","cluster_addr":"172.21.15.181:6819/179568936","heartbeat_back_addr":"172.21.15.181:6823/179568936","heartbeat_front_addr":"172.21.15.181:6821/179568936","state":["exists","up"]},{"osd":9,"uuid":"f6620e1e-f761-4f1c-917f-cbc748df32a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6827","nonce":315759515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6829","nonce":315759515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6833","nonce":315759515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6831","nonce":315759515}]},"public_addr":"172.21.15.99:6827/315759515","cluster_addr":"172.21.15.99:6829/315759515","heartbeat_back_addr":"172.21.15.99:6833/315759515","heartbeat_front_addr":"172.21.15.99:6831/315759515","state":["exists","up"]},{"osd":10,"uuid":"ee86af7d-66f8-4795-bcc3-dfec79e4680c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6825","nonce":2985063934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6827","nonce":2985063934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6831","nonce":2985063934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6829","nonce":2985063934}]},"public_addr":"172.21.15.179:6825/2985063934","cluster_addr":"172.21.15.179:6827/2985063934","heartbeat_back_addr":"172.21.15.179:6831/2985063934","heartbeat_front_addr":"172.21.15.179:6829/2985063934","state":["exists","up"]},{"osd":11,"uuid":"82f04fee-f6ae-4630-a75b-b12a9c4ab2e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6825","nonce":1858219600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6827","nonce":1858219600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6831","nonce":1858219600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6829","nonce":1858219600}]},"public_addr":"172.21.15.181:6825/1858219600","cluster_addr":"172.21.15.181:6827/1858219600","heartbeat_back_addr":"172.21.15.181:6831/1858219600","heartbeat_front_addr":"172.21.15.181:6829/1858219600","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:55.518970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:04:19.936339+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:04:44.064814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:09.331683+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:34.616774+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:58.881810+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:06:23.869838+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:06:49.127331+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:07:12.847187+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:07:38.231045+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:08:03.949162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:08:28.471802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:0/401101729":"2024-02-01T05:02:20.510858+0000","172.21.15.99:6801/1993198206":"2024-02-01T05:02:20.510858+0000","172.21.15.99:0/3819754569":"2024-02-01T05:02:20.510858+0000","172.21.15.99:0/475390265":"2024-02-01T05:01:53.732026+0000","172.21.15.99:6800/1993198206":"2024-02-01T05:02:20.510858+0000","172.21.15.99:6800/1706888338":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/4150146075":"2024-02-01T05:01:53.732026+0000","172.21.15.99:6801/1706888338":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/2851066598":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/1865156424":"2024-02-01T05:02:20.510858+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:09:22.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.176+0000 7fbb6c91f640 1 -- 172.21.15.99:0/4195303022 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fbb500a12e0 msgr2=0x7fbb500a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:22.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.176+0000 7fbb6c91f640 1 --2- 172.21.15.99:0/4195303022 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fbb500a12e0 0x7fbb500a37a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbb5800abe0 tx=0x7fbb5800a2d0 comp rx=0 tx=0).stop 2024-01-31T05:09:22.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.176+0000 7fbb6c91f640 1 -- 172.21.15.99:0/4195303022 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb68100800 msgr2=0x7fbb6819b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:22.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.176+0000 7fbb6c91f640 1 --2- 172.21.15.99:0/4195303022 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb68100800 0x7fbb6819b9e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c009230 tx=0x7fbb5c0040c0 comp rx=0 tx=0).stop 2024-01-31T05:09:22.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.176+0000 7fbb6c91f640 1 -- 172.21.15.99:0/4195303022 shutdown_connections 2024-01-31T05:09:22.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.176+0000 7fbb6c91f640 1 --2- 172.21.15.99:0/4195303022 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fbb500a12e0 0x7fbb500a37a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:22.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.176+0000 7fbb6c91f640 1 --2- 172.21.15.99:0/4195303022 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb68101280 0x7fbb6819e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:22.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.176+0000 7fbb6c91f640 1 --2- 172.21.15.99:0/4195303022 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb68100800 0x7fbb6819b9e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:22.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.176+0000 7fbb6c91f640 1 --2- 172.21.15.99:0/4195303022 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb680ffe40 0x7fbb680ff8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:22.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.176+0000 7fbb6c91f640 1 -- 172.21.15.99:0/4195303022 >> 172.21.15.99:0/4195303022 conn(0x7fbb680fa8f0 msgr2=0x7fbb68104170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:22.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.176+0000 7fbb6c91f640 1 -- 172.21.15.99:0/4195303022 shutdown_connections 2024-01-31T05:09:22.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.176+0000 7fbb6c91f640 1 -- 172.21.15.99:0/4195303022 wait complete. 2024-01-31T05:09:22.188 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-31T05:09:22.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.295+0000 7f026d237640 1 -- 172.21.15.99:0/163770053 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f02681017a0 msgr2=0x7f0268108030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:22.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.295+0000 7f026d237640 1 --2- 172.21.15.99:0/163770053 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f02681017a0 0x7f0268108030 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0258009900 tx=0x7f025802bc30 comp rx=0 tx=0).stop 2024-01-31T05:09:22.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.295+0000 7f026d237640 1 -- 172.21.15.99:0/163770053 shutdown_connections 2024-01-31T05:09:22.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.295+0000 7f026d237640 1 --2- 172.21.15.99:0/163770053 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f02681017a0 0x7f0268108030 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:22.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.295+0000 7f026d237640 1 --2- 172.21.15.99:0/163770053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0268100de0 0x7f0268101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:22.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.295+0000 7f026d237640 1 --2- 172.21.15.99:0/163770053 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f02680ffbf0 0x7f0268100010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:22.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.295+0000 7f026d237640 1 -- 172.21.15.99:0/163770053 >> 172.21.15.99:0/163770053 conn(0x7f02680fb180 msgr2=0x7f02680fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:22.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.295+0000 7f026d237640 1 -- 172.21.15.99:0/163770053 shutdown_connections 2024-01-31T05:09:22.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.295+0000 7f026d237640 1 -- 172.21.15.99:0/163770053 wait complete. 2024-01-31T05:09:22.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.296+0000 7f026d237640 1 Processor -- start 2024-01-31T05:09:22.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.296+0000 7f026d237640 1 -- start start 2024-01-31T05:09:22.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.296+0000 7f026d237640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f02680ffbf0 0x7f0268103b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:22.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.296+0000 7f026d237640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0268100de0 0x7f02681021c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:22.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.296+0000 7f026d237640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f02681017a0 0x7f0268102700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:22.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.296+0000 7f026d237640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0268102e60 con 0x7f02681017a0 2024-01-31T05:09:22.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.296+0000 7f026d237640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0268102fd0 con 0x7f0268100de0 2024-01-31T05:09:22.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.296+0000 7f026d237640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02681a0ce0 con 0x7f02680ffbf0 2024-01-31T05:09:22.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.296+0000 7f026759e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f02681017a0 0x7f0268102700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:22.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.296+0000 7f026759e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f02681017a0 0x7f0268102700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52374/0 (socket says 172.21.15.99:52374) 2024-01-31T05:09:22.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.296+0000 7f026759e640 1 -- 172.21.15.99:0/94099194 learned_addr learned my addr 172.21.15.99:0/94099194 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:09:22.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.296+0000 7f0266d9d640 1 --2- 172.21.15.99:0/94099194 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f02680ffbf0 0x7f0268103b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:22.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.296+0000 7f026659c640 1 --2- 172.21.15.99:0/94099194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0268100de0 0x7f02681021c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:22.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.297+0000 7f026759e640 1 -- 172.21.15.99:0/94099194 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f02680ffbf0 msgr2=0x7f0268103b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:22.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.297+0000 7f026759e640 1 --2- 172.21.15.99:0/94099194 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f02680ffbf0 0x7f0268103b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:22.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.297+0000 7f026759e640 1 -- 172.21.15.99:0/94099194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0268100de0 msgr2=0x7f02681021c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:22.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.297+0000 7f026759e640 1 --2- 172.21.15.99:0/94099194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0268100de0 0x7f02681021c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:22.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.297+0000 7f026759e640 1 -- 172.21.15.99:0/94099194 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0258009560 con 0x7f02681017a0 2024-01-31T05:09:22.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.297+0000 7f026659c640 1 --2- 172.21.15.99:0/94099194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0268100de0 0x7f02681021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:09:22.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.297+0000 7f026759e640 1 --2- 172.21.15.99:0/94099194 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f02681017a0 0x7f0268102700 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f025802c610 tx=0x7f0258004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:22.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.297+0000 7f024ffff640 1 -- 172.21.15.99:0/94099194 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0258005000 con 0x7f02681017a0 2024-01-31T05:09:22.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.297+0000 7f024ffff640 1 -- 172.21.15.99:0/94099194 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0258005620 con 0x7f02681017a0 2024-01-31T05:09:22.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.297+0000 7f026d237640 1 -- 172.21.15.99:0/94099194 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02681a0f30 con 0x7f02681017a0 2024-01-31T05:09:22.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.297+0000 7f024ffff640 1 -- 172.21.15.99:0/94099194 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025803e450 con 0x7f02681017a0 2024-01-31T05:09:22.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.297+0000 7f026d237640 1 -- 172.21.15.99:0/94099194 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02681a13b0 con 0x7f02681017a0 2024-01-31T05:09:22.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.298+0000 7f026d237640 1 -- 172.21.15.99:0/94099194 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f026810b490 con 0x7f02681017a0 2024-01-31T05:09:22.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.299+0000 7f024ffff640 1 -- 172.21.15.99:0/94099194 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f02580036f0 con 0x7f02681017a0 2024-01-31T05:09:22.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.299+0000 7f024ffff640 1 --2- 172.21.15.99:0/94099194 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f02500a12e0 0x7f02500a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:22.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.299+0000 7f0266d9d640 1 --2- 172.21.15.99:0/94099194 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f02500a12e0 0x7f02500a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:22.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.300+0000 7f024ffff640 1 -- 172.21.15.99:0/94099194 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f02580ef110 con 0x7f02681017a0 2024-01-31T05:09:22.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.300+0000 7f0266d9d640 1 --2- 172.21.15.99:0/94099194 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f02500a12e0 0x7f02500a37a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f026000a300 tx=0x7f026000a290 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:22.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.304+0000 7f024ffff640 1 -- 172.21.15.99:0/94099194 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f02580b86e0 con 0x7f02681017a0 2024-01-31T05:09:22.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:22.512+0000 7f026d237640 1 -- 172.21.15.99:0/94099194 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f02681a15d0 con 0x7f02681017a0 2024-01-31T05:09:22.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:22 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/960855348' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-01-31T05:09:22.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:22 smithi099 ceph-mon[31615]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-01-31T05:09:22.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:22 smithi099 ceph-mon[31615]: osdmap e86: 12 total, 12 up, 12 in 2024-01-31T05:09:22.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:22 smithi099 ceph-mon[31615]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-01-31T05:09:22.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:22 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/652075496' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:09:22.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:22 smithi099 ceph-mon[31615]: mds.? [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] up:active 2024-01-31T05:09:22.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:22 smithi099 ceph-mon[31615]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-01-31T05:09:22.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:22 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/4195303022' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:09:22.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:22 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/94099194' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-01-31T05:09:22.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:22 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/960855348' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-01-31T05:09:22.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:22 smithi181 ceph-mon[36434]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-01-31T05:09:22.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:22 smithi181 ceph-mon[36434]: osdmap e86: 12 total, 12 up, 12 in 2024-01-31T05:09:22.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:22 smithi181 ceph-mon[36434]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-01-31T05:09:22.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:22 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/652075496' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:09:22.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:22 smithi181 ceph-mon[36434]: mds.? [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] up:active 2024-01-31T05:09:22.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:22 smithi181 ceph-mon[36434]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-01-31T05:09:22.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:22 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/4195303022' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:09:22.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:22 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/94099194' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-01-31T05:09:22.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:22 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/960855348' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-01-31T05:09:22.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:22 smithi179 ceph-mon[35652]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-01-31T05:09:22.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:22 smithi179 ceph-mon[35652]: osdmap e86: 12 total, 12 up, 12 in 2024-01-31T05:09:22.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:22 smithi179 ceph-mon[35652]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-01-31T05:09:22.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:22 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/652075496' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:09:22.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:22 smithi179 ceph-mon[35652]: mds.? [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] up:active 2024-01-31T05:09:22.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:22 smithi179 ceph-mon[35652]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-01-31T05:09:22.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:22 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/4195303022' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:09:22.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:22 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/94099194' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-01-31T05:09:23.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.166+0000 7f024ffff640 1 -- 172.21.15.99:0/94099194 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f02580bbd00 con 0x7f02681017a0 2024-01-31T05:09:23.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.168+0000 7f026d237640 1 -- 172.21.15.99:0/94099194 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f02500a12e0 msgr2=0x7f02500a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:23.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.168+0000 7f026d237640 1 --2- 172.21.15.99:0/94099194 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f02500a12e0 0x7f02500a37a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f026000a300 tx=0x7f026000a290 comp rx=0 tx=0).stop 2024-01-31T05:09:23.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.168+0000 7f026d237640 1 -- 172.21.15.99:0/94099194 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f02681017a0 msgr2=0x7f0268102700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:23.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.168+0000 7f026d237640 1 --2- 172.21.15.99:0/94099194 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f02681017a0 0x7f0268102700 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f025802c610 tx=0x7f0258004270 comp rx=0 tx=0).stop 2024-01-31T05:09:23.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.169+0000 7f026d237640 1 -- 172.21.15.99:0/94099194 shutdown_connections 2024-01-31T05:09:23.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.169+0000 7f026d237640 1 --2- 172.21.15.99:0/94099194 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f02500a12e0 0x7f02500a37a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:23.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.169+0000 7f026d237640 1 --2- 172.21.15.99:0/94099194 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f02681017a0 0x7f0268102700 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:23.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.169+0000 7f026d237640 1 --2- 172.21.15.99:0/94099194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0268100de0 0x7f02681021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:23.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.169+0000 7f026d237640 1 --2- 172.21.15.99:0/94099194 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f02680ffbf0 0x7f0268103b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:23.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.169+0000 7f026d237640 1 -- 172.21.15.99:0/94099194 >> 172.21.15.99:0/94099194 conn(0x7f02680fb180 msgr2=0x7f02680fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:23.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.169+0000 7f026d237640 1 -- 172.21.15.99:0/94099194 shutdown_connections 2024-01-31T05:09:23.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.169+0000 7f026d237640 1 -- 172.21.15.99:0/94099194 wait complete. 2024-01-31T05:09:23.179 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-01-31T05:09:23.179 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2024-01-31T05:09:23.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.286+0000 7f0c17505640 1 -- 172.21.15.99:0/3554845088 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c100ffc10 msgr2=0x7f0c10100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:23.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.286+0000 7f0c17505640 1 --2- 172.21.15.99:0/3554845088 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c100ffc10 0x7f0c10100030 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c009900 tx=0x7f0c0c02bc30 comp rx=0 tx=0).stop 2024-01-31T05:09:23.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.286+0000 7f0c17505640 1 -- 172.21.15.99:0/3554845088 shutdown_connections 2024-01-31T05:09:23.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.286+0000 7f0c17505640 1 --2- 172.21.15.99:0/3554845088 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c101017c0 0x7f0c10108050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:23.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.286+0000 7f0c17505640 1 --2- 172.21.15.99:0/3554845088 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0c10100e00 0x7f0c10101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:23.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.286+0000 7f0c17505640 1 --2- 172.21.15.99:0/3554845088 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c100ffc10 0x7f0c10100030 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:23.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.286+0000 7f0c17505640 1 -- 172.21.15.99:0/3554845088 >> 172.21.15.99:0/3554845088 conn(0x7f0c100fb1a0 msgr2=0x7f0c100fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:23.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.286+0000 7f0c17505640 1 -- 172.21.15.99:0/3554845088 shutdown_connections 2024-01-31T05:09:23.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.286+0000 7f0c17505640 1 -- 172.21.15.99:0/3554845088 wait complete. 2024-01-31T05:09:23.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.286+0000 7f0c17505640 1 Processor -- start 2024-01-31T05:09:23.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.287+0000 7f0c17505640 1 -- start start 2024-01-31T05:09:23.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.287+0000 7f0c17505640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c100ffc10 0x7f0c10069e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:23.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.287+0000 7f0c17505640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c10100e00 0x7f0c1019ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:23.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.287+0000 7f0c17505640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0c101017c0 0x7f0c1019e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:23.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.287+0000 7f0c17505640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1019e830 con 0x7f0c10100e00 2024-01-31T05:09:23.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.287+0000 7f0c17505640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1019e9a0 con 0x7f0c100ffc10 2024-01-31T05:09:23.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.287+0000 7f0c17505640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1019eb60 con 0x7f0c101017c0 2024-01-31T05:09:23.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.287+0000 7f0c14aa0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c10100e00 0x7f0c1019ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:23.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.287+0000 7f0c14aa0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c10100e00 0x7f0c1019ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52396/0 (socket says 172.21.15.99:52396) 2024-01-31T05:09:23.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.287+0000 7f0c14aa0640 1 -- 172.21.15.99:0/3254764928 learned_addr learned my addr 172.21.15.99:0/3254764928 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:09:23.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.287+0000 7f0c15aa2640 1 --2- 172.21.15.99:0/3254764928 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0c101017c0 0x7f0c1019e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:23.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.287+0000 7f0c152a1640 1 --2- 172.21.15.99:0/3254764928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c100ffc10 0x7f0c10069e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:23.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.287+0000 7f0c14aa0640 1 -- 172.21.15.99:0/3254764928 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0c101017c0 msgr2=0x7f0c1019e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:23.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.287+0000 7f0c14aa0640 1 --2- 172.21.15.99:0/3254764928 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0c101017c0 0x7f0c1019e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:23.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.287+0000 7f0c14aa0640 1 -- 172.21.15.99:0/3254764928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c100ffc10 msgr2=0x7f0c10069e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:23.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.287+0000 7f0c14aa0640 1 --2- 172.21.15.99:0/3254764928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c100ffc10 0x7f0c10069e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:23.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.287+0000 7f0c14aa0640 1 -- 172.21.15.99:0/3254764928 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c0c009560 con 0x7f0c10100e00 2024-01-31T05:09:23.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.287+0000 7f0c15aa2640 1 --2- 172.21.15.99:0/3254764928 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0c101017c0 0x7f0c1019e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:09:23.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.287+0000 7f0c14aa0640 1 --2- 172.21.15.99:0/3254764928 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c10100e00 0x7f0c1019ba30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0c0000d950 tx=0x7f0c0000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:23.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.287+0000 7f0c067fc640 1 -- 172.21.15.99:0/3254764928 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c00009a30 con 0x7f0c10100e00 2024-01-31T05:09:23.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.287+0000 7f0c067fc640 1 -- 172.21.15.99:0/3254764928 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0c00009b90 con 0x7f0c10100e00 2024-01-31T05:09:23.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.287+0000 7f0c17505640 1 -- 172.21.15.99:0/3254764928 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c1019ede0 con 0x7f0c10100e00 2024-01-31T05:09:23.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.287+0000 7f0c067fc640 1 -- 172.21.15.99:0/3254764928 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c000047a0 con 0x7f0c10100e00 2024-01-31T05:09:23.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.287+0000 7f0c17505640 1 -- 172.21.15.99:0/3254764928 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c1019f260 con 0x7f0c10100e00 2024-01-31T05:09:23.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.288+0000 7f0c17505640 1 -- 172.21.15.99:0/3254764928 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c10107000 con 0x7f0c10100e00 2024-01-31T05:09:23.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.289+0000 7f0c067fc640 1 -- 172.21.15.99:0/3254764928 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f0c00009d00 con 0x7f0c10100e00 2024-01-31T05:09:23.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.290+0000 7f0c067fc640 1 --2- 172.21.15.99:0/3254764928 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f0bfc0a12e0 0x7f0bfc0a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:23.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.290+0000 7f0c152a1640 1 --2- 172.21.15.99:0/3254764928 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f0bfc0a12e0 0x7f0bfc0a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:23.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.290+0000 7f0c067fc640 1 -- 172.21.15.99:0/3254764928 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f0c000cc5c0 con 0x7f0c10100e00 2024-01-31T05:09:23.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.290+0000 7f0c152a1640 1 --2- 172.21.15.99:0/3254764928 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f0bfc0a12e0 0x7f0bfc0a37a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c02c7e0 tx=0x7f0c0c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:23.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.294+0000 7f0c067fc640 1 -- 172.21.15.99:0/3254764928 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f0c00095b90 con 0x7f0c10100e00 2024-01-31T05:09:23.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:23.508+0000 7f0c17505640 1 -- 172.21.15.99:0/3254764928 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) v1 -- 0x7f0c1010b6f0 con 0x7f0c10100e00 2024-01-31T05:09:23.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:23 smithi099 ceph-mon[31615]: pgmap v287: 97 pgs: 20 unknown, 77 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 2 op/s 2024-01-31T05:09:23.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:23 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/94099194' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-01-31T05:09:23.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:23 smithi099 ceph-mon[31615]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-01-31T05:09:23.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:23 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/3254764928' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-01-31T05:09:23.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:23 smithi181 ceph-mon[36434]: pgmap v287: 97 pgs: 20 unknown, 77 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 2 op/s 2024-01-31T05:09:23.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:23 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/94099194' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-01-31T05:09:23.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:23 smithi181 ceph-mon[36434]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-01-31T05:09:23.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:23 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/3254764928' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-01-31T05:09:23.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:23 smithi179 ceph-mon[35652]: pgmap v287: 97 pgs: 20 unknown, 77 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 2 op/s 2024-01-31T05:09:23.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:23 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/94099194' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-01-31T05:09:23.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:23 smithi179 ceph-mon[35652]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-01-31T05:09:23.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:23 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/3254764928' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-01-31T05:09:24.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.168+0000 7f0c067fc640 1 -- 172.21.15.99:0/3254764928 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v17) v1 ==== 105+0+0 (secure 0 0 0) 0x7f0c000991b0 con 0x7f0c10100e00 2024-01-31T05:09:24.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.170+0000 7f0c17505640 1 -- 172.21.15.99:0/3254764928 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f0bfc0a12e0 msgr2=0x7f0bfc0a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:24.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.170+0000 7f0c17505640 1 --2- 172.21.15.99:0/3254764928 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f0bfc0a12e0 0x7f0bfc0a37a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c02c7e0 tx=0x7f0c0c000bc0 comp rx=0 tx=0).stop 2024-01-31T05:09:24.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.170+0000 7f0c17505640 1 -- 172.21.15.99:0/3254764928 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c10100e00 msgr2=0x7f0c1019ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:24.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.170+0000 7f0c17505640 1 --2- 172.21.15.99:0/3254764928 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c10100e00 0x7f0c1019ba30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0c0000d950 tx=0x7f0c0000de10 comp rx=0 tx=0).stop 2024-01-31T05:09:24.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.170+0000 7f0c17505640 1 -- 172.21.15.99:0/3254764928 shutdown_connections 2024-01-31T05:09:24.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.170+0000 7f0c17505640 1 --2- 172.21.15.99:0/3254764928 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f0bfc0a12e0 0x7f0bfc0a37a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:24.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.170+0000 7f0c17505640 1 --2- 172.21.15.99:0/3254764928 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0c101017c0 0x7f0c1019e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:24.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.170+0000 7f0c17505640 1 --2- 172.21.15.99:0/3254764928 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c10100e00 0x7f0c1019ba30 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:24.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.170+0000 7f0c17505640 1 --2- 172.21.15.99:0/3254764928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c100ffc10 0x7f0c10069e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:24.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.170+0000 7f0c17505640 1 -- 172.21.15.99:0/3254764928 >> 172.21.15.99:0/3254764928 conn(0x7f0c100fb1a0 msgr2=0x7f0c101041d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:24.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.171+0000 7f0c17505640 1 -- 172.21.15.99:0/3254764928 shutdown_connections 2024-01-31T05:09:24.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.171+0000 7f0c17505640 1 -- 172.21.15.99:0/3254764928 wait complete. 2024-01-31T05:09:24.186 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-01-31T05:09:24.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.295+0000 7ff415d05640 1 -- 172.21.15.99:0/3804841331 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4101017d0 msgr2=0x7ff410103bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:24.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.295+0000 7ff415d05640 1 --2- 172.21.15.99:0/3804841331 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4101017d0 0x7ff410103bc0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff400009900 tx=0x7ff40002bc30 comp rx=0 tx=0).stop 2024-01-31T05:09:24.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.295+0000 7ff415d05640 1 -- 172.21.15.99:0/3804841331 shutdown_connections 2024-01-31T05:09:24.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.295+0000 7ff415d05640 1 --2- 172.21.15.99:0/3804841331 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff410106a30 0x7ff410108e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:24.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.295+0000 7ff415d05640 1 --2- 172.21.15.99:0/3804841331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff410104100 0x7ff4101064f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:24.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.295+0000 7ff415d05640 1 --2- 172.21.15.99:0/3804841331 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4101017d0 0x7ff410103bc0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:24.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.295+0000 7ff415d05640 1 -- 172.21.15.99:0/3804841331 >> 172.21.15.99:0/3804841331 conn(0x7ff4100fb180 msgr2=0x7ff4100fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:24.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.295+0000 7ff415d05640 1 -- 172.21.15.99:0/3804841331 shutdown_connections 2024-01-31T05:09:24.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.295+0000 7ff415d05640 1 -- 172.21.15.99:0/3804841331 wait complete. 2024-01-31T05:09:24.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.296+0000 7ff415d05640 1 Processor -- start 2024-01-31T05:09:24.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.296+0000 7ff415d05640 1 -- start start 2024-01-31T05:09:24.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.296+0000 7ff415d05640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4101017d0 0x7ff410196d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:24.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.296+0000 7ff415d05640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff410104100 0x7ff410197290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:24.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.296+0000 7ff415d05640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff410106a30 0x7ff41019e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:24.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.296+0000 7ff415d05640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41019e830 con 0x7ff4101017d0 2024-01-31T05:09:24.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.296+0000 7ff415d05640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41019e9a0 con 0x7ff410106a30 2024-01-31T05:09:24.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.296+0000 7ff415d05640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41019eb60 con 0x7ff410104100 2024-01-31T05:09:24.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.296+0000 7ff40f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4101017d0 0x7ff410196d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:24.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.296+0000 7ff40f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4101017d0 0x7ff410196d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52414/0 (socket says 172.21.15.99:52414) 2024-01-31T05:09:24.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.296+0000 7ff40f7fe640 1 -- 172.21.15.99:0/1549514492 learned_addr learned my addr 172.21.15.99:0/1549514492 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:09:24.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.296+0000 7ff40effd640 1 --2- 172.21.15.99:0/1549514492 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff410104100 0x7ff410197290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:24.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.296+0000 7ff40ffff640 1 --2- 172.21.15.99:0/1549514492 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff410106a30 0x7ff41019e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:24.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.297+0000 7ff40f7fe640 1 -- 172.21.15.99:0/1549514492 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff410104100 msgr2=0x7ff410197290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:24.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.297+0000 7ff40f7fe640 1 --2- 172.21.15.99:0/1549514492 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff410104100 0x7ff410197290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:24.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.297+0000 7ff40f7fe640 1 -- 172.21.15.99:0/1549514492 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff410106a30 msgr2=0x7ff41019e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:24.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.297+0000 7ff40f7fe640 1 --2- 172.21.15.99:0/1549514492 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff410106a30 0x7ff41019e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:24.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.297+0000 7ff40f7fe640 1 -- 172.21.15.99:0/1549514492 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff400009560 con 0x7ff4101017d0 2024-01-31T05:09:24.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.297+0000 7ff40f7fe640 1 --2- 172.21.15.99:0/1549514492 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4101017d0 0x7ff410196d50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff400009230 tx=0x7ff400004ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:24.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.297+0000 7ff40cff9640 1 -- 172.21.15.99:0/1549514492 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4000043d0 con 0x7ff4101017d0 2024-01-31T05:09:24.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.297+0000 7ff40cff9640 1 -- 172.21.15.99:0/1549514492 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff4000054c0 con 0x7ff4101017d0 2024-01-31T05:09:24.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.297+0000 7ff415d05640 1 -- 172.21.15.99:0/1549514492 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff41019ede0 con 0x7ff4101017d0 2024-01-31T05:09:24.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.297+0000 7ff40cff9640 1 -- 172.21.15.99:0/1549514492 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40003e450 con 0x7ff4101017d0 2024-01-31T05:09:24.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.297+0000 7ff415d05640 1 -- 172.21.15.99:0/1549514492 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff41019f200 con 0x7ff4101017d0 2024-01-31T05:09:24.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.298+0000 7ff415d05640 1 -- 172.21.15.99:0/1549514492 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4100fcc70 con 0x7ff4101017d0 2024-01-31T05:09:24.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.299+0000 7ff40cff9640 1 -- 172.21.15.99:0/1549514492 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7ff4000035f0 con 0x7ff4101017d0 2024-01-31T05:09:24.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.299+0000 7ff40cff9640 1 --2- 172.21.15.99:0/1549514492 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff3f80a12e0 0x7ff3f80a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:24.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.300+0000 7ff40effd640 1 --2- 172.21.15.99:0/1549514492 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff3f80a12e0 0x7ff3f80a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:24.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.300+0000 7ff40cff9640 1 -- 172.21.15.99:0/1549514492 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff4000ef380 con 0x7ff4101017d0 2024-01-31T05:09:24.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.300+0000 7ff40effd640 1 --2- 172.21.15.99:0/1549514492 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff3f80a12e0 0x7ff3f80a37a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff410068950 tx=0x7ff40400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:24.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.304+0000 7ff40cff9640 1 -- 172.21.15.99:0/1549514492 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7ff4000b88c0 con 0x7ff4101017d0 2024-01-31T05:09:24.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:24.511+0000 7ff415d05640 1 -- 172.21.15.99:0/1549514492 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7ff41010c7d0 con 0x7ff4101017d0 2024-01-31T05:09:24.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:24 smithi181 ceph-mon[36434]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-01-31T05:09:24.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:24 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/3254764928' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-01-31T05:09:24.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:24 smithi181 ceph-mon[36434]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-01-31T05:09:24.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:24 smithi181 ceph-mon[36434]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-01-31T05:09:24.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:24 smithi181 ceph-mon[36434]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-01-31T05:09:24.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:24 smithi181 ceph-mon[36434]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-01-31T05:09:24.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:24 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/1549514492' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-01-31T05:09:24.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:24 smithi179 ceph-mon[35652]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-01-31T05:09:24.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:24 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/3254764928' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-01-31T05:09:24.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:24 smithi179 ceph-mon[35652]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-01-31T05:09:24.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:24 smithi179 ceph-mon[35652]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-01-31T05:09:24.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:24 smithi179 ceph-mon[35652]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-01-31T05:09:24.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:24 smithi179 ceph-mon[35652]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-01-31T05:09:24.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:24 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/1549514492' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-01-31T05:09:25.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:24 smithi099 ceph-mon[31615]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-01-31T05:09:25.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:24 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/3254764928' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-01-31T05:09:25.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:24 smithi099 ceph-mon[31615]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-01-31T05:09:25.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:24 smithi099 ceph-mon[31615]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-01-31T05:09:25.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:24 smithi099 ceph-mon[31615]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-01-31T05:09:25.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:24 smithi099 ceph-mon[31615]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-01-31T05:09:25.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:24 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/1549514492' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-01-31T05:09:25.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.174+0000 7ff40cff9640 1 -- 172.21.15.99:0/1549514492 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v19) v1 ==== 121+0+0 (secure 0 0 0) 0x7ff4000430c0 con 0x7ff4101017d0 2024-01-31T05:09:25.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.176+0000 7ff415d05640 1 -- 172.21.15.99:0/1549514492 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff3f80a12e0 msgr2=0x7ff3f80a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:25.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.176+0000 7ff415d05640 1 --2- 172.21.15.99:0/1549514492 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff3f80a12e0 0x7ff3f80a37a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff410068950 tx=0x7ff40400b390 comp rx=0 tx=0).stop 2024-01-31T05:09:25.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.176+0000 7ff415d05640 1 -- 172.21.15.99:0/1549514492 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4101017d0 msgr2=0x7ff410196d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:25.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.176+0000 7ff415d05640 1 --2- 172.21.15.99:0/1549514492 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4101017d0 0x7ff410196d50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff400009230 tx=0x7ff400004ee0 comp rx=0 tx=0).stop 2024-01-31T05:09:25.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.176+0000 7ff415d05640 1 -- 172.21.15.99:0/1549514492 shutdown_connections 2024-01-31T05:09:25.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.176+0000 7ff415d05640 1 --2- 172.21.15.99:0/1549514492 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff3f80a12e0 0x7ff3f80a37a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:25.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.176+0000 7ff415d05640 1 --2- 172.21.15.99:0/1549514492 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff410106a30 0x7ff41019e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:25.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.176+0000 7ff415d05640 1 --2- 172.21.15.99:0/1549514492 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff410104100 0x7ff410197290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:25.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.176+0000 7ff415d05640 1 --2- 172.21.15.99:0/1549514492 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4101017d0 0x7ff410196d50 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:25.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.176+0000 7ff415d05640 1 -- 172.21.15.99:0/1549514492 >> 172.21.15.99:0/1549514492 conn(0x7ff4100fb180 msgr2=0x7ff410102270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:25.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.177+0000 7ff415d05640 1 -- 172.21.15.99:0/1549514492 shutdown_connections 2024-01-31T05:09:25.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.177+0000 7ff415d05640 1 -- 172.21.15.99:0/1549514492 wait complete. 2024-01-31T05:09:25.191 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-01-31T05:09:25.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.299+0000 7f1d37f89640 1 -- 172.21.15.99:0/3397416996 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d301040a0 msgr2=0x7f1d30106490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:25.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.299+0000 7f1d37f89640 1 --2- 172.21.15.99:0/3397416996 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d301040a0 0x7f1d30106490 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1d20009900 tx=0x7f1d2002bc30 comp rx=0 tx=0).stop 2024-01-31T05:09:25.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.299+0000 7f1d37f89640 1 -- 172.21.15.99:0/3397416996 shutdown_connections 2024-01-31T05:09:25.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.299+0000 7f1d37f89640 1 --2- 172.21.15.99:0/3397416996 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1d301069d0 0x7f1d30108e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:25.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.299+0000 7f1d37f89640 1 --2- 172.21.15.99:0/3397416996 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d301040a0 0x7f1d30106490 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:25.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.299+0000 7f1d37f89640 1 --2- 172.21.15.99:0/3397416996 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d30101770 0x7f1d30103b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:25.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.299+0000 7f1d37f89640 1 -- 172.21.15.99:0/3397416996 >> 172.21.15.99:0/3397416996 conn(0x7f1d300fb180 msgr2=0x7f1d300fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:25.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.299+0000 7f1d37f89640 1 -- 172.21.15.99:0/3397416996 shutdown_connections 2024-01-31T05:09:25.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.299+0000 7f1d37f89640 1 -- 172.21.15.99:0/3397416996 wait complete. 2024-01-31T05:09:25.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.300+0000 7f1d37f89640 1 Processor -- start 2024-01-31T05:09:25.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.300+0000 7f1d37f89640 1 -- start start 2024-01-31T05:09:25.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.300+0000 7f1d37f89640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1d30101770 0x7f1d30196dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:25.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.300+0000 7f1d37f89640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d301040a0 0x7f1d30197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:25.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.300+0000 7f1d37f89640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d301069d0 0x7f1d3019e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:25.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.300+0000 7f1d37f89640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3019e860 con 0x7f1d301040a0 2024-01-31T05:09:25.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.300+0000 7f1d37f89640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3019e9d0 con 0x7f1d301069d0 2024-01-31T05:09:25.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.300+0000 7f1d37f89640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3019eb90 con 0x7f1d30101770 2024-01-31T05:09:25.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.300+0000 7f1d35524640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d301040a0 0x7f1d30197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:25.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.300+0000 7f1d35524640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d301040a0 0x7f1d30197300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52428/0 (socket says 172.21.15.99:52428) 2024-01-31T05:09:25.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.300+0000 7f1d35524640 1 -- 172.21.15.99:0/3348747531 learned_addr learned my addr 172.21.15.99:0/3348747531 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:09:25.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.300+0000 7f1d35d25640 1 --2- 172.21.15.99:0/3348747531 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1d30101770 0x7f1d30196dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:25.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.300+0000 7f1d36526640 1 --2- 172.21.15.99:0/3348747531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d301069d0 0x7f1d3019e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:25.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.301+0000 7f1d35524640 1 -- 172.21.15.99:0/3348747531 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1d30101770 msgr2=0x7f1d30196dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:25.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.301+0000 7f1d35524640 1 --2- 172.21.15.99:0/3348747531 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1d30101770 0x7f1d30196dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:25.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.301+0000 7f1d35524640 1 -- 172.21.15.99:0/3348747531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d301069d0 msgr2=0x7f1d3019e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:25.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.301+0000 7f1d35524640 1 --2- 172.21.15.99:0/3348747531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d301069d0 0x7f1d3019e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:25.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.301+0000 7f1d35524640 1 -- 172.21.15.99:0/3348747531 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d20009560 con 0x7f1d301040a0 2024-01-31T05:09:25.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.301+0000 7f1d35524640 1 --2- 172.21.15.99:0/3348747531 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d301040a0 0x7f1d30197300 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1d20009230 tx=0x7f1d20004f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:25.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.301+0000 7f1d26ffd640 1 -- 172.21.15.99:0/3348747531 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d200043d0 con 0x7f1d301040a0 2024-01-31T05:09:25.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.301+0000 7f1d26ffd640 1 -- 172.21.15.99:0/3348747531 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1d200054c0 con 0x7f1d301040a0 2024-01-31T05:09:25.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.301+0000 7f1d26ffd640 1 -- 172.21.15.99:0/3348747531 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d20003e30 con 0x7f1d301040a0 2024-01-31T05:09:25.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.301+0000 7f1d37f89640 1 -- 172.21.15.99:0/3348747531 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d3019ee10 con 0x7f1d301040a0 2024-01-31T05:09:25.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.301+0000 7f1d37f89640 1 -- 172.21.15.99:0/3348747531 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d3019f2c0 con 0x7f1d301040a0 2024-01-31T05:09:25.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.302+0000 7f1d37f89640 1 -- 172.21.15.99:0/3348747531 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d300fcc70 con 0x7f1d301040a0 2024-01-31T05:09:25.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.303+0000 7f1d26ffd640 1 -- 172.21.15.99:0/3348747531 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f1d20005000 con 0x7f1d301040a0 2024-01-31T05:09:25.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.303+0000 7f1d26ffd640 1 --2- 172.21.15.99:0/3348747531 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f1d1c0a12e0 0x7f1d1c0a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:25.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.303+0000 7f1d35d25640 1 --2- 172.21.15.99:0/3348747531 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f1d1c0a12e0 0x7f1d1c0a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:25.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.303+0000 7f1d26ffd640 1 -- 172.21.15.99:0/3348747531 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f1d200ef2c0 con 0x7f1d301040a0 2024-01-31T05:09:25.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.304+0000 7f1d35d25640 1 --2- 172.21.15.99:0/3348747531 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f1d1c0a12e0 0x7f1d1c0a37a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1d2800bbe0 tx=0x7f1d2800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:25.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.308+0000 7f1d26ffd640 1 -- 172.21.15.99:0/3348747531 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f1d200b8890 con 0x7f1d301040a0 2024-01-31T05:09:25.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:25.518+0000 7f1d37f89640 1 -- 172.21.15.99:0/3348747531 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f1d3010c850 con 0x7f1d301040a0 2024-01-31T05:09:25.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:25 smithi179 ceph-mon[35652]: pgmap v288: 97 pgs: 97 active+clean; 578 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 3 op/s 2024-01-31T05:09:25.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:25 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/1549514492' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-01-31T05:09:25.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:25 smithi179 ceph-mon[35652]: mds.? [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] up:active 2024-01-31T05:09:25.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:25 smithi179 ceph-mon[35652]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-01-31T05:09:25.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:25 smithi179 ceph-mon[35652]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-01-31T05:09:25.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:25 smithi179 ceph-mon[35652]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-01-31T05:09:25.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:25 smithi179 ceph-mon[35652]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-01-31T05:09:25.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:25 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/3348747531' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-01-31T05:09:26.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:25 smithi099 ceph-mon[31615]: pgmap v288: 97 pgs: 97 active+clean; 578 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 3 op/s 2024-01-31T05:09:26.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:25 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/1549514492' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-01-31T05:09:26.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:25 smithi099 ceph-mon[31615]: mds.? [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] up:active 2024-01-31T05:09:26.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:25 smithi099 ceph-mon[31615]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-01-31T05:09:26.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:25 smithi099 ceph-mon[31615]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-01-31T05:09:26.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:25 smithi099 ceph-mon[31615]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-01-31T05:09:26.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:25 smithi099 ceph-mon[31615]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-01-31T05:09:26.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:25 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/3348747531' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-01-31T05:09:26.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:25 smithi181 ceph-mon[36434]: pgmap v288: 97 pgs: 97 active+clean; 578 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 3 op/s 2024-01-31T05:09:26.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:25 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/1549514492' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-01-31T05:09:26.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:25 smithi181 ceph-mon[36434]: mds.? [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] up:active 2024-01-31T05:09:26.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:25 smithi181 ceph-mon[36434]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-01-31T05:09:26.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:25 smithi181 ceph-mon[36434]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-01-31T05:09:26.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:25 smithi181 ceph-mon[36434]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-01-31T05:09:26.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:25 smithi181 ceph-mon[36434]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-01-31T05:09:26.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:25 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/3348747531' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-01-31T05:09:26.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.180+0000 7f1d26ffd640 1 -- 172.21.15.99:0/3348747531 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v21) v1 ==== 115+0+0 (secure 0 0 0) 0x7f1d200bbeb0 con 0x7f1d301040a0 2024-01-31T05:09:26.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.183+0000 7f1d37f89640 1 -- 172.21.15.99:0/3348747531 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f1d1c0a12e0 msgr2=0x7f1d1c0a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:26.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.183+0000 7f1d37f89640 1 --2- 172.21.15.99:0/3348747531 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f1d1c0a12e0 0x7f1d1c0a37a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1d2800bbe0 tx=0x7f1d2800b390 comp rx=0 tx=0).stop 2024-01-31T05:09:26.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.183+0000 7f1d37f89640 1 -- 172.21.15.99:0/3348747531 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d301040a0 msgr2=0x7f1d30197300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:26.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.183+0000 7f1d37f89640 1 --2- 172.21.15.99:0/3348747531 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d301040a0 0x7f1d30197300 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1d20009230 tx=0x7f1d20004f40 comp rx=0 tx=0).stop 2024-01-31T05:09:26.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.183+0000 7f1d37f89640 1 -- 172.21.15.99:0/3348747531 shutdown_connections 2024-01-31T05:09:26.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.183+0000 7f1d37f89640 1 --2- 172.21.15.99:0/3348747531 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f1d1c0a12e0 0x7f1d1c0a37a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:26.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.183+0000 7f1d37f89640 1 --2- 172.21.15.99:0/3348747531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d301069d0 0x7f1d3019e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:26.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.183+0000 7f1d37f89640 1 --2- 172.21.15.99:0/3348747531 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d301040a0 0x7f1d30197300 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:26.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.183+0000 7f1d37f89640 1 --2- 172.21.15.99:0/3348747531 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1d30101770 0x7f1d30196dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:26.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.183+0000 7f1d37f89640 1 -- 172.21.15.99:0/3348747531 >> 172.21.15.99:0/3348747531 conn(0x7f1d300fb180 msgr2=0x7f1d30102210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:26.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.183+0000 7f1d37f89640 1 -- 172.21.15.99:0/3348747531 shutdown_connections 2024-01-31T05:09:26.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.183+0000 7f1d37f89640 1 -- 172.21.15.99:0/3348747531 wait complete. 2024-01-31T05:09:26.199 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-01-31T05:09:26.199 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs qa 2024-01-31T05:09:26.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.309+0000 7f52e3d96640 1 -- 172.21.15.99:0/1137951193 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52dc0ffc00 msgr2=0x7f52dc100020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:26.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.309+0000 7f52e3d96640 1 --2- 172.21.15.99:0/1137951193 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52dc0ffc00 0x7f52dc100020 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f52d8009900 tx=0x7f52d802bc30 comp rx=0 tx=0).stop 2024-01-31T05:09:26.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.309+0000 7f52e3d96640 1 -- 172.21.15.99:0/1137951193 shutdown_connections 2024-01-31T05:09:26.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.309+0000 7f52e3d96640 1 --2- 172.21.15.99:0/1137951193 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52dc1017b0 0x7f52dc108040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:26.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.309+0000 7f52e3d96640 1 --2- 172.21.15.99:0/1137951193 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f52dc100df0 0x7f52dc101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:26.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.309+0000 7f52e3d96640 1 --2- 172.21.15.99:0/1137951193 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52dc0ffc00 0x7f52dc100020 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:26.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.309+0000 7f52e3d96640 1 -- 172.21.15.99:0/1137951193 >> 172.21.15.99:0/1137951193 conn(0x7f52dc0fb190 msgr2=0x7f52dc0fd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:26.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.309+0000 7f52e3d96640 1 -- 172.21.15.99:0/1137951193 shutdown_connections 2024-01-31T05:09:26.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.309+0000 7f52e3d96640 1 -- 172.21.15.99:0/1137951193 wait complete. 2024-01-31T05:09:26.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.310+0000 7f52e3d96640 1 Processor -- start 2024-01-31T05:09:26.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.310+0000 7f52e3d96640 1 -- start start 2024-01-31T05:09:26.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.310+0000 7f52e3d96640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52dc0ffc00 0x7f52dc196c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:26.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.310+0000 7f52e3d96640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f52dc100df0 0x7f52dc1971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:26.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.310+0000 7f52e3d96640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52dc1017b0 0x7f52dc19e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:26.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.310+0000 7f52e3d96640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc19e780 con 0x7f52dc0ffc00 2024-01-31T05:09:26.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.310+0000 7f52e3d96640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc19e8f0 con 0x7f52dc1017b0 2024-01-31T05:09:26.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.310+0000 7f52e3d96640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc19eab0 con 0x7f52dc100df0 2024-01-31T05:09:26.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.310+0000 7f52e1b32640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52dc0ffc00 0x7f52dc196c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:26.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.310+0000 7f52e1b32640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52dc0ffc00 0x7f52dc196c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60596/0 (socket says 172.21.15.99:60596) 2024-01-31T05:09:26.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.310+0000 7f52e1b32640 1 -- 172.21.15.99:0/2781754774 learned_addr learned my addr 172.21.15.99:0/2781754774 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:09:26.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.310+0000 7f52e1331640 1 --2- 172.21.15.99:0/2781754774 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f52dc100df0 0x7f52dc1971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:26.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.310+0000 7f52e2333640 1 --2- 172.21.15.99:0/2781754774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52dc1017b0 0x7f52dc19e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:26.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.310+0000 7f52e1b32640 1 -- 172.21.15.99:0/2781754774 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f52dc100df0 msgr2=0x7f52dc1971b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:26.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.310+0000 7f52e1b32640 1 --2- 172.21.15.99:0/2781754774 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f52dc100df0 0x7f52dc1971b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:26.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.310+0000 7f52e1b32640 1 -- 172.21.15.99:0/2781754774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52dc1017b0 msgr2=0x7f52dc19e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:26.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.310+0000 7f52e1b32640 1 --2- 172.21.15.99:0/2781754774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52dc1017b0 0x7f52dc19e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:26.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.310+0000 7f52e1b32640 1 -- 172.21.15.99:0/2781754774 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d8009560 con 0x7f52dc0ffc00 2024-01-31T05:09:26.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.310+0000 7f52e2333640 1 --2- 172.21.15.99:0/2781754774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52dc1017b0 0x7f52dc19e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:09:26.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.311+0000 7f52e1b32640 1 --2- 172.21.15.99:0/2781754774 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52dc0ffc00 0x7f52dc196c70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f52d8009230 tx=0x7f52d80040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:26.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.311+0000 7f52d2ffd640 1 -- 172.21.15.99:0/2781754774 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d80044c0 con 0x7f52dc0ffc00 2024-01-31T05:09:26.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.311+0000 7f52d2ffd640 1 -- 172.21.15.99:0/2781754774 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f52d80054c0 con 0x7f52dc0ffc00 2024-01-31T05:09:26.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.311+0000 7f52e3d96640 1 -- 172.21.15.99:0/2781754774 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52dc19ed30 con 0x7f52dc0ffc00 2024-01-31T05:09:26.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.311+0000 7f52d2ffd640 1 -- 172.21.15.99:0/2781754774 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d803e450 con 0x7f52dc0ffc00 2024-01-31T05:09:26.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.311+0000 7f52e3d96640 1 -- 172.21.15.99:0/2781754774 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52dc19f190 con 0x7f52dc0ffc00 2024-01-31T05:09:26.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.312+0000 7f52e3d96640 1 -- 172.21.15.99:0/2781754774 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52dc107040 con 0x7f52dc0ffc00 2024-01-31T05:09:26.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.313+0000 7f52d2ffd640 1 -- 172.21.15.99:0/2781754774 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f52d8003680 con 0x7f52dc0ffc00 2024-01-31T05:09:26.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.313+0000 7f52d2ffd640 1 --2- 172.21.15.99:0/2781754774 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f52c80a12e0 0x7f52c80a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:26.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.313+0000 7f52e1331640 1 --2- 172.21.15.99:0/2781754774 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f52c80a12e0 0x7f52c80a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:26.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.313+0000 7f52d2ffd640 1 -- 172.21.15.99:0/2781754774 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f52d80ef480 con 0x7f52dc0ffc00 2024-01-31T05:09:26.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.314+0000 7f52e1331640 1 --2- 172.21.15.99:0/2781754774 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f52c80a12e0 0x7f52c80a37a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f52dc198170 tx=0x7f52cc00a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:26.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.318+0000 7f52d2ffd640 1 -- 172.21.15.99:0/2781754774 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f52d80b8a50 con 0x7f52dc0ffc00 2024-01-31T05:09:26.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:26.513+0000 7f52e3d96640 1 -- 172.21.15.99:0/2781754774 --> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7f52dc02cca0 con 0x7f52c80a12e0 2024-01-31T05:09:26.632 INFO:journalctl@ceph.mds.b.smithi179.stdout:Jan 31 05:09:26 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-b[66457]: 2024-01-31T05:09:26.313+0000 7fef06546700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-31T05:09:26.632 INFO:journalctl@ceph.mds.b.smithi179.stdout:Jan 31 05:09:26 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-b[66457]: 2024-01-31T05:09:26.313+0000 7fef06546700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-01-31T05:09:26.632 INFO:journalctl@ceph.mds.b.smithi179.stdout:Jan 31 05:09:26 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-b[66457]: 2024-01-31T05:09:26.313+0000 7fef06546700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-01-31T05:09:26.818 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:09:26 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:09:26.518+0000 7f4921dbf700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-31T05:09:26.818 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:09:26 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:09:26.518+0000 7f4921dbf700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-31T05:09:26.818 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:09:26 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:09:26.518+0000 7f4921dbf700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-31T05:09:26.819 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:09:26 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:09:26.518+0000 7f4921dbf700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-31T05:09:26.819 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:09:26 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:09:26.518+0000 7f4921dbf700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-31T05:09:27.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.192+0000 7f52d2ffd640 1 -- 172.21.15.99:0/2781754774 <== mgr.14152 v2:172.21.15.99:6800/3925720924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f52dc02cca0 con 0x7f52c80a12e0 2024-01-31T05:09:27.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.194+0000 7f52e3d96640 1 -- 172.21.15.99:0/2781754774 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f52c80a12e0 msgr2=0x7f52c80a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:27.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.194+0000 7f52e3d96640 1 --2- 172.21.15.99:0/2781754774 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f52c80a12e0 0x7f52c80a37a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f52dc198170 tx=0x7f52cc00a2d0 comp rx=0 tx=0).stop 2024-01-31T05:09:27.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.194+0000 7f52e3d96640 1 -- 172.21.15.99:0/2781754774 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52dc0ffc00 msgr2=0x7f52dc196c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:27.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.194+0000 7f52e3d96640 1 --2- 172.21.15.99:0/2781754774 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52dc0ffc00 0x7f52dc196c70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f52d8009230 tx=0x7f52d80040c0 comp rx=0 tx=0).stop 2024-01-31T05:09:27.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.194+0000 7f52e3d96640 1 -- 172.21.15.99:0/2781754774 shutdown_connections 2024-01-31T05:09:27.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.194+0000 7f52e3d96640 1 --2- 172.21.15.99:0/2781754774 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f52c80a12e0 0x7f52c80a37a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:27.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.194+0000 7f52e3d96640 1 --2- 172.21.15.99:0/2781754774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52dc1017b0 0x7f52dc19e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:27.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.194+0000 7f52e3d96640 1 --2- 172.21.15.99:0/2781754774 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f52dc100df0 0x7f52dc1971b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:27.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.194+0000 7f52e3d96640 1 --2- 172.21.15.99:0/2781754774 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52dc0ffc00 0x7f52dc196c70 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:27.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.194+0000 7f52e3d96640 1 -- 172.21.15.99:0/2781754774 >> 172.21.15.99:0/2781754774 conn(0x7f52dc0fb190 msgr2=0x7f52dc104210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:27.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.194+0000 7f52e3d96640 1 -- 172.21.15.99:0/2781754774 shutdown_connections 2024-01-31T05:09:27.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.194+0000 7f52e3d96640 1 -- 172.21.15.99:0/2781754774 wait complete. 2024-01-31T05:09:27.206 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 --group_name qa 2024-01-31T05:09:27.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.314+0000 7fc48f7f1640 1 -- 172.21.15.99:0/3598260575 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4880ff5f0 msgr2=0x7fc4880ffa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:27.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.314+0000 7fc48f7f1640 1 --2- 172.21.15.99:0/3598260575 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4880ff5f0 0x7fc4880ffa10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc484009900 tx=0x7fc48402bcd0 comp rx=0 tx=0).stop 2024-01-31T05:09:27.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.314+0000 7fc48f7f1640 1 -- 172.21.15.99:0/3598260575 shutdown_connections 2024-01-31T05:09:27.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.314+0000 7fc48f7f1640 1 --2- 172.21.15.99:0/3598260575 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4881008f0 0x7fc488100d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:27.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.314+0000 7fc48f7f1640 1 --2- 172.21.15.99:0/3598260575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc4880fff50 0x7fc4881003b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:27.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.314+0000 7fc48f7f1640 1 --2- 172.21.15.99:0/3598260575 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4880ff5f0 0x7fc4880ffa10 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:27.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.314+0000 7fc48f7f1640 1 -- 172.21.15.99:0/3598260575 >> 172.21.15.99:0/3598260575 conn(0x7fc4880fb190 msgr2=0x7fc4880fd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:27.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.314+0000 7fc48f7f1640 1 -- 172.21.15.99:0/3598260575 shutdown_connections 2024-01-31T05:09:27.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.314+0000 7fc48f7f1640 1 -- 172.21.15.99:0/3598260575 wait complete. 2024-01-31T05:09:27.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.315+0000 7fc48f7f1640 1 Processor -- start 2024-01-31T05:09:27.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.315+0000 7fc48f7f1640 1 -- start start 2024-01-31T05:09:27.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.315+0000 7fc48f7f1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4880ff5f0 0x7fc488105170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:27.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.315+0000 7fc48f7f1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc4880fff50 0x7fc4881056b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:27.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.315+0000 7fc48f7f1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4881008f0 0x7fc488101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:27.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.315+0000 7fc48f7f1640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc488102470 con 0x7fc4881008f0 2024-01-31T05:09:27.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.315+0000 7fc48f7f1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4881025e0 con 0x7fc4880ff5f0 2024-01-31T05:09:27.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.315+0000 7fc48f7f1640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4881027a0 con 0x7fc4880fff50 2024-01-31T05:09:27.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.315+0000 7fc48dd8e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4881008f0 0x7fc488101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:27.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.315+0000 7fc48d58d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4880ff5f0 0x7fc488105170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:27.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.315+0000 7fc48cd8c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc4880fff50 0x7fc4881056b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:27.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.315+0000 7fc48dd8e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4881008f0 0x7fc488101ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60620/0 (socket says 172.21.15.99:60620) 2024-01-31T05:09:27.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.315+0000 7fc48dd8e640 1 -- 172.21.15.99:0/1820517581 learned_addr learned my addr 172.21.15.99:0/1820517581 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:09:27.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.315+0000 7fc48d58d640 1 --2- 172.21.15.99:0/1820517581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4880ff5f0 0x7fc488105170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.99:39310/0 (socket says 172.21.15.99:39310) 2024-01-31T05:09:27.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.316+0000 7fc48dd8e640 1 -- 172.21.15.99:0/1820517581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc4880fff50 msgr2=0x7fc4881056b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:27.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.316+0000 7fc48dd8e640 1 --2- 172.21.15.99:0/1820517581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc4880fff50 0x7fc4881056b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:27.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.316+0000 7fc48dd8e640 1 -- 172.21.15.99:0/1820517581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4880ff5f0 msgr2=0x7fc488105170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:27.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.316+0000 7fc48dd8e640 1 --2- 172.21.15.99:0/1820517581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4880ff5f0 0x7fc488105170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:27.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.316+0000 7fc48dd8e640 1 -- 172.21.15.99:0/1820517581 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc484009560 con 0x7fc4881008f0 2024-01-31T05:09:27.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.316+0000 7fc48dd8e640 1 --2- 172.21.15.99:0/1820517581 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4881008f0 0x7fc488101ce0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc48000b970 tx=0x7fc48000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:27.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.316+0000 7fc47e7fc640 1 -- 172.21.15.99:0/1820517581 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48000caa0 con 0x7fc4881008f0 2024-01-31T05:09:27.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.316+0000 7fc47e7fc640 1 -- 172.21.15.99:0/1820517581 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc48000cc00 con 0x7fc4881008f0 2024-01-31T05:09:27.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.316+0000 7fc48f7f1640 1 -- 172.21.15.99:0/1820517581 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4881a5540 con 0x7fc4881008f0 2024-01-31T05:09:27.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.316+0000 7fc47e7fc640 1 -- 172.21.15.99:0/1820517581 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4800075d0 con 0x7fc4881008f0 2024-01-31T05:09:27.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.316+0000 7fc48f7f1640 1 -- 172.21.15.99:0/1820517581 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4881a5a80 con 0x7fc4881008f0 2024-01-31T05:09:27.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.317+0000 7fc48f7f1640 1 -- 172.21.15.99:0/1820517581 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc48810a620 con 0x7fc4881008f0 2024-01-31T05:09:27.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.318+0000 7fc47e7fc640 1 -- 172.21.15.99:0/1820517581 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7fc480014440 con 0x7fc4881008f0 2024-01-31T05:09:27.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.318+0000 7fc47e7fc640 1 --2- 172.21.15.99:0/1820517581 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc4740a12e0 0x7fc4740a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:27.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.318+0000 7fc48d58d640 1 --2- 172.21.15.99:0/1820517581 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc4740a12e0 0x7fc4740a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:27.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.318+0000 7fc47e7fc640 1 -- 172.21.15.99:0/1820517581 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fc4800cc200 con 0x7fc4881008f0 2024-01-31T05:09:27.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.319+0000 7fc48d58d640 1 --2- 172.21.15.99:0/1820517581 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc4740a12e0 0x7fc4740a37a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc484005ab0 tx=0x7fc48402c670 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:27.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.323+0000 7fc47e7fc640 1 -- 172.21.15.99:0/1820517581 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fc480095880 con 0x7fc4881008f0 2024-01-31T05:09:27.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.520+0000 7fc48f7f1640 1 -- 172.21.15.99:0/1820517581 --> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7fc488061130 con 0x7fc4740a12e0 2024-01-31T05:09:27.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.541+0000 7fc47e7fc640 1 -- 172.21.15.99:0/1820517581 <== mgr.14152 v2:172.21.15.99:6800/3925720924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fc488061130 con 0x7fc4740a12e0 2024-01-31T05:09:27.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.543+0000 7fc48f7f1640 1 -- 172.21.15.99:0/1820517581 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc4740a12e0 msgr2=0x7fc4740a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:27.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.543+0000 7fc48f7f1640 1 --2- 172.21.15.99:0/1820517581 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc4740a12e0 0x7fc4740a37a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc484005ab0 tx=0x7fc48402c670 comp rx=0 tx=0).stop 2024-01-31T05:09:27.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.543+0000 7fc48f7f1640 1 -- 172.21.15.99:0/1820517581 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4881008f0 msgr2=0x7fc488101ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:27.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.543+0000 7fc48f7f1640 1 --2- 172.21.15.99:0/1820517581 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4881008f0 0x7fc488101ce0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc48000b970 tx=0x7fc48000bd70 comp rx=0 tx=0).stop 2024-01-31T05:09:27.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.543+0000 7fc48f7f1640 1 -- 172.21.15.99:0/1820517581 shutdown_connections 2024-01-31T05:09:27.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.543+0000 7fc48f7f1640 1 --2- 172.21.15.99:0/1820517581 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc4740a12e0 0x7fc4740a37a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:27.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.543+0000 7fc48f7f1640 1 --2- 172.21.15.99:0/1820517581 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4881008f0 0x7fc488101ce0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:27.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.543+0000 7fc48f7f1640 1 --2- 172.21.15.99:0/1820517581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc4880fff50 0x7fc4881056b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:27.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.543+0000 7fc48f7f1640 1 --2- 172.21.15.99:0/1820517581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4880ff5f0 0x7fc488105170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:27.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.543+0000 7fc48f7f1640 1 -- 172.21.15.99:0/1820517581 >> 172.21.15.99:0/1820517581 conn(0x7fc4880fb190 msgr2=0x7fc4880fc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:27.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.543+0000 7fc48f7f1640 1 -- 172.21.15.99:0/1820517581 shutdown_connections 2024-01-31T05:09:27.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.543+0000 7fc48f7f1640 1 -- 172.21.15.99:0/1820517581 wait complete. 2024-01-31T05:09:27.553 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:27 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/3348747531' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-01-31T05:09:27.553 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:27 smithi099 ceph-mon[31615]: mds.? [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] up:active 2024-01-31T05:09:27.553 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:27 smithi099 ceph-mon[31615]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-01-31T05:09:27.553 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:27 smithi099 ceph-mon[31615]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-01-31T05:09:27.553 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:27 smithi099 ceph-mon[31615]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=c=up:creating} 8 up:standby 2024-01-31T05:09:27.553 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:27 smithi099 ceph-mon[31615]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-01-31T05:09:27.553 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:27 smithi099 ceph-mon[31615]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:09:27.553 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:27 smithi099 ceph-mon[31615]: pgmap v289: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s wr, 11 op/s 2024-01-31T05:09:27.553 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:27 smithi099 ceph-mon[31615]: mds.? [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] up:active 2024-01-31T05:09:27.553 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:27 smithi099 ceph-mon[31615]: daemon mds.a assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-01-31T05:09:27.554 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:27 smithi099 ceph-mon[31615]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-01-31T05:09:27.554 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:27 smithi099 ceph-mon[31615]: Cluster is now healthy 2024-01-31T05:09:27.554 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:27 smithi099 ceph-mon[31615]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=c=up:active} 4 up:standby-replay 4 up:standby 2024-01-31T05:09:27.554 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:27 smithi099 ceph-mon[31615]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2024-01-31T05:09:27.554 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:27 smithi099 ceph-mon[31615]: daemon mds.a is now active in filesystem cephfs as rank 4 2024-01-31T05:09:27.555 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-01-31T05:09:27.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:27 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/3348747531' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-01-31T05:09:27.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:27 smithi181 ceph-mon[36434]: mds.? [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] up:active 2024-01-31T05:09:27.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:27 smithi181 ceph-mon[36434]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-01-31T05:09:27.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:27 smithi181 ceph-mon[36434]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-01-31T05:09:27.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:27 smithi181 ceph-mon[36434]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=c=up:creating} 8 up:standby 2024-01-31T05:09:27.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:27 smithi181 ceph-mon[36434]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-01-31T05:09:27.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:27 smithi181 ceph-mon[36434]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:09:27.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:27 smithi181 ceph-mon[36434]: pgmap v289: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s wr, 11 op/s 2024-01-31T05:09:27.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:27 smithi181 ceph-mon[36434]: mds.? [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] up:active 2024-01-31T05:09:27.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:27 smithi181 ceph-mon[36434]: daemon mds.a assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-01-31T05:09:27.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:27 smithi181 ceph-mon[36434]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-01-31T05:09:27.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:27 smithi181 ceph-mon[36434]: Cluster is now healthy 2024-01-31T05:09:27.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:27 smithi181 ceph-mon[36434]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=c=up:active} 4 up:standby-replay 4 up:standby 2024-01-31T05:09:27.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:27 smithi181 ceph-mon[36434]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2024-01-31T05:09:27.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:27 smithi181 ceph-mon[36434]: daemon mds.a is now active in filesystem cephfs as rank 4 2024-01-31T05:09:27.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:27 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/3348747531' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-01-31T05:09:27.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:27 smithi179 ceph-mon[35652]: mds.? [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] up:active 2024-01-31T05:09:27.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:27 smithi179 ceph-mon[35652]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-01-31T05:09:27.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:27 smithi179 ceph-mon[35652]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-01-31T05:09:27.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:27 smithi179 ceph-mon[35652]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=c=up:creating} 8 up:standby 2024-01-31T05:09:27.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:27 smithi179 ceph-mon[35652]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-01-31T05:09:27.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:27 smithi179 ceph-mon[35652]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:09:27.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:27 smithi179 ceph-mon[35652]: pgmap v289: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s wr, 11 op/s 2024-01-31T05:09:27.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:27 smithi179 ceph-mon[35652]: mds.? [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] up:active 2024-01-31T05:09:27.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:27 smithi179 ceph-mon[35652]: daemon mds.a assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-01-31T05:09:27.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:27 smithi179 ceph-mon[35652]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-01-31T05:09:27.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:27 smithi179 ceph-mon[35652]: Cluster is now healthy 2024-01-31T05:09:27.634 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:27 smithi179 ceph-mon[35652]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=c=up:active} 4 up:standby-replay 4 up:standby 2024-01-31T05:09:27.634 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:27 smithi179 ceph-mon[35652]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2024-01-31T05:09:27.634 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:27 smithi179 ceph-mon[35652]: daemon mds.a is now active in filesystem cephfs as rank 4 2024-01-31T05:09:27.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.662+0000 7f9fc0459640 1 -- 172.21.15.99:0/1627805242 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fb8101ef0 msgr2=0x7f9fb8102370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:27.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.662+0000 7f9fc0459640 1 --2- 172.21.15.99:0/1627805242 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fb8101ef0 0x7f9fb8102370 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8009900 tx=0x7f9fa802bc30 comp rx=0 tx=0).stop 2024-01-31T05:09:27.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.662+0000 7f9fc0459640 1 -- 172.21.15.99:0/1627805242 shutdown_connections 2024-01-31T05:09:27.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.662+0000 7f9fc0459640 1 --2- 172.21.15.99:0/1627805242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fb81028b0 0x7f9fb8109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:27.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.662+0000 7f9fc0459640 1 --2- 172.21.15.99:0/1627805242 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fb8101ef0 0x7f9fb8102370 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:27.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.662+0000 7f9fc0459640 1 --2- 172.21.15.99:0/1627805242 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fb8100d00 0x7f9fb8101120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:27.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.662+0000 7f9fc0459640 1 -- 172.21.15.99:0/1627805242 >> 172.21.15.99:0/1627805242 conn(0x7f9fb80fc290 msgr2=0x7f9fb80fe6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:27.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.662+0000 7f9fc0459640 1 -- 172.21.15.99:0/1627805242 shutdown_connections 2024-01-31T05:09:27.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.662+0000 7f9fc0459640 1 -- 172.21.15.99:0/1627805242 wait complete. 2024-01-31T05:09:27.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.663+0000 7f9fc0459640 1 Processor -- start 2024-01-31T05:09:27.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.663+0000 7f9fc0459640 1 -- start start 2024-01-31T05:09:27.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.663+0000 7f9fc0459640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fb8100d00 0x7f9fb8196d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:27.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.663+0000 7f9fc0459640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fb8101ef0 0x7f9fb8197250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:27.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.663+0000 7f9fc0459640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fb81028b0 0x7f9fb819e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:27.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.663+0000 7f9fc0459640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb819e7f0 con 0x7f9fb8101ef0 2024-01-31T05:09:27.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.663+0000 7f9fc0459640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb819e960 con 0x7f9fb8100d00 2024-01-31T05:09:27.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.663+0000 7f9fc0459640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb819eb20 con 0x7f9fb81028b0 2024-01-31T05:09:27.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.663+0000 7f9fbd9f4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fb8101ef0 0x7f9fb8197250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:27.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.663+0000 7f9fbd9f4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fb8101ef0 0x7f9fb8197250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60642/0 (socket says 172.21.15.99:60642) 2024-01-31T05:09:27.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.663+0000 7f9fbd9f4640 1 -- 172.21.15.99:0/2353678393 learned_addr learned my addr 172.21.15.99:0/2353678393 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:09:27.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.663+0000 7f9fbd9f4640 1 -- 172.21.15.99:0/2353678393 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fb81028b0 msgr2=0x7f9fb819e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:27.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.663+0000 7f9fbe9f6640 1 --2- 172.21.15.99:0/2353678393 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fb81028b0 0x7f9fb819e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:27.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.663+0000 7f9fbe1f5640 1 --2- 172.21.15.99:0/2353678393 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fb8100d00 0x7f9fb8196d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:27.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.663+0000 7f9fbd9f4640 1 --2- 172.21.15.99:0/2353678393 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fb81028b0 0x7f9fb819e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:27.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.663+0000 7f9fbd9f4640 1 -- 172.21.15.99:0/2353678393 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fb8100d00 msgr2=0x7f9fb8196d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:27.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.663+0000 7f9fbd9f4640 1 --2- 172.21.15.99:0/2353678393 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fb8100d00 0x7f9fb8196d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:27.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.663+0000 7f9fbd9f4640 1 -- 172.21.15.99:0/2353678393 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa8009560 con 0x7f9fb8101ef0 2024-01-31T05:09:27.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.663+0000 7f9fbe9f6640 1 --2- 172.21.15.99:0/2353678393 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fb81028b0 0x7f9fb819e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:09:27.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.664+0000 7f9fbd9f4640 1 --2- 172.21.15.99:0/2353678393 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fb8101ef0 0x7f9fb8197250 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8009230 tx=0x7f9fa8004ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:27.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.664+0000 7f9faf7fe640 1 -- 172.21.15.99:0/2353678393 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa80043d0 con 0x7f9fb8101ef0 2024-01-31T05:09:27.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.664+0000 7f9fc0459640 1 -- 172.21.15.99:0/2353678393 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fb819eda0 con 0x7f9fb8101ef0 2024-01-31T05:09:27.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.664+0000 7f9faf7fe640 1 -- 172.21.15.99:0/2353678393 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9fa80054c0 con 0x7f9fb8101ef0 2024-01-31T05:09:27.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.664+0000 7f9faf7fe640 1 -- 172.21.15.99:0/2353678393 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa803e450 con 0x7f9fb8101ef0 2024-01-31T05:09:27.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.664+0000 7f9fc0459640 1 -- 172.21.15.99:0/2353678393 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fb819f210 con 0x7f9fb8101ef0 2024-01-31T05:09:27.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.665+0000 7f9fc0459640 1 -- 172.21.15.99:0/2353678393 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fb8108160 con 0x7f9fb8101ef0 2024-01-31T05:09:27.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.666+0000 7f9faf7fe640 1 -- 172.21.15.99:0/2353678393 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f9fa80035f0 con 0x7f9fb8101ef0 2024-01-31T05:09:27.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.666+0000 7f9faf7fe640 1 --2- 172.21.15.99:0/2353678393 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f9fa40a12e0 0x7f9fa40a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:27.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.667+0000 7f9fbe1f5640 1 --2- 172.21.15.99:0/2353678393 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f9fa40a12e0 0x7f9fa40a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:27.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.667+0000 7f9faf7fe640 1 -- 172.21.15.99:0/2353678393 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f9fa80ef900 con 0x7f9fb8101ef0 2024-01-31T05:09:27.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.667+0000 7f9fbe1f5640 1 --2- 172.21.15.99:0/2353678393 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f9fa40a12e0 0x7f9fa40a37a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4005fd0 tx=0x7f9fb4005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:27.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.670+0000 7f9faf7fe640 1 -- 172.21.15.99:0/2353678393 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f9fa80b8f40 con 0x7f9fb8101ef0 2024-01-31T05:09:27.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.870+0000 7f9fc0459640 1 -- 172.21.15.99:0/2353678393 --> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7f9fb802cca0 con 0x7f9fa40a12e0 2024-01-31T05:09:27.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.874+0000 7f9faf7fe640 1 -- 172.21.15.99:0/2353678393 <== mgr.14152 v2:172.21.15.99:6800/3925720924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+54 (secure 0 0 0) 0x7f9fb802cca0 con 0x7f9fa40a12e0 2024-01-31T05:09:27.874 INFO:teuthology.orchestra.run.smithi099.stdout:/volumes/qa/sv_0/9291f8bf-fb76-40d7-b612-2626c321128d 2024-01-31T05:09:27.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.876+0000 7f9fc0459640 1 -- 172.21.15.99:0/2353678393 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f9fa40a12e0 msgr2=0x7f9fa40a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:27.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.876+0000 7f9fc0459640 1 --2- 172.21.15.99:0/2353678393 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f9fa40a12e0 0x7f9fa40a37a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4005fd0 tx=0x7f9fb4005850 comp rx=0 tx=0).stop 2024-01-31T05:09:27.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.876+0000 7f9fc0459640 1 -- 172.21.15.99:0/2353678393 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fb8101ef0 msgr2=0x7f9fb8197250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:27.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.876+0000 7f9fc0459640 1 --2- 172.21.15.99:0/2353678393 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fb8101ef0 0x7f9fb8197250 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8009230 tx=0x7f9fa8004ee0 comp rx=0 tx=0).stop 2024-01-31T05:09:27.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.876+0000 7f9fc0459640 1 -- 172.21.15.99:0/2353678393 shutdown_connections 2024-01-31T05:09:27.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.876+0000 7f9fc0459640 1 --2- 172.21.15.99:0/2353678393 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f9fa40a12e0 0x7f9fa40a37a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:27.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.876+0000 7f9fc0459640 1 --2- 172.21.15.99:0/2353678393 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fb81028b0 0x7f9fb819e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:27.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.876+0000 7f9fc0459640 1 --2- 172.21.15.99:0/2353678393 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fb8101ef0 0x7f9fb8197250 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:27.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.876+0000 7f9fc0459640 1 --2- 172.21.15.99:0/2353678393 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fb8100d00 0x7f9fb8196d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:27.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.876+0000 7f9fc0459640 1 -- 172.21.15.99:0/2353678393 >> 172.21.15.99:0/2353678393 conn(0x7f9fb80fc290 msgr2=0x7f9fb8105330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:27.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.877+0000 7f9fc0459640 1 -- 172.21.15.99:0/2353678393 shutdown_connections 2024-01-31T05:09:27.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.877+0000 7f9fc0459640 1 -- 172.21.15.99:0/2353678393 wait complete. 2024-01-31T05:09:27.887 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 --group_name qa 2024-01-31T05:09:27.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.994+0000 7f6dcd375640 1 -- 172.21.15.99:0/1351392588 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6dc80ffc10 msgr2=0x7f6dc8100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:27.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.994+0000 7f6dcd375640 1 --2- 172.21.15.99:0/1351392588 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6dc80ffc10 0x7f6dc8100030 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6db8009900 tx=0x7f6db802bc30 comp rx=0 tx=0).stop 2024-01-31T05:09:27.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.994+0000 7f6dcd375640 1 -- 172.21.15.99:0/1351392588 shutdown_connections 2024-01-31T05:09:27.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.994+0000 7f6dcd375640 1 --2- 172.21.15.99:0/1351392588 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6dc81017c0 0x7f6dc8108050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:27.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.994+0000 7f6dcd375640 1 --2- 172.21.15.99:0/1351392588 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6dc8100e00 0x7f6dc8101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:27.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.994+0000 7f6dcd375640 1 --2- 172.21.15.99:0/1351392588 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6dc80ffc10 0x7f6dc8100030 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:27.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.994+0000 7f6dcd375640 1 -- 172.21.15.99:0/1351392588 >> 172.21.15.99:0/1351392588 conn(0x7f6dc80fb1a0 msgr2=0x7f6dc80fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:27.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.994+0000 7f6dcd375640 1 -- 172.21.15.99:0/1351392588 shutdown_connections 2024-01-31T05:09:27.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.994+0000 7f6dcd375640 1 -- 172.21.15.99:0/1351392588 wait complete. 2024-01-31T05:09:27.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.994+0000 7f6dcd375640 1 Processor -- start 2024-01-31T05:09:27.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.994+0000 7f6dcd375640 1 -- start start 2024-01-31T05:09:27.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.995+0000 7f6dcd375640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6dc80ffc10 0x7f6dc8195c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:27.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.995+0000 7f6dcd375640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6dc8100e00 0x7f6dc8196160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:27.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.995+0000 7f6dcd375640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6dc81017c0 0x7f6dc819d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:27.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.995+0000 7f6dcd375640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc819d700 con 0x7f6dc80ffc10 2024-01-31T05:09:27.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.995+0000 7f6dcd375640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc819d870 con 0x7f6dc81017c0 2024-01-31T05:09:27.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.995+0000 7f6dcd375640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc819da30 con 0x7f6dc8100e00 2024-01-31T05:09:27.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.995+0000 7f6dc6ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6dc80ffc10 0x7f6dc8195c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:27.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.995+0000 7f6dc6ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6dc80ffc10 0x7f6dc8195c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60652/0 (socket says 172.21.15.99:60652) 2024-01-31T05:09:27.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.995+0000 7f6dc6ffd640 1 -- 172.21.15.99:0/4292683546 learned_addr learned my addr 172.21.15.99:0/4292683546 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:09:27.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.995+0000 7f6dc67fc640 1 --2- 172.21.15.99:0/4292683546 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6dc8100e00 0x7f6dc8196160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:27.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.995+0000 7f6dc77fe640 1 --2- 172.21.15.99:0/4292683546 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6dc81017c0 0x7f6dc819d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:27.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.995+0000 7f6dc6ffd640 1 -- 172.21.15.99:0/4292683546 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6dc8100e00 msgr2=0x7f6dc8196160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:27.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.995+0000 7f6dc6ffd640 1 --2- 172.21.15.99:0/4292683546 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6dc8100e00 0x7f6dc8196160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:27.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.995+0000 7f6dc6ffd640 1 -- 172.21.15.99:0/4292683546 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6dc81017c0 msgr2=0x7f6dc819d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:27.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.995+0000 7f6dc6ffd640 1 --2- 172.21.15.99:0/4292683546 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6dc81017c0 0x7f6dc819d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:27.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.995+0000 7f6dc6ffd640 1 -- 172.21.15.99:0/4292683546 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db8009560 con 0x7f6dc80ffc10 2024-01-31T05:09:27.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.995+0000 7f6dc77fe640 1 --2- 172.21.15.99:0/4292683546 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6dc81017c0 0x7f6dc819d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:09:27.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.995+0000 7f6dc6ffd640 1 --2- 172.21.15.99:0/4292683546 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6dc80ffc10 0x7f6dc8195c20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6db8009230 tx=0x7f6db8004dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:27.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.995+0000 7f6daffff640 1 -- 172.21.15.99:0/4292683546 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db80042d0 con 0x7f6dc80ffc10 2024-01-31T05:09:27.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.995+0000 7f6daffff640 1 -- 172.21.15.99:0/4292683546 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6db8004430 con 0x7f6dc80ffc10 2024-01-31T05:09:27.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.995+0000 7f6dcd375640 1 -- 172.21.15.99:0/4292683546 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dc819dcb0 con 0x7f6dc80ffc10 2024-01-31T05:09:27.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.995+0000 7f6daffff640 1 -- 172.21.15.99:0/4292683546 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db8003d10 con 0x7f6dc80ffc10 2024-01-31T05:09:27.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.995+0000 7f6dcd375640 1 -- 172.21.15.99:0/4292683546 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dc819e1c0 con 0x7f6dc80ffc10 2024-01-31T05:09:27.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.996+0000 7f6dcd375640 1 -- 172.21.15.99:0/4292683546 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dc8106fa0 con 0x7f6dc80ffc10 2024-01-31T05:09:27.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.997+0000 7f6daffff640 1 -- 172.21.15.99:0/4292683546 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f6db8005000 con 0x7f6dc80ffc10 2024-01-31T05:09:27.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.998+0000 7f6daffff640 1 --2- 172.21.15.99:0/4292683546 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f6db00a12e0 0x7f6db00a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:27.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.998+0000 7f6dc67fc640 1 --2- 172.21.15.99:0/4292683546 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f6db00a12e0 0x7f6db00a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:27.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.998+0000 7f6daffff640 1 -- 172.21.15.99:0/4292683546 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f6db80ef790 con 0x7f6dc80ffc10 2024-01-31T05:09:27.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:27.998+0000 7f6dc67fc640 1 --2- 172.21.15.99:0/4292683546 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f6db00a12e0 0x7f6db00a37a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc009b60 tx=0x7f6dbc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:28.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.001+0000 7f6daffff640 1 -- 172.21.15.99:0/4292683546 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f6db80b8cd0 con 0x7f6dc80ffc10 2024-01-31T05:09:28.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.204+0000 7f6dcd375640 1 -- 172.21.15.99:0/4292683546 --> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7f6dc802cc50 con 0x7f6db00a12e0 2024-01-31T05:09:28.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.225+0000 7f6daffff640 1 -- 172.21.15.99:0/4292683546 <== mgr.14152 v2:172.21.15.99:6800/3925720924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f6dc802cc50 con 0x7f6db00a12e0 2024-01-31T05:09:28.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.227+0000 7f6dcd375640 1 -- 172.21.15.99:0/4292683546 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f6db00a12e0 msgr2=0x7f6db00a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:28.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.227+0000 7f6dcd375640 1 --2- 172.21.15.99:0/4292683546 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f6db00a12e0 0x7f6db00a37a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc009b60 tx=0x7f6dbc005f90 comp rx=0 tx=0).stop 2024-01-31T05:09:28.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.228+0000 7f6dcd375640 1 -- 172.21.15.99:0/4292683546 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6dc80ffc10 msgr2=0x7f6dc8195c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:28.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.228+0000 7f6dcd375640 1 --2- 172.21.15.99:0/4292683546 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6dc80ffc10 0x7f6dc8195c20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6db8009230 tx=0x7f6db8004dd0 comp rx=0 tx=0).stop 2024-01-31T05:09:28.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.228+0000 7f6dcd375640 1 -- 172.21.15.99:0/4292683546 shutdown_connections 2024-01-31T05:09:28.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.228+0000 7f6dcd375640 1 --2- 172.21.15.99:0/4292683546 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f6db00a12e0 0x7f6db00a37a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:28.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.228+0000 7f6dcd375640 1 --2- 172.21.15.99:0/4292683546 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6dc81017c0 0x7f6dc819d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:28.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.228+0000 7f6dcd375640 1 --2- 172.21.15.99:0/4292683546 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6dc8100e00 0x7f6dc8196160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:28.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.228+0000 7f6dcd375640 1 --2- 172.21.15.99:0/4292683546 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6dc80ffc10 0x7f6dc8195c20 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:28.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.228+0000 7f6dcd375640 1 -- 172.21.15.99:0/4292683546 >> 172.21.15.99:0/4292683546 conn(0x7f6dc80fb1a0 msgr2=0x7f6dc8104170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:28.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.228+0000 7f6dcd375640 1 -- 172.21.15.99:0/4292683546 shutdown_connections 2024-01-31T05:09:28.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.228+0000 7f6dcd375640 1 -- 172.21.15.99:0/4292683546 wait complete. 2024-01-31T05:09:28.238 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-01-31T05:09:28.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.345+0000 7fd9248d6640 1 -- 172.21.15.99:0/4170394215 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9200ffbf0 msgr2=0x7fd920100010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:28.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.345+0000 7fd9248d6640 1 --2- 172.21.15.99:0/4170394215 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9200ffbf0 0x7fd920100010 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd910009900 tx=0x7fd91002bc30 comp rx=0 tx=0).stop 2024-01-31T05:09:28.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.346+0000 7fd9248d6640 1 -- 172.21.15.99:0/4170394215 shutdown_connections 2024-01-31T05:09:28.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.346+0000 7fd9248d6640 1 --2- 172.21.15.99:0/4170394215 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd9201017a0 0x7fd920108030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:28.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.346+0000 7fd9248d6640 1 --2- 172.21.15.99:0/4170394215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd920100de0 0x7fd920101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:28.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.346+0000 7fd9248d6640 1 --2- 172.21.15.99:0/4170394215 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9200ffbf0 0x7fd920100010 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:28.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.346+0000 7fd9248d6640 1 -- 172.21.15.99:0/4170394215 >> 172.21.15.99:0/4170394215 conn(0x7fd9200fb180 msgr2=0x7fd9200fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:28.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.346+0000 7fd9248d6640 1 -- 172.21.15.99:0/4170394215 shutdown_connections 2024-01-31T05:09:28.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.346+0000 7fd9248d6640 1 -- 172.21.15.99:0/4170394215 wait complete. 2024-01-31T05:09:28.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.346+0000 7fd9248d6640 1 Processor -- start 2024-01-31T05:09:28.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.346+0000 7fd9248d6640 1 -- start start 2024-01-31T05:09:28.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.346+0000 7fd9248d6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9200ffbf0 0x7fd9200689e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:28.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.347+0000 7fd9248d6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd920100de0 0x7fd92019ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:28.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.347+0000 7fd9248d6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9201017a0 0x7fd92019e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:28.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.347+0000 7fd9248d6640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd92019e800 con 0x7fd9200ffbf0 2024-01-31T05:09:28.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.347+0000 7fd9248d6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd92019e970 con 0x7fd9201017a0 2024-01-31T05:09:28.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.347+0000 7fd9248d6640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd92019eb30 con 0x7fd920100de0 2024-01-31T05:09:28.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.347+0000 7fd91e59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9200ffbf0 0x7fd9200689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:28.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.347+0000 7fd91e59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9200ffbf0 0x7fd9200689e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60676/0 (socket says 172.21.15.99:60676) 2024-01-31T05:09:28.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.347+0000 7fd91e59c640 1 -- 172.21.15.99:0/2563492310 learned_addr learned my addr 172.21.15.99:0/2563492310 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:09:28.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.347+0000 7fd917fff640 1 --2- 172.21.15.99:0/2563492310 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd920100de0 0x7fd92019ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:28.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.347+0000 7fd91ed9d640 1 --2- 172.21.15.99:0/2563492310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9201017a0 0x7fd92019e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:28.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.347+0000 7fd91e59c640 1 -- 172.21.15.99:0/2563492310 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd920100de0 msgr2=0x7fd92019ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:28.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.347+0000 7fd91e59c640 1 --2- 172.21.15.99:0/2563492310 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd920100de0 0x7fd92019ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:28.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.347+0000 7fd91e59c640 1 -- 172.21.15.99:0/2563492310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9201017a0 msgr2=0x7fd92019e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:28.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.347+0000 7fd91e59c640 1 --2- 172.21.15.99:0/2563492310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9201017a0 0x7fd92019e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:28.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.347+0000 7fd91e59c640 1 -- 172.21.15.99:0/2563492310 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd910009560 con 0x7fd9200ffbf0 2024-01-31T05:09:28.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.347+0000 7fd917fff640 1 --2- 172.21.15.99:0/2563492310 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd920100de0 0x7fd92019ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:09:28.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.347+0000 7fd91ed9d640 1 --2- 172.21.15.99:0/2563492310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9201017a0 0x7fd92019e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:09:28.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.347+0000 7fd91e59c640 1 --2- 172.21.15.99:0/2563492310 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9200ffbf0 0x7fd9200689e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd910009230 tx=0x7fd910004f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:28.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.347+0000 7fd9177fe640 1 -- 172.21.15.99:0/2563492310 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9100043d0 con 0x7fd9200ffbf0 2024-01-31T05:09:28.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.347+0000 7fd9177fe640 1 -- 172.21.15.99:0/2563492310 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd9100054c0 con 0x7fd9200ffbf0 2024-01-31T05:09:28.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.347+0000 7fd9248d6640 1 -- 172.21.15.99:0/2563492310 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd92019edb0 con 0x7fd9200ffbf0 2024-01-31T05:09:28.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.347+0000 7fd9177fe640 1 -- 172.21.15.99:0/2563492310 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd910003e60 con 0x7fd9200ffbf0 2024-01-31T05:09:28.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.347+0000 7fd9248d6640 1 -- 172.21.15.99:0/2563492310 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd92019f260 con 0x7fd9200ffbf0 2024-01-31T05:09:28.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.348+0000 7fd9248d6640 1 -- 172.21.15.99:0/2563492310 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd920107000 con 0x7fd9200ffbf0 2024-01-31T05:09:28.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.349+0000 7fd9177fe640 1 -- 172.21.15.99:0/2563492310 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7fd9100035f0 con 0x7fd9200ffbf0 2024-01-31T05:09:28.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.350+0000 7fd9177fe640 1 --2- 172.21.15.99:0/2563492310 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd90c0a12e0 0x7fd90c0a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:28.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.350+0000 7fd917fff640 1 --2- 172.21.15.99:0/2563492310 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd90c0a12e0 0x7fd90c0a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:28.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.350+0000 7fd9177fe640 1 -- 172.21.15.99:0/2563492310 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd9100ef830 con 0x7fd9200ffbf0 2024-01-31T05:09:28.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.350+0000 7fd917fff640 1 --2- 172.21.15.99:0/2563492310 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd90c0a12e0 0x7fd90c0a37a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd920068750 tx=0x7fd908005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:28.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.353+0000 7fd9177fe640 1 -- 172.21.15.99:0/2563492310 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fd9100b8e00 con 0x7fd9200ffbf0 2024-01-31T05:09:28.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.552+0000 7fd9248d6640 1 -- 172.21.15.99:0/2563492310 --> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fd92002cc30 con 0x7fd90c0a12e0 2024-01-31T05:09:28.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.556+0000 7fd9177fe640 1 -- 172.21.15.99:0/2563492310 <== mgr.14152 v2:172.21.15.99:6800/3925720924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+54 (secure 0 0 0) 0x7fd92002cc30 con 0x7fd90c0a12e0 2024-01-31T05:09:28.555 INFO:teuthology.orchestra.run.smithi099.stdout:/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f 2024-01-31T05:09:28.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.558+0000 7fd9248d6640 1 -- 172.21.15.99:0/2563492310 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd90c0a12e0 msgr2=0x7fd90c0a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:28.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.558+0000 7fd9248d6640 1 --2- 172.21.15.99:0/2563492310 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd90c0a12e0 0x7fd90c0a37a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd920068750 tx=0x7fd908005e50 comp rx=0 tx=0).stop 2024-01-31T05:09:28.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.558+0000 7fd9248d6640 1 -- 172.21.15.99:0/2563492310 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9200ffbf0 msgr2=0x7fd9200689e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:28.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.558+0000 7fd9248d6640 1 --2- 172.21.15.99:0/2563492310 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9200ffbf0 0x7fd9200689e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd910009230 tx=0x7fd910004f40 comp rx=0 tx=0).stop 2024-01-31T05:09:28.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.558+0000 7fd9248d6640 1 -- 172.21.15.99:0/2563492310 shutdown_connections 2024-01-31T05:09:28.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.558+0000 7fd9248d6640 1 --2- 172.21.15.99:0/2563492310 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd90c0a12e0 0x7fd90c0a37a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:28.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.558+0000 7fd9248d6640 1 --2- 172.21.15.99:0/2563492310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9201017a0 0x7fd92019e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:28.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.558+0000 7fd9248d6640 1 --2- 172.21.15.99:0/2563492310 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd920100de0 0x7fd92019ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:28.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.558+0000 7fd9248d6640 1 --2- 172.21.15.99:0/2563492310 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9200ffbf0 0x7fd9200689e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:28.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.558+0000 7fd9248d6640 1 -- 172.21.15.99:0/2563492310 >> 172.21.15.99:0/2563492310 conn(0x7fd9200fb180 msgr2=0x7fd9201041d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:28.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.558+0000 7fd9248d6640 1 -- 172.21.15.99:0/2563492310 shutdown_connections 2024-01-31T05:09:28.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.558+0000 7fd9248d6640 1 -- 172.21.15.99:0/2563492310 wait complete. 2024-01-31T05:09:28.567 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:28 smithi099 ceph-mon[31615]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:09:28.567 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:28 smithi099 ceph-mon[31615]: mds.? [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] up:active 2024-01-31T05:09:28.567 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:28 smithi099 ceph-mon[31615]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-01-31T05:09:28.567 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:28 smithi099 ceph-mon[31615]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:09:28.568 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T05:09:28.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:28 smithi181 ceph-mon[36434]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:09:28.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:28 smithi181 ceph-mon[36434]: mds.? [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] up:active 2024-01-31T05:09:28.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:28 smithi181 ceph-mon[36434]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-01-31T05:09:28.572 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:28 smithi181 ceph-mon[36434]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:09:28.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:28 smithi179 ceph-mon[35652]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:09:28.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:28 smithi179 ceph-mon[35652]: mds.? [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] up:active 2024-01-31T05:09:28.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:28 smithi179 ceph-mon[35652]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-01-31T05:09:28.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:28 smithi179 ceph-mon[35652]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:09:28.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.672+0000 7fd8e165e640 1 -- 172.21.15.99:0/3512818212 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8dc100d30 msgr2=0x7fd8dc101150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:28.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.672+0000 7fd8e165e640 1 --2- 172.21.15.99:0/3512818212 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8dc100d30 0x7fd8dc101150 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd8d4009900 tx=0x7fd8d402bc30 comp rx=0 tx=0).stop 2024-01-31T05:09:28.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.672+0000 7fd8e165e640 1 -- 172.21.15.99:0/3512818212 shutdown_connections 2024-01-31T05:09:28.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.672+0000 7fd8e165e640 1 --2- 172.21.15.99:0/3512818212 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8dc1028e0 0x7fd8dc109170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:28.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.672+0000 7fd8e165e640 1 --2- 172.21.15.99:0/3512818212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8dc101f20 0x7fd8dc1023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:28.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.672+0000 7fd8e165e640 1 --2- 172.21.15.99:0/3512818212 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8dc100d30 0x7fd8dc101150 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:28.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.672+0000 7fd8e165e640 1 -- 172.21.15.99:0/3512818212 >> 172.21.15.99:0/3512818212 conn(0x7fd8dc0fc2a0 msgr2=0x7fd8dc0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:28.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.672+0000 7fd8e165e640 1 -- 172.21.15.99:0/3512818212 shutdown_connections 2024-01-31T05:09:28.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.672+0000 7fd8e165e640 1 -- 172.21.15.99:0/3512818212 wait complete. 2024-01-31T05:09:28.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.673+0000 7fd8e165e640 1 Processor -- start 2024-01-31T05:09:28.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.673+0000 7fd8e165e640 1 -- start start 2024-01-31T05:09:28.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.673+0000 7fd8e165e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8dc100d30 0x7fd8dc196d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:28.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.673+0000 7fd8e165e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8dc101f20 0x7fd8dc197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:28.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.673+0000 7fd8e165e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8dc1028e0 0x7fd8dc19e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:28.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.673+0000 7fd8e165e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc19e7e0 con 0x7fd8dc1028e0 2024-01-31T05:09:28.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.673+0000 7fd8e165e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc19e950 con 0x7fd8dc101f20 2024-01-31T05:09:28.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.673+0000 7fd8e165e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc19eb10 con 0x7fd8dc100d30 2024-01-31T05:09:28.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.673+0000 7fd8db7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8dc1028e0 0x7fd8dc19e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:28.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.673+0000 7fd8db7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8dc1028e0 0x7fd8dc19e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60684/0 (socket says 172.21.15.99:60684) 2024-01-31T05:09:28.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.673+0000 7fd8db7fe640 1 -- 172.21.15.99:0/3964250433 learned_addr learned my addr 172.21.15.99:0/3964250433 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:09:28.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.673+0000 7fd8da7fc640 1 --2- 172.21.15.99:0/3964250433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8dc101f20 0x7fd8dc197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:28.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.674+0000 7fd8db7fe640 1 -- 172.21.15.99:0/3964250433 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8dc100d30 msgr2=0x7fd8dc196d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:28.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.674+0000 7fd8daffd640 1 --2- 172.21.15.99:0/3964250433 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8dc100d30 0x7fd8dc196d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:28.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.674+0000 7fd8db7fe640 1 --2- 172.21.15.99:0/3964250433 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8dc100d30 0x7fd8dc196d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:28.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.674+0000 7fd8db7fe640 1 -- 172.21.15.99:0/3964250433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8dc101f20 msgr2=0x7fd8dc197240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:28.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.674+0000 7fd8db7fe640 1 --2- 172.21.15.99:0/3964250433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8dc101f20 0x7fd8dc197240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:28.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.674+0000 7fd8db7fe640 1 -- 172.21.15.99:0/3964250433 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d4009560 con 0x7fd8dc1028e0 2024-01-31T05:09:28.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.674+0000 7fd8db7fe640 1 --2- 172.21.15.99:0/3964250433 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8dc1028e0 0x7fd8dc19e270 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc00b970 tx=0x7fd8cc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:28.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.674+0000 7fd8c3fff640 1 -- 172.21.15.99:0/3964250433 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc00cb40 con 0x7fd8dc1028e0 2024-01-31T05:09:28.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.674+0000 7fd8c3fff640 1 -- 172.21.15.99:0/3964250433 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd8cc00cca0 con 0x7fd8dc1028e0 2024-01-31T05:09:28.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.674+0000 7fd8e165e640 1 -- 172.21.15.99:0/3964250433 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8dc19edf0 con 0x7fd8dc1028e0 2024-01-31T05:09:28.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.674+0000 7fd8c3fff640 1 -- 172.21.15.99:0/3964250433 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc007770 con 0x7fd8dc1028e0 2024-01-31T05:09:28.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.674+0000 7fd8e165e640 1 -- 172.21.15.99:0/3964250433 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8dc19f290 con 0x7fd8dc1028e0 2024-01-31T05:09:28.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.675+0000 7fd8e165e640 1 -- 172.21.15.99:0/3964250433 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8dc108050 con 0x7fd8dc1028e0 2024-01-31T05:09:28.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.676+0000 7fd8c3fff640 1 -- 172.21.15.99:0/3964250433 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7fd8cc014440 con 0x7fd8dc1028e0 2024-01-31T05:09:28.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.677+0000 7fd8c3fff640 1 --2- 172.21.15.99:0/3964250433 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd8c40a12e0 0x7fd8c40a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:28.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.677+0000 7fd8daffd640 1 --2- 172.21.15.99:0/3964250433 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd8c40a12e0 0x7fd8c40a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:28.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.677+0000 7fd8c3fff640 1 -- 172.21.15.99:0/3964250433 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd8cc0cc390 con 0x7fd8dc1028e0 2024-01-31T05:09:28.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.677+0000 7fd8daffd640 1 --2- 172.21.15.99:0/3964250433 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd8c40a12e0 0x7fd8c40a37a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd8d4006010 tx=0x7fd8d4000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:28.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.681+0000 7fd8c3fff640 1 -- 172.21.15.99:0/3964250433 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fd8cc04f600 con 0x7fd8dc1028e0 2024-01-31T05:09:28.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.889+0000 7fd8e165e640 1 -- 172.21.15.99:0/3964250433 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd8dc10c640 con 0x7fd8dc1028e0 2024-01-31T05:09:28.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.889+0000 7fd8c3fff640 1 -- 172.21.15.99:0/3964250433 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11385 (secure 0 0 0) 0x7fd8cc0958d0 con 0x7fd8dc1028e0 2024-01-31T05:09:28.889 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:09:28.889 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/1488539026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1488539026},{"type":"v1","addr":"172.21.15.99:6835","nonce":1488539026}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/1649552652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1649552652},{"type":"v1","addr":"172.21.15.99:6837","nonce":1649552652}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-01-31T05:09:20.564215+0000","modified":"2024-01-31T05:09:28.172314+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24461,"mds_2":24457,"mds_3":24439,"mds_4":14619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6839/4070477446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4070477446},{"type":"v1","addr":"172.21.15.99:6839","nonce":4070477446}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.99:6841/3069939345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6840","nonce":3069939345},{"type":"v1","addr":"172.21.15.99:6841","nonce":3069939345}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24376":{"gid":24376,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6833/427201290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":427201290},{"type":"v1","addr":"172.21.15.181:6833","nonce":427201290}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24401":{"gid":24401,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/472161020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":472161020},{"type":"v1","addr":"172.21.15.179:6833","nonce":472161020}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24427":{"gid":24427,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/1038715471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1038715471},{"type":"v1","addr":"172.21.15.181:6835","nonce":1038715471}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24434":{"gid":24434,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/966976592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":966976592},{"type":"v1","addr":"172.21.15.179:6835","nonce":966976592}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24439":{"gid":24439,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.181:6837/3875964154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3875964154},{"type":"v1","addr":"172.21.15.181:6837","nonce":3875964154}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24457":{"gid":24457,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.181:6839/996120687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":996120687},{"type":"v1","addr":"172.21.15.181:6839","nonce":996120687}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6837/837402830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":837402830},{"type":"v1","addr":"172.21.15.179:6837","nonce":837402830}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6839/754762785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":754762785},{"type":"v1","addr":"172.21.15.179:6839","nonce":754762785}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-31T05:09:28.889 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 26 2024-01-31T05:09:28.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.891+0000 7fd8e165e640 1 -- 172.21.15.99:0/3964250433 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd8c40a12e0 msgr2=0x7fd8c40a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:28.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.891+0000 7fd8e165e640 1 --2- 172.21.15.99:0/3964250433 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd8c40a12e0 0x7fd8c40a37a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd8d4006010 tx=0x7fd8d4000bc0 comp rx=0 tx=0).stop 2024-01-31T05:09:28.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.891+0000 7fd8e165e640 1 -- 172.21.15.99:0/3964250433 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8dc1028e0 msgr2=0x7fd8dc19e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:28.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.891+0000 7fd8e165e640 1 --2- 172.21.15.99:0/3964250433 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8dc1028e0 0x7fd8dc19e270 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc00b970 tx=0x7fd8cc00be30 comp rx=0 tx=0).stop 2024-01-31T05:09:28.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.891+0000 7fd8e165e640 1 -- 172.21.15.99:0/3964250433 shutdown_connections 2024-01-31T05:09:28.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.891+0000 7fd8e165e640 1 --2- 172.21.15.99:0/3964250433 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd8c40a12e0 0x7fd8c40a37a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:28.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.891+0000 7fd8e165e640 1 --2- 172.21.15.99:0/3964250433 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8dc1028e0 0x7fd8dc19e270 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:28.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.891+0000 7fd8e165e640 1 --2- 172.21.15.99:0/3964250433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8dc101f20 0x7fd8dc197240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:28.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.891+0000 7fd8e165e640 1 --2- 172.21.15.99:0/3964250433 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8dc100d30 0x7fd8dc196d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:28.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.891+0000 7fd8e165e640 1 -- 172.21.15.99:0/3964250433 >> 172.21.15.99:0/3964250433 conn(0x7fd8dc0fc2a0 msgr2=0x7fd8dc105220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:28.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.892+0000 7fd8e165e640 1 -- 172.21.15.99:0/3964250433 shutdown_connections 2024-01-31T05:09:28.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:28.892+0000 7fd8e165e640 1 -- 172.21.15.99:0/3964250433 wait complete. 2024-01-31T05:09:28.902 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:09:29.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.004+0000 7fa18baf1640 1 -- 172.21.15.99:0/2502539358 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa1841017a0 msgr2=0x7fa184103b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:29.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.004+0000 7fa18baf1640 1 --2- 172.21.15.99:0/2502539358 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa1841017a0 0x7fa184103b90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa180009900 tx=0x7fa18002bc30 comp rx=0 tx=0).stop 2024-01-31T05:09:29.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.004+0000 7fa18baf1640 1 -- 172.21.15.99:0/2502539358 shutdown_connections 2024-01-31T05:09:29.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.004+0000 7fa18baf1640 1 --2- 172.21.15.99:0/2502539358 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa184106a00 0x7fa184108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:29.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.004+0000 7fa18baf1640 1 --2- 172.21.15.99:0/2502539358 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa1841040d0 0x7fa1841064c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:29.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.004+0000 7fa18baf1640 1 --2- 172.21.15.99:0/2502539358 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa1841017a0 0x7fa184103b90 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:29.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.004+0000 7fa18baf1640 1 -- 172.21.15.99:0/2502539358 >> 172.21.15.99:0/2502539358 conn(0x7fa1840fb1d0 msgr2=0x7fa1840fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:29.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.004+0000 7fa18baf1640 1 -- 172.21.15.99:0/2502539358 shutdown_connections 2024-01-31T05:09:29.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.004+0000 7fa18baf1640 1 -- 172.21.15.99:0/2502539358 wait complete. 2024-01-31T05:09:29.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.005+0000 7fa18baf1640 1 Processor -- start 2024-01-31T05:09:29.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.005+0000 7fa18baf1640 1 -- start start 2024-01-31T05:09:29.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.005+0000 7fa18baf1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa1841017a0 0x7fa184196cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:29.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.005+0000 7fa18baf1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1841040d0 0x7fa184197230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:29.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.005+0000 7fa18baf1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa184106a00 0x7fa18419e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:29.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.005+0000 7fa18baf1640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18419e7d0 con 0x7fa1841017a0 2024-01-31T05:09:29.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.005+0000 7fa18baf1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18419e940 con 0x7fa184106a00 2024-01-31T05:09:29.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.005+0000 7fa18baf1640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18419eb00 con 0x7fa1841040d0 2024-01-31T05:09:29.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.005+0000 7fa18988d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa1841017a0 0x7fa184196cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:29.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.005+0000 7fa18988d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa1841017a0 0x7fa184196cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60708/0 (socket says 172.21.15.99:60708) 2024-01-31T05:09:29.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.005+0000 7fa18988d640 1 -- 172.21.15.99:0/802535416 learned_addr learned my addr 172.21.15.99:0/802535416 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:09:29.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.005+0000 7fa18a08e640 1 --2- 172.21.15.99:0/802535416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa184106a00 0x7fa18419e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:29.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.005+0000 7fa18908c640 1 --2- 172.21.15.99:0/802535416 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1841040d0 0x7fa184197230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:29.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.005+0000 7fa18988d640 1 -- 172.21.15.99:0/802535416 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1841040d0 msgr2=0x7fa184197230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:29.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.005+0000 7fa18988d640 1 --2- 172.21.15.99:0/802535416 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1841040d0 0x7fa184197230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:29.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.005+0000 7fa18988d640 1 -- 172.21.15.99:0/802535416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa184106a00 msgr2=0x7fa18419e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:29.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.005+0000 7fa18988d640 1 --2- 172.21.15.99:0/802535416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa184106a00 0x7fa18419e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:29.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.005+0000 7fa18988d640 1 -- 172.21.15.99:0/802535416 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa180009560 con 0x7fa1841017a0 2024-01-31T05:09:29.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.006+0000 7fa18988d640 1 --2- 172.21.15.99:0/802535416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa1841017a0 0x7fa184196cf0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa180009230 tx=0x7fa180004ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:29.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.006+0000 7fa17affd640 1 -- 172.21.15.99:0/802535416 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1800043d0 con 0x7fa1841017a0 2024-01-31T05:09:29.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.006+0000 7fa17affd640 1 -- 172.21.15.99:0/802535416 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa1800054c0 con 0x7fa1841017a0 2024-01-31T05:09:29.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.006+0000 7fa18baf1640 1 -- 172.21.15.99:0/802535416 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa18419ed80 con 0x7fa1841017a0 2024-01-31T05:09:29.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.006+0000 7fa17affd640 1 -- 172.21.15.99:0/802535416 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18003e450 con 0x7fa1841017a0 2024-01-31T05:09:29.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.006+0000 7fa18baf1640 1 -- 172.21.15.99:0/802535416 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa18419f1d0 con 0x7fa1841017a0 2024-01-31T05:09:29.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.007+0000 7fa18baf1640 1 -- 172.21.15.99:0/802535416 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1840fccc0 con 0x7fa1841017a0 2024-01-31T05:09:29.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.008+0000 7fa17affd640 1 -- 172.21.15.99:0/802535416 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) v1 ==== 135895+0+0 (secure 0 0 0) 0x7fa1800035f0 con 0x7fa1841017a0 2024-01-31T05:09:29.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.008+0000 7fa17affd640 1 --2- 172.21.15.99:0/802535416 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa1700a12e0 0x7fa1700a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:29.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.008+0000 7fa18908c640 1 --2- 172.21.15.99:0/802535416 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa1700a12e0 0x7fa1700a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:29.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.008+0000 7fa17affd640 1 -- 172.21.15.99:0/802535416 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa1800ef540 con 0x7fa1841017a0 2024-01-31T05:09:29.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.009+0000 7fa18908c640 1 --2- 172.21.15.99:0/802535416 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa1700a12e0 0x7fa1700a37a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa1740058c0 tx=0x7fa174005c60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:29.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.012+0000 7fa17affd640 1 -- 172.21.15.99:0/802535416 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fa1800b8a80 con 0x7fa1841017a0 2024-01-31T05:09:29.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.186+0000 7fa18baf1640 1 -- 172.21.15.99:0/802535416 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa18410c820 con 0x7fa1841017a0 2024-01-31T05:09:29.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.187+0000 7fa17affd640 1 -- 172.21.15.99:0/802535416 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22132 (secure 0 0 0) 0x7fa1800ba9b0 con 0x7fa1841017a0 2024-01-31T05:09:29.188 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:09:29.188 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":86,"fsid":"9288ff44-bff5-11ee-95b3-87774f69a715","created":"2024-01-31T05:01:26.130917+0000","modified":"2024-01-31T05:09:21.567593+0000","last_up_change":"2024-01-31T05:08:31.228478+0000","last_in_change":"2024-01-31T05:08:10.799511+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:46.842423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:09:18.693558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-31T05:09:19.734003+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b45878d9-28f1-4821-ba72-26a32d3fc780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6803","nonce":1213805280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6805","nonce":1213805280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6809","nonce":1213805280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6807","nonce":1213805280}]},"public_addr":"172.21.15.99:6803/1213805280","cluster_addr":"172.21.15.99:6805/1213805280","heartbeat_back_addr":"172.21.15.99:6809/1213805280","heartbeat_front_addr":"172.21.15.99:6807/1213805280","state":["exists","up"]},{"osd":1,"uuid":"e0b71ff3-5d97-4659-8dea-4c9091e1beb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6801","nonce":2019451677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6803","nonce":2019451677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6807","nonce":2019451677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6805","nonce":2019451677}]},"public_addr":"172.21.15.179:6801/2019451677","cluster_addr":"172.21.15.179:6803/2019451677","heartbeat_back_addr":"172.21.15.179:6807/2019451677","heartbeat_front_addr":"172.21.15.179:6805/2019451677","state":["exists","up"]},{"osd":2,"uuid":"11c919c8-19a9-48b0-8880-3002efcb64f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6801","nonce":3934284457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6803","nonce":3934284457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6807","nonce":3934284457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6805","nonce":3934284457}]},"public_addr":"172.21.15.181:6801/3934284457","cluster_addr":"172.21.15.181:6803/3934284457","heartbeat_back_addr":"172.21.15.181:6807/3934284457","heartbeat_front_addr":"172.21.15.181:6805/3934284457","state":["exists","up"]},{"osd":3,"uuid":"bcab5135-a5d1-45ae-a9b8-674425d3999e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6811","nonce":4207675427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6813","nonce":4207675427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6817","nonce":4207675427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6815","nonce":4207675427}]},"public_addr":"172.21.15.99:6811/4207675427","cluster_addr":"172.21.15.99:6813/4207675427","heartbeat_back_addr":"172.21.15.99:6817/4207675427","heartbeat_front_addr":"172.21.15.99:6815/4207675427","state":["exists","up"]},{"osd":4,"uuid":"0250d7ac-3894-457a-9c04-cc7205d61eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6809","nonce":2861083896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6811","nonce":2861083896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6815","nonce":2861083896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6813","nonce":2861083896}]},"public_addr":"172.21.15.179:6809/2861083896","cluster_addr":"172.21.15.179:6811/2861083896","heartbeat_back_addr":"172.21.15.179:6815/2861083896","heartbeat_front_addr":"172.21.15.179:6813/2861083896","state":["exists","up"]},{"osd":5,"uuid":"5e19222a-c2a4-45bc-8445-1d302f26d11c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6809","nonce":1485017095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6811","nonce":1485017095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6815","nonce":1485017095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6813","nonce":1485017095}]},"public_addr":"172.21.15.181:6809/1485017095","cluster_addr":"172.21.15.181:6811/1485017095","heartbeat_back_addr":"172.21.15.181:6815/1485017095","heartbeat_front_addr":"172.21.15.181:6813/1485017095","state":["exists","up"]},{"osd":6,"uuid":"56555035-f9fc-4e91-96dd-caa632d58adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6819","nonce":1534047839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6821","nonce":1534047839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6825","nonce":1534047839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6823","nonce":1534047839}]},"public_addr":"172.21.15.99:6819/1534047839","cluster_addr":"172.21.15.99:6821/1534047839","heartbeat_back_addr":"172.21.15.99:6825/1534047839","heartbeat_front_addr":"172.21.15.99:6823/1534047839","state":["exists","up"]},{"osd":7,"uuid":"5e079cf5-1340-4599-88a6-df410ef0148e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6817","nonce":3875950553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6819","nonce":3875950553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6823","nonce":3875950553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6821","nonce":3875950553}]},"public_addr":"172.21.15.179:6817/3875950553","cluster_addr":"172.21.15.179:6819/3875950553","heartbeat_back_addr":"172.21.15.179:6823/3875950553","heartbeat_front_addr":"172.21.15.179:6821/3875950553","state":["exists","up"]},{"osd":8,"uuid":"10a73592-4251-4492-b67d-ce9b9d7fff32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6817","nonce":179568936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6819","nonce":179568936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6823","nonce":179568936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6821","nonce":179568936}]},"public_addr":"172.21.15.181:6817/179568936","cluster_addr":"172.21.15.181:6819/179568936","heartbeat_back_addr":"172.21.15.181:6823/179568936","heartbeat_front_addr":"172.21.15.181:6821/179568936","state":["exists","up"]},{"osd":9,"uuid":"f6620e1e-f761-4f1c-917f-cbc748df32a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6827","nonce":315759515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6829","nonce":315759515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6833","nonce":315759515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6831","nonce":315759515}]},"public_addr":"172.21.15.99:6827/315759515","cluster_addr":"172.21.15.99:6829/315759515","heartbeat_back_addr":"172.21.15.99:6833/315759515","heartbeat_front_addr":"172.21.15.99:6831/315759515","state":["exists","up"]},{"osd":10,"uuid":"ee86af7d-66f8-4795-bcc3-dfec79e4680c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6825","nonce":2985063934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6827","nonce":2985063934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6831","nonce":2985063934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6829","nonce":2985063934}]},"public_addr":"172.21.15.179:6825/2985063934","cluster_addr":"172.21.15.179:6827/2985063934","heartbeat_back_addr":"172.21.15.179:6831/2985063934","heartbeat_front_addr":"172.21.15.179:6829/2985063934","state":["exists","up"]},{"osd":11,"uuid":"82f04fee-f6ae-4630-a75b-b12a9c4ab2e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6825","nonce":1858219600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6827","nonce":1858219600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6831","nonce":1858219600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6829","nonce":1858219600}]},"public_addr":"172.21.15.181:6825/1858219600","cluster_addr":"172.21.15.181:6827/1858219600","heartbeat_back_addr":"172.21.15.181:6831/1858219600","heartbeat_front_addr":"172.21.15.181:6829/1858219600","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:55.518970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:04:19.936339+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:04:44.064814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:09.331683+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:34.616774+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:58.881810+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:06:23.869838+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:06:49.127331+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:07:12.847187+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:07:38.231045+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:08:03.949162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:08:28.471802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:0/401101729":"2024-02-01T05:02:20.510858+0000","172.21.15.99:6801/1993198206":"2024-02-01T05:02:20.510858+0000","172.21.15.99:0/3819754569":"2024-02-01T05:02:20.510858+0000","172.21.15.99:0/475390265":"2024-02-01T05:01:53.732026+0000","172.21.15.99:6800/1993198206":"2024-02-01T05:02:20.510858+0000","172.21.15.99:6800/1706888338":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/4150146075":"2024-02-01T05:01:53.732026+0000","172.21.15.99:6801/1706888338":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/2851066598":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/1865156424":"2024-02-01T05:02:20.510858+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:09:29.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.189+0000 7fa18baf1640 1 -- 172.21.15.99:0/802535416 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa1700a12e0 msgr2=0x7fa1700a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:29.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.189+0000 7fa18baf1640 1 --2- 172.21.15.99:0/802535416 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa1700a12e0 0x7fa1700a37a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa1740058c0 tx=0x7fa174005c60 comp rx=0 tx=0).stop 2024-01-31T05:09:29.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.189+0000 7fa18baf1640 1 -- 172.21.15.99:0/802535416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa1841017a0 msgr2=0x7fa184196cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:29.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.189+0000 7fa18baf1640 1 --2- 172.21.15.99:0/802535416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa1841017a0 0x7fa184196cf0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa180009230 tx=0x7fa180004ee0 comp rx=0 tx=0).stop 2024-01-31T05:09:29.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.189+0000 7fa18baf1640 1 -- 172.21.15.99:0/802535416 shutdown_connections 2024-01-31T05:09:29.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.189+0000 7fa18baf1640 1 --2- 172.21.15.99:0/802535416 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa1700a12e0 0x7fa1700a37a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:29.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.189+0000 7fa18baf1640 1 --2- 172.21.15.99:0/802535416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa184106a00 0x7fa18419e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:29.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.189+0000 7fa18baf1640 1 --2- 172.21.15.99:0/802535416 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1841040d0 0x7fa184197230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:29.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.189+0000 7fa18baf1640 1 --2- 172.21.15.99:0/802535416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa1841017a0 0x7fa184196cf0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:29.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.189+0000 7fa18baf1640 1 -- 172.21.15.99:0/802535416 >> 172.21.15.99:0/802535416 conn(0x7fa1840fb1d0 msgr2=0x7fa184102260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:29.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.190+0000 7fa18baf1640 1 -- 172.21.15.99:0/802535416 shutdown_connections 2024-01-31T05:09:29.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.190+0000 7fa18baf1640 1 -- 172.21.15.99:0/802535416 wait complete. 2024-01-31T05:09:29.205 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-31T05:09:29.205 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-31T05:09:29.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.309+0000 7f00ccdbb640 1 -- 172.21.15.99:0/3554445607 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00c80ffc10 msgr2=0x7f00c8100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:29.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.309+0000 7f00ccdbb640 1 --2- 172.21.15.99:0/3554445607 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00c80ffc10 0x7f00c8100030 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f00bc009900 tx=0x7f00bc02bc30 comp rx=0 tx=0).stop 2024-01-31T05:09:29.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.310+0000 7f00ccdbb640 1 -- 172.21.15.99:0/3554445607 shutdown_connections 2024-01-31T05:09:29.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.310+0000 7f00ccdbb640 1 --2- 172.21.15.99:0/3554445607 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00c81017c0 0x7f00c8108050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:29.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.310+0000 7f00ccdbb640 1 --2- 172.21.15.99:0/3554445607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00c8100e00 0x7f00c8101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:29.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.310+0000 7f00ccdbb640 1 --2- 172.21.15.99:0/3554445607 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00c80ffc10 0x7f00c8100030 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:29.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.310+0000 7f00ccdbb640 1 -- 172.21.15.99:0/3554445607 >> 172.21.15.99:0/3554445607 conn(0x7f00c80fb180 msgr2=0x7f00c80fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:29.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.310+0000 7f00ccdbb640 1 -- 172.21.15.99:0/3554445607 shutdown_connections 2024-01-31T05:09:29.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.310+0000 7f00ccdbb640 1 -- 172.21.15.99:0/3554445607 wait complete. 2024-01-31T05:09:29.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.310+0000 7f00ccdbb640 1 Processor -- start 2024-01-31T05:09:29.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.310+0000 7f00ccdbb640 1 -- start start 2024-01-31T05:09:29.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.310+0000 7f00ccdbb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00c80ffc10 0x7f00c8198f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:29.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.310+0000 7f00ccdbb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00c8100e00 0x7f00c8199490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:29.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.310+0000 7f00ccdbb640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00c81017c0 0x7f00c81a0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:29.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.310+0000 7f00ccdbb640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c81a0a40 con 0x7f00c80ffc10 2024-01-31T05:09:29.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.310+0000 7f00ccdbb640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c81a0bb0 con 0x7f00c81017c0 2024-01-31T05:09:29.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.310+0000 7f00ccdbb640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c81a0d70 con 0x7f00c8100e00 2024-01-31T05:09:29.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.311+0000 7f00c659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00c80ffc10 0x7f00c8198f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:29.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.311+0000 7f00c659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00c80ffc10 0x7f00c8198f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60730/0 (socket says 172.21.15.99:60730) 2024-01-31T05:09:29.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.311+0000 7f00c659c640 1 -- 172.21.15.99:0/3940932038 learned_addr learned my addr 172.21.15.99:0/3940932038 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:09:29.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.311+0000 7f00c6d9d640 1 --2- 172.21.15.99:0/3940932038 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00c81017c0 0x7f00c81a0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:29.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.311+0000 7f00c5d9b640 1 --2- 172.21.15.99:0/3940932038 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00c8100e00 0x7f00c8199490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:29.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.311+0000 7f00c659c640 1 -- 172.21.15.99:0/3940932038 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00c8100e00 msgr2=0x7f00c8199490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:29.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.311+0000 7f00c659c640 1 --2- 172.21.15.99:0/3940932038 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00c8100e00 0x7f00c8199490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:29.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.311+0000 7f00c659c640 1 -- 172.21.15.99:0/3940932038 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00c81017c0 msgr2=0x7f00c81a0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:29.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.311+0000 7f00c659c640 1 --2- 172.21.15.99:0/3940932038 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00c81017c0 0x7f00c81a0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:29.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.311+0000 7f00c659c640 1 -- 172.21.15.99:0/3940932038 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00bc009560 con 0x7f00c80ffc10 2024-01-31T05:09:29.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.311+0000 7f00c659c640 1 --2- 172.21.15.99:0/3940932038 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00c80ffc10 0x7f00c8198f50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f00bc009230 tx=0x7f00bc004f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:29.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.311+0000 7f00b77fe640 1 -- 172.21.15.99:0/3940932038 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00bc0043d0 con 0x7f00c80ffc10 2024-01-31T05:09:29.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.311+0000 7f00b77fe640 1 -- 172.21.15.99:0/3940932038 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f00bc0054c0 con 0x7f00c80ffc10 2024-01-31T05:09:29.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.311+0000 7f00ccdbb640 1 -- 172.21.15.99:0/3940932038 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00c81a0ff0 con 0x7f00c80ffc10 2024-01-31T05:09:29.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.311+0000 7f00b77fe640 1 -- 172.21.15.99:0/3940932038 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00bc003e30 con 0x7f00c80ffc10 2024-01-31T05:09:29.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.311+0000 7f00ccdbb640 1 -- 172.21.15.99:0/3940932038 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00c81a1410 con 0x7f00c80ffc10 2024-01-31T05:09:29.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.312+0000 7f00ccdbb640 1 -- 172.21.15.99:0/3940932038 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00c810c600 con 0x7f00c80ffc10 2024-01-31T05:09:29.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.313+0000 7f00b77fe640 1 -- 172.21.15.99:0/3940932038 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f00bc005000 con 0x7f00c80ffc10 2024-01-31T05:09:29.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.314+0000 7f00b77fe640 1 --2- 172.21.15.99:0/3940932038 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f00b00a1370 0x7f00b00a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:29.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.314+0000 7f00c5d9b640 1 --2- 172.21.15.99:0/3940932038 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f00b00a1370 0x7f00b00a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:29.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.314+0000 7f00b77fe640 1 -- 172.21.15.99:0/3940932038 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f00bc0ef6c0 con 0x7f00c80ffc10 2024-01-31T05:09:29.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.314+0000 7f00c5d9b640 1 --2- 172.21.15.99:0/3940932038 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f00b00a1370 0x7f00b00a3830 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f00c819a460 tx=0x7f00b800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:29.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.317+0000 7f00b77fe640 1 -- 172.21.15.99:0/3940932038 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f00bc0b8ca0 con 0x7f00c80ffc10 2024-01-31T05:09:29.477 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:29 smithi099 ceph-mon[31615]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:09:29.478 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:29 smithi099 ceph-mon[31615]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:09:29.478 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:29 smithi099 ceph-mon[31615]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:09:29.478 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:29 smithi099 ceph-mon[31615]: pgmap v290: 97 pgs: 97 active+clean; 602 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 9.2 KiB/s wr, 21 op/s 2024-01-31T05:09:29.478 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:29 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/3964250433' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:09:29.478 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:29 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/802535416' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:09:29.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.499+0000 7f00ccdbb640 1 -- 172.21.15.99:0/3940932038 --> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f00c8107cc0 con 0x7f00b00a1370 2024-01-31T05:09:29.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.510+0000 7f00b77fe640 1 -- 172.21.15.99:0/3940932038 <== mgr.14152 v2:172.21.15.99:6800/3925720924 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+337001 (secure 0 0 0) 0x7f00c8107cc0 con 0x7f00b00a1370 2024-01-31T05:09:29.514 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:09:29.515 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-01-31T05:09:29.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.513+0000 7f00ccdbb640 1 -- 172.21.15.99:0/3940932038 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f00b00a1370 msgr2=0x7f00b00a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:29.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.513+0000 7f00ccdbb640 1 --2- 172.21.15.99:0/3940932038 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f00b00a1370 0x7f00b00a3830 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f00c819a460 tx=0x7f00b800b410 comp rx=0 tx=0).stop 2024-01-31T05:09:29.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.513+0000 7f00ccdbb640 1 -- 172.21.15.99:0/3940932038 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00c80ffc10 msgr2=0x7f00c8198f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:29.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.513+0000 7f00ccdbb640 1 --2- 172.21.15.99:0/3940932038 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00c80ffc10 0x7f00c8198f50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f00bc009230 tx=0x7f00bc004f40 comp rx=0 tx=0).stop 2024-01-31T05:09:29.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.513+0000 7f00ccdbb640 1 -- 172.21.15.99:0/3940932038 shutdown_connections 2024-01-31T05:09:29.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.513+0000 7f00ccdbb640 1 --2- 172.21.15.99:0/3940932038 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f00b00a1370 0x7f00b00a3830 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:29.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.513+0000 7f00ccdbb640 1 --2- 172.21.15.99:0/3940932038 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00c81017c0 0x7f00c81a0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:29.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.513+0000 7f00ccdbb640 1 --2- 172.21.15.99:0/3940932038 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00c8100e00 0x7f00c8199490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:29.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.513+0000 7f00ccdbb640 1 --2- 172.21.15.99:0/3940932038 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00c80ffc10 0x7f00c8198f50 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:29.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.513+0000 7f00ccdbb640 1 -- 172.21.15.99:0/3940932038 >> 172.21.15.99:0/3940932038 conn(0x7f00c80fb180 msgr2=0x7f00c81065a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:29.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.513+0000 7f00ccdbb640 1 -- 172.21.15.99:0/3940932038 shutdown_connections 2024-01-31T05:09:29.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.513+0000 7f00ccdbb640 1 -- 172.21.15.99:0/3940932038 wait complete. 2024-01-31T05:09:29.524 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":290,"stamp":"2024-01-31T05:09:28.594037+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":616819,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":140,"num_read_kb":121,"num_write":343,"num_write_kb":3012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":279,"ondisk_log_size":279,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":366204,"kb_used_data":12892,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575620,"statfs":{"total":1151940427776,"available":1151565434880,"internally_reserved":0,"allocated":13201408,"data_stored":7138437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":26451,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":162,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.026370"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.057445+0000","last_change":"2024-01-31T05:09:20.582274+0000","last_active":"2024-01-31T05:09:22.057445+0000","last_peered":"2024-01-31T05:09:22.057445+0000","last_clean":"2024-01-31T05:09:22.057445+0000","last_became_active":"2024-01-31T05:09:20.581511+0000","last_became_peered":"2024-01-31T05:09:20.581511+0000","last_unstale":"2024-01-31T05:09:22.057445+0000","last_undegraded":"2024-01-31T05:09:22.057445+0000","last_fullsized":"2024-01-31T05:09:22.057445+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:59:10.674456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.292714+0000","last_change":"2024-01-31T05:09:20.581752+0000","last_active":"2024-01-31T05:09:22.292714+0000","last_peered":"2024-01-31T05:09:22.292714+0000","last_clean":"2024-01-31T05:09:22.292714+0000","last_became_active":"2024-01-31T05:09:20.581035+0000","last_became_peered":"2024-01-31T05:09:20.581035+0000","last_unstale":"2024-01-31T05:09:22.292714+0000","last_undegraded":"2024-01-31T05:09:22.292714+0000","last_fullsized":"2024-01-31T05:09:22.292714+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:03:16.999371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.292678+0000","last_change":"2024-01-31T05:09:20.588191+0000","last_active":"2024-01-31T05:09:22.292678+0000","last_peered":"2024-01-31T05:09:22.292678+0000","last_clean":"2024-01-31T05:09:22.292678+0000","last_became_active":"2024-01-31T05:09:20.587466+0000","last_became_peered":"2024-01-31T05:09:20.587466+0000","last_unstale":"2024-01-31T05:09:22.292678+0000","last_undegraded":"2024-01-31T05:09:22.292678+0000","last_fullsized":"2024-01-31T05:09:22.292678+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:22:29.037408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.579566+0000","last_change":"2024-01-31T05:09:20.589377+0000","last_active":"2024-01-31T05:09:21.579566+0000","last_peered":"2024-01-31T05:09:21.579566+0000","last_clean":"2024-01-31T05:09:21.579566+0000","last_became_active":"2024-01-31T05:09:20.589065+0000","last_became_peered":"2024-01-31T05:09:20.589065+0000","last_unstale":"2024-01-31T05:09:21.579566+0000","last_undegraded":"2024-01-31T05:09:21.579566+0000","last_fullsized":"2024-01-31T05:09:21.579566+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:57:11.612654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.056186+0000","last_change":"2024-01-31T05:09:20.578919+0000","last_active":"2024-01-31T05:09:22.056186+0000","last_peered":"2024-01-31T05:09:22.056186+0000","last_clean":"2024-01-31T05:09:22.056186+0000","last_became_active":"2024-01-31T05:09:20.578594+0000","last_became_peered":"2024-01-31T05:09:20.578594+0000","last_unstale":"2024-01-31T05:09:22.056186+0000","last_undegraded":"2024-01-31T05:09:22.056186+0000","last_fullsized":"2024-01-31T05:09:22.056186+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:16:57.168457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.582521+0000","last_change":"2024-01-31T05:09:20.586620+0000","last_active":"2024-01-31T05:09:21.582521+0000","last_peered":"2024-01-31T05:09:21.582521+0000","last_clean":"2024-01-31T05:09:21.582521+0000","last_became_active":"2024-01-31T05:09:20.586323+0000","last_became_peered":"2024-01-31T05:09:20.586323+0000","last_unstale":"2024-01-31T05:09:21.582521+0000","last_undegraded":"2024-01-31T05:09:21.582521+0000","last_fullsized":"2024-01-31T05:09:21.582521+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:03:31.479078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.055650+0000","last_change":"2024-01-31T05:09:20.595122+0000","last_active":"2024-01-31T05:09:22.055650+0000","last_peered":"2024-01-31T05:09:22.055650+0000","last_clean":"2024-01-31T05:09:22.055650+0000","last_became_active":"2024-01-31T05:09:20.594766+0000","last_became_peered":"2024-01-31T05:09:20.594766+0000","last_unstale":"2024-01-31T05:09:22.055650+0000","last_undegraded":"2024-01-31T05:09:22.055650+0000","last_fullsized":"2024-01-31T05:09:22.055650+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:18:40.002855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.937544+0000","last_change":"2024-01-31T05:09:20.584047+0000","last_active":"2024-01-31T05:09:21.937544+0000","last_peered":"2024-01-31T05:09:21.937544+0000","last_clean":"2024-01-31T05:09:21.937544+0000","last_became_active":"2024-01-31T05:09:20.583741+0000","last_became_peered":"2024-01-31T05:09:20.583741+0000","last_unstale":"2024-01-31T05:09:21.937544+0000","last_undegraded":"2024-01-31T05:09:21.937544+0000","last_fullsized":"2024-01-31T05:09:21.937544+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:15:47.253010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.585060+0000","last_change":"2024-01-31T05:09:20.588892+0000","last_active":"2024-01-31T05:09:21.585060+0000","last_peered":"2024-01-31T05:09:21.585060+0000","last_clean":"2024-01-31T05:09:21.585060+0000","last_became_active":"2024-01-31T05:09:20.588212+0000","last_became_peered":"2024-01-31T05:09:20.588212+0000","last_unstale":"2024-01-31T05:09:21.585060+0000","last_undegraded":"2024-01-31T05:09:21.585060+0000","last_fullsized":"2024-01-31T05:09:21.585060+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:49:45.270341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.582657+0000","last_change":"2024-01-31T05:09:20.589396+0000","last_active":"2024-01-31T05:09:21.582657+0000","last_peered":"2024-01-31T05:09:21.582657+0000","last_clean":"2024-01-31T05:09:21.582657+0000","last_became_active":"2024-01-31T05:09:20.589058+0000","last_became_peered":"2024-01-31T05:09:20.589058+0000","last_unstale":"2024-01-31T05:09:21.582657+0000","last_undegraded":"2024-01-31T05:09:21.582657+0000","last_fullsized":"2024-01-31T05:09:21.582657+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:05:53.403136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.056019+0000","last_change":"2024-01-31T05:09:20.592010+0000","last_active":"2024-01-31T05:09:22.056019+0000","last_peered":"2024-01-31T05:09:22.056019+0000","last_clean":"2024-01-31T05:09:22.056019+0000","last_became_active":"2024-01-31T05:09:20.591714+0000","last_became_peered":"2024-01-31T05:09:20.591714+0000","last_unstale":"2024-01-31T05:09:22.056019+0000","last_undegraded":"2024-01-31T05:09:22.056019+0000","last_fullsized":"2024-01-31T05:09:22.056019+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:56:11.651035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.579479+0000","last_change":"2024-01-31T05:09:20.591161+0000","last_active":"2024-01-31T05:09:21.579479+0000","last_peered":"2024-01-31T05:09:21.579479+0000","last_clean":"2024-01-31T05:09:21.579479+0000","last_became_active":"2024-01-31T05:09:20.590857+0000","last_became_peered":"2024-01-31T05:09:20.590857+0000","last_unstale":"2024-01-31T05:09:21.579479+0000","last_undegraded":"2024-01-31T05:09:21.579479+0000","last_fullsized":"2024-01-31T05:09:21.579479+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:44:24.048236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.578664+0000","last_change":"2024-01-31T05:09:20.582167+0000","last_active":"2024-01-31T05:09:21.578664+0000","last_peered":"2024-01-31T05:09:21.578664+0000","last_clean":"2024-01-31T05:09:21.578664+0000","last_became_active":"2024-01-31T05:09:20.581860+0000","last_became_peered":"2024-01-31T05:09:20.581860+0000","last_unstale":"2024-01-31T05:09:21.578664+0000","last_undegraded":"2024-01-31T05:09:21.578664+0000","last_fullsized":"2024-01-31T05:09:21.578664+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:46:05.891545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.292368+0000","last_change":"2024-01-31T05:09:20.587899+0000","last_active":"2024-01-31T05:09:22.292368+0000","last_peered":"2024-01-31T05:09:22.292368+0000","last_clean":"2024-01-31T05:09:22.292368+0000","last_became_active":"2024-01-31T05:09:20.587068+0000","last_became_peered":"2024-01-31T05:09:20.587068+0000","last_unstale":"2024-01-31T05:09:22.292368+0000","last_undegraded":"2024-01-31T05:09:22.292368+0000","last_fullsized":"2024-01-31T05:09:22.292368+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:59:44.747928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.292408+0000","last_change":"2024-01-31T05:09:20.590392+0000","last_active":"2024-01-31T05:09:22.292408+0000","last_peered":"2024-01-31T05:09:22.292408+0000","last_clean":"2024-01-31T05:09:22.292408+0000","last_became_active":"2024-01-31T05:09:20.590082+0000","last_became_peered":"2024-01-31T05:09:20.590082+0000","last_unstale":"2024-01-31T05:09:22.292408+0000","last_undegraded":"2024-01-31T05:09:22.292408+0000","last_fullsized":"2024-01-31T05:09:22.292408+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:59:10.672890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.584539+0000","last_change":"2024-01-31T05:09:20.584822+0000","last_active":"2024-01-31T05:09:21.584539+0000","last_peered":"2024-01-31T05:09:21.584539+0000","last_clean":"2024-01-31T05:09:21.584539+0000","last_became_active":"2024-01-31T05:09:20.584531+0000","last_became_peered":"2024-01-31T05:09:20.584531+0000","last_unstale":"2024-01-31T05:09:21.584539+0000","last_undegraded":"2024-01-31T05:09:21.584539+0000","last_fullsized":"2024-01-31T05:09:21.584539+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:35:44.793407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.057625+0000","last_change":"2024-01-31T05:09:20.582615+0000","last_active":"2024-01-31T05:09:22.057625+0000","last_peered":"2024-01-31T05:09:22.057625+0000","last_clean":"2024-01-31T05:09:22.057625+0000","last_became_active":"2024-01-31T05:09:20.581959+0000","last_became_peered":"2024-01-31T05:09:20.581959+0000","last_unstale":"2024-01-31T05:09:22.057625+0000","last_undegraded":"2024-01-31T05:09:22.057625+0000","last_fullsized":"2024-01-31T05:09:22.057625+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:29:06.817822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.055898+0000","last_change":"2024-01-31T05:09:20.582421+0000","last_active":"2024-01-31T05:09:22.055898+0000","last_peered":"2024-01-31T05:09:22.055898+0000","last_clean":"2024-01-31T05:09:22.055898+0000","last_became_active":"2024-01-31T05:09:20.582099+0000","last_became_peered":"2024-01-31T05:09:20.582099+0000","last_unstale":"2024-01-31T05:09:22.055898+0000","last_undegraded":"2024-01-31T05:09:22.055898+0000","last_fullsized":"2024-01-31T05:09:22.055898+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:08:03.802219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.579716+0000","last_change":"2024-01-31T05:09:20.580511+0000","last_active":"2024-01-31T05:09:21.579716+0000","last_peered":"2024-01-31T05:09:21.579716+0000","last_clean":"2024-01-31T05:09:21.579716+0000","last_became_active":"2024-01-31T05:09:20.579596+0000","last_became_peered":"2024-01-31T05:09:20.579596+0000","last_unstale":"2024-01-31T05:09:21.579716+0000","last_undegraded":"2024-01-31T05:09:21.579716+0000","last_fullsized":"2024-01-31T05:09:21.579716+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:07:01.206181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'9","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:25.189761+0000","last_change":"2024-01-31T05:09:20.187398+0000","last_active":"2024-01-31T05:09:25.189761+0000","last_peered":"2024-01-31T05:09:25.189761+0000","last_clean":"2024-01-31T05:09:25.189761+0000","last_became_active":"2024-01-31T05:09:20.186925+0000","last_became_peered":"2024-01-31T05:09:20.186925+0000","last_unstale":"2024-01-31T05:09:25.189761+0000","last_undegraded":"2024-01-31T05:09:25.189761+0000","last_fullsized":"2024-01-31T05:09:25.189761+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:33:34.624017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.937823+0000","last_change":"2024-01-31T05:09:20.582800+0000","last_active":"2024-01-31T05:09:21.937823+0000","last_peered":"2024-01-31T05:09:21.937823+0000","last_clean":"2024-01-31T05:09:21.937823+0000","last_became_active":"2024-01-31T05:09:20.582523+0000","last_became_peered":"2024-01-31T05:09:20.582523+0000","last_unstale":"2024-01-31T05:09:21.937823+0000","last_undegraded":"2024-01-31T05:09:21.937823+0000","last_fullsized":"2024-01-31T05:09:21.937823+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:19:57.975954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.937973+0000","last_change":"2024-01-31T05:09:20.191566+0000","last_active":"2024-01-31T05:09:21.937973+0000","last_peered":"2024-01-31T05:09:21.937973+0000","last_clean":"2024-01-31T05:09:21.937973+0000","last_became_active":"2024-01-31T05:09:20.191268+0000","last_became_peered":"2024-01-31T05:09:20.191268+0000","last_unstale":"2024-01-31T05:09:21.937973+0000","last_undegraded":"2024-01-31T05:09:21.937973+0000","last_fullsized":"2024-01-31T05:09:21.937973+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:45:40.042374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.292851+0000","last_change":"2024-01-31T05:09:20.579061+0000","last_active":"2024-01-31T05:09:22.292851+0000","last_peered":"2024-01-31T05:09:22.292851+0000","last_clean":"2024-01-31T05:09:22.292851+0000","last_became_active":"2024-01-31T05:09:20.578728+0000","last_became_peered":"2024-01-31T05:09:20.578728+0000","last_unstale":"2024-01-31T05:09:22.292851+0000","last_undegraded":"2024-01-31T05:09:22.292851+0000","last_fullsized":"2024-01-31T05:09:22.292851+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:57:12.142419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:25.189279+0000","last_change":"2024-01-31T05:09:20.187366+0000","last_active":"2024-01-31T05:09:25.189279+0000","last_peered":"2024-01-31T05:09:25.189279+0000","last_clean":"2024-01-31T05:09:25.189279+0000","last_became_active":"2024-01-31T05:09:20.186616+0000","last_became_peered":"2024-01-31T05:09:20.186616+0000","last_unstale":"2024-01-31T05:09:25.189279+0000","last_undegraded":"2024-01-31T05:09:25.189279+0000","last_fullsized":"2024-01-31T05:09:25.189279+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:39:28.802810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.584666+0000","last_change":"2024-01-31T05:09:20.590538+0000","last_active":"2024-01-31T05:09:21.584666+0000","last_peered":"2024-01-31T05:09:21.584666+0000","last_clean":"2024-01-31T05:09:21.584666+0000","last_became_active":"2024-01-31T05:09:20.590254+0000","last_became_peered":"2024-01-31T05:09:20.590254+0000","last_unstale":"2024-01-31T05:09:21.584666+0000","last_undegraded":"2024-01-31T05:09:21.584666+0000","last_fullsized":"2024-01-31T05:09:21.584666+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:06:38.209930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.057045+0000","last_change":"2024-01-31T05:09:20.183808+0000","last_active":"2024-01-31T05:09:22.057045+0000","last_peered":"2024-01-31T05:09:22.057045+0000","last_clean":"2024-01-31T05:09:22.057045+0000","last_became_active":"2024-01-31T05:09:20.183514+0000","last_became_peered":"2024-01-31T05:09:20.183514+0000","last_unstale":"2024-01-31T05:09:22.057045+0000","last_undegraded":"2024-01-31T05:09:22.057045+0000","last_fullsized":"2024-01-31T05:09:22.057045+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:32:43.392640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.057407+0000","last_change":"2024-01-31T05:09:20.590871+0000","last_active":"2024-01-31T05:09:22.057407+0000","last_peered":"2024-01-31T05:09:22.057407+0000","last_clean":"2024-01-31T05:09:22.057407+0000","last_became_active":"2024-01-31T05:09:20.588533+0000","last_became_peered":"2024-01-31T05:09:20.588533+0000","last_unstale":"2024-01-31T05:09:22.057407+0000","last_undegraded":"2024-01-31T05:09:22.057407+0000","last_fullsized":"2024-01-31T05:09:22.057407+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:44:26.772616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'5","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:24.184100+0000","last_change":"2024-01-31T05:09:20.183455+0000","last_active":"2024-01-31T05:09:24.184100+0000","last_peered":"2024-01-31T05:09:24.184100+0000","last_clean":"2024-01-31T05:09:24.184100+0000","last_became_active":"2024-01-31T05:09:20.183070+0000","last_became_peered":"2024-01-31T05:09:20.183070+0000","last_unstale":"2024-01-31T05:09:24.184100+0000","last_undegraded":"2024-01-31T05:09:24.184100+0000","last_fullsized":"2024-01-31T05:09:24.184100+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:15:29.503830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.057044+0000","last_change":"2024-01-31T05:09:20.580755+0000","last_active":"2024-01-31T05:09:22.057044+0000","last_peered":"2024-01-31T05:09:22.057044+0000","last_clean":"2024-01-31T05:09:22.057044+0000","last_became_active":"2024-01-31T05:09:20.580452+0000","last_became_peered":"2024-01-31T05:09:20.580452+0000","last_unstale":"2024-01-31T05:09:22.057044+0000","last_undegraded":"2024-01-31T05:09:22.057044+0000","last_fullsized":"2024-01-31T05:09:22.057044+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:29:08.383532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:26.196802+0000","last_change":"2024-01-31T05:09:20.182129+0000","last_active":"2024-01-31T05:09:26.196802+0000","last_peered":"2024-01-31T05:09:26.196802+0000","last_clean":"2024-01-31T05:09:26.196802+0000","last_became_active":"2024-01-31T05:09:20.181781+0000","last_became_peered":"2024-01-31T05:09:20.181781+0000","last_unstale":"2024-01-31T05:09:26.196802+0000","last_undegraded":"2024-01-31T05:09:26.196802+0000","last_fullsized":"2024-01-31T05:09:26.196802+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:05:57.854213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.057048+0000","last_change":"2024-01-31T05:09:20.591696+0000","last_active":"2024-01-31T05:09:22.057048+0000","last_peered":"2024-01-31T05:09:22.057048+0000","last_clean":"2024-01-31T05:09:22.057048+0000","last_became_active":"2024-01-31T05:09:20.591307+0000","last_became_peered":"2024-01-31T05:09:20.591307+0000","last_unstale":"2024-01-31T05:09:22.057048+0000","last_undegraded":"2024-01-31T05:09:22.057048+0000","last_fullsized":"2024-01-31T05:09:22.057048+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:59:56.884326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:25.190462+0000","last_change":"2024-01-31T05:09:20.179846+0000","last_active":"2024-01-31T05:09:25.190462+0000","last_peered":"2024-01-31T05:09:25.190462+0000","last_clean":"2024-01-31T05:09:25.190462+0000","last_became_active":"2024-01-31T05:09:20.179524+0000","last_became_peered":"2024-01-31T05:09:20.179524+0000","last_unstale":"2024-01-31T05:09:25.190462+0000","last_undegraded":"2024-01-31T05:09:25.190462+0000","last_fullsized":"2024-01-31T05:09:25.190462+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:13:51.085861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.937478+0000","last_change":"2024-01-31T05:09:20.580076+0000","last_active":"2024-01-31T05:09:21.937478+0000","last_peered":"2024-01-31T05:09:21.937478+0000","last_clean":"2024-01-31T05:09:21.937478+0000","last_became_active":"2024-01-31T05:09:20.579764+0000","last_became_peered":"2024-01-31T05:09:20.579764+0000","last_unstale":"2024-01-31T05:09:21.937478+0000","last_undegraded":"2024-01-31T05:09:21.937478+0000","last_fullsized":"2024-01-31T05:09:21.937478+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:02:13.861848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:24.183560+0000","last_change":"2024-01-31T05:09:20.183941+0000","last_active":"2024-01-31T05:09:24.183560+0000","last_peered":"2024-01-31T05:09:24.183560+0000","last_clean":"2024-01-31T05:09:24.183560+0000","last_became_active":"2024-01-31T05:09:20.183631+0000","last_became_peered":"2024-01-31T05:09:20.183631+0000","last_unstale":"2024-01-31T05:09:24.183560+0000","last_undegraded":"2024-01-31T05:09:24.183560+0000","last_fullsized":"2024-01-31T05:09:24.183560+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:31:31.419345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.055661+0000","last_change":"2024-01-31T05:09:20.589275+0000","last_active":"2024-01-31T05:09:22.055661+0000","last_peered":"2024-01-31T05:09:22.055661+0000","last_clean":"2024-01-31T05:09:22.055661+0000","last_became_active":"2024-01-31T05:09:20.588891+0000","last_became_peered":"2024-01-31T05:09:20.588891+0000","last_unstale":"2024-01-31T05:09:22.055661+0000","last_undegraded":"2024-01-31T05:09:22.055661+0000","last_fullsized":"2024-01-31T05:09:22.055661+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:30:27.665553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:27.171213+0000","last_change":"2024-01-31T05:09:20.182836+0000","last_active":"2024-01-31T05:09:27.171213+0000","last_peered":"2024-01-31T05:09:27.171213+0000","last_clean":"2024-01-31T05:09:27.171213+0000","last_became_active":"2024-01-31T05:09:20.182376+0000","last_became_peered":"2024-01-31T05:09:20.182376+0000","last_unstale":"2024-01-31T05:09:27.171213+0000","last_undegraded":"2024-01-31T05:09:27.171213+0000","last_fullsized":"2024-01-31T05:09:27.171213+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:55:52.354323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.584993+0000","last_change":"2024-01-31T05:09:20.583592+0000","last_active":"2024-01-31T05:09:21.584993+0000","last_peered":"2024-01-31T05:09:21.584993+0000","last_clean":"2024-01-31T05:09:21.584993+0000","last_became_active":"2024-01-31T05:09:20.583247+0000","last_became_peered":"2024-01-31T05:09:20.583247+0000","last_unstale":"2024-01-31T05:09:21.584993+0000","last_undegraded":"2024-01-31T05:09:21.584993+0000","last_fullsized":"2024-01-31T05:09:21.584993+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:28:04.946620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:24.183376+0000","last_change":"2024-01-31T05:09:20.188171+0000","last_active":"2024-01-31T05:09:24.183376+0000","last_peered":"2024-01-31T05:09:24.183376+0000","last_clean":"2024-01-31T05:09:24.183376+0000","last_became_active":"2024-01-31T05:09:20.187807+0000","last_became_peered":"2024-01-31T05:09:20.187807+0000","last_unstale":"2024-01-31T05:09:24.183376+0000","last_undegraded":"2024-01-31T05:09:24.183376+0000","last_fullsized":"2024-01-31T05:09:24.183376+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:53:22.765389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.292859+0000","last_change":"2024-01-31T05:09:20.589462+0000","last_active":"2024-01-31T05:09:22.292859+0000","last_peered":"2024-01-31T05:09:22.292859+0000","last_clean":"2024-01-31T05:09:22.292859+0000","last_became_active":"2024-01-31T05:09:20.589002+0000","last_became_peered":"2024-01-31T05:09:20.589002+0000","last_unstale":"2024-01-31T05:09:22.292859+0000","last_undegraded":"2024-01-31T05:09:22.292859+0000","last_fullsized":"2024-01-31T05:09:22.292859+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:41:35.918827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:24.182402+0000","last_change":"2024-01-31T05:09:20.184963+0000","last_active":"2024-01-31T05:09:24.182402+0000","last_peered":"2024-01-31T05:09:24.182402+0000","last_clean":"2024-01-31T05:09:24.182402+0000","last_became_active":"2024-01-31T05:09:20.184590+0000","last_became_peered":"2024-01-31T05:09:20.184590+0000","last_unstale":"2024-01-31T05:09:24.182402+0000","last_undegraded":"2024-01-31T05:09:24.182402+0000","last_fullsized":"2024-01-31T05:09:24.182402+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:06:31.291846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.584837+0000","last_change":"2024-01-31T05:09:20.589237+0000","last_active":"2024-01-31T05:09:21.584837+0000","last_peered":"2024-01-31T05:09:21.584837+0000","last_clean":"2024-01-31T05:09:21.584837+0000","last_became_active":"2024-01-31T05:09:20.588656+0000","last_became_peered":"2024-01-31T05:09:20.588656+0000","last_unstale":"2024-01-31T05:09:21.584837+0000","last_undegraded":"2024-01-31T05:09:21.584837+0000","last_fullsized":"2024-01-31T05:09:21.584837+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:02:02.025136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'17","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:27.535093+0000","last_change":"2024-01-31T05:09:20.182539+0000","last_active":"2024-01-31T05:09:27.535093+0000","last_peered":"2024-01-31T05:09:27.535093+0000","last_clean":"2024-01-31T05:09:27.535093+0000","last_became_active":"2024-01-31T05:09:20.182229+0000","last_became_peered":"2024-01-31T05:09:20.182229+0000","last_unstale":"2024-01-31T05:09:27.535093+0000","last_undegraded":"2024-01-31T05:09:27.535093+0000","last_fullsized":"2024-01-31T05:09:27.535093+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:56:21.974450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20894,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":19,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.056567+0000","last_change":"2024-01-31T05:09:20.587838+0000","last_active":"2024-01-31T05:09:22.056567+0000","last_peered":"2024-01-31T05:09:22.056567+0000","last_clean":"2024-01-31T05:09:22.056567+0000","last_became_active":"2024-01-31T05:09:20.587523+0000","last_became_peered":"2024-01-31T05:09:20.587523+0000","last_unstale":"2024-01-31T05:09:22.056567+0000","last_undegraded":"2024-01-31T05:09:22.056567+0000","last_fullsized":"2024-01-31T05:09:22.056567+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:36:17.582890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'7","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:25.189426+0000","last_change":"2024-01-31T05:09:20.191935+0000","last_active":"2024-01-31T05:09:25.189426+0000","last_peered":"2024-01-31T05:09:25.189426+0000","last_clean":"2024-01-31T05:09:25.189426+0000","last_became_active":"2024-01-31T05:09:20.191614+0000","last_became_peered":"2024-01-31T05:09:20.191614+0000","last_unstale":"2024-01-31T05:09:25.189426+0000","last_undegraded":"2024-01-31T05:09:25.189426+0000","last_fullsized":"2024-01-31T05:09:25.189426+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:12:38.245944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.578556+0000","last_change":"2024-01-31T05:09:20.585705+0000","last_active":"2024-01-31T05:09:21.578556+0000","last_peered":"2024-01-31T05:09:21.578556+0000","last_clean":"2024-01-31T05:09:21.578556+0000","last_became_active":"2024-01-31T05:09:20.585413+0000","last_became_peered":"2024-01-31T05:09:20.585413+0000","last_unstale":"2024-01-31T05:09:21.578556+0000","last_undegraded":"2024-01-31T05:09:21.578556+0000","last_fullsized":"2024-01-31T05:09:21.578556+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:35:34.686300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:24.184250+0000","last_change":"2024-01-31T05:09:20.191975+0000","last_active":"2024-01-31T05:09:24.184250+0000","last_peered":"2024-01-31T05:09:24.184250+0000","last_clean":"2024-01-31T05:09:24.184250+0000","last_became_active":"2024-01-31T05:09:20.191666+0000","last_became_peered":"2024-01-31T05:09:20.191666+0000","last_unstale":"2024-01-31T05:09:24.184250+0000","last_undegraded":"2024-01-31T05:09:24.184250+0000","last_fullsized":"2024-01-31T05:09:24.184250+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:00:01.162509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.055939+0000","last_change":"2024-01-31T05:09:20.588737+0000","last_active":"2024-01-31T05:09:22.055939+0000","last_peered":"2024-01-31T05:09:22.055939+0000","last_clean":"2024-01-31T05:09:22.055939+0000","last_became_active":"2024-01-31T05:09:20.588434+0000","last_became_peered":"2024-01-31T05:09:20.588434+0000","last_unstale":"2024-01-31T05:09:22.055939+0000","last_undegraded":"2024-01-31T05:09:22.055939+0000","last_fullsized":"2024-01-31T05:09:22.055939+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:35:24.618246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'6","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:27.173918+0000","last_change":"2024-01-31T05:09:20.183752+0000","last_active":"2024-01-31T05:09:27.173918+0000","last_peered":"2024-01-31T05:09:27.173918+0000","last_clean":"2024-01-31T05:09:27.173918+0000","last_became_active":"2024-01-31T05:09:20.183421+0000","last_became_peered":"2024-01-31T05:09:20.183421+0000","last_unstale":"2024-01-31T05:09:27.173918+0000","last_undegraded":"2024-01-31T05:09:27.173918+0000","last_fullsized":"2024-01-31T05:09:27.173918+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:04:12.919266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.055585+0000","last_change":"2024-01-31T05:09:20.593893+0000","last_active":"2024-01-31T05:09:22.055585+0000","last_peered":"2024-01-31T05:09:22.055585+0000","last_clean":"2024-01-31T05:09:22.055585+0000","last_became_active":"2024-01-31T05:09:20.593604+0000","last_became_peered":"2024-01-31T05:09:20.593604+0000","last_unstale":"2024-01-31T05:09:22.055585+0000","last_undegraded":"2024-01-31T05:09:22.055585+0000","last_fullsized":"2024-01-31T05:09:22.055585+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:50:31.534607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'15","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:25.190457+0000","last_change":"2024-01-31T05:09:20.187006+0000","last_active":"2024-01-31T05:09:25.190457+0000","last_peered":"2024-01-31T05:09:25.190457+0000","last_clean":"2024-01-31T05:09:25.190457+0000","last_became_active":"2024-01-31T05:09:20.186233+0000","last_became_peered":"2024-01-31T05:09:20.186233+0000","last_unstale":"2024-01-31T05:09:25.190457+0000","last_undegraded":"2024-01-31T05:09:25.190457+0000","last_fullsized":"2024-01-31T05:09:25.190457+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:50:47.722060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.057087+0000","last_change":"2024-01-31T05:09:20.588049+0000","last_active":"2024-01-31T05:09:22.057087+0000","last_peered":"2024-01-31T05:09:22.057087+0000","last_clean":"2024-01-31T05:09:22.057087+0000","last_became_active":"2024-01-31T05:09:20.587542+0000","last_became_peered":"2024-01-31T05:09:20.587542+0000","last_unstale":"2024-01-31T05:09:22.057087+0000","last_undegraded":"2024-01-31T05:09:22.057087+0000","last_fullsized":"2024-01-31T05:09:22.057087+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:19:55.948269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.056450+0000","last_change":"2024-01-31T05:09:20.185328+0000","last_active":"2024-01-31T05:09:22.056450+0000","last_peered":"2024-01-31T05:09:22.056450+0000","last_clean":"2024-01-31T05:09:22.056450+0000","last_became_active":"2024-01-31T05:09:20.184551+0000","last_became_peered":"2024-01-31T05:09:20.184551+0000","last_unstale":"2024-01-31T05:09:22.056450+0000","last_undegraded":"2024-01-31T05:09:22.056450+0000","last_fullsized":"2024-01-31T05:09:22.056450+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:19:36.143101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.056741+0000","last_change":"2024-01-31T05:09:20.586286+0000","last_active":"2024-01-31T05:09:22.056741+0000","last_peered":"2024-01-31T05:09:22.056741+0000","last_clean":"2024-01-31T05:09:22.056741+0000","last_became_active":"2024-01-31T05:09:20.586011+0000","last_became_peered":"2024-01-31T05:09:20.586011+0000","last_unstale":"2024-01-31T05:09:22.056741+0000","last_undegraded":"2024-01-31T05:09:22.056741+0000","last_fullsized":"2024-01-31T05:09:22.056741+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:21:23.064829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.055779+0000","last_change":"2024-01-31T05:09:20.183083+0000","last_active":"2024-01-31T05:09:22.055779+0000","last_peered":"2024-01-31T05:09:22.055779+0000","last_clean":"2024-01-31T05:09:22.055779+0000","last_became_active":"2024-01-31T05:09:20.182742+0000","last_became_peered":"2024-01-31T05:09:20.182742+0000","last_unstale":"2024-01-31T05:09:22.055779+0000","last_undegraded":"2024-01-31T05:09:22.055779+0000","last_fullsized":"2024-01-31T05:09:22.055779+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:12:02.081688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'1","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.945596+0000","last_change":"2024-01-31T05:09:20.591522+0000","last_active":"2024-01-31T05:09:22.945596+0000","last_peered":"2024-01-31T05:09:22.945596+0000","last_clean":"2024-01-31T05:09:22.945596+0000","last_became_active":"2024-01-31T05:09:20.591224+0000","last_became_peered":"2024-01-31T05:09:20.591224+0000","last_unstale":"2024-01-31T05:09:22.945596+0000","last_undegraded":"2024-01-31T05:09:22.945596+0000","last_fullsized":"2024-01-31T05:09:22.945596+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:24:17.153662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.055810+0000","last_change":"2024-01-31T05:09:20.186176+0000","last_active":"2024-01-31T05:09:22.055810+0000","last_peered":"2024-01-31T05:09:22.055810+0000","last_clean":"2024-01-31T05:09:22.055810+0000","last_became_active":"2024-01-31T05:09:20.185873+0000","last_became_peered":"2024-01-31T05:09:20.185873+0000","last_unstale":"2024-01-31T05:09:22.055810+0000","last_undegraded":"2024-01-31T05:09:22.055810+0000","last_fullsized":"2024-01-31T05:09:22.055810+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:55:12.689664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.582732+0000","last_change":"2024-01-31T05:09:20.587556+0000","last_active":"2024-01-31T05:09:21.582732+0000","last_peered":"2024-01-31T05:09:21.582732+0000","last_clean":"2024-01-31T05:09:21.582732+0000","last_became_active":"2024-01-31T05:09:20.587275+0000","last_became_peered":"2024-01-31T05:09:20.587275+0000","last_unstale":"2024-01-31T05:09:21.582732+0000","last_undegraded":"2024-01-31T05:09:21.582732+0000","last_fullsized":"2024-01-31T05:09:21.582732+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:35:16.022422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.056065+0000","last_change":"2024-01-31T05:09:20.588044+0000","last_active":"2024-01-31T05:09:22.056065+0000","last_peered":"2024-01-31T05:09:22.056065+0000","last_clean":"2024-01-31T05:09:22.056065+0000","last_became_active":"2024-01-31T05:09:20.587526+0000","last_became_peered":"2024-01-31T05:09:20.587526+0000","last_unstale":"2024-01-31T05:09:22.056065+0000","last_undegraded":"2024-01-31T05:09:22.056065+0000","last_fullsized":"2024-01-31T05:09:22.056065+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:49:07.270009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:25.189799+0000","last_change":"2024-01-31T05:09:20.194791+0000","last_active":"2024-01-31T05:09:25.189799+0000","last_peered":"2024-01-31T05:09:25.189799+0000","last_clean":"2024-01-31T05:09:25.189799+0000","last_became_active":"2024-01-31T05:09:20.194454+0000","last_became_peered":"2024-01-31T05:09:20.194454+0000","last_unstale":"2024-01-31T05:09:25.189799+0000","last_undegraded":"2024-01-31T05:09:25.189799+0000","last_fullsized":"2024-01-31T05:09:25.189799+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:31:26.809960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.937801+0000","last_change":"2024-01-31T05:09:20.585022+0000","last_active":"2024-01-31T05:09:21.937801+0000","last_peered":"2024-01-31T05:09:21.937801+0000","last_clean":"2024-01-31T05:09:21.937801+0000","last_became_active":"2024-01-31T05:09:20.584709+0000","last_became_peered":"2024-01-31T05:09:20.584709+0000","last_unstale":"2024-01-31T05:09:21.937801+0000","last_undegraded":"2024-01-31T05:09:21.937801+0000","last_fullsized":"2024-01-31T05:09:21.937801+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:10:45.616985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:27.169803+0000","last_change":"2024-01-31T05:09:20.183779+0000","last_active":"2024-01-31T05:09:27.169803+0000","last_peered":"2024-01-31T05:09:27.169803+0000","last_clean":"2024-01-31T05:09:27.169803+0000","last_became_active":"2024-01-31T05:09:20.183399+0000","last_became_peered":"2024-01-31T05:09:20.183399+0000","last_unstale":"2024-01-31T05:09:27.169803+0000","last_undegraded":"2024-01-31T05:09:27.169803+0000","last_fullsized":"2024-01-31T05:09:27.169803+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:48:43.831022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":341,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.055577+0000","last_change":"2024-01-31T05:08:10.168270+0000","last_active":"2024-01-31T05:09:22.055577+0000","last_peered":"2024-01-31T05:09:22.055577+0000","last_clean":"2024-01-31T05:09:22.055577+0000","last_became_active":"2024-01-31T05:08:10.167743+0000","last_became_peered":"2024-01-31T05:08:10.167743+0000","last_unstale":"2024-01-31T05:09:22.055577+0000","last_undegraded":"2024-01-31T05:09:22.055577+0000","last_fullsized":"2024-01-31T05:09:22.055577+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:46.976985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:46.976985+0000","last_clean_scrub_stamp":"2024-01-31T05:04:46.976985+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:21:54.724227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.578349+0000","last_change":"2024-01-31T05:09:20.583135+0000","last_active":"2024-01-31T05:09:21.578349+0000","last_peered":"2024-01-31T05:09:21.578349+0000","last_clean":"2024-01-31T05:09:21.578349+0000","last_became_active":"2024-01-31T05:09:20.582850+0000","last_became_peered":"2024-01-31T05:09:20.582850+0000","last_unstale":"2024-01-31T05:09:21.578349+0000","last_undegraded":"2024-01-31T05:09:21.578349+0000","last_fullsized":"2024-01-31T05:09:21.578349+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:04:51.204561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'3","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:25.188608+0000","last_change":"2024-01-31T05:09:20.188181+0000","last_active":"2024-01-31T05:09:25.188608+0000","last_peered":"2024-01-31T05:09:25.188608+0000","last_clean":"2024-01-31T05:09:25.188608+0000","last_became_active":"2024-01-31T05:09:20.187801+0000","last_became_peered":"2024-01-31T05:09:20.187801+0000","last_unstale":"2024-01-31T05:09:25.188608+0000","last_undegraded":"2024-01-31T05:09:25.188608+0000","last_fullsized":"2024-01-31T05:09:25.188608+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:27:05.269615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.056718+0000","last_change":"2024-01-31T05:09:20.186242+0000","last_active":"2024-01-31T05:09:22.056718+0000","last_peered":"2024-01-31T05:09:22.056718+0000","last_clean":"2024-01-31T05:09:22.056718+0000","last_became_active":"2024-01-31T05:09:20.185908+0000","last_became_peered":"2024-01-31T05:09:20.185908+0000","last_unstale":"2024-01-31T05:09:22.056718+0000","last_undegraded":"2024-01-31T05:09:22.056718+0000","last_fullsized":"2024-01-31T05:09:22.056718+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:33:40.859324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.578748+0000","last_change":"2024-01-31T05:09:20.590896+0000","last_active":"2024-01-31T05:09:21.578748+0000","last_peered":"2024-01-31T05:09:21.578748+0000","last_clean":"2024-01-31T05:09:21.578748+0000","last_became_active":"2024-01-31T05:09:20.590546+0000","last_became_peered":"2024-01-31T05:09:20.590546+0000","last_unstale":"2024-01-31T05:09:21.578748+0000","last_undegraded":"2024-01-31T05:09:21.578748+0000","last_fullsized":"2024-01-31T05:09:21.578748+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:39:05.969756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'3","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:25.189194+0000","last_change":"2024-01-31T05:09:20.185811+0000","last_active":"2024-01-31T05:09:25.189194+0000","last_peered":"2024-01-31T05:09:25.189194+0000","last_clean":"2024-01-31T05:09:25.189194+0000","last_became_active":"2024-01-31T05:09:20.185490+0000","last_became_peered":"2024-01-31T05:09:20.185490+0000","last_unstale":"2024-01-31T05:09:25.189194+0000","last_undegraded":"2024-01-31T05:09:25.189194+0000","last_fullsized":"2024-01-31T05:09:25.189194+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:16:25.446046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.937860+0000","last_change":"2024-01-31T05:09:20.585298+0000","last_active":"2024-01-31T05:09:21.937860+0000","last_peered":"2024-01-31T05:09:21.937860+0000","last_clean":"2024-01-31T05:09:21.937860+0000","last_became_active":"2024-01-31T05:09:20.584256+0000","last_became_peered":"2024-01-31T05:09:20.584256+0000","last_unstale":"2024-01-31T05:09:21.937860+0000","last_undegraded":"2024-01-31T05:09:21.937860+0000","last_fullsized":"2024-01-31T05:09:21.937860+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:48:10.331714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:27.177856+0000","last_change":"2024-01-31T05:09:20.184960+0000","last_active":"2024-01-31T05:09:27.177856+0000","last_peered":"2024-01-31T05:09:27.177856+0000","last_clean":"2024-01-31T05:09:27.177856+0000","last_became_active":"2024-01-31T05:09:20.184599+0000","last_became_peered":"2024-01-31T05:09:20.184599+0000","last_unstale":"2024-01-31T05:09:27.177856+0000","last_undegraded":"2024-01-31T05:09:27.177856+0000","last_fullsized":"2024-01-31T05:09:27.177856+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:07:01.846976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.292723+0000","last_change":"2024-01-31T05:09:20.588597+0000","last_active":"2024-01-31T05:09:22.292723+0000","last_peered":"2024-01-31T05:09:22.292723+0000","last_clean":"2024-01-31T05:09:22.292723+0000","last_became_active":"2024-01-31T05:09:20.588326+0000","last_became_peered":"2024-01-31T05:09:20.588326+0000","last_unstale":"2024-01-31T05:09:22.292723+0000","last_undegraded":"2024-01-31T05:09:22.292723+0000","last_fullsized":"2024-01-31T05:09:22.292723+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:31:53.873261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:24.182841+0000","last_change":"2024-01-31T05:09:20.186196+0000","last_active":"2024-01-31T05:09:24.182841+0000","last_peered":"2024-01-31T05:09:24.182841+0000","last_clean":"2024-01-31T05:09:24.182841+0000","last_became_active":"2024-01-31T05:09:20.185373+0000","last_became_peered":"2024-01-31T05:09:20.185373+0000","last_unstale":"2024-01-31T05:09:24.182841+0000","last_undegraded":"2024-01-31T05:09:24.182841+0000","last_fullsized":"2024-01-31T05:09:24.182841+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:13:07.826906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.055924+0000","last_change":"2024-01-31T05:09:20.589183+0000","last_active":"2024-01-31T05:09:22.055924+0000","last_peered":"2024-01-31T05:09:22.055924+0000","last_clean":"2024-01-31T05:09:22.055924+0000","last_became_active":"2024-01-31T05:09:20.588884+0000","last_became_peered":"2024-01-31T05:09:20.588884+0000","last_unstale":"2024-01-31T05:09:22.055924+0000","last_undegraded":"2024-01-31T05:09:22.055924+0000","last_fullsized":"2024-01-31T05:09:22.055924+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:23:49.878076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'5","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:26.196704+0000","last_change":"2024-01-31T05:09:20.184849+0000","last_active":"2024-01-31T05:09:26.196704+0000","last_peered":"2024-01-31T05:09:26.196704+0000","last_clean":"2024-01-31T05:09:26.196704+0000","last_became_active":"2024-01-31T05:09:20.184491+0000","last_became_peered":"2024-01-31T05:09:20.184491+0000","last_unstale":"2024-01-31T05:09:26.196704+0000","last_undegraded":"2024-01-31T05:09:26.196704+0000","last_fullsized":"2024-01-31T05:09:26.196704+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:36:31.757646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.057381+0000","last_change":"2024-01-31T05:09:20.585917+0000","last_active":"2024-01-31T05:09:22.057381+0000","last_peered":"2024-01-31T05:09:22.057381+0000","last_clean":"2024-01-31T05:09:22.057381+0000","last_became_active":"2024-01-31T05:09:20.585082+0000","last_became_peered":"2024-01-31T05:09:20.585082+0000","last_unstale":"2024-01-31T05:09:22.057381+0000","last_undegraded":"2024-01-31T05:09:22.057381+0000","last_fullsized":"2024-01-31T05:09:22.057381+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:30:17.670739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.989744+0000","last_change":"2024-01-31T05:09:20.192050+0000","last_active":"2024-01-31T05:09:21.989744+0000","last_peered":"2024-01-31T05:09:21.989744+0000","last_clean":"2024-01-31T05:09:21.989744+0000","last_became_active":"2024-01-31T05:09:20.191662+0000","last_became_peered":"2024-01-31T05:09:20.191662+0000","last_unstale":"2024-01-31T05:09:21.989744+0000","last_undegraded":"2024-01-31T05:09:21.989744+0000","last_fullsized":"2024-01-31T05:09:21.989744+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:30:05.575409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.937934+0000","last_change":"2024-01-31T05:09:20.580332+0000","last_active":"2024-01-31T05:09:21.937934+0000","last_peered":"2024-01-31T05:09:21.937934+0000","last_clean":"2024-01-31T05:09:21.937934+0000","last_became_active":"2024-01-31T05:09:20.580014+0000","last_became_peered":"2024-01-31T05:09:20.580014+0000","last_unstale":"2024-01-31T05:09:21.937934+0000","last_undegraded":"2024-01-31T05:09:21.937934+0000","last_fullsized":"2024-01-31T05:09:21.937934+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:38:52.507575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:24.183405+0000","last_change":"2024-01-31T05:09:20.186065+0000","last_active":"2024-01-31T05:09:24.183405+0000","last_peered":"2024-01-31T05:09:24.183405+0000","last_clean":"2024-01-31T05:09:24.183405+0000","last_became_active":"2024-01-31T05:09:20.185798+0000","last_became_peered":"2024-01-31T05:09:20.185798+0000","last_unstale":"2024-01-31T05:09:24.183405+0000","last_undegraded":"2024-01-31T05:09:24.183405+0000","last_fullsized":"2024-01-31T05:09:24.183405+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:25:05.792886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.055901+0000","last_change":"2024-01-31T05:09:20.589746+0000","last_active":"2024-01-31T05:09:22.055901+0000","last_peered":"2024-01-31T05:09:22.055901+0000","last_clean":"2024-01-31T05:09:22.055901+0000","last_became_active":"2024-01-31T05:09:20.589452+0000","last_became_peered":"2024-01-31T05:09:20.589452+0000","last_unstale":"2024-01-31T05:09:22.055901+0000","last_undegraded":"2024-01-31T05:09:22.055901+0000","last_fullsized":"2024-01-31T05:09:22.055901+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:04:39.773280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'5","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:26.195304+0000","last_change":"2024-01-31T05:09:20.181920+0000","last_active":"2024-01-31T05:09:26.195304+0000","last_peered":"2024-01-31T05:09:26.195304+0000","last_clean":"2024-01-31T05:09:26.195304+0000","last_became_active":"2024-01-31T05:09:20.181603+0000","last_became_peered":"2024-01-31T05:09:20.181603+0000","last_unstale":"2024-01-31T05:09:26.195304+0000","last_undegraded":"2024-01-31T05:09:26.195304+0000","last_fullsized":"2024-01-31T05:09:26.195304+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:11:30.696322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.056186+0000","last_change":"2024-01-31T05:09:20.592244+0000","last_active":"2024-01-31T05:09:22.056186+0000","last_peered":"2024-01-31T05:09:22.056186+0000","last_clean":"2024-01-31T05:09:22.056186+0000","last_became_active":"2024-01-31T05:09:20.591940+0000","last_became_peered":"2024-01-31T05:09:20.591940+0000","last_unstale":"2024-01-31T05:09:22.056186+0000","last_undegraded":"2024-01-31T05:09:22.056186+0000","last_fullsized":"2024-01-31T05:09:22.056186+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:16:02.284216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.057367+0000","last_change":"2024-01-31T05:09:20.192018+0000","last_active":"2024-01-31T05:09:22.057367+0000","last_peered":"2024-01-31T05:09:22.057367+0000","last_clean":"2024-01-31T05:09:22.057367+0000","last_became_active":"2024-01-31T05:09:20.191721+0000","last_became_peered":"2024-01-31T05:09:20.191721+0000","last_unstale":"2024-01-31T05:09:22.057367+0000","last_undegraded":"2024-01-31T05:09:22.057367+0000","last_fullsized":"2024-01-31T05:09:22.057367+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:53:56.199730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.055990+0000","last_change":"2024-01-31T05:09:20.593153+0000","last_active":"2024-01-31T05:09:22.055990+0000","last_peered":"2024-01-31T05:09:22.055990+0000","last_clean":"2024-01-31T05:09:22.055990+0000","last_became_active":"2024-01-31T05:09:20.592869+0000","last_became_peered":"2024-01-31T05:09:20.592869+0000","last_unstale":"2024-01-31T05:09:22.055990+0000","last_undegraded":"2024-01-31T05:09:22.055990+0000","last_fullsized":"2024-01-31T05:09:22.055990+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:35:42.234519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'3","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.798809+0000","last_change":"2024-01-31T05:09:20.191998+0000","last_active":"2024-01-31T05:09:21.798809+0000","last_peered":"2024-01-31T05:09:21.798809+0000","last_clean":"2024-01-31T05:09:21.798809+0000","last_became_active":"2024-01-31T05:09:20.191658+0000","last_became_peered":"2024-01-31T05:09:20.191658+0000","last_unstale":"2024-01-31T05:09:21.798809+0000","last_undegraded":"2024-01-31T05:09:21.798809+0000","last_fullsized":"2024-01-31T05:09:21.798809+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T17:06:39.916765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.056311+0000","last_change":"2024-01-31T05:09:20.586822+0000","last_active":"2024-01-31T05:09:22.056311+0000","last_peered":"2024-01-31T05:09:22.056311+0000","last_clean":"2024-01-31T05:09:22.056311+0000","last_became_active":"2024-01-31T05:09:20.586523+0000","last_became_peered":"2024-01-31T05:09:20.586523+0000","last_unstale":"2024-01-31T05:09:22.056311+0000","last_undegraded":"2024-01-31T05:09:22.056311+0000","last_fullsized":"2024-01-31T05:09:22.056311+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:02:59.311443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.057527+0000","last_change":"2024-01-31T05:09:20.586141+0000","last_active":"2024-01-31T05:09:22.057527+0000","last_peered":"2024-01-31T05:09:22.057527+0000","last_clean":"2024-01-31T05:09:22.057527+0000","last_became_active":"2024-01-31T05:09:20.585626+0000","last_became_peered":"2024-01-31T05:09:20.585626+0000","last_unstale":"2024-01-31T05:09:22.057527+0000","last_undegraded":"2024-01-31T05:09:22.057527+0000","last_fullsized":"2024-01-31T05:09:22.057527+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:39:18.023044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.579542+0000","last_change":"2024-01-31T05:09:20.588203+0000","last_active":"2024-01-31T05:09:21.579542+0000","last_peered":"2024-01-31T05:09:21.579542+0000","last_clean":"2024-01-31T05:09:21.579542+0000","last_became_active":"2024-01-31T05:09:20.586660+0000","last_became_peered":"2024-01-31T05:09:20.586660+0000","last_unstale":"2024-01-31T05:09:21.579542+0000","last_undegraded":"2024-01-31T05:09:21.579542+0000","last_fullsized":"2024-01-31T05:09:21.579542+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:27:41.249756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.579751+0000","last_change":"2024-01-31T05:09:20.591708+0000","last_active":"2024-01-31T05:09:21.579751+0000","last_peered":"2024-01-31T05:09:21.579751+0000","last_clean":"2024-01-31T05:09:21.579751+0000","last_became_active":"2024-01-31T05:09:20.590874+0000","last_became_peered":"2024-01-31T05:09:20.590874+0000","last_unstale":"2024-01-31T05:09:21.579751+0000","last_undegraded":"2024-01-31T05:09:21.579751+0000","last_fullsized":"2024-01-31T05:09:21.579751+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:13:30.221125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.292658+0000","last_change":"2024-01-31T05:09:20.587566+0000","last_active":"2024-01-31T05:09:22.292658+0000","last_peered":"2024-01-31T05:09:22.292658+0000","last_clean":"2024-01-31T05:09:22.292658+0000","last_became_active":"2024-01-31T05:09:20.587260+0000","last_became_peered":"2024-01-31T05:09:20.587260+0000","last_unstale":"2024-01-31T05:09:22.292658+0000","last_undegraded":"2024-01-31T05:09:22.292658+0000","last_fullsized":"2024-01-31T05:09:22.292658+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:32:46.030539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.578699+0000","last_change":"2024-01-31T05:09:20.587259+0000","last_active":"2024-01-31T05:09:21.578699+0000","last_peered":"2024-01-31T05:09:21.578699+0000","last_clean":"2024-01-31T05:09:21.578699+0000","last_became_active":"2024-01-31T05:09:20.586935+0000","last_became_peered":"2024-01-31T05:09:20.586935+0000","last_unstale":"2024-01-31T05:09:21.578699+0000","last_undegraded":"2024-01-31T05:09:21.578699+0000","last_fullsized":"2024-01-31T05:09:21.578699+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:28:23.217392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.057174+0000","last_change":"2024-01-31T05:09:20.587213+0000","last_active":"2024-01-31T05:09:22.057174+0000","last_peered":"2024-01-31T05:09:22.057174+0000","last_clean":"2024-01-31T05:09:22.057174+0000","last_became_active":"2024-01-31T05:09:20.586918+0000","last_became_peered":"2024-01-31T05:09:20.586918+0000","last_unstale":"2024-01-31T05:09:22.057174+0000","last_undegraded":"2024-01-31T05:09:22.057174+0000","last_fullsized":"2024-01-31T05:09:22.057174+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:39:27.541560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.579825+0000","last_change":"2024-01-31T05:09:20.584532+0000","last_active":"2024-01-31T05:09:21.579825+0000","last_peered":"2024-01-31T05:09:21.579825+0000","last_clean":"2024-01-31T05:09:21.579825+0000","last_became_active":"2024-01-31T05:09:20.583512+0000","last_became_peered":"2024-01-31T05:09:20.583512+0000","last_unstale":"2024-01-31T05:09:21.579825+0000","last_undegraded":"2024-01-31T05:09:21.579825+0000","last_fullsized":"2024-01-31T05:09:21.579825+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:04:33.848498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.937932+0000","last_change":"2024-01-31T05:09:20.587561+0000","last_active":"2024-01-31T05:09:21.937932+0000","last_peered":"2024-01-31T05:09:21.937932+0000","last_clean":"2024-01-31T05:09:21.937932+0000","last_became_active":"2024-01-31T05:09:20.587232+0000","last_became_peered":"2024-01-31T05:09:20.587232+0000","last_unstale":"2024-01-31T05:09:21.937932+0000","last_undegraded":"2024-01-31T05:09:21.937932+0000","last_fullsized":"2024-01-31T05:09:21.937932+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:17:01.913186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.056046+0000","last_change":"2024-01-31T05:09:20.581823+0000","last_active":"2024-01-31T05:09:22.056046+0000","last_peered":"2024-01-31T05:09:22.056046+0000","last_clean":"2024-01-31T05:09:22.056046+0000","last_became_active":"2024-01-31T05:09:20.581560+0000","last_became_peered":"2024-01-31T05:09:20.581560+0000","last_unstale":"2024-01-31T05:09:22.056046+0000","last_undegraded":"2024-01-31T05:09:22.056046+0000","last_fullsized":"2024-01-31T05:09:22.056046+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:48:50.057303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.937598+0000","last_change":"2024-01-31T05:09:20.582477+0000","last_active":"2024-01-31T05:09:21.937598+0000","last_peered":"2024-01-31T05:09:21.937598+0000","last_clean":"2024-01-31T05:09:21.937598+0000","last_became_active":"2024-01-31T05:09:20.582051+0000","last_became_peered":"2024-01-31T05:09:20.582051+0000","last_unstale":"2024-01-31T05:09:21.937598+0000","last_undegraded":"2024-01-31T05:09:21.937598+0000","last_fullsized":"2024-01-31T05:09:21.937598+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:24:36.665707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.584755+0000","last_change":"2024-01-31T05:09:20.587281+0000","last_active":"2024-01-31T05:09:21.584755+0000","last_peered":"2024-01-31T05:09:21.584755+0000","last_clean":"2024-01-31T05:09:21.584755+0000","last_became_active":"2024-01-31T05:09:20.586976+0000","last_became_peered":"2024-01-31T05:09:20.586976+0000","last_unstale":"2024-01-31T05:09:21.584755+0000","last_undegraded":"2024-01-31T05:09:21.584755+0000","last_fullsized":"2024-01-31T05:09:21.584755+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:33:59.065647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.578714+0000","last_change":"2024-01-31T05:09:20.585953+0000","last_active":"2024-01-31T05:09:21.578714+0000","last_peered":"2024-01-31T05:09:21.578714+0000","last_clean":"2024-01-31T05:09:21.578714+0000","last_became_active":"2024-01-31T05:09:20.585406+0000","last_became_peered":"2024-01-31T05:09:20.585406+0000","last_unstale":"2024-01-31T05:09:21.578714+0000","last_undegraded":"2024-01-31T05:09:21.578714+0000","last_fullsized":"2024-01-31T05:09:21.578714+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:14:24.622166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.056496+0000","last_change":"2024-01-31T05:09:20.587073+0000","last_active":"2024-01-31T05:09:22.056496+0000","last_peered":"2024-01-31T05:09:22.056496+0000","last_clean":"2024-01-31T05:09:22.056496+0000","last_became_active":"2024-01-31T05:09:20.586753+0000","last_became_peered":"2024-01-31T05:09:20.586753+0000","last_unstale":"2024-01-31T05:09:22.056496+0000","last_undegraded":"2024-01-31T05:09:22.056496+0000","last_fullsized":"2024-01-31T05:09:22.056496+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:13:20.291390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":26334,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":161,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":360448,"data_stored":48195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892350990,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":929792,"data_stored":445558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0469999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]}]},{"osd":10,"up_from":73,"seq":313532612628,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36872,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708280,"statfs":{"total":95995035648,"available":95957278720,"internally_reserved":0,"allocated":1572864,"data_stored":1038658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":36174273},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":1,"last update":"Wed Jan 31 05:09:09 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.378},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.40200000000000002}]},{"osd":2,"last update":"Wed Jan 31 05:09:09 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.74299999999999999}]},{"osd":3,"last update":"Wed Jan 31 05:09:09 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.46400000000000002}]},{"osd":4,"last update":"Wed Jan 31 05:09:09 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.52800000000000002}]},{"osd":5,"last update":"Wed Jan 31 05:09:09 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.68000000000000005}]},{"osd":6,"last update":"Wed Jan 31 05:09:09 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.495},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.54300000000000004}]},{"osd":7,"last update":"Wed Jan 31 05:09:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.57199999999999995}]},{"osd":8,"last update":"Wed Jan 31 05:09:09 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.71299999999999997}]},{"osd":9,"last update":"Wed Jan 31 05:09:09 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.60799999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]}]},{"osd":9,"up_from":67,"seq":287762808856,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":445794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:08:44 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.41899999999999998}]},{"osd":1,"last update":"Wed Jan 31 05:08:44 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.40300000000000002}]},{"osd":2,"last update":"Wed Jan 31 05:08:44 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.44600000000000001}]},{"osd":3,"last update":"Wed Jan 31 05:08:44 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.34699999999999998}]},{"osd":4,"last update":"Wed Jan 31 05:08:44 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.68999999999999995}]},{"osd":5,"last update":"Wed Jan 31 05:08:44 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.61199999999999999}]},{"osd":6,"last update":"Wed Jan 31 05:08:44 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.503},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.48299999999999998}]},{"osd":7,"last update":"Wed Jan 31 05:08:44 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1,"5min":1,"15min":1},"last":0.65800000000000003}]},{"osd":8,"last update":"Wed Jan 31 05:08:44 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.58699999999999997}]},{"osd":10,"last update":"Wed Jan 31 05:09:10 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.627},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.63600000000000001}]}]},{"osd":8,"up_from":59,"seq":253403070493,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":937984,"data_stored":445602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:09:17 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.57099999999999995,"15min":0.57599999999999996},"min":{"1min":0.39400000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.57299999999999995,"15min":0.58499999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.72499999999999998,"5min":0.877,"15min":0.877},"last":0.65700000000000003}]},{"osd":1,"last update":"Wed Jan 31 05:09:17 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59599999999999997,"15min":0.59899999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.874},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61899999999999999,"15min":0.621},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84099999999999997,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.68200000000000005}]},{"osd":2,"last update":"Wed Jan 31 05:09:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.46899999999999997,"15min":0.47699999999999998},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.48299999999999998,"15min":0.497},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.63800000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.498}]},{"osd":3,"last update":"Wed Jan 31 05:09:17 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.56899999999999995,"15min":0.58099999999999996},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.70799999999999996,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.629,"15min":0.64500000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.84299999999999997}]},{"osd":4,"last update":"Wed Jan 31 05:09:17 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.622,"15min":0.629},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.86599999999999999,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.64600000000000002,"15min":0.65000000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.57499999999999996}]},{"osd":5,"last update":"Wed Jan 31 05:09:17 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.58399999999999996,"15min":0.60399999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.64100000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.57499999999999996,"15min":0.59199999999999997},"min":{"1min":0.33000000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.59899999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.35899999999999999}]},{"osd":6,"last update":"Wed Jan 31 05:09:17 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.69599999999999995,"15min":0.71599999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.95599999999999996,"5min":0.996,"15min":0.996},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.70999999999999996,"15min":0.72699999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.75,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.79400000000000004}]},{"osd":7,"last update":"Wed Jan 31 05:09:17 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.70899999999999996,"15min":0.71899999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.877,"5min":1.171,"15min":1.171},"last":0.748},{"interface":"front","average":{"1min":1.675,"5min":0.91500000000000004,"15min":0.78900000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":19.677,"5min":19.677,"15min":19.677},"last":0.82599999999999996}]},{"osd":9,"last update":"Wed Jan 31 05:08:42 2024","interfaces":[{"interface":"back","average":{"1min":1.665,"5min":1.665,"15min":1.665},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":19.695,"5min":19.695,"15min":19.695},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.90100000000000002}]},{"osd":10,"last update":"Wed Jan 31 05:09:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.81200000000000006}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]}]},{"osd":7,"up_from":51,"seq":219043332130,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28524,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716628,"statfs":{"total":95995035648,"available":95965827072,"internally_reserved":0,"allocated":1544192,"data_stored":1037808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:08:52 2024","interfaces":[{"interface":"back","average":{"1min":1.669,"5min":0.75600000000000001,"15min":0.60399999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":19.462,"5min":19.462,"15min":19.462},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.52900000000000003,"15min":0.51900000000000002},"min":{"1min":0.40899999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.45500000000000002}]},{"osd":1,"last update":"Wed Jan 31 05:08:52 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.41299999999999998,"15min":0.41099999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.44700000000000001,"15min":0.441},"min":{"1min":0.30099999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.63900000000000001}]},{"osd":2,"last update":"Wed Jan 31 05:08:52 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.60599999999999998,"15min":0.60299999999999998},"min":{"1min":0.34799999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.622}]},{"osd":3,"last update":"Wed Jan 31 05:08:52 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.753,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.52600000000000002}]},{"osd":4,"last update":"Wed Jan 31 05:08:52 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.47799999999999998,"15min":0.47699999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.63,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.5,"5min":0.50700000000000001,"15min":0.50800000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.71399999999999997,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.42999999999999999}]},{"osd":5,"last update":"Wed Jan 31 05:08:52 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.629,"15min":0.625},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64300000000000002,"15min":0.64200000000000002},"min":{"1min":0.432,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.78000000000000003}]},{"osd":6,"last update":"Wed Jan 31 05:08:52 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.63700000000000001,"15min":0.63100000000000001},"min":{"1min":0.46800000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.69699999999999995},{"interface":"front","average":{"1min":1.7889999999999999,"5min":0.88100000000000001,"15min":0.72999999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":19.425000000000001,"5min":19.425000000000001,"15min":19.425000000000001},"last":0.67300000000000004}]},{"osd":8,"last update":"Wed Jan 31 05:09:20 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67700000000000005,"15min":0.67800000000000005},"min":{"1min":0.52700000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.873,"5min":0.875,"15min":0.875},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.70599999999999996,"15min":0.71099999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.88200000000000001,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.80900000000000005}]},{"osd":9,"last update":"Wed Jan 31 05:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.755}]},{"osd":10,"last update":"Wed Jan 31 05:09:11 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.81999999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]}]},{"osd":6,"up_from":46,"seq":197568495655,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":445066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.376,"15min":0.37},"min":{"1min":0.27800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41199999999999998,"15min":0.40999999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.33300000000000002}]},{"osd":1,"last update":"Wed Jan 31 05:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53900000000000003,"15min":0.53700000000000003},"min":{"1min":0.40200000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55600000000000005,"15min":0.55200000000000005},"min":{"1min":0.436,"5min":0.378,"15min":0.378},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.63500000000000001}]},{"osd":2,"last update":"Wed Jan 31 05:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56100000000000005,"15min":0.55400000000000005},"min":{"1min":0.42599999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55400000000000005,"15min":0.54700000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.56399999999999995}]},{"osd":3,"last update":"Wed Jan 31 05:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.45900000000000002,"15min":0.45400000000000001},"min":{"1min":0.29499999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.49199999999999999,"15min":0.48599999999999999},"min":{"1min":0.318,"5min":0.313,"15min":0.313},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.39400000000000002}]},{"osd":4,"last update":"Wed Jan 31 05:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58799999999999997,"15min":0.59199999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.73499999999999999,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.622},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.57699999999999996,"15min":0.57299999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.83899999999999997,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.61099999999999999}]},{"osd":5,"last update":"Wed Jan 31 05:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.625,"15min":0.621},"min":{"1min":0.443,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.46300000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.53700000000000003}]},{"osd":7,"last update":"Wed Jan 31 05:08:55 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.64500000000000002,"15min":0.63700000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.65500000000000003,"15min":0.65100000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.69499999999999995}]},{"osd":8,"last update":"Wed Jan 31 05:09:17 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.68799999999999994,"15min":0.69299999999999995},"min":{"1min":0.48699999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.78300000000000003,"15min":0.80600000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.91200000000000003,"5min":3.3130000000000002,"15min":3.3130000000000002},"last":0.71199999999999997}]},{"osd":9,"last update":"Wed Jan 31 05:08:44 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1,"5min":1,"15min":1},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.49399999999999999}]},{"osd":10,"last update":"Wed Jan 31 05:09:07 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.66100000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574911,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":954368,"data_stored":454939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:08:27 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.496,"15min":0.48699999999999999},"min":{"1min":0.33200000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.51500000000000001,"15min":0.505},"min":{"1min":0.371,"5min":0.314,"15min":0.314},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.68899999999999995}]},{"osd":2,"last update":"Wed Jan 31 05:08:53 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.53500000000000003,"15min":0.51300000000000001},"min":{"1min":0.36699999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.80600000000000005,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.52200000000000002,"15min":0.499},"min":{"1min":0.40000000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.73899999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.76100000000000001}]},{"osd":3,"last update":"Wed Jan 31 05:09:17 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.501,"15min":0.48699999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.53200000000000003,"15min":0.5},"min":{"1min":0.374,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.90000000000000002,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.61499999999999999}]},{"osd":4,"last update":"Wed Jan 31 05:08:43 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.439,"15min":0.432},"min":{"1min":0.314,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.63200000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.44800000000000001,"15min":0.438},"min":{"1min":0.29399999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.505}]},{"osd":5,"last update":"Wed Jan 31 05:09:04 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.56399999999999995,"15min":0.54600000000000004},"min":{"1min":0.379,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.57399999999999995,"15min":0.55800000000000005},"min":{"1min":0.40799999999999997,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.83599999999999997}]},{"osd":6,"last update":"Wed Jan 31 05:08:27 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.58099999999999996},"min":{"1min":0.43099999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.44900000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.745}]},{"osd":7,"last update":"Wed Jan 31 05:08:53 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.36299999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.64000000000000001}]},{"osd":8,"last update":"Wed Jan 31 05:09:17 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.66600000000000004,"15min":0.66200000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.85999999999999999,"5min":0.875,"15min":0.875},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.66000000000000003,"15min":0.65800000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.80900000000000005}]},{"osd":9,"last update":"Wed Jan 31 05:08:43 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.72999999999999998}]},{"osd":10,"last update":"Wed Jan 31 05:09:10 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.86399999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]}]},{"osd":0,"up_from":8,"seq":34359738437,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":447544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 31 05:08:30 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51700000000000002,"15min":0.52700000000000002},"min":{"1min":0.40100000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.71699999999999997,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.53300000000000003,"15min":0.52900000000000003},"min":{"1min":0.35799999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.73299999999999998,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.57899999999999996}]},{"osd":2,"last update":"Wed Jan 31 05:08:59 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55000000000000004,"15min":0.54400000000000004},"min":{"1min":0.34999999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.78400000000000003,"5min":0.873,"15min":0.873},"last":0.54400000000000004},{"interface":"front","average":{"1min":1.0389999999999999,"5min":0.65500000000000003,"15min":0.59499999999999997},"min":{"1min":0.42099999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":9.3170000000000002,"5min":9.3170000000000002,"15min":9.3170000000000002},"last":0.35799999999999998}]},{"osd":3,"last update":"Wed Jan 31 05:08:15 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.41699999999999998,"15min":0.40999999999999998},"min":{"1min":0.27000000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.62,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.39600000000000002,"15min":0.39100000000000001},"min":{"1min":0.312,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.56000000000000005,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.28599999999999998}]},{"osd":4,"last update":"Wed Jan 31 05:08:40 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53500000000000003,"15min":0.52100000000000002},"min":{"1min":0.40500000000000003,"5min":0.375,"15min":0.375},"max":{"1min":0.68899999999999995,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.53600000000000003,"15min":0.50900000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.72799999999999998}]},{"osd":5,"last update":"Wed Jan 31 05:09:10 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55600000000000005,"15min":0.54600000000000004},"min":{"1min":0.39300000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.75600000000000001,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.45800000000000002},{"interface":"front","average":{"1min":1.0549999999999999,"5min":0.68000000000000005,"15min":0.60699999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":9.2690000000000001,"5min":9.2690000000000001,"15min":9.2690000000000001},"last":0.628}]},{"osd":6,"last update":"Wed Jan 31 05:08:29 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.52700000000000002,"15min":0.52200000000000002},"min":{"1min":0.31,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.53000000000000003,"15min":0.52100000000000002},"min":{"1min":0.39000000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.47099999999999997}]},{"osd":7,"last update":"Wed Jan 31 05:08:59 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.627,"15min":0.622},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80900000000000005,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.64400000000000002,"15min":0.64200000000000002},"min":{"1min":0.47899999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.81699999999999995,"5min":0.874,"15min":0.874},"last":0.54600000000000004}]},{"osd":8,"last update":"Wed Jan 31 05:09:19 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.72299999999999998,"15min":0.67700000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":9.2840000000000007,"5min":9.2840000000000007,"15min":9.2840000000000007},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.70999999999999996,"15min":0.72199999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.78100000000000003,"5min":1.006,"15min":1.006},"last":0.66500000000000004}]},{"osd":9,"last update":"Wed Jan 31 05:08:40 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.44400000000000001}]},{"osd":10,"last update":"Wed Jan 31 05:09:10 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.69699999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]}]},{"osd":2,"up_from":18,"seq":77309411387,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":970752,"data_stored":448560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:08:55 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.499,"15min":0.47299999999999998},"min":{"1min":0.38700000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.70599999999999996,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.50800000000000001,"15min":0.495},"min":{"1min":0.36599999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.72599999999999998,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.40300000000000002}]},{"osd":1,"last update":"Wed Jan 31 05:08:55 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.52100000000000002,"15min":0.50700000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76700000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.53500000000000003,"15min":0.51900000000000002},"min":{"1min":0.41799999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.53700000000000003}]},{"osd":3,"last update":"Wed Jan 31 05:09:19 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55400000000000005,"15min":0.52400000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.75,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.56399999999999995,"15min":0.53600000000000003},"min":{"1min":0.40799999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.76800000000000002,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.68000000000000005}]},{"osd":4,"last update":"Wed Jan 31 05:08:40 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.41699999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.71599999999999997,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.53600000000000003,"15min":0.54000000000000004},"min":{"1min":0.40699999999999997,"5min":0.377,"15min":0.377},"max":{"1min":0.75600000000000001,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.57699999999999996}]},{"osd":5,"last update":"Wed Jan 31 05:09:02 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.41899999999999998,"15min":0.40699999999999997},"min":{"1min":0.29899999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.69899999999999995,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.44,"15min":0.434},"min":{"1min":0.30299999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.61799999999999999,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.60599999999999998}]},{"osd":6,"last update":"Wed Jan 31 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.55900000000000005,"15min":0.54400000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57199999999999995,"15min":0.56599999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.76000000000000001,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.624}]},{"osd":7,"last update":"Wed Jan 31 05:08:55 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.77600000000000002,"15min":0.80300000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.77000000000000002,"5min":3.9449999999999998,"15min":3.9449999999999998},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.78600000000000003,"15min":0.80900000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.80600000000000005,"5min":4.1230000000000002,"15min":4.1230000000000002},"last":0.44}]},{"osd":8,"last update":"Wed Jan 31 05:09:18 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.33300000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.80400000000000005,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.501},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61799999999999999,"15min":0.61899999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.84399999999999997,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.81699999999999995}]},{"osd":9,"last update":"Wed Jan 31 05:08:44 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.69599999999999995}]},{"osd":10,"last update":"Wed Jan 31 05:09:08 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.79000000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]}]},{"osd":3,"up_from":25,"seq":107374182453,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":445260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:09:22 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.33800000000000002,"15min":0.315},"min":{"1min":0.24199999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.36099999999999999,"15min":0.33800000000000002},"min":{"1min":0.252,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.58899999999999997,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.38700000000000001}]},{"osd":1,"last update":"Wed Jan 31 05:09:22 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.52500000000000002,"15min":0.505},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.80600000000000005,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.52500000000000002,"15min":0.502},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.629}]},{"osd":2,"last update":"Wed Jan 31 05:09:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.54200000000000004,"15min":0.504},"min":{"1min":0.42099999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.53000000000000003,"15min":0.51000000000000001},"min":{"1min":0.36499999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.75600000000000001,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.60599999999999998}]},{"osd":4,"last update":"Wed Jan 31 05:08:45 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.54000000000000004,"15min":0.52000000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.54700000000000004,"15min":0.51100000000000001},"min":{"1min":0.45900000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.78000000000000003}]},{"osd":5,"last update":"Wed Jan 31 05:09:06 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56399999999999995,"15min":0.56100000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.59299999999999997,"15min":0.58099999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.57599999999999996}]},{"osd":6,"last update":"Wed Jan 31 05:08:27 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.47399999999999998,"15min":0.46300000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.48199999999999998,"15min":0.47699999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.44500000000000001}]},{"osd":7,"last update":"Wed Jan 31 05:08:52 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.66500000000000004,"15min":0.65100000000000002},"min":{"1min":0.53400000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.65300000000000002,"15min":0.64600000000000002},"min":{"1min":0.52400000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.79700000000000004}]},{"osd":8,"last update":"Wed Jan 31 05:08:16 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.68200000000000005}]},{"osd":9,"last update":"Wed Jan 31 05:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.51100000000000001}]},{"osd":10,"last update":"Wed Jan 31 05:09:10 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.753},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.81000000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]}]},{"osd":4,"up_from":33,"seq":141733920817,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":946176,"data_stored":446066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.502,"15min":0.497},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.51900000000000002,"15min":0.51600000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.51300000000000001}]},{"osd":1,"last update":"Wed Jan 31 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.35599999999999998,"15min":0.33800000000000002},"min":{"1min":0.29099999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.38400000000000001,"15min":0.371},"min":{"1min":0.27100000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.36599999999999999}]},{"osd":2,"last update":"Wed Jan 31 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.54400000000000004,"15min":0.53400000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.54600000000000004,"15min":0.52500000000000002},"min":{"1min":0.40400000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76200000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.76800000000000002}]},{"osd":3,"last update":"Wed Jan 31 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.54700000000000004,"15min":0.53400000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54100000000000004,"15min":0.53900000000000003},"min":{"1min":0.39400000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.48999999999999999}]},{"osd":5,"last update":"Wed Jan 31 05:09:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55100000000000005,"15min":0.53400000000000003},"min":{"1min":0.442,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.71299999999999997,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.56399999999999995,"15min":0.54000000000000004},"min":{"1min":0.46200000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.78600000000000003,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.71499999999999997}]},{"osd":6,"last update":"Wed Jan 31 05:08:30 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58199999999999996,"15min":0.57599999999999996},"min":{"1min":0.46999999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.82799999999999996,"5min":0.87,"15min":0.87},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.45200000000000001}]},{"osd":7,"last update":"Wed Jan 31 05:08:52 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.55100000000000005,"15min":0.53900000000000003},"min":{"1min":0.41999999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59199999999999997,"15min":0.58899999999999997},"min":{"1min":0.39600000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.80300000000000005,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.61099999999999999}]},{"osd":8,"last update":"Wed Jan 31 05:09:18 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.67400000000000004,"15min":0.67000000000000004},"min":{"1min":0.53500000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.85499999999999998,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.67500000000000004,"15min":0.66600000000000004},"min":{"1min":0.55300000000000005,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.88600000000000001,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.80100000000000005}]},{"osd":9,"last update":"Wed Jan 31 05:08:44 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.67900000000000005}]},{"osd":10,"last update":"Wed Jan 31 05:09:08 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.754}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]}]},{"osd":5,"up_from":38,"seq":163208757292,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32700,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712452,"statfs":{"total":95995035648,"available":95961550848,"internally_reserved":0,"allocated":1560576,"data_stored":1037582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:09:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.503,"15min":0.47299999999999998},"min":{"1min":0.314,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.31},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.52200000000000002,"15min":0.499},"min":{"1min":0.32700000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.82999999999999996,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.35199999999999998}]},{"osd":1,"last update":"Wed Jan 31 05:09:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53100000000000003,"15min":0.52100000000000002},"min":{"1min":0.34699999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.55600000000000005,"15min":0.54800000000000004},"min":{"1min":0.35399999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.82199999999999995,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.42299999999999999}]},{"osd":2,"last update":"Wed Jan 31 05:09:05 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.40000000000000002,"15min":0.39200000000000002},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.60599999999999998,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41599999999999998,"15min":0.41499999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.59899999999999998,"5min":0.623,"15min":0.623},"last":0.54000000000000004}]},{"osd":3,"last update":"Wed Jan 31 05:09:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.55000000000000004,"15min":0.52700000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.91000000000000003,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54800000000000004,"15min":0.53200000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.72499999999999998,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.55500000000000005}]},{"osd":4,"last update":"Wed Jan 31 05:09:05 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60099999999999998,"15min":0.59499999999999997},"min":{"1min":0.442,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.77800000000000002,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.60899999999999999,"15min":0.60199999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.83299999999999996,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.48399999999999999}]},{"osd":6,"last update":"Wed Jan 31 05:08:32 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.40000000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.503}]},{"osd":7,"last update":"Wed Jan 31 05:08:52 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.59799999999999998,"15min":0.59099999999999997},"min":{"1min":0.40699999999999997,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.64100000000000001,"15min":0.63700000000000001},"min":{"1min":0.45600000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.64500000000000002}]},{"osd":8,"last update":"Wed Jan 31 05:09:17 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.55000000000000004,"15min":0.54400000000000004},"min":{"1min":0.35999999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.84299999999999997,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58099999999999996,"15min":0.58299999999999996},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.89300000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.51400000000000001}]},{"osd":9,"last update":"Wed Jan 31 05:08:42 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.63},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.67000000000000004}]},{"osd":10,"last update":"Wed Jan 31 05:09:10 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.69199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":9963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":23020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-31T05:09:29.531 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-31T05:09:29.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:29 smithi181 ceph-mon[36434]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:09:29.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:29 smithi181 ceph-mon[36434]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:09:29.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:29 smithi181 ceph-mon[36434]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:09:29.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:29 smithi181 ceph-mon[36434]: pgmap v290: 97 pgs: 97 active+clean; 602 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 9.2 KiB/s wr, 21 op/s 2024-01-31T05:09:29.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:29 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/3964250433' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:09:29.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:29 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/802535416' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:09:29.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:29 smithi179 ceph-mon[35652]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:09:29.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:29 smithi179 ceph-mon[35652]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:09:29.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:29 smithi179 ceph-mon[35652]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:09:29.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:29 smithi179 ceph-mon[35652]: pgmap v290: 97 pgs: 97 active+clean; 602 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 9.2 KiB/s wr, 21 op/s 2024-01-31T05:09:29.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:29 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/3964250433' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:09:29.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:29 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/802535416' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:09:29.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.669+0000 7fbff29ee640 1 -- 172.21.15.99:0/4242790259 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbfec101f20 msgr2=0x7fbfec1023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:29.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.669+0000 7fbff29ee640 1 --2- 172.21.15.99:0/4242790259 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbfec101f20 0x7fbfec1023a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0009900 tx=0x7fbfe002bc30 comp rx=0 tx=0).stop 2024-01-31T05:09:29.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.669+0000 7fbff29ee640 1 -- 172.21.15.99:0/4242790259 shutdown_connections 2024-01-31T05:09:29.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.669+0000 7fbff29ee640 1 --2- 172.21.15.99:0/4242790259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfec1028e0 0x7fbfec109170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:29.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.669+0000 7fbff29ee640 1 --2- 172.21.15.99:0/4242790259 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbfec101f20 0x7fbfec1023a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:29.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.669+0000 7fbff29ee640 1 --2- 172.21.15.99:0/4242790259 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbfec100d30 0x7fbfec101150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:29.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.669+0000 7fbff29ee640 1 -- 172.21.15.99:0/4242790259 >> 172.21.15.99:0/4242790259 conn(0x7fbfec0fc2a0 msgr2=0x7fbfec0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:29.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.669+0000 7fbff29ee640 1 -- 172.21.15.99:0/4242790259 shutdown_connections 2024-01-31T05:09:29.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.669+0000 7fbff29ee640 1 -- 172.21.15.99:0/4242790259 wait complete. 2024-01-31T05:09:29.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.670+0000 7fbff29ee640 1 Processor -- start 2024-01-31T05:09:29.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.670+0000 7fbff29ee640 1 -- start start 2024-01-31T05:09:29.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.670+0000 7fbff29ee640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfec100d30 0x7fbfec196c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:29.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.670+0000 7fbff29ee640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbfec101f20 0x7fbfec1971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:29.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.670+0000 7fbff29ee640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbfec1028e0 0x7fbfec19e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:29.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.670+0000 7fbff29ee640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfec19e750 con 0x7fbfec101f20 2024-01-31T05:09:29.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.670+0000 7fbff29ee640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfec19e8c0 con 0x7fbfec100d30 2024-01-31T05:09:29.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.670+0000 7fbff29ee640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfec19ea80 con 0x7fbfec1028e0 2024-01-31T05:09:29.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.670+0000 7fbfeb7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbfec101f20 0x7fbfec1971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:29.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.670+0000 7fbfeb7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbfec101f20 0x7fbfec1971b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60744/0 (socket says 172.21.15.99:60744) 2024-01-31T05:09:29.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.670+0000 7fbfeb7fe640 1 -- 172.21.15.99:0/3612961152 learned_addr learned my addr 172.21.15.99:0/3612961152 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:09:29.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.670+0000 7fbff0f8b640 1 --2- 172.21.15.99:0/3612961152 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbfec1028e0 0x7fbfec19e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:29.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.671+0000 7fbfebfff640 1 --2- 172.21.15.99:0/3612961152 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfec100d30 0x7fbfec196c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:29.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.671+0000 7fbfeb7fe640 1 -- 172.21.15.99:0/3612961152 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbfec1028e0 msgr2=0x7fbfec19e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:29.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.671+0000 7fbfeb7fe640 1 --2- 172.21.15.99:0/3612961152 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbfec1028e0 0x7fbfec19e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:29.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.671+0000 7fbfeb7fe640 1 -- 172.21.15.99:0/3612961152 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfec100d30 msgr2=0x7fbfec196c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:29.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.671+0000 7fbfeb7fe640 1 --2- 172.21.15.99:0/3612961152 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfec100d30 0x7fbfec196c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:29.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.671+0000 7fbfeb7fe640 1 -- 172.21.15.99:0/3612961152 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe0009560 con 0x7fbfec101f20 2024-01-31T05:09:29.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.671+0000 7fbfeb7fe640 1 --2- 172.21.15.99:0/3612961152 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbfec101f20 0x7fbfec1971b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0009230 tx=0x7fbfe0004ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:29.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.671+0000 7fbfe97fa640 1 -- 172.21.15.99:0/3612961152 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe00043d0 con 0x7fbfec101f20 2024-01-31T05:09:29.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.671+0000 7fbff29ee640 1 -- 172.21.15.99:0/3612961152 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfec19ed00 con 0x7fbfec101f20 2024-01-31T05:09:29.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.671+0000 7fbfe97fa640 1 -- 172.21.15.99:0/3612961152 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbfe00054c0 con 0x7fbfec101f20 2024-01-31T05:09:29.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.671+0000 7fbfe97fa640 1 -- 172.21.15.99:0/3612961152 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe003e450 con 0x7fbfec101f20 2024-01-31T05:09:29.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.671+0000 7fbff29ee640 1 -- 172.21.15.99:0/3612961152 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfec19f1c0 con 0x7fbfec101f20 2024-01-31T05:09:29.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.672+0000 7fbff29ee640 1 -- 172.21.15.99:0/3612961152 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfec108050 con 0x7fbfec101f20 2024-01-31T05:09:29.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.673+0000 7fbfe97fa640 1 -- 172.21.15.99:0/3612961152 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7fbfe00035f0 con 0x7fbfec101f20 2024-01-31T05:09:29.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.673+0000 7fbfe97fa640 1 --2- 172.21.15.99:0/3612961152 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fbfd40a1370 0x7fbfd40a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:29.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.674+0000 7fbfe97fa640 1 -- 172.21.15.99:0/3612961152 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fbfe00ef3a0 con 0x7fbfec101f20 2024-01-31T05:09:29.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.674+0000 7fbfebfff640 1 --2- 172.21.15.99:0/3612961152 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fbfd40a1370 0x7fbfd40a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:29.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.674+0000 7fbfebfff640 1 --2- 172.21.15.99:0/3612961152 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fbfd40a1370 0x7fbfd40a3830 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbfec198140 tx=0x7fbfdc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:29.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.678+0000 7fbfe97fa640 1 -- 172.21.15.99:0/3612961152 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fbfe00b88f0 con 0x7fbfec101f20 2024-01-31T05:09:29.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.852+0000 7fbff29ee640 1 -- 172.21.15.99:0/3612961152 --> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbfec02cbb0 con 0x7fbfd40a1370 2024-01-31T05:09:29.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.862+0000 7fbfe97fa640 1 -- 172.21.15.99:0/3612961152 <== mgr.14152 v2:172.21.15.99:6800/3925720924 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+337001 (secure 0 0 0) 0x7fbfec02cbb0 con 0x7fbfd40a1370 2024-01-31T05:09:29.865 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:09:29.867 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-01-31T05:09:29.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.866+0000 7fbff29ee640 1 -- 172.21.15.99:0/3612961152 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fbfd40a1370 msgr2=0x7fbfd40a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:29.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.866+0000 7fbff29ee640 1 --2- 172.21.15.99:0/3612961152 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fbfd40a1370 0x7fbfd40a3830 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbfec198140 tx=0x7fbfdc005f90 comp rx=0 tx=0).stop 2024-01-31T05:09:29.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.866+0000 7fbff29ee640 1 -- 172.21.15.99:0/3612961152 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbfec101f20 msgr2=0x7fbfec1971b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:29.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.866+0000 7fbff29ee640 1 --2- 172.21.15.99:0/3612961152 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbfec101f20 0x7fbfec1971b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0009230 tx=0x7fbfe0004ee0 comp rx=0 tx=0).stop 2024-01-31T05:09:29.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.866+0000 7fbff29ee640 1 -- 172.21.15.99:0/3612961152 shutdown_connections 2024-01-31T05:09:29.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.866+0000 7fbff29ee640 1 --2- 172.21.15.99:0/3612961152 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fbfd40a1370 0x7fbfd40a3830 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:29.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.866+0000 7fbff29ee640 1 --2- 172.21.15.99:0/3612961152 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbfec1028e0 0x7fbfec19e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:29.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.866+0000 7fbff29ee640 1 --2- 172.21.15.99:0/3612961152 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbfec101f20 0x7fbfec1971b0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:29.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.866+0000 7fbff29ee640 1 --2- 172.21.15.99:0/3612961152 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfec100d30 0x7fbfec196c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:29.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.866+0000 7fbff29ee640 1 -- 172.21.15.99:0/3612961152 >> 172.21.15.99:0/3612961152 conn(0x7fbfec0fc2a0 msgr2=0x7fbfec105220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:29.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.866+0000 7fbff29ee640 1 -- 172.21.15.99:0/3612961152 shutdown_connections 2024-01-31T05:09:29.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:29.866+0000 7fbff29ee640 1 -- 172.21.15.99:0/3612961152 wait complete. 2024-01-31T05:09:29.876 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":290,"stamp":"2024-01-31T05:09:28.594037+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":616819,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":140,"num_read_kb":121,"num_write":343,"num_write_kb":3012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":279,"ondisk_log_size":279,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":366204,"kb_used_data":12892,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575620,"statfs":{"total":1151940427776,"available":1151565434880,"internally_reserved":0,"allocated":13201408,"data_stored":7138437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":26451,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":162,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.026370"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.057445+0000","last_change":"2024-01-31T05:09:20.582274+0000","last_active":"2024-01-31T05:09:22.057445+0000","last_peered":"2024-01-31T05:09:22.057445+0000","last_clean":"2024-01-31T05:09:22.057445+0000","last_became_active":"2024-01-31T05:09:20.581511+0000","last_became_peered":"2024-01-31T05:09:20.581511+0000","last_unstale":"2024-01-31T05:09:22.057445+0000","last_undegraded":"2024-01-31T05:09:22.057445+0000","last_fullsized":"2024-01-31T05:09:22.057445+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:59:10.674456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.292714+0000","last_change":"2024-01-31T05:09:20.581752+0000","last_active":"2024-01-31T05:09:22.292714+0000","last_peered":"2024-01-31T05:09:22.292714+0000","last_clean":"2024-01-31T05:09:22.292714+0000","last_became_active":"2024-01-31T05:09:20.581035+0000","last_became_peered":"2024-01-31T05:09:20.581035+0000","last_unstale":"2024-01-31T05:09:22.292714+0000","last_undegraded":"2024-01-31T05:09:22.292714+0000","last_fullsized":"2024-01-31T05:09:22.292714+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:03:16.999371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.292678+0000","last_change":"2024-01-31T05:09:20.588191+0000","last_active":"2024-01-31T05:09:22.292678+0000","last_peered":"2024-01-31T05:09:22.292678+0000","last_clean":"2024-01-31T05:09:22.292678+0000","last_became_active":"2024-01-31T05:09:20.587466+0000","last_became_peered":"2024-01-31T05:09:20.587466+0000","last_unstale":"2024-01-31T05:09:22.292678+0000","last_undegraded":"2024-01-31T05:09:22.292678+0000","last_fullsized":"2024-01-31T05:09:22.292678+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:22:29.037408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.579566+0000","last_change":"2024-01-31T05:09:20.589377+0000","last_active":"2024-01-31T05:09:21.579566+0000","last_peered":"2024-01-31T05:09:21.579566+0000","last_clean":"2024-01-31T05:09:21.579566+0000","last_became_active":"2024-01-31T05:09:20.589065+0000","last_became_peered":"2024-01-31T05:09:20.589065+0000","last_unstale":"2024-01-31T05:09:21.579566+0000","last_undegraded":"2024-01-31T05:09:21.579566+0000","last_fullsized":"2024-01-31T05:09:21.579566+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:57:11.612654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.056186+0000","last_change":"2024-01-31T05:09:20.578919+0000","last_active":"2024-01-31T05:09:22.056186+0000","last_peered":"2024-01-31T05:09:22.056186+0000","last_clean":"2024-01-31T05:09:22.056186+0000","last_became_active":"2024-01-31T05:09:20.578594+0000","last_became_peered":"2024-01-31T05:09:20.578594+0000","last_unstale":"2024-01-31T05:09:22.056186+0000","last_undegraded":"2024-01-31T05:09:22.056186+0000","last_fullsized":"2024-01-31T05:09:22.056186+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:16:57.168457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.582521+0000","last_change":"2024-01-31T05:09:20.586620+0000","last_active":"2024-01-31T05:09:21.582521+0000","last_peered":"2024-01-31T05:09:21.582521+0000","last_clean":"2024-01-31T05:09:21.582521+0000","last_became_active":"2024-01-31T05:09:20.586323+0000","last_became_peered":"2024-01-31T05:09:20.586323+0000","last_unstale":"2024-01-31T05:09:21.582521+0000","last_undegraded":"2024-01-31T05:09:21.582521+0000","last_fullsized":"2024-01-31T05:09:21.582521+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:03:31.479078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.055650+0000","last_change":"2024-01-31T05:09:20.595122+0000","last_active":"2024-01-31T05:09:22.055650+0000","last_peered":"2024-01-31T05:09:22.055650+0000","last_clean":"2024-01-31T05:09:22.055650+0000","last_became_active":"2024-01-31T05:09:20.594766+0000","last_became_peered":"2024-01-31T05:09:20.594766+0000","last_unstale":"2024-01-31T05:09:22.055650+0000","last_undegraded":"2024-01-31T05:09:22.055650+0000","last_fullsized":"2024-01-31T05:09:22.055650+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:18:40.002855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.937544+0000","last_change":"2024-01-31T05:09:20.584047+0000","last_active":"2024-01-31T05:09:21.937544+0000","last_peered":"2024-01-31T05:09:21.937544+0000","last_clean":"2024-01-31T05:09:21.937544+0000","last_became_active":"2024-01-31T05:09:20.583741+0000","last_became_peered":"2024-01-31T05:09:20.583741+0000","last_unstale":"2024-01-31T05:09:21.937544+0000","last_undegraded":"2024-01-31T05:09:21.937544+0000","last_fullsized":"2024-01-31T05:09:21.937544+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:15:47.253010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.585060+0000","last_change":"2024-01-31T05:09:20.588892+0000","last_active":"2024-01-31T05:09:21.585060+0000","last_peered":"2024-01-31T05:09:21.585060+0000","last_clean":"2024-01-31T05:09:21.585060+0000","last_became_active":"2024-01-31T05:09:20.588212+0000","last_became_peered":"2024-01-31T05:09:20.588212+0000","last_unstale":"2024-01-31T05:09:21.585060+0000","last_undegraded":"2024-01-31T05:09:21.585060+0000","last_fullsized":"2024-01-31T05:09:21.585060+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:49:45.270341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.582657+0000","last_change":"2024-01-31T05:09:20.589396+0000","last_active":"2024-01-31T05:09:21.582657+0000","last_peered":"2024-01-31T05:09:21.582657+0000","last_clean":"2024-01-31T05:09:21.582657+0000","last_became_active":"2024-01-31T05:09:20.589058+0000","last_became_peered":"2024-01-31T05:09:20.589058+0000","last_unstale":"2024-01-31T05:09:21.582657+0000","last_undegraded":"2024-01-31T05:09:21.582657+0000","last_fullsized":"2024-01-31T05:09:21.582657+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:05:53.403136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.056019+0000","last_change":"2024-01-31T05:09:20.592010+0000","last_active":"2024-01-31T05:09:22.056019+0000","last_peered":"2024-01-31T05:09:22.056019+0000","last_clean":"2024-01-31T05:09:22.056019+0000","last_became_active":"2024-01-31T05:09:20.591714+0000","last_became_peered":"2024-01-31T05:09:20.591714+0000","last_unstale":"2024-01-31T05:09:22.056019+0000","last_undegraded":"2024-01-31T05:09:22.056019+0000","last_fullsized":"2024-01-31T05:09:22.056019+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:56:11.651035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.579479+0000","last_change":"2024-01-31T05:09:20.591161+0000","last_active":"2024-01-31T05:09:21.579479+0000","last_peered":"2024-01-31T05:09:21.579479+0000","last_clean":"2024-01-31T05:09:21.579479+0000","last_became_active":"2024-01-31T05:09:20.590857+0000","last_became_peered":"2024-01-31T05:09:20.590857+0000","last_unstale":"2024-01-31T05:09:21.579479+0000","last_undegraded":"2024-01-31T05:09:21.579479+0000","last_fullsized":"2024-01-31T05:09:21.579479+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:44:24.048236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.578664+0000","last_change":"2024-01-31T05:09:20.582167+0000","last_active":"2024-01-31T05:09:21.578664+0000","last_peered":"2024-01-31T05:09:21.578664+0000","last_clean":"2024-01-31T05:09:21.578664+0000","last_became_active":"2024-01-31T05:09:20.581860+0000","last_became_peered":"2024-01-31T05:09:20.581860+0000","last_unstale":"2024-01-31T05:09:21.578664+0000","last_undegraded":"2024-01-31T05:09:21.578664+0000","last_fullsized":"2024-01-31T05:09:21.578664+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:46:05.891545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.292368+0000","last_change":"2024-01-31T05:09:20.587899+0000","last_active":"2024-01-31T05:09:22.292368+0000","last_peered":"2024-01-31T05:09:22.292368+0000","last_clean":"2024-01-31T05:09:22.292368+0000","last_became_active":"2024-01-31T05:09:20.587068+0000","last_became_peered":"2024-01-31T05:09:20.587068+0000","last_unstale":"2024-01-31T05:09:22.292368+0000","last_undegraded":"2024-01-31T05:09:22.292368+0000","last_fullsized":"2024-01-31T05:09:22.292368+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:59:44.747928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.292408+0000","last_change":"2024-01-31T05:09:20.590392+0000","last_active":"2024-01-31T05:09:22.292408+0000","last_peered":"2024-01-31T05:09:22.292408+0000","last_clean":"2024-01-31T05:09:22.292408+0000","last_became_active":"2024-01-31T05:09:20.590082+0000","last_became_peered":"2024-01-31T05:09:20.590082+0000","last_unstale":"2024-01-31T05:09:22.292408+0000","last_undegraded":"2024-01-31T05:09:22.292408+0000","last_fullsized":"2024-01-31T05:09:22.292408+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:59:10.672890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.584539+0000","last_change":"2024-01-31T05:09:20.584822+0000","last_active":"2024-01-31T05:09:21.584539+0000","last_peered":"2024-01-31T05:09:21.584539+0000","last_clean":"2024-01-31T05:09:21.584539+0000","last_became_active":"2024-01-31T05:09:20.584531+0000","last_became_peered":"2024-01-31T05:09:20.584531+0000","last_unstale":"2024-01-31T05:09:21.584539+0000","last_undegraded":"2024-01-31T05:09:21.584539+0000","last_fullsized":"2024-01-31T05:09:21.584539+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:35:44.793407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.057625+0000","last_change":"2024-01-31T05:09:20.582615+0000","last_active":"2024-01-31T05:09:22.057625+0000","last_peered":"2024-01-31T05:09:22.057625+0000","last_clean":"2024-01-31T05:09:22.057625+0000","last_became_active":"2024-01-31T05:09:20.581959+0000","last_became_peered":"2024-01-31T05:09:20.581959+0000","last_unstale":"2024-01-31T05:09:22.057625+0000","last_undegraded":"2024-01-31T05:09:22.057625+0000","last_fullsized":"2024-01-31T05:09:22.057625+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:29:06.817822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.055898+0000","last_change":"2024-01-31T05:09:20.582421+0000","last_active":"2024-01-31T05:09:22.055898+0000","last_peered":"2024-01-31T05:09:22.055898+0000","last_clean":"2024-01-31T05:09:22.055898+0000","last_became_active":"2024-01-31T05:09:20.582099+0000","last_became_peered":"2024-01-31T05:09:20.582099+0000","last_unstale":"2024-01-31T05:09:22.055898+0000","last_undegraded":"2024-01-31T05:09:22.055898+0000","last_fullsized":"2024-01-31T05:09:22.055898+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:08:03.802219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.579716+0000","last_change":"2024-01-31T05:09:20.580511+0000","last_active":"2024-01-31T05:09:21.579716+0000","last_peered":"2024-01-31T05:09:21.579716+0000","last_clean":"2024-01-31T05:09:21.579716+0000","last_became_active":"2024-01-31T05:09:20.579596+0000","last_became_peered":"2024-01-31T05:09:20.579596+0000","last_unstale":"2024-01-31T05:09:21.579716+0000","last_undegraded":"2024-01-31T05:09:21.579716+0000","last_fullsized":"2024-01-31T05:09:21.579716+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:07:01.206181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'9","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:25.189761+0000","last_change":"2024-01-31T05:09:20.187398+0000","last_active":"2024-01-31T05:09:25.189761+0000","last_peered":"2024-01-31T05:09:25.189761+0000","last_clean":"2024-01-31T05:09:25.189761+0000","last_became_active":"2024-01-31T05:09:20.186925+0000","last_became_peered":"2024-01-31T05:09:20.186925+0000","last_unstale":"2024-01-31T05:09:25.189761+0000","last_undegraded":"2024-01-31T05:09:25.189761+0000","last_fullsized":"2024-01-31T05:09:25.189761+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:33:34.624017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.937823+0000","last_change":"2024-01-31T05:09:20.582800+0000","last_active":"2024-01-31T05:09:21.937823+0000","last_peered":"2024-01-31T05:09:21.937823+0000","last_clean":"2024-01-31T05:09:21.937823+0000","last_became_active":"2024-01-31T05:09:20.582523+0000","last_became_peered":"2024-01-31T05:09:20.582523+0000","last_unstale":"2024-01-31T05:09:21.937823+0000","last_undegraded":"2024-01-31T05:09:21.937823+0000","last_fullsized":"2024-01-31T05:09:21.937823+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:19:57.975954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.937973+0000","last_change":"2024-01-31T05:09:20.191566+0000","last_active":"2024-01-31T05:09:21.937973+0000","last_peered":"2024-01-31T05:09:21.937973+0000","last_clean":"2024-01-31T05:09:21.937973+0000","last_became_active":"2024-01-31T05:09:20.191268+0000","last_became_peered":"2024-01-31T05:09:20.191268+0000","last_unstale":"2024-01-31T05:09:21.937973+0000","last_undegraded":"2024-01-31T05:09:21.937973+0000","last_fullsized":"2024-01-31T05:09:21.937973+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:45:40.042374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.292851+0000","last_change":"2024-01-31T05:09:20.579061+0000","last_active":"2024-01-31T05:09:22.292851+0000","last_peered":"2024-01-31T05:09:22.292851+0000","last_clean":"2024-01-31T05:09:22.292851+0000","last_became_active":"2024-01-31T05:09:20.578728+0000","last_became_peered":"2024-01-31T05:09:20.578728+0000","last_unstale":"2024-01-31T05:09:22.292851+0000","last_undegraded":"2024-01-31T05:09:22.292851+0000","last_fullsized":"2024-01-31T05:09:22.292851+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:57:12.142419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:25.189279+0000","last_change":"2024-01-31T05:09:20.187366+0000","last_active":"2024-01-31T05:09:25.189279+0000","last_peered":"2024-01-31T05:09:25.189279+0000","last_clean":"2024-01-31T05:09:25.189279+0000","last_became_active":"2024-01-31T05:09:20.186616+0000","last_became_peered":"2024-01-31T05:09:20.186616+0000","last_unstale":"2024-01-31T05:09:25.189279+0000","last_undegraded":"2024-01-31T05:09:25.189279+0000","last_fullsized":"2024-01-31T05:09:25.189279+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:39:28.802810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.584666+0000","last_change":"2024-01-31T05:09:20.590538+0000","last_active":"2024-01-31T05:09:21.584666+0000","last_peered":"2024-01-31T05:09:21.584666+0000","last_clean":"2024-01-31T05:09:21.584666+0000","last_became_active":"2024-01-31T05:09:20.590254+0000","last_became_peered":"2024-01-31T05:09:20.590254+0000","last_unstale":"2024-01-31T05:09:21.584666+0000","last_undegraded":"2024-01-31T05:09:21.584666+0000","last_fullsized":"2024-01-31T05:09:21.584666+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:06:38.209930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.057045+0000","last_change":"2024-01-31T05:09:20.183808+0000","last_active":"2024-01-31T05:09:22.057045+0000","last_peered":"2024-01-31T05:09:22.057045+0000","last_clean":"2024-01-31T05:09:22.057045+0000","last_became_active":"2024-01-31T05:09:20.183514+0000","last_became_peered":"2024-01-31T05:09:20.183514+0000","last_unstale":"2024-01-31T05:09:22.057045+0000","last_undegraded":"2024-01-31T05:09:22.057045+0000","last_fullsized":"2024-01-31T05:09:22.057045+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:32:43.392640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.057407+0000","last_change":"2024-01-31T05:09:20.590871+0000","last_active":"2024-01-31T05:09:22.057407+0000","last_peered":"2024-01-31T05:09:22.057407+0000","last_clean":"2024-01-31T05:09:22.057407+0000","last_became_active":"2024-01-31T05:09:20.588533+0000","last_became_peered":"2024-01-31T05:09:20.588533+0000","last_unstale":"2024-01-31T05:09:22.057407+0000","last_undegraded":"2024-01-31T05:09:22.057407+0000","last_fullsized":"2024-01-31T05:09:22.057407+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:44:26.772616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'5","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:24.184100+0000","last_change":"2024-01-31T05:09:20.183455+0000","last_active":"2024-01-31T05:09:24.184100+0000","last_peered":"2024-01-31T05:09:24.184100+0000","last_clean":"2024-01-31T05:09:24.184100+0000","last_became_active":"2024-01-31T05:09:20.183070+0000","last_became_peered":"2024-01-31T05:09:20.183070+0000","last_unstale":"2024-01-31T05:09:24.184100+0000","last_undegraded":"2024-01-31T05:09:24.184100+0000","last_fullsized":"2024-01-31T05:09:24.184100+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:15:29.503830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.057044+0000","last_change":"2024-01-31T05:09:20.580755+0000","last_active":"2024-01-31T05:09:22.057044+0000","last_peered":"2024-01-31T05:09:22.057044+0000","last_clean":"2024-01-31T05:09:22.057044+0000","last_became_active":"2024-01-31T05:09:20.580452+0000","last_became_peered":"2024-01-31T05:09:20.580452+0000","last_unstale":"2024-01-31T05:09:22.057044+0000","last_undegraded":"2024-01-31T05:09:22.057044+0000","last_fullsized":"2024-01-31T05:09:22.057044+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:29:08.383532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:26.196802+0000","last_change":"2024-01-31T05:09:20.182129+0000","last_active":"2024-01-31T05:09:26.196802+0000","last_peered":"2024-01-31T05:09:26.196802+0000","last_clean":"2024-01-31T05:09:26.196802+0000","last_became_active":"2024-01-31T05:09:20.181781+0000","last_became_peered":"2024-01-31T05:09:20.181781+0000","last_unstale":"2024-01-31T05:09:26.196802+0000","last_undegraded":"2024-01-31T05:09:26.196802+0000","last_fullsized":"2024-01-31T05:09:26.196802+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:05:57.854213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.057048+0000","last_change":"2024-01-31T05:09:20.591696+0000","last_active":"2024-01-31T05:09:22.057048+0000","last_peered":"2024-01-31T05:09:22.057048+0000","last_clean":"2024-01-31T05:09:22.057048+0000","last_became_active":"2024-01-31T05:09:20.591307+0000","last_became_peered":"2024-01-31T05:09:20.591307+0000","last_unstale":"2024-01-31T05:09:22.057048+0000","last_undegraded":"2024-01-31T05:09:22.057048+0000","last_fullsized":"2024-01-31T05:09:22.057048+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:59:56.884326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:25.190462+0000","last_change":"2024-01-31T05:09:20.179846+0000","last_active":"2024-01-31T05:09:25.190462+0000","last_peered":"2024-01-31T05:09:25.190462+0000","last_clean":"2024-01-31T05:09:25.190462+0000","last_became_active":"2024-01-31T05:09:20.179524+0000","last_became_peered":"2024-01-31T05:09:20.179524+0000","last_unstale":"2024-01-31T05:09:25.190462+0000","last_undegraded":"2024-01-31T05:09:25.190462+0000","last_fullsized":"2024-01-31T05:09:25.190462+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:13:51.085861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.937478+0000","last_change":"2024-01-31T05:09:20.580076+0000","last_active":"2024-01-31T05:09:21.937478+0000","last_peered":"2024-01-31T05:09:21.937478+0000","last_clean":"2024-01-31T05:09:21.937478+0000","last_became_active":"2024-01-31T05:09:20.579764+0000","last_became_peered":"2024-01-31T05:09:20.579764+0000","last_unstale":"2024-01-31T05:09:21.937478+0000","last_undegraded":"2024-01-31T05:09:21.937478+0000","last_fullsized":"2024-01-31T05:09:21.937478+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:02:13.861848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:24.183560+0000","last_change":"2024-01-31T05:09:20.183941+0000","last_active":"2024-01-31T05:09:24.183560+0000","last_peered":"2024-01-31T05:09:24.183560+0000","last_clean":"2024-01-31T05:09:24.183560+0000","last_became_active":"2024-01-31T05:09:20.183631+0000","last_became_peered":"2024-01-31T05:09:20.183631+0000","last_unstale":"2024-01-31T05:09:24.183560+0000","last_undegraded":"2024-01-31T05:09:24.183560+0000","last_fullsized":"2024-01-31T05:09:24.183560+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:31:31.419345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.055661+0000","last_change":"2024-01-31T05:09:20.589275+0000","last_active":"2024-01-31T05:09:22.055661+0000","last_peered":"2024-01-31T05:09:22.055661+0000","last_clean":"2024-01-31T05:09:22.055661+0000","last_became_active":"2024-01-31T05:09:20.588891+0000","last_became_peered":"2024-01-31T05:09:20.588891+0000","last_unstale":"2024-01-31T05:09:22.055661+0000","last_undegraded":"2024-01-31T05:09:22.055661+0000","last_fullsized":"2024-01-31T05:09:22.055661+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:30:27.665553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:27.171213+0000","last_change":"2024-01-31T05:09:20.182836+0000","last_active":"2024-01-31T05:09:27.171213+0000","last_peered":"2024-01-31T05:09:27.171213+0000","last_clean":"2024-01-31T05:09:27.171213+0000","last_became_active":"2024-01-31T05:09:20.182376+0000","last_became_peered":"2024-01-31T05:09:20.182376+0000","last_unstale":"2024-01-31T05:09:27.171213+0000","last_undegraded":"2024-01-31T05:09:27.171213+0000","last_fullsized":"2024-01-31T05:09:27.171213+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:55:52.354323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.584993+0000","last_change":"2024-01-31T05:09:20.583592+0000","last_active":"2024-01-31T05:09:21.584993+0000","last_peered":"2024-01-31T05:09:21.584993+0000","last_clean":"2024-01-31T05:09:21.584993+0000","last_became_active":"2024-01-31T05:09:20.583247+0000","last_became_peered":"2024-01-31T05:09:20.583247+0000","last_unstale":"2024-01-31T05:09:21.584993+0000","last_undegraded":"2024-01-31T05:09:21.584993+0000","last_fullsized":"2024-01-31T05:09:21.584993+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:28:04.946620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:24.183376+0000","last_change":"2024-01-31T05:09:20.188171+0000","last_active":"2024-01-31T05:09:24.183376+0000","last_peered":"2024-01-31T05:09:24.183376+0000","last_clean":"2024-01-31T05:09:24.183376+0000","last_became_active":"2024-01-31T05:09:20.187807+0000","last_became_peered":"2024-01-31T05:09:20.187807+0000","last_unstale":"2024-01-31T05:09:24.183376+0000","last_undegraded":"2024-01-31T05:09:24.183376+0000","last_fullsized":"2024-01-31T05:09:24.183376+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:53:22.765389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.292859+0000","last_change":"2024-01-31T05:09:20.589462+0000","last_active":"2024-01-31T05:09:22.292859+0000","last_peered":"2024-01-31T05:09:22.292859+0000","last_clean":"2024-01-31T05:09:22.292859+0000","last_became_active":"2024-01-31T05:09:20.589002+0000","last_became_peered":"2024-01-31T05:09:20.589002+0000","last_unstale":"2024-01-31T05:09:22.292859+0000","last_undegraded":"2024-01-31T05:09:22.292859+0000","last_fullsized":"2024-01-31T05:09:22.292859+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:41:35.918827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:24.182402+0000","last_change":"2024-01-31T05:09:20.184963+0000","last_active":"2024-01-31T05:09:24.182402+0000","last_peered":"2024-01-31T05:09:24.182402+0000","last_clean":"2024-01-31T05:09:24.182402+0000","last_became_active":"2024-01-31T05:09:20.184590+0000","last_became_peered":"2024-01-31T05:09:20.184590+0000","last_unstale":"2024-01-31T05:09:24.182402+0000","last_undegraded":"2024-01-31T05:09:24.182402+0000","last_fullsized":"2024-01-31T05:09:24.182402+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:06:31.291846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.584837+0000","last_change":"2024-01-31T05:09:20.589237+0000","last_active":"2024-01-31T05:09:21.584837+0000","last_peered":"2024-01-31T05:09:21.584837+0000","last_clean":"2024-01-31T05:09:21.584837+0000","last_became_active":"2024-01-31T05:09:20.588656+0000","last_became_peered":"2024-01-31T05:09:20.588656+0000","last_unstale":"2024-01-31T05:09:21.584837+0000","last_undegraded":"2024-01-31T05:09:21.584837+0000","last_fullsized":"2024-01-31T05:09:21.584837+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:02:02.025136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'17","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:27.535093+0000","last_change":"2024-01-31T05:09:20.182539+0000","last_active":"2024-01-31T05:09:27.535093+0000","last_peered":"2024-01-31T05:09:27.535093+0000","last_clean":"2024-01-31T05:09:27.535093+0000","last_became_active":"2024-01-31T05:09:20.182229+0000","last_became_peered":"2024-01-31T05:09:20.182229+0000","last_unstale":"2024-01-31T05:09:27.535093+0000","last_undegraded":"2024-01-31T05:09:27.535093+0000","last_fullsized":"2024-01-31T05:09:27.535093+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:56:21.974450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20894,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":19,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.056567+0000","last_change":"2024-01-31T05:09:20.587838+0000","last_active":"2024-01-31T05:09:22.056567+0000","last_peered":"2024-01-31T05:09:22.056567+0000","last_clean":"2024-01-31T05:09:22.056567+0000","last_became_active":"2024-01-31T05:09:20.587523+0000","last_became_peered":"2024-01-31T05:09:20.587523+0000","last_unstale":"2024-01-31T05:09:22.056567+0000","last_undegraded":"2024-01-31T05:09:22.056567+0000","last_fullsized":"2024-01-31T05:09:22.056567+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:36:17.582890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'7","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:25.189426+0000","last_change":"2024-01-31T05:09:20.191935+0000","last_active":"2024-01-31T05:09:25.189426+0000","last_peered":"2024-01-31T05:09:25.189426+0000","last_clean":"2024-01-31T05:09:25.189426+0000","last_became_active":"2024-01-31T05:09:20.191614+0000","last_became_peered":"2024-01-31T05:09:20.191614+0000","last_unstale":"2024-01-31T05:09:25.189426+0000","last_undegraded":"2024-01-31T05:09:25.189426+0000","last_fullsized":"2024-01-31T05:09:25.189426+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:12:38.245944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.578556+0000","last_change":"2024-01-31T05:09:20.585705+0000","last_active":"2024-01-31T05:09:21.578556+0000","last_peered":"2024-01-31T05:09:21.578556+0000","last_clean":"2024-01-31T05:09:21.578556+0000","last_became_active":"2024-01-31T05:09:20.585413+0000","last_became_peered":"2024-01-31T05:09:20.585413+0000","last_unstale":"2024-01-31T05:09:21.578556+0000","last_undegraded":"2024-01-31T05:09:21.578556+0000","last_fullsized":"2024-01-31T05:09:21.578556+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:35:34.686300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:24.184250+0000","last_change":"2024-01-31T05:09:20.191975+0000","last_active":"2024-01-31T05:09:24.184250+0000","last_peered":"2024-01-31T05:09:24.184250+0000","last_clean":"2024-01-31T05:09:24.184250+0000","last_became_active":"2024-01-31T05:09:20.191666+0000","last_became_peered":"2024-01-31T05:09:20.191666+0000","last_unstale":"2024-01-31T05:09:24.184250+0000","last_undegraded":"2024-01-31T05:09:24.184250+0000","last_fullsized":"2024-01-31T05:09:24.184250+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:00:01.162509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.055939+0000","last_change":"2024-01-31T05:09:20.588737+0000","last_active":"2024-01-31T05:09:22.055939+0000","last_peered":"2024-01-31T05:09:22.055939+0000","last_clean":"2024-01-31T05:09:22.055939+0000","last_became_active":"2024-01-31T05:09:20.588434+0000","last_became_peered":"2024-01-31T05:09:20.588434+0000","last_unstale":"2024-01-31T05:09:22.055939+0000","last_undegraded":"2024-01-31T05:09:22.055939+0000","last_fullsized":"2024-01-31T05:09:22.055939+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:35:24.618246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'6","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:27.173918+0000","last_change":"2024-01-31T05:09:20.183752+0000","last_active":"2024-01-31T05:09:27.173918+0000","last_peered":"2024-01-31T05:09:27.173918+0000","last_clean":"2024-01-31T05:09:27.173918+0000","last_became_active":"2024-01-31T05:09:20.183421+0000","last_became_peered":"2024-01-31T05:09:20.183421+0000","last_unstale":"2024-01-31T05:09:27.173918+0000","last_undegraded":"2024-01-31T05:09:27.173918+0000","last_fullsized":"2024-01-31T05:09:27.173918+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:04:12.919266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.055585+0000","last_change":"2024-01-31T05:09:20.593893+0000","last_active":"2024-01-31T05:09:22.055585+0000","last_peered":"2024-01-31T05:09:22.055585+0000","last_clean":"2024-01-31T05:09:22.055585+0000","last_became_active":"2024-01-31T05:09:20.593604+0000","last_became_peered":"2024-01-31T05:09:20.593604+0000","last_unstale":"2024-01-31T05:09:22.055585+0000","last_undegraded":"2024-01-31T05:09:22.055585+0000","last_fullsized":"2024-01-31T05:09:22.055585+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:50:31.534607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'15","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:25.190457+0000","last_change":"2024-01-31T05:09:20.187006+0000","last_active":"2024-01-31T05:09:25.190457+0000","last_peered":"2024-01-31T05:09:25.190457+0000","last_clean":"2024-01-31T05:09:25.190457+0000","last_became_active":"2024-01-31T05:09:20.186233+0000","last_became_peered":"2024-01-31T05:09:20.186233+0000","last_unstale":"2024-01-31T05:09:25.190457+0000","last_undegraded":"2024-01-31T05:09:25.190457+0000","last_fullsized":"2024-01-31T05:09:25.190457+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:50:47.722060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.057087+0000","last_change":"2024-01-31T05:09:20.588049+0000","last_active":"2024-01-31T05:09:22.057087+0000","last_peered":"2024-01-31T05:09:22.057087+0000","last_clean":"2024-01-31T05:09:22.057087+0000","last_became_active":"2024-01-31T05:09:20.587542+0000","last_became_peered":"2024-01-31T05:09:20.587542+0000","last_unstale":"2024-01-31T05:09:22.057087+0000","last_undegraded":"2024-01-31T05:09:22.057087+0000","last_fullsized":"2024-01-31T05:09:22.057087+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:19:55.948269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.056450+0000","last_change":"2024-01-31T05:09:20.185328+0000","last_active":"2024-01-31T05:09:22.056450+0000","last_peered":"2024-01-31T05:09:22.056450+0000","last_clean":"2024-01-31T05:09:22.056450+0000","last_became_active":"2024-01-31T05:09:20.184551+0000","last_became_peered":"2024-01-31T05:09:20.184551+0000","last_unstale":"2024-01-31T05:09:22.056450+0000","last_undegraded":"2024-01-31T05:09:22.056450+0000","last_fullsized":"2024-01-31T05:09:22.056450+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:19:36.143101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.056741+0000","last_change":"2024-01-31T05:09:20.586286+0000","last_active":"2024-01-31T05:09:22.056741+0000","last_peered":"2024-01-31T05:09:22.056741+0000","last_clean":"2024-01-31T05:09:22.056741+0000","last_became_active":"2024-01-31T05:09:20.586011+0000","last_became_peered":"2024-01-31T05:09:20.586011+0000","last_unstale":"2024-01-31T05:09:22.056741+0000","last_undegraded":"2024-01-31T05:09:22.056741+0000","last_fullsized":"2024-01-31T05:09:22.056741+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:21:23.064829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.055779+0000","last_change":"2024-01-31T05:09:20.183083+0000","last_active":"2024-01-31T05:09:22.055779+0000","last_peered":"2024-01-31T05:09:22.055779+0000","last_clean":"2024-01-31T05:09:22.055779+0000","last_became_active":"2024-01-31T05:09:20.182742+0000","last_became_peered":"2024-01-31T05:09:20.182742+0000","last_unstale":"2024-01-31T05:09:22.055779+0000","last_undegraded":"2024-01-31T05:09:22.055779+0000","last_fullsized":"2024-01-31T05:09:22.055779+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:12:02.081688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'1","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.945596+0000","last_change":"2024-01-31T05:09:20.591522+0000","last_active":"2024-01-31T05:09:22.945596+0000","last_peered":"2024-01-31T05:09:22.945596+0000","last_clean":"2024-01-31T05:09:22.945596+0000","last_became_active":"2024-01-31T05:09:20.591224+0000","last_became_peered":"2024-01-31T05:09:20.591224+0000","last_unstale":"2024-01-31T05:09:22.945596+0000","last_undegraded":"2024-01-31T05:09:22.945596+0000","last_fullsized":"2024-01-31T05:09:22.945596+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:24:17.153662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.055810+0000","last_change":"2024-01-31T05:09:20.186176+0000","last_active":"2024-01-31T05:09:22.055810+0000","last_peered":"2024-01-31T05:09:22.055810+0000","last_clean":"2024-01-31T05:09:22.055810+0000","last_became_active":"2024-01-31T05:09:20.185873+0000","last_became_peered":"2024-01-31T05:09:20.185873+0000","last_unstale":"2024-01-31T05:09:22.055810+0000","last_undegraded":"2024-01-31T05:09:22.055810+0000","last_fullsized":"2024-01-31T05:09:22.055810+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:55:12.689664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.582732+0000","last_change":"2024-01-31T05:09:20.587556+0000","last_active":"2024-01-31T05:09:21.582732+0000","last_peered":"2024-01-31T05:09:21.582732+0000","last_clean":"2024-01-31T05:09:21.582732+0000","last_became_active":"2024-01-31T05:09:20.587275+0000","last_became_peered":"2024-01-31T05:09:20.587275+0000","last_unstale":"2024-01-31T05:09:21.582732+0000","last_undegraded":"2024-01-31T05:09:21.582732+0000","last_fullsized":"2024-01-31T05:09:21.582732+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:35:16.022422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.056065+0000","last_change":"2024-01-31T05:09:20.588044+0000","last_active":"2024-01-31T05:09:22.056065+0000","last_peered":"2024-01-31T05:09:22.056065+0000","last_clean":"2024-01-31T05:09:22.056065+0000","last_became_active":"2024-01-31T05:09:20.587526+0000","last_became_peered":"2024-01-31T05:09:20.587526+0000","last_unstale":"2024-01-31T05:09:22.056065+0000","last_undegraded":"2024-01-31T05:09:22.056065+0000","last_fullsized":"2024-01-31T05:09:22.056065+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:49:07.270009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:25.189799+0000","last_change":"2024-01-31T05:09:20.194791+0000","last_active":"2024-01-31T05:09:25.189799+0000","last_peered":"2024-01-31T05:09:25.189799+0000","last_clean":"2024-01-31T05:09:25.189799+0000","last_became_active":"2024-01-31T05:09:20.194454+0000","last_became_peered":"2024-01-31T05:09:20.194454+0000","last_unstale":"2024-01-31T05:09:25.189799+0000","last_undegraded":"2024-01-31T05:09:25.189799+0000","last_fullsized":"2024-01-31T05:09:25.189799+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:31:26.809960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.937801+0000","last_change":"2024-01-31T05:09:20.585022+0000","last_active":"2024-01-31T05:09:21.937801+0000","last_peered":"2024-01-31T05:09:21.937801+0000","last_clean":"2024-01-31T05:09:21.937801+0000","last_became_active":"2024-01-31T05:09:20.584709+0000","last_became_peered":"2024-01-31T05:09:20.584709+0000","last_unstale":"2024-01-31T05:09:21.937801+0000","last_undegraded":"2024-01-31T05:09:21.937801+0000","last_fullsized":"2024-01-31T05:09:21.937801+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:10:45.616985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:27.169803+0000","last_change":"2024-01-31T05:09:20.183779+0000","last_active":"2024-01-31T05:09:27.169803+0000","last_peered":"2024-01-31T05:09:27.169803+0000","last_clean":"2024-01-31T05:09:27.169803+0000","last_became_active":"2024-01-31T05:09:20.183399+0000","last_became_peered":"2024-01-31T05:09:20.183399+0000","last_unstale":"2024-01-31T05:09:27.169803+0000","last_undegraded":"2024-01-31T05:09:27.169803+0000","last_fullsized":"2024-01-31T05:09:27.169803+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:48:43.831022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":341,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.055577+0000","last_change":"2024-01-31T05:08:10.168270+0000","last_active":"2024-01-31T05:09:22.055577+0000","last_peered":"2024-01-31T05:09:22.055577+0000","last_clean":"2024-01-31T05:09:22.055577+0000","last_became_active":"2024-01-31T05:08:10.167743+0000","last_became_peered":"2024-01-31T05:08:10.167743+0000","last_unstale":"2024-01-31T05:09:22.055577+0000","last_undegraded":"2024-01-31T05:09:22.055577+0000","last_fullsized":"2024-01-31T05:09:22.055577+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:46.976985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:46.976985+0000","last_clean_scrub_stamp":"2024-01-31T05:04:46.976985+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:21:54.724227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.578349+0000","last_change":"2024-01-31T05:09:20.583135+0000","last_active":"2024-01-31T05:09:21.578349+0000","last_peered":"2024-01-31T05:09:21.578349+0000","last_clean":"2024-01-31T05:09:21.578349+0000","last_became_active":"2024-01-31T05:09:20.582850+0000","last_became_peered":"2024-01-31T05:09:20.582850+0000","last_unstale":"2024-01-31T05:09:21.578349+0000","last_undegraded":"2024-01-31T05:09:21.578349+0000","last_fullsized":"2024-01-31T05:09:21.578349+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:04:51.204561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'3","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:25.188608+0000","last_change":"2024-01-31T05:09:20.188181+0000","last_active":"2024-01-31T05:09:25.188608+0000","last_peered":"2024-01-31T05:09:25.188608+0000","last_clean":"2024-01-31T05:09:25.188608+0000","last_became_active":"2024-01-31T05:09:20.187801+0000","last_became_peered":"2024-01-31T05:09:20.187801+0000","last_unstale":"2024-01-31T05:09:25.188608+0000","last_undegraded":"2024-01-31T05:09:25.188608+0000","last_fullsized":"2024-01-31T05:09:25.188608+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:27:05.269615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.056718+0000","last_change":"2024-01-31T05:09:20.186242+0000","last_active":"2024-01-31T05:09:22.056718+0000","last_peered":"2024-01-31T05:09:22.056718+0000","last_clean":"2024-01-31T05:09:22.056718+0000","last_became_active":"2024-01-31T05:09:20.185908+0000","last_became_peered":"2024-01-31T05:09:20.185908+0000","last_unstale":"2024-01-31T05:09:22.056718+0000","last_undegraded":"2024-01-31T05:09:22.056718+0000","last_fullsized":"2024-01-31T05:09:22.056718+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:33:40.859324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.578748+0000","last_change":"2024-01-31T05:09:20.590896+0000","last_active":"2024-01-31T05:09:21.578748+0000","last_peered":"2024-01-31T05:09:21.578748+0000","last_clean":"2024-01-31T05:09:21.578748+0000","last_became_active":"2024-01-31T05:09:20.590546+0000","last_became_peered":"2024-01-31T05:09:20.590546+0000","last_unstale":"2024-01-31T05:09:21.578748+0000","last_undegraded":"2024-01-31T05:09:21.578748+0000","last_fullsized":"2024-01-31T05:09:21.578748+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:39:05.969756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'3","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:25.189194+0000","last_change":"2024-01-31T05:09:20.185811+0000","last_active":"2024-01-31T05:09:25.189194+0000","last_peered":"2024-01-31T05:09:25.189194+0000","last_clean":"2024-01-31T05:09:25.189194+0000","last_became_active":"2024-01-31T05:09:20.185490+0000","last_became_peered":"2024-01-31T05:09:20.185490+0000","last_unstale":"2024-01-31T05:09:25.189194+0000","last_undegraded":"2024-01-31T05:09:25.189194+0000","last_fullsized":"2024-01-31T05:09:25.189194+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:16:25.446046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.937860+0000","last_change":"2024-01-31T05:09:20.585298+0000","last_active":"2024-01-31T05:09:21.937860+0000","last_peered":"2024-01-31T05:09:21.937860+0000","last_clean":"2024-01-31T05:09:21.937860+0000","last_became_active":"2024-01-31T05:09:20.584256+0000","last_became_peered":"2024-01-31T05:09:20.584256+0000","last_unstale":"2024-01-31T05:09:21.937860+0000","last_undegraded":"2024-01-31T05:09:21.937860+0000","last_fullsized":"2024-01-31T05:09:21.937860+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:48:10.331714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:27.177856+0000","last_change":"2024-01-31T05:09:20.184960+0000","last_active":"2024-01-31T05:09:27.177856+0000","last_peered":"2024-01-31T05:09:27.177856+0000","last_clean":"2024-01-31T05:09:27.177856+0000","last_became_active":"2024-01-31T05:09:20.184599+0000","last_became_peered":"2024-01-31T05:09:20.184599+0000","last_unstale":"2024-01-31T05:09:27.177856+0000","last_undegraded":"2024-01-31T05:09:27.177856+0000","last_fullsized":"2024-01-31T05:09:27.177856+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:07:01.846976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.292723+0000","last_change":"2024-01-31T05:09:20.588597+0000","last_active":"2024-01-31T05:09:22.292723+0000","last_peered":"2024-01-31T05:09:22.292723+0000","last_clean":"2024-01-31T05:09:22.292723+0000","last_became_active":"2024-01-31T05:09:20.588326+0000","last_became_peered":"2024-01-31T05:09:20.588326+0000","last_unstale":"2024-01-31T05:09:22.292723+0000","last_undegraded":"2024-01-31T05:09:22.292723+0000","last_fullsized":"2024-01-31T05:09:22.292723+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:31:53.873261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:24.182841+0000","last_change":"2024-01-31T05:09:20.186196+0000","last_active":"2024-01-31T05:09:24.182841+0000","last_peered":"2024-01-31T05:09:24.182841+0000","last_clean":"2024-01-31T05:09:24.182841+0000","last_became_active":"2024-01-31T05:09:20.185373+0000","last_became_peered":"2024-01-31T05:09:20.185373+0000","last_unstale":"2024-01-31T05:09:24.182841+0000","last_undegraded":"2024-01-31T05:09:24.182841+0000","last_fullsized":"2024-01-31T05:09:24.182841+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:13:07.826906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.055924+0000","last_change":"2024-01-31T05:09:20.589183+0000","last_active":"2024-01-31T05:09:22.055924+0000","last_peered":"2024-01-31T05:09:22.055924+0000","last_clean":"2024-01-31T05:09:22.055924+0000","last_became_active":"2024-01-31T05:09:20.588884+0000","last_became_peered":"2024-01-31T05:09:20.588884+0000","last_unstale":"2024-01-31T05:09:22.055924+0000","last_undegraded":"2024-01-31T05:09:22.055924+0000","last_fullsized":"2024-01-31T05:09:22.055924+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:23:49.878076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'5","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:26.196704+0000","last_change":"2024-01-31T05:09:20.184849+0000","last_active":"2024-01-31T05:09:26.196704+0000","last_peered":"2024-01-31T05:09:26.196704+0000","last_clean":"2024-01-31T05:09:26.196704+0000","last_became_active":"2024-01-31T05:09:20.184491+0000","last_became_peered":"2024-01-31T05:09:20.184491+0000","last_unstale":"2024-01-31T05:09:26.196704+0000","last_undegraded":"2024-01-31T05:09:26.196704+0000","last_fullsized":"2024-01-31T05:09:26.196704+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:36:31.757646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.057381+0000","last_change":"2024-01-31T05:09:20.585917+0000","last_active":"2024-01-31T05:09:22.057381+0000","last_peered":"2024-01-31T05:09:22.057381+0000","last_clean":"2024-01-31T05:09:22.057381+0000","last_became_active":"2024-01-31T05:09:20.585082+0000","last_became_peered":"2024-01-31T05:09:20.585082+0000","last_unstale":"2024-01-31T05:09:22.057381+0000","last_undegraded":"2024-01-31T05:09:22.057381+0000","last_fullsized":"2024-01-31T05:09:22.057381+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:30:17.670739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.989744+0000","last_change":"2024-01-31T05:09:20.192050+0000","last_active":"2024-01-31T05:09:21.989744+0000","last_peered":"2024-01-31T05:09:21.989744+0000","last_clean":"2024-01-31T05:09:21.989744+0000","last_became_active":"2024-01-31T05:09:20.191662+0000","last_became_peered":"2024-01-31T05:09:20.191662+0000","last_unstale":"2024-01-31T05:09:21.989744+0000","last_undegraded":"2024-01-31T05:09:21.989744+0000","last_fullsized":"2024-01-31T05:09:21.989744+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:30:05.575409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.937934+0000","last_change":"2024-01-31T05:09:20.580332+0000","last_active":"2024-01-31T05:09:21.937934+0000","last_peered":"2024-01-31T05:09:21.937934+0000","last_clean":"2024-01-31T05:09:21.937934+0000","last_became_active":"2024-01-31T05:09:20.580014+0000","last_became_peered":"2024-01-31T05:09:20.580014+0000","last_unstale":"2024-01-31T05:09:21.937934+0000","last_undegraded":"2024-01-31T05:09:21.937934+0000","last_fullsized":"2024-01-31T05:09:21.937934+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:38:52.507575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:24.183405+0000","last_change":"2024-01-31T05:09:20.186065+0000","last_active":"2024-01-31T05:09:24.183405+0000","last_peered":"2024-01-31T05:09:24.183405+0000","last_clean":"2024-01-31T05:09:24.183405+0000","last_became_active":"2024-01-31T05:09:20.185798+0000","last_became_peered":"2024-01-31T05:09:20.185798+0000","last_unstale":"2024-01-31T05:09:24.183405+0000","last_undegraded":"2024-01-31T05:09:24.183405+0000","last_fullsized":"2024-01-31T05:09:24.183405+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:25:05.792886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.055901+0000","last_change":"2024-01-31T05:09:20.589746+0000","last_active":"2024-01-31T05:09:22.055901+0000","last_peered":"2024-01-31T05:09:22.055901+0000","last_clean":"2024-01-31T05:09:22.055901+0000","last_became_active":"2024-01-31T05:09:20.589452+0000","last_became_peered":"2024-01-31T05:09:20.589452+0000","last_unstale":"2024-01-31T05:09:22.055901+0000","last_undegraded":"2024-01-31T05:09:22.055901+0000","last_fullsized":"2024-01-31T05:09:22.055901+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:04:39.773280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'5","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:26.195304+0000","last_change":"2024-01-31T05:09:20.181920+0000","last_active":"2024-01-31T05:09:26.195304+0000","last_peered":"2024-01-31T05:09:26.195304+0000","last_clean":"2024-01-31T05:09:26.195304+0000","last_became_active":"2024-01-31T05:09:20.181603+0000","last_became_peered":"2024-01-31T05:09:20.181603+0000","last_unstale":"2024-01-31T05:09:26.195304+0000","last_undegraded":"2024-01-31T05:09:26.195304+0000","last_fullsized":"2024-01-31T05:09:26.195304+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:11:30.696322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.056186+0000","last_change":"2024-01-31T05:09:20.592244+0000","last_active":"2024-01-31T05:09:22.056186+0000","last_peered":"2024-01-31T05:09:22.056186+0000","last_clean":"2024-01-31T05:09:22.056186+0000","last_became_active":"2024-01-31T05:09:20.591940+0000","last_became_peered":"2024-01-31T05:09:20.591940+0000","last_unstale":"2024-01-31T05:09:22.056186+0000","last_undegraded":"2024-01-31T05:09:22.056186+0000","last_fullsized":"2024-01-31T05:09:22.056186+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:16:02.284216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.057367+0000","last_change":"2024-01-31T05:09:20.192018+0000","last_active":"2024-01-31T05:09:22.057367+0000","last_peered":"2024-01-31T05:09:22.057367+0000","last_clean":"2024-01-31T05:09:22.057367+0000","last_became_active":"2024-01-31T05:09:20.191721+0000","last_became_peered":"2024-01-31T05:09:20.191721+0000","last_unstale":"2024-01-31T05:09:22.057367+0000","last_undegraded":"2024-01-31T05:09:22.057367+0000","last_fullsized":"2024-01-31T05:09:22.057367+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:53:56.199730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.055990+0000","last_change":"2024-01-31T05:09:20.593153+0000","last_active":"2024-01-31T05:09:22.055990+0000","last_peered":"2024-01-31T05:09:22.055990+0000","last_clean":"2024-01-31T05:09:22.055990+0000","last_became_active":"2024-01-31T05:09:20.592869+0000","last_became_peered":"2024-01-31T05:09:20.592869+0000","last_unstale":"2024-01-31T05:09:22.055990+0000","last_undegraded":"2024-01-31T05:09:22.055990+0000","last_fullsized":"2024-01-31T05:09:22.055990+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:35:42.234519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'3","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.798809+0000","last_change":"2024-01-31T05:09:20.191998+0000","last_active":"2024-01-31T05:09:21.798809+0000","last_peered":"2024-01-31T05:09:21.798809+0000","last_clean":"2024-01-31T05:09:21.798809+0000","last_became_active":"2024-01-31T05:09:20.191658+0000","last_became_peered":"2024-01-31T05:09:20.191658+0000","last_unstale":"2024-01-31T05:09:21.798809+0000","last_undegraded":"2024-01-31T05:09:21.798809+0000","last_fullsized":"2024-01-31T05:09:21.798809+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T17:06:39.916765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.056311+0000","last_change":"2024-01-31T05:09:20.586822+0000","last_active":"2024-01-31T05:09:22.056311+0000","last_peered":"2024-01-31T05:09:22.056311+0000","last_clean":"2024-01-31T05:09:22.056311+0000","last_became_active":"2024-01-31T05:09:20.586523+0000","last_became_peered":"2024-01-31T05:09:20.586523+0000","last_unstale":"2024-01-31T05:09:22.056311+0000","last_undegraded":"2024-01-31T05:09:22.056311+0000","last_fullsized":"2024-01-31T05:09:22.056311+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:02:59.311443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.057527+0000","last_change":"2024-01-31T05:09:20.586141+0000","last_active":"2024-01-31T05:09:22.057527+0000","last_peered":"2024-01-31T05:09:22.057527+0000","last_clean":"2024-01-31T05:09:22.057527+0000","last_became_active":"2024-01-31T05:09:20.585626+0000","last_became_peered":"2024-01-31T05:09:20.585626+0000","last_unstale":"2024-01-31T05:09:22.057527+0000","last_undegraded":"2024-01-31T05:09:22.057527+0000","last_fullsized":"2024-01-31T05:09:22.057527+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:39:18.023044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.579542+0000","last_change":"2024-01-31T05:09:20.588203+0000","last_active":"2024-01-31T05:09:21.579542+0000","last_peered":"2024-01-31T05:09:21.579542+0000","last_clean":"2024-01-31T05:09:21.579542+0000","last_became_active":"2024-01-31T05:09:20.586660+0000","last_became_peered":"2024-01-31T05:09:20.586660+0000","last_unstale":"2024-01-31T05:09:21.579542+0000","last_undegraded":"2024-01-31T05:09:21.579542+0000","last_fullsized":"2024-01-31T05:09:21.579542+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:27:41.249756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.579751+0000","last_change":"2024-01-31T05:09:20.591708+0000","last_active":"2024-01-31T05:09:21.579751+0000","last_peered":"2024-01-31T05:09:21.579751+0000","last_clean":"2024-01-31T05:09:21.579751+0000","last_became_active":"2024-01-31T05:09:20.590874+0000","last_became_peered":"2024-01-31T05:09:20.590874+0000","last_unstale":"2024-01-31T05:09:21.579751+0000","last_undegraded":"2024-01-31T05:09:21.579751+0000","last_fullsized":"2024-01-31T05:09:21.579751+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:13:30.221125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.292658+0000","last_change":"2024-01-31T05:09:20.587566+0000","last_active":"2024-01-31T05:09:22.292658+0000","last_peered":"2024-01-31T05:09:22.292658+0000","last_clean":"2024-01-31T05:09:22.292658+0000","last_became_active":"2024-01-31T05:09:20.587260+0000","last_became_peered":"2024-01-31T05:09:20.587260+0000","last_unstale":"2024-01-31T05:09:22.292658+0000","last_undegraded":"2024-01-31T05:09:22.292658+0000","last_fullsized":"2024-01-31T05:09:22.292658+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:32:46.030539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.578699+0000","last_change":"2024-01-31T05:09:20.587259+0000","last_active":"2024-01-31T05:09:21.578699+0000","last_peered":"2024-01-31T05:09:21.578699+0000","last_clean":"2024-01-31T05:09:21.578699+0000","last_became_active":"2024-01-31T05:09:20.586935+0000","last_became_peered":"2024-01-31T05:09:20.586935+0000","last_unstale":"2024-01-31T05:09:21.578699+0000","last_undegraded":"2024-01-31T05:09:21.578699+0000","last_fullsized":"2024-01-31T05:09:21.578699+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:28:23.217392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.057174+0000","last_change":"2024-01-31T05:09:20.587213+0000","last_active":"2024-01-31T05:09:22.057174+0000","last_peered":"2024-01-31T05:09:22.057174+0000","last_clean":"2024-01-31T05:09:22.057174+0000","last_became_active":"2024-01-31T05:09:20.586918+0000","last_became_peered":"2024-01-31T05:09:20.586918+0000","last_unstale":"2024-01-31T05:09:22.057174+0000","last_undegraded":"2024-01-31T05:09:22.057174+0000","last_fullsized":"2024-01-31T05:09:22.057174+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:39:27.541560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.579825+0000","last_change":"2024-01-31T05:09:20.584532+0000","last_active":"2024-01-31T05:09:21.579825+0000","last_peered":"2024-01-31T05:09:21.579825+0000","last_clean":"2024-01-31T05:09:21.579825+0000","last_became_active":"2024-01-31T05:09:20.583512+0000","last_became_peered":"2024-01-31T05:09:20.583512+0000","last_unstale":"2024-01-31T05:09:21.579825+0000","last_undegraded":"2024-01-31T05:09:21.579825+0000","last_fullsized":"2024-01-31T05:09:21.579825+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:04:33.848498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.937932+0000","last_change":"2024-01-31T05:09:20.587561+0000","last_active":"2024-01-31T05:09:21.937932+0000","last_peered":"2024-01-31T05:09:21.937932+0000","last_clean":"2024-01-31T05:09:21.937932+0000","last_became_active":"2024-01-31T05:09:20.587232+0000","last_became_peered":"2024-01-31T05:09:20.587232+0000","last_unstale":"2024-01-31T05:09:21.937932+0000","last_undegraded":"2024-01-31T05:09:21.937932+0000","last_fullsized":"2024-01-31T05:09:21.937932+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:17:01.913186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.056046+0000","last_change":"2024-01-31T05:09:20.581823+0000","last_active":"2024-01-31T05:09:22.056046+0000","last_peered":"2024-01-31T05:09:22.056046+0000","last_clean":"2024-01-31T05:09:22.056046+0000","last_became_active":"2024-01-31T05:09:20.581560+0000","last_became_peered":"2024-01-31T05:09:20.581560+0000","last_unstale":"2024-01-31T05:09:22.056046+0000","last_undegraded":"2024-01-31T05:09:22.056046+0000","last_fullsized":"2024-01-31T05:09:22.056046+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:48:50.057303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.937598+0000","last_change":"2024-01-31T05:09:20.582477+0000","last_active":"2024-01-31T05:09:21.937598+0000","last_peered":"2024-01-31T05:09:21.937598+0000","last_clean":"2024-01-31T05:09:21.937598+0000","last_became_active":"2024-01-31T05:09:20.582051+0000","last_became_peered":"2024-01-31T05:09:20.582051+0000","last_unstale":"2024-01-31T05:09:21.937598+0000","last_undegraded":"2024-01-31T05:09:21.937598+0000","last_fullsized":"2024-01-31T05:09:21.937598+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:24:36.665707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.584755+0000","last_change":"2024-01-31T05:09:20.587281+0000","last_active":"2024-01-31T05:09:21.584755+0000","last_peered":"2024-01-31T05:09:21.584755+0000","last_clean":"2024-01-31T05:09:21.584755+0000","last_became_active":"2024-01-31T05:09:20.586976+0000","last_became_peered":"2024-01-31T05:09:20.586976+0000","last_unstale":"2024-01-31T05:09:21.584755+0000","last_undegraded":"2024-01-31T05:09:21.584755+0000","last_fullsized":"2024-01-31T05:09:21.584755+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:33:59.065647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:21.578714+0000","last_change":"2024-01-31T05:09:20.585953+0000","last_active":"2024-01-31T05:09:21.578714+0000","last_peered":"2024-01-31T05:09:21.578714+0000","last_clean":"2024-01-31T05:09:21.578714+0000","last_became_active":"2024-01-31T05:09:20.585406+0000","last_became_peered":"2024-01-31T05:09:20.585406+0000","last_unstale":"2024-01-31T05:09:21.578714+0000","last_undegraded":"2024-01-31T05:09:21.578714+0000","last_fullsized":"2024-01-31T05:09:21.578714+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:14:24.622166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-01-31T05:09:22.056496+0000","last_change":"2024-01-31T05:09:20.587073+0000","last_active":"2024-01-31T05:09:22.056496+0000","last_peered":"2024-01-31T05:09:22.056496+0000","last_clean":"2024-01-31T05:09:22.056496+0000","last_became_active":"2024-01-31T05:09:20.586753+0000","last_became_peered":"2024-01-31T05:09:20.586753+0000","last_unstale":"2024-01-31T05:09:22.056496+0000","last_undegraded":"2024-01-31T05:09:22.056496+0000","last_fullsized":"2024-01-31T05:09:22.056496+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:13:20.291390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":26334,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":161,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":360448,"data_stored":48195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892350990,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":929792,"data_stored":445558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0469999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]}]},{"osd":10,"up_from":73,"seq":313532612628,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36872,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708280,"statfs":{"total":95995035648,"available":95957278720,"internally_reserved":0,"allocated":1572864,"data_stored":1038658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":36174273},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":1,"last update":"Wed Jan 31 05:09:09 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.378},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.40200000000000002}]},{"osd":2,"last update":"Wed Jan 31 05:09:09 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.74299999999999999}]},{"osd":3,"last update":"Wed Jan 31 05:09:09 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.46400000000000002}]},{"osd":4,"last update":"Wed Jan 31 05:09:09 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.52800000000000002}]},{"osd":5,"last update":"Wed Jan 31 05:09:09 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.68000000000000005}]},{"osd":6,"last update":"Wed Jan 31 05:09:09 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.495},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.54300000000000004}]},{"osd":7,"last update":"Wed Jan 31 05:09:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.57199999999999995}]},{"osd":8,"last update":"Wed Jan 31 05:09:09 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.71299999999999997}]},{"osd":9,"last update":"Wed Jan 31 05:09:09 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.60799999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]}]},{"osd":9,"up_from":67,"seq":287762808856,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":445794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:08:44 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.41899999999999998}]},{"osd":1,"last update":"Wed Jan 31 05:08:44 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.40300000000000002}]},{"osd":2,"last update":"Wed Jan 31 05:08:44 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.44600000000000001}]},{"osd":3,"last update":"Wed Jan 31 05:08:44 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.34699999999999998}]},{"osd":4,"last update":"Wed Jan 31 05:08:44 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.68999999999999995}]},{"osd":5,"last update":"Wed Jan 31 05:08:44 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.61199999999999999}]},{"osd":6,"last update":"Wed Jan 31 05:08:44 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.503},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.48299999999999998}]},{"osd":7,"last update":"Wed Jan 31 05:08:44 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1,"5min":1,"15min":1},"last":0.65800000000000003}]},{"osd":8,"last update":"Wed Jan 31 05:08:44 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.58699999999999997}]},{"osd":10,"last update":"Wed Jan 31 05:09:10 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.627},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.63600000000000001}]}]},{"osd":8,"up_from":59,"seq":253403070493,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":937984,"data_stored":445602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:09:17 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.57099999999999995,"15min":0.57599999999999996},"min":{"1min":0.39400000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.57299999999999995,"15min":0.58499999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.72499999999999998,"5min":0.877,"15min":0.877},"last":0.65700000000000003}]},{"osd":1,"last update":"Wed Jan 31 05:09:17 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59599999999999997,"15min":0.59899999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.874},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61899999999999999,"15min":0.621},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84099999999999997,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.68200000000000005}]},{"osd":2,"last update":"Wed Jan 31 05:09:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.46899999999999997,"15min":0.47699999999999998},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.48299999999999998,"15min":0.497},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.63800000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.498}]},{"osd":3,"last update":"Wed Jan 31 05:09:17 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.56899999999999995,"15min":0.58099999999999996},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.70799999999999996,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.629,"15min":0.64500000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.84299999999999997}]},{"osd":4,"last update":"Wed Jan 31 05:09:17 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.622,"15min":0.629},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.86599999999999999,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.64600000000000002,"15min":0.65000000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.57499999999999996}]},{"osd":5,"last update":"Wed Jan 31 05:09:17 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.58399999999999996,"15min":0.60399999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.64100000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.57499999999999996,"15min":0.59199999999999997},"min":{"1min":0.33000000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.59899999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.35899999999999999}]},{"osd":6,"last update":"Wed Jan 31 05:09:17 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.69599999999999995,"15min":0.71599999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.95599999999999996,"5min":0.996,"15min":0.996},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.70999999999999996,"15min":0.72699999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.75,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.79400000000000004}]},{"osd":7,"last update":"Wed Jan 31 05:09:17 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.70899999999999996,"15min":0.71899999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.877,"5min":1.171,"15min":1.171},"last":0.748},{"interface":"front","average":{"1min":1.675,"5min":0.91500000000000004,"15min":0.78900000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":19.677,"5min":19.677,"15min":19.677},"last":0.82599999999999996}]},{"osd":9,"last update":"Wed Jan 31 05:08:42 2024","interfaces":[{"interface":"back","average":{"1min":1.665,"5min":1.665,"15min":1.665},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":19.695,"5min":19.695,"15min":19.695},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.90100000000000002}]},{"osd":10,"last update":"Wed Jan 31 05:09:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.81200000000000006}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]}]},{"osd":7,"up_from":51,"seq":219043332130,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28524,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716628,"statfs":{"total":95995035648,"available":95965827072,"internally_reserved":0,"allocated":1544192,"data_stored":1037808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:08:52 2024","interfaces":[{"interface":"back","average":{"1min":1.669,"5min":0.75600000000000001,"15min":0.60399999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":19.462,"5min":19.462,"15min":19.462},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.52900000000000003,"15min":0.51900000000000002},"min":{"1min":0.40899999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.45500000000000002}]},{"osd":1,"last update":"Wed Jan 31 05:08:52 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.41299999999999998,"15min":0.41099999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.44700000000000001,"15min":0.441},"min":{"1min":0.30099999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.63900000000000001}]},{"osd":2,"last update":"Wed Jan 31 05:08:52 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.60599999999999998,"15min":0.60299999999999998},"min":{"1min":0.34799999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.622}]},{"osd":3,"last update":"Wed Jan 31 05:08:52 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.753,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.52600000000000002}]},{"osd":4,"last update":"Wed Jan 31 05:08:52 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.47799999999999998,"15min":0.47699999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.63,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.5,"5min":0.50700000000000001,"15min":0.50800000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.71399999999999997,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.42999999999999999}]},{"osd":5,"last update":"Wed Jan 31 05:08:52 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.629,"15min":0.625},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64300000000000002,"15min":0.64200000000000002},"min":{"1min":0.432,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.78000000000000003}]},{"osd":6,"last update":"Wed Jan 31 05:08:52 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.63700000000000001,"15min":0.63100000000000001},"min":{"1min":0.46800000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.69699999999999995},{"interface":"front","average":{"1min":1.7889999999999999,"5min":0.88100000000000001,"15min":0.72999999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":19.425000000000001,"5min":19.425000000000001,"15min":19.425000000000001},"last":0.67300000000000004}]},{"osd":8,"last update":"Wed Jan 31 05:09:20 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67700000000000005,"15min":0.67800000000000005},"min":{"1min":0.52700000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.873,"5min":0.875,"15min":0.875},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.70599999999999996,"15min":0.71099999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.88200000000000001,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.80900000000000005}]},{"osd":9,"last update":"Wed Jan 31 05:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.755}]},{"osd":10,"last update":"Wed Jan 31 05:09:11 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.81999999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]}]},{"osd":6,"up_from":46,"seq":197568495655,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":445066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.376,"15min":0.37},"min":{"1min":0.27800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41199999999999998,"15min":0.40999999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.33300000000000002}]},{"osd":1,"last update":"Wed Jan 31 05:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53900000000000003,"15min":0.53700000000000003},"min":{"1min":0.40200000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55600000000000005,"15min":0.55200000000000005},"min":{"1min":0.436,"5min":0.378,"15min":0.378},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.63500000000000001}]},{"osd":2,"last update":"Wed Jan 31 05:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56100000000000005,"15min":0.55400000000000005},"min":{"1min":0.42599999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55400000000000005,"15min":0.54700000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.56399999999999995}]},{"osd":3,"last update":"Wed Jan 31 05:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.45900000000000002,"15min":0.45400000000000001},"min":{"1min":0.29499999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.49199999999999999,"15min":0.48599999999999999},"min":{"1min":0.318,"5min":0.313,"15min":0.313},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.39400000000000002}]},{"osd":4,"last update":"Wed Jan 31 05:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58799999999999997,"15min":0.59199999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.73499999999999999,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.622},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.57699999999999996,"15min":0.57299999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.83899999999999997,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.61099999999999999}]},{"osd":5,"last update":"Wed Jan 31 05:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.625,"15min":0.621},"min":{"1min":0.443,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.46300000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.53700000000000003}]},{"osd":7,"last update":"Wed Jan 31 05:08:55 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.64500000000000002,"15min":0.63700000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.65500000000000003,"15min":0.65100000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.69499999999999995}]},{"osd":8,"last update":"Wed Jan 31 05:09:17 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.68799999999999994,"15min":0.69299999999999995},"min":{"1min":0.48699999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.78300000000000003,"15min":0.80600000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.91200000000000003,"5min":3.3130000000000002,"15min":3.3130000000000002},"last":0.71199999999999997}]},{"osd":9,"last update":"Wed Jan 31 05:08:44 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1,"5min":1,"15min":1},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.49399999999999999}]},{"osd":10,"last update":"Wed Jan 31 05:09:07 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.66100000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574911,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":954368,"data_stored":454939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:08:27 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.496,"15min":0.48699999999999999},"min":{"1min":0.33200000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.51500000000000001,"15min":0.505},"min":{"1min":0.371,"5min":0.314,"15min":0.314},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.68899999999999995}]},{"osd":2,"last update":"Wed Jan 31 05:08:53 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.53500000000000003,"15min":0.51300000000000001},"min":{"1min":0.36699999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.80600000000000005,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.52200000000000002,"15min":0.499},"min":{"1min":0.40000000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.73899999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.76100000000000001}]},{"osd":3,"last update":"Wed Jan 31 05:09:17 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.501,"15min":0.48699999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.53200000000000003,"15min":0.5},"min":{"1min":0.374,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.90000000000000002,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.61499999999999999}]},{"osd":4,"last update":"Wed Jan 31 05:08:43 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.439,"15min":0.432},"min":{"1min":0.314,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.63200000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.44800000000000001,"15min":0.438},"min":{"1min":0.29399999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.505}]},{"osd":5,"last update":"Wed Jan 31 05:09:04 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.56399999999999995,"15min":0.54600000000000004},"min":{"1min":0.379,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.57399999999999995,"15min":0.55800000000000005},"min":{"1min":0.40799999999999997,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.83599999999999997}]},{"osd":6,"last update":"Wed Jan 31 05:08:27 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.58099999999999996},"min":{"1min":0.43099999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.44900000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.745}]},{"osd":7,"last update":"Wed Jan 31 05:08:53 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.36299999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.64000000000000001}]},{"osd":8,"last update":"Wed Jan 31 05:09:17 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.66600000000000004,"15min":0.66200000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.85999999999999999,"5min":0.875,"15min":0.875},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.66000000000000003,"15min":0.65800000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.80900000000000005}]},{"osd":9,"last update":"Wed Jan 31 05:08:43 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.72999999999999998}]},{"osd":10,"last update":"Wed Jan 31 05:09:10 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.86399999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]}]},{"osd":0,"up_from":8,"seq":34359738437,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":447544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 31 05:08:30 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51700000000000002,"15min":0.52700000000000002},"min":{"1min":0.40100000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.71699999999999997,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.53300000000000003,"15min":0.52900000000000003},"min":{"1min":0.35799999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.73299999999999998,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.57899999999999996}]},{"osd":2,"last update":"Wed Jan 31 05:08:59 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55000000000000004,"15min":0.54400000000000004},"min":{"1min":0.34999999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.78400000000000003,"5min":0.873,"15min":0.873},"last":0.54400000000000004},{"interface":"front","average":{"1min":1.0389999999999999,"5min":0.65500000000000003,"15min":0.59499999999999997},"min":{"1min":0.42099999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":9.3170000000000002,"5min":9.3170000000000002,"15min":9.3170000000000002},"last":0.35799999999999998}]},{"osd":3,"last update":"Wed Jan 31 05:08:15 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.41699999999999998,"15min":0.40999999999999998},"min":{"1min":0.27000000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.62,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.39600000000000002,"15min":0.39100000000000001},"min":{"1min":0.312,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.56000000000000005,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.28599999999999998}]},{"osd":4,"last update":"Wed Jan 31 05:08:40 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53500000000000003,"15min":0.52100000000000002},"min":{"1min":0.40500000000000003,"5min":0.375,"15min":0.375},"max":{"1min":0.68899999999999995,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.53600000000000003,"15min":0.50900000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.72799999999999998}]},{"osd":5,"last update":"Wed Jan 31 05:09:10 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55600000000000005,"15min":0.54600000000000004},"min":{"1min":0.39300000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.75600000000000001,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.45800000000000002},{"interface":"front","average":{"1min":1.0549999999999999,"5min":0.68000000000000005,"15min":0.60699999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":9.2690000000000001,"5min":9.2690000000000001,"15min":9.2690000000000001},"last":0.628}]},{"osd":6,"last update":"Wed Jan 31 05:08:29 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.52700000000000002,"15min":0.52200000000000002},"min":{"1min":0.31,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.53000000000000003,"15min":0.52100000000000002},"min":{"1min":0.39000000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.47099999999999997}]},{"osd":7,"last update":"Wed Jan 31 05:08:59 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.627,"15min":0.622},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80900000000000005,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.64400000000000002,"15min":0.64200000000000002},"min":{"1min":0.47899999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.81699999999999995,"5min":0.874,"15min":0.874},"last":0.54600000000000004}]},{"osd":8,"last update":"Wed Jan 31 05:09:19 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.72299999999999998,"15min":0.67700000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":9.2840000000000007,"5min":9.2840000000000007,"15min":9.2840000000000007},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.70999999999999996,"15min":0.72199999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.78100000000000003,"5min":1.006,"15min":1.006},"last":0.66500000000000004}]},{"osd":9,"last update":"Wed Jan 31 05:08:40 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.44400000000000001}]},{"osd":10,"last update":"Wed Jan 31 05:09:10 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.69699999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]}]},{"osd":2,"up_from":18,"seq":77309411387,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":970752,"data_stored":448560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:08:55 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.499,"15min":0.47299999999999998},"min":{"1min":0.38700000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.70599999999999996,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.50800000000000001,"15min":0.495},"min":{"1min":0.36599999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.72599999999999998,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.40300000000000002}]},{"osd":1,"last update":"Wed Jan 31 05:08:55 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.52100000000000002,"15min":0.50700000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76700000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.53500000000000003,"15min":0.51900000000000002},"min":{"1min":0.41799999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.53700000000000003}]},{"osd":3,"last update":"Wed Jan 31 05:09:19 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55400000000000005,"15min":0.52400000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.75,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.56399999999999995,"15min":0.53600000000000003},"min":{"1min":0.40799999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.76800000000000002,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.68000000000000005}]},{"osd":4,"last update":"Wed Jan 31 05:08:40 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.41699999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.71599999999999997,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.53600000000000003,"15min":0.54000000000000004},"min":{"1min":0.40699999999999997,"5min":0.377,"15min":0.377},"max":{"1min":0.75600000000000001,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.57699999999999996}]},{"osd":5,"last update":"Wed Jan 31 05:09:02 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.41899999999999998,"15min":0.40699999999999997},"min":{"1min":0.29899999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.69899999999999995,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.44,"15min":0.434},"min":{"1min":0.30299999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.61799999999999999,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.60599999999999998}]},{"osd":6,"last update":"Wed Jan 31 05:08:31 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.55900000000000005,"15min":0.54400000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57199999999999995,"15min":0.56599999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.76000000000000001,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.624}]},{"osd":7,"last update":"Wed Jan 31 05:08:55 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.77600000000000002,"15min":0.80300000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.77000000000000002,"5min":3.9449999999999998,"15min":3.9449999999999998},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.78600000000000003,"15min":0.80900000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.80600000000000005,"5min":4.1230000000000002,"15min":4.1230000000000002},"last":0.44}]},{"osd":8,"last update":"Wed Jan 31 05:09:18 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.33300000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.80400000000000005,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.501},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61799999999999999,"15min":0.61899999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.84399999999999997,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.81699999999999995}]},{"osd":9,"last update":"Wed Jan 31 05:08:44 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.69599999999999995}]},{"osd":10,"last update":"Wed Jan 31 05:09:08 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.79000000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]}]},{"osd":3,"up_from":25,"seq":107374182453,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":445260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:09:22 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.33800000000000002,"15min":0.315},"min":{"1min":0.24199999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.36099999999999999,"15min":0.33800000000000002},"min":{"1min":0.252,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.58899999999999997,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.38700000000000001}]},{"osd":1,"last update":"Wed Jan 31 05:09:22 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.52500000000000002,"15min":0.505},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.80600000000000005,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.52500000000000002,"15min":0.502},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.629}]},{"osd":2,"last update":"Wed Jan 31 05:09:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.54200000000000004,"15min":0.504},"min":{"1min":0.42099999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.53000000000000003,"15min":0.51000000000000001},"min":{"1min":0.36499999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.75600000000000001,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.60599999999999998}]},{"osd":4,"last update":"Wed Jan 31 05:08:45 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.54000000000000004,"15min":0.52000000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.54700000000000004,"15min":0.51100000000000001},"min":{"1min":0.45900000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.78000000000000003}]},{"osd":5,"last update":"Wed Jan 31 05:09:06 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56399999999999995,"15min":0.56100000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.59299999999999997,"15min":0.58099999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.57599999999999996}]},{"osd":6,"last update":"Wed Jan 31 05:08:27 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.47399999999999998,"15min":0.46300000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.48199999999999998,"15min":0.47699999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.44500000000000001}]},{"osd":7,"last update":"Wed Jan 31 05:08:52 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.66500000000000004,"15min":0.65100000000000002},"min":{"1min":0.53400000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.65300000000000002,"15min":0.64600000000000002},"min":{"1min":0.52400000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.79700000000000004}]},{"osd":8,"last update":"Wed Jan 31 05:08:16 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.68200000000000005}]},{"osd":9,"last update":"Wed Jan 31 05:08:41 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.51100000000000001}]},{"osd":10,"last update":"Wed Jan 31 05:09:10 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.753},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.81000000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]}]},{"osd":4,"up_from":33,"seq":141733920817,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":946176,"data_stored":446066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.502,"15min":0.497},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.51900000000000002,"15min":0.51600000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.51300000000000001}]},{"osd":1,"last update":"Wed Jan 31 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.35599999999999998,"15min":0.33800000000000002},"min":{"1min":0.29099999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.38400000000000001,"15min":0.371},"min":{"1min":0.27100000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.36599999999999999}]},{"osd":2,"last update":"Wed Jan 31 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.54400000000000004,"15min":0.53400000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.54600000000000004,"15min":0.52500000000000002},"min":{"1min":0.40400000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76200000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.76800000000000002}]},{"osd":3,"last update":"Wed Jan 31 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.54700000000000004,"15min":0.53400000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54100000000000004,"15min":0.53900000000000003},"min":{"1min":0.39400000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.48999999999999999}]},{"osd":5,"last update":"Wed Jan 31 05:09:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55100000000000005,"15min":0.53400000000000003},"min":{"1min":0.442,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.71299999999999997,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.56399999999999995,"15min":0.54000000000000004},"min":{"1min":0.46200000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.78600000000000003,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.71499999999999997}]},{"osd":6,"last update":"Wed Jan 31 05:08:30 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58199999999999996,"15min":0.57599999999999996},"min":{"1min":0.46999999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.82799999999999996,"5min":0.87,"15min":0.87},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.45200000000000001}]},{"osd":7,"last update":"Wed Jan 31 05:08:52 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.55100000000000005,"15min":0.53900000000000003},"min":{"1min":0.41999999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59199999999999997,"15min":0.58899999999999997},"min":{"1min":0.39600000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.80300000000000005,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.61099999999999999}]},{"osd":8,"last update":"Wed Jan 31 05:09:18 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.67400000000000004,"15min":0.67000000000000004},"min":{"1min":0.53500000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.85499999999999998,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.67500000000000004,"15min":0.66600000000000004},"min":{"1min":0.55300000000000005,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.88600000000000001,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.80100000000000005}]},{"osd":9,"last update":"Wed Jan 31 05:08:44 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.67900000000000005}]},{"osd":10,"last update":"Wed Jan 31 05:09:08 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.754}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]}]},{"osd":5,"up_from":38,"seq":163208757292,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32700,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712452,"statfs":{"total":95995035648,"available":95961550848,"internally_reserved":0,"allocated":1560576,"data_stored":1037582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:09:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.503,"15min":0.47299999999999998},"min":{"1min":0.314,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.31},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.52200000000000002,"15min":0.499},"min":{"1min":0.32700000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.82999999999999996,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.35199999999999998}]},{"osd":1,"last update":"Wed Jan 31 05:09:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53100000000000003,"15min":0.52100000000000002},"min":{"1min":0.34699999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.55600000000000005,"15min":0.54800000000000004},"min":{"1min":0.35399999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.82199999999999995,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.42299999999999999}]},{"osd":2,"last update":"Wed Jan 31 05:09:05 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.40000000000000002,"15min":0.39200000000000002},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.60599999999999998,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41599999999999998,"15min":0.41499999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.59899999999999998,"5min":0.623,"15min":0.623},"last":0.54000000000000004}]},{"osd":3,"last update":"Wed Jan 31 05:09:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.55000000000000004,"15min":0.52700000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.91000000000000003,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54800000000000004,"15min":0.53200000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.72499999999999998,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.55500000000000005}]},{"osd":4,"last update":"Wed Jan 31 05:09:05 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60099999999999998,"15min":0.59499999999999997},"min":{"1min":0.442,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.77800000000000002,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.60899999999999999,"15min":0.60199999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.83299999999999996,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.48399999999999999}]},{"osd":6,"last update":"Wed Jan 31 05:08:32 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.40000000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.503}]},{"osd":7,"last update":"Wed Jan 31 05:08:52 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.59799999999999998,"15min":0.59099999999999997},"min":{"1min":0.40699999999999997,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.64100000000000001,"15min":0.63700000000000001},"min":{"1min":0.45600000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.64500000000000002}]},{"osd":8,"last update":"Wed Jan 31 05:09:17 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.55000000000000004,"15min":0.54400000000000004},"min":{"1min":0.35999999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.84299999999999997,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58099999999999996,"15min":0.58299999999999996},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.89300000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.51400000000000001}]},{"osd":9,"last update":"Wed Jan 31 05:08:42 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.63},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.67000000000000004}]},{"osd":10,"last update":"Wed Jan 31 05:09:10 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.69199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":9963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":23020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-31T05:09:29.883 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-31T05:09:29.884 INFO:tasks.cephadm:Setting up client nodes... 2024-01-31T05:09:29.884 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-01-31T05:09:30.155 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:09:30.446 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:30 smithi099 ceph-mon[31615]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-01-31T05:09:30.446 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:30 smithi099 ceph-mon[31615]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-31T05:09:30.446 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:30 smithi099 ceph-mon[31615]: from='client.14763 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-31T05:09:30.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:30 smithi181 ceph-mon[36434]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-01-31T05:09:30.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:30 smithi181 ceph-mon[36434]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-31T05:09:30.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:30 smithi181 ceph-mon[36434]: from='client.14763 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-31T05:09:30.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:30 smithi179 ceph-mon[35652]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-01-31T05:09:30.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:30 smithi179 ceph-mon[35652]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-31T05:09:30.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:30 smithi179 ceph-mon[35652]: from='client.14763 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-31T05:09:31.472 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:31 smithi181 ceph-mon[36434]: pgmap v291: 97 pgs: 97 active+clean; 602 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 7.4 KiB/s wr, 17 op/s 2024-01-31T05:09:31.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:31 smithi099 ceph-mon[31615]: pgmap v291: 97 pgs: 97 active+clean; 602 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 7.4 KiB/s wr, 17 op/s 2024-01-31T05:09:31.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:31 smithi179 ceph-mon[35652]: pgmap v291: 97 pgs: 97 active+clean; 602 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 7.4 KiB/s wr, 17 op/s 2024-01-31T05:09:31.633 INFO:journalctl@ceph.mds.b.smithi179.stdout:Jan 31 05:09:31 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-b[66457]: 2024-01-31T05:09:31.314+0000 7fef06546700 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-01-31T05:09:31.633 INFO:journalctl@ceph.mds.b.smithi179.stdout:Jan 31 05:09:31 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-b[66457]: 2024-01-31T05:09:31.314+0000 7fef06546700 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-01-31T05:09:31.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:31.946+0000 7f8d2ff93700 1 -- 172.21.15.99:0/4231795841 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8d281033e0 msgr2=0x7f8d28109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:31.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:31.946+0000 7f8d2ff93700 1 --2- 172.21.15.99:0/4231795841 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8d281033e0 0x7f8d28109c90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8d2000b0d0 tx=0x7f8d2000b3e0 comp rx=0 tx=0).stop 2024-01-31T05:09:31.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:31.946+0000 7f8d2ff93700 1 -- 172.21.15.99:0/4231795841 shutdown_connections 2024-01-31T05:09:31.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:31.946+0000 7f8d2ff93700 1 --2- 172.21.15.99:0/4231795841 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8d281033e0 0x7f8d28109c90 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:31.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:31.946+0000 7f8d2ff93700 1 --2- 172.21.15.99:0/4231795841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d28101840 0x7f8d28101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:31.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:31.946+0000 7f8d2ff93700 1 --2- 172.21.15.99:0/4231795841 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d28102a40 0x7f8d28102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:31.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:31.946+0000 7f8d2ff93700 1 -- 172.21.15.99:0/4231795841 >> 172.21.15.99:0/4231795841 conn(0x7f8d280fcdc0 msgr2=0x7f8d280ff220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:31.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:31.946+0000 7f8d2ff93700 1 -- 172.21.15.99:0/4231795841 shutdown_connections 2024-01-31T05:09:31.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:31.946+0000 7f8d2ff93700 1 -- 172.21.15.99:0/4231795841 wait complete. 2024-01-31T05:09:31.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:31.947+0000 7f8d2ff93700 1 Processor -- start 2024-01-31T05:09:31.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:31.947+0000 7f8d2ff93700 1 -- start start 2024-01-31T05:09:31.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:31.947+0000 7f8d2ff93700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d28101840 0x7f8d28197650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:31.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:31.947+0000 7f8d2ff93700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d28102a40 0x7f8d28197b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:31.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:31.947+0000 7f8d2ff93700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8d281033e0 0x7f8d2819ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:31.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:31.947+0000 7f8d2ff93700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2819f1e0 con 0x7f8d281033e0 2024-01-31T05:09:31.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:31.947+0000 7f8d2ff93700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2819f320 con 0x7f8d28102a40 2024-01-31T05:09:31.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:31.947+0000 7f8d2ff93700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2819f4b0 con 0x7f8d28101840 2024-01-31T05:09:31.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:31.947+0000 7f8d2e530700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8d281033e0 0x7f8d2819ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:31.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:31.947+0000 7f8d2e530700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8d281033e0 0x7f8d2819ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60770/0 (socket says 172.21.15.99:60770) 2024-01-31T05:09:31.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:31.947+0000 7f8d2e530700 1 -- 172.21.15.99:0/3989088369 learned_addr learned my addr 172.21.15.99:0/3989088369 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:09:31.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:31.947+0000 7f8d2dd2f700 1 --2- 172.21.15.99:0/3989088369 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d28101840 0x7f8d28197650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:31.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:31.947+0000 7f8d2d52e700 1 --2- 172.21.15.99:0/3989088369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d28102a40 0x7f8d28197b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:31.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:31.947+0000 7f8d2e530700 1 -- 172.21.15.99:0/3989088369 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d28101840 msgr2=0x7f8d28197650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:31.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:31.947+0000 7f8d2e530700 1 --2- 172.21.15.99:0/3989088369 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d28101840 0x7f8d28197650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:31.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:31.947+0000 7f8d2e530700 1 -- 172.21.15.99:0/3989088369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d28102a40 msgr2=0x7f8d28197b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:31.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:31.947+0000 7f8d2e530700 1 --2- 172.21.15.99:0/3989088369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d28102a40 0x7f8d28197b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:31.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:31.947+0000 7f8d2e530700 1 -- 172.21.15.99:0/3989088369 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d20009d00 con 0x7f8d281033e0 2024-01-31T05:09:31.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:31.947+0000 7f8d2d52e700 1 --2- 172.21.15.99:0/3989088369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d28102a40 0x7f8d28197b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:09:31.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:31.948+0000 7f8d2e530700 1 --2- 172.21.15.99:0/3989088369 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8d281033e0 0x7f8d2819ec10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8d20007a00 tx=0x7f8d20009440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:31.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:31.948+0000 7f8d1effd700 1 -- 172.21.15.99:0/3989088369 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2000e040 con 0x7f8d281033e0 2024-01-31T05:09:31.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:31.948+0000 7f8d2ff93700 1 -- 172.21.15.99:0/3989088369 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d2819f730 con 0x7f8d281033e0 2024-01-31T05:09:31.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:31.948+0000 7f8d1effd700 1 -- 172.21.15.99:0/3989088369 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8d2001dd50 con 0x7f8d281033e0 2024-01-31T05:09:31.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:31.948+0000 7f8d1effd700 1 -- 172.21.15.99:0/3989088369 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2001b450 con 0x7f8d281033e0 2024-01-31T05:09:31.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:31.948+0000 7f8d2ff93700 1 -- 172.21.15.99:0/3989088369 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d2819fbf0 con 0x7f8d281033e0 2024-01-31T05:09:31.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:31.949+0000 7f8d2ff93700 1 -- 172.21.15.99:0/3989088369 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d28108b30 con 0x7f8d281033e0 2024-01-31T05:09:31.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:31.950+0000 7f8d1effd700 1 -- 172.21.15.99:0/3989088369 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f8d20012570 con 0x7f8d281033e0 2024-01-31T05:09:31.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:31.950+0000 7f8d1effd700 1 --2- 172.21.15.99:0/3989088369 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f8d140a14b0 0x7f8d140a3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:31.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:31.950+0000 7f8d2dd2f700 1 --2- 172.21.15.99:0/3989088369 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f8d140a14b0 0x7f8d140a3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:31.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:31.950+0000 7f8d1effd700 1 -- 172.21.15.99:0/3989088369 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f8d200ce8f0 con 0x7f8d281033e0 2024-01-31T05:09:31.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:31.951+0000 7f8d2dd2f700 1 --2- 172.21.15.99:0/3989088369 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f8d140a14b0 0x7f8d140a3970 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8d281028a0 tx=0x7f8d1800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:31.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:31.954+0000 7f8d1effd700 1 -- 172.21.15.99:0/3989088369 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f8d20097e50 con 0x7f8d281033e0 2024-01-31T05:09:32.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:32.227+0000 7f8d2ff93700 1 -- 172.21.15.99:0/3989088369 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f8d2810d050 con 0x7f8d281033e0 2024-01-31T05:09:32.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:32.229+0000 7f8d1effd700 1 -- 172.21.15.99:0/3989088369 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) v1 ==== 170+0+59 (secure 0 0 0) 0x7f8d2009b470 con 0x7f8d281033e0 2024-01-31T05:09:32.229 INFO:teuthology.orchestra.run.smithi099.stdout:[client.0] 2024-01-31T05:09:32.229 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQAM1rllCC2fDRAALuwRw5xmtKRlmQ2JDFz/ow== 2024-01-31T05:09:32.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:32.231+0000 7f8d2ff93700 1 -- 172.21.15.99:0/3989088369 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f8d140a14b0 msgr2=0x7f8d140a3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:32.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:32.231+0000 7f8d2ff93700 1 --2- 172.21.15.99:0/3989088369 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f8d140a14b0 0x7f8d140a3970 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8d281028a0 tx=0x7f8d1800b410 comp rx=0 tx=0).stop 2024-01-31T05:09:32.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:32.231+0000 7f8d2ff93700 1 -- 172.21.15.99:0/3989088369 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8d281033e0 msgr2=0x7f8d2819ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:32.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:32.231+0000 7f8d2ff93700 1 --2- 172.21.15.99:0/3989088369 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8d281033e0 0x7f8d2819ec10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8d20007a00 tx=0x7f8d20009440 comp rx=0 tx=0).stop 2024-01-31T05:09:32.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:32.232+0000 7f8d2ff93700 1 -- 172.21.15.99:0/3989088369 shutdown_connections 2024-01-31T05:09:32.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:32.232+0000 7f8d2ff93700 1 --2- 172.21.15.99:0/3989088369 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8d281033e0 0x7f8d2819ec10 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:32.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:32.232+0000 7f8d2ff93700 1 --2- 172.21.15.99:0/3989088369 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d28101840 0x7f8d28197650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:32.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:32.232+0000 7f8d2ff93700 1 --2- 172.21.15.99:0/3989088369 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f8d140a14b0 0x7f8d140a3970 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:32.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:32.232+0000 7f8d2ff93700 1 --2- 172.21.15.99:0/3989088369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d28102a40 0x7f8d28197b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:32.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:32.232+0000 7f8d2ff93700 1 -- 172.21.15.99:0/3989088369 >> 172.21.15.99:0/3989088369 conn(0x7f8d280fcdc0 msgr2=0x7f8d28105c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:32.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:32.232+0000 7f8d2ff93700 1 -- 172.21.15.99:0/3989088369 shutdown_connections 2024-01-31T05:09:32.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:32.232+0000 7f8d2ff93700 1 -- 172.21.15.99:0/3989088369 wait complete. 2024-01-31T05:09:32.908 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-31T05:09:32.908 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-01-31T05:09:32.908 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-01-31T05:09:32.951 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-01-31T05:09:32.951 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-01-31T05:09:32.951 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph mgr dump --format=json 2024-01-31T05:09:33.230 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:09:33.435 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:33 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/3989088369' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-01-31T05:09:33.435 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:33 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/3989088369' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-01-31T05:09:33.435 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:33 smithi179 ceph-mon[35652]: pgmap v292: 97 pgs: 97 active+clean; 605 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8.1 KiB/s wr, 25 op/s 2024-01-31T05:09:33.460 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:33 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/3989088369' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-01-31T05:09:33.460 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:33 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/3989088369' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-01-31T05:09:33.460 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:33 smithi099 ceph-mon[31615]: pgmap v292: 97 pgs: 97 active+clean; 605 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8.1 KiB/s wr, 25 op/s 2024-01-31T05:09:33.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:33 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/3989088369' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-01-31T05:09:33.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:33 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/3989088369' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-01-31T05:09:33.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:33 smithi181 ceph-mon[36434]: pgmap v292: 97 pgs: 97 active+clean; 605 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8.1 KiB/s wr, 25 op/s 2024-01-31T05:09:34.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:34.941+0000 7f350d39d700 1 -- 172.21.15.99:0/395819505 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3508106650 msgr2=0x7f3508106a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:34.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:34.941+0000 7f350d39d700 1 --2- 172.21.15.99:0/395819505 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3508106650 0x7f3508106a30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f34f8009990 tx=0x7f34f8009ca0 comp rx=0 tx=0).stop 2024-01-31T05:09:34.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:34.941+0000 7f350d39d700 1 -- 172.21.15.99:0/395819505 shutdown_connections 2024-01-31T05:09:34.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:34.941+0000 7f350d39d700 1 --2- 172.21.15.99:0/395819505 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3508100f80 0x7f350810d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:34.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:34.941+0000 7f350d39d700 1 --2- 172.21.15.99:0/395819505 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3508106650 0x7f3508106a30 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:34.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:34.941+0000 7f350d39d700 1 --2- 172.21.15.99:0/395819505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f35081005c0 0x7f3508100a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:34.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:34.941+0000 7f350d39d700 1 -- 172.21.15.99:0/395819505 >> 172.21.15.99:0/395819505 conn(0x7f35080fc0b0 msgr2=0x7f35080fe4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:34.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:34.941+0000 7f350d39d700 1 -- 172.21.15.99:0/395819505 shutdown_connections 2024-01-31T05:09:34.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:34.941+0000 7f350d39d700 1 -- 172.21.15.99:0/395819505 wait complete. 2024-01-31T05:09:34.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:34.942+0000 7f350d39d700 1 Processor -- start 2024-01-31T05:09:34.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:34.942+0000 7f350d39d700 1 -- start start 2024-01-31T05:09:34.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:34.942+0000 7f350d39d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35081005c0 0x7f3508102260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:34.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:34.942+0000 7f350d39d700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3508100f80 0x7f35081027a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:34.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:34.942+0000 7f350d39d700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3508106650 0x7f3508102ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:34.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:34.942+0000 7f350d39d700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35081a5ef0 con 0x7f3508106650 2024-01-31T05:09:34.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:34.942+0000 7f350d39d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35081a6060 con 0x7f35081005c0 2024-01-31T05:09:34.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:34.942+0000 7f350d39d700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35081a6220 con 0x7f3508100f80 2024-01-31T05:09:34.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:34.942+0000 7f3507fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35081005c0 0x7f3508102260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:34.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:34.942+0000 7f350cb9c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3508106650 0x7f3508102ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:34.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:34.942+0000 7f3507fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35081005c0 0x7f3508102260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.99:39442/0 (socket says 172.21.15.99:39442) 2024-01-31T05:09:34.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:34.942+0000 7f3507fff700 1 -- 172.21.15.99:0/2579543918 learned_addr learned my addr 172.21.15.99:0/2579543918 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:09:34.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:34.942+0000 7f350cb9c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3508106650 0x7f3508102ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60786/0 (socket says 172.21.15.99:60786) 2024-01-31T05:09:34.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:34.943+0000 7f35077fe700 1 --2- 172.21.15.99:0/2579543918 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3508100f80 0x7f35081027a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:34.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:34.943+0000 7f350cb9c700 1 -- 172.21.15.99:0/2579543918 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3508100f80 msgr2=0x7f35081027a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:34.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:34.943+0000 7f350cb9c700 1 --2- 172.21.15.99:0/2579543918 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3508100f80 0x7f35081027a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:34.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:34.943+0000 7f350cb9c700 1 -- 172.21.15.99:0/2579543918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35081005c0 msgr2=0x7f3508102260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:34.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:34.943+0000 7f350cb9c700 1 --2- 172.21.15.99:0/2579543918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35081005c0 0x7f3508102260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:34.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:34.943+0000 7f350cb9c700 1 -- 172.21.15.99:0/2579543918 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f80095f0 con 0x7f3508106650 2024-01-31T05:09:34.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:34.943+0000 7f3507fff700 1 --2- 172.21.15.99:0/2579543918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35081005c0 0x7f3508102260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:09:34.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:34.943+0000 7f350cb9c700 1 --2- 172.21.15.99:0/2579543918 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3508106650 0x7f3508102ce0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3500007f10 tx=0x7f350000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:34.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:34.943+0000 7f35057fa700 1 -- 172.21.15.99:0/2579543918 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350000ddd0 con 0x7f3508106650 2024-01-31T05:09:34.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:34.943+0000 7f35057fa700 1 -- 172.21.15.99:0/2579543918 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f350000f040 con 0x7f3508106650 2024-01-31T05:09:34.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:34.943+0000 7f350d39d700 1 -- 172.21.15.99:0/2579543918 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35081a6500 con 0x7f3508106650 2024-01-31T05:09:34.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:34.943+0000 7f35057fa700 1 -- 172.21.15.99:0/2579543918 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3500005a90 con 0x7f3508106650 2024-01-31T05:09:34.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:34.943+0000 7f350d39d700 1 -- 172.21.15.99:0/2579543918 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35081a6a00 con 0x7f3508106650 2024-01-31T05:09:34.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:34.944+0000 7f350d39d700 1 -- 172.21.15.99:0/2579543918 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35080684a0 con 0x7f3508106650 2024-01-31T05:09:34.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:34.945+0000 7f35057fa700 1 -- 172.21.15.99:0/2579543918 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f3500004ad0 con 0x7f3508106650 2024-01-31T05:09:34.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:34.946+0000 7f35057fa700 1 --2- 172.21.15.99:0/2579543918 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f34f00a1480 0x7f34f00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:34.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:34.946+0000 7f3507fff700 1 --2- 172.21.15.99:0/2579543918 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f34f00a1480 0x7f34f00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:34.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:34.946+0000 7f35057fa700 1 -- 172.21.15.99:0/2579543918 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f35000cc360 con 0x7f3508106650 2024-01-31T05:09:34.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:34.946+0000 7f3507fff700 1 --2- 172.21.15.99:0/2579543918 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f34f00a1480 0x7f34f00a3940 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f34f800b5c0 tx=0x7f34f801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:34.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:34.950+0000 7f35057fa700 1 -- 172.21.15.99:0/2579543918 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f3500095830 con 0x7f3508106650 2024-01-31T05:09:35.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:35.198+0000 7f350d39d700 1 -- 172.21.15.99:0/2579543918 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f3508110660 con 0x7f3508106650 2024-01-31T05:09:35.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:35.203+0000 7f35057fa700 1 -- 172.21.15.99:0/2579543918 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) v1 ==== 74+0+259960 (secure 0 0 0) 0x7f3500098e50 con 0x7f3508106650 2024-01-31T05:09:35.206 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:09:35.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:35.206+0000 7f350d39d700 1 -- 172.21.15.99:0/2579543918 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f34f00a1480 msgr2=0x7f34f00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:35.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:35.206+0000 7f350d39d700 1 --2- 172.21.15.99:0/2579543918 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f34f00a1480 0x7f34f00a3940 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f34f800b5c0 tx=0x7f34f801a040 comp rx=0 tx=0).stop 2024-01-31T05:09:35.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:35.206+0000 7f350d39d700 1 -- 172.21.15.99:0/2579543918 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3508106650 msgr2=0x7f3508102ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:35.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:35.206+0000 7f350d39d700 1 --2- 172.21.15.99:0/2579543918 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3508106650 0x7f3508102ce0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3500007f10 tx=0x7f350000d3b0 comp rx=0 tx=0).stop 2024-01-31T05:09:35.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:35.206+0000 7f350d39d700 1 -- 172.21.15.99:0/2579543918 shutdown_connections 2024-01-31T05:09:35.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:35.206+0000 7f350d39d700 1 --2- 172.21.15.99:0/2579543918 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3508106650 0x7f3508102ce0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:35.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:35.206+0000 7f350d39d700 1 --2- 172.21.15.99:0/2579543918 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f34f00a1480 0x7f34f00a3940 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:35.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:35.206+0000 7f350d39d700 1 --2- 172.21.15.99:0/2579543918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35081005c0 0x7f3508102260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:35.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:35.206+0000 7f350d39d700 1 --2- 172.21.15.99:0/2579543918 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3508100f80 0x7f35081027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:35.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:35.206+0000 7f350d39d700 1 -- 172.21.15.99:0/2579543918 >> 172.21.15.99:0/2579543918 conn(0x7f35080fc0b0 msgr2=0x7f35080fde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:35.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:35.206+0000 7f350d39d700 1 -- 172.21.15.99:0/2579543918 shutdown_connections 2024-01-31T05:09:35.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:35.206+0000 7f350d39d700 1 -- 172.21.15.99:0/2579543918 wait complete. 2024-01-31T05:09:35.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:35 smithi099 ceph-mon[31615]: pgmap v293: 97 pgs: 97 active+clean; 627 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 8.6 KiB/s wr, 24 op/s 2024-01-31T05:09:35.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:35 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/2579543918' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-01-31T05:09:35.863 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":3925720924},{"type":"v1","addr":"172.21.15.99:6801","nonce":3925720924}]},"active_addr":"172.21.15.99:6801/3925720924","active_change":"2024-01-31T05:02:20.510969+0000","active_mgr_features":4540701272860131327,"available":true,"standbys":[{"gid":24106,"name":"z","mgr_features":4540701272860131327,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24110,"name":"y","mgr_features":4540701272860131327,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.99:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.99:0","nonce":1488125855}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.99:0","nonce":231463475}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.99:0","nonce":2800754321}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.99:0","nonce":1499649828}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.99:0","nonce":2232715345}]}]} 2024-01-31T05:09:35.868 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-01-31T05:09:35.868 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-01-31T05:09:35.868 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph osd dump --format=json 2024-01-31T05:09:36.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:35 smithi181 ceph-mon[36434]: pgmap v293: 97 pgs: 97 active+clean; 627 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 8.6 KiB/s wr, 24 op/s 2024-01-31T05:09:36.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:35 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/2579543918' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-01-31T05:09:36.107 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:09:36.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:35 smithi179 ceph-mon[35652]: pgmap v293: 97 pgs: 97 active+clean; 627 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 8.6 KiB/s wr, 24 op/s 2024-01-31T05:09:36.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:35 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/2579543918' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-01-31T05:09:37.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:37.876+0000 7faaa5ca9700 1 -- 172.21.15.99:0/1478930338 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faaa01021f0 msgr2=0x7faaa010e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:37.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:37.876+0000 7faaa5ca9700 1 --2- 172.21.15.99:0/1478930338 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faaa01021f0 0x7faaa010e690 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7faa9800b0a0 tx=0x7faa9800b3b0 comp rx=0 tx=0).stop 2024-01-31T05:09:37.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:37.876+0000 7faaa5ca9700 1 -- 172.21.15.99:0/1478930338 shutdown_connections 2024-01-31T05:09:37.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:37.876+0000 7faaa5ca9700 1 --2- 172.21.15.99:0/1478930338 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faaa01021f0 0x7faaa010e690 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:37.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:37.876+0000 7faaa5ca9700 1 --2- 172.21.15.99:0/1478930338 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faaa0106700 0x7faaa0106ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:37.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:37.876+0000 7faaa5ca9700 1 --2- 172.21.15.99:0/1478930338 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faaa0101830 0x7faaa0101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:37.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:37.876+0000 7faaa5ca9700 1 -- 172.21.15.99:0/1478930338 >> 172.21.15.99:0/1478930338 conn(0x7faaa0078910 msgr2=0x7faaa0078d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:37.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:37.876+0000 7faaa5ca9700 1 -- 172.21.15.99:0/1478930338 shutdown_connections 2024-01-31T05:09:37.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:37.876+0000 7faaa5ca9700 1 -- 172.21.15.99:0/1478930338 wait complete. 2024-01-31T05:09:37.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:37.876+0000 7faaa5ca9700 1 Processor -- start 2024-01-31T05:09:37.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:37.876+0000 7faaa5ca9700 1 -- start start 2024-01-31T05:09:37.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:37.877+0000 7faaa5ca9700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faaa0101830 0x7faaa0197d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:37.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:37.877+0000 7faaa5ca9700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faaa01021f0 0x7faaa01982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:37.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:37.877+0000 7faaa5ca9700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faaa0106700 0x7faaa019c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:37.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:37.877+0000 7faaa5ca9700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa019cc20 con 0x7faaa01021f0 2024-01-31T05:09:37.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:37.877+0000 7faaa5ca9700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa019cd90 con 0x7faaa0106700 2024-01-31T05:09:37.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:37.877+0000 7faaa5ca9700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa019cf50 con 0x7faaa0101830 2024-01-31T05:09:37.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:37.877+0000 7faa96ffd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faaa01021f0 0x7faaa01982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:37.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:37.877+0000 7faa96ffd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faaa01021f0 0x7faaa01982d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57520/0 (socket says 172.21.15.99:57520) 2024-01-31T05:09:37.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:37.877+0000 7faa96ffd700 1 -- 172.21.15.99:0/3242264615 learned_addr learned my addr 172.21.15.99:0/3242264615 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:09:37.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:37.877+0000 7faa9f7fe700 1 --2- 172.21.15.99:0/3242264615 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faaa0101830 0x7faaa0197d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:37.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:37.877+0000 7faa9ffff700 1 --2- 172.21.15.99:0/3242264615 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faaa0106700 0x7faaa019c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:37.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:37.877+0000 7faa96ffd700 1 -- 172.21.15.99:0/3242264615 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faaa0101830 msgr2=0x7faaa0197d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:37.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:37.877+0000 7faa96ffd700 1 --2- 172.21.15.99:0/3242264615 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faaa0101830 0x7faaa0197d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:37.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:37.877+0000 7faa96ffd700 1 -- 172.21.15.99:0/3242264615 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faaa0106700 msgr2=0x7faaa019c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:37.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:37.877+0000 7faa96ffd700 1 --2- 172.21.15.99:0/3242264615 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faaa0106700 0x7faaa019c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:37.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:37.877+0000 7faa96ffd700 1 -- 172.21.15.99:0/3242264615 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa98009d00 con 0x7faaa01021f0 2024-01-31T05:09:37.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:37.877+0000 7faa9f7fe700 1 --2- 172.21.15.99:0/3242264615 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faaa0101830 0x7faaa0197d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:09:37.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:37.877+0000 7faa96ffd700 1 --2- 172.21.15.99:0/3242264615 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faaa01021f0 0x7faaa01982d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7faa8800d950 tx=0x7faa8800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:37.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:37.877+0000 7faa9d7fa700 1 -- 172.21.15.99:0/3242264615 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa88009b40 con 0x7faaa01021f0 2024-01-31T05:09:37.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:37.878+0000 7faaa5ca9700 1 -- 172.21.15.99:0/3242264615 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaa019d230 con 0x7faaa01021f0 2024-01-31T05:09:37.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:37.878+0000 7faa9d7fa700 1 -- 172.21.15.99:0/3242264615 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa88009ca0 con 0x7faaa01021f0 2024-01-31T05:09:37.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:37.878+0000 7faa9d7fa700 1 -- 172.21.15.99:0/3242264615 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8800f620 con 0x7faaa01021f0 2024-01-31T05:09:37.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:37.878+0000 7faaa5ca9700 1 -- 172.21.15.99:0/3242264615 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa01a4a90 con 0x7faaa01021f0 2024-01-31T05:09:37.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:37.879+0000 7faaa5ca9700 1 -- 172.21.15.99:0/3242264615 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaa0109d70 con 0x7faaa01021f0 2024-01-31T05:09:37.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:37.880+0000 7faa9d7fa700 1 -- 172.21.15.99:0/3242264615 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7faa88010460 con 0x7faaa01021f0 2024-01-31T05:09:37.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:37.880+0000 7faa9d7fa700 1 --2- 172.21.15.99:0/3242264615 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7faa8c0a1400 0x7faa8c0a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:37.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:37.880+0000 7faa9f7fe700 1 --2- 172.21.15.99:0/3242264615 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7faa8c0a1400 0x7faa8c0a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:37.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:37.880+0000 7faa9d7fa700 1 -- 172.21.15.99:0/3242264615 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7faa880cce90 con 0x7faaa01021f0 2024-01-31T05:09:37.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:37.881+0000 7faa9f7fe700 1 --2- 172.21.15.99:0/3242264615 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7faa8c0a1400 0x7faa8c0a38c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7faa90005fd0 tx=0x7faa90005db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:37.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:37.885+0000 7faa9d7fa700 1 -- 172.21.15.99:0/3242264615 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7faa88096360 con 0x7faaa01021f0 2024-01-31T05:09:38.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:37 smithi099 ceph-mon[31615]: pgmap v294: 97 pgs: 97 active+clean; 627 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 8.3 KiB/s wr, 24 op/s 2024-01-31T05:09:38.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:37 smithi181 ceph-mon[36434]: pgmap v294: 97 pgs: 97 active+clean; 627 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 8.3 KiB/s wr, 24 op/s 2024-01-31T05:09:38.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:38.078+0000 7faaa5ca9700 1 -- 172.21.15.99:0/3242264615 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faaa01990a0 con 0x7faaa01021f0 2024-01-31T05:09:38.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:38.079+0000 7faa9d7fa700 1 -- 172.21.15.99:0/3242264615 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22132 (secure 0 0 0) 0x7faa88016090 con 0x7faaa01021f0 2024-01-31T05:09:38.079 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:09:38.079 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":86,"fsid":"9288ff44-bff5-11ee-95b3-87774f69a715","created":"2024-01-31T05:01:26.130917+0000","modified":"2024-01-31T05:09:21.567593+0000","last_up_change":"2024-01-31T05:08:31.228478+0000","last_in_change":"2024-01-31T05:08:10.799511+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:46.842423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:09:18.693558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-31T05:09:19.734003+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b45878d9-28f1-4821-ba72-26a32d3fc780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6803","nonce":1213805280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6805","nonce":1213805280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6809","nonce":1213805280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6807","nonce":1213805280}]},"public_addr":"172.21.15.99:6803/1213805280","cluster_addr":"172.21.15.99:6805/1213805280","heartbeat_back_addr":"172.21.15.99:6809/1213805280","heartbeat_front_addr":"172.21.15.99:6807/1213805280","state":["exists","up"]},{"osd":1,"uuid":"e0b71ff3-5d97-4659-8dea-4c9091e1beb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6801","nonce":2019451677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6803","nonce":2019451677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6807","nonce":2019451677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6805","nonce":2019451677}]},"public_addr":"172.21.15.179:6801/2019451677","cluster_addr":"172.21.15.179:6803/2019451677","heartbeat_back_addr":"172.21.15.179:6807/2019451677","heartbeat_front_addr":"172.21.15.179:6805/2019451677","state":["exists","up"]},{"osd":2,"uuid":"11c919c8-19a9-48b0-8880-3002efcb64f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6801","nonce":3934284457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6803","nonce":3934284457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6807","nonce":3934284457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6805","nonce":3934284457}]},"public_addr":"172.21.15.181:6801/3934284457","cluster_addr":"172.21.15.181:6803/3934284457","heartbeat_back_addr":"172.21.15.181:6807/3934284457","heartbeat_front_addr":"172.21.15.181:6805/3934284457","state":["exists","up"]},{"osd":3,"uuid":"bcab5135-a5d1-45ae-a9b8-674425d3999e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6811","nonce":4207675427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6813","nonce":4207675427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6817","nonce":4207675427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6815","nonce":4207675427}]},"public_addr":"172.21.15.99:6811/4207675427","cluster_addr":"172.21.15.99:6813/4207675427","heartbeat_back_addr":"172.21.15.99:6817/4207675427","heartbeat_front_addr":"172.21.15.99:6815/4207675427","state":["exists","up"]},{"osd":4,"uuid":"0250d7ac-3894-457a-9c04-cc7205d61eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6809","nonce":2861083896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6811","nonce":2861083896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6815","nonce":2861083896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6813","nonce":2861083896}]},"public_addr":"172.21.15.179:6809/2861083896","cluster_addr":"172.21.15.179:6811/2861083896","heartbeat_back_addr":"172.21.15.179:6815/2861083896","heartbeat_front_addr":"172.21.15.179:6813/2861083896","state":["exists","up"]},{"osd":5,"uuid":"5e19222a-c2a4-45bc-8445-1d302f26d11c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6809","nonce":1485017095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6811","nonce":1485017095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6815","nonce":1485017095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6813","nonce":1485017095}]},"public_addr":"172.21.15.181:6809/1485017095","cluster_addr":"172.21.15.181:6811/1485017095","heartbeat_back_addr":"172.21.15.181:6815/1485017095","heartbeat_front_addr":"172.21.15.181:6813/1485017095","state":["exists","up"]},{"osd":6,"uuid":"56555035-f9fc-4e91-96dd-caa632d58adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6819","nonce":1534047839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6821","nonce":1534047839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6825","nonce":1534047839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6823","nonce":1534047839}]},"public_addr":"172.21.15.99:6819/1534047839","cluster_addr":"172.21.15.99:6821/1534047839","heartbeat_back_addr":"172.21.15.99:6825/1534047839","heartbeat_front_addr":"172.21.15.99:6823/1534047839","state":["exists","up"]},{"osd":7,"uuid":"5e079cf5-1340-4599-88a6-df410ef0148e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6817","nonce":3875950553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6819","nonce":3875950553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6823","nonce":3875950553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6821","nonce":3875950553}]},"public_addr":"172.21.15.179:6817/3875950553","cluster_addr":"172.21.15.179:6819/3875950553","heartbeat_back_addr":"172.21.15.179:6823/3875950553","heartbeat_front_addr":"172.21.15.179:6821/3875950553","state":["exists","up"]},{"osd":8,"uuid":"10a73592-4251-4492-b67d-ce9b9d7fff32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6817","nonce":179568936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6819","nonce":179568936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6823","nonce":179568936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6821","nonce":179568936}]},"public_addr":"172.21.15.181:6817/179568936","cluster_addr":"172.21.15.181:6819/179568936","heartbeat_back_addr":"172.21.15.181:6823/179568936","heartbeat_front_addr":"172.21.15.181:6821/179568936","state":["exists","up"]},{"osd":9,"uuid":"f6620e1e-f761-4f1c-917f-cbc748df32a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6827","nonce":315759515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6829","nonce":315759515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6833","nonce":315759515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6831","nonce":315759515}]},"public_addr":"172.21.15.99:6827/315759515","cluster_addr":"172.21.15.99:6829/315759515","heartbeat_back_addr":"172.21.15.99:6833/315759515","heartbeat_front_addr":"172.21.15.99:6831/315759515","state":["exists","up"]},{"osd":10,"uuid":"ee86af7d-66f8-4795-bcc3-dfec79e4680c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6825","nonce":2985063934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6827","nonce":2985063934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6831","nonce":2985063934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6829","nonce":2985063934}]},"public_addr":"172.21.15.179:6825/2985063934","cluster_addr":"172.21.15.179:6827/2985063934","heartbeat_back_addr":"172.21.15.179:6831/2985063934","heartbeat_front_addr":"172.21.15.179:6829/2985063934","state":["exists","up"]},{"osd":11,"uuid":"82f04fee-f6ae-4630-a75b-b12a9c4ab2e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6825","nonce":1858219600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6827","nonce":1858219600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6831","nonce":1858219600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6829","nonce":1858219600}]},"public_addr":"172.21.15.181:6825/1858219600","cluster_addr":"172.21.15.181:6827/1858219600","heartbeat_back_addr":"172.21.15.181:6831/1858219600","heartbeat_front_addr":"172.21.15.181:6829/1858219600","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:55.518970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:04:19.936339+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:04:44.064814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:09.331683+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:34.616774+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:58.881810+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:06:23.869838+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:06:49.127331+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:07:12.847187+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:07:38.231045+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:08:03.949162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:08:28.471802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:0/401101729":"2024-02-01T05:02:20.510858+0000","172.21.15.99:6801/1993198206":"2024-02-01T05:02:20.510858+0000","172.21.15.99:0/3819754569":"2024-02-01T05:02:20.510858+0000","172.21.15.99:0/475390265":"2024-02-01T05:01:53.732026+0000","172.21.15.99:6800/1993198206":"2024-02-01T05:02:20.510858+0000","172.21.15.99:6800/1706888338":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/4150146075":"2024-02-01T05:01:53.732026+0000","172.21.15.99:6801/1706888338":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/2851066598":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/1865156424":"2024-02-01T05:02:20.510858+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:09:38.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:38.082+0000 7faaa5ca9700 1 -- 172.21.15.99:0/3242264615 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7faa8c0a1400 msgr2=0x7faa8c0a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:38.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:38.082+0000 7faaa5ca9700 1 --2- 172.21.15.99:0/3242264615 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7faa8c0a1400 0x7faa8c0a38c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7faa90005fd0 tx=0x7faa90005db0 comp rx=0 tx=0).stop 2024-01-31T05:09:38.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:38.082+0000 7faaa5ca9700 1 -- 172.21.15.99:0/3242264615 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faaa01021f0 msgr2=0x7faaa01982d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:38.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:38.082+0000 7faaa5ca9700 1 --2- 172.21.15.99:0/3242264615 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faaa01021f0 0x7faaa01982d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7faa8800d950 tx=0x7faa8800dd10 comp rx=0 tx=0).stop 2024-01-31T05:09:38.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:38.082+0000 7faaa5ca9700 1 -- 172.21.15.99:0/3242264615 shutdown_connections 2024-01-31T05:09:38.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:38.082+0000 7faaa5ca9700 1 --2- 172.21.15.99:0/3242264615 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7faa8c0a1400 0x7faa8c0a38c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:38.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:38.082+0000 7faaa5ca9700 1 --2- 172.21.15.99:0/3242264615 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faaa0106700 0x7faaa019c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:38.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:38.082+0000 7faaa5ca9700 1 --2- 172.21.15.99:0/3242264615 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faaa0101830 0x7faaa0197d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:38.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:38.082+0000 7faaa5ca9700 1 --2- 172.21.15.99:0/3242264615 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faaa01021f0 0x7faaa01982d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:38.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:38.082+0000 7faaa5ca9700 1 -- 172.21.15.99:0/3242264615 >> 172.21.15.99:0/3242264615 conn(0x7faaa0078910 msgr2=0x7faaa00ff8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:38.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:38.082+0000 7faaa5ca9700 1 -- 172.21.15.99:0/3242264615 shutdown_connections 2024-01-31T05:09:38.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:38.082+0000 7faaa5ca9700 1 -- 172.21.15.99:0/3242264615 wait complete. 2024-01-31T05:09:38.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:37 smithi179 ceph-mon[35652]: pgmap v294: 97 pgs: 97 active+clean; 627 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 8.3 KiB/s wr, 24 op/s 2024-01-31T05:09:38.705 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-01-31T05:09:38.705 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph osd dump --format=json 2024-01-31T05:09:38.942 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:09:39.064 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:38 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/3242264615' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:09:39.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:38 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/3242264615' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:09:39.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:38 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/3242264615' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:09:39.917 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:39 smithi099 ceph-mon[31615]: pgmap v295: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.7 KiB/s wr, 24 op/s 2024-01-31T05:09:40.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:39 smithi181 ceph-mon[36434]: pgmap v295: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.7 KiB/s wr, 24 op/s 2024-01-31T05:09:40.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:39 smithi179 ceph-mon[35652]: pgmap v295: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.7 KiB/s wr, 24 op/s 2024-01-31T05:09:40.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.667+0000 7f3f893f5700 1 -- 172.21.15.99:0/3231250500 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f841066c0 msgr2=0x7f3f84106aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:40.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.667+0000 7f3f893f5700 1 --2- 172.21.15.99:0/3231250500 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f841066c0 0x7f3f84106aa0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3f74009990 tx=0x7f3f74009ca0 comp rx=0 tx=0).stop 2024-01-31T05:09:40.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.668+0000 7f3f893f5700 1 -- 172.21.15.99:0/3231250500 shutdown_connections 2024-01-31T05:09:40.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.668+0000 7f3f893f5700 1 --2- 172.21.15.99:0/3231250500 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f841010d0 0x7f3f8410d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:40.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.668+0000 7f3f893f5700 1 --2- 172.21.15.99:0/3231250500 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f841066c0 0x7f3f84106aa0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:40.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.668+0000 7f3f893f5700 1 --2- 172.21.15.99:0/3231250500 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f84100710 0x7f3f84100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:40.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.668+0000 7f3f893f5700 1 -- 172.21.15.99:0/3231250500 >> 172.21.15.99:0/3231250500 conn(0x7f3f840766f0 msgr2=0x7f3f84076b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:40.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.668+0000 7f3f893f5700 1 -- 172.21.15.99:0/3231250500 shutdown_connections 2024-01-31T05:09:40.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.668+0000 7f3f893f5700 1 -- 172.21.15.99:0/3231250500 wait complete. 2024-01-31T05:09:40.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.668+0000 7f3f893f5700 1 Processor -- start 2024-01-31T05:09:40.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.668+0000 7f3f893f5700 1 -- start start 2024-01-31T05:09:40.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.669+0000 7f3f893f5700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f84100710 0x7f3f84198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:40.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.669+0000 7f3f893f5700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f841010d0 0x7f3f84198f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:40.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.669+0000 7f3f893f5700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f841066c0 0x7f3f841a3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:40.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.669+0000 7f3f893f5700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f841997e0 con 0x7f3f84100710 2024-01-31T05:09:40.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.669+0000 7f3f893f5700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f841a3fc0 con 0x7f3f841010d0 2024-01-31T05:09:40.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.669+0000 7f3f893f5700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f841a4100 con 0x7f3f841066c0 2024-01-31T05:09:40.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.669+0000 7f3f82ffd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f84100710 0x7f3f84198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:40.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.669+0000 7f3f82ffd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f84100710 0x7f3f84198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57544/0 (socket says 172.21.15.99:57544) 2024-01-31T05:09:40.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.669+0000 7f3f82ffd700 1 -- 172.21.15.99:0/167714931 learned_addr learned my addr 172.21.15.99:0/167714931 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:09:40.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.669+0000 7f3f837fe700 1 --2- 172.21.15.99:0/167714931 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f841066c0 0x7f3f841a3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:40.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.669+0000 7f3f827fc700 1 --2- 172.21.15.99:0/167714931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f841010d0 0x7f3f84198f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:40.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.669+0000 7f3f82ffd700 1 -- 172.21.15.99:0/167714931 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f841066c0 msgr2=0x7f3f841a3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:40.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.669+0000 7f3f82ffd700 1 --2- 172.21.15.99:0/167714931 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f841066c0 0x7f3f841a3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:40.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.669+0000 7f3f82ffd700 1 -- 172.21.15.99:0/167714931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f841010d0 msgr2=0x7f3f84198f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:40.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.669+0000 7f3f82ffd700 1 --2- 172.21.15.99:0/167714931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f841010d0 0x7f3f84198f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:40.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.669+0000 7f3f82ffd700 1 -- 172.21.15.99:0/167714931 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f740095f0 con 0x7f3f84100710 2024-01-31T05:09:40.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.669+0000 7f3f827fc700 1 --2- 172.21.15.99:0/167714931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f841010d0 0x7f3f84198f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:09:40.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.669+0000 7f3f82ffd700 1 --2- 172.21.15.99:0/167714931 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f84100710 0x7f3f84198a00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3f7400f670 tx=0x7f3f7400f750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:40.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.669+0000 7f3f6bfff700 1 -- 172.21.15.99:0/167714931 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7401d070 con 0x7f3f84100710 2024-01-31T05:09:40.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.669+0000 7f3f6bfff700 1 -- 172.21.15.99:0/167714931 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3f74005510 con 0x7f3f84100710 2024-01-31T05:09:40.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.669+0000 7f3f893f5700 1 -- 172.21.15.99:0/167714931 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f841a4350 con 0x7f3f84100710 2024-01-31T05:09:40.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.669+0000 7f3f6bfff700 1 -- 172.21.15.99:0/167714931 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f74004bd0 con 0x7f3f84100710 2024-01-31T05:09:40.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.669+0000 7f3f893f5700 1 -- 172.21.15.99:0/167714931 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f841a47f0 con 0x7f3f84100710 2024-01-31T05:09:40.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.670+0000 7f3f893f5700 1 -- 172.21.15.99:0/167714931 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f84108be0 con 0x7f3f84100710 2024-01-31T05:09:40.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.672+0000 7f3f6bfff700 1 -- 172.21.15.99:0/167714931 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f3f74004d30 con 0x7f3f84100710 2024-01-31T05:09:40.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.672+0000 7f3f6bfff700 1 --2- 172.21.15.99:0/167714931 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f3f6c0a1400 0x7f3f6c0a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:40.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.672+0000 7f3f827fc700 1 --2- 172.21.15.99:0/167714931 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f3f6c0a1400 0x7f3f6c0a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:40.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.672+0000 7f3f6bfff700 1 -- 172.21.15.99:0/167714931 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f3f740cdd60 con 0x7f3f84100710 2024-01-31T05:09:40.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.673+0000 7f3f827fc700 1 --2- 172.21.15.99:0/167714931 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f3f6c0a1400 0x7f3f6c0a38c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3f78005950 tx=0x7f3f780058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:40.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.676+0000 7f3f6bfff700 1 -- 172.21.15.99:0/167714931 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f3f740972c0 con 0x7f3f84100710 2024-01-31T05:09:40.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.871+0000 7f3f893f5700 1 -- 172.21.15.99:0/167714931 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f8406a530 con 0x7f3f84100710 2024-01-31T05:09:40.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.872+0000 7f3f6bfff700 1 -- 172.21.15.99:0/167714931 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22132 (secure 0 0 0) 0x7f3f7409a8e0 con 0x7f3f84100710 2024-01-31T05:09:40.872 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:09:40.872 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":86,"fsid":"9288ff44-bff5-11ee-95b3-87774f69a715","created":"2024-01-31T05:01:26.130917+0000","modified":"2024-01-31T05:09:21.567593+0000","last_up_change":"2024-01-31T05:08:31.228478+0000","last_in_change":"2024-01-31T05:08:10.799511+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:46.842423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:09:18.693558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-31T05:09:19.734003+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b45878d9-28f1-4821-ba72-26a32d3fc780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6803","nonce":1213805280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6805","nonce":1213805280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6809","nonce":1213805280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6807","nonce":1213805280}]},"public_addr":"172.21.15.99:6803/1213805280","cluster_addr":"172.21.15.99:6805/1213805280","heartbeat_back_addr":"172.21.15.99:6809/1213805280","heartbeat_front_addr":"172.21.15.99:6807/1213805280","state":["exists","up"]},{"osd":1,"uuid":"e0b71ff3-5d97-4659-8dea-4c9091e1beb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6801","nonce":2019451677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6803","nonce":2019451677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6807","nonce":2019451677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6805","nonce":2019451677}]},"public_addr":"172.21.15.179:6801/2019451677","cluster_addr":"172.21.15.179:6803/2019451677","heartbeat_back_addr":"172.21.15.179:6807/2019451677","heartbeat_front_addr":"172.21.15.179:6805/2019451677","state":["exists","up"]},{"osd":2,"uuid":"11c919c8-19a9-48b0-8880-3002efcb64f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6801","nonce":3934284457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6803","nonce":3934284457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6807","nonce":3934284457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6805","nonce":3934284457}]},"public_addr":"172.21.15.181:6801/3934284457","cluster_addr":"172.21.15.181:6803/3934284457","heartbeat_back_addr":"172.21.15.181:6807/3934284457","heartbeat_front_addr":"172.21.15.181:6805/3934284457","state":["exists","up"]},{"osd":3,"uuid":"bcab5135-a5d1-45ae-a9b8-674425d3999e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6811","nonce":4207675427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6813","nonce":4207675427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6817","nonce":4207675427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6815","nonce":4207675427}]},"public_addr":"172.21.15.99:6811/4207675427","cluster_addr":"172.21.15.99:6813/4207675427","heartbeat_back_addr":"172.21.15.99:6817/4207675427","heartbeat_front_addr":"172.21.15.99:6815/4207675427","state":["exists","up"]},{"osd":4,"uuid":"0250d7ac-3894-457a-9c04-cc7205d61eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6809","nonce":2861083896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6811","nonce":2861083896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6815","nonce":2861083896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6813","nonce":2861083896}]},"public_addr":"172.21.15.179:6809/2861083896","cluster_addr":"172.21.15.179:6811/2861083896","heartbeat_back_addr":"172.21.15.179:6815/2861083896","heartbeat_front_addr":"172.21.15.179:6813/2861083896","state":["exists","up"]},{"osd":5,"uuid":"5e19222a-c2a4-45bc-8445-1d302f26d11c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6809","nonce":1485017095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6811","nonce":1485017095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6815","nonce":1485017095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6813","nonce":1485017095}]},"public_addr":"172.21.15.181:6809/1485017095","cluster_addr":"172.21.15.181:6811/1485017095","heartbeat_back_addr":"172.21.15.181:6815/1485017095","heartbeat_front_addr":"172.21.15.181:6813/1485017095","state":["exists","up"]},{"osd":6,"uuid":"56555035-f9fc-4e91-96dd-caa632d58adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6819","nonce":1534047839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6821","nonce":1534047839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6825","nonce":1534047839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6823","nonce":1534047839}]},"public_addr":"172.21.15.99:6819/1534047839","cluster_addr":"172.21.15.99:6821/1534047839","heartbeat_back_addr":"172.21.15.99:6825/1534047839","heartbeat_front_addr":"172.21.15.99:6823/1534047839","state":["exists","up"]},{"osd":7,"uuid":"5e079cf5-1340-4599-88a6-df410ef0148e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6817","nonce":3875950553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6819","nonce":3875950553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6823","nonce":3875950553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6821","nonce":3875950553}]},"public_addr":"172.21.15.179:6817/3875950553","cluster_addr":"172.21.15.179:6819/3875950553","heartbeat_back_addr":"172.21.15.179:6823/3875950553","heartbeat_front_addr":"172.21.15.179:6821/3875950553","state":["exists","up"]},{"osd":8,"uuid":"10a73592-4251-4492-b67d-ce9b9d7fff32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6817","nonce":179568936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6819","nonce":179568936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6823","nonce":179568936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6821","nonce":179568936}]},"public_addr":"172.21.15.181:6817/179568936","cluster_addr":"172.21.15.181:6819/179568936","heartbeat_back_addr":"172.21.15.181:6823/179568936","heartbeat_front_addr":"172.21.15.181:6821/179568936","state":["exists","up"]},{"osd":9,"uuid":"f6620e1e-f761-4f1c-917f-cbc748df32a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6827","nonce":315759515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6829","nonce":315759515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6833","nonce":315759515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6831","nonce":315759515}]},"public_addr":"172.21.15.99:6827/315759515","cluster_addr":"172.21.15.99:6829/315759515","heartbeat_back_addr":"172.21.15.99:6833/315759515","heartbeat_front_addr":"172.21.15.99:6831/315759515","state":["exists","up"]},{"osd":10,"uuid":"ee86af7d-66f8-4795-bcc3-dfec79e4680c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6825","nonce":2985063934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6827","nonce":2985063934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6831","nonce":2985063934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6829","nonce":2985063934}]},"public_addr":"172.21.15.179:6825/2985063934","cluster_addr":"172.21.15.179:6827/2985063934","heartbeat_back_addr":"172.21.15.179:6831/2985063934","heartbeat_front_addr":"172.21.15.179:6829/2985063934","state":["exists","up"]},{"osd":11,"uuid":"82f04fee-f6ae-4630-a75b-b12a9c4ab2e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6825","nonce":1858219600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6827","nonce":1858219600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6831","nonce":1858219600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6829","nonce":1858219600}]},"public_addr":"172.21.15.181:6825/1858219600","cluster_addr":"172.21.15.181:6827/1858219600","heartbeat_back_addr":"172.21.15.181:6831/1858219600","heartbeat_front_addr":"172.21.15.181:6829/1858219600","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:55.518970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:04:19.936339+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:04:44.064814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:09.331683+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:34.616774+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:58.881810+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:06:23.869838+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:06:49.127331+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:07:12.847187+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:07:38.231045+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:08:03.949162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:08:28.471802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:0/401101729":"2024-02-01T05:02:20.510858+0000","172.21.15.99:6801/1993198206":"2024-02-01T05:02:20.510858+0000","172.21.15.99:0/3819754569":"2024-02-01T05:02:20.510858+0000","172.21.15.99:0/475390265":"2024-02-01T05:01:53.732026+0000","172.21.15.99:6800/1993198206":"2024-02-01T05:02:20.510858+0000","172.21.15.99:6800/1706888338":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/4150146075":"2024-02-01T05:01:53.732026+0000","172.21.15.99:6801/1706888338":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/2851066598":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/1865156424":"2024-02-01T05:02:20.510858+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:09:40.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.874+0000 7f3f893f5700 1 -- 172.21.15.99:0/167714931 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f3f6c0a1400 msgr2=0x7f3f6c0a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:40.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.874+0000 7f3f893f5700 1 --2- 172.21.15.99:0/167714931 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f3f6c0a1400 0x7f3f6c0a38c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3f78005950 tx=0x7f3f780058e0 comp rx=0 tx=0).stop 2024-01-31T05:09:40.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.874+0000 7f3f893f5700 1 -- 172.21.15.99:0/167714931 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f84100710 msgr2=0x7f3f84198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:40.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.874+0000 7f3f893f5700 1 --2- 172.21.15.99:0/167714931 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f84100710 0x7f3f84198a00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3f7400f670 tx=0x7f3f7400f750 comp rx=0 tx=0).stop 2024-01-31T05:09:40.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.874+0000 7f3f893f5700 1 -- 172.21.15.99:0/167714931 shutdown_connections 2024-01-31T05:09:40.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.874+0000 7f3f893f5700 1 --2- 172.21.15.99:0/167714931 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f841066c0 0x7f3f841a3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:40.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.874+0000 7f3f893f5700 1 --2- 172.21.15.99:0/167714931 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f84100710 0x7f3f84198a00 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:40.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.874+0000 7f3f893f5700 1 --2- 172.21.15.99:0/167714931 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f3f6c0a1400 0x7f3f6c0a38c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:40.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.874+0000 7f3f893f5700 1 --2- 172.21.15.99:0/167714931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f841010d0 0x7f3f84198f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:40.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.874+0000 7f3f893f5700 1 -- 172.21.15.99:0/167714931 >> 172.21.15.99:0/167714931 conn(0x7f3f840766f0 msgr2=0x7f3f840ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:40.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.874+0000 7f3f893f5700 1 -- 172.21.15.99:0/167714931 shutdown_connections 2024-01-31T05:09:40.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:40.874+0000 7f3f893f5700 1 -- 172.21.15.99:0/167714931 wait complete. 2024-01-31T05:09:41.564 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2024-01-31T05:09:41.565 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2024-01-31T05:09:41.565 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2024-01-31T05:09:41.565 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2024-01-31T05:09:41.609 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2024-01-31T05:09:41.609 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2024-01-31T05:09:41.609 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph tell osd.6 flush_pg_stats 2024-01-31T05:09:41.610 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph tell osd.7 flush_pg_stats 2024-01-31T05:09:41.610 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph tell osd.8 flush_pg_stats 2024-01-31T05:09:41.611 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph tell osd.9 flush_pg_stats 2024-01-31T05:09:41.611 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph tell osd.10 flush_pg_stats 2024-01-31T05:09:41.612 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph tell osd.11 flush_pg_stats 2024-01-31T05:09:41.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:41 smithi099 ceph-mon[31615]: pgmap v296: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.6 KiB/s wr, 16 op/s 2024-01-31T05:09:41.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:41 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/167714931' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:09:42.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:41 smithi181 ceph-mon[36434]: pgmap v296: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.6 KiB/s wr, 16 op/s 2024-01-31T05:09:42.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:41 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/167714931' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:09:42.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:41 smithi179 ceph-mon[35652]: pgmap v296: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.6 KiB/s wr, 16 op/s 2024-01-31T05:09:42.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:41 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/167714931' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:09:42.342 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:09:42.342 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:09:43.120 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:09:43.121 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:09:43.121 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:09:43.126 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:09:43.132 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:09:43.132 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:09:43.132 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:09:43.261 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:09:43.484 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:43 smithi099 ceph-mon[31615]: pgmap v297: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.6 KiB/s wr, 18 op/s 2024-01-31T05:09:43.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:43 smithi181 ceph-mon[36434]: pgmap v297: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.6 KiB/s wr, 18 op/s 2024-01-31T05:09:43.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:43 smithi179 ceph-mon[35652]: pgmap v297: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.6 KiB/s wr, 18 op/s 2024-01-31T05:09:45.351 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:09:45.986 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:45 smithi099 ceph-mon[31615]: pgmap v298: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.3 KiB/s wr, 11 op/s 2024-01-31T05:09:46.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:45 smithi181 ceph-mon[36434]: pgmap v298: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.3 KiB/s wr, 11 op/s 2024-01-31T05:09:46.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:45 smithi179 ceph-mon[35652]: pgmap v298: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.3 KiB/s wr, 11 op/s 2024-01-31T05:09:47.896 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:47 smithi099 ceph-mon[31615]: pgmap v299: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-01-31T05:09:48.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:47 smithi181 ceph-mon[36434]: pgmap v299: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-01-31T05:09:48.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:47 smithi179 ceph-mon[35652]: pgmap v299: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-01-31T05:09:49.744 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:49 smithi099 ceph-mon[31615]: pgmap v300: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-01-31T05:09:50.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:49 smithi181 ceph-mon[36434]: pgmap v300: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-01-31T05:09:50.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:49 smithi179 ceph-mon[35652]: pgmap v300: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-01-31T05:09:51.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.003+0000 7fd85151c700 1 -- 172.21.15.99:0/970496327 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd84c1077c0 msgr2=0x7fd84c107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:51.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.003+0000 7fd85151c700 1 --2- 172.21.15.99:0/970496327 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd84c1077c0 0x7fd84c107ba0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd83c009990 tx=0x7fd83c009ca0 comp rx=0 tx=0).stop 2024-01-31T05:09:51.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.003+0000 7fd85151c700 1 -- 172.21.15.99:0/970496327 shutdown_connections 2024-01-31T05:09:51.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.003+0000 7fd85151c700 1 --2- 172.21.15.99:0/970496327 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd84c102180 0x7fd84c10e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:51.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.003+0000 7fd85151c700 1 --2- 172.21.15.99:0/970496327 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd84c1077c0 0x7fd84c107ba0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:51.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.003+0000 7fd85151c700 1 --2- 172.21.15.99:0/970496327 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd84c1017c0 0x7fd84c101c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:51.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.003+0000 7fd85151c700 1 -- 172.21.15.99:0/970496327 >> 172.21.15.99:0/970496327 conn(0x7fd84c0fd290 msgr2=0x7fd84c0ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:51.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.003+0000 7fd85151c700 1 -- 172.21.15.99:0/970496327 shutdown_connections 2024-01-31T05:09:51.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.003+0000 7fd85151c700 1 -- 172.21.15.99:0/970496327 wait complete. 2024-01-31T05:09:51.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.004+0000 7fd85151c700 1 Processor -- start 2024-01-31T05:09:51.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.004+0000 7fd85151c700 1 -- start start 2024-01-31T05:09:51.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.004+0000 7fd85151c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd84c1017c0 0x7fd84c19d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:51.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.004+0000 7fd85151c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd84c102180 0x7fd84c19ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:51.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.004+0000 7fd85151c700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd84c1077c0 0x7fd84c197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:51.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.004+0000 7fd85151c700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84c1980b0 con 0x7fd84c1017c0 2024-01-31T05:09:51.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.004+0000 7fd85151c700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84c1981f0 con 0x7fd84c102180 2024-01-31T05:09:51.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.004+0000 7fd85151c700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84c1983b0 con 0x7fd84c1077c0 2024-01-31T05:09:51.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.004+0000 7fd84affd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd84c1017c0 0x7fd84c19d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:51.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.004+0000 7fd84affd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd84c1017c0 0x7fd84c19d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47114/0 (socket says 172.21.15.99:47114) 2024-01-31T05:09:51.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.004+0000 7fd84affd700 1 -- 172.21.15.99:0/587244050 learned_addr learned my addr 172.21.15.99:0/587244050 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:09:51.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.004+0000 7fd8427fc700 1 --2- 172.21.15.99:0/587244050 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd84c102180 0x7fd84c19ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:51.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.004+0000 7fd84affd700 1 -- 172.21.15.99:0/587244050 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd84c1077c0 msgr2=0x7fd84c197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:51.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.004+0000 7fd84affd700 1 --2- 172.21.15.99:0/587244050 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd84c1077c0 0x7fd84c197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:51.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.004+0000 7fd84affd700 1 -- 172.21.15.99:0/587244050 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd84c102180 msgr2=0x7fd84c19ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:51.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.004+0000 7fd84affd700 1 --2- 172.21.15.99:0/587244050 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd84c102180 0x7fd84c19ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:51.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.004+0000 7fd84affd700 1 -- 172.21.15.99:0/587244050 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd83c0095f0 con 0x7fd84c1017c0 2024-01-31T05:09:51.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.005+0000 7fd84affd700 1 --2- 172.21.15.99:0/587244050 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd84c1017c0 0x7fd84c19d890 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd83c0098e0 tx=0x7fd83c00f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:51.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.005+0000 7fd848ff9700 1 -- 172.21.15.99:0/587244050 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83c01d070 con 0x7fd84c1017c0 2024-01-31T05:09:51.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.005+0000 7fd85151c700 1 -- 172.21.15.99:0/587244050 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd84c198630 con 0x7fd84c1017c0 2024-01-31T05:09:51.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.005+0000 7fd848ff9700 1 -- 172.21.15.99:0/587244050 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd83c00fb90 con 0x7fd84c1017c0 2024-01-31T05:09:51.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.005+0000 7fd848ff9700 1 -- 172.21.15.99:0/587244050 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83c017650 con 0x7fd84c1017c0 2024-01-31T05:09:51.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.005+0000 7fd85151c700 1 -- 172.21.15.99:0/587244050 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd84c1a4930 con 0x7fd84c1017c0 2024-01-31T05:09:51.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.006+0000 7fd85151c700 1 -- 172.21.15.99:0/587244050 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd84c102f00 con 0x7fd84c1017c0 2024-01-31T05:09:51.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.007+0000 7fd848ff9700 1 -- 172.21.15.99:0/587244050 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7fd83c00fd00 con 0x7fd84c1017c0 2024-01-31T05:09:51.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.007+0000 7fd848ff9700 1 --2- 172.21.15.99:0/587244050 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd8380a1400 0x7fd8380a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:51.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.007+0000 7fd8427fc700 1 --2- 172.21.15.99:0/587244050 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd8380a1400 0x7fd8380a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:51.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.008+0000 7fd848ff9700 1 -- 172.21.15.99:0/587244050 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd83c0ce270 con 0x7fd84c1017c0 2024-01-31T05:09:51.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.008+0000 7fd848ff9700 1 --2- 172.21.15.99:0/587244050 >> [v2:172.21.15.181:6816/179568936,v1:172.21.15.181:6817/179568936] conn(0x7fd8380aabe0 0x7fd8380ad000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:51.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.008+0000 7fd848ff9700 1 -- 172.21.15.99:0/587244050 --> [v2:172.21.15.181:6816/179568936,v1:172.21.15.181:6817/179568936] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd8380ad6b0 con 0x7fd8380aabe0 2024-01-31T05:09:51.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.008+0000 7fd848ff9700 1 -- 172.21.15.99:0/587244050 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd83c0ce710 con 0x7fd84c1017c0 2024-01-31T05:09:51.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.008+0000 7fd8427fc700 1 --2- 172.21.15.99:0/587244050 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd8380a1400 0x7fd8380a38c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd834005950 tx=0x7fd8340058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:51.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.008+0000 7fd84b7fe700 1 --2- 172.21.15.99:0/587244050 >> [v2:172.21.15.181:6816/179568936,v1:172.21.15.181:6817/179568936] conn(0x7fd8380aabe0 0x7fd8380ad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:51.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.010+0000 7fd84b7fe700 1 --2- 172.21.15.99:0/587244050 >> [v2:172.21.15.181:6816/179568936,v1:172.21.15.181:6817/179568936] conn(0x7fd8380aabe0 0x7fd8380ad000 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:51.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.013+0000 7fd848ff9700 1 -- 172.21.15.99:0/587244050 <== osd.8 v2:172.21.15.181:6816/179568936 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fd8380ad6b0 con 0x7fd8380aabe0 2024-01-31T05:09:51.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.029+0000 7fd85151c700 1 -- 172.21.15.99:0/587244050 --> [v2:172.21.15.181:6816/179568936,v1:172.21.15.181:6817/179568936] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd84c111a60 con 0x7fd8380aabe0 2024-01-31T05:09:51.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.030+0000 7fd848ff9700 1 -- 172.21.15.99:0/587244050 <== osd.8 v2:172.21.15.181:6816/179568936 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fd84c111a60 con 0x7fd8380aabe0 2024-01-31T05:09:51.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.030+0000 7fd85151c700 1 -- 172.21.15.99:0/587244050 >> [v2:172.21.15.181:6816/179568936,v1:172.21.15.181:6817/179568936] conn(0x7fd8380aabe0 msgr2=0x7fd8380ad000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:51.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.030+0000 7fd85151c700 1 --2- 172.21.15.99:0/587244050 >> [v2:172.21.15.181:6816/179568936,v1:172.21.15.181:6817/179568936] conn(0x7fd8380aabe0 0x7fd8380ad000 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:51.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.030+0000 7fd85151c700 1 -- 172.21.15.99:0/587244050 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd8380a1400 msgr2=0x7fd8380a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:51.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.030+0000 7fd85151c700 1 --2- 172.21.15.99:0/587244050 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd8380a1400 0x7fd8380a38c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd834005950 tx=0x7fd8340058e0 comp rx=0 tx=0).stop 2024-01-31T05:09:51.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.030+0000 7fd85151c700 1 -- 172.21.15.99:0/587244050 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd84c1017c0 msgr2=0x7fd84c19d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:51.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.030+0000 7fd85151c700 1 --2- 172.21.15.99:0/587244050 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd84c1017c0 0x7fd84c19d890 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd83c0098e0 tx=0x7fd83c00f720 comp rx=0 tx=0).stop 2024-01-31T05:09:51.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.030+0000 7fd84b7fe700 1 -- 172.21.15.99:0/587244050 reap_dead start 2024-01-31T05:09:51.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.030+0000 7fd85151c700 1 -- 172.21.15.99:0/587244050 shutdown_connections 2024-01-31T05:09:51.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.030+0000 7fd85151c700 1 -- 172.21.15.99:0/587244050 >> 172.21.15.99:0/587244050 conn(0x7fd84c0fd290 msgr2=0x7fd84c0fdb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:51.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.030+0000 7fd85151c700 1 -- 172.21.15.99:0/587244050 shutdown_connections 2024-01-31T05:09:51.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.030+0000 7fd85151c700 1 -- 172.21.15.99:0/587244050 wait complete. 2024-01-31T05:09:51.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.632+0000 7fddc7b18700 1 -- 172.21.15.99:0/1026748035 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fddc010bed0 msgr2=0x7fddc010e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:51.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.632+0000 7fddc7b18700 1 --2- 172.21.15.99:0/1026748035 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fddc010bed0 0x7fddc010e300 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fddb800b0a0 tx=0x7fddb800b3b0 comp rx=0 tx=0).stop 2024-01-31T05:09:51.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.632+0000 7fddc7b18700 1 -- 172.21.15.99:0/1026748035 shutdown_connections 2024-01-31T05:09:51.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.632+0000 7fddc7b18700 1 --2- 172.21.15.99:0/1026748035 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fddc010bed0 0x7fddc010e300 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:51.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.632+0000 7fddc7b18700 1 --2- 172.21.15.99:0/1026748035 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddc0102af0 0x7fddc0102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:51.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.632+0000 7fddc7b18700 1 --2- 172.21.15.99:0/1026748035 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fddc0103410 0x7fddc010b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:51.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.632+0000 7fddc7b18700 1 -- 172.21.15.99:0/1026748035 >> 172.21.15.99:0/1026748035 conn(0x7fddc0077810 msgr2=0x7fddc0077c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:51.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.632+0000 7fddc7b18700 1 -- 172.21.15.99:0/1026748035 shutdown_connections 2024-01-31T05:09:51.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.632+0000 7fddc7b18700 1 -- 172.21.15.99:0/1026748035 wait complete. 2024-01-31T05:09:51.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.632+0000 7fddc7b18700 1 Processor -- start 2024-01-31T05:09:51.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.632+0000 7fddc7b18700 1 -- start start 2024-01-31T05:09:51.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.633+0000 7fddc7b18700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddc0102af0 0x7fddc0100750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:51.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.633+0000 7fddc7b18700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fddc0103410 0x7fddc0100c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:51.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.633+0000 7fddc7b18700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fddc010bed0 0x7fddc01011d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:51.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.633+0000 7fddc7b18700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc01a6210 con 0x7fddc0103410 2024-01-31T05:09:51.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.633+0000 7fddc7b18700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc01a6380 con 0x7fddc0102af0 2024-01-31T05:09:51.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.633+0000 7fddc7b18700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc01a6540 con 0x7fddc010bed0 2024-01-31T05:09:51.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.633+0000 7fddc50b3700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fddc0103410 0x7fddc0100c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:51.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.633+0000 7fddc50b3700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fddc0103410 0x7fddc0100c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47132/0 (socket says 172.21.15.99:47132) 2024-01-31T05:09:51.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.633+0000 7fddc50b3700 1 -- 172.21.15.99:0/618650545 learned_addr learned my addr 172.21.15.99:0/618650545 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:09:51.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.633+0000 7fddc60b5700 1 --2- 172.21.15.99:0/618650545 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fddc010bed0 0x7fddc01011d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:51.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.633+0000 7fddc58b4700 1 --2- 172.21.15.99:0/618650545 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddc0102af0 0x7fddc0100750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:51.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.633+0000 7fddc50b3700 1 -- 172.21.15.99:0/618650545 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fddc010bed0 msgr2=0x7fddc01011d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:51.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.633+0000 7fddc50b3700 1 --2- 172.21.15.99:0/618650545 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fddc010bed0 0x7fddc01011d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:51.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.633+0000 7fddc50b3700 1 -- 172.21.15.99:0/618650545 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddc0102af0 msgr2=0x7fddc0100750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:51.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.633+0000 7fddc50b3700 1 --2- 172.21.15.99:0/618650545 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddc0102af0 0x7fddc0100750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:51.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.633+0000 7fddc50b3700 1 -- 172.21.15.99:0/618650545 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb8009d00 con 0x7fddc0103410 2024-01-31T05:09:51.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.633+0000 7fddc58b4700 1 --2- 172.21.15.99:0/618650545 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddc0102af0 0x7fddc0100750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:09:51.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.633+0000 7fddc60b5700 1 --2- 172.21.15.99:0/618650545 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fddc010bed0 0x7fddc01011d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:09:51.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.633+0000 7fddc50b3700 1 --2- 172.21.15.99:0/618650545 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fddc0103410 0x7fddc0100c90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fddb000c8f0 tx=0x7fddb000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:51.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.633+0000 7fddb6ffd700 1 -- 172.21.15.99:0/618650545 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb0007b00 con 0x7fddc0103410 2024-01-31T05:09:51.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.633+0000 7fddb6ffd700 1 -- 172.21.15.99:0/618650545 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fddb0007c60 con 0x7fddc0103410 2024-01-31T05:09:51.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.633+0000 7fddc7b18700 1 -- 172.21.15.99:0/618650545 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddc01a6820 con 0x7fddc0103410 2024-01-31T05:09:51.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.633+0000 7fddb6ffd700 1 -- 172.21.15.99:0/618650545 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb0018660 con 0x7fddc0103410 2024-01-31T05:09:51.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.633+0000 7fddc7b18700 1 -- 172.21.15.99:0/618650545 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddc01a6d70 con 0x7fddc0103410 2024-01-31T05:09:51.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.634+0000 7fddb4ff9700 1 -- 172.21.15.99:0/618650545 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fddc0111a90 con 0x7fddc0103410 2024-01-31T05:09:51.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.635+0000 7fddb6ffd700 1 -- 172.21.15.99:0/618650545 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7fddb000f450 con 0x7fddc0103410 2024-01-31T05:09:51.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.636+0000 7fddb6ffd700 1 --2- 172.21.15.99:0/618650545 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fddac0a1480 0x7fddac0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:51.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.636+0000 7fddc58b4700 1 --2- 172.21.15.99:0/618650545 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fddac0a1480 0x7fddac0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:51.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.636+0000 7fddb6ffd700 1 -- 172.21.15.99:0/618650545 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fddb00ccd40 con 0x7fddc0103410 2024-01-31T05:09:51.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.636+0000 7fddb6ffd700 1 --2- 172.21.15.99:0/618650545 >> [v2:172.21.15.99:6826/315759515,v1:172.21.15.99:6827/315759515] conn(0x7fddac0aac60 0x7fddac0ad080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:51.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.636+0000 7fddb6ffd700 1 -- 172.21.15.99:0/618650545 --> [v2:172.21.15.99:6826/315759515,v1:172.21.15.99:6827/315759515] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fddac0ad730 con 0x7fddac0aac60 2024-01-31T05:09:51.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.636+0000 7fddb6ffd700 1 -- 172.21.15.99:0/618650545 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7fddb00cd1e0 con 0x7fddc0103410 2024-01-31T05:09:51.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.636+0000 7fddc60b5700 1 --2- 172.21.15.99:0/618650545 >> [v2:172.21.15.99:6826/315759515,v1:172.21.15.99:6827/315759515] conn(0x7fddac0aac60 0x7fddac0ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:51.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.636+0000 7fddc58b4700 1 --2- 172.21.15.99:0/618650545 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fddac0a1480 0x7fddac0a3940 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fddbc007900 tx=0x7fddbc008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:51.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.637+0000 7fddc60b5700 1 --2- 172.21.15.99:0/618650545 >> [v2:172.21.15.99:6826/315759515,v1:172.21.15.99:6827/315759515] conn(0x7fddac0aac60 0x7fddac0ad080 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:51.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.637+0000 7fddb6ffd700 1 -- 172.21.15.99:0/618650545 <== osd.9 v2:172.21.15.99:6826/315759515 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fddac0ad730 con 0x7fddac0aac60 2024-01-31T05:09:51.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.653+0000 7fddb4ff9700 1 -- 172.21.15.99:0/618650545 --> [v2:172.21.15.99:6826/315759515,v1:172.21.15.99:6827/315759515] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fddc0061e70 con 0x7fddac0aac60 2024-01-31T05:09:51.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.654+0000 7fddb6ffd700 1 -- 172.21.15.99:0/618650545 <== osd.9 v2:172.21.15.99:6826/315759515 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fddc0061e70 con 0x7fddac0aac60 2024-01-31T05:09:51.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.654+0000 7fddb4ff9700 1 -- 172.21.15.99:0/618650545 >> [v2:172.21.15.99:6826/315759515,v1:172.21.15.99:6827/315759515] conn(0x7fddac0aac60 msgr2=0x7fddac0ad080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:51.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.654+0000 7fddb4ff9700 1 --2- 172.21.15.99:0/618650545 >> [v2:172.21.15.99:6826/315759515,v1:172.21.15.99:6827/315759515] conn(0x7fddac0aac60 0x7fddac0ad080 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:51.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.654+0000 7fddb4ff9700 1 -- 172.21.15.99:0/618650545 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fddac0a1480 msgr2=0x7fddac0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:51.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.654+0000 7fddb4ff9700 1 --2- 172.21.15.99:0/618650545 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fddac0a1480 0x7fddac0a3940 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fddbc007900 tx=0x7fddbc008040 comp rx=0 tx=0).stop 2024-01-31T05:09:51.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.654+0000 7fddb4ff9700 1 -- 172.21.15.99:0/618650545 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fddc0103410 msgr2=0x7fddc0100c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:51.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.654+0000 7fddb4ff9700 1 --2- 172.21.15.99:0/618650545 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fddc0103410 0x7fddc0100c90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fddb000c8f0 tx=0x7fddb000ccb0 comp rx=0 tx=0).stop 2024-01-31T05:09:51.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.654+0000 7fddc60b5700 1 -- 172.21.15.99:0/618650545 reap_dead start 2024-01-31T05:09:51.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.654+0000 7fddb4ff9700 1 -- 172.21.15.99:0/618650545 shutdown_connections 2024-01-31T05:09:51.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.654+0000 7fddb4ff9700 1 -- 172.21.15.99:0/618650545 >> 172.21.15.99:0/618650545 conn(0x7fddc0077810 msgr2=0x7fddc00fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:51.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.654+0000 7fddb4ff9700 1 -- 172.21.15.99:0/618650545 shutdown_connections 2024-01-31T05:09:51.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:51.654+0000 7fddb4ff9700 1 -- 172.21.15.99:0/618650545 wait complete. 2024-01-31T05:09:51.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:51 smithi099 ceph-mon[31615]: pgmap v301: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2024-01-31T05:09:52.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:51 smithi181 ceph-mon[36434]: pgmap v301: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2024-01-31T05:09:52.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:51 smithi179 ceph-mon[35652]: pgmap v301: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2024-01-31T05:09:52.935 INFO:teuthology.orchestra.run.smithi099.stdout:253403070499 2024-01-31T05:09:52.936 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph osd last-stat-seq osd.8 2024-01-31T05:09:53.341 INFO:teuthology.orchestra.run.smithi099.stdout:287762808862 2024-01-31T05:09:53.341 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph osd last-stat-seq osd.9 2024-01-31T05:09:53.452 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:53 smithi099 ceph-mon[31615]: pgmap v302: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-01-31T05:09:53.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:53 smithi181 ceph-mon[36434]: pgmap v302: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-01-31T05:09:53.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:53 smithi179 ceph-mon[35652]: pgmap v302: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-01-31T05:09:55.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.046+0000 7f2df20c6700 1 -- 172.21.15.99:0/2305323704 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2dec101830 msgr2=0x7f2dec101cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:55.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.046+0000 7f2df20c6700 1 --2- 172.21.15.99:0/2305323704 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2dec101830 0x7f2dec101cb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2de00099c0 tx=0x7f2de0009cd0 comp rx=0 tx=0).stop 2024-01-31T05:09:55.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.046+0000 7f2df20c6700 1 -- 172.21.15.99:0/2305323704 shutdown_connections 2024-01-31T05:09:55.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.046+0000 7f2df20c6700 1 --2- 172.21.15.99:0/2305323704 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2dec1021f0 0x7f2dec10e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:55.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.046+0000 7f2df20c6700 1 --2- 172.21.15.99:0/2305323704 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2dec106650 0x7f2dec106a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:55.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.046+0000 7f2df20c6700 1 --2- 172.21.15.99:0/2305323704 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2dec101830 0x7f2dec101cb0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:55.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.046+0000 7f2df20c6700 1 -- 172.21.15.99:0/2305323704 >> 172.21.15.99:0/2305323704 conn(0x7f2dec078910 msgr2=0x7f2dec078d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:55.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.046+0000 7f2df20c6700 1 -- 172.21.15.99:0/2305323704 shutdown_connections 2024-01-31T05:09:55.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.046+0000 7f2df20c6700 1 -- 172.21.15.99:0/2305323704 wait complete. 2024-01-31T05:09:55.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.047+0000 7f2df20c6700 1 Processor -- start 2024-01-31T05:09:55.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.047+0000 7f2df20c6700 1 -- start start 2024-01-31T05:09:55.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.047+0000 7f2df20c6700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2dec101830 0x7f2dec19d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:55.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.047+0000 7f2df20c6700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2dec1021f0 0x7f2dec19ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:55.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.047+0000 7f2df20c6700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2dec106650 0x7f2dec197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:55.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.047+0000 7f2df20c6700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dec198090 con 0x7f2dec101830 2024-01-31T05:09:55.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.047+0000 7f2df20c6700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dec1981d0 con 0x7f2dec1021f0 2024-01-31T05:09:55.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.047+0000 7f2df20c6700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dec198390 con 0x7f2dec106650 2024-01-31T05:09:55.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.047+0000 7f2deb7fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2dec101830 0x7f2dec19d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:55.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.047+0000 7f2debfff700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2dec106650 0x7f2dec197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:55.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.047+0000 7f2deb7fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2dec101830 0x7f2dec19d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47154/0 (socket says 172.21.15.99:47154) 2024-01-31T05:09:55.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.047+0000 7f2deb7fe700 1 -- 172.21.15.99:0/1317603121 learned_addr learned my addr 172.21.15.99:0/1317603121 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:09:55.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.047+0000 7f2deaffd700 1 --2- 172.21.15.99:0/1317603121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2dec1021f0 0x7f2dec19ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:55.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.048+0000 7f2deb7fe700 1 -- 172.21.15.99:0/1317603121 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2dec106650 msgr2=0x7f2dec197a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:55.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.048+0000 7f2deb7fe700 1 --2- 172.21.15.99:0/1317603121 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2dec106650 0x7f2dec197a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:55.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.048+0000 7f2deb7fe700 1 -- 172.21.15.99:0/1317603121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2dec1021f0 msgr2=0x7f2dec19ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:55.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.048+0000 7f2deb7fe700 1 --2- 172.21.15.99:0/1317603121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2dec1021f0 0x7f2dec19ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:55.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.048+0000 7f2deb7fe700 1 -- 172.21.15.99:0/1317603121 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de00095f0 con 0x7f2dec101830 2024-01-31T05:09:55.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.048+0000 7f2deb7fe700 1 --2- 172.21.15.99:0/1317603121 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2dec101830 0x7f2dec19d870 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc00d980 tx=0x7f2ddc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:55.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.048+0000 7f2de8ff9700 1 -- 172.21.15.99:0/1317603121 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc004220 con 0x7f2dec101830 2024-01-31T05:09:55.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.048+0000 7f2de8ff9700 1 -- 172.21.15.99:0/1317603121 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2ddc007640 con 0x7f2dec101830 2024-01-31T05:09:55.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.048+0000 7f2df20c6700 1 -- 172.21.15.99:0/1317603121 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dec198670 con 0x7f2dec101830 2024-01-31T05:09:55.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.048+0000 7f2de8ff9700 1 -- 172.21.15.99:0/1317603121 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc005690 con 0x7f2dec101830 2024-01-31T05:09:55.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.048+0000 7f2df20c6700 1 -- 172.21.15.99:0/1317603121 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dec1a4910 con 0x7f2dec101830 2024-01-31T05:09:55.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.049+0000 7f2df20c6700 1 -- 172.21.15.99:0/1317603121 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2dec102ec0 con 0x7f2dec101830 2024-01-31T05:09:55.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.050+0000 7f2de8ff9700 1 -- 172.21.15.99:0/1317603121 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f2ddc004750 con 0x7f2dec101830 2024-01-31T05:09:55.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.050+0000 7f2de8ff9700 1 --2- 172.21.15.99:0/1317603121 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2dd40a1480 0x7f2dd40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:55.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.051+0000 7f2deaffd700 1 --2- 172.21.15.99:0/1317603121 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2dd40a1480 0x7f2dd40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:55.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.051+0000 7f2de8ff9700 1 -- 172.21.15.99:0/1317603121 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f2ddc0cce20 con 0x7f2dec101830 2024-01-31T05:09:55.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.051+0000 7f2de8ff9700 1 --2- 172.21.15.99:0/1317603121 >> [v2:172.21.15.179:6800/2019451677,v1:172.21.15.179:6801/2019451677] conn(0x7f2dd40aac60 0x7f2dd40ad080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:55.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.051+0000 7f2de8ff9700 1 -- 172.21.15.99:0/1317603121 --> [v2:172.21.15.179:6800/2019451677,v1:172.21.15.179:6801/2019451677] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2dd40ad730 con 0x7f2dd40aac60 2024-01-31T05:09:55.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.051+0000 7f2de8ff9700 1 -- 172.21.15.99:0/1317603121 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ddc0cd2c0 con 0x7f2dec101830 2024-01-31T05:09:55.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.051+0000 7f2deaffd700 1 --2- 172.21.15.99:0/1317603121 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2dd40a1480 0x7f2dd40a3940 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2de0009990 tx=0x7f2de0003680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:55.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.051+0000 7f2debfff700 1 --2- 172.21.15.99:0/1317603121 >> [v2:172.21.15.179:6800/2019451677,v1:172.21.15.179:6801/2019451677] conn(0x7f2dd40aac60 0x7f2dd40ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:55.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.051+0000 7f2debfff700 1 --2- 172.21.15.99:0/1317603121 >> [v2:172.21.15.179:6800/2019451677,v1:172.21.15.179:6801/2019451677] conn(0x7f2dd40aac60 0x7f2dd40ad080 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:55.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.052+0000 7f2de8ff9700 1 -- 172.21.15.99:0/1317603121 <== osd.1 v2:172.21.15.179:6800/2019451677 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f2dd40ad730 con 0x7f2dd40aac60 2024-01-31T05:09:55.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.069+0000 7f2df20c6700 1 -- 172.21.15.99:0/1317603121 --> [v2:172.21.15.179:6800/2019451677,v1:172.21.15.179:6801/2019451677] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2dec1119e0 con 0x7f2dd40aac60 2024-01-31T05:09:55.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.070+0000 7f2de8ff9700 1 -- 172.21.15.99:0/1317603121 <== osd.1 v2:172.21.15.179:6800/2019451677 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2dec1119e0 con 0x7f2dd40aac60 2024-01-31T05:09:55.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.070+0000 7f2df20c6700 1 -- 172.21.15.99:0/1317603121 >> [v2:172.21.15.179:6800/2019451677,v1:172.21.15.179:6801/2019451677] conn(0x7f2dd40aac60 msgr2=0x7f2dd40ad080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:55.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.070+0000 7f2df20c6700 1 --2- 172.21.15.99:0/1317603121 >> [v2:172.21.15.179:6800/2019451677,v1:172.21.15.179:6801/2019451677] conn(0x7f2dd40aac60 0x7f2dd40ad080 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:55.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.070+0000 7f2df20c6700 1 -- 172.21.15.99:0/1317603121 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2dd40a1480 msgr2=0x7f2dd40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:55.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.070+0000 7f2df20c6700 1 --2- 172.21.15.99:0/1317603121 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2dd40a1480 0x7f2dd40a3940 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2de0009990 tx=0x7f2de0003680 comp rx=0 tx=0).stop 2024-01-31T05:09:55.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.070+0000 7f2df20c6700 1 -- 172.21.15.99:0/1317603121 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2dec101830 msgr2=0x7f2dec19d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:55.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.070+0000 7f2df20c6700 1 --2- 172.21.15.99:0/1317603121 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2dec101830 0x7f2dec19d870 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc00d980 tx=0x7f2ddc00dc90 comp rx=0 tx=0).stop 2024-01-31T05:09:55.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.070+0000 7f2debfff700 1 -- 172.21.15.99:0/1317603121 reap_dead start 2024-01-31T05:09:55.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.070+0000 7f2df20c6700 1 -- 172.21.15.99:0/1317603121 shutdown_connections 2024-01-31T05:09:55.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.070+0000 7f2df20c6700 1 -- 172.21.15.99:0/1317603121 >> 172.21.15.99:0/1317603121 conn(0x7f2dec078910 msgr2=0x7f2dec0ff920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:55.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.071+0000 7f2df20c6700 1 -- 172.21.15.99:0/1317603121 shutdown_connections 2024-01-31T05:09:55.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:55.071+0000 7f2df20c6700 1 -- 172.21.15.99:0/1317603121 wait complete. 2024-01-31T05:09:55.936 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:55 smithi099 ceph-mon[31615]: pgmap v303: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-01-31T05:09:56.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:55 smithi181 ceph-mon[36434]: pgmap v303: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-01-31T05:09:56.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:55 smithi179 ceph-mon[35652]: pgmap v303: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-01-31T05:09:57.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.462+0000 7fd1973b5700 1 -- 172.21.15.99:0/2522483826 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1901077c0 msgr2=0x7fd190107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:57.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.462+0000 7fd1973b5700 1 --2- 172.21.15.99:0/2522483826 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1901077c0 0x7fd190107ba0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd18c009990 tx=0x7fd18c009ca0 comp rx=0 tx=0).stop 2024-01-31T05:09:57.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.462+0000 7fd1973b5700 1 -- 172.21.15.99:0/2522483826 shutdown_connections 2024-01-31T05:09:57.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.462+0000 7fd1973b5700 1 --2- 172.21.15.99:0/2522483826 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd190102180 0x7fd19010e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:57.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.462+0000 7fd1973b5700 1 --2- 172.21.15.99:0/2522483826 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1901077c0 0x7fd190107ba0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:57.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.462+0000 7fd1973b5700 1 --2- 172.21.15.99:0/2522483826 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1901017c0 0x7fd190101c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:57.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.462+0000 7fd1973b5700 1 -- 172.21.15.99:0/2522483826 >> 172.21.15.99:0/2522483826 conn(0x7fd1900fd290 msgr2=0x7fd1900ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:57.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.462+0000 7fd1973b5700 1 -- 172.21.15.99:0/2522483826 shutdown_connections 2024-01-31T05:09:57.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.462+0000 7fd1973b5700 1 -- 172.21.15.99:0/2522483826 wait complete. 2024-01-31T05:09:57.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.462+0000 7fd1973b5700 1 Processor -- start 2024-01-31T05:09:57.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.462+0000 7fd1973b5700 1 -- start start 2024-01-31T05:09:57.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.463+0000 7fd1973b5700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1901017c0 0x7fd19019d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:57.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.463+0000 7fd1973b5700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd190102180 0x7fd19019dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:57.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.463+0000 7fd1973b5700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1901077c0 0x7fd190197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:57.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.463+0000 7fd1973b5700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd190198070 con 0x7fd190102180 2024-01-31T05:09:57.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.463+0000 7fd1973b5700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1901981b0 con 0x7fd1901077c0 2024-01-31T05:09:57.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.463+0000 7fd1973b5700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd190198370 con 0x7fd1901017c0 2024-01-31T05:09:57.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.463+0000 7fd194950700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd190102180 0x7fd19019dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:57.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.463+0000 7fd194950700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd190102180 0x7fd19019dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51590/0 (socket says 172.21.15.99:51590) 2024-01-31T05:09:57.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.463+0000 7fd194950700 1 -- 172.21.15.99:0/4266631207 learned_addr learned my addr 172.21.15.99:0/4266631207 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:09:57.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.463+0000 7fd195952700 1 --2- 172.21.15.99:0/4266631207 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1901077c0 0x7fd190197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:57.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.463+0000 7fd194950700 1 -- 172.21.15.99:0/4266631207 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1901017c0 msgr2=0x7fd19019d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:57.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.463+0000 7fd195151700 1 --2- 172.21.15.99:0/4266631207 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1901017c0 0x7fd19019d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:57.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.463+0000 7fd194950700 1 --2- 172.21.15.99:0/4266631207 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1901017c0 0x7fd19019d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:57.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.463+0000 7fd194950700 1 -- 172.21.15.99:0/4266631207 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1901077c0 msgr2=0x7fd190197a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:57.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.463+0000 7fd194950700 1 --2- 172.21.15.99:0/4266631207 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1901077c0 0x7fd190197a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:57.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.463+0000 7fd194950700 1 -- 172.21.15.99:0/4266631207 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd18c0095f0 con 0x7fd190102180 2024-01-31T05:09:57.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.463+0000 7fd195151700 1 --2- 172.21.15.99:0/4266631207 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1901017c0 0x7fd19019d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:09:57.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.463+0000 7fd194950700 1 --2- 172.21.15.99:0/4266631207 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd190102180 0x7fd19019dd90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd18000c920 tx=0x7fd18000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:57.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.463+0000 7fd1867fc700 1 -- 172.21.15.99:0/4266631207 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd180007b00 con 0x7fd190102180 2024-01-31T05:09:57.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.463+0000 7fd1867fc700 1 -- 172.21.15.99:0/4266631207 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd18000ce70 con 0x7fd190102180 2024-01-31T05:09:57.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.463+0000 7fd1973b5700 1 -- 172.21.15.99:0/4266631207 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd190198650 con 0x7fd190102180 2024-01-31T05:09:57.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.463+0000 7fd1867fc700 1 -- 172.21.15.99:0/4266631207 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1800054e0 con 0x7fd190102180 2024-01-31T05:09:57.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.463+0000 7fd1973b5700 1 -- 172.21.15.99:0/4266631207 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1901a48f0 con 0x7fd190102180 2024-01-31T05:09:57.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.464+0000 7fd1973b5700 1 -- 172.21.15.99:0/4266631207 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd190102f00 con 0x7fd190102180 2024-01-31T05:09:57.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.465+0000 7fd1867fc700 1 -- 172.21.15.99:0/4266631207 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7fd180004750 con 0x7fd190102180 2024-01-31T05:09:57.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.466+0000 7fd1867fc700 1 --2- 172.21.15.99:0/4266631207 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd17c0a1480 0x7fd17c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:57.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.466+0000 7fd195151700 1 --2- 172.21.15.99:0/4266631207 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd17c0a1480 0x7fd17c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:57.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.466+0000 7fd1867fc700 1 -- 172.21.15.99:0/4266631207 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd1800cca10 con 0x7fd190102180 2024-01-31T05:09:57.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.466+0000 7fd1867fc700 1 --2- 172.21.15.99:0/4266631207 >> [v2:172.21.15.179:6824/2985063934,v1:172.21.15.179:6825/2985063934] conn(0x7fd17c0aac60 0x7fd17c0ad080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:57.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.466+0000 7fd1867fc700 1 -- 172.21.15.99:0/4266631207 --> [v2:172.21.15.179:6824/2985063934,v1:172.21.15.179:6825/2985063934] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd17c0ad730 con 0x7fd17c0aac60 2024-01-31T05:09:57.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.466+0000 7fd1867fc700 1 -- 172.21.15.99:0/4266631207 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1800cceb0 con 0x7fd190102180 2024-01-31T05:09:57.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.466+0000 7fd195151700 1 --2- 172.21.15.99:0/4266631207 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd17c0a1480 0x7fd17c0a3940 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd18c000c00 tx=0x7fd18c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:57.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.466+0000 7fd195952700 1 --2- 172.21.15.99:0/4266631207 >> [v2:172.21.15.179:6824/2985063934,v1:172.21.15.179:6825/2985063934] conn(0x7fd17c0aac60 0x7fd17c0ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:57.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.467+0000 7fd195952700 1 --2- 172.21.15.99:0/4266631207 >> [v2:172.21.15.179:6824/2985063934,v1:172.21.15.179:6825/2985063934] conn(0x7fd17c0aac60 0x7fd17c0ad080 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:57.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.468+0000 7fd1867fc700 1 -- 172.21.15.99:0/4266631207 <== osd.10 v2:172.21.15.179:6824/2985063934 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fd17c0ad730 con 0x7fd17c0aac60 2024-01-31T05:09:57.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.484+0000 7fd1973b5700 1 -- 172.21.15.99:0/4266631207 --> [v2:172.21.15.179:6824/2985063934,v1:172.21.15.179:6825/2985063934] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd190111a60 con 0x7fd17c0aac60 2024-01-31T05:09:57.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.485+0000 7fd1867fc700 1 -- 172.21.15.99:0/4266631207 <== osd.10 v2:172.21.15.179:6824/2985063934 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fd190111a60 con 0x7fd17c0aac60 2024-01-31T05:09:57.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.486+0000 7fd1973b5700 1 -- 172.21.15.99:0/4266631207 >> [v2:172.21.15.179:6824/2985063934,v1:172.21.15.179:6825/2985063934] conn(0x7fd17c0aac60 msgr2=0x7fd17c0ad080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:57.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.486+0000 7fd1973b5700 1 --2- 172.21.15.99:0/4266631207 >> [v2:172.21.15.179:6824/2985063934,v1:172.21.15.179:6825/2985063934] conn(0x7fd17c0aac60 0x7fd17c0ad080 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:57.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.486+0000 7fd1973b5700 1 -- 172.21.15.99:0/4266631207 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd17c0a1480 msgr2=0x7fd17c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:57.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.486+0000 7fd1973b5700 1 --2- 172.21.15.99:0/4266631207 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd17c0a1480 0x7fd17c0a3940 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd18c000c00 tx=0x7fd18c005fb0 comp rx=0 tx=0).stop 2024-01-31T05:09:57.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.486+0000 7fd1973b5700 1 -- 172.21.15.99:0/4266631207 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd190102180 msgr2=0x7fd19019dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:57.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.486+0000 7fd1973b5700 1 --2- 172.21.15.99:0/4266631207 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd190102180 0x7fd19019dd90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd18000c920 tx=0x7fd18000cc30 comp rx=0 tx=0).stop 2024-01-31T05:09:57.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.486+0000 7fd195952700 1 -- 172.21.15.99:0/4266631207 reap_dead start 2024-01-31T05:09:57.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.486+0000 7fd1973b5700 1 -- 172.21.15.99:0/4266631207 shutdown_connections 2024-01-31T05:09:57.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.486+0000 7fd1973b5700 1 -- 172.21.15.99:0/4266631207 >> 172.21.15.99:0/4266631207 conn(0x7fd1900fd290 msgr2=0x7fd1900fda80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:57.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.486+0000 7fd1973b5700 1 -- 172.21.15.99:0/4266631207 shutdown_connections 2024-01-31T05:09:57.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:57.486+0000 7fd1973b5700 1 -- 172.21.15.99:0/4266631207 wait complete. 2024-01-31T05:09:58.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:57 smithi099 ceph-mon[31615]: pgmap v304: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 8 op/s 2024-01-31T05:09:58.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:57 smithi181 ceph-mon[36434]: pgmap v304: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 8 op/s 2024-01-31T05:09:58.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:57 smithi179 ceph-mon[35652]: pgmap v304: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 8 op/s 2024-01-31T05:09:58.592 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:09:59.688 INFO:teuthology.orchestra.run.smithi099.stdout:313532612634 2024-01-31T05:09:59.689 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph osd last-stat-seq osd.10 2024-01-31T05:09:59.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.919+0000 7f8023aa0700 1 -- 172.21.15.99:0/961198011 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f801c069eb0 msgr2=0x7f801c06a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:59.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.919+0000 7f8023aa0700 1 --2- 172.21.15.99:0/961198011 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f801c069eb0 0x7f801c06a330 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f80100099c0 tx=0x7f8010009cd0 comp rx=0 tx=0).stop 2024-01-31T05:09:59.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.919+0000 7f8023aa0700 1 -- 172.21.15.99:0/961198011 shutdown_connections 2024-01-31T05:09:59.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.919+0000 7f8023aa0700 1 --2- 172.21.15.99:0/961198011 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f801c06a870 0x7f801c10e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:59.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.919+0000 7f8023aa0700 1 --2- 172.21.15.99:0/961198011 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f801c107780 0x7f801c107b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:59.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.919+0000 7f8023aa0700 1 --2- 172.21.15.99:0/961198011 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f801c069eb0 0x7f801c06a330 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:59.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.919+0000 7f8023aa0700 1 -- 172.21.15.99:0/961198011 >> 172.21.15.99:0/961198011 conn(0x7f801c077650 msgr2=0x7f801c077a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:59.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.919+0000 7f8023aa0700 1 -- 172.21.15.99:0/961198011 shutdown_connections 2024-01-31T05:09:59.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.919+0000 7f8023aa0700 1 -- 172.21.15.99:0/961198011 wait complete. 2024-01-31T05:09:59.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.919+0000 7f8023aa0700 1 Processor -- start 2024-01-31T05:09:59.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.919+0000 7f8023aa0700 1 -- start start 2024-01-31T05:09:59.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.920+0000 7f8023aa0700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f801c069eb0 0x7f801c199eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:59.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.920+0000 7f8023aa0700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f801c06a870 0x7f801c19a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:59.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.920+0000 7f8023aa0700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f801c107780 0x7f801c19e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:59.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.920+0000 7f8023aa0700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801c19ed90 con 0x7f801c06a870 2024-01-31T05:09:59.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.920+0000 7f8023aa0700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801c19ef00 con 0x7f801c107780 2024-01-31T05:09:59.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.920+0000 7f8023aa0700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801c19f0c0 con 0x7f801c069eb0 2024-01-31T05:09:59.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.920+0000 7f802103b700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f801c06a870 0x7f801c19a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:59.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.920+0000 7f802103b700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f801c06a870 0x7f801c19a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51578/0 (socket says 172.21.15.99:51578) 2024-01-31T05:09:59.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.920+0000 7f802103b700 1 -- 172.21.15.99:0/1085859733 learned_addr learned my addr 172.21.15.99:0/1085859733 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:09:59.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.920+0000 7f802183c700 1 --2- 172.21.15.99:0/1085859733 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f801c069eb0 0x7f801c199eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:59.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.920+0000 7f802203d700 1 --2- 172.21.15.99:0/1085859733 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f801c107780 0x7f801c19e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:59.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.920+0000 7f802103b700 1 -- 172.21.15.99:0/1085859733 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f801c069eb0 msgr2=0x7f801c199eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:59.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.920+0000 7f802103b700 1 --2- 172.21.15.99:0/1085859733 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f801c069eb0 0x7f801c199eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:59.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.920+0000 7f802103b700 1 -- 172.21.15.99:0/1085859733 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f801c107780 msgr2=0x7f801c19e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:59.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.920+0000 7f802103b700 1 --2- 172.21.15.99:0/1085859733 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f801c107780 0x7f801c19e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:59.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.921+0000 7f802103b700 1 -- 172.21.15.99:0/1085859733 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80100095f0 con 0x7f801c06a870 2024-01-31T05:09:59.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.921+0000 7f802103b700 1 --2- 172.21.15.99:0/1085859733 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f801c06a870 0x7f801c19a3f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f801000b580 tx=0x7f801000f6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:59.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.921+0000 7f800effd700 1 -- 172.21.15.99:0/1085859733 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801001d070 con 0x7f801c06a870 2024-01-31T05:09:59.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.921+0000 7f800effd700 1 -- 172.21.15.99:0/1085859733 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f801000fe80 con 0x7f801c06a870 2024-01-31T05:09:59.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.921+0000 7f800effd700 1 -- 172.21.15.99:0/1085859733 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8010022d10 con 0x7f801c06a870 2024-01-31T05:09:59.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.921+0000 7f8023aa0700 1 -- 172.21.15.99:0/1085859733 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f801c19f340 con 0x7f801c06a870 2024-01-31T05:09:59.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.921+0000 7f8023aa0700 1 -- 172.21.15.99:0/1085859733 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f801c1a6a30 con 0x7f801c06a870 2024-01-31T05:09:59.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.923+0000 7f8023aa0700 1 -- 172.21.15.99:0/1085859733 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f801c111a20 con 0x7f801c06a870 2024-01-31T05:09:59.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.924+0000 7f800effd700 1 -- 172.21.15.99:0/1085859733 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f8010022470 con 0x7f801c06a870 2024-01-31T05:09:59.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.925+0000 7f800effd700 1 --2- 172.21.15.99:0/1085859733 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f80080a1480 0x7f80080a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:59.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.925+0000 7f802183c700 1 --2- 172.21.15.99:0/1085859733 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f80080a1480 0x7f80080a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:59.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.925+0000 7f800effd700 1 -- 172.21.15.99:0/1085859733 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f80100cdd00 con 0x7f801c06a870 2024-01-31T05:09:59.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.925+0000 7f800effd700 1 --2- 172.21.15.99:0/1085859733 >> [v2:172.21.15.181:6808/1485017095,v1:172.21.15.181:6809/1485017095] conn(0x7f80080aac60 0x7f80080ad080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:09:59.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.925+0000 7f800effd700 1 -- 172.21.15.99:0/1085859733 --> [v2:172.21.15.181:6808/1485017095,v1:172.21.15.181:6809/1485017095] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f80080ad730 con 0x7f80080aac60 2024-01-31T05:09:59.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.925+0000 7f800effd700 1 -- 172.21.15.99:0/1085859733 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80100d0410 con 0x7f801c06a870 2024-01-31T05:09:59.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.925+0000 7f802183c700 1 --2- 172.21.15.99:0/1085859733 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f80080a1480 0x7f80080a3940 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f801400a400 tx=0x7f801400d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:59.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.926+0000 7f802203d700 1 --2- 172.21.15.99:0/1085859733 >> [v2:172.21.15.181:6808/1485017095,v1:172.21.15.181:6809/1485017095] conn(0x7f80080aac60 0x7f80080ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:09:59.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.926+0000 7f802203d700 1 --2- 172.21.15.99:0/1085859733 >> [v2:172.21.15.181:6808/1485017095,v1:172.21.15.181:6809/1485017095] conn(0x7f80080aac60 0x7f80080ad080 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:09:59.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.927+0000 7f800effd700 1 -- 172.21.15.99:0/1085859733 <== osd.5 v2:172.21.15.181:6808/1485017095 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f80080ad730 con 0x7f80080aac60 2024-01-31T05:09:59.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.944+0000 7f8023aa0700 1 -- 172.21.15.99:0/1085859733 --> [v2:172.21.15.181:6808/1485017095,v1:172.21.15.181:6809/1485017095] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f801c10d310 con 0x7f80080aac60 2024-01-31T05:09:59.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.945+0000 7f800effd700 1 -- 172.21.15.99:0/1085859733 <== osd.5 v2:172.21.15.181:6808/1485017095 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f801c10d310 con 0x7f80080aac60 2024-01-31T05:09:59.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.945+0000 7f8023aa0700 1 -- 172.21.15.99:0/1085859733 >> [v2:172.21.15.181:6808/1485017095,v1:172.21.15.181:6809/1485017095] conn(0x7f80080aac60 msgr2=0x7f80080ad080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:59.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.945+0000 7f8023aa0700 1 --2- 172.21.15.99:0/1085859733 >> [v2:172.21.15.181:6808/1485017095,v1:172.21.15.181:6809/1485017095] conn(0x7f80080aac60 0x7f80080ad080 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:09:59.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.945+0000 7f8023aa0700 1 -- 172.21.15.99:0/1085859733 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f80080a1480 msgr2=0x7f80080a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:59.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.945+0000 7f8023aa0700 1 --2- 172.21.15.99:0/1085859733 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f80080a1480 0x7f80080a3940 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f801400a400 tx=0x7f801400d040 comp rx=0 tx=0).stop 2024-01-31T05:09:59.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.945+0000 7f8023aa0700 1 -- 172.21.15.99:0/1085859733 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f801c06a870 msgr2=0x7f801c19a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:09:59.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.945+0000 7f8023aa0700 1 --2- 172.21.15.99:0/1085859733 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f801c06a870 0x7f801c19a3f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f801000b580 tx=0x7f801000f6e0 comp rx=0 tx=0).stop 2024-01-31T05:09:59.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.945+0000 7f802203d700 1 -- 172.21.15.99:0/1085859733 reap_dead start 2024-01-31T05:09:59.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.945+0000 7f8023aa0700 1 -- 172.21.15.99:0/1085859733 shutdown_connections 2024-01-31T05:09:59.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.945+0000 7f8023aa0700 1 -- 172.21.15.99:0/1085859733 >> 172.21.15.99:0/1085859733 conn(0x7f801c077650 msgr2=0x7f801c10c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:09:59.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.946+0000 7f8023aa0700 1 -- 172.21.15.99:0/1085859733 shutdown_connections 2024-01-31T05:09:59.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:09:56.946+0000 7f8023aa0700 1 -- 172.21.15.99:0/1085859733 wait complete. 2024-01-31T05:10:00.039 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:09:59 smithi099 ceph-mon[31615]: pgmap v305: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 12 op/s 2024-01-31T05:10:00.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:09:59 smithi181 ceph-mon[36434]: pgmap v305: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 12 op/s 2024-01-31T05:10:00.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:09:59 smithi179 ceph-mon[35652]: pgmap v305: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 12 op/s 2024-01-31T05:10:00.381 INFO:teuthology.orchestra.run.smithi099.stdout:163208757299 2024-01-31T05:10:00.381 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph osd last-stat-seq osd.5 2024-01-31T05:10:00.769 INFO:teuthology.orchestra.run.smithi099.stdout:55834574917 2024-01-31T05:10:00.769 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph osd last-stat-seq osd.1 2024-01-31T05:10:00.991 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:00 smithi099 ceph-mon[31615]: overall HEALTH_OK 2024-01-31T05:10:01.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:00 smithi181 ceph-mon[36434]: overall HEALTH_OK 2024-01-31T05:10:01.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:00 smithi179 ceph-mon[35652]: overall HEALTH_OK 2024-01-31T05:10:01.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.565+0000 7fb95dcab700 1 -- 172.21.15.99:0/2054500210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb958069d20 msgr2=0x7fb95806a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:01.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.565+0000 7fb95dcab700 1 --2- 172.21.15.99:0/2054500210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb958069d20 0x7fb95806a100 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb948009990 tx=0x7fb948009ca0 comp rx=0 tx=0).stop 2024-01-31T05:10:01.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.565+0000 7fb95dcab700 1 -- 172.21.15.99:0/2054500210 shutdown_connections 2024-01-31T05:10:01.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.565+0000 7fb95dcab700 1 --2- 172.21.15.99:0/2054500210 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb95810e2c0 0x7fb9581106b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:01.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.565+0000 7fb95dcab700 1 --2- 172.21.15.99:0/2054500210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb958069d20 0x7fb95806a100 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:01.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.565+0000 7fb95dcab700 1 --2- 172.21.15.99:0/2054500210 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb95806a640 0x7fb95810dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:01.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.565+0000 7fb95dcab700 1 -- 172.21.15.99:0/2054500210 >> 172.21.15.99:0/2054500210 conn(0x7fb958076730 msgr2=0x7fb958076b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:01.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.565+0000 7fb95dcab700 1 -- 172.21.15.99:0/2054500210 shutdown_connections 2024-01-31T05:10:01.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.565+0000 7fb95dcab700 1 -- 172.21.15.99:0/2054500210 wait complete. 2024-01-31T05:10:01.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.566+0000 7fb95dcab700 1 Processor -- start 2024-01-31T05:10:01.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.566+0000 7fb95dcab700 1 -- start start 2024-01-31T05:10:01.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.566+0000 7fb95dcab700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb958069d20 0x7fb958199de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:01.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.566+0000 7fb95dcab700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb95806a640 0x7fb95819a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:01.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.566+0000 7fb95dcab700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb95810e2c0 0x7fb95819e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:01.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.566+0000 7fb95dcab700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb95819ec70 con 0x7fb958069d20 2024-01-31T05:10:01.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.566+0000 7fb95dcab700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb95819ede0 con 0x7fb95806a640 2024-01-31T05:10:01.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.566+0000 7fb95dcab700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb95819efa0 con 0x7fb95810e2c0 2024-01-31T05:10:01.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.566+0000 7fb9577fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb958069d20 0x7fb958199de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:01.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.566+0000 7fb9577fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb958069d20 0x7fb958199de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51596/0 (socket says 172.21.15.99:51596) 2024-01-31T05:10:01.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.566+0000 7fb9577fe700 1 -- 172.21.15.99:0/3469480557 learned_addr learned my addr 172.21.15.99:0/3469480557 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:01.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.566+0000 7fb94effd700 1 --2- 172.21.15.99:0/3469480557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb95806a640 0x7fb95819a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:01.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.566+0000 7fb957fff700 1 --2- 172.21.15.99:0/3469480557 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb95810e2c0 0x7fb95819e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:01.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.567+0000 7fb9577fe700 1 -- 172.21.15.99:0/3469480557 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb95810e2c0 msgr2=0x7fb95819e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:01.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.567+0000 7fb9577fe700 1 --2- 172.21.15.99:0/3469480557 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb95810e2c0 0x7fb95819e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:01.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.567+0000 7fb9577fe700 1 -- 172.21.15.99:0/3469480557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb95806a640 msgr2=0x7fb95819a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:01.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.567+0000 7fb9577fe700 1 --2- 172.21.15.99:0/3469480557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb95806a640 0x7fb95819a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:01.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.567+0000 7fb9577fe700 1 -- 172.21.15.99:0/3469480557 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9480095f0 con 0x7fb958069d20 2024-01-31T05:10:01.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.567+0000 7fb94effd700 1 --2- 172.21.15.99:0/3469480557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb95806a640 0x7fb95819a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:10:01.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.567+0000 7fb9577fe700 1 --2- 172.21.15.99:0/3469480557 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb958069d20 0x7fb958199de0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb948000c00 tx=0x7fb94800f7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:01.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.567+0000 7fb9557fa700 1 -- 172.21.15.99:0/3469480557 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94801d070 con 0x7fb958069d20 2024-01-31T05:10:01.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.567+0000 7fb9557fa700 1 -- 172.21.15.99:0/3469480557 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb94800fd30 con 0x7fb958069d20 2024-01-31T05:10:01.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.567+0000 7fb95dcab700 1 -- 172.21.15.99:0/3469480557 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb95819f220 con 0x7fb958069d20 2024-01-31T05:10:01.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.567+0000 7fb9557fa700 1 -- 172.21.15.99:0/3469480557 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb948017630 con 0x7fb958069d20 2024-01-31T05:10:01.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.567+0000 7fb95dcab700 1 -- 172.21.15.99:0/3469480557 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9581a6ae0 con 0x7fb958069d20 2024-01-31T05:10:01.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.568+0000 7fb95dcab700 1 -- 172.21.15.99:0/3469480557 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb958113ba0 con 0x7fb958069d20 2024-01-31T05:10:01.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.569+0000 7fb9557fa700 1 -- 172.21.15.99:0/3469480557 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7fb948017790 con 0x7fb958069d20 2024-01-31T05:10:01.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.569+0000 7fb9557fa700 1 --2- 172.21.15.99:0/3469480557 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb9440a1400 0x7fb9440a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:01.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.570+0000 7fb94effd700 1 --2- 172.21.15.99:0/3469480557 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb9440a1400 0x7fb9440a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:01.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.570+0000 7fb9557fa700 1 -- 172.21.15.99:0/3469480557 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fb9480ce380 con 0x7fb958069d20 2024-01-31T05:10:01.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.570+0000 7fb9557fa700 1 --2- 172.21.15.99:0/3469480557 >> [v2:172.21.15.181:6800/3934284457,v1:172.21.15.181:6801/3934284457] conn(0x7fb9440aabe0 0x7fb9440ad000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:01.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.570+0000 7fb9557fa700 1 -- 172.21.15.99:0/3469480557 --> [v2:172.21.15.181:6800/3934284457,v1:172.21.15.181:6801/3934284457] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb9440ad6b0 con 0x7fb9440aabe0 2024-01-31T05:10:01.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.570+0000 7fb9557fa700 1 -- 172.21.15.99:0/3469480557 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9480ce820 con 0x7fb958069d20 2024-01-31T05:10:01.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.570+0000 7fb94effd700 1 --2- 172.21.15.99:0/3469480557 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb9440a1400 0x7fb9440a38c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb940005fd0 tx=0x7fb940005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:01.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.570+0000 7fb957fff700 1 --2- 172.21.15.99:0/3469480557 >> [v2:172.21.15.181:6800/3934284457,v1:172.21.15.181:6801/3934284457] conn(0x7fb9440aabe0 0x7fb9440ad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:01.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.571+0000 7fb957fff700 1 --2- 172.21.15.99:0/3469480557 >> [v2:172.21.15.181:6800/3934284457,v1:172.21.15.181:6801/3934284457] conn(0x7fb9440aabe0 0x7fb9440ad000 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:01.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.571+0000 7fb9557fa700 1 -- 172.21.15.99:0/3469480557 <== osd.2 v2:172.21.15.181:6800/3934284457 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fb9440ad6b0 con 0x7fb9440aabe0 2024-01-31T05:10:01.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.587+0000 7fb95dcab700 1 -- 172.21.15.99:0/3469480557 --> [v2:172.21.15.181:6800/3934284457,v1:172.21.15.181:6801/3934284457] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb958061ef0 con 0x7fb9440aabe0 2024-01-31T05:10:01.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.588+0000 7fb9557fa700 1 -- 172.21.15.99:0/3469480557 <== osd.2 v2:172.21.15.181:6800/3934284457 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb958061ef0 con 0x7fb9440aabe0 2024-01-31T05:10:01.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.588+0000 7fb95dcab700 1 -- 172.21.15.99:0/3469480557 >> [v2:172.21.15.181:6800/3934284457,v1:172.21.15.181:6801/3934284457] conn(0x7fb9440aabe0 msgr2=0x7fb9440ad000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:01.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.588+0000 7fb95dcab700 1 --2- 172.21.15.99:0/3469480557 >> [v2:172.21.15.181:6800/3934284457,v1:172.21.15.181:6801/3934284457] conn(0x7fb9440aabe0 0x7fb9440ad000 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:01.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.589+0000 7fb95dcab700 1 -- 172.21.15.99:0/3469480557 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb9440a1400 msgr2=0x7fb9440a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:01.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.589+0000 7fb95dcab700 1 --2- 172.21.15.99:0/3469480557 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb9440a1400 0x7fb9440a38c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb940005fd0 tx=0x7fb940005e30 comp rx=0 tx=0).stop 2024-01-31T05:10:01.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.589+0000 7fb95dcab700 1 -- 172.21.15.99:0/3469480557 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb958069d20 msgr2=0x7fb958199de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:01.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.589+0000 7fb95dcab700 1 --2- 172.21.15.99:0/3469480557 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb958069d20 0x7fb958199de0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb948000c00 tx=0x7fb94800f7d0 comp rx=0 tx=0).stop 2024-01-31T05:10:01.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.589+0000 7fb957fff700 1 -- 172.21.15.99:0/3469480557 reap_dead start 2024-01-31T05:10:01.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.589+0000 7fb95dcab700 1 -- 172.21.15.99:0/3469480557 shutdown_connections 2024-01-31T05:10:01.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.589+0000 7fb95dcab700 1 -- 172.21.15.99:0/3469480557 >> 172.21.15.99:0/3469480557 conn(0x7fb958076730 msgr2=0x7fb95810f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:01.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.589+0000 7fb95dcab700 1 -- 172.21.15.99:0/3469480557 shutdown_connections 2024-01-31T05:10:01.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.589+0000 7fb95dcab700 1 -- 172.21.15.99:0/3469480557 wait complete. 2024-01-31T05:10:01.972 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:01 smithi181 ceph-mon[36434]: pgmap v306: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-01-31T05:10:02.017 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:01 smithi099 ceph-mon[31615]: pgmap v306: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-01-31T05:10:02.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:01 smithi179 ceph-mon[35652]: pgmap v306: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-01-31T05:10:02.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.733+0000 7f6990f73700 1 -- 172.21.15.99:0/3743717144 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f698c100710 msgr2=0x7f698c100b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:02.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.733+0000 7f6990f73700 1 --2- 172.21.15.99:0/3743717144 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f698c100710 0x7f698c100b90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f697c009990 tx=0x7f697c009ca0 comp rx=0 tx=0).stop 2024-01-31T05:10:02.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.733+0000 7f6990f73700 1 -- 172.21.15.99:0/3743717144 shutdown_connections 2024-01-31T05:10:02.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.733+0000 7f6990f73700 1 --2- 172.21.15.99:0/3743717144 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f698c1010d0 0x7f698c10d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:02.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.733+0000 7f6990f73700 1 --2- 172.21.15.99:0/3743717144 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f698c106680 0x7f698c106a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:02.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.733+0000 7f6990f73700 1 --2- 172.21.15.99:0/3743717144 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f698c100710 0x7f698c100b90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:02.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.733+0000 7f6990f73700 1 -- 172.21.15.99:0/3743717144 >> 172.21.15.99:0/3743717144 conn(0x7f698c076730 msgr2=0x7f698c076b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:02.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.733+0000 7f6990f73700 1 -- 172.21.15.99:0/3743717144 shutdown_connections 2024-01-31T05:10:02.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.733+0000 7f6990f73700 1 -- 172.21.15.99:0/3743717144 wait complete. 2024-01-31T05:10:02.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.734+0000 7f6990f73700 1 Processor -- start 2024-01-31T05:10:02.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.734+0000 7f6990f73700 1 -- start start 2024-01-31T05:10:02.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.734+0000 7f6990f73700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f698c100710 0x7f698c19c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:02.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.734+0000 7f6990f73700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f698c1010d0 0x7f698c19cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:02.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.734+0000 7f6990f73700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f698c106680 0x7f698c196940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:02.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.734+0000 7f6990f73700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698c196fa0 con 0x7f698c1010d0 2024-01-31T05:10:02.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.734+0000 7f6990f73700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698c1970e0 con 0x7f698c106680 2024-01-31T05:10:02.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.734+0000 7f6990f73700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698c1972a0 con 0x7f698c100710 2024-01-31T05:10:02.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.734+0000 7f6989d9b700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f698c1010d0 0x7f698c19cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:02.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.734+0000 7f6989d9b700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f698c1010d0 0x7f698c19cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51616/0 (socket says 172.21.15.99:51616) 2024-01-31T05:10:02.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.734+0000 7f6989d9b700 1 -- 172.21.15.99:0/3719282207 learned_addr learned my addr 172.21.15.99:0/3719282207 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:02.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.734+0000 7f698a59c700 1 --2- 172.21.15.99:0/3719282207 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f698c100710 0x7f698c19c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:02.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.735+0000 7f6989d9b700 1 -- 172.21.15.99:0/3719282207 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f698c100710 msgr2=0x7f698c19c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:02.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.735+0000 7f6989d9b700 1 --2- 172.21.15.99:0/3719282207 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f698c100710 0x7f698c19c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:02.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.735+0000 7f698ad9d700 1 --2- 172.21.15.99:0/3719282207 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f698c106680 0x7f698c196940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:02.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.735+0000 7f6989d9b700 1 -- 172.21.15.99:0/3719282207 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f698c106680 msgr2=0x7f698c196940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:02.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.735+0000 7f6989d9b700 1 --2- 172.21.15.99:0/3719282207 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f698c106680 0x7f698c196940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:02.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.735+0000 7f6989d9b700 1 -- 172.21.15.99:0/3719282207 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f697c0095f0 con 0x7f698c1010d0 2024-01-31T05:10:02.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.735+0000 7f698a59c700 1 --2- 172.21.15.99:0/3719282207 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f698c100710 0x7f698c19c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:10:02.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.735+0000 7f6989d9b700 1 --2- 172.21.15.99:0/3719282207 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f698c1010d0 0x7f698c19cc70 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f697c000c00 tx=0x7f697c00f880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:02.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.735+0000 7f69837fe700 1 -- 172.21.15.99:0/3719282207 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c01d070 con 0x7f698c1010d0 2024-01-31T05:10:02.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.735+0000 7f69837fe700 1 -- 172.21.15.99:0/3719282207 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f697c00fde0 con 0x7f698c1010d0 2024-01-31T05:10:02.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.735+0000 7f6990f73700 1 -- 172.21.15.99:0/3719282207 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f698c197520 con 0x7f698c1010d0 2024-01-31T05:10:02.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.735+0000 7f69837fe700 1 -- 172.21.15.99:0/3719282207 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c017770 con 0x7f698c1010d0 2024-01-31T05:10:02.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.735+0000 7f6990f73700 1 -- 172.21.15.99:0/3719282207 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f698c1a37d0 con 0x7f698c1010d0 2024-01-31T05:10:02.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.736+0000 7f6990f73700 1 -- 172.21.15.99:0/3719282207 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f698c101dc0 con 0x7f698c1010d0 2024-01-31T05:10:02.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.737+0000 7f69837fe700 1 -- 172.21.15.99:0/3719282207 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f697c022aa0 con 0x7f698c1010d0 2024-01-31T05:10:02.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.737+0000 7f69837fe700 1 --2- 172.21.15.99:0/3719282207 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f69780a1400 0x7f69780a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:02.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.738+0000 7f698a59c700 1 --2- 172.21.15.99:0/3719282207 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f69780a1400 0x7f69780a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:02.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.738+0000 7f69837fe700 1 -- 172.21.15.99:0/3719282207 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f697c0ce440 con 0x7f698c1010d0 2024-01-31T05:10:02.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.738+0000 7f69837fe700 1 --2- 172.21.15.99:0/3719282207 >> [v2:172.21.15.179:6816/3875950553,v1:172.21.15.179:6817/3875950553] conn(0x7f69780aabe0 0x7f69780ad000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:02.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.738+0000 7f69837fe700 1 -- 172.21.15.99:0/3719282207 --> [v2:172.21.15.179:6816/3875950553,v1:172.21.15.179:6817/3875950553] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f69780ad6b0 con 0x7f69780aabe0 2024-01-31T05:10:02.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.738+0000 7f69837fe700 1 -- 172.21.15.99:0/3719282207 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f697c0ce8e0 con 0x7f698c1010d0 2024-01-31T05:10:02.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.738+0000 7f698a59c700 1 --2- 172.21.15.99:0/3719282207 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f69780a1400 0x7f69780a38c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6974005e20 tx=0x7f6974005db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:02.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.738+0000 7f698ad9d700 1 --2- 172.21.15.99:0/3719282207 >> [v2:172.21.15.179:6816/3875950553,v1:172.21.15.179:6817/3875950553] conn(0x7f69780aabe0 0x7f69780ad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:02.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.739+0000 7f698ad9d700 1 --2- 172.21.15.99:0/3719282207 >> [v2:172.21.15.179:6816/3875950553,v1:172.21.15.179:6817/3875950553] conn(0x7f69780aabe0 0x7f69780ad000 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:02.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.739+0000 7f69837fe700 1 -- 172.21.15.99:0/3719282207 <== osd.7 v2:172.21.15.179:6816/3875950553 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f69780ad6b0 con 0x7f69780aabe0 2024-01-31T05:10:02.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.755+0000 7f6990f73700 1 -- 172.21.15.99:0/3719282207 --> [v2:172.21.15.179:6816/3875950553,v1:172.21.15.179:6817/3875950553] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f698c110930 con 0x7f69780aabe0 2024-01-31T05:10:02.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.756+0000 7f69837fe700 1 -- 172.21.15.99:0/3719282207 <== osd.7 v2:172.21.15.179:6816/3875950553 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f698c110930 con 0x7f69780aabe0 2024-01-31T05:10:02.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.756+0000 7f6990f73700 1 -- 172.21.15.99:0/3719282207 >> [v2:172.21.15.179:6816/3875950553,v1:172.21.15.179:6817/3875950553] conn(0x7f69780aabe0 msgr2=0x7f69780ad000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:02.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.756+0000 7f6990f73700 1 --2- 172.21.15.99:0/3719282207 >> [v2:172.21.15.179:6816/3875950553,v1:172.21.15.179:6817/3875950553] conn(0x7f69780aabe0 0x7f69780ad000 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:02.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.757+0000 7f6990f73700 1 -- 172.21.15.99:0/3719282207 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f69780a1400 msgr2=0x7f69780a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:02.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.757+0000 7f6990f73700 1 --2- 172.21.15.99:0/3719282207 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f69780a1400 0x7f69780a38c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6974005e20 tx=0x7f6974005db0 comp rx=0 tx=0).stop 2024-01-31T05:10:02.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.757+0000 7f6990f73700 1 -- 172.21.15.99:0/3719282207 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f698c1010d0 msgr2=0x7f698c19cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:02.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.757+0000 7f6990f73700 1 --2- 172.21.15.99:0/3719282207 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f698c1010d0 0x7f698c19cc70 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f697c000c00 tx=0x7f697c00f880 comp rx=0 tx=0).stop 2024-01-31T05:10:02.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.757+0000 7f698ad9d700 1 -- 172.21.15.99:0/3719282207 reap_dead start 2024-01-31T05:10:02.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.757+0000 7f6990f73700 1 -- 172.21.15.99:0/3719282207 shutdown_connections 2024-01-31T05:10:02.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.757+0000 7f6990f73700 1 -- 172.21.15.99:0/3719282207 >> 172.21.15.99:0/3719282207 conn(0x7f698c076730 msgr2=0x7f698c0fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:02.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.757+0000 7f6990f73700 1 -- 172.21.15.99:0/3719282207 shutdown_connections 2024-01-31T05:10:02.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:01.757+0000 7f6990f73700 1 -- 172.21.15.99:0/3719282207 wait complete. 2024-01-31T05:10:03.152 INFO:teuthology.orchestra.run.smithi099.stdout:219043332138 2024-01-31T05:10:03.152 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph osd last-stat-seq osd.7 2024-01-31T05:10:03.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:03 smithi099 ceph-mon[31615]: pgmap v307: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-01-31T05:10:03.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:03 smithi181 ceph-mon[36434]: pgmap v307: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-01-31T05:10:03.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:03 smithi179 ceph-mon[35652]: pgmap v307: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-01-31T05:10:03.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.785+0000 7f85538eb700 1 -- 172.21.15.99:0/3301392052 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f854c1006e0 msgr2=0x7f854c100b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:03.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.785+0000 7f85538eb700 1 --2- 172.21.15.99:0/3301392052 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f854c1006e0 0x7f854c100b40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f853c009990 tx=0x7f853c009ca0 comp rx=0 tx=0).stop 2024-01-31T05:10:03.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.785+0000 7f85538eb700 1 -- 172.21.15.99:0/3301392052 shutdown_connections 2024-01-31T05:10:03.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.785+0000 7f85538eb700 1 --2- 172.21.15.99:0/3301392052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f854c101080 0x7f854c10d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:03.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.785+0000 7f85538eb700 1 --2- 172.21.15.99:0/3301392052 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f854c106690 0x7f854c106a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:03.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.785+0000 7f85538eb700 1 --2- 172.21.15.99:0/3301392052 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f854c1006e0 0x7f854c100b40 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:03.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.785+0000 7f85538eb700 1 -- 172.21.15.99:0/3301392052 >> 172.21.15.99:0/3301392052 conn(0x7f854c077610 msgr2=0x7f854c077a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:03.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.785+0000 7f85538eb700 1 -- 172.21.15.99:0/3301392052 shutdown_connections 2024-01-31T05:10:03.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.785+0000 7f85538eb700 1 -- 172.21.15.99:0/3301392052 wait complete. 2024-01-31T05:10:03.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.785+0000 7f85538eb700 1 Processor -- start 2024-01-31T05:10:03.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.786+0000 7f85538eb700 1 -- start start 2024-01-31T05:10:03.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.786+0000 7f85538eb700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f854c1006e0 0x7f854c19c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:03.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.786+0000 7f85538eb700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f854c101080 0x7f854c19cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:03.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.786+0000 7f85538eb700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f854c106690 0x7f854c1968f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:03.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.786+0000 7f85538eb700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854c196f50 con 0x7f854c1006e0 2024-01-31T05:10:03.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.786+0000 7f85538eb700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854c197090 con 0x7f854c106690 2024-01-31T05:10:03.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.786+0000 7f85538eb700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854c197250 con 0x7f854c101080 2024-01-31T05:10:03.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.786+0000 7f8551687700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f854c1006e0 0x7f854c19c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:03.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.786+0000 7f8551687700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f854c1006e0 0x7f854c19c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51632/0 (socket says 172.21.15.99:51632) 2024-01-31T05:10:03.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.786+0000 7f8551687700 1 -- 172.21.15.99:0/1882840497 learned_addr learned my addr 172.21.15.99:0/1882840497 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:03.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.786+0000 7f8551e88700 1 --2- 172.21.15.99:0/1882840497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f854c106690 0x7f854c1968f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:03.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.786+0000 7f8550e86700 1 --2- 172.21.15.99:0/1882840497 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f854c101080 0x7f854c19cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:03.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.786+0000 7f8551687700 1 -- 172.21.15.99:0/1882840497 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f854c101080 msgr2=0x7f854c19cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:03.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.786+0000 7f8551687700 1 --2- 172.21.15.99:0/1882840497 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f854c101080 0x7f854c19cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:03.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.786+0000 7f8551687700 1 -- 172.21.15.99:0/1882840497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f854c106690 msgr2=0x7f854c1968f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:03.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.786+0000 7f8551687700 1 --2- 172.21.15.99:0/1882840497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f854c106690 0x7f854c1968f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:03.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.786+0000 7f8551687700 1 -- 172.21.15.99:0/1882840497 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f853c0095f0 con 0x7f854c1006e0 2024-01-31T05:10:03.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.786+0000 7f8551e88700 1 --2- 172.21.15.99:0/1882840497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f854c106690 0x7f854c1968f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:10:03.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.786+0000 7f8551687700 1 --2- 172.21.15.99:0/1882840497 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f854c1006e0 0x7f854c19c730 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f854800c920 tx=0x7f854800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:03.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.786+0000 7f85427fc700 1 -- 172.21.15.99:0/1882840497 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8548007b00 con 0x7f854c1006e0 2024-01-31T05:10:03.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.787+0000 7f85538eb700 1 -- 172.21.15.99:0/1882840497 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f854c197530 con 0x7f854c1006e0 2024-01-31T05:10:03.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.787+0000 7f85427fc700 1 -- 172.21.15.99:0/1882840497 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8548004cf0 con 0x7f854c1006e0 2024-01-31T05:10:03.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.787+0000 7f85538eb700 1 -- 172.21.15.99:0/1882840497 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f854c069660 con 0x7f854c1006e0 2024-01-31T05:10:03.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.787+0000 7f85427fc700 1 -- 172.21.15.99:0/1882840497 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8548005520 con 0x7f854c1006e0 2024-01-31T05:10:03.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.788+0000 7f85538eb700 1 -- 172.21.15.99:0/1882840497 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8530001030 con 0x7f854c1006e0 2024-01-31T05:10:03.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.789+0000 7f85427fc700 1 -- 172.21.15.99:0/1882840497 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f8548004750 con 0x7f854c1006e0 2024-01-31T05:10:03.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.789+0000 7f85427fc700 1 --2- 172.21.15.99:0/1882840497 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f85380a1480 0x7f85380a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:03.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.790+0000 7f8550e86700 1 --2- 172.21.15.99:0/1882840497 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f85380a1480 0x7f85380a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:03.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.790+0000 7f85427fc700 1 -- 172.21.15.99:0/1882840497 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f85480ce550 con 0x7f854c1006e0 2024-01-31T05:10:03.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.790+0000 7f85427fc700 1 --2- 172.21.15.99:0/1882840497 >> [v2:172.21.15.99:6810/4207675427,v1:172.21.15.99:6811/4207675427] conn(0x7f85380aac60 0x7f85380ad080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:03.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.790+0000 7f85427fc700 1 -- 172.21.15.99:0/1882840497 --> [v2:172.21.15.99:6810/4207675427,v1:172.21.15.99:6811/4207675427] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f85380ad730 con 0x7f85380aac60 2024-01-31T05:10:03.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.790+0000 7f85427fc700 1 -- 172.21.15.99:0/1882840497 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f85480d0c60 con 0x7f854c1006e0 2024-01-31T05:10:03.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.790+0000 7f8551e88700 1 --2- 172.21.15.99:0/1882840497 >> [v2:172.21.15.99:6810/4207675427,v1:172.21.15.99:6811/4207675427] conn(0x7f85380aac60 0x7f85380ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:03.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.790+0000 7f8550e86700 1 --2- 172.21.15.99:0/1882840497 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f85380a1480 0x7f85380a3940 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f853c00b5c0 tx=0x7f853c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:03.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.791+0000 7f8551e88700 1 --2- 172.21.15.99:0/1882840497 >> [v2:172.21.15.99:6810/4207675427,v1:172.21.15.99:6811/4207675427] conn(0x7f85380aac60 0x7f85380ad080 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:03.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.792+0000 7f85427fc700 1 -- 172.21.15.99:0/1882840497 <== osd.3 v2:172.21.15.99:6810/4207675427 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f85380ad730 con 0x7f85380aac60 2024-01-31T05:10:03.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.808+0000 7f85538eb700 1 -- 172.21.15.99:0/1882840497 --> [v2:172.21.15.99:6810/4207675427,v1:172.21.15.99:6811/4207675427] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8530002dc0 con 0x7f85380aac60 2024-01-31T05:10:03.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.809+0000 7f85427fc700 1 -- 172.21.15.99:0/1882840497 <== osd.3 v2:172.21.15.99:6810/4207675427 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f8530002dc0 con 0x7f85380aac60 2024-01-31T05:10:03.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.809+0000 7f85538eb700 1 -- 172.21.15.99:0/1882840497 >> [v2:172.21.15.99:6810/4207675427,v1:172.21.15.99:6811/4207675427] conn(0x7f85380aac60 msgr2=0x7f85380ad080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:03.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.809+0000 7f85538eb700 1 --2- 172.21.15.99:0/1882840497 >> [v2:172.21.15.99:6810/4207675427,v1:172.21.15.99:6811/4207675427] conn(0x7f85380aac60 0x7f85380ad080 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:03.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.809+0000 7f85538eb700 1 -- 172.21.15.99:0/1882840497 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f85380a1480 msgr2=0x7f85380a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:03.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.809+0000 7f85538eb700 1 --2- 172.21.15.99:0/1882840497 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f85380a1480 0x7f85380a3940 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f853c00b5c0 tx=0x7f853c005fb0 comp rx=0 tx=0).stop 2024-01-31T05:10:03.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.809+0000 7f85538eb700 1 -- 172.21.15.99:0/1882840497 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f854c1006e0 msgr2=0x7f854c19c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:03.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.809+0000 7f85538eb700 1 --2- 172.21.15.99:0/1882840497 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f854c1006e0 0x7f854c19c730 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f854800c920 tx=0x7f854800cce0 comp rx=0 tx=0).stop 2024-01-31T05:10:03.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.809+0000 7f8551e88700 1 -- 172.21.15.99:0/1882840497 reap_dead start 2024-01-31T05:10:03.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.809+0000 7f85538eb700 1 -- 172.21.15.99:0/1882840497 shutdown_connections 2024-01-31T05:10:03.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.809+0000 7f85538eb700 1 -- 172.21.15.99:0/1882840497 >> 172.21.15.99:0/1882840497 conn(0x7f854c077610 msgr2=0x7f854c0fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:03.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.810+0000 7f85538eb700 1 -- 172.21.15.99:0/1882840497 shutdown_connections 2024-01-31T05:10:03.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:03.810+0000 7f85538eb700 1 -- 172.21.15.99:0/1882840497 wait complete. 2024-01-31T05:10:03.947 INFO:teuthology.orchestra.run.smithi099.stdout:77309411394 2024-01-31T05:10:03.947 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph osd last-stat-seq osd.2 2024-01-31T05:10:04.613 INFO:teuthology.orchestra.run.smithi099.stdout:107374182461 2024-01-31T05:10:04.613 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph osd last-stat-seq osd.3 2024-01-31T05:10:04.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.822+0000 7f0d87cab700 1 -- 172.21.15.99:0/2338787053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d800ffdd0 msgr2=0x7f0d80100250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:04.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.822+0000 7f0d87cab700 1 --2- 172.21.15.99:0/2338787053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d800ffdd0 0x7f0d80100250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0d700098f0 tx=0x7f0d70009c00 comp rx=0 tx=0).stop 2024-01-31T05:10:04.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.822+0000 7f0d87cab700 1 -- 172.21.15.99:0/2338787053 shutdown_connections 2024-01-31T05:10:04.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.822+0000 7f0d87cab700 1 --2- 172.21.15.99:0/2338787053 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d80100790 0x7f0d8010e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:04.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.822+0000 7f0d87cab700 1 --2- 172.21.15.99:0/2338787053 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d80106850 0x7f0d80106c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:04.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.822+0000 7f0d87cab700 1 --2- 172.21.15.99:0/2338787053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d800ffdd0 0x7f0d80100250 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:04.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.822+0000 7f0d87cab700 1 -- 172.21.15.99:0/2338787053 >> 172.21.15.99:0/2338787053 conn(0x7f0d80076ce0 msgr2=0x7f0d800fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:04.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.822+0000 7f0d87cab700 1 -- 172.21.15.99:0/2338787053 shutdown_connections 2024-01-31T05:10:04.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.822+0000 7f0d87cab700 1 -- 172.21.15.99:0/2338787053 wait complete. 2024-01-31T05:10:04.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.823+0000 7f0d87cab700 1 Processor -- start 2024-01-31T05:10:04.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.823+0000 7f0d87cab700 1 -- start start 2024-01-31T05:10:04.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.823+0000 7f0d87cab700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d800ffdd0 0x7f0d80197d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:04.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.823+0000 7f0d87cab700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d80100790 0x7f0d801982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:04.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.823+0000 7f0d87cab700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d80106850 0x7f0d8019c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:04.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.823+0000 7f0d87cab700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8019cc70 con 0x7f0d800ffdd0 2024-01-31T05:10:04.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.823+0000 7f0d87cab700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8019cde0 con 0x7f0d80106850 2024-01-31T05:10:04.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.823+0000 7f0d87cab700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8019cfa0 con 0x7f0d80100790 2024-01-31T05:10:04.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.824+0000 7f0d85a47700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d800ffdd0 0x7f0d80197d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:04.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.824+0000 7f0d85a47700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d800ffdd0 0x7f0d80197d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51644/0 (socket says 172.21.15.99:51644) 2024-01-31T05:10:04.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.824+0000 7f0d85a47700 1 -- 172.21.15.99:0/941456826 learned_addr learned my addr 172.21.15.99:0/941456826 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:04.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.824+0000 7f0d86248700 1 --2- 172.21.15.99:0/941456826 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d80106850 0x7f0d8019c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:04.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.824+0000 7f0d85a47700 1 -- 172.21.15.99:0/941456826 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d80100790 msgr2=0x7f0d801982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:04.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.824+0000 7f0d85a47700 1 --2- 172.21.15.99:0/941456826 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d80100790 0x7f0d801982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:04.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.824+0000 7f0d85a47700 1 -- 172.21.15.99:0/941456826 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d80106850 msgr2=0x7f0d8019c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:04.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.824+0000 7f0d85a47700 1 --2- 172.21.15.99:0/941456826 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d80106850 0x7f0d8019c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:04.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.824+0000 7f0d85a47700 1 -- 172.21.15.99:0/941456826 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d78009d00 con 0x7f0d800ffdd0 2024-01-31T05:10:04.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.824+0000 7f0d85a47700 1 --2- 172.21.15.99:0/941456826 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d800ffdd0 0x7f0d80197d90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c00e9a0 tx=0x7f0d7c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:04.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.824+0000 7f0d76ffd700 1 -- 172.21.15.99:0/941456826 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c009790 con 0x7f0d800ffdd0 2024-01-31T05:10:04.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.824+0000 7f0d87cab700 1 -- 172.21.15.99:0/941456826 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d70009520 con 0x7f0d800ffdd0 2024-01-31T05:10:04.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.824+0000 7f0d76ffd700 1 -- 172.21.15.99:0/941456826 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0d7c00cbd0 con 0x7f0d800ffdd0 2024-01-31T05:10:04.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.824+0000 7f0d87cab700 1 -- 172.21.15.99:0/941456826 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d801a4910 con 0x7f0d800ffdd0 2024-01-31T05:10:04.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.825+0000 7f0d76ffd700 1 -- 172.21.15.99:0/941456826 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c018680 con 0x7f0d800ffdd0 2024-01-31T05:10:04.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.825+0000 7f0d87cab700 1 -- 172.21.15.99:0/941456826 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0d80111c10 con 0x7f0d800ffdd0 2024-01-31T05:10:04.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.827+0000 7f0d76ffd700 1 -- 172.21.15.99:0/941456826 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f0d7c00cd40 con 0x7f0d800ffdd0 2024-01-31T05:10:04.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.827+0000 7f0d76ffd700 1 --2- 172.21.15.99:0/941456826 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f0d6c0a1460 0x7f0d6c0a3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:04.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.828+0000 7f0d85246700 1 --2- 172.21.15.99:0/941456826 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f0d6c0a1460 0x7f0d6c0a3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:04.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.828+0000 7f0d76ffd700 1 -- 172.21.15.99:0/941456826 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f0d7c014070 con 0x7f0d800ffdd0 2024-01-31T05:10:04.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.828+0000 7f0d76ffd700 1 --2- 172.21.15.99:0/941456826 >> [v2:172.21.15.181:6824/1858219600,v1:172.21.15.181:6825/1858219600] conn(0x7f0d6c0aac40 0x7f0d6c0ad060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:04.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.828+0000 7f0d76ffd700 1 -- 172.21.15.99:0/941456826 --> [v2:172.21.15.181:6824/1858219600,v1:172.21.15.181:6825/1858219600] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0d6c0ad710 con 0x7f0d6c0aac40 2024-01-31T05:10:04.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.828+0000 7f0d76ffd700 1 -- 172.21.15.99:0/941456826 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d7c018680 con 0x7f0d800ffdd0 2024-01-31T05:10:04.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.828+0000 7f0d85246700 1 --2- 172.21.15.99:0/941456826 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f0d6c0a1460 0x7f0d6c0a3920 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0d7000c010 tx=0x7f0d70009f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:04.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.828+0000 7f0d86248700 1 --2- 172.21.15.99:0/941456826 >> [v2:172.21.15.181:6824/1858219600,v1:172.21.15.181:6825/1858219600] conn(0x7f0d6c0aac40 0x7f0d6c0ad060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:04.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.829+0000 7f0d86248700 1 --2- 172.21.15.99:0/941456826 >> [v2:172.21.15.181:6824/1858219600,v1:172.21.15.181:6825/1858219600] conn(0x7f0d6c0aac40 0x7f0d6c0ad060 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:04.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.829+0000 7f0d76ffd700 1 -- 172.21.15.99:0/941456826 <== osd.11 v2:172.21.15.181:6824/1858219600 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f0d6c0ad710 con 0x7f0d6c0aac40 2024-01-31T05:10:04.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.846+0000 7f0d87cab700 1 -- 172.21.15.99:0/941456826 --> [v2:172.21.15.181:6824/1858219600,v1:172.21.15.181:6825/1858219600] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0d80061e70 con 0x7f0d6c0aac40 2024-01-31T05:10:04.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.846+0000 7f0d76ffd700 1 -- 172.21.15.99:0/941456826 <== osd.11 v2:172.21.15.181:6824/1858219600 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f0d80061e70 con 0x7f0d6c0aac40 2024-01-31T05:10:04.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.847+0000 7f0d87cab700 1 -- 172.21.15.99:0/941456826 >> [v2:172.21.15.181:6824/1858219600,v1:172.21.15.181:6825/1858219600] conn(0x7f0d6c0aac40 msgr2=0x7f0d6c0ad060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:04.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.847+0000 7f0d87cab700 1 --2- 172.21.15.99:0/941456826 >> [v2:172.21.15.181:6824/1858219600,v1:172.21.15.181:6825/1858219600] conn(0x7f0d6c0aac40 0x7f0d6c0ad060 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:04.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.847+0000 7f0d87cab700 1 -- 172.21.15.99:0/941456826 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f0d6c0a1460 msgr2=0x7f0d6c0a3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:04.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.847+0000 7f0d87cab700 1 --2- 172.21.15.99:0/941456826 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f0d6c0a1460 0x7f0d6c0a3920 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0d7000c010 tx=0x7f0d70009f50 comp rx=0 tx=0).stop 2024-01-31T05:10:04.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.847+0000 7f0d87cab700 1 -- 172.21.15.99:0/941456826 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d800ffdd0 msgr2=0x7f0d80197d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:04.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.847+0000 7f0d87cab700 1 --2- 172.21.15.99:0/941456826 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d800ffdd0 0x7f0d80197d90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c00e9a0 tx=0x7f0d7c00ecb0 comp rx=0 tx=0).stop 2024-01-31T05:10:04.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.847+0000 7f0d86248700 1 -- 172.21.15.99:0/941456826 reap_dead start 2024-01-31T05:10:04.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.847+0000 7f0d87cab700 1 -- 172.21.15.99:0/941456826 shutdown_connections 2024-01-31T05:10:04.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.847+0000 7f0d87cab700 1 -- 172.21.15.99:0/941456826 >> 172.21.15.99:0/941456826 conn(0x7f0d80076ce0 msgr2=0x7f0d800fc430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:04.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.847+0000 7f0d87cab700 1 -- 172.21.15.99:0/941456826 shutdown_connections 2024-01-31T05:10:04.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:04.847+0000 7f0d87cab700 1 -- 172.21.15.99:0/941456826 wait complete. 2024-01-31T05:10:05.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.303+0000 7f6b22027700 1 -- 172.21.15.99:0/2557845949 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b1c100710 msgr2=0x7f6b1c100b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:05.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.303+0000 7f6b22027700 1 --2- 172.21.15.99:0/2557845949 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b1c100710 0x7f6b1c100b90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6b04009990 tx=0x7f6b04009ca0 comp rx=0 tx=0).stop 2024-01-31T05:10:05.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.303+0000 7f6b22027700 1 -- 172.21.15.99:0/2557845949 shutdown_connections 2024-01-31T05:10:05.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.303+0000 7f6b22027700 1 --2- 172.21.15.99:0/2557845949 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b1c1010d0 0x7f6b1c10d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:05.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.303+0000 7f6b22027700 1 --2- 172.21.15.99:0/2557845949 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6b1c106680 0x7f6b1c106a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:05.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.303+0000 7f6b22027700 1 --2- 172.21.15.99:0/2557845949 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b1c100710 0x7f6b1c100b90 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:05.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.303+0000 7f6b22027700 1 -- 172.21.15.99:0/2557845949 >> 172.21.15.99:0/2557845949 conn(0x7f6b1c076730 msgr2=0x7f6b1c076b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:05.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.303+0000 7f6b22027700 1 -- 172.21.15.99:0/2557845949 shutdown_connections 2024-01-31T05:10:05.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.303+0000 7f6b22027700 1 -- 172.21.15.99:0/2557845949 wait complete. 2024-01-31T05:10:05.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.303+0000 7f6b22027700 1 Processor -- start 2024-01-31T05:10:05.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.304+0000 7f6b22027700 1 -- start start 2024-01-31T05:10:05.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.304+0000 7f6b22027700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b1c100710 0x7f6b1c19d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:05.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.304+0000 7f6b22027700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b1c1010d0 0x7f6b1c19dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:05.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.304+0000 7f6b22027700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6b1c106680 0x7f6b1c197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:05.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.304+0000 7f6b22027700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1c1980c0 con 0x7f6b1c100710 2024-01-31T05:10:05.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.304+0000 7f6b1b7fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b1c100710 0x7f6b1c19d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:05.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.304+0000 7f6b1b7fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b1c100710 0x7f6b1c19d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51662/0 (socket says 172.21.15.99:51662) 2024-01-31T05:10:05.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.304+0000 7f6b1b7fe700 1 -- 172.21.15.99:0/1854034961 learned_addr learned my addr 172.21.15.99:0/1854034961 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:05.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.304+0000 7f6b22027700 1 -- 172.21.15.99:0/1854034961 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1c198200 con 0x7f6b1c1010d0 2024-01-31T05:10:05.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.304+0000 7f6b22027700 1 -- 172.21.15.99:0/1854034961 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1c1983c0 con 0x7f6b1c106680 2024-01-31T05:10:05.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.304+0000 7f6b1affd700 1 --2- 172.21.15.99:0/1854034961 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b1c1010d0 0x7f6b1c19dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:05.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.304+0000 7f6b1bfff700 1 --2- 172.21.15.99:0/1854034961 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6b1c106680 0x7f6b1c197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:05.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.304+0000 7f6b1b7fe700 1 -- 172.21.15.99:0/1854034961 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6b1c106680 msgr2=0x7f6b1c197a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:05.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.304+0000 7f6b1b7fe700 1 --2- 172.21.15.99:0/1854034961 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6b1c106680 0x7f6b1c197a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:05.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.304+0000 7f6b1b7fe700 1 -- 172.21.15.99:0/1854034961 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b1c1010d0 msgr2=0x7f6b1c19dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:05.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.304+0000 7f6b1b7fe700 1 --2- 172.21.15.99:0/1854034961 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b1c1010d0 0x7f6b1c19dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:05.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.304+0000 7f6b1b7fe700 1 -- 172.21.15.99:0/1854034961 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b040095f0 con 0x7f6b1c100710 2024-01-31T05:10:05.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.305+0000 7f6b1b7fe700 1 --2- 172.21.15.99:0/1854034961 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b1c100710 0x7f6b1c19d8a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c00d950 tx=0x7f6b0c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:05.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.305+0000 7f6b18ff9700 1 -- 172.21.15.99:0/1854034961 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c009940 con 0x7f6b1c100710 2024-01-31T05:10:05.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.305+0000 7f6b22027700 1 -- 172.21.15.99:0/1854034961 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b1c1986a0 con 0x7f6b1c100710 2024-01-31T05:10:05.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.305+0000 7f6b22027700 1 -- 172.21.15.99:0/1854034961 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b1c1a4940 con 0x7f6b1c100710 2024-01-31T05:10:05.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.305+0000 7f6b18ff9700 1 -- 172.21.15.99:0/1854034961 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6b0c010460 con 0x7f6b1c100710 2024-01-31T05:10:05.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.305+0000 7f6b18ff9700 1 -- 172.21.15.99:0/1854034961 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c00f620 con 0x7f6b1c100710 2024-01-31T05:10:05.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.306+0000 7f6b22027700 1 -- 172.21.15.99:0/1854034961 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6afc001030 con 0x7f6b1c100710 2024-01-31T05:10:05.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.307+0000 7f6b18ff9700 1 -- 172.21.15.99:0/1854034961 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f6b0c0105d0 con 0x7f6b1c100710 2024-01-31T05:10:05.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.307+0000 7f6b18ff9700 1 --2- 172.21.15.99:0/1854034961 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f6b080a1480 0x7f6b080a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:05.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.308+0000 7f6b1affd700 1 --2- 172.21.15.99:0/1854034961 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f6b080a1480 0x7f6b080a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:05.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.308+0000 7f6b18ff9700 1 -- 172.21.15.99:0/1854034961 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f6b0c0ccdb0 con 0x7f6b1c100710 2024-01-31T05:10:05.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.308+0000 7f6b18ff9700 1 --2- 172.21.15.99:0/1854034961 >> [v2:172.21.15.99:6818/1534047839,v1:172.21.15.99:6819/1534047839] conn(0x7f6b080aac60 0x7f6b080ad080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:05.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.308+0000 7f6b18ff9700 1 -- 172.21.15.99:0/1854034961 --> [v2:172.21.15.99:6818/1534047839,v1:172.21.15.99:6819/1534047839] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6b080ad730 con 0x7f6b080aac60 2024-01-31T05:10:05.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.308+0000 7f6b18ff9700 1 -- 172.21.15.99:0/1854034961 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b0c0cd250 con 0x7f6b1c100710 2024-01-31T05:10:05.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.308+0000 7f6b1bfff700 1 --2- 172.21.15.99:0/1854034961 >> [v2:172.21.15.99:6818/1534047839,v1:172.21.15.99:6819/1534047839] conn(0x7f6b080aac60 0x7f6b080ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:05.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.308+0000 7f6b1affd700 1 --2- 172.21.15.99:0/1854034961 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f6b080a1480 0x7f6b080a3940 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6b0400b5c0 tx=0x7f6b04005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:05.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.308+0000 7f6b1bfff700 1 --2- 172.21.15.99:0/1854034961 >> [v2:172.21.15.99:6818/1534047839,v1:172.21.15.99:6819/1534047839] conn(0x7f6b080aac60 0x7f6b080ad080 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:05.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.309+0000 7f6b18ff9700 1 -- 172.21.15.99:0/1854034961 <== osd.6 v2:172.21.15.99:6818/1534047839 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f6b080ad730 con 0x7f6b080aac60 2024-01-31T05:10:05.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.325+0000 7f6b22027700 1 -- 172.21.15.99:0/1854034961 --> [v2:172.21.15.99:6818/1534047839,v1:172.21.15.99:6819/1534047839] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6afc002dc0 con 0x7f6b080aac60 2024-01-31T05:10:05.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.325+0000 7f6b18ff9700 1 -- 172.21.15.99:0/1854034961 <== osd.6 v2:172.21.15.99:6818/1534047839 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f6afc002dc0 con 0x7f6b080aac60 2024-01-31T05:10:05.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.325+0000 7f6b22027700 1 -- 172.21.15.99:0/1854034961 >> [v2:172.21.15.99:6818/1534047839,v1:172.21.15.99:6819/1534047839] conn(0x7f6b080aac60 msgr2=0x7f6b080ad080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:05.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.325+0000 7f6b22027700 1 --2- 172.21.15.99:0/1854034961 >> [v2:172.21.15.99:6818/1534047839,v1:172.21.15.99:6819/1534047839] conn(0x7f6b080aac60 0x7f6b080ad080 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:05.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.325+0000 7f6b22027700 1 -- 172.21.15.99:0/1854034961 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f6b080a1480 msgr2=0x7f6b080a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:05.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.325+0000 7f6b22027700 1 --2- 172.21.15.99:0/1854034961 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f6b080a1480 0x7f6b080a3940 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6b0400b5c0 tx=0x7f6b04005960 comp rx=0 tx=0).stop 2024-01-31T05:10:05.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.325+0000 7f6b22027700 1 -- 172.21.15.99:0/1854034961 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b1c100710 msgr2=0x7f6b1c19d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:05.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.325+0000 7f6b22027700 1 --2- 172.21.15.99:0/1854034961 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b1c100710 0x7f6b1c19d8a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c00d950 tx=0x7f6b0c00dc60 comp rx=0 tx=0).stop 2024-01-31T05:10:05.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.325+0000 7f6b1bfff700 1 -- 172.21.15.99:0/1854034961 reap_dead start 2024-01-31T05:10:05.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.326+0000 7f6b22027700 1 -- 172.21.15.99:0/1854034961 shutdown_connections 2024-01-31T05:10:05.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.326+0000 7f6b22027700 1 -- 172.21.15.99:0/1854034961 >> 172.21.15.99:0/1854034961 conn(0x7f6b1c076730 msgr2=0x7f6b1c06a160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:05.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.326+0000 7f6b22027700 1 -- 172.21.15.99:0/1854034961 shutdown_connections 2024-01-31T05:10:05.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:05.326+0000 7f6b22027700 1 -- 172.21.15.99:0/1854034961 wait complete. 2024-01-31T05:10:06.061 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:05 smithi099 ceph-mon[31615]: pgmap v308: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-01-31T05:10:06.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:05 smithi181 ceph-mon[36434]: pgmap v308: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-01-31T05:10:06.087 INFO:teuthology.orchestra.run.smithi099.stdout:197568495663 2024-01-31T05:10:06.087 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph osd last-stat-seq osd.6 2024-01-31T05:10:06.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:05 smithi179 ceph-mon[35652]: pgmap v308: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-01-31T05:10:06.824 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:10:07.923 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:07 smithi099 ceph-mon[31615]: pgmap v309: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-01-31T05:10:07.948 INFO:teuthology.orchestra.run.smithi099.stdout:347892350998 2024-01-31T05:10:07.949 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph osd last-stat-seq osd.11 2024-01-31T05:10:08.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:07 smithi181 ceph-mon[36434]: pgmap v309: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-01-31T05:10:08.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:07 smithi179 ceph-mon[35652]: pgmap v309: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8 op/s 2024-01-31T05:10:08.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.181+0000 7f5042936700 1 -- 172.21.15.99:0/576415533 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f503c100710 msgr2=0x7f503c100b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:08.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.181+0000 7f5042936700 1 --2- 172.21.15.99:0/576415533 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f503c100710 0x7f503c100b90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5030009990 tx=0x7f5030009ca0 comp rx=0 tx=0).stop 2024-01-31T05:10:08.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.181+0000 7f5042936700 1 -- 172.21.15.99:0/576415533 shutdown_connections 2024-01-31T05:10:08.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.181+0000 7f5042936700 1 --2- 172.21.15.99:0/576415533 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f503c1010d0 0x7f503c10d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:08.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.181+0000 7f5042936700 1 --2- 172.21.15.99:0/576415533 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f503c106680 0x7f503c106a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:08.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.181+0000 7f5042936700 1 --2- 172.21.15.99:0/576415533 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f503c100710 0x7f503c100b90 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:08.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.181+0000 7f5042936700 1 -- 172.21.15.99:0/576415533 >> 172.21.15.99:0/576415533 conn(0x7f503c076730 msgr2=0x7f503c076b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:08.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.181+0000 7f5042936700 1 -- 172.21.15.99:0/576415533 shutdown_connections 2024-01-31T05:10:08.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.181+0000 7f5042936700 1 -- 172.21.15.99:0/576415533 wait complete. 2024-01-31T05:10:08.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.181+0000 7f5042936700 1 Processor -- start 2024-01-31T05:10:08.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.181+0000 7f5042936700 1 -- start start 2024-01-31T05:10:08.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.182+0000 7f5042936700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f503c100710 0x7f503c198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:08.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.182+0000 7f5042936700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f503c1010d0 0x7f503c198f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:08.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.182+0000 7f5042936700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f503c106680 0x7f503c1a3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:08.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.182+0000 7f5042936700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503c199790 con 0x7f503c1010d0 2024-01-31T05:10:08.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.182+0000 7f5042936700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503c1a3fc0 con 0x7f503c106680 2024-01-31T05:10:08.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.182+0000 7f5042936700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503c1a4100 con 0x7f503c100710 2024-01-31T05:10:08.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.182+0000 7f503b7fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f503c1010d0 0x7f503c198f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:08.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.182+0000 7f503b7fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f503c1010d0 0x7f503c198f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39610/0 (socket says 172.21.15.99:39610) 2024-01-31T05:10:08.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.182+0000 7f503b7fe700 1 -- 172.21.15.99:0/3562958278 learned_addr learned my addr 172.21.15.99:0/3562958278 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:08.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.182+0000 7f5040ed3700 1 --2- 172.21.15.99:0/3562958278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f503c106680 0x7f503c1a3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:08.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.182+0000 7f503b7fe700 1 -- 172.21.15.99:0/3562958278 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f503c100710 msgr2=0x7f503c198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:08.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.182+0000 7f503b7fe700 1 --2- 172.21.15.99:0/3562958278 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f503c100710 0x7f503c198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:08.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.182+0000 7f503b7fe700 1 -- 172.21.15.99:0/3562958278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f503c106680 msgr2=0x7f503c1a3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:08.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.182+0000 7f503b7fe700 1 --2- 172.21.15.99:0/3562958278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f503c106680 0x7f503c1a3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:08.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.182+0000 7f503b7fe700 1 -- 172.21.15.99:0/3562958278 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50300095f0 con 0x7f503c1010d0 2024-01-31T05:10:08.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.182+0000 7f5040ed3700 1 --2- 172.21.15.99:0/3562958278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f503c106680 0x7f503c1a3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:10:08.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.182+0000 7f503b7fe700 1 --2- 172.21.15.99:0/3562958278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f503c1010d0 0x7f503c198f40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f503000f6d0 tx=0x7f503000f7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:08.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.183+0000 7f50397fa700 1 -- 172.21.15.99:0/3562958278 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503001d070 con 0x7f503c1010d0 2024-01-31T05:10:08.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.183+0000 7f50397fa700 1 -- 172.21.15.99:0/3562958278 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f503000fc90 con 0x7f503c1010d0 2024-01-31T05:10:08.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.183+0000 7f5042936700 1 -- 172.21.15.99:0/3562958278 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f503c1a4300 con 0x7f503c1010d0 2024-01-31T05:10:08.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.183+0000 7f50397fa700 1 -- 172.21.15.99:0/3562958278 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5030017650 con 0x7f503c1010d0 2024-01-31T05:10:08.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.183+0000 7f5042936700 1 -- 172.21.15.99:0/3562958278 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f503c1a47a0 con 0x7f503c1010d0 2024-01-31T05:10:08.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.184+0000 7f5042936700 1 -- 172.21.15.99:0/3562958278 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f503c1108f0 con 0x7f503c1010d0 2024-01-31T05:10:08.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.186+0000 7f50397fa700 1 -- 172.21.15.99:0/3562958278 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f5030005080 con 0x7f503c1010d0 2024-01-31T05:10:08.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.186+0000 7f50397fa700 1 --2- 172.21.15.99:0/3562958278 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f50240a1480 0x7f50240a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:08.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.186+0000 7f50397fa700 1 -- 172.21.15.99:0/3562958278 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f50300ce470 con 0x7f503c1010d0 2024-01-31T05:10:08.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.187+0000 7f50397fa700 1 --2- 172.21.15.99:0/3562958278 >> [v2:172.21.15.99:6802/1213805280,v1:172.21.15.99:6803/1213805280] conn(0x7f50240aac60 0x7f50240ad080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:08.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.187+0000 7f50397fa700 1 -- 172.21.15.99:0/3562958278 --> [v2:172.21.15.99:6802/1213805280,v1:172.21.15.99:6803/1213805280] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f50240ad730 con 0x7f50240aac60 2024-01-31T05:10:08.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.187+0000 7f50397fa700 1 -- 172.21.15.99:0/3562958278 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50300ce820 con 0x7f503c1010d0 2024-01-31T05:10:08.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.187+0000 7f503bfff700 1 --2- 172.21.15.99:0/3562958278 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f50240a1480 0x7f50240a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:08.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.187+0000 7f5040ed3700 1 --2- 172.21.15.99:0/3562958278 >> [v2:172.21.15.99:6802/1213805280,v1:172.21.15.99:6803/1213805280] conn(0x7f50240aac60 0x7f50240ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:08.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.188+0000 7f503bfff700 1 --2- 172.21.15.99:0/3562958278 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f50240a1480 0x7f50240a3940 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f502c00a9b0 tx=0x7f502c005c90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:08.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.188+0000 7f5040ed3700 1 --2- 172.21.15.99:0/3562958278 >> [v2:172.21.15.99:6802/1213805280,v1:172.21.15.99:6803/1213805280] conn(0x7f50240aac60 0x7f50240ad080 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:08.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.189+0000 7f50397fa700 1 -- 172.21.15.99:0/3562958278 <== osd.0 v2:172.21.15.99:6802/1213805280 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f50240ad730 con 0x7f50240aac60 2024-01-31T05:10:08.193 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:10:08.201 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:10:08.202 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:10:08.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.226+0000 7f5042936700 1 -- 172.21.15.99:0/3562958278 --> [v2:172.21.15.99:6802/1213805280,v1:172.21.15.99:6803/1213805280] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f503c061e70 con 0x7f50240aac60 2024-01-31T05:10:08.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.226+0000 7f50397fa700 1 -- 172.21.15.99:0/3562958278 <== osd.0 v2:172.21.15.99:6802/1213805280 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f503c061e70 con 0x7f50240aac60 2024-01-31T05:10:08.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.227+0000 7f5042936700 1 -- 172.21.15.99:0/3562958278 >> [v2:172.21.15.99:6802/1213805280,v1:172.21.15.99:6803/1213805280] conn(0x7f50240aac60 msgr2=0x7f50240ad080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:08.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.227+0000 7f5042936700 1 --2- 172.21.15.99:0/3562958278 >> [v2:172.21.15.99:6802/1213805280,v1:172.21.15.99:6803/1213805280] conn(0x7f50240aac60 0x7f50240ad080 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:08.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.228+0000 7f5042936700 1 -- 172.21.15.99:0/3562958278 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f50240a1480 msgr2=0x7f50240a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:08.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.228+0000 7f5042936700 1 --2- 172.21.15.99:0/3562958278 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f50240a1480 0x7f50240a3940 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f502c00a9b0 tx=0x7f502c005c90 comp rx=0 tx=0).stop 2024-01-31T05:10:08.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.228+0000 7f5042936700 1 -- 172.21.15.99:0/3562958278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f503c1010d0 msgr2=0x7f503c198f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:08.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.228+0000 7f5042936700 1 --2- 172.21.15.99:0/3562958278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f503c1010d0 0x7f503c198f40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f503000f6d0 tx=0x7f503000f7b0 comp rx=0 tx=0).stop 2024-01-31T05:10:08.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.228+0000 7f5040ed3700 1 -- 172.21.15.99:0/3562958278 reap_dead start 2024-01-31T05:10:08.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.228+0000 7f5042936700 1 -- 172.21.15.99:0/3562958278 shutdown_connections 2024-01-31T05:10:08.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.228+0000 7f5042936700 1 -- 172.21.15.99:0/3562958278 >> 172.21.15.99:0/3562958278 conn(0x7f503c076730 msgr2=0x7f503c0fe760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:08.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.228+0000 7f5042936700 1 -- 172.21.15.99:0/3562958278 shutdown_connections 2024-01-31T05:10:08.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:08.229+0000 7f5042936700 1 -- 172.21.15.99:0/3562958278 wait complete. 2024-01-31T05:10:09.194 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:10:09.873 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:09 smithi099 ceph-mon[31615]: pgmap v310: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-01-31T05:10:10.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:09 smithi181 ceph-mon[36434]: pgmap v310: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-01-31T05:10:10.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.098+0000 7f81e0825700 1 -- 172.21.15.99:0/1548093539 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81dc069e30 msgr2=0x7f81dc10e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:10.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.098+0000 7f81e0825700 1 --2- 172.21.15.99:0/1548093539 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81dc069e30 0x7f81dc10e670 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f81d400b0d0 tx=0x7f81d400b3e0 comp rx=0 tx=0).stop 2024-01-31T05:10:10.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.098+0000 7f81e0825700 1 -- 172.21.15.99:0/1548093539 shutdown_connections 2024-01-31T05:10:10.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.098+0000 7f81e0825700 1 --2- 172.21.15.99:0/1548093539 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81dc069e30 0x7f81dc10e670 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:10.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.098+0000 7f81e0825700 1 --2- 172.21.15.99:0/1548093539 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81dc1077a0 0x7f81dc107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:10.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.098+0000 7f81e0825700 1 --2- 172.21.15.99:0/1548093539 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81dc069490 0x7f81dc0698f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:10.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.098+0000 7f81e0825700 1 -- 172.21.15.99:0/1548093539 >> 172.21.15.99:0/1548093539 conn(0x7f81dc077610 msgr2=0x7f81dc077a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:10.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.098+0000 7f81e0825700 1 -- 172.21.15.99:0/1548093539 shutdown_connections 2024-01-31T05:10:10.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.098+0000 7f81e0825700 1 -- 172.21.15.99:0/1548093539 wait complete. 2024-01-31T05:10:10.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.099+0000 7f81e0825700 1 Processor -- start 2024-01-31T05:10:10.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.099+0000 7f81e0825700 1 -- start start 2024-01-31T05:10:10.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.099+0000 7f81e0825700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81dc069490 0x7f81dc19d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:10.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.099+0000 7f81e0825700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81dc069e30 0x7f81dc19de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:10.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.099+0000 7f81e0825700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81dc1077a0 0x7f81dc197af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:10.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.099+0000 7f81e0825700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc198150 con 0x7f81dc1077a0 2024-01-31T05:10:10.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.099+0000 7f81e0825700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc198290 con 0x7f81dc069490 2024-01-31T05:10:10.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.099+0000 7f81e0825700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc198450 con 0x7f81dc069e30 2024-01-31T05:10:10.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.099+0000 7f81dad9d700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81dc1077a0 0x7f81dc197af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:10.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.099+0000 7f81dad9d700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81dc1077a0 0x7f81dc197af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39628/0 (socket says 172.21.15.99:39628) 2024-01-31T05:10:10.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.099+0000 7f81dad9d700 1 -- 172.21.15.99:0/3796946557 learned_addr learned my addr 172.21.15.99:0/3796946557 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:10.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.099+0000 7f81d1d9b700 1 --2- 172.21.15.99:0/3796946557 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81dc069e30 0x7f81dc19de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:10.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.099+0000 7f81da59c700 1 --2- 172.21.15.99:0/3796946557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81dc069490 0x7f81dc19d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:10.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.099+0000 7f81dad9d700 1 -- 172.21.15.99:0/3796946557 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81dc069e30 msgr2=0x7f81dc19de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:10.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.099+0000 7f81dad9d700 1 --2- 172.21.15.99:0/3796946557 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81dc069e30 0x7f81dc19de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:10.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.099+0000 7f81dad9d700 1 -- 172.21.15.99:0/3796946557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81dc069490 msgr2=0x7f81dc19d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:10.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.099+0000 7f81dad9d700 1 --2- 172.21.15.99:0/3796946557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81dc069490 0x7f81dc19d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:10.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.099+0000 7f81dad9d700 1 -- 172.21.15.99:0/3796946557 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d4009d00 con 0x7f81dc1077a0 2024-01-31T05:10:10.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.099+0000 7f81d1d9b700 1 --2- 172.21.15.99:0/3796946557 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81dc069e30 0x7f81dc19de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:10:10.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.100+0000 7f81dad9d700 1 --2- 172.21.15.99:0/3796946557 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81dc1077a0 0x7f81dc197af0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f81d40094c0 tx=0x7f81d40095a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:10.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.100+0000 7f81d3fff700 1 -- 172.21.15.99:0/3796946557 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d400e040 con 0x7f81dc1077a0 2024-01-31T05:10:10.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.100+0000 7f81e0825700 1 -- 172.21.15.99:0/3796946557 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81dc1986d0 con 0x7f81dc1077a0 2024-01-31T05:10:10.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.100+0000 7f81d3fff700 1 -- 172.21.15.99:0/3796946557 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f81d401db40 con 0x7f81dc1077a0 2024-01-31T05:10:10.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.100+0000 7f81d3fff700 1 -- 172.21.15.99:0/3796946557 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d401baf0 con 0x7f81dc1077a0 2024-01-31T05:10:10.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.100+0000 7f81e0825700 1 -- 172.21.15.99:0/3796946557 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81dc1a49d0 con 0x7f81dc1077a0 2024-01-31T05:10:10.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.101+0000 7f81e0825700 1 -- 172.21.15.99:0/3796946557 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f81dc102ee0 con 0x7f81dc1077a0 2024-01-31T05:10:10.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.102+0000 7f81d3fff700 1 -- 172.21.15.99:0/3796946557 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f81d401dcb0 con 0x7f81dc1077a0 2024-01-31T05:10:10.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.102+0000 7f81d3fff700 1 --2- 172.21.15.99:0/3796946557 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f81c80a1400 0x7f81c80a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:10.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.102+0000 7f81da59c700 1 --2- 172.21.15.99:0/3796946557 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f81c80a1400 0x7f81c80a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:10.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.102+0000 7f81d3fff700 1 -- 172.21.15.99:0/3796946557 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f81d40cebb0 con 0x7f81dc1077a0 2024-01-31T05:10:10.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.103+0000 7f81d3fff700 1 --2- 172.21.15.99:0/3796946557 >> [v2:172.21.15.179:6808/2861083896,v1:172.21.15.179:6809/2861083896] conn(0x7f81c80aabe0 0x7f81c80ad000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:10.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.103+0000 7f81d3fff700 1 -- 172.21.15.99:0/3796946557 --> [v2:172.21.15.179:6808/2861083896,v1:172.21.15.179:6809/2861083896] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f81c80ad6b0 con 0x7f81c80aabe0 2024-01-31T05:10:10.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.103+0000 7f81d3fff700 1 -- 172.21.15.99:0/3796946557 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f81d40cf050 con 0x7f81dc1077a0 2024-01-31T05:10:10.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.103+0000 7f81da59c700 1 --2- 172.21.15.99:0/3796946557 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f81c80a1400 0x7f81c80a38c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f81cc005950 tx=0x7f81cc0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:10.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.103+0000 7f81d1d9b700 1 --2- 172.21.15.99:0/3796946557 >> [v2:172.21.15.179:6808/2861083896,v1:172.21.15.179:6809/2861083896] conn(0x7f81c80aabe0 0x7f81c80ad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:10.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.103+0000 7f81d1d9b700 1 --2- 172.21.15.99:0/3796946557 >> [v2:172.21.15.179:6808/2861083896,v1:172.21.15.179:6809/2861083896] conn(0x7f81c80aabe0 0x7f81c80ad000 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:10.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.104+0000 7f81d3fff700 1 -- 172.21.15.99:0/3796946557 <== osd.4 v2:172.21.15.179:6808/2861083896 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f81c80ad6b0 con 0x7f81c80aabe0 2024-01-31T05:10:10.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.121+0000 7f81e0825700 1 -- 172.21.15.99:0/3796946557 --> [v2:172.21.15.179:6808/2861083896,v1:172.21.15.179:6809/2861083896] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f81dc111a00 con 0x7f81c80aabe0 2024-01-31T05:10:10.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.122+0000 7f81d3fff700 1 -- 172.21.15.99:0/3796946557 <== osd.4 v2:172.21.15.179:6808/2861083896 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f81dc111a00 con 0x7f81c80aabe0 2024-01-31T05:10:10.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.122+0000 7f81e0825700 1 -- 172.21.15.99:0/3796946557 >> [v2:172.21.15.179:6808/2861083896,v1:172.21.15.179:6809/2861083896] conn(0x7f81c80aabe0 msgr2=0x7f81c80ad000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:10.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.122+0000 7f81e0825700 1 --2- 172.21.15.99:0/3796946557 >> [v2:172.21.15.179:6808/2861083896,v1:172.21.15.179:6809/2861083896] conn(0x7f81c80aabe0 0x7f81c80ad000 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:10.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.122+0000 7f81e0825700 1 -- 172.21.15.99:0/3796946557 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f81c80a1400 msgr2=0x7f81c80a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:10.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.122+0000 7f81e0825700 1 --2- 172.21.15.99:0/3796946557 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f81c80a1400 0x7f81c80a38c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f81cc005950 tx=0x7f81cc0058e0 comp rx=0 tx=0).stop 2024-01-31T05:10:10.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.122+0000 7f81e0825700 1 -- 172.21.15.99:0/3796946557 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81dc1077a0 msgr2=0x7f81dc197af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:10.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.122+0000 7f81e0825700 1 --2- 172.21.15.99:0/3796946557 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81dc1077a0 0x7f81dc197af0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f81d40094c0 tx=0x7f81d40095a0 comp rx=0 tx=0).stop 2024-01-31T05:10:10.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.122+0000 7f81dad9d700 1 -- 172.21.15.99:0/3796946557 reap_dead start 2024-01-31T05:10:10.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.122+0000 7f81e0825700 1 -- 172.21.15.99:0/3796946557 shutdown_connections 2024-01-31T05:10:10.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.122+0000 7f81e0825700 1 -- 172.21.15.99:0/3796946557 >> 172.21.15.99:0/3796946557 conn(0x7f81dc077610 msgr2=0x7f81dc0fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:10.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.122+0000 7f81e0825700 1 -- 172.21.15.99:0/3796946557 shutdown_connections 2024-01-31T05:10:10.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:10.122+0000 7f81e0825700 1 -- 172.21.15.99:0/3796946557 wait complete. 2024-01-31T05:10:10.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:09 smithi179 ceph-mon[35652]: pgmap v310: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-01-31T05:10:11.135 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:10:11.136 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:10:11.988 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:11 smithi099 ceph-mon[31615]: pgmap v311: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-01-31T05:10:12.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:11 smithi181 ceph-mon[36434]: pgmap v311: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-01-31T05:10:12.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:11 smithi179 ceph-mon[35652]: pgmap v311: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-01-31T05:10:12.327 INFO:teuthology.orchestra.run.smithi099.stdout:141733920826 2024-01-31T05:10:12.338 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph osd last-stat-seq osd.4 2024-01-31T05:10:12.442 INFO:teuthology.orchestra.run.smithi099.stdout:34359738445 2024-01-31T05:10:12.443 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph osd last-stat-seq osd.0 2024-01-31T05:10:13.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:13 smithi099 ceph-mon[31615]: pgmap v312: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-01-31T05:10:13.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:13 smithi181 ceph-mon[36434]: pgmap v312: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-01-31T05:10:13.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:13 smithi179 ceph-mon[35652]: pgmap v312: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-01-31T05:10:15.953 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:15 smithi099 ceph-mon[31615]: pgmap v313: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-01-31T05:10:16.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:15 smithi181 ceph-mon[36434]: pgmap v313: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-01-31T05:10:16.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:15 smithi179 ceph-mon[35652]: pgmap v313: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-01-31T05:10:17.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.729+0000 7f3996c11700 1 -- 172.21.15.99:0/3311502035 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3990106850 msgr2=0x7f3990106c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:17.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.729+0000 7f3996c11700 1 --2- 172.21.15.99:0/3311502035 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3990106850 0x7f3990106c30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3984009990 tx=0x7f3984009ca0 comp rx=0 tx=0).stop 2024-01-31T05:10:17.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.729+0000 7f3996c11700 1 -- 172.21.15.99:0/3311502035 shutdown_connections 2024-01-31T05:10:17.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.729+0000 7f3996c11700 1 --2- 172.21.15.99:0/3311502035 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3990100790 0x7f399010e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:17.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.729+0000 7f3996c11700 1 --2- 172.21.15.99:0/3311502035 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3990106850 0x7f3990106c30 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:17.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.729+0000 7f3996c11700 1 --2- 172.21.15.99:0/3311502035 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f39900ffdd0 0x7f3990100250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:17.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.729+0000 7f3996c11700 1 -- 172.21.15.99:0/3311502035 >> 172.21.15.99:0/3311502035 conn(0x7f3990076ce0 msgr2=0x7f39900fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:17.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.730+0000 7f3996c11700 1 -- 172.21.15.99:0/3311502035 shutdown_connections 2024-01-31T05:10:17.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.730+0000 7f3996c11700 1 -- 172.21.15.99:0/3311502035 wait complete. 2024-01-31T05:10:17.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.730+0000 7f3996c11700 1 Processor -- start 2024-01-31T05:10:17.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.730+0000 7f3996c11700 1 -- start start 2024-01-31T05:10:17.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.730+0000 7f3996c11700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39900ffdd0 0x7f3990100fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:17.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.730+0000 7f3996c11700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3990100790 0x7f39901014f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:17.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.730+0000 7f3996c11700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3990106850 0x7f3990101a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:17.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.730+0000 7f3996c11700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39901a6200 con 0x7f3990106850 2024-01-31T05:10:17.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.730+0000 7f3996c11700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39901a6370 con 0x7f39900ffdd0 2024-01-31T05:10:17.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.730+0000 7f3996c11700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39901a6530 con 0x7f3990100790 2024-01-31T05:10:17.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.731+0000 7f39951ae700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3990106850 0x7f3990101a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:17.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.731+0000 7f398ffff700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3990100790 0x7f39901014f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:17.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.731+0000 7f39951ae700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3990106850 0x7f3990101a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48278/0 (socket says 172.21.15.99:48278) 2024-01-31T05:10:17.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.731+0000 7f39951ae700 1 -- 172.21.15.99:0/2229988550 learned_addr learned my addr 172.21.15.99:0/2229988550 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:17.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.731+0000 7f39949ad700 1 --2- 172.21.15.99:0/2229988550 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39900ffdd0 0x7f3990100fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:17.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.731+0000 7f39951ae700 1 -- 172.21.15.99:0/2229988550 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3990100790 msgr2=0x7f39901014f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:17.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.731+0000 7f39951ae700 1 --2- 172.21.15.99:0/2229988550 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3990100790 0x7f39901014f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:17.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.731+0000 7f39951ae700 1 -- 172.21.15.99:0/2229988550 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39900ffdd0 msgr2=0x7f3990100fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:17.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.731+0000 7f39951ae700 1 --2- 172.21.15.99:0/2229988550 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39900ffdd0 0x7f3990100fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:17.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.731+0000 7f39951ae700 1 -- 172.21.15.99:0/2229988550 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39840095f0 con 0x7f3990106850 2024-01-31T05:10:17.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.731+0000 7f39951ae700 1 --2- 172.21.15.99:0/2229988550 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3990106850 0x7f3990101a30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f398800b9e0 tx=0x7f398800bcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:17.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.731+0000 7f398dffb700 1 -- 172.21.15.99:0/2229988550 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398800d8e0 con 0x7f3990106850 2024-01-31T05:10:17.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.731+0000 7f398dffb700 1 -- 172.21.15.99:0/2229988550 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3988009880 con 0x7f3990106850 2024-01-31T05:10:17.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.731+0000 7f3996c11700 1 -- 172.21.15.99:0/2229988550 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39901a6810 con 0x7f3990106850 2024-01-31T05:10:17.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.732+0000 7f398dffb700 1 -- 172.21.15.99:0/2229988550 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39880143d0 con 0x7f3990106850 2024-01-31T05:10:17.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.732+0000 7f3996c11700 1 -- 172.21.15.99:0/2229988550 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39901a6d10 con 0x7f3990106850 2024-01-31T05:10:17.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.733+0000 7f3996c11700 1 -- 172.21.15.99:0/2229988550 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3990109e20 con 0x7f3990106850 2024-01-31T05:10:17.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.733+0000 7f398dffb700 1 -- 172.21.15.99:0/2229988550 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f3988014530 con 0x7f3990106850 2024-01-31T05:10:17.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.734+0000 7f398dffb700 1 --2- 172.21.15.99:0/2229988550 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f39800a1400 0x7f39800a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:17.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.734+0000 7f39949ad700 1 --2- 172.21.15.99:0/2229988550 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f39800a1400 0x7f39800a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:17.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.734+0000 7f398dffb700 1 -- 172.21.15.99:0/2229988550 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f3988011070 con 0x7f3990106850 2024-01-31T05:10:17.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.735+0000 7f39949ad700 1 --2- 172.21.15.99:0/2229988550 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f39800a1400 0x7f39800a38c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f398400b5c0 tx=0x7f3984005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:17.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.739+0000 7f398dffb700 1 -- 172.21.15.99:0/2229988550 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f398804f600 con 0x7f3990106850 2024-01-31T05:10:17.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.945+0000 7f3996c11700 1 -- 172.21.15.99:0/2229988550 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f39901024e0 con 0x7f3990106850 2024-01-31T05:10:17.945 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:17 smithi099 ceph-mon[31615]: pgmap v314: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-01-31T05:10:17.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.945+0000 7f398dffb700 1 -- 172.21.15.99:0/2229988550 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f39880958c0 con 0x7f3990106850 2024-01-31T05:10:17.946 INFO:teuthology.orchestra.run.smithi099.stdout:55834574921 2024-01-31T05:10:17.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.949+0000 7f3996c11700 1 -- 172.21.15.99:0/2229988550 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f39800a1400 msgr2=0x7f39800a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:17.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.949+0000 7f3996c11700 1 --2- 172.21.15.99:0/2229988550 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f39800a1400 0x7f39800a38c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f398400b5c0 tx=0x7f3984005960 comp rx=0 tx=0).stop 2024-01-31T05:10:17.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.949+0000 7f3996c11700 1 -- 172.21.15.99:0/2229988550 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3990106850 msgr2=0x7f3990101a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:17.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.949+0000 7f3996c11700 1 --2- 172.21.15.99:0/2229988550 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3990106850 0x7f3990101a30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f398800b9e0 tx=0x7f398800bcf0 comp rx=0 tx=0).stop 2024-01-31T05:10:17.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.949+0000 7f3996c11700 1 -- 172.21.15.99:0/2229988550 shutdown_connections 2024-01-31T05:10:17.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.949+0000 7f3996c11700 1 --2- 172.21.15.99:0/2229988550 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3990106850 0x7f3990101a30 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:17.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.949+0000 7f3996c11700 1 --2- 172.21.15.99:0/2229988550 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f39800a1400 0x7f39800a38c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:17.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.949+0000 7f3996c11700 1 --2- 172.21.15.99:0/2229988550 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39900ffdd0 0x7f3990100fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:17.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.949+0000 7f3996c11700 1 --2- 172.21.15.99:0/2229988550 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3990100790 0x7f39901014f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:17.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.949+0000 7f3996c11700 1 -- 172.21.15.99:0/2229988550 >> 172.21.15.99:0/2229988550 conn(0x7f3990076ce0 msgr2=0x7f3990104930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:17.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.949+0000 7f3996c11700 1 -- 172.21.15.99:0/2229988550 shutdown_connections 2024-01-31T05:10:17.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:17.949+0000 7f3996c11700 1 -- 172.21.15.99:0/2229988550 wait complete. 2024-01-31T05:10:18.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:17 smithi181 ceph-mon[36434]: pgmap v314: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-01-31T05:10:18.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:17 smithi179 ceph-mon[35652]: pgmap v314: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-01-31T05:10:18.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.288+0000 7f2f493ba700 1 -- 172.21.15.99:0/785793300 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2f44100ae0 msgr2=0x7f2f441108d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:18.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.288+0000 7f2f493ba700 1 --2- 172.21.15.99:0/785793300 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2f44100ae0 0x7f2f441108d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c00b0d0 tx=0x7f2f3c00b3e0 comp rx=0 tx=0).stop 2024-01-31T05:10:18.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.288+0000 7f2f493ba700 1 -- 172.21.15.99:0/785793300 shutdown_connections 2024-01-31T05:10:18.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.288+0000 7f2f493ba700 1 --2- 172.21.15.99:0/785793300 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2f44100ae0 0x7f2f441108d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:18.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.288+0000 7f2f493ba700 1 --2- 172.21.15.99:0/785793300 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f44102660 0x7f2f44102a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:18.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.288+0000 7f2f493ba700 1 --2- 172.21.15.99:0/785793300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f44100120 0x7f2f441005a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:18.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.288+0000 7f2f493ba700 1 -- 172.21.15.99:0/785793300 >> 172.21.15.99:0/785793300 conn(0x7f2f44075a20 msgr2=0x7f2f44075e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:18.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.288+0000 7f2f493ba700 1 -- 172.21.15.99:0/785793300 shutdown_connections 2024-01-31T05:10:18.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.288+0000 7f2f493ba700 1 -- 172.21.15.99:0/785793300 wait complete. 2024-01-31T05:10:18.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.289+0000 7f2f493ba700 1 Processor -- start 2024-01-31T05:10:18.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.289+0000 7f2f493ba700 1 -- start start 2024-01-31T05:10:18.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.290+0000 7f2f493ba700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2f44100120 0x7f2f44199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:18.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.290+0000 7f2f493ba700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f44100ae0 0x7f2f4419a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:18.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.290+0000 7f2f493ba700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f44102660 0x7f2f4419e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:18.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.290+0000 7f2f493ba700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4419ee80 con 0x7f2f44100120 2024-01-31T05:10:18.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.290+0000 7f2f493ba700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4419eff0 con 0x7f2f44102660 2024-01-31T05:10:18.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.290+0000 7f2f493ba700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4419f1b0 con 0x7f2f44100ae0 2024-01-31T05:10:18.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.290+0000 7f2f42ffd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2f44100120 0x7f2f44199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:18.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.290+0000 7f2f42ffd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2f44100120 0x7f2f44199ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48326/0 (socket says 172.21.15.99:48326) 2024-01-31T05:10:18.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.290+0000 7f2f427fc700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f44100ae0 0x7f2f4419a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:18.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.290+0000 7f2f42ffd700 1 -- 172.21.15.99:0/244786853 learned_addr learned my addr 172.21.15.99:0/244786853 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:18.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.290+0000 7f2f437fe700 1 --2- 172.21.15.99:0/244786853 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f44102660 0x7f2f4419e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:18.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.290+0000 7f2f427fc700 1 -- 172.21.15.99:0/244786853 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f44102660 msgr2=0x7f2f4419e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:18.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.290+0000 7f2f427fc700 1 --2- 172.21.15.99:0/244786853 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f44102660 0x7f2f4419e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:18.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.290+0000 7f2f427fc700 1 -- 172.21.15.99:0/244786853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2f44100120 msgr2=0x7f2f44199ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:18.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.290+0000 7f2f427fc700 1 --2- 172.21.15.99:0/244786853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2f44100120 0x7f2f44199ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:18.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.291+0000 7f2f427fc700 1 -- 172.21.15.99:0/244786853 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f3c009d00 con 0x7f2f44100ae0 2024-01-31T05:10:18.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.291+0000 7f2f42ffd700 1 --2- 172.21.15.99:0/244786853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2f44100120 0x7f2f44199ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:10:18.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.291+0000 7f2f427fc700 1 --2- 172.21.15.99:0/244786853 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f44100ae0 0x7f2f4419a530 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2f3800d950 tx=0x7f2f3800dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:18.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.291+0000 7f2f2bfff700 1 -- 172.21.15.99:0/244786853 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3800f890 con 0x7f2f44100ae0 2024-01-31T05:10:18.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.291+0000 7f2f493ba700 1 -- 172.21.15.99:0/244786853 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f4419f490 con 0x7f2f44100ae0 2024-01-31T05:10:18.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.291+0000 7f2f2bfff700 1 -- 172.21.15.99:0/244786853 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2f38010460 con 0x7f2f44100ae0 2024-01-31T05:10:18.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.291+0000 7f2f493ba700 1 -- 172.21.15.99:0/244786853 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f441a6cf0 con 0x7f2f44100ae0 2024-01-31T05:10:18.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.291+0000 7f2f2bfff700 1 -- 172.21.15.99:0/244786853 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3800e610 con 0x7f2f44100ae0 2024-01-31T05:10:18.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.292+0000 7f2f493ba700 1 -- 172.21.15.99:0/244786853 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f30005330 con 0x7f2f44100ae0 2024-01-31T05:10:18.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.294+0000 7f2f2bfff700 1 -- 172.21.15.99:0/244786853 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f2f3800f9f0 con 0x7f2f44100ae0 2024-01-31T05:10:18.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.295+0000 7f2f2bfff700 1 --2- 172.21.15.99:0/244786853 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2f2c0a1480 0x7f2f2c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:18.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.295+0000 7f2f42ffd700 1 --2- 172.21.15.99:0/244786853 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2f2c0a1480 0x7f2f2c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:18.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.295+0000 7f2f2bfff700 1 -- 172.21.15.99:0/244786853 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f2f380cca60 con 0x7f2f44100ae0 2024-01-31T05:10:18.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.295+0000 7f2f42ffd700 1 --2- 172.21.15.99:0/244786853 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2f2c0a1480 0x7f2f2c0a3940 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2f34005950 tx=0x7f2f3400a3b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:18.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.298+0000 7f2f2bfff700 1 -- 172.21.15.99:0/244786853 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f2f38095f30 con 0x7f2f44100ae0 2024-01-31T05:10:18.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.180+0000 7f28e9497700 1 -- 172.21.15.99:0/2693591224 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28e4100710 msgr2=0x7f28e4100b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:18.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.180+0000 7f28e9497700 1 --2- 172.21.15.99:0/2693591224 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28e4100710 0x7f28e4100b90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f28d4009990 tx=0x7f28d4009ca0 comp rx=0 tx=0).stop 2024-01-31T05:10:18.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.180+0000 7f28e9497700 1 -- 172.21.15.99:0/2693591224 shutdown_connections 2024-01-31T05:10:18.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.180+0000 7f28e9497700 1 --2- 172.21.15.99:0/2693591224 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28e41010d0 0x7f28e410d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:18.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.180+0000 7f28e9497700 1 --2- 172.21.15.99:0/2693591224 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f28e4106680 0x7f28e4106a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:18.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.180+0000 7f28e9497700 1 --2- 172.21.15.99:0/2693591224 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28e4100710 0x7f28e4100b90 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:18.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.180+0000 7f28e9497700 1 -- 172.21.15.99:0/2693591224 >> 172.21.15.99:0/2693591224 conn(0x7f28e4076730 msgr2=0x7f28e4076b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:18.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.180+0000 7f28e9497700 1 -- 172.21.15.99:0/2693591224 shutdown_connections 2024-01-31T05:10:18.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.180+0000 7f28e9497700 1 -- 172.21.15.99:0/2693591224 wait complete. 2024-01-31T05:10:18.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.180+0000 7f28e9497700 1 Processor -- start 2024-01-31T05:10:18.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.181+0000 7f28e9497700 1 -- start start 2024-01-31T05:10:18.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.181+0000 7f28e9497700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28e4100710 0x7f28e419d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:18.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.181+0000 7f28e9497700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f28e41010d0 0x7f28e419ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:18.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.181+0000 7f28e9497700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28e4106680 0x7f28e4197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:18.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.181+0000 7f28e9497700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e4198090 con 0x7f28e4106680 2024-01-31T05:10:18.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.181+0000 7f28e9497700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e41981d0 con 0x7f28e4100710 2024-01-31T05:10:18.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.181+0000 7f28e9497700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e4198390 con 0x7f28e41010d0 2024-01-31T05:10:18.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.181+0000 7f28e37fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28e4106680 0x7f28e4197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:18.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.181+0000 7f28e37fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28e4106680 0x7f28e4197a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48298/0 (socket says 172.21.15.99:48298) 2024-01-31T05:10:18.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.181+0000 7f28e37fe700 1 -- 172.21.15.99:0/726180377 learned_addr learned my addr 172.21.15.99:0/726180377 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:18.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.181+0000 7f28e2ffd700 1 --2- 172.21.15.99:0/726180377 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28e4100710 0x7f28e419d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:18.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.181+0000 7f28e27fc700 1 --2- 172.21.15.99:0/726180377 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f28e41010d0 0x7f28e419ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:18.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.181+0000 7f28e37fe700 1 -- 172.21.15.99:0/726180377 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f28e41010d0 msgr2=0x7f28e419ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:18.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.181+0000 7f28e37fe700 1 --2- 172.21.15.99:0/726180377 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f28e41010d0 0x7f28e419ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:18.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.181+0000 7f28e37fe700 1 -- 172.21.15.99:0/726180377 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28e4100710 msgr2=0x7f28e419d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:18.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.181+0000 7f28e37fe700 1 --2- 172.21.15.99:0/726180377 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28e4100710 0x7f28e419d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:18.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.181+0000 7f28e37fe700 1 -- 172.21.15.99:0/726180377 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d40095f0 con 0x7f28e4106680 2024-01-31T05:10:18.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.182+0000 7f28e37fe700 1 --2- 172.21.15.99:0/726180377 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28e4106680 0x7f28e4197a30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f28dc007ee0 tx=0x7f28dc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:18.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.182+0000 7f28cbfff700 1 -- 172.21.15.99:0/726180377 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28dc017070 con 0x7f28e4106680 2024-01-31T05:10:18.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.182+0000 7f28cbfff700 1 -- 172.21.15.99:0/726180377 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f28dc00f040 con 0x7f28e4106680 2024-01-31T05:10:18.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.182+0000 7f28e9497700 1 -- 172.21.15.99:0/726180377 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28e4198670 con 0x7f28e4106680 2024-01-31T05:10:18.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.182+0000 7f28cbfff700 1 -- 172.21.15.99:0/726180377 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28dc005740 con 0x7f28e4106680 2024-01-31T05:10:18.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.182+0000 7f28e9497700 1 -- 172.21.15.99:0/726180377 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28e41a4910 con 0x7f28e4106680 2024-01-31T05:10:18.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.183+0000 7f28e9497700 1 -- 172.21.15.99:0/726180377 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28e4108c10 con 0x7f28e4106680 2024-01-31T05:10:18.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.184+0000 7f28cbfff700 1 -- 172.21.15.99:0/726180377 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f28dc00dc60 con 0x7f28e4106680 2024-01-31T05:10:18.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.184+0000 7f28cbfff700 1 --2- 172.21.15.99:0/726180377 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f28cc0a1400 0x7f28cc0a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:18.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.185+0000 7f28e2ffd700 1 --2- 172.21.15.99:0/726180377 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f28cc0a1400 0x7f28cc0a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:18.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.185+0000 7f28cbfff700 1 -- 172.21.15.99:0/726180377 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f28dc0cc470 con 0x7f28e4106680 2024-01-31T05:10:18.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.185+0000 7f28e2ffd700 1 --2- 172.21.15.99:0/726180377 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f28cc0a1400 0x7f28cc0a38c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f28e4198b70 tx=0x7f28d800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:18.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.189+0000 7f28cbfff700 1 -- 172.21.15.99:0/726180377 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f28dc095840 con 0x7f28e4106680 2024-01-31T05:10:18.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.393+0000 7f28e9497700 1 -- 172.21.15.99:0/726180377 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7f28e4198f60 con 0x7f28e4106680 2024-01-31T05:10:18.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.393+0000 7f28cbfff700 1 -- 172.21.15.99:0/726180377 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f28dc098e60 con 0x7f28e4106680 2024-01-31T05:10:18.393 INFO:teuthology.orchestra.run.smithi099.stdout:253403070504 2024-01-31T05:10:18.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.395+0000 7f28e9497700 1 -- 172.21.15.99:0/726180377 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f28cc0a1400 msgr2=0x7f28cc0a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:18.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.395+0000 7f28e9497700 1 --2- 172.21.15.99:0/726180377 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f28cc0a1400 0x7f28cc0a38c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f28e4198b70 tx=0x7f28d800b410 comp rx=0 tx=0).stop 2024-01-31T05:10:18.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.395+0000 7f28e9497700 1 -- 172.21.15.99:0/726180377 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28e4106680 msgr2=0x7f28e4197a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:18.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.395+0000 7f28e9497700 1 --2- 172.21.15.99:0/726180377 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28e4106680 0x7f28e4197a30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f28dc007ee0 tx=0x7f28dc00d3b0 comp rx=0 tx=0).stop 2024-01-31T05:10:18.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.395+0000 7f28e9497700 1 -- 172.21.15.99:0/726180377 shutdown_connections 2024-01-31T05:10:18.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.395+0000 7f28e9497700 1 --2- 172.21.15.99:0/726180377 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28e4106680 0x7f28e4197a30 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:18.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.395+0000 7f28e9497700 1 --2- 172.21.15.99:0/726180377 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f28cc0a1400 0x7f28cc0a38c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:18.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.395+0000 7f28e9497700 1 --2- 172.21.15.99:0/726180377 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28e4100710 0x7f28e419d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:18.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.395+0000 7f28e9497700 1 --2- 172.21.15.99:0/726180377 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f28e41010d0 0x7f28e419ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:18.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.395+0000 7f28e9497700 1 -- 172.21.15.99:0/726180377 >> 172.21.15.99:0/726180377 conn(0x7f28e4076730 msgr2=0x7f28e40fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:18.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.395+0000 7f28e9497700 1 -- 172.21.15.99:0/726180377 shutdown_connections 2024-01-31T05:10:18.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.395+0000 7f28e9497700 1 -- 172.21.15.99:0/726180377 wait complete. 2024-01-31T05:10:18.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.501+0000 7f2f493ba700 1 -- 172.21.15.99:0/244786853 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f2f300058b0 con 0x7f2f44100ae0 2024-01-31T05:10:18.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.502+0000 7f2f2bfff700 1 -- 172.21.15.99:0/244786853 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2f38020090 con 0x7f2f44100ae0 2024-01-31T05:10:18.501 INFO:teuthology.orchestra.run.smithi099.stdout:219043332140 2024-01-31T05:10:18.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.505+0000 7f2f493ba700 1 -- 172.21.15.99:0/244786853 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2f2c0a1480 msgr2=0x7f2f2c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:18.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.505+0000 7f2f493ba700 1 --2- 172.21.15.99:0/244786853 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2f2c0a1480 0x7f2f2c0a3940 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2f34005950 tx=0x7f2f3400a3b0 comp rx=0 tx=0).stop 2024-01-31T05:10:18.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.505+0000 7f2f493ba700 1 -- 172.21.15.99:0/244786853 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f44100ae0 msgr2=0x7f2f4419a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:18.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.505+0000 7f2f493ba700 1 --2- 172.21.15.99:0/244786853 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f44100ae0 0x7f2f4419a530 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2f3800d950 tx=0x7f2f3800dc60 comp rx=0 tx=0).stop 2024-01-31T05:10:18.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.505+0000 7f2f493ba700 1 -- 172.21.15.99:0/244786853 shutdown_connections 2024-01-31T05:10:18.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.505+0000 7f2f493ba700 1 --2- 172.21.15.99:0/244786853 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2f2c0a1480 0x7f2f2c0a3940 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:18.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.505+0000 7f2f493ba700 1 --2- 172.21.15.99:0/244786853 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f44102660 0x7f2f4419e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:18.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.505+0000 7f2f493ba700 1 --2- 172.21.15.99:0/244786853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2f44100120 0x7f2f44199ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:18.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.505+0000 7f2f493ba700 1 --2- 172.21.15.99:0/244786853 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f44100ae0 0x7f2f4419a530 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:18.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.505+0000 7f2f493ba700 1 -- 172.21.15.99:0/244786853 >> 172.21.15.99:0/244786853 conn(0x7f2f44075a20 msgr2=0x7f2f440fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:18.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.505+0000 7f2f493ba700 1 -- 172.21.15.99:0/244786853 shutdown_connections 2024-01-31T05:10:18.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:18.505+0000 7f2f493ba700 1 -- 172.21.15.99:0/244786853 wait complete. 2024-01-31T05:10:18.885 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:18 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/2229988550' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-01-31T05:10:18.885 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:18 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/726180377' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-01-31T05:10:18.886 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:18 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/244786853' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-01-31T05:10:19.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:18 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/2229988550' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-01-31T05:10:19.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:18 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/726180377' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-01-31T05:10:19.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:18 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/244786853' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-01-31T05:10:19.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:18 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/2229988550' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-01-31T05:10:19.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:18 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/726180377' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-01-31T05:10:19.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:18 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/244786853' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-01-31T05:10:19.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.570+0000 7f7d5b3bb700 1 -- 172.21.15.99:0/750245683 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d54100380 msgr2=0x7f7d54100760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:19.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.570+0000 7f7d5b3bb700 1 --2- 172.21.15.99:0/750245683 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d54100380 0x7f7d54100760 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7d50009990 tx=0x7f7d50009ca0 comp rx=0 tx=0).stop 2024-01-31T05:10:19.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.571+0000 7f7d5b3bb700 1 -- 172.21.15.99:0/750245683 shutdown_connections 2024-01-31T05:10:19.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.571+0000 7f7d5b3bb700 1 --2- 172.21.15.99:0/750245683 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d54106ba0 0x7f7d5410e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:19.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.571+0000 7f7d5b3bb700 1 --2- 172.21.15.99:0/750245683 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d54100380 0x7f7d54100760 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:19.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.571+0000 7f7d5b3bb700 1 --2- 172.21.15.99:0/750245683 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d54100d30 0x7f7d54106470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:19.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.571+0000 7f7d5b3bb700 1 -- 172.21.15.99:0/750245683 >> 172.21.15.99:0/750245683 conn(0x7f7d54075a40 msgr2=0x7f7d54075e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:19.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.571+0000 7f7d5b3bb700 1 -- 172.21.15.99:0/750245683 shutdown_connections 2024-01-31T05:10:19.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.571+0000 7f7d5b3bb700 1 -- 172.21.15.99:0/750245683 wait complete. 2024-01-31T05:10:19.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.571+0000 7f7d5b3bb700 1 Processor -- start 2024-01-31T05:10:19.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.571+0000 7f7d5b3bb700 1 -- start start 2024-01-31T05:10:19.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.571+0000 7f7d5b3bb700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d54100380 0x7f7d54197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:19.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.571+0000 7f7d5b3bb700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d54100d30 0x7f7d54198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:19.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.571+0000 7f7d5b3bb700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d54106ba0 0x7f7d5419c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:19.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.571+0000 7f7d5b3bb700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5419cc30 con 0x7f7d54100380 2024-01-31T05:10:19.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.571+0000 7f7d5b3bb700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5419cda0 con 0x7f7d54106ba0 2024-01-31T05:10:19.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.571+0000 7f7d5b3bb700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5419cf60 con 0x7f7d54100d30 2024-01-31T05:10:19.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.572+0000 7f7d59157700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d54100380 0x7f7d54197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:19.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.572+0000 7f7d59157700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d54100380 0x7f7d54197d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48338/0 (socket says 172.21.15.99:48338) 2024-01-31T05:10:19.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.572+0000 7f7d59157700 1 -- 172.21.15.99:0/1014889062 learned_addr learned my addr 172.21.15.99:0/1014889062 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:19.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.572+0000 7f7d58956700 1 --2- 172.21.15.99:0/1014889062 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d54100d30 0x7f7d54198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:19.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.572+0000 7f7d59157700 1 -- 172.21.15.99:0/1014889062 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d54100d30 msgr2=0x7f7d54198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:19.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.572+0000 7f7d59157700 1 --2- 172.21.15.99:0/1014889062 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d54100d30 0x7f7d54198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:19.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.572+0000 7f7d59157700 1 -- 172.21.15.99:0/1014889062 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d54106ba0 msgr2=0x7f7d5419c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:19.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.572+0000 7f7d59958700 1 --2- 172.21.15.99:0/1014889062 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d54106ba0 0x7f7d5419c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:19.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.572+0000 7f7d59157700 1 --2- 172.21.15.99:0/1014889062 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d54106ba0 0x7f7d5419c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:19.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.572+0000 7f7d59157700 1 -- 172.21.15.99:0/1014889062 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d500095f0 con 0x7f7d54100380 2024-01-31T05:10:19.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.572+0000 7f7d58956700 1 --2- 172.21.15.99:0/1014889062 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d54100d30 0x7f7d54198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:10:19.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.572+0000 7f7d59157700 1 --2- 172.21.15.99:0/1014889062 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d54100380 0x7f7d54197d50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7d50003ac0 tx=0x7f7d500037c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:19.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.572+0000 7f7d4a7fc700 1 -- 172.21.15.99:0/1014889062 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5001d070 con 0x7f7d54100380 2024-01-31T05:10:19.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.572+0000 7f7d4a7fc700 1 -- 172.21.15.99:0/1014889062 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d50003e00 con 0x7f7d54100380 2024-01-31T05:10:19.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.572+0000 7f7d5b3bb700 1 -- 172.21.15.99:0/1014889062 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d5419d1e0 con 0x7f7d54100380 2024-01-31T05:10:19.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.572+0000 7f7d4a7fc700 1 -- 172.21.15.99:0/1014889062 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5000fe60 con 0x7f7d54100380 2024-01-31T05:10:19.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.572+0000 7f7d5b3bb700 1 -- 172.21.15.99:0/1014889062 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d541a4aa0 con 0x7f7d54100380 2024-01-31T05:10:19.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.573+0000 7f7d5b3bb700 1 -- 172.21.15.99:0/1014889062 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d54109de0 con 0x7f7d54100380 2024-01-31T05:10:19.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.574+0000 7f7d4a7fc700 1 -- 172.21.15.99:0/1014889062 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f7d5000f560 con 0x7f7d54100380 2024-01-31T05:10:19.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.575+0000 7f7d4a7fc700 1 --2- 172.21.15.99:0/1014889062 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f7d400a1400 0x7f7d400a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:19.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.575+0000 7f7d58956700 1 --2- 172.21.15.99:0/1014889062 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f7d400a1400 0x7f7d400a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:19.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.575+0000 7f7d4a7fc700 1 -- 172.21.15.99:0/1014889062 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f7d500cdcf0 con 0x7f7d54100380 2024-01-31T05:10:19.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.575+0000 7f7d58956700 1 --2- 172.21.15.99:0/1014889062 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f7d400a1400 0x7f7d400a38c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7d540feca0 tx=0x7f7d44008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:19.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.579+0000 7f7d4a7fc700 1 -- 172.21.15.99:0/1014889062 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f7d50097250 con 0x7f7d54100380 2024-01-31T05:10:19.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.778+0000 7f7d5b3bb700 1 -- 172.21.15.99:0/1014889062 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7f7d54069a50 con 0x7f7d54100380 2024-01-31T05:10:19.778 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:19 smithi099 ceph-mon[31615]: pgmap v315: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 11 op/s 2024-01-31T05:10:19.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.779+0000 7f7d4a7fc700 1 -- 172.21.15.99:0/1014889062 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7d5009a870 con 0x7f7d54100380 2024-01-31T05:10:19.779 INFO:teuthology.orchestra.run.smithi099.stdout:287762808867 2024-01-31T05:10:19.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.781+0000 7f7d5b3bb700 1 -- 172.21.15.99:0/1014889062 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f7d400a1400 msgr2=0x7f7d400a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:19.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.781+0000 7f7d5b3bb700 1 --2- 172.21.15.99:0/1014889062 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f7d400a1400 0x7f7d400a38c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7d540feca0 tx=0x7f7d44008040 comp rx=0 tx=0).stop 2024-01-31T05:10:19.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.781+0000 7f7d5b3bb700 1 -- 172.21.15.99:0/1014889062 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d54100380 msgr2=0x7f7d54197d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:19.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.781+0000 7f7d5b3bb700 1 --2- 172.21.15.99:0/1014889062 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d54100380 0x7f7d54197d50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7d50003ac0 tx=0x7f7d500037c0 comp rx=0 tx=0).stop 2024-01-31T05:10:19.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.781+0000 7f7d5b3bb700 1 -- 172.21.15.99:0/1014889062 shutdown_connections 2024-01-31T05:10:19.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.781+0000 7f7d5b3bb700 1 --2- 172.21.15.99:0/1014889062 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f7d400a1400 0x7f7d400a38c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:19.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.781+0000 7f7d5b3bb700 1 --2- 172.21.15.99:0/1014889062 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d54106ba0 0x7f7d5419c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:19.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.781+0000 7f7d5b3bb700 1 --2- 172.21.15.99:0/1014889062 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d54100380 0x7f7d54197d50 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:19.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.781+0000 7f7d5b3bb700 1 --2- 172.21.15.99:0/1014889062 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d54100d30 0x7f7d54198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:19.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.781+0000 7f7d5b3bb700 1 -- 172.21.15.99:0/1014889062 >> 172.21.15.99:0/1014889062 conn(0x7f7d54075a40 msgr2=0x7f7d540ff900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:19.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.781+0000 7f7d5b3bb700 1 -- 172.21.15.99:0/1014889062 shutdown_connections 2024-01-31T05:10:19.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.781+0000 7f7d5b3bb700 1 -- 172.21.15.99:0/1014889062 wait complete. 2024-01-31T05:10:19.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.817+0000 7fe858a2b700 1 -- 172.21.15.99:0/2562874557 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe854101080 msgr2=0x7fe85410d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:19.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.817+0000 7fe858a2b700 1 --2- 172.21.15.99:0/2562874557 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe854101080 0x7fe85410d560 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe84c00b0a0 tx=0x7fe84c00b3b0 comp rx=0 tx=0).stop 2024-01-31T05:10:19.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.817+0000 7fe858a2b700 1 -- 172.21.15.99:0/2562874557 shutdown_connections 2024-01-31T05:10:19.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.817+0000 7fe858a2b700 1 --2- 172.21.15.99:0/2562874557 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe854101080 0x7fe85410d560 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:19.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.817+0000 7fe858a2b700 1 --2- 172.21.15.99:0/2562874557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe854106690 0x7fe854106a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:19.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.817+0000 7fe858a2b700 1 --2- 172.21.15.99:0/2562874557 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8541006e0 0x7fe854100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:19.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.817+0000 7fe858a2b700 1 -- 172.21.15.99:0/2562874557 >> 172.21.15.99:0/2562874557 conn(0x7fe854077610 msgr2=0x7fe854077a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:19.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.817+0000 7fe858a2b700 1 -- 172.21.15.99:0/2562874557 shutdown_connections 2024-01-31T05:10:19.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.817+0000 7fe858a2b700 1 -- 172.21.15.99:0/2562874557 wait complete. 2024-01-31T05:10:19.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.817+0000 7fe858a2b700 1 Processor -- start 2024-01-31T05:10:19.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.817+0000 7fe858a2b700 1 -- start start 2024-01-31T05:10:19.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.818+0000 7fe858a2b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8541006e0 0x7fe85419da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:19.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.818+0000 7fe858a2b700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe854101080 0x7fe85419df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:19.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.818+0000 7fe858a2b700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe854106690 0x7fe854197b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:19.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.818+0000 7fe858a2b700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe854198310 con 0x7fe854101080 2024-01-31T05:10:19.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.818+0000 7fe858a2b700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe854198480 con 0x7fe8541006e0 2024-01-31T05:10:19.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.818+0000 7fe858a2b700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe854198640 con 0x7fe854106690 2024-01-31T05:10:19.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.818+0000 7fe851d9b700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe854101080 0x7fe85419df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:19.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.818+0000 7fe851d9b700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe854101080 0x7fe85419df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48350/0 (socket says 172.21.15.99:48350) 2024-01-31T05:10:19.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.818+0000 7fe851d9b700 1 -- 172.21.15.99:0/3884719633 learned_addr learned my addr 172.21.15.99:0/3884719633 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:19.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.818+0000 7fe85259c700 1 --2- 172.21.15.99:0/3884719633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8541006e0 0x7fe85419da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:19.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.818+0000 7fe852d9d700 1 --2- 172.21.15.99:0/3884719633 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe854106690 0x7fe854197b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:19.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.818+0000 7fe851d9b700 1 -- 172.21.15.99:0/3884719633 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe854106690 msgr2=0x7fe854197b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:19.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.818+0000 7fe851d9b700 1 --2- 172.21.15.99:0/3884719633 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe854106690 0x7fe854197b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:19.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.818+0000 7fe851d9b700 1 -- 172.21.15.99:0/3884719633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8541006e0 msgr2=0x7fe85419da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:19.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.818+0000 7fe851d9b700 1 --2- 172.21.15.99:0/3884719633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8541006e0 0x7fe85419da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:19.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.818+0000 7fe851d9b700 1 -- 172.21.15.99:0/3884719633 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe84c009d00 con 0x7fe854101080 2024-01-31T05:10:19.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.818+0000 7fe852d9d700 1 --2- 172.21.15.99:0/3884719633 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe854106690 0x7fe854197b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:10:19.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.818+0000 7fe85259c700 1 --2- 172.21.15.99:0/3884719633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8541006e0 0x7fe85419da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:10:19.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.818+0000 7fe851d9b700 1 --2- 172.21.15.99:0/3884719633 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe854101080 0x7fe85419df80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe84800b530 tx=0x7fe84800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:19.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.818+0000 7fe8437fe700 1 -- 172.21.15.99:0/3884719633 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe848011830 con 0x7fe854101080 2024-01-31T05:10:19.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.818+0000 7fe858a2b700 1 -- 172.21.15.99:0/3884719633 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe854198920 con 0x7fe854101080 2024-01-31T05:10:19.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.818+0000 7fe8437fe700 1 -- 172.21.15.99:0/3884719633 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe848011e50 con 0x7fe854101080 2024-01-31T05:10:19.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.818+0000 7fe8437fe700 1 -- 172.21.15.99:0/3884719633 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe84800f2e0 con 0x7fe854101080 2024-01-31T05:10:19.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.818+0000 7fe858a2b700 1 -- 172.21.15.99:0/3884719633 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8541a4a10 con 0x7fe854101080 2024-01-31T05:10:19.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.819+0000 7fe858a2b700 1 -- 172.21.15.99:0/3884719633 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe854108c40 con 0x7fe854101080 2024-01-31T05:10:19.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.820+0000 7fe8437fe700 1 -- 172.21.15.99:0/3884719633 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7fe848010580 con 0x7fe854101080 2024-01-31T05:10:19.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.821+0000 7fe8437fe700 1 --2- 172.21.15.99:0/3884719633 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe83c0a1480 0x7fe83c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:19.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.821+0000 7fe85259c700 1 --2- 172.21.15.99:0/3884719633 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe83c0a1480 0x7fe83c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:19.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.821+0000 7fe8437fe700 1 -- 172.21.15.99:0/3884719633 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fe8480cca10 con 0x7fe854101080 2024-01-31T05:10:19.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.821+0000 7fe85259c700 1 --2- 172.21.15.99:0/3884719633 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe83c0a1480 0x7fe83c0a3940 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe844005fd0 tx=0x7fe844005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:19.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:19.824+0000 7fe8437fe700 1 -- 172.21.15.99:0/3884719633 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fe848095ff0 con 0x7fe854101080 2024-01-31T05:10:20.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.021+0000 7fe858a2b700 1 -- 172.21.15.99:0/3884719633 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe854101dd0 con 0x7fe854101080 2024-01-31T05:10:20.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.021+0000 7fe8437fe700 1 -- 172.21.15.99:0/3884719633 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe848015020 con 0x7fe854101080 2024-01-31T05:10:20.021 INFO:teuthology.orchestra.run.smithi099.stdout:77309411398 2024-01-31T05:10:20.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.023+0000 7fe858a2b700 1 -- 172.21.15.99:0/3884719633 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe83c0a1480 msgr2=0x7fe83c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:20.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.023+0000 7fe858a2b700 1 --2- 172.21.15.99:0/3884719633 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe83c0a1480 0x7fe83c0a3940 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe844005fd0 tx=0x7fe844005e30 comp rx=0 tx=0).stop 2024-01-31T05:10:20.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.023+0000 7fe858a2b700 1 -- 172.21.15.99:0/3884719633 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe854101080 msgr2=0x7fe85419df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:20.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.023+0000 7fe858a2b700 1 --2- 172.21.15.99:0/3884719633 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe854101080 0x7fe85419df80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe84800b530 tx=0x7fe84800b8f0 comp rx=0 tx=0).stop 2024-01-31T05:10:20.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.023+0000 7fe858a2b700 1 -- 172.21.15.99:0/3884719633 shutdown_connections 2024-01-31T05:10:20.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.023+0000 7fe858a2b700 1 --2- 172.21.15.99:0/3884719633 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe854106690 0x7fe854197b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:20.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.023+0000 7fe858a2b700 1 --2- 172.21.15.99:0/3884719633 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe83c0a1480 0x7fe83c0a3940 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:20.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.023+0000 7fe858a2b700 1 --2- 172.21.15.99:0/3884719633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8541006e0 0x7fe85419da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:20.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.023+0000 7fe858a2b700 1 --2- 172.21.15.99:0/3884719633 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe854101080 0x7fe85419df80 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:20.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.023+0000 7fe858a2b700 1 -- 172.21.15.99:0/3884719633 >> 172.21.15.99:0/3884719633 conn(0x7fe854077610 msgr2=0x7fe8540fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:20.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.023+0000 7fe858a2b700 1 -- 172.21.15.99:0/3884719633 shutdown_connections 2024-01-31T05:10:20.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.023+0000 7fe858a2b700 1 -- 172.21.15.99:0/3884719633 wait complete. 2024-01-31T05:10:20.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:19 smithi181 ceph-mon[36434]: pgmap v315: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 11 op/s 2024-01-31T05:10:20.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:19 smithi179 ceph-mon[35652]: pgmap v315: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 11 op/s 2024-01-31T05:10:20.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.233+0000 7f9396826700 1 -- 172.21.15.99:0/1393691680 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93901006c0 msgr2=0x7f9390100b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:20.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.233+0000 7f9396826700 1 --2- 172.21.15.99:0/1393691680 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93901006c0 0x7f9390100b40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9380009990 tx=0x7f9380009ca0 comp rx=0 tx=0).stop 2024-01-31T05:10:20.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.233+0000 7f9396826700 1 -- 172.21.15.99:0/1393691680 shutdown_connections 2024-01-31T05:10:20.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.233+0000 7f9396826700 1 --2- 172.21.15.99:0/1393691680 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9390101080 0x7f939010d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:20.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.233+0000 7f9396826700 1 --2- 172.21.15.99:0/1393691680 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93901066b0 0x7f9390106a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:20.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.233+0000 7f9396826700 1 --2- 172.21.15.99:0/1393691680 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93901006c0 0x7f9390100b40 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:20.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.233+0000 7f9396826700 1 -- 172.21.15.99:0/1393691680 >> 172.21.15.99:0/1393691680 conn(0x7f9390077680 msgr2=0x7f9390077a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:20.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.233+0000 7f9396826700 1 -- 172.21.15.99:0/1393691680 shutdown_connections 2024-01-31T05:10:20.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.233+0000 7f9396826700 1 -- 172.21.15.99:0/1393691680 wait complete. 2024-01-31T05:10:20.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.234+0000 7f9396826700 1 Processor -- start 2024-01-31T05:10:20.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.234+0000 7f9396826700 1 -- start start 2024-01-31T05:10:20.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.234+0000 7f9396826700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93901006c0 0x7f939019c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:20.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.234+0000 7f9396826700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9390101080 0x7f939019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:20.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.234+0000 7f9396826700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93901066b0 0x7f93901969e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:20.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.234+0000 7f9396826700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9390197040 con 0x7f93901006c0 2024-01-31T05:10:20.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.234+0000 7f9396826700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9390197180 con 0x7f93901066b0 2024-01-31T05:10:20.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.234+0000 7f9396826700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9390197340 con 0x7f9390101080 2024-01-31T05:10:20.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.234+0000 7f938ffff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93901006c0 0x7f939019c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:20.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.234+0000 7f938ffff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93901006c0 0x7f939019c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48368/0 (socket says 172.21.15.99:48368) 2024-01-31T05:10:20.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.234+0000 7f938ffff700 1 -- 172.21.15.99:0/1280178075 learned_addr learned my addr 172.21.15.99:0/1280178075 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:20.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.234+0000 7f938f7fe700 1 --2- 172.21.15.99:0/1280178075 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9390101080 0x7f939019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:20.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.235+0000 7f9394dc3700 1 --2- 172.21.15.99:0/1280178075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93901066b0 0x7f93901969e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:20.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.235+0000 7f938ffff700 1 -- 172.21.15.99:0/1280178075 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9390101080 msgr2=0x7f939019cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:20.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.235+0000 7f938ffff700 1 --2- 172.21.15.99:0/1280178075 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9390101080 0x7f939019cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:20.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.235+0000 7f938ffff700 1 -- 172.21.15.99:0/1280178075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93901066b0 msgr2=0x7f93901969e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:20.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.235+0000 7f938ffff700 1 --2- 172.21.15.99:0/1280178075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93901066b0 0x7f93901969e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:20.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.235+0000 7f938ffff700 1 -- 172.21.15.99:0/1280178075 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93800095f0 con 0x7f93901006c0 2024-01-31T05:10:20.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.235+0000 7f9394dc3700 1 --2- 172.21.15.99:0/1280178075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93901066b0 0x7f93901969e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:10:20.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.235+0000 7f938ffff700 1 --2- 172.21.15.99:0/1280178075 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93901006c0 0x7f939019c820 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f938400b530 tx=0x7f938400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:20.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.235+0000 7f938d7fa700 1 -- 172.21.15.99:0/1280178075 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9384011830 con 0x7f93901006c0 2024-01-31T05:10:20.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.235+0000 7f938d7fa700 1 -- 172.21.15.99:0/1280178075 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9384011e50 con 0x7f93901006c0 2024-01-31T05:10:20.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.235+0000 7f9396826700 1 -- 172.21.15.99:0/1280178075 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9390197620 con 0x7f93901006c0 2024-01-31T05:10:20.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.235+0000 7f938d7fa700 1 -- 172.21.15.99:0/1280178075 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938400f2e0 con 0x7f93901006c0 2024-01-31T05:10:20.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.235+0000 7f9396826700 1 -- 172.21.15.99:0/1280178075 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93901a38c0 con 0x7f93901006c0 2024-01-31T05:10:20.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.236+0000 7f9396826700 1 -- 172.21.15.99:0/1280178075 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9390108bf0 con 0x7f93901006c0 2024-01-31T05:10:20.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.237+0000 7f938d7fa700 1 -- 172.21.15.99:0/1280178075 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f9384010580 con 0x7f93901006c0 2024-01-31T05:10:20.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.238+0000 7f938d7fa700 1 --2- 172.21.15.99:0/1280178075 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f93780a1400 0x7f93780a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:20.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.238+0000 7f938f7fe700 1 --2- 172.21.15.99:0/1280178075 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f93780a1400 0x7f93780a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:20.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.238+0000 7f938d7fa700 1 -- 172.21.15.99:0/1280178075 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f93840ccbb0 con 0x7f93901006c0 2024-01-31T05:10:20.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.238+0000 7f938f7fe700 1 --2- 172.21.15.99:0/1280178075 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f93780a1400 0x7f93780a38c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9380005850 tx=0x7f938001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:20.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.241+0000 7f938d7fa700 1 -- 172.21.15.99:0/1280178075 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f9384096090 con 0x7f93901006c0 2024-01-31T05:10:20.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.449+0000 7f9396826700 1 -- 172.21.15.99:0/1280178075 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f93900684a0 con 0x7f93901006c0 2024-01-31T05:10:20.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.450+0000 7f938d7fa700 1 -- 172.21.15.99:0/1280178075 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f93840996b0 con 0x7f93901006c0 2024-01-31T05:10:20.449 INFO:teuthology.orchestra.run.smithi099.stdout:163208757303 2024-01-31T05:10:20.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.452+0000 7f9396826700 1 -- 172.21.15.99:0/1280178075 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f93780a1400 msgr2=0x7f93780a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:20.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.452+0000 7f9396826700 1 --2- 172.21.15.99:0/1280178075 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f93780a1400 0x7f93780a38c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9380005850 tx=0x7f938001a040 comp rx=0 tx=0).stop 2024-01-31T05:10:20.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.452+0000 7f9396826700 1 -- 172.21.15.99:0/1280178075 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93901006c0 msgr2=0x7f939019c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:20.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.452+0000 7f9396826700 1 --2- 172.21.15.99:0/1280178075 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93901006c0 0x7f939019c820 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f938400b530 tx=0x7f938400b8f0 comp rx=0 tx=0).stop 2024-01-31T05:10:20.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.452+0000 7f9396826700 1 -- 172.21.15.99:0/1280178075 shutdown_connections 2024-01-31T05:10:20.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.452+0000 7f9396826700 1 --2- 172.21.15.99:0/1280178075 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f93780a1400 0x7f93780a38c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:20.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.452+0000 7f9396826700 1 --2- 172.21.15.99:0/1280178075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93901066b0 0x7f93901969e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:20.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.452+0000 7f9396826700 1 --2- 172.21.15.99:0/1280178075 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93901006c0 0x7f939019c820 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:20.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.452+0000 7f9396826700 1 --2- 172.21.15.99:0/1280178075 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9390101080 0x7f939019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:20.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.452+0000 7f9396826700 1 -- 172.21.15.99:0/1280178075 >> 172.21.15.99:0/1280178075 conn(0x7f9390077680 msgr2=0x7f93900ff440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:20.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.452+0000 7f9396826700 1 -- 172.21.15.99:0/1280178075 shutdown_connections 2024-01-31T05:10:20.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:20.452+0000 7f9396826700 1 -- 172.21.15.99:0/1280178075 wait complete. 2024-01-31T05:10:20.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:20 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/1014889062' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-01-31T05:10:20.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:20 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/3884719633' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-01-31T05:10:20.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:20 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/1280178075' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-01-31T05:10:20.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:20 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-01-31T05:10:20.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:20 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-01-31T05:10:20.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:20 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-01-31T05:10:20.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:20 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-01-31T05:10:20.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:20 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2024-01-31T05:10:20.888 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574917 got 55834574921 for osd.1 2024-01-31T05:10:20.888 DEBUG:teuthology.parallel:result is None 2024-01-31T05:10:21.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:20 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/1014889062' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-01-31T05:10:21.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:20 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/3884719633' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-01-31T05:10:21.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:20 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/1280178075' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-01-31T05:10:21.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:20 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-01-31T05:10:21.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:20 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-01-31T05:10:21.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:20 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-01-31T05:10:21.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:20 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-01-31T05:10:21.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:20 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2024-01-31T05:10:21.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:20 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/1014889062' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-01-31T05:10:21.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:20 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/3884719633' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-01-31T05:10:21.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:20 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/1280178075' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-01-31T05:10:21.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:20 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-01-31T05:10:21.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:20 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-01-31T05:10:21.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:20 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-01-31T05:10:21.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:20 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-01-31T05:10:21.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:20 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2024-01-31T05:10:21.500 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411394 got 77309411398 for osd.2 2024-01-31T05:10:21.500 DEBUG:teuthology.parallel:result is None 2024-01-31T05:10:21.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:21 smithi099 ceph-mon[31615]: pgmap v316: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-01-31T05:10:21.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:21 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-01-31T05:10:21.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:21 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-01-31T05:10:21.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:21 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-01-31T05:10:21.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:21 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-01-31T05:10:21.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:21 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-01-31T05:10:21.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:21 smithi099 ceph-mon[31615]: osdmap e87: 12 total, 12 up, 12 in 2024-01-31T05:10:21.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:21 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:10:21.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:21 smithi181 ceph-mon[36434]: pgmap v316: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-01-31T05:10:21.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:21 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-01-31T05:10:21.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:21 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-01-31T05:10:21.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:21 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-01-31T05:10:21.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:21 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-01-31T05:10:21.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:21 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-01-31T05:10:21.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:21 smithi181 ceph-mon[36434]: osdmap e87: 12 total, 12 up, 12 in 2024-01-31T05:10:21.822 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:21 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:10:21.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:21 smithi179 ceph-mon[35652]: pgmap v316: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-01-31T05:10:21.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:21 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-01-31T05:10:21.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:21 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-01-31T05:10:21.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:21 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-01-31T05:10:21.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:21 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-01-31T05:10:21.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:21 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-01-31T05:10:21.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:21 smithi179 ceph-mon[35652]: osdmap e87: 12 total, 12 up, 12 in 2024-01-31T05:10:21.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:21 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:10:22.814 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:22 smithi099 ceph-mon[31615]: osdmap e88: 12 total, 12 up, 12 in 2024-01-31T05:10:22.814 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:22 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:10:22.814 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:22 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:10:22.814 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:22 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:10:22.815 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:22 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:10:22.839 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757299 got 163208757303 for osd.5 2024-01-31T05:10:22.839 DEBUG:teuthology.parallel:result is None 2024-01-31T05:10:23.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:22 smithi181 ceph-mon[36434]: osdmap e88: 12 total, 12 up, 12 in 2024-01-31T05:10:23.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:22 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:10:23.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:22 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:10:23.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:22 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:10:23.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:22 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:10:23.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:22 smithi179 ceph-mon[35652]: osdmap e88: 12 total, 12 up, 12 in 2024-01-31T05:10:23.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:22 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:10:23.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:22 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:10:23.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:22 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:10:23.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:22 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:10:23.487 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332138 got 219043332140 for osd.7 2024-01-31T05:10:23.487 DEBUG:teuthology.parallel:result is None 2024-01-31T05:10:23.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:23 smithi099 ceph-mon[31615]: pgmap v319: 97 pgs: 4 peering, 93 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-01-31T05:10:23.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:23 smithi099 ceph-mon[31615]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-01-31T05:10:23.975 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808862 got 287762808867 for osd.9 2024-01-31T05:10:23.975 DEBUG:teuthology.parallel:result is None 2024-01-31T05:10:24.015 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:10:24.015 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:10:24.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:23 smithi181 ceph-mon[36434]: pgmap v319: 97 pgs: 4 peering, 93 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-01-31T05:10:24.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:23 smithi181 ceph-mon[36434]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-01-31T05:10:24.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:23 smithi179 ceph-mon[35652]: pgmap v319: 97 pgs: 4 peering, 93 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-01-31T05:10:24.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:23 smithi179 ceph-mon[35652]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-01-31T05:10:24.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.622+0000 7f62b760c700 1 -- 172.21.15.99:0/3560568033 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62b0101080 msgr2=0x7f62b010d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:24.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.622+0000 7f62b760c700 1 --2- 172.21.15.99:0/3560568033 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62b0101080 0x7f62b010d560 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f62a800b0a0 tx=0x7f62a800b3b0 comp rx=0 tx=0).stop 2024-01-31T05:10:24.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.622+0000 7f62b760c700 1 -- 172.21.15.99:0/3560568033 shutdown_connections 2024-01-31T05:10:24.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.622+0000 7f62b760c700 1 --2- 172.21.15.99:0/3560568033 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62b0101080 0x7f62b010d560 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:24.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.622+0000 7f62b760c700 1 --2- 172.21.15.99:0/3560568033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62b0106690 0x7f62b0106a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:24.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.622+0000 7f62b760c700 1 --2- 172.21.15.99:0/3560568033 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62b01006e0 0x7f62b0100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:24.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.622+0000 7f62b760c700 1 -- 172.21.15.99:0/3560568033 >> 172.21.15.99:0/3560568033 conn(0x7f62b0077610 msgr2=0x7f62b0077a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:24.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.622+0000 7f62b760c700 1 -- 172.21.15.99:0/3560568033 shutdown_connections 2024-01-31T05:10:24.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.622+0000 7f62b760c700 1 -- 172.21.15.99:0/3560568033 wait complete. 2024-01-31T05:10:24.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.623+0000 7f62b760c700 1 Processor -- start 2024-01-31T05:10:24.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.623+0000 7f62b760c700 1 -- start start 2024-01-31T05:10:24.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.623+0000 7f62b760c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62b01006e0 0x7f62b019da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:24.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.623+0000 7f62b760c700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62b0101080 0x7f62b019df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:24.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.623+0000 7f62b760c700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62b0106690 0x7f62b0197b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:24.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.623+0000 7f62b760c700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b0198310 con 0x7f62b0106690 2024-01-31T05:10:24.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.623+0000 7f62b760c700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b0198480 con 0x7f62b01006e0 2024-01-31T05:10:24.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.623+0000 7f62b760c700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b0198640 con 0x7f62b0101080 2024-01-31T05:10:24.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.623+0000 7f62b5ba9700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62b0106690 0x7f62b0197b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:24.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.623+0000 7f62b53a8700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62b01006e0 0x7f62b019da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:24.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.623+0000 7f62b5ba9700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62b0106690 0x7f62b0197b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48394/0 (socket says 172.21.15.99:48394) 2024-01-31T05:10:24.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.623+0000 7f62b5ba9700 1 -- 172.21.15.99:0/3088555799 learned_addr learned my addr 172.21.15.99:0/3088555799 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:24.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.623+0000 7f62b4ba7700 1 --2- 172.21.15.99:0/3088555799 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62b0101080 0x7f62b019df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:24.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.624+0000 7f62b5ba9700 1 -- 172.21.15.99:0/3088555799 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62b0101080 msgr2=0x7f62b019df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:24.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.624+0000 7f62b5ba9700 1 --2- 172.21.15.99:0/3088555799 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62b0101080 0x7f62b019df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:24.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.624+0000 7f62b5ba9700 1 -- 172.21.15.99:0/3088555799 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62b01006e0 msgr2=0x7f62b019da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:24.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.624+0000 7f62b5ba9700 1 --2- 172.21.15.99:0/3088555799 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62b01006e0 0x7f62b019da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:24.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.624+0000 7f62b5ba9700 1 -- 172.21.15.99:0/3088555799 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a8009d00 con 0x7f62b0106690 2024-01-31T05:10:24.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.624+0000 7f62b5ba9700 1 --2- 172.21.15.99:0/3088555799 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62b0106690 0x7f62b0197b60 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f62a800b070 tx=0x7f62a8007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:24.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.624+0000 7f62a67fc700 1 -- 172.21.15.99:0/3088555799 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a800e040 con 0x7f62b0106690 2024-01-31T05:10:24.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.624+0000 7f62b760c700 1 -- 172.21.15.99:0/3088555799 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62b01988c0 con 0x7f62b0106690 2024-01-31T05:10:24.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.624+0000 7f62a67fc700 1 -- 172.21.15.99:0/3088555799 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f62a8009440 con 0x7f62b0106690 2024-01-31T05:10:24.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.624+0000 7f62a67fc700 1 -- 172.21.15.99:0/3088555799 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a801b450 con 0x7f62b0106690 2024-01-31T05:10:24.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.624+0000 7f62b760c700 1 -- 172.21.15.99:0/3088555799 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62b01a49c0 con 0x7f62b0106690 2024-01-31T05:10:24.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.625+0000 7f62b760c700 1 -- 172.21.15.99:0/3088555799 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62b0108c20 con 0x7f62b0106690 2024-01-31T05:10:24.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.626+0000 7f62a67fc700 1 -- 172.21.15.99:0/3088555799 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f62a8004cf0 con 0x7f62b0106690 2024-01-31T05:10:24.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.627+0000 7f62a67fc700 1 --2- 172.21.15.99:0/3088555799 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f629c0a1400 0x7f629c0a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:24.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.627+0000 7f62b53a8700 1 --2- 172.21.15.99:0/3088555799 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f629c0a1400 0x7f629c0a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:24.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.627+0000 7f62a67fc700 1 -- 172.21.15.99:0/3088555799 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f62a80ce0d0 con 0x7f62b0106690 2024-01-31T05:10:24.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.627+0000 7f62b53a8700 1 --2- 172.21.15.99:0/3088555799 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f629c0a1400 0x7f629c0a38c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f62ac005950 tx=0x7f62ac00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:24.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.631+0000 7f62a67fc700 1 -- 172.21.15.99:0/3088555799 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f62a80975a0 con 0x7f62b0106690 2024-01-31T05:10:24.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.828+0000 7f62b760c700 1 -- 172.21.15.99:0/3088555799 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7f62b0198fd0 con 0x7f62b0106690 2024-01-31T05:10:24.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.829+0000 7f62a67fc700 1 -- 172.21.15.99:0/3088555799 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f62a809abc0 con 0x7f62b0106690 2024-01-31T05:10:24.828 INFO:teuthology.orchestra.run.smithi099.stdout:313532612640 2024-01-31T05:10:24.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.831+0000 7f62b760c700 1 -- 172.21.15.99:0/3088555799 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f629c0a1400 msgr2=0x7f629c0a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:24.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.831+0000 7f62b760c700 1 --2- 172.21.15.99:0/3088555799 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f629c0a1400 0x7f629c0a38c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f62ac005950 tx=0x7f62ac00b410 comp rx=0 tx=0).stop 2024-01-31T05:10:24.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.831+0000 7f62b760c700 1 -- 172.21.15.99:0/3088555799 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62b0106690 msgr2=0x7f62b0197b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:24.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.831+0000 7f62b760c700 1 --2- 172.21.15.99:0/3088555799 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62b0106690 0x7f62b0197b60 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f62a800b070 tx=0x7f62a8007870 comp rx=0 tx=0).stop 2024-01-31T05:10:24.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.831+0000 7f62b760c700 1 -- 172.21.15.99:0/3088555799 shutdown_connections 2024-01-31T05:10:24.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.831+0000 7f62b760c700 1 --2- 172.21.15.99:0/3088555799 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62b0106690 0x7f62b0197b60 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:24.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.831+0000 7f62b760c700 1 --2- 172.21.15.99:0/3088555799 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f629c0a1400 0x7f629c0a38c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:24.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.831+0000 7f62b760c700 1 --2- 172.21.15.99:0/3088555799 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62b01006e0 0x7f62b019da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:24.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.831+0000 7f62b760c700 1 --2- 172.21.15.99:0/3088555799 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62b0101080 0x7f62b019df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:24.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.831+0000 7f62b760c700 1 -- 172.21.15.99:0/3088555799 >> 172.21.15.99:0/3088555799 conn(0x7f62b0077610 msgr2=0x7f62b00ff440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:24.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.831+0000 7f62b760c700 1 -- 172.21.15.99:0/3088555799 shutdown_connections 2024-01-31T05:10:24.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:24.831+0000 7f62b760c700 1 -- 172.21.15.99:0/3088555799 wait complete. 2024-01-31T05:10:25.744 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:25 smithi099 ceph-mon[31615]: pgmap v320: 97 pgs: 4 peering, 93 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 11 op/s 2024-01-31T05:10:25.744 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:25 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/3088555799' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-01-31T05:10:26.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:25 smithi181 ceph-mon[36434]: pgmap v320: 97 pgs: 4 peering, 93 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 11 op/s 2024-01-31T05:10:26.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:25 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/3088555799' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-01-31T05:10:26.091 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070499 got 253403070504 for osd.8 2024-01-31T05:10:26.091 DEBUG:teuthology.parallel:result is None 2024-01-31T05:10:26.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:25 smithi179 ceph-mon[35652]: pgmap v320: 97 pgs: 4 peering, 93 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 11 op/s 2024-01-31T05:10:26.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:25 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/3088555799' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-01-31T05:10:26.340 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:10:26.776 INFO:tasks.cephadm.ceph_manager.ceph:need seq 313532612634 got 313532612640 for osd.10 2024-01-31T05:10:26.776 DEBUG:teuthology.parallel:result is None 2024-01-31T05:10:27.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:26 smithi099 ceph-mon[31615]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-01-31T05:10:27.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:26 smithi099 ceph-mon[31615]: Cluster is now healthy 2024-01-31T05:10:27.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:26 smithi181 ceph-mon[36434]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-01-31T05:10:27.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:26 smithi181 ceph-mon[36434]: Cluster is now healthy 2024-01-31T05:10:27.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:26 smithi179 ceph-mon[35652]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-01-31T05:10:27.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:26 smithi179 ceph-mon[35652]: Cluster is now healthy 2024-01-31T05:10:27.206 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:10:27.217 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:10:27.890 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:27 smithi099 ceph-mon[31615]: pgmap v321: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s; 13 B/s, 1 objects/s recovering 2024-01-31T05:10:28.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:27 smithi181 ceph-mon[36434]: pgmap v321: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s; 13 B/s, 1 objects/s recovering 2024-01-31T05:10:28.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:27 smithi179 ceph-mon[35652]: pgmap v321: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s; 13 B/s, 1 objects/s recovering 2024-01-31T05:10:28.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.657+0000 7fbdd7700700 1 -- 172.21.15.99:0/3806991503 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdd006a6e0 msgr2=0x7fbdd010e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:28.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.657+0000 7fbdd7700700 1 --2- 172.21.15.99:0/3806991503 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdd006a6e0 0x7fbdd010e660 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbdc800b0a0 tx=0x7fbdc800b3b0 comp rx=0 tx=0).stop 2024-01-31T05:10:28.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.658+0000 7fbdd7700700 1 -- 172.21.15.99:0/3806991503 shutdown_connections 2024-01-31T05:10:28.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.658+0000 7fbdd7700700 1 --2- 172.21.15.99:0/3806991503 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdd006a6e0 0x7fbdd010e660 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:28.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.658+0000 7fbdd7700700 1 --2- 172.21.15.99:0/3806991503 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbdd0107790 0x7fbdd0107b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:28.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.658+0000 7fbdd7700700 1 --2- 172.21.15.99:0/3806991503 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdd0069d20 0x7fbdd006a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:28.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.658+0000 7fbdd7700700 1 -- 172.21.15.99:0/3806991503 >> 172.21.15.99:0/3806991503 conn(0x7fbdd0076730 msgr2=0x7fbdd0076b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:28.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.658+0000 7fbdd7700700 1 -- 172.21.15.99:0/3806991503 shutdown_connections 2024-01-31T05:10:28.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.658+0000 7fbdd7700700 1 -- 172.21.15.99:0/3806991503 wait complete. 2024-01-31T05:10:28.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.658+0000 7fbdd7700700 1 Processor -- start 2024-01-31T05:10:28.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.658+0000 7fbdd7700700 1 -- start start 2024-01-31T05:10:28.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.658+0000 7fbdd7700700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdd0069d20 0x7fbdd019d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:28.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.658+0000 7fbdd7700700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdd006a6e0 0x7fbdd019de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:28.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.658+0000 7fbdd7700700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbdd0107790 0x7fbdd0197b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:28.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.658+0000 7fbdd7700700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd0198160 con 0x7fbdd006a6e0 2024-01-31T05:10:28.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.658+0000 7fbdd7700700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd01982a0 con 0x7fbdd0069d20 2024-01-31T05:10:28.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.658+0000 7fbdd7700700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd0198460 con 0x7fbdd0107790 2024-01-31T05:10:28.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.659+0000 7fbdd4c9b700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdd006a6e0 0x7fbdd019de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:28.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.659+0000 7fbdd4c9b700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdd006a6e0 0x7fbdd019de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39442/0 (socket says 172.21.15.99:39442) 2024-01-31T05:10:28.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.659+0000 7fbdd4c9b700 1 -- 172.21.15.99:0/2567633496 learned_addr learned my addr 172.21.15.99:0/2567633496 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:28.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.659+0000 7fbdd5c9d700 1 --2- 172.21.15.99:0/2567633496 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbdd0107790 0x7fbdd0197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:28.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.659+0000 7fbdd549c700 1 --2- 172.21.15.99:0/2567633496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdd0069d20 0x7fbdd019d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:28.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.659+0000 7fbdd4c9b700 1 -- 172.21.15.99:0/2567633496 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbdd0107790 msgr2=0x7fbdd0197b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:28.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.659+0000 7fbdd4c9b700 1 --2- 172.21.15.99:0/2567633496 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbdd0107790 0x7fbdd0197b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:28.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.659+0000 7fbdd4c9b700 1 -- 172.21.15.99:0/2567633496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdd0069d20 msgr2=0x7fbdd019d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:28.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.659+0000 7fbdd4c9b700 1 --2- 172.21.15.99:0/2567633496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdd0069d20 0x7fbdd019d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:28.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.659+0000 7fbdd4c9b700 1 -- 172.21.15.99:0/2567633496 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc8009d00 con 0x7fbdd006a6e0 2024-01-31T05:10:28.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.659+0000 7fbdd549c700 1 --2- 172.21.15.99:0/2567633496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdd0069d20 0x7fbdd019d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:10:28.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.659+0000 7fbdd4c9b700 1 --2- 172.21.15.99:0/2567633496 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdd006a6e0 0x7fbdd019de80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbdc000d950 tx=0x7fbdc000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:28.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.659+0000 7fbdc67fc700 1 -- 172.21.15.99:0/2567633496 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc0009940 con 0x7fbdd006a6e0 2024-01-31T05:10:28.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.659+0000 7fbdc67fc700 1 -- 172.21.15.99:0/2567633496 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbdc0010460 con 0x7fbdd006a6e0 2024-01-31T05:10:28.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.659+0000 7fbdc67fc700 1 -- 172.21.15.99:0/2567633496 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc000f620 con 0x7fbdd006a6e0 2024-01-31T05:10:28.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.659+0000 7fbdd7700700 1 -- 172.21.15.99:0/2567633496 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdd0198740 con 0x7fbdd006a6e0 2024-01-31T05:10:28.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.659+0000 7fbdd7700700 1 -- 172.21.15.99:0/2567633496 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdd01a49e0 con 0x7fbdd006a6e0 2024-01-31T05:10:28.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.660+0000 7fbdd7700700 1 -- 172.21.15.99:0/2567633496 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdd0109d90 con 0x7fbdd006a6e0 2024-01-31T05:10:28.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.661+0000 7fbdc67fc700 1 -- 172.21.15.99:0/2567633496 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7fbdc00108d0 con 0x7fbdd006a6e0 2024-01-31T05:10:28.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.662+0000 7fbdc67fc700 1 --2- 172.21.15.99:0/2567633496 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fbdbc0a1400 0x7fbdbc0a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:28.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.662+0000 7fbdd549c700 1 --2- 172.21.15.99:0/2567633496 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fbdbc0a1400 0x7fbdbc0a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:28.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.662+0000 7fbdc67fc700 1 -- 172.21.15.99:0/2567633496 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fbdc00cca30 con 0x7fbdd006a6e0 2024-01-31T05:10:28.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.662+0000 7fbdd549c700 1 --2- 172.21.15.99:0/2567633496 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fbdbc0a1400 0x7fbdbc0a38c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc009b50 tx=0x7fbdcc009550 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:28.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.665+0000 7fbdc67fc700 1 -- 172.21.15.99:0/2567633496 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fbdc0095e70 con 0x7fbdd006a6e0 2024-01-31T05:10:28.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.865+0000 7fbdd7700700 1 -- 172.21.15.99:0/2567633496 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbdd00684a0 con 0x7fbdd006a6e0 2024-01-31T05:10:28.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.865+0000 7fbdc67fc700 1 -- 172.21.15.99:0/2567633496 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbdc0099490 con 0x7fbdd006a6e0 2024-01-31T05:10:28.865 INFO:teuthology.orchestra.run.smithi099.stdout:107374182466 2024-01-31T05:10:28.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.867+0000 7fbdd7700700 1 -- 172.21.15.99:0/2567633496 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fbdbc0a1400 msgr2=0x7fbdbc0a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:28.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.867+0000 7fbdd7700700 1 --2- 172.21.15.99:0/2567633496 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fbdbc0a1400 0x7fbdbc0a38c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc009b50 tx=0x7fbdcc009550 comp rx=0 tx=0).stop 2024-01-31T05:10:28.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.867+0000 7fbdd7700700 1 -- 172.21.15.99:0/2567633496 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdd006a6e0 msgr2=0x7fbdd019de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:28.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.867+0000 7fbdd7700700 1 --2- 172.21.15.99:0/2567633496 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdd006a6e0 0x7fbdd019de80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbdc000d950 tx=0x7fbdc000dc60 comp rx=0 tx=0).stop 2024-01-31T05:10:28.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.867+0000 7fbdd7700700 1 -- 172.21.15.99:0/2567633496 shutdown_connections 2024-01-31T05:10:28.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.867+0000 7fbdd7700700 1 --2- 172.21.15.99:0/2567633496 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbdd0107790 0x7fbdd0197b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:28.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.867+0000 7fbdd7700700 1 --2- 172.21.15.99:0/2567633496 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fbdbc0a1400 0x7fbdbc0a38c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:28.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.867+0000 7fbdd7700700 1 --2- 172.21.15.99:0/2567633496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdd0069d20 0x7fbdd019d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:28.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.867+0000 7fbdd7700700 1 --2- 172.21.15.99:0/2567633496 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdd006a6e0 0x7fbdd019de80 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:28.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.867+0000 7fbdd7700700 1 -- 172.21.15.99:0/2567633496 >> 172.21.15.99:0/2567633496 conn(0x7fbdd0076730 msgr2=0x7fbdd00fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:28.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.867+0000 7fbdd7700700 1 -- 172.21.15.99:0/2567633496 shutdown_connections 2024-01-31T05:10:28.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:28.867+0000 7fbdd7700700 1 -- 172.21.15.99:0/2567633496 wait complete. 2024-01-31T05:10:30.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:29 smithi099 ceph-mon[31615]: pgmap v322: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s; 13 B/s, 1 objects/s recovering 2024-01-31T05:10:30.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:29 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/2567633496' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-01-31T05:10:30.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:29 smithi181 ceph-mon[36434]: pgmap v322: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s; 13 B/s, 1 objects/s recovering 2024-01-31T05:10:30.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:29 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/2567633496' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-01-31T05:10:30.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:29 smithi179 ceph-mon[35652]: pgmap v322: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s; 13 B/s, 1 objects/s recovering 2024-01-31T05:10:30.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:29 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/2567633496' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-01-31T05:10:30.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.456+0000 7f91e6a7b700 1 -- 172.21.15.99:0/3490556694 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91e0101080 msgr2=0x7f91e010d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:30.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.456+0000 7f91e6a7b700 1 --2- 172.21.15.99:0/3490556694 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91e0101080 0x7f91e010d560 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f91d800b0a0 tx=0x7f91d800b3b0 comp rx=0 tx=0).stop 2024-01-31T05:10:30.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.456+0000 7f91e6a7b700 1 -- 172.21.15.99:0/3490556694 shutdown_connections 2024-01-31T05:10:30.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.457+0000 7f91e6a7b700 1 --2- 172.21.15.99:0/3490556694 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91e0101080 0x7f91e010d560 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:30.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.457+0000 7f91e6a7b700 1 --2- 172.21.15.99:0/3490556694 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91e0106690 0x7f91e0106a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:30.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.457+0000 7f91e6a7b700 1 --2- 172.21.15.99:0/3490556694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91e01006e0 0x7f91e0100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:30.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.457+0000 7f91e6a7b700 1 -- 172.21.15.99:0/3490556694 >> 172.21.15.99:0/3490556694 conn(0x7f91e0077610 msgr2=0x7f91e0077a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:30.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.457+0000 7f91e6a7b700 1 -- 172.21.15.99:0/3490556694 shutdown_connections 2024-01-31T05:10:30.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.457+0000 7f91e6a7b700 1 -- 172.21.15.99:0/3490556694 wait complete. 2024-01-31T05:10:30.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.457+0000 7f91e6a7b700 1 Processor -- start 2024-01-31T05:10:30.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.457+0000 7f91e6a7b700 1 -- start start 2024-01-31T05:10:30.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.457+0000 7f91e6a7b700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91e01006e0 0x7f91e019c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:30.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.457+0000 7f91e6a7b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91e0101080 0x7f91e019cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:30.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.457+0000 7f91e6a7b700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91e0106690 0x7f91e0196a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:30.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.457+0000 7f91e6a7b700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e01970a0 con 0x7f91e0106690 2024-01-31T05:10:30.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.457+0000 7f91e6a7b700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e01971e0 con 0x7f91e0101080 2024-01-31T05:10:30.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.457+0000 7f91e6a7b700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e01973a0 con 0x7f91e01006e0 2024-01-31T05:10:30.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.458+0000 7f91e5018700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91e0106690 0x7f91e0196a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:30.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.458+0000 7f91e5018700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91e0106690 0x7f91e0196a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39460/0 (socket says 172.21.15.99:39460) 2024-01-31T05:10:30.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.458+0000 7f91e5018700 1 -- 172.21.15.99:0/2979587861 learned_addr learned my addr 172.21.15.99:0/2979587861 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:30.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.458+0000 7f91e4817700 1 --2- 172.21.15.99:0/2979587861 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91e01006e0 0x7f91e019c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:30.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.458+0000 7f91dffff700 1 --2- 172.21.15.99:0/2979587861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91e0101080 0x7f91e019cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:30.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.458+0000 7f91e5018700 1 -- 172.21.15.99:0/2979587861 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91e01006e0 msgr2=0x7f91e019c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:30.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.458+0000 7f91e5018700 1 --2- 172.21.15.99:0/2979587861 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91e01006e0 0x7f91e019c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:30.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.458+0000 7f91e5018700 1 -- 172.21.15.99:0/2979587861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91e0101080 msgr2=0x7f91e019cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:30.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.458+0000 7f91e5018700 1 --2- 172.21.15.99:0/2979587861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91e0101080 0x7f91e019cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:30.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.458+0000 7f91e5018700 1 -- 172.21.15.99:0/2979587861 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d8009d00 con 0x7f91e0106690 2024-01-31T05:10:30.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.458+0000 7f91dffff700 1 --2- 172.21.15.99:0/2979587861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91e0101080 0x7f91e019cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:10:30.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.458+0000 7f91e4817700 1 --2- 172.21.15.99:0/2979587861 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91e01006e0 0x7f91e019c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:10:30.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.458+0000 7f91e5018700 1 --2- 172.21.15.99:0/2979587861 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91e0106690 0x7f91e0196a40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f91d800b830 tx=0x7f91d80078a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:30.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.458+0000 7f91ddffb700 1 -- 172.21.15.99:0/2979587861 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d800e040 con 0x7f91e0106690 2024-01-31T05:10:30.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.458+0000 7f91e6a7b700 1 -- 172.21.15.99:0/2979587861 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91e0197620 con 0x7f91e0106690 2024-01-31T05:10:30.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.458+0000 7f91ddffb700 1 -- 172.21.15.99:0/2979587861 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f91d8004e60 con 0x7f91e0106690 2024-01-31T05:10:30.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.458+0000 7f91ddffb700 1 -- 172.21.15.99:0/2979587861 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d8005420 con 0x7f91e0106690 2024-01-31T05:10:30.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.458+0000 7f91e6a7b700 1 -- 172.21.15.99:0/2979587861 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e01a3920 con 0x7f91e0106690 2024-01-31T05:10:30.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.459+0000 7f91e6a7b700 1 -- 172.21.15.99:0/2979587861 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91e0108c40 con 0x7f91e0106690 2024-01-31T05:10:30.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.460+0000 7f91ddffb700 1 -- 172.21.15.99:0/2979587861 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f91d801bb30 con 0x7f91e0106690 2024-01-31T05:10:30.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.461+0000 7f91ddffb700 1 --2- 172.21.15.99:0/2979587861 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f91d00a1400 0x7f91d00a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:30.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.461+0000 7f91e4817700 1 --2- 172.21.15.99:0/2979587861 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f91d00a1400 0x7f91d00a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:30.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.461+0000 7f91ddffb700 1 -- 172.21.15.99:0/2979587861 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f91d80cec80 con 0x7f91e0106690 2024-01-31T05:10:30.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.461+0000 7f91e4817700 1 --2- 172.21.15.99:0/2979587861 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f91d00a1400 0x7f91d00a38c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f91e0197b80 tx=0x7f91d4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:30.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.464+0000 7f91ddffb700 1 -- 172.21.15.99:0/2979587861 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f91d80980d0 con 0x7f91e0106690 2024-01-31T05:10:30.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.666+0000 7f91e6a7b700 1 -- 172.21.15.99:0/2979587861 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f91e0197f70 con 0x7f91e0106690 2024-01-31T05:10:30.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.666+0000 7f91ddffb700 1 -- 172.21.15.99:0/2979587861 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f91d809b6f0 con 0x7f91e0106690 2024-01-31T05:10:30.667 INFO:teuthology.orchestra.run.smithi099.stdout:197568495668 2024-01-31T05:10:30.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.668+0000 7f91e6a7b700 1 -- 172.21.15.99:0/2979587861 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f91d00a1400 msgr2=0x7f91d00a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:30.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.668+0000 7f91e6a7b700 1 --2- 172.21.15.99:0/2979587861 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f91d00a1400 0x7f91d00a38c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f91e0197b80 tx=0x7f91d4008040 comp rx=0 tx=0).stop 2024-01-31T05:10:30.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.668+0000 7f91e6a7b700 1 -- 172.21.15.99:0/2979587861 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91e0106690 msgr2=0x7f91e0196a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:30.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.668+0000 7f91e6a7b700 1 --2- 172.21.15.99:0/2979587861 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91e0106690 0x7f91e0196a40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f91d800b830 tx=0x7f91d80078a0 comp rx=0 tx=0).stop 2024-01-31T05:10:30.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.668+0000 7f91e6a7b700 1 -- 172.21.15.99:0/2979587861 shutdown_connections 2024-01-31T05:10:30.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.668+0000 7f91e6a7b700 1 --2- 172.21.15.99:0/2979587861 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91e0106690 0x7f91e0196a40 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:30.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.668+0000 7f91e6a7b700 1 --2- 172.21.15.99:0/2979587861 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91e01006e0 0x7f91e019c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:30.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.668+0000 7f91e6a7b700 1 --2- 172.21.15.99:0/2979587861 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f91d00a1400 0x7f91d00a38c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:30.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.668+0000 7f91e6a7b700 1 --2- 172.21.15.99:0/2979587861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91e0101080 0x7f91e019cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:30.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.668+0000 7f91e6a7b700 1 -- 172.21.15.99:0/2979587861 >> 172.21.15.99:0/2979587861 conn(0x7f91e0077610 msgr2=0x7f91e00fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:30.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.668+0000 7f91e6a7b700 1 -- 172.21.15.99:0/2979587861 shutdown_connections 2024-01-31T05:10:30.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:30.669+0000 7f91e6a7b700 1 -- 172.21.15.99:0/2979587861 wait complete. 2024-01-31T05:10:31.046 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:30 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/2979587861' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-01-31T05:10:31.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:30 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/2979587861' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-01-31T05:10:31.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.046+0000 7fa695ff1700 1 -- 172.21.15.99:0/3570487528 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6901017c0 msgr2=0x7fa690101c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:31.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.046+0000 7fa695ff1700 1 --2- 172.21.15.99:0/3570487528 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6901017c0 0x7fa690101c40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa678009990 tx=0x7fa678009ca0 comp rx=0 tx=0).stop 2024-01-31T05:10:31.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.046+0000 7fa695ff1700 1 -- 172.21.15.99:0/3570487528 shutdown_connections 2024-01-31T05:10:31.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.046+0000 7fa695ff1700 1 --2- 172.21.15.99:0/3570487528 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa690102180 0x7fa69010e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:31.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.046+0000 7fa695ff1700 1 --2- 172.21.15.99:0/3570487528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6901077c0 0x7fa690107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:31.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.046+0000 7fa695ff1700 1 --2- 172.21.15.99:0/3570487528 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6901017c0 0x7fa690101c40 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:31.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.046+0000 7fa695ff1700 1 -- 172.21.15.99:0/3570487528 >> 172.21.15.99:0/3570487528 conn(0x7fa6900fd290 msgr2=0x7fa6900ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:31.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.046+0000 7fa695ff1700 1 -- 172.21.15.99:0/3570487528 shutdown_connections 2024-01-31T05:10:31.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.046+0000 7fa695ff1700 1 -- 172.21.15.99:0/3570487528 wait complete. 2024-01-31T05:10:31.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.047+0000 7fa695ff1700 1 Processor -- start 2024-01-31T05:10:31.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.047+0000 7fa695ff1700 1 -- start start 2024-01-31T05:10:31.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.047+0000 7fa695ff1700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6901017c0 0x7fa69019d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:31.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.047+0000 7fa695ff1700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa690102180 0x7fa69019dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:31.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.047+0000 7fa695ff1700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6901077c0 0x7fa690197970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:31.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.047+0000 7fa695ff1700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa690197fd0 con 0x7fa6901077c0 2024-01-31T05:10:31.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.047+0000 7fa695ff1700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa690198110 con 0x7fa6901017c0 2024-01-31T05:10:31.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.047+0000 7fa695ff1700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6901982d0 con 0x7fa690102180 2024-01-31T05:10:31.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.047+0000 7fa68ffff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6901077c0 0x7fa690197970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:31.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.047+0000 7fa68ffff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6901077c0 0x7fa690197970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39470/0 (socket says 172.21.15.99:39470) 2024-01-31T05:10:31.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.047+0000 7fa68ffff700 1 -- 172.21.15.99:0/2392207352 learned_addr learned my addr 172.21.15.99:0/2392207352 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:31.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.048+0000 7fa68effd700 1 --2- 172.21.15.99:0/2392207352 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa690102180 0x7fa69019dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:31.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.048+0000 7fa68ffff700 1 -- 172.21.15.99:0/2392207352 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa690102180 msgr2=0x7fa69019dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:31.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.048+0000 7fa68ffff700 1 --2- 172.21.15.99:0/2392207352 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa690102180 0x7fa69019dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:31.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.048+0000 7fa68ffff700 1 -- 172.21.15.99:0/2392207352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6901017c0 msgr2=0x7fa69019d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:31.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.048+0000 7fa68f7fe700 1 --2- 172.21.15.99:0/2392207352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6901017c0 0x7fa69019d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:31.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.048+0000 7fa68ffff700 1 --2- 172.21.15.99:0/2392207352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6901017c0 0x7fa69019d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:31.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.048+0000 7fa68ffff700 1 -- 172.21.15.99:0/2392207352 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6780095f0 con 0x7fa6901077c0 2024-01-31T05:10:31.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.048+0000 7fa68effd700 1 --2- 172.21.15.99:0/2392207352 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa690102180 0x7fa69019dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:10:31.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.048+0000 7fa68ffff700 1 --2- 172.21.15.99:0/2392207352 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6901077c0 0x7fa690197970 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa68800c900 tx=0x7fa68800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:31.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.048+0000 7fa68cff9700 1 -- 172.21.15.99:0/2392207352 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa688007b00 con 0x7fa6901077c0 2024-01-31T05:10:31.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.048+0000 7fa695ff1700 1 -- 172.21.15.99:0/2392207352 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6901985b0 con 0x7fa6901077c0 2024-01-31T05:10:31.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.048+0000 7fa68cff9700 1 -- 172.21.15.99:0/2392207352 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa688007c60 con 0x7fa6901077c0 2024-01-31T05:10:31.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.048+0000 7fa68cff9700 1 -- 172.21.15.99:0/2392207352 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa688018660 con 0x7fa6901077c0 2024-01-31T05:10:31.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.048+0000 7fa695ff1700 1 -- 172.21.15.99:0/2392207352 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6901a4850 con 0x7fa6901077c0 2024-01-31T05:10:31.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.049+0000 7fa695ff1700 1 -- 172.21.15.99:0/2392207352 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa690109d50 con 0x7fa6901077c0 2024-01-31T05:10:31.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.050+0000 7fa68cff9700 1 -- 172.21.15.99:0/2392207352 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7fa68800f450 con 0x7fa6901077c0 2024-01-31T05:10:31.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.051+0000 7fa68cff9700 1 --2- 172.21.15.99:0/2392207352 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa67c0a1400 0x7fa67c0a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:31.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.051+0000 7fa68f7fe700 1 --2- 172.21.15.99:0/2392207352 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa67c0a1400 0x7fa67c0a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:31.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.051+0000 7fa68cff9700 1 -- 172.21.15.99:0/2392207352 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fa6880ccb10 con 0x7fa6901077c0 2024-01-31T05:10:31.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.051+0000 7fa68f7fe700 1 --2- 172.21.15.99:0/2392207352 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa67c0a1400 0x7fa67c0a38c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa6800094f0 tx=0x7fa680009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:31.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.055+0000 7fa68cff9700 1 -- 172.21.15.99:0/2392207352 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fa688095f50 con 0x7fa6901077c0 2024-01-31T05:10:31.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:30 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/2979587861' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-01-31T05:10:31.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.259+0000 7fa695ff1700 1 -- 172.21.15.99:0/2392207352 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fa690198ed0 con 0x7fa6901077c0 2024-01-31T05:10:31.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.260+0000 7fa68cff9700 1 -- 172.21.15.99:0/2392207352 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa688099570 con 0x7fa6901077c0 2024-01-31T05:10:31.260 INFO:teuthology.orchestra.run.smithi099.stdout:141733920830 2024-01-31T05:10:31.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.262+0000 7fa695ff1700 1 -- 172.21.15.99:0/2392207352 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa67c0a1400 msgr2=0x7fa67c0a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:31.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.262+0000 7fa695ff1700 1 --2- 172.21.15.99:0/2392207352 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa67c0a1400 0x7fa67c0a38c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa6800094f0 tx=0x7fa680009040 comp rx=0 tx=0).stop 2024-01-31T05:10:31.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.262+0000 7fa695ff1700 1 -- 172.21.15.99:0/2392207352 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6901077c0 msgr2=0x7fa690197970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:31.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.262+0000 7fa695ff1700 1 --2- 172.21.15.99:0/2392207352 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6901077c0 0x7fa690197970 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa68800c900 tx=0x7fa68800ccc0 comp rx=0 tx=0).stop 2024-01-31T05:10:31.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.262+0000 7fa695ff1700 1 -- 172.21.15.99:0/2392207352 shutdown_connections 2024-01-31T05:10:31.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.262+0000 7fa695ff1700 1 --2- 172.21.15.99:0/2392207352 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6901077c0 0x7fa690197970 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:31.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.262+0000 7fa695ff1700 1 --2- 172.21.15.99:0/2392207352 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa67c0a1400 0x7fa67c0a38c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:31.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.262+0000 7fa695ff1700 1 --2- 172.21.15.99:0/2392207352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6901017c0 0x7fa69019d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:31.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.262+0000 7fa695ff1700 1 --2- 172.21.15.99:0/2392207352 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa690102180 0x7fa69019dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:31.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.262+0000 7fa695ff1700 1 -- 172.21.15.99:0/2392207352 >> 172.21.15.99:0/2392207352 conn(0x7fa6900fd290 msgr2=0x7fa6900fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:31.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.262+0000 7fa695ff1700 1 -- 172.21.15.99:0/2392207352 shutdown_connections 2024-01-31T05:10:31.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:31.262+0000 7fa695ff1700 1 -- 172.21.15.99:0/2392207352 wait complete. 2024-01-31T05:10:31.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:31 smithi099 ceph-mon[31615]: pgmap v323: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s; 11 B/s, 1 objects/s recovering 2024-01-31T05:10:31.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:31 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/2392207352' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-01-31T05:10:31.825 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182461 got 107374182466 for osd.3 2024-01-31T05:10:31.826 DEBUG:teuthology.parallel:result is None 2024-01-31T05:10:32.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:31 smithi181 ceph-mon[36434]: pgmap v323: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s; 11 B/s, 1 objects/s recovering 2024-01-31T05:10:32.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:31 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/2392207352' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-01-31T05:10:32.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:31 smithi179 ceph-mon[35652]: pgmap v323: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s; 11 B/s, 1 objects/s recovering 2024-01-31T05:10:32.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:31 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/2392207352' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-01-31T05:10:32.428 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920826 got 141733920830 for osd.4 2024-01-31T05:10:32.429 DEBUG:teuthology.parallel:result is None 2024-01-31T05:10:33.357 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:33 smithi099 ceph-mon[31615]: pgmap v324: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s; 10 B/s, 0 objects/s recovering 2024-01-31T05:10:33.389 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495663 got 197568495668 for osd.6 2024-01-31T05:10:33.389 DEBUG:teuthology.parallel:result is None 2024-01-31T05:10:33.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:33 smithi181 ceph-mon[36434]: pgmap v324: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s; 10 B/s, 0 objects/s recovering 2024-01-31T05:10:33.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:33 smithi179 ceph-mon[35652]: pgmap v324: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s; 10 B/s, 0 objects/s recovering 2024-01-31T05:10:35.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.631+0000 7f79d33c7700 1 -- 172.21.15.99:0/1830145885 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79cc1010d0 msgr2=0x7f79cc10d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:35.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.631+0000 7f79d33c7700 1 --2- 172.21.15.99:0/1830145885 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79cc1010d0 0x7f79cc10d630 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f79bc0099c0 tx=0x7f79bc009cd0 comp rx=0 tx=0).stop 2024-01-31T05:10:35.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.631+0000 7f79d33c7700 1 -- 172.21.15.99:0/1830145885 shutdown_connections 2024-01-31T05:10:35.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.631+0000 7f79d33c7700 1 --2- 172.21.15.99:0/1830145885 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79cc1010d0 0x7f79cc10d630 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:35.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.631+0000 7f79d33c7700 1 --2- 172.21.15.99:0/1830145885 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79cc102570 0x7f79cc102950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:35.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.631+0000 7f79d33c7700 1 --2- 172.21.15.99:0/1830145885 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79cc100710 0x7f79cc100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:35.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.631+0000 7f79d33c7700 1 -- 172.21.15.99:0/1830145885 >> 172.21.15.99:0/1830145885 conn(0x7f79cc076700 msgr2=0x7f79cc076b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:35.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.631+0000 7f79d33c7700 1 -- 172.21.15.99:0/1830145885 shutdown_connections 2024-01-31T05:10:35.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.631+0000 7f79d33c7700 1 -- 172.21.15.99:0/1830145885 wait complete. 2024-01-31T05:10:35.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.632+0000 7f79d33c7700 1 Processor -- start 2024-01-31T05:10:35.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.632+0000 7f79d33c7700 1 -- start start 2024-01-31T05:10:35.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.632+0000 7f79d33c7700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79cc100710 0x7f79cc196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:35.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.632+0000 7f79d33c7700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79cc1010d0 0x7f79cc196f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:35.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.632+0000 7f79d33c7700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79cc102570 0x7f79cc197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:35.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.632+0000 7f79d33c7700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79cc1a6120 con 0x7f79cc1010d0 2024-01-31T05:10:35.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.632+0000 7f79d33c7700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79cc1a6260 con 0x7f79cc102570 2024-01-31T05:10:35.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.632+0000 7f79d33c7700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79cc1a6420 con 0x7f79cc100710 2024-01-31T05:10:35.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.632+0000 7f79d0962700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79cc1010d0 0x7f79cc196f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:35.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.632+0000 7f79d0962700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79cc1010d0 0x7f79cc196f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40822/0 (socket says 172.21.15.99:40822) 2024-01-31T05:10:35.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.632+0000 7f79d0962700 1 -- 172.21.15.99:0/2804398683 learned_addr learned my addr 172.21.15.99:0/2804398683 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:35.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.632+0000 7f79d1964700 1 --2- 172.21.15.99:0/2804398683 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79cc102570 0x7f79cc197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:35.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.632+0000 7f79d1163700 1 --2- 172.21.15.99:0/2804398683 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79cc100710 0x7f79cc196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:35.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.633+0000 7f79d0962700 1 -- 172.21.15.99:0/2804398683 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79cc100710 msgr2=0x7f79cc196a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:35.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.633+0000 7f79d0962700 1 --2- 172.21.15.99:0/2804398683 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79cc100710 0x7f79cc196a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:35.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.633+0000 7f79d0962700 1 -- 172.21.15.99:0/2804398683 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79cc102570 msgr2=0x7f79cc197490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:35.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.633+0000 7f79d0962700 1 --2- 172.21.15.99:0/2804398683 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79cc102570 0x7f79cc197490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:35.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.633+0000 7f79d0962700 1 -- 172.21.15.99:0/2804398683 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79bc0095f0 con 0x7f79cc1010d0 2024-01-31T05:10:35.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.633+0000 7f79d0962700 1 --2- 172.21.15.99:0/2804398683 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79cc1010d0 0x7f79cc196f50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f79c000b530 tx=0x7f79c000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:35.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.633+0000 7f79ca7fc700 1 -- 172.21.15.99:0/2804398683 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c0011830 con 0x7f79cc1010d0 2024-01-31T05:10:35.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.633+0000 7f79ca7fc700 1 -- 172.21.15.99:0/2804398683 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f79c0011e50 con 0x7f79cc1010d0 2024-01-31T05:10:35.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.633+0000 7f79d33c7700 1 -- 172.21.15.99:0/2804398683 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79cc1a6700 con 0x7f79cc1010d0 2024-01-31T05:10:35.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.633+0000 7f79ca7fc700 1 -- 172.21.15.99:0/2804398683 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c0010df0 con 0x7f79cc1010d0 2024-01-31T05:10:35.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.633+0000 7f79d33c7700 1 -- 172.21.15.99:0/2804398683 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79cc1a6c00 con 0x7f79cc1010d0 2024-01-31T05:10:35.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.634+0000 7f79d33c7700 1 -- 172.21.15.99:0/2804398683 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79cc108cf0 con 0x7f79cc1010d0 2024-01-31T05:10:35.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.635+0000 7f79ca7fc700 1 -- 172.21.15.99:0/2804398683 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f79c0010380 con 0x7f79cc1010d0 2024-01-31T05:10:35.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.636+0000 7f79ca7fc700 1 --2- 172.21.15.99:0/2804398683 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f79b40a1400 0x7f79b40a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:35.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.636+0000 7f79d1163700 1 --2- 172.21.15.99:0/2804398683 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f79b40a1400 0x7f79b40a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:35.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.636+0000 7f79ca7fc700 1 -- 172.21.15.99:0/2804398683 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f79c00cc900 con 0x7f79cc1010d0 2024-01-31T05:10:35.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.636+0000 7f79d1163700 1 --2- 172.21.15.99:0/2804398683 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f79b40a1400 0x7f79b40a38c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f79c4009550 tx=0x7f79c40091b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:35.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.639+0000 7f79ca7fc700 1 -- 172.21.15.99:0/2804398683 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f79c0095e50 con 0x7f79cc1010d0 2024-01-31T05:10:35.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:35 smithi099 ceph-mon[31615]: pgmap v325: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s; 9 B/s, 0 objects/s recovering 2024-01-31T05:10:35.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.840+0000 7f79d33c7700 1 -- 172.21.15.99:0/2804398683 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f79cc0684a0 con 0x7f79cc1010d0 2024-01-31T05:10:35.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.840+0000 7f79ca7fc700 1 -- 172.21.15.99:0/2804398683 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f79c0099470 con 0x7f79cc1010d0 2024-01-31T05:10:35.841 INFO:teuthology.orchestra.run.smithi099.stdout:34359738451 2024-01-31T05:10:35.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.842+0000 7f79d33c7700 1 -- 172.21.15.99:0/2804398683 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f79b40a1400 msgr2=0x7f79b40a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:35.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.842+0000 7f79d33c7700 1 --2- 172.21.15.99:0/2804398683 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f79b40a1400 0x7f79b40a38c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f79c4009550 tx=0x7f79c40091b0 comp rx=0 tx=0).stop 2024-01-31T05:10:35.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.842+0000 7f79d33c7700 1 -- 172.21.15.99:0/2804398683 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79cc1010d0 msgr2=0x7f79cc196f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:35.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.842+0000 7f79d33c7700 1 --2- 172.21.15.99:0/2804398683 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79cc1010d0 0x7f79cc196f50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f79c000b530 tx=0x7f79c000b840 comp rx=0 tx=0).stop 2024-01-31T05:10:35.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.842+0000 7f79d33c7700 1 -- 172.21.15.99:0/2804398683 shutdown_connections 2024-01-31T05:10:35.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.842+0000 7f79d33c7700 1 --2- 172.21.15.99:0/2804398683 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f79b40a1400 0x7f79b40a38c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:35.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.842+0000 7f79d33c7700 1 --2- 172.21.15.99:0/2804398683 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79cc102570 0x7f79cc197490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:35.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.843+0000 7f79d33c7700 1 --2- 172.21.15.99:0/2804398683 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f79cc100710 0x7f79cc196a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:35.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.843+0000 7f79d33c7700 1 --2- 172.21.15.99:0/2804398683 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79cc1010d0 0x7f79cc196f50 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:35.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.843+0000 7f79d33c7700 1 -- 172.21.15.99:0/2804398683 >> 172.21.15.99:0/2804398683 conn(0x7f79cc076700 msgr2=0x7f79cc0ff4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:35.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.843+0000 7f79d33c7700 1 -- 172.21.15.99:0/2804398683 shutdown_connections 2024-01-31T05:10:35.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.843+0000 7f79d33c7700 1 -- 172.21.15.99:0/2804398683 wait complete. 2024-01-31T05:10:35.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.852+0000 7f2cdde93700 1 -- 172.21.15.99:0/4126855752 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cd81066c0 msgr2=0x7f2cd8106aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:35.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.852+0000 7f2cdde93700 1 --2- 172.21.15.99:0/4126855752 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cd81066c0 0x7f2cd8106aa0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8009990 tx=0x7f2cc8009ca0 comp rx=0 tx=0).stop 2024-01-31T05:10:35.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.852+0000 7f2cdde93700 1 -- 172.21.15.99:0/4126855752 shutdown_connections 2024-01-31T05:10:35.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.852+0000 7f2cdde93700 1 --2- 172.21.15.99:0/4126855752 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2cd8101090 0x7f2cd810d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:35.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.852+0000 7f2cdde93700 1 --2- 172.21.15.99:0/4126855752 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cd81066c0 0x7f2cd8106aa0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:35.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.852+0000 7f2cdde93700 1 --2- 172.21.15.99:0/4126855752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cd81006d0 0x7f2cd8100b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:35.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.852+0000 7f2cdde93700 1 -- 172.21.15.99:0/4126855752 >> 172.21.15.99:0/4126855752 conn(0x7f2cd8077650 msgr2=0x7f2cd8077a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:35.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.852+0000 7f2cdde93700 1 -- 172.21.15.99:0/4126855752 shutdown_connections 2024-01-31T05:10:35.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.853+0000 7f2cdde93700 1 -- 172.21.15.99:0/4126855752 wait complete. 2024-01-31T05:10:35.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.853+0000 7f2cdde93700 1 Processor -- start 2024-01-31T05:10:35.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.854+0000 7f2cdde93700 1 -- start start 2024-01-31T05:10:35.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.854+0000 7f2cdde93700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cd81006d0 0x7f2cd8198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:35.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.854+0000 7f2cdde93700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2cd8101090 0x7f2cd8199020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:35.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.854+0000 7f2cdde93700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cd81066c0 0x7f2cd81a3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:35.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.854+0000 7f2cdde93700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd8199920 con 0x7f2cd81006d0 2024-01-31T05:10:35.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.854+0000 7f2cdde93700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd81a40a0 con 0x7f2cd81066c0 2024-01-31T05:10:35.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.854+0000 7f2cdde93700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd81a4210 con 0x7f2cd8101090 2024-01-31T05:10:35.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.854+0000 7f2cd77fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cd81006d0 0x7f2cd8198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:35.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.854+0000 7f2cd77fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cd81006d0 0x7f2cd8198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40838/0 (socket says 172.21.15.99:40838) 2024-01-31T05:10:35.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.854+0000 7f2cd77fe700 1 -- 172.21.15.99:0/1995919079 learned_addr learned my addr 172.21.15.99:0/1995919079 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:35.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.854+0000 7f2cd7fff700 1 --2- 172.21.15.99:0/1995919079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cd81066c0 0x7f2cd81a3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:35.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.854+0000 7f2cd6ffd700 1 --2- 172.21.15.99:0/1995919079 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2cd8101090 0x7f2cd8199020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:35.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.854+0000 7f2cd7fff700 1 -- 172.21.15.99:0/1995919079 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2cd8101090 msgr2=0x7f2cd8199020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:35.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.854+0000 7f2cd7fff700 1 --2- 172.21.15.99:0/1995919079 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2cd8101090 0x7f2cd8199020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:35.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.854+0000 7f2cd7fff700 1 -- 172.21.15.99:0/1995919079 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cd81006d0 msgr2=0x7f2cd8198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:35.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.854+0000 7f2cd7fff700 1 --2- 172.21.15.99:0/1995919079 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cd81006d0 0x7f2cd8198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:35.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.854+0000 7f2cd7fff700 1 -- 172.21.15.99:0/1995919079 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc80095f0 con 0x7f2cd81066c0 2024-01-31T05:10:35.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.854+0000 7f2cd77fe700 1 --2- 172.21.15.99:0/1995919079 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cd81006d0 0x7f2cd8198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:10:35.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.855+0000 7f2cd7fff700 1 --2- 172.21.15.99:0/1995919079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cd81066c0 0x7f2cd81a3b60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0007f10 tx=0x7f2cd000d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:35.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.855+0000 7f2cd4ff9700 1 -- 172.21.15.99:0/1995919079 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd0004db0 con 0x7f2cd81066c0 2024-01-31T05:10:35.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.855+0000 7f2cd4ff9700 1 -- 172.21.15.99:0/1995919079 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2cd000f040 con 0x7f2cd81066c0 2024-01-31T05:10:35.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.855+0000 7f2cdde93700 1 -- 172.21.15.99:0/1995919079 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cd81a4490 con 0x7f2cd81066c0 2024-01-31T05:10:35.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.855+0000 7f2cd4ff9700 1 -- 172.21.15.99:0/1995919079 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd0005990 con 0x7f2cd81066c0 2024-01-31T05:10:35.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.855+0000 7f2cdde93700 1 -- 172.21.15.99:0/1995919079 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cd81a4930 con 0x7f2cd81066c0 2024-01-31T05:10:35.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.856+0000 7f2cdde93700 1 -- 172.21.15.99:0/1995919079 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cd8108c00 con 0x7f2cd81066c0 2024-01-31T05:10:35.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.857+0000 7f2cd4ff9700 1 -- 172.21.15.99:0/1995919079 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f2cd000db20 con 0x7f2cd81066c0 2024-01-31T05:10:35.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.858+0000 7f2cd4ff9700 1 --2- 172.21.15.99:0/1995919079 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2cc00a1400 0x7f2cc00a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:35.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.858+0000 7f2cd77fe700 1 --2- 172.21.15.99:0/1995919079 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2cc00a1400 0x7f2cc00a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:35.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.858+0000 7f2cd4ff9700 1 -- 172.21.15.99:0/1995919079 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f2cd00cc480 con 0x7f2cd81066c0 2024-01-31T05:10:35.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.858+0000 7f2cd77fe700 1 --2- 172.21.15.99:0/1995919079 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2cc00a1400 0x7f2cc00a38c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8006010 tx=0x7f2cc800b280 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:35.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:35.861+0000 7f2cd4ff9700 1 -- 172.21.15.99:0/1995919079 <== mon.2 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f2cd00958c0 con 0x7f2cd81066c0 2024-01-31T05:10:36.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:36.060+0000 7f2cdde93700 1 -- 172.21.15.99:0/1995919079 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7f2cd806a4d0 con 0x7f2cd81066c0 2024-01-31T05:10:36.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:36.060+0000 7f2cd4ff9700 1 -- 172.21.15.99:0/1995919079 <== mon.2 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f2cd0098ee0 con 0x7f2cd81066c0 2024-01-31T05:10:36.061 INFO:teuthology.orchestra.run.smithi099.stdout:347892351004 2024-01-31T05:10:36.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:36.062+0000 7f2cdde93700 1 -- 172.21.15.99:0/1995919079 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2cc00a1400 msgr2=0x7f2cc00a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:36.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:36.062+0000 7f2cdde93700 1 --2- 172.21.15.99:0/1995919079 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2cc00a1400 0x7f2cc00a38c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8006010 tx=0x7f2cc800b280 comp rx=0 tx=0).stop 2024-01-31T05:10:36.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:36.062+0000 7f2cdde93700 1 -- 172.21.15.99:0/1995919079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cd81066c0 msgr2=0x7f2cd81a3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:36.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:36.062+0000 7f2cdde93700 1 --2- 172.21.15.99:0/1995919079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cd81066c0 0x7f2cd81a3b60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0007f10 tx=0x7f2cd000d3b0 comp rx=0 tx=0).stop 2024-01-31T05:10:36.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:36.063+0000 7f2cdde93700 1 -- 172.21.15.99:0/1995919079 shutdown_connections 2024-01-31T05:10:36.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:36.063+0000 7f2cdde93700 1 --2- 172.21.15.99:0/1995919079 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2cc00a1400 0x7f2cc00a38c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:36.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:36.063+0000 7f2cdde93700 1 --2- 172.21.15.99:0/1995919079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cd81066c0 0x7f2cd81a3b60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:36.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:36.063+0000 7f2cdde93700 1 --2- 172.21.15.99:0/1995919079 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cd81006d0 0x7f2cd8198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:36.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:36.063+0000 7f2cdde93700 1 --2- 172.21.15.99:0/1995919079 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2cd8101090 0x7f2cd8199020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:36.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:36.063+0000 7f2cdde93700 1 -- 172.21.15.99:0/1995919079 >> 172.21.15.99:0/1995919079 conn(0x7f2cd8077650 msgr2=0x7f2cd80ff420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:36.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:36.063+0000 7f2cdde93700 1 -- 172.21.15.99:0/1995919079 shutdown_connections 2024-01-31T05:10:36.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:36.063+0000 7f2cdde93700 1 -- 172.21.15.99:0/1995919079 wait complete. 2024-01-31T05:10:36.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:35 smithi181 ceph-mon[36434]: pgmap v325: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s; 9 B/s, 0 objects/s recovering 2024-01-31T05:10:36.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:35 smithi179 ceph-mon[35652]: pgmap v325: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s; 9 B/s, 0 objects/s recovering 2024-01-31T05:10:36.903 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:36 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/2804398683' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-01-31T05:10:36.904 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:36 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/1995919079' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-01-31T05:10:36.931 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738445 got 34359738451 for osd.0 2024-01-31T05:10:36.931 DEBUG:teuthology.parallel:result is None 2024-01-31T05:10:37.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:36 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/2804398683' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-01-31T05:10:37.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:36 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/1995919079' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-01-31T05:10:37.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:36 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/2804398683' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-01-31T05:10:37.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:36 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/1995919079' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-01-31T05:10:37.291 INFO:tasks.cephadm.ceph_manager.ceph:need seq 347892350998 got 347892351004 for osd.11 2024-01-31T05:10:37.291 DEBUG:teuthology.parallel:result is None 2024-01-31T05:10:37.291 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-01-31T05:10:37.291 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph pg dump --format=json 2024-01-31T05:10:37.565 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:10:37.922 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:37 smithi099 ceph-mon[31615]: pgmap v326: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s; 9 B/s, 0 objects/s recovering 2024-01-31T05:10:37.976 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:37 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:10:37.977 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:37 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:10:38.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:37 smithi181 ceph-mon[36434]: pgmap v326: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s; 9 B/s, 0 objects/s recovering 2024-01-31T05:10:38.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:37 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:10:38.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:37 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:10:38.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:37 smithi179 ceph-mon[35652]: pgmap v326: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s; 9 B/s, 0 objects/s recovering 2024-01-31T05:10:38.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:37 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:10:38.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:37 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:10:39.014 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:38 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:10:39.014 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:38 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:10:39.014 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:38 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:10:39.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:38 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:10:39.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:38 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:10:39.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:38 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:10:39.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:38 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:10:39.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:38 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:10:39.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:38 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:10:39.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.242+0000 7f0768257700 1 -- 172.21.15.99:0/52870419 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0760101830 msgr2=0x7f0760101cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:39.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.242+0000 7f0768257700 1 --2- 172.21.15.99:0/52870419 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0760101830 0x7f0760101cb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f07500099c0 tx=0x7f0750009cd0 comp rx=0 tx=0).stop 2024-01-31T05:10:39.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.243+0000 7f0768257700 1 -- 172.21.15.99:0/52870419 shutdown_connections 2024-01-31T05:10:39.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.243+0000 7f0768257700 1 --2- 172.21.15.99:0/52870419 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f07601021f0 0x7f076010e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:39.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.243+0000 7f0768257700 1 --2- 172.21.15.99:0/52870419 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0760106650 0x7f0760106a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:39.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.243+0000 7f0768257700 1 --2- 172.21.15.99:0/52870419 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0760101830 0x7f0760101cb0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:39.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.243+0000 7f0768257700 1 -- 172.21.15.99:0/52870419 >> 172.21.15.99:0/52870419 conn(0x7f0760078910 msgr2=0x7f0760078d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:39.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.243+0000 7f0768257700 1 -- 172.21.15.99:0/52870419 shutdown_connections 2024-01-31T05:10:39.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.243+0000 7f0768257700 1 -- 172.21.15.99:0/52870419 wait complete. 2024-01-31T05:10:39.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.243+0000 7f0768257700 1 Processor -- start 2024-01-31T05:10:39.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.243+0000 7f0768257700 1 -- start start 2024-01-31T05:10:39.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.243+0000 7f0768257700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0760101830 0x7f0760197c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:39.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.243+0000 7f0768257700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07601021f0 0x7f0760198180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:39.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.243+0000 7f0768257700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0760106650 0x7f076019c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:39.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.243+0000 7f0768257700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076019cb10 con 0x7f07601021f0 2024-01-31T05:10:39.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.243+0000 7f0768257700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076019cc80 con 0x7f0760106650 2024-01-31T05:10:39.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.244+0000 7f0768257700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076019ce40 con 0x7f0760101830 2024-01-31T05:10:39.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.244+0000 7f07657f2700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07601021f0 0x7f0760198180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:39.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.244+0000 7f07657f2700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07601021f0 0x7f0760198180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40848/0 (socket says 172.21.15.99:40848) 2024-01-31T05:10:39.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.244+0000 7f07657f2700 1 -- 172.21.15.99:0/1626193124 learned_addr learned my addr 172.21.15.99:0/1626193124 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:39.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.244+0000 7f0765ff3700 1 --2- 172.21.15.99:0/1626193124 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0760101830 0x7f0760197c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:39.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.244+0000 7f07667f4700 1 --2- 172.21.15.99:0/1626193124 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0760106650 0x7f076019c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:39.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.244+0000 7f07657f2700 1 -- 172.21.15.99:0/1626193124 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0760101830 msgr2=0x7f0760197c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:39.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.244+0000 7f07657f2700 1 --2- 172.21.15.99:0/1626193124 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0760101830 0x7f0760197c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:39.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.244+0000 7f07657f2700 1 -- 172.21.15.99:0/1626193124 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0760106650 msgr2=0x7f076019c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:39.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.244+0000 7f07657f2700 1 --2- 172.21.15.99:0/1626193124 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0760106650 0x7f076019c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:39.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.244+0000 7f07657f2700 1 -- 172.21.15.99:0/1626193124 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07500095f0 con 0x7f07601021f0 2024-01-31T05:10:39.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.244+0000 7f07657f2700 1 --2- 172.21.15.99:0/1626193124 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07601021f0 0x7f0760198180 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f075000b580 tx=0x7f0750004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:39.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.244+0000 7f0756ffd700 1 -- 172.21.15.99:0/1626193124 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075001d070 con 0x7f07601021f0 2024-01-31T05:10:39.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.244+0000 7f0756ffd700 1 -- 172.21.15.99:0/1626193124 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f075000fc30 con 0x7f07601021f0 2024-01-31T05:10:39.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.244+0000 7f0756ffd700 1 -- 172.21.15.99:0/1626193124 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0750022e40 con 0x7f07601021f0 2024-01-31T05:10:39.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.244+0000 7f0768257700 1 -- 172.21.15.99:0/1626193124 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f076019d0c0 con 0x7f07601021f0 2024-01-31T05:10:39.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.244+0000 7f0768257700 1 -- 172.21.15.99:0/1626193124 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f076019d390 con 0x7f07601021f0 2024-01-31T05:10:39.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.245+0000 7f0768257700 1 -- 172.21.15.99:0/1626193124 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0760109d10 con 0x7f07601021f0 2024-01-31T05:10:39.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.246+0000 7f0756ffd700 1 -- 172.21.15.99:0/1626193124 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f0750022570 con 0x7f07601021f0 2024-01-31T05:10:39.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.247+0000 7f0756ffd700 1 --2- 172.21.15.99:0/1626193124 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f074c0a1400 0x7f074c0a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:39.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.247+0000 7f0765ff3700 1 --2- 172.21.15.99:0/1626193124 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f074c0a1400 0x7f074c0a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:39.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.247+0000 7f0756ffd700 1 -- 172.21.15.99:0/1626193124 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f07500ce210 con 0x7f07601021f0 2024-01-31T05:10:39.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.247+0000 7f0765ff3700 1 --2- 172.21.15.99:0/1626193124 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f074c0a1400 0x7f074c0a38c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f075c00ac50 tx=0x7f075c00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:39.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.251+0000 7f0756ffd700 1 -- 172.21.15.99:0/1626193124 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f07500976e0 con 0x7f07601021f0 2024-01-31T05:10:39.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.440+0000 7f0768257700 1 -- 172.21.15.99:0/1626193124 --> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0760198fa0 con 0x7f074c0a1400 2024-01-31T05:10:39.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.450+0000 7f0756ffd700 1 -- 172.21.15.99:0/1626193124 <== mgr.14152 v2:172.21.15.99:6800/3925720924 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344564 (secure 0 0 0) 0x7f0760198fa0 con 0x7f074c0a1400 2024-01-31T05:10:39.456 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:10:39.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.454+0000 7f0768257700 1 -- 172.21.15.99:0/1626193124 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f074c0a1400 msgr2=0x7f074c0a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:39.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.454+0000 7f0768257700 1 --2- 172.21.15.99:0/1626193124 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f074c0a1400 0x7f074c0a38c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f075c00ac50 tx=0x7f075c00a380 comp rx=0 tx=0).stop 2024-01-31T05:10:39.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.454+0000 7f0768257700 1 -- 172.21.15.99:0/1626193124 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07601021f0 msgr2=0x7f0760198180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:39.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.454+0000 7f0768257700 1 --2- 172.21.15.99:0/1626193124 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07601021f0 0x7f0760198180 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f075000b580 tx=0x7f0750004730 comp rx=0 tx=0).stop 2024-01-31T05:10:39.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.454+0000 7f0768257700 1 -- 172.21.15.99:0/1626193124 shutdown_connections 2024-01-31T05:10:39.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.454+0000 7f0768257700 1 --2- 172.21.15.99:0/1626193124 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f074c0a1400 0x7f074c0a38c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:39.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.454+0000 7f0768257700 1 --2- 172.21.15.99:0/1626193124 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0760106650 0x7f076019c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:39.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.454+0000 7f0768257700 1 --2- 172.21.15.99:0/1626193124 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0760101830 0x7f0760197c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:39.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.454+0000 7f0768257700 1 --2- 172.21.15.99:0/1626193124 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07601021f0 0x7f0760198180 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:39.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.454+0000 7f0768257700 1 -- 172.21.15.99:0/1626193124 >> 172.21.15.99:0/1626193124 conn(0x7f0760078910 msgr2=0x7f07600ff880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:39.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.454+0000 7f0768257700 1 -- 172.21.15.99:0/1626193124 shutdown_connections 2024-01-31T05:10:39.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:39.454+0000 7f0768257700 1 -- 172.21.15.99:0/1626193124 wait complete. 2024-01-31T05:10:39.459 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-01-31T05:10:39.801 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:39 smithi099 ceph-mon[31615]: pgmap v327: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-01-31T05:10:40.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:39 smithi181 ceph-mon[36434]: pgmap v327: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-01-31T05:10:40.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:39 smithi179 ceph-mon[35652]: pgmap v327: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-01-31T05:10:40.145 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":327,"stamp":"2024-01-31T05:10:38.611459+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657658,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":865,"num_read_kb":551,"num_write":414,"num_write_kb":3070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":1180848,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":342,"ondisk_log_size":342,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":366844,"kb_used_data":13452,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124574980,"statfs":{"total":1151940427776,"available":1151564779520,"internally_reserved":0,"allocated":13774848,"data_stored":7514490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":70,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003087"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681428+0000","last_change":"2024-01-31T05:09:20.582274+0000","last_active":"2024-01-31T05:10:21.681428+0000","last_peered":"2024-01-31T05:10:21.681428+0000","last_clean":"2024-01-31T05:10:21.681428+0000","last_became_active":"2024-01-31T05:09:20.581511+0000","last_became_peered":"2024-01-31T05:09:20.581511+0000","last_unstale":"2024-01-31T05:10:21.681428+0000","last_undegraded":"2024-01-31T05:10:21.681428+0000","last_fullsized":"2024-01-31T05:10:21.681428+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:59:10.674456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.679950+0000","last_change":"2024-01-31T05:09:20.581752+0000","last_active":"2024-01-31T05:10:21.679950+0000","last_peered":"2024-01-31T05:10:21.679950+0000","last_clean":"2024-01-31T05:10:21.679950+0000","last_became_active":"2024-01-31T05:09:20.581035+0000","last_became_peered":"2024-01-31T05:09:20.581035+0000","last_unstale":"2024-01-31T05:10:21.679950+0000","last_undegraded":"2024-01-31T05:10:21.679950+0000","last_fullsized":"2024-01-31T05:10:21.679950+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:03:16.999371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.679907+0000","last_change":"2024-01-31T05:09:20.588191+0000","last_active":"2024-01-31T05:10:21.679907+0000","last_peered":"2024-01-31T05:10:21.679907+0000","last_clean":"2024-01-31T05:10:21.679907+0000","last_became_active":"2024-01-31T05:09:20.587466+0000","last_became_peered":"2024-01-31T05:09:20.587466+0000","last_unstale":"2024-01-31T05:10:21.679907+0000","last_undegraded":"2024-01-31T05:10:21.679907+0000","last_fullsized":"2024-01-31T05:10:21.679907+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:22:29.037408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.688961+0000","last_change":"2024-01-31T05:09:20.589377+0000","last_active":"2024-01-31T05:10:21.688961+0000","last_peered":"2024-01-31T05:10:21.688961+0000","last_clean":"2024-01-31T05:10:21.688961+0000","last_became_active":"2024-01-31T05:09:20.589065+0000","last_became_peered":"2024-01-31T05:09:20.589065+0000","last_unstale":"2024-01-31T05:10:21.688961+0000","last_undegraded":"2024-01-31T05:10:21.688961+0000","last_fullsized":"2024-01-31T05:10:21.688961+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:57:11.612654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.683051+0000","last_change":"2024-01-31T05:09:20.578919+0000","last_active":"2024-01-31T05:10:21.683051+0000","last_peered":"2024-01-31T05:10:21.683051+0000","last_clean":"2024-01-31T05:10:21.683051+0000","last_became_active":"2024-01-31T05:09:20.578594+0000","last_became_peered":"2024-01-31T05:09:20.578594+0000","last_unstale":"2024-01-31T05:10:21.683051+0000","last_undegraded":"2024-01-31T05:10:21.683051+0000","last_fullsized":"2024-01-31T05:10:21.683051+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:16:57.168457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681644+0000","last_change":"2024-01-31T05:09:20.586620+0000","last_active":"2024-01-31T05:10:21.681644+0000","last_peered":"2024-01-31T05:10:21.681644+0000","last_clean":"2024-01-31T05:10:21.681644+0000","last_became_active":"2024-01-31T05:09:20.586323+0000","last_became_peered":"2024-01-31T05:09:20.586323+0000","last_unstale":"2024-01-31T05:10:21.681644+0000","last_undegraded":"2024-01-31T05:10:21.681644+0000","last_fullsized":"2024-01-31T05:10:21.681644+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:03:31.479078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681655+0000","last_change":"2024-01-31T05:09:20.595122+0000","last_active":"2024-01-31T05:10:21.681655+0000","last_peered":"2024-01-31T05:10:21.681655+0000","last_clean":"2024-01-31T05:10:21.681655+0000","last_became_active":"2024-01-31T05:09:20.594766+0000","last_became_peered":"2024-01-31T05:09:20.594766+0000","last_unstale":"2024-01-31T05:10:21.681655+0000","last_undegraded":"2024-01-31T05:10:21.681655+0000","last_fullsized":"2024-01-31T05:10:21.681655+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:18:40.002855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.686734+0000","last_change":"2024-01-31T05:10:21.686734+0000","last_active":"2024-01-31T05:10:21.686734+0000","last_peered":"2024-01-31T05:10:21.686734+0000","last_clean":"2024-01-31T05:10:21.686734+0000","last_became_active":"2024-01-31T05:10:21.686293+0000","last_became_peered":"2024-01-31T05:10:21.686293+0000","last_unstale":"2024-01-31T05:10:21.686734+0000","last_undegraded":"2024-01-31T05:10:21.686734+0000","last_fullsized":"2024-01-31T05:10:21.686734+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:19:35.416043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684701+0000","last_change":"2024-01-31T05:09:20.588892+0000","last_active":"2024-01-31T05:10:21.684701+0000","last_peered":"2024-01-31T05:10:21.684701+0000","last_clean":"2024-01-31T05:10:21.684701+0000","last_became_active":"2024-01-31T05:09:20.588212+0000","last_became_peered":"2024-01-31T05:09:20.588212+0000","last_unstale":"2024-01-31T05:10:21.684701+0000","last_undegraded":"2024-01-31T05:10:21.684701+0000","last_fullsized":"2024-01-31T05:10:21.684701+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:49:45.270341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681790+0000","last_change":"2024-01-31T05:09:20.589396+0000","last_active":"2024-01-31T05:10:21.681790+0000","last_peered":"2024-01-31T05:10:21.681790+0000","last_clean":"2024-01-31T05:10:21.681790+0000","last_became_active":"2024-01-31T05:09:20.589058+0000","last_became_peered":"2024-01-31T05:09:20.589058+0000","last_unstale":"2024-01-31T05:10:21.681790+0000","last_undegraded":"2024-01-31T05:10:21.681790+0000","last_fullsized":"2024-01-31T05:10:21.681790+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:05:53.403136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681381+0000","last_change":"2024-01-31T05:09:20.592010+0000","last_active":"2024-01-31T05:10:21.681381+0000","last_peered":"2024-01-31T05:10:21.681381+0000","last_clean":"2024-01-31T05:10:21.681381+0000","last_became_active":"2024-01-31T05:09:20.591714+0000","last_became_peered":"2024-01-31T05:09:20.591714+0000","last_unstale":"2024-01-31T05:10:21.681381+0000","last_undegraded":"2024-01-31T05:10:21.681381+0000","last_fullsized":"2024-01-31T05:10:21.681381+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:56:11.651035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.685195+0000","last_change":"2024-01-31T05:10:21.685195+0000","last_active":"2024-01-31T05:10:21.685195+0000","last_peered":"2024-01-31T05:10:21.685195+0000","last_clean":"2024-01-31T05:10:21.685195+0000","last_became_active":"2024-01-31T05:10:21.684742+0000","last_became_peered":"2024-01-31T05:10:21.684742+0000","last_unstale":"2024-01-31T05:10:21.685195+0000","last_undegraded":"2024-01-31T05:10:21.685195+0000","last_fullsized":"2024-01-31T05:10:21.685195+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:18:59.674766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.679540+0000","last_change":"2024-01-31T05:09:20.582167+0000","last_active":"2024-01-31T05:10:21.679540+0000","last_peered":"2024-01-31T05:10:21.679540+0000","last_clean":"2024-01-31T05:10:21.679540+0000","last_became_active":"2024-01-31T05:09:20.581860+0000","last_became_peered":"2024-01-31T05:09:20.581860+0000","last_unstale":"2024-01-31T05:10:21.679540+0000","last_undegraded":"2024-01-31T05:10:21.679540+0000","last_fullsized":"2024-01-31T05:10:21.679540+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:46:05.891545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.679778+0000","last_change":"2024-01-31T05:09:20.587899+0000","last_active":"2024-01-31T05:10:21.679778+0000","last_peered":"2024-01-31T05:10:21.679778+0000","last_clean":"2024-01-31T05:10:21.679778+0000","last_became_active":"2024-01-31T05:09:20.587068+0000","last_became_peered":"2024-01-31T05:09:20.587068+0000","last_unstale":"2024-01-31T05:10:21.679778+0000","last_undegraded":"2024-01-31T05:10:21.679778+0000","last_fullsized":"2024-01-31T05:10:21.679778+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:59:44.747928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.679180+0000","last_change":"2024-01-31T05:09:20.590392+0000","last_active":"2024-01-31T05:10:21.679180+0000","last_peered":"2024-01-31T05:10:21.679180+0000","last_clean":"2024-01-31T05:10:21.679180+0000","last_became_active":"2024-01-31T05:09:20.590082+0000","last_became_peered":"2024-01-31T05:09:20.590082+0000","last_unstale":"2024-01-31T05:10:21.679180+0000","last_undegraded":"2024-01-31T05:10:21.679180+0000","last_fullsized":"2024-01-31T05:10:21.679180+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:59:10.672890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684330+0000","last_change":"2024-01-31T05:09:20.584822+0000","last_active":"2024-01-31T05:10:21.684330+0000","last_peered":"2024-01-31T05:10:21.684330+0000","last_clean":"2024-01-31T05:10:21.684330+0000","last_became_active":"2024-01-31T05:09:20.584531+0000","last_became_peered":"2024-01-31T05:09:20.584531+0000","last_unstale":"2024-01-31T05:10:21.684330+0000","last_undegraded":"2024-01-31T05:10:21.684330+0000","last_fullsized":"2024-01-31T05:10:21.684330+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:35:44.793407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681609+0000","last_change":"2024-01-31T05:09:20.582615+0000","last_active":"2024-01-31T05:10:21.681609+0000","last_peered":"2024-01-31T05:10:21.681609+0000","last_clean":"2024-01-31T05:10:21.681609+0000","last_became_active":"2024-01-31T05:09:20.581959+0000","last_became_peered":"2024-01-31T05:09:20.581959+0000","last_unstale":"2024-01-31T05:10:21.681609+0000","last_undegraded":"2024-01-31T05:10:21.681609+0000","last_fullsized":"2024-01-31T05:10:21.681609+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:29:06.817822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.682121+0000","last_change":"2024-01-31T05:09:20.582421+0000","last_active":"2024-01-31T05:10:21.682121+0000","last_peered":"2024-01-31T05:10:21.682121+0000","last_clean":"2024-01-31T05:10:21.682121+0000","last_became_active":"2024-01-31T05:09:20.582099+0000","last_became_peered":"2024-01-31T05:09:20.582099+0000","last_unstale":"2024-01-31T05:10:21.682121+0000","last_undegraded":"2024-01-31T05:10:21.682121+0000","last_fullsized":"2024-01-31T05:10:21.682121+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:08:03.802219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.683646+0000","last_change":"2024-01-31T05:09:20.580511+0000","last_active":"2024-01-31T05:10:21.683646+0000","last_peered":"2024-01-31T05:10:21.683646+0000","last_clean":"2024-01-31T05:10:21.683646+0000","last_became_active":"2024-01-31T05:09:20.579596+0000","last_became_peered":"2024-01-31T05:09:20.579596+0000","last_unstale":"2024-01-31T05:10:21.683646+0000","last_undegraded":"2024-01-31T05:10:21.683646+0000","last_fullsized":"2024-01-31T05:10:21.683646+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:07:01.206181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'13","reported_seq":101,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:34.268021+0000","last_change":"2024-01-31T05:09:20.187398+0000","last_active":"2024-01-31T05:10:34.268021+0000","last_peered":"2024-01-31T05:10:34.268021+0000","last_clean":"2024-01-31T05:10:34.268021+0000","last_became_active":"2024-01-31T05:09:20.186925+0000","last_became_peered":"2024-01-31T05:09:20.186925+0000","last_unstale":"2024-01-31T05:10:34.268021+0000","last_undegraded":"2024-01-31T05:10:34.268021+0000","last_fullsized":"2024-01-31T05:10:34.268021+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:33:34.624017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":69,"num_read_kb":69,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684902+0000","last_change":"2024-01-31T05:09:20.582800+0000","last_active":"2024-01-31T05:10:21.684902+0000","last_peered":"2024-01-31T05:10:21.684902+0000","last_clean":"2024-01-31T05:10:21.684902+0000","last_became_active":"2024-01-31T05:09:20.582523+0000","last_became_peered":"2024-01-31T05:09:20.582523+0000","last_unstale":"2024-01-31T05:10:21.684902+0000","last_undegraded":"2024-01-31T05:10:21.684902+0000","last_fullsized":"2024-01-31T05:10:21.684902+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:19:57.975954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.685133+0000","last_change":"2024-01-31T05:09:20.191566+0000","last_active":"2024-01-31T05:10:21.685133+0000","last_peered":"2024-01-31T05:10:21.685133+0000","last_clean":"2024-01-31T05:10:21.685133+0000","last_became_active":"2024-01-31T05:09:20.191268+0000","last_became_peered":"2024-01-31T05:09:20.191268+0000","last_unstale":"2024-01-31T05:10:21.685133+0000","last_undegraded":"2024-01-31T05:10:21.685133+0000","last_fullsized":"2024-01-31T05:10:21.685133+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:45:40.042374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.680124+0000","last_change":"2024-01-31T05:09:20.579061+0000","last_active":"2024-01-31T05:10:21.680124+0000","last_peered":"2024-01-31T05:10:21.680124+0000","last_clean":"2024-01-31T05:10:21.680124+0000","last_became_active":"2024-01-31T05:09:20.578728+0000","last_became_peered":"2024-01-31T05:09:20.578728+0000","last_unstale":"2024-01-31T05:10:21.680124+0000","last_undegraded":"2024-01-31T05:10:21.680124+0000","last_fullsized":"2024-01-31T05:10:21.680124+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:57:12.142419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.683895+0000","last_change":"2024-01-31T05:09:20.187366+0000","last_active":"2024-01-31T05:10:21.683895+0000","last_peered":"2024-01-31T05:10:21.683895+0000","last_clean":"2024-01-31T05:10:21.683895+0000","last_became_active":"2024-01-31T05:09:20.186616+0000","last_became_peered":"2024-01-31T05:09:20.186616+0000","last_unstale":"2024-01-31T05:10:21.683895+0000","last_undegraded":"2024-01-31T05:10:21.683895+0000","last_fullsized":"2024-01-31T05:10:21.683895+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:39:28.802810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684406+0000","last_change":"2024-01-31T05:09:20.590538+0000","last_active":"2024-01-31T05:10:21.684406+0000","last_peered":"2024-01-31T05:10:21.684406+0000","last_clean":"2024-01-31T05:10:21.684406+0000","last_became_active":"2024-01-31T05:09:20.590254+0000","last_became_peered":"2024-01-31T05:09:20.590254+0000","last_unstale":"2024-01-31T05:10:21.684406+0000","last_undegraded":"2024-01-31T05:10:21.684406+0000","last_fullsized":"2024-01-31T05:10:21.684406+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:06:38.209930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.683304+0000","last_change":"2024-01-31T05:09:20.183808+0000","last_active":"2024-01-31T05:10:21.683304+0000","last_peered":"2024-01-31T05:10:21.683304+0000","last_clean":"2024-01-31T05:10:21.683304+0000","last_became_active":"2024-01-31T05:09:20.183514+0000","last_became_peered":"2024-01-31T05:09:20.183514+0000","last_unstale":"2024-01-31T05:10:21.683304+0000","last_undegraded":"2024-01-31T05:10:21.683304+0000","last_fullsized":"2024-01-31T05:10:21.683304+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:32:43.392640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684938+0000","last_change":"2024-01-31T05:09:20.590871+0000","last_active":"2024-01-31T05:10:21.684938+0000","last_peered":"2024-01-31T05:10:21.684938+0000","last_clean":"2024-01-31T05:10:21.684938+0000","last_became_active":"2024-01-31T05:09:20.588533+0000","last_became_peered":"2024-01-31T05:09:20.588533+0000","last_unstale":"2024-01-31T05:10:21.684938+0000","last_undegraded":"2024-01-31T05:10:21.684938+0000","last_fullsized":"2024-01-31T05:10:21.684938+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:44:26.772616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'6","reported_seq":97,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:35.270235+0000","last_change":"2024-01-31T05:09:20.183455+0000","last_active":"2024-01-31T05:10:35.270235+0000","last_peered":"2024-01-31T05:10:35.270235+0000","last_clean":"2024-01-31T05:10:35.270235+0000","last_became_active":"2024-01-31T05:09:20.183070+0000","last_became_peered":"2024-01-31T05:09:20.183070+0000","last_unstale":"2024-01-31T05:10:35.270235+0000","last_undegraded":"2024-01-31T05:10:35.270235+0000","last_fullsized":"2024-01-31T05:10:35.270235+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:15:29.503830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":72,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.683440+0000","last_change":"2024-01-31T05:09:20.580755+0000","last_active":"2024-01-31T05:10:21.683440+0000","last_peered":"2024-01-31T05:10:21.683440+0000","last_clean":"2024-01-31T05:10:21.683440+0000","last_became_active":"2024-01-31T05:09:20.580452+0000","last_became_peered":"2024-01-31T05:09:20.580452+0000","last_unstale":"2024-01-31T05:10:21.683440+0000","last_undegraded":"2024-01-31T05:10:21.683440+0000","last_fullsized":"2024-01-31T05:10:21.683440+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:29:08.383532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681549+0000","last_change":"2024-01-31T05:09:20.182129+0000","last_active":"2024-01-31T05:10:21.681549+0000","last_peered":"2024-01-31T05:10:21.681549+0000","last_clean":"2024-01-31T05:10:21.681549+0000","last_became_active":"2024-01-31T05:09:20.181781+0000","last_became_peered":"2024-01-31T05:09:20.181781+0000","last_unstale":"2024-01-31T05:10:21.681549+0000","last_undegraded":"2024-01-31T05:10:21.681549+0000","last_fullsized":"2024-01-31T05:10:21.681549+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:05:57.854213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.685273+0000","last_change":"2024-01-31T05:09:20.591696+0000","last_active":"2024-01-31T05:10:21.685273+0000","last_peered":"2024-01-31T05:10:21.685273+0000","last_clean":"2024-01-31T05:10:21.685273+0000","last_became_active":"2024-01-31T05:09:20.591307+0000","last_became_peered":"2024-01-31T05:09:20.591307+0000","last_unstale":"2024-01-31T05:10:21.685273+0000","last_undegraded":"2024-01-31T05:10:21.685273+0000","last_fullsized":"2024-01-31T05:10:21.685273+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:59:56.884326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.679697+0000","last_change":"2024-01-31T05:09:20.179846+0000","last_active":"2024-01-31T05:10:21.679697+0000","last_peered":"2024-01-31T05:10:21.679697+0000","last_clean":"2024-01-31T05:10:21.679697+0000","last_became_active":"2024-01-31T05:09:20.179524+0000","last_became_peered":"2024-01-31T05:09:20.179524+0000","last_unstale":"2024-01-31T05:10:21.679697+0000","last_undegraded":"2024-01-31T05:10:21.679697+0000","last_fullsized":"2024-01-31T05:10:21.679697+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:13:51.085861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684000+0000","last_change":"2024-01-31T05:09:20.580076+0000","last_active":"2024-01-31T05:10:21.684000+0000","last_peered":"2024-01-31T05:10:21.684000+0000","last_clean":"2024-01-31T05:10:21.684000+0000","last_became_active":"2024-01-31T05:09:20.579764+0000","last_became_peered":"2024-01-31T05:09:20.579764+0000","last_unstale":"2024-01-31T05:10:21.684000+0000","last_undegraded":"2024-01-31T05:10:21.684000+0000","last_fullsized":"2024-01-31T05:10:21.684000+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:02:13.861848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.685470+0000","last_change":"2024-01-31T05:09:20.183941+0000","last_active":"2024-01-31T05:10:21.685470+0000","last_peered":"2024-01-31T05:10:21.685470+0000","last_clean":"2024-01-31T05:10:21.685470+0000","last_became_active":"2024-01-31T05:09:20.183631+0000","last_became_peered":"2024-01-31T05:09:20.183631+0000","last_unstale":"2024-01-31T05:10:21.685470+0000","last_undegraded":"2024-01-31T05:10:21.685470+0000","last_fullsized":"2024-01-31T05:10:21.685470+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:31:31.419345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681774+0000","last_change":"2024-01-31T05:09:20.589275+0000","last_active":"2024-01-31T05:10:21.681774+0000","last_peered":"2024-01-31T05:10:21.681774+0000","last_clean":"2024-01-31T05:10:21.681774+0000","last_became_active":"2024-01-31T05:09:20.588891+0000","last_became_peered":"2024-01-31T05:09:20.588891+0000","last_unstale":"2024-01-31T05:10:21.681774+0000","last_undegraded":"2024-01-31T05:10:21.681774+0000","last_fullsized":"2024-01-31T05:10:21.681774+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:30:27.665553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":165,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:37.272295+0000","last_change":"2024-01-31T05:09:20.182836+0000","last_active":"2024-01-31T05:10:37.272295+0000","last_peered":"2024-01-31T05:10:37.272295+0000","last_clean":"2024-01-31T05:10:37.272295+0000","last_became_active":"2024-01-31T05:09:20.182376+0000","last_became_peered":"2024-01-31T05:09:20.182376+0000","last_unstale":"2024-01-31T05:10:37.272295+0000","last_undegraded":"2024-01-31T05:10:37.272295+0000","last_fullsized":"2024-01-31T05:10:37.272295+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:55:52.354323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":142,"num_read_kb":142,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684677+0000","last_change":"2024-01-31T05:09:20.583592+0000","last_active":"2024-01-31T05:10:21.684677+0000","last_peered":"2024-01-31T05:10:21.684677+0000","last_clean":"2024-01-31T05:10:21.684677+0000","last_became_active":"2024-01-31T05:09:20.583247+0000","last_became_peered":"2024-01-31T05:09:20.583247+0000","last_unstale":"2024-01-31T05:10:21.684677+0000","last_undegraded":"2024-01-31T05:10:21.684677+0000","last_fullsized":"2024-01-31T05:10:21.684677+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:28:04.946620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681815+0000","last_change":"2024-01-31T05:09:20.188171+0000","last_active":"2024-01-31T05:10:21.681815+0000","last_peered":"2024-01-31T05:10:21.681815+0000","last_clean":"2024-01-31T05:10:21.681815+0000","last_became_active":"2024-01-31T05:09:20.187807+0000","last_became_peered":"2024-01-31T05:09:20.187807+0000","last_unstale":"2024-01-31T05:10:21.681815+0000","last_undegraded":"2024-01-31T05:10:21.681815+0000","last_fullsized":"2024-01-31T05:10:21.681815+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:53:22.765389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.680069+0000","last_change":"2024-01-31T05:09:20.589462+0000","last_active":"2024-01-31T05:10:21.680069+0000","last_peered":"2024-01-31T05:10:21.680069+0000","last_clean":"2024-01-31T05:10:21.680069+0000","last_became_active":"2024-01-31T05:09:20.589002+0000","last_became_peered":"2024-01-31T05:09:20.589002+0000","last_unstale":"2024-01-31T05:10:21.680069+0000","last_undegraded":"2024-01-31T05:10:21.680069+0000","last_fullsized":"2024-01-31T05:10:21.680069+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:41:35.918827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684998+0000","last_change":"2024-01-31T05:09:20.184963+0000","last_active":"2024-01-31T05:10:21.684998+0000","last_peered":"2024-01-31T05:10:21.684998+0000","last_clean":"2024-01-31T05:10:21.684998+0000","last_became_active":"2024-01-31T05:09:20.184590+0000","last_became_peered":"2024-01-31T05:09:20.184590+0000","last_unstale":"2024-01-31T05:10:21.684998+0000","last_undegraded":"2024-01-31T05:10:21.684998+0000","last_fullsized":"2024-01-31T05:10:21.684998+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:06:31.291846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684522+0000","last_change":"2024-01-31T05:09:20.589237+0000","last_active":"2024-01-31T05:10:21.684522+0000","last_peered":"2024-01-31T05:10:21.684522+0000","last_clean":"2024-01-31T05:10:21.684522+0000","last_became_active":"2024-01-31T05:09:20.588656+0000","last_became_peered":"2024-01-31T05:09:20.588656+0000","last_unstale":"2024-01-31T05:10:21.684522+0000","last_undegraded":"2024-01-31T05:10:21.684522+0000","last_fullsized":"2024-01-31T05:10:21.684522+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:02:02.025136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'29","reported_seq":197,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:37.272169+0000","last_change":"2024-01-31T05:09:20.182539+0000","last_active":"2024-01-31T05:10:37.272169+0000","last_peered":"2024-01-31T05:10:37.272169+0000","last_clean":"2024-01-31T05:10:37.272169+0000","last_became_active":"2024-01-31T05:09:20.182229+0000","last_became_peered":"2024-01-31T05:09:20.182229+0000","last_unstale":"2024-01-31T05:10:37.272169+0000","last_undegraded":"2024-01-31T05:10:37.272169+0000","last_fullsized":"2024-01-31T05:10:37.272169+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:56:21.974450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59464,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":149,"num_read_kb":132,"num_write":31,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.683080+0000","last_change":"2024-01-31T05:09:20.587838+0000","last_active":"2024-01-31T05:10:21.683080+0000","last_peered":"2024-01-31T05:10:21.683080+0000","last_clean":"2024-01-31T05:10:21.683080+0000","last_became_active":"2024-01-31T05:09:20.587523+0000","last_became_peered":"2024-01-31T05:09:20.587523+0000","last_unstale":"2024-01-31T05:10:21.683080+0000","last_undegraded":"2024-01-31T05:10:21.683080+0000","last_fullsized":"2024-01-31T05:10:21.683080+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:36:17.582890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.683191+0000","last_change":"2024-01-31T05:09:20.191935+0000","last_active":"2024-01-31T05:10:21.683191+0000","last_peered":"2024-01-31T05:10:21.683191+0000","last_clean":"2024-01-31T05:10:21.683191+0000","last_became_active":"2024-01-31T05:09:20.191614+0000","last_became_peered":"2024-01-31T05:09:20.191614+0000","last_unstale":"2024-01-31T05:10:21.683191+0000","last_undegraded":"2024-01-31T05:10:21.683191+0000","last_fullsized":"2024-01-31T05:10:21.683191+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:12:38.245944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.679434+0000","last_change":"2024-01-31T05:09:20.585705+0000","last_active":"2024-01-31T05:10:21.679434+0000","last_peered":"2024-01-31T05:10:21.679434+0000","last_clean":"2024-01-31T05:10:21.679434+0000","last_became_active":"2024-01-31T05:09:20.585413+0000","last_became_peered":"2024-01-31T05:09:20.585413+0000","last_unstale":"2024-01-31T05:10:21.679434+0000","last_undegraded":"2024-01-31T05:10:21.679434+0000","last_fullsized":"2024-01-31T05:10:21.679434+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:35:34.686300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684861+0000","last_change":"2024-01-31T05:09:20.191975+0000","last_active":"2024-01-31T05:10:21.684861+0000","last_peered":"2024-01-31T05:10:21.684861+0000","last_clean":"2024-01-31T05:10:21.684861+0000","last_became_active":"2024-01-31T05:09:20.191666+0000","last_became_peered":"2024-01-31T05:09:20.191666+0000","last_unstale":"2024-01-31T05:10:21.684861+0000","last_undegraded":"2024-01-31T05:10:21.684861+0000","last_fullsized":"2024-01-31T05:10:21.684861+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:00:01.162509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684093+0000","last_change":"2024-01-31T05:10:21.684093+0000","last_active":"2024-01-31T05:10:21.684093+0000","last_peered":"2024-01-31T05:10:21.684093+0000","last_clean":"2024-01-31T05:10:21.684093+0000","last_became_active":"2024-01-31T05:10:21.683777+0000","last_became_peered":"2024-01-31T05:10:21.683777+0000","last_unstale":"2024-01-31T05:10:21.684093+0000","last_undegraded":"2024-01-31T05:10:21.684093+0000","last_fullsized":"2024-01-31T05:10:21.684093+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:54:18.618017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'6","reported_seq":98,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:36.283612+0000","last_change":"2024-01-31T05:09:20.183752+0000","last_active":"2024-01-31T05:10:36.283612+0000","last_peered":"2024-01-31T05:10:36.283612+0000","last_clean":"2024-01-31T05:10:36.283612+0000","last_became_active":"2024-01-31T05:09:20.183421+0000","last_became_peered":"2024-01-31T05:09:20.183421+0000","last_unstale":"2024-01-31T05:10:36.283612+0000","last_undegraded":"2024-01-31T05:10:36.283612+0000","last_fullsized":"2024-01-31T05:10:36.283612+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:04:12.919266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681219+0000","last_change":"2024-01-31T05:09:20.593893+0000","last_active":"2024-01-31T05:10:21.681219+0000","last_peered":"2024-01-31T05:10:21.681219+0000","last_clean":"2024-01-31T05:10:21.681219+0000","last_became_active":"2024-01-31T05:09:20.593604+0000","last_became_peered":"2024-01-31T05:09:20.593604+0000","last_unstale":"2024-01-31T05:10:21.681219+0000","last_undegraded":"2024-01-31T05:10:21.681219+0000","last_fullsized":"2024-01-31T05:10:21.681219+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:50:31.534607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.696407+0000","last_change":"2024-01-31T05:10:21.696407+0000","last_active":"2024-01-31T05:10:21.696407+0000","last_peered":"2024-01-31T05:10:21.696407+0000","last_clean":"2024-01-31T05:10:21.696407+0000","last_became_active":"2024-01-31T05:10:21.684807+0000","last_became_peered":"2024-01-31T05:10:21.684807+0000","last_unstale":"2024-01-31T05:10:21.696407+0000","last_undegraded":"2024-01-31T05:10:21.696407+0000","last_fullsized":"2024-01-31T05:10:21.696407+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:21:51.260528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684725+0000","last_change":"2024-01-31T05:09:20.588049+0000","last_active":"2024-01-31T05:10:21.684725+0000","last_peered":"2024-01-31T05:10:21.684725+0000","last_clean":"2024-01-31T05:10:21.684725+0000","last_became_active":"2024-01-31T05:09:20.587542+0000","last_became_peered":"2024-01-31T05:09:20.587542+0000","last_unstale":"2024-01-31T05:10:21.684725+0000","last_undegraded":"2024-01-31T05:10:21.684725+0000","last_fullsized":"2024-01-31T05:10:21.684725+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:19:55.948269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.683712+0000","last_change":"2024-01-31T05:09:20.185328+0000","last_active":"2024-01-31T05:10:21.683712+0000","last_peered":"2024-01-31T05:10:21.683712+0000","last_clean":"2024-01-31T05:10:21.683712+0000","last_became_active":"2024-01-31T05:09:20.184551+0000","last_became_peered":"2024-01-31T05:09:20.184551+0000","last_unstale":"2024-01-31T05:10:21.683712+0000","last_undegraded":"2024-01-31T05:10:21.683712+0000","last_fullsized":"2024-01-31T05:10:21.683712+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:19:36.143101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681302+0000","last_change":"2024-01-31T05:09:20.586286+0000","last_active":"2024-01-31T05:10:21.681302+0000","last_peered":"2024-01-31T05:10:21.681302+0000","last_clean":"2024-01-31T05:10:21.681302+0000","last_became_active":"2024-01-31T05:09:20.586011+0000","last_became_peered":"2024-01-31T05:09:20.586011+0000","last_unstale":"2024-01-31T05:10:21.681302+0000","last_undegraded":"2024-01-31T05:10:21.681302+0000","last_fullsized":"2024-01-31T05:10:21.681302+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:21:23.064829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681935+0000","last_change":"2024-01-31T05:09:20.183083+0000","last_active":"2024-01-31T05:10:21.681935+0000","last_peered":"2024-01-31T05:10:21.681935+0000","last_clean":"2024-01-31T05:10:21.681935+0000","last_became_active":"2024-01-31T05:09:20.182742+0000","last_became_peered":"2024-01-31T05:09:20.182742+0000","last_unstale":"2024-01-31T05:10:21.681935+0000","last_undegraded":"2024-01-31T05:10:21.681935+0000","last_fullsized":"2024-01-31T05:10:21.681935+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:12:02.081688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'1","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681563+0000","last_change":"2024-01-31T05:09:20.591522+0000","last_active":"2024-01-31T05:10:21.681563+0000","last_peered":"2024-01-31T05:10:21.681563+0000","last_clean":"2024-01-31T05:10:21.681563+0000","last_became_active":"2024-01-31T05:09:20.591224+0000","last_became_peered":"2024-01-31T05:09:20.591224+0000","last_unstale":"2024-01-31T05:10:21.681563+0000","last_undegraded":"2024-01-31T05:10:21.681563+0000","last_fullsized":"2024-01-31T05:10:21.681563+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:24:17.153662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'5","reported_seq":94,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:35.269549+0000","last_change":"2024-01-31T05:09:20.186176+0000","last_active":"2024-01-31T05:10:35.269549+0000","last_peered":"2024-01-31T05:10:35.269549+0000","last_clean":"2024-01-31T05:10:35.269549+0000","last_became_active":"2024-01-31T05:09:20.185873+0000","last_became_peered":"2024-01-31T05:09:20.185873+0000","last_unstale":"2024-01-31T05:10:35.269549+0000","last_undegraded":"2024-01-31T05:10:35.269549+0000","last_fullsized":"2024-01-31T05:10:35.269549+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:55:12.689664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":70,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681969+0000","last_change":"2024-01-31T05:09:20.587556+0000","last_active":"2024-01-31T05:10:21.681969+0000","last_peered":"2024-01-31T05:10:21.681969+0000","last_clean":"2024-01-31T05:10:21.681969+0000","last_became_active":"2024-01-31T05:09:20.587275+0000","last_became_peered":"2024-01-31T05:09:20.587275+0000","last_unstale":"2024-01-31T05:10:21.681969+0000","last_undegraded":"2024-01-31T05:10:21.681969+0000","last_fullsized":"2024-01-31T05:10:21.681969+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:35:16.022422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.685648+0000","last_change":"2024-01-31T05:09:20.588044+0000","last_active":"2024-01-31T05:10:21.685648+0000","last_peered":"2024-01-31T05:10:21.685648+0000","last_clean":"2024-01-31T05:10:21.685648+0000","last_became_active":"2024-01-31T05:09:20.587526+0000","last_became_peered":"2024-01-31T05:09:20.587526+0000","last_unstale":"2024-01-31T05:10:21.685648+0000","last_undegraded":"2024-01-31T05:10:21.685648+0000","last_fullsized":"2024-01-31T05:10:21.685648+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:49:07.270009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":95,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:35.282012+0000","last_change":"2024-01-31T05:09:20.194791+0000","last_active":"2024-01-31T05:10:35.282012+0000","last_peered":"2024-01-31T05:10:35.282012+0000","last_clean":"2024-01-31T05:10:35.282012+0000","last_became_active":"2024-01-31T05:09:20.194454+0000","last_became_peered":"2024-01-31T05:09:20.194454+0000","last_unstale":"2024-01-31T05:10:35.282012+0000","last_undegraded":"2024-01-31T05:10:35.282012+0000","last_fullsized":"2024-01-31T05:10:35.282012+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:31:26.809960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":71,"num_read_kb":71,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684437+0000","last_change":"2024-01-31T05:09:20.585022+0000","last_active":"2024-01-31T05:10:21.684437+0000","last_peered":"2024-01-31T05:10:21.684437+0000","last_clean":"2024-01-31T05:10:21.684437+0000","last_became_active":"2024-01-31T05:09:20.584709+0000","last_became_peered":"2024-01-31T05:09:20.584709+0000","last_unstale":"2024-01-31T05:10:21.684437+0000","last_undegraded":"2024-01-31T05:10:21.684437+0000","last_fullsized":"2024-01-31T05:10:21.684437+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:10:45.616985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.688980+0000","last_change":"2024-01-31T05:09:20.183779+0000","last_active":"2024-01-31T05:10:21.688980+0000","last_peered":"2024-01-31T05:10:21.688980+0000","last_clean":"2024-01-31T05:10:21.688980+0000","last_became_active":"2024-01-31T05:09:20.183399+0000","last_became_peered":"2024-01-31T05:09:20.183399+0000","last_unstale":"2024-01-31T05:10:21.688980+0000","last_undegraded":"2024-01-31T05:10:21.688980+0000","last_fullsized":"2024-01-31T05:10:21.688980+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:48:43.831022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":345,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681317+0000","last_change":"2024-01-31T05:08:10.168270+0000","last_active":"2024-01-31T05:10:21.681317+0000","last_peered":"2024-01-31T05:10:21.681317+0000","last_clean":"2024-01-31T05:10:21.681317+0000","last_became_active":"2024-01-31T05:08:10.167743+0000","last_became_peered":"2024-01-31T05:08:10.167743+0000","last_unstale":"2024-01-31T05:10:21.681317+0000","last_undegraded":"2024-01-31T05:10:21.681317+0000","last_fullsized":"2024-01-31T05:10:21.681317+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:46.976985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:46.976985+0000","last_clean_scrub_stamp":"2024-01-31T05:04:46.976985+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:21:54.724227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.679480+0000","last_change":"2024-01-31T05:09:20.583135+0000","last_active":"2024-01-31T05:10:21.679480+0000","last_peered":"2024-01-31T05:10:21.679480+0000","last_clean":"2024-01-31T05:10:21.679480+0000","last_became_active":"2024-01-31T05:09:20.582850+0000","last_became_peered":"2024-01-31T05:09:20.582850+0000","last_unstale":"2024-01-31T05:10:21.679480+0000","last_undegraded":"2024-01-31T05:10:21.679480+0000","last_fullsized":"2024-01-31T05:10:21.679480+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:04:51.204561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681474+0000","last_change":"2024-01-31T05:09:20.188181+0000","last_active":"2024-01-31T05:10:21.681474+0000","last_peered":"2024-01-31T05:10:21.681474+0000","last_clean":"2024-01-31T05:10:21.681474+0000","last_became_active":"2024-01-31T05:09:20.187801+0000","last_became_peered":"2024-01-31T05:09:20.187801+0000","last_unstale":"2024-01-31T05:10:21.681474+0000","last_undegraded":"2024-01-31T05:10:21.681474+0000","last_fullsized":"2024-01-31T05:10:21.681474+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:27:05.269615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.683769+0000","last_change":"2024-01-31T05:09:20.186242+0000","last_active":"2024-01-31T05:10:21.683769+0000","last_peered":"2024-01-31T05:10:21.683769+0000","last_clean":"2024-01-31T05:10:21.683769+0000","last_became_active":"2024-01-31T05:09:20.185908+0000","last_became_peered":"2024-01-31T05:09:20.185908+0000","last_unstale":"2024-01-31T05:10:21.683769+0000","last_undegraded":"2024-01-31T05:10:21.683769+0000","last_fullsized":"2024-01-31T05:10:21.683769+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:33:40.859324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.679626+0000","last_change":"2024-01-31T05:09:20.590896+0000","last_active":"2024-01-31T05:10:21.679626+0000","last_peered":"2024-01-31T05:10:21.679626+0000","last_clean":"2024-01-31T05:10:21.679626+0000","last_became_active":"2024-01-31T05:09:20.590546+0000","last_became_peered":"2024-01-31T05:09:20.590546+0000","last_unstale":"2024-01-31T05:10:21.679626+0000","last_undegraded":"2024-01-31T05:10:21.679626+0000","last_fullsized":"2024-01-31T05:10:21.679626+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:39:05.969756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.682224+0000","last_change":"2024-01-31T05:09:20.185811+0000","last_active":"2024-01-31T05:10:21.682224+0000","last_peered":"2024-01-31T05:10:21.682224+0000","last_clean":"2024-01-31T05:10:21.682224+0000","last_became_active":"2024-01-31T05:09:20.185490+0000","last_became_peered":"2024-01-31T05:09:20.185490+0000","last_unstale":"2024-01-31T05:10:21.682224+0000","last_undegraded":"2024-01-31T05:10:21.682224+0000","last_fullsized":"2024-01-31T05:10:21.682224+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:16:25.446046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684943+0000","last_change":"2024-01-31T05:09:20.585298+0000","last_active":"2024-01-31T05:10:21.684943+0000","last_peered":"2024-01-31T05:10:21.684943+0000","last_clean":"2024-01-31T05:10:21.684943+0000","last_became_active":"2024-01-31T05:09:20.584256+0000","last_became_peered":"2024-01-31T05:09:20.584256+0000","last_unstale":"2024-01-31T05:10:21.684943+0000","last_undegraded":"2024-01-31T05:10:21.684943+0000","last_fullsized":"2024-01-31T05:10:21.684943+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:48:10.331714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.689153+0000","last_change":"2024-01-31T05:09:20.184960+0000","last_active":"2024-01-31T05:10:21.689153+0000","last_peered":"2024-01-31T05:10:21.689153+0000","last_clean":"2024-01-31T05:10:21.689153+0000","last_became_active":"2024-01-31T05:09:20.184599+0000","last_became_peered":"2024-01-31T05:09:20.184599+0000","last_unstale":"2024-01-31T05:10:21.689153+0000","last_undegraded":"2024-01-31T05:10:21.689153+0000","last_fullsized":"2024-01-31T05:10:21.689153+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:07:01.846976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.679983+0000","last_change":"2024-01-31T05:09:20.588597+0000","last_active":"2024-01-31T05:10:21.679983+0000","last_peered":"2024-01-31T05:10:21.679983+0000","last_clean":"2024-01-31T05:10:21.679983+0000","last_became_active":"2024-01-31T05:09:20.588326+0000","last_became_peered":"2024-01-31T05:09:20.588326+0000","last_unstale":"2024-01-31T05:10:21.679983+0000","last_undegraded":"2024-01-31T05:10:21.679983+0000","last_fullsized":"2024-01-31T05:10:21.679983+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:31:53.873261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684381+0000","last_change":"2024-01-31T05:09:20.186196+0000","last_active":"2024-01-31T05:10:21.684381+0000","last_peered":"2024-01-31T05:10:21.684381+0000","last_clean":"2024-01-31T05:10:21.684381+0000","last_became_active":"2024-01-31T05:09:20.185373+0000","last_became_peered":"2024-01-31T05:09:20.185373+0000","last_unstale":"2024-01-31T05:10:21.684381+0000","last_undegraded":"2024-01-31T05:10:21.684381+0000","last_fullsized":"2024-01-31T05:10:21.684381+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:13:07.826906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.683037+0000","last_change":"2024-01-31T05:09:20.589183+0000","last_active":"2024-01-31T05:10:21.683037+0000","last_peered":"2024-01-31T05:10:21.683037+0000","last_clean":"2024-01-31T05:10:21.683037+0000","last_became_active":"2024-01-31T05:09:20.588884+0000","last_became_peered":"2024-01-31T05:09:20.588884+0000","last_unstale":"2024-01-31T05:10:21.683037+0000","last_undegraded":"2024-01-31T05:10:21.683037+0000","last_fullsized":"2024-01-31T05:10:21.683037+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:23:49.878076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684293+0000","last_change":"2024-01-31T05:09:20.184849+0000","last_active":"2024-01-31T05:10:21.684293+0000","last_peered":"2024-01-31T05:10:21.684293+0000","last_clean":"2024-01-31T05:10:21.684293+0000","last_became_active":"2024-01-31T05:09:20.184491+0000","last_became_peered":"2024-01-31T05:09:20.184491+0000","last_unstale":"2024-01-31T05:10:21.684293+0000","last_undegraded":"2024-01-31T05:10:21.684293+0000","last_fullsized":"2024-01-31T05:10:21.684293+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:36:31.757646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681747+0000","last_change":"2024-01-31T05:09:20.585917+0000","last_active":"2024-01-31T05:10:21.681747+0000","last_peered":"2024-01-31T05:10:21.681747+0000","last_clean":"2024-01-31T05:10:21.681747+0000","last_became_active":"2024-01-31T05:09:20.585082+0000","last_became_peered":"2024-01-31T05:09:20.585082+0000","last_unstale":"2024-01-31T05:10:21.681747+0000","last_undegraded":"2024-01-31T05:10:21.681747+0000","last_fullsized":"2024-01-31T05:10:21.681747+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:30:17.670739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.699341+0000","last_change":"2024-01-31T05:10:21.699341+0000","last_active":"2024-01-31T05:10:21.699341+0000","last_peered":"2024-01-31T05:10:21.699341+0000","last_clean":"2024-01-31T05:10:21.699341+0000","last_became_active":"2024-01-31T05:10:21.684981+0000","last_became_peered":"2024-01-31T05:10:21.684981+0000","last_unstale":"2024-01-31T05:10:21.699341+0000","last_undegraded":"2024-01-31T05:10:21.699341+0000","last_fullsized":"2024-01-31T05:10:21.699341+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:36:33.975341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684488+0000","last_change":"2024-01-31T05:09:20.580332+0000","last_active":"2024-01-31T05:10:21.684488+0000","last_peered":"2024-01-31T05:10:21.684488+0000","last_clean":"2024-01-31T05:10:21.684488+0000","last_became_active":"2024-01-31T05:09:20.580014+0000","last_became_peered":"2024-01-31T05:09:20.580014+0000","last_unstale":"2024-01-31T05:10:21.684488+0000","last_undegraded":"2024-01-31T05:10:21.684488+0000","last_fullsized":"2024-01-31T05:10:21.684488+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:38:52.507575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.683162+0000","last_change":"2024-01-31T05:09:20.186065+0000","last_active":"2024-01-31T05:10:21.683162+0000","last_peered":"2024-01-31T05:10:21.683162+0000","last_clean":"2024-01-31T05:10:21.683162+0000","last_became_active":"2024-01-31T05:09:20.185798+0000","last_became_peered":"2024-01-31T05:09:20.185798+0000","last_unstale":"2024-01-31T05:10:21.683162+0000","last_undegraded":"2024-01-31T05:10:21.683162+0000","last_fullsized":"2024-01-31T05:10:21.683162+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:25:05.792886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.682118+0000","last_change":"2024-01-31T05:09:20.589746+0000","last_active":"2024-01-31T05:10:21.682118+0000","last_peered":"2024-01-31T05:10:21.682118+0000","last_clean":"2024-01-31T05:10:21.682118+0000","last_became_active":"2024-01-31T05:09:20.589452+0000","last_became_peered":"2024-01-31T05:09:20.589452+0000","last_unstale":"2024-01-31T05:10:21.682118+0000","last_undegraded":"2024-01-31T05:10:21.682118+0000","last_fullsized":"2024-01-31T05:10:21.682118+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:04:39.773280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'6","reported_seq":98,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:35.270284+0000","last_change":"2024-01-31T05:09:20.181920+0000","last_active":"2024-01-31T05:10:35.270284+0000","last_peered":"2024-01-31T05:10:35.270284+0000","last_clean":"2024-01-31T05:10:35.270284+0000","last_became_active":"2024-01-31T05:09:20.181603+0000","last_became_peered":"2024-01-31T05:09:20.181603+0000","last_unstale":"2024-01-31T05:10:35.270284+0000","last_undegraded":"2024-01-31T05:10:35.270284+0000","last_fullsized":"2024-01-31T05:10:35.270284+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:11:30.696322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1560,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":73,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681547+0000","last_change":"2024-01-31T05:09:20.592244+0000","last_active":"2024-01-31T05:10:21.681547+0000","last_peered":"2024-01-31T05:10:21.681547+0000","last_clean":"2024-01-31T05:10:21.681547+0000","last_became_active":"2024-01-31T05:09:20.591940+0000","last_became_peered":"2024-01-31T05:09:20.591940+0000","last_unstale":"2024-01-31T05:10:21.681547+0000","last_undegraded":"2024-01-31T05:10:21.681547+0000","last_fullsized":"2024-01-31T05:10:21.681547+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:16:02.284216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684890+0000","last_change":"2024-01-31T05:09:20.192018+0000","last_active":"2024-01-31T05:10:21.684890+0000","last_peered":"2024-01-31T05:10:21.684890+0000","last_clean":"2024-01-31T05:10:21.684890+0000","last_became_active":"2024-01-31T05:09:20.191721+0000","last_became_peered":"2024-01-31T05:09:20.191721+0000","last_unstale":"2024-01-31T05:10:21.684890+0000","last_undegraded":"2024-01-31T05:10:21.684890+0000","last_fullsized":"2024-01-31T05:10:21.684890+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:53:56.199730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"86'1","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681828+0000","last_change":"2024-01-31T05:09:20.593153+0000","last_active":"2024-01-31T05:10:21.681828+0000","last_peered":"2024-01-31T05:10:21.681828+0000","last_clean":"2024-01-31T05:10:21.681828+0000","last_became_active":"2024-01-31T05:09:20.592869+0000","last_became_peered":"2024-01-31T05:09:20.592869+0000","last_unstale":"2024-01-31T05:10:21.681828+0000","last_undegraded":"2024-01-31T05:10:21.681828+0000","last_fullsized":"2024-01-31T05:10:21.681828+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:35:42.234519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.679538+0000","last_change":"2024-01-31T05:09:20.191998+0000","last_active":"2024-01-31T05:10:21.679538+0000","last_peered":"2024-01-31T05:10:21.679538+0000","last_clean":"2024-01-31T05:10:21.679538+0000","last_became_active":"2024-01-31T05:09:20.191658+0000","last_became_peered":"2024-01-31T05:09:20.191658+0000","last_unstale":"2024-01-31T05:10:21.679538+0000","last_undegraded":"2024-01-31T05:10:21.679538+0000","last_fullsized":"2024-01-31T05:10:21.679538+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T17:06:39.916765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681969+0000","last_change":"2024-01-31T05:09:20.586822+0000","last_active":"2024-01-31T05:10:21.681969+0000","last_peered":"2024-01-31T05:10:21.681969+0000","last_clean":"2024-01-31T05:10:21.681969+0000","last_became_active":"2024-01-31T05:09:20.586523+0000","last_became_peered":"2024-01-31T05:09:20.586523+0000","last_unstale":"2024-01-31T05:10:21.681969+0000","last_undegraded":"2024-01-31T05:10:21.681969+0000","last_fullsized":"2024-01-31T05:10:21.681969+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:02:59.311443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681774+0000","last_change":"2024-01-31T05:09:20.586141+0000","last_active":"2024-01-31T05:10:21.681774+0000","last_peered":"2024-01-31T05:10:21.681774+0000","last_clean":"2024-01-31T05:10:21.681774+0000","last_became_active":"2024-01-31T05:09:20.585626+0000","last_became_peered":"2024-01-31T05:09:20.585626+0000","last_unstale":"2024-01-31T05:10:21.681774+0000","last_undegraded":"2024-01-31T05:10:21.681774+0000","last_fullsized":"2024-01-31T05:10:21.681774+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:39:18.023044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.683405+0000","last_change":"2024-01-31T05:09:20.588203+0000","last_active":"2024-01-31T05:10:21.683405+0000","last_peered":"2024-01-31T05:10:21.683405+0000","last_clean":"2024-01-31T05:10:21.683405+0000","last_became_active":"2024-01-31T05:09:20.586660+0000","last_became_peered":"2024-01-31T05:09:20.586660+0000","last_unstale":"2024-01-31T05:10:21.683405+0000","last_undegraded":"2024-01-31T05:10:21.683405+0000","last_fullsized":"2024-01-31T05:10:21.683405+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:27:41.249756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.683895+0000","last_change":"2024-01-31T05:09:20.591708+0000","last_active":"2024-01-31T05:10:21.683895+0000","last_peered":"2024-01-31T05:10:21.683895+0000","last_clean":"2024-01-31T05:10:21.683895+0000","last_became_active":"2024-01-31T05:09:20.590874+0000","last_became_peered":"2024-01-31T05:09:20.590874+0000","last_unstale":"2024-01-31T05:10:21.683895+0000","last_undegraded":"2024-01-31T05:10:21.683895+0000","last_fullsized":"2024-01-31T05:10:21.683895+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:13:30.221125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.680037+0000","last_change":"2024-01-31T05:09:20.587566+0000","last_active":"2024-01-31T05:10:21.680037+0000","last_peered":"2024-01-31T05:10:21.680037+0000","last_clean":"2024-01-31T05:10:21.680037+0000","last_became_active":"2024-01-31T05:09:20.587260+0000","last_became_peered":"2024-01-31T05:09:20.587260+0000","last_unstale":"2024-01-31T05:10:21.680037+0000","last_undegraded":"2024-01-31T05:10:21.680037+0000","last_fullsized":"2024-01-31T05:10:21.680037+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:32:46.030539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.679451+0000","last_change":"2024-01-31T05:09:20.587259+0000","last_active":"2024-01-31T05:10:21.679451+0000","last_peered":"2024-01-31T05:10:21.679451+0000","last_clean":"2024-01-31T05:10:21.679451+0000","last_became_active":"2024-01-31T05:09:20.586935+0000","last_became_peered":"2024-01-31T05:09:20.586935+0000","last_unstale":"2024-01-31T05:10:21.679451+0000","last_undegraded":"2024-01-31T05:10:21.679451+0000","last_fullsized":"2024-01-31T05:10:21.679451+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:28:23.217392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681333+0000","last_change":"2024-01-31T05:09:20.587213+0000","last_active":"2024-01-31T05:10:21.681333+0000","last_peered":"2024-01-31T05:10:21.681333+0000","last_clean":"2024-01-31T05:10:21.681333+0000","last_became_active":"2024-01-31T05:09:20.586918+0000","last_became_peered":"2024-01-31T05:09:20.586918+0000","last_unstale":"2024-01-31T05:10:21.681333+0000","last_undegraded":"2024-01-31T05:10:21.681333+0000","last_fullsized":"2024-01-31T05:10:21.681333+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:39:27.541560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.683938+0000","last_change":"2024-01-31T05:09:20.584532+0000","last_active":"2024-01-31T05:10:21.683938+0000","last_peered":"2024-01-31T05:10:21.683938+0000","last_clean":"2024-01-31T05:10:21.683938+0000","last_became_active":"2024-01-31T05:09:20.583512+0000","last_became_peered":"2024-01-31T05:09:20.583512+0000","last_unstale":"2024-01-31T05:10:21.683938+0000","last_undegraded":"2024-01-31T05:10:21.683938+0000","last_fullsized":"2024-01-31T05:10:21.683938+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:04:33.848498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684859+0000","last_change":"2024-01-31T05:09:20.587561+0000","last_active":"2024-01-31T05:10:21.684859+0000","last_peered":"2024-01-31T05:10:21.684859+0000","last_clean":"2024-01-31T05:10:21.684859+0000","last_became_active":"2024-01-31T05:09:20.587232+0000","last_became_peered":"2024-01-31T05:09:20.587232+0000","last_unstale":"2024-01-31T05:10:21.684859+0000","last_undegraded":"2024-01-31T05:10:21.684859+0000","last_fullsized":"2024-01-31T05:10:21.684859+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:17:01.913186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.685569+0000","last_change":"2024-01-31T05:09:20.581823+0000","last_active":"2024-01-31T05:10:21.685569+0000","last_peered":"2024-01-31T05:10:21.685569+0000","last_clean":"2024-01-31T05:10:21.685569+0000","last_became_active":"2024-01-31T05:09:20.581560+0000","last_became_peered":"2024-01-31T05:09:20.581560+0000","last_unstale":"2024-01-31T05:10:21.685569+0000","last_undegraded":"2024-01-31T05:10:21.685569+0000","last_fullsized":"2024-01-31T05:10:21.685569+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:48:50.057303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684214+0000","last_change":"2024-01-31T05:09:20.582477+0000","last_active":"2024-01-31T05:10:21.684214+0000","last_peered":"2024-01-31T05:10:21.684214+0000","last_clean":"2024-01-31T05:10:21.684214+0000","last_became_active":"2024-01-31T05:09:20.582051+0000","last_became_peered":"2024-01-31T05:09:20.582051+0000","last_unstale":"2024-01-31T05:10:21.684214+0000","last_undegraded":"2024-01-31T05:10:21.684214+0000","last_fullsized":"2024-01-31T05:10:21.684214+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:24:36.665707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684508+0000","last_change":"2024-01-31T05:09:20.587281+0000","last_active":"2024-01-31T05:10:21.684508+0000","last_peered":"2024-01-31T05:10:21.684508+0000","last_clean":"2024-01-31T05:10:21.684508+0000","last_became_active":"2024-01-31T05:09:20.586976+0000","last_became_peered":"2024-01-31T05:09:20.586976+0000","last_unstale":"2024-01-31T05:10:21.684508+0000","last_undegraded":"2024-01-31T05:10:21.684508+0000","last_fullsized":"2024-01-31T05:10:21.684508+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:33:59.065647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.679629+0000","last_change":"2024-01-31T05:09:20.585953+0000","last_active":"2024-01-31T05:10:21.679629+0000","last_peered":"2024-01-31T05:10:21.679629+0000","last_clean":"2024-01-31T05:10:21.679629+0000","last_became_active":"2024-01-31T05:09:20.585406+0000","last_became_peered":"2024-01-31T05:09:20.585406+0000","last_unstale":"2024-01-31T05:10:21.679629+0000","last_undegraded":"2024-01-31T05:10:21.679629+0000","last_fullsized":"2024-01-31T05:10:21.679629+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:14:24.622166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681454+0000","last_change":"2024-01-31T05:09:20.587073+0000","last_active":"2024-01-31T05:10:21.681454+0000","last_peered":"2024-01-31T05:10:21.681454+0000","last_clean":"2024-01-31T05:10:21.681454+0000","last_became_active":"2024-01-31T05:09:20.586753+0000","last_became_peered":"2024-01-31T05:09:20.586753+0000","last_unstale":"2024-01-31T05:10:21.681454+0000","last_undegraded":"2024-01-31T05:10:21.681454+0000","last_fullsized":"2024-01-31T05:10:21.681454+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:13:20.291390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67056,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":739,"num_read_kb":442,"num_write":231,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":201168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":203,"ondisk_log_size":203,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351005,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":970752,"data_stored":463487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:09:32 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.41799999999999998}]},{"osd":1,"last update":"Wed Jan 31 05:09:32 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.66800000000000004}]},{"osd":2,"last update":"Wed Jan 31 05:09:32 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.498}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":4,"last update":"Wed Jan 31 05:09:32 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.76900000000000002}]},{"osd":5,"last update":"Wed Jan 31 05:09:32 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.68400000000000005}]},{"osd":6,"last update":"Wed Jan 31 05:09:32 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.432},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.58999999999999997}]},{"osd":7,"last update":"Wed Jan 31 05:09:32 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.71899999999999997}]},{"osd":8,"last update":"Wed Jan 31 05:10:20 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.78200000000000003}]},{"osd":9,"last update":"Wed Jan 31 05:09:32 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.72999999999999998}]},{"osd":10,"last update":"Wed Jan 31 05:09:32 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.79400000000000004}]}]},{"osd":10,"up_from":73,"seq":313532612643,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36964,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708188,"statfs":{"total":95995035648,"available":95957184512,"internally_reserved":0,"allocated":1662976,"data_stored":1113868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":36174273},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:10:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.372}]},{"osd":1,"last update":"Wed Jan 31 05:10:11 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48599999999999999,"15min":0.48699999999999999},"min":{"1min":0.312,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.754,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.313},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.51000000000000001,"15min":0.51600000000000001},"min":{"1min":0.35799999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.77100000000000002,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.42799999999999999}]},{"osd":2,"last update":"Wed Jan 31 05:10:11 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59199999999999997,"15min":0.58699999999999997},"min":{"1min":0.42899999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.63300000000000001,"15min":0.63100000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.48399999999999999}]},{"osd":3,"last update":"Wed Jan 31 05:10:11 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.621,"15min":0.629},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.79500000000000004,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.65700000000000003,"15min":0.66200000000000003},"min":{"1min":0.46400000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.83099999999999996,"5min":1.115,"15min":1.115},"last":0.40500000000000003}]},{"osd":4,"last update":"Wed Jan 31 05:10:11 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55800000000000005,"15min":0.55600000000000005},"min":{"1min":0.41999999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.75900000000000001,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.34799999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.80300000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.29599999999999999}]},{"osd":5,"last update":"Wed Jan 31 05:10:11 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.66000000000000003,"15min":0.65400000000000003},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.65900000000000003,"15min":0.65300000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95699999999999996,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.54100000000000004}]},{"osd":6,"last update":"Wed Jan 31 05:10:11 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.71599999999999997,"15min":0.71999999999999997},"min":{"1min":0.46500000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.92200000000000004,"5min":1.022,"15min":1.022},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.72199999999999998,"15min":0.73199999999999998},"min":{"1min":0.51500000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.89000000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.44700000000000001}]},{"osd":7,"last update":"Wed Jan 31 05:09:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.57199999999999995}]},{"osd":8,"last update":"Wed Jan 31 05:10:11 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76200000000000001,"15min":0.76500000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78000000000000003,"15min":0.78200000000000003},"min":{"1min":0.57199999999999995,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0569999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.63400000000000001}]},{"osd":9,"last update":"Wed Jan 31 05:10:11 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.79500000000000004,"15min":0.80300000000000005},"min":{"1min":0.58199999999999996,"5min":0.44,"15min":0.44},"max":{"1min":0.90900000000000003,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.79700000000000004,"15min":0.80500000000000005},"min":{"1min":0.53700000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0169999999999999,"5min":1.452,"15min":1.452},"last":0.52200000000000002}]},{"osd":11,"last update":"Wed Jan 31 05:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.75,"15min":0.746},"min":{"1min":0.64500000000000002,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.90200000000000002,"5min":1.026,"15min":1.026},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77100000000000002,"15min":0.77000000000000002},"min":{"1min":0.61099999999999999,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.94199999999999995,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.61099999999999999}]}]},{"osd":9,"up_from":67,"seq":287762808871,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":462915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:09:44 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.42899999999999999,"15min":0.439},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.51700000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.375},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.54900000000000004,"15min":0.51500000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":7.8330000000000002,"5min":7.8330000000000002,"15min":7.8330000000000002},"last":0.40600000000000003}]},{"osd":1,"last update":"Wed Jan 31 05:09:44 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.61599999999999999,"15min":0.60499999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":2.661,"5min":2.661,"15min":2.661},"last":0.497},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.60599999999999998,"15min":0.61599999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76300000000000001,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.48799999999999999}]},{"osd":2,"last update":"Wed Jan 31 05:09:44 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.61699999999999999,"15min":0.60399999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":2.7810000000000001,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.61399999999999999,"15min":0.626},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.68999999999999995,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.61699999999999999}]},{"osd":3,"last update":"Wed Jan 31 05:09:44 2024","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":0.71399999999999997,"15min":0.60099999999999998},"min":{"1min":0.28299999999999997,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":19.687000000000001,"5min":19.687000000000001,"15min":19.687000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.59499999999999997,"15min":0.54500000000000004},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":10.478,"5min":10.478,"15min":10.478},"last":0.32900000000000001}]},{"osd":4,"last update":"Wed Jan 31 05:09:44 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.64800000000000002,"15min":0.65600000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.71099999999999997,"15min":0.66800000000000004},"min":{"1min":0.47499999999999998,"5min":0.434,"15min":0.434},"max":{"1min":8.2289999999999992,"5min":8.2289999999999992,"15min":8.2289999999999992},"last":0.51500000000000001}]},{"osd":5,"last update":"Wed Jan 31 05:09:44 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":0.755,"15min":0.70699999999999996},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":9.9339999999999993,"5min":9.9339999999999993,"15min":9.9339999999999993},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.71299999999999997,"15min":0.71499999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.8130000000000002,"5min":2.8130000000000002,"15min":2.8130000000000002},"last":0.70699999999999996}]},{"osd":6,"last update":"Wed Jan 31 05:09:44 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.63900000000000001,"15min":0.64500000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":3.141,"5min":3.141,"15min":3.141},"last":0.443},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71899999999999997,"15min":0.71999999999999997},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":2.9350000000000001,"5min":2.9350000000000001,"15min":2.9350000000000001},"last":0.52600000000000002}]},{"osd":7,"last update":"Wed Jan 31 05:09:44 2024","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":0.80400000000000005,"15min":0.76300000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":8.2639999999999993,"5min":8.2639999999999993,"15min":8.2639999999999993},"last":0.53900000000000003},{"interface":"front","average":{"1min":1.1279999999999999,"5min":0.84099999999999997,"15min":0.79300000000000004},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":10.438000000000001,"5min":10.438000000000001,"15min":10.438000000000001},"last":0.60199999999999998}]},{"osd":8,"last update":"Wed Jan 31 05:09:44 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.8889999999999998,"5min":2.8889999999999998,"15min":2.8889999999999998},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.494,"5min":0.93600000000000005,"15min":0.84299999999999997},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":17.093,"5min":17.093,"15min":17.093},"last":0.68100000000000005}]},{"osd":10,"last update":"Wed Jan 31 05:10:11 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.76700000000000002,"15min":0.77300000000000002},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.107,"5min":1.111,"15min":1.111},"last":0.57999999999999996},{"interface":"front","average":{"1min":1.1399999999999999,"5min":0.84099999999999997,"15min":0.79100000000000004},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":9.5899999999999999,"5min":9.5899999999999999,"15min":9.5899999999999999},"last":0.55600000000000005}]}]},{"osd":8,"up_from":59,"seq":253403070508,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":974848,"data_stored":463181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.60799999999999998,"15min":0.58799999999999997},"min":{"1min":0.373,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":3.5819999999999999,"5min":3.5819999999999999,"15min":3.5819999999999999},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.57499999999999996,"15min":0.58599999999999997},"min":{"1min":0.38800000000000001,"5min":0.316,"15min":0.316},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.41099999999999998}]},{"osd":1,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.63700000000000001,"15min":0.61299999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":2.7679999999999998,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.65800000000000003,"15min":0.63400000000000001},"min":{"1min":0.47699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":3.2389999999999999,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.61899999999999999}]},{"osd":2,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.48999999999999999,"15min":0.48399999999999999},"min":{"1min":0.32600000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.314},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.52900000000000003,"15min":0.51300000000000001},"min":{"1min":0.41799999999999998,"5min":0.251,"15min":0.251},"max":{"1min":3.9729999999999999,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":0.45200000000000001}]},{"osd":3,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.57899999999999996,"15min":0.58499999999999996},"min":{"1min":0.34100000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.374},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.64500000000000002,"15min":0.65100000000000002},"min":{"1min":0.435,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":2.8050000000000002,"5min":2.8050000000000002,"15min":2.8050000000000002},"last":0.42999999999999999}]},{"osd":4,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.68899999999999995,"15min":0.65100000000000002},"min":{"1min":0.51800000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":5.1820000000000004,"5min":5.1820000000000004,"15min":5.1820000000000004},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.68600000000000005,"15min":0.66400000000000003},"min":{"1min":0.56200000000000006,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":3.0150000000000001,"5min":3.0150000000000001,"15min":3.0150000000000001},"last":0.56899999999999995}]},{"osd":5,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.627,"15min":0.61899999999999999},"min":{"1min":0.48899999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":3.617,"5min":3.617,"15min":3.617},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.61299999999999999,"15min":0.60499999999999998},"min":{"1min":0.35899999999999999,"5min":0.317,"15min":0.317},"max":{"1min":2.9540000000000002,"5min":2.9540000000000002,"15min":2.9540000000000002},"last":0.50900000000000001}]},{"osd":6,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.70999999999999996,"15min":0.72099999999999997},"min":{"1min":0.47399999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":2.3740000000000001,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.74299999999999999,"15min":0.73799999999999999},"min":{"1min":0.54800000000000004,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":3.2749999999999999,"5min":3.2749999999999999,"15min":3.2749999999999999},"last":0.58899999999999997}]},{"osd":7,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":0.76900000000000002,"15min":0.73899999999999999},"min":{"1min":0.64100000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":4.1970000000000001,"5min":4.1970000000000001,"15min":4.1970000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.94699999999999995,"15min":0.79900000000000004},"min":{"1min":0.67900000000000005,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":2.181,"5min":19.677,"15min":19.677},"last":0.57999999999999996}]},{"osd":9,"last update":"Wed Jan 31 05:09:43 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":1.482,"15min":1.6040000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.823,"5min":19.695,"15min":19.695},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.71699999999999997,"15min":0.69099999999999995},"min":{"1min":0.52100000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":3.306,"5min":3.306,"15min":3.306},"last":0.64600000000000002}]},{"osd":10,"last update":"Wed Jan 31 05:10:08 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.747,"15min":0.70499999999999996},"min":{"1min":0.55000000000000004,"5min":0.439,"15min":0.439},"max":{"1min":4.3760000000000003,"5min":4.3760000000000003,"15min":4.3760000000000003},"last":0.63600000000000001},{"interface":"front","average":{"1min":1.1499999999999999,"5min":0.81100000000000005,"15min":0.755},"min":{"1min":0.56499999999999995,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":6.875,"5min":6.875,"15min":6.875},"last":0.627}]},{"osd":11,"last update":"Wed Jan 31 05:10:21 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.65600000000000003}]}]},{"osd":7,"up_from":51,"seq":219043332145,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28564,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716588,"statfs":{"total":95995035648,"available":95965786112,"internally_reserved":0,"allocated":1581056,"data_stored":1056200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:08:52 2024","interfaces":[{"interface":"back","average":{"1min":1.669,"5min":0.75600000000000001,"15min":0.60399999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":19.462,"5min":19.462,"15min":19.462},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.52900000000000003,"15min":0.51900000000000002},"min":{"1min":0.40899999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.45500000000000002}]},{"osd":1,"last update":"Wed Jan 31 05:09:54 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.42099999999999999,"15min":0.41299999999999998},"min":{"1min":0.30499999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.64700000000000002,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.377},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.45000000000000001,"15min":0.442},"min":{"1min":0.312,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.68899999999999995,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.40500000000000003}]},{"osd":2,"last update":"Wed Jan 31 05:09:54 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.59199999999999997,"15min":0.58499999999999996},"min":{"1min":0.35099999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.77300000000000002,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.501},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.60299999999999998,"15min":0.60199999999999998},"min":{"1min":0.35899999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.73699999999999999,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.48799999999999999}]},{"osd":3,"last update":"Wed Jan 31 05:09:54 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.56000000000000005,"15min":0.55300000000000005},"min":{"1min":0.40899999999999997,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.434},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57999999999999996,"15min":0.57699999999999996},"min":{"1min":0.40300000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.52700000000000002}]},{"osd":4,"last update":"Wed Jan 31 05:09:54 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.48799999999999999,"15min":0.47999999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.73199999999999998,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.35499999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.55200000000000005}]},{"osd":5,"last update":"Wed Jan 31 05:09:54 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.63400000000000001,"15min":0.627},"min":{"1min":0.44800000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.80000000000000004,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.64700000000000002,"15min":0.64300000000000002},"min":{"1min":0.439,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.85299999999999998,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.57799999999999996}]},{"osd":6,"last update":"Wed Jan 31 05:09:54 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63900000000000001,"15min":0.63100000000000001},"min":{"1min":0.46400000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.80000000000000004,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.88700000000000001,"15min":0.73199999999999998},"min":{"1min":0.48099999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.95799999999999996,"5min":19.425000000000001,"15min":19.425000000000001},"last":0.60599999999999998}]},{"osd":8,"last update":"Wed Jan 31 05:10:21 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.68799999999999994,"15min":0.68200000000000005},"min":{"1min":0.61799999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.85099999999999998,"5min":0.875,"15min":0.875},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.70799999999999996,"15min":0.71199999999999997},"min":{"1min":0.56899999999999995,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.85899999999999999,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.624}]},{"osd":9,"last update":"Wed Jan 31 05:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.71299999999999997,"15min":0.71399999999999997},"min":{"1min":0.51100000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.89700000000000002,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.69799999999999995,"15min":0.69499999999999995},"min":{"1min":0.57999999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.89400000000000002,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.69299999999999995}]},{"osd":10,"last update":"Wed Jan 31 05:10:13 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71399999999999997,"15min":0.71299999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.751},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.55100000000000005,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.88400000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.64300000000000002}]},{"osd":11,"last update":"Wed Jan 31 05:10:21 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.80000000000000004}]}]},{"osd":6,"up_from":46,"seq":197568495670,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":462632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:10:34 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.378,"15min":0.37},"min":{"1min":0.28100000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.53400000000000003,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.40600000000000003,"15min":0.40799999999999997},"min":{"1min":0.28499999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.33700000000000002}]},{"osd":1,"last update":"Wed Jan 31 05:10:34 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.54700000000000004,"15min":0.53900000000000003},"min":{"1min":0.40899999999999997,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56200000000000006,"15min":0.55400000000000005},"min":{"1min":0.42699999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.83599999999999997,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.377}]},{"osd":2,"last update":"Wed Jan 31 05:10:34 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.55400000000000005,"15min":0.55200000000000005},"min":{"1min":0.39000000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.77600000000000002,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.55200000000000005,"15min":0.54600000000000004},"min":{"1min":0.372,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73599999999999999,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":19.234000000000002}]},{"osd":3,"last update":"Wed Jan 31 05:10:34 2024","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.437,"15min":0.44700000000000001},"min":{"1min":0.30199999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.56100000000000005,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.47499999999999998,"15min":0.47999999999999998},"min":{"1min":0.316,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.61199999999999999,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.40899999999999997}]},{"osd":4,"last update":"Wed Jan 31 05:10:34 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.58499999999999996,"15min":0.59099999999999997},"min":{"1min":0.443,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58499999999999996,"15min":0.57599999999999996},"min":{"1min":0.41099999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.86199999999999999,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.44900000000000001}]},{"osd":5,"last update":"Wed Jan 31 05:10:34 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.44,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.70299999999999996,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.495},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.61399999999999999,"15min":0.63},"min":{"1min":0.42599999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.82099999999999995,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.60599999999999998}]},{"osd":7,"last update":"Wed Jan 31 05:09:56 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.71999999999999997,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.64800000000000002,"15min":0.64900000000000002},"min":{"1min":0.48199999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.71699999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.52400000000000002}]},{"osd":8,"last update":"Wed Jan 31 05:10:17 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.67100000000000004,"15min":0.68700000000000006},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81399999999999995,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.747,"15min":0.79400000000000004},"min":{"1min":0.48599999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.80200000000000005,"5min":3.3130000000000002,"15min":3.3130000000000002},"last":0.53400000000000003}]},{"osd":9,"last update":"Wed Jan 31 05:09:45 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.68100000000000005,"15min":0.70199999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82099999999999995,"5min":1,"15min":1},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.65700000000000003,"15min":0.67400000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.48399999999999999}]},{"osd":10,"last update":"Wed Jan 31 05:10:10 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.75900000000000001,"15min":0.77400000000000002},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.83899999999999997,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.74399999999999999,"15min":0.753},"min":{"1min":0.58299999999999996,"5min":0.501,"15min":0.501},"max":{"1min":0.878,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.55700000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32192,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712960,"statfs":{"total":95995035648,"available":95962071040,"internally_reserved":0,"allocated":1032192,"data_stored":523009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:10:34 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51800000000000002,"15min":0.49399999999999999},"min":{"1min":0.36199999999999999,"5min":0.29999999999999999,"15min":0.29399999999999998},"max":{"1min":0.76600000000000001,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.55100000000000005,"15min":0.51700000000000002},"min":{"1min":0.39200000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.84399999999999997,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.51700000000000002}]},{"osd":2,"last update":"Wed Jan 31 05:09:56 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.56899999999999995,"15min":0.52400000000000002},"min":{"1min":0.43099999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.55100000000000005,"15min":0.50900000000000001},"min":{"1min":0.44400000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.42199999999999999}]},{"osd":3,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.52100000000000002,"15min":0.49399999999999999},"min":{"1min":0.40899999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.56699999999999995,"15min":0.51200000000000001},"min":{"1min":0.496,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.91600000000000004,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.65000000000000002}]},{"osd":4,"last update":"Wed Jan 31 05:09:45 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.45300000000000001,"15min":0.437},"min":{"1min":0.29199999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.46700000000000003,"15min":0.44500000000000001},"min":{"1min":0.314,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.36299999999999999}]},{"osd":5,"last update":"Wed Jan 31 05:10:07 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.60299999999999998,"15min":0.55900000000000005},"min":{"1min":0.505,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.60899999999999999,"15min":0.56999999999999995},"min":{"1min":0.41199999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.57099999999999995}]},{"osd":6,"last update":"Wed Jan 31 05:10:34 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.59699999999999998,"15min":0.58499999999999996},"min":{"1min":0.48199999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83899999999999997,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.65000000000000002,"15min":0.61899999999999999},"min":{"1min":0.54100000000000004,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.98899999999999999,"5min":0.998,"15min":0.998},"last":0.55300000000000005}]},{"osd":7,"last update":"Wed Jan 31 05:09:56 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.60099999999999998,"15min":0.57999999999999996},"min":{"1min":0.35199999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.046,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.437},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.60099999999999998,"15min":0.59499999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.502}]},{"osd":8,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.69899999999999995,"15min":0.67300000000000004},"min":{"1min":0.51200000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.69199999999999995,"15min":0.66900000000000004},"min":{"1min":0.58999999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.59699999999999998}]},{"osd":9,"last update":"Wed Jan 31 05:09:45 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.74099999999999999,"15min":0.73899999999999999},"min":{"1min":0.54400000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69499999999999995,"15min":0.69299999999999995},"min":{"1min":0.48599999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.95599999999999996,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.622}]},{"osd":10,"last update":"Wed Jan 31 05:10:12 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.754,"15min":0.74399999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.75,"15min":0.74299999999999999},"min":{"1min":0.497,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.66600000000000004}]},{"osd":11,"last update":"Wed Jan 31 05:10:25 2024","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.69099999999999995}]}]},{"osd":0,"up_from":8,"seq":34359738452,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":464361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 31 05:10:33 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":0.62,"15min":0.56100000000000005},"min":{"1min":0.40500000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":9.5289999999999999,"5min":9.5289999999999999,"15min":9.5289999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54700000000000004,"15min":0.53300000000000003},"min":{"1min":0.38700000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.74399999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.61399999999999999}]},{"osd":2,"last update":"Wed Jan 31 05:10:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.55800000000000005,"15min":0.54700000000000004},"min":{"1min":0.36499999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76700000000000002,"5min":0.873,"15min":0.873},"last":0.70099999999999996},{"interface":"front","average":{"1min":1.0269999999999999,"5min":0.747,"15min":0.626},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":9.4990000000000006,"5min":9.4990000000000006,"15min":9.4990000000000006},"last":0.77200000000000002}]},{"osd":3,"last update":"Wed Jan 31 05:10:23 2024","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.44},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.41299999999999998}]},{"osd":4,"last update":"Wed Jan 31 05:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53700000000000003,"15min":0.52200000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.54900000000000004,"15min":0.51300000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.73299999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.58599999999999997}]},{"osd":5,"last update":"Wed Jan 31 05:10:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56399999999999995,"15min":0.54900000000000004},"min":{"1min":0.41199999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.75900000000000001,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.67100000000000004},{"interface":"front","average":{"1min":1.167,"5min":0.79900000000000004,"15min":0.64700000000000002},"min":{"1min":0.37,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":9.5489999999999995,"5min":9.5489999999999995,"15min":9.5489999999999995},"last":0.73399999999999999}]},{"osd":6,"last update":"Wed Jan 31 05:10:33 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.49399999999999999,"15min":0.51100000000000001},"min":{"1min":0.317,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.75700000000000001,"5min":0.878,"15min":0.878},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.503,"5min":0.51000000000000001,"15min":0.51400000000000001},"min":{"1min":0.308,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.46700000000000003}]},{"osd":7,"last update":"Wed Jan 31 05:08:59 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.627,"15min":0.622},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80900000000000005,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.64400000000000002,"15min":0.64200000000000002},"min":{"1min":0.47899999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.81699999999999995,"5min":0.874,"15min":0.874},"last":0.54600000000000004}]},{"osd":8,"last update":"Wed Jan 31 05:10:23 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.71899999999999997,"15min":0.67500000000000004},"min":{"1min":0.40000000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.133,"5min":9.2840000000000007,"15min":9.2840000000000007},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70199999999999996,"15min":0.71999999999999997},"min":{"1min":0.52500000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.85399999999999998,"5min":1.006,"15min":1.006},"last":0.749}]},{"osd":9,"last update":"Wed Jan 31 05:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.67300000000000004,"15min":0.69499999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.78600000000000003,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.66200000000000003,"15min":0.68500000000000005},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.57299999999999995}]},{"osd":10,"last update":"Wed Jan 31 05:10:13 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.65100000000000002,"15min":0.65700000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.78900000000000003,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.69799999999999995,"15min":0.70399999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.65100000000000002}]},{"osd":11,"last update":"Wed Jan 31 05:10:33 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.65100000000000002,"15min":0.64300000000000002},"min":{"1min":0.56100000000000005,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.79400000000000004,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71499999999999997,"15min":0.71399999999999997},"min":{"1min":0.57499999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.84599999999999997,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.71699999999999997}]}]},{"osd":2,"up_from":18,"seq":77309411402,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1052672,"data_stored":524009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:09:55 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.51700000000000002,"15min":0.47899999999999998},"min":{"1min":0.42999999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.52000000000000002,"15min":0.499},"min":{"1min":0.39600000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.79400000000000004,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.54000000000000004}]},{"osd":1,"last update":"Wed Jan 31 05:09:55 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.54000000000000004,"15min":0.51400000000000001},"min":{"1min":0.378,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.56299999999999994,"15min":0.52800000000000002},"min":{"1min":0.36699999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.56499999999999995}]},{"osd":3,"last update":"Wed Jan 31 05:10:22 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.57199999999999995,"15min":0.53000000000000003},"min":{"1min":0.48699999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57199999999999995,"15min":0.53800000000000003},"min":{"1min":0.41099999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.753,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.878}]},{"osd":4,"last update":"Wed Jan 31 05:10:22 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.59999999999999998}]},{"osd":5,"last update":"Wed Jan 31 05:10:02 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.44400000000000001,"15min":0.41499999999999998},"min":{"1min":0.32400000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.46200000000000002,"15min":0.441},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.89500000000000002}]},{"osd":6,"last update":"Wed Jan 31 05:10:34 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.61399999999999999,"15min":0.56200000000000006},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.89700000000000002,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.60299999999999998,"15min":0.57699999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.747}]},{"osd":7,"last update":"Wed Jan 31 05:08:55 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.77600000000000002,"15min":0.80300000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.77000000000000002,"5min":3.9449999999999998,"15min":3.9449999999999998},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.78600000000000003,"15min":0.80900000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.80600000000000005,"5min":4.1230000000000002,"15min":4.1230000000000002},"last":0.44}]},{"osd":8,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.58699999999999997,"15min":0.57499999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.63700000000000001,"15min":0.625},"min":{"1min":0.38100000000000001,"5min":0.37,"15min":0.37},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.78000000000000003}]},{"osd":9,"last update":"Wed Jan 31 05:09:47 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.47599999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90000000000000002,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.47399999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.80000000000000004}]},{"osd":10,"last update":"Wed Jan 31 05:10:09 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68999999999999995,"15min":0.69299999999999995},"min":{"1min":0.51400000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.879,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.71899999999999997,"15min":0.70599999999999996},"min":{"1min":0.57499999999999996,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.94999999999999996}]},{"osd":11,"last update":"Wed Jan 31 05:10:22 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.99199999999999999}]}]},{"osd":3,"up_from":25,"seq":107374182468,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":987136,"data_stored":462457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:10:25 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.36099999999999999,"15min":0.32300000000000001},"min":{"1min":0.25600000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.38700000000000001,"15min":0.34699999999999998},"min":{"1min":0.23899999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.30399999999999999}]},{"osd":1,"last update":"Wed Jan 31 05:10:25 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.54600000000000004,"15min":0.51200000000000001},"min":{"1min":0.42799999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.54000000000000004,"15min":0.50700000000000001},"min":{"1min":0.32600000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.373}]},{"osd":2,"last update":"Wed Jan 31 05:10:25 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.56999999999999995,"15min":0.51300000000000001},"min":{"1min":0.44,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.55200000000000005,"15min":0.51700000000000002},"min":{"1min":0.35599999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.53000000000000003}]},{"osd":4,"last update":"Wed Jan 31 05:09:46 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54800000000000004,"15min":0.52200000000000002},"min":{"1min":0.34799999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.57199999999999995,"15min":0.52000000000000002},"min":{"1min":0.37,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.45100000000000001}]},{"osd":5,"last update":"Wed Jan 31 05:10:10 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.42999999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60599999999999998,"15min":0.58499999999999996},"min":{"1min":0.46400000000000002,"5min":0.371,"15min":0.371},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.54500000000000004}]},{"osd":6,"last update":"Wed Jan 31 05:10:33 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.51400000000000001,"15min":0.47599999999999998},"min":{"1min":0.318,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":2.5600000000000001,"5min":2.5600000000000001,"15min":2.5600000000000001},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.51000000000000001,"15min":0.48599999999999999},"min":{"1min":0.34399999999999997,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.7210000000000001,"5min":2.7210000000000001,"15min":2.7210000000000001},"last":0.35699999999999998}]},{"osd":7,"last update":"Wed Jan 31 05:09:55 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67200000000000004,"15min":0.65400000000000003},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65800000000000003,"15min":0.64800000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.499}]},{"osd":8,"last update":"Wed Jan 31 05:08:16 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.68200000000000005}]},{"osd":9,"last update":"Wed Jan 31 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.72399999999999998,"15min":0.72999999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.0630000000000002,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66200000000000003,"15min":0.66400000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":2.2919999999999998,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.46600000000000003}]},{"osd":10,"last update":"Wed Jan 31 05:10:10 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.71899999999999997,"15min":0.72799999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.79000000000000004,"15min":0.80100000000000005},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.60799999999999998}]},{"osd":11,"last update":"Wed Jan 31 05:10:25 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.55700000000000005}]}]},{"osd":4,"up_from":33,"seq":141733920832,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":970752,"data_stored":462883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.502,"15min":0.497},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.51900000000000002,"15min":0.51600000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.51300000000000001}]},{"osd":1,"last update":"Wed Jan 31 05:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.375,"15min":0.34499999999999997},"min":{"1min":0.311,"5min":0.245,"15min":0.245},"max":{"1min":0.67400000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.40000000000000002,"15min":0.376},"min":{"1min":0.28299999999999997,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.64000000000000001,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.49199999999999999}]},{"osd":2,"last update":"Wed Jan 31 05:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.56100000000000005,"15min":0.53900000000000003},"min":{"1min":0.46400000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.79700000000000004,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.58199999999999996,"15min":0.53700000000000003},"min":{"1min":0.498,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.89100000000000001}]},{"osd":3,"last update":"Wed Jan 31 05:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.56799999999999995,"15min":0.54100000000000004},"min":{"1min":0.40799999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.77400000000000002,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.54700000000000004,"15min":0.54100000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86199999999999999,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.52500000000000002}]},{"osd":5,"last update":"Wed Jan 31 05:10:04 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.57299999999999995,"15min":0.54100000000000004},"min":{"1min":0.42599999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.86199999999999999,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.59299999999999997,"15min":0.55000000000000004},"min":{"1min":0.48299999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.83299999999999996,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.65400000000000003}]},{"osd":6,"last update":"Wed Jan 31 05:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.60499999999999998,"15min":0.58299999999999996},"min":{"1min":0.44800000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.79400000000000004,"5min":0.87,"15min":0.87},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.59899999999999998,"15min":0.58699999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.85799999999999998,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.60899999999999999}]},{"osd":7,"last update":"Wed Jan 31 05:09:52 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.56599999999999995,"15min":0.54400000000000004},"min":{"1min":0.39300000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.85599999999999998,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.40799999999999997,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.80900000000000005,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.57399999999999995}]},{"osd":8,"last update":"Wed Jan 31 05:10:23 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.68000000000000005,"15min":0.67200000000000004},"min":{"1min":0.48599999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.753},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.68400000000000005,"15min":0.66900000000000004},"min":{"1min":0.495,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89300000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.79800000000000004}]},{"osd":9,"last update":"Wed Jan 31 05:09:45 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71299999999999997,"15min":0.71099999999999997},"min":{"1min":0.53400000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.71399999999999997,"15min":0.70699999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.78300000000000003}]},{"osd":10,"last update":"Wed Jan 31 05:10:11 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.745,"15min":0.74199999999999999},"min":{"1min":0.55900000000000005,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.76500000000000001,"15min":0.76600000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.76900000000000002}]},{"osd":11,"last update":"Wed Jan 31 05:10:23 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.871},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.82699999999999996}]}]},{"osd":5,"up_from":38,"seq":163208757307,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32736,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712416,"statfs":{"total":95995035648,"available":95961513984,"internally_reserved":0,"allocated":1593344,"data_stored":1055488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:10:07 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.51100000000000001,"15min":0.47499999999999998},"min":{"1min":0.31,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.746,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.502},"min":{"1min":0.35199999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.749,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.46999999999999997}]},{"osd":1,"last update":"Wed Jan 31 05:10:07 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.55100000000000005,"15min":0.52700000000000002},"min":{"1min":0.38,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56599999999999995,"15min":0.55200000000000005},"min":{"1min":0.42199999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.77800000000000002,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.40500000000000003}]},{"osd":2,"last update":"Wed Jan 31 05:10:07 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.41499999999999998,"15min":0.39700000000000002},"min":{"1min":0.30099999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.628,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.437,"5min":0.41999999999999998,"15min":0.41599999999999998},"min":{"1min":0.28399999999999997,"5min":0.247,"15min":0.247},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.32000000000000001}]},{"osd":3,"last update":"Wed Jan 31 05:10:07 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56100000000000005,"15min":0.53100000000000003},"min":{"1min":0.35699999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.81000000000000005,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56100000000000005,"15min":0.53600000000000003},"min":{"1min":0.46100000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.77800000000000002,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.44500000000000001}]},{"osd":4,"last update":"Wed Jan 31 05:10:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.61799999999999999,"15min":0.60099999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.82199999999999995,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.496},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.63100000000000001,"15min":0.60899999999999999},"min":{"1min":0.48399999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.89300000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.57199999999999995}]},{"osd":6,"last update":"Wed Jan 31 05:10:32 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59399999999999997,"15min":0.57999999999999996},"min":{"1min":0.38700000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.82499999999999996,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60399999999999998,"15min":0.59299999999999997},"min":{"1min":0.437,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.75800000000000001,"5min":0.873,"15min":0.873},"last":0.53300000000000003}]},{"osd":7,"last update":"Wed Jan 31 05:09:53 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.62,"15min":0.59799999999999998},"min":{"1min":0.47299999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.65700000000000003,"15min":0.64300000000000002},"min":{"1min":0.54500000000000004,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.80900000000000005,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.55800000000000005}]},{"osd":8,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.36599999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.77500000000000002,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58199999999999996,"15min":0.58399999999999996},"min":{"1min":0.39600000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.79500000000000004,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.372}]},{"osd":9,"last update":"Wed Jan 31 05:09:45 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.68500000000000005,"15min":0.68200000000000005},"min":{"1min":0.47399999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.91600000000000004,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68500000000000005,"15min":0.68300000000000005},"min":{"1min":0.47399999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.48499999999999999}]},{"osd":10,"last update":"Wed Jan 31 05:10:14 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.69099999999999995,"15min":0.68300000000000005},"min":{"1min":0.56799999999999995,"5min":0.497,"15min":0.497},"max":{"1min":0.92100000000000004,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.72699999999999998,"15min":0.71899999999999997},"min":{"1min":0.60499999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.94099999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.57799999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":61216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":61590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-31T05:10:40.152 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph pg dump --format=json 2024-01-31T05:10:40.394 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:10:40.779 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:40 smithi099 ceph-mon[31615]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-31T05:10:41.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:40 smithi181 ceph-mon[36434]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-31T05:10:41.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:40 smithi179 ceph-mon[35652]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-31T05:10:41.932 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:41 smithi099 ceph-mon[31615]: pgmap v328: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-01-31T05:10:42.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:41 smithi181 ceph-mon[36434]: pgmap v328: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-01-31T05:10:42.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:41 smithi179 ceph-mon[35652]: pgmap v328: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-01-31T05:10:42.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.137+0000 7fd0a50e9700 1 -- 172.21.15.99:0/3480526957 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0a0101830 msgr2=0x7fd0a0101cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:42.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.137+0000 7fd0a50e9700 1 --2- 172.21.15.99:0/3480526957 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0a0101830 0x7fd0a0101cb0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd0940099c0 tx=0x7fd094009cd0 comp rx=0 tx=0).stop 2024-01-31T05:10:42.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.138+0000 7fd0a50e9700 1 -- 172.21.15.99:0/3480526957 shutdown_connections 2024-01-31T05:10:42.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.138+0000 7fd0a50e9700 1 --2- 172.21.15.99:0/3480526957 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0a01021f0 0x7fd0a010e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:42.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.138+0000 7fd0a50e9700 1 --2- 172.21.15.99:0/3480526957 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd0a0106650 0x7fd0a0106a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:42.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.138+0000 7fd0a50e9700 1 --2- 172.21.15.99:0/3480526957 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0a0101830 0x7fd0a0101cb0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:42.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.138+0000 7fd0a50e9700 1 -- 172.21.15.99:0/3480526957 >> 172.21.15.99:0/3480526957 conn(0x7fd0a0078910 msgr2=0x7fd0a0078d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:42.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.138+0000 7fd0a50e9700 1 -- 172.21.15.99:0/3480526957 shutdown_connections 2024-01-31T05:10:42.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.138+0000 7fd0a50e9700 1 -- 172.21.15.99:0/3480526957 wait complete. 2024-01-31T05:10:42.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.138+0000 7fd0a50e9700 1 Processor -- start 2024-01-31T05:10:42.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.139+0000 7fd0a50e9700 1 -- start start 2024-01-31T05:10:42.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.139+0000 7fd0a50e9700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0a0101830 0x7fd0a0073ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:42.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.139+0000 7fd0a50e9700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd0a01021f0 0x7fd0a0074020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:42.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.139+0000 7fd0a50e9700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0a0106650 0x7fd0a0074560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:42.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.139+0000 7fd0a50e9700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a01a6060 con 0x7fd0a0106650 2024-01-31T05:10:42.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.139+0000 7fd0a50e9700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a01a61d0 con 0x7fd0a0101830 2024-01-31T05:10:42.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.139+0000 7fd0a50e9700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a01a6390 con 0x7fd0a01021f0 2024-01-31T05:10:42.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.139+0000 7fd09f59e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0a0106650 0x7fd0a0074560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:42.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.139+0000 7fd09f59e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0a0106650 0x7fd0a0074560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40874/0 (socket says 172.21.15.99:40874) 2024-01-31T05:10:42.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.139+0000 7fd09f59e700 1 -- 172.21.15.99:0/946664519 learned_addr learned my addr 172.21.15.99:0/946664519 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:42.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.139+0000 7fd09ed9d700 1 --2- 172.21.15.99:0/946664519 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0a0101830 0x7fd0a0073ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:42.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.139+0000 7fd09e59c700 1 --2- 172.21.15.99:0/946664519 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd0a01021f0 0x7fd0a0074020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:42.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.139+0000 7fd09f59e700 1 -- 172.21.15.99:0/946664519 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd0a01021f0 msgr2=0x7fd0a0074020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:42.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.139+0000 7fd09f59e700 1 --2- 172.21.15.99:0/946664519 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd0a01021f0 0x7fd0a0074020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:42.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.139+0000 7fd09f59e700 1 -- 172.21.15.99:0/946664519 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0a0101830 msgr2=0x7fd0a0073ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:42.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.139+0000 7fd09f59e700 1 --2- 172.21.15.99:0/946664519 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0a0101830 0x7fd0a0073ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:42.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.139+0000 7fd09f59e700 1 -- 172.21.15.99:0/946664519 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0940095f0 con 0x7fd0a0106650 2024-01-31T05:10:42.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.139+0000 7fd09f59e700 1 --2- 172.21.15.99:0/946664519 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0a0106650 0x7fd0a0074560 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd09800b970 tx=0x7fd09800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:42.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.140+0000 7fd087fff700 1 -- 172.21.15.99:0/946664519 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09800d860 con 0x7fd0a0106650 2024-01-31T05:10:42.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.140+0000 7fd087fff700 1 -- 172.21.15.99:0/946664519 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd09800de80 con 0x7fd0a0106650 2024-01-31T05:10:42.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.140+0000 7fd0a50e9700 1 -- 172.21.15.99:0/946664519 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0a01a6670 con 0x7fd0a0106650 2024-01-31T05:10:42.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.140+0000 7fd087fff700 1 -- 172.21.15.99:0/946664519 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd098017400 con 0x7fd0a0106650 2024-01-31T05:10:42.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.140+0000 7fd0a50e9700 1 -- 172.21.15.99:0/946664519 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a01a6af0 con 0x7fd0a0106650 2024-01-31T05:10:42.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.141+0000 7fd0a50e9700 1 -- 172.21.15.99:0/946664519 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0a0109d10 con 0x7fd0a0106650 2024-01-31T05:10:42.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.142+0000 7fd087fff700 1 -- 172.21.15.99:0/946664519 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7fd09800e630 con 0x7fd0a0106650 2024-01-31T05:10:42.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.142+0000 7fd087fff700 1 --2- 172.21.15.99:0/946664519 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd0880a1400 0x7fd0880a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:42.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.143+0000 7fd09ed9d700 1 --2- 172.21.15.99:0/946664519 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd0880a1400 0x7fd0880a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:42.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.143+0000 7fd087fff700 1 -- 172.21.15.99:0/946664519 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fd098006e40 con 0x7fd0a0106650 2024-01-31T05:10:42.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.143+0000 7fd09ed9d700 1 --2- 172.21.15.99:0/946664519 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd0880a1400 0x7fd0880a38c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd090005950 tx=0x7fd09000a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:42.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.146+0000 7fd087fff700 1 -- 172.21.15.99:0/946664519 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fd098095fb0 con 0x7fd0a0106650 2024-01-31T05:10:42.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.339+0000 7fd0a50e9700 1 -- 172.21.15.99:0/946664519 --> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd0a0075080 con 0x7fd0880a1400 2024-01-31T05:10:42.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.349+0000 7fd087fff700 1 -- 172.21.15.99:0/946664519 <== mgr.14152 v2:172.21.15.99:6800/3925720924 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344564 (secure 0 0 0) 0x7fd0a0075080 con 0x7fd0880a1400 2024-01-31T05:10:42.353 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:10:42.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.352+0000 7fd0a50e9700 1 -- 172.21.15.99:0/946664519 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd0880a1400 msgr2=0x7fd0880a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:42.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.352+0000 7fd0a50e9700 1 --2- 172.21.15.99:0/946664519 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd0880a1400 0x7fd0880a38c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd090005950 tx=0x7fd09000a300 comp rx=0 tx=0).stop 2024-01-31T05:10:42.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.352+0000 7fd0a50e9700 1 -- 172.21.15.99:0/946664519 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0a0106650 msgr2=0x7fd0a0074560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:42.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.352+0000 7fd0a50e9700 1 --2- 172.21.15.99:0/946664519 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0a0106650 0x7fd0a0074560 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd09800b970 tx=0x7fd09800bc80 comp rx=0 tx=0).stop 2024-01-31T05:10:42.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.352+0000 7fd0a50e9700 1 -- 172.21.15.99:0/946664519 shutdown_connections 2024-01-31T05:10:42.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.352+0000 7fd0a50e9700 1 --2- 172.21.15.99:0/946664519 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0a0106650 0x7fd0a0074560 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:42.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.352+0000 7fd0a50e9700 1 --2- 172.21.15.99:0/946664519 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd0880a1400 0x7fd0880a38c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:42.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.352+0000 7fd0a50e9700 1 --2- 172.21.15.99:0/946664519 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0a0101830 0x7fd0a0073ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:42.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.352+0000 7fd0a50e9700 1 --2- 172.21.15.99:0/946664519 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd0a01021f0 0x7fd0a0074020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:42.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.352+0000 7fd0a50e9700 1 -- 172.21.15.99:0/946664519 >> 172.21.15.99:0/946664519 conn(0x7fd0a0078910 msgr2=0x7fd0a00ff920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:42.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.353+0000 7fd0a50e9700 1 -- 172.21.15.99:0/946664519 shutdown_connections 2024-01-31T05:10:42.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:42.353+0000 7fd0a50e9700 1 -- 172.21.15.99:0/946664519 wait complete. 2024-01-31T05:10:42.356 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-01-31T05:10:43.037 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":328,"stamp":"2024-01-31T05:10:40.612002+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657658,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":865,"num_read_kb":551,"num_write":414,"num_write_kb":3070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":1180848,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":342,"ondisk_log_size":342,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":366844,"kb_used_data":13452,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124574980,"statfs":{"total":1151940427776,"available":1151564779520,"internally_reserved":0,"allocated":13774848,"data_stored":7514490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":50,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002951"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681428+0000","last_change":"2024-01-31T05:09:20.582274+0000","last_active":"2024-01-31T05:10:21.681428+0000","last_peered":"2024-01-31T05:10:21.681428+0000","last_clean":"2024-01-31T05:10:21.681428+0000","last_became_active":"2024-01-31T05:09:20.581511+0000","last_became_peered":"2024-01-31T05:09:20.581511+0000","last_unstale":"2024-01-31T05:10:21.681428+0000","last_undegraded":"2024-01-31T05:10:21.681428+0000","last_fullsized":"2024-01-31T05:10:21.681428+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:59:10.674456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.679950+0000","last_change":"2024-01-31T05:09:20.581752+0000","last_active":"2024-01-31T05:10:21.679950+0000","last_peered":"2024-01-31T05:10:21.679950+0000","last_clean":"2024-01-31T05:10:21.679950+0000","last_became_active":"2024-01-31T05:09:20.581035+0000","last_became_peered":"2024-01-31T05:09:20.581035+0000","last_unstale":"2024-01-31T05:10:21.679950+0000","last_undegraded":"2024-01-31T05:10:21.679950+0000","last_fullsized":"2024-01-31T05:10:21.679950+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:03:16.999371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.679907+0000","last_change":"2024-01-31T05:09:20.588191+0000","last_active":"2024-01-31T05:10:21.679907+0000","last_peered":"2024-01-31T05:10:21.679907+0000","last_clean":"2024-01-31T05:10:21.679907+0000","last_became_active":"2024-01-31T05:09:20.587466+0000","last_became_peered":"2024-01-31T05:09:20.587466+0000","last_unstale":"2024-01-31T05:10:21.679907+0000","last_undegraded":"2024-01-31T05:10:21.679907+0000","last_fullsized":"2024-01-31T05:10:21.679907+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:22:29.037408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.688961+0000","last_change":"2024-01-31T05:09:20.589377+0000","last_active":"2024-01-31T05:10:21.688961+0000","last_peered":"2024-01-31T05:10:21.688961+0000","last_clean":"2024-01-31T05:10:21.688961+0000","last_became_active":"2024-01-31T05:09:20.589065+0000","last_became_peered":"2024-01-31T05:09:20.589065+0000","last_unstale":"2024-01-31T05:10:21.688961+0000","last_undegraded":"2024-01-31T05:10:21.688961+0000","last_fullsized":"2024-01-31T05:10:21.688961+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:57:11.612654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.683051+0000","last_change":"2024-01-31T05:09:20.578919+0000","last_active":"2024-01-31T05:10:21.683051+0000","last_peered":"2024-01-31T05:10:21.683051+0000","last_clean":"2024-01-31T05:10:21.683051+0000","last_became_active":"2024-01-31T05:09:20.578594+0000","last_became_peered":"2024-01-31T05:09:20.578594+0000","last_unstale":"2024-01-31T05:10:21.683051+0000","last_undegraded":"2024-01-31T05:10:21.683051+0000","last_fullsized":"2024-01-31T05:10:21.683051+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:16:57.168457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681644+0000","last_change":"2024-01-31T05:09:20.586620+0000","last_active":"2024-01-31T05:10:21.681644+0000","last_peered":"2024-01-31T05:10:21.681644+0000","last_clean":"2024-01-31T05:10:21.681644+0000","last_became_active":"2024-01-31T05:09:20.586323+0000","last_became_peered":"2024-01-31T05:09:20.586323+0000","last_unstale":"2024-01-31T05:10:21.681644+0000","last_undegraded":"2024-01-31T05:10:21.681644+0000","last_fullsized":"2024-01-31T05:10:21.681644+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:03:31.479078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681655+0000","last_change":"2024-01-31T05:09:20.595122+0000","last_active":"2024-01-31T05:10:21.681655+0000","last_peered":"2024-01-31T05:10:21.681655+0000","last_clean":"2024-01-31T05:10:21.681655+0000","last_became_active":"2024-01-31T05:09:20.594766+0000","last_became_peered":"2024-01-31T05:09:20.594766+0000","last_unstale":"2024-01-31T05:10:21.681655+0000","last_undegraded":"2024-01-31T05:10:21.681655+0000","last_fullsized":"2024-01-31T05:10:21.681655+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:18:40.002855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.686734+0000","last_change":"2024-01-31T05:10:21.686734+0000","last_active":"2024-01-31T05:10:21.686734+0000","last_peered":"2024-01-31T05:10:21.686734+0000","last_clean":"2024-01-31T05:10:21.686734+0000","last_became_active":"2024-01-31T05:10:21.686293+0000","last_became_peered":"2024-01-31T05:10:21.686293+0000","last_unstale":"2024-01-31T05:10:21.686734+0000","last_undegraded":"2024-01-31T05:10:21.686734+0000","last_fullsized":"2024-01-31T05:10:21.686734+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:19:35.416043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684701+0000","last_change":"2024-01-31T05:09:20.588892+0000","last_active":"2024-01-31T05:10:21.684701+0000","last_peered":"2024-01-31T05:10:21.684701+0000","last_clean":"2024-01-31T05:10:21.684701+0000","last_became_active":"2024-01-31T05:09:20.588212+0000","last_became_peered":"2024-01-31T05:09:20.588212+0000","last_unstale":"2024-01-31T05:10:21.684701+0000","last_undegraded":"2024-01-31T05:10:21.684701+0000","last_fullsized":"2024-01-31T05:10:21.684701+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:49:45.270341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681790+0000","last_change":"2024-01-31T05:09:20.589396+0000","last_active":"2024-01-31T05:10:21.681790+0000","last_peered":"2024-01-31T05:10:21.681790+0000","last_clean":"2024-01-31T05:10:21.681790+0000","last_became_active":"2024-01-31T05:09:20.589058+0000","last_became_peered":"2024-01-31T05:09:20.589058+0000","last_unstale":"2024-01-31T05:10:21.681790+0000","last_undegraded":"2024-01-31T05:10:21.681790+0000","last_fullsized":"2024-01-31T05:10:21.681790+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:05:53.403136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681381+0000","last_change":"2024-01-31T05:09:20.592010+0000","last_active":"2024-01-31T05:10:21.681381+0000","last_peered":"2024-01-31T05:10:21.681381+0000","last_clean":"2024-01-31T05:10:21.681381+0000","last_became_active":"2024-01-31T05:09:20.591714+0000","last_became_peered":"2024-01-31T05:09:20.591714+0000","last_unstale":"2024-01-31T05:10:21.681381+0000","last_undegraded":"2024-01-31T05:10:21.681381+0000","last_fullsized":"2024-01-31T05:10:21.681381+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:56:11.651035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.685195+0000","last_change":"2024-01-31T05:10:21.685195+0000","last_active":"2024-01-31T05:10:21.685195+0000","last_peered":"2024-01-31T05:10:21.685195+0000","last_clean":"2024-01-31T05:10:21.685195+0000","last_became_active":"2024-01-31T05:10:21.684742+0000","last_became_peered":"2024-01-31T05:10:21.684742+0000","last_unstale":"2024-01-31T05:10:21.685195+0000","last_undegraded":"2024-01-31T05:10:21.685195+0000","last_fullsized":"2024-01-31T05:10:21.685195+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:18:59.674766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.679540+0000","last_change":"2024-01-31T05:09:20.582167+0000","last_active":"2024-01-31T05:10:21.679540+0000","last_peered":"2024-01-31T05:10:21.679540+0000","last_clean":"2024-01-31T05:10:21.679540+0000","last_became_active":"2024-01-31T05:09:20.581860+0000","last_became_peered":"2024-01-31T05:09:20.581860+0000","last_unstale":"2024-01-31T05:10:21.679540+0000","last_undegraded":"2024-01-31T05:10:21.679540+0000","last_fullsized":"2024-01-31T05:10:21.679540+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:46:05.891545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.679778+0000","last_change":"2024-01-31T05:09:20.587899+0000","last_active":"2024-01-31T05:10:21.679778+0000","last_peered":"2024-01-31T05:10:21.679778+0000","last_clean":"2024-01-31T05:10:21.679778+0000","last_became_active":"2024-01-31T05:09:20.587068+0000","last_became_peered":"2024-01-31T05:09:20.587068+0000","last_unstale":"2024-01-31T05:10:21.679778+0000","last_undegraded":"2024-01-31T05:10:21.679778+0000","last_fullsized":"2024-01-31T05:10:21.679778+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:59:44.747928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.679180+0000","last_change":"2024-01-31T05:09:20.590392+0000","last_active":"2024-01-31T05:10:21.679180+0000","last_peered":"2024-01-31T05:10:21.679180+0000","last_clean":"2024-01-31T05:10:21.679180+0000","last_became_active":"2024-01-31T05:09:20.590082+0000","last_became_peered":"2024-01-31T05:09:20.590082+0000","last_unstale":"2024-01-31T05:10:21.679180+0000","last_undegraded":"2024-01-31T05:10:21.679180+0000","last_fullsized":"2024-01-31T05:10:21.679180+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:59:10.672890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684330+0000","last_change":"2024-01-31T05:09:20.584822+0000","last_active":"2024-01-31T05:10:21.684330+0000","last_peered":"2024-01-31T05:10:21.684330+0000","last_clean":"2024-01-31T05:10:21.684330+0000","last_became_active":"2024-01-31T05:09:20.584531+0000","last_became_peered":"2024-01-31T05:09:20.584531+0000","last_unstale":"2024-01-31T05:10:21.684330+0000","last_undegraded":"2024-01-31T05:10:21.684330+0000","last_fullsized":"2024-01-31T05:10:21.684330+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:35:44.793407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681609+0000","last_change":"2024-01-31T05:09:20.582615+0000","last_active":"2024-01-31T05:10:21.681609+0000","last_peered":"2024-01-31T05:10:21.681609+0000","last_clean":"2024-01-31T05:10:21.681609+0000","last_became_active":"2024-01-31T05:09:20.581959+0000","last_became_peered":"2024-01-31T05:09:20.581959+0000","last_unstale":"2024-01-31T05:10:21.681609+0000","last_undegraded":"2024-01-31T05:10:21.681609+0000","last_fullsized":"2024-01-31T05:10:21.681609+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:29:06.817822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.682121+0000","last_change":"2024-01-31T05:09:20.582421+0000","last_active":"2024-01-31T05:10:21.682121+0000","last_peered":"2024-01-31T05:10:21.682121+0000","last_clean":"2024-01-31T05:10:21.682121+0000","last_became_active":"2024-01-31T05:09:20.582099+0000","last_became_peered":"2024-01-31T05:09:20.582099+0000","last_unstale":"2024-01-31T05:10:21.682121+0000","last_undegraded":"2024-01-31T05:10:21.682121+0000","last_fullsized":"2024-01-31T05:10:21.682121+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:08:03.802219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.683646+0000","last_change":"2024-01-31T05:09:20.580511+0000","last_active":"2024-01-31T05:10:21.683646+0000","last_peered":"2024-01-31T05:10:21.683646+0000","last_clean":"2024-01-31T05:10:21.683646+0000","last_became_active":"2024-01-31T05:09:20.579596+0000","last_became_peered":"2024-01-31T05:09:20.579596+0000","last_unstale":"2024-01-31T05:10:21.683646+0000","last_undegraded":"2024-01-31T05:10:21.683646+0000","last_fullsized":"2024-01-31T05:10:21.683646+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:07:01.206181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'13","reported_seq":101,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:34.268021+0000","last_change":"2024-01-31T05:09:20.187398+0000","last_active":"2024-01-31T05:10:34.268021+0000","last_peered":"2024-01-31T05:10:34.268021+0000","last_clean":"2024-01-31T05:10:34.268021+0000","last_became_active":"2024-01-31T05:09:20.186925+0000","last_became_peered":"2024-01-31T05:09:20.186925+0000","last_unstale":"2024-01-31T05:10:34.268021+0000","last_undegraded":"2024-01-31T05:10:34.268021+0000","last_fullsized":"2024-01-31T05:10:34.268021+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:33:34.624017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":69,"num_read_kb":69,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684902+0000","last_change":"2024-01-31T05:09:20.582800+0000","last_active":"2024-01-31T05:10:21.684902+0000","last_peered":"2024-01-31T05:10:21.684902+0000","last_clean":"2024-01-31T05:10:21.684902+0000","last_became_active":"2024-01-31T05:09:20.582523+0000","last_became_peered":"2024-01-31T05:09:20.582523+0000","last_unstale":"2024-01-31T05:10:21.684902+0000","last_undegraded":"2024-01-31T05:10:21.684902+0000","last_fullsized":"2024-01-31T05:10:21.684902+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:19:57.975954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.685133+0000","last_change":"2024-01-31T05:09:20.191566+0000","last_active":"2024-01-31T05:10:21.685133+0000","last_peered":"2024-01-31T05:10:21.685133+0000","last_clean":"2024-01-31T05:10:21.685133+0000","last_became_active":"2024-01-31T05:09:20.191268+0000","last_became_peered":"2024-01-31T05:09:20.191268+0000","last_unstale":"2024-01-31T05:10:21.685133+0000","last_undegraded":"2024-01-31T05:10:21.685133+0000","last_fullsized":"2024-01-31T05:10:21.685133+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:45:40.042374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.680124+0000","last_change":"2024-01-31T05:09:20.579061+0000","last_active":"2024-01-31T05:10:21.680124+0000","last_peered":"2024-01-31T05:10:21.680124+0000","last_clean":"2024-01-31T05:10:21.680124+0000","last_became_active":"2024-01-31T05:09:20.578728+0000","last_became_peered":"2024-01-31T05:09:20.578728+0000","last_unstale":"2024-01-31T05:10:21.680124+0000","last_undegraded":"2024-01-31T05:10:21.680124+0000","last_fullsized":"2024-01-31T05:10:21.680124+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:57:12.142419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.683895+0000","last_change":"2024-01-31T05:09:20.187366+0000","last_active":"2024-01-31T05:10:21.683895+0000","last_peered":"2024-01-31T05:10:21.683895+0000","last_clean":"2024-01-31T05:10:21.683895+0000","last_became_active":"2024-01-31T05:09:20.186616+0000","last_became_peered":"2024-01-31T05:09:20.186616+0000","last_unstale":"2024-01-31T05:10:21.683895+0000","last_undegraded":"2024-01-31T05:10:21.683895+0000","last_fullsized":"2024-01-31T05:10:21.683895+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:39:28.802810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684406+0000","last_change":"2024-01-31T05:09:20.590538+0000","last_active":"2024-01-31T05:10:21.684406+0000","last_peered":"2024-01-31T05:10:21.684406+0000","last_clean":"2024-01-31T05:10:21.684406+0000","last_became_active":"2024-01-31T05:09:20.590254+0000","last_became_peered":"2024-01-31T05:09:20.590254+0000","last_unstale":"2024-01-31T05:10:21.684406+0000","last_undegraded":"2024-01-31T05:10:21.684406+0000","last_fullsized":"2024-01-31T05:10:21.684406+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:06:38.209930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.683304+0000","last_change":"2024-01-31T05:09:20.183808+0000","last_active":"2024-01-31T05:10:21.683304+0000","last_peered":"2024-01-31T05:10:21.683304+0000","last_clean":"2024-01-31T05:10:21.683304+0000","last_became_active":"2024-01-31T05:09:20.183514+0000","last_became_peered":"2024-01-31T05:09:20.183514+0000","last_unstale":"2024-01-31T05:10:21.683304+0000","last_undegraded":"2024-01-31T05:10:21.683304+0000","last_fullsized":"2024-01-31T05:10:21.683304+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:32:43.392640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684938+0000","last_change":"2024-01-31T05:09:20.590871+0000","last_active":"2024-01-31T05:10:21.684938+0000","last_peered":"2024-01-31T05:10:21.684938+0000","last_clean":"2024-01-31T05:10:21.684938+0000","last_became_active":"2024-01-31T05:09:20.588533+0000","last_became_peered":"2024-01-31T05:09:20.588533+0000","last_unstale":"2024-01-31T05:10:21.684938+0000","last_undegraded":"2024-01-31T05:10:21.684938+0000","last_fullsized":"2024-01-31T05:10:21.684938+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:44:26.772616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'6","reported_seq":97,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:35.270235+0000","last_change":"2024-01-31T05:09:20.183455+0000","last_active":"2024-01-31T05:10:35.270235+0000","last_peered":"2024-01-31T05:10:35.270235+0000","last_clean":"2024-01-31T05:10:35.270235+0000","last_became_active":"2024-01-31T05:09:20.183070+0000","last_became_peered":"2024-01-31T05:09:20.183070+0000","last_unstale":"2024-01-31T05:10:35.270235+0000","last_undegraded":"2024-01-31T05:10:35.270235+0000","last_fullsized":"2024-01-31T05:10:35.270235+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:15:29.503830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":72,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.683440+0000","last_change":"2024-01-31T05:09:20.580755+0000","last_active":"2024-01-31T05:10:21.683440+0000","last_peered":"2024-01-31T05:10:21.683440+0000","last_clean":"2024-01-31T05:10:21.683440+0000","last_became_active":"2024-01-31T05:09:20.580452+0000","last_became_peered":"2024-01-31T05:09:20.580452+0000","last_unstale":"2024-01-31T05:10:21.683440+0000","last_undegraded":"2024-01-31T05:10:21.683440+0000","last_fullsized":"2024-01-31T05:10:21.683440+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:29:08.383532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681549+0000","last_change":"2024-01-31T05:09:20.182129+0000","last_active":"2024-01-31T05:10:21.681549+0000","last_peered":"2024-01-31T05:10:21.681549+0000","last_clean":"2024-01-31T05:10:21.681549+0000","last_became_active":"2024-01-31T05:09:20.181781+0000","last_became_peered":"2024-01-31T05:09:20.181781+0000","last_unstale":"2024-01-31T05:10:21.681549+0000","last_undegraded":"2024-01-31T05:10:21.681549+0000","last_fullsized":"2024-01-31T05:10:21.681549+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:05:57.854213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.685273+0000","last_change":"2024-01-31T05:09:20.591696+0000","last_active":"2024-01-31T05:10:21.685273+0000","last_peered":"2024-01-31T05:10:21.685273+0000","last_clean":"2024-01-31T05:10:21.685273+0000","last_became_active":"2024-01-31T05:09:20.591307+0000","last_became_peered":"2024-01-31T05:09:20.591307+0000","last_unstale":"2024-01-31T05:10:21.685273+0000","last_undegraded":"2024-01-31T05:10:21.685273+0000","last_fullsized":"2024-01-31T05:10:21.685273+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:59:56.884326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.679697+0000","last_change":"2024-01-31T05:09:20.179846+0000","last_active":"2024-01-31T05:10:21.679697+0000","last_peered":"2024-01-31T05:10:21.679697+0000","last_clean":"2024-01-31T05:10:21.679697+0000","last_became_active":"2024-01-31T05:09:20.179524+0000","last_became_peered":"2024-01-31T05:09:20.179524+0000","last_unstale":"2024-01-31T05:10:21.679697+0000","last_undegraded":"2024-01-31T05:10:21.679697+0000","last_fullsized":"2024-01-31T05:10:21.679697+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:13:51.085861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684000+0000","last_change":"2024-01-31T05:09:20.580076+0000","last_active":"2024-01-31T05:10:21.684000+0000","last_peered":"2024-01-31T05:10:21.684000+0000","last_clean":"2024-01-31T05:10:21.684000+0000","last_became_active":"2024-01-31T05:09:20.579764+0000","last_became_peered":"2024-01-31T05:09:20.579764+0000","last_unstale":"2024-01-31T05:10:21.684000+0000","last_undegraded":"2024-01-31T05:10:21.684000+0000","last_fullsized":"2024-01-31T05:10:21.684000+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:02:13.861848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.685470+0000","last_change":"2024-01-31T05:09:20.183941+0000","last_active":"2024-01-31T05:10:21.685470+0000","last_peered":"2024-01-31T05:10:21.685470+0000","last_clean":"2024-01-31T05:10:21.685470+0000","last_became_active":"2024-01-31T05:09:20.183631+0000","last_became_peered":"2024-01-31T05:09:20.183631+0000","last_unstale":"2024-01-31T05:10:21.685470+0000","last_undegraded":"2024-01-31T05:10:21.685470+0000","last_fullsized":"2024-01-31T05:10:21.685470+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:31:31.419345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681774+0000","last_change":"2024-01-31T05:09:20.589275+0000","last_active":"2024-01-31T05:10:21.681774+0000","last_peered":"2024-01-31T05:10:21.681774+0000","last_clean":"2024-01-31T05:10:21.681774+0000","last_became_active":"2024-01-31T05:09:20.588891+0000","last_became_peered":"2024-01-31T05:09:20.588891+0000","last_unstale":"2024-01-31T05:10:21.681774+0000","last_undegraded":"2024-01-31T05:10:21.681774+0000","last_fullsized":"2024-01-31T05:10:21.681774+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:30:27.665553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":165,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:37.272295+0000","last_change":"2024-01-31T05:09:20.182836+0000","last_active":"2024-01-31T05:10:37.272295+0000","last_peered":"2024-01-31T05:10:37.272295+0000","last_clean":"2024-01-31T05:10:37.272295+0000","last_became_active":"2024-01-31T05:09:20.182376+0000","last_became_peered":"2024-01-31T05:09:20.182376+0000","last_unstale":"2024-01-31T05:10:37.272295+0000","last_undegraded":"2024-01-31T05:10:37.272295+0000","last_fullsized":"2024-01-31T05:10:37.272295+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:55:52.354323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":142,"num_read_kb":142,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684677+0000","last_change":"2024-01-31T05:09:20.583592+0000","last_active":"2024-01-31T05:10:21.684677+0000","last_peered":"2024-01-31T05:10:21.684677+0000","last_clean":"2024-01-31T05:10:21.684677+0000","last_became_active":"2024-01-31T05:09:20.583247+0000","last_became_peered":"2024-01-31T05:09:20.583247+0000","last_unstale":"2024-01-31T05:10:21.684677+0000","last_undegraded":"2024-01-31T05:10:21.684677+0000","last_fullsized":"2024-01-31T05:10:21.684677+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:28:04.946620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681815+0000","last_change":"2024-01-31T05:09:20.188171+0000","last_active":"2024-01-31T05:10:21.681815+0000","last_peered":"2024-01-31T05:10:21.681815+0000","last_clean":"2024-01-31T05:10:21.681815+0000","last_became_active":"2024-01-31T05:09:20.187807+0000","last_became_peered":"2024-01-31T05:09:20.187807+0000","last_unstale":"2024-01-31T05:10:21.681815+0000","last_undegraded":"2024-01-31T05:10:21.681815+0000","last_fullsized":"2024-01-31T05:10:21.681815+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:53:22.765389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.680069+0000","last_change":"2024-01-31T05:09:20.589462+0000","last_active":"2024-01-31T05:10:21.680069+0000","last_peered":"2024-01-31T05:10:21.680069+0000","last_clean":"2024-01-31T05:10:21.680069+0000","last_became_active":"2024-01-31T05:09:20.589002+0000","last_became_peered":"2024-01-31T05:09:20.589002+0000","last_unstale":"2024-01-31T05:10:21.680069+0000","last_undegraded":"2024-01-31T05:10:21.680069+0000","last_fullsized":"2024-01-31T05:10:21.680069+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:41:35.918827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684998+0000","last_change":"2024-01-31T05:09:20.184963+0000","last_active":"2024-01-31T05:10:21.684998+0000","last_peered":"2024-01-31T05:10:21.684998+0000","last_clean":"2024-01-31T05:10:21.684998+0000","last_became_active":"2024-01-31T05:09:20.184590+0000","last_became_peered":"2024-01-31T05:09:20.184590+0000","last_unstale":"2024-01-31T05:10:21.684998+0000","last_undegraded":"2024-01-31T05:10:21.684998+0000","last_fullsized":"2024-01-31T05:10:21.684998+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:06:31.291846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684522+0000","last_change":"2024-01-31T05:09:20.589237+0000","last_active":"2024-01-31T05:10:21.684522+0000","last_peered":"2024-01-31T05:10:21.684522+0000","last_clean":"2024-01-31T05:10:21.684522+0000","last_became_active":"2024-01-31T05:09:20.588656+0000","last_became_peered":"2024-01-31T05:09:20.588656+0000","last_unstale":"2024-01-31T05:10:21.684522+0000","last_undegraded":"2024-01-31T05:10:21.684522+0000","last_fullsized":"2024-01-31T05:10:21.684522+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:02:02.025136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'29","reported_seq":197,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:37.272169+0000","last_change":"2024-01-31T05:09:20.182539+0000","last_active":"2024-01-31T05:10:37.272169+0000","last_peered":"2024-01-31T05:10:37.272169+0000","last_clean":"2024-01-31T05:10:37.272169+0000","last_became_active":"2024-01-31T05:09:20.182229+0000","last_became_peered":"2024-01-31T05:09:20.182229+0000","last_unstale":"2024-01-31T05:10:37.272169+0000","last_undegraded":"2024-01-31T05:10:37.272169+0000","last_fullsized":"2024-01-31T05:10:37.272169+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:56:21.974450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59464,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":149,"num_read_kb":132,"num_write":31,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.683080+0000","last_change":"2024-01-31T05:09:20.587838+0000","last_active":"2024-01-31T05:10:21.683080+0000","last_peered":"2024-01-31T05:10:21.683080+0000","last_clean":"2024-01-31T05:10:21.683080+0000","last_became_active":"2024-01-31T05:09:20.587523+0000","last_became_peered":"2024-01-31T05:09:20.587523+0000","last_unstale":"2024-01-31T05:10:21.683080+0000","last_undegraded":"2024-01-31T05:10:21.683080+0000","last_fullsized":"2024-01-31T05:10:21.683080+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:36:17.582890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.683191+0000","last_change":"2024-01-31T05:09:20.191935+0000","last_active":"2024-01-31T05:10:21.683191+0000","last_peered":"2024-01-31T05:10:21.683191+0000","last_clean":"2024-01-31T05:10:21.683191+0000","last_became_active":"2024-01-31T05:09:20.191614+0000","last_became_peered":"2024-01-31T05:09:20.191614+0000","last_unstale":"2024-01-31T05:10:21.683191+0000","last_undegraded":"2024-01-31T05:10:21.683191+0000","last_fullsized":"2024-01-31T05:10:21.683191+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:12:38.245944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.679434+0000","last_change":"2024-01-31T05:09:20.585705+0000","last_active":"2024-01-31T05:10:21.679434+0000","last_peered":"2024-01-31T05:10:21.679434+0000","last_clean":"2024-01-31T05:10:21.679434+0000","last_became_active":"2024-01-31T05:09:20.585413+0000","last_became_peered":"2024-01-31T05:09:20.585413+0000","last_unstale":"2024-01-31T05:10:21.679434+0000","last_undegraded":"2024-01-31T05:10:21.679434+0000","last_fullsized":"2024-01-31T05:10:21.679434+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:35:34.686300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684861+0000","last_change":"2024-01-31T05:09:20.191975+0000","last_active":"2024-01-31T05:10:21.684861+0000","last_peered":"2024-01-31T05:10:21.684861+0000","last_clean":"2024-01-31T05:10:21.684861+0000","last_became_active":"2024-01-31T05:09:20.191666+0000","last_became_peered":"2024-01-31T05:09:20.191666+0000","last_unstale":"2024-01-31T05:10:21.684861+0000","last_undegraded":"2024-01-31T05:10:21.684861+0000","last_fullsized":"2024-01-31T05:10:21.684861+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:00:01.162509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684093+0000","last_change":"2024-01-31T05:10:21.684093+0000","last_active":"2024-01-31T05:10:21.684093+0000","last_peered":"2024-01-31T05:10:21.684093+0000","last_clean":"2024-01-31T05:10:21.684093+0000","last_became_active":"2024-01-31T05:10:21.683777+0000","last_became_peered":"2024-01-31T05:10:21.683777+0000","last_unstale":"2024-01-31T05:10:21.684093+0000","last_undegraded":"2024-01-31T05:10:21.684093+0000","last_fullsized":"2024-01-31T05:10:21.684093+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:54:18.618017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'6","reported_seq":98,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:36.283612+0000","last_change":"2024-01-31T05:09:20.183752+0000","last_active":"2024-01-31T05:10:36.283612+0000","last_peered":"2024-01-31T05:10:36.283612+0000","last_clean":"2024-01-31T05:10:36.283612+0000","last_became_active":"2024-01-31T05:09:20.183421+0000","last_became_peered":"2024-01-31T05:09:20.183421+0000","last_unstale":"2024-01-31T05:10:36.283612+0000","last_undegraded":"2024-01-31T05:10:36.283612+0000","last_fullsized":"2024-01-31T05:10:36.283612+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:04:12.919266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681219+0000","last_change":"2024-01-31T05:09:20.593893+0000","last_active":"2024-01-31T05:10:21.681219+0000","last_peered":"2024-01-31T05:10:21.681219+0000","last_clean":"2024-01-31T05:10:21.681219+0000","last_became_active":"2024-01-31T05:09:20.593604+0000","last_became_peered":"2024-01-31T05:09:20.593604+0000","last_unstale":"2024-01-31T05:10:21.681219+0000","last_undegraded":"2024-01-31T05:10:21.681219+0000","last_fullsized":"2024-01-31T05:10:21.681219+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:50:31.534607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.696407+0000","last_change":"2024-01-31T05:10:21.696407+0000","last_active":"2024-01-31T05:10:21.696407+0000","last_peered":"2024-01-31T05:10:21.696407+0000","last_clean":"2024-01-31T05:10:21.696407+0000","last_became_active":"2024-01-31T05:10:21.684807+0000","last_became_peered":"2024-01-31T05:10:21.684807+0000","last_unstale":"2024-01-31T05:10:21.696407+0000","last_undegraded":"2024-01-31T05:10:21.696407+0000","last_fullsized":"2024-01-31T05:10:21.696407+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:21:51.260528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684725+0000","last_change":"2024-01-31T05:09:20.588049+0000","last_active":"2024-01-31T05:10:21.684725+0000","last_peered":"2024-01-31T05:10:21.684725+0000","last_clean":"2024-01-31T05:10:21.684725+0000","last_became_active":"2024-01-31T05:09:20.587542+0000","last_became_peered":"2024-01-31T05:09:20.587542+0000","last_unstale":"2024-01-31T05:10:21.684725+0000","last_undegraded":"2024-01-31T05:10:21.684725+0000","last_fullsized":"2024-01-31T05:10:21.684725+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:19:55.948269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.683712+0000","last_change":"2024-01-31T05:09:20.185328+0000","last_active":"2024-01-31T05:10:21.683712+0000","last_peered":"2024-01-31T05:10:21.683712+0000","last_clean":"2024-01-31T05:10:21.683712+0000","last_became_active":"2024-01-31T05:09:20.184551+0000","last_became_peered":"2024-01-31T05:09:20.184551+0000","last_unstale":"2024-01-31T05:10:21.683712+0000","last_undegraded":"2024-01-31T05:10:21.683712+0000","last_fullsized":"2024-01-31T05:10:21.683712+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:19:36.143101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681302+0000","last_change":"2024-01-31T05:09:20.586286+0000","last_active":"2024-01-31T05:10:21.681302+0000","last_peered":"2024-01-31T05:10:21.681302+0000","last_clean":"2024-01-31T05:10:21.681302+0000","last_became_active":"2024-01-31T05:09:20.586011+0000","last_became_peered":"2024-01-31T05:09:20.586011+0000","last_unstale":"2024-01-31T05:10:21.681302+0000","last_undegraded":"2024-01-31T05:10:21.681302+0000","last_fullsized":"2024-01-31T05:10:21.681302+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:21:23.064829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681935+0000","last_change":"2024-01-31T05:09:20.183083+0000","last_active":"2024-01-31T05:10:21.681935+0000","last_peered":"2024-01-31T05:10:21.681935+0000","last_clean":"2024-01-31T05:10:21.681935+0000","last_became_active":"2024-01-31T05:09:20.182742+0000","last_became_peered":"2024-01-31T05:09:20.182742+0000","last_unstale":"2024-01-31T05:10:21.681935+0000","last_undegraded":"2024-01-31T05:10:21.681935+0000","last_fullsized":"2024-01-31T05:10:21.681935+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:12:02.081688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'1","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681563+0000","last_change":"2024-01-31T05:09:20.591522+0000","last_active":"2024-01-31T05:10:21.681563+0000","last_peered":"2024-01-31T05:10:21.681563+0000","last_clean":"2024-01-31T05:10:21.681563+0000","last_became_active":"2024-01-31T05:09:20.591224+0000","last_became_peered":"2024-01-31T05:09:20.591224+0000","last_unstale":"2024-01-31T05:10:21.681563+0000","last_undegraded":"2024-01-31T05:10:21.681563+0000","last_fullsized":"2024-01-31T05:10:21.681563+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:24:17.153662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'5","reported_seq":94,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:35.269549+0000","last_change":"2024-01-31T05:09:20.186176+0000","last_active":"2024-01-31T05:10:35.269549+0000","last_peered":"2024-01-31T05:10:35.269549+0000","last_clean":"2024-01-31T05:10:35.269549+0000","last_became_active":"2024-01-31T05:09:20.185873+0000","last_became_peered":"2024-01-31T05:09:20.185873+0000","last_unstale":"2024-01-31T05:10:35.269549+0000","last_undegraded":"2024-01-31T05:10:35.269549+0000","last_fullsized":"2024-01-31T05:10:35.269549+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:55:12.689664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":70,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681969+0000","last_change":"2024-01-31T05:09:20.587556+0000","last_active":"2024-01-31T05:10:21.681969+0000","last_peered":"2024-01-31T05:10:21.681969+0000","last_clean":"2024-01-31T05:10:21.681969+0000","last_became_active":"2024-01-31T05:09:20.587275+0000","last_became_peered":"2024-01-31T05:09:20.587275+0000","last_unstale":"2024-01-31T05:10:21.681969+0000","last_undegraded":"2024-01-31T05:10:21.681969+0000","last_fullsized":"2024-01-31T05:10:21.681969+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:35:16.022422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.685648+0000","last_change":"2024-01-31T05:09:20.588044+0000","last_active":"2024-01-31T05:10:21.685648+0000","last_peered":"2024-01-31T05:10:21.685648+0000","last_clean":"2024-01-31T05:10:21.685648+0000","last_became_active":"2024-01-31T05:09:20.587526+0000","last_became_peered":"2024-01-31T05:09:20.587526+0000","last_unstale":"2024-01-31T05:10:21.685648+0000","last_undegraded":"2024-01-31T05:10:21.685648+0000","last_fullsized":"2024-01-31T05:10:21.685648+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:49:07.270009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":95,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:35.282012+0000","last_change":"2024-01-31T05:09:20.194791+0000","last_active":"2024-01-31T05:10:35.282012+0000","last_peered":"2024-01-31T05:10:35.282012+0000","last_clean":"2024-01-31T05:10:35.282012+0000","last_became_active":"2024-01-31T05:09:20.194454+0000","last_became_peered":"2024-01-31T05:09:20.194454+0000","last_unstale":"2024-01-31T05:10:35.282012+0000","last_undegraded":"2024-01-31T05:10:35.282012+0000","last_fullsized":"2024-01-31T05:10:35.282012+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:31:26.809960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":71,"num_read_kb":71,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684437+0000","last_change":"2024-01-31T05:09:20.585022+0000","last_active":"2024-01-31T05:10:21.684437+0000","last_peered":"2024-01-31T05:10:21.684437+0000","last_clean":"2024-01-31T05:10:21.684437+0000","last_became_active":"2024-01-31T05:09:20.584709+0000","last_became_peered":"2024-01-31T05:09:20.584709+0000","last_unstale":"2024-01-31T05:10:21.684437+0000","last_undegraded":"2024-01-31T05:10:21.684437+0000","last_fullsized":"2024-01-31T05:10:21.684437+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:10:45.616985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.688980+0000","last_change":"2024-01-31T05:09:20.183779+0000","last_active":"2024-01-31T05:10:21.688980+0000","last_peered":"2024-01-31T05:10:21.688980+0000","last_clean":"2024-01-31T05:10:21.688980+0000","last_became_active":"2024-01-31T05:09:20.183399+0000","last_became_peered":"2024-01-31T05:09:20.183399+0000","last_unstale":"2024-01-31T05:10:21.688980+0000","last_undegraded":"2024-01-31T05:10:21.688980+0000","last_fullsized":"2024-01-31T05:10:21.688980+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:48:43.831022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":345,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681317+0000","last_change":"2024-01-31T05:08:10.168270+0000","last_active":"2024-01-31T05:10:21.681317+0000","last_peered":"2024-01-31T05:10:21.681317+0000","last_clean":"2024-01-31T05:10:21.681317+0000","last_became_active":"2024-01-31T05:08:10.167743+0000","last_became_peered":"2024-01-31T05:08:10.167743+0000","last_unstale":"2024-01-31T05:10:21.681317+0000","last_undegraded":"2024-01-31T05:10:21.681317+0000","last_fullsized":"2024-01-31T05:10:21.681317+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:46.976985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:46.976985+0000","last_clean_scrub_stamp":"2024-01-31T05:04:46.976985+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:21:54.724227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.679480+0000","last_change":"2024-01-31T05:09:20.583135+0000","last_active":"2024-01-31T05:10:21.679480+0000","last_peered":"2024-01-31T05:10:21.679480+0000","last_clean":"2024-01-31T05:10:21.679480+0000","last_became_active":"2024-01-31T05:09:20.582850+0000","last_became_peered":"2024-01-31T05:09:20.582850+0000","last_unstale":"2024-01-31T05:10:21.679480+0000","last_undegraded":"2024-01-31T05:10:21.679480+0000","last_fullsized":"2024-01-31T05:10:21.679480+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:04:51.204561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681474+0000","last_change":"2024-01-31T05:09:20.188181+0000","last_active":"2024-01-31T05:10:21.681474+0000","last_peered":"2024-01-31T05:10:21.681474+0000","last_clean":"2024-01-31T05:10:21.681474+0000","last_became_active":"2024-01-31T05:09:20.187801+0000","last_became_peered":"2024-01-31T05:09:20.187801+0000","last_unstale":"2024-01-31T05:10:21.681474+0000","last_undegraded":"2024-01-31T05:10:21.681474+0000","last_fullsized":"2024-01-31T05:10:21.681474+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:27:05.269615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.683769+0000","last_change":"2024-01-31T05:09:20.186242+0000","last_active":"2024-01-31T05:10:21.683769+0000","last_peered":"2024-01-31T05:10:21.683769+0000","last_clean":"2024-01-31T05:10:21.683769+0000","last_became_active":"2024-01-31T05:09:20.185908+0000","last_became_peered":"2024-01-31T05:09:20.185908+0000","last_unstale":"2024-01-31T05:10:21.683769+0000","last_undegraded":"2024-01-31T05:10:21.683769+0000","last_fullsized":"2024-01-31T05:10:21.683769+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:33:40.859324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.679626+0000","last_change":"2024-01-31T05:09:20.590896+0000","last_active":"2024-01-31T05:10:21.679626+0000","last_peered":"2024-01-31T05:10:21.679626+0000","last_clean":"2024-01-31T05:10:21.679626+0000","last_became_active":"2024-01-31T05:09:20.590546+0000","last_became_peered":"2024-01-31T05:09:20.590546+0000","last_unstale":"2024-01-31T05:10:21.679626+0000","last_undegraded":"2024-01-31T05:10:21.679626+0000","last_fullsized":"2024-01-31T05:10:21.679626+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:39:05.969756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.682224+0000","last_change":"2024-01-31T05:09:20.185811+0000","last_active":"2024-01-31T05:10:21.682224+0000","last_peered":"2024-01-31T05:10:21.682224+0000","last_clean":"2024-01-31T05:10:21.682224+0000","last_became_active":"2024-01-31T05:09:20.185490+0000","last_became_peered":"2024-01-31T05:09:20.185490+0000","last_unstale":"2024-01-31T05:10:21.682224+0000","last_undegraded":"2024-01-31T05:10:21.682224+0000","last_fullsized":"2024-01-31T05:10:21.682224+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:16:25.446046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684943+0000","last_change":"2024-01-31T05:09:20.585298+0000","last_active":"2024-01-31T05:10:21.684943+0000","last_peered":"2024-01-31T05:10:21.684943+0000","last_clean":"2024-01-31T05:10:21.684943+0000","last_became_active":"2024-01-31T05:09:20.584256+0000","last_became_peered":"2024-01-31T05:09:20.584256+0000","last_unstale":"2024-01-31T05:10:21.684943+0000","last_undegraded":"2024-01-31T05:10:21.684943+0000","last_fullsized":"2024-01-31T05:10:21.684943+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:48:10.331714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.689153+0000","last_change":"2024-01-31T05:09:20.184960+0000","last_active":"2024-01-31T05:10:21.689153+0000","last_peered":"2024-01-31T05:10:21.689153+0000","last_clean":"2024-01-31T05:10:21.689153+0000","last_became_active":"2024-01-31T05:09:20.184599+0000","last_became_peered":"2024-01-31T05:09:20.184599+0000","last_unstale":"2024-01-31T05:10:21.689153+0000","last_undegraded":"2024-01-31T05:10:21.689153+0000","last_fullsized":"2024-01-31T05:10:21.689153+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:07:01.846976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.679983+0000","last_change":"2024-01-31T05:09:20.588597+0000","last_active":"2024-01-31T05:10:21.679983+0000","last_peered":"2024-01-31T05:10:21.679983+0000","last_clean":"2024-01-31T05:10:21.679983+0000","last_became_active":"2024-01-31T05:09:20.588326+0000","last_became_peered":"2024-01-31T05:09:20.588326+0000","last_unstale":"2024-01-31T05:10:21.679983+0000","last_undegraded":"2024-01-31T05:10:21.679983+0000","last_fullsized":"2024-01-31T05:10:21.679983+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:31:53.873261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684381+0000","last_change":"2024-01-31T05:09:20.186196+0000","last_active":"2024-01-31T05:10:21.684381+0000","last_peered":"2024-01-31T05:10:21.684381+0000","last_clean":"2024-01-31T05:10:21.684381+0000","last_became_active":"2024-01-31T05:09:20.185373+0000","last_became_peered":"2024-01-31T05:09:20.185373+0000","last_unstale":"2024-01-31T05:10:21.684381+0000","last_undegraded":"2024-01-31T05:10:21.684381+0000","last_fullsized":"2024-01-31T05:10:21.684381+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:13:07.826906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.683037+0000","last_change":"2024-01-31T05:09:20.589183+0000","last_active":"2024-01-31T05:10:21.683037+0000","last_peered":"2024-01-31T05:10:21.683037+0000","last_clean":"2024-01-31T05:10:21.683037+0000","last_became_active":"2024-01-31T05:09:20.588884+0000","last_became_peered":"2024-01-31T05:09:20.588884+0000","last_unstale":"2024-01-31T05:10:21.683037+0000","last_undegraded":"2024-01-31T05:10:21.683037+0000","last_fullsized":"2024-01-31T05:10:21.683037+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:23:49.878076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684293+0000","last_change":"2024-01-31T05:09:20.184849+0000","last_active":"2024-01-31T05:10:21.684293+0000","last_peered":"2024-01-31T05:10:21.684293+0000","last_clean":"2024-01-31T05:10:21.684293+0000","last_became_active":"2024-01-31T05:09:20.184491+0000","last_became_peered":"2024-01-31T05:09:20.184491+0000","last_unstale":"2024-01-31T05:10:21.684293+0000","last_undegraded":"2024-01-31T05:10:21.684293+0000","last_fullsized":"2024-01-31T05:10:21.684293+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:36:31.757646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681747+0000","last_change":"2024-01-31T05:09:20.585917+0000","last_active":"2024-01-31T05:10:21.681747+0000","last_peered":"2024-01-31T05:10:21.681747+0000","last_clean":"2024-01-31T05:10:21.681747+0000","last_became_active":"2024-01-31T05:09:20.585082+0000","last_became_peered":"2024-01-31T05:09:20.585082+0000","last_unstale":"2024-01-31T05:10:21.681747+0000","last_undegraded":"2024-01-31T05:10:21.681747+0000","last_fullsized":"2024-01-31T05:10:21.681747+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:30:17.670739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.699341+0000","last_change":"2024-01-31T05:10:21.699341+0000","last_active":"2024-01-31T05:10:21.699341+0000","last_peered":"2024-01-31T05:10:21.699341+0000","last_clean":"2024-01-31T05:10:21.699341+0000","last_became_active":"2024-01-31T05:10:21.684981+0000","last_became_peered":"2024-01-31T05:10:21.684981+0000","last_unstale":"2024-01-31T05:10:21.699341+0000","last_undegraded":"2024-01-31T05:10:21.699341+0000","last_fullsized":"2024-01-31T05:10:21.699341+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:36:33.975341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684488+0000","last_change":"2024-01-31T05:09:20.580332+0000","last_active":"2024-01-31T05:10:21.684488+0000","last_peered":"2024-01-31T05:10:21.684488+0000","last_clean":"2024-01-31T05:10:21.684488+0000","last_became_active":"2024-01-31T05:09:20.580014+0000","last_became_peered":"2024-01-31T05:09:20.580014+0000","last_unstale":"2024-01-31T05:10:21.684488+0000","last_undegraded":"2024-01-31T05:10:21.684488+0000","last_fullsized":"2024-01-31T05:10:21.684488+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:38:52.507575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.683162+0000","last_change":"2024-01-31T05:09:20.186065+0000","last_active":"2024-01-31T05:10:21.683162+0000","last_peered":"2024-01-31T05:10:21.683162+0000","last_clean":"2024-01-31T05:10:21.683162+0000","last_became_active":"2024-01-31T05:09:20.185798+0000","last_became_peered":"2024-01-31T05:09:20.185798+0000","last_unstale":"2024-01-31T05:10:21.683162+0000","last_undegraded":"2024-01-31T05:10:21.683162+0000","last_fullsized":"2024-01-31T05:10:21.683162+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:25:05.792886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.682118+0000","last_change":"2024-01-31T05:09:20.589746+0000","last_active":"2024-01-31T05:10:21.682118+0000","last_peered":"2024-01-31T05:10:21.682118+0000","last_clean":"2024-01-31T05:10:21.682118+0000","last_became_active":"2024-01-31T05:09:20.589452+0000","last_became_peered":"2024-01-31T05:09:20.589452+0000","last_unstale":"2024-01-31T05:10:21.682118+0000","last_undegraded":"2024-01-31T05:10:21.682118+0000","last_fullsized":"2024-01-31T05:10:21.682118+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:04:39.773280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'6","reported_seq":98,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:35.270284+0000","last_change":"2024-01-31T05:09:20.181920+0000","last_active":"2024-01-31T05:10:35.270284+0000","last_peered":"2024-01-31T05:10:35.270284+0000","last_clean":"2024-01-31T05:10:35.270284+0000","last_became_active":"2024-01-31T05:09:20.181603+0000","last_became_peered":"2024-01-31T05:09:20.181603+0000","last_unstale":"2024-01-31T05:10:35.270284+0000","last_undegraded":"2024-01-31T05:10:35.270284+0000","last_fullsized":"2024-01-31T05:10:35.270284+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:11:30.696322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1560,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":73,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681547+0000","last_change":"2024-01-31T05:09:20.592244+0000","last_active":"2024-01-31T05:10:21.681547+0000","last_peered":"2024-01-31T05:10:21.681547+0000","last_clean":"2024-01-31T05:10:21.681547+0000","last_became_active":"2024-01-31T05:09:20.591940+0000","last_became_peered":"2024-01-31T05:09:20.591940+0000","last_unstale":"2024-01-31T05:10:21.681547+0000","last_undegraded":"2024-01-31T05:10:21.681547+0000","last_fullsized":"2024-01-31T05:10:21.681547+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:16:02.284216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684890+0000","last_change":"2024-01-31T05:09:20.192018+0000","last_active":"2024-01-31T05:10:21.684890+0000","last_peered":"2024-01-31T05:10:21.684890+0000","last_clean":"2024-01-31T05:10:21.684890+0000","last_became_active":"2024-01-31T05:09:20.191721+0000","last_became_peered":"2024-01-31T05:09:20.191721+0000","last_unstale":"2024-01-31T05:10:21.684890+0000","last_undegraded":"2024-01-31T05:10:21.684890+0000","last_fullsized":"2024-01-31T05:10:21.684890+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:53:56.199730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"86'1","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681828+0000","last_change":"2024-01-31T05:09:20.593153+0000","last_active":"2024-01-31T05:10:21.681828+0000","last_peered":"2024-01-31T05:10:21.681828+0000","last_clean":"2024-01-31T05:10:21.681828+0000","last_became_active":"2024-01-31T05:09:20.592869+0000","last_became_peered":"2024-01-31T05:09:20.592869+0000","last_unstale":"2024-01-31T05:10:21.681828+0000","last_undegraded":"2024-01-31T05:10:21.681828+0000","last_fullsized":"2024-01-31T05:10:21.681828+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:35:42.234519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.679538+0000","last_change":"2024-01-31T05:09:20.191998+0000","last_active":"2024-01-31T05:10:21.679538+0000","last_peered":"2024-01-31T05:10:21.679538+0000","last_clean":"2024-01-31T05:10:21.679538+0000","last_became_active":"2024-01-31T05:09:20.191658+0000","last_became_peered":"2024-01-31T05:09:20.191658+0000","last_unstale":"2024-01-31T05:10:21.679538+0000","last_undegraded":"2024-01-31T05:10:21.679538+0000","last_fullsized":"2024-01-31T05:10:21.679538+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T17:06:39.916765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681969+0000","last_change":"2024-01-31T05:09:20.586822+0000","last_active":"2024-01-31T05:10:21.681969+0000","last_peered":"2024-01-31T05:10:21.681969+0000","last_clean":"2024-01-31T05:10:21.681969+0000","last_became_active":"2024-01-31T05:09:20.586523+0000","last_became_peered":"2024-01-31T05:09:20.586523+0000","last_unstale":"2024-01-31T05:10:21.681969+0000","last_undegraded":"2024-01-31T05:10:21.681969+0000","last_fullsized":"2024-01-31T05:10:21.681969+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:02:59.311443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681774+0000","last_change":"2024-01-31T05:09:20.586141+0000","last_active":"2024-01-31T05:10:21.681774+0000","last_peered":"2024-01-31T05:10:21.681774+0000","last_clean":"2024-01-31T05:10:21.681774+0000","last_became_active":"2024-01-31T05:09:20.585626+0000","last_became_peered":"2024-01-31T05:09:20.585626+0000","last_unstale":"2024-01-31T05:10:21.681774+0000","last_undegraded":"2024-01-31T05:10:21.681774+0000","last_fullsized":"2024-01-31T05:10:21.681774+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:39:18.023044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.683405+0000","last_change":"2024-01-31T05:09:20.588203+0000","last_active":"2024-01-31T05:10:21.683405+0000","last_peered":"2024-01-31T05:10:21.683405+0000","last_clean":"2024-01-31T05:10:21.683405+0000","last_became_active":"2024-01-31T05:09:20.586660+0000","last_became_peered":"2024-01-31T05:09:20.586660+0000","last_unstale":"2024-01-31T05:10:21.683405+0000","last_undegraded":"2024-01-31T05:10:21.683405+0000","last_fullsized":"2024-01-31T05:10:21.683405+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:27:41.249756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.683895+0000","last_change":"2024-01-31T05:09:20.591708+0000","last_active":"2024-01-31T05:10:21.683895+0000","last_peered":"2024-01-31T05:10:21.683895+0000","last_clean":"2024-01-31T05:10:21.683895+0000","last_became_active":"2024-01-31T05:09:20.590874+0000","last_became_peered":"2024-01-31T05:09:20.590874+0000","last_unstale":"2024-01-31T05:10:21.683895+0000","last_undegraded":"2024-01-31T05:10:21.683895+0000","last_fullsized":"2024-01-31T05:10:21.683895+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:13:30.221125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.680037+0000","last_change":"2024-01-31T05:09:20.587566+0000","last_active":"2024-01-31T05:10:21.680037+0000","last_peered":"2024-01-31T05:10:21.680037+0000","last_clean":"2024-01-31T05:10:21.680037+0000","last_became_active":"2024-01-31T05:09:20.587260+0000","last_became_peered":"2024-01-31T05:09:20.587260+0000","last_unstale":"2024-01-31T05:10:21.680037+0000","last_undegraded":"2024-01-31T05:10:21.680037+0000","last_fullsized":"2024-01-31T05:10:21.680037+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:32:46.030539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.679451+0000","last_change":"2024-01-31T05:09:20.587259+0000","last_active":"2024-01-31T05:10:21.679451+0000","last_peered":"2024-01-31T05:10:21.679451+0000","last_clean":"2024-01-31T05:10:21.679451+0000","last_became_active":"2024-01-31T05:09:20.586935+0000","last_became_peered":"2024-01-31T05:09:20.586935+0000","last_unstale":"2024-01-31T05:10:21.679451+0000","last_undegraded":"2024-01-31T05:10:21.679451+0000","last_fullsized":"2024-01-31T05:10:21.679451+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:28:23.217392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681333+0000","last_change":"2024-01-31T05:09:20.587213+0000","last_active":"2024-01-31T05:10:21.681333+0000","last_peered":"2024-01-31T05:10:21.681333+0000","last_clean":"2024-01-31T05:10:21.681333+0000","last_became_active":"2024-01-31T05:09:20.586918+0000","last_became_peered":"2024-01-31T05:09:20.586918+0000","last_unstale":"2024-01-31T05:10:21.681333+0000","last_undegraded":"2024-01-31T05:10:21.681333+0000","last_fullsized":"2024-01-31T05:10:21.681333+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:39:27.541560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.683938+0000","last_change":"2024-01-31T05:09:20.584532+0000","last_active":"2024-01-31T05:10:21.683938+0000","last_peered":"2024-01-31T05:10:21.683938+0000","last_clean":"2024-01-31T05:10:21.683938+0000","last_became_active":"2024-01-31T05:09:20.583512+0000","last_became_peered":"2024-01-31T05:09:20.583512+0000","last_unstale":"2024-01-31T05:10:21.683938+0000","last_undegraded":"2024-01-31T05:10:21.683938+0000","last_fullsized":"2024-01-31T05:10:21.683938+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:04:33.848498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684859+0000","last_change":"2024-01-31T05:09:20.587561+0000","last_active":"2024-01-31T05:10:21.684859+0000","last_peered":"2024-01-31T05:10:21.684859+0000","last_clean":"2024-01-31T05:10:21.684859+0000","last_became_active":"2024-01-31T05:09:20.587232+0000","last_became_peered":"2024-01-31T05:09:20.587232+0000","last_unstale":"2024-01-31T05:10:21.684859+0000","last_undegraded":"2024-01-31T05:10:21.684859+0000","last_fullsized":"2024-01-31T05:10:21.684859+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:17:01.913186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.685569+0000","last_change":"2024-01-31T05:09:20.581823+0000","last_active":"2024-01-31T05:10:21.685569+0000","last_peered":"2024-01-31T05:10:21.685569+0000","last_clean":"2024-01-31T05:10:21.685569+0000","last_became_active":"2024-01-31T05:09:20.581560+0000","last_became_peered":"2024-01-31T05:09:20.581560+0000","last_unstale":"2024-01-31T05:10:21.685569+0000","last_undegraded":"2024-01-31T05:10:21.685569+0000","last_fullsized":"2024-01-31T05:10:21.685569+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:48:50.057303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684214+0000","last_change":"2024-01-31T05:09:20.582477+0000","last_active":"2024-01-31T05:10:21.684214+0000","last_peered":"2024-01-31T05:10:21.684214+0000","last_clean":"2024-01-31T05:10:21.684214+0000","last_became_active":"2024-01-31T05:09:20.582051+0000","last_became_peered":"2024-01-31T05:09:20.582051+0000","last_unstale":"2024-01-31T05:10:21.684214+0000","last_undegraded":"2024-01-31T05:10:21.684214+0000","last_fullsized":"2024-01-31T05:10:21.684214+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:24:36.665707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684508+0000","last_change":"2024-01-31T05:09:20.587281+0000","last_active":"2024-01-31T05:10:21.684508+0000","last_peered":"2024-01-31T05:10:21.684508+0000","last_clean":"2024-01-31T05:10:21.684508+0000","last_became_active":"2024-01-31T05:09:20.586976+0000","last_became_peered":"2024-01-31T05:09:20.586976+0000","last_unstale":"2024-01-31T05:10:21.684508+0000","last_undegraded":"2024-01-31T05:10:21.684508+0000","last_fullsized":"2024-01-31T05:10:21.684508+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:33:59.065647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.679629+0000","last_change":"2024-01-31T05:09:20.585953+0000","last_active":"2024-01-31T05:10:21.679629+0000","last_peered":"2024-01-31T05:10:21.679629+0000","last_clean":"2024-01-31T05:10:21.679629+0000","last_became_active":"2024-01-31T05:09:20.585406+0000","last_became_peered":"2024-01-31T05:09:20.585406+0000","last_unstale":"2024-01-31T05:10:21.679629+0000","last_undegraded":"2024-01-31T05:10:21.679629+0000","last_fullsized":"2024-01-31T05:10:21.679629+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:14:24.622166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681454+0000","last_change":"2024-01-31T05:09:20.587073+0000","last_active":"2024-01-31T05:10:21.681454+0000","last_peered":"2024-01-31T05:10:21.681454+0000","last_clean":"2024-01-31T05:10:21.681454+0000","last_became_active":"2024-01-31T05:09:20.586753+0000","last_became_peered":"2024-01-31T05:09:20.586753+0000","last_unstale":"2024-01-31T05:10:21.681454+0000","last_undegraded":"2024-01-31T05:10:21.681454+0000","last_fullsized":"2024-01-31T05:10:21.681454+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:13:20.291390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67056,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":739,"num_read_kb":442,"num_write":231,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":201168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":203,"ondisk_log_size":203,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351005,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":970752,"data_stored":463487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:09:32 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.41799999999999998}]},{"osd":1,"last update":"Wed Jan 31 05:09:32 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.66800000000000004}]},{"osd":2,"last update":"Wed Jan 31 05:09:32 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.498}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":4,"last update":"Wed Jan 31 05:09:32 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.76900000000000002}]},{"osd":5,"last update":"Wed Jan 31 05:09:32 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.68400000000000005}]},{"osd":6,"last update":"Wed Jan 31 05:09:32 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.432},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.58999999999999997}]},{"osd":7,"last update":"Wed Jan 31 05:09:32 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.71899999999999997}]},{"osd":8,"last update":"Wed Jan 31 05:10:20 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.78200000000000003}]},{"osd":9,"last update":"Wed Jan 31 05:09:32 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.72999999999999998}]},{"osd":10,"last update":"Wed Jan 31 05:09:32 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.79400000000000004}]}]},{"osd":10,"up_from":73,"seq":313532612643,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36964,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708188,"statfs":{"total":95995035648,"available":95957184512,"internally_reserved":0,"allocated":1662976,"data_stored":1113868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":36174273},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:10:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.372}]},{"osd":1,"last update":"Wed Jan 31 05:10:11 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48599999999999999,"15min":0.48699999999999999},"min":{"1min":0.312,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.754,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.313},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.51000000000000001,"15min":0.51600000000000001},"min":{"1min":0.35799999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.77100000000000002,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.42799999999999999}]},{"osd":2,"last update":"Wed Jan 31 05:10:11 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59199999999999997,"15min":0.58699999999999997},"min":{"1min":0.42899999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.63300000000000001,"15min":0.63100000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.48399999999999999}]},{"osd":3,"last update":"Wed Jan 31 05:10:11 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.621,"15min":0.629},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.79500000000000004,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.65700000000000003,"15min":0.66200000000000003},"min":{"1min":0.46400000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.83099999999999996,"5min":1.115,"15min":1.115},"last":0.40500000000000003}]},{"osd":4,"last update":"Wed Jan 31 05:10:11 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55800000000000005,"15min":0.55600000000000005},"min":{"1min":0.41999999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.75900000000000001,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.34799999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.80300000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.29599999999999999}]},{"osd":5,"last update":"Wed Jan 31 05:10:11 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.66000000000000003,"15min":0.65400000000000003},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.65900000000000003,"15min":0.65300000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95699999999999996,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.54100000000000004}]},{"osd":6,"last update":"Wed Jan 31 05:10:11 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.71599999999999997,"15min":0.71999999999999997},"min":{"1min":0.46500000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.92200000000000004,"5min":1.022,"15min":1.022},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.72199999999999998,"15min":0.73199999999999998},"min":{"1min":0.51500000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.89000000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.44700000000000001}]},{"osd":7,"last update":"Wed Jan 31 05:09:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.57199999999999995}]},{"osd":8,"last update":"Wed Jan 31 05:10:11 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76200000000000001,"15min":0.76500000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78000000000000003,"15min":0.78200000000000003},"min":{"1min":0.57199999999999995,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0569999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.63400000000000001}]},{"osd":9,"last update":"Wed Jan 31 05:10:11 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.79500000000000004,"15min":0.80300000000000005},"min":{"1min":0.58199999999999996,"5min":0.44,"15min":0.44},"max":{"1min":0.90900000000000003,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.79700000000000004,"15min":0.80500000000000005},"min":{"1min":0.53700000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0169999999999999,"5min":1.452,"15min":1.452},"last":0.52200000000000002}]},{"osd":11,"last update":"Wed Jan 31 05:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.75,"15min":0.746},"min":{"1min":0.64500000000000002,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.90200000000000002,"5min":1.026,"15min":1.026},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77100000000000002,"15min":0.77000000000000002},"min":{"1min":0.61099999999999999,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.94199999999999995,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.61099999999999999}]}]},{"osd":9,"up_from":67,"seq":287762808871,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":462915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:09:44 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.42899999999999999,"15min":0.439},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.51700000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.375},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.54900000000000004,"15min":0.51500000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":7.8330000000000002,"5min":7.8330000000000002,"15min":7.8330000000000002},"last":0.40600000000000003}]},{"osd":1,"last update":"Wed Jan 31 05:09:44 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.61599999999999999,"15min":0.60499999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":2.661,"5min":2.661,"15min":2.661},"last":0.497},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.60599999999999998,"15min":0.61599999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76300000000000001,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.48799999999999999}]},{"osd":2,"last update":"Wed Jan 31 05:09:44 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.61699999999999999,"15min":0.60399999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":2.7810000000000001,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.61399999999999999,"15min":0.626},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.68999999999999995,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.61699999999999999}]},{"osd":3,"last update":"Wed Jan 31 05:09:44 2024","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":0.71399999999999997,"15min":0.60099999999999998},"min":{"1min":0.28299999999999997,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":19.687000000000001,"5min":19.687000000000001,"15min":19.687000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.59499999999999997,"15min":0.54500000000000004},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":10.478,"5min":10.478,"15min":10.478},"last":0.32900000000000001}]},{"osd":4,"last update":"Wed Jan 31 05:09:44 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.64800000000000002,"15min":0.65600000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.71099999999999997,"15min":0.66800000000000004},"min":{"1min":0.47499999999999998,"5min":0.434,"15min":0.434},"max":{"1min":8.2289999999999992,"5min":8.2289999999999992,"15min":8.2289999999999992},"last":0.51500000000000001}]},{"osd":5,"last update":"Wed Jan 31 05:09:44 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":0.755,"15min":0.70699999999999996},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":9.9339999999999993,"5min":9.9339999999999993,"15min":9.9339999999999993},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.71299999999999997,"15min":0.71499999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.8130000000000002,"5min":2.8130000000000002,"15min":2.8130000000000002},"last":0.70699999999999996}]},{"osd":6,"last update":"Wed Jan 31 05:09:44 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.63900000000000001,"15min":0.64500000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":3.141,"5min":3.141,"15min":3.141},"last":0.443},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71899999999999997,"15min":0.71999999999999997},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":2.9350000000000001,"5min":2.9350000000000001,"15min":2.9350000000000001},"last":0.52600000000000002}]},{"osd":7,"last update":"Wed Jan 31 05:09:44 2024","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":0.80400000000000005,"15min":0.76300000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":8.2639999999999993,"5min":8.2639999999999993,"15min":8.2639999999999993},"last":0.53900000000000003},{"interface":"front","average":{"1min":1.1279999999999999,"5min":0.84099999999999997,"15min":0.79300000000000004},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":10.438000000000001,"5min":10.438000000000001,"15min":10.438000000000001},"last":0.60199999999999998}]},{"osd":8,"last update":"Wed Jan 31 05:09:44 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.8889999999999998,"5min":2.8889999999999998,"15min":2.8889999999999998},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.494,"5min":0.93600000000000005,"15min":0.84299999999999997},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":17.093,"5min":17.093,"15min":17.093},"last":0.68100000000000005}]},{"osd":10,"last update":"Wed Jan 31 05:10:11 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.76700000000000002,"15min":0.77300000000000002},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.107,"5min":1.111,"15min":1.111},"last":0.57999999999999996},{"interface":"front","average":{"1min":1.1399999999999999,"5min":0.84099999999999997,"15min":0.79100000000000004},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":9.5899999999999999,"5min":9.5899999999999999,"15min":9.5899999999999999},"last":0.55600000000000005}]}]},{"osd":8,"up_from":59,"seq":253403070508,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":974848,"data_stored":463181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.60799999999999998,"15min":0.58799999999999997},"min":{"1min":0.373,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":3.5819999999999999,"5min":3.5819999999999999,"15min":3.5819999999999999},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.57499999999999996,"15min":0.58599999999999997},"min":{"1min":0.38800000000000001,"5min":0.316,"15min":0.316},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.41099999999999998}]},{"osd":1,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.63700000000000001,"15min":0.61299999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":2.7679999999999998,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.65800000000000003,"15min":0.63400000000000001},"min":{"1min":0.47699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":3.2389999999999999,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.61899999999999999}]},{"osd":2,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.48999999999999999,"15min":0.48399999999999999},"min":{"1min":0.32600000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.314},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.52900000000000003,"15min":0.51300000000000001},"min":{"1min":0.41799999999999998,"5min":0.251,"15min":0.251},"max":{"1min":3.9729999999999999,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":0.45200000000000001}]},{"osd":3,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.57899999999999996,"15min":0.58499999999999996},"min":{"1min":0.34100000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.374},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.64500000000000002,"15min":0.65100000000000002},"min":{"1min":0.435,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":2.8050000000000002,"5min":2.8050000000000002,"15min":2.8050000000000002},"last":0.42999999999999999}]},{"osd":4,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.68899999999999995,"15min":0.65100000000000002},"min":{"1min":0.51800000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":5.1820000000000004,"5min":5.1820000000000004,"15min":5.1820000000000004},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.68600000000000005,"15min":0.66400000000000003},"min":{"1min":0.56200000000000006,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":3.0150000000000001,"5min":3.0150000000000001,"15min":3.0150000000000001},"last":0.56899999999999995}]},{"osd":5,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.627,"15min":0.61899999999999999},"min":{"1min":0.48899999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":3.617,"5min":3.617,"15min":3.617},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.61299999999999999,"15min":0.60499999999999998},"min":{"1min":0.35899999999999999,"5min":0.317,"15min":0.317},"max":{"1min":2.9540000000000002,"5min":2.9540000000000002,"15min":2.9540000000000002},"last":0.50900000000000001}]},{"osd":6,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.70999999999999996,"15min":0.72099999999999997},"min":{"1min":0.47399999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":2.3740000000000001,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.74299999999999999,"15min":0.73799999999999999},"min":{"1min":0.54800000000000004,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":3.2749999999999999,"5min":3.2749999999999999,"15min":3.2749999999999999},"last":0.58899999999999997}]},{"osd":7,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":0.76900000000000002,"15min":0.73899999999999999},"min":{"1min":0.64100000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":4.1970000000000001,"5min":4.1970000000000001,"15min":4.1970000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.94699999999999995,"15min":0.79900000000000004},"min":{"1min":0.67900000000000005,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":2.181,"5min":19.677,"15min":19.677},"last":0.57999999999999996}]},{"osd":9,"last update":"Wed Jan 31 05:09:43 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":1.482,"15min":1.6040000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.823,"5min":19.695,"15min":19.695},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.71699999999999997,"15min":0.69099999999999995},"min":{"1min":0.52100000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":3.306,"5min":3.306,"15min":3.306},"last":0.64600000000000002}]},{"osd":10,"last update":"Wed Jan 31 05:10:08 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.747,"15min":0.70499999999999996},"min":{"1min":0.55000000000000004,"5min":0.439,"15min":0.439},"max":{"1min":4.3760000000000003,"5min":4.3760000000000003,"15min":4.3760000000000003},"last":0.63600000000000001},{"interface":"front","average":{"1min":1.1499999999999999,"5min":0.81100000000000005,"15min":0.755},"min":{"1min":0.56499999999999995,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":6.875,"5min":6.875,"15min":6.875},"last":0.627}]},{"osd":11,"last update":"Wed Jan 31 05:10:21 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.65600000000000003}]}]},{"osd":7,"up_from":51,"seq":219043332145,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28564,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716588,"statfs":{"total":95995035648,"available":95965786112,"internally_reserved":0,"allocated":1581056,"data_stored":1056200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:08:52 2024","interfaces":[{"interface":"back","average":{"1min":1.669,"5min":0.75600000000000001,"15min":0.60399999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":19.462,"5min":19.462,"15min":19.462},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.52900000000000003,"15min":0.51900000000000002},"min":{"1min":0.40899999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.45500000000000002}]},{"osd":1,"last update":"Wed Jan 31 05:09:54 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.42099999999999999,"15min":0.41299999999999998},"min":{"1min":0.30499999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.64700000000000002,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.377},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.45000000000000001,"15min":0.442},"min":{"1min":0.312,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.68899999999999995,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.40500000000000003}]},{"osd":2,"last update":"Wed Jan 31 05:09:54 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.59199999999999997,"15min":0.58499999999999996},"min":{"1min":0.35099999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.77300000000000002,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.501},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.60299999999999998,"15min":0.60199999999999998},"min":{"1min":0.35899999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.73699999999999999,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.48799999999999999}]},{"osd":3,"last update":"Wed Jan 31 05:09:54 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.56000000000000005,"15min":0.55300000000000005},"min":{"1min":0.40899999999999997,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.434},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57999999999999996,"15min":0.57699999999999996},"min":{"1min":0.40300000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.52700000000000002}]},{"osd":4,"last update":"Wed Jan 31 05:09:54 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.48799999999999999,"15min":0.47999999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.73199999999999998,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.35499999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.55200000000000005}]},{"osd":5,"last update":"Wed Jan 31 05:09:54 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.63400000000000001,"15min":0.627},"min":{"1min":0.44800000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.80000000000000004,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.64700000000000002,"15min":0.64300000000000002},"min":{"1min":0.439,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.85299999999999998,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.57799999999999996}]},{"osd":6,"last update":"Wed Jan 31 05:09:54 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63900000000000001,"15min":0.63100000000000001},"min":{"1min":0.46400000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.80000000000000004,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.88700000000000001,"15min":0.73199999999999998},"min":{"1min":0.48099999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.95799999999999996,"5min":19.425000000000001,"15min":19.425000000000001},"last":0.60599999999999998}]},{"osd":8,"last update":"Wed Jan 31 05:10:21 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.68799999999999994,"15min":0.68200000000000005},"min":{"1min":0.61799999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.85099999999999998,"5min":0.875,"15min":0.875},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.70799999999999996,"15min":0.71199999999999997},"min":{"1min":0.56899999999999995,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.85899999999999999,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.624}]},{"osd":9,"last update":"Wed Jan 31 05:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.71299999999999997,"15min":0.71399999999999997},"min":{"1min":0.51100000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.89700000000000002,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.69799999999999995,"15min":0.69499999999999995},"min":{"1min":0.57999999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.89400000000000002,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.69299999999999995}]},{"osd":10,"last update":"Wed Jan 31 05:10:13 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71399999999999997,"15min":0.71299999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.751},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.55100000000000005,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.88400000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.64300000000000002}]},{"osd":11,"last update":"Wed Jan 31 05:10:21 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.80000000000000004}]}]},{"osd":6,"up_from":46,"seq":197568495670,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":462632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:10:34 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.378,"15min":0.37},"min":{"1min":0.28100000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.53400000000000003,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.40600000000000003,"15min":0.40799999999999997},"min":{"1min":0.28499999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.33700000000000002}]},{"osd":1,"last update":"Wed Jan 31 05:10:34 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.54700000000000004,"15min":0.53900000000000003},"min":{"1min":0.40899999999999997,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56200000000000006,"15min":0.55400000000000005},"min":{"1min":0.42699999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.83599999999999997,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.377}]},{"osd":2,"last update":"Wed Jan 31 05:10:34 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.55400000000000005,"15min":0.55200000000000005},"min":{"1min":0.39000000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.77600000000000002,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.55200000000000005,"15min":0.54600000000000004},"min":{"1min":0.372,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73599999999999999,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":19.234000000000002}]},{"osd":3,"last update":"Wed Jan 31 05:10:34 2024","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.437,"15min":0.44700000000000001},"min":{"1min":0.30199999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.56100000000000005,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.47499999999999998,"15min":0.47999999999999998},"min":{"1min":0.316,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.61199999999999999,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.40899999999999997}]},{"osd":4,"last update":"Wed Jan 31 05:10:34 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.58499999999999996,"15min":0.59099999999999997},"min":{"1min":0.443,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58499999999999996,"15min":0.57599999999999996},"min":{"1min":0.41099999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.86199999999999999,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.44900000000000001}]},{"osd":5,"last update":"Wed Jan 31 05:10:34 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.44,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.70299999999999996,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.495},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.61399999999999999,"15min":0.63},"min":{"1min":0.42599999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.82099999999999995,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.60599999999999998}]},{"osd":7,"last update":"Wed Jan 31 05:09:56 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.71999999999999997,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.64800000000000002,"15min":0.64900000000000002},"min":{"1min":0.48199999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.71699999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.52400000000000002}]},{"osd":8,"last update":"Wed Jan 31 05:10:17 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.67100000000000004,"15min":0.68700000000000006},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81399999999999995,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.747,"15min":0.79400000000000004},"min":{"1min":0.48599999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.80200000000000005,"5min":3.3130000000000002,"15min":3.3130000000000002},"last":0.53400000000000003}]},{"osd":9,"last update":"Wed Jan 31 05:09:45 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.68100000000000005,"15min":0.70199999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82099999999999995,"5min":1,"15min":1},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.65700000000000003,"15min":0.67400000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.48399999999999999}]},{"osd":10,"last update":"Wed Jan 31 05:10:10 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.75900000000000001,"15min":0.77400000000000002},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.83899999999999997,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.74399999999999999,"15min":0.753},"min":{"1min":0.58299999999999996,"5min":0.501,"15min":0.501},"max":{"1min":0.878,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.55700000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32192,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712960,"statfs":{"total":95995035648,"available":95962071040,"internally_reserved":0,"allocated":1032192,"data_stored":523009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:10:34 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51800000000000002,"15min":0.49399999999999999},"min":{"1min":0.36199999999999999,"5min":0.29999999999999999,"15min":0.29399999999999998},"max":{"1min":0.76600000000000001,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.55100000000000005,"15min":0.51700000000000002},"min":{"1min":0.39200000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.84399999999999997,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.51700000000000002}]},{"osd":2,"last update":"Wed Jan 31 05:09:56 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.56899999999999995,"15min":0.52400000000000002},"min":{"1min":0.43099999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.55100000000000005,"15min":0.50900000000000001},"min":{"1min":0.44400000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.42199999999999999}]},{"osd":3,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.52100000000000002,"15min":0.49399999999999999},"min":{"1min":0.40899999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.56699999999999995,"15min":0.51200000000000001},"min":{"1min":0.496,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.91600000000000004,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.65000000000000002}]},{"osd":4,"last update":"Wed Jan 31 05:09:45 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.45300000000000001,"15min":0.437},"min":{"1min":0.29199999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.46700000000000003,"15min":0.44500000000000001},"min":{"1min":0.314,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.36299999999999999}]},{"osd":5,"last update":"Wed Jan 31 05:10:07 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.60299999999999998,"15min":0.55900000000000005},"min":{"1min":0.505,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.60899999999999999,"15min":0.56999999999999995},"min":{"1min":0.41199999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.57099999999999995}]},{"osd":6,"last update":"Wed Jan 31 05:10:34 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.59699999999999998,"15min":0.58499999999999996},"min":{"1min":0.48199999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83899999999999997,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.65000000000000002,"15min":0.61899999999999999},"min":{"1min":0.54100000000000004,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.98899999999999999,"5min":0.998,"15min":0.998},"last":0.55300000000000005}]},{"osd":7,"last update":"Wed Jan 31 05:09:56 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.60099999999999998,"15min":0.57999999999999996},"min":{"1min":0.35199999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.046,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.437},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.60099999999999998,"15min":0.59499999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.502}]},{"osd":8,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.69899999999999995,"15min":0.67300000000000004},"min":{"1min":0.51200000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.69199999999999995,"15min":0.66900000000000004},"min":{"1min":0.58999999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.59699999999999998}]},{"osd":9,"last update":"Wed Jan 31 05:09:45 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.74099999999999999,"15min":0.73899999999999999},"min":{"1min":0.54400000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69499999999999995,"15min":0.69299999999999995},"min":{"1min":0.48599999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.95599999999999996,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.622}]},{"osd":10,"last update":"Wed Jan 31 05:10:12 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.754,"15min":0.74399999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.75,"15min":0.74299999999999999},"min":{"1min":0.497,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.66600000000000004}]},{"osd":11,"last update":"Wed Jan 31 05:10:25 2024","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.69099999999999995}]}]},{"osd":0,"up_from":8,"seq":34359738452,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":464361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 31 05:10:33 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":0.62,"15min":0.56100000000000005},"min":{"1min":0.40500000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":9.5289999999999999,"5min":9.5289999999999999,"15min":9.5289999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54700000000000004,"15min":0.53300000000000003},"min":{"1min":0.38700000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.74399999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.61399999999999999}]},{"osd":2,"last update":"Wed Jan 31 05:10:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.55800000000000005,"15min":0.54700000000000004},"min":{"1min":0.36499999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76700000000000002,"5min":0.873,"15min":0.873},"last":0.70099999999999996},{"interface":"front","average":{"1min":1.0269999999999999,"5min":0.747,"15min":0.626},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":9.4990000000000006,"5min":9.4990000000000006,"15min":9.4990000000000006},"last":0.77200000000000002}]},{"osd":3,"last update":"Wed Jan 31 05:10:23 2024","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.44},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.41299999999999998}]},{"osd":4,"last update":"Wed Jan 31 05:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53700000000000003,"15min":0.52200000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.54900000000000004,"15min":0.51300000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.73299999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.58599999999999997}]},{"osd":5,"last update":"Wed Jan 31 05:10:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56399999999999995,"15min":0.54900000000000004},"min":{"1min":0.41199999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.75900000000000001,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.67100000000000004},{"interface":"front","average":{"1min":1.167,"5min":0.79900000000000004,"15min":0.64700000000000002},"min":{"1min":0.37,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":9.5489999999999995,"5min":9.5489999999999995,"15min":9.5489999999999995},"last":0.73399999999999999}]},{"osd":6,"last update":"Wed Jan 31 05:10:33 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.49399999999999999,"15min":0.51100000000000001},"min":{"1min":0.317,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.75700000000000001,"5min":0.878,"15min":0.878},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.503,"5min":0.51000000000000001,"15min":0.51400000000000001},"min":{"1min":0.308,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.46700000000000003}]},{"osd":7,"last update":"Wed Jan 31 05:08:59 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.627,"15min":0.622},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80900000000000005,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.64400000000000002,"15min":0.64200000000000002},"min":{"1min":0.47899999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.81699999999999995,"5min":0.874,"15min":0.874},"last":0.54600000000000004}]},{"osd":8,"last update":"Wed Jan 31 05:10:23 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.71899999999999997,"15min":0.67500000000000004},"min":{"1min":0.40000000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.133,"5min":9.2840000000000007,"15min":9.2840000000000007},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70199999999999996,"15min":0.71999999999999997},"min":{"1min":0.52500000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.85399999999999998,"5min":1.006,"15min":1.006},"last":0.749}]},{"osd":9,"last update":"Wed Jan 31 05:09:41 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.67300000000000004,"15min":0.69499999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.78600000000000003,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.66200000000000003,"15min":0.68500000000000005},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.57299999999999995}]},{"osd":10,"last update":"Wed Jan 31 05:10:13 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.65100000000000002,"15min":0.65700000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.78900000000000003,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.69799999999999995,"15min":0.70399999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.65100000000000002}]},{"osd":11,"last update":"Wed Jan 31 05:10:33 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.65100000000000002,"15min":0.64300000000000002},"min":{"1min":0.56100000000000005,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.79400000000000004,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71499999999999997,"15min":0.71399999999999997},"min":{"1min":0.57499999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.84599999999999997,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.71699999999999997}]}]},{"osd":2,"up_from":18,"seq":77309411402,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1052672,"data_stored":524009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:09:55 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.51700000000000002,"15min":0.47899999999999998},"min":{"1min":0.42999999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.52000000000000002,"15min":0.499},"min":{"1min":0.39600000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.79400000000000004,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.54000000000000004}]},{"osd":1,"last update":"Wed Jan 31 05:09:55 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.54000000000000004,"15min":0.51400000000000001},"min":{"1min":0.378,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.56299999999999994,"15min":0.52800000000000002},"min":{"1min":0.36699999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.56499999999999995}]},{"osd":3,"last update":"Wed Jan 31 05:10:22 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.57199999999999995,"15min":0.53000000000000003},"min":{"1min":0.48699999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57199999999999995,"15min":0.53800000000000003},"min":{"1min":0.41099999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.753,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.878}]},{"osd":4,"last update":"Wed Jan 31 05:10:22 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.59999999999999998}]},{"osd":5,"last update":"Wed Jan 31 05:10:02 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.44400000000000001,"15min":0.41499999999999998},"min":{"1min":0.32400000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.46200000000000002,"15min":0.441},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.89500000000000002}]},{"osd":6,"last update":"Wed Jan 31 05:10:34 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.61399999999999999,"15min":0.56200000000000006},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.89700000000000002,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.60299999999999998,"15min":0.57699999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.747}]},{"osd":7,"last update":"Wed Jan 31 05:08:55 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.77600000000000002,"15min":0.80300000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.77000000000000002,"5min":3.9449999999999998,"15min":3.9449999999999998},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.78600000000000003,"15min":0.80900000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.80600000000000005,"5min":4.1230000000000002,"15min":4.1230000000000002},"last":0.44}]},{"osd":8,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.58699999999999997,"15min":0.57499999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.63700000000000001,"15min":0.625},"min":{"1min":0.38100000000000001,"5min":0.37,"15min":0.37},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.78000000000000003}]},{"osd":9,"last update":"Wed Jan 31 05:09:47 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.47599999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90000000000000002,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.47399999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.80000000000000004}]},{"osd":10,"last update":"Wed Jan 31 05:10:09 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68999999999999995,"15min":0.69299999999999995},"min":{"1min":0.51400000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.879,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.71899999999999997,"15min":0.70599999999999996},"min":{"1min":0.57499999999999996,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.94999999999999996}]},{"osd":11,"last update":"Wed Jan 31 05:10:22 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.99199999999999999}]}]},{"osd":3,"up_from":25,"seq":107374182468,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":987136,"data_stored":462457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:10:25 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.36099999999999999,"15min":0.32300000000000001},"min":{"1min":0.25600000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.38700000000000001,"15min":0.34699999999999998},"min":{"1min":0.23899999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.30399999999999999}]},{"osd":1,"last update":"Wed Jan 31 05:10:25 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.54600000000000004,"15min":0.51200000000000001},"min":{"1min":0.42799999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.54000000000000004,"15min":0.50700000000000001},"min":{"1min":0.32600000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.373}]},{"osd":2,"last update":"Wed Jan 31 05:10:25 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.56999999999999995,"15min":0.51300000000000001},"min":{"1min":0.44,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.55200000000000005,"15min":0.51700000000000002},"min":{"1min":0.35599999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.53000000000000003}]},{"osd":4,"last update":"Wed Jan 31 05:09:46 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54800000000000004,"15min":0.52200000000000002},"min":{"1min":0.34799999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.57199999999999995,"15min":0.52000000000000002},"min":{"1min":0.37,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.45100000000000001}]},{"osd":5,"last update":"Wed Jan 31 05:10:10 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.42999999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60599999999999998,"15min":0.58499999999999996},"min":{"1min":0.46400000000000002,"5min":0.371,"15min":0.371},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.54500000000000004}]},{"osd":6,"last update":"Wed Jan 31 05:10:33 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.51400000000000001,"15min":0.47599999999999998},"min":{"1min":0.318,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":2.5600000000000001,"5min":2.5600000000000001,"15min":2.5600000000000001},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.51000000000000001,"15min":0.48599999999999999},"min":{"1min":0.34399999999999997,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.7210000000000001,"5min":2.7210000000000001,"15min":2.7210000000000001},"last":0.35699999999999998}]},{"osd":7,"last update":"Wed Jan 31 05:09:55 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67200000000000004,"15min":0.65400000000000003},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65800000000000003,"15min":0.64800000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.499}]},{"osd":8,"last update":"Wed Jan 31 05:08:16 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.68200000000000005}]},{"osd":9,"last update":"Wed Jan 31 05:09:42 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.72399999999999998,"15min":0.72999999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.0630000000000002,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66200000000000003,"15min":0.66400000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":2.2919999999999998,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.46600000000000003}]},{"osd":10,"last update":"Wed Jan 31 05:10:10 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.71899999999999997,"15min":0.72799999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.79000000000000004,"15min":0.80100000000000005},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.60799999999999998}]},{"osd":11,"last update":"Wed Jan 31 05:10:25 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.55700000000000005}]}]},{"osd":4,"up_from":33,"seq":141733920832,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":970752,"data_stored":462883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.502,"15min":0.497},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.51900000000000002,"15min":0.51600000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.51300000000000001}]},{"osd":1,"last update":"Wed Jan 31 05:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.375,"15min":0.34499999999999997},"min":{"1min":0.311,"5min":0.245,"15min":0.245},"max":{"1min":0.67400000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.40000000000000002,"15min":0.376},"min":{"1min":0.28299999999999997,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.64000000000000001,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.49199999999999999}]},{"osd":2,"last update":"Wed Jan 31 05:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.56100000000000005,"15min":0.53900000000000003},"min":{"1min":0.46400000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.79700000000000004,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.58199999999999996,"15min":0.53700000000000003},"min":{"1min":0.498,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.89100000000000001}]},{"osd":3,"last update":"Wed Jan 31 05:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.56799999999999995,"15min":0.54100000000000004},"min":{"1min":0.40799999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.77400000000000002,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.54700000000000004,"15min":0.54100000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86199999999999999,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.52500000000000002}]},{"osd":5,"last update":"Wed Jan 31 05:10:04 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.57299999999999995,"15min":0.54100000000000004},"min":{"1min":0.42599999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.86199999999999999,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.59299999999999997,"15min":0.55000000000000004},"min":{"1min":0.48299999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.83299999999999996,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.65400000000000003}]},{"osd":6,"last update":"Wed Jan 31 05:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.60499999999999998,"15min":0.58299999999999996},"min":{"1min":0.44800000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.79400000000000004,"5min":0.87,"15min":0.87},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.59899999999999998,"15min":0.58699999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.85799999999999998,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.60899999999999999}]},{"osd":7,"last update":"Wed Jan 31 05:09:52 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.56599999999999995,"15min":0.54400000000000004},"min":{"1min":0.39300000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.85599999999999998,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.40799999999999997,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.80900000000000005,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.57399999999999995}]},{"osd":8,"last update":"Wed Jan 31 05:10:23 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.68000000000000005,"15min":0.67200000000000004},"min":{"1min":0.48599999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.753},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.68400000000000005,"15min":0.66900000000000004},"min":{"1min":0.495,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89300000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.79800000000000004}]},{"osd":9,"last update":"Wed Jan 31 05:09:45 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71299999999999997,"15min":0.71099999999999997},"min":{"1min":0.53400000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.71399999999999997,"15min":0.70699999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.78300000000000003}]},{"osd":10,"last update":"Wed Jan 31 05:10:11 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.745,"15min":0.74199999999999999},"min":{"1min":0.55900000000000005,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.76500000000000001,"15min":0.76600000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.76900000000000002}]},{"osd":11,"last update":"Wed Jan 31 05:10:23 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.871},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.82699999999999996}]}]},{"osd":5,"up_from":38,"seq":163208757307,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32736,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712416,"statfs":{"total":95995035648,"available":95961513984,"internally_reserved":0,"allocated":1593344,"data_stored":1055488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:10:07 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.51100000000000001,"15min":0.47499999999999998},"min":{"1min":0.31,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.746,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.502},"min":{"1min":0.35199999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.749,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.46999999999999997}]},{"osd":1,"last update":"Wed Jan 31 05:10:07 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.55100000000000005,"15min":0.52700000000000002},"min":{"1min":0.38,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56599999999999995,"15min":0.55200000000000005},"min":{"1min":0.42199999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.77800000000000002,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.40500000000000003}]},{"osd":2,"last update":"Wed Jan 31 05:10:07 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.41499999999999998,"15min":0.39700000000000002},"min":{"1min":0.30099999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.628,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.437,"5min":0.41999999999999998,"15min":0.41599999999999998},"min":{"1min":0.28399999999999997,"5min":0.247,"15min":0.247},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.32000000000000001}]},{"osd":3,"last update":"Wed Jan 31 05:10:07 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56100000000000005,"15min":0.53100000000000003},"min":{"1min":0.35699999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.81000000000000005,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56100000000000005,"15min":0.53600000000000003},"min":{"1min":0.46100000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.77800000000000002,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.44500000000000001}]},{"osd":4,"last update":"Wed Jan 31 05:10:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.61799999999999999,"15min":0.60099999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.82199999999999995,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.496},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.63100000000000001,"15min":0.60899999999999999},"min":{"1min":0.48399999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.89300000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.57199999999999995}]},{"osd":6,"last update":"Wed Jan 31 05:10:32 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59399999999999997,"15min":0.57999999999999996},"min":{"1min":0.38700000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.82499999999999996,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60399999999999998,"15min":0.59299999999999997},"min":{"1min":0.437,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.75800000000000001,"5min":0.873,"15min":0.873},"last":0.53300000000000003}]},{"osd":7,"last update":"Wed Jan 31 05:09:53 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.62,"15min":0.59799999999999998},"min":{"1min":0.47299999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.65700000000000003,"15min":0.64300000000000002},"min":{"1min":0.54500000000000004,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.80900000000000005,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.55800000000000005}]},{"osd":8,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.36599999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.77500000000000002,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58199999999999996,"15min":0.58399999999999996},"min":{"1min":0.39600000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.79500000000000004,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.372}]},{"osd":9,"last update":"Wed Jan 31 05:09:45 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.68500000000000005,"15min":0.68200000000000005},"min":{"1min":0.47399999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.91600000000000004,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68500000000000005,"15min":0.68300000000000005},"min":{"1min":0.47399999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.48499999999999999}]},{"osd":10,"last update":"Wed Jan 31 05:10:14 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.69099999999999995,"15min":0.68300000000000005},"min":{"1min":0.56799999999999995,"5min":0.497,"15min":0.497},"max":{"1min":0.92100000000000004,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.72699999999999998,"15min":0.71899999999999997},"min":{"1min":0.60499999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.94099999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.57799999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":61216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":61590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-31T05:10:43.043 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-01-31T05:10:43.043 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-01-31T05:10:43.043 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-01-31T05:10:43.043 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph health --format=json 2024-01-31T05:10:43.287 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:10:43.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:43 smithi099 ceph-mon[31615]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-31T05:10:43.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:43 smithi099 ceph-mon[31615]: pgmap v329: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-01-31T05:10:43.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:43 smithi181 ceph-mon[36434]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-31T05:10:43.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:43 smithi181 ceph-mon[36434]: pgmap v329: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-01-31T05:10:43.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:43 smithi179 ceph-mon[35652]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-31T05:10:43.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:43 smithi179 ceph-mon[35652]: pgmap v329: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-01-31T05:10:44.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:44.958+0000 7f5e091b7700 1 -- 172.21.15.99:0/1188722444 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e040ffdd0 msgr2=0x7f5e04100250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:44.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:44.958+0000 7f5e091b7700 1 --2- 172.21.15.99:0/1188722444 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e040ffdd0 0x7f5e04100250 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5df8009990 tx=0x7f5df8009ca0 comp rx=0 tx=0).stop 2024-01-31T05:10:44.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:44.958+0000 7f5e091b7700 1 -- 172.21.15.99:0/1188722444 shutdown_connections 2024-01-31T05:10:44.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:44.958+0000 7f5e091b7700 1 --2- 172.21.15.99:0/1188722444 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e04100790 0x7f5e0410e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:44.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:44.958+0000 7f5e091b7700 1 --2- 172.21.15.99:0/1188722444 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5e04106850 0x7f5e04106c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:44.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:44.958+0000 7f5e091b7700 1 --2- 172.21.15.99:0/1188722444 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e040ffdd0 0x7f5e04100250 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:44.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:44.958+0000 7f5e091b7700 1 -- 172.21.15.99:0/1188722444 >> 172.21.15.99:0/1188722444 conn(0x7f5e04076ce0 msgr2=0x7f5e040fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:44.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:44.958+0000 7f5e091b7700 1 -- 172.21.15.99:0/1188722444 shutdown_connections 2024-01-31T05:10:44.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:44.958+0000 7f5e091b7700 1 -- 172.21.15.99:0/1188722444 wait complete. 2024-01-31T05:10:44.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:44.959+0000 7f5e091b7700 1 Processor -- start 2024-01-31T05:10:44.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:44.959+0000 7f5e091b7700 1 -- start start 2024-01-31T05:10:44.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:44.959+0000 7f5e091b7700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e040ffdd0 0x7f5e04197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:44.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:44.959+0000 7f5e091b7700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5e04100790 0x7f5e04198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:44.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:44.959+0000 7f5e091b7700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e04106850 0x7f5e0419c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:44.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:44.959+0000 7f5e091b7700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0419cd20 con 0x7f5e04106850 2024-01-31T05:10:44.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:44.959+0000 7f5e091b7700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0419ce90 con 0x7f5e040ffdd0 2024-01-31T05:10:44.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:44.959+0000 7f5e091b7700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0419d050 con 0x7f5e04100790 2024-01-31T05:10:44.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:44.959+0000 7f5e0359e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e04106850 0x7f5e0419c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:44.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:44.959+0000 7f5e0359e700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e04106850 0x7f5e0419c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40900/0 (socket says 172.21.15.99:40900) 2024-01-31T05:10:44.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:44.959+0000 7f5e0359e700 1 -- 172.21.15.99:0/2291831249 learned_addr learned my addr 172.21.15.99:0/2291831249 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:44.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:44.959+0000 7f5e02d9d700 1 --2- 172.21.15.99:0/2291831249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e040ffdd0 0x7f5e04197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:44.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:44.959+0000 7f5e0259c700 1 --2- 172.21.15.99:0/2291831249 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5e04100790 0x7f5e04198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:44.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:44.960+0000 7f5e0359e700 1 -- 172.21.15.99:0/2291831249 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5e04100790 msgr2=0x7f5e04198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:44.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:44.960+0000 7f5e0359e700 1 --2- 172.21.15.99:0/2291831249 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5e04100790 0x7f5e04198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:44.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:44.960+0000 7f5e0359e700 1 -- 172.21.15.99:0/2291831249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e040ffdd0 msgr2=0x7f5e04197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:44.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:44.960+0000 7f5e0359e700 1 --2- 172.21.15.99:0/2291831249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e040ffdd0 0x7f5e04197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:44.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:44.960+0000 7f5e0359e700 1 -- 172.21.15.99:0/2291831249 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df80095f0 con 0x7f5e04106850 2024-01-31T05:10:44.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:44.960+0000 7f5e0359e700 1 --2- 172.21.15.99:0/2291831249 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e04106850 0x7f5e0419c710 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc0094f0 tx=0x7f5dfc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:44.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:44.960+0000 7f5debfff700 1 -- 172.21.15.99:0/2291831249 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc004db0 con 0x7f5e04106850 2024-01-31T05:10:44.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:44.960+0000 7f5e091b7700 1 -- 172.21.15.99:0/2291831249 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e0419d330 con 0x7f5e04106850 2024-01-31T05:10:44.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:44.960+0000 7f5debfff700 1 -- 172.21.15.99:0/2291831249 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5dfc00f040 con 0x7f5e04106850 2024-01-31T05:10:44.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:44.960+0000 7f5debfff700 1 -- 172.21.15.99:0/2291831249 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc005980 con 0x7f5e04106850 2024-01-31T05:10:44.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:44.960+0000 7f5e091b7700 1 -- 172.21.15.99:0/2291831249 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e041a4b90 con 0x7f5e04106850 2024-01-31T05:10:44.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:44.961+0000 7f5e091b7700 1 -- 172.21.15.99:0/2291831249 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e04109e40 con 0x7f5e04106850 2024-01-31T05:10:44.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:44.962+0000 7f5debfff700 1 -- 172.21.15.99:0/2291831249 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f5dfc005020 con 0x7f5e04106850 2024-01-31T05:10:44.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:44.962+0000 7f5debfff700 1 --2- 172.21.15.99:0/2291831249 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f5dec0a1400 0x7f5dec0a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:44.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:44.963+0000 7f5e02d9d700 1 --2- 172.21.15.99:0/2291831249 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f5dec0a1400 0x7f5dec0a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:44.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:44.963+0000 7f5debfff700 1 -- 172.21.15.99:0/2291831249 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f5dfc0cc4a0 con 0x7f5e04106850 2024-01-31T05:10:44.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:44.963+0000 7f5e02d9d700 1 --2- 172.21.15.99:0/2291831249 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f5dec0a1400 0x7f5dec0a38c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5df4009a10 tx=0x7f5df4009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:44.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:44.967+0000 7f5debfff700 1 -- 172.21.15.99:0/2291831249 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f5dfc0958e0 con 0x7f5e04106850 2024-01-31T05:10:45.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:45.205+0000 7f5e091b7700 1 -- 172.21.15.99:0/2291831249 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f5e041991a0 con 0x7f5e04106850 2024-01-31T05:10:45.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:45.205+0000 7f5debfff700 1 -- 172.21.15.99:0/2291831249 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f5dfc098f00 con 0x7f5e04106850 2024-01-31T05:10:45.205 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:10:45.205 INFO:teuthology.orchestra.run.smithi099.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-01-31T05:10:45.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:45.207+0000 7f5e091b7700 1 -- 172.21.15.99:0/2291831249 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f5dec0a1400 msgr2=0x7f5dec0a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:45.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:45.207+0000 7f5e091b7700 1 --2- 172.21.15.99:0/2291831249 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f5dec0a1400 0x7f5dec0a38c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5df4009a10 tx=0x7f5df4009190 comp rx=0 tx=0).stop 2024-01-31T05:10:45.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:45.207+0000 7f5e091b7700 1 -- 172.21.15.99:0/2291831249 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e04106850 msgr2=0x7f5e0419c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:45.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:45.207+0000 7f5e091b7700 1 --2- 172.21.15.99:0/2291831249 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e04106850 0x7f5e0419c710 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc0094f0 tx=0x7f5dfc00d3b0 comp rx=0 tx=0).stop 2024-01-31T05:10:45.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:45.207+0000 7f5e091b7700 1 -- 172.21.15.99:0/2291831249 shutdown_connections 2024-01-31T05:10:45.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:45.208+0000 7f5e091b7700 1 --2- 172.21.15.99:0/2291831249 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e04106850 0x7f5e0419c710 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:45.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:45.208+0000 7f5e091b7700 1 --2- 172.21.15.99:0/2291831249 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f5dec0a1400 0x7f5dec0a38c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:45.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:45.208+0000 7f5e091b7700 1 --2- 172.21.15.99:0/2291831249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e040ffdd0 0x7f5e04197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:45.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:45.208+0000 7f5e091b7700 1 --2- 172.21.15.99:0/2291831249 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5e04100790 0x7f5e04198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:45.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:45.208+0000 7f5e091b7700 1 -- 172.21.15.99:0/2291831249 >> 172.21.15.99:0/2291831249 conn(0x7f5e04076ce0 msgr2=0x7f5e041049b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:45.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:45.208+0000 7f5e091b7700 1 -- 172.21.15.99:0/2291831249 shutdown_connections 2024-01-31T05:10:45.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:45.208+0000 7f5e091b7700 1 -- 172.21.15.99:0/2291831249 wait complete. 2024-01-31T05:10:45.896 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:45 smithi099 ceph-mon[31615]: pgmap v330: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-01-31T05:10:45.896 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:45 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/2291831249' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-01-31T05:10:45.923 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-01-31T05:10:45.924 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:10:46.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.029+0000 7f269a61d640 1 -- 172.21.15.99:0/3546926618 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f26941017b0 msgr2=0x7f2694103ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:46.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.029+0000 7f269a61d640 1 --2- 172.21.15.99:0/3546926618 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f26941017b0 0x7f2694103ba0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2684009900 tx=0x7f268402bc30 comp rx=0 tx=0).stop 2024-01-31T05:10:46.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.029+0000 7f269a61d640 1 -- 172.21.15.99:0/3546926618 shutdown_connections 2024-01-31T05:10:46.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.029+0000 7f269a61d640 1 --2- 172.21.15.99:0/3546926618 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2694106a10 0x7f2694108e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:46.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.029+0000 7f269a61d640 1 --2- 172.21.15.99:0/3546926618 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26941040e0 0x7f26941064d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:46.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.029+0000 7f269a61d640 1 --2- 172.21.15.99:0/3546926618 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f26941017b0 0x7f2694103ba0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:46.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.029+0000 7f269a61d640 1 -- 172.21.15.99:0/3546926618 >> 172.21.15.99:0/3546926618 conn(0x7f26940fb1a0 msgr2=0x7f26940fd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:46.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.029+0000 7f269a61d640 1 -- 172.21.15.99:0/3546926618 shutdown_connections 2024-01-31T05:10:46.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.029+0000 7f269a61d640 1 -- 172.21.15.99:0/3546926618 wait complete. 2024-01-31T05:10:46.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.029+0000 7f269a61d640 1 Processor -- start 2024-01-31T05:10:46.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.030+0000 7f269a61d640 1 -- start start 2024-01-31T05:10:46.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.030+0000 7f269a61d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f26941017b0 0x7f2694196d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:46.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.030+0000 7f269a61d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26941040e0 0x7f26941972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:46.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.030+0000 7f269a61d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2694106a10 0x7f269419e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:46.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.030+0000 7f269a61d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269419e860 con 0x7f26941017b0 2024-01-31T05:10:46.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.030+0000 7f269a61d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269419e9d0 con 0x7f2694106a10 2024-01-31T05:10:46.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.030+0000 7f269a61d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269419eb90 con 0x7f26941040e0 2024-01-31T05:10:46.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.030+0000 7f2693fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f26941017b0 0x7f2694196d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:46.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.030+0000 7f2693fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f26941017b0 0x7f2694196d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44856/0 (socket says 172.21.15.99:44856) 2024-01-31T05:10:46.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.030+0000 7f2693fff640 1 -- 172.21.15.99:0/1565974241 learned_addr learned my addr 172.21.15.99:0/1565974241 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:46.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.030+0000 7f2698bba640 1 --2- 172.21.15.99:0/1565974241 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2694106a10 0x7f269419e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:46.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.030+0000 7f2693fff640 1 -- 172.21.15.99:0/1565974241 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26941040e0 msgr2=0x7f26941972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:46.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.030+0000 7f2693fff640 1 --2- 172.21.15.99:0/1565974241 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26941040e0 0x7f26941972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:46.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.030+0000 7f2693fff640 1 -- 172.21.15.99:0/1565974241 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2694106a10 msgr2=0x7f269419e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:46.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.030+0000 7f2693fff640 1 --2- 172.21.15.99:0/1565974241 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2694106a10 0x7f269419e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:46.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.030+0000 7f2693fff640 1 -- 172.21.15.99:0/1565974241 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2684009560 con 0x7f26941017b0 2024-01-31T05:10:46.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.030+0000 7f2693fff640 1 --2- 172.21.15.99:0/1565974241 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f26941017b0 0x7f2694196d70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2684009230 tx=0x7f2684004ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:46.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.031+0000 7f26917fa640 1 -- 172.21.15.99:0/1565974241 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26840043d0 con 0x7f26941017b0 2024-01-31T05:10:46.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.031+0000 7f26917fa640 1 -- 172.21.15.99:0/1565974241 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f26840054c0 con 0x7f26941017b0 2024-01-31T05:10:46.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.031+0000 7f269a61d640 1 -- 172.21.15.99:0/1565974241 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f269419ee10 con 0x7f26941017b0 2024-01-31T05:10:46.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.031+0000 7f26917fa640 1 -- 172.21.15.99:0/1565974241 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268403e450 con 0x7f26941017b0 2024-01-31T05:10:46.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.031+0000 7f269a61d640 1 -- 172.21.15.99:0/1565974241 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f269419f310 con 0x7f26941017b0 2024-01-31T05:10:46.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.032+0000 7f269a61d640 1 -- 172.21.15.99:0/1565974241 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26940fcc90 con 0x7f26941017b0 2024-01-31T05:10:46.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.033+0000 7f26917fa640 1 -- 172.21.15.99:0/1565974241 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f26840035f0 con 0x7f26941017b0 2024-01-31T05:10:46.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.033+0000 7f26917fa640 1 --2- 172.21.15.99:0/1565974241 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f267c0a1370 0x7f267c0a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:46.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.033+0000 7f26937fe640 1 --2- 172.21.15.99:0/1565974241 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f267c0a1370 0x7f267c0a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:46.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.033+0000 7f26917fa640 1 -- 172.21.15.99:0/1565974241 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f26840ef490 con 0x7f26941017b0 2024-01-31T05:10:46.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.034+0000 7f26937fe640 1 --2- 172.21.15.99:0/1565974241 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f267c0a1370 0x7f267c0a3830 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2694198280 tx=0x7f2688006c90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:46.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.037+0000 7f26917fa640 1 -- 172.21.15.99:0/1565974241 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f26840b8b00 con 0x7f26941017b0 2024-01-31T05:10:46.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:45 smithi181 ceph-mon[36434]: pgmap v330: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-01-31T05:10:46.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:45 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/2291831249' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-01-31T05:10:46.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:45 smithi179 ceph-mon[35652]: pgmap v330: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-01-31T05:10:46.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:45 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/2291831249' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-01-31T05:10:46.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.210+0000 7f269a61d640 1 -- 172.21.15.99:0/1565974241 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f269402cb10 con 0x7f26941017b0 2024-01-31T05:10:46.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.212+0000 7f26917fa640 1 -- 172.21.15.99:0/1565974241 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22426 (secure 0 0 0) 0x7f2684043020 con 0x7f26941017b0 2024-01-31T05:10:46.211 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:10:46.212 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":88,"fsid":"9288ff44-bff5-11ee-95b3-87774f69a715","created":"2024-01-31T05:01:26.130917+0000","modified":"2024-01-31T05:10:21.675877+0000","last_up_change":"2024-01-31T05:08:31.228478+0000","last_in_change":"2024-01-31T05:08:10.799511+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:46.842423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:09:18.693558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-31T05:09:19.734003+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b45878d9-28f1-4821-ba72-26a32d3fc780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6803","nonce":1213805280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6805","nonce":1213805280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6809","nonce":1213805280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6807","nonce":1213805280}]},"public_addr":"172.21.15.99:6803/1213805280","cluster_addr":"172.21.15.99:6805/1213805280","heartbeat_back_addr":"172.21.15.99:6809/1213805280","heartbeat_front_addr":"172.21.15.99:6807/1213805280","state":["exists","up"]},{"osd":1,"uuid":"e0b71ff3-5d97-4659-8dea-4c9091e1beb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6801","nonce":2019451677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6803","nonce":2019451677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6807","nonce":2019451677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6805","nonce":2019451677}]},"public_addr":"172.21.15.179:6801/2019451677","cluster_addr":"172.21.15.179:6803/2019451677","heartbeat_back_addr":"172.21.15.179:6807/2019451677","heartbeat_front_addr":"172.21.15.179:6805/2019451677","state":["exists","up"]},{"osd":2,"uuid":"11c919c8-19a9-48b0-8880-3002efcb64f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6801","nonce":3934284457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6803","nonce":3934284457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6807","nonce":3934284457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6805","nonce":3934284457}]},"public_addr":"172.21.15.181:6801/3934284457","cluster_addr":"172.21.15.181:6803/3934284457","heartbeat_back_addr":"172.21.15.181:6807/3934284457","heartbeat_front_addr":"172.21.15.181:6805/3934284457","state":["exists","up"]},{"osd":3,"uuid":"bcab5135-a5d1-45ae-a9b8-674425d3999e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6811","nonce":4207675427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6813","nonce":4207675427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6817","nonce":4207675427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6815","nonce":4207675427}]},"public_addr":"172.21.15.99:6811/4207675427","cluster_addr":"172.21.15.99:6813/4207675427","heartbeat_back_addr":"172.21.15.99:6817/4207675427","heartbeat_front_addr":"172.21.15.99:6815/4207675427","state":["exists","up"]},{"osd":4,"uuid":"0250d7ac-3894-457a-9c04-cc7205d61eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6809","nonce":2861083896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6811","nonce":2861083896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6815","nonce":2861083896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6813","nonce":2861083896}]},"public_addr":"172.21.15.179:6809/2861083896","cluster_addr":"172.21.15.179:6811/2861083896","heartbeat_back_addr":"172.21.15.179:6815/2861083896","heartbeat_front_addr":"172.21.15.179:6813/2861083896","state":["exists","up"]},{"osd":5,"uuid":"5e19222a-c2a4-45bc-8445-1d302f26d11c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6809","nonce":1485017095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6811","nonce":1485017095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6815","nonce":1485017095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6813","nonce":1485017095}]},"public_addr":"172.21.15.181:6809/1485017095","cluster_addr":"172.21.15.181:6811/1485017095","heartbeat_back_addr":"172.21.15.181:6815/1485017095","heartbeat_front_addr":"172.21.15.181:6813/1485017095","state":["exists","up"]},{"osd":6,"uuid":"56555035-f9fc-4e91-96dd-caa632d58adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6819","nonce":1534047839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6821","nonce":1534047839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6825","nonce":1534047839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6823","nonce":1534047839}]},"public_addr":"172.21.15.99:6819/1534047839","cluster_addr":"172.21.15.99:6821/1534047839","heartbeat_back_addr":"172.21.15.99:6825/1534047839","heartbeat_front_addr":"172.21.15.99:6823/1534047839","state":["exists","up"]},{"osd":7,"uuid":"5e079cf5-1340-4599-88a6-df410ef0148e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6817","nonce":3875950553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6819","nonce":3875950553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6823","nonce":3875950553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6821","nonce":3875950553}]},"public_addr":"172.21.15.179:6817/3875950553","cluster_addr":"172.21.15.179:6819/3875950553","heartbeat_back_addr":"172.21.15.179:6823/3875950553","heartbeat_front_addr":"172.21.15.179:6821/3875950553","state":["exists","up"]},{"osd":8,"uuid":"10a73592-4251-4492-b67d-ce9b9d7fff32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6817","nonce":179568936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6819","nonce":179568936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6823","nonce":179568936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6821","nonce":179568936}]},"public_addr":"172.21.15.181:6817/179568936","cluster_addr":"172.21.15.181:6819/179568936","heartbeat_back_addr":"172.21.15.181:6823/179568936","heartbeat_front_addr":"172.21.15.181:6821/179568936","state":["exists","up"]},{"osd":9,"uuid":"f6620e1e-f761-4f1c-917f-cbc748df32a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6827","nonce":315759515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6829","nonce":315759515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6833","nonce":315759515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6831","nonce":315759515}]},"public_addr":"172.21.15.99:6827/315759515","cluster_addr":"172.21.15.99:6829/315759515","heartbeat_back_addr":"172.21.15.99:6833/315759515","heartbeat_front_addr":"172.21.15.99:6831/315759515","state":["exists","up"]},{"osd":10,"uuid":"ee86af7d-66f8-4795-bcc3-dfec79e4680c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6825","nonce":2985063934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6827","nonce":2985063934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6831","nonce":2985063934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6829","nonce":2985063934}]},"public_addr":"172.21.15.179:6825/2985063934","cluster_addr":"172.21.15.179:6827/2985063934","heartbeat_back_addr":"172.21.15.179:6831/2985063934","heartbeat_front_addr":"172.21.15.179:6829/2985063934","state":["exists","up"]},{"osd":11,"uuid":"82f04fee-f6ae-4630-a75b-b12a9c4ab2e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6825","nonce":1858219600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6827","nonce":1858219600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6831","nonce":1858219600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6829","nonce":1858219600}]},"public_addr":"172.21.15.181:6825/1858219600","cluster_addr":"172.21.15.181:6827/1858219600","heartbeat_back_addr":"172.21.15.181:6831/1858219600","heartbeat_front_addr":"172.21.15.181:6829/1858219600","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:55.518970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:04:19.936339+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:04:44.064814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:09.331683+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:34.616774+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:58.881810+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:06:23.869838+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:06:49.127331+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:07:12.847187+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:07:38.231045+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:08:03.949162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:08:28.471802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:0/401101729":"2024-02-01T05:02:20.510858+0000","172.21.15.99:6801/1993198206":"2024-02-01T05:02:20.510858+0000","172.21.15.99:0/3819754569":"2024-02-01T05:02:20.510858+0000","172.21.15.99:0/475390265":"2024-02-01T05:01:53.732026+0000","172.21.15.99:6800/1993198206":"2024-02-01T05:02:20.510858+0000","172.21.15.99:6800/1706888338":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/4150146075":"2024-02-01T05:01:53.732026+0000","172.21.15.99:6801/1706888338":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/2851066598":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/1865156424":"2024-02-01T05:02:20.510858+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:10:46.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.214+0000 7f269a61d640 1 -- 172.21.15.99:0/1565974241 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f267c0a1370 msgr2=0x7f267c0a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:46.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.214+0000 7f269a61d640 1 --2- 172.21.15.99:0/1565974241 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f267c0a1370 0x7f267c0a3830 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2694198280 tx=0x7f2688006c90 comp rx=0 tx=0).stop 2024-01-31T05:10:46.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.214+0000 7f269a61d640 1 -- 172.21.15.99:0/1565974241 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f26941017b0 msgr2=0x7f2694196d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:46.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.214+0000 7f269a61d640 1 --2- 172.21.15.99:0/1565974241 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f26941017b0 0x7f2694196d70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2684009230 tx=0x7f2684004ee0 comp rx=0 tx=0).stop 2024-01-31T05:10:46.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.214+0000 7f269a61d640 1 -- 172.21.15.99:0/1565974241 shutdown_connections 2024-01-31T05:10:46.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.214+0000 7f269a61d640 1 --2- 172.21.15.99:0/1565974241 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f267c0a1370 0x7f267c0a3830 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:46.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.214+0000 7f269a61d640 1 --2- 172.21.15.99:0/1565974241 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2694106a10 0x7f269419e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:46.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.214+0000 7f269a61d640 1 --2- 172.21.15.99:0/1565974241 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26941040e0 0x7f26941972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:46.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.214+0000 7f269a61d640 1 --2- 172.21.15.99:0/1565974241 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f26941017b0 0x7f2694196d70 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:46.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.214+0000 7f269a61d640 1 -- 172.21.15.99:0/1565974241 >> 172.21.15.99:0/1565974241 conn(0x7f26940fb1a0 msgr2=0x7f26941022f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:46.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.214+0000 7f269a61d640 1 -- 172.21.15.99:0/1565974241 shutdown_connections 2024-01-31T05:10:46.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.214+0000 7f269a61d640 1 -- 172.21.15.99:0/1565974241 wait complete. 2024-01-31T05:10:46.225 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-31T05:04:46.842423+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-31T05:09:18.693558+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-31T05:09:19.734003+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-31T05:10:46.225 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-31T05:10:46.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.331+0000 7f97605d0640 1 -- 172.21.15.99:0/1776304989 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9758108bd0 msgr2=0x7f975810b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:46.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.331+0000 7f97605d0640 1 --2- 172.21.15.99:0/1776304989 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9758108bd0 0x7f975810b060 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9750009900 tx=0x7f975002bcd0 comp rx=0 tx=0).stop 2024-01-31T05:10:46.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.332+0000 7f97605d0640 1 -- 172.21.15.99:0/1776304989 shutdown_connections 2024-01-31T05:10:46.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.332+0000 7f97605d0640 1 --2- 172.21.15.99:0/1776304989 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9758108bd0 0x7f975810b060 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:46.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.332+0000 7f97605d0640 1 --2- 172.21.15.99:0/1776304989 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97580736d0 0x7f9758073b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:46.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.332+0000 7f97605d0640 1 --2- 172.21.15.99:0/1776304989 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9758074cb0 0x7f9758073100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:46.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.332+0000 7f97605d0640 1 -- 172.21.15.99:0/1776304989 >> 172.21.15.99:0/1776304989 conn(0x7f97580fc290 msgr2=0x7f97580fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:46.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.332+0000 7f97605d0640 1 -- 172.21.15.99:0/1776304989 shutdown_connections 2024-01-31T05:10:46.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.332+0000 7f97605d0640 1 -- 172.21.15.99:0/1776304989 wait complete. 2024-01-31T05:10:46.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.332+0000 7f97605d0640 1 Processor -- start 2024-01-31T05:10:46.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.332+0000 7f97605d0640 1 -- start start 2024-01-31T05:10:46.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.332+0000 7f97605d0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97580736d0 0x7f9758198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:46.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.332+0000 7f97605d0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9758074cb0 0x7f97581993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:46.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.332+0000 7f97605d0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9758108bd0 0x7f97581a0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:46.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.332+0000 7f97605d0640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97581a0980 con 0x7f9758074cb0 2024-01-31T05:10:46.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.332+0000 7f97605d0640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97581a0af0 con 0x7f9758108bd0 2024-01-31T05:10:46.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.332+0000 7f97605d0640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97581a0cb0 con 0x7f97580736d0 2024-01-31T05:10:46.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.332+0000 7f975db6b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9758074cb0 0x7f97581993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:46.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.333+0000 7f975db6b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9758074cb0 0x7f97581993d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44870/0 (socket says 172.21.15.99:44870) 2024-01-31T05:10:46.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.333+0000 7f975db6b640 1 -- 172.21.15.99:0/2279796516 learned_addr learned my addr 172.21.15.99:0/2279796516 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:46.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.333+0000 7f975e36c640 1 --2- 172.21.15.99:0/2279796516 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97580736d0 0x7f9758198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:46.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.333+0000 7f975eb6d640 1 --2- 172.21.15.99:0/2279796516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9758108bd0 0x7f97581a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:46.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.333+0000 7f975db6b640 1 -- 172.21.15.99:0/2279796516 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97580736d0 msgr2=0x7f9758198e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:46.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.333+0000 7f975db6b640 1 --2- 172.21.15.99:0/2279796516 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97580736d0 0x7f9758198e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:46.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.333+0000 7f975db6b640 1 -- 172.21.15.99:0/2279796516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9758108bd0 msgr2=0x7f97581a0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:46.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.333+0000 7f975db6b640 1 --2- 172.21.15.99:0/2279796516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9758108bd0 0x7f97581a0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:46.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.333+0000 7f975db6b640 1 -- 172.21.15.99:0/2279796516 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9750009560 con 0x7f9758074cb0 2024-01-31T05:10:46.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.333+0000 7f975eb6d640 1 --2- 172.21.15.99:0/2279796516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9758108bd0 0x7f97581a0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:10:46.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.333+0000 7f975e36c640 1 --2- 172.21.15.99:0/2279796516 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97580736d0 0x7f9758198e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:10:46.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.333+0000 7f975db6b640 1 --2- 172.21.15.99:0/2279796516 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9758074cb0 0x7f97581993d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f974800d950 tx=0x7f974800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:46.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.333+0000 7f974f7fe640 1 -- 172.21.15.99:0/2279796516 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9748009c30 con 0x7f9758074cb0 2024-01-31T05:10:46.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.333+0000 7f974f7fe640 1 -- 172.21.15.99:0/2279796516 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9748009d90 con 0x7f9758074cb0 2024-01-31T05:10:46.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.333+0000 7f97605d0640 1 -- 172.21.15.99:0/2279796516 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97581a0f90 con 0x7f9758074cb0 2024-01-31T05:10:46.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.333+0000 7f974f7fe640 1 -- 172.21.15.99:0/2279796516 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974800f740 con 0x7f9758074cb0 2024-01-31T05:10:46.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.333+0000 7f97605d0640 1 -- 172.21.15.99:0/2279796516 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97581a1410 con 0x7f9758074cb0 2024-01-31T05:10:46.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.334+0000 7f97605d0640 1 -- 172.21.15.99:0/2279796516 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9758107990 con 0x7f9758074cb0 2024-01-31T05:10:46.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.335+0000 7f974f7fe640 1 -- 172.21.15.99:0/2279796516 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f9748010a20 con 0x7f9758074cb0 2024-01-31T05:10:46.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.335+0000 7f974f7fe640 1 --2- 172.21.15.99:0/2279796516 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f97440a1370 0x7f97440a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:46.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.336+0000 7f975e36c640 1 --2- 172.21.15.99:0/2279796516 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f97440a1370 0x7f97440a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:46.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.336+0000 7f974f7fe640 1 -- 172.21.15.99:0/2279796516 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f97480cc8b0 con 0x7f9758074cb0 2024-01-31T05:10:46.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.336+0000 7f975e36c640 1 --2- 172.21.15.99:0/2279796516 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f97440a1370 0x7f97440a3830 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9754005fd0 tx=0x7f9754009520 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:46.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.340+0000 7f974f7fe640 1 -- 172.21.15.99:0/2279796516 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f9748095cf0 con 0x7f9758074cb0 2024-01-31T05:10:46.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.509+0000 7f97605d0640 1 -- 172.21.15.99:0/2279796516 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f975810e9f0 con 0x7f9758074cb0 2024-01-31T05:10:46.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.509+0000 7f974f7fe640 1 -- 172.21.15.99:0/2279796516 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9748099310 con 0x7f9758074cb0 2024-01-31T05:10:46.509 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-01-31T05:10:46.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.511+0000 7f97605d0640 1 -- 172.21.15.99:0/2279796516 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f97440a1370 msgr2=0x7f97440a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:46.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.511+0000 7f97605d0640 1 --2- 172.21.15.99:0/2279796516 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f97440a1370 0x7f97440a3830 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9754005fd0 tx=0x7f9754009520 comp rx=0 tx=0).stop 2024-01-31T05:10:46.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.511+0000 7f97605d0640 1 -- 172.21.15.99:0/2279796516 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9758074cb0 msgr2=0x7f97581993d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:46.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.511+0000 7f97605d0640 1 --2- 172.21.15.99:0/2279796516 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9758074cb0 0x7f97581993d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f974800d950 tx=0x7f974800de10 comp rx=0 tx=0).stop 2024-01-31T05:10:46.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.511+0000 7f97605d0640 1 -- 172.21.15.99:0/2279796516 shutdown_connections 2024-01-31T05:10:46.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.511+0000 7f97605d0640 1 --2- 172.21.15.99:0/2279796516 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f97440a1370 0x7f97440a3830 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:46.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.511+0000 7f97605d0640 1 --2- 172.21.15.99:0/2279796516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9758108bd0 0x7f97581a0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:46.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.511+0000 7f97605d0640 1 --2- 172.21.15.99:0/2279796516 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9758074cb0 0x7f97581993d0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:46.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.511+0000 7f97605d0640 1 --2- 172.21.15.99:0/2279796516 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97580736d0 0x7f9758198e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:46.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.511+0000 7f97605d0640 1 -- 172.21.15.99:0/2279796516 >> 172.21.15.99:0/2279796516 conn(0x7f97580fc290 msgr2=0x7f9758104b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:46.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.511+0000 7f97605d0640 1 -- 172.21.15.99:0/2279796516 shutdown_connections 2024-01-31T05:10:46.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.511+0000 7f97605d0640 1 -- 172.21.15.99:0/2279796516 wait complete. 2024-01-31T05:10:46.522 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-31T05:10:46.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.627+0000 7f9945f2b640 1 -- 172.21.15.99:0/1132481231 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99401040b0 msgr2=0x7f99401064a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:46.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.627+0000 7f9945f2b640 1 --2- 172.21.15.99:0/1132481231 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99401040b0 0x7f99401064a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9934009900 tx=0x7f993402bc30 comp rx=0 tx=0).stop 2024-01-31T05:10:46.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.627+0000 7f9945f2b640 1 -- 172.21.15.99:0/1132481231 shutdown_connections 2024-01-31T05:10:46.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.627+0000 7f9945f2b640 1 --2- 172.21.15.99:0/1132481231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99401069e0 0x7f9940108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:46.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.627+0000 7f9945f2b640 1 --2- 172.21.15.99:0/1132481231 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99401040b0 0x7f99401064a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:46.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.627+0000 7f9945f2b640 1 --2- 172.21.15.99:0/1132481231 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9940101780 0x7f9940103b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:46.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.627+0000 7f9945f2b640 1 -- 172.21.15.99:0/1132481231 >> 172.21.15.99:0/1132481231 conn(0x7f99400fb190 msgr2=0x7f99400fd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:46.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.627+0000 7f9945f2b640 1 -- 172.21.15.99:0/1132481231 shutdown_connections 2024-01-31T05:10:46.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.627+0000 7f9945f2b640 1 -- 172.21.15.99:0/1132481231 wait complete. 2024-01-31T05:10:46.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.628+0000 7f9945f2b640 1 Processor -- start 2024-01-31T05:10:46.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.628+0000 7f9945f2b640 1 -- start start 2024-01-31T05:10:46.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.628+0000 7f9945f2b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9940101780 0x7f9940196da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:46.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.628+0000 7f9945f2b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99401040b0 0x7f99401972e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:46.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.628+0000 7f9945f2b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99401069e0 0x7f994019e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:46.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.628+0000 7f9945f2b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994019e880 con 0x7f99401069e0 2024-01-31T05:10:46.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.628+0000 7f9945f2b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994019e9f0 con 0x7f99401040b0 2024-01-31T05:10:46.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.628+0000 7f9945f2b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994019ebb0 con 0x7f9940101780 2024-01-31T05:10:46.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.628+0000 7f993ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99401069e0 0x7f994019e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:46.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.628+0000 7f993ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99401069e0 0x7f994019e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44890/0 (socket says 172.21.15.99:44890) 2024-01-31T05:10:46.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.628+0000 7f993ffff640 1 -- 172.21.15.99:0/4071523603 learned_addr learned my addr 172.21.15.99:0/4071523603 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:46.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.628+0000 7f993effd640 1 --2- 172.21.15.99:0/4071523603 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99401040b0 0x7f99401972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:46.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.628+0000 7f993ffff640 1 -- 172.21.15.99:0/4071523603 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9940101780 msgr2=0x7f9940196da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:46.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.628+0000 7f993f7fe640 1 --2- 172.21.15.99:0/4071523603 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9940101780 0x7f9940196da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:46.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.629+0000 7f993ffff640 1 --2- 172.21.15.99:0/4071523603 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9940101780 0x7f9940196da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:46.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.629+0000 7f993ffff640 1 -- 172.21.15.99:0/4071523603 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99401040b0 msgr2=0x7f99401972e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:46.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.629+0000 7f993ffff640 1 --2- 172.21.15.99:0/4071523603 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99401040b0 0x7f99401972e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:46.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.629+0000 7f993ffff640 1 -- 172.21.15.99:0/4071523603 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9934009560 con 0x7f99401069e0 2024-01-31T05:10:46.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.629+0000 7f993effd640 1 --2- 172.21.15.99:0/4071523603 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99401040b0 0x7f99401972e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:10:46.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.629+0000 7f993ffff640 1 --2- 172.21.15.99:0/4071523603 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99401069e0 0x7f994019e310 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f993800b970 tx=0x7f993800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:46.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.629+0000 7f993cff9640 1 -- 172.21.15.99:0/4071523603 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993800cb40 con 0x7f99401069e0 2024-01-31T05:10:46.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.629+0000 7f993cff9640 1 -- 172.21.15.99:0/4071523603 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f993800cca0 con 0x7f99401069e0 2024-01-31T05:10:46.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.629+0000 7f993cff9640 1 -- 172.21.15.99:0/4071523603 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9938007770 con 0x7f99401069e0 2024-01-31T05:10:46.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.629+0000 7f9945f2b640 1 -- 172.21.15.99:0/4071523603 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f994019ee90 con 0x7f99401069e0 2024-01-31T05:10:46.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.629+0000 7f9945f2b640 1 -- 172.21.15.99:0/4071523603 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f994019f330 con 0x7f99401069e0 2024-01-31T05:10:46.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.630+0000 7f9945f2b640 1 -- 172.21.15.99:0/4071523603 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99400fcc80 con 0x7f99401069e0 2024-01-31T05:10:46.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.631+0000 7f993cff9640 1 -- 172.21.15.99:0/4071523603 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f9938014440 con 0x7f99401069e0 2024-01-31T05:10:46.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.631+0000 7f993cff9640 1 --2- 172.21.15.99:0/4071523603 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f99280a1370 0x7f99280a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:46.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.631+0000 7f993f7fe640 1 --2- 172.21.15.99:0/4071523603 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f99280a1370 0x7f99280a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:46.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.632+0000 7f993cff9640 1 -- 172.21.15.99:0/4071523603 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f99380cc440 con 0x7f99401069e0 2024-01-31T05:10:46.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.632+0000 7f993f7fe640 1 --2- 172.21.15.99:0/4071523603 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f99280a1370 0x7f99280a3830 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f99300058c0 tx=0x7f9930005c80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:46.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.636+0000 7f993cff9640 1 -- 172.21.15.99:0/4071523603 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f993804f600 con 0x7f99401069e0 2024-01-31T05:10:46.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.809+0000 7f9945f2b640 1 -- 172.21.15.99:0/4071523603 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f994002cca0 con 0x7f99401069e0 2024-01-31T05:10:46.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.810+0000 7f993cff9640 1 -- 172.21.15.99:0/4071523603 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9938095900 con 0x7f99401069e0 2024-01-31T05:10:46.809 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-01-31T05:10:46.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.812+0000 7f9945f2b640 1 -- 172.21.15.99:0/4071523603 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f99280a1370 msgr2=0x7f99280a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:46.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.812+0000 7f9945f2b640 1 --2- 172.21.15.99:0/4071523603 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f99280a1370 0x7f99280a3830 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f99300058c0 tx=0x7f9930005c80 comp rx=0 tx=0).stop 2024-01-31T05:10:46.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.812+0000 7f9945f2b640 1 -- 172.21.15.99:0/4071523603 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99401069e0 msgr2=0x7f994019e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:46.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.812+0000 7f9945f2b640 1 --2- 172.21.15.99:0/4071523603 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99401069e0 0x7f994019e310 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f993800b970 tx=0x7f993800be30 comp rx=0 tx=0).stop 2024-01-31T05:10:46.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.812+0000 7f9945f2b640 1 -- 172.21.15.99:0/4071523603 shutdown_connections 2024-01-31T05:10:46.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.812+0000 7f9945f2b640 1 --2- 172.21.15.99:0/4071523603 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f99280a1370 0x7f99280a3830 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:46.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.812+0000 7f9945f2b640 1 --2- 172.21.15.99:0/4071523603 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99401069e0 0x7f994019e310 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:46.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.812+0000 7f9945f2b640 1 --2- 172.21.15.99:0/4071523603 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99401040b0 0x7f99401972e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:46.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.812+0000 7f9945f2b640 1 --2- 172.21.15.99:0/4071523603 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9940101780 0x7f9940196da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:46.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.812+0000 7f9945f2b640 1 -- 172.21.15.99:0/4071523603 >> 172.21.15.99:0/4071523603 conn(0x7f99400fb190 msgr2=0x7f9940102100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:46.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.812+0000 7f9945f2b640 1 -- 172.21.15.99:0/4071523603 shutdown_connections 2024-01-31T05:10:46.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.812+0000 7f9945f2b640 1 -- 172.21.15.99:0/4071523603 wait complete. 2024-01-31T05:10:46.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:46 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/1565974241' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:10:46.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:46 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/2279796516' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-31T05:10:46.822 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-31T05:10:46.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.927+0000 7f3021c3e640 1 -- 172.21.15.99:0/3551185116 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f301c1011a0 msgr2=0x7f301c1015c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:46.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.927+0000 7f3021c3e640 1 --2- 172.21.15.99:0/3551185116 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f301c1011a0 0x7f301c1015c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f300c009930 tx=0x7f300c02bc30 comp rx=0 tx=0).stop 2024-01-31T05:10:46.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.928+0000 7f3021c3e640 1 -- 172.21.15.99:0/3551185116 shutdown_connections 2024-01-31T05:10:46.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.928+0000 7f3021c3e640 1 --2- 172.21.15.99:0/3551185116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f301c100890 0x7f301c108130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:46.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.928+0000 7f3021c3e640 1 --2- 172.21.15.99:0/3551185116 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f301c0ffed0 0x7f301c100350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:46.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.928+0000 7f3021c3e640 1 --2- 172.21.15.99:0/3551185116 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f301c1011a0 0x7f301c1015c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:46.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.928+0000 7f3021c3e640 1 -- 172.21.15.99:0/3551185116 >> 172.21.15.99:0/3551185116 conn(0x7f301c0fa920 msgr2=0x7f301c0fcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:46.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.928+0000 7f3021c3e640 1 -- 172.21.15.99:0/3551185116 shutdown_connections 2024-01-31T05:10:46.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.928+0000 7f3021c3e640 1 -- 172.21.15.99:0/3551185116 wait complete. 2024-01-31T05:10:46.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.928+0000 7f3021c3e640 1 Processor -- start 2024-01-31T05:10:46.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.928+0000 7f3021c3e640 1 -- start start 2024-01-31T05:10:46.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.929+0000 7f3021c3e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f301c0ffed0 0x7f301c196d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:46.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.929+0000 7f3021c3e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f301c100890 0x7f301c1972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:46.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.929+0000 7f3021c3e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f301c1011a0 0x7f301c19e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:46.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.929+0000 7f3021c3e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f301c19e860 con 0x7f301c1011a0 2024-01-31T05:10:46.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.929+0000 7f3021c3e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f301c19e9d0 con 0x7f301c100890 2024-01-31T05:10:46.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.929+0000 7f3021c3e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f301c19eb90 con 0x7f301c0ffed0 2024-01-31T05:10:46.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.929+0000 7f301bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f301c1011a0 0x7f301c19e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:46.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.929+0000 7f301bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f301c1011a0 0x7f301c19e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44900/0 (socket says 172.21.15.99:44900) 2024-01-31T05:10:46.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.929+0000 7f301bfff640 1 -- 172.21.15.99:0/1036312218 learned_addr learned my addr 172.21.15.99:0/1036312218 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:46.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.929+0000 7f301b7fe640 1 --2- 172.21.15.99:0/1036312218 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f301c0ffed0 0x7f301c196d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:46.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.929+0000 7f301affd640 1 --2- 172.21.15.99:0/1036312218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f301c100890 0x7f301c1972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:46.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.929+0000 7f301bfff640 1 -- 172.21.15.99:0/1036312218 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f301c0ffed0 msgr2=0x7f301c196d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:46.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.929+0000 7f301bfff640 1 --2- 172.21.15.99:0/1036312218 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f301c0ffed0 0x7f301c196d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:46.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.929+0000 7f301bfff640 1 -- 172.21.15.99:0/1036312218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f301c100890 msgr2=0x7f301c1972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:46.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.929+0000 7f301bfff640 1 --2- 172.21.15.99:0/1036312218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f301c100890 0x7f301c1972b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:46.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.929+0000 7f301bfff640 1 -- 172.21.15.99:0/1036312218 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f300c009560 con 0x7f301c1011a0 2024-01-31T05:10:46.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.929+0000 7f301bfff640 1 --2- 172.21.15.99:0/1036312218 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f301c1011a0 0x7f301c19e320 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f301400cad0 tx=0x7f301400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:46.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.929+0000 7f3018ff9640 1 -- 172.21.15.99:0/1036312218 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301400ae20 con 0x7f301c1011a0 2024-01-31T05:10:46.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.929+0000 7f3018ff9640 1 -- 172.21.15.99:0/1036312218 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3014005020 con 0x7f301c1011a0 2024-01-31T05:10:46.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.929+0000 7f3021c3e640 1 -- 172.21.15.99:0/1036312218 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f301c19ee70 con 0x7f301c1011a0 2024-01-31T05:10:46.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.929+0000 7f3018ff9640 1 -- 172.21.15.99:0/1036312218 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301400f6b0 con 0x7f301c1011a0 2024-01-31T05:10:46.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.929+0000 7f3021c3e640 1 -- 172.21.15.99:0/1036312218 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f301c19f2a0 con 0x7f301c1011a0 2024-01-31T05:10:46.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.930+0000 7f3021c3e640 1 -- 172.21.15.99:0/1036312218 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f301c1071d0 con 0x7f301c1011a0 2024-01-31T05:10:46.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.931+0000 7f3018ff9640 1 -- 172.21.15.99:0/1036312218 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f3014005190 con 0x7f301c1011a0 2024-01-31T05:10:46.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.932+0000 7f3018ff9640 1 --2- 172.21.15.99:0/1036312218 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f30040a1370 0x7f30040a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:46.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.932+0000 7f301b7fe640 1 --2- 172.21.15.99:0/1036312218 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f30040a1370 0x7f30040a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:46.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.932+0000 7f3018ff9640 1 -- 172.21.15.99:0/1036312218 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f30140ccc80 con 0x7f301c1011a0 2024-01-31T05:10:46.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.932+0000 7f301b7fe640 1 --2- 172.21.15.99:0/1036312218 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f30040a1370 0x7f30040a3830 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f300c02c6b0 tx=0x7f300c02c5d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:46.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:46.936+0000 7f3018ff9640 1 -- 172.21.15.99:0/1036312218 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f30140960c0 con 0x7f301c1011a0 2024-01-31T05:10:47.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:46 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/1565974241' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:10:47.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:46 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/2279796516' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-31T05:10:47.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.110+0000 7f3021c3e640 1 -- 172.21.15.99:0/1036312218 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f301c10c7f0 con 0x7f301c1011a0 2024-01-31T05:10:47.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.110+0000 7f3018ff9640 1 -- 172.21.15.99:0/1036312218 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f301401d0a0 con 0x7f301c1011a0 2024-01-31T05:10:47.110 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 64 2024-01-31T05:10:47.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.112+0000 7f3021c3e640 1 -- 172.21.15.99:0/1036312218 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f30040a1370 msgr2=0x7f30040a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:47.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.112+0000 7f3021c3e640 1 --2- 172.21.15.99:0/1036312218 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f30040a1370 0x7f30040a3830 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f300c02c6b0 tx=0x7f300c02c5d0 comp rx=0 tx=0).stop 2024-01-31T05:10:47.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.112+0000 7f3021c3e640 1 -- 172.21.15.99:0/1036312218 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f301c1011a0 msgr2=0x7f301c19e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:47.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.112+0000 7f3021c3e640 1 --2- 172.21.15.99:0/1036312218 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f301c1011a0 0x7f301c19e320 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f301400cad0 tx=0x7f301400cf90 comp rx=0 tx=0).stop 2024-01-31T05:10:47.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.112+0000 7f3021c3e640 1 -- 172.21.15.99:0/1036312218 shutdown_connections 2024-01-31T05:10:47.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.112+0000 7f3021c3e640 1 --2- 172.21.15.99:0/1036312218 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f30040a1370 0x7f30040a3830 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:47.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.112+0000 7f3021c3e640 1 --2- 172.21.15.99:0/1036312218 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f301c1011a0 0x7f301c19e320 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:47.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.112+0000 7f3021c3e640 1 --2- 172.21.15.99:0/1036312218 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f301c100890 0x7f301c1972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:47.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.112+0000 7f3021c3e640 1 --2- 172.21.15.99:0/1036312218 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f301c0ffed0 0x7f301c196d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:47.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.112+0000 7f3021c3e640 1 -- 172.21.15.99:0/1036312218 >> 172.21.15.99:0/1036312218 conn(0x7f301c0fa920 msgr2=0x7f301c1043a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:47.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.112+0000 7f3021c3e640 1 -- 172.21.15.99:0/1036312218 shutdown_connections 2024-01-31T05:10:47.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.112+0000 7f3021c3e640 1 -- 172.21.15.99:0/1036312218 wait complete. 2024-01-31T05:10:47.123 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T05:10:47.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:46 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/1565974241' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:10:47.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:46 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/2279796516' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-31T05:10:47.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.226+0000 7f9dacf42640 1 -- 172.21.15.99:0/1563460846 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9da80ff750 msgr2=0x7f9da8109300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:47.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.226+0000 7f9dacf42640 1 --2- 172.21.15.99:0/1563460846 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9da80ff750 0x7f9da8109300 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9da0009ca0 tx=0x7f9da002c0f0 comp rx=0 tx=0).stop 2024-01-31T05:10:47.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.226+0000 7f9dacf42640 1 -- 172.21.15.99:0/1563460846 shutdown_connections 2024-01-31T05:10:47.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.226+0000 7f9dacf42640 1 --2- 172.21.15.99:0/1563460846 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9da80ff750 0x7f9da8109300 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:47.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.226+0000 7f9dacf42640 1 --2- 172.21.15.99:0/1563460846 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9da80fed90 0x7f9da80ff210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:47.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.226+0000 7f9dacf42640 1 --2- 172.21.15.99:0/1563460846 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9da8102320 0x7f9da8102740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:47.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.226+0000 7f9dacf42640 1 -- 172.21.15.99:0/1563460846 >> 172.21.15.99:0/1563460846 conn(0x7f9da80fa930 msgr2=0x7f9da80fcd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:47.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.226+0000 7f9dacf42640 1 -- 172.21.15.99:0/1563460846 shutdown_connections 2024-01-31T05:10:47.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.226+0000 7f9dacf42640 1 -- 172.21.15.99:0/1563460846 wait complete. 2024-01-31T05:10:47.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.227+0000 7f9dacf42640 1 Processor -- start 2024-01-31T05:10:47.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.227+0000 7f9dacf42640 1 -- start start 2024-01-31T05:10:47.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.227+0000 7f9dacf42640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9da80fed90 0x7f9da8196ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:47.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.227+0000 7f9dacf42640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9da80ff750 0x7f9da81971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:47.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.227+0000 7f9dacf42640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9da8102320 0x7f9da819e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:47.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.227+0000 7f9dacf42640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da819e7b0 con 0x7f9da8102320 2024-01-31T05:10:47.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.227+0000 7f9dacf42640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da819e920 con 0x7f9da80fed90 2024-01-31T05:10:47.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.227+0000 7f9dacf42640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da819eae0 con 0x7f9da80ff750 2024-01-31T05:10:47.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.227+0000 7f9da6d9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9da8102320 0x7f9da819e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:47.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.227+0000 7f9da6d9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9da8102320 0x7f9da819e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44922/0 (socket says 172.21.15.99:44922) 2024-01-31T05:10:47.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.227+0000 7f9da6d9d640 1 -- 172.21.15.99:0/2081965400 learned_addr learned my addr 172.21.15.99:0/2081965400 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:47.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.227+0000 7f9d9ffff640 1 --2- 172.21.15.99:0/2081965400 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9da80ff750 0x7f9da81971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:47.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.227+0000 7f9da659c640 1 --2- 172.21.15.99:0/2081965400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9da80fed90 0x7f9da8196ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:47.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.227+0000 7f9da6d9d640 1 -- 172.21.15.99:0/2081965400 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9da80ff750 msgr2=0x7f9da81971e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:47.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.227+0000 7f9da6d9d640 1 --2- 172.21.15.99:0/2081965400 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9da80ff750 0x7f9da81971e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:47.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.227+0000 7f9da6d9d640 1 -- 172.21.15.99:0/2081965400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9da80fed90 msgr2=0x7f9da8196ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:47.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.227+0000 7f9da6d9d640 1 --2- 172.21.15.99:0/2081965400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9da80fed90 0x7f9da8196ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:47.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.227+0000 7f9da6d9d640 1 -- 172.21.15.99:0/2081965400 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da0009900 con 0x7f9da8102320 2024-01-31T05:10:47.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.228+0000 7f9da6d9d640 1 --2- 172.21.15.99:0/2081965400 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9da8102320 0x7f9da819e240 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9da0037040 tx=0x7f9da0032810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:47.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.228+0000 7f9d9f7fe640 1 -- 172.21.15.99:0/2081965400 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da0032af0 con 0x7f9da8102320 2024-01-31T05:10:47.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.228+0000 7f9dacf42640 1 -- 172.21.15.99:0/2081965400 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9da819ed60 con 0x7f9da8102320 2024-01-31T05:10:47.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.228+0000 7f9d9f7fe640 1 -- 172.21.15.99:0/2081965400 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9da0034e80 con 0x7f9da8102320 2024-01-31T05:10:47.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.228+0000 7f9d9f7fe640 1 -- 172.21.15.99:0/2081965400 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da003d3f0 con 0x7f9da8102320 2024-01-31T05:10:47.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.228+0000 7f9dacf42640 1 -- 172.21.15.99:0/2081965400 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9da819f200 con 0x7f9da8102320 2024-01-31T05:10:47.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.229+0000 7f9dacf42640 1 -- 172.21.15.99:0/2081965400 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9da81081e0 con 0x7f9da8102320 2024-01-31T05:10:47.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.230+0000 7f9d9f7fe640 1 -- 172.21.15.99:0/2081965400 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f9da003b040 con 0x7f9da8102320 2024-01-31T05:10:47.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.230+0000 7f9d9f7fe640 1 --2- 172.21.15.99:0/2081965400 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f9d940a1370 0x7f9d940a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:47.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.230+0000 7f9da659c640 1 --2- 172.21.15.99:0/2081965400 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f9d940a1370 0x7f9d940a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:47.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.230+0000 7f9d9f7fe640 1 -- 172.21.15.99:0/2081965400 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f9da00ef230 con 0x7f9da8102320 2024-01-31T05:10:47.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.231+0000 7f9da659c640 1 --2- 172.21.15.99:0/2081965400 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f9d940a1370 0x7f9d940a3830 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9d98005fd0 tx=0x7f9d98005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:47.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.235+0000 7f9d9f7fe640 1 -- 172.21.15.99:0/2081965400 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f9da00b8780 con 0x7f9da8102320 2024-01-31T05:10:47.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.444+0000 7f9dacf42640 1 -- 172.21.15.99:0/2081965400 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9da810c800 con 0x7f9da8102320 2024-01-31T05:10:47.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.445+0000 7f9d9f7fe640 1 -- 172.21.15.99:0/2081965400 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11385 (secure 0 0 0) 0x7f9da00bbda0 con 0x7f9da8102320 2024-01-31T05:10:47.444 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:10:47.444 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/1488539026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1488539026},{"type":"v1","addr":"172.21.15.99:6835","nonce":1488539026}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/1649552652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1649552652},{"type":"v1","addr":"172.21.15.99:6837","nonce":1649552652}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-01-31T05:09:20.564215+0000","modified":"2024-01-31T05:09:28.172314+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24461,"mds_2":24457,"mds_3":24439,"mds_4":14619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6839/4070477446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4070477446},{"type":"v1","addr":"172.21.15.99:6839","nonce":4070477446}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.99:6841/3069939345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6840","nonce":3069939345},{"type":"v1","addr":"172.21.15.99:6841","nonce":3069939345}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24376":{"gid":24376,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6833/427201290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":427201290},{"type":"v1","addr":"172.21.15.181:6833","nonce":427201290}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24401":{"gid":24401,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/472161020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":472161020},{"type":"v1","addr":"172.21.15.179:6833","nonce":472161020}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24427":{"gid":24427,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/1038715471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1038715471},{"type":"v1","addr":"172.21.15.181:6835","nonce":1038715471}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24434":{"gid":24434,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/966976592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":966976592},{"type":"v1","addr":"172.21.15.179:6835","nonce":966976592}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24439":{"gid":24439,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.181:6837/3875964154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3875964154},{"type":"v1","addr":"172.21.15.181:6837","nonce":3875964154}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24457":{"gid":24457,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.181:6839/996120687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":996120687},{"type":"v1","addr":"172.21.15.181:6839","nonce":996120687}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6837/837402830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":837402830},{"type":"v1","addr":"172.21.15.179:6837","nonce":837402830}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6839/754762785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":754762785},{"type":"v1","addr":"172.21.15.179:6839","nonce":754762785}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-31T05:10:47.444 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 26 2024-01-31T05:10:47.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.447+0000 7f9dacf42640 1 -- 172.21.15.99:0/2081965400 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f9d940a1370 msgr2=0x7f9d940a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:47.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.447+0000 7f9dacf42640 1 --2- 172.21.15.99:0/2081965400 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f9d940a1370 0x7f9d940a3830 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9d98005fd0 tx=0x7f9d98005850 comp rx=0 tx=0).stop 2024-01-31T05:10:47.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.447+0000 7f9dacf42640 1 -- 172.21.15.99:0/2081965400 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9da8102320 msgr2=0x7f9da819e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:47.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.447+0000 7f9dacf42640 1 --2- 172.21.15.99:0/2081965400 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9da8102320 0x7f9da819e240 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9da0037040 tx=0x7f9da0032810 comp rx=0 tx=0).stop 2024-01-31T05:10:47.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.447+0000 7f9dacf42640 1 -- 172.21.15.99:0/2081965400 shutdown_connections 2024-01-31T05:10:47.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.447+0000 7f9dacf42640 1 --2- 172.21.15.99:0/2081965400 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f9d940a1370 0x7f9d940a3830 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:47.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.447+0000 7f9dacf42640 1 --2- 172.21.15.99:0/2081965400 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9da8102320 0x7f9da819e240 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:47.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.447+0000 7f9dacf42640 1 --2- 172.21.15.99:0/2081965400 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9da80ff750 0x7f9da81971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:47.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.447+0000 7f9dacf42640 1 --2- 172.21.15.99:0/2081965400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9da80fed90 0x7f9da8196ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:47.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.447+0000 7f9dacf42640 1 -- 172.21.15.99:0/2081965400 >> 172.21.15.99:0/2081965400 conn(0x7f9da80fa930 msgr2=0x7f9da81053b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:47.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.447+0000 7f9dacf42640 1 -- 172.21.15.99:0/2081965400 shutdown_connections 2024-01-31T05:10:47.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.447+0000 7f9dacf42640 1 -- 172.21.15.99:0/2081965400 wait complete. 2024-01-31T05:10:47.457 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:10:47.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.558+0000 7fc3bf51f640 1 -- 172.21.15.99:0/835154350 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3b8100d10 msgr2=0x7fc3b8101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:47.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.558+0000 7fc3bf51f640 1 --2- 172.21.15.99:0/835154350 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3b8100d10 0x7fc3b8101130 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc3b0009900 tx=0x7fc3b002bc30 comp rx=0 tx=0).stop 2024-01-31T05:10:47.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.559+0000 7fc3bf51f640 1 -- 172.21.15.99:0/835154350 shutdown_connections 2024-01-31T05:10:47.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.559+0000 7fc3bf51f640 1 --2- 172.21.15.99:0/835154350 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3b81028c0 0x7fc3b8109150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:47.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.559+0000 7fc3bf51f640 1 --2- 172.21.15.99:0/835154350 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3b8101f00 0x7fc3b8102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:47.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.559+0000 7fc3bf51f640 1 --2- 172.21.15.99:0/835154350 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3b8100d10 0x7fc3b8101130 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:47.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.559+0000 7fc3bf51f640 1 -- 172.21.15.99:0/835154350 >> 172.21.15.99:0/835154350 conn(0x7fc3b80fc2a0 msgr2=0x7fc3b80fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:47.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.559+0000 7fc3bf51f640 1 -- 172.21.15.99:0/835154350 shutdown_connections 2024-01-31T05:10:47.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.559+0000 7fc3bf51f640 1 -- 172.21.15.99:0/835154350 wait complete. 2024-01-31T05:10:47.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.559+0000 7fc3bf51f640 1 Processor -- start 2024-01-31T05:10:47.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.559+0000 7fc3bf51f640 1 -- start start 2024-01-31T05:10:47.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.559+0000 7fc3bf51f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3b8100d10 0x7fc3b8196c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:47.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.559+0000 7fc3bf51f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3b8101f00 0x7fc3b81971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:47.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.559+0000 7fc3bf51f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3b81028c0 0x7fc3b819e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:47.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.559+0000 7fc3bf51f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b819e790 con 0x7fc3b81028c0 2024-01-31T05:10:47.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.559+0000 7fc3bf51f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b819e900 con 0x7fc3b8100d10 2024-01-31T05:10:47.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.559+0000 7fc3bf51f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b819eac0 con 0x7fc3b8101f00 2024-01-31T05:10:47.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.559+0000 7fc3bdabc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3b81028c0 0x7fc3b819e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:47.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.559+0000 7fc3bdabc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3b81028c0 0x7fc3b819e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44934/0 (socket says 172.21.15.99:44934) 2024-01-31T05:10:47.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.559+0000 7fc3bdabc640 1 -- 172.21.15.99:0/388053777 learned_addr learned my addr 172.21.15.99:0/388053777 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:47.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.560+0000 7fc3bdabc640 1 -- 172.21.15.99:0/388053777 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3b8101f00 msgr2=0x7fc3b81971c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:47.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.560+0000 7fc3bcaba640 1 --2- 172.21.15.99:0/388053777 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3b8101f00 0x7fc3b81971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:47.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.560+0000 7fc3bd2bb640 1 --2- 172.21.15.99:0/388053777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3b8100d10 0x7fc3b8196c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:47.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.560+0000 7fc3bdabc640 1 --2- 172.21.15.99:0/388053777 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3b8101f00 0x7fc3b81971c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:47.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.560+0000 7fc3bdabc640 1 -- 172.21.15.99:0/388053777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3b8100d10 msgr2=0x7fc3b8196c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:47.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.560+0000 7fc3bdabc640 1 --2- 172.21.15.99:0/388053777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3b8100d10 0x7fc3b8196c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:47.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.560+0000 7fc3bdabc640 1 -- 172.21.15.99:0/388053777 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b0009560 con 0x7fc3b81028c0 2024-01-31T05:10:47.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.560+0000 7fc3bdabc640 1 --2- 172.21.15.99:0/388053777 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3b81028c0 0x7fc3b819e220 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc3a800c970 tx=0x7fc3a800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:47.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.560+0000 7fc3b67fc640 1 -- 172.21.15.99:0/388053777 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a8007bb0 con 0x7fc3b81028c0 2024-01-31T05:10:47.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.560+0000 7fc3b67fc640 1 -- 172.21.15.99:0/388053777 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc3a8007d10 con 0x7fc3b81028c0 2024-01-31T05:10:47.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.560+0000 7fc3bf51f640 1 -- 172.21.15.99:0/388053777 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3b819eda0 con 0x7fc3b81028c0 2024-01-31T05:10:47.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.560+0000 7fc3b67fc640 1 -- 172.21.15.99:0/388053777 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a80186c0 con 0x7fc3b81028c0 2024-01-31T05:10:47.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.560+0000 7fc3bf51f640 1 -- 172.21.15.99:0/388053777 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3b819f250 con 0x7fc3b81028c0 2024-01-31T05:10:47.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.561+0000 7fc3bf51f640 1 -- 172.21.15.99:0/388053777 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3b8108050 con 0x7fc3b81028c0 2024-01-31T05:10:47.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.562+0000 7fc3b67fc640 1 -- 172.21.15.99:0/388053777 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7fc3a800f450 con 0x7fc3b81028c0 2024-01-31T05:10:47.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.563+0000 7fc3b67fc640 1 --2- 172.21.15.99:0/388053777 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc3a00a13f0 0x7fc3a00a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:47.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.563+0000 7fc3bd2bb640 1 --2- 172.21.15.99:0/388053777 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc3a00a13f0 0x7fc3a00a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:47.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.563+0000 7fc3b67fc640 1 -- 172.21.15.99:0/388053777 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fc3a80ccc70 con 0x7fc3b81028c0 2024-01-31T05:10:47.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.563+0000 7fc3bd2bb640 1 --2- 172.21.15.99:0/388053777 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc3a00a13f0 0x7fc3a00a38b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc3b0006010 tx=0x7fc3b0000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:47.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.567+0000 7fc3b67fc640 1 -- 172.21.15.99:0/388053777 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fc3a80960b0 con 0x7fc3b81028c0 2024-01-31T05:10:47.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.741+0000 7fc3bf51f640 1 -- 172.21.15.99:0/388053777 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc3b810c5a0 con 0x7fc3b81028c0 2024-01-31T05:10:47.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.743+0000 7fc3b67fc640 1 -- 172.21.15.99:0/388053777 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22426 (secure 0 0 0) 0x7fc3a80996d0 con 0x7fc3b81028c0 2024-01-31T05:10:47.742 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:10:47.742 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":88,"fsid":"9288ff44-bff5-11ee-95b3-87774f69a715","created":"2024-01-31T05:01:26.130917+0000","modified":"2024-01-31T05:10:21.675877+0000","last_up_change":"2024-01-31T05:08:31.228478+0000","last_in_change":"2024-01-31T05:08:10.799511+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:46.842423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:09:18.693558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-31T05:09:19.734003+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b45878d9-28f1-4821-ba72-26a32d3fc780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6803","nonce":1213805280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6805","nonce":1213805280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6809","nonce":1213805280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6807","nonce":1213805280}]},"public_addr":"172.21.15.99:6803/1213805280","cluster_addr":"172.21.15.99:6805/1213805280","heartbeat_back_addr":"172.21.15.99:6809/1213805280","heartbeat_front_addr":"172.21.15.99:6807/1213805280","state":["exists","up"]},{"osd":1,"uuid":"e0b71ff3-5d97-4659-8dea-4c9091e1beb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6801","nonce":2019451677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6803","nonce":2019451677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6807","nonce":2019451677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6805","nonce":2019451677}]},"public_addr":"172.21.15.179:6801/2019451677","cluster_addr":"172.21.15.179:6803/2019451677","heartbeat_back_addr":"172.21.15.179:6807/2019451677","heartbeat_front_addr":"172.21.15.179:6805/2019451677","state":["exists","up"]},{"osd":2,"uuid":"11c919c8-19a9-48b0-8880-3002efcb64f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6801","nonce":3934284457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6803","nonce":3934284457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6807","nonce":3934284457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6805","nonce":3934284457}]},"public_addr":"172.21.15.181:6801/3934284457","cluster_addr":"172.21.15.181:6803/3934284457","heartbeat_back_addr":"172.21.15.181:6807/3934284457","heartbeat_front_addr":"172.21.15.181:6805/3934284457","state":["exists","up"]},{"osd":3,"uuid":"bcab5135-a5d1-45ae-a9b8-674425d3999e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6811","nonce":4207675427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6813","nonce":4207675427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6817","nonce":4207675427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6815","nonce":4207675427}]},"public_addr":"172.21.15.99:6811/4207675427","cluster_addr":"172.21.15.99:6813/4207675427","heartbeat_back_addr":"172.21.15.99:6817/4207675427","heartbeat_front_addr":"172.21.15.99:6815/4207675427","state":["exists","up"]},{"osd":4,"uuid":"0250d7ac-3894-457a-9c04-cc7205d61eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6809","nonce":2861083896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6811","nonce":2861083896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6815","nonce":2861083896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6813","nonce":2861083896}]},"public_addr":"172.21.15.179:6809/2861083896","cluster_addr":"172.21.15.179:6811/2861083896","heartbeat_back_addr":"172.21.15.179:6815/2861083896","heartbeat_front_addr":"172.21.15.179:6813/2861083896","state":["exists","up"]},{"osd":5,"uuid":"5e19222a-c2a4-45bc-8445-1d302f26d11c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6809","nonce":1485017095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6811","nonce":1485017095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6815","nonce":1485017095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6813","nonce":1485017095}]},"public_addr":"172.21.15.181:6809/1485017095","cluster_addr":"172.21.15.181:6811/1485017095","heartbeat_back_addr":"172.21.15.181:6815/1485017095","heartbeat_front_addr":"172.21.15.181:6813/1485017095","state":["exists","up"]},{"osd":6,"uuid":"56555035-f9fc-4e91-96dd-caa632d58adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6819","nonce":1534047839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6821","nonce":1534047839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6825","nonce":1534047839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6823","nonce":1534047839}]},"public_addr":"172.21.15.99:6819/1534047839","cluster_addr":"172.21.15.99:6821/1534047839","heartbeat_back_addr":"172.21.15.99:6825/1534047839","heartbeat_front_addr":"172.21.15.99:6823/1534047839","state":["exists","up"]},{"osd":7,"uuid":"5e079cf5-1340-4599-88a6-df410ef0148e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6817","nonce":3875950553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6819","nonce":3875950553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6823","nonce":3875950553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6821","nonce":3875950553}]},"public_addr":"172.21.15.179:6817/3875950553","cluster_addr":"172.21.15.179:6819/3875950553","heartbeat_back_addr":"172.21.15.179:6823/3875950553","heartbeat_front_addr":"172.21.15.179:6821/3875950553","state":["exists","up"]},{"osd":8,"uuid":"10a73592-4251-4492-b67d-ce9b9d7fff32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6817","nonce":179568936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6819","nonce":179568936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6823","nonce":179568936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6821","nonce":179568936}]},"public_addr":"172.21.15.181:6817/179568936","cluster_addr":"172.21.15.181:6819/179568936","heartbeat_back_addr":"172.21.15.181:6823/179568936","heartbeat_front_addr":"172.21.15.181:6821/179568936","state":["exists","up"]},{"osd":9,"uuid":"f6620e1e-f761-4f1c-917f-cbc748df32a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6827","nonce":315759515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6829","nonce":315759515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6833","nonce":315759515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6831","nonce":315759515}]},"public_addr":"172.21.15.99:6827/315759515","cluster_addr":"172.21.15.99:6829/315759515","heartbeat_back_addr":"172.21.15.99:6833/315759515","heartbeat_front_addr":"172.21.15.99:6831/315759515","state":["exists","up"]},{"osd":10,"uuid":"ee86af7d-66f8-4795-bcc3-dfec79e4680c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6825","nonce":2985063934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6827","nonce":2985063934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6831","nonce":2985063934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6829","nonce":2985063934}]},"public_addr":"172.21.15.179:6825/2985063934","cluster_addr":"172.21.15.179:6827/2985063934","heartbeat_back_addr":"172.21.15.179:6831/2985063934","heartbeat_front_addr":"172.21.15.179:6829/2985063934","state":["exists","up"]},{"osd":11,"uuid":"82f04fee-f6ae-4630-a75b-b12a9c4ab2e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6825","nonce":1858219600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6827","nonce":1858219600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6831","nonce":1858219600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6829","nonce":1858219600}]},"public_addr":"172.21.15.181:6825/1858219600","cluster_addr":"172.21.15.181:6827/1858219600","heartbeat_back_addr":"172.21.15.181:6831/1858219600","heartbeat_front_addr":"172.21.15.181:6829/1858219600","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:55.518970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:04:19.936339+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:04:44.064814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:09.331683+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:34.616774+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:58.881810+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:06:23.869838+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:06:49.127331+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:07:12.847187+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:07:38.231045+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:08:03.949162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:08:28.471802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:0/401101729":"2024-02-01T05:02:20.510858+0000","172.21.15.99:6801/1993198206":"2024-02-01T05:02:20.510858+0000","172.21.15.99:0/3819754569":"2024-02-01T05:02:20.510858+0000","172.21.15.99:0/475390265":"2024-02-01T05:01:53.732026+0000","172.21.15.99:6800/1993198206":"2024-02-01T05:02:20.510858+0000","172.21.15.99:6800/1706888338":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/4150146075":"2024-02-01T05:01:53.732026+0000","172.21.15.99:6801/1706888338":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/2851066598":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/1865156424":"2024-02-01T05:02:20.510858+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:10:47.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.745+0000 7fc3bf51f640 1 -- 172.21.15.99:0/388053777 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc3a00a13f0 msgr2=0x7fc3a00a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:47.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.745+0000 7fc3bf51f640 1 --2- 172.21.15.99:0/388053777 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc3a00a13f0 0x7fc3a00a38b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc3b0006010 tx=0x7fc3b0000bc0 comp rx=0 tx=0).stop 2024-01-31T05:10:47.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.745+0000 7fc3bf51f640 1 -- 172.21.15.99:0/388053777 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3b81028c0 msgr2=0x7fc3b819e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:47.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.745+0000 7fc3bf51f640 1 --2- 172.21.15.99:0/388053777 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3b81028c0 0x7fc3b819e220 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc3a800c970 tx=0x7fc3a800ce30 comp rx=0 tx=0).stop 2024-01-31T05:10:47.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.745+0000 7fc3bf51f640 1 -- 172.21.15.99:0/388053777 shutdown_connections 2024-01-31T05:10:47.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.745+0000 7fc3bf51f640 1 --2- 172.21.15.99:0/388053777 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc3a00a13f0 0x7fc3a00a38b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:47.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.745+0000 7fc3bf51f640 1 --2- 172.21.15.99:0/388053777 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3b81028c0 0x7fc3b819e220 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:47.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.745+0000 7fc3bf51f640 1 --2- 172.21.15.99:0/388053777 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3b8101f00 0x7fc3b81971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:47.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.745+0000 7fc3bf51f640 1 --2- 172.21.15.99:0/388053777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3b8100d10 0x7fc3b8196c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:47.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.745+0000 7fc3bf51f640 1 -- 172.21.15.99:0/388053777 >> 172.21.15.99:0/388053777 conn(0x7fc3b80fc2a0 msgr2=0x7fc3b8105220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:47.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.745+0000 7fc3bf51f640 1 -- 172.21.15.99:0/388053777 shutdown_connections 2024-01-31T05:10:47.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.745+0000 7fc3bf51f640 1 -- 172.21.15.99:0/388053777 wait complete. 2024-01-31T05:10:47.754 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:47 smithi099 ceph-mon[31615]: pgmap v331: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-01-31T05:10:47.754 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:47 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/4071523603' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-31T05:10:47.754 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:47 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/1036312218' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-31T05:10:47.754 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:47 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/2081965400' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:10:47.756 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-31T05:04:46.842423+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-31T05:09:18.693558+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-31T05:09:19.734003+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-31T05:10:47.756 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-31T05:10:47.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.860+0000 7f754e35e640 1 -- 172.21.15.99:0/1135111532 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7548104100 msgr2=0x7f75481064f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:47.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.860+0000 7f754e35e640 1 --2- 172.21.15.99:0/1135111532 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7548104100 0x7f75481064f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7538009900 tx=0x7f753802bc30 comp rx=0 tx=0).stop 2024-01-31T05:10:47.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.860+0000 7f754e35e640 1 -- 172.21.15.99:0/1135111532 shutdown_connections 2024-01-31T05:10:47.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.860+0000 7f754e35e640 1 --2- 172.21.15.99:0/1135111532 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7548106a30 0x7f7548108e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:47.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.860+0000 7f754e35e640 1 --2- 172.21.15.99:0/1135111532 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7548104100 0x7f75481064f0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:47.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.860+0000 7f754e35e640 1 --2- 172.21.15.99:0/1135111532 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f75481017d0 0x7f7548103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:47.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.860+0000 7f754e35e640 1 -- 172.21.15.99:0/1135111532 >> 172.21.15.99:0/1135111532 conn(0x7f75480fb180 msgr2=0x7f75480fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:47.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.860+0000 7f754e35e640 1 -- 172.21.15.99:0/1135111532 shutdown_connections 2024-01-31T05:10:47.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.860+0000 7f754e35e640 1 -- 172.21.15.99:0/1135111532 wait complete. 2024-01-31T05:10:47.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.861+0000 7f754e35e640 1 Processor -- start 2024-01-31T05:10:47.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.861+0000 7f754e35e640 1 -- start start 2024-01-31T05:10:47.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.861+0000 7f754e35e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f75481017d0 0x7f7548196d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:47.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.861+0000 7f754e35e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7548104100 0x7f7548197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:47.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.861+0000 7f754e35e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7548106a30 0x7f754819e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:47.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.861+0000 7f754e35e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754819e7e0 con 0x7f75481017d0 2024-01-31T05:10:47.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.861+0000 7f754e35e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754819e950 con 0x7f7548106a30 2024-01-31T05:10:47.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.861+0000 7f754e35e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754819eb10 con 0x7f7548104100 2024-01-31T05:10:47.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.861+0000 7f7547fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f75481017d0 0x7f7548196d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:47.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.861+0000 7f7547fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f75481017d0 0x7f7548196d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44942/0 (socket says 172.21.15.99:44942) 2024-01-31T05:10:47.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.861+0000 7f7547fff640 1 -- 172.21.15.99:0/661649491 learned_addr learned my addr 172.21.15.99:0/661649491 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:47.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.862+0000 7f75477fe640 1 --2- 172.21.15.99:0/661649491 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7548104100 0x7f7548197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:47.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.862+0000 7f754c8fb640 1 --2- 172.21.15.99:0/661649491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7548106a30 0x7f754819e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:47.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.862+0000 7f7547fff640 1 -- 172.21.15.99:0/661649491 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7548104100 msgr2=0x7f7548197240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:47.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.862+0000 7f7547fff640 1 --2- 172.21.15.99:0/661649491 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7548104100 0x7f7548197240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:47.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.862+0000 7f7547fff640 1 -- 172.21.15.99:0/661649491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7548106a30 msgr2=0x7f754819e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:47.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.862+0000 7f7547fff640 1 --2- 172.21.15.99:0/661649491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7548106a30 0x7f754819e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:47.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.862+0000 7f7547fff640 1 -- 172.21.15.99:0/661649491 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7538009560 con 0x7f75481017d0 2024-01-31T05:10:47.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.862+0000 7f7547fff640 1 --2- 172.21.15.99:0/661649491 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f75481017d0 0x7f7548196d00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f753c00c920 tx=0x7f753c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:47.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.862+0000 7f75457fa640 1 -- 172.21.15.99:0/661649491 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753c007c70 con 0x7f75481017d0 2024-01-31T05:10:47.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.862+0000 7f75457fa640 1 -- 172.21.15.99:0/661649491 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f753c007dd0 con 0x7f75481017d0 2024-01-31T05:10:47.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.862+0000 7f75457fa640 1 -- 172.21.15.99:0/661649491 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753c0187c0 con 0x7f75481017d0 2024-01-31T05:10:47.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.862+0000 7f754e35e640 1 -- 172.21.15.99:0/661649491 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f754819edf0 con 0x7f75481017d0 2024-01-31T05:10:47.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.862+0000 7f754e35e640 1 -- 172.21.15.99:0/661649491 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f754819f210 con 0x7f75481017d0 2024-01-31T05:10:47.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.863+0000 7f754e35e640 1 -- 172.21.15.99:0/661649491 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75480fcc70 con 0x7f75481017d0 2024-01-31T05:10:47.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.864+0000 7f75457fa640 1 -- 172.21.15.99:0/661649491 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f753c00f450 con 0x7f75481017d0 2024-01-31T05:10:47.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.864+0000 7f75457fa640 1 --2- 172.21.15.99:0/661649491 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f75300a1370 0x7f75300a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:47.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.865+0000 7f75477fe640 1 --2- 172.21.15.99:0/661649491 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f75300a1370 0x7f75300a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:47.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.865+0000 7f75457fa640 1 -- 172.21.15.99:0/661649491 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f753c0cce60 con 0x7f75481017d0 2024-01-31T05:10:47.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.865+0000 7f75477fe640 1 --2- 172.21.15.99:0/661649491 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f75300a1370 0x7f75300a3830 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f753802c6b0 tx=0x7f753802c5d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:47.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:47.869+0000 7f75457fa640 1 -- 172.21.15.99:0/661649491 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f753c096210 con 0x7f75481017d0 2024-01-31T05:10:48.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.042+0000 7f754e35e640 1 -- 172.21.15.99:0/661649491 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f754810c580 con 0x7f75481017d0 2024-01-31T05:10:48.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.042+0000 7f75457fa640 1 -- 172.21.15.99:0/661649491 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f753c098140 con 0x7f75481017d0 2024-01-31T05:10:48.041 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-01-31T05:10:48.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.044+0000 7f754e35e640 1 -- 172.21.15.99:0/661649491 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f75300a1370 msgr2=0x7f75300a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:48.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.044+0000 7f754e35e640 1 --2- 172.21.15.99:0/661649491 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f75300a1370 0x7f75300a3830 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f753802c6b0 tx=0x7f753802c5d0 comp rx=0 tx=0).stop 2024-01-31T05:10:48.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.044+0000 7f754e35e640 1 -- 172.21.15.99:0/661649491 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f75481017d0 msgr2=0x7f7548196d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:48.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.044+0000 7f754e35e640 1 --2- 172.21.15.99:0/661649491 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f75481017d0 0x7f7548196d00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f753c00c920 tx=0x7f753c00cde0 comp rx=0 tx=0).stop 2024-01-31T05:10:48.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.044+0000 7f754e35e640 1 -- 172.21.15.99:0/661649491 shutdown_connections 2024-01-31T05:10:48.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.044+0000 7f754e35e640 1 --2- 172.21.15.99:0/661649491 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f75300a1370 0x7f75300a3830 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:48.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.044+0000 7f754e35e640 1 --2- 172.21.15.99:0/661649491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7548106a30 0x7f754819e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:48.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.044+0000 7f754e35e640 1 --2- 172.21.15.99:0/661649491 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7548104100 0x7f7548197240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:48.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.044+0000 7f754e35e640 1 --2- 172.21.15.99:0/661649491 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f75481017d0 0x7f7548196d00 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:48.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.044+0000 7f754e35e640 1 -- 172.21.15.99:0/661649491 >> 172.21.15.99:0/661649491 conn(0x7f75480fb180 msgr2=0x7f7548102090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:48.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.044+0000 7f754e35e640 1 -- 172.21.15.99:0/661649491 shutdown_connections 2024-01-31T05:10:48.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.044+0000 7f754e35e640 1 -- 172.21.15.99:0/661649491 wait complete. 2024-01-31T05:10:48.055 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-31T05:10:48.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:47 smithi181 ceph-mon[36434]: pgmap v331: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-01-31T05:10:48.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:47 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/4071523603' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-31T05:10:48.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:47 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/1036312218' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-31T05:10:48.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:47 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/2081965400' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:10:48.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:47 smithi179 ceph-mon[35652]: pgmap v331: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-01-31T05:10:48.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:47 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/4071523603' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-31T05:10:48.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:47 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/1036312218' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-31T05:10:48.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:47 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/2081965400' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:10:48.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.159+0000 7eff4c1c9640 1 -- 172.21.15.99:0/2370269223 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff440ffc00 msgr2=0x7eff44100020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:48.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.159+0000 7eff4c1c9640 1 --2- 172.21.15.99:0/2370269223 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff440ffc00 0x7eff44100020 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7eff40009900 tx=0x7eff4002bc30 comp rx=0 tx=0).stop 2024-01-31T05:10:48.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.159+0000 7eff4c1c9640 1 -- 172.21.15.99:0/2370269223 shutdown_connections 2024-01-31T05:10:48.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.159+0000 7eff4c1c9640 1 --2- 172.21.15.99:0/2370269223 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff441017b0 0x7eff44108040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:48.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.159+0000 7eff4c1c9640 1 --2- 172.21.15.99:0/2370269223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff44100df0 0x7eff44101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:48.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.159+0000 7eff4c1c9640 1 --2- 172.21.15.99:0/2370269223 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff440ffc00 0x7eff44100020 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:48.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.159+0000 7eff4c1c9640 1 -- 172.21.15.99:0/2370269223 >> 172.21.15.99:0/2370269223 conn(0x7eff440fb190 msgr2=0x7eff440fd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:48.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.160+0000 7eff4c1c9640 1 -- 172.21.15.99:0/2370269223 shutdown_connections 2024-01-31T05:10:48.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.160+0000 7eff4c1c9640 1 -- 172.21.15.99:0/2370269223 wait complete. 2024-01-31T05:10:48.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.160+0000 7eff4c1c9640 1 Processor -- start 2024-01-31T05:10:48.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.160+0000 7eff4c1c9640 1 -- start start 2024-01-31T05:10:48.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.160+0000 7eff4c1c9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff440ffc00 0x7eff44196d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:48.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.160+0000 7eff4c1c9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff44100df0 0x7eff44197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:48.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.160+0000 7eff4c1c9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff441017b0 0x7eff4419e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:48.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.160+0000 7eff4c1c9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4419e820 con 0x7eff44100df0 2024-01-31T05:10:48.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.160+0000 7eff4c1c9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4419e990 con 0x7eff440ffc00 2024-01-31T05:10:48.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.160+0000 7eff4c1c9640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4419eb50 con 0x7eff441017b0 2024-01-31T05:10:48.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.160+0000 7eff49764640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff44100df0 0x7eff44197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:48.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.160+0000 7eff49764640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff44100df0 0x7eff44197280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44958/0 (socket says 172.21.15.99:44958) 2024-01-31T05:10:48.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.160+0000 7eff49764640 1 -- 172.21.15.99:0/859539210 learned_addr learned my addr 172.21.15.99:0/859539210 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:48.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.160+0000 7eff49f65640 1 --2- 172.21.15.99:0/859539210 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff440ffc00 0x7eff44196d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:48.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.161+0000 7eff49764640 1 -- 172.21.15.99:0/859539210 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff441017b0 msgr2=0x7eff4419e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:48.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.161+0000 7eff49764640 1 --2- 172.21.15.99:0/859539210 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff441017b0 0x7eff4419e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:48.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.161+0000 7eff49764640 1 -- 172.21.15.99:0/859539210 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff440ffc00 msgr2=0x7eff44196d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:48.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.161+0000 7eff49764640 1 --2- 172.21.15.99:0/859539210 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff440ffc00 0x7eff44196d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:48.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.161+0000 7eff49764640 1 -- 172.21.15.99:0/859539210 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff40009560 con 0x7eff44100df0 2024-01-31T05:10:48.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.161+0000 7eff49f65640 1 --2- 172.21.15.99:0/859539210 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff440ffc00 0x7eff44196d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:10:48.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.161+0000 7eff49764640 1 --2- 172.21.15.99:0/859539210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff44100df0 0x7eff44197280 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7eff3400d950 tx=0x7eff3400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:48.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.161+0000 7eff3affd640 1 -- 172.21.15.99:0/859539210 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff34009c30 con 0x7eff44100df0 2024-01-31T05:10:48.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.161+0000 7eff4c1c9640 1 -- 172.21.15.99:0/859539210 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff4419ee30 con 0x7eff44100df0 2024-01-31T05:10:48.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.161+0000 7eff3affd640 1 -- 172.21.15.99:0/859539210 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7eff34009d90 con 0x7eff44100df0 2024-01-31T05:10:48.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.161+0000 7eff3affd640 1 -- 172.21.15.99:0/859539210 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3400f740 con 0x7eff44100df0 2024-01-31T05:10:48.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.161+0000 7eff4c1c9640 1 -- 172.21.15.99:0/859539210 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff4419f2d0 con 0x7eff44100df0 2024-01-31T05:10:48.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.162+0000 7eff4c1c9640 1 -- 172.21.15.99:0/859539210 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff44107010 con 0x7eff44100df0 2024-01-31T05:10:48.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.163+0000 7eff3affd640 1 -- 172.21.15.99:0/859539210 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7eff34010a20 con 0x7eff44100df0 2024-01-31T05:10:48.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.163+0000 7eff3affd640 1 --2- 172.21.15.99:0/859539210 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7eff300a1370 0x7eff300a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:48.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.163+0000 7eff49f65640 1 --2- 172.21.15.99:0/859539210 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7eff300a1370 0x7eff300a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:48.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.163+0000 7eff3affd640 1 -- 172.21.15.99:0/859539210 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7eff340cc960 con 0x7eff44100df0 2024-01-31T05:10:48.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.164+0000 7eff49f65640 1 --2- 172.21.15.99:0/859539210 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7eff300a1370 0x7eff300a3830 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7eff44198210 tx=0x7eff40005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:48.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.168+0000 7eff3affd640 1 -- 172.21.15.99:0/859539210 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7eff34095d10 con 0x7eff44100df0 2024-01-31T05:10:48.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.342+0000 7eff4c1c9640 1 -- 172.21.15.99:0/859539210 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7eff4410c810 con 0x7eff44100df0 2024-01-31T05:10:48.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.343+0000 7eff3affd640 1 -- 172.21.15.99:0/859539210 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7eff34097c40 con 0x7eff44100df0 2024-01-31T05:10:48.342 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-01-31T05:10:48.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.344+0000 7eff4c1c9640 1 -- 172.21.15.99:0/859539210 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7eff300a1370 msgr2=0x7eff300a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:48.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.344+0000 7eff4c1c9640 1 --2- 172.21.15.99:0/859539210 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7eff300a1370 0x7eff300a3830 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7eff44198210 tx=0x7eff40005fd0 comp rx=0 tx=0).stop 2024-01-31T05:10:48.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.344+0000 7eff4c1c9640 1 -- 172.21.15.99:0/859539210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff44100df0 msgr2=0x7eff44197280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:48.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.344+0000 7eff4c1c9640 1 --2- 172.21.15.99:0/859539210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff44100df0 0x7eff44197280 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7eff3400d950 tx=0x7eff3400de10 comp rx=0 tx=0).stop 2024-01-31T05:10:48.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.345+0000 7eff4c1c9640 1 -- 172.21.15.99:0/859539210 shutdown_connections 2024-01-31T05:10:48.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.345+0000 7eff4c1c9640 1 --2- 172.21.15.99:0/859539210 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7eff300a1370 0x7eff300a3830 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:48.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.345+0000 7eff4c1c9640 1 --2- 172.21.15.99:0/859539210 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff441017b0 0x7eff4419e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:48.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.345+0000 7eff4c1c9640 1 --2- 172.21.15.99:0/859539210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff44100df0 0x7eff44197280 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:48.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.345+0000 7eff4c1c9640 1 --2- 172.21.15.99:0/859539210 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff440ffc00 0x7eff44196d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:48.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.345+0000 7eff4c1c9640 1 -- 172.21.15.99:0/859539210 >> 172.21.15.99:0/859539210 conn(0x7eff440fb190 msgr2=0x7eff441041e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:48.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.345+0000 7eff4c1c9640 1 -- 172.21.15.99:0/859539210 shutdown_connections 2024-01-31T05:10:48.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.345+0000 7eff4c1c9640 1 -- 172.21.15.99:0/859539210 wait complete. 2024-01-31T05:10:48.355 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-31T05:10:48.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.460+0000 7f1a158f1640 1 -- 172.21.15.99:0/2130226918 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a101040a0 msgr2=0x7f1a10106490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:48.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.460+0000 7f1a158f1640 1 --2- 172.21.15.99:0/2130226918 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a101040a0 0x7f1a10106490 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1a04009900 tx=0x7f1a0402bc30 comp rx=0 tx=0).stop 2024-01-31T05:10:48.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.460+0000 7f1a158f1640 1 -- 172.21.15.99:0/2130226918 shutdown_connections 2024-01-31T05:10:48.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.460+0000 7f1a158f1640 1 --2- 172.21.15.99:0/2130226918 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a101069d0 0x7f1a10108e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:48.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.460+0000 7f1a158f1640 1 --2- 172.21.15.99:0/2130226918 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a101040a0 0x7f1a10106490 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:48.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.460+0000 7f1a158f1640 1 --2- 172.21.15.99:0/2130226918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a10101770 0x7f1a10103b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:48.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.460+0000 7f1a158f1640 1 -- 172.21.15.99:0/2130226918 >> 172.21.15.99:0/2130226918 conn(0x7f1a100fb180 msgr2=0x7f1a100fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:48.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.460+0000 7f1a158f1640 1 -- 172.21.15.99:0/2130226918 shutdown_connections 2024-01-31T05:10:48.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.460+0000 7f1a158f1640 1 -- 172.21.15.99:0/2130226918 wait complete. 2024-01-31T05:10:48.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.461+0000 7f1a158f1640 1 Processor -- start 2024-01-31T05:10:48.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.461+0000 7f1a158f1640 1 -- start start 2024-01-31T05:10:48.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.461+0000 7f1a158f1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a10101770 0x7f1a10196d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:48.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.461+0000 7f1a158f1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a101040a0 0x7f1a10197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:48.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.461+0000 7f1a158f1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a101069d0 0x7f1a1019e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:48.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.461+0000 7f1a158f1640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1019e7e0 con 0x7f1a101069d0 2024-01-31T05:10:48.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.461+0000 7f1a158f1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1019e950 con 0x7f1a101040a0 2024-01-31T05:10:48.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.461+0000 7f1a158f1640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1019eb10 con 0x7f1a10101770 2024-01-31T05:10:48.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.461+0000 7f1a0f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a101069d0 0x7f1a1019e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:48.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.461+0000 7f1a0f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a101069d0 0x7f1a1019e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44974/0 (socket says 172.21.15.99:44974) 2024-01-31T05:10:48.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.461+0000 7f1a0f7fe640 1 -- 172.21.15.99:0/312347464 learned_addr learned my addr 172.21.15.99:0/312347464 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:48.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.461+0000 7f1a0effd640 1 --2- 172.21.15.99:0/312347464 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a10101770 0x7f1a10196d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:48.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.461+0000 7f1a0e7fc640 1 --2- 172.21.15.99:0/312347464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a101040a0 0x7f1a10197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:48.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.462+0000 7f1a0f7fe640 1 -- 172.21.15.99:0/312347464 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a10101770 msgr2=0x7f1a10196d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:48.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.462+0000 7f1a0f7fe640 1 --2- 172.21.15.99:0/312347464 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a10101770 0x7f1a10196d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:48.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.462+0000 7f1a0f7fe640 1 -- 172.21.15.99:0/312347464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a101040a0 msgr2=0x7f1a10197240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:48.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.462+0000 7f1a0f7fe640 1 --2- 172.21.15.99:0/312347464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a101040a0 0x7f1a10197240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:48.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.462+0000 7f1a0f7fe640 1 -- 172.21.15.99:0/312347464 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a04009560 con 0x7f1a101069d0 2024-01-31T05:10:48.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.462+0000 7f1a0f7fe640 1 --2- 172.21.15.99:0/312347464 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a101069d0 0x7f1a1019e270 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1a0800d750 tx=0x7f1a0800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:48.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.462+0000 7f1a148ef640 1 -- 172.21.15.99:0/312347464 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a08009bd0 con 0x7f1a101069d0 2024-01-31T05:10:48.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.462+0000 7f1a148ef640 1 -- 172.21.15.99:0/312347464 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1a0800de60 con 0x7f1a101069d0 2024-01-31T05:10:48.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.462+0000 7f1a148ef640 1 -- 172.21.15.99:0/312347464 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a08004e00 con 0x7f1a101069d0 2024-01-31T05:10:48.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.462+0000 7f1a158f1640 1 -- 172.21.15.99:0/312347464 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a1019edf0 con 0x7f1a101069d0 2024-01-31T05:10:48.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.462+0000 7f1a158f1640 1 -- 172.21.15.99:0/312347464 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a1019f210 con 0x7f1a101069d0 2024-01-31T05:10:48.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.463+0000 7f1a158f1640 1 -- 172.21.15.99:0/312347464 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a100fcc70 con 0x7f1a101069d0 2024-01-31T05:10:48.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.464+0000 7f1a148ef640 1 -- 172.21.15.99:0/312347464 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f1a08004f60 con 0x7f1a101069d0 2024-01-31T05:10:48.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.465+0000 7f1a148ef640 1 --2- 172.21.15.99:0/312347464 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f19f80a13f0 0x7f19f80a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:48.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.465+0000 7f1a0effd640 1 --2- 172.21.15.99:0/312347464 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f19f80a13f0 0x7f19f80a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:48.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.465+0000 7f1a148ef640 1 -- 172.21.15.99:0/312347464 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f1a080cc510 con 0x7f1a101069d0 2024-01-31T05:10:48.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.465+0000 7f1a0effd640 1 --2- 172.21.15.99:0/312347464 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f19f80a13f0 0x7f19f80a38b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1a101981d0 tx=0x7f1a00009680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:48.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.469+0000 7f1a148ef640 1 -- 172.21.15.99:0/312347464 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f1a08099490 con 0x7f1a101069d0 2024-01-31T05:10:48.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.644+0000 7f1a158f1640 1 -- 172.21.15.99:0/312347464 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1a1010c810 con 0x7f1a101069d0 2024-01-31T05:10:48.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.645+0000 7f1a148ef640 1 -- 172.21.15.99:0/312347464 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1a08020020 con 0x7f1a101069d0 2024-01-31T05:10:48.644 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 64 2024-01-31T05:10:48.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.647+0000 7f1a158f1640 1 -- 172.21.15.99:0/312347464 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f19f80a13f0 msgr2=0x7f19f80a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:48.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.647+0000 7f1a158f1640 1 --2- 172.21.15.99:0/312347464 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f19f80a13f0 0x7f19f80a38b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1a101981d0 tx=0x7f1a00009680 comp rx=0 tx=0).stop 2024-01-31T05:10:48.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.647+0000 7f1a158f1640 1 -- 172.21.15.99:0/312347464 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a101069d0 msgr2=0x7f1a1019e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:48.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.647+0000 7f1a158f1640 1 --2- 172.21.15.99:0/312347464 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a101069d0 0x7f1a1019e270 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1a0800d750 tx=0x7f1a0800dc10 comp rx=0 tx=0).stop 2024-01-31T05:10:48.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.647+0000 7f1a158f1640 1 -- 172.21.15.99:0/312347464 shutdown_connections 2024-01-31T05:10:48.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.647+0000 7f1a158f1640 1 --2- 172.21.15.99:0/312347464 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f19f80a13f0 0x7f19f80a38b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:48.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.647+0000 7f1a158f1640 1 --2- 172.21.15.99:0/312347464 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a101069d0 0x7f1a1019e270 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:48.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.647+0000 7f1a158f1640 1 --2- 172.21.15.99:0/312347464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a101040a0 0x7f1a10197240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:48.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.647+0000 7f1a158f1640 1 --2- 172.21.15.99:0/312347464 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a10101770 0x7f1a10196d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:48.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.647+0000 7f1a158f1640 1 -- 172.21.15.99:0/312347464 >> 172.21.15.99:0/312347464 conn(0x7f1a100fb180 msgr2=0x7f1a101021f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:48.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.647+0000 7f1a158f1640 1 -- 172.21.15.99:0/312347464 shutdown_connections 2024-01-31T05:10:48.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.647+0000 7f1a158f1640 1 -- 172.21.15.99:0/312347464 wait complete. 2024-01-31T05:10:48.657 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T05:10:48.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.759+0000 7ffab7398640 1 -- 172.21.15.99:0/475520966 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffab00ffc10 msgr2=0x7ffab0100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:48.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.759+0000 7ffab7398640 1 --2- 172.21.15.99:0/475520966 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffab00ffc10 0x7ffab0100030 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ffaac009900 tx=0x7ffaac02bc30 comp rx=0 tx=0).stop 2024-01-31T05:10:48.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.759+0000 7ffab7398640 1 -- 172.21.15.99:0/475520966 shutdown_connections 2024-01-31T05:10:48.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.759+0000 7ffab7398640 1 --2- 172.21.15.99:0/475520966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffab01017c0 0x7ffab0108050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:48.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.759+0000 7ffab7398640 1 --2- 172.21.15.99:0/475520966 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffab0100e00 0x7ffab0101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:48.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.759+0000 7ffab7398640 1 --2- 172.21.15.99:0/475520966 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffab00ffc10 0x7ffab0100030 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:48.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.759+0000 7ffab7398640 1 -- 172.21.15.99:0/475520966 >> 172.21.15.99:0/475520966 conn(0x7ffab00fb1a0 msgr2=0x7ffab00fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:48.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.759+0000 7ffab7398640 1 -- 172.21.15.99:0/475520966 shutdown_connections 2024-01-31T05:10:48.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.759+0000 7ffab7398640 1 -- 172.21.15.99:0/475520966 wait complete. 2024-01-31T05:10:48.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.760+0000 7ffab7398640 1 Processor -- start 2024-01-31T05:10:48.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.760+0000 7ffab7398640 1 -- start start 2024-01-31T05:10:48.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.760+0000 7ffab7398640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffab00ffc10 0x7ffab0196db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:48.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.760+0000 7ffab7398640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffab0100e00 0x7ffab01972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:48.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.760+0000 7ffab7398640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffab01017c0 0x7ffab019e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:48.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.760+0000 7ffab7398640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab019e890 con 0x7ffab01017c0 2024-01-31T05:10:48.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.760+0000 7ffab7398640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab019ea00 con 0x7ffab0100e00 2024-01-31T05:10:48.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.760+0000 7ffab7398640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab019ebc0 con 0x7ffab00ffc10 2024-01-31T05:10:48.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.760+0000 7ffab5935640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffab01017c0 0x7ffab019e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:48.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.760+0000 7ffab5935640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffab01017c0 0x7ffab019e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44986/0 (socket says 172.21.15.99:44986) 2024-01-31T05:10:48.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.760+0000 7ffab5935640 1 -- 172.21.15.99:0/1937146762 learned_addr learned my addr 172.21.15.99:0/1937146762 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:48.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.760+0000 7ffab4933640 1 --2- 172.21.15.99:0/1937146762 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffab0100e00 0x7ffab01972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:48.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.760+0000 7ffab5134640 1 --2- 172.21.15.99:0/1937146762 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffab00ffc10 0x7ffab0196db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:48.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.760+0000 7ffab5935640 1 -- 172.21.15.99:0/1937146762 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffab00ffc10 msgr2=0x7ffab0196db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:48.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.760+0000 7ffab5935640 1 --2- 172.21.15.99:0/1937146762 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffab00ffc10 0x7ffab0196db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:48.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.760+0000 7ffab5935640 1 -- 172.21.15.99:0/1937146762 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffab0100e00 msgr2=0x7ffab01972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:48.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.760+0000 7ffab5935640 1 --2- 172.21.15.99:0/1937146762 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffab0100e00 0x7ffab01972f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:48.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.760+0000 7ffab5935640 1 -- 172.21.15.99:0/1937146762 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaac009560 con 0x7ffab01017c0 2024-01-31T05:10:48.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.760+0000 7ffab4933640 1 --2- 172.21.15.99:0/1937146762 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffab0100e00 0x7ffab01972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:10:48.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.760+0000 7ffab5935640 1 --2- 172.21.15.99:0/1937146762 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffab01017c0 0x7ffab019e320 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ffaa800b970 tx=0x7ffaa800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:48.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.760+0000 7ffaa27fc640 1 -- 172.21.15.99:0/1937146762 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa800cb40 con 0x7ffab01017c0 2024-01-31T05:10:48.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.760+0000 7ffaa27fc640 1 -- 172.21.15.99:0/1937146762 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffaa800cca0 con 0x7ffab01017c0 2024-01-31T05:10:48.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.760+0000 7ffab7398640 1 -- 172.21.15.99:0/1937146762 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffab019eea0 con 0x7ffab01017c0 2024-01-31T05:10:48.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.761+0000 7ffaa27fc640 1 -- 172.21.15.99:0/1937146762 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa8007770 con 0x7ffab01017c0 2024-01-31T05:10:48.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.761+0000 7ffab7398640 1 -- 172.21.15.99:0/1937146762 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab019f2f0 con 0x7ffab01017c0 2024-01-31T05:10:48.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.761+0000 7ffab7398640 1 -- 172.21.15.99:0/1937146762 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab010b540 con 0x7ffab01017c0 2024-01-31T05:10:48.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.762+0000 7ffaa27fc640 1 -- 172.21.15.99:0/1937146762 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7ffaa8014440 con 0x7ffab01017c0 2024-01-31T05:10:48.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.763+0000 7ffaa27fc640 1 --2- 172.21.15.99:0/1937146762 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ffa9c0a1370 0x7ffa9c0a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:48.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.763+0000 7ffab5134640 1 --2- 172.21.15.99:0/1937146762 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ffa9c0a1370 0x7ffa9c0a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:48.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.763+0000 7ffaa27fc640 1 -- 172.21.15.99:0/1937146762 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7ffaa80cc920 con 0x7ffab01017c0 2024-01-31T05:10:48.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.763+0000 7ffab5134640 1 --2- 172.21.15.99:0/1937146762 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ffa9c0a1370 0x7ffa9c0a3830 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ffaac006010 tx=0x7ffaac000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:48.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.766+0000 7ffaa27fc640 1 -- 172.21.15.99:0/1937146762 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7ffaa8095de0 con 0x7ffab01017c0 2024-01-31T05:10:48.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.974+0000 7ffab7398640 1 -- 172.21.15.99:0/1937146762 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffab019f6d0 con 0x7ffab01017c0 2024-01-31T05:10:48.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.975+0000 7ffaa27fc640 1 -- 172.21.15.99:0/1937146762 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11385 (secure 0 0 0) 0x7ffaa8097d10 con 0x7ffab01017c0 2024-01-31T05:10:48.974 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:10:48.974 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/1488539026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1488539026},{"type":"v1","addr":"172.21.15.99:6835","nonce":1488539026}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/1649552652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1649552652},{"type":"v1","addr":"172.21.15.99:6837","nonce":1649552652}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-01-31T05:09:20.564215+0000","modified":"2024-01-31T05:09:28.172314+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24461,"mds_2":24457,"mds_3":24439,"mds_4":14619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6839/4070477446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4070477446},{"type":"v1","addr":"172.21.15.99:6839","nonce":4070477446}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.99:6841/3069939345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6840","nonce":3069939345},{"type":"v1","addr":"172.21.15.99:6841","nonce":3069939345}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24376":{"gid":24376,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6833/427201290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":427201290},{"type":"v1","addr":"172.21.15.181:6833","nonce":427201290}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24401":{"gid":24401,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/472161020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":472161020},{"type":"v1","addr":"172.21.15.179:6833","nonce":472161020}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24427":{"gid":24427,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/1038715471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1038715471},{"type":"v1","addr":"172.21.15.181:6835","nonce":1038715471}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24434":{"gid":24434,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/966976592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":966976592},{"type":"v1","addr":"172.21.15.179:6835","nonce":966976592}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24439":{"gid":24439,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.181:6837/3875964154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3875964154},{"type":"v1","addr":"172.21.15.181:6837","nonce":3875964154}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24457":{"gid":24457,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.181:6839/996120687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":996120687},{"type":"v1","addr":"172.21.15.181:6839","nonce":996120687}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6837/837402830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":837402830},{"type":"v1","addr":"172.21.15.179:6837","nonce":837402830}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6839/754762785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":754762785},{"type":"v1","addr":"172.21.15.179:6839","nonce":754762785}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-31T05:10:48.974 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 26 2024-01-31T05:10:48.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.977+0000 7ffab7398640 1 -- 172.21.15.99:0/1937146762 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ffa9c0a1370 msgr2=0x7ffa9c0a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:48.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.977+0000 7ffab7398640 1 --2- 172.21.15.99:0/1937146762 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ffa9c0a1370 0x7ffa9c0a3830 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ffaac006010 tx=0x7ffaac000bc0 comp rx=0 tx=0).stop 2024-01-31T05:10:48.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.977+0000 7ffab7398640 1 -- 172.21.15.99:0/1937146762 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffab01017c0 msgr2=0x7ffab019e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:48.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.977+0000 7ffab7398640 1 --2- 172.21.15.99:0/1937146762 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffab01017c0 0x7ffab019e320 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ffaa800b970 tx=0x7ffaa800be30 comp rx=0 tx=0).stop 2024-01-31T05:10:48.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.977+0000 7ffab7398640 1 -- 172.21.15.99:0/1937146762 shutdown_connections 2024-01-31T05:10:48.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.977+0000 7ffab7398640 1 --2- 172.21.15.99:0/1937146762 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ffa9c0a1370 0x7ffa9c0a3830 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:48.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.977+0000 7ffab7398640 1 --2- 172.21.15.99:0/1937146762 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffab01017c0 0x7ffab019e320 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:48.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.977+0000 7ffab7398640 1 --2- 172.21.15.99:0/1937146762 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffab0100e00 0x7ffab01972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:48.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.977+0000 7ffab7398640 1 --2- 172.21.15.99:0/1937146762 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffab00ffc10 0x7ffab0196db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:48.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.977+0000 7ffab7398640 1 -- 172.21.15.99:0/1937146762 >> 172.21.15.99:0/1937146762 conn(0x7ffab00fb1a0 msgr2=0x7ffab0069340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:48.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.977+0000 7ffab7398640 1 -- 172.21.15.99:0/1937146762 shutdown_connections 2024-01-31T05:10:48.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:48.977+0000 7ffab7398640 1 -- 172.21.15.99:0/1937146762 wait complete. 2024-01-31T05:10:48.986 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:48 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/388053777' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:10:48.986 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:48 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/661649491' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-31T05:10:48.986 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:48 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/859539210' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-31T05:10:48.986 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:48 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/312347464' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-31T05:10:48.987 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:10:49.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:48 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/388053777' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:10:49.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:48 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/661649491' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-31T05:10:49.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:48 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/859539210' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-31T05:10:49.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:48 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/312347464' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-31T05:10:49.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.090+0000 7f0168f8d640 1 -- 172.21.15.99:0/966666362 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0164101f00 msgr2=0x7f0164102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:49.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.090+0000 7f0168f8d640 1 --2- 172.21.15.99:0/966666362 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0164101f00 0x7f0164102380 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f014c009900 tx=0x7f014c02bc30 comp rx=0 tx=0).stop 2024-01-31T05:10:49.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.090+0000 7f0168f8d640 1 -- 172.21.15.99:0/966666362 shutdown_connections 2024-01-31T05:10:49.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.090+0000 7f0168f8d640 1 --2- 172.21.15.99:0/966666362 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01641028c0 0x7f0164109150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.090+0000 7f0168f8d640 1 --2- 172.21.15.99:0/966666362 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0164101f00 0x7f0164102380 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.090+0000 7f0168f8d640 1 --2- 172.21.15.99:0/966666362 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0164100d10 0x7f0164101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.090+0000 7f0168f8d640 1 -- 172.21.15.99:0/966666362 >> 172.21.15.99:0/966666362 conn(0x7f01640fc2a0 msgr2=0x7f01640fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:49.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.090+0000 7f0168f8d640 1 -- 172.21.15.99:0/966666362 shutdown_connections 2024-01-31T05:10:49.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.090+0000 7f0168f8d640 1 -- 172.21.15.99:0/966666362 wait complete. 2024-01-31T05:10:49.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.090+0000 7f0168f8d640 1 Processor -- start 2024-01-31T05:10:49.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.091+0000 7f0168f8d640 1 -- start start 2024-01-31T05:10:49.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.091+0000 7f0168f8d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0164100d10 0x7f0164074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:49.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.091+0000 7f0168f8d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0164101f00 0x7f01640730e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:49.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.091+0000 7f0168f8d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f01641028c0 0x7f0164073620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:49.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.091+0000 7f0168f8d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0164073d80 con 0x7f0164100d10 2024-01-31T05:10:49.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.091+0000 7f0168f8d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0164073ef0 con 0x7f0164101f00 2024-01-31T05:10:49.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.091+0000 7f0168f8d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01641a0e90 con 0x7f01641028c0 2024-01-31T05:10:49.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.091+0000 7f016259c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0164100d10 0x7f0164074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:49.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.091+0000 7f016259c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0164100d10 0x7f0164074aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45006/0 (socket says 172.21.15.99:45006) 2024-01-31T05:10:49.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.091+0000 7f016259c640 1 -- 172.21.15.99:0/3806458649 learned_addr learned my addr 172.21.15.99:0/3806458649 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:49.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.091+0000 7f0162d9d640 1 --2- 172.21.15.99:0/3806458649 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f01641028c0 0x7f0164073620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:49.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.091+0000 7f0159d9b640 1 --2- 172.21.15.99:0/3806458649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0164101f00 0x7f01640730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:49.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.091+0000 7f016259c640 1 -- 172.21.15.99:0/3806458649 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f01641028c0 msgr2=0x7f0164073620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:49.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.091+0000 7f016259c640 1 --2- 172.21.15.99:0/3806458649 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f01641028c0 0x7f0164073620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.091+0000 7f016259c640 1 -- 172.21.15.99:0/3806458649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0164101f00 msgr2=0x7f01640730e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:49.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.091+0000 7f016259c640 1 --2- 172.21.15.99:0/3806458649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0164101f00 0x7f01640730e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.091+0000 7f016259c640 1 -- 172.21.15.99:0/3806458649 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014c009560 con 0x7f0164100d10 2024-01-31T05:10:49.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.091+0000 7f0159d9b640 1 --2- 172.21.15.99:0/3806458649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0164101f00 0x7f01640730e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:10:49.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.091+0000 7f016259c640 1 --2- 172.21.15.99:0/3806458649 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0164100d10 0x7f0164074aa0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f015400b480 tx=0x7f015400b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:49.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.091+0000 7f015bfff640 1 -- 172.21.15.99:0/3806458649 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0154010870 con 0x7f0164100d10 2024-01-31T05:10:49.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.092+0000 7f0168f8d640 1 -- 172.21.15.99:0/3806458649 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01641a1140 con 0x7f0164100d10 2024-01-31T05:10:49.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.092+0000 7f015bfff640 1 -- 172.21.15.99:0/3806458649 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0154010e90 con 0x7f0164100d10 2024-01-31T05:10:49.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.092+0000 7f0168f8d640 1 -- 172.21.15.99:0/3806458649 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01641a16d0 con 0x7f0164100d10 2024-01-31T05:10:49.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.092+0000 7f015bfff640 1 -- 172.21.15.99:0/3806458649 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0154019450 con 0x7f0164100d10 2024-01-31T05:10:49.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.092+0000 7f0168f8d640 1 -- 172.21.15.99:0/3806458649 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0164108150 con 0x7f0164100d10 2024-01-31T05:10:49.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.094+0000 7f015bfff640 1 -- 172.21.15.99:0/3806458649 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f015400f5e0 con 0x7f0164100d10 2024-01-31T05:10:49.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.094+0000 7f015bfff640 1 --2- 172.21.15.99:0/3806458649 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f01500a1370 0x7f01500a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:49.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.094+0000 7f0159d9b640 1 --2- 172.21.15.99:0/3806458649 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f01500a1370 0x7f01500a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:49.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.094+0000 7f015bfff640 1 -- 172.21.15.99:0/3806458649 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f01540cca40 con 0x7f0164100d10 2024-01-31T05:10:49.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.095+0000 7f0159d9b640 1 --2- 172.21.15.99:0/3806458649 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f01500a1370 0x7f01500a3830 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f014c036040 tx=0x7f014c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:49.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.097+0000 7f015bfff640 1 -- 172.21.15.99:0/3806458649 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f0154096020 con 0x7f0164100d10 2024-01-31T05:10:49.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:48 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/388053777' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:10:49.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:48 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/661649491' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-31T05:10:49.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:48 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/859539210' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-31T05:10:49.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:48 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/312347464' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-31T05:10:49.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.272+0000 7f0168f8d640 1 -- 172.21.15.99:0/3806458649 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f016402caa0 con 0x7f0164100d10 2024-01-31T05:10:49.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.274+0000 7f015bfff640 1 -- 172.21.15.99:0/3806458649 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22426 (secure 0 0 0) 0x7f0154099640 con 0x7f0164100d10 2024-01-31T05:10:49.273 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:10:49.273 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":88,"fsid":"9288ff44-bff5-11ee-95b3-87774f69a715","created":"2024-01-31T05:01:26.130917+0000","modified":"2024-01-31T05:10:21.675877+0000","last_up_change":"2024-01-31T05:08:31.228478+0000","last_in_change":"2024-01-31T05:08:10.799511+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:46.842423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:09:18.693558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-31T05:09:19.734003+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b45878d9-28f1-4821-ba72-26a32d3fc780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6803","nonce":1213805280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6805","nonce":1213805280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6809","nonce":1213805280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6807","nonce":1213805280}]},"public_addr":"172.21.15.99:6803/1213805280","cluster_addr":"172.21.15.99:6805/1213805280","heartbeat_back_addr":"172.21.15.99:6809/1213805280","heartbeat_front_addr":"172.21.15.99:6807/1213805280","state":["exists","up"]},{"osd":1,"uuid":"e0b71ff3-5d97-4659-8dea-4c9091e1beb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6801","nonce":2019451677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6803","nonce":2019451677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6807","nonce":2019451677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6805","nonce":2019451677}]},"public_addr":"172.21.15.179:6801/2019451677","cluster_addr":"172.21.15.179:6803/2019451677","heartbeat_back_addr":"172.21.15.179:6807/2019451677","heartbeat_front_addr":"172.21.15.179:6805/2019451677","state":["exists","up"]},{"osd":2,"uuid":"11c919c8-19a9-48b0-8880-3002efcb64f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6801","nonce":3934284457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6803","nonce":3934284457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6807","nonce":3934284457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6805","nonce":3934284457}]},"public_addr":"172.21.15.181:6801/3934284457","cluster_addr":"172.21.15.181:6803/3934284457","heartbeat_back_addr":"172.21.15.181:6807/3934284457","heartbeat_front_addr":"172.21.15.181:6805/3934284457","state":["exists","up"]},{"osd":3,"uuid":"bcab5135-a5d1-45ae-a9b8-674425d3999e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6811","nonce":4207675427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6813","nonce":4207675427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6817","nonce":4207675427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6815","nonce":4207675427}]},"public_addr":"172.21.15.99:6811/4207675427","cluster_addr":"172.21.15.99:6813/4207675427","heartbeat_back_addr":"172.21.15.99:6817/4207675427","heartbeat_front_addr":"172.21.15.99:6815/4207675427","state":["exists","up"]},{"osd":4,"uuid":"0250d7ac-3894-457a-9c04-cc7205d61eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6809","nonce":2861083896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6811","nonce":2861083896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6815","nonce":2861083896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6813","nonce":2861083896}]},"public_addr":"172.21.15.179:6809/2861083896","cluster_addr":"172.21.15.179:6811/2861083896","heartbeat_back_addr":"172.21.15.179:6815/2861083896","heartbeat_front_addr":"172.21.15.179:6813/2861083896","state":["exists","up"]},{"osd":5,"uuid":"5e19222a-c2a4-45bc-8445-1d302f26d11c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6809","nonce":1485017095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6811","nonce":1485017095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6815","nonce":1485017095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6813","nonce":1485017095}]},"public_addr":"172.21.15.181:6809/1485017095","cluster_addr":"172.21.15.181:6811/1485017095","heartbeat_back_addr":"172.21.15.181:6815/1485017095","heartbeat_front_addr":"172.21.15.181:6813/1485017095","state":["exists","up"]},{"osd":6,"uuid":"56555035-f9fc-4e91-96dd-caa632d58adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6819","nonce":1534047839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6821","nonce":1534047839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6825","nonce":1534047839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6823","nonce":1534047839}]},"public_addr":"172.21.15.99:6819/1534047839","cluster_addr":"172.21.15.99:6821/1534047839","heartbeat_back_addr":"172.21.15.99:6825/1534047839","heartbeat_front_addr":"172.21.15.99:6823/1534047839","state":["exists","up"]},{"osd":7,"uuid":"5e079cf5-1340-4599-88a6-df410ef0148e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6817","nonce":3875950553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6819","nonce":3875950553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6823","nonce":3875950553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6821","nonce":3875950553}]},"public_addr":"172.21.15.179:6817/3875950553","cluster_addr":"172.21.15.179:6819/3875950553","heartbeat_back_addr":"172.21.15.179:6823/3875950553","heartbeat_front_addr":"172.21.15.179:6821/3875950553","state":["exists","up"]},{"osd":8,"uuid":"10a73592-4251-4492-b67d-ce9b9d7fff32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6817","nonce":179568936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6819","nonce":179568936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6823","nonce":179568936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6821","nonce":179568936}]},"public_addr":"172.21.15.181:6817/179568936","cluster_addr":"172.21.15.181:6819/179568936","heartbeat_back_addr":"172.21.15.181:6823/179568936","heartbeat_front_addr":"172.21.15.181:6821/179568936","state":["exists","up"]},{"osd":9,"uuid":"f6620e1e-f761-4f1c-917f-cbc748df32a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6827","nonce":315759515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6829","nonce":315759515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6833","nonce":315759515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6831","nonce":315759515}]},"public_addr":"172.21.15.99:6827/315759515","cluster_addr":"172.21.15.99:6829/315759515","heartbeat_back_addr":"172.21.15.99:6833/315759515","heartbeat_front_addr":"172.21.15.99:6831/315759515","state":["exists","up"]},{"osd":10,"uuid":"ee86af7d-66f8-4795-bcc3-dfec79e4680c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6825","nonce":2985063934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6827","nonce":2985063934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6831","nonce":2985063934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6829","nonce":2985063934}]},"public_addr":"172.21.15.179:6825/2985063934","cluster_addr":"172.21.15.179:6827/2985063934","heartbeat_back_addr":"172.21.15.179:6831/2985063934","heartbeat_front_addr":"172.21.15.179:6829/2985063934","state":["exists","up"]},{"osd":11,"uuid":"82f04fee-f6ae-4630-a75b-b12a9c4ab2e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6825","nonce":1858219600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6827","nonce":1858219600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6831","nonce":1858219600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6829","nonce":1858219600}]},"public_addr":"172.21.15.181:6825/1858219600","cluster_addr":"172.21.15.181:6827/1858219600","heartbeat_back_addr":"172.21.15.181:6831/1858219600","heartbeat_front_addr":"172.21.15.181:6829/1858219600","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:55.518970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:04:19.936339+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:04:44.064814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:09.331683+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:34.616774+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:58.881810+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:06:23.869838+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:06:49.127331+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:07:12.847187+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:07:38.231045+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:08:03.949162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:08:28.471802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:0/401101729":"2024-02-01T05:02:20.510858+0000","172.21.15.99:6801/1993198206":"2024-02-01T05:02:20.510858+0000","172.21.15.99:0/3819754569":"2024-02-01T05:02:20.510858+0000","172.21.15.99:0/475390265":"2024-02-01T05:01:53.732026+0000","172.21.15.99:6800/1993198206":"2024-02-01T05:02:20.510858+0000","172.21.15.99:6800/1706888338":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/4150146075":"2024-02-01T05:01:53.732026+0000","172.21.15.99:6801/1706888338":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/2851066598":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/1865156424":"2024-02-01T05:02:20.510858+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:10:49.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.276+0000 7f0168f8d640 1 -- 172.21.15.99:0/3806458649 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f01500a1370 msgr2=0x7f01500a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:49.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.276+0000 7f0168f8d640 1 --2- 172.21.15.99:0/3806458649 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f01500a1370 0x7f01500a3830 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f014c036040 tx=0x7f014c000bc0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.276+0000 7f0168f8d640 1 -- 172.21.15.99:0/3806458649 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0164100d10 msgr2=0x7f0164074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:49.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.276+0000 7f0168f8d640 1 --2- 172.21.15.99:0/3806458649 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0164100d10 0x7f0164074aa0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f015400b480 tx=0x7f015400b940 comp rx=0 tx=0).stop 2024-01-31T05:10:49.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.276+0000 7f0168f8d640 1 -- 172.21.15.99:0/3806458649 shutdown_connections 2024-01-31T05:10:49.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.276+0000 7f0168f8d640 1 --2- 172.21.15.99:0/3806458649 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f01500a1370 0x7f01500a3830 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.276+0000 7f0168f8d640 1 --2- 172.21.15.99:0/3806458649 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f01641028c0 0x7f0164073620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.276+0000 7f0168f8d640 1 --2- 172.21.15.99:0/3806458649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0164101f00 0x7f01640730e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.276+0000 7f0168f8d640 1 --2- 172.21.15.99:0/3806458649 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0164100d10 0x7f0164074aa0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.276+0000 7f0168f8d640 1 -- 172.21.15.99:0/3806458649 >> 172.21.15.99:0/3806458649 conn(0x7f01640fc2a0 msgr2=0x7f0164105320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:49.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.276+0000 7f0168f8d640 1 -- 172.21.15.99:0/3806458649 shutdown_connections 2024-01-31T05:10:49.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.276+0000 7f0168f8d640 1 -- 172.21.15.99:0/3806458649 wait complete. 2024-01-31T05:10:49.287 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T05:10:49.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.389+0000 7f85dc262640 1 -- 172.21.15.99:0/1505384424 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85d410c910 msgr2=0x7f85d410cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:49.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.389+0000 7f85dc262640 1 --2- 172.21.15.99:0/1505384424 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85d410c910 0x7f85d410cd90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f85c4009900 tx=0x7f85c402bc30 comp rx=0 tx=0).stop 2024-01-31T05:10:49.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.389+0000 7f85dc262640 1 -- 172.21.15.99:0/1505384424 shutdown_connections 2024-01-31T05:10:49.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.389+0000 7f85dc262640 1 --2- 172.21.15.99:0/1505384424 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f85d410d2d0 0x7f85d4113b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.389+0000 7f85dc262640 1 --2- 172.21.15.99:0/1505384424 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85d410c910 0x7f85d410cd90 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.389+0000 7f85dc262640 1 --2- 172.21.15.99:0/1505384424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85d410b720 0x7f85d410bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.389+0000 7f85dc262640 1 -- 172.21.15.99:0/1505384424 >> 172.21.15.99:0/1505384424 conn(0x7f85d406b750 msgr2=0x7f85d406bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:49.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.389+0000 7f85dc262640 1 -- 172.21.15.99:0/1505384424 shutdown_connections 2024-01-31T05:10:49.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.389+0000 7f85dc262640 1 -- 172.21.15.99:0/1505384424 wait complete. 2024-01-31T05:10:49.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.389+0000 7f85dc262640 1 Processor -- start 2024-01-31T05:10:49.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.390+0000 7f85dc262640 1 -- start start 2024-01-31T05:10:49.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.390+0000 7f85dc262640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f85d410b720 0x7f85d41a1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:49.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.390+0000 7f85dc262640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85d410c910 0x7f85d41a1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:49.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.390+0000 7f85dc262640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85d410d2d0 0x7f85d41a8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:49.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.390+0000 7f85dc262640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d41a9200 con 0x7f85d410c910 2024-01-31T05:10:49.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.390+0000 7f85dc262640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d41a9370 con 0x7f85d410d2d0 2024-01-31T05:10:49.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.390+0000 7f85dc262640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d41a9530 con 0x7f85d410b720 2024-01-31T05:10:49.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.390+0000 7f85d97fd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85d410c910 0x7f85d41a1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:49.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.390+0000 7f85d97fd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85d410c910 0x7f85d41a1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45034/0 (socket says 172.21.15.99:45034) 2024-01-31T05:10:49.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.390+0000 7f85d97fd640 1 -- 172.21.15.99:0/312308560 learned_addr learned my addr 172.21.15.99:0/312308560 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:49.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.390+0000 7f85d9ffe640 1 --2- 172.21.15.99:0/312308560 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f85d410b720 0x7f85d41a1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:49.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.390+0000 7f85da7ff640 1 --2- 172.21.15.99:0/312308560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85d410d2d0 0x7f85d41a8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:49.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.390+0000 7f85d97fd640 1 -- 172.21.15.99:0/312308560 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f85d410b720 msgr2=0x7f85d41a1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:49.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.390+0000 7f85d97fd640 1 --2- 172.21.15.99:0/312308560 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f85d410b720 0x7f85d41a1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.390+0000 7f85d97fd640 1 -- 172.21.15.99:0/312308560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85d410d2d0 msgr2=0x7f85d41a8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:49.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.390+0000 7f85d97fd640 1 --2- 172.21.15.99:0/312308560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85d410d2d0 0x7f85d41a8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.390+0000 7f85d97fd640 1 -- 172.21.15.99:0/312308560 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c4009560 con 0x7f85d410c910 2024-01-31T05:10:49.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.390+0000 7f85d9ffe640 1 --2- 172.21.15.99:0/312308560 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f85d410b720 0x7f85d41a1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:10:49.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.390+0000 7f85da7ff640 1 --2- 172.21.15.99:0/312308560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85d410d2d0 0x7f85d41a8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:10:49.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.390+0000 7f85d97fd640 1 --2- 172.21.15.99:0/312308560 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85d410c910 0x7f85d41a1c50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f85c4009230 tx=0x7f85c40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:49.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.390+0000 7f85caffd640 1 -- 172.21.15.99:0/312308560 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c40044e0 con 0x7f85d410c910 2024-01-31T05:10:49.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.390+0000 7f85caffd640 1 -- 172.21.15.99:0/312308560 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f85c40035f0 con 0x7f85d410c910 2024-01-31T05:10:49.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.390+0000 7f85dc262640 1 -- 172.21.15.99:0/312308560 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85d41a97b0 con 0x7f85d410c910 2024-01-31T05:10:49.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.390+0000 7f85caffd640 1 -- 172.21.15.99:0/312308560 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c403e6b0 con 0x7f85d410c910 2024-01-31T05:10:49.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.390+0000 7f85dc262640 1 -- 172.21.15.99:0/312308560 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85d41a9cc0 con 0x7f85d410c910 2024-01-31T05:10:49.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.391+0000 7f85dc262640 1 -- 172.21.15.99:0/312308560 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85d4112ac0 con 0x7f85d410c910 2024-01-31T05:10:49.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.392+0000 7f85caffd640 1 -- 172.21.15.99:0/312308560 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f85c4003960 con 0x7f85d410c910 2024-01-31T05:10:49.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.393+0000 7f85caffd640 1 --2- 172.21.15.99:0/312308560 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f85c00a1370 0x7f85c00a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:49.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.393+0000 7f85d9ffe640 1 --2- 172.21.15.99:0/312308560 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f85c00a1370 0x7f85c00a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:49.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.393+0000 7f85caffd640 1 -- 172.21.15.99:0/312308560 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f85c40ef5f0 con 0x7f85d410c910 2024-01-31T05:10:49.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.394+0000 7f85d9ffe640 1 --2- 172.21.15.99:0/312308560 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f85c00a1370 0x7f85c00a3830 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f85d410c770 tx=0x7f85d000a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:49.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.398+0000 7f85caffd640 1 -- 172.21.15.99:0/312308560 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f85c40b8b40 con 0x7f85d410c910 2024-01-31T05:10:49.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.606+0000 7f85dc262640 1 -- 172.21.15.99:0/312308560 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f85d402ca70 con 0x7f85d410c910 2024-01-31T05:10:49.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.607+0000 7f85caffd640 1 -- 172.21.15.99:0/312308560 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11385 (secure 0 0 0) 0x7f85c40bc160 con 0x7f85d410c910 2024-01-31T05:10:49.607 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:10:49.607 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/1488539026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1488539026},{"type":"v1","addr":"172.21.15.99:6835","nonce":1488539026}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/1649552652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1649552652},{"type":"v1","addr":"172.21.15.99:6837","nonce":1649552652}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-01-31T05:09:20.564215+0000","modified":"2024-01-31T05:09:28.172314+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24461,"mds_2":24457,"mds_3":24439,"mds_4":14619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6839/4070477446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4070477446},{"type":"v1","addr":"172.21.15.99:6839","nonce":4070477446}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.99:6841/3069939345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6840","nonce":3069939345},{"type":"v1","addr":"172.21.15.99:6841","nonce":3069939345}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24376":{"gid":24376,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6833/427201290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":427201290},{"type":"v1","addr":"172.21.15.181:6833","nonce":427201290}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24401":{"gid":24401,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/472161020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":472161020},{"type":"v1","addr":"172.21.15.179:6833","nonce":472161020}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24427":{"gid":24427,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/1038715471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1038715471},{"type":"v1","addr":"172.21.15.181:6835","nonce":1038715471}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24434":{"gid":24434,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/966976592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":966976592},{"type":"v1","addr":"172.21.15.179:6835","nonce":966976592}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24439":{"gid":24439,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.181:6837/3875964154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3875964154},{"type":"v1","addr":"172.21.15.181:6837","nonce":3875964154}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24457":{"gid":24457,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.181:6839/996120687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":996120687},{"type":"v1","addr":"172.21.15.181:6839","nonce":996120687}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6837/837402830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":837402830},{"type":"v1","addr":"172.21.15.179:6837","nonce":837402830}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6839/754762785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":754762785},{"type":"v1","addr":"172.21.15.179:6839","nonce":754762785}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-31T05:10:49.608 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 26 2024-01-31T05:10:49.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.609+0000 7f85dc262640 1 -- 172.21.15.99:0/312308560 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f85c00a1370 msgr2=0x7f85c00a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:49.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.609+0000 7f85dc262640 1 --2- 172.21.15.99:0/312308560 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f85c00a1370 0x7f85c00a3830 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f85d410c770 tx=0x7f85d000a560 comp rx=0 tx=0).stop 2024-01-31T05:10:49.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.609+0000 7f85dc262640 1 -- 172.21.15.99:0/312308560 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85d410c910 msgr2=0x7f85d41a1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:49.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.609+0000 7f85dc262640 1 --2- 172.21.15.99:0/312308560 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85d410c910 0x7f85d41a1c50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f85c4009230 tx=0x7f85c40042f0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.609+0000 7f85dc262640 1 -- 172.21.15.99:0/312308560 shutdown_connections 2024-01-31T05:10:49.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.609+0000 7f85dc262640 1 --2- 172.21.15.99:0/312308560 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f85c00a1370 0x7f85c00a3830 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.609+0000 7f85dc262640 1 --2- 172.21.15.99:0/312308560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85d410d2d0 0x7f85d41a8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.609+0000 7f85dc262640 1 --2- 172.21.15.99:0/312308560 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85d410c910 0x7f85d41a1c50 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.609+0000 7f85dc262640 1 --2- 172.21.15.99:0/312308560 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f85d410b720 0x7f85d41a1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.609+0000 7f85dc262640 1 -- 172.21.15.99:0/312308560 >> 172.21.15.99:0/312308560 conn(0x7f85d406b750 msgr2=0x7f85d410fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:49.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.609+0000 7f85dc262640 1 -- 172.21.15.99:0/312308560 shutdown_connections 2024-01-31T05:10:49.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.609+0000 7f85dc262640 1 -- 172.21.15.99:0/312308560 wait complete. 2024-01-31T05:10:49.620 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-01-31T05:09:20.564215+0000', 'modified': '2024-01-31T05:09:28.172314+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24497, 'mds_1': 24461, 'mds_2': 24457, 'mds_3': 24439, 'mds_4': 14619}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14607': {'gid': 14607, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.99:6839/4070477446', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6838', 'nonce': 4070477446}, {'type': 'v1', 'addr': '172.21.15.99:6839', 'nonce': 4070477446}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_14619': {'gid': 14619, 'name': 'a', 'rank': 4, 'incarnation': 24, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.99:6841/3069939345', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6840', 'nonce': 3069939345}, {'type': 'v1', 'addr': '172.21.15.99:6841', 'nonce': 3069939345}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24376': {'gid': 24376, 'name': 'l', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.181:6833/427201290', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6832', 'nonce': 427201290}, {'type': 'v1', 'addr': '172.21.15.181:6833', 'nonce': 427201290}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24401': {'gid': 24401, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.179:6833/472161020', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6832', 'nonce': 472161020}, {'type': 'v1', 'addr': '172.21.15.179:6833', 'nonce': 472161020}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24427': {'gid': 24427, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.181:6835/1038715471', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6834', 'nonce': 1038715471}, {'type': 'v1', 'addr': '172.21.15.181:6835', 'nonce': 1038715471}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24434': {'gid': 24434, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.179:6835/966976592', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6834', 'nonce': 966976592}, {'type': 'v1', 'addr': '172.21.15.179:6835', 'nonce': 966976592}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24439': {'gid': 24439, 'name': 'c', 'rank': 3, 'incarnation': 22, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.181:6837/3875964154', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6836', 'nonce': 3875964154}, {'type': 'v1', 'addr': '172.21.15.181:6837', 'nonce': 3875964154}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24457': {'gid': 24457, 'name': 'i', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.181:6839/996120687', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6838', 'nonce': 996120687}, {'type': 'v1', 'addr': '172.21.15.181:6839', 'nonce': 996120687}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24461': {'gid': 24461, 'name': 'h', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.179:6837/837402830', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6836', 'nonce': 837402830}, {'type': 'v1', 'addr': '172.21.15.179:6837', 'nonce': 837402830}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24497': {'gid': 24497, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.179:6839/754762785', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6838', 'nonce': 754762785}, {'type': 'v1', 'addr': '172.21.15.179:6839', 'nonce': 754762785}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-01-31T05:10:49.620 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-01-31T05:10:49.620 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-01-31T05:10:49.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.725+0000 7f9ce5f12640 1 -- 172.21.15.99:0/3966155344 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ce00ffc10 msgr2=0x7f9ce0100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:49.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.725+0000 7f9ce5f12640 1 --2- 172.21.15.99:0/3966155344 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ce00ffc10 0x7f9ce0100030 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0009ca0 tx=0x7f9cd002c0f0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.725+0000 7f9ce5f12640 1 -- 172.21.15.99:0/3966155344 shutdown_connections 2024-01-31T05:10:49.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.725+0000 7f9ce5f12640 1 --2- 172.21.15.99:0/3966155344 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ce01017c0 0x7f9ce0108050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.725+0000 7f9ce5f12640 1 --2- 172.21.15.99:0/3966155344 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ce0100e00 0x7f9ce0101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.725+0000 7f9ce5f12640 1 --2- 172.21.15.99:0/3966155344 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ce00ffc10 0x7f9ce0100030 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.725+0000 7f9ce5f12640 1 -- 172.21.15.99:0/3966155344 >> 172.21.15.99:0/3966155344 conn(0x7f9ce00fb1a0 msgr2=0x7f9ce00fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:49.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.725+0000 7f9ce5f12640 1 -- 172.21.15.99:0/3966155344 shutdown_connections 2024-01-31T05:10:49.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.725+0000 7f9ce5f12640 1 -- 172.21.15.99:0/3966155344 wait complete. 2024-01-31T05:10:49.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.725+0000 7f9ce5f12640 1 Processor -- start 2024-01-31T05:10:49.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.726+0000 7f9ce5f12640 1 -- start start 2024-01-31T05:10:49.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.726+0000 7f9ce5f12640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ce00ffc10 0x7f9ce0069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:49.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.726+0000 7f9ce5f12640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ce0100e00 0x7f9ce019bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:49.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.726+0000 7f9ce5f12640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ce01017c0 0x7f9ce019e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:49.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.726+0000 7f9ce5f12640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce019e880 con 0x7f9ce01017c0 2024-01-31T05:10:49.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.726+0000 7f9ce5f12640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce019e9f0 con 0x7f9ce00ffc10 2024-01-31T05:10:49.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.726+0000 7f9ce5f12640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce019ebb0 con 0x7f9ce0100e00 2024-01-31T05:10:49.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.726+0000 7f9cdffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ce01017c0 0x7f9ce019e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:49.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.726+0000 7f9cdffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ce01017c0 0x7f9ce019e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45052/0 (socket says 172.21.15.99:45052) 2024-01-31T05:10:49.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.726+0000 7f9cdffff640 1 -- 172.21.15.99:0/1098242420 learned_addr learned my addr 172.21.15.99:0/1098242420 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:49.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.726+0000 7f9cdeffd640 1 --2- 172.21.15.99:0/1098242420 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ce0100e00 0x7f9ce019bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:49.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.726+0000 7f9cdf7fe640 1 --2- 172.21.15.99:0/1098242420 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ce00ffc10 0x7f9ce0069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:49.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.726+0000 7f9cdffff640 1 -- 172.21.15.99:0/1098242420 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ce0100e00 msgr2=0x7f9ce019bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:49.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.726+0000 7f9cdffff640 1 --2- 172.21.15.99:0/1098242420 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ce0100e00 0x7f9ce019bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.726+0000 7f9cdffff640 1 -- 172.21.15.99:0/1098242420 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ce00ffc10 msgr2=0x7f9ce0069e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:49.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.726+0000 7f9cdffff640 1 --2- 172.21.15.99:0/1098242420 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ce00ffc10 0x7f9ce0069e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.726+0000 7f9cdffff640 1 -- 172.21.15.99:0/1098242420 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd0009900 con 0x7f9ce01017c0 2024-01-31T05:10:49.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.726+0000 7f9cdffff640 1 --2- 172.21.15.99:0/1098242420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ce01017c0 0x7f9ce019e0f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8009fd0 tx=0x7f9cd800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:49.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.727+0000 7f9cdcff9640 1 -- 172.21.15.99:0/1098242420 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd8011830 con 0x7f9ce01017c0 2024-01-31T05:10:49.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.727+0000 7f9cdcff9640 1 -- 172.21.15.99:0/1098242420 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9cd8011e50 con 0x7f9ce01017c0 2024-01-31T05:10:49.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.727+0000 7f9cdcff9640 1 -- 172.21.15.99:0/1098242420 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd800f2e0 con 0x7f9ce01017c0 2024-01-31T05:10:49.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.727+0000 7f9ce5f12640 1 -- 172.21.15.99:0/1098242420 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ce019ee90 con 0x7f9ce01017c0 2024-01-31T05:10:49.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.727+0000 7f9ce5f12640 1 -- 172.21.15.99:0/1098242420 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ce019f3f0 con 0x7f9ce01017c0 2024-01-31T05:10:49.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.729+0000 7f9cdcff9640 1 -- 172.21.15.99:0/1098242420 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f9cd8010580 con 0x7f9ce01017c0 2024-01-31T05:10:49.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.729+0000 7f9ce8da9740 1 Processor -- start 2024-01-31T05:10:49.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.729+0000 7f9ce8da9740 1 -- start start 2024-01-31T05:10:49.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.729+0000 7f9cdcff9640 1 --2- 172.21.15.99:0/1098242420 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f9ccc0a1370 0x7f9ccc0a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:49.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.729+0000 7f9ce8da9740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56544c1b5670 0x56544c1b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:49.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.729+0000 7f9ce8da9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56544c1b6060 0x56544c1bab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:49.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.729+0000 7f9ce8da9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56544c1bb1d0 0x56544c1bd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:49.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.729+0000 7f9ce8da9740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56544c124000 con 0x56544c1b5670 2024-01-31T05:10:49.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.729+0000 7f9ce8da9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x56544c1216f0 con 0x56544c1bb1d0 2024-01-31T05:10:49.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.729+0000 7f9ce8da9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x56544c11cfe0 con 0x56544c1b6060 2024-01-31T05:10:49.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.729+0000 7f9cdcff9640 1 -- 172.21.15.99:0/1098242420 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f9cd80cc190 con 0x7f9ce01017c0 2024-01-31T05:10:49.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.729+0000 7f9cdf7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56544c1b5670 0x56544c1b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:49.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.729+0000 7f9cdeffd640 1 --2- 172.21.15.99:0/1098242420 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f9ccc0a1370 0x7f9ccc0a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:49.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.729+0000 7f9cdf7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56544c1b5670 0x56544c1b5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45058/0 (socket says 172.21.15.99:45058) 2024-01-31T05:10:49.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.729+0000 7f9cdf7fe640 1 -- 172.21.15.99:0/537129600 learned_addr learned my addr 172.21.15.99:0/537129600 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:49.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.729+0000 7f9cdffff640 1 --2- 172.21.15.99:0/537129600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56544c1bb1d0 0x56544c1bd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:49.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.730+0000 7f9cdf7fe640 1 -- 172.21.15.99:0/537129600 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56544c1b6060 msgr2=0x56544c1bab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:10:49.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.730+0000 7f9cdeffd640 1 --2- 172.21.15.99:0/537129600 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56544c1b6060 0x56544c1bab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:49.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.730+0000 7f9cdf7fe640 1 --2- 172.21.15.99:0/537129600 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56544c1b6060 0x56544c1bab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.730+0000 7f9cdf7fe640 1 -- 172.21.15.99:0/537129600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56544c1bb1d0 msgr2=0x56544c1bd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:10:49.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.730+0000 7f9cdf7fe640 1 --2- 172.21.15.99:0/537129600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56544c1bb1d0 0x56544c1bd660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.730+0000 7f9cdf7fe640 1 -- 172.21.15.99:0/537129600 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56544c0df650 con 0x56544c1b5670 2024-01-31T05:10:49.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.730+0000 7f9cdffff640 1 --2- 172.21.15.99:0/537129600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56544c1bb1d0 0x56544c1bd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:10:49.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.730+0000 7f9cdeffd640 1 --2- 172.21.15.99:0/537129600 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56544c1b6060 0x56544c1bab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:10:49.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.730+0000 7f9cdeffd640 1 --2- 172.21.15.99:0/1098242420 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f9ccc0a1370 0x7f9ccc0a3830 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0069bc0 tx=0x7f9cc800a6f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:49.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.730+0000 7f9cdf7fe640 1 --2- 172.21.15.99:0/537129600 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56544c1b5670 0x56544c1b5a90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9cd00098d0 tx=0x7f9cd0032470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51fe357348d6e897 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:49.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.730+0000 7f9cd5ffb640 1 -- 172.21.15.99:0/537129600 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd0034440 con 0x56544c1b5670 2024-01-31T05:10:49.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.730+0000 7f9cd5ffb640 1 -- 172.21.15.99:0/537129600 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9cd00345a0 con 0x56544c1b5670 2024-01-31T05:10:49.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.730+0000 7f9cd5ffb640 1 -- 172.21.15.99:0/537129600 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd0003c00 con 0x56544c1b5670 2024-01-31T05:10:49.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.731+0000 7f9ce8da9740 1 -- 172.21.15.99:0/537129600 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56544c1b5670 msgr2=0x56544c1b5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:49.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.731+0000 7f9ce8da9740 1 --2- 172.21.15.99:0/537129600 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56544c1b5670 0x56544c1b5a90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9cd00098d0 tx=0x7f9cd0032470 comp rx=0 tx=0).stop 2024-01-31T05:10:49.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.731+0000 7f9ce8da9740 1 -- 172.21.15.99:0/537129600 shutdown_connections 2024-01-31T05:10:49.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.731+0000 7f9ce8da9740 1 --2- 172.21.15.99:0/537129600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56544c1bb1d0 0x56544c1bd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.731+0000 7f9ce8da9740 1 --2- 172.21.15.99:0/537129600 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56544c1b6060 0x56544c1bab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.731+0000 7f9ce8da9740 1 --2- 172.21.15.99:0/537129600 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56544c1b5670 0x56544c1b5a90 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.731+0000 7f9ce8da9740 1 -- 172.21.15.99:0/537129600 >> 172.21.15.99:0/537129600 conn(0x56544c1b0be0 msgr2=0x56544c1b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:49.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.731+0000 7f9ce8da9740 1 -- 172.21.15.99:0/537129600 shutdown_connections 2024-01-31T05:10:49.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.731+0000 7f9ce8da9740 1 -- 172.21.15.99:0/537129600 wait complete. 2024-01-31T05:10:49.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.731+0000 7f9ce8da9740 1 -- start start 2024-01-31T05:10:49.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.731+0000 7f9ce8da9740 1 Processor -- start 2024-01-31T05:10:49.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.731+0000 7f9ce8da9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56544c1b5670 0x56544c1bf850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:49.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.731+0000 7f9ce8da9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56544c1b6060 0x56544c1bfd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:49.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.731+0000 7f9ce8da9740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56544c1bb1d0 0x56544c1c6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:49.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.731+0000 7f9ce8da9740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56544c0d65c0 con 0x56544c1bb1d0 2024-01-31T05:10:49.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.731+0000 7f9ce8da9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x56544c0d6260 con 0x56544c1b5670 2024-01-31T05:10:49.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.731+0000 7f9ce8da9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x56544c09b2d0 con 0x56544c1b6060 2024-01-31T05:10:49.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.731+0000 7f9ce8da9740 10 client.0 _ll_register_callbacks cb 0x56544c0d1230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:10:49.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.731+0000 7f9cdffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56544c1bb1d0 0x56544c1c6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:49.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.731+0000 7f9cdffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56544c1bb1d0 0x56544c1c6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45062/0 (socket says 172.21.15.99:45062) 2024-01-31T05:10:49.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.731+0000 7f9cdffff640 1 -- 172.21.15.99:0/1959441600 learned_addr learned my addr 172.21.15.99:0/1959441600 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:49.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.732+0000 7f9cdeffd640 1 --2- 172.21.15.99:0/1959441600 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56544c1b6060 0x56544c1bfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:49.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.732+0000 7f9cdf7fe640 1 --2- 172.21.15.99:0/1959441600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56544c1b5670 0x56544c1bf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:49.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.732+0000 7f9cdffff640 1 -- 172.21.15.99:0/1959441600 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56544c1b6060 msgr2=0x56544c1bfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:10:49.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.732+0000 7f9cdffff640 1 --2- 172.21.15.99:0/1959441600 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56544c1b6060 0x56544c1bfd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.732+0000 7f9cdffff640 1 -- 172.21.15.99:0/1959441600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56544c1b5670 msgr2=0x56544c1bf850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:10:49.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.732+0000 7f9cdffff640 1 --2- 172.21.15.99:0/1959441600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56544c1b5670 0x56544c1bf850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.732+0000 7f9cdffff640 1 -- 172.21.15.99:0/1959441600 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ce0108950 con 0x56544c1bb1d0 2024-01-31T05:10:49.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.732+0000 7f9cdf7fe640 1 --2- 172.21.15.99:0/1959441600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56544c1b5670 0x56544c1bf850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:10:49.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.732+0000 7f9cdffff640 1 --2- 172.21.15.99:0/1959441600 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56544c1bb1d0 0x56544c1c6d60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9cd80990a0 tx=0x7f9cd8098d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=947f597c979cf75a server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:49.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.732+0000 7f9cbeffd640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:10:49.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.732+0000 7f9cbeffd640 1 -- 172.21.15.99:0/1959441600 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd80993a0 con 0x56544c1bb1d0 2024-01-31T05:10:49.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.732+0000 7f9cbeffd640 1 -- 172.21.15.99:0/1959441600 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f9cd809d4f0 con 0x56544c1bb1d0 2024-01-31T05:10:49.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.732+0000 7f9ce8da9740 1 -- 172.21.15.99:0/1959441600 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56544c115e70 con 0x56544c1bb1d0 2024-01-31T05:10:49.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.732+0000 7f9cbeffd640 1 -- 172.21.15.99:0/1959441600 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9cd80a1730 con 0x56544c1bb1d0 2024-01-31T05:10:49.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.732+0000 7f9ce8da9740 10 client.15033 fetch_fsmap learned FSMap version 26 2024-01-31T05:10:49.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.732+0000 7f9ce8da9740 1 -- 172.21.15.99:0/1959441600 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56544c11b660 con 0x56544c1bb1d0 2024-01-31T05:10:49.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.732+0000 7f9cbeffd640 1 -- 172.21.15.99:0/1959441600 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56544c115e70 con 0x56544c1bb1d0 2024-01-31T05:10:49.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.732+0000 7f9cbeffd640 1 -- 172.21.15.99:0/1959441600 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9cd8095190 con 0x56544c1bb1d0 2024-01-31T05:10:49.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.732+0000 7f9ce8da9740 10 client.15033 fetch_fsmap finished waiting for FSMap version 26 2024-01-31T05:10:49.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.733+0000 7f9ce8da9740 10 client.15033 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-31T05:10:49.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.733+0000 7f9ce8da9740 20 client.15033 populate_metadata read hostname 'smithi099' 2024-01-31T05:10:49.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.733+0000 7f9ce8da9740 1 --2- 172.21.15.99:0/1959441600 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x56544c1cc8e0 0x56544c1cb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:49.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.733+0000 7f9ce8da9740 4 client.15033 mds_command: new command op to 14619 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:10:49.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.733+0000 7f9ce8da9740 1 -- 172.21.15.99:0/1959441600 --> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56544c115b90 con 0x56544c1cc8e0 2024-01-31T05:10:49.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.733+0000 7f9cdf7fe640 1 --2- 172.21.15.99:0/1959441600 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x56544c1cc8e0 0x56544c1cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:49.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.733+0000 7f9cbeffd640 10 client.15033 ms_handle_connect on v2:172.21.15.99:6840/3069939345 2024-01-31T05:10:49.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.733+0000 7f9cdf7fe640 1 --2- 172.21.15.99:0/1959441600 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x56544c1cc8e0 0x56544c1cb340 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=915912d698659623 server_cookie=1382acda0239daae in_seq=0 out_seq=0 2024-01-31T05:10:49.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.734+0000 7f9cbeffd640 1 -- 172.21.15.99:0/1959441600 <== mds.4 v2:172.21.15.99:6840/3069939345 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56544c115b90 con 0x56544c1cc8e0 2024-01-31T05:10:49.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.734+0000 7f9cbeffd640 10 client.15033 handle_command_reply: tid=0 2024-01-31T05:10:49.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.734+0000 7f9ce8da9740 1 client.15033 shutdown 2024-01-31T05:10:49.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.734+0000 7f9ce8da9740 1 -- 172.21.15.99:0/1959441600 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56544c1bb1d0 msgr2=0x56544c1c6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:49.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.734+0000 7f9ce8da9740 1 --2- 172.21.15.99:0/1959441600 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56544c1bb1d0 0x56544c1c6d60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9cd80990a0 tx=0x7f9cd8098d00 comp rx=0 tx=0).stop 2024-01-31T05:10:49.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.734+0000 7f9ce8da9740 1 -- 172.21.15.99:0/1959441600 shutdown_connections 2024-01-31T05:10:49.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.734+0000 7f9ce8da9740 1 --2- 172.21.15.99:0/1959441600 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x56544c1cc8e0 0x56544c1cb340 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.734+0000 7f9ce8da9740 1 --2- 172.21.15.99:0/1959441600 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56544c1bb1d0 0x56544c1c6d60 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.734+0000 7f9cbeffd640 0 client.15033 ms_handle_reset on v2:172.21.15.99:6840/3069939345 2024-01-31T05:10:49.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.734+0000 7f9ce8da9740 1 --2- 172.21.15.99:0/1959441600 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56544c1b6060 0x56544c1bfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.734+0000 7f9ce8da9740 1 --2- 172.21.15.99:0/1959441600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56544c1b5670 0x56544c1bf850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.734+0000 7f9ce8da9740 1 -- 172.21.15.99:0/1959441600 >> 172.21.15.99:0/1959441600 conn(0x56544c1b0be0 msgr2=0x56544c1afd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:49.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.734+0000 7f9ce8da9740 1 -- 172.21.15.99:0/1959441600 shutdown_connections 2024-01-31T05:10:49.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.734+0000 7f9ce8da9740 1 -- 172.21.15.99:0/1959441600 wait complete. 2024-01-31T05:10:49.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.734+0000 7f9ce8da9740 20 client.15033 trim_cache size 0 max 16384 2024-01-31T05:10:49.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.749+0000 7f9ce8da9740 1 Processor -- start 2024-01-31T05:10:49.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.749+0000 7f9ce8da9740 1 -- start start 2024-01-31T05:10:49.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.749+0000 7f9ce8da9740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56544c1b5670 0x56544c1cb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:49.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.749+0000 7f9ce8da9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56544c1b6060 0x56544c1cb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:49.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.749+0000 7f9ce8da9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56544c1bb1d0 0x56544c1af4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:49.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.749+0000 7f9ce8da9740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56544c1c0780 con 0x56544c1b5670 2024-01-31T05:10:49.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.749+0000 7f9ce8da9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x56544c1ac4e0 con 0x56544c1bb1d0 2024-01-31T05:10:49.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.749+0000 7f9ce8da9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x56544c0c97a0 con 0x56544c1b6060 2024-01-31T05:10:49.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.750+0000 7f9cdf7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56544c1b5670 0x56544c1cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:49.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.750+0000 7f9cdf7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56544c1b5670 0x56544c1cb340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45064/0 (socket says 172.21.15.99:45064) 2024-01-31T05:10:49.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.750+0000 7f9cdf7fe640 1 -- 172.21.15.99:0/2102688803 learned_addr learned my addr 172.21.15.99:0/2102688803 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:49.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.750+0000 7f9cdeffd640 1 --2- 172.21.15.99:0/2102688803 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56544c1b6060 0x56544c1cb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:49.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.750+0000 7f9cdf7fe640 1 -- 172.21.15.99:0/2102688803 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56544c1b6060 msgr2=0x56544c1cb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:10:49.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.750+0000 7f9cdf7fe640 1 --2- 172.21.15.99:0/2102688803 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56544c1b6060 0x56544c1cb880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.750+0000 7f9cdf7fe640 1 -- 172.21.15.99:0/2102688803 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56544c1bb1d0 msgr2=0x56544c1af4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:10:49.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.750+0000 7f9cdf7fe640 1 --2- 172.21.15.99:0/2102688803 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56544c1bb1d0 0x56544c1af4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.750+0000 7f9cdf7fe640 1 -- 172.21.15.99:0/2102688803 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56544c0b8360 con 0x56544c1b5670 2024-01-31T05:10:49.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.750+0000 7f9cdf7fe640 1 --2- 172.21.15.99:0/2102688803 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56544c1b5670 0x56544c1cb340 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0033000 tx=0x7f9cd002e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13b84bab01feb64f server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:49.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.750+0000 7f9cd57fa640 1 -- 172.21.15.99:0/2102688803 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd0034710 con 0x56544c1b5670 2024-01-31T05:10:49.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.750+0000 7f9cd57fa640 1 -- 172.21.15.99:0/2102688803 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9cd003f480 con 0x56544c1b5670 2024-01-31T05:10:49.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.750+0000 7f9cd57fa640 1 -- 172.21.15.99:0/2102688803 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd0048670 con 0x56544c1b5670 2024-01-31T05:10:49.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.751+0000 7f9ce8da9740 1 -- 172.21.15.99:0/2102688803 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56544c1b5670 msgr2=0x56544c1cb340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:49.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.751+0000 7f9ce8da9740 1 --2- 172.21.15.99:0/2102688803 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56544c1b5670 0x56544c1cb340 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0033000 tx=0x7f9cd002e040 comp rx=0 tx=0).stop 2024-01-31T05:10:49.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.751+0000 7f9ce8da9740 1 -- 172.21.15.99:0/2102688803 shutdown_connections 2024-01-31T05:10:49.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.751+0000 7f9ce8da9740 1 --2- 172.21.15.99:0/2102688803 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56544c1bb1d0 0x56544c1af4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.751+0000 7f9ce8da9740 1 --2- 172.21.15.99:0/2102688803 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56544c1b6060 0x56544c1cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.751+0000 7f9ce8da9740 1 --2- 172.21.15.99:0/2102688803 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56544c1b5670 0x56544c1cb340 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.751+0000 7f9ce8da9740 1 -- 172.21.15.99:0/2102688803 >> 172.21.15.99:0/2102688803 conn(0x56544c1b0be0 msgr2=0x56544c1b7520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:49.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.751+0000 7f9ce8da9740 1 -- 172.21.15.99:0/2102688803 shutdown_connections 2024-01-31T05:10:49.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.751+0000 7f9ce8da9740 1 -- 172.21.15.99:0/2102688803 wait complete. 2024-01-31T05:10:49.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.751+0000 7f9ce8da9740 1 -- start start 2024-01-31T05:10:49.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.751+0000 7f9ce8da9740 1 Processor -- start 2024-01-31T05:10:49.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.751+0000 7f9ce8da9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56544c1b5670 0x56544c21e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:49.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.751+0000 7f9ce8da9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56544c1b6060 0x56544c21eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:49.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.751+0000 7f9ce8da9740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56544c1bb1d0 0x56544c225bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:49.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.751+0000 7f9ce8da9740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56544c226110 con 0x56544c1bb1d0 2024-01-31T05:10:49.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.751+0000 7f9ce8da9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x56544c226250 con 0x56544c1b5670 2024-01-31T05:10:49.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.751+0000 7f9ce8da9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x56544c2263c0 con 0x56544c1b6060 2024-01-31T05:10:49.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.752+0000 7f9ce8da9740 10 client.0 _ll_register_callbacks cb 0x7f9cd0009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:10:49.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.752+0000 7f9cdffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56544c1bb1d0 0x56544c225bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:49.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.752+0000 7f9cdffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56544c1bb1d0 0x56544c225bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45080/0 (socket says 172.21.15.99:45080) 2024-01-31T05:10:49.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.752+0000 7f9cdffff640 1 -- 172.21.15.99:0/2051905831 learned_addr learned my addr 172.21.15.99:0/2051905831 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:49.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.752+0000 7f9cdeffd640 1 --2- 172.21.15.99:0/2051905831 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56544c1b6060 0x56544c21eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:49.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.752+0000 7f9cdf7fe640 1 --2- 172.21.15.99:0/2051905831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56544c1b5670 0x56544c21e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:49.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.752+0000 7f9cdffff640 1 -- 172.21.15.99:0/2051905831 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56544c1b6060 msgr2=0x56544c21eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:10:49.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.752+0000 7f9cdffff640 1 --2- 172.21.15.99:0/2051905831 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56544c1b6060 0x56544c21eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.752+0000 7f9cdffff640 1 -- 172.21.15.99:0/2051905831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56544c1b5670 msgr2=0x56544c21e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:10:49.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.752+0000 7f9cdffff640 1 --2- 172.21.15.99:0/2051905831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56544c1b5670 0x56544c21e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.752+0000 7f9cdffff640 1 -- 172.21.15.99:0/2051905831 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56544c0df650 con 0x56544c1bb1d0 2024-01-31T05:10:49.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.752+0000 7f9cdf7fe640 1 --2- 172.21.15.99:0/2051905831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56544c1b5670 0x56544c21e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:10:49.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.752+0000 7f9cdffff640 1 --2- 172.21.15.99:0/2051905831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56544c1bb1d0 0x56544c225bd0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8099330 tx=0x7f9cd80956e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af38bb582e46f05c server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:49.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.752+0000 7f9cbeffd640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:10:49.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.752+0000 7f9cbeffd640 1 -- 172.21.15.99:0/2051905831 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd804f490 con 0x56544c1bb1d0 2024-01-31T05:10:49.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.752+0000 7f9cbeffd640 1 -- 172.21.15.99:0/2051905831 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f9cd809d4f0 con 0x56544c1bb1d0 2024-01-31T05:10:49.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.752+0000 7f9ce8da9740 1 -- 172.21.15.99:0/2051905831 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9cd00345a0 con 0x56544c1bb1d0 2024-01-31T05:10:49.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.752+0000 7f9cbeffd640 1 -- 172.21.15.99:0/2051905831 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9cd80b7070 con 0x56544c1bb1d0 2024-01-31T05:10:49.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.752+0000 7f9ce8da9740 10 client.15039 fetch_fsmap learned FSMap version 26 2024-01-31T05:10:49.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.752+0000 7f9ce8da9740 1 -- 172.21.15.99:0/2051905831 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56544c0ddeb0 con 0x56544c1bb1d0 2024-01-31T05:10:49.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.752+0000 7f9cbeffd640 1 -- 172.21.15.99:0/2051905831 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9cd00345a0 con 0x56544c1bb1d0 2024-01-31T05:10:49.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.752+0000 7f9cbeffd640 1 -- 172.21.15.99:0/2051905831 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9cd8079020 con 0x56544c1bb1d0 2024-01-31T05:10:49.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.752+0000 7f9ce8da9740 10 client.15039 fetch_fsmap finished waiting for FSMap version 26 2024-01-31T05:10:49.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.753+0000 7f9ce8da9740 10 client.15039 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-31T05:10:49.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.753+0000 7f9ce8da9740 20 client.15039 populate_metadata read hostname 'smithi099' 2024-01-31T05:10:49.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.753+0000 7f9ce8da9740 1 --2- 172.21.15.99:0/2051905831 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x56544c22b160 0x56544c2276b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:49.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.753+0000 7f9ce8da9740 4 client.15039 mds_command: new command op to 14619 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-31T05:10:49.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.753+0000 7f9ce8da9740 1 -- 172.21.15.99:0/2051905831 --> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56544be1c6c0 con 0x56544c22b160 2024-01-31T05:10:49.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.753+0000 7f9cdf7fe640 1 --2- 172.21.15.99:0/2051905831 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x56544c22b160 0x56544c2276b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:49.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.753+0000 7f9cbeffd640 10 client.15039 ms_handle_connect on v2:172.21.15.99:6840/3069939345 2024-01-31T05:10:49.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.753+0000 7f9cdf7fe640 1 --2- 172.21.15.99:0/2051905831 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x56544c22b160 0x56544c2276b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=408e633b05f128df server_cookie=a4d6d40114988190 in_seq=0 out_seq=0 2024-01-31T05:10:49.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.753+0000 7f9cbeffd640 1 -- 172.21.15.99:0/2051905831 <== mds.4 v2:172.21.15.99:6840/3069939345 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x56544be1c6c0 con 0x56544c22b160 2024-01-31T05:10:49.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.753+0000 7f9cbeffd640 10 client.15039 handle_command_reply: tid=0 2024-01-31T05:10:49.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.753+0000 7f9ce8da9740 1 client.15039 shutdown 2024-01-31T05:10:49.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.753+0000 7f9ce8da9740 1 -- 172.21.15.99:0/2051905831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56544c1bb1d0 msgr2=0x56544c225bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:49.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.753+0000 7f9ce8da9740 1 --2- 172.21.15.99:0/2051905831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56544c1bb1d0 0x56544c225bd0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8099330 tx=0x7f9cd80956e0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.753+0000 7f9ce8da9740 1 -- 172.21.15.99:0/2051905831 shutdown_connections 2024-01-31T05:10:49.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.753+0000 7f9ce8da9740 1 --2- 172.21.15.99:0/2051905831 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x56544c22b160 0x56544c2276b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.753+0000 7f9ce8da9740 1 --2- 172.21.15.99:0/2051905831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56544c1bb1d0 0x56544c225bd0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.753+0000 7f9ce8da9740 1 --2- 172.21.15.99:0/2051905831 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56544c1b6060 0x56544c21eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.753+0000 7f9ce8da9740 1 --2- 172.21.15.99:0/2051905831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56544c1b5670 0x56544c21e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.753+0000 7f9cbeffd640 0 client.15039 ms_handle_reset on v2:172.21.15.99:6840/3069939345 2024-01-31T05:10:49.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.753+0000 7f9ce8da9740 1 -- 172.21.15.99:0/2051905831 >> 172.21.15.99:0/2051905831 conn(0x56544c1b0be0 msgr2=0x56544c1cb340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:49.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.754+0000 7f9ce8da9740 1 -- 172.21.15.99:0/2051905831 shutdown_connections 2024-01-31T05:10:49.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.754+0000 7f9ce8da9740 1 -- 172.21.15.99:0/2051905831 wait complete. 2024-01-31T05:10:49.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.754+0000 7f9ce8da9740 20 client.15039 trim_cache size 0 max 16384 2024-01-31T05:10:49.760 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-01-31T05:10:49.760 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_fsid": "9288ff44-bff5-11ee-95b3-87774f69a715", 2024-01-31T05:10:49.760 INFO:teuthology.orchestra.run.smithi099.stdout: "whoami": 4, 2024-01-31T05:10:49.760 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 14619, 2024-01-31T05:10:49.760 INFO:teuthology.orchestra.run.smithi099.stdout: "want_state": "up:active", 2024-01-31T05:10:49.760 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "up:active", 2024-01-31T05:10:49.760 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "cephfs", 2024-01-31T05:10:49.760 INFO:teuthology.orchestra.run.smithi099.stdout: "rank_uptime": 82.585475852000002, 2024-01-31T05:10:49.760 INFO:teuthology.orchestra.run.smithi099.stdout: "mdsmap_epoch": 26, 2024-01-31T05:10:49.760 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch": 88, 2024-01-31T05:10:49.760 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch_barrier": 86, 2024-01-31T05:10:49.761 INFO:teuthology.orchestra.run.smithi099.stdout: "uptime": 96.584909933000006 2024-01-31T05:10:49.761 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-01-31T05:10:49.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.754+0000 7f9ce5f12640 1 -- 172.21.15.99:0/1098242420 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f9ccc0a1370 msgr2=0x7f9ccc0a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:49.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.754+0000 7f9ce5f12640 1 --2- 172.21.15.99:0/1098242420 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f9ccc0a1370 0x7f9ccc0a3830 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0069bc0 tx=0x7f9cc800a6f0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.754+0000 7f9ce5f12640 1 -- 172.21.15.99:0/1098242420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ce01017c0 msgr2=0x7f9ce019e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:49.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.754+0000 7f9ce5f12640 1 --2- 172.21.15.99:0/1098242420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ce01017c0 0x7f9ce019e0f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8009fd0 tx=0x7f9cd800b8e0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.754+0000 7f9ce5f12640 1 -- 172.21.15.99:0/1098242420 shutdown_connections 2024-01-31T05:10:49.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.754+0000 7f9ce5f12640 1 --2- 172.21.15.99:0/1098242420 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f9ccc0a1370 0x7f9ccc0a3830 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.754+0000 7f9ce5f12640 1 --2- 172.21.15.99:0/1098242420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ce01017c0 0x7f9ce019e0f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.754+0000 7f9ce5f12640 1 --2- 172.21.15.99:0/1098242420 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ce0100e00 0x7f9ce019bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.754+0000 7f9ce5f12640 1 --2- 172.21.15.99:0/1098242420 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ce00ffc10 0x7f9ce0069e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.754+0000 7f9ce5f12640 1 -- 172.21.15.99:0/1098242420 >> 172.21.15.99:0/1098242420 conn(0x7f9ce00fb1a0 msgr2=0x7f9ce01041d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:49.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.754+0000 7f9ce5f12640 1 -- 172.21.15.99:0/1098242420 shutdown_connections 2024-01-31T05:10:49.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.754+0000 7f9ce5f12640 1 -- 172.21.15.99:0/1098242420 wait complete. 2024-01-31T05:10:49.764 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-01-31T05:10:49.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.867+0000 7fb6df4df640 1 -- 172.21.15.99:0/1687201674 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6d80ff560 msgr2=0x7fb6d8101990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:49.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.867+0000 7fb6df4df640 1 --2- 172.21.15.99:0/1687201674 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6d80ff560 0x7fb6d8101990 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4009900 tx=0x7fb6d402bc30 comp rx=0 tx=0).stop 2024-01-31T05:10:49.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.867+0000 7fb6df4df640 1 -- 172.21.15.99:0/1687201674 shutdown_connections 2024-01-31T05:10:49.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.867+0000 7fb6df4df640 1 --2- 172.21.15.99:0/1687201674 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6d8104880 0x7fb6d8104d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.867+0000 7fb6df4df640 1 --2- 172.21.15.99:0/1687201674 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb6d8101ed0 0x7fb6d8104340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.867+0000 7fb6df4df640 1 --2- 172.21.15.99:0/1687201674 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6d80ff560 0x7fb6d8101990 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.867+0000 7fb6df4df640 1 -- 172.21.15.99:0/1687201674 >> 172.21.15.99:0/1687201674 conn(0x7fb6d80fb180 msgr2=0x7fb6d80fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:49.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.867+0000 7fb6df4df640 1 -- 172.21.15.99:0/1687201674 shutdown_connections 2024-01-31T05:10:49.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.867+0000 7fb6df4df640 1 -- 172.21.15.99:0/1687201674 wait complete. 2024-01-31T05:10:49.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.868+0000 7fb6df4df640 1 Processor -- start 2024-01-31T05:10:49.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.868+0000 7fb6df4df640 1 -- start start 2024-01-31T05:10:49.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.868+0000 7fb6df4df640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6d80ff560 0x7fb6d819d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:49.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.868+0000 7fb6df4df640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6d8101ed0 0x7fb6d819d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:49.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.868+0000 7fb6df4df640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb6d8104880 0x7fb6d81a4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:49.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.868+0000 7fb6df4df640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d81a4db0 con 0x7fb6d8101ed0 2024-01-31T05:10:49.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.868+0000 7fb6df4df640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d81a4f20 con 0x7fb6d80ff560 2024-01-31T05:10:49.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.868+0000 7fb6df4df640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d81a50e0 con 0x7fb6d8104880 2024-01-31T05:10:49.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.868+0000 7fb6dca7a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6d8101ed0 0x7fb6d819d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:49.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.868+0000 7fb6dca7a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6d8101ed0 0x7fb6d819d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45100/0 (socket says 172.21.15.99:45100) 2024-01-31T05:10:49.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.868+0000 7fb6dca7a640 1 -- 172.21.15.99:0/4195598357 learned_addr learned my addr 172.21.15.99:0/4195598357 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:49.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.868+0000 7fb6dd27b640 1 --2- 172.21.15.99:0/4195598357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6d80ff560 0x7fb6d819d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:49.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.868+0000 7fb6dca7a640 1 -- 172.21.15.99:0/4195598357 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb6d8104880 msgr2=0x7fb6d81a4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:49.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.868+0000 7fb6dca7a640 1 --2- 172.21.15.99:0/4195598357 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb6d8104880 0x7fb6d81a4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.868+0000 7fb6dca7a640 1 -- 172.21.15.99:0/4195598357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6d80ff560 msgr2=0x7fb6d819d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:49.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.868+0000 7fb6dca7a640 1 --2- 172.21.15.99:0/4195598357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6d80ff560 0x7fb6d819d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.868+0000 7fb6dca7a640 1 -- 172.21.15.99:0/4195598357 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d4009560 con 0x7fb6d8101ed0 2024-01-31T05:10:49.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.868+0000 7fb6dd27b640 1 --2- 172.21.15.99:0/4195598357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6d80ff560 0x7fb6d819d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:10:49.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.868+0000 7fb6dca7a640 1 --2- 172.21.15.99:0/4195598357 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6d8101ed0 0x7fb6d819d850 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb6c800d770 tx=0x7fb6c800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:49.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.869+0000 7fb6ce7fc640 1 -- 172.21.15.99:0/4195598357 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c8009c30 con 0x7fb6d8101ed0 2024-01-31T05:10:49.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.869+0000 7fb6ce7fc640 1 -- 172.21.15.99:0/4195598357 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb6c800de80 con 0x7fb6d8101ed0 2024-01-31T05:10:49.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.869+0000 7fb6df4df640 1 -- 172.21.15.99:0/4195598357 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6d81a53c0 con 0x7fb6d8101ed0 2024-01-31T05:10:49.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.869+0000 7fb6ce7fc640 1 -- 172.21.15.99:0/4195598357 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c8004de0 con 0x7fb6d8101ed0 2024-01-31T05:10:49.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.869+0000 7fb6df4df640 1 -- 172.21.15.99:0/4195598357 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6d81a5880 con 0x7fb6d8101ed0 2024-01-31T05:10:49.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.871+0000 7fb6ce7fc640 1 -- 172.21.15.99:0/4195598357 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7fb6c8004f40 con 0x7fb6d8101ed0 2024-01-31T05:10:49.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.871+0000 7fb6e2387740 1 Processor -- start 2024-01-31T05:10:49.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.871+0000 7fb6e2387740 1 -- start start 2024-01-31T05:10:49.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.871+0000 7fb6e2387740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558811dd1670 0x558811dd1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:49.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.871+0000 7fb6e2387740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558811dd2060 0x558811dd6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:49.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.871+0000 7fb6e2387740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558811dd71d0 0x558811dd9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:49.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.872+0000 7fb6e2387740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x558811d40000 con 0x558811dd1670 2024-01-31T05:10:49.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.872+0000 7fb6e2387740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x558811d3d6f0 con 0x558811dd71d0 2024-01-31T05:10:49.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.872+0000 7fb6e2387740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x558811d38fe0 con 0x558811dd2060 2024-01-31T05:10:49.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.872+0000 7fb6ce7fc640 1 --2- 172.21.15.99:0/4195598357 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb6c40a1370 0x7fb6c40a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:49.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.872+0000 7fb6dda7c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558811dd1670 0x558811dd1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:49.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.872+0000 7fb6dda7c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558811dd1670 0x558811dd1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45114/0 (socket says 172.21.15.99:45114) 2024-01-31T05:10:49.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.872+0000 7fb6dda7c640 1 -- 172.21.15.99:0/2355137129 learned_addr learned my addr 172.21.15.99:0/2355137129 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:49.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.872+0000 7fb6dda7c640 1 --2- 172.21.15.99:0/4195598357 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb6c40a1370 0x7fb6c40a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:49.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.872+0000 7fb6dd27b640 1 --2- 172.21.15.99:0/2355137129 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558811dd2060 0x558811dd6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:49.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.872+0000 7fb6ce7fc640 1 -- 172.21.15.99:0/4195598357 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fb6c80cc6d0 con 0x7fb6d8101ed0 2024-01-31T05:10:49.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.872+0000 7fb6dca7a640 1 --2- 172.21.15.99:0/2355137129 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558811dd71d0 0x558811dd9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:49.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.872+0000 7fb6dda7c640 1 -- 172.21.15.99:0/2355137129 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558811dd2060 msgr2=0x558811dd6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:10:49.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.872+0000 7fb6dda7c640 1 --2- 172.21.15.99:0/2355137129 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558811dd2060 0x558811dd6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.872+0000 7fb6dda7c640 1 -- 172.21.15.99:0/2355137129 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558811dd71d0 msgr2=0x558811dd9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:10:49.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.872+0000 7fb6dda7c640 1 --2- 172.21.15.99:0/2355137129 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558811dd71d0 0x558811dd9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.872+0000 7fb6dda7c640 1 -- 172.21.15.99:0/2355137129 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558811cfb650 con 0x558811dd1670 2024-01-31T05:10:49.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.872+0000 7fb6dca7a640 1 --2- 172.21.15.99:0/2355137129 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558811dd71d0 0x558811dd9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:10:49.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.872+0000 7fb6dda7c640 1 --2- 172.21.15.99:0/2355137129 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558811dd1670 0x558811dd1a90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0013d00 tx=0x7fb6d0011750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b97e8ba5e00d1b72 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:49.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.872+0000 7fb6dda7c640 1 --2- 172.21.15.99:0/4195598357 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb6c40a1370 0x7fb6c40a3830 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0005fd0 tx=0x7fb6d0019000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:49.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.872+0000 7fb6c37fe640 1 -- 172.21.15.99:0/2355137129 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d0018070 con 0x558811dd1670 2024-01-31T05:10:49.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.872+0000 7fb6c37fe640 1 -- 172.21.15.99:0/2355137129 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb6d0009ae0 con 0x558811dd1670 2024-01-31T05:10:49.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.872+0000 7fb6c37fe640 1 -- 172.21.15.99:0/2355137129 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d0012a80 con 0x558811dd1670 2024-01-31T05:10:49.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.873+0000 7fb6e2387740 1 -- 172.21.15.99:0/2355137129 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558811dd1670 msgr2=0x558811dd1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:49.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.873+0000 7fb6e2387740 1 --2- 172.21.15.99:0/2355137129 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558811dd1670 0x558811dd1a90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0013d00 tx=0x7fb6d0011750 comp rx=0 tx=0).stop 2024-01-31T05:10:49.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.873+0000 7fb6e2387740 1 -- 172.21.15.99:0/2355137129 shutdown_connections 2024-01-31T05:10:49.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.873+0000 7fb6e2387740 1 --2- 172.21.15.99:0/2355137129 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558811dd71d0 0x558811dd9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.873+0000 7fb6e2387740 1 --2- 172.21.15.99:0/2355137129 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558811dd2060 0x558811dd6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.873+0000 7fb6e2387740 1 --2- 172.21.15.99:0/2355137129 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558811dd1670 0x558811dd1a90 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.873+0000 7fb6e2387740 1 -- 172.21.15.99:0/2355137129 >> 172.21.15.99:0/2355137129 conn(0x558811dccbe0 msgr2=0x558811dccfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:49.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.873+0000 7fb6e2387740 1 -- 172.21.15.99:0/2355137129 shutdown_connections 2024-01-31T05:10:49.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.873+0000 7fb6e2387740 1 -- 172.21.15.99:0/2355137129 wait complete. 2024-01-31T05:10:49.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.873+0000 7fb6e2387740 1 -- start start 2024-01-31T05:10:49.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.874+0000 7fb6e2387740 1 Processor -- start 2024-01-31T05:10:49.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.874+0000 7fb6e2387740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558811dd1670 0x558811ddb850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:49.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.874+0000 7fb6e2387740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558811dd2060 0x558811ddbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:49.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.874+0000 7fb6e2387740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558811dd71d0 0x558811de2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:49.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.874+0000 7fb6e2387740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x558811cf25c0 con 0x558811dd2060 2024-01-31T05:10:49.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.874+0000 7fb6e2387740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x558811cf2260 con 0x558811dd1670 2024-01-31T05:10:49.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.874+0000 7fb6e2387740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x558811cb72d0 con 0x558811dd71d0 2024-01-31T05:10:49.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.874+0000 7fb6e2387740 10 client.0 _ll_register_callbacks cb 0x558811ced230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:10:49.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.874+0000 7fb6dca7a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558811dd2060 0x558811ddbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:49.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.874+0000 7fb6dca7a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558811dd2060 0x558811ddbd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45120/0 (socket says 172.21.15.99:45120) 2024-01-31T05:10:49.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.874+0000 7fb6dca7a640 1 -- 172.21.15.99:0/1894710387 learned_addr learned my addr 172.21.15.99:0/1894710387 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:49.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.874+0000 7fb6dd27b640 1 --2- 172.21.15.99:0/1894710387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558811dd1670 0x558811ddb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:49.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.874+0000 7fb6dda7c640 1 --2- 172.21.15.99:0/1894710387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558811dd71d0 0x558811de2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:49.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.874+0000 7fb6dca7a640 1 -- 172.21.15.99:0/1894710387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558811dd71d0 msgr2=0x558811de2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:10:49.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.874+0000 7fb6dca7a640 1 --2- 172.21.15.99:0/1894710387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558811dd71d0 0x558811de2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.874+0000 7fb6dca7a640 1 -- 172.21.15.99:0/1894710387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558811dd1670 msgr2=0x558811ddb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:10:49.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.874+0000 7fb6dca7a640 1 --2- 172.21.15.99:0/1894710387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558811dd1670 0x558811ddb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.874+0000 7fb6dca7a640 1 -- 172.21.15.99:0/1894710387 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6d0013930 con 0x558811dd2060 2024-01-31T05:10:49.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.874+0000 7fb6dca7a640 1 --2- 172.21.15.99:0/1894710387 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558811dd2060 0x558811ddbd90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb6c800d740 tx=0x7fb6c809a010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=569bfa125a0f2049 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:49.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.874+0000 7fb6c0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:10:49.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.875+0000 7fb6c0ff9640 1 -- 172.21.15.99:0/1894710387 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c80a1b60 con 0x558811dd2060 2024-01-31T05:10:49.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.875+0000 7fb6c0ff9640 1 -- 172.21.15.99:0/1894710387 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fb6c8097b70 con 0x558811dd2060 2024-01-31T05:10:49.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.875+0000 7fb6e2387740 1 -- 172.21.15.99:0/1894710387 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558811d31e70 con 0x558811dd2060 2024-01-31T05:10:49.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.875+0000 7fb6c0ff9640 1 -- 172.21.15.99:0/1894710387 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb6c8095ee0 con 0x558811dd2060 2024-01-31T05:10:49.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.875+0000 7fb6e2387740 10 client.15051 fetch_fsmap learned FSMap version 26 2024-01-31T05:10:49.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.875+0000 7fb6e2387740 1 -- 172.21.15.99:0/1894710387 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x558811d37660 con 0x558811dd2060 2024-01-31T05:10:49.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.875+0000 7fb6c0ff9640 1 -- 172.21.15.99:0/1894710387 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb6c80b4030 con 0x558811dd2060 2024-01-31T05:10:49.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.875+0000 7fb6c0ff9640 1 -- 172.21.15.99:0/1894710387 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb6c80051f0 con 0x558811dd2060 2024-01-31T05:10:49.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.875+0000 7fb6e2387740 10 client.15051 fetch_fsmap finished waiting for FSMap version 26 2024-01-31T05:10:49.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.875+0000 7fb6e2387740 10 client.15051 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-31T05:10:49.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.875+0000 7fb6e2387740 20 client.15051 populate_metadata read hostname 'smithi099' 2024-01-31T05:10:49.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.875+0000 7fb6e2387740 1 --2- 172.21.15.99:0/1894710387 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x558811de89a0 0x558811de7410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:49.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.875+0000 7fb6e2387740 4 client.15051 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:10:49.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.875+0000 7fb6e2387740 1 -- 172.21.15.99:0/1894710387 --> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558811d31b90 con 0x558811de89a0 2024-01-31T05:10:49.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.875+0000 7fb6dd27b640 1 --2- 172.21.15.99:0/1894710387 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x558811de89a0 0x558811de7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:49.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.876+0000 7fb6c0ff9640 10 client.15051 ms_handle_connect on v2:172.21.15.181:6836/3875964154 2024-01-31T05:10:49.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.876+0000 7fb6dd27b640 1 --2- 172.21.15.99:0/1894710387 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x558811de89a0 0x558811de7410 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=38307ee58ef4dbc6 server_cookie=e7c96c6612b54760 in_seq=0 out_seq=0 2024-01-31T05:10:49.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.877+0000 7fb6c0ff9640 1 -- 172.21.15.99:0/1894710387 <== mds.3 v2:172.21.15.181:6836/3875964154 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558811d31b90 con 0x558811de89a0 2024-01-31T05:10:49.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.877+0000 7fb6c0ff9640 10 client.15051 handle_command_reply: tid=0 2024-01-31T05:10:49.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.877+0000 7fb6e2387740 1 client.15051 shutdown 2024-01-31T05:10:49.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.877+0000 7fb6e2387740 1 -- 172.21.15.99:0/1894710387 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558811dd2060 msgr2=0x558811ddbd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:49.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.877+0000 7fb6e2387740 1 --2- 172.21.15.99:0/1894710387 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558811dd2060 0x558811ddbd90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb6c800d740 tx=0x7fb6c809a010 comp rx=0 tx=0).stop 2024-01-31T05:10:49.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.877+0000 7fb6e2387740 1 -- 172.21.15.99:0/1894710387 shutdown_connections 2024-01-31T05:10:49.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.877+0000 7fb6e2387740 1 --2- 172.21.15.99:0/1894710387 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x558811de89a0 0x558811de7410 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.877+0000 7fb6e2387740 1 --2- 172.21.15.99:0/1894710387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558811dd71d0 0x558811de2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.877+0000 7fb6c0ff9640 0 client.15051 ms_handle_reset on v2:172.21.15.181:6836/3875964154 2024-01-31T05:10:49.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.877+0000 7fb6e2387740 1 --2- 172.21.15.99:0/1894710387 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558811dd2060 0x558811ddbd90 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.877+0000 7fb6e2387740 1 --2- 172.21.15.99:0/1894710387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558811dd1670 0x558811ddb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.877+0000 7fb6e2387740 1 -- 172.21.15.99:0/1894710387 >> 172.21.15.99:0/1894710387 conn(0x558811dccbe0 msgr2=0x558811dcbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:49.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.877+0000 7fb6e2387740 1 -- 172.21.15.99:0/1894710387 shutdown_connections 2024-01-31T05:10:49.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.877+0000 7fb6e2387740 1 -- 172.21.15.99:0/1894710387 wait complete. 2024-01-31T05:10:49.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.877+0000 7fb6e2387740 20 client.15051 trim_cache size 0 max 16384 2024-01-31T05:10:49.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.892+0000 7fb6e2387740 1 Processor -- start 2024-01-31T05:10:49.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.892+0000 7fb6e2387740 1 -- start start 2024-01-31T05:10:49.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.892+0000 7fb6e2387740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558811dccbe0 0x558811dd35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:49.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.892+0000 7fb6e2387740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558811dd1670 0x558811dd3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:49.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.892+0000 7fb6e2387740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558811dd2060 0x558811de2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:49.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.892+0000 7fb6e2387740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x558811de9cc0 con 0x558811dd1670 2024-01-31T05:10:49.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.892+0000 7fb6e2387740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x558811ddb690 con 0x558811dccbe0 2024-01-31T05:10:49.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.892+0000 7fb6e2387740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x558811d31b90 con 0x558811dd2060 2024-01-31T05:10:49.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.893+0000 7fb6dca7a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558811dd1670 0x558811dd3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:49.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.893+0000 7fb6dca7a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558811dd1670 0x558811dd3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45132/0 (socket says 172.21.15.99:45132) 2024-01-31T05:10:49.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.893+0000 7fb6dca7a640 1 -- 172.21.15.99:0/1984705357 learned_addr learned my addr 172.21.15.99:0/1984705357 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:49.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.893+0000 7fb6dda7c640 1 --2- 172.21.15.99:0/1984705357 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558811dd2060 0x558811de2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:49.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.893+0000 7fb6dca7a640 1 -- 172.21.15.99:0/1984705357 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558811dd2060 msgr2=0x558811de2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:10:49.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.893+0000 7fb6dca7a640 1 --2- 172.21.15.99:0/1984705357 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558811dd2060 0x558811de2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.893+0000 7fb6dca7a640 1 -- 172.21.15.99:0/1984705357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558811dccbe0 msgr2=0x558811dd35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:10:49.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.893+0000 7fb6dca7a640 1 --2- 172.21.15.99:0/1984705357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558811dccbe0 0x558811dd35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.893+0000 7fb6dca7a640 1 -- 172.21.15.99:0/1984705357 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558811cd4360 con 0x558811dd1670 2024-01-31T05:10:49.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.893+0000 7fb6dca7a640 1 --2- 172.21.15.99:0/1984705357 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558811dd1670 0x558811dd3af0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8009610 tx=0x7fb6c80056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a688768ff833246 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:49.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.893+0000 7fb6c2ffd640 1 -- 172.21.15.99:0/1984705357 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c8064070 con 0x558811dd1670 2024-01-31T05:10:49.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.893+0000 7fb6c2ffd640 1 -- 172.21.15.99:0/1984705357 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb6c80b4050 con 0x558811dd1670 2024-01-31T05:10:49.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.893+0000 7fb6c2ffd640 1 -- 172.21.15.99:0/1984705357 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c8097b70 con 0x558811dd1670 2024-01-31T05:10:49.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.894+0000 7fb6e2387740 1 -- 172.21.15.99:0/1984705357 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558811dd1670 msgr2=0x558811dd3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:49.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.894+0000 7fb6e2387740 1 --2- 172.21.15.99:0/1984705357 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558811dd1670 0x558811dd3af0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8009610 tx=0x7fb6c80056d0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.894+0000 7fb6e2387740 1 -- 172.21.15.99:0/1984705357 shutdown_connections 2024-01-31T05:10:49.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.894+0000 7fb6e2387740 1 --2- 172.21.15.99:0/1984705357 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558811dd2060 0x558811de2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.894+0000 7fb6e2387740 1 --2- 172.21.15.99:0/1984705357 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558811dd1670 0x558811dd3af0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.894+0000 7fb6e2387740 1 --2- 172.21.15.99:0/1984705357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558811dccbe0 0x558811dd35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.894+0000 7fb6e2387740 1 -- 172.21.15.99:0/1984705357 >> 172.21.15.99:0/1984705357 conn(0x558811dcd330 msgr2=0x558811df0180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:49.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.894+0000 7fb6e2387740 1 -- 172.21.15.99:0/1984705357 shutdown_connections 2024-01-31T05:10:49.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.894+0000 7fb6e2387740 1 -- 172.21.15.99:0/1984705357 wait complete. 2024-01-31T05:10:49.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.894+0000 7fb6e2387740 1 -- start start 2024-01-31T05:10:49.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.894+0000 7fb6e2387740 1 Processor -- start 2024-01-31T05:10:49.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.894+0000 7fb6e2387740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558811dccbe0 0x558811ddffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:49.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.894+0000 7fb6e2387740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558811dd1670 0x558811de0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:49.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.894+0000 7fb6e2387740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558811dd2060 0x558811de13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:49.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.894+0000 7fb6e2387740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x558811de1920 con 0x558811dd2060 2024-01-31T05:10:49.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.894+0000 7fb6e2387740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x558811de1a90 con 0x558811dd1670 2024-01-31T05:10:49.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.894+0000 7fb6e2387740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x558811de1c50 con 0x558811dccbe0 2024-01-31T05:10:49.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.894+0000 7fb6e2387740 10 client.0 _ll_register_callbacks cb 0x7fb6d0009d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:10:49.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.894+0000 7fb6dda7c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558811dd2060 0x558811de13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:49.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.894+0000 7fb6dda7c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558811dd2060 0x558811de13e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45138/0 (socket says 172.21.15.99:45138) 2024-01-31T05:10:49.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.894+0000 7fb6dda7c640 1 -- 172.21.15.99:0/487441862 learned_addr learned my addr 172.21.15.99:0/487441862 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:49.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.895+0000 7fb6dd27b640 1 --2- 172.21.15.99:0/487441862 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558811dccbe0 0x558811ddffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:49.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.895+0000 7fb6dca7a640 1 --2- 172.21.15.99:0/487441862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558811dd1670 0x558811de0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:49.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.895+0000 7fb6dda7c640 1 -- 172.21.15.99:0/487441862 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558811dccbe0 msgr2=0x558811ddffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:10:49.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.895+0000 7fb6dda7c640 1 --2- 172.21.15.99:0/487441862 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558811dccbe0 0x558811ddffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.895+0000 7fb6dda7c640 1 -- 172.21.15.99:0/487441862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558811dd1670 msgr2=0x558811de0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:10:49.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.895+0000 7fb6dda7c640 1 --2- 172.21.15.99:0/487441862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558811dd1670 0x558811de0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.895+0000 7fb6dda7c640 1 -- 172.21.15.99:0/487441862 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558811d37660 con 0x558811dd2060 2024-01-31T05:10:49.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.895+0000 7fb6dca7a640 1 --2- 172.21.15.99:0/487441862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558811dd1670 0x558811de0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:10:49.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.895+0000 7fb6dda7c640 1 --2- 172.21.15.99:0/487441862 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558811dd2060 0x558811de13e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0013d00 tx=0x7fb6d0012f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4657e5214fe4687 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:49.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.895+0000 7fb6c0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:10:49.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.895+0000 7fb6c0ff9640 1 -- 172.21.15.99:0/487441862 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d0018040 con 0x558811dd2060 2024-01-31T05:10:49.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.895+0000 7fb6c0ff9640 1 -- 172.21.15.99:0/487441862 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fb6d0012a90 con 0x558811dd2060 2024-01-31T05:10:49.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.895+0000 7fb6e2387740 1 -- 172.21.15.99:0/487441862 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb6d0009ae0 con 0x558811dd2060 2024-01-31T05:10:49.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.895+0000 7fb6c0ff9640 1 -- 172.21.15.99:0/487441862 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb6d0013740 con 0x558811dd2060 2024-01-31T05:10:49.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.895+0000 7fb6e2387740 10 client.15057 fetch_fsmap learned FSMap version 26 2024-01-31T05:10:49.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.895+0000 7fb6e2387740 1 -- 172.21.15.99:0/487441862 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x558811cf9eb0 con 0x558811dd2060 2024-01-31T05:10:49.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.895+0000 7fb6c0ff9640 1 -- 172.21.15.99:0/487441862 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb6d0009ae0 con 0x558811dd2060 2024-01-31T05:10:49.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.896+0000 7fb6c0ff9640 1 -- 172.21.15.99:0/487441862 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb6d0022070 con 0x558811dd2060 2024-01-31T05:10:49.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.896+0000 7fb6e2387740 10 client.15057 fetch_fsmap finished waiting for FSMap version 26 2024-01-31T05:10:49.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.896+0000 7fb6e2387740 10 client.15057 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-31T05:10:49.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.896+0000 7fb6e2387740 20 client.15057 populate_metadata read hostname 'smithi099' 2024-01-31T05:10:49.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.896+0000 7fb6e2387740 1 --2- 172.21.15.99:0/487441862 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x558811dd71d0 0x558811e3fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:49.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.896+0000 7fb6e2387740 4 client.15057 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-31T05:10:49.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.896+0000 7fb6e2387740 1 -- 172.21.15.99:0/487441862 --> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558811a386c0 con 0x558811dd71d0 2024-01-31T05:10:49.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.896+0000 7fb6dd27b640 1 --2- 172.21.15.99:0/487441862 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x558811dd71d0 0x558811e3fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:49.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.896+0000 7fb6dd27b640 1 --2- 172.21.15.99:0/487441862 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x558811dd71d0 0x558811e3fab0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6da80b23b0481b7c server_cookie=4e914d67909dad9b in_seq=0 out_seq=0 2024-01-31T05:10:49.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.896+0000 7fb6c0ff9640 10 client.15057 ms_handle_connect on v2:172.21.15.181:6836/3875964154 2024-01-31T05:10:49.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.896+0000 7fb6c0ff9640 1 -- 172.21.15.99:0/487441862 <== mds.3 v2:172.21.15.181:6836/3875964154 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x558811a386c0 con 0x558811dd71d0 2024-01-31T05:10:49.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.896+0000 7fb6c0ff9640 10 client.15057 handle_command_reply: tid=0 2024-01-31T05:10:49.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.896+0000 7fb6e2387740 1 client.15057 shutdown 2024-01-31T05:10:49.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.897+0000 7fb6e2387740 1 -- 172.21.15.99:0/487441862 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558811dd2060 msgr2=0x558811de13e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:49.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.897+0000 7fb6e2387740 1 --2- 172.21.15.99:0/487441862 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558811dd2060 0x558811de13e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0013d00 tx=0x7fb6d0012f60 comp rx=0 tx=0).stop 2024-01-31T05:10:49.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.897+0000 7fb6e2387740 1 -- 172.21.15.99:0/487441862 shutdown_connections 2024-01-31T05:10:49.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.897+0000 7fb6e2387740 1 --2- 172.21.15.99:0/487441862 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x558811dd71d0 0x558811e3fab0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.897+0000 7fb6e2387740 1 --2- 172.21.15.99:0/487441862 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558811dd2060 0x558811de13e0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.897+0000 7fb6c0ff9640 0 client.15057 ms_handle_reset on v2:172.21.15.181:6836/3875964154 2024-01-31T05:10:49.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.897+0000 7fb6e2387740 1 --2- 172.21.15.99:0/487441862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558811dd1670 0x558811de0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.897+0000 7fb6e2387740 1 --2- 172.21.15.99:0/487441862 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558811dccbe0 0x558811ddffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.897+0000 7fb6e2387740 1 -- 172.21.15.99:0/487441862 >> 172.21.15.99:0/487441862 conn(0x558811dcd330 msgr2=0x558811dd35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:49.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.897+0000 7fb6e2387740 1 -- 172.21.15.99:0/487441862 shutdown_connections 2024-01-31T05:10:49.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.897+0000 7fb6e2387740 1 -- 172.21.15.99:0/487441862 wait complete. 2024-01-31T05:10:49.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.897+0000 7fb6e2387740 20 client.15057 trim_cache size 0 max 16384 2024-01-31T05:10:49.909 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-01-31T05:10:49.909 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_fsid": "9288ff44-bff5-11ee-95b3-87774f69a715", 2024-01-31T05:10:49.909 INFO:teuthology.orchestra.run.smithi099.stdout: "whoami": 3, 2024-01-31T05:10:49.909 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 24439, 2024-01-31T05:10:49.909 INFO:teuthology.orchestra.run.smithi099.stdout: "want_state": "up:active", 2024-01-31T05:10:49.909 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "up:active", 2024-01-31T05:10:49.909 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "cephfs", 2024-01-31T05:10:49.909 INFO:teuthology.orchestra.run.smithi099.stdout: "rank_uptime": 83.710421929999995, 2024-01-31T05:10:49.909 INFO:teuthology.orchestra.run.smithi099.stdout: "mdsmap_epoch": 26, 2024-01-31T05:10:49.909 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch": 88, 2024-01-31T05:10:49.909 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch_barrier": 86, 2024-01-31T05:10:49.910 INFO:teuthology.orchestra.run.smithi099.stdout: "uptime": 107.81465269500001 2024-01-31T05:10:49.910 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-01-31T05:10:49.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.897+0000 7fb6df4df640 1 -- 172.21.15.99:0/4195598357 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb6c40a1370 msgr2=0x7fb6c40a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:49.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.897+0000 7fb6df4df640 1 --2- 172.21.15.99:0/4195598357 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb6c40a1370 0x7fb6c40a3830 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0005fd0 tx=0x7fb6d0019000 comp rx=0 tx=0).stop 2024-01-31T05:10:49.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.897+0000 7fb6df4df640 1 -- 172.21.15.99:0/4195598357 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6d8101ed0 msgr2=0x7fb6d819d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:49.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.897+0000 7fb6df4df640 1 --2- 172.21.15.99:0/4195598357 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6d8101ed0 0x7fb6d819d850 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb6c800d770 tx=0x7fb6c800dc30 comp rx=0 tx=0).stop 2024-01-31T05:10:49.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.897+0000 7fb6df4df640 1 -- 172.21.15.99:0/4195598357 shutdown_connections 2024-01-31T05:10:49.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.897+0000 7fb6df4df640 1 --2- 172.21.15.99:0/4195598357 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb6c40a1370 0x7fb6c40a3830 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.897+0000 7fb6df4df640 1 --2- 172.21.15.99:0/4195598357 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb6d8104880 0x7fb6d81a4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.897+0000 7fb6df4df640 1 --2- 172.21.15.99:0/4195598357 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6d8101ed0 0x7fb6d819d850 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.897+0000 7fb6df4df640 1 --2- 172.21.15.99:0/4195598357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6d80ff560 0x7fb6d819d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:49.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.897+0000 7fb6df4df640 1 -- 172.21.15.99:0/4195598357 >> 172.21.15.99:0/4195598357 conn(0x7fb6d80fb180 msgr2=0x7fb6d8102890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:49.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.897+0000 7fb6df4df640 1 -- 172.21.15.99:0/4195598357 shutdown_connections 2024-01-31T05:10:49.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:49.897+0000 7fb6df4df640 1 -- 172.21.15.99:0/4195598357 wait complete. 2024-01-31T05:10:49.912 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:49 smithi099 ceph-mon[31615]: pgmap v332: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-01-31T05:10:49.912 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:49 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/1937146762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:10:49.912 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:49 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/3806458649' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:10:49.912 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:49 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/312308560' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:10:49.913 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-01-31T05:10:50.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.015+0000 7fcd4cf9d640 1 -- 172.21.15.99:0/3803724114 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd48101810 msgr2=0x7fcd481080a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:50.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.015+0000 7fcd4cf9d640 1 --2- 172.21.15.99:0/3803724114 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd48101810 0x7fcd481080a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fcd40009ca0 tx=0x7fcd4002c0f0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.015+0000 7fcd4cf9d640 1 -- 172.21.15.99:0/3803724114 shutdown_connections 2024-01-31T05:10:50.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.015+0000 7fcd4cf9d640 1 --2- 172.21.15.99:0/3803724114 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd48101810 0x7fcd481080a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.015+0000 7fcd4cf9d640 1 --2- 172.21.15.99:0/3803724114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd48100e50 0x7fcd481012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.015+0000 7fcd4cf9d640 1 --2- 172.21.15.99:0/3803724114 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd48100140 0x7fcd48100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.015+0000 7fcd4cf9d640 1 -- 172.21.15.99:0/3803724114 >> 172.21.15.99:0/3803724114 conn(0x7fcd480fa8f0 msgr2=0x7fcd480fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:50.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.015+0000 7fcd4cf9d640 1 -- 172.21.15.99:0/3803724114 shutdown_connections 2024-01-31T05:10:50.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.015+0000 7fcd4cf9d640 1 -- 172.21.15.99:0/3803724114 wait complete. 2024-01-31T05:10:50.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.016+0000 7fcd4cf9d640 1 Processor -- start 2024-01-31T05:10:50.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.016+0000 7fcd4cf9d640 1 -- start start 2024-01-31T05:10:50.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.016+0000 7fcd4cf9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd48100140 0x7fcd48196cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.016+0000 7fcd4cf9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd48100e50 0x7fcd48197200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.016+0000 7fcd4cf9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd48101810 0x7fcd4819e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.016+0000 7fcd4cf9d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4819e750 con 0x7fcd48101810 2024-01-31T05:10:50.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.016+0000 7fcd4cf9d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4819e8c0 con 0x7fcd48100140 2024-01-31T05:10:50.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.016+0000 7fcd4cf9d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4819ea80 con 0x7fcd48100e50 2024-01-31T05:10:50.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.016+0000 7fcd46d9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd48101810 0x7fcd4819e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.016+0000 7fcd46d9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd48101810 0x7fcd4819e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45154/0 (socket says 172.21.15.99:45154) 2024-01-31T05:10:50.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.016+0000 7fcd46d9d640 1 -- 172.21.15.99:0/1406912578 learned_addr learned my addr 172.21.15.99:0/1406912578 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:50.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.016+0000 7fcd4659c640 1 --2- 172.21.15.99:0/1406912578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd48100140 0x7fcd48196cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.016+0000 7fcd46d9d640 1 -- 172.21.15.99:0/1406912578 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd48100e50 msgr2=0x7fcd48197200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:50.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.016+0000 7fcd46d9d640 1 --2- 172.21.15.99:0/1406912578 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd48100e50 0x7fcd48197200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.016+0000 7fcd46d9d640 1 -- 172.21.15.99:0/1406912578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd48100140 msgr2=0x7fcd48196cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:50.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.016+0000 7fcd46d9d640 1 --2- 172.21.15.99:0/1406912578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd48100140 0x7fcd48196cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.016+0000 7fcd46d9d640 1 -- 172.21.15.99:0/1406912578 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd40009900 con 0x7fcd48101810 2024-01-31T05:10:50.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.016+0000 7fcd4659c640 1 --2- 172.21.15.99:0/1406912578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd48100140 0x7fcd48196cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:10:50.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.017+0000 7fcd46d9d640 1 --2- 172.21.15.99:0/1406912578 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd48101810 0x7fcd4819e1e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fcd40037040 tx=0x7fcd40032810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:50.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.017+0000 7fcd3f7fe640 1 -- 172.21.15.99:0/1406912578 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd40034e80 con 0x7fcd48101810 2024-01-31T05:10:50.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.017+0000 7fcd4cf9d640 1 -- 172.21.15.99:0/1406912578 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd4819ed00 con 0x7fcd48101810 2024-01-31T05:10:50.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.017+0000 7fcd3f7fe640 1 -- 172.21.15.99:0/1406912578 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcd40003e30 con 0x7fcd48101810 2024-01-31T05:10:50.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.017+0000 7fcd3f7fe640 1 -- 172.21.15.99:0/1406912578 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4003d3f0 con 0x7fcd48101810 2024-01-31T05:10:50.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.017+0000 7fcd4cf9d640 1 -- 172.21.15.99:0/1406912578 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd4819f1b0 con 0x7fcd48101810 2024-01-31T05:10:50.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.019+0000 7fcd3f7fe640 1 -- 172.21.15.99:0/1406912578 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7fcd4003b040 con 0x7fcd48101810 2024-01-31T05:10:50.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.019+0000 7fcd4f9fd740 1 Processor -- start 2024-01-31T05:10:50.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.020+0000 7fcd4f9fd740 1 -- start start 2024-01-31T05:10:50.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.020+0000 7fcd3f7fe640 1 --2- 172.21.15.99:0/1406912578 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fcd340a1370 0x7fcd340a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.020+0000 7fcd4f9fd740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563830c3a670 0x563830c3aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.020+0000 7fcd4f9fd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563830c3b060 0x563830c3fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.020+0000 7fcd4f9fd740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563830c401d0 0x563830c42660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.020+0000 7fcd4f9fd740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x563830ba9000 con 0x563830c401d0 2024-01-31T05:10:50.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.020+0000 7fcd4f9fd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x563830ba66f0 con 0x563830c3b060 2024-01-31T05:10:50.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.020+0000 7fcd4f9fd740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x563830ba1fe0 con 0x563830c3a670 2024-01-31T05:10:50.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.020+0000 7fcd3ffff640 1 --2- 172.21.15.99:0/1406912578 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fcd340a1370 0x7fcd340a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.020+0000 7fcd3f7fe640 1 -- 172.21.15.99:0/1406912578 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fcd400ef3d0 con 0x7fcd48101810 2024-01-31T05:10:50.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.020+0000 7fcd46d9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563830c401d0 0x563830c42660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.020+0000 7fcd46d9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563830c401d0 0x563830c42660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45162/0 (socket says 172.21.15.99:45162) 2024-01-31T05:10:50.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.020+0000 7fcd46d9d640 1 -- 172.21.15.99:0/1563342414 learned_addr learned my addr 172.21.15.99:0/1563342414 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:50.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.020+0000 7fcd3ffff640 1 --2- 172.21.15.99:0/1563342414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563830c3b060 0x563830c3fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.020+0000 7fcd4659c640 1 --2- 172.21.15.99:0/1563342414 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563830c3a670 0x563830c3aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.020+0000 7fcd46d9d640 1 -- 172.21.15.99:0/1563342414 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563830c3a670 msgr2=0x563830c3aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:10:50.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.020+0000 7fcd46d9d640 1 --2- 172.21.15.99:0/1563342414 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563830c3a670 0x563830c3aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.020+0000 7fcd46d9d640 1 -- 172.21.15.99:0/1563342414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563830c3b060 msgr2=0x563830c3fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:10:50.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.020+0000 7fcd46d9d640 1 --2- 172.21.15.99:0/1563342414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563830c3b060 0x563830c3fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.020+0000 7fcd46d9d640 1 -- 172.21.15.99:0/1563342414 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563830b64650 con 0x563830c401d0 2024-01-31T05:10:50.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.020+0000 7fcd4659c640 1 --2- 172.21.15.99:0/1563342414 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563830c3a670 0x563830c3aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:10:50.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.020+0000 7fcd3ffff640 1 --2- 172.21.15.99:0/1406912578 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fcd340a1370 0x7fcd340a3830 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcd3000bf70 tx=0x7fcd3000b5e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:50.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.020+0000 7fcd46d9d640 1 --2- 172.21.15.99:0/1563342414 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563830c401d0 0x563830c42660 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fcd400b8fc0 tx=0x7fcd400b8950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da589ab174c8fc44 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:50.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.020+0000 7fcd3cff9640 1 -- 172.21.15.99:0/1563342414 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd400bbf40 con 0x563830c401d0 2024-01-31T05:10:50.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.021+0000 7fcd3cff9640 1 -- 172.21.15.99:0/1563342414 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcd400ba7c0 con 0x563830c401d0 2024-01-31T05:10:50.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.021+0000 7fcd3cff9640 1 -- 172.21.15.99:0/1563342414 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd400c0730 con 0x563830c401d0 2024-01-31T05:10:50.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.021+0000 7fcd4f9fd740 1 -- 172.21.15.99:0/1563342414 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563830c401d0 msgr2=0x563830c42660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:50.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.021+0000 7fcd4f9fd740 1 --2- 172.21.15.99:0/1563342414 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563830c401d0 0x563830c42660 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fcd400b8fc0 tx=0x7fcd400b8950 comp rx=0 tx=0).stop 2024-01-31T05:10:50.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.021+0000 7fcd4f9fd740 1 -- 172.21.15.99:0/1563342414 shutdown_connections 2024-01-31T05:10:50.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.021+0000 7fcd4f9fd740 1 --2- 172.21.15.99:0/1563342414 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563830c401d0 0x563830c42660 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.021+0000 7fcd4f9fd740 1 --2- 172.21.15.99:0/1563342414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563830c3b060 0x563830c3fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.021+0000 7fcd4f9fd740 1 --2- 172.21.15.99:0/1563342414 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563830c3a670 0x563830c3aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.021+0000 7fcd4f9fd740 1 -- 172.21.15.99:0/1563342414 >> 172.21.15.99:0/1563342414 conn(0x563830c35be0 msgr2=0x563830c35fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:50.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.021+0000 7fcd4f9fd740 1 -- 172.21.15.99:0/1563342414 shutdown_connections 2024-01-31T05:10:50.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.021+0000 7fcd4f9fd740 1 -- 172.21.15.99:0/1563342414 wait complete. 2024-01-31T05:10:50.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.022+0000 7fcd4f9fd740 1 -- start start 2024-01-31T05:10:50.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.022+0000 7fcd4f9fd740 1 Processor -- start 2024-01-31T05:10:50.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.022+0000 7fcd4f9fd740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563830c3a670 0x563830c44400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.022+0000 7fcd4f9fd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563830c3b060 0x563830c44940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.022+0000 7fcd4f9fd740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563830c401d0 0x563830c4b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.022+0000 7fcd4f9fd740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x563830b5b5c0 con 0x563830c401d0 2024-01-31T05:10:50.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.022+0000 7fcd4f9fd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x563830b5b260 con 0x563830c3b060 2024-01-31T05:10:50.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.022+0000 7fcd4f9fd740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x563830b202d0 con 0x563830c3a670 2024-01-31T05:10:50.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.022+0000 7fcd4f9fd740 10 client.0 _ll_register_callbacks cb 0x563830b56230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:10:50.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.022+0000 7fcd46d9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563830c401d0 0x563830c4b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.022+0000 7fcd46d9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563830c401d0 0x563830c4b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45172/0 (socket says 172.21.15.99:45172) 2024-01-31T05:10:50.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.022+0000 7fcd46d9d640 1 -- 172.21.15.99:0/3979623324 learned_addr learned my addr 172.21.15.99:0/3979623324 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:50.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.022+0000 7fcd3ffff640 1 --2- 172.21.15.99:0/3979623324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563830c3b060 0x563830c44940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.022+0000 7fcd46d9d640 1 -- 172.21.15.99:0/3979623324 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563830c3a670 msgr2=0x563830c44400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:10:50.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.022+0000 7fcd4659c640 1 --2- 172.21.15.99:0/3979623324 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563830c3a670 0x563830c44400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.022+0000 7fcd46d9d640 1 --2- 172.21.15.99:0/3979623324 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563830c3a670 0x563830c44400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.022+0000 7fcd46d9d640 1 -- 172.21.15.99:0/3979623324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563830c3b060 msgr2=0x563830c44940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:10:50.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.022+0000 7fcd46d9d640 1 --2- 172.21.15.99:0/3979623324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563830c3b060 0x563830c44940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.022+0000 7fcd46d9d640 1 -- 172.21.15.99:0/3979623324 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd400b8040 con 0x563830c401d0 2024-01-31T05:10:50.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.022+0000 7fcd3ffff640 1 --2- 172.21.15.99:0/3979623324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563830c3b060 0x563830c44940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:10:50.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.022+0000 7fcd46d9d640 1 --2- 172.21.15.99:0/3979623324 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563830c401d0 0x563830c4b980 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fcd400bc570 tx=0x7fcd400a7170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd918b9166812fe9 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:50.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.022+0000 7fcd2dffb640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:10:50.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.023+0000 7fcd2dffb640 1 -- 172.21.15.99:0/3979623324 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd400bbf40 con 0x563830c401d0 2024-01-31T05:10:50.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.023+0000 7fcd2dffb640 1 -- 172.21.15.99:0/3979623324 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fcd400ef020 con 0x563830c401d0 2024-01-31T05:10:50.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.023+0000 7fcd4f9fd740 1 -- 172.21.15.99:0/3979623324 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563830b9ae70 con 0x563830c401d0 2024-01-31T05:10:50.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.023+0000 7fcd2dffb640 1 -- 172.21.15.99:0/3979623324 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd400c4970 con 0x563830c401d0 2024-01-31T05:10:50.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.023+0000 7fcd4f9fd740 10 client.15069 fetch_fsmap learned FSMap version 26 2024-01-31T05:10:50.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.023+0000 7fcd4f9fd740 1 -- 172.21.15.99:0/3979623324 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x563830ba0660 con 0x563830c401d0 2024-01-31T05:10:50.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.023+0000 7fcd2dffb640 1 -- 172.21.15.99:0/3979623324 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x563830b9ae70 con 0x563830c401d0 2024-01-31T05:10:50.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.023+0000 7fcd2dffb640 1 -- 172.21.15.99:0/3979623324 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fcd400a5b80 con 0x563830c401d0 2024-01-31T05:10:50.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.023+0000 7fcd4f9fd740 10 client.15069 fetch_fsmap finished waiting for FSMap version 26 2024-01-31T05:10:50.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.023+0000 7fcd4f9fd740 10 client.15069 resolve_mds: resolved name 'i' to daemon mds.i 2024-01-31T05:10:50.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.023+0000 7fcd4f9fd740 20 client.15069 populate_metadata read hostname 'smithi099' 2024-01-31T05:10:50.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.023+0000 7fcd4f9fd740 1 --2- 172.21.15.99:0/3979623324 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x563830c50f10 0x563830c4fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.023+0000 7fcd4f9fd740 4 client.15069 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:10:50.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.023+0000 7fcd4f9fd740 1 -- 172.21.15.99:0/3979623324 --> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563830b9ab90 con 0x563830c50f10 2024-01-31T05:10:50.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.023+0000 7fcd4659c640 1 --2- 172.21.15.99:0/3979623324 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x563830c50f10 0x563830c4fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.024+0000 7fcd2dffb640 10 client.15069 ms_handle_connect on v2:172.21.15.181:6838/996120687 2024-01-31T05:10:50.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.024+0000 7fcd4659c640 1 --2- 172.21.15.99:0/3979623324 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x563830c50f10 0x563830c4fde0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=36605147016f8e99 server_cookie=cedfdd515afa12c0 in_seq=0 out_seq=0 2024-01-31T05:10:50.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.025+0000 7fcd2dffb640 1 -- 172.21.15.99:0/3979623324 <== mds.2 v2:172.21.15.181:6838/996120687 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563830b9ab90 con 0x563830c50f10 2024-01-31T05:10:50.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.025+0000 7fcd2dffb640 10 client.15069 handle_command_reply: tid=0 2024-01-31T05:10:50.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.025+0000 7fcd4f9fd740 1 client.15069 shutdown 2024-01-31T05:10:50.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.025+0000 7fcd4f9fd740 1 -- 172.21.15.99:0/3979623324 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563830c401d0 msgr2=0x563830c4b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:50.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.025+0000 7fcd4f9fd740 1 --2- 172.21.15.99:0/3979623324 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563830c401d0 0x563830c4b980 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fcd400bc570 tx=0x7fcd400a7170 comp rx=0 tx=0).stop 2024-01-31T05:10:50.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.025+0000 7fcd4f9fd740 1 -- 172.21.15.99:0/3979623324 shutdown_connections 2024-01-31T05:10:50.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.025+0000 7fcd4f9fd740 1 --2- 172.21.15.99:0/3979623324 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563830c401d0 0x563830c4b980 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.025+0000 7fcd4f9fd740 1 --2- 172.21.15.99:0/3979623324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563830c3b060 0x563830c44940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.025+0000 7fcd4f9fd740 1 --2- 172.21.15.99:0/3979623324 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x563830c50f10 0x563830c4fde0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.025+0000 7fcd4f9fd740 1 --2- 172.21.15.99:0/3979623324 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563830c3a670 0x563830c44400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.025+0000 7fcd4f9fd740 1 -- 172.21.15.99:0/3979623324 >> 172.21.15.99:0/3979623324 conn(0x563830c35be0 msgr2=0x563830c34d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:50.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.025+0000 7fcd2dffb640 0 client.15069 ms_handle_reset on v2:172.21.15.181:6838/996120687 2024-01-31T05:10:50.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.025+0000 7fcd4f9fd740 1 -- 172.21.15.99:0/3979623324 shutdown_connections 2024-01-31T05:10:50.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.025+0000 7fcd4f9fd740 1 -- 172.21.15.99:0/3979623324 wait complete. 2024-01-31T05:10:50.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.025+0000 7fcd4f9fd740 20 client.15069 trim_cache size 0 max 16384 2024-01-31T05:10:50.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.040+0000 7fcd4f9fd740 1 Processor -- start 2024-01-31T05:10:50.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.040+0000 7fcd4f9fd740 1 -- start start 2024-01-31T05:10:50.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.040+0000 7fcd4f9fd740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563830c3a670 0x563830c3c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.040+0000 7fcd4f9fd740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563830c3b060 0x563830c3c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.040+0000 7fcd4f9fd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563830c401d0 0x563830c4b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.040+0000 7fcd4f9fd740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x563830ba66f0 con 0x563830c3b060 2024-01-31T05:10:50.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.040+0000 7fcd4f9fd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x563830c3fc80 con 0x563830c401d0 2024-01-31T05:10:50.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.040+0000 7fcd4f9fd740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x563830c432e0 con 0x563830c3a670 2024-01-31T05:10:50.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.040+0000 7fcd3ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563830c3b060 0x563830c3c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.040+0000 7fcd3ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563830c3b060 0x563830c3c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45182/0 (socket says 172.21.15.99:45182) 2024-01-31T05:10:50.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.040+0000 7fcd3ffff640 1 -- 172.21.15.99:0/1838683990 learned_addr learned my addr 172.21.15.99:0/1838683990 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:50.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.041+0000 7fcd4659c640 1 --2- 172.21.15.99:0/1838683990 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563830c3a670 0x563830c3c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.041+0000 7fcd3ffff640 1 -- 172.21.15.99:0/1838683990 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563830c3a670 msgr2=0x563830c3c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:10:50.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.041+0000 7fcd3ffff640 1 --2- 172.21.15.99:0/1838683990 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563830c3a670 0x563830c3c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.041+0000 7fcd3ffff640 1 -- 172.21.15.99:0/1838683990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563830c401d0 msgr2=0x563830c4b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:10:50.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.041+0000 7fcd3ffff640 1 --2- 172.21.15.99:0/1838683990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563830c401d0 0x563830c4b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.041+0000 7fcd3ffff640 1 -- 172.21.15.99:0/1838683990 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563830b3d360 con 0x563830c3b060 2024-01-31T05:10:50.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.041+0000 7fcd3ffff640 1 --2- 172.21.15.99:0/1838683990 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563830c3b060 0x563830c3c920 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fcd30014c70 tx=0x7fcd30017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a0a993e737db11e server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:50.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.041+0000 7fcd2ffff640 1 -- 172.21.15.99:0/1838683990 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd30012cc0 con 0x563830c3b060 2024-01-31T05:10:50.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.041+0000 7fcd2ffff640 1 -- 172.21.15.99:0/1838683990 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcd30012e20 con 0x563830c3b060 2024-01-31T05:10:50.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.041+0000 7fcd2ffff640 1 -- 172.21.15.99:0/1838683990 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3000f750 con 0x563830c3b060 2024-01-31T05:10:50.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.041+0000 7fcd4f9fd740 1 -- 172.21.15.99:0/1838683990 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563830c3b060 msgr2=0x563830c3c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:50.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.041+0000 7fcd4f9fd740 1 --2- 172.21.15.99:0/1838683990 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563830c3b060 0x563830c3c920 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fcd30014c70 tx=0x7fcd30017000 comp rx=0 tx=0).stop 2024-01-31T05:10:50.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.041+0000 7fcd4f9fd740 1 -- 172.21.15.99:0/1838683990 shutdown_connections 2024-01-31T05:10:50.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.041+0000 7fcd4f9fd740 1 --2- 172.21.15.99:0/1838683990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563830c401d0 0x563830c4b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.041+0000 7fcd4f9fd740 1 --2- 172.21.15.99:0/1838683990 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563830c3b060 0x563830c3c920 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.041+0000 7fcd4f9fd740 1 --2- 172.21.15.99:0/1838683990 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563830c3a670 0x563830c3c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.042+0000 7fcd4f9fd740 1 -- 172.21.15.99:0/1838683990 >> 172.21.15.99:0/1838683990 conn(0x563830c35be0 msgr2=0x563830c586f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:50.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.042+0000 7fcd4f9fd740 1 -- 172.21.15.99:0/1838683990 shutdown_connections 2024-01-31T05:10:50.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.042+0000 7fcd4f9fd740 1 -- 172.21.15.99:0/1838683990 wait complete. 2024-01-31T05:10:50.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.042+0000 7fcd4f9fd740 1 -- start start 2024-01-31T05:10:50.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.042+0000 7fcd4f9fd740 1 Processor -- start 2024-01-31T05:10:50.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.042+0000 7fcd4f9fd740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563830c3a670 0x563830c4b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.042+0000 7fcd4f9fd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563830c3b060 0x563830c483a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.042+0000 7fcd4f9fd740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563830c401d0 0x563830c488e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.042+0000 7fcd4f9fd740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x563830ba9000 con 0x563830c401d0 2024-01-31T05:10:50.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.042+0000 7fcd4f9fd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x563830c49010 con 0x563830c3b060 2024-01-31T05:10:50.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.042+0000 7fcd4f9fd740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x563830ca5ea0 con 0x563830c3a670 2024-01-31T05:10:50.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.042+0000 7fcd4f9fd740 10 client.0 _ll_register_callbacks cb 0x7fcd40032ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:10:50.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.042+0000 7fcd46d9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563830c401d0 0x563830c488e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.042+0000 7fcd46d9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563830c401d0 0x563830c488e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45192/0 (socket says 172.21.15.99:45192) 2024-01-31T05:10:50.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.042+0000 7fcd46d9d640 1 -- 172.21.15.99:0/884727379 learned_addr learned my addr 172.21.15.99:0/884727379 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:50.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.042+0000 7fcd3ffff640 1 --2- 172.21.15.99:0/884727379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563830c3b060 0x563830c483a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.042+0000 7fcd4659c640 1 --2- 172.21.15.99:0/884727379 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563830c3a670 0x563830c4b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.042+0000 7fcd46d9d640 1 -- 172.21.15.99:0/884727379 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563830c3a670 msgr2=0x563830c4b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:10:50.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.042+0000 7fcd46d9d640 1 --2- 172.21.15.99:0/884727379 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563830c3a670 0x563830c4b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.042+0000 7fcd46d9d640 1 -- 172.21.15.99:0/884727379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563830c3b060 msgr2=0x563830c483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:10:50.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.042+0000 7fcd46d9d640 1 --2- 172.21.15.99:0/884727379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563830c3b060 0x563830c483a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.042+0000 7fcd46d9d640 1 -- 172.21.15.99:0/884727379 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd3001a050 con 0x563830c401d0 2024-01-31T05:10:50.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.042+0000 7fcd3ffff640 1 --2- 172.21.15.99:0/884727379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563830c3b060 0x563830c483a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:10:50.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.042+0000 7fcd46d9d640 1 --2- 172.21.15.99:0/884727379 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563830c401d0 0x563830c488e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fcd400ba930 tx=0x7fcd400ba690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=731d0f49a53ac611 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:50.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.043+0000 7fcd2dffb640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:10:50.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.043+0000 7fcd2dffb640 1 -- 172.21.15.99:0/884727379 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd400bbf40 con 0x563830c401d0 2024-01-31T05:10:50.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.043+0000 7fcd2dffb640 1 -- 172.21.15.99:0/884727379 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fcd400ef050 con 0x563830c401d0 2024-01-31T05:10:50.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.043+0000 7fcd4f9fd740 1 -- 172.21.15.99:0/884727379 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcd400ba7c0 con 0x563830c401d0 2024-01-31T05:10:50.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.043+0000 7fcd2dffb640 1 -- 172.21.15.99:0/884727379 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd400c4770 con 0x563830c401d0 2024-01-31T05:10:50.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.043+0000 7fcd4f9fd740 10 client.15075 fetch_fsmap learned FSMap version 26 2024-01-31T05:10:50.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.043+0000 7fcd4f9fd740 1 -- 172.21.15.99:0/884727379 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x563830b62eb0 con 0x563830c401d0 2024-01-31T05:10:50.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.043+0000 7fcd2dffb640 1 -- 172.21.15.99:0/884727379 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcd40086020 con 0x563830c401d0 2024-01-31T05:10:50.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.043+0000 7fcd2dffb640 1 -- 172.21.15.99:0/884727379 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fcd4002cca0 con 0x563830c401d0 2024-01-31T05:10:50.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.043+0000 7fcd4f9fd740 10 client.15075 fetch_fsmap finished waiting for FSMap version 26 2024-01-31T05:10:50.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.043+0000 7fcd4f9fd740 10 client.15075 resolve_mds: resolved name 'i' to daemon mds.i 2024-01-31T05:10:50.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.043+0000 7fcd4f9fd740 20 client.15075 populate_metadata read hostname 'smithi099' 2024-01-31T05:10:50.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.043+0000 7fcd4f9fd740 1 --2- 172.21.15.99:0/884727379 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x563830caae60 0x563830ca72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.043+0000 7fcd4f9fd740 4 client.15075 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-31T05:10:50.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.043+0000 7fcd4f9fd740 1 -- 172.21.15.99:0/884727379 --> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5638308a16c0 con 0x563830caae60 2024-01-31T05:10:50.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.043+0000 7fcd4659c640 1 --2- 172.21.15.99:0/884727379 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x563830caae60 0x563830ca72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.044+0000 7fcd2dffb640 10 client.15075 ms_handle_connect on v2:172.21.15.181:6838/996120687 2024-01-31T05:10:50.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.044+0000 7fcd4659c640 1 --2- 172.21.15.99:0/884727379 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x563830caae60 0x563830ca72e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=42c408901d0d74b5 server_cookie=99efdbe23cdde71 in_seq=0 out_seq=0 2024-01-31T05:10:50.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.044+0000 7fcd2dffb640 1 -- 172.21.15.99:0/884727379 <== mds.2 v2:172.21.15.181:6838/996120687 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x5638308a16c0 con 0x563830caae60 2024-01-31T05:10:50.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.044+0000 7fcd2dffb640 10 client.15075 handle_command_reply: tid=0 2024-01-31T05:10:50.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.044+0000 7fcd4f9fd740 1 client.15075 shutdown 2024-01-31T05:10:50.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.044+0000 7fcd4f9fd740 1 -- 172.21.15.99:0/884727379 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563830c401d0 msgr2=0x563830c488e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:50.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.044+0000 7fcd4f9fd740 1 --2- 172.21.15.99:0/884727379 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563830c401d0 0x563830c488e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fcd400ba930 tx=0x7fcd400ba690 comp rx=0 tx=0).stop 2024-01-31T05:10:50.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.044+0000 7fcd4f9fd740 1 -- 172.21.15.99:0/884727379 shutdown_connections 2024-01-31T05:10:50.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.044+0000 7fcd4f9fd740 1 --2- 172.21.15.99:0/884727379 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563830c401d0 0x563830c488e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.044+0000 7fcd4f9fd740 1 --2- 172.21.15.99:0/884727379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563830c3b060 0x563830c483a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.044+0000 7fcd4f9fd740 1 --2- 172.21.15.99:0/884727379 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x563830caae60 0x563830ca72e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.044+0000 7fcd4f9fd740 1 --2- 172.21.15.99:0/884727379 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563830c3a670 0x563830c4b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.044+0000 7fcd2dffb640 0 client.15075 ms_handle_reset on v2:172.21.15.181:6838/996120687 2024-01-31T05:10:50.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.044+0000 7fcd4f9fd740 1 -- 172.21.15.99:0/884727379 >> 172.21.15.99:0/884727379 conn(0x563830c35be0 msgr2=0x563830c3c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:50.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.044+0000 7fcd4f9fd740 1 -- 172.21.15.99:0/884727379 shutdown_connections 2024-01-31T05:10:50.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.044+0000 7fcd4f9fd740 1 -- 172.21.15.99:0/884727379 wait complete. 2024-01-31T05:10:50.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.044+0000 7fcd4f9fd740 20 client.15075 trim_cache size 0 max 16384 2024-01-31T05:10:50.053 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-01-31T05:10:50.053 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_fsid": "9288ff44-bff5-11ee-95b3-87774f69a715", 2024-01-31T05:10:50.054 INFO:teuthology.orchestra.run.smithi099.stdout: "whoami": 2, 2024-01-31T05:10:50.054 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 24457, 2024-01-31T05:10:50.054 INFO:teuthology.orchestra.run.smithi099.stdout: "want_state": "up:active", 2024-01-31T05:10:50.054 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "up:active", 2024-01-31T05:10:50.054 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "cephfs", 2024-01-31T05:10:50.054 INFO:teuthology.orchestra.run.smithi099.stdout: "rank_uptime": 84.864189992999997, 2024-01-31T05:10:50.054 INFO:teuthology.orchestra.run.smithi099.stdout: "mdsmap_epoch": 26, 2024-01-31T05:10:50.054 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch": 88, 2024-01-31T05:10:50.054 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch_barrier": 86, 2024-01-31T05:10:50.054 INFO:teuthology.orchestra.run.smithi099.stdout: "uptime": 102.575864541 2024-01-31T05:10:50.054 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-01-31T05:10:50.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.045+0000 7fcd4cf9d640 1 -- 172.21.15.99:0/1406912578 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fcd340a1370 msgr2=0x7fcd340a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:50.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.045+0000 7fcd4cf9d640 1 --2- 172.21.15.99:0/1406912578 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fcd340a1370 0x7fcd340a3830 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcd3000bf70 tx=0x7fcd3000b5e0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.045+0000 7fcd4cf9d640 1 -- 172.21.15.99:0/1406912578 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd48101810 msgr2=0x7fcd4819e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:50.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.045+0000 7fcd4cf9d640 1 --2- 172.21.15.99:0/1406912578 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd48101810 0x7fcd4819e1e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fcd40037040 tx=0x7fcd40032810 comp rx=0 tx=0).stop 2024-01-31T05:10:50.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.045+0000 7fcd4cf9d640 1 -- 172.21.15.99:0/1406912578 shutdown_connections 2024-01-31T05:10:50.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.045+0000 7fcd4cf9d640 1 --2- 172.21.15.99:0/1406912578 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fcd340a1370 0x7fcd340a3830 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.045+0000 7fcd4cf9d640 1 --2- 172.21.15.99:0/1406912578 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd48101810 0x7fcd4819e1e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.045+0000 7fcd4cf9d640 1 --2- 172.21.15.99:0/1406912578 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd48100e50 0x7fcd48197200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.045+0000 7fcd4cf9d640 1 --2- 172.21.15.99:0/1406912578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd48100140 0x7fcd48196cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.045+0000 7fcd4cf9d640 1 -- 172.21.15.99:0/1406912578 >> 172.21.15.99:0/1406912578 conn(0x7fcd480fa8f0 msgr2=0x7fcd480fc3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:50.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.045+0000 7fcd4cf9d640 1 -- 172.21.15.99:0/1406912578 shutdown_connections 2024-01-31T05:10:50.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.045+0000 7fcd4cf9d640 1 -- 172.21.15.99:0/1406912578 wait complete. 2024-01-31T05:10:50.057 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-01-31T05:10:50.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:49 smithi181 ceph-mon[36434]: pgmap v332: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-01-31T05:10:50.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:49 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/1937146762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:10:50.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:49 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/3806458649' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:10:50.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:49 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/312308560' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:10:50.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:49 smithi179 ceph-mon[35652]: pgmap v332: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-01-31T05:10:50.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:49 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/1937146762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:10:50.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:49 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/3806458649' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:10:50.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:49 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/312308560' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:10:50.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.159+0000 7fc4a218d640 1 -- 172.21.15.99:0/1733943486 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc49c102960 msgr2=0x7fc49c1091f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:50.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.159+0000 7fc4a218d640 1 --2- 172.21.15.99:0/1733943486 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc49c102960 0x7fc49c1091f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc494009ca0 tx=0x7fc49402c0f0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.159+0000 7fc4a218d640 1 -- 172.21.15.99:0/1733943486 shutdown_connections 2024-01-31T05:10:50.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.159+0000 7fc4a218d640 1 --2- 172.21.15.99:0/1733943486 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc49c102960 0x7fc49c1091f0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.159+0000 7fc4a218d640 1 --2- 172.21.15.99:0/1733943486 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc49c101fa0 0x7fc49c102420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.159+0000 7fc4a218d640 1 --2- 172.21.15.99:0/1733943486 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc49c0fefd0 0x7fc49c0ff3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.159+0000 7fc4a218d640 1 -- 172.21.15.99:0/1733943486 >> 172.21.15.99:0/1733943486 conn(0x7fc49c0fa920 msgr2=0x7fc49c0fcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:50.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.159+0000 7fc4a218d640 1 -- 172.21.15.99:0/1733943486 shutdown_connections 2024-01-31T05:10:50.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.159+0000 7fc4a218d640 1 -- 172.21.15.99:0/1733943486 wait complete. 2024-01-31T05:10:50.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.160+0000 7fc4a218d640 1 Processor -- start 2024-01-31T05:10:50.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.160+0000 7fc4a218d640 1 -- start start 2024-01-31T05:10:50.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.160+0000 7fc4a218d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc49c0fefd0 0x7fc49c101910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.160+0000 7fc4a218d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc49c101fa0 0x7fc49c0fff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.160+0000 7fc4a218d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc49c102960 0x7fc49c100490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.160+0000 7fc4a218d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49c100bf0 con 0x7fc49c0fefd0 2024-01-31T05:10:50.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.160+0000 7fc4a218d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49c100d60 con 0x7fc49c102960 2024-01-31T05:10:50.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.160+0000 7fc4a218d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49c1a0c00 con 0x7fc49c101fa0 2024-01-31T05:10:50.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.160+0000 7fc49b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc49c0fefd0 0x7fc49c101910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.160+0000 7fc49b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc49c0fefd0 0x7fc49c101910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45212/0 (socket says 172.21.15.99:45212) 2024-01-31T05:10:50.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.160+0000 7fc49b7fe640 1 -- 172.21.15.99:0/2720313334 learned_addr learned my addr 172.21.15.99:0/2720313334 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:50.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.160+0000 7fc49bfff640 1 --2- 172.21.15.99:0/2720313334 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc49c102960 0x7fc49c100490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.160+0000 7fc49b7fe640 1 -- 172.21.15.99:0/2720313334 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc49c101fa0 msgr2=0x7fc49c0fff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:50.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.160+0000 7fc49b7fe640 1 --2- 172.21.15.99:0/2720313334 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc49c101fa0 0x7fc49c0fff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.160+0000 7fc49b7fe640 1 -- 172.21.15.99:0/2720313334 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc49c102960 msgr2=0x7fc49c100490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:50.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.160+0000 7fc49b7fe640 1 --2- 172.21.15.99:0/2720313334 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc49c102960 0x7fc49c100490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.160+0000 7fc49b7fe640 1 -- 172.21.15.99:0/2720313334 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc494009900 con 0x7fc49c0fefd0 2024-01-31T05:10:50.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.161+0000 7fc49b7fe640 1 --2- 172.21.15.99:0/2720313334 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc49c0fefd0 0x7fc49c101910 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc48c00c9a0 tx=0x7fc48c00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:50.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.161+0000 7fc498ff9640 1 -- 172.21.15.99:0/2720313334 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48c007c10 con 0x7fc49c0fefd0 2024-01-31T05:10:50.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.161+0000 7fc498ff9640 1 -- 172.21.15.99:0/2720313334 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc48c007d70 con 0x7fc49c0fefd0 2024-01-31T05:10:50.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.161+0000 7fc4a218d640 1 -- 172.21.15.99:0/2720313334 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc49c1a0eb0 con 0x7fc49c0fefd0 2024-01-31T05:10:50.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.161+0000 7fc498ff9640 1 -- 172.21.15.99:0/2720313334 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48c00f850 con 0x7fc49c0fefd0 2024-01-31T05:10:50.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.161+0000 7fc4a218d640 1 -- 172.21.15.99:0/2720313334 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc49c1a1380 con 0x7fc49c0fefd0 2024-01-31T05:10:50.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.163+0000 7fc498ff9640 1 -- 172.21.15.99:0/2720313334 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7fc48c018480 con 0x7fc49c0fefd0 2024-01-31T05:10:50.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.163+0000 7fc4a502f740 1 Processor -- start 2024-01-31T05:10:50.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.163+0000 7fc4a502f740 1 -- start start 2024-01-31T05:10:50.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.163+0000 7fc498ff9640 1 --2- 172.21.15.99:0/2720313334 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc4840a13f0 0x7fc4840a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.163+0000 7fc4a502f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558078341670 0x558078341a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.163+0000 7fc4a502f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558078342060 0x558078346b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.163+0000 7fc4a502f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5580783471d0 0x558078349660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.163+0000 7fc4a502f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580782b0000 con 0x558078341670 2024-01-31T05:10:50.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.163+0000 7fc4a502f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580782ad6f0 con 0x558078342060 2024-01-31T05:10:50.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.163+0000 7fc4a502f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580782a8fe0 con 0x5580783471d0 2024-01-31T05:10:50.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.163+0000 7fc49b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558078341670 0x558078341a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.163+0000 7fc49bfff640 1 --2- 172.21.15.99:0/2720313334 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc4840a13f0 0x7fc4840a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.163+0000 7fc49b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558078341670 0x558078341a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45226/0 (socket says 172.21.15.99:45226) 2024-01-31T05:10:50.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.163+0000 7fc49b7fe640 1 -- 172.21.15.99:0/2572371233 learned_addr learned my addr 172.21.15.99:0/2572371233 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:50.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.164+0000 7fc498ff9640 1 -- 172.21.15.99:0/2720313334 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fc48c013070 con 0x7fc49c0fefd0 2024-01-31T05:10:50.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.164+0000 7fc49affd640 1 --2- 172.21.15.99:0/2572371233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558078342060 0x558078346b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.164+0000 7fc49b7fe640 1 -- 172.21.15.99:0/2572371233 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5580783471d0 msgr2=0x558078349660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:10:50.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.164+0000 7fc49b7fe640 1 --2- 172.21.15.99:0/2572371233 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5580783471d0 0x558078349660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.164+0000 7fc49b7fe640 1 -- 172.21.15.99:0/2572371233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558078342060 msgr2=0x558078346b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:10:50.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.164+0000 7fc49b7fe640 1 --2- 172.21.15.99:0/2572371233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558078342060 0x558078346b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.164+0000 7fc49b7fe640 1 -- 172.21.15.99:0/2572371233 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55807826b650 con 0x558078341670 2024-01-31T05:10:50.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.164+0000 7fc49affd640 1 --2- 172.21.15.99:0/2572371233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558078342060 0x558078346b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:10:50.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.164+0000 7fc49bfff640 1 --2- 172.21.15.99:0/2720313334 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc4840a13f0 0x7fc4840a38b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc494006010 tx=0x7fc494009800 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:50.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.164+0000 7fc49b7fe640 1 --2- 172.21.15.99:0/2572371233 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558078341670 0x558078341a90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc48c096ae0 tx=0x7fc48c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5146bdb831895927 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:50.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.164+0000 7fc481ffb640 1 -- 172.21.15.99:0/2572371233 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48c099bb0 con 0x558078341670 2024-01-31T05:10:50.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.164+0000 7fc481ffb640 1 -- 172.21.15.99:0/2572371233 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc48c0999d0 con 0x558078341670 2024-01-31T05:10:50.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.164+0000 7fc481ffb640 1 -- 172.21.15.99:0/2572371233 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48c0984a0 con 0x558078341670 2024-01-31T05:10:50.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.165+0000 7fc4a502f740 1 -- 172.21.15.99:0/2572371233 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558078341670 msgr2=0x558078341a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:50.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.165+0000 7fc4a502f740 1 --2- 172.21.15.99:0/2572371233 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558078341670 0x558078341a90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc48c096ae0 tx=0x7fc48c00cf90 comp rx=0 tx=0).stop 2024-01-31T05:10:50.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.165+0000 7fc4a502f740 1 -- 172.21.15.99:0/2572371233 shutdown_connections 2024-01-31T05:10:50.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.165+0000 7fc4a502f740 1 --2- 172.21.15.99:0/2572371233 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5580783471d0 0x558078349660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.165+0000 7fc4a502f740 1 --2- 172.21.15.99:0/2572371233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558078342060 0x558078346b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.165+0000 7fc4a502f740 1 --2- 172.21.15.99:0/2572371233 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558078341670 0x558078341a90 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.165+0000 7fc4a502f740 1 -- 172.21.15.99:0/2572371233 >> 172.21.15.99:0/2572371233 conn(0x55807833cbe0 msgr2=0x55807833cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:50.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.165+0000 7fc4a502f740 1 -- 172.21.15.99:0/2572371233 shutdown_connections 2024-01-31T05:10:50.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.165+0000 7fc4a502f740 1 -- 172.21.15.99:0/2572371233 wait complete. 2024-01-31T05:10:50.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.165+0000 7fc4a502f740 1 -- start start 2024-01-31T05:10:50.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.165+0000 7fc4a502f740 1 Processor -- start 2024-01-31T05:10:50.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.166+0000 7fc4a502f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558078341670 0x55807834b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.166+0000 7fc4a502f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558078342060 0x55807834be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.166+0000 7fc4a502f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5580783471d0 0x558078352e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.166+0000 7fc4a502f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580782625c0 con 0x5580783471d0 2024-01-31T05:10:50.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.166+0000 7fc4a502f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x558078262260 con 0x558078342060 2024-01-31T05:10:50.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.166+0000 7fc4a502f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580782272d0 con 0x558078341670 2024-01-31T05:10:50.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.166+0000 7fc4a502f740 10 client.0 _ll_register_callbacks cb 0x55807825d230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:10:50.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.166+0000 7fc49bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5580783471d0 0x558078352e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.166+0000 7fc49bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5580783471d0 0x558078352e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45232/0 (socket says 172.21.15.99:45232) 2024-01-31T05:10:50.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.166+0000 7fc49bfff640 1 -- 172.21.15.99:0/2253534815 learned_addr learned my addr 172.21.15.99:0/2253534815 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:50.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.166+0000 7fc49affd640 1 --2- 172.21.15.99:0/2253534815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558078342060 0x55807834be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.166+0000 7fc49b7fe640 1 --2- 172.21.15.99:0/2253534815 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558078341670 0x55807834b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.166+0000 7fc49bfff640 1 -- 172.21.15.99:0/2253534815 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558078341670 msgr2=0x55807834b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:10:50.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.166+0000 7fc49bfff640 1 --2- 172.21.15.99:0/2253534815 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558078341670 0x55807834b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.166+0000 7fc49bfff640 1 -- 172.21.15.99:0/2253534815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558078342060 msgr2=0x55807834be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:10:50.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.166+0000 7fc49bfff640 1 --2- 172.21.15.99:0/2253534815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558078342060 0x55807834be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.166+0000 7fc49bfff640 1 -- 172.21.15.99:0/2253534815 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc49c1a1380 con 0x5580783471d0 2024-01-31T05:10:50.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.166+0000 7fc49bfff640 1 --2- 172.21.15.99:0/2253534815 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5580783471d0 0x558078352e60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc494009ca0 tx=0x7fc49402c0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8db2a3265f223985 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:50.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.166+0000 7fc47affd640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:10:50.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.166+0000 7fc47affd640 1 -- 172.21.15.99:0/2253534815 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc494003b70 con 0x5580783471d0 2024-01-31T05:10:50.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.166+0000 7fc47affd640 1 -- 172.21.15.99:0/2253534815 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fc494032a80 con 0x5580783471d0 2024-01-31T05:10:50.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.166+0000 7fc4a502f740 1 -- 172.21.15.99:0/2253534815 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5580782a1e70 con 0x5580783471d0 2024-01-31T05:10:50.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.166+0000 7fc47affd640 1 -- 172.21.15.99:0/2253534815 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc494003cd0 con 0x5580783471d0 2024-01-31T05:10:50.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.166+0000 7fc4a502f740 10 client.15087 fetch_fsmap learned FSMap version 26 2024-01-31T05:10:50.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.166+0000 7fc4a502f740 1 -- 172.21.15.99:0/2253534815 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5580782a7660 con 0x5580783471d0 2024-01-31T05:10:50.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.167+0000 7fc47affd640 1 -- 172.21.15.99:0/2253534815 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5580782a1e70 con 0x5580783471d0 2024-01-31T05:10:50.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.167+0000 7fc47affd640 1 -- 172.21.15.99:0/2253534815 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc49403e040 con 0x5580783471d0 2024-01-31T05:10:50.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.167+0000 7fc4a502f740 10 client.15087 fetch_fsmap finished waiting for FSMap version 26 2024-01-31T05:10:50.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.167+0000 7fc4a502f740 10 client.15087 resolve_mds: resolved name 'h' to daemon mds.h 2024-01-31T05:10:50.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.167+0000 7fc4a502f740 20 client.15087 populate_metadata read hostname 'smithi099' 2024-01-31T05:10:50.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.167+0000 7fc4a502f740 1 --2- 172.21.15.99:0/2253534815 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x558078358ad0 0x5580783574f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.167+0000 7fc4a502f740 4 client.15087 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:10:50.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.167+0000 7fc4a502f740 1 -- 172.21.15.99:0/2253534815 --> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5580782a1b90 con 0x558078358ad0 2024-01-31T05:10:50.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.167+0000 7fc49b7fe640 1 --2- 172.21.15.99:0/2253534815 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x558078358ad0 0x5580783574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.167+0000 7fc47affd640 10 client.15087 ms_handle_connect on v2:172.21.15.179:6836/837402830 2024-01-31T05:10:50.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.167+0000 7fc49b7fe640 1 --2- 172.21.15.99:0/2253534815 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x558078358ad0 0x5580783574f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=49cf79d78153d11a server_cookie=5dd1e29c05a2bbed in_seq=0 out_seq=0 2024-01-31T05:10:50.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.168+0000 7fc47affd640 1 -- 172.21.15.99:0/2253534815 <== mds.1 v2:172.21.15.179:6836/837402830 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5580782a1b90 con 0x558078358ad0 2024-01-31T05:10:50.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.168+0000 7fc47affd640 10 client.15087 handle_command_reply: tid=0 2024-01-31T05:10:50.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.168+0000 7fc4a502f740 1 client.15087 shutdown 2024-01-31T05:10:50.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.168+0000 7fc4a502f740 1 -- 172.21.15.99:0/2253534815 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5580783471d0 msgr2=0x558078352e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:50.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.168+0000 7fc4a502f740 1 --2- 172.21.15.99:0/2253534815 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5580783471d0 0x558078352e60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc494009ca0 tx=0x7fc49402c0f0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.168+0000 7fc4a502f740 1 -- 172.21.15.99:0/2253534815 shutdown_connections 2024-01-31T05:10:50.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.168+0000 7fc4a502f740 1 --2- 172.21.15.99:0/2253534815 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x558078358ad0 0x5580783574f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.168+0000 7fc4a502f740 1 --2- 172.21.15.99:0/2253534815 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5580783471d0 0x558078352e60 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.168+0000 7fc4a502f740 1 --2- 172.21.15.99:0/2253534815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558078342060 0x55807834be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.168+0000 7fc47affd640 0 client.15087 ms_handle_reset on v2:172.21.15.179:6836/837402830 2024-01-31T05:10:50.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.168+0000 7fc4a502f740 1 --2- 172.21.15.99:0/2253534815 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558078341670 0x55807834b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.168+0000 7fc4a502f740 1 -- 172.21.15.99:0/2253534815 >> 172.21.15.99:0/2253534815 conn(0x55807833cbe0 msgr2=0x55807833bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:50.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.168+0000 7fc4a502f740 1 -- 172.21.15.99:0/2253534815 shutdown_connections 2024-01-31T05:10:50.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.168+0000 7fc4a502f740 1 -- 172.21.15.99:0/2253534815 wait complete. 2024-01-31T05:10:50.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.169+0000 7fc4a502f740 20 client.15087 trim_cache size 0 max 16384 2024-01-31T05:10:50.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.184+0000 7fc4a502f740 1 Processor -- start 2024-01-31T05:10:50.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.184+0000 7fc4a502f740 1 -- start start 2024-01-31T05:10:50.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.184+0000 7fc4a502f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55807833cbe0 0x558078357c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.184+0000 7fc4a502f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558078341670 0x558078352e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.184+0000 7fc4a502f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558078342060 0x55807833b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.184+0000 7fc4a502f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580783497f0 con 0x55807833cbe0 2024-01-31T05:10:50.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.184+0000 7fc4a502f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55807833ca90 con 0x558078341670 2024-01-31T05:10:50.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.184+0000 7fc4a502f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580782a1b90 con 0x558078342060 2024-01-31T05:10:50.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.184+0000 7fc49b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55807833cbe0 0x558078357c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.184+0000 7fc49b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55807833cbe0 0x558078357c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45234/0 (socket says 172.21.15.99:45234) 2024-01-31T05:10:50.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.184+0000 7fc49b7fe640 1 -- 172.21.15.99:0/976222356 learned_addr learned my addr 172.21.15.99:0/976222356 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:50.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.185+0000 7fc49bfff640 1 --2- 172.21.15.99:0/976222356 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558078342060 0x55807833b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.185+0000 7fc49b7fe640 1 -- 172.21.15.99:0/976222356 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558078342060 msgr2=0x55807833b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:10:50.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.185+0000 7fc49b7fe640 1 --2- 172.21.15.99:0/976222356 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558078342060 0x55807833b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.185+0000 7fc49b7fe640 1 -- 172.21.15.99:0/976222356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558078341670 msgr2=0x558078352e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:10:50.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.185+0000 7fc49affd640 1 --2- 172.21.15.99:0/976222356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558078341670 0x558078352e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.185+0000 7fc49b7fe640 1 --2- 172.21.15.99:0/976222356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558078341670 0x558078352e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.185+0000 7fc49b7fe640 1 -- 172.21.15.99:0/976222356 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558078244360 con 0x55807833cbe0 2024-01-31T05:10:50.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.185+0000 7fc49bfff640 1 --2- 172.21.15.99:0/976222356 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558078342060 0x55807833b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:10:50.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.185+0000 7fc49b7fe640 1 --2- 172.21.15.99:0/976222356 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55807833cbe0 0x558078357c00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc48c0caa30 tx=0x7fc48c0a2370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89ce841a034dd66a server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:50.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.185+0000 7fc4817fa640 1 -- 172.21.15.99:0/976222356 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48c0a23e0 con 0x55807833cbe0 2024-01-31T05:10:50.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.185+0000 7fc4817fa640 1 -- 172.21.15.99:0/976222356 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc48c09a770 con 0x55807833cbe0 2024-01-31T05:10:50.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.185+0000 7fc4817fa640 1 -- 172.21.15.99:0/976222356 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48c018730 con 0x55807833cbe0 2024-01-31T05:10:50.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.185+0000 7fc4a502f740 1 -- 172.21.15.99:0/976222356 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55807833cbe0 msgr2=0x558078357c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:50.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.185+0000 7fc4a502f740 1 --2- 172.21.15.99:0/976222356 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55807833cbe0 0x558078357c00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc48c0caa30 tx=0x7fc48c0a2370 comp rx=0 tx=0).stop 2024-01-31T05:10:50.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.185+0000 7fc4a502f740 1 -- 172.21.15.99:0/976222356 shutdown_connections 2024-01-31T05:10:50.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.185+0000 7fc4a502f740 1 --2- 172.21.15.99:0/976222356 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558078342060 0x55807833b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.185+0000 7fc4a502f740 1 --2- 172.21.15.99:0/976222356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558078341670 0x558078352e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.185+0000 7fc4a502f740 1 --2- 172.21.15.99:0/976222356 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55807833cbe0 0x558078357c00 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.185+0000 7fc4a502f740 1 -- 172.21.15.99:0/976222356 >> 172.21.15.99:0/976222356 conn(0x55807833d330 msgr2=0x5580783574f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:50.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.185+0000 7fc4a502f740 1 -- 172.21.15.99:0/976222356 shutdown_connections 2024-01-31T05:10:50.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.185+0000 7fc4a502f740 1 -- 172.21.15.99:0/976222356 wait complete. 2024-01-31T05:10:50.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.186+0000 7fc4a502f740 1 -- start start 2024-01-31T05:10:50.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.186+0000 7fc4a502f740 1 Processor -- start 2024-01-31T05:10:50.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.186+0000 7fc4a502f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55807833cbe0 0x558078350560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.186+0000 7fc4a502f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558078341670 0x558078350aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.186+0000 7fc4a502f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558078342060 0x558078351a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.186+0000 7fc4a502f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x558078351fa0 con 0x55807833cbe0 2024-01-31T05:10:50.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.186+0000 7fc4a502f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x558078352110 con 0x558078341670 2024-01-31T05:10:50.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.186+0000 7fc4a502f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580783522d0 con 0x558078342060 2024-01-31T05:10:50.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.186+0000 7fc49b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55807833cbe0 0x558078350560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.186+0000 7fc4a502f740 10 client.0 _ll_register_callbacks cb 0x7fc48c007ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:10:50.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.186+0000 7fc49b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55807833cbe0 0x558078350560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45236/0 (socket says 172.21.15.99:45236) 2024-01-31T05:10:50.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.186+0000 7fc49b7fe640 1 -- 172.21.15.99:0/35444738 learned_addr learned my addr 172.21.15.99:0/35444738 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:50.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.186+0000 7fc49affd640 1 --2- 172.21.15.99:0/35444738 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558078341670 0x558078350aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.186+0000 7fc49bfff640 1 --2- 172.21.15.99:0/35444738 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558078342060 0x558078351a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.186+0000 7fc49b7fe640 1 -- 172.21.15.99:0/35444738 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558078342060 msgr2=0x558078351a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:10:50.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.186+0000 7fc49b7fe640 1 --2- 172.21.15.99:0/35444738 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558078342060 0x558078351a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.186+0000 7fc49b7fe640 1 -- 172.21.15.99:0/35444738 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558078341670 msgr2=0x558078350aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:10:50.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.186+0000 7fc49b7fe640 1 --2- 172.21.15.99:0/35444738 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558078341670 0x558078350aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.186+0000 7fc49b7fe640 1 -- 172.21.15.99:0/35444738 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55807826b650 con 0x55807833cbe0 2024-01-31T05:10:50.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.187+0000 7fc49b7fe640 1 --2- 172.21.15.99:0/35444738 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55807833cbe0 0x558078350560 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc48c099f10 tx=0x7fc48c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36b5e42a64566f34 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:50.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.187+0000 7fc47affd640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:10:50.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.187+0000 7fc47affd640 1 -- 172.21.15.99:0/35444738 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48c0b9ac0 con 0x55807833cbe0 2024-01-31T05:10:50.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.187+0000 7fc47affd640 1 -- 172.21.15.99:0/35444738 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fc48c09e1c0 con 0x55807833cbe0 2024-01-31T05:10:50.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.187+0000 7fc4a502f740 1 -- 172.21.15.99:0/35444738 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc48c0999d0 con 0x55807833cbe0 2024-01-31T05:10:50.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.187+0000 7fc47affd640 1 -- 172.21.15.99:0/35444738 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc48c098410 con 0x55807833cbe0 2024-01-31T05:10:50.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.187+0000 7fc4a502f740 10 client.15093 fetch_fsmap learned FSMap version 26 2024-01-31T05:10:50.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.187+0000 7fc4a502f740 1 -- 172.21.15.99:0/35444738 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x558078269eb0 con 0x55807833cbe0 2024-01-31T05:10:50.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.187+0000 7fc47affd640 1 -- 172.21.15.99:0/35444738 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc48c0999d0 con 0x55807833cbe0 2024-01-31T05:10:50.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.187+0000 7fc47affd640 1 -- 172.21.15.99:0/35444738 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc48c099680 con 0x55807833cbe0 2024-01-31T05:10:50.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.187+0000 7fc4a502f740 10 client.15093 fetch_fsmap finished waiting for FSMap version 26 2024-01-31T05:10:50.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.187+0000 7fc4a502f740 10 client.15093 resolve_mds: resolved name 'h' to daemon mds.h 2024-01-31T05:10:50.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.187+0000 7fc4a502f740 20 client.15093 populate_metadata read hostname 'smithi099' 2024-01-31T05:10:50.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.187+0000 7fc4a502f740 1 --2- 172.21.15.99:0/35444738 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x5580783471d0 0x5580783afc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.187+0000 7fc4a502f740 4 client.15093 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-31T05:10:50.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.187+0000 7fc4a502f740 1 -- 172.21.15.99:0/35444738 --> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558077fa86c0 con 0x5580783471d0 2024-01-31T05:10:50.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.187+0000 7fc49affd640 1 --2- 172.21.15.99:0/35444738 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x5580783471d0 0x5580783afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.188+0000 7fc49affd640 1 --2- 172.21.15.99:0/35444738 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x5580783471d0 0x5580783afc90 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=72134e1eda902f38 server_cookie=f7cdf773072d3090 in_seq=0 out_seq=0 2024-01-31T05:10:50.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.188+0000 7fc47affd640 10 client.15093 ms_handle_connect on v2:172.21.15.179:6836/837402830 2024-01-31T05:10:50.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.188+0000 7fc47affd640 1 -- 172.21.15.99:0/35444738 <== mds.1 v2:172.21.15.179:6836/837402830 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x558077fa86c0 con 0x5580783471d0 2024-01-31T05:10:50.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.188+0000 7fc47affd640 10 client.15093 handle_command_reply: tid=0 2024-01-31T05:10:50.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.188+0000 7fc4a502f740 1 client.15093 shutdown 2024-01-31T05:10:50.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.188+0000 7fc4a502f740 1 -- 172.21.15.99:0/35444738 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55807833cbe0 msgr2=0x558078350560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:50.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.188+0000 7fc4a502f740 1 --2- 172.21.15.99:0/35444738 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55807833cbe0 0x558078350560 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc48c099f10 tx=0x7fc48c000bc0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.188+0000 7fc4a502f740 1 -- 172.21.15.99:0/35444738 shutdown_connections 2024-01-31T05:10:50.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.188+0000 7fc4a502f740 1 --2- 172.21.15.99:0/35444738 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x5580783471d0 0x5580783afc90 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.188+0000 7fc4a502f740 1 --2- 172.21.15.99:0/35444738 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558078342060 0x558078351a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.188+0000 7fc4a502f740 1 --2- 172.21.15.99:0/35444738 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558078341670 0x558078350aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.188+0000 7fc47affd640 0 client.15093 ms_handle_reset on v2:172.21.15.179:6836/837402830 2024-01-31T05:10:50.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.188+0000 7fc4a502f740 1 --2- 172.21.15.99:0/35444738 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55807833cbe0 0x558078350560 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.188+0000 7fc4a502f740 1 -- 172.21.15.99:0/35444738 >> 172.21.15.99:0/35444738 conn(0x55807833d330 msgr2=0x55807833b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:50.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.188+0000 7fc4a502f740 1 -- 172.21.15.99:0/35444738 shutdown_connections 2024-01-31T05:10:50.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.188+0000 7fc4a502f740 1 -- 172.21.15.99:0/35444738 wait complete. 2024-01-31T05:10:50.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.188+0000 7fc4a502f740 20 client.15093 trim_cache size 0 max 16384 2024-01-31T05:10:50.197 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-01-31T05:10:50.197 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_fsid": "9288ff44-bff5-11ee-95b3-87774f69a715", 2024-01-31T05:10:50.197 INFO:teuthology.orchestra.run.smithi099.stdout: "whoami": 1, 2024-01-31T05:10:50.198 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 24461, 2024-01-31T05:10:50.198 INFO:teuthology.orchestra.run.smithi099.stdout: "want_state": "up:active", 2024-01-31T05:10:50.198 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "up:active", 2024-01-31T05:10:50.198 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "cephfs", 2024-01-31T05:10:50.198 INFO:teuthology.orchestra.run.smithi099.stdout: "rank_uptime": 86.014765564000001, 2024-01-31T05:10:50.198 INFO:teuthology.orchestra.run.smithi099.stdout: "mdsmap_epoch": 26, 2024-01-31T05:10:50.198 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch": 88, 2024-01-31T05:10:50.198 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch_barrier": 86, 2024-01-31T05:10:50.198 INFO:teuthology.orchestra.run.smithi099.stdout: "uptime": 105.330666682 2024-01-31T05:10:50.198 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-01-31T05:10:50.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.189+0000 7fc4a218d640 1 -- 172.21.15.99:0/2720313334 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc4840a13f0 msgr2=0x7fc4840a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:50.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.189+0000 7fc4a218d640 1 --2- 172.21.15.99:0/2720313334 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc4840a13f0 0x7fc4840a38b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc494006010 tx=0x7fc494009800 comp rx=0 tx=0).stop 2024-01-31T05:10:50.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.189+0000 7fc4a218d640 1 -- 172.21.15.99:0/2720313334 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc49c0fefd0 msgr2=0x7fc49c101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:50.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.189+0000 7fc4a218d640 1 --2- 172.21.15.99:0/2720313334 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc49c0fefd0 0x7fc49c101910 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc48c00c9a0 tx=0x7fc48c00ce60 comp rx=0 tx=0).stop 2024-01-31T05:10:50.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.189+0000 7fc4a218d640 1 -- 172.21.15.99:0/2720313334 shutdown_connections 2024-01-31T05:10:50.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.189+0000 7fc4a218d640 1 --2- 172.21.15.99:0/2720313334 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc4840a13f0 0x7fc4840a38b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.189+0000 7fc4a218d640 1 --2- 172.21.15.99:0/2720313334 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc49c102960 0x7fc49c100490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.189+0000 7fc4a218d640 1 --2- 172.21.15.99:0/2720313334 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc49c101fa0 0x7fc49c0fff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.189+0000 7fc4a218d640 1 --2- 172.21.15.99:0/2720313334 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc49c0fefd0 0x7fc49c101910 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.189+0000 7fc4a218d640 1 -- 172.21.15.99:0/2720313334 >> 172.21.15.99:0/2720313334 conn(0x7fc49c0fa920 msgr2=0x7fc49c105320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:50.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.189+0000 7fc4a218d640 1 -- 172.21.15.99:0/2720313334 shutdown_connections 2024-01-31T05:10:50.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.189+0000 7fc4a218d640 1 -- 172.21.15.99:0/2720313334 wait complete. 2024-01-31T05:10:50.201 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-01-31T05:10:50.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.303+0000 7fada34b1640 1 -- 172.21.15.99:0/1532728774 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad9c101ef0 msgr2=0x7fad9c102370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:50.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.303+0000 7fada34b1640 1 --2- 172.21.15.99:0/1532728774 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad9c101ef0 0x7fad9c102370 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fad8c009900 tx=0x7fad8c02bc30 comp rx=0 tx=0).stop 2024-01-31T05:10:50.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.303+0000 7fada34b1640 1 -- 172.21.15.99:0/1532728774 shutdown_connections 2024-01-31T05:10:50.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.303+0000 7fada34b1640 1 --2- 172.21.15.99:0/1532728774 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad9c1028b0 0x7fad9c109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.304+0000 7fada34b1640 1 --2- 172.21.15.99:0/1532728774 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad9c101ef0 0x7fad9c102370 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.304+0000 7fada34b1640 1 --2- 172.21.15.99:0/1532728774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad9c100d00 0x7fad9c101120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.304+0000 7fada34b1640 1 -- 172.21.15.99:0/1532728774 >> 172.21.15.99:0/1532728774 conn(0x7fad9c0fc290 msgr2=0x7fad9c0fe6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:50.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.304+0000 7fada34b1640 1 -- 172.21.15.99:0/1532728774 shutdown_connections 2024-01-31T05:10:50.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.304+0000 7fada34b1640 1 -- 172.21.15.99:0/1532728774 wait complete. 2024-01-31T05:10:50.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.304+0000 7fada34b1640 1 Processor -- start 2024-01-31T05:10:50.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.304+0000 7fada34b1640 1 -- start start 2024-01-31T05:10:50.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.304+0000 7fada34b1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad9c100d00 0x7fad9c196ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.304+0000 7fada34b1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad9c101ef0 0x7fad9c1971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.304+0000 7fada34b1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad9c1028b0 0x7fad9c19e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.304+0000 7fada34b1640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c19e7b0 con 0x7fad9c100d00 2024-01-31T05:10:50.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.304+0000 7fada34b1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c19e920 con 0x7fad9c101ef0 2024-01-31T05:10:50.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.304+0000 7fada34b1640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c19eae0 con 0x7fad9c1028b0 2024-01-31T05:10:50.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.304+0000 7fada124d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad9c100d00 0x7fad9c196ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.304+0000 7fada124d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad9c100d00 0x7fad9c196ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45268/0 (socket says 172.21.15.99:45268) 2024-01-31T05:10:50.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.304+0000 7fada124d640 1 -- 172.21.15.99:0/3301527958 learned_addr learned my addr 172.21.15.99:0/3301527958 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:50.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.305+0000 7fada1a4e640 1 --2- 172.21.15.99:0/3301527958 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad9c1028b0 0x7fad9c19e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.305+0000 7fada0a4c640 1 --2- 172.21.15.99:0/3301527958 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad9c101ef0 0x7fad9c1971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.305+0000 7fada124d640 1 -- 172.21.15.99:0/3301527958 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad9c1028b0 msgr2=0x7fad9c19e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:50.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.305+0000 7fada124d640 1 --2- 172.21.15.99:0/3301527958 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad9c1028b0 0x7fad9c19e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.305+0000 7fada124d640 1 -- 172.21.15.99:0/3301527958 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad9c101ef0 msgr2=0x7fad9c1971e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:50.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.305+0000 7fada124d640 1 --2- 172.21.15.99:0/3301527958 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad9c101ef0 0x7fad9c1971e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.305+0000 7fada124d640 1 -- 172.21.15.99:0/3301527958 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad8c009560 con 0x7fad9c100d00 2024-01-31T05:10:50.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.305+0000 7fada124d640 1 --2- 172.21.15.99:0/3301527958 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad9c100d00 0x7fad9c196ca0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fad9800e9c0 tx=0x7fad9800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:50.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.305+0000 7fad927fc640 1 -- 172.21.15.99:0/3301527958 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad98009700 con 0x7fad9c100d00 2024-01-31T05:10:50.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.305+0000 7fad927fc640 1 -- 172.21.15.99:0/3301527958 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fad980044e0 con 0x7fad9c100d00 2024-01-31T05:10:50.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.305+0000 7fada34b1640 1 -- 172.21.15.99:0/3301527958 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad9c19edc0 con 0x7fad9c100d00 2024-01-31T05:10:50.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.305+0000 7fad927fc640 1 -- 172.21.15.99:0/3301527958 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad98010430 con 0x7fad9c100d00 2024-01-31T05:10:50.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.305+0000 7fada34b1640 1 -- 172.21.15.99:0/3301527958 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad9c19f250 con 0x7fad9c100d00 2024-01-31T05:10:50.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.308+0000 7fad927fc640 1 -- 172.21.15.99:0/3301527958 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 135946+0+0 (secure 0 0 0) 0x7fad98003f60 con 0x7fad9c100d00 2024-01-31T05:10:50.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.308+0000 7fada627c740 1 Processor -- start 2024-01-31T05:10:50.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.308+0000 7fada627c740 1 -- start start 2024-01-31T05:10:50.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.308+0000 7fada627c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c3a24b670 0x557c3a24ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.308+0000 7fada627c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557c3a24c060 0x557c3a250b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.308+0000 7fada627c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557c3a2511d0 0x557c3a253660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.308+0000 7fada627c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c3a1ba000 con 0x557c3a2511d0 2024-01-31T05:10:50.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.308+0000 7fada627c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c3a1b76f0 con 0x557c3a24b670 2024-01-31T05:10:50.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.308+0000 7fada627c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c3a1b2fe0 con 0x557c3a24c060 2024-01-31T05:10:50.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.308+0000 7fad927fc640 1 --2- 172.21.15.99:0/3301527958 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fad880a13f0 0x7fad880a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.309+0000 7fada0a4c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557c3a2511d0 0x557c3a253660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.309+0000 7fada0a4c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557c3a2511d0 0x557c3a253660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45272/0 (socket says 172.21.15.99:45272) 2024-01-31T05:10:50.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.309+0000 7fada0a4c640 1 -- 172.21.15.99:0/1214280124 learned_addr learned my addr 172.21.15.99:0/1214280124 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:50.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.309+0000 7fada1a4e640 1 --2- 172.21.15.99:0/3301527958 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fad880a13f0 0x7fad880a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.309+0000 7fad927fc640 1 -- 172.21.15.99:0/3301527958 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fad98014070 con 0x7fad9c100d00 2024-01-31T05:10:50.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.309+0000 7fada124d640 1 --2- 172.21.15.99:0/1214280124 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557c3a24c060 0x557c3a250b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.309+0000 7fada1a4e640 1 --2- 172.21.15.99:0/1214280124 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c3a24b670 0x557c3a24ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.309+0000 7fada0a4c640 1 -- 172.21.15.99:0/1214280124 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557c3a24c060 msgr2=0x557c3a250b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:10:50.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.309+0000 7fada0a4c640 1 --2- 172.21.15.99:0/1214280124 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557c3a24c060 0x557c3a250b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.309+0000 7fada0a4c640 1 -- 172.21.15.99:0/1214280124 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c3a24b670 msgr2=0x557c3a24ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:10:50.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.309+0000 7fada0a4c640 1 --2- 172.21.15.99:0/1214280124 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c3a24b670 0x557c3a24ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.309+0000 7fada0a4c640 1 -- 172.21.15.99:0/1214280124 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c3a175650 con 0x557c3a2511d0 2024-01-31T05:10:50.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.309+0000 7fada1a4e640 1 --2- 172.21.15.99:0/3301527958 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fad880a13f0 0x7fad880a38b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fad94005fd0 tx=0x7fad94012a30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:50.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.309+0000 7fada0a4c640 1 --2- 172.21.15.99:0/1214280124 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557c3a2511d0 0x557c3a253660 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fad8c02c610 tx=0x7fad8c005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49b0724f97810baa server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:50.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.309+0000 7fad877fe640 1 -- 172.21.15.99:0/1214280124 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c02ca80 con 0x557c3a2511d0 2024-01-31T05:10:50.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.309+0000 7fad877fe640 1 -- 172.21.15.99:0/1214280124 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fad8c02cbe0 con 0x557c3a2511d0 2024-01-31T05:10:50.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.309+0000 7fad877fe640 1 -- 172.21.15.99:0/1214280124 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c0052f0 con 0x557c3a2511d0 2024-01-31T05:10:50.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.310+0000 7fada627c740 1 -- 172.21.15.99:0/1214280124 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557c3a2511d0 msgr2=0x557c3a253660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:50.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.310+0000 7fada627c740 1 --2- 172.21.15.99:0/1214280124 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557c3a2511d0 0x557c3a253660 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fad8c02c610 tx=0x7fad8c005e50 comp rx=0 tx=0).stop 2024-01-31T05:10:50.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.310+0000 7fada627c740 1 -- 172.21.15.99:0/1214280124 shutdown_connections 2024-01-31T05:10:50.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.310+0000 7fada627c740 1 --2- 172.21.15.99:0/1214280124 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557c3a2511d0 0x557c3a253660 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.310+0000 7fada627c740 1 --2- 172.21.15.99:0/1214280124 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557c3a24c060 0x557c3a250b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.310+0000 7fada627c740 1 --2- 172.21.15.99:0/1214280124 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c3a24b670 0x557c3a24ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.310+0000 7fada627c740 1 -- 172.21.15.99:0/1214280124 >> 172.21.15.99:0/1214280124 conn(0x557c3a246be0 msgr2=0x557c3a246fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:50.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.310+0000 7fada627c740 1 -- 172.21.15.99:0/1214280124 shutdown_connections 2024-01-31T05:10:50.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.310+0000 7fada627c740 1 -- 172.21.15.99:0/1214280124 wait complete. 2024-01-31T05:10:50.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.310+0000 7fada627c740 1 -- start start 2024-01-31T05:10:50.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.310+0000 7fada627c740 1 Processor -- start 2024-01-31T05:10:50.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.311+0000 7fada627c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c3a24b670 0x557c3a2557a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.311+0000 7fada627c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557c3a24c060 0x557c3a255ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.311+0000 7fada627c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557c3a2511d0 0x557c3a25cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.311+0000 7fada627c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c3a16c5c0 con 0x557c3a24c060 2024-01-31T05:10:50.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.311+0000 7fada627c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c3a16c260 con 0x557c3a24b670 2024-01-31T05:10:50.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.311+0000 7fada627c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c3a1312d0 con 0x557c3a2511d0 2024-01-31T05:10:50.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.311+0000 7fada627c740 10 client.0 _ll_register_callbacks cb 0x557c3a167230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:10:50.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.311+0000 7fada0a4c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557c3a24c060 0x557c3a255ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.311+0000 7fada0a4c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557c3a24c060 0x557c3a255ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45278/0 (socket says 172.21.15.99:45278) 2024-01-31T05:10:50.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.311+0000 7fada0a4c640 1 -- 172.21.15.99:0/2679086082 learned_addr learned my addr 172.21.15.99:0/2679086082 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:50.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.311+0000 7fada124d640 1 --2- 172.21.15.99:0/2679086082 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c3a24b670 0x557c3a2557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.311+0000 7fada0a4c640 1 -- 172.21.15.99:0/2679086082 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557c3a2511d0 msgr2=0x557c3a25cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:10:50.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.311+0000 7fada0a4c640 1 --2- 172.21.15.99:0/2679086082 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557c3a2511d0 0x557c3a25cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.311+0000 7fada0a4c640 1 -- 172.21.15.99:0/2679086082 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c3a24b670 msgr2=0x557c3a2557a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:10:50.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.311+0000 7fada0a4c640 1 --2- 172.21.15.99:0/2679086082 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c3a24b670 0x557c3a2557a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.311+0000 7fada0a4c640 1 -- 172.21.15.99:0/2679086082 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad9c109a40 con 0x557c3a24c060 2024-01-31T05:10:50.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.311+0000 7fada124d640 1 --2- 172.21.15.99:0/2679086082 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c3a24b670 0x557c3a2557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:10:50.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.311+0000 7fada0a4c640 1 --2- 172.21.15.99:0/2679086082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557c3a24c060 0x557c3a255ce0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fad8c02c7e0 tx=0x7fad8c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f721f575d07274a server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:50.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.311+0000 7fad84ff9640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:10:50.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.311+0000 7fad84ff9640 1 -- 172.21.15.99:0/2679086082 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c005480 con 0x557c3a24c060 2024-01-31T05:10:50.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.311+0000 7fada627c740 1 -- 172.21.15.99:0/2679086082 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557c3a1abe70 con 0x557c3a24c060 2024-01-31T05:10:50.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.311+0000 7fad84ff9640 1 -- 172.21.15.99:0/2679086082 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fad8c02ce40 con 0x557c3a24c060 2024-01-31T05:10:50.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.312+0000 7fad84ff9640 1 -- 172.21.15.99:0/2679086082 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fad8c004af0 con 0x557c3a24c060 2024-01-31T05:10:50.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.312+0000 7fada627c740 10 client.15105 fetch_fsmap learned FSMap version 26 2024-01-31T05:10:50.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.312+0000 7fada627c740 1 -- 172.21.15.99:0/2679086082 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x557c3a1b1660 con 0x557c3a24c060 2024-01-31T05:10:50.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.312+0000 7fad84ff9640 1 -- 172.21.15.99:0/2679086082 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557c3a1abe70 con 0x557c3a24c060 2024-01-31T05:10:50.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.312+0000 7fad84ff9640 1 -- 172.21.15.99:0/2679086082 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fad8c03c040 con 0x557c3a24c060 2024-01-31T05:10:50.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.312+0000 7fada627c740 10 client.15105 fetch_fsmap finished waiting for FSMap version 26 2024-01-31T05:10:50.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.312+0000 7fada627c740 10 client.15105 resolve_mds: resolved name 'b' to daemon mds.b 2024-01-31T05:10:50.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.312+0000 7fada627c740 20 client.15105 populate_metadata read hostname 'smithi099' 2024-01-31T05:10:50.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.312+0000 7fada627c740 1 --2- 172.21.15.99:0/2679086082 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x557c3a2625b0 0x557c3a261210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.312+0000 7fada627c740 4 client.15105 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:10:50.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.312+0000 7fada627c740 1 -- 172.21.15.99:0/2679086082 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557c3a1abb90 con 0x557c3a2625b0 2024-01-31T05:10:50.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.312+0000 7fada124d640 1 --2- 172.21.15.99:0/2679086082 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x557c3a2625b0 0x557c3a261210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.313+0000 7fad84ff9640 10 client.15105 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:10:50.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.313+0000 7fada124d640 1 --2- 172.21.15.99:0/2679086082 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x557c3a2625b0 0x557c3a261210 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64305b8334d02be1 server_cookie=7901cf2ae78aa7cc in_seq=0 out_seq=0 2024-01-31T05:10:50.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.313+0000 7fad84ff9640 1 -- 172.21.15.99:0/2679086082 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557c3a1abb90 con 0x557c3a2625b0 2024-01-31T05:10:50.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.313+0000 7fad84ff9640 10 client.15105 handle_command_reply: tid=0 2024-01-31T05:10:50.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.313+0000 7fada627c740 1 client.15105 shutdown 2024-01-31T05:10:50.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.313+0000 7fada627c740 1 -- 172.21.15.99:0/2679086082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557c3a24c060 msgr2=0x557c3a255ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:50.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.313+0000 7fada627c740 1 --2- 172.21.15.99:0/2679086082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557c3a24c060 0x557c3a255ce0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fad8c02c7e0 tx=0x7fad8c000bc0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.313+0000 7fada627c740 1 -- 172.21.15.99:0/2679086082 shutdown_connections 2024-01-31T05:10:50.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.313+0000 7fada627c740 1 --2- 172.21.15.99:0/2679086082 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557c3a2511d0 0x557c3a25cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.313+0000 7fada627c740 1 --2- 172.21.15.99:0/2679086082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557c3a24c060 0x557c3a255ce0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.313+0000 7fada627c740 1 --2- 172.21.15.99:0/2679086082 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x557c3a2625b0 0x557c3a261210 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.313+0000 7fada627c740 1 --2- 172.21.15.99:0/2679086082 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c3a24b670 0x557c3a2557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.313+0000 7fad84ff9640 0 client.15105 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:10:50.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.313+0000 7fada627c740 1 -- 172.21.15.99:0/2679086082 >> 172.21.15.99:0/2679086082 conn(0x557c3a246be0 msgr2=0x557c3a245d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:50.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.314+0000 7fada627c740 1 -- 172.21.15.99:0/2679086082 shutdown_connections 2024-01-31T05:10:50.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.314+0000 7fada627c740 1 -- 172.21.15.99:0/2679086082 wait complete. 2024-01-31T05:10:50.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.314+0000 7fada627c740 20 client.15105 trim_cache size 0 max 16384 2024-01-31T05:10:50.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.329+0000 7fada627c740 1 Processor -- start 2024-01-31T05:10:50.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.329+0000 7fada627c740 1 -- start start 2024-01-31T05:10:50.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.329+0000 7fada627c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557c3a24b670 0x557c3a24d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.329+0000 7fada627c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557c3a24c060 0x557c3a24da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.329+0000 7fada627c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c3a2511d0 0x557c3a261210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.329+0000 7fada627c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c3a254570 con 0x557c3a24b670 2024-01-31T05:10:50.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.329+0000 7fada627c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c3a25dbd0 con 0x557c3a2511d0 2024-01-31T05:10:50.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.329+0000 7fada627c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c3a254cc0 con 0x557c3a24c060 2024-01-31T05:10:50.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.329+0000 7fada124d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557c3a24b670 0x557c3a24d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.329+0000 7fada124d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557c3a24b670 0x557c3a24d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45290/0 (socket says 172.21.15.99:45290) 2024-01-31T05:10:50.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.329+0000 7fada124d640 1 -- 172.21.15.99:0/651386366 learned_addr learned my addr 172.21.15.99:0/651386366 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:50.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.329+0000 7fada1a4e640 1 --2- 172.21.15.99:0/651386366 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c3a2511d0 0x557c3a261210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.329+0000 7fada124d640 1 -- 172.21.15.99:0/651386366 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557c3a24c060 msgr2=0x557c3a24da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:10:50.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.329+0000 7fada124d640 1 --2- 172.21.15.99:0/651386366 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557c3a24c060 0x557c3a24da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.329+0000 7fada124d640 1 -- 172.21.15.99:0/651386366 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c3a2511d0 msgr2=0x557c3a261210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:10:50.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.329+0000 7fada124d640 1 --2- 172.21.15.99:0/651386366 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c3a2511d0 0x557c3a261210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.329+0000 7fada124d640 1 -- 172.21.15.99:0/651386366 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c3a14e360 con 0x557c3a24b670 2024-01-31T05:10:50.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.329+0000 7fada1a4e640 1 --2- 172.21.15.99:0/651386366 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c3a2511d0 0x557c3a261210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:10:50.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.329+0000 7fada124d640 1 --2- 172.21.15.99:0/651386366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557c3a24b670 0x557c3a24d4e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fad980966c0 tx=0x7fad98094be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88c820cff2a643f9 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:50.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.330+0000 7fad86ffd640 1 -- 172.21.15.99:0/651386366 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9800cd80 con 0x557c3a24b670 2024-01-31T05:10:50.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.330+0000 7fad86ffd640 1 -- 172.21.15.99:0/651386366 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fad98065c20 con 0x557c3a24b670 2024-01-31T05:10:50.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.330+0000 7fad86ffd640 1 -- 172.21.15.99:0/651386366 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad980035f0 con 0x557c3a24b670 2024-01-31T05:10:50.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.330+0000 7fada627c740 1 -- 172.21.15.99:0/651386366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557c3a24b670 msgr2=0x557c3a24d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:50.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.330+0000 7fada627c740 1 --2- 172.21.15.99:0/651386366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557c3a24b670 0x557c3a24d4e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fad980966c0 tx=0x7fad98094be0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.330+0000 7fada627c740 1 -- 172.21.15.99:0/651386366 shutdown_connections 2024-01-31T05:10:50.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.330+0000 7fada627c740 1 --2- 172.21.15.99:0/651386366 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c3a2511d0 0x557c3a261210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.330+0000 7fada627c740 1 --2- 172.21.15.99:0/651386366 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557c3a24c060 0x557c3a24da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.330+0000 7fada627c740 1 --2- 172.21.15.99:0/651386366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557c3a24b670 0x557c3a24d4e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.330+0000 7fada627c740 1 -- 172.21.15.99:0/651386366 >> 172.21.15.99:0/651386366 conn(0x557c3a246be0 msgr2=0x557c3a269d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:50.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.330+0000 7fada627c740 1 -- 172.21.15.99:0/651386366 shutdown_connections 2024-01-31T05:10:50.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.330+0000 7fada627c740 1 -- 172.21.15.99:0/651386366 wait complete. 2024-01-31T05:10:50.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.330+0000 7fada627c740 1 -- start start 2024-01-31T05:10:50.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.331+0000 7fada627c740 1 Processor -- start 2024-01-31T05:10:50.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.331+0000 7fada627c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557c3a24b670 0x557c3a2b4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.331+0000 7fada627c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557c3a24c060 0x557c3a2b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.331+0000 7fada627c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c3a2511d0 0x557c3a2bb930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.331+0000 7fada627c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c3a247520 con 0x557c3a24c060 2024-01-31T05:10:50.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.331+0000 7fada627c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c3a2bbe70 con 0x557c3a2511d0 2024-01-31T05:10:50.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.331+0000 7fada627c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c3a2bc000 con 0x557c3a24b670 2024-01-31T05:10:50.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.331+0000 7fada627c740 10 client.0 _ll_register_callbacks cb 0x7fad98005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:10:50.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.331+0000 7fada0a4c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557c3a24c060 0x557c3a2b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.331+0000 7fada0a4c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557c3a24c060 0x557c3a2b4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45298/0 (socket says 172.21.15.99:45298) 2024-01-31T05:10:50.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.331+0000 7fada0a4c640 1 -- 172.21.15.99:0/2955812240 learned_addr learned my addr 172.21.15.99:0/2955812240 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:50.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.331+0000 7fada124d640 1 --2- 172.21.15.99:0/2955812240 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557c3a24b670 0x557c3a2b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.331+0000 7fada1a4e640 1 --2- 172.21.15.99:0/2955812240 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c3a2511d0 0x557c3a2bb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.331+0000 7fada0a4c640 1 -- 172.21.15.99:0/2955812240 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557c3a24b670 msgr2=0x557c3a2b4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:10:50.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.331+0000 7fada0a4c640 1 --2- 172.21.15.99:0/2955812240 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557c3a24b670 0x557c3a2b4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.331+0000 7fada0a4c640 1 -- 172.21.15.99:0/2955812240 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c3a2511d0 msgr2=0x557c3a2bb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:10:50.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.331+0000 7fada0a4c640 1 --2- 172.21.15.99:0/2955812240 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c3a2511d0 0x557c3a2bb930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.331+0000 7fada0a4c640 1 -- 172.21.15.99:0/2955812240 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad9c19f250 con 0x557c3a24c060 2024-01-31T05:10:50.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.331+0000 7fada1a4e640 1 --2- 172.21.15.99:0/2955812240 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c3a2511d0 0x557c3a2bb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:10:50.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.331+0000 7fada0a4c640 1 --2- 172.21.15.99:0/2955812240 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557c3a24c060 0x557c3a2b4cb0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fad8c02cd70 tx=0x7fad8c004b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f4b37580911b16e server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:50.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.331+0000 7fad84ff9640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:10:50.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.332+0000 7fad84ff9640 1 -- 172.21.15.99:0/2955812240 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c05f070 con 0x557c3a24c060 2024-01-31T05:10:50.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.332+0000 7fad84ff9640 1 -- 172.21.15.99:0/2955812240 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fad8c02ce40 con 0x557c3a24c060 2024-01-31T05:10:50.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.332+0000 7fada627c740 1 -- 172.21.15.99:0/2955812240 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557c3a262f80 con 0x557c3a24c060 2024-01-31T05:10:50.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.332+0000 7fad84ff9640 1 -- 172.21.15.99:0/2955812240 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fad8c02c2b0 con 0x557c3a24c060 2024-01-31T05:10:50.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.332+0000 7fada627c740 10 client.15111 fetch_fsmap learned FSMap version 26 2024-01-31T05:10:50.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.332+0000 7fada627c740 1 -- 172.21.15.99:0/2955812240 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x557c3a173eb0 con 0x557c3a24c060 2024-01-31T05:10:50.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.332+0000 7fad84ff9640 1 -- 172.21.15.99:0/2955812240 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fad8c06a020 con 0x557c3a24c060 2024-01-31T05:10:50.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.332+0000 7fad84ff9640 1 -- 172.21.15.99:0/2955812240 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fad8c062020 con 0x557c3a24c060 2024-01-31T05:10:50.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.332+0000 7fada627c740 10 client.15111 fetch_fsmap finished waiting for FSMap version 26 2024-01-31T05:10:50.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.332+0000 7fada627c740 10 client.15111 resolve_mds: resolved name 'b' to daemon mds.b 2024-01-31T05:10:50.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.332+0000 7fada627c740 20 client.15111 populate_metadata read hostname 'smithi099' 2024-01-31T05:10:50.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.332+0000 7fada627c740 1 --2- 172.21.15.99:0/2955812240 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x557c3a2c0ea0 0x557c3a2bd380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:50.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.332+0000 7fada627c740 4 client.15111 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-31T05:10:50.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.332+0000 7fada627c740 1 -- 172.21.15.99:0/2955812240 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557c3a2622c0 con 0x557c3a2c0ea0 2024-01-31T05:10:50.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.332+0000 7fada124d640 1 --2- 172.21.15.99:0/2955812240 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x557c3a2c0ea0 0x557c3a2bd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:50.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.333+0000 7fad84ff9640 10 client.15111 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:10:50.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.333+0000 7fada124d640 1 --2- 172.21.15.99:0/2955812240 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x557c3a2c0ea0 0x557c3a2bd380 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d35da95e06c4090 server_cookie=ceb0aeeba8987713 in_seq=0 out_seq=0 2024-01-31T05:10:50.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.333+0000 7fad84ff9640 1 -- 172.21.15.99:0/2955812240 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x557c3a2622c0 con 0x557c3a2c0ea0 2024-01-31T05:10:50.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.333+0000 7fad84ff9640 10 client.15111 handle_command_reply: tid=0 2024-01-31T05:10:50.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.333+0000 7fada627c740 1 client.15111 shutdown 2024-01-31T05:10:50.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.333+0000 7fada627c740 1 -- 172.21.15.99:0/2955812240 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557c3a24c060 msgr2=0x557c3a2b4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:50.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.333+0000 7fada627c740 1 --2- 172.21.15.99:0/2955812240 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557c3a24c060 0x557c3a2b4cb0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fad8c02cd70 tx=0x7fad8c004b80 comp rx=0 tx=0).stop 2024-01-31T05:10:50.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.333+0000 7fada627c740 1 -- 172.21.15.99:0/2955812240 shutdown_connections 2024-01-31T05:10:50.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.333+0000 7fada627c740 1 --2- 172.21.15.99:0/2955812240 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x557c3a2c0ea0 0x557c3a2bd380 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.333+0000 7fada627c740 1 --2- 172.21.15.99:0/2955812240 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c3a2511d0 0x557c3a2bb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.333+0000 7fada627c740 1 --2- 172.21.15.99:0/2955812240 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557c3a24c060 0x557c3a2b4cb0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.333+0000 7fada627c740 1 --2- 172.21.15.99:0/2955812240 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557c3a24b670 0x557c3a2b4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.333+0000 7fada627c740 1 -- 172.21.15.99:0/2955812240 >> 172.21.15.99:0/2955812240 conn(0x557c3a246be0 msgr2=0x557c3a24d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:50.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.333+0000 7fad84ff9640 0 client.15111 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:10:50.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.333+0000 7fada627c740 1 -- 172.21.15.99:0/2955812240 shutdown_connections 2024-01-31T05:10:50.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.333+0000 7fada627c740 1 -- 172.21.15.99:0/2955812240 wait complete. 2024-01-31T05:10:50.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.333+0000 7fada627c740 20 client.15111 trim_cache size 0 max 16384 2024-01-31T05:10:50.346 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-01-31T05:10:50.346 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_fsid": "9288ff44-bff5-11ee-95b3-87774f69a715", 2024-01-31T05:10:50.346 INFO:teuthology.orchestra.run.smithi099.stdout: "whoami": 0, 2024-01-31T05:10:50.346 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 24497, 2024-01-31T05:10:50.346 INFO:teuthology.orchestra.run.smithi099.stdout: "want_state": "up:active", 2024-01-31T05:10:50.346 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "up:active", 2024-01-31T05:10:50.346 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "cephfs", 2024-01-31T05:10:50.346 INFO:teuthology.orchestra.run.smithi099.stdout: "rank_uptime": 88.769235653999999, 2024-01-31T05:10:50.346 INFO:teuthology.orchestra.run.smithi099.stdout: "mdsmap_epoch": 26, 2024-01-31T05:10:50.347 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch": 88, 2024-01-31T05:10:50.347 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch_barrier": 86, 2024-01-31T05:10:50.347 INFO:teuthology.orchestra.run.smithi099.stdout: "uptime": 94.344576372999995 2024-01-31T05:10:50.347 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-01-31T05:10:50.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.334+0000 7fada34b1640 1 -- 172.21.15.99:0/3301527958 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fad880a13f0 msgr2=0x7fad880a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:50.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.334+0000 7fada34b1640 1 --2- 172.21.15.99:0/3301527958 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fad880a13f0 0x7fad880a38b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fad94005fd0 tx=0x7fad94012a30 comp rx=0 tx=0).stop 2024-01-31T05:10:50.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.334+0000 7fada34b1640 1 -- 172.21.15.99:0/3301527958 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad9c100d00 msgr2=0x7fad9c196ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:50.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.334+0000 7fada34b1640 1 --2- 172.21.15.99:0/3301527958 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad9c100d00 0x7fad9c196ca0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fad9800e9c0 tx=0x7fad9800ee80 comp rx=0 tx=0).stop 2024-01-31T05:10:50.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.334+0000 7fada34b1640 1 -- 172.21.15.99:0/3301527958 shutdown_connections 2024-01-31T05:10:50.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.334+0000 7fada34b1640 1 --2- 172.21.15.99:0/3301527958 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fad880a13f0 0x7fad880a38b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.334+0000 7fada34b1640 1 --2- 172.21.15.99:0/3301527958 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad9c1028b0 0x7fad9c19e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.334+0000 7fada34b1640 1 --2- 172.21.15.99:0/3301527958 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad9c101ef0 0x7fad9c1971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.334+0000 7fada34b1640 1 --2- 172.21.15.99:0/3301527958 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad9c100d00 0x7fad9c196ca0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:50.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.334+0000 7fada34b1640 1 -- 172.21.15.99:0/3301527958 >> 172.21.15.99:0/3301527958 conn(0x7fad9c0fc290 msgr2=0x7fad9c1052e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:50.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.334+0000 7fada34b1640 1 -- 172.21.15.99:0/3301527958 shutdown_connections 2024-01-31T05:10:50.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:50.334+0000 7fada34b1640 1 -- 172.21.15.99:0/3301527958 wait complete. 2024-01-31T05:10:50.349 INFO:tasks.cephadm:Setup complete, yielding 2024-01-31T05:10:50.350 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-01-31T05:10:50.359 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi099.front.sepia.ceph.com 2024-01-31T05:10:50.359 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- bash -c 'ceph orch status' 2024-01-31T05:10:50.605 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:10:51.952 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:51 smithi099 ceph-mon[31615]: pgmap v333: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-01-31T05:10:52.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:51 smithi181 ceph-mon[36434]: pgmap v333: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-01-31T05:10:52.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:51 smithi179 ceph-mon[35652]: pgmap v333: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-01-31T05:10:52.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.301+0000 7fb544665700 1 -- 172.21.15.99:0/3364882940 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb53c104c70 msgr2=0x7fb53c107060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:52.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.301+0000 7fb544665700 1 --2- 172.21.15.99:0/3364882940 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb53c104c70 0x7fb53c107060 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb538009990 tx=0x7fb538009ca0 comp rx=0 tx=0).stop 2024-01-31T05:10:52.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.301+0000 7fb544665700 1 -- 172.21.15.99:0/3364882940 shutdown_connections 2024-01-31T05:10:52.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.301+0000 7fb544665700 1 --2- 172.21.15.99:0/3364882940 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb53c1075a0 0x7fb53c109990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:52.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.301+0000 7fb544665700 1 --2- 172.21.15.99:0/3364882940 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb53c102340 0x7fb53c104730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:52.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.301+0000 7fb544665700 1 --2- 172.21.15.99:0/3364882940 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb53c104c70 0x7fb53c107060 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:52.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.301+0000 7fb544665700 1 -- 172.21.15.99:0/3364882940 >> 172.21.15.99:0/3364882940 conn(0x7fb53c0fbcb0 msgr2=0x7fb53c0fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:52.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.301+0000 7fb544665700 1 -- 172.21.15.99:0/3364882940 shutdown_connections 2024-01-31T05:10:52.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.301+0000 7fb544665700 1 -- 172.21.15.99:0/3364882940 wait complete. 2024-01-31T05:10:52.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.302+0000 7fb544665700 1 Processor -- start 2024-01-31T05:10:52.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.302+0000 7fb544665700 1 -- start start 2024-01-31T05:10:52.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.302+0000 7fb544665700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb53c102340 0x7fb53c197770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:52.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.302+0000 7fb544665700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb53c104c70 0x7fb53c197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:52.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.302+0000 7fb544665700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb53c1075a0 0x7fb53c19ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:52.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.302+0000 7fb544665700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c19f2b0 con 0x7fb53c102340 2024-01-31T05:10:52.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.302+0000 7fb544665700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c19f3f0 con 0x7fb53c1075a0 2024-01-31T05:10:52.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.302+0000 7fb544665700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c19f580 con 0x7fb53c104c70 2024-01-31T05:10:52.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.302+0000 7fb542401700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb53c102340 0x7fb53c197770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:52.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.302+0000 7fb542401700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb53c102340 0x7fb53c197770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45322/0 (socket says 172.21.15.99:45322) 2024-01-31T05:10:52.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.302+0000 7fb542401700 1 -- 172.21.15.99:0/1060081106 learned_addr learned my addr 172.21.15.99:0/1060081106 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:52.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.302+0000 7fb541c00700 1 --2- 172.21.15.99:0/1060081106 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb53c104c70 0x7fb53c197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:52.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.303+0000 7fb542c02700 1 --2- 172.21.15.99:0/1060081106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb53c1075a0 0x7fb53c19ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:52.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.303+0000 7fb542401700 1 -- 172.21.15.99:0/1060081106 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb53c104c70 msgr2=0x7fb53c197cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:52.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.303+0000 7fb542401700 1 --2- 172.21.15.99:0/1060081106 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb53c104c70 0x7fb53c197cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:52.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.303+0000 7fb542401700 1 -- 172.21.15.99:0/1060081106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb53c1075a0 msgr2=0x7fb53c19ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:52.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.303+0000 7fb542401700 1 --2- 172.21.15.99:0/1060081106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb53c1075a0 0x7fb53c19ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:52.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.303+0000 7fb542401700 1 -- 172.21.15.99:0/1060081106 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5380095f0 con 0x7fb53c102340 2024-01-31T05:10:52.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.303+0000 7fb542401700 1 --2- 172.21.15.99:0/1060081106 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb53c102340 0x7fb53c197770 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb534007ee0 tx=0x7fb53400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:52.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.303+0000 7fb5337fe700 1 -- 172.21.15.99:0/1060081106 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53400ddd0 con 0x7fb53c102340 2024-01-31T05:10:52.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.303+0000 7fb5337fe700 1 -- 172.21.15.99:0/1060081106 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb53400f040 con 0x7fb53c102340 2024-01-31T05:10:52.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.303+0000 7fb5337fe700 1 -- 172.21.15.99:0/1060081106 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb534014690 con 0x7fb53c102340 2024-01-31T05:10:52.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.303+0000 7fb544665700 1 -- 172.21.15.99:0/1060081106 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb53c19f860 con 0x7fb53c102340 2024-01-31T05:10:52.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.303+0000 7fb544665700 1 -- 172.21.15.99:0/1060081106 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb53c19fd60 con 0x7fb53c102340 2024-01-31T05:10:52.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.304+0000 7fb544665700 1 -- 172.21.15.99:0/1060081106 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb53c0fd830 con 0x7fb53c102340 2024-01-31T05:10:52.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.305+0000 7fb5337fe700 1 -- 172.21.15.99:0/1060081106 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) v1 ==== 135895+0+0 (secure 0 0 0) 0x7fb5340159c0 con 0x7fb53c102340 2024-01-31T05:10:52.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.306+0000 7fb5337fe700 1 --2- 172.21.15.99:0/1060081106 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb5240a1370 0x7fb5240a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:52.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.306+0000 7fb541c00700 1 --2- 172.21.15.99:0/1060081106 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb5240a1370 0x7fb5240a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:52.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.306+0000 7fb5337fe700 1 -- 172.21.15.99:0/1060081106 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fb5340cc450 con 0x7fb53c102340 2024-01-31T05:10:52.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.306+0000 7fb541c00700 1 --2- 172.21.15.99:0/1060081106 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb5240a1370 0x7fb5240a3830 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb5380036c0 tx=0x7fb538005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:52.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.310+0000 7fb5337fe700 1 -- 172.21.15.99:0/1060081106 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fb534095990 con 0x7fb53c102340 2024-01-31T05:10:52.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.517+0000 7fb544665700 1 -- 172.21.15.99:0/1060081106 --> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb53c02d570 con 0x7fb5240a1370 2024-01-31T05:10:52.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.518+0000 7fb5337fe700 1 -- 172.21.15.99:0/1060081106 <== mgr.14152 v2:172.21.15.99:6800/3925720924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fb53c02d570 con 0x7fb5240a1370 2024-01-31T05:10:52.518 INFO:teuthology.orchestra.run.smithi099.stdout:Backend: cephadm 2024-01-31T05:10:52.518 INFO:teuthology.orchestra.run.smithi099.stdout:Available: Yes 2024-01-31T05:10:52.518 INFO:teuthology.orchestra.run.smithi099.stdout:Paused: No 2024-01-31T05:10:52.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.520+0000 7fb544665700 1 -- 172.21.15.99:0/1060081106 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb5240a1370 msgr2=0x7fb5240a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:52.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.520+0000 7fb544665700 1 --2- 172.21.15.99:0/1060081106 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb5240a1370 0x7fb5240a3830 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb5380036c0 tx=0x7fb538005fb0 comp rx=0 tx=0).stop 2024-01-31T05:10:52.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.520+0000 7fb544665700 1 -- 172.21.15.99:0/1060081106 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb53c102340 msgr2=0x7fb53c197770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:52.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.520+0000 7fb544665700 1 --2- 172.21.15.99:0/1060081106 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb53c102340 0x7fb53c197770 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb534007ee0 tx=0x7fb53400d3b0 comp rx=0 tx=0).stop 2024-01-31T05:10:52.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.520+0000 7fb544665700 1 -- 172.21.15.99:0/1060081106 shutdown_connections 2024-01-31T05:10:52.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.520+0000 7fb544665700 1 --2- 172.21.15.99:0/1060081106 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb5240a1370 0x7fb5240a3830 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:52.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.520+0000 7fb544665700 1 --2- 172.21.15.99:0/1060081106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb53c1075a0 0x7fb53c19ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:52.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.520+0000 7fb544665700 1 --2- 172.21.15.99:0/1060081106 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb53c102340 0x7fb53c197770 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:52.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.520+0000 7fb544665700 1 --2- 172.21.15.99:0/1060081106 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb53c104c70 0x7fb53c197cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:52.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.520+0000 7fb544665700 1 -- 172.21.15.99:0/1060081106 >> 172.21.15.99:0/1060081106 conn(0x7fb53c0fbcb0 msgr2=0x7fb53c1041d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:52.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.520+0000 7fb544665700 1 -- 172.21.15.99:0/1060081106 shutdown_connections 2024-01-31T05:10:52.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:52.521+0000 7fb544665700 1 -- 172.21.15.99:0/1060081106 wait complete. 2024-01-31T05:10:53.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:52 smithi099 ceph-mon[31615]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-01-31T05:10:53.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:52 smithi181 ceph-mon[36434]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-01-31T05:10:53.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:52 smithi179 ceph-mon[35652]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-01-31T05:10:53.189 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- bash -c 'ceph orch ps' 2024-01-31T05:10:53.443 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:10:53.731 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:53 smithi099 ceph-mon[31615]: from='client.15117 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:10:53.731 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:53 smithi099 ceph-mon[31615]: pgmap v334: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-01-31T05:10:54.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:53 smithi181 ceph-mon[36434]: from='client.15117 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:10:54.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:53 smithi181 ceph-mon[36434]: pgmap v334: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-01-31T05:10:54.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:53 smithi179 ceph-mon[35652]: from='client.15117 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:10:54.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:53 smithi179 ceph-mon[35652]: pgmap v334: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-01-31T05:10:55.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.187+0000 7f5889d75700 1 -- 172.21.15.99:0/2714923512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5884101910 msgr2=0x7f5884101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:55.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.187+0000 7f5889d75700 1 --2- 172.21.15.99:0/2714923512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5884101910 0x7f5884101d70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f58780099c0 tx=0x7f5878009cd0 comp rx=0 tx=0).stop 2024-01-31T05:10:55.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.187+0000 7f5889d75700 1 -- 172.21.15.99:0/2714923512 shutdown_connections 2024-01-31T05:10:55.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.187+0000 7f5889d75700 1 --2- 172.21.15.99:0/2714923512 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58841022b0 0x7f5884108b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:55.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.187+0000 7f5889d75700 1 --2- 172.21.15.99:0/2714923512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5884100710 0x7f5884100b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:55.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.187+0000 7f5889d75700 1 --2- 172.21.15.99:0/2714923512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5884101910 0x7f5884101d70 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:55.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.187+0000 7f5889d75700 1 -- 172.21.15.99:0/2714923512 >> 172.21.15.99:0/2714923512 conn(0x7f58840fbcd0 msgr2=0x7f58840fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:55.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.187+0000 7f5889d75700 1 -- 172.21.15.99:0/2714923512 shutdown_connections 2024-01-31T05:10:55.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.187+0000 7f5889d75700 1 -- 172.21.15.99:0/2714923512 wait complete. 2024-01-31T05:10:55.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.187+0000 7f5889d75700 1 Processor -- start 2024-01-31T05:10:55.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.187+0000 7f5889d75700 1 -- start start 2024-01-31T05:10:55.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.188+0000 7f5889d75700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5884100710 0x7f5884196520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:55.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.188+0000 7f5889d75700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5884101910 0x7f5884196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:55.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.188+0000 7f5889d75700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58841022b0 0x7f588419dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:55.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.188+0000 7f5889d75700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f588419e0b0 con 0x7f5884101910 2024-01-31T05:10:55.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.188+0000 7f5889d75700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f588419e1f0 con 0x7f58841022b0 2024-01-31T05:10:55.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.188+0000 7f5889d75700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f588419e380 con 0x7f5884100710 2024-01-31T05:10:55.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.188+0000 7f5882ffd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5884101910 0x7f5884196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:55.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.188+0000 7f5882ffd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5884101910 0x7f5884196a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45346/0 (socket says 172.21.15.99:45346) 2024-01-31T05:10:55.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.188+0000 7f5882ffd700 1 -- 172.21.15.99:0/995526039 learned_addr learned my addr 172.21.15.99:0/995526039 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:55.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.188+0000 7f5883fff700 1 --2- 172.21.15.99:0/995526039 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58841022b0 0x7f588419dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:55.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.188+0000 7f58837fe700 1 --2- 172.21.15.99:0/995526039 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5884100710 0x7f5884196520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:55.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.188+0000 7f5882ffd700 1 -- 172.21.15.99:0/995526039 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5884100710 msgr2=0x7f5884196520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:55.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.188+0000 7f5882ffd700 1 --2- 172.21.15.99:0/995526039 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5884100710 0x7f5884196520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:55.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.188+0000 7f5882ffd700 1 -- 172.21.15.99:0/995526039 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58841022b0 msgr2=0x7f588419dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:55.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.188+0000 7f5882ffd700 1 --2- 172.21.15.99:0/995526039 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58841022b0 0x7f588419dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:55.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.188+0000 7f5882ffd700 1 -- 172.21.15.99:0/995526039 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58780095f0 con 0x7f5884101910 2024-01-31T05:10:55.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.188+0000 7f58837fe700 1 --2- 172.21.15.99:0/995526039 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5884100710 0x7f5884196520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:10:55.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.188+0000 7f5882ffd700 1 --2- 172.21.15.99:0/995526039 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5884101910 0x7f5884196a60 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f587800f690 tx=0x7f5878005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:55.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.188+0000 7f5880ff9700 1 -- 172.21.15.99:0/995526039 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587801d070 con 0x7f5884101910 2024-01-31T05:10:55.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.188+0000 7f5889d75700 1 -- 172.21.15.99:0/995526039 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f588419e600 con 0x7f5884101910 2024-01-31T05:10:55.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.188+0000 7f5880ff9700 1 -- 172.21.15.99:0/995526039 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f58780059a0 con 0x7f5884101910 2024-01-31T05:10:55.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.188+0000 7f5880ff9700 1 -- 172.21.15.99:0/995526039 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58780173f0 con 0x7f5884101910 2024-01-31T05:10:55.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.189+0000 7f5889d75700 1 -- 172.21.15.99:0/995526039 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f588419eaf0 con 0x7f5884101910 2024-01-31T05:10:55.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.189+0000 7f5889d75700 1 -- 172.21.15.99:0/995526039 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5884107ad0 con 0x7f5884101910 2024-01-31T05:10:55.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.190+0000 7f5880ff9700 1 -- 172.21.15.99:0/995526039 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f58780226e0 con 0x7f5884101910 2024-01-31T05:10:55.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.191+0000 7f5880ff9700 1 --2- 172.21.15.99:0/995526039 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f586c0a1370 0x7f586c0a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:55.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.191+0000 7f58837fe700 1 --2- 172.21.15.99:0/995526039 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f586c0a1370 0x7f586c0a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:55.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.191+0000 7f5880ff9700 1 -- 172.21.15.99:0/995526039 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f58780cdd10 con 0x7f5884101910 2024-01-31T05:10:55.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.191+0000 7f58837fe700 1 --2- 172.21.15.99:0/995526039 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f586c0a1370 0x7f586c0a3830 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5884101770 tx=0x7f5874009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:55.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.194+0000 7f5880ff9700 1 -- 172.21.15.99:0/995526039 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f58780972e0 con 0x7f5884101910 2024-01-31T05:10:55.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.404+0000 7f5889d75700 1 -- 172.21.15.99:0/995526039 --> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f588402d4a0 con 0x7f586c0a1370 2024-01-31T05:10:55.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.418+0000 7f5880ff9700 1 -- 172.21.15.99:0/995526039 <== mgr.14152 v2:172.21.15.99:6800/3925720924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4154 (secure 0 0 0) 0x7f588402d4a0 con 0x7f586c0a1370 2024-01-31T05:10:55.418 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-01-31T05:10:55.418 INFO:teuthology.orchestra.run.smithi099.stdout:mds.a smithi099 running (102s) 17s ago 102s 18.2M - 19.0.0-885-g661946e7 0b5dc47a38d7 f5357530e711 2024-01-31T05:10:55.418 INFO:teuthology.orchestra.run.smithi099.stdout:mds.b smithi179 running (99s) 33s ago 99s 27.9M - 19.0.0-885-g661946e7 0b5dc47a38d7 95f2ec3f19ea 2024-01-31T05:10:55.418 INFO:teuthology.orchestra.run.smithi099.stdout:mds.c smithi181 running (113s) 33s ago 113s 19.4M - 19.0.0-885-g661946e7 0b5dc47a38d7 f7610ed57c6d 2024-01-31T05:10:55.418 INFO:teuthology.orchestra.run.smithi099.stdout:mds.d smithi099 running (2m) 17s ago 2m 15.3M - 19.0.0-885-g661946e7 0b5dc47a38d7 fd036ce99dc8 2024-01-31T05:10:55.418 INFO:teuthology.orchestra.run.smithi099.stdout:mds.e smithi179 running (118s) 33s ago 118s 20.2M - 19.0.0-885-g661946e7 0b5dc47a38d7 fe8e57110bfb 2024-01-31T05:10:55.418 INFO:teuthology.orchestra.run.smithi099.stdout:mds.f smithi181 running (116s) 33s ago 115s 18.1M - 19.0.0-885-g661946e7 0b5dc47a38d7 c4b143c29662 2024-01-31T05:10:55.418 INFO:teuthology.orchestra.run.smithi099.stdout:mds.g smithi099 running (105s) 17s ago 104s 16.6M - 19.0.0-885-g661946e7 0b5dc47a38d7 29817ee4f467 2024-01-31T05:10:55.418 INFO:teuthology.orchestra.run.smithi099.stdout:mds.h smithi179 running (110s) 33s ago 110s 18.6M - 19.0.0-885-g661946e7 0b5dc47a38d7 c01094228e2e 2024-01-31T05:10:55.419 INFO:teuthology.orchestra.run.smithi099.stdout:mds.i smithi181 running (108s) 33s ago 107s 16.7M - 19.0.0-885-g661946e7 0b5dc47a38d7 2ad233c1f567 2024-01-31T05:10:55.419 INFO:teuthology.orchestra.run.smithi099.stdout:mds.j smithi099 running (2m) 17s ago 2m 12.9M - 19.0.0-885-g661946e7 0b5dc47a38d7 f70d8b2a2333 2024-01-31T05:10:55.419 INFO:teuthology.orchestra.run.smithi099.stdout:mds.k smithi179 running (2m) 33s ago 2m 18.1M - 19.0.0-885-g661946e7 0b5dc47a38d7 78d89daaa42e 2024-01-31T05:10:55.419 INFO:teuthology.orchestra.run.smithi099.stdout:mds.l smithi181 running (2m) 33s ago 2m 18.2M - 19.0.0-885-g661946e7 0b5dc47a38d7 377206dd4be8 2024-01-31T05:10:55.419 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.x smithi099 *:9283,8765 running (9m) 17s ago 9m 504M - 19.0.0-885-g661946e7 0b5dc47a38d7 3ad20d70eb12 2024-01-31T05:10:55.419 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.y smithi179 *:8443,8765 running (7m) 33s ago 7m 443M - 19.0.0-885-g661946e7 0b5dc47a38d7 709d4d484e43 2024-01-31T05:10:55.419 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.z smithi181 *:8443,8765 running (7m) 33s ago 7m 443M - 19.0.0-885-g661946e7 0b5dc47a38d7 48f729b6ae87 2024-01-31T05:10:55.419 INFO:teuthology.orchestra.run.smithi099.stdout:mon.a smithi099 running (9m) 17s ago 9m 49.6M 2048M 19.0.0-885-g661946e7 0b5dc47a38d7 c2448782b9b7 2024-01-31T05:10:55.419 INFO:teuthology.orchestra.run.smithi099.stdout:mon.b smithi179 running (7m) 33s ago 7m 39.7M 2048M 19.0.0-885-g661946e7 0b5dc47a38d7 3f34d781cfae 2024-01-31T05:10:55.419 INFO:teuthology.orchestra.run.smithi099.stdout:mon.c smithi181 running (7m) 33s ago 7m 40.7M 2048M 19.0.0-885-g661946e7 0b5dc47a38d7 06764ffa8ade 2024-01-31T05:10:55.419 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (7m) 17s ago 7m 51.1M 4272M 19.0.0-885-g661946e7 0b5dc47a38d7 fc1986db2d2e 2024-01-31T05:10:55.419 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi179 running (6m) 33s ago 6m 55.1M 4270M 19.0.0-885-g661946e7 0b5dc47a38d7 17cfc249192c 2024-01-31T05:10:55.419 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi181 running (6m) 33s ago 6m 49.5M 4270M 19.0.0-885-g661946e7 0b5dc47a38d7 2f3b11f459d3 2024-01-31T05:10:55.419 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi099 running (5m) 17s ago 5m 47.0M 4272M 19.0.0-885-g661946e7 0b5dc47a38d7 e87b873284d7 2024-01-31T05:10:55.420 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi179 running (5m) 33s ago 5m 54.7M 4270M 19.0.0-885-g661946e7 0b5dc47a38d7 a2e32cfb1701 2024-01-31T05:10:55.420 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi181 running (5m) 33s ago 5m 54.2M 4270M 19.0.0-885-g661946e7 0b5dc47a38d7 66917db634a5 2024-01-31T05:10:55.420 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6 smithi099 running (4m) 17s ago 4m 47.0M 4272M 19.0.0-885-g661946e7 0b5dc47a38d7 43a2351bd426 2024-01-31T05:10:55.420 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7 smithi179 running (4m) 33s ago 4m 46.3M 4270M 19.0.0-885-g661946e7 0b5dc47a38d7 6fc0d6555bfa 2024-01-31T05:10:55.420 INFO:teuthology.orchestra.run.smithi099.stdout:osd.8 smithi181 running (3m) 33s ago 3m 54.2M 4270M 19.0.0-885-g661946e7 0b5dc47a38d7 a5b79c83c1e1 2024-01-31T05:10:55.420 INFO:teuthology.orchestra.run.smithi099.stdout:osd.9 smithi099 running (3m) 17s ago 3m 43.5M 4272M 19.0.0-885-g661946e7 0b5dc47a38d7 61b33cd3e78b 2024-01-31T05:10:55.420 INFO:teuthology.orchestra.run.smithi099.stdout:osd.10 smithi179 running (2m) 33s ago 2m 53.0M 4270M 19.0.0-885-g661946e7 0b5dc47a38d7 4b872feb21c7 2024-01-31T05:10:55.420 INFO:teuthology.orchestra.run.smithi099.stdout:osd.11 smithi181 running (2m) 33s ago 2m 50.8M 4270M 19.0.0-885-g661946e7 0b5dc47a38d7 3fabee58035b 2024-01-31T05:10:55.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.421+0000 7f5889d75700 1 -- 172.21.15.99:0/995526039 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f586c0a1370 msgr2=0x7f586c0a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:55.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.421+0000 7f5889d75700 1 --2- 172.21.15.99:0/995526039 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f586c0a1370 0x7f586c0a3830 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5884101770 tx=0x7f5874009260 comp rx=0 tx=0).stop 2024-01-31T05:10:55.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.421+0000 7f5889d75700 1 -- 172.21.15.99:0/995526039 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5884101910 msgr2=0x7f5884196a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:55.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.421+0000 7f5889d75700 1 --2- 172.21.15.99:0/995526039 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5884101910 0x7f5884196a60 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f587800f690 tx=0x7f5878005f10 comp rx=0 tx=0).stop 2024-01-31T05:10:55.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.421+0000 7f5889d75700 1 -- 172.21.15.99:0/995526039 shutdown_connections 2024-01-31T05:10:55.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.421+0000 7f5889d75700 1 --2- 172.21.15.99:0/995526039 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f586c0a1370 0x7f586c0a3830 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:55.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.421+0000 7f5889d75700 1 --2- 172.21.15.99:0/995526039 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58841022b0 0x7f588419dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:55.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.421+0000 7f5889d75700 1 --2- 172.21.15.99:0/995526039 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5884100710 0x7f5884196520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:55.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.421+0000 7f5889d75700 1 --2- 172.21.15.99:0/995526039 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5884101910 0x7f5884196a60 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:55.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.421+0000 7f5889d75700 1 -- 172.21.15.99:0/995526039 >> 172.21.15.99:0/995526039 conn(0x7f58840fbcd0 msgr2=0x7f5884104c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:55.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.421+0000 7f5889d75700 1 -- 172.21.15.99:0/995526039 shutdown_connections 2024-01-31T05:10:55.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:55.421+0000 7f5889d75700 1 -- 172.21.15.99:0/995526039 wait complete. 2024-01-31T05:10:56.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:55 smithi099 ceph-mon[31615]: pgmap v335: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 11 op/s 2024-01-31T05:10:56.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:55 smithi181 ceph-mon[36434]: pgmap v335: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 11 op/s 2024-01-31T05:10:56.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:55 smithi179 ceph-mon[35652]: pgmap v335: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 11 op/s 2024-01-31T05:10:56.223 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- bash -c 'ceph orch ls' 2024-01-31T05:10:56.467 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:10:56.920 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:56 smithi099 ceph-mon[31615]: from='client.15120 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:10:57.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:56 smithi181 ceph-mon[36434]: from='client.15120 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:10:57.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:56 smithi179 ceph-mon[35652]: from='client.15120 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:10:57.809 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:57 smithi099 ceph-mon[31615]: pgmap v336: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 9 op/s 2024-01-31T05:10:58.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.029+0000 7fbd2186b700 1 -- 172.21.15.99:0/4188356851 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd1c101810 msgr2=0x7fbd1c101c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:58.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.029+0000 7fbd2186b700 1 --2- 172.21.15.99:0/4188356851 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd1c101810 0x7fbd1c101c30 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c00b0d0 tx=0x7fbd0c00b3e0 comp rx=0 tx=0).stop 2024-01-31T05:10:58.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.029+0000 7fbd2186b700 1 -- 172.21.15.99:0/4188356851 shutdown_connections 2024-01-31T05:10:58.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.029+0000 7fbd2186b700 1 --2- 172.21.15.99:0/4188356851 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd1c1033b0 0x7fbd1c109c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:58.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.029+0000 7fbd2186b700 1 --2- 172.21.15.99:0/4188356851 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd1c101810 0x7fbd1c101c30 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:58.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.029+0000 7fbd2186b700 1 --2- 172.21.15.99:0/4188356851 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbd1c102a10 0x7fbd1c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:58.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.029+0000 7fbd2186b700 1 -- 172.21.15.99:0/4188356851 >> 172.21.15.99:0/4188356851 conn(0x7fbd1c0fcd90 msgr2=0x7fbd1c0ff1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:58.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.029+0000 7fbd2186b700 1 -- 172.21.15.99:0/4188356851 shutdown_connections 2024-01-31T05:10:58.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.029+0000 7fbd2186b700 1 -- 172.21.15.99:0/4188356851 wait complete. 2024-01-31T05:10:58.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.029+0000 7fbd2186b700 1 Processor -- start 2024-01-31T05:10:58.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.030+0000 7fbd2186b700 1 -- start start 2024-01-31T05:10:58.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.030+0000 7fbd2186b700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbd1c101810 0x7fbd1c075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:58.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.030+0000 7fbd2186b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd1c102a10 0x7fbd1c073bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:58.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.030+0000 7fbd2186b700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd1c1033b0 0x7fbd1c074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:58.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.030+0000 7fbd2186b700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c0748b0 con 0x7fbd1c1033b0 2024-01-31T05:10:58.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.030+0000 7fbd2186b700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c074a20 con 0x7fbd1c102a10 2024-01-31T05:10:58.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.030+0000 7fbd2186b700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c1a1870 con 0x7fbd1c101810 2024-01-31T05:10:58.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.030+0000 7fbd1b7fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd1c1033b0 0x7fbd1c074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:58.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.030+0000 7fbd1b7fe700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd1c1033b0 0x7fbd1c074110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35072/0 (socket says 172.21.15.99:35072) 2024-01-31T05:10:58.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.030+0000 7fbd1b7fe700 1 -- 172.21.15.99:0/2747333111 learned_addr learned my addr 172.21.15.99:0/2747333111 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:10:58.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.030+0000 7fbd1a7fc700 1 --2- 172.21.15.99:0/2747333111 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd1c102a10 0x7fbd1c073bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:58.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.030+0000 7fbd1affd700 1 --2- 172.21.15.99:0/2747333111 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbd1c101810 0x7fbd1c075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:58.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.030+0000 7fbd1b7fe700 1 -- 172.21.15.99:0/2747333111 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbd1c101810 msgr2=0x7fbd1c075530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:58.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.030+0000 7fbd1b7fe700 1 --2- 172.21.15.99:0/2747333111 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbd1c101810 0x7fbd1c075530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:58.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.030+0000 7fbd1b7fe700 1 -- 172.21.15.99:0/2747333111 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd1c102a10 msgr2=0x7fbd1c073bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:58.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.030+0000 7fbd1b7fe700 1 --2- 172.21.15.99:0/2747333111 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd1c102a10 0x7fbd1c073bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:58.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.030+0000 7fbd1b7fe700 1 -- 172.21.15.99:0/2747333111 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd0c009d00 con 0x7fbd1c1033b0 2024-01-31T05:10:58.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.030+0000 7fbd1affd700 1 --2- 172.21.15.99:0/2747333111 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbd1c101810 0x7fbd1c075530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:10:58.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.030+0000 7fbd1b7fe700 1 --2- 172.21.15.99:0/2747333111 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd1c1033b0 0x7fbd1c074110 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fbd1400c900 tx=0x7fbd1400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:58.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.031+0000 7fbd20869700 1 -- 172.21.15.99:0/2747333111 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd14007b00 con 0x7fbd1c1033b0 2024-01-31T05:10:58.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.031+0000 7fbd20869700 1 -- 172.21.15.99:0/2747333111 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd1400ce50 con 0x7fbd1c1033b0 2024-01-31T05:10:58.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.031+0000 7fbd2186b700 1 -- 172.21.15.99:0/2747333111 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd1c1a1b00 con 0x7fbd1c1033b0 2024-01-31T05:10:58.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.031+0000 7fbd20869700 1 -- 172.21.15.99:0/2747333111 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd14018660 con 0x7fbd1c1033b0 2024-01-31T05:10:58.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.031+0000 7fbd2186b700 1 -- 172.21.15.99:0/2747333111 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd1c1a2000 con 0x7fbd1c1033b0 2024-01-31T05:10:58.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.032+0000 7fbd2186b700 1 -- 172.21.15.99:0/2747333111 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd1c108cf0 con 0x7fbd1c1033b0 2024-01-31T05:10:58.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.033+0000 7fbd20869700 1 -- 172.21.15.99:0/2747333111 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) v1 ==== 135895+0+0 (secure 0 0 0) 0x7fbd1400f450 con 0x7fbd1c1033b0 2024-01-31T05:10:58.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.033+0000 7fbd20869700 1 --2- 172.21.15.99:0/2747333111 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fbd080a13f0 0x7fbd080a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:10:58.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.034+0000 7fbd1affd700 1 --2- 172.21.15.99:0/2747333111 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fbd080a13f0 0x7fbd080a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:10:58.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.034+0000 7fbd20869700 1 -- 172.21.15.99:0/2747333111 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fbd140cc9a0 con 0x7fbd1c1033b0 2024-01-31T05:10:58.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.034+0000 7fbd1affd700 1 --2- 172.21.15.99:0/2747333111 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fbd080a13f0 0x7fbd080a38b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c007bd0 tx=0x7fbd0c00b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:10:58.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.037+0000 7fbd20869700 1 -- 172.21.15.99:0/2747333111 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fbd14095f60 con 0x7fbd1c1033b0 2024-01-31T05:10:58.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:57 smithi181 ceph-mon[36434]: pgmap v336: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 9 op/s 2024-01-31T05:10:58.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:57 smithi179 ceph-mon[35652]: pgmap v336: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 9 op/s 2024-01-31T05:10:58.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.239+0000 7fbd2186b700 1 -- 172.21.15.99:0/2747333111 --> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd1c02d5b0 con 0x7fbd080a13f0 2024-01-31T05:10:58.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.245+0000 7fbd20869700 1 -- 172.21.15.99:0/2747333111 <== mgr.14152 v2:172.21.15.99:6800/3925720924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+980 (secure 0 0 0) 0x7fbd1c02d5b0 con 0x7fbd080a13f0 2024-01-31T05:10:58.245 INFO:teuthology.orchestra.run.smithi099.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-01-31T05:10:58.245 INFO:teuthology.orchestra.run.smithi099.stdout:mds.all 12/12 35s ago 2m smithi099=a;smithi099=d;smithi099=g;smithi099=j;smithi179=b;smithi179=e;smithi179=h;smithi179=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l;count:12 2024-01-31T05:10:58.245 INFO:teuthology.orchestra.run.smithi099.stdout:mgr 3/3 35s ago 7m smithi099=x;smithi179=y;smithi181=z;count:3 2024-01-31T05:10:58.245 INFO:teuthology.orchestra.run.smithi099.stdout:mon 3/3 35s ago 7m smithi099:172.21.15.99=a;smithi179:172.21.15.179=b;smithi181:172.21.15.181=c;count:3 2024-01-31T05:10:58.245 INFO:teuthology.orchestra.run.smithi099.stdout:osd 12 35s ago - 2024-01-31T05:10:58.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.247+0000 7fbd2186b700 1 -- 172.21.15.99:0/2747333111 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fbd080a13f0 msgr2=0x7fbd080a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:58.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.247+0000 7fbd2186b700 1 --2- 172.21.15.99:0/2747333111 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fbd080a13f0 0x7fbd080a38b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c007bd0 tx=0x7fbd0c00b040 comp rx=0 tx=0).stop 2024-01-31T05:10:58.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.247+0000 7fbd2186b700 1 -- 172.21.15.99:0/2747333111 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd1c1033b0 msgr2=0x7fbd1c074110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:10:58.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.247+0000 7fbd2186b700 1 --2- 172.21.15.99:0/2747333111 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd1c1033b0 0x7fbd1c074110 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fbd1400c900 tx=0x7fbd1400cc10 comp rx=0 tx=0).stop 2024-01-31T05:10:58.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.247+0000 7fbd2186b700 1 -- 172.21.15.99:0/2747333111 shutdown_connections 2024-01-31T05:10:58.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.247+0000 7fbd2186b700 1 --2- 172.21.15.99:0/2747333111 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd1c1033b0 0x7fbd1c074110 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:58.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.247+0000 7fbd2186b700 1 --2- 172.21.15.99:0/2747333111 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbd1c101810 0x7fbd1c075530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:58.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.247+0000 7fbd2186b700 1 --2- 172.21.15.99:0/2747333111 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fbd080a13f0 0x7fbd080a38b0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:58.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.247+0000 7fbd2186b700 1 --2- 172.21.15.99:0/2747333111 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd1c102a10 0x7fbd1c073bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:10:58.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.247+0000 7fbd2186b700 1 -- 172.21.15.99:0/2747333111 >> 172.21.15.99:0/2747333111 conn(0x7fbd1c0fcd90 msgr2=0x7fbd1c105e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:10:58.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.248+0000 7fbd2186b700 1 -- 172.21.15.99:0/2747333111 shutdown_connections 2024-01-31T05:10:58.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:10:58.248+0000 7fbd2186b700 1 -- 172.21.15.99:0/2747333111 wait complete. 2024-01-31T05:10:59.052 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- bash -c 'ceph orch host ls' 2024-01-31T05:10:59.292 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:11:00.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:59 smithi099 ceph-mon[31615]: from='client.15126 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:11:00.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:10:59 smithi099 ceph-mon[31615]: pgmap v337: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 13 op/s 2024-01-31T05:11:00.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:59 smithi181 ceph-mon[36434]: from='client.15126 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:11:00.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:10:59 smithi181 ceph-mon[36434]: pgmap v337: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 13 op/s 2024-01-31T05:11:00.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:59 smithi179 ceph-mon[35652]: from='client.15126 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:11:00.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:10:59 smithi179 ceph-mon[35652]: pgmap v337: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 13 op/s 2024-01-31T05:11:01.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.206+0000 7f51f6d60700 1 -- 172.21.15.99:0/3273479948 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51f0103490 msgr2=0x7f51f0109d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:01.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.206+0000 7f51f6d60700 1 --2- 172.21.15.99:0/3273479948 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51f0103490 0x7f51f0109d40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f51e800b0a0 tx=0x7f51e800b3b0 comp rx=0 tx=0).stop 2024-01-31T05:11:01.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.207+0000 7f51f6d60700 1 -- 172.21.15.99:0/3273479948 shutdown_connections 2024-01-31T05:11:01.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.207+0000 7f51f6d60700 1 --2- 172.21.15.99:0/3273479948 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51f0103490 0x7f51f0109d40 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:01.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.207+0000 7f51f6d60700 1 --2- 172.21.15.99:0/3273479948 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51f00ffb10 0x7f51f00fff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:01.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.207+0000 7f51f6d60700 1 --2- 172.21.15.99:0/3273479948 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51f0102af0 0x7f51f0102f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:01.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.207+0000 7f51f6d60700 1 -- 172.21.15.99:0/3273479948 >> 172.21.15.99:0/3273479948 conn(0x7f51f00fb470 msgr2=0x7f51f00fd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:01.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.207+0000 7f51f6d60700 1 -- 172.21.15.99:0/3273479948 shutdown_connections 2024-01-31T05:11:01.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.207+0000 7f51f6d60700 1 -- 172.21.15.99:0/3273479948 wait complete. 2024-01-31T05:11:01.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.207+0000 7f51f6d60700 1 Processor -- start 2024-01-31T05:11:01.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.207+0000 7f51f6d60700 1 -- start start 2024-01-31T05:11:01.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.207+0000 7f51f6d60700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51f00ffb10 0x7f51f0195540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:01.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.208+0000 7f51f6d60700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51f0102af0 0x7f51f019aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:01.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.208+0000 7f51f6d60700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51f0103490 0x7f51f0195b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:01.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.208+0000 7f51f6d60700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f01ae0e0 con 0x7f51f0103490 2024-01-31T05:11:01.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.208+0000 7f51f6d60700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f01ae220 con 0x7f51f0102af0 2024-01-31T05:11:01.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.208+0000 7f51f6d60700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f01ae3b0 con 0x7f51f00ffb10 2024-01-31T05:11:01.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.208+0000 7f51f52fd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51f0103490 0x7f51f0195b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:01.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.208+0000 7f51f52fd700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51f0103490 0x7f51f0195b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35086/0 (socket says 172.21.15.99:35086) 2024-01-31T05:11:01.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.208+0000 7f51f52fd700 1 -- 172.21.15.99:0/1016706347 learned_addr learned my addr 172.21.15.99:0/1016706347 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:01.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.208+0000 7f51f4afc700 1 --2- 172.21.15.99:0/1016706347 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51f00ffb10 0x7f51f0195540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:01.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.208+0000 7f51effff700 1 --2- 172.21.15.99:0/1016706347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51f0102af0 0x7f51f019aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:01.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.208+0000 7f51f52fd700 1 -- 172.21.15.99:0/1016706347 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51f00ffb10 msgr2=0x7f51f0195540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:01.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.208+0000 7f51f52fd700 1 --2- 172.21.15.99:0/1016706347 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51f00ffb10 0x7f51f0195540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:01.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.208+0000 7f51f52fd700 1 -- 172.21.15.99:0/1016706347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51f0102af0 msgr2=0x7f51f019aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:01.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.208+0000 7f51f52fd700 1 --2- 172.21.15.99:0/1016706347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51f0102af0 0x7f51f019aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:01.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.208+0000 7f51f52fd700 1 -- 172.21.15.99:0/1016706347 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e8009d00 con 0x7f51f0103490 2024-01-31T05:11:01.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.208+0000 7f51f52fd700 1 --2- 172.21.15.99:0/1016706347 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51f0103490 0x7f51f0195b70 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f51e8004d30 tx=0x7f51e8004e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:01.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.208+0000 7f51edffb700 1 -- 172.21.15.99:0/1016706347 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e800e040 con 0x7f51f0103490 2024-01-31T05:11:01.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.208+0000 7f51edffb700 1 -- 172.21.15.99:0/1016706347 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f51e8009440 con 0x7f51f0103490 2024-01-31T05:11:01.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.208+0000 7f51f6d60700 1 -- 172.21.15.99:0/1016706347 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51f01ae630 con 0x7f51f0103490 2024-01-31T05:11:01.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.208+0000 7f51edffb700 1 -- 172.21.15.99:0/1016706347 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e801ba10 con 0x7f51f0103490 2024-01-31T05:11:01.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.209+0000 7f51f6d60700 1 -- 172.21.15.99:0/1016706347 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51f01aea50 con 0x7f51f0103490 2024-01-31T05:11:01.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.209+0000 7f51f6d60700 1 -- 172.21.15.99:0/1016706347 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51f0106bd0 con 0x7f51f0103490 2024-01-31T05:11:01.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.210+0000 7f51edffb700 1 -- 172.21.15.99:0/1016706347 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f51e801dcc0 con 0x7f51f0103490 2024-01-31T05:11:01.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.211+0000 7f51edffb700 1 --2- 172.21.15.99:0/1016706347 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f51e00a1370 0x7f51e00a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:01.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.211+0000 7f51f4afc700 1 --2- 172.21.15.99:0/1016706347 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f51e00a1370 0x7f51e00a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:01.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.211+0000 7f51edffb700 1 -- 172.21.15.99:0/1016706347 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f51e80ce920 con 0x7f51f0103490 2024-01-31T05:11:01.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.211+0000 7f51f4afc700 1 --2- 172.21.15.99:0/1016706347 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f51e00a1370 0x7f51e00a3830 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f51e4005fd0 tx=0x7f51e4005dd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:01.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.215+0000 7f51edffb700 1 -- 172.21.15.99:0/1016706347 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f51e8097ef0 con 0x7f51f0103490 2024-01-31T05:11:01.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.413+0000 7f51f6d60700 1 -- 172.21.15.99:0/1016706347 --> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f51f002d540 con 0x7f51e00a1370 2024-01-31T05:11:01.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.414+0000 7f51edffb700 1 -- 172.21.15.99:0/1016706347 <== mgr.14152 v2:172.21.15.99:6800/3925720924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7f51f002d540 con 0x7f51e00a1370 2024-01-31T05:11:01.413 INFO:teuthology.orchestra.run.smithi099.stdout:HOST ADDR LABELS STATUS 2024-01-31T05:11:01.413 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099 172.21.15.99 2024-01-31T05:11:01.414 INFO:teuthology.orchestra.run.smithi099.stdout:smithi179 172.21.15.179 2024-01-31T05:11:01.414 INFO:teuthology.orchestra.run.smithi099.stdout:smithi181 172.21.15.181 2024-01-31T05:11:01.414 INFO:teuthology.orchestra.run.smithi099.stdout:3 hosts in cluster 2024-01-31T05:11:01.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.416+0000 7f51f6d60700 1 -- 172.21.15.99:0/1016706347 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f51e00a1370 msgr2=0x7f51e00a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:01.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.416+0000 7f51f6d60700 1 --2- 172.21.15.99:0/1016706347 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f51e00a1370 0x7f51e00a3830 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f51e4005fd0 tx=0x7f51e4005dd0 comp rx=0 tx=0).stop 2024-01-31T05:11:01.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.416+0000 7f51f6d60700 1 -- 172.21.15.99:0/1016706347 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51f0103490 msgr2=0x7f51f0195b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:01.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.416+0000 7f51f6d60700 1 --2- 172.21.15.99:0/1016706347 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51f0103490 0x7f51f0195b70 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f51e8004d30 tx=0x7f51e8004e10 comp rx=0 tx=0).stop 2024-01-31T05:11:01.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.416+0000 7f51f6d60700 1 -- 172.21.15.99:0/1016706347 shutdown_connections 2024-01-31T05:11:01.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.416+0000 7f51f6d60700 1 --2- 172.21.15.99:0/1016706347 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51f0103490 0x7f51f0195b70 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:01.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.416+0000 7f51f6d60700 1 --2- 172.21.15.99:0/1016706347 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51f00ffb10 0x7f51f0195540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:01.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.416+0000 7f51f6d60700 1 --2- 172.21.15.99:0/1016706347 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f51e00a1370 0x7f51e00a3830 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:01.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.416+0000 7f51f6d60700 1 --2- 172.21.15.99:0/1016706347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51f0102af0 0x7f51f019aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:01.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.416+0000 7f51f6d60700 1 -- 172.21.15.99:0/1016706347 >> 172.21.15.99:0/1016706347 conn(0x7f51f00fb470 msgr2=0x7f51f0103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:01.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.416+0000 7f51f6d60700 1 -- 172.21.15.99:0/1016706347 shutdown_connections 2024-01-31T05:11:01.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:01.416+0000 7f51f6d60700 1 -- 172.21.15.99:0/1016706347 wait complete. 2024-01-31T05:11:02.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:01 smithi099 ceph-mon[31615]: pgmap v338: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 9 op/s 2024-01-31T05:11:02.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:01 smithi181 ceph-mon[36434]: pgmap v338: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 9 op/s 2024-01-31T05:11:02.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:01 smithi179 ceph-mon[35652]: pgmap v338: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 9 op/s 2024-01-31T05:11:02.206 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- bash -c 'ceph orch device ls' 2024-01-31T05:11:02.449 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:11:02.911 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:02 smithi099 ceph-mon[31615]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:11:03.033 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:02 smithi179 ceph-mon[35652]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:11:03.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:02 smithi181 ceph-mon[36434]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:11:03.998 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:03 smithi099 ceph-mon[31615]: pgmap v339: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 767 B/s wr, 11 op/s 2024-01-31T05:11:04.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:03 smithi181 ceph-mon[36434]: pgmap v339: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 767 B/s wr, 11 op/s 2024-01-31T05:11:04.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:03 smithi179 ceph-mon[35652]: pgmap v339: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 767 B/s wr, 11 op/s 2024-01-31T05:11:04.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.273+0000 7f183e9de700 1 -- 172.21.15.99:0/617110319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1838102b70 msgr2=0x7f1838102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:04.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.273+0000 7f183e9de700 1 --2- 172.21.15.99:0/617110319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1838102b70 0x7f1838102fd0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f182c009990 tx=0x7f182c009ca0 comp rx=0 tx=0).stop 2024-01-31T05:11:04.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.273+0000 7f183e9de700 1 -- 172.21.15.99:0/617110319 shutdown_connections 2024-01-31T05:11:04.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.273+0000 7f183e9de700 1 --2- 172.21.15.99:0/617110319 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1838103510 0x7f1838109dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:04.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.273+0000 7f183e9de700 1 --2- 172.21.15.99:0/617110319 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f18380ffaf0 0x7f18380fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:04.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.273+0000 7f183e9de700 1 --2- 172.21.15.99:0/617110319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1838102b70 0x7f1838102fd0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:04.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.273+0000 7f183e9de700 1 -- 172.21.15.99:0/617110319 >> 172.21.15.99:0/617110319 conn(0x7f18380fb450 msgr2=0x7f18380fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:04.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.273+0000 7f183e9de700 1 -- 172.21.15.99:0/617110319 shutdown_connections 2024-01-31T05:11:04.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.273+0000 7f183e9de700 1 -- 172.21.15.99:0/617110319 wait complete. 2024-01-31T05:11:04.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.274+0000 7f183e9de700 1 Processor -- start 2024-01-31T05:11:04.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.274+0000 7f183e9de700 1 -- start start 2024-01-31T05:11:04.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.274+0000 7f183e9de700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18380ffaf0 0x7f18381975f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:04.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.274+0000 7f183e9de700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1838102b70 0x7f1838197b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:04.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.274+0000 7f183e9de700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1838103510 0x7f183819ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:04.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.274+0000 7f183e9de700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183819f180 con 0x7f18380ffaf0 2024-01-31T05:11:04.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.274+0000 7f183e9de700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183819f2c0 con 0x7f1838103510 2024-01-31T05:11:04.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.274+0000 7f183e9de700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183819f450 con 0x7f1838102b70 2024-01-31T05:11:04.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.274+0000 7f1837fff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18380ffaf0 0x7f18381975f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:04.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.274+0000 7f1837fff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18380ffaf0 0x7f18381975f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35098/0 (socket says 172.21.15.99:35098) 2024-01-31T05:11:04.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.274+0000 7f1837fff700 1 -- 172.21.15.99:0/801937317 learned_addr learned my addr 172.21.15.99:0/801937317 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:04.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.274+0000 7f183cf7b700 1 --2- 172.21.15.99:0/801937317 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1838103510 0x7f183819ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:04.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.274+0000 7f18377fe700 1 --2- 172.21.15.99:0/801937317 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1838102b70 0x7f1838197b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:04.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.274+0000 7f1837fff700 1 -- 172.21.15.99:0/801937317 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1838102b70 msgr2=0x7f1838197b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:04.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.274+0000 7f1837fff700 1 --2- 172.21.15.99:0/801937317 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1838102b70 0x7f1838197b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:04.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.274+0000 7f1837fff700 1 -- 172.21.15.99:0/801937317 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1838103510 msgr2=0x7f183819ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:04.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.274+0000 7f1837fff700 1 --2- 172.21.15.99:0/801937317 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1838103510 0x7f183819ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:04.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.274+0000 7f1837fff700 1 -- 172.21.15.99:0/801937317 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f182c0095f0 con 0x7f18380ffaf0 2024-01-31T05:11:04.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.275+0000 7f1837fff700 1 --2- 172.21.15.99:0/801937317 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18380ffaf0 0x7f18381975f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f182800c9c0 tx=0x7f182800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:04.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.275+0000 7f18357fa700 1 -- 172.21.15.99:0/801937317 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1828007ac0 con 0x7f18380ffaf0 2024-01-31T05:11:04.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.275+0000 7f183e9de700 1 -- 172.21.15.99:0/801937317 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f183819f730 con 0x7f18380ffaf0 2024-01-31T05:11:04.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.275+0000 7f18357fa700 1 -- 172.21.15.99:0/801937317 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1828007c20 con 0x7f18380ffaf0 2024-01-31T05:11:04.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.275+0000 7f18357fa700 1 -- 172.21.15.99:0/801937317 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1828018660 con 0x7f18380ffaf0 2024-01-31T05:11:04.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.275+0000 7f183e9de700 1 -- 172.21.15.99:0/801937317 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f183819fc30 con 0x7f18380ffaf0 2024-01-31T05:11:04.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.276+0000 7f183e9de700 1 -- 172.21.15.99:0/801937317 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1838108d50 con 0x7f18380ffaf0 2024-01-31T05:11:04.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.277+0000 7f18357fa700 1 -- 172.21.15.99:0/801937317 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f182800f450 con 0x7f18380ffaf0 2024-01-31T05:11:04.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.277+0000 7f18357fa700 1 --2- 172.21.15.99:0/801937317 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f18200a1370 0x7f18200a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:04.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.277+0000 7f18377fe700 1 --2- 172.21.15.99:0/801937317 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f18200a1370 0x7f18200a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:04.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.277+0000 7f18357fa700 1 -- 172.21.15.99:0/801937317 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f18280cc9a0 con 0x7f18380ffaf0 2024-01-31T05:11:04.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.278+0000 7f18377fe700 1 --2- 172.21.15.99:0/801937317 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f18200a1370 0x7f18200a3830 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f182c00b5c0 tx=0x7f182c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:04.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.282+0000 7f18357fa700 1 -- 172.21.15.99:0/801937317 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f1828095ee0 con 0x7f18380ffaf0 2024-01-31T05:11:04.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.482+0000 7f183e9de700 1 -- 172.21.15.99:0/801937317 --> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f183802d5a0 con 0x7f18200a1370 2024-01-31T05:11:04.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.484+0000 7f18357fa700 1 -- 172.21.15.99:0/801937317 <== mgr.14152 v2:172.21.15.99:6800/3925720924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+532 (secure 0 0 0) 0x7f183802d5a0 con 0x7f18200a1370 2024-01-31T05:11:04.483 INFO:teuthology.orchestra.run.smithi099.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-01-31T05:11:04.483 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT62040101400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-01-31T05:11:04.484 INFO:teuthology.orchestra.run.smithi099.stdout:smithi179 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6303009J400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-01-31T05:11:04.484 INFO:teuthology.orchestra.run.smithi099.stdout:smithi181 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6246000E400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-01-31T05:11:04.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.486+0000 7f183e9de700 1 -- 172.21.15.99:0/801937317 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f18200a1370 msgr2=0x7f18200a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:04.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.486+0000 7f183e9de700 1 --2- 172.21.15.99:0/801937317 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f18200a1370 0x7f18200a3830 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f182c00b5c0 tx=0x7f182c005fb0 comp rx=0 tx=0).stop 2024-01-31T05:11:04.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.486+0000 7f183e9de700 1 -- 172.21.15.99:0/801937317 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18380ffaf0 msgr2=0x7f18381975f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:04.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.486+0000 7f183e9de700 1 --2- 172.21.15.99:0/801937317 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18380ffaf0 0x7f18381975f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f182800c9c0 tx=0x7f182800ccd0 comp rx=0 tx=0).stop 2024-01-31T05:11:04.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.486+0000 7f183e9de700 1 -- 172.21.15.99:0/801937317 shutdown_connections 2024-01-31T05:11:04.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.486+0000 7f183e9de700 1 --2- 172.21.15.99:0/801937317 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f18200a1370 0x7f18200a3830 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:04.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.486+0000 7f183e9de700 1 --2- 172.21.15.99:0/801937317 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1838103510 0x7f183819ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:04.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.487+0000 7f183e9de700 1 --2- 172.21.15.99:0/801937317 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18380ffaf0 0x7f18381975f0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:04.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.487+0000 7f183e9de700 1 --2- 172.21.15.99:0/801937317 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1838102b70 0x7f1838197b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:04.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.487+0000 7f183e9de700 1 -- 172.21.15.99:0/801937317 >> 172.21.15.99:0/801937317 conn(0x7f18380fb450 msgr2=0x7f1838105e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:04.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.487+0000 7f183e9de700 1 -- 172.21.15.99:0/801937317 shutdown_connections 2024-01-31T05:11:04.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:04.487+0000 7f183e9de700 1 -- 172.21.15.99:0/801937317 wait complete. 2024-01-31T05:11:05.304 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-01-31T05:11:05.313 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi099.front.sepia.ceph.com 2024-01-31T05:11:05.314 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- bash -c 'ceph fs dump' 2024-01-31T05:11:05.557 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:11:05.935 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:05 smithi099 ceph-mon[31615]: from='client.15138 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:11:05.935 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:05 smithi099 ceph-mon[31615]: pgmap v340: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 511 B/s wr, 11 op/s 2024-01-31T05:11:06.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:05 smithi181 ceph-mon[36434]: from='client.15138 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:11:06.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:05 smithi181 ceph-mon[36434]: pgmap v340: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 511 B/s wr, 11 op/s 2024-01-31T05:11:06.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:05 smithi179 ceph-mon[35652]: from='client.15138 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:11:06.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:05 smithi179 ceph-mon[35652]: pgmap v340: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 511 B/s wr, 11 op/s 2024-01-31T05:11:07.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.322+0000 7fc648088700 1 -- 172.21.15.99:0/2362378742 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6400ffb10 msgr2=0x7fc6400fff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:07.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.322+0000 7fc648088700 1 --2- 172.21.15.99:0/2362378742 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6400ffb10 0x7fc6400fff30 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc630009990 tx=0x7fc630009ca0 comp rx=0 tx=0).stop 2024-01-31T05:11:07.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.322+0000 7fc648088700 1 -- 172.21.15.99:0/2362378742 shutdown_connections 2024-01-31T05:11:07.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.322+0000 7fc648088700 1 --2- 172.21.15.99:0/2362378742 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc640103490 0x7fc640109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:07.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.322+0000 7fc648088700 1 --2- 172.21.15.99:0/2362378742 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6400ffb10 0x7fc6400fff30 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:07.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.322+0000 7fc648088700 1 --2- 172.21.15.99:0/2362378742 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc640102af0 0x7fc640102f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:07.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.322+0000 7fc648088700 1 -- 172.21.15.99:0/2362378742 >> 172.21.15.99:0/2362378742 conn(0x7fc6400fb470 msgr2=0x7fc6400fd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:07.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.322+0000 7fc648088700 1 -- 172.21.15.99:0/2362378742 shutdown_connections 2024-01-31T05:11:07.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.322+0000 7fc648088700 1 -- 172.21.15.99:0/2362378742 wait complete. 2024-01-31T05:11:07.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.323+0000 7fc648088700 1 Processor -- start 2024-01-31T05:11:07.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.323+0000 7fc648088700 1 -- start start 2024-01-31T05:11:07.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.323+0000 7fc648088700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6400ffb10 0x7fc640197700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:07.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.323+0000 7fc648088700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc640102af0 0x7fc640197c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:07.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.323+0000 7fc648088700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc640103490 0x7fc64019ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:07.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.323+0000 7fc648088700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64019f290 con 0x7fc6400ffb10 2024-01-31T05:11:07.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.323+0000 7fc648088700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64019f3d0 con 0x7fc640103490 2024-01-31T05:11:07.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.323+0000 7fc648088700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64019f560 con 0x7fc640102af0 2024-01-31T05:11:07.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.323+0000 7fc645e24700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6400ffb10 0x7fc640197700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:07.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.323+0000 7fc645e24700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6400ffb10 0x7fc640197700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54060/0 (socket says 172.21.15.99:54060) 2024-01-31T05:11:07.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.323+0000 7fc645e24700 1 -- 172.21.15.99:0/2590659902 learned_addr learned my addr 172.21.15.99:0/2590659902 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:07.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.323+0000 7fc645623700 1 --2- 172.21.15.99:0/2590659902 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc640102af0 0x7fc640197c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:07.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.324+0000 7fc646625700 1 --2- 172.21.15.99:0/2590659902 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc640103490 0x7fc64019ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:07.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.324+0000 7fc645e24700 1 -- 172.21.15.99:0/2590659902 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc640102af0 msgr2=0x7fc640197c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:07.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.324+0000 7fc645e24700 1 --2- 172.21.15.99:0/2590659902 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc640102af0 0x7fc640197c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:07.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.324+0000 7fc645e24700 1 -- 172.21.15.99:0/2590659902 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc640103490 msgr2=0x7fc64019ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:07.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.324+0000 7fc645e24700 1 --2- 172.21.15.99:0/2590659902 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc640103490 0x7fc64019ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:07.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.324+0000 7fc645e24700 1 -- 172.21.15.99:0/2590659902 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6300095f0 con 0x7fc6400ffb10 2024-01-31T05:11:07.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.324+0000 7fc645e24700 1 --2- 172.21.15.99:0/2590659902 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6400ffb10 0x7fc640197700 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc6300037f0 tx=0x7fc63000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:07.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.324+0000 7fc636ffd700 1 -- 172.21.15.99:0/2590659902 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63001d070 con 0x7fc6400ffb10 2024-01-31T05:11:07.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.324+0000 7fc636ffd700 1 -- 172.21.15.99:0/2590659902 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc630022470 con 0x7fc6400ffb10 2024-01-31T05:11:07.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.324+0000 7fc648088700 1 -- 172.21.15.99:0/2590659902 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc64019f7e0 con 0x7fc6400ffb10 2024-01-31T05:11:07.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.324+0000 7fc636ffd700 1 -- 172.21.15.99:0/2590659902 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc630017650 con 0x7fc6400ffb10 2024-01-31T05:11:07.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.324+0000 7fc648088700 1 -- 172.21.15.99:0/2590659902 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc64019fc50 con 0x7fc6400ffb10 2024-01-31T05:11:07.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.325+0000 7fc648088700 1 -- 172.21.15.99:0/2590659902 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc640108d30 con 0x7fc6400ffb10 2024-01-31T05:11:07.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.326+0000 7fc636ffd700 1 -- 172.21.15.99:0/2590659902 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) v1 ==== 135895+0+0 (secure 0 0 0) 0x7fc6300225e0 con 0x7fc6400ffb10 2024-01-31T05:11:07.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.327+0000 7fc636ffd700 1 --2- 172.21.15.99:0/2590659902 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc62c0a13f0 0x7fc62c0a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:07.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.327+0000 7fc645623700 1 --2- 172.21.15.99:0/2590659902 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc62c0a13f0 0x7fc62c0a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:07.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.327+0000 7fc636ffd700 1 -- 172.21.15.99:0/2590659902 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fc6300cdf90 con 0x7fc6400ffb10 2024-01-31T05:11:07.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.327+0000 7fc645623700 1 --2- 172.21.15.99:0/2590659902 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc62c0a13f0 0x7fc62c0a38b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc63c005950 tx=0x7fc63c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:07.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.330+0000 7fc636ffd700 1 -- 172.21.15.99:0/2590659902 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fc630097560 con 0x7fc6400ffb10 2024-01-31T05:11:07.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.564+0000 7fc648088700 1 -- 172.21.15.99:0/2590659902 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc64010d090 con 0x7fc6400ffb10 2024-01-31T05:11:07.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.565+0000 7fc636ffd700 1 -- 172.21.15.99:0/2590659902 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+2965 (secure 0 0 0) 0x7fc630031bb0 con 0x7fc6400ffb10 2024-01-31T05:11:07.564 INFO:teuthology.orchestra.run.smithi099.stdout:e26 2024-01-31T05:11:07.564 INFO:teuthology.orchestra.run.smithi099.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-01-31T05:11:07.564 INFO:teuthology.orchestra.run.smithi099.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-01-31T05:11:07.565 INFO:teuthology.orchestra.run.smithi099.stdout:legacy client fscid: 1 2024-01-31T05:11:07.565 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:11:07.565 INFO:teuthology.orchestra.run.smithi099.stdout:Filesystem 'cephfs' (1) 2024-01-31T05:11:07.565 INFO:teuthology.orchestra.run.smithi099.stdout:fs_name cephfs 2024-01-31T05:11:07.565 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 26 2024-01-31T05:11:07.565 INFO:teuthology.orchestra.run.smithi099.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-01-31T05:11:07.565 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-01-31T05:09:20.564215+0000 2024-01-31T05:11:07.565 INFO:teuthology.orchestra.run.smithi099.stdout:modified 2024-01-31T05:09:28.172314+0000 2024-01-31T05:11:07.565 INFO:teuthology.orchestra.run.smithi099.stdout:tableserver 0 2024-01-31T05:11:07.565 INFO:teuthology.orchestra.run.smithi099.stdout:root 0 2024-01-31T05:11:07.565 INFO:teuthology.orchestra.run.smithi099.stdout:session_timeout 300 2024-01-31T05:11:07.565 INFO:teuthology.orchestra.run.smithi099.stdout:session_autoclose 300 2024-01-31T05:11:07.565 INFO:teuthology.orchestra.run.smithi099.stdout:max_file_size 1099511627776 2024-01-31T05:11:07.565 INFO:teuthology.orchestra.run.smithi099.stdout:max_xattr_size 65536 2024-01-31T05:11:07.566 INFO:teuthology.orchestra.run.smithi099.stdout:required_client_features {} 2024-01-31T05:11:07.566 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure 0 2024-01-31T05:11:07.566 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure_osd_epoch 0 2024-01-31T05:11:07.566 INFO:teuthology.orchestra.run.smithi099.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-01-31T05:11:07.566 INFO:teuthology.orchestra.run.smithi099.stdout:max_mds 5 2024-01-31T05:11:07.566 INFO:teuthology.orchestra.run.smithi099.stdout:in 0,1,2,3,4 2024-01-31T05:11:07.566 INFO:teuthology.orchestra.run.smithi099.stdout:up {0=24497,1=24461,2=24457,3=24439,4=14619} 2024-01-31T05:11:07.566 INFO:teuthology.orchestra.run.smithi099.stdout:failed 2024-01-31T05:11:07.566 INFO:teuthology.orchestra.run.smithi099.stdout:damaged 2024-01-31T05:11:07.566 INFO:teuthology.orchestra.run.smithi099.stdout:stopped 2024-01-31T05:11:07.566 INFO:teuthology.orchestra.run.smithi099.stdout:data_pools [3] 2024-01-31T05:11:07.566 INFO:teuthology.orchestra.run.smithi099.stdout:metadata_pool 2 2024-01-31T05:11:07.566 INFO:teuthology.orchestra.run.smithi099.stdout:inline_data disabled 2024-01-31T05:11:07.566 INFO:teuthology.orchestra.run.smithi099.stdout:balancer 2024-01-31T05:11:07.567 INFO:teuthology.orchestra.run.smithi099.stdout:bal_rank_mask -1 2024-01-31T05:11:07.567 INFO:teuthology.orchestra.run.smithi099.stdout:standby_count_wanted 0 2024-01-31T05:11:07.567 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.b{0:24497} state up:active seq 3 addr [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] compat {c=[1],r=[1],i=[fff]}] 2024-01-31T05:11:07.567 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.e{0:24434} state up:standby-replay seq 1 addr [v2:172.21.15.179:6834/966976592,v1:172.21.15.179:6835/966976592] compat {c=[1],r=[1],i=[fff]}] 2024-01-31T05:11:07.567 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.h{1:24461} state up:active seq 6 addr [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] compat {c=[1],r=[1],i=[fff]}] 2024-01-31T05:11:07.567 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.f{1:24427} state up:standby-replay seq 1 addr [v2:172.21.15.181:6834/1038715471,v1:172.21.15.181:6835/1038715471] compat {c=[1],r=[1],i=[fff]}] 2024-01-31T05:11:07.567 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.i{2:24457} state up:active seq 6 addr [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] compat {c=[1],r=[1],i=[fff]}] 2024-01-31T05:11:07.567 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.k{2:24401} state up:standby-replay seq 1 addr [v2:172.21.15.179:6832/472161020,v1:172.21.15.179:6833/472161020] compat {c=[1],r=[1],i=[fff]}] 2024-01-31T05:11:07.567 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.c{3:24439} state up:active seq 8 addr [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] compat {c=[1],r=[1],i=[fff]}] 2024-01-31T05:11:07.567 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.l{3:24376} state up:standby-replay seq 1 addr [v2:172.21.15.181:6832/427201290,v1:172.21.15.181:6833/427201290] compat {c=[1],r=[1],i=[fff]}] 2024-01-31T05:11:07.567 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.a{4:14619} state up:active seq 5 addr [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] compat {c=[1],r=[1],i=[fff]}] 2024-01-31T05:11:07.567 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.g{4:14607} state up:standby-replay seq 1 addr [v2:172.21.15.99:6838/4070477446,v1:172.21.15.99:6839/4070477446] compat {c=[1],r=[1],i=[fff]}] 2024-01-31T05:11:07.567 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:11:07.567 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:11:07.567 INFO:teuthology.orchestra.run.smithi099.stdout:Standby daemons: 2024-01-31T05:11:07.568 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:11:07.568 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.j{-1:14523} state up:standby seq 1 addr [v2:172.21.15.99:6834/1488539026,v1:172.21.15.99:6835/1488539026] compat {c=[1],r=[1],i=[fff]}] 2024-01-31T05:11:07.568 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.d{-1:14535} state up:standby seq 1 addr [v2:172.21.15.99:6836/1649552652,v1:172.21.15.99:6837/1649552652] compat {c=[1],r=[1],i=[fff]}] 2024-01-31T05:11:07.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.567+0000 7fc648088700 1 -- 172.21.15.99:0/2590659902 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc62c0a13f0 msgr2=0x7fc62c0a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:07.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.567+0000 7fc648088700 1 --2- 172.21.15.99:0/2590659902 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc62c0a13f0 0x7fc62c0a38b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc63c005950 tx=0x7fc63c00b410 comp rx=0 tx=0).stop 2024-01-31T05:11:07.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.567+0000 7fc648088700 1 -- 172.21.15.99:0/2590659902 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6400ffb10 msgr2=0x7fc640197700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:07.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.567+0000 7fc648088700 1 --2- 172.21.15.99:0/2590659902 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6400ffb10 0x7fc640197700 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc6300037f0 tx=0x7fc63000f690 comp rx=0 tx=0).stop 2024-01-31T05:11:07.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.567+0000 7fc648088700 1 -- 172.21.15.99:0/2590659902 shutdown_connections 2024-01-31T05:11:07.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.567+0000 7fc648088700 1 --2- 172.21.15.99:0/2590659902 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc62c0a13f0 0x7fc62c0a38b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:07.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.567+0000 7fc648088700 1 --2- 172.21.15.99:0/2590659902 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc640103490 0x7fc64019ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:07.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.567+0000 7fc648088700 1 --2- 172.21.15.99:0/2590659902 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6400ffb10 0x7fc640197700 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:07.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.567+0000 7fc648088700 1 --2- 172.21.15.99:0/2590659902 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc640102af0 0x7fc640197c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:07.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.567+0000 7fc648088700 1 -- 172.21.15.99:0/2590659902 >> 172.21.15.99:0/2590659902 conn(0x7fc6400fb470 msgr2=0x7fc640105e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:07.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.567+0000 7fc648088700 1 -- 172.21.15.99:0/2590659902 shutdown_connections 2024-01-31T05:11:07.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:07.567+0000 7fc648088700 1 -- 172.21.15.99:0/2590659902 wait complete. 2024-01-31T05:11:07.569 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 26 2024-01-31T05:11:07.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:07 smithi099 ceph-mon[31615]: pgmap v341: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-01-31T05:11:07.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:07 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/2590659902' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-01-31T05:11:08.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:07 smithi181 ceph-mon[36434]: pgmap v341: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-01-31T05:11:08.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:07 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/2590659902' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-01-31T05:11:08.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:07 smithi179 ceph-mon[35652]: pgmap v341: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-01-31T05:11:08.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:07 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/2590659902' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-01-31T05:11:08.253 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- bash -c 'ceph osd dump' 2024-01-31T05:11:08.492 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:11:10.015 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:09 smithi099 ceph-mon[31615]: pgmap v342: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-01-31T05:11:10.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:09 smithi181 ceph-mon[36434]: pgmap v342: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-01-31T05:11:10.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:09 smithi179 ceph-mon[35652]: pgmap v342: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-01-31T05:11:10.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.252+0000 7ff8d41b1700 1 -- 172.21.15.99:0/1072691640 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8cc101810 msgr2=0x7ff8cc101c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:10.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.252+0000 7ff8d41b1700 1 --2- 172.21.15.99:0/1072691640 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8cc101810 0x7ff8cc101c30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc0099c0 tx=0x7ff8bc009cd0 comp rx=0 tx=0).stop 2024-01-31T05:11:10.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.252+0000 7ff8d41b1700 1 -- 172.21.15.99:0/1072691640 shutdown_connections 2024-01-31T05:11:10.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.252+0000 7ff8d41b1700 1 --2- 172.21.15.99:0/1072691640 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff8cc1033b0 0x7ff8cc109c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:10.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.252+0000 7ff8d41b1700 1 --2- 172.21.15.99:0/1072691640 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8cc101810 0x7ff8cc101c30 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:10.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.252+0000 7ff8d41b1700 1 --2- 172.21.15.99:0/1072691640 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8cc102a10 0x7ff8cc102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:10.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.252+0000 7ff8d41b1700 1 -- 172.21.15.99:0/1072691640 >> 172.21.15.99:0/1072691640 conn(0x7ff8cc0fcdf0 msgr2=0x7ff8cc0ff210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:10.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.252+0000 7ff8d41b1700 1 -- 172.21.15.99:0/1072691640 shutdown_connections 2024-01-31T05:11:10.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.252+0000 7ff8d41b1700 1 -- 172.21.15.99:0/1072691640 wait complete. 2024-01-31T05:11:10.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.253+0000 7ff8d41b1700 1 Processor -- start 2024-01-31T05:11:10.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.253+0000 7ff8d41b1700 1 -- start start 2024-01-31T05:11:10.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.253+0000 7ff8d41b1700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8cc101810 0x7ff8cc075580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:10.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.253+0000 7ff8d41b1700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff8cc102a10 0x7ff8cc073bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:10.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.253+0000 7ff8d41b1700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8cc1033b0 0x7ff8cc074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:10.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.253+0000 7ff8d41b1700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc074890 con 0x7ff8cc101810 2024-01-31T05:11:10.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.253+0000 7ff8d41b1700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc074a00 con 0x7ff8cc1033b0 2024-01-31T05:11:10.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.253+0000 7ff8d41b1700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc1a1810 con 0x7ff8cc102a10 2024-01-31T05:11:10.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.253+0000 7ff8d1f4d700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8cc101810 0x7ff8cc075580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:10.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.253+0000 7ff8d1f4d700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8cc101810 0x7ff8cc075580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54086/0 (socket says 172.21.15.99:54086) 2024-01-31T05:11:10.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.253+0000 7ff8d1f4d700 1 -- 172.21.15.99:0/1603972611 learned_addr learned my addr 172.21.15.99:0/1603972611 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:10.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.253+0000 7ff8d174c700 1 --2- 172.21.15.99:0/1603972611 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff8cc102a10 0x7ff8cc073bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:10.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.254+0000 7ff8d1f4d700 1 -- 172.21.15.99:0/1603972611 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff8cc102a10 msgr2=0x7ff8cc073bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:10.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.254+0000 7ff8d1f4d700 1 --2- 172.21.15.99:0/1603972611 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff8cc102a10 0x7ff8cc073bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:10.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.254+0000 7ff8d274e700 1 --2- 172.21.15.99:0/1603972611 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8cc1033b0 0x7ff8cc074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:10.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.254+0000 7ff8d1f4d700 1 -- 172.21.15.99:0/1603972611 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8cc1033b0 msgr2=0x7ff8cc074110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:10.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.254+0000 7ff8d1f4d700 1 --2- 172.21.15.99:0/1603972611 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8cc1033b0 0x7ff8cc074110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:10.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.254+0000 7ff8d1f4d700 1 -- 172.21.15.99:0/1603972611 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8bc0095f0 con 0x7ff8cc101810 2024-01-31T05:11:10.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.254+0000 7ff8d274e700 1 --2- 172.21.15.99:0/1603972611 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8cc1033b0 0x7ff8cc074110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:11:10.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.254+0000 7ff8d1f4d700 1 --2- 172.21.15.99:0/1603972611 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8cc101810 0x7ff8cc075580 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc009f50 tx=0x7ff8bc003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:10.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.254+0000 7ff8c2ffd700 1 -- 172.21.15.99:0/1603972611 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc01d070 con 0x7ff8cc101810 2024-01-31T05:11:10.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.254+0000 7ff8d41b1700 1 -- 172.21.15.99:0/1603972611 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8cc1a1a90 con 0x7ff8cc101810 2024-01-31T05:11:10.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.254+0000 7ff8c2ffd700 1 -- 172.21.15.99:0/1603972611 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff8bc022470 con 0x7ff8cc101810 2024-01-31T05:11:10.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.254+0000 7ff8c2ffd700 1 -- 172.21.15.99:0/1603972611 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc022ea0 con 0x7ff8cc101810 2024-01-31T05:11:10.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.254+0000 7ff8d41b1700 1 -- 172.21.15.99:0/1603972611 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8cc1a1f80 con 0x7ff8cc101810 2024-01-31T05:11:10.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.255+0000 7ff8d41b1700 1 -- 172.21.15.99:0/1603972611 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8cc108ca0 con 0x7ff8cc101810 2024-01-31T05:11:10.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.256+0000 7ff8c2ffd700 1 -- 172.21.15.99:0/1603972611 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) v1 ==== 135895+0+0 (secure 0 0 0) 0x7ff8bc022800 con 0x7ff8cc101810 2024-01-31T05:11:10.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.256+0000 7ff8c2ffd700 1 --2- 172.21.15.99:0/1603972611 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff8b80a1370 0x7ff8b80a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:10.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.257+0000 7ff8d174c700 1 --2- 172.21.15.99:0/1603972611 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff8b80a1370 0x7ff8b80a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:10.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.257+0000 7ff8c2ffd700 1 -- 172.21.15.99:0/1603972611 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7ff8bc0ce2b0 con 0x7ff8cc101810 2024-01-31T05:11:10.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.257+0000 7ff8d174c700 1 --2- 172.21.15.99:0/1603972611 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff8b80a1370 0x7ff8b80a3830 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8006fd0 tx=0x7ff8c8008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:10.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.260+0000 7ff8c2ffd700 1 -- 172.21.15.99:0/1603972611 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7ff8bc097880 con 0x7ff8cc101810 2024-01-31T05:11:10.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.453+0000 7ff8d41b1700 1 -- 172.21.15.99:0/1603972611 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7ff8cc0684a0 con 0x7ff8cc101810 2024-01-31T05:11:10.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.454+0000 7ff8c2ffd700 1 -- 172.21.15.99:0/1603972611 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v88) v1 ==== 56+0+5211 (secure 0 0 0) 0x7ff8bc09aea0 con 0x7ff8cc101810 2024-01-31T05:11:10.453 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 88 2024-01-31T05:11:10.454 INFO:teuthology.orchestra.run.smithi099.stdout:fsid 9288ff44-bff5-11ee-95b3-87774f69a715 2024-01-31T05:11:10.454 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-01-31T05:01:26.130917+0000 2024-01-31T05:11:10.454 INFO:teuthology.orchestra.run.smithi099.stdout:modified 2024-01-31T05:10:21.675877+0000 2024-01-31T05:11:10.454 INFO:teuthology.orchestra.run.smithi099.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-01-31T05:11:10.454 INFO:teuthology.orchestra.run.smithi099.stdout:crush_version 26 2024-01-31T05:11:10.454 INFO:teuthology.orchestra.run.smithi099.stdout:full_ratio 0.95 2024-01-31T05:11:10.454 INFO:teuthology.orchestra.run.smithi099.stdout:backfillfull_ratio 0.9 2024-01-31T05:11:10.454 INFO:teuthology.orchestra.run.smithi099.stdout:nearfull_ratio 0.85 2024-01-31T05:11:10.454 INFO:teuthology.orchestra.run.smithi099.stdout:require_min_compat_client luminous 2024-01-31T05:11:10.454 INFO:teuthology.orchestra.run.smithi099.stdout:min_compat_client luminous 2024-01-31T05:11:10.454 INFO:teuthology.orchestra.run.smithi099.stdout:require_osd_release squid 2024-01-31T05:11:10.454 INFO:teuthology.orchestra.run.smithi099.stdout:stretch_mode_enabled false 2024-01-31T05:11:10.454 INFO:teuthology.orchestra.run.smithi099.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-01-31T05:11:10.454 INFO:teuthology.orchestra.run.smithi099.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 85 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-01-31T05:11:10.454 INFO:teuthology.orchestra.run.smithi099.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 86 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-01-31T05:11:10.455 INFO:teuthology.orchestra.run.smithi099.stdout:max_osd 12 2024-01-31T05:11:10.455 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 up in weight 1 up_from 8 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.99:6802/1213805280,v1:172.21.15.99:6803/1213805280] [v2:172.21.15.99:6804/1213805280,v1:172.21.15.99:6805/1213805280] exists,up b45878d9-28f1-4821-ba72-26a32d3fc780 2024-01-31T05:11:10.455 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 up in weight 1 up_from 13 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.179:6800/2019451677,v1:172.21.15.179:6801/2019451677] [v2:172.21.15.179:6802/2019451677,v1:172.21.15.179:6803/2019451677] exists,up e0b71ff3-5d97-4659-8dea-4c9091e1beb3 2024-01-31T05:11:10.455 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 up in weight 1 up_from 18 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.181:6800/3934284457,v1:172.21.15.181:6801/3934284457] [v2:172.21.15.181:6802/3934284457,v1:172.21.15.181:6803/3934284457] exists,up 11c919c8-19a9-48b0-8880-3002efcb64f3 2024-01-31T05:11:10.455 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 up in weight 1 up_from 25 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.99:6810/4207675427,v1:172.21.15.99:6811/4207675427] [v2:172.21.15.99:6812/4207675427,v1:172.21.15.99:6813/4207675427] exists,up bcab5135-a5d1-45ae-a9b8-674425d3999e 2024-01-31T05:11:10.455 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 up in weight 1 up_from 33 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.179:6808/2861083896,v1:172.21.15.179:6809/2861083896] [v2:172.21.15.179:6810/2861083896,v1:172.21.15.179:6811/2861083896] exists,up 0250d7ac-3894-457a-9c04-cc7205d61eca 2024-01-31T05:11:10.455 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 up in weight 1 up_from 38 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.181:6808/1485017095,v1:172.21.15.181:6809/1485017095] [v2:172.21.15.181:6810/1485017095,v1:172.21.15.181:6811/1485017095] exists,up 5e19222a-c2a4-45bc-8445-1d302f26d11c 2024-01-31T05:11:10.455 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6 up in weight 1 up_from 46 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.99:6818/1534047839,v1:172.21.15.99:6819/1534047839] [v2:172.21.15.99:6820/1534047839,v1:172.21.15.99:6821/1534047839] exists,up 56555035-f9fc-4e91-96dd-caa632d58adb 2024-01-31T05:11:10.455 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7 up in weight 1 up_from 51 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.179:6816/3875950553,v1:172.21.15.179:6817/3875950553] [v2:172.21.15.179:6818/3875950553,v1:172.21.15.179:6819/3875950553] exists,up 5e079cf5-1340-4599-88a6-df410ef0148e 2024-01-31T05:11:10.455 INFO:teuthology.orchestra.run.smithi099.stdout:osd.8 up in weight 1 up_from 59 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.181:6816/179568936,v1:172.21.15.181:6817/179568936] [v2:172.21.15.181:6818/179568936,v1:172.21.15.181:6819/179568936] exists,up 10a73592-4251-4492-b67d-ce9b9d7fff32 2024-01-31T05:11:10.455 INFO:teuthology.orchestra.run.smithi099.stdout:osd.9 up in weight 1 up_from 67 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.99:6826/315759515,v1:172.21.15.99:6827/315759515] [v2:172.21.15.99:6828/315759515,v1:172.21.15.99:6829/315759515] exists,up f6620e1e-f761-4f1c-917f-cbc748df32a8 2024-01-31T05:11:10.455 INFO:teuthology.orchestra.run.smithi099.stdout:osd.10 up in weight 1 up_from 73 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.179:6824/2985063934,v1:172.21.15.179:6825/2985063934] [v2:172.21.15.179:6826/2985063934,v1:172.21.15.179:6827/2985063934] exists,up ee86af7d-66f8-4795-bcc3-dfec79e4680c 2024-01-31T05:11:10.455 INFO:teuthology.orchestra.run.smithi099.stdout:osd.11 up in weight 1 up_from 81 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.181:6824/1858219600,v1:172.21.15.181:6825/1858219600] [v2:172.21.15.181:6826/1858219600,v1:172.21.15.181:6827/1858219600] exists,up 82f04fee-f6ae-4630-a75b-b12a9c4ab2e7 2024-01-31T05:11:10.455 INFO:teuthology.orchestra.run.smithi099.stdout:pg_upmap_items 2.a [2,11] 2024-01-31T05:11:10.456 INFO:teuthology.orchestra.run.smithi099.stdout:pg_upmap_items 2.10 [8,11] 2024-01-31T05:11:10.456 INFO:teuthology.orchestra.run.smithi099.stdout:pg_upmap_items 3.13 [4,9] 2024-01-31T05:11:10.456 INFO:teuthology.orchestra.run.smithi099.stdout:pg_upmap_items 3.34 [4,9] 2024-01-31T05:11:10.456 INFO:teuthology.orchestra.run.smithi099.stdout:pg_upmap_items 3.38 [3,9] 2024-01-31T05:11:10.456 INFO:teuthology.orchestra.run.smithi099.stdout:blocklist 172.21.15.99:0/401101729 expires 2024-02-01T05:02:20.510858+0000 2024-01-31T05:11:10.456 INFO:teuthology.orchestra.run.smithi099.stdout:blocklist 172.21.15.99:6801/1993198206 expires 2024-02-01T05:02:20.510858+0000 2024-01-31T05:11:10.456 INFO:teuthology.orchestra.run.smithi099.stdout:blocklist 172.21.15.99:0/3819754569 expires 2024-02-01T05:02:20.510858+0000 2024-01-31T05:11:10.456 INFO:teuthology.orchestra.run.smithi099.stdout:blocklist 172.21.15.99:0/475390265 expires 2024-02-01T05:01:53.732026+0000 2024-01-31T05:11:10.456 INFO:teuthology.orchestra.run.smithi099.stdout:blocklist 172.21.15.99:6800/1993198206 expires 2024-02-01T05:02:20.510858+0000 2024-01-31T05:11:10.456 INFO:teuthology.orchestra.run.smithi099.stdout:blocklist 172.21.15.99:6800/1706888338 expires 2024-02-01T05:01:53.732026+0000 2024-01-31T05:11:10.456 INFO:teuthology.orchestra.run.smithi099.stdout:blocklist 172.21.15.99:0/4150146075 expires 2024-02-01T05:01:53.732026+0000 2024-01-31T05:11:10.456 INFO:teuthology.orchestra.run.smithi099.stdout:blocklist 172.21.15.99:6801/1706888338 expires 2024-02-01T05:01:53.732026+0000 2024-01-31T05:11:10.456 INFO:teuthology.orchestra.run.smithi099.stdout:blocklist 172.21.15.99:0/2851066598 expires 2024-02-01T05:01:53.732026+0000 2024-01-31T05:11:10.456 INFO:teuthology.orchestra.run.smithi099.stdout:blocklist 172.21.15.99:0/1865156424 expires 2024-02-01T05:02:20.510858+0000 2024-01-31T05:11:10.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.456+0000 7ff8d41b1700 1 -- 172.21.15.99:0/1603972611 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff8b80a1370 msgr2=0x7ff8b80a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:10.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.456+0000 7ff8d41b1700 1 --2- 172.21.15.99:0/1603972611 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff8b80a1370 0x7ff8b80a3830 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8006fd0 tx=0x7ff8c8008040 comp rx=0 tx=0).stop 2024-01-31T05:11:10.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.456+0000 7ff8d41b1700 1 -- 172.21.15.99:0/1603972611 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8cc101810 msgr2=0x7ff8cc075580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:10.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.456+0000 7ff8d41b1700 1 --2- 172.21.15.99:0/1603972611 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8cc101810 0x7ff8cc075580 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc009f50 tx=0x7ff8bc003970 comp rx=0 tx=0).stop 2024-01-31T05:11:10.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.456+0000 7ff8d41b1700 1 -- 172.21.15.99:0/1603972611 shutdown_connections 2024-01-31T05:11:10.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.456+0000 7ff8d41b1700 1 --2- 172.21.15.99:0/1603972611 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff8b80a1370 0x7ff8b80a3830 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:10.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.456+0000 7ff8d41b1700 1 --2- 172.21.15.99:0/1603972611 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8cc1033b0 0x7ff8cc074110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:10.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.456+0000 7ff8d41b1700 1 --2- 172.21.15.99:0/1603972611 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8cc101810 0x7ff8cc075580 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:10.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.456+0000 7ff8d41b1700 1 --2- 172.21.15.99:0/1603972611 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff8cc102a10 0x7ff8cc073bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:10.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.456+0000 7ff8d41b1700 1 -- 172.21.15.99:0/1603972611 >> 172.21.15.99:0/1603972611 conn(0x7ff8cc0fcdf0 msgr2=0x7ff8cc105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:10.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.456+0000 7ff8d41b1700 1 -- 172.21.15.99:0/1603972611 shutdown_connections 2024-01-31T05:11:10.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:10.456+0000 7ff8d41b1700 1 -- 172.21.15.99:0/1603972611 wait complete. 2024-01-31T05:11:11.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:10 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/1603972611' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-01-31T05:11:11.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:10 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/1603972611' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-01-31T05:11:11.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:10 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/1603972611' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-01-31T05:11:11.240 INFO:teuthology.run_tasks:Running task fs.ready... 2024-01-31T05:11:11.253 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:11:11.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.358+0000 7fe3f17a7640 1 -- 172.21.15.99:0/2160791560 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3ec1017c0 msgr2=0x7fe3ec108050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:11.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.358+0000 7fe3f17a7640 1 --2- 172.21.15.99:0/2160791560 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3ec1017c0 0x7fe3ec108050 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe3e4009ca0 tx=0x7fe3e402c0f0 comp rx=0 tx=0).stop 2024-01-31T05:11:11.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.359+0000 7fe3f17a7640 1 -- 172.21.15.99:0/2160791560 shutdown_connections 2024-01-31T05:11:11.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.359+0000 7fe3f17a7640 1 --2- 172.21.15.99:0/2160791560 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3ec1017c0 0x7fe3ec108050 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:11.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.359+0000 7fe3f17a7640 1 --2- 172.21.15.99:0/2160791560 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3ec100e00 0x7fe3ec101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:11.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.359+0000 7fe3f17a7640 1 --2- 172.21.15.99:0/2160791560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3ec0ffc10 0x7fe3ec100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:11.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.359+0000 7fe3f17a7640 1 -- 172.21.15.99:0/2160791560 >> 172.21.15.99:0/2160791560 conn(0x7fe3ec0fb180 msgr2=0x7fe3ec0fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:11.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.359+0000 7fe3f17a7640 1 -- 172.21.15.99:0/2160791560 shutdown_connections 2024-01-31T05:11:11.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.359+0000 7fe3f17a7640 1 -- 172.21.15.99:0/2160791560 wait complete. 2024-01-31T05:11:11.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.359+0000 7fe3f17a7640 1 Processor -- start 2024-01-31T05:11:11.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.359+0000 7fe3f17a7640 1 -- start start 2024-01-31T05:11:11.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.359+0000 7fe3f17a7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3ec0ffc10 0x7fe3ec196c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:11.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.359+0000 7fe3f17a7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3ec100e00 0x7fe3ec1971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:11.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.359+0000 7fe3f17a7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3ec1017c0 0x7fe3ec19e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:11.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.359+0000 7fe3f17a7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3ec19e790 con 0x7fe3ec100e00 2024-01-31T05:11:11.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.359+0000 7fe3f17a7640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3ec19e900 con 0x7fe3ec1017c0 2024-01-31T05:11:11.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.359+0000 7fe3f17a7640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3ec19eac0 con 0x7fe3ec0ffc10 2024-01-31T05:11:11.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.360+0000 7fe3ea7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3ec100e00 0x7fe3ec1971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:11.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.360+0000 7fe3ea7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3ec100e00 0x7fe3ec1971c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54112/0 (socket says 172.21.15.99:54112) 2024-01-31T05:11:11.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.360+0000 7fe3ea7fc640 1 -- 172.21.15.99:0/717378186 learned_addr learned my addr 172.21.15.99:0/717378186 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:11.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.360+0000 7fe3eaffd640 1 --2- 172.21.15.99:0/717378186 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3ec0ffc10 0x7fe3ec196c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:11.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.360+0000 7fe3eb7fe640 1 --2- 172.21.15.99:0/717378186 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3ec1017c0 0x7fe3ec19e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:11.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.360+0000 7fe3ea7fc640 1 -- 172.21.15.99:0/717378186 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3ec0ffc10 msgr2=0x7fe3ec196c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:11.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.360+0000 7fe3ea7fc640 1 --2- 172.21.15.99:0/717378186 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3ec0ffc10 0x7fe3ec196c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:11.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.360+0000 7fe3ea7fc640 1 -- 172.21.15.99:0/717378186 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3ec1017c0 msgr2=0x7fe3ec19e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:11.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.360+0000 7fe3ea7fc640 1 --2- 172.21.15.99:0/717378186 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3ec1017c0 0x7fe3ec19e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:11.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.360+0000 7fe3ea7fc640 1 -- 172.21.15.99:0/717378186 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e4009900 con 0x7fe3ec100e00 2024-01-31T05:11:11.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.360+0000 7fe3ea7fc640 1 --2- 172.21.15.99:0/717378186 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3ec100e00 0x7fe3ec1971c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe3e000c970 tx=0x7fe3e000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:11.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.360+0000 7fe3d3fff640 1 -- 172.21.15.99:0/717378186 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e0007bb0 con 0x7fe3ec100e00 2024-01-31T05:11:11.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.360+0000 7fe3d3fff640 1 -- 172.21.15.99:0/717378186 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe3e0007d10 con 0x7fe3ec100e00 2024-01-31T05:11:11.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.360+0000 7fe3d3fff640 1 -- 172.21.15.99:0/717378186 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e0004e40 con 0x7fe3ec100e00 2024-01-31T05:11:11.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.360+0000 7fe3f17a7640 1 -- 172.21.15.99:0/717378186 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3ec19eda0 con 0x7fe3ec100e00 2024-01-31T05:11:11.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.360+0000 7fe3f17a7640 1 -- 172.21.15.99:0/717378186 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3ec19f200 con 0x7fe3ec100e00 2024-01-31T05:11:11.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.361+0000 7fe3f17a7640 1 -- 172.21.15.99:0/717378186 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3ec10b4d0 con 0x7fe3ec100e00 2024-01-31T05:11:11.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.362+0000 7fe3d3fff640 1 -- 172.21.15.99:0/717378186 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) v1 ==== 135895+0+0 (secure 0 0 0) 0x7fe3e0005020 con 0x7fe3ec100e00 2024-01-31T05:11:11.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.363+0000 7fe3d3fff640 1 --2- 172.21.15.99:0/717378186 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe3d40a12e0 0x7fe3d40a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:11.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.363+0000 7fe3eaffd640 1 --2- 172.21.15.99:0/717378186 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe3d40a12e0 0x7fe3d40a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:11.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.363+0000 7fe3d3fff640 1 -- 172.21.15.99:0/717378186 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fe3e00cc7d0 con 0x7fe3ec100e00 2024-01-31T05:11:11.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.363+0000 7fe3eaffd640 1 --2- 172.21.15.99:0/717378186 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe3d40a12e0 0x7fe3d40a37a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec197b50 tx=0x7fe3dc00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:11.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.367+0000 7fe3d3fff640 1 -- 172.21.15.99:0/717378186 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fe3e0095d10 con 0x7fe3ec100e00 2024-01-31T05:11:11.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.543+0000 7fe3f17a7640 1 -- 172.21.15.99:0/717378186 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3ec19f760 con 0x7fe3ec100e00 2024-01-31T05:11:11.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.544+0000 7fe3d3fff640 1 -- 172.21.15.99:0/717378186 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22426 (secure 0 0 0) 0x7fe3e0099330 con 0x7fe3ec100e00 2024-01-31T05:11:11.544 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:11:11.544 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":88,"fsid":"9288ff44-bff5-11ee-95b3-87774f69a715","created":"2024-01-31T05:01:26.130917+0000","modified":"2024-01-31T05:10:21.675877+0000","last_up_change":"2024-01-31T05:08:31.228478+0000","last_in_change":"2024-01-31T05:08:10.799511+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:46.842423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:09:18.693558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-31T05:09:19.734003+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b45878d9-28f1-4821-ba72-26a32d3fc780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6803","nonce":1213805280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6805","nonce":1213805280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6809","nonce":1213805280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6807","nonce":1213805280}]},"public_addr":"172.21.15.99:6803/1213805280","cluster_addr":"172.21.15.99:6805/1213805280","heartbeat_back_addr":"172.21.15.99:6809/1213805280","heartbeat_front_addr":"172.21.15.99:6807/1213805280","state":["exists","up"]},{"osd":1,"uuid":"e0b71ff3-5d97-4659-8dea-4c9091e1beb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6801","nonce":2019451677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6803","nonce":2019451677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6807","nonce":2019451677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6805","nonce":2019451677}]},"public_addr":"172.21.15.179:6801/2019451677","cluster_addr":"172.21.15.179:6803/2019451677","heartbeat_back_addr":"172.21.15.179:6807/2019451677","heartbeat_front_addr":"172.21.15.179:6805/2019451677","state":["exists","up"]},{"osd":2,"uuid":"11c919c8-19a9-48b0-8880-3002efcb64f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6801","nonce":3934284457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6803","nonce":3934284457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6807","nonce":3934284457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6805","nonce":3934284457}]},"public_addr":"172.21.15.181:6801/3934284457","cluster_addr":"172.21.15.181:6803/3934284457","heartbeat_back_addr":"172.21.15.181:6807/3934284457","heartbeat_front_addr":"172.21.15.181:6805/3934284457","state":["exists","up"]},{"osd":3,"uuid":"bcab5135-a5d1-45ae-a9b8-674425d3999e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6811","nonce":4207675427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6813","nonce":4207675427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6817","nonce":4207675427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6815","nonce":4207675427}]},"public_addr":"172.21.15.99:6811/4207675427","cluster_addr":"172.21.15.99:6813/4207675427","heartbeat_back_addr":"172.21.15.99:6817/4207675427","heartbeat_front_addr":"172.21.15.99:6815/4207675427","state":["exists","up"]},{"osd":4,"uuid":"0250d7ac-3894-457a-9c04-cc7205d61eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6809","nonce":2861083896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6811","nonce":2861083896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6815","nonce":2861083896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6813","nonce":2861083896}]},"public_addr":"172.21.15.179:6809/2861083896","cluster_addr":"172.21.15.179:6811/2861083896","heartbeat_back_addr":"172.21.15.179:6815/2861083896","heartbeat_front_addr":"172.21.15.179:6813/2861083896","state":["exists","up"]},{"osd":5,"uuid":"5e19222a-c2a4-45bc-8445-1d302f26d11c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6809","nonce":1485017095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6811","nonce":1485017095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6815","nonce":1485017095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6813","nonce":1485017095}]},"public_addr":"172.21.15.181:6809/1485017095","cluster_addr":"172.21.15.181:6811/1485017095","heartbeat_back_addr":"172.21.15.181:6815/1485017095","heartbeat_front_addr":"172.21.15.181:6813/1485017095","state":["exists","up"]},{"osd":6,"uuid":"56555035-f9fc-4e91-96dd-caa632d58adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6819","nonce":1534047839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6821","nonce":1534047839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6825","nonce":1534047839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6823","nonce":1534047839}]},"public_addr":"172.21.15.99:6819/1534047839","cluster_addr":"172.21.15.99:6821/1534047839","heartbeat_back_addr":"172.21.15.99:6825/1534047839","heartbeat_front_addr":"172.21.15.99:6823/1534047839","state":["exists","up"]},{"osd":7,"uuid":"5e079cf5-1340-4599-88a6-df410ef0148e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6817","nonce":3875950553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6819","nonce":3875950553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6823","nonce":3875950553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6821","nonce":3875950553}]},"public_addr":"172.21.15.179:6817/3875950553","cluster_addr":"172.21.15.179:6819/3875950553","heartbeat_back_addr":"172.21.15.179:6823/3875950553","heartbeat_front_addr":"172.21.15.179:6821/3875950553","state":["exists","up"]},{"osd":8,"uuid":"10a73592-4251-4492-b67d-ce9b9d7fff32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6817","nonce":179568936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6819","nonce":179568936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6823","nonce":179568936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6821","nonce":179568936}]},"public_addr":"172.21.15.181:6817/179568936","cluster_addr":"172.21.15.181:6819/179568936","heartbeat_back_addr":"172.21.15.181:6823/179568936","heartbeat_front_addr":"172.21.15.181:6821/179568936","state":["exists","up"]},{"osd":9,"uuid":"f6620e1e-f761-4f1c-917f-cbc748df32a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6827","nonce":315759515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6829","nonce":315759515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6833","nonce":315759515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6831","nonce":315759515}]},"public_addr":"172.21.15.99:6827/315759515","cluster_addr":"172.21.15.99:6829/315759515","heartbeat_back_addr":"172.21.15.99:6833/315759515","heartbeat_front_addr":"172.21.15.99:6831/315759515","state":["exists","up"]},{"osd":10,"uuid":"ee86af7d-66f8-4795-bcc3-dfec79e4680c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6825","nonce":2985063934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6827","nonce":2985063934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6831","nonce":2985063934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6829","nonce":2985063934}]},"public_addr":"172.21.15.179:6825/2985063934","cluster_addr":"172.21.15.179:6827/2985063934","heartbeat_back_addr":"172.21.15.179:6831/2985063934","heartbeat_front_addr":"172.21.15.179:6829/2985063934","state":["exists","up"]},{"osd":11,"uuid":"82f04fee-f6ae-4630-a75b-b12a9c4ab2e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6825","nonce":1858219600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6827","nonce":1858219600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6831","nonce":1858219600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6829","nonce":1858219600}]},"public_addr":"172.21.15.181:6825/1858219600","cluster_addr":"172.21.15.181:6827/1858219600","heartbeat_back_addr":"172.21.15.181:6831/1858219600","heartbeat_front_addr":"172.21.15.181:6829/1858219600","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:55.518970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:04:19.936339+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:04:44.064814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:09.331683+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:34.616774+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:58.881810+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:06:23.869838+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:06:49.127331+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:07:12.847187+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:07:38.231045+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:08:03.949162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:08:28.471802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:0/401101729":"2024-02-01T05:02:20.510858+0000","172.21.15.99:6801/1993198206":"2024-02-01T05:02:20.510858+0000","172.21.15.99:0/3819754569":"2024-02-01T05:02:20.510858+0000","172.21.15.99:0/475390265":"2024-02-01T05:01:53.732026+0000","172.21.15.99:6800/1993198206":"2024-02-01T05:02:20.510858+0000","172.21.15.99:6800/1706888338":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/4150146075":"2024-02-01T05:01:53.732026+0000","172.21.15.99:6801/1706888338":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/2851066598":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/1865156424":"2024-02-01T05:02:20.510858+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:11:11.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.547+0000 7fe3f17a7640 1 -- 172.21.15.99:0/717378186 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe3d40a12e0 msgr2=0x7fe3d40a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:11.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.547+0000 7fe3f17a7640 1 --2- 172.21.15.99:0/717378186 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe3d40a12e0 0x7fe3d40a37a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec197b50 tx=0x7fe3dc00b390 comp rx=0 tx=0).stop 2024-01-31T05:11:11.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.547+0000 7fe3f17a7640 1 -- 172.21.15.99:0/717378186 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3ec100e00 msgr2=0x7fe3ec1971c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:11.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.547+0000 7fe3f17a7640 1 --2- 172.21.15.99:0/717378186 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3ec100e00 0x7fe3ec1971c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe3e000c970 tx=0x7fe3e000ce30 comp rx=0 tx=0).stop 2024-01-31T05:11:11.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.547+0000 7fe3f17a7640 1 -- 172.21.15.99:0/717378186 shutdown_connections 2024-01-31T05:11:11.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.547+0000 7fe3f17a7640 1 --2- 172.21.15.99:0/717378186 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe3d40a12e0 0x7fe3d40a37a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:11.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.547+0000 7fe3f17a7640 1 --2- 172.21.15.99:0/717378186 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3ec1017c0 0x7fe3ec19e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:11.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.547+0000 7fe3f17a7640 1 --2- 172.21.15.99:0/717378186 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3ec100e00 0x7fe3ec1971c0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:11.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.547+0000 7fe3f17a7640 1 --2- 172.21.15.99:0/717378186 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3ec0ffc10 0x7fe3ec196c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:11.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.547+0000 7fe3f17a7640 1 -- 172.21.15.99:0/717378186 >> 172.21.15.99:0/717378186 conn(0x7fe3ec0fb180 msgr2=0x7fe3ec067e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:11.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.547+0000 7fe3f17a7640 1 -- 172.21.15.99:0/717378186 shutdown_connections 2024-01-31T05:11:11.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.547+0000 7fe3f17a7640 1 -- 172.21.15.99:0/717378186 wait complete. 2024-01-31T05:11:11.558 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-31T05:04:46.842423+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-31T05:09:18.693558+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-31T05:09:19.734003+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-31T05:11:11.558 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-31T05:11:11.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.664+0000 7f91d4fe1640 1 -- 172.21.15.99:0/1831509737 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91d0102960 msgr2=0x7f91d01091f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:11.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.664+0000 7f91d4fe1640 1 --2- 172.21.15.99:0/1831509737 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91d0102960 0x7f91d01091f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f91c8009ca0 tx=0x7f91c802c0f0 comp rx=0 tx=0).stop 2024-01-31T05:11:11.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.664+0000 7f91d4fe1640 1 -- 172.21.15.99:0/1831509737 shutdown_connections 2024-01-31T05:11:11.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.664+0000 7f91d4fe1640 1 --2- 172.21.15.99:0/1831509737 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91d0102960 0x7f91d01091f0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:11.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.664+0000 7f91d4fe1640 1 --2- 172.21.15.99:0/1831509737 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91d0101fa0 0x7f91d0102420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:11.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.664+0000 7f91d4fe1640 1 --2- 172.21.15.99:0/1831509737 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91d00fefd0 0x7f91d00ff3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:11.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.664+0000 7f91d4fe1640 1 -- 172.21.15.99:0/1831509737 >> 172.21.15.99:0/1831509737 conn(0x7f91d00fa900 msgr2=0x7f91d00fcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:11.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.664+0000 7f91d4fe1640 1 -- 172.21.15.99:0/1831509737 shutdown_connections 2024-01-31T05:11:11.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.664+0000 7f91d4fe1640 1 -- 172.21.15.99:0/1831509737 wait complete. 2024-01-31T05:11:11.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.664+0000 7f91d4fe1640 1 Processor -- start 2024-01-31T05:11:11.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.665+0000 7f91d4fe1640 1 -- start start 2024-01-31T05:11:11.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.665+0000 7f91d4fe1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91d00fefd0 0x7f91d0101910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:11.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.665+0000 7f91d4fe1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91d0101fa0 0x7f91d00fff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:11.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.665+0000 7f91d4fe1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91d0102960 0x7f91d0100490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:11.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.665+0000 7f91d4fe1640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d0100bf0 con 0x7f91d00fefd0 2024-01-31T05:11:11.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.665+0000 7f91d4fe1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d0100d60 con 0x7f91d0101fa0 2024-01-31T05:11:11.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.665+0000 7f91d4fe1640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d01a0cd0 con 0x7f91d0102960 2024-01-31T05:11:11.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.665+0000 7f91ce59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91d00fefd0 0x7f91d0101910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:11.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.665+0000 7f91ce59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91d00fefd0 0x7f91d0101910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54140/0 (socket says 172.21.15.99:54140) 2024-01-31T05:11:11.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.665+0000 7f91ce59c640 1 -- 172.21.15.99:0/2997014512 learned_addr learned my addr 172.21.15.99:0/2997014512 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:11.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.665+0000 7f91c5d9b640 1 --2- 172.21.15.99:0/2997014512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91d0101fa0 0x7f91d00fff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:11.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.665+0000 7f91ced9d640 1 --2- 172.21.15.99:0/2997014512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91d0102960 0x7f91d0100490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:11.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.665+0000 7f91ce59c640 1 -- 172.21.15.99:0/2997014512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91d0102960 msgr2=0x7f91d0100490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:11.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.665+0000 7f91ce59c640 1 --2- 172.21.15.99:0/2997014512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91d0102960 0x7f91d0100490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:11.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.665+0000 7f91ce59c640 1 -- 172.21.15.99:0/2997014512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91d0101fa0 msgr2=0x7f91d00fff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:11.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.665+0000 7f91ce59c640 1 --2- 172.21.15.99:0/2997014512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91d0101fa0 0x7f91d00fff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:11.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.665+0000 7f91ce59c640 1 -- 172.21.15.99:0/2997014512 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c8009900 con 0x7f91d00fefd0 2024-01-31T05:11:11.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.665+0000 7f91ce59c640 1 --2- 172.21.15.99:0/2997014512 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91d00fefd0 0x7f91d0101910 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f91c000d980 tx=0x7f91c000de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:11.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.666+0000 7f91c7fff640 1 -- 172.21.15.99:0/2997014512 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c0009c30 con 0x7f91d00fefd0 2024-01-31T05:11:11.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.666+0000 7f91c7fff640 1 -- 172.21.15.99:0/2997014512 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f91c0009d90 con 0x7f91d00fefd0 2024-01-31T05:11:11.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.666+0000 7f91d4fe1640 1 -- 172.21.15.99:0/2997014512 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91d01a0f80 con 0x7f91d00fefd0 2024-01-31T05:11:11.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.666+0000 7f91c7fff640 1 -- 172.21.15.99:0/2997014512 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c000f620 con 0x7f91d00fefd0 2024-01-31T05:11:11.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.666+0000 7f91d4fe1640 1 -- 172.21.15.99:0/2997014512 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91d01a13a0 con 0x7f91d00fefd0 2024-01-31T05:11:11.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.667+0000 7f91d4fe1640 1 -- 172.21.15.99:0/2997014512 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91d01080d0 con 0x7f91d00fefd0 2024-01-31T05:11:11.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.668+0000 7f91c7fff640 1 -- 172.21.15.99:0/2997014512 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f91c0010460 con 0x7f91d00fefd0 2024-01-31T05:11:11.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.668+0000 7f91c7fff640 1 --2- 172.21.15.99:0/2997014512 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f91bc0a12e0 0x7f91bc0a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:11.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.668+0000 7f91c5d9b640 1 --2- 172.21.15.99:0/2997014512 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f91bc0a12e0 0x7f91bc0a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:11.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.668+0000 7f91c7fff640 1 -- 172.21.15.99:0/2997014512 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f91c00cc800 con 0x7f91d00fefd0 2024-01-31T05:11:11.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.668+0000 7f91c5d9b640 1 --2- 172.21.15.99:0/2997014512 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f91bc0a12e0 0x7f91bc0a37a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f91d0101680 tx=0x7f91b800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:11.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.672+0000 7f91c7fff640 1 -- 172.21.15.99:0/2997014512 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f91c0095d40 con 0x7f91d00fefd0 2024-01-31T05:11:11.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:11 smithi099 ceph-mon[31615]: pgmap v343: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-01-31T05:11:11.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:11 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/717378186' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:11:11.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.845+0000 7f91d4fe1640 1 -- 172.21.15.99:0/2997014512 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f91d010c840 con 0x7f91d00fefd0 2024-01-31T05:11:11.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.846+0000 7f91c7fff640 1 -- 172.21.15.99:0/2997014512 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f91c0099360 con 0x7f91d00fefd0 2024-01-31T05:11:11.845 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-01-31T05:11:11.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.847+0000 7f91d4fe1640 1 -- 172.21.15.99:0/2997014512 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f91bc0a12e0 msgr2=0x7f91bc0a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:11.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.847+0000 7f91d4fe1640 1 --2- 172.21.15.99:0/2997014512 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f91bc0a12e0 0x7f91bc0a37a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f91d0101680 tx=0x7f91b800b390 comp rx=0 tx=0).stop 2024-01-31T05:11:11.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.847+0000 7f91d4fe1640 1 -- 172.21.15.99:0/2997014512 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91d00fefd0 msgr2=0x7f91d0101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:11.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.847+0000 7f91d4fe1640 1 --2- 172.21.15.99:0/2997014512 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91d00fefd0 0x7f91d0101910 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f91c000d980 tx=0x7f91c000de40 comp rx=0 tx=0).stop 2024-01-31T05:11:11.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.847+0000 7f91d4fe1640 1 -- 172.21.15.99:0/2997014512 shutdown_connections 2024-01-31T05:11:11.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.847+0000 7f91d4fe1640 1 --2- 172.21.15.99:0/2997014512 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f91bc0a12e0 0x7f91bc0a37a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:11.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.847+0000 7f91d4fe1640 1 --2- 172.21.15.99:0/2997014512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f91d0102960 0x7f91d0100490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:11.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.847+0000 7f91d4fe1640 1 --2- 172.21.15.99:0/2997014512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91d0101fa0 0x7f91d00fff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:11.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.847+0000 7f91d4fe1640 1 --2- 172.21.15.99:0/2997014512 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91d00fefd0 0x7f91d0101910 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:11.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.847+0000 7f91d4fe1640 1 -- 172.21.15.99:0/2997014512 >> 172.21.15.99:0/2997014512 conn(0x7f91d00fa900 msgr2=0x7f91d01052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:11.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.848+0000 7f91d4fe1640 1 -- 172.21.15.99:0/2997014512 shutdown_connections 2024-01-31T05:11:11.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.848+0000 7f91d4fe1640 1 -- 172.21.15.99:0/2997014512 wait complete. 2024-01-31T05:11:11.858 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-31T05:11:11.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.963+0000 7f6151e5e640 1 -- 172.21.15.99:0/3517934085 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f614c1028b0 msgr2=0x7f614c109140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:11.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.963+0000 7f6151e5e640 1 --2- 172.21.15.99:0/3517934085 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f614c1028b0 0x7f614c109140 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6144009ca0 tx=0x7f614402c0f0 comp rx=0 tx=0).stop 2024-01-31T05:11:11.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.963+0000 7f6151e5e640 1 -- 172.21.15.99:0/3517934085 shutdown_connections 2024-01-31T05:11:11.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.963+0000 7f6151e5e640 1 --2- 172.21.15.99:0/3517934085 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f614c1028b0 0x7f614c109140 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:11.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.963+0000 7f6151e5e640 1 --2- 172.21.15.99:0/3517934085 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f614c101ef0 0x7f614c102370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:11.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.963+0000 7f6151e5e640 1 --2- 172.21.15.99:0/3517934085 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f614c100d00 0x7f614c101120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:11.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.963+0000 7f6151e5e640 1 -- 172.21.15.99:0/3517934085 >> 172.21.15.99:0/3517934085 conn(0x7f614c0fc290 msgr2=0x7f614c0fe6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:11.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.963+0000 7f6151e5e640 1 -- 172.21.15.99:0/3517934085 shutdown_connections 2024-01-31T05:11:11.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.963+0000 7f6151e5e640 1 -- 172.21.15.99:0/3517934085 wait complete. 2024-01-31T05:11:11.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.964+0000 7f6151e5e640 1 Processor -- start 2024-01-31T05:11:11.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.964+0000 7f6151e5e640 1 -- start start 2024-01-31T05:11:11.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.964+0000 7f6151e5e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f614c100d00 0x7f614c196d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:11.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.964+0000 7f6151e5e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f614c101ef0 0x7f614c197260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:11.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.964+0000 7f6151e5e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f614c1028b0 0x7f614c19e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:11.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.964+0000 7f6151e5e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614c19e800 con 0x7f614c101ef0 2024-01-31T05:11:11.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.964+0000 7f6151e5e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614c19e970 con 0x7f614c100d00 2024-01-31T05:11:11.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.964+0000 7f6151e5e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614c19eb30 con 0x7f614c1028b0 2024-01-31T05:11:11.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.964+0000 7f614affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f614c101ef0 0x7f614c197260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:11.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.964+0000 7f614affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f614c101ef0 0x7f614c197260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54148/0 (socket says 172.21.15.99:54148) 2024-01-31T05:11:11.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.964+0000 7f614affd640 1 -- 172.21.15.99:0/908889343 learned_addr learned my addr 172.21.15.99:0/908889343 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:11.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.964+0000 7f614bfff640 1 --2- 172.21.15.99:0/908889343 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f614c1028b0 0x7f614c19e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:11.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.964+0000 7f614b7fe640 1 --2- 172.21.15.99:0/908889343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f614c100d00 0x7f614c196d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:11.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.964+0000 7f614affd640 1 -- 172.21.15.99:0/908889343 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f614c1028b0 msgr2=0x7f614c19e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:11.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.964+0000 7f614affd640 1 --2- 172.21.15.99:0/908889343 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f614c1028b0 0x7f614c19e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:11.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.964+0000 7f614affd640 1 -- 172.21.15.99:0/908889343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f614c100d00 msgr2=0x7f614c196d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:11.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.964+0000 7f614affd640 1 --2- 172.21.15.99:0/908889343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f614c100d00 0x7f614c196d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:11.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.964+0000 7f614affd640 1 -- 172.21.15.99:0/908889343 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6144009900 con 0x7f614c101ef0 2024-01-31T05:11:11.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.964+0000 7f614b7fe640 1 --2- 172.21.15.99:0/908889343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f614c100d00 0x7f614c196d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:11:11.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.964+0000 7f614affd640 1 --2- 172.21.15.99:0/908889343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f614c101ef0 0x7f614c197260 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f614000d950 tx=0x7f614000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:11.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.965+0000 7f6148ff9640 1 -- 172.21.15.99:0/908889343 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6140009a30 con 0x7f614c101ef0 2024-01-31T05:11:11.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.965+0000 7f6148ff9640 1 -- 172.21.15.99:0/908889343 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6140009b90 con 0x7f614c101ef0 2024-01-31T05:11:11.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.965+0000 7f6148ff9640 1 -- 172.21.15.99:0/908889343 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61400047a0 con 0x7f614c101ef0 2024-01-31T05:11:11.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.965+0000 7f6151e5e640 1 -- 172.21.15.99:0/908889343 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f614c19ee10 con 0x7f614c101ef0 2024-01-31T05:11:11.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.965+0000 7f6151e5e640 1 -- 172.21.15.99:0/908889343 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f614c19f290 con 0x7f614c101ef0 2024-01-31T05:11:11.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.966+0000 7f6151e5e640 1 -- 172.21.15.99:0/908889343 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f614c1080c0 con 0x7f614c101ef0 2024-01-31T05:11:11.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.967+0000 7f6148ff9640 1 -- 172.21.15.99:0/908889343 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f6140009d00 con 0x7f614c101ef0 2024-01-31T05:11:11.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.967+0000 7f6148ff9640 1 --2- 172.21.15.99:0/908889343 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f61340a1360 0x7f61340a3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:11.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.967+0000 7f614b7fe640 1 --2- 172.21.15.99:0/908889343 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f61340a1360 0x7f61340a3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:11.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.967+0000 7f6148ff9640 1 -- 172.21.15.99:0/908889343 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f61400cc600 con 0x7f614c101ef0 2024-01-31T05:11:11.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.968+0000 7f614b7fe640 1 --2- 172.21.15.99:0/908889343 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f61340a1360 0x7f61340a3820 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f614c1981f0 tx=0x7f613c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:11.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:11.971+0000 7f6148ff9640 1 -- 172.21.15.99:0/908889343 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f6140095ab0 con 0x7f614c101ef0 2024-01-31T05:11:12.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:11 smithi181 ceph-mon[36434]: pgmap v343: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-01-31T05:11:12.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:11 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/717378186' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:11:12.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:11 smithi179 ceph-mon[35652]: pgmap v343: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-01-31T05:11:12.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:11 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/717378186' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:11:12.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.142+0000 7f6151e5e640 1 -- 172.21.15.99:0/908889343 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f614c10c880 con 0x7f614c101ef0 2024-01-31T05:11:12.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.142+0000 7f6148ff9640 1 -- 172.21.15.99:0/908889343 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f61400979e0 con 0x7f614c101ef0 2024-01-31T05:11:12.141 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-01-31T05:11:12.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.144+0000 7f6151e5e640 1 -- 172.21.15.99:0/908889343 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f61340a1360 msgr2=0x7f61340a3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:12.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.144+0000 7f6151e5e640 1 --2- 172.21.15.99:0/908889343 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f61340a1360 0x7f61340a3820 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f614c1981f0 tx=0x7f613c008040 comp rx=0 tx=0).stop 2024-01-31T05:11:12.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.144+0000 7f6151e5e640 1 -- 172.21.15.99:0/908889343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f614c101ef0 msgr2=0x7f614c197260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:12.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.144+0000 7f6151e5e640 1 --2- 172.21.15.99:0/908889343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f614c101ef0 0x7f614c197260 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f614000d950 tx=0x7f614000de10 comp rx=0 tx=0).stop 2024-01-31T05:11:12.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.144+0000 7f6151e5e640 1 -- 172.21.15.99:0/908889343 shutdown_connections 2024-01-31T05:11:12.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.144+0000 7f6151e5e640 1 --2- 172.21.15.99:0/908889343 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f61340a1360 0x7f61340a3820 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:12.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.144+0000 7f6151e5e640 1 --2- 172.21.15.99:0/908889343 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f614c1028b0 0x7f614c19e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:12.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.144+0000 7f6151e5e640 1 --2- 172.21.15.99:0/908889343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f614c101ef0 0x7f614c197260 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:12.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.144+0000 7f6151e5e640 1 --2- 172.21.15.99:0/908889343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f614c100d00 0x7f614c196d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:12.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.144+0000 7f6151e5e640 1 -- 172.21.15.99:0/908889343 >> 172.21.15.99:0/908889343 conn(0x7f614c0fc290 msgr2=0x7f614c105290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:12.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.144+0000 7f6151e5e640 1 -- 172.21.15.99:0/908889343 shutdown_connections 2024-01-31T05:11:12.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.144+0000 7f6151e5e640 1 -- 172.21.15.99:0/908889343 wait complete. 2024-01-31T05:11:12.154 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-31T05:11:12.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.260+0000 7f5affbee640 1 -- 172.21.15.99:0/268629047 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5af80ff5e0 msgr2=0x7f5af80ffa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:12.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.260+0000 7f5affbee640 1 --2- 172.21.15.99:0/268629047 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5af80ff5e0 0x7f5af80ffa00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8009ca0 tx=0x7f5ae802c180 comp rx=0 tx=0).stop 2024-01-31T05:11:12.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.260+0000 7f5affbee640 1 -- 172.21.15.99:0/268629047 shutdown_connections 2024-01-31T05:11:12.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.260+0000 7f5affbee640 1 --2- 172.21.15.99:0/268629047 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5af81008e0 0x7f5af8100d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:12.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.260+0000 7f5affbee640 1 --2- 172.21.15.99:0/268629047 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5af80fff40 0x7f5af81003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:12.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.260+0000 7f5affbee640 1 --2- 172.21.15.99:0/268629047 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5af80ff5e0 0x7f5af80ffa00 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:12.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.260+0000 7f5affbee640 1 -- 172.21.15.99:0/268629047 >> 172.21.15.99:0/268629047 conn(0x7f5af80fb180 msgr2=0x7f5af80fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:12.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.261+0000 7f5affbee640 1 -- 172.21.15.99:0/268629047 shutdown_connections 2024-01-31T05:11:12.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.261+0000 7f5affbee640 1 -- 172.21.15.99:0/268629047 wait complete. 2024-01-31T05:11:12.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.261+0000 7f5affbee640 1 Processor -- start 2024-01-31T05:11:12.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.261+0000 7f5affbee640 1 -- start start 2024-01-31T05:11:12.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.261+0000 7f5affbee640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5af80ff5e0 0x7f5af8198f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:12.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.261+0000 7f5affbee640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5af80fff40 0x7f5af81994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:12.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.261+0000 7f5affbee640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5af81008e0 0x7f5af81a0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:12.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.261+0000 7f5affbee640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af81a0a50 con 0x7f5af80fff40 2024-01-31T05:11:12.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.261+0000 7f5affbee640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af81a0bc0 con 0x7f5af80ff5e0 2024-01-31T05:11:12.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.261+0000 7f5affbee640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af81a0d80 con 0x7f5af81008e0 2024-01-31T05:11:12.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.261+0000 7f5afd189640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5af80fff40 0x7f5af81994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:12.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.261+0000 7f5afd189640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5af80fff40 0x7f5af81994a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54174/0 (socket says 172.21.15.99:54174) 2024-01-31T05:11:12.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.261+0000 7f5afd189640 1 -- 172.21.15.99:0/3884651514 learned_addr learned my addr 172.21.15.99:0/3884651514 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:12.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.261+0000 7f5afe18b640 1 --2- 172.21.15.99:0/3884651514 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5af81008e0 0x7f5af81a0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:12.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.261+0000 7f5afd189640 1 -- 172.21.15.99:0/3884651514 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5af81008e0 msgr2=0x7f5af81a0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:12.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.262+0000 7f5afd189640 1 --2- 172.21.15.99:0/3884651514 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5af81008e0 0x7f5af81a0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:12.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.262+0000 7f5afd189640 1 -- 172.21.15.99:0/3884651514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5af80ff5e0 msgr2=0x7f5af8198f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:12.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.262+0000 7f5afd98a640 1 --2- 172.21.15.99:0/3884651514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5af80ff5e0 0x7f5af8198f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:12.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.262+0000 7f5afd189640 1 --2- 172.21.15.99:0/3884651514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5af80ff5e0 0x7f5af8198f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:12.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.262+0000 7f5afd189640 1 -- 172.21.15.99:0/3884651514 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae8009900 con 0x7f5af80fff40 2024-01-31T05:11:12.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.262+0000 7f5afd98a640 1 --2- 172.21.15.99:0/3884651514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5af80ff5e0 0x7f5af8198f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:11:12.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.262+0000 7f5afd189640 1 --2- 172.21.15.99:0/3884651514 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5af80fff40 0x7f5af81994a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f5aec00b4a0 tx=0x7f5aec00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:12.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.262+0000 7f5af6ffd640 1 -- 172.21.15.99:0/3884651514 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec010610 con 0x7f5af80fff40 2024-01-31T05:11:12.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.262+0000 7f5af6ffd640 1 -- 172.21.15.99:0/3884651514 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5aec010c30 con 0x7f5af80fff40 2024-01-31T05:11:12.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.262+0000 7f5affbee640 1 -- 172.21.15.99:0/3884651514 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5af81a1060 con 0x7f5af80fff40 2024-01-31T05:11:12.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.262+0000 7f5af6ffd640 1 -- 172.21.15.99:0/3884651514 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec017dd0 con 0x7f5af80fff40 2024-01-31T05:11:12.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.262+0000 7f5affbee640 1 -- 172.21.15.99:0/3884651514 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5af81a1570 con 0x7f5af80fff40 2024-01-31T05:11:12.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.263+0000 7f5affbee640 1 -- 172.21.15.99:0/3884651514 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5af810a590 con 0x7f5af80fff40 2024-01-31T05:11:12.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.264+0000 7f5af6ffd640 1 -- 172.21.15.99:0/3884651514 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f5aec0173f0 con 0x7f5af80fff40 2024-01-31T05:11:12.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.264+0000 7f5af6ffd640 1 --2- 172.21.15.99:0/3884651514 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f5ae00a12e0 0x7f5ae00a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:12.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.264+0000 7f5afd98a640 1 --2- 172.21.15.99:0/3884651514 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f5ae00a12e0 0x7f5ae00a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:12.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.264+0000 7f5af6ffd640 1 -- 172.21.15.99:0/3884651514 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f5aec0cc5b0 con 0x7f5af80fff40 2024-01-31T05:11:12.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.265+0000 7f5afd98a640 1 --2- 172.21.15.99:0/3884651514 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f5ae00a12e0 0x7f5ae00a37a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8006010 tx=0x7f5ae80093f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:12.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.268+0000 7f5af6ffd640 1 -- 172.21.15.99:0/3884651514 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f5aec095af0 con 0x7f5af80fff40 2024-01-31T05:11:12.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.439+0000 7f5affbee640 1 -- 172.21.15.99:0/3884651514 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5af810ea70 con 0x7f5af80fff40 2024-01-31T05:11:12.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.439+0000 7f5af6ffd640 1 -- 172.21.15.99:0/3884651514 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5aec0092b0 con 0x7f5af80fff40 2024-01-31T05:11:12.440 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 64 2024-01-31T05:11:12.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.441+0000 7f5affbee640 1 -- 172.21.15.99:0/3884651514 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f5ae00a12e0 msgr2=0x7f5ae00a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:12.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.441+0000 7f5affbee640 1 --2- 172.21.15.99:0/3884651514 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f5ae00a12e0 0x7f5ae00a37a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8006010 tx=0x7f5ae80093f0 comp rx=0 tx=0).stop 2024-01-31T05:11:12.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.441+0000 7f5affbee640 1 -- 172.21.15.99:0/3884651514 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5af80fff40 msgr2=0x7f5af81994a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:12.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.441+0000 7f5affbee640 1 --2- 172.21.15.99:0/3884651514 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5af80fff40 0x7f5af81994a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f5aec00b4a0 tx=0x7f5aec00b960 comp rx=0 tx=0).stop 2024-01-31T05:11:12.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.441+0000 7f5affbee640 1 -- 172.21.15.99:0/3884651514 shutdown_connections 2024-01-31T05:11:12.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.441+0000 7f5affbee640 1 --2- 172.21.15.99:0/3884651514 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f5ae00a12e0 0x7f5ae00a37a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:12.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.441+0000 7f5affbee640 1 --2- 172.21.15.99:0/3884651514 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5af81008e0 0x7f5af81a0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:12.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.441+0000 7f5affbee640 1 --2- 172.21.15.99:0/3884651514 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5af80fff40 0x7f5af81994a0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:12.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.441+0000 7f5affbee640 1 --2- 172.21.15.99:0/3884651514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5af80ff5e0 0x7f5af8198f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:12.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.441+0000 7f5affbee640 1 -- 172.21.15.99:0/3884651514 >> 172.21.15.99:0/3884651514 conn(0x7f5af80fb180 msgr2=0x7f5af80fc990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:12.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.441+0000 7f5affbee640 1 -- 172.21.15.99:0/3884651514 shutdown_connections 2024-01-31T05:11:12.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.441+0000 7f5affbee640 1 -- 172.21.15.99:0/3884651514 wait complete. 2024-01-31T05:11:12.453 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T05:11:12.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.554+0000 7f29fc565640 1 -- 172.21.15.99:0/3409432483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29f4100e80 msgr2=0x7f29f4101300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:12.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.554+0000 7f29fc565640 1 --2- 172.21.15.99:0/3409432483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29f4100e80 0x7f29f4101300 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f29e4009900 tx=0x7f29e402bc30 comp rx=0 tx=0).stop 2024-01-31T05:11:12.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.554+0000 7f29fc565640 1 -- 172.21.15.99:0/3409432483 shutdown_connections 2024-01-31T05:11:12.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.554+0000 7f29fc565640 1 --2- 172.21.15.99:0/3409432483 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f29f4101840 0x7f29f41080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:12.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.554+0000 7f29fc565640 1 --2- 172.21.15.99:0/3409432483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29f4100e80 0x7f29f4101300 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:12.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.554+0000 7f29fc565640 1 --2- 172.21.15.99:0/3409432483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29f40ffc90 0x7f29f41000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:12.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.554+0000 7f29fc565640 1 -- 172.21.15.99:0/3409432483 >> 172.21.15.99:0/3409432483 conn(0x7f29f40fb220 msgr2=0x7f29f40fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:12.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.554+0000 7f29fc565640 1 -- 172.21.15.99:0/3409432483 shutdown_connections 2024-01-31T05:11:12.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.554+0000 7f29fc565640 1 -- 172.21.15.99:0/3409432483 wait complete. 2024-01-31T05:11:12.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.554+0000 7f29fc565640 1 Processor -- start 2024-01-31T05:11:12.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.555+0000 7f29fc565640 1 -- start start 2024-01-31T05:11:12.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.555+0000 7f29fc565640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f29f40ffc90 0x7f29f4196cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:12.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.555+0000 7f29fc565640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29f4100e80 0x7f29f41971f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:12.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.555+0000 7f29fc565640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29f4101840 0x7f29f419e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:12.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.555+0000 7f29fc565640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f419e7c0 con 0x7f29f4101840 2024-01-31T05:11:12.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.555+0000 7f29fc565640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f419e930 con 0x7f29f4100e80 2024-01-31T05:11:12.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.555+0000 7f29fc565640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f419eaf0 con 0x7f29f40ffc90 2024-01-31T05:11:12.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.555+0000 7f29fab02640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29f4101840 0x7f29f419e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:12.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.555+0000 7f29fab02640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29f4101840 0x7f29f419e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54194/0 (socket says 172.21.15.99:54194) 2024-01-31T05:11:12.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.555+0000 7f29fab02640 1 -- 172.21.15.99:0/1663407697 learned_addr learned my addr 172.21.15.99:0/1663407697 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:12.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.555+0000 7f29f9b00640 1 --2- 172.21.15.99:0/1663407697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29f4100e80 0x7f29f41971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:12.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.555+0000 7f29fa301640 1 --2- 172.21.15.99:0/1663407697 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f29f40ffc90 0x7f29f4196cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:12.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.555+0000 7f29fab02640 1 -- 172.21.15.99:0/1663407697 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f29f40ffc90 msgr2=0x7f29f4196cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:12.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.555+0000 7f29fab02640 1 --2- 172.21.15.99:0/1663407697 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f29f40ffc90 0x7f29f4196cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:12.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.555+0000 7f29fab02640 1 -- 172.21.15.99:0/1663407697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29f4100e80 msgr2=0x7f29f41971f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:12.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.555+0000 7f29fab02640 1 --2- 172.21.15.99:0/1663407697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29f4100e80 0x7f29f41971f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:12.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.555+0000 7f29fab02640 1 -- 172.21.15.99:0/1663407697 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e4009560 con 0x7f29f4101840 2024-01-31T05:11:12.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.555+0000 7f29fab02640 1 --2- 172.21.15.99:0/1663407697 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29f4101840 0x7f29f419e250 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f29f000eaa0 tx=0x7f29f000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:12.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.555+0000 7f29eb7fe640 1 -- 172.21.15.99:0/1663407697 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f000cdb0 con 0x7f29f4101840 2024-01-31T05:11:12.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.555+0000 7f29eb7fe640 1 -- 172.21.15.99:0/1663407697 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f29f0005020 con 0x7f29f4101840 2024-01-31T05:11:12.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.555+0000 7f29fc565640 1 -- 172.21.15.99:0/1663407697 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f419edd0 con 0x7f29f4101840 2024-01-31T05:11:12.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.555+0000 7f29eb7fe640 1 -- 172.21.15.99:0/1663407697 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f00116d0 con 0x7f29f4101840 2024-01-31T05:11:12.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.556+0000 7f29fc565640 1 -- 172.21.15.99:0/1663407697 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f419f250 con 0x7f29f4101840 2024-01-31T05:11:12.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.556+0000 7f29fc565640 1 -- 172.21.15.99:0/1663407697 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29f410b4e0 con 0x7f29f4101840 2024-01-31T05:11:12.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.557+0000 7f29eb7fe640 1 -- 172.21.15.99:0/1663407697 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f29f0005190 con 0x7f29f4101840 2024-01-31T05:11:12.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.558+0000 7f29eb7fe640 1 --2- 172.21.15.99:0/1663407697 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f29e00a1360 0x7f29e00a3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:12.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.558+0000 7f29fa301640 1 --2- 172.21.15.99:0/1663407697 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f29e00a1360 0x7f29e00a3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:12.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.558+0000 7f29eb7fe640 1 -- 172.21.15.99:0/1663407697 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f29f00ccae0 con 0x7f29f4101840 2024-01-31T05:11:12.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.559+0000 7f29fa301640 1 --2- 172.21.15.99:0/1663407697 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f29e00a1360 0x7f29e00a3820 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f29f4197b80 tx=0x7f29ec00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:12.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.563+0000 7f29eb7fe640 1 -- 172.21.15.99:0/1663407697 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f29f00960d0 con 0x7f29f4101840 2024-01-31T05:11:12.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.777+0000 7f29fc565640 1 -- 172.21.15.99:0/1663407697 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f29f419f630 con 0x7f29f4101840 2024-01-31T05:11:12.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.777+0000 7f29eb7fe640 1 -- 172.21.15.99:0/1663407697 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11385 (secure 0 0 0) 0x7f29f001f020 con 0x7f29f4101840 2024-01-31T05:11:12.778 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:11:12.778 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/1488539026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1488539026},{"type":"v1","addr":"172.21.15.99:6835","nonce":1488539026}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/1649552652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1649552652},{"type":"v1","addr":"172.21.15.99:6837","nonce":1649552652}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-01-31T05:09:20.564215+0000","modified":"2024-01-31T05:09:28.172314+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24461,"mds_2":24457,"mds_3":24439,"mds_4":14619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6839/4070477446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4070477446},{"type":"v1","addr":"172.21.15.99:6839","nonce":4070477446}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.99:6841/3069939345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6840","nonce":3069939345},{"type":"v1","addr":"172.21.15.99:6841","nonce":3069939345}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24376":{"gid":24376,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6833/427201290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":427201290},{"type":"v1","addr":"172.21.15.181:6833","nonce":427201290}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24401":{"gid":24401,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/472161020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":472161020},{"type":"v1","addr":"172.21.15.179:6833","nonce":472161020}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24427":{"gid":24427,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/1038715471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1038715471},{"type":"v1","addr":"172.21.15.181:6835","nonce":1038715471}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24434":{"gid":24434,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/966976592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":966976592},{"type":"v1","addr":"172.21.15.179:6835","nonce":966976592}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24439":{"gid":24439,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.181:6837/3875964154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3875964154},{"type":"v1","addr":"172.21.15.181:6837","nonce":3875964154}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24457":{"gid":24457,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.181:6839/996120687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":996120687},{"type":"v1","addr":"172.21.15.181:6839","nonce":996120687}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6837/837402830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":837402830},{"type":"v1","addr":"172.21.15.179:6837","nonce":837402830}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6839/754762785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":754762785},{"type":"v1","addr":"172.21.15.179:6839","nonce":754762785}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-31T05:11:12.778 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 26 2024-01-31T05:11:12.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.779+0000 7f29fc565640 1 -- 172.21.15.99:0/1663407697 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f29e00a1360 msgr2=0x7f29e00a3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:12.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.779+0000 7f29fc565640 1 --2- 172.21.15.99:0/1663407697 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f29e00a1360 0x7f29e00a3820 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f29f4197b80 tx=0x7f29ec00b410 comp rx=0 tx=0).stop 2024-01-31T05:11:12.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.779+0000 7f29fc565640 1 -- 172.21.15.99:0/1663407697 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29f4101840 msgr2=0x7f29f419e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:12.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.779+0000 7f29fc565640 1 --2- 172.21.15.99:0/1663407697 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29f4101840 0x7f29f419e250 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f29f000eaa0 tx=0x7f29f000ef60 comp rx=0 tx=0).stop 2024-01-31T05:11:12.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.779+0000 7f29fc565640 1 -- 172.21.15.99:0/1663407697 shutdown_connections 2024-01-31T05:11:12.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.779+0000 7f29fc565640 1 --2- 172.21.15.99:0/1663407697 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f29e00a1360 0x7f29e00a3820 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:12.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.779+0000 7f29fc565640 1 --2- 172.21.15.99:0/1663407697 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29f4101840 0x7f29f419e250 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:12.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.779+0000 7f29fc565640 1 --2- 172.21.15.99:0/1663407697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29f4100e80 0x7f29f41971f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:12.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.779+0000 7f29fc565640 1 --2- 172.21.15.99:0/1663407697 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f29f40ffc90 0x7f29f4196cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:12.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.779+0000 7f29fc565640 1 -- 172.21.15.99:0/1663407697 >> 172.21.15.99:0/1663407697 conn(0x7f29f40fb220 msgr2=0x7f29f4069300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:12.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.779+0000 7f29fc565640 1 -- 172.21.15.99:0/1663407697 shutdown_connections 2024-01-31T05:11:12.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.779+0000 7f29fc565640 1 -- 172.21.15.99:0/1663407697 wait complete. 2024-01-31T05:11:12.791 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:11:12.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.892+0000 7f02a174c640 1 -- 172.21.15.99:0/1108121375 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f029c101790 msgr2=0x7f029c103b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:12.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.892+0000 7f02a174c640 1 --2- 172.21.15.99:0/1108121375 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f029c101790 0x7f029c103b80 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f028c009900 tx=0x7f028c02bc30 comp rx=0 tx=0).stop 2024-01-31T05:11:12.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.892+0000 7f02a174c640 1 -- 172.21.15.99:0/1108121375 shutdown_connections 2024-01-31T05:11:12.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.892+0000 7f02a174c640 1 --2- 172.21.15.99:0/1108121375 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f029c1069f0 0x7f029c108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:12.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.892+0000 7f02a174c640 1 --2- 172.21.15.99:0/1108121375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f029c1040c0 0x7f029c1064b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:12.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.892+0000 7f02a174c640 1 --2- 172.21.15.99:0/1108121375 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f029c101790 0x7f029c103b80 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:12.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.892+0000 7f02a174c640 1 -- 172.21.15.99:0/1108121375 >> 172.21.15.99:0/1108121375 conn(0x7f029c0fb180 msgr2=0x7f029c0fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:12.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.892+0000 7f02a174c640 1 -- 172.21.15.99:0/1108121375 shutdown_connections 2024-01-31T05:11:12.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.892+0000 7f02a174c640 1 -- 172.21.15.99:0/1108121375 wait complete. 2024-01-31T05:11:12.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.893+0000 7f02a174c640 1 Processor -- start 2024-01-31T05:11:12.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.893+0000 7f02a174c640 1 -- start start 2024-01-31T05:11:12.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.893+0000 7f02a174c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f029c101790 0x7f029c196cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:12.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.893+0000 7f02a174c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f029c1040c0 0x7f029c197230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:12.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.893+0000 7f02a174c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f029c1069f0 0x7f029c19e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:12.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.893+0000 7f02a174c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029c19e7d0 con 0x7f029c101790 2024-01-31T05:11:12.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.893+0000 7f02a174c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029c19e940 con 0x7f029c1040c0 2024-01-31T05:11:12.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.893+0000 7f02a174c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029c19eb00 con 0x7f029c1069f0 2024-01-31T05:11:12.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.893+0000 7f029affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f029c101790 0x7f029c196cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:12.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.893+0000 7f029affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f029c101790 0x7f029c196cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54202/0 (socket says 172.21.15.99:54202) 2024-01-31T05:11:12.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.893+0000 7f029affd640 1 -- 172.21.15.99:0/3935205624 learned_addr learned my addr 172.21.15.99:0/3935205624 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:12.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.893+0000 7f029b7fe640 1 --2- 172.21.15.99:0/3935205624 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f029c1069f0 0x7f029c19e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:12.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.894+0000 7f029affd640 1 -- 172.21.15.99:0/3935205624 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f029c1069f0 msgr2=0x7f029c19e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:12.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.894+0000 7f029affd640 1 --2- 172.21.15.99:0/3935205624 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f029c1069f0 0x7f029c19e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:12.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.894+0000 7f029affd640 1 -- 172.21.15.99:0/3935205624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f029c1040c0 msgr2=0x7f029c197230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:12.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.894+0000 7f029a7fc640 1 --2- 172.21.15.99:0/3935205624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f029c1040c0 0x7f029c197230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:12.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.894+0000 7f029affd640 1 --2- 172.21.15.99:0/3935205624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f029c1040c0 0x7f029c197230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:12.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.894+0000 7f029affd640 1 -- 172.21.15.99:0/3935205624 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f028c009560 con 0x7f029c101790 2024-01-31T05:11:12.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.894+0000 7f029affd640 1 --2- 172.21.15.99:0/3935205624 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f029c101790 0x7f029c196cf0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f028c009230 tx=0x7f028c004ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:12.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.894+0000 7f0283fff640 1 -- 172.21.15.99:0/3935205624 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028c0043d0 con 0x7f029c101790 2024-01-31T05:11:12.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.894+0000 7f0283fff640 1 -- 172.21.15.99:0/3935205624 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f028c0054c0 con 0x7f029c101790 2024-01-31T05:11:12.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.894+0000 7f02a174c640 1 -- 172.21.15.99:0/3935205624 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f029c19ed80 con 0x7f029c101790 2024-01-31T05:11:12.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.894+0000 7f0283fff640 1 -- 172.21.15.99:0/3935205624 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028c03e450 con 0x7f029c101790 2024-01-31T05:11:12.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.894+0000 7f02a174c640 1 -- 172.21.15.99:0/3935205624 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f029c19f1d0 con 0x7f029c101790 2024-01-31T05:11:12.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.895+0000 7f02a174c640 1 -- 172.21.15.99:0/3935205624 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f029c0fcc70 con 0x7f029c101790 2024-01-31T05:11:12.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.896+0000 7f0283fff640 1 -- 172.21.15.99:0/3935205624 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f028c0035f0 con 0x7f029c101790 2024-01-31T05:11:12.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.897+0000 7f0283fff640 1 --2- 172.21.15.99:0/3935205624 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f02840a12e0 0x7f02840a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:12.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.897+0000 7f029a7fc640 1 --2- 172.21.15.99:0/3935205624 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f02840a12e0 0x7f02840a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:12.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.897+0000 7f0283fff640 1 -- 172.21.15.99:0/3935205624 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f028c0ef4c0 con 0x7f029c101790 2024-01-31T05:11:12.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.897+0000 7f029a7fc640 1 --2- 172.21.15.99:0/3935205624 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f02840a12e0 0x7f02840a37a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0290005fd0 tx=0x7f0290005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:12.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:12.901+0000 7f0283fff640 1 -- 172.21.15.99:0/3935205624 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f028c0b8970 con 0x7f029c101790 2024-01-31T05:11:13.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:12 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/2997014512' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-31T05:11:13.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:12 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/908889343' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-31T05:11:13.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:12 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/3884651514' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-31T05:11:13.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:12 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/2997014512' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-31T05:11:13.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:12 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/908889343' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-31T05:11:13.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:12 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/3884651514' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-31T05:11:13.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.073+0000 7f02a174c640 1 -- 172.21.15.99:0/3935205624 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f029c10c800 con 0x7f029c101790 2024-01-31T05:11:13.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.075+0000 7f0283fff640 1 -- 172.21.15.99:0/3935205624 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22426 (secure 0 0 0) 0x7f028c043090 con 0x7f029c101790 2024-01-31T05:11:13.075 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:11:13.076 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":88,"fsid":"9288ff44-bff5-11ee-95b3-87774f69a715","created":"2024-01-31T05:01:26.130917+0000","modified":"2024-01-31T05:10:21.675877+0000","last_up_change":"2024-01-31T05:08:31.228478+0000","last_in_change":"2024-01-31T05:08:10.799511+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:46.842423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:09:18.693558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-31T05:09:19.734003+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b45878d9-28f1-4821-ba72-26a32d3fc780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6803","nonce":1213805280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6805","nonce":1213805280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6809","nonce":1213805280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6807","nonce":1213805280}]},"public_addr":"172.21.15.99:6803/1213805280","cluster_addr":"172.21.15.99:6805/1213805280","heartbeat_back_addr":"172.21.15.99:6809/1213805280","heartbeat_front_addr":"172.21.15.99:6807/1213805280","state":["exists","up"]},{"osd":1,"uuid":"e0b71ff3-5d97-4659-8dea-4c9091e1beb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6801","nonce":2019451677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6803","nonce":2019451677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6807","nonce":2019451677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6805","nonce":2019451677}]},"public_addr":"172.21.15.179:6801/2019451677","cluster_addr":"172.21.15.179:6803/2019451677","heartbeat_back_addr":"172.21.15.179:6807/2019451677","heartbeat_front_addr":"172.21.15.179:6805/2019451677","state":["exists","up"]},{"osd":2,"uuid":"11c919c8-19a9-48b0-8880-3002efcb64f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6801","nonce":3934284457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6803","nonce":3934284457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6807","nonce":3934284457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6805","nonce":3934284457}]},"public_addr":"172.21.15.181:6801/3934284457","cluster_addr":"172.21.15.181:6803/3934284457","heartbeat_back_addr":"172.21.15.181:6807/3934284457","heartbeat_front_addr":"172.21.15.181:6805/3934284457","state":["exists","up"]},{"osd":3,"uuid":"bcab5135-a5d1-45ae-a9b8-674425d3999e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6811","nonce":4207675427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6813","nonce":4207675427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6817","nonce":4207675427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6815","nonce":4207675427}]},"public_addr":"172.21.15.99:6811/4207675427","cluster_addr":"172.21.15.99:6813/4207675427","heartbeat_back_addr":"172.21.15.99:6817/4207675427","heartbeat_front_addr":"172.21.15.99:6815/4207675427","state":["exists","up"]},{"osd":4,"uuid":"0250d7ac-3894-457a-9c04-cc7205d61eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6809","nonce":2861083896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6811","nonce":2861083896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6815","nonce":2861083896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6813","nonce":2861083896}]},"public_addr":"172.21.15.179:6809/2861083896","cluster_addr":"172.21.15.179:6811/2861083896","heartbeat_back_addr":"172.21.15.179:6815/2861083896","heartbeat_front_addr":"172.21.15.179:6813/2861083896","state":["exists","up"]},{"osd":5,"uuid":"5e19222a-c2a4-45bc-8445-1d302f26d11c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6809","nonce":1485017095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6811","nonce":1485017095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6815","nonce":1485017095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6813","nonce":1485017095}]},"public_addr":"172.21.15.181:6809/1485017095","cluster_addr":"172.21.15.181:6811/1485017095","heartbeat_back_addr":"172.21.15.181:6815/1485017095","heartbeat_front_addr":"172.21.15.181:6813/1485017095","state":["exists","up"]},{"osd":6,"uuid":"56555035-f9fc-4e91-96dd-caa632d58adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6819","nonce":1534047839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6821","nonce":1534047839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6825","nonce":1534047839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6823","nonce":1534047839}]},"public_addr":"172.21.15.99:6819/1534047839","cluster_addr":"172.21.15.99:6821/1534047839","heartbeat_back_addr":"172.21.15.99:6825/1534047839","heartbeat_front_addr":"172.21.15.99:6823/1534047839","state":["exists","up"]},{"osd":7,"uuid":"5e079cf5-1340-4599-88a6-df410ef0148e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6817","nonce":3875950553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6819","nonce":3875950553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6823","nonce":3875950553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6821","nonce":3875950553}]},"public_addr":"172.21.15.179:6817/3875950553","cluster_addr":"172.21.15.179:6819/3875950553","heartbeat_back_addr":"172.21.15.179:6823/3875950553","heartbeat_front_addr":"172.21.15.179:6821/3875950553","state":["exists","up"]},{"osd":8,"uuid":"10a73592-4251-4492-b67d-ce9b9d7fff32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6817","nonce":179568936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6819","nonce":179568936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6823","nonce":179568936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6821","nonce":179568936}]},"public_addr":"172.21.15.181:6817/179568936","cluster_addr":"172.21.15.181:6819/179568936","heartbeat_back_addr":"172.21.15.181:6823/179568936","heartbeat_front_addr":"172.21.15.181:6821/179568936","state":["exists","up"]},{"osd":9,"uuid":"f6620e1e-f761-4f1c-917f-cbc748df32a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6827","nonce":315759515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6829","nonce":315759515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6833","nonce":315759515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6831","nonce":315759515}]},"public_addr":"172.21.15.99:6827/315759515","cluster_addr":"172.21.15.99:6829/315759515","heartbeat_back_addr":"172.21.15.99:6833/315759515","heartbeat_front_addr":"172.21.15.99:6831/315759515","state":["exists","up"]},{"osd":10,"uuid":"ee86af7d-66f8-4795-bcc3-dfec79e4680c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6825","nonce":2985063934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6827","nonce":2985063934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6831","nonce":2985063934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6829","nonce":2985063934}]},"public_addr":"172.21.15.179:6825/2985063934","cluster_addr":"172.21.15.179:6827/2985063934","heartbeat_back_addr":"172.21.15.179:6831/2985063934","heartbeat_front_addr":"172.21.15.179:6829/2985063934","state":["exists","up"]},{"osd":11,"uuid":"82f04fee-f6ae-4630-a75b-b12a9c4ab2e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6825","nonce":1858219600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6827","nonce":1858219600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6831","nonce":1858219600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6829","nonce":1858219600}]},"public_addr":"172.21.15.181:6825/1858219600","cluster_addr":"172.21.15.181:6827/1858219600","heartbeat_back_addr":"172.21.15.181:6831/1858219600","heartbeat_front_addr":"172.21.15.181:6829/1858219600","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:55.518970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:04:19.936339+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:04:44.064814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:09.331683+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:34.616774+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:58.881810+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:06:23.869838+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:06:49.127331+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:07:12.847187+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:07:38.231045+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:08:03.949162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:08:28.471802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:0/401101729":"2024-02-01T05:02:20.510858+0000","172.21.15.99:6801/1993198206":"2024-02-01T05:02:20.510858+0000","172.21.15.99:0/3819754569":"2024-02-01T05:02:20.510858+0000","172.21.15.99:0/475390265":"2024-02-01T05:01:53.732026+0000","172.21.15.99:6800/1993198206":"2024-02-01T05:02:20.510858+0000","172.21.15.99:6800/1706888338":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/4150146075":"2024-02-01T05:01:53.732026+0000","172.21.15.99:6801/1706888338":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/2851066598":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/1865156424":"2024-02-01T05:02:20.510858+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:11:13.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.077+0000 7f02a174c640 1 -- 172.21.15.99:0/3935205624 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f02840a12e0 msgr2=0x7f02840a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:13.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.077+0000 7f02a174c640 1 --2- 172.21.15.99:0/3935205624 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f02840a12e0 0x7f02840a37a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0290005fd0 tx=0x7f0290005850 comp rx=0 tx=0).stop 2024-01-31T05:11:13.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.077+0000 7f02a174c640 1 -- 172.21.15.99:0/3935205624 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f029c101790 msgr2=0x7f029c196cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:13.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.077+0000 7f02a174c640 1 --2- 172.21.15.99:0/3935205624 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f029c101790 0x7f029c196cf0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f028c009230 tx=0x7f028c004ee0 comp rx=0 tx=0).stop 2024-01-31T05:11:13.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.077+0000 7f02a174c640 1 -- 172.21.15.99:0/3935205624 shutdown_connections 2024-01-31T05:11:13.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.077+0000 7f02a174c640 1 --2- 172.21.15.99:0/3935205624 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f02840a12e0 0x7f02840a37a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:13.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.077+0000 7f02a174c640 1 --2- 172.21.15.99:0/3935205624 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f029c1069f0 0x7f029c19e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:13.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.077+0000 7f02a174c640 1 --2- 172.21.15.99:0/3935205624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f029c1040c0 0x7f029c197230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:13.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.077+0000 7f02a174c640 1 --2- 172.21.15.99:0/3935205624 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f029c101790 0x7f029c196cf0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:13.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.077+0000 7f02a174c640 1 -- 172.21.15.99:0/3935205624 >> 172.21.15.99:0/3935205624 conn(0x7f029c0fb180 msgr2=0x7f029c1020d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:13.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.077+0000 7f02a174c640 1 -- 172.21.15.99:0/3935205624 shutdown_connections 2024-01-31T05:11:13.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.077+0000 7f02a174c640 1 -- 172.21.15.99:0/3935205624 wait complete. 2024-01-31T05:11:13.089 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-31T05:04:46.842423+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-31T05:09:18.693558+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-31T05:09:19.734003+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-31T05:11:13.089 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-31T05:11:13.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:12 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/2997014512' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-31T05:11:13.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:12 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/908889343' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-31T05:11:13.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:12 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/3884651514' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-31T05:11:13.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.194+0000 7f81e8705640 1 -- 172.21.15.99:0/2155942182 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81e0102960 msgr2=0x7f81e01091f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:13.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.194+0000 7f81e8705640 1 --2- 172.21.15.99:0/2155942182 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81e0102960 0x7f81e01091f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f81d8009ca0 tx=0x7f81d802c0f0 comp rx=0 tx=0).stop 2024-01-31T05:11:13.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.194+0000 7f81e8705640 1 -- 172.21.15.99:0/2155942182 shutdown_connections 2024-01-31T05:11:13.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.194+0000 7f81e8705640 1 --2- 172.21.15.99:0/2155942182 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81e0102960 0x7f81e01091f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:13.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.194+0000 7f81e8705640 1 --2- 172.21.15.99:0/2155942182 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81e0101fa0 0x7f81e0102420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:13.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.194+0000 7f81e8705640 1 --2- 172.21.15.99:0/2155942182 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81e00fefd0 0x7f81e00ff3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:13.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.194+0000 7f81e8705640 1 -- 172.21.15.99:0/2155942182 >> 172.21.15.99:0/2155942182 conn(0x7f81e00fa900 msgr2=0x7f81e00fcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:13.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.194+0000 7f81e8705640 1 -- 172.21.15.99:0/2155942182 shutdown_connections 2024-01-31T05:11:13.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.194+0000 7f81e8705640 1 -- 172.21.15.99:0/2155942182 wait complete. 2024-01-31T05:11:13.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.195+0000 7f81e8705640 1 Processor -- start 2024-01-31T05:11:13.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.195+0000 7f81e8705640 1 -- start start 2024-01-31T05:11:13.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.195+0000 7f81e8705640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81e00fefd0 0x7f81e0196bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:13.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.195+0000 7f81e8705640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81e0101fa0 0x7f81e0197130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:13.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.195+0000 7f81e8705640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81e0102960 0x7f81e019e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:13.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.195+0000 7f81e8705640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e019e6e0 con 0x7f81e00fefd0 2024-01-31T05:11:13.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.195+0000 7f81e8705640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e019e850 con 0x7f81e0102960 2024-01-31T05:11:13.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.195+0000 7f81e8705640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e019ea10 con 0x7f81e0101fa0 2024-01-31T05:11:13.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.195+0000 7f81e64a1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81e00fefd0 0x7f81e0196bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:13.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.195+0000 7f81e64a1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81e00fefd0 0x7f81e0196bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54216/0 (socket says 172.21.15.99:54216) 2024-01-31T05:11:13.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.195+0000 7f81e64a1640 1 -- 172.21.15.99:0/1278039432 learned_addr learned my addr 172.21.15.99:0/1278039432 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:13.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.195+0000 7f81e6ca2640 1 --2- 172.21.15.99:0/1278039432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81e0102960 0x7f81e019e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:13.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.195+0000 7f81e5ca0640 1 --2- 172.21.15.99:0/1278039432 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81e0101fa0 0x7f81e0197130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:13.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.195+0000 7f81e64a1640 1 -- 172.21.15.99:0/1278039432 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81e0101fa0 msgr2=0x7f81e0197130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:13.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.195+0000 7f81e64a1640 1 --2- 172.21.15.99:0/1278039432 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81e0101fa0 0x7f81e0197130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:13.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.195+0000 7f81e64a1640 1 -- 172.21.15.99:0/1278039432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81e0102960 msgr2=0x7f81e019e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:13.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.195+0000 7f81e64a1640 1 --2- 172.21.15.99:0/1278039432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81e0102960 0x7f81e019e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:13.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.195+0000 7f81e64a1640 1 -- 172.21.15.99:0/1278039432 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d8009900 con 0x7f81e00fefd0 2024-01-31T05:11:13.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.195+0000 7f81e64a1640 1 --2- 172.21.15.99:0/1278039432 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81e00fefd0 0x7f81e0196bf0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f81dc00e9c0 tx=0x7f81dc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:13.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.196+0000 7f81d77fe640 1 -- 172.21.15.99:0/1278039432 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81dc009700 con 0x7f81e00fefd0 2024-01-31T05:11:13.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.196+0000 7f81e8705640 1 -- 172.21.15.99:0/1278039432 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81e019ecf0 con 0x7f81e00fefd0 2024-01-31T05:11:13.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.196+0000 7f81d77fe640 1 -- 172.21.15.99:0/1278039432 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f81dc0044e0 con 0x7f81e00fefd0 2024-01-31T05:11:13.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.196+0000 7f81d77fe640 1 -- 172.21.15.99:0/1278039432 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81dc010430 con 0x7f81e00fefd0 2024-01-31T05:11:13.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.196+0000 7f81e8705640 1 -- 172.21.15.99:0/1278039432 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81e019f1a0 con 0x7f81e00fefd0 2024-01-31T05:11:13.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.197+0000 7f81e8705640 1 -- 172.21.15.99:0/1278039432 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81e01080d0 con 0x7f81e00fefd0 2024-01-31T05:11:13.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.198+0000 7f81d77fe640 1 -- 172.21.15.99:0/1278039432 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f81dc003f60 con 0x7f81e00fefd0 2024-01-31T05:11:13.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.198+0000 7f81d77fe640 1 --2- 172.21.15.99:0/1278039432 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f81cc0a12e0 0x7f81cc0a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:13.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.198+0000 7f81e5ca0640 1 --2- 172.21.15.99:0/1278039432 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f81cc0a12e0 0x7f81cc0a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:13.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.198+0000 7f81d77fe640 1 -- 172.21.15.99:0/1278039432 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f81dc014070 con 0x7f81e00fefd0 2024-01-31T05:11:13.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.199+0000 7f81e5ca0640 1 --2- 172.21.15.99:0/1278039432 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f81cc0a12e0 0x7f81cc0a37a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f81e0198100 tx=0x7f81d0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:13.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.203+0000 7f81d77fe640 1 -- 172.21.15.99:0/1278039432 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f81dc096490 con 0x7f81e00fefd0 2024-01-31T05:11:13.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.374+0000 7f81e8705640 1 -- 172.21.15.99:0/1278039432 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f81e002cc50 con 0x7f81e00fefd0 2024-01-31T05:11:13.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.374+0000 7f81d77fe640 1 -- 172.21.15.99:0/1278039432 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f81dc099ab0 con 0x7f81e00fefd0 2024-01-31T05:11:13.375 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-01-31T05:11:13.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.376+0000 7f81e8705640 1 -- 172.21.15.99:0/1278039432 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f81cc0a12e0 msgr2=0x7f81cc0a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:13.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.376+0000 7f81e8705640 1 --2- 172.21.15.99:0/1278039432 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f81cc0a12e0 0x7f81cc0a37a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f81e0198100 tx=0x7f81d0005f90 comp rx=0 tx=0).stop 2024-01-31T05:11:13.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.376+0000 7f81e8705640 1 -- 172.21.15.99:0/1278039432 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81e00fefd0 msgr2=0x7f81e0196bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:13.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.376+0000 7f81e8705640 1 --2- 172.21.15.99:0/1278039432 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81e00fefd0 0x7f81e0196bf0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f81dc00e9c0 tx=0x7f81dc00ee80 comp rx=0 tx=0).stop 2024-01-31T05:11:13.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.376+0000 7f81e8705640 1 -- 172.21.15.99:0/1278039432 shutdown_connections 2024-01-31T05:11:13.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.376+0000 7f81e8705640 1 --2- 172.21.15.99:0/1278039432 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f81cc0a12e0 0x7f81cc0a37a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:13.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.376+0000 7f81e8705640 1 --2- 172.21.15.99:0/1278039432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81e0102960 0x7f81e019e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:13.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.376+0000 7f81e8705640 1 --2- 172.21.15.99:0/1278039432 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81e0101fa0 0x7f81e0197130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:13.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.376+0000 7f81e8705640 1 --2- 172.21.15.99:0/1278039432 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81e00fefd0 0x7f81e0196bf0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:13.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.376+0000 7f81e8705640 1 -- 172.21.15.99:0/1278039432 >> 172.21.15.99:0/1278039432 conn(0x7f81e00fa900 msgr2=0x7f81e01052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:13.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.376+0000 7f81e8705640 1 -- 172.21.15.99:0/1278039432 shutdown_connections 2024-01-31T05:11:13.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.376+0000 7f81e8705640 1 -- 172.21.15.99:0/1278039432 wait complete. 2024-01-31T05:11:13.388 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-31T05:11:13.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.492+0000 7fe3d594e640 1 -- 172.21.15.99:0/690399222 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3d0101f00 msgr2=0x7fe3d0102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:13.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.492+0000 7fe3d594e640 1 --2- 172.21.15.99:0/690399222 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3d0101f00 0x7fe3d0102380 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4009900 tx=0x7fe3c402bc30 comp rx=0 tx=0).stop 2024-01-31T05:11:13.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.492+0000 7fe3d594e640 1 -- 172.21.15.99:0/690399222 shutdown_connections 2024-01-31T05:11:13.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.492+0000 7fe3d594e640 1 --2- 172.21.15.99:0/690399222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3d01028c0 0x7fe3d0109150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:13.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.492+0000 7fe3d594e640 1 --2- 172.21.15.99:0/690399222 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3d0101f00 0x7fe3d0102380 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:13.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.492+0000 7fe3d594e640 1 --2- 172.21.15.99:0/690399222 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3d0100d10 0x7fe3d0101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:13.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.492+0000 7fe3d594e640 1 -- 172.21.15.99:0/690399222 >> 172.21.15.99:0/690399222 conn(0x7fe3d00fc260 msgr2=0x7fe3d00fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:13.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.492+0000 7fe3d594e640 1 -- 172.21.15.99:0/690399222 shutdown_connections 2024-01-31T05:11:13.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.492+0000 7fe3d594e640 1 -- 172.21.15.99:0/690399222 wait complete. 2024-01-31T05:11:13.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.492+0000 7fe3d594e640 1 Processor -- start 2024-01-31T05:11:13.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.493+0000 7fe3d594e640 1 -- start start 2024-01-31T05:11:13.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.493+0000 7fe3d594e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3d0100d10 0x7fe3d0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:13.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.493+0000 7fe3d594e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3d0101f00 0x7fe3d00730e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:13.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.493+0000 7fe3d594e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3d01028c0 0x7fe3d0073620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:13.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.493+0000 7fe3d594e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d0073d80 con 0x7fe3d0101f00 2024-01-31T05:11:13.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.493+0000 7fe3d594e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d0073ef0 con 0x7fe3d0100d10 2024-01-31T05:11:13.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.493+0000 7fe3d594e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d01a0d10 con 0x7fe3d01028c0 2024-01-31T05:11:13.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.493+0000 7fe3ce7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3d0101f00 0x7fe3d00730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:13.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.493+0000 7fe3ce7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3d0101f00 0x7fe3d00730e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54236/0 (socket says 172.21.15.99:54236) 2024-01-31T05:11:13.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.493+0000 7fe3ce7fc640 1 -- 172.21.15.99:0/533500319 learned_addr learned my addr 172.21.15.99:0/533500319 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:13.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.493+0000 7fe3ceffd640 1 --2- 172.21.15.99:0/533500319 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3d0100d10 0x7fe3d0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:13.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.493+0000 7fe3cf7fe640 1 --2- 172.21.15.99:0/533500319 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3d01028c0 0x7fe3d0073620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:13.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.493+0000 7fe3ce7fc640 1 -- 172.21.15.99:0/533500319 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3d01028c0 msgr2=0x7fe3d0073620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:13.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.493+0000 7fe3ce7fc640 1 --2- 172.21.15.99:0/533500319 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3d01028c0 0x7fe3d0073620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:13.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.493+0000 7fe3ce7fc640 1 -- 172.21.15.99:0/533500319 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3d0100d10 msgr2=0x7fe3d0074aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:13.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.493+0000 7fe3ce7fc640 1 --2- 172.21.15.99:0/533500319 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3d0100d10 0x7fe3d0074aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:13.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.493+0000 7fe3ce7fc640 1 -- 172.21.15.99:0/533500319 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c4009560 con 0x7fe3d0101f00 2024-01-31T05:11:13.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.493+0000 7fe3cf7fe640 1 --2- 172.21.15.99:0/533500319 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3d01028c0 0x7fe3d0073620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:11:13.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.493+0000 7fe3ce7fc640 1 --2- 172.21.15.99:0/533500319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3d0101f00 0x7fe3d00730e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4009430 tx=0x7fe3c4004ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:13.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.493+0000 7fe3d494c640 1 -- 172.21.15.99:0/533500319 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c40043d0 con 0x7fe3d0101f00 2024-01-31T05:11:13.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.493+0000 7fe3d494c640 1 -- 172.21.15.99:0/533500319 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe3c40054c0 con 0x7fe3d0101f00 2024-01-31T05:11:13.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.493+0000 7fe3d594e640 1 -- 172.21.15.99:0/533500319 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3d01a0f60 con 0x7fe3d0101f00 2024-01-31T05:11:13.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.493+0000 7fe3d494c640 1 -- 172.21.15.99:0/533500319 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c4003e80 con 0x7fe3d0101f00 2024-01-31T05:11:13.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.493+0000 7fe3d594e640 1 -- 172.21.15.99:0/533500319 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d01a13e0 con 0x7fe3d0101f00 2024-01-31T05:11:13.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.494+0000 7fe3d594e640 1 -- 172.21.15.99:0/533500319 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3d0108150 con 0x7fe3d0101f00 2024-01-31T05:11:13.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.495+0000 7fe3d494c640 1 -- 172.21.15.99:0/533500319 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) v1 ==== 135895+0+0 (secure 0 0 0) 0x7fe3c40035f0 con 0x7fe3d0101f00 2024-01-31T05:11:13.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.496+0000 7fe3d494c640 1 --2- 172.21.15.99:0/533500319 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe3b80a12e0 0x7fe3b80a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:13.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.496+0000 7fe3ceffd640 1 --2- 172.21.15.99:0/533500319 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe3b80a12e0 0x7fe3b80a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:13.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.496+0000 7fe3d494c640 1 -- 172.21.15.99:0/533500319 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fe3c40eee40 con 0x7fe3d0101f00 2024-01-31T05:11:13.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.496+0000 7fe3ceffd640 1 --2- 172.21.15.99:0/533500319 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe3b80a12e0 0x7fe3b80a37a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe3c0005fd0 tx=0x7fe3c000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:13.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.500+0000 7fe3d494c640 1 -- 172.21.15.99:0/533500319 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fe3c40b8380 con 0x7fe3d0101f00 2024-01-31T05:11:13.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.672+0000 7fe3d594e640 1 -- 172.21.15.99:0/533500319 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe3d002ca70 con 0x7fe3d0101f00 2024-01-31T05:11:13.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.672+0000 7fe3d494c640 1 -- 172.21.15.99:0/533500319 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe3c40bb9a0 con 0x7fe3d0101f00 2024-01-31T05:11:13.673 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-01-31T05:11:13.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.674+0000 7fe3d594e640 1 -- 172.21.15.99:0/533500319 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe3b80a12e0 msgr2=0x7fe3b80a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:13.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.674+0000 7fe3d594e640 1 --2- 172.21.15.99:0/533500319 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe3b80a12e0 0x7fe3b80a37a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe3c0005fd0 tx=0x7fe3c000b390 comp rx=0 tx=0).stop 2024-01-31T05:11:13.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.674+0000 7fe3d594e640 1 -- 172.21.15.99:0/533500319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3d0101f00 msgr2=0x7fe3d00730e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:13.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.674+0000 7fe3d594e640 1 --2- 172.21.15.99:0/533500319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3d0101f00 0x7fe3d00730e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4009430 tx=0x7fe3c4004ee0 comp rx=0 tx=0).stop 2024-01-31T05:11:13.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.674+0000 7fe3d594e640 1 -- 172.21.15.99:0/533500319 shutdown_connections 2024-01-31T05:11:13.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.674+0000 7fe3d594e640 1 --2- 172.21.15.99:0/533500319 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe3b80a12e0 0x7fe3b80a37a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:13.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.674+0000 7fe3d594e640 1 --2- 172.21.15.99:0/533500319 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3d01028c0 0x7fe3d0073620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:13.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.674+0000 7fe3d594e640 1 --2- 172.21.15.99:0/533500319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3d0101f00 0x7fe3d00730e0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:13.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.674+0000 7fe3d594e640 1 --2- 172.21.15.99:0/533500319 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3d0100d10 0x7fe3d0074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:13.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.674+0000 7fe3d594e640 1 -- 172.21.15.99:0/533500319 >> 172.21.15.99:0/533500319 conn(0x7fe3d00fc260 msgr2=0x7fe3d0105320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:13.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.674+0000 7fe3d594e640 1 -- 172.21.15.99:0/533500319 shutdown_connections 2024-01-31T05:11:13.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.674+0000 7fe3d594e640 1 -- 172.21.15.99:0/533500319 wait complete. 2024-01-31T05:11:13.686 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-31T05:11:13.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.789+0000 7f95a491f640 1 -- 172.21.15.99:0/3719862597 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95a01069f0 msgr2=0x7f95a0108e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:13.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.789+0000 7f95a491f640 1 --2- 172.21.15.99:0/3719862597 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95a01069f0 0x7f95a0108e40 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9598009ca0 tx=0x7f959802c0f0 comp rx=0 tx=0).stop 2024-01-31T05:11:13.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.789+0000 7f95a491f640 1 -- 172.21.15.99:0/3719862597 shutdown_connections 2024-01-31T05:11:13.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.789+0000 7f95a491f640 1 --2- 172.21.15.99:0/3719862597 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95a01069f0 0x7f95a0108e40 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:13.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.789+0000 7f95a491f640 1 --2- 172.21.15.99:0/3719862597 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95a01040c0 0x7f95a01064b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:13.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.789+0000 7f95a491f640 1 --2- 172.21.15.99:0/3719862597 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95a0101790 0x7f95a0103b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:13.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.789+0000 7f95a491f640 1 -- 172.21.15.99:0/3719862597 >> 172.21.15.99:0/3719862597 conn(0x7f95a00fb1a0 msgr2=0x7f95a00fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:13.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.789+0000 7f95a491f640 1 -- 172.21.15.99:0/3719862597 shutdown_connections 2024-01-31T05:11:13.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.789+0000 7f95a491f640 1 -- 172.21.15.99:0/3719862597 wait complete. 2024-01-31T05:11:13.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.790+0000 7f95a491f640 1 Processor -- start 2024-01-31T05:11:13.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.790+0000 7f95a491f640 1 -- start start 2024-01-31T05:11:13.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.790+0000 7f95a491f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95a0101790 0x7f95a0196ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:13.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.790+0000 7f95a491f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95a01040c0 0x7f95a01971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:13.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.790+0000 7f95a491f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95a01069f0 0x7f95a019e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:13.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.790+0000 7f95a491f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a019e7b0 con 0x7f95a01069f0 2024-01-31T05:11:13.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.790+0000 7f95a491f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a019e920 con 0x7f95a0101790 2024-01-31T05:11:13.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.790+0000 7f95a491f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a019eae0 con 0x7f95a01040c0 2024-01-31T05:11:13.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.790+0000 7f959ed9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95a01069f0 0x7f95a019e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:13.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.790+0000 7f959ed9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95a01069f0 0x7f95a019e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54252/0 (socket says 172.21.15.99:54252) 2024-01-31T05:11:13.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.790+0000 7f959ed9d640 1 -- 172.21.15.99:0/177372413 learned_addr learned my addr 172.21.15.99:0/177372413 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:13.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.790+0000 7f959e59c640 1 --2- 172.21.15.99:0/177372413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95a0101790 0x7f95a0196ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:13.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.791+0000 7f959dd9b640 1 --2- 172.21.15.99:0/177372413 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95a01040c0 0x7f95a01971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:13.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.791+0000 7f959ed9d640 1 -- 172.21.15.99:0/177372413 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95a01040c0 msgr2=0x7f95a01971e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:13.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.791+0000 7f959ed9d640 1 --2- 172.21.15.99:0/177372413 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95a01040c0 0x7f95a01971e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:13.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.791+0000 7f959ed9d640 1 -- 172.21.15.99:0/177372413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95a0101790 msgr2=0x7f95a0196ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:13.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.791+0000 7f959ed9d640 1 --2- 172.21.15.99:0/177372413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95a0101790 0x7f95a0196ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:13.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.791+0000 7f959ed9d640 1 -- 172.21.15.99:0/177372413 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9598009900 con 0x7f95a01069f0 2024-01-31T05:11:13.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.791+0000 7f959dd9b640 1 --2- 172.21.15.99:0/177372413 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95a01040c0 0x7f95a01971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:11:13.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.791+0000 7f959ed9d640 1 --2- 172.21.15.99:0/177372413 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95a01069f0 0x7f95a019e240 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f959802c630 tx=0x7f95980329c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:13.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.791+0000 7f958f7fe640 1 -- 172.21.15.99:0/177372413 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9598034e80 con 0x7f95a01069f0 2024-01-31T05:11:13.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.791+0000 7f958f7fe640 1 -- 172.21.15.99:0/177372413 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9598032e90 con 0x7f95a01069f0 2024-01-31T05:11:13.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.791+0000 7f95a491f640 1 -- 172.21.15.99:0/177372413 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95a019ed60 con 0x7f95a01069f0 2024-01-31T05:11:13.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.791+0000 7f958f7fe640 1 -- 172.21.15.99:0/177372413 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95980048a0 con 0x7f95a01069f0 2024-01-31T05:11:13.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.791+0000 7f95a491f640 1 -- 172.21.15.99:0/177372413 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95a019f1c0 con 0x7f95a01069f0 2024-01-31T05:11:13.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.792+0000 7f95a491f640 1 -- 172.21.15.99:0/177372413 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95a00fcc90 con 0x7f95a01069f0 2024-01-31T05:11:13.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.793+0000 7f958f7fe640 1 -- 172.21.15.99:0/177372413 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f959803b040 con 0x7f95a01069f0 2024-01-31T05:11:13.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.793+0000 7f958f7fe640 1 --2- 172.21.15.99:0/177372413 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f95880a12e0 0x7f95880a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:13.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.793+0000 7f959e59c640 1 --2- 172.21.15.99:0/177372413 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f95880a12e0 0x7f95880a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:13.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.794+0000 7f958f7fe640 1 -- 172.21.15.99:0/177372413 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f95980ef180 con 0x7f95a01069f0 2024-01-31T05:11:13.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.794+0000 7f959e59c640 1 --2- 172.21.15.99:0/177372413 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f95880a12e0 0x7f95880a37a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f95a0197b70 tx=0x7f959000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:13.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.798+0000 7f958f7fe640 1 -- 172.21.15.99:0/177372413 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f95980b86c0 con 0x7f95a01069f0 2024-01-31T05:11:13.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.967+0000 7f95a491f640 1 -- 172.21.15.99:0/177372413 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f95a010c7f0 con 0x7f95a01069f0 2024-01-31T05:11:13.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.968+0000 7f958f7fe640 1 -- 172.21.15.99:0/177372413 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f95980bbce0 con 0x7f95a01069f0 2024-01-31T05:11:13.969 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 64 2024-01-31T05:11:13.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.970+0000 7f95a491f640 1 -- 172.21.15.99:0/177372413 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f95880a12e0 msgr2=0x7f95880a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:13.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.970+0000 7f95a491f640 1 --2- 172.21.15.99:0/177372413 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f95880a12e0 0x7f95880a37a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f95a0197b70 tx=0x7f959000b390 comp rx=0 tx=0).stop 2024-01-31T05:11:13.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.970+0000 7f95a491f640 1 -- 172.21.15.99:0/177372413 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95a01069f0 msgr2=0x7f95a019e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:13.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.970+0000 7f95a491f640 1 --2- 172.21.15.99:0/177372413 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95a01069f0 0x7f95a019e240 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f959802c630 tx=0x7f95980329c0 comp rx=0 tx=0).stop 2024-01-31T05:11:13.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.970+0000 7f95a491f640 1 -- 172.21.15.99:0/177372413 shutdown_connections 2024-01-31T05:11:13.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.970+0000 7f95a491f640 1 --2- 172.21.15.99:0/177372413 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f95880a12e0 0x7f95880a37a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:13.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.970+0000 7f95a491f640 1 --2- 172.21.15.99:0/177372413 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95a01069f0 0x7f95a019e240 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:13.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.970+0000 7f95a491f640 1 --2- 172.21.15.99:0/177372413 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95a01040c0 0x7f95a01971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:13.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.970+0000 7f95a491f640 1 --2- 172.21.15.99:0/177372413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95a0101790 0x7f95a0196ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:13.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.970+0000 7f95a491f640 1 -- 172.21.15.99:0/177372413 >> 172.21.15.99:0/177372413 conn(0x7f95a00fb1a0 msgr2=0x7f95a0102030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:13.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.970+0000 7f95a491f640 1 -- 172.21.15.99:0/177372413 shutdown_connections 2024-01-31T05:11:13.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:13.970+0000 7f95a491f640 1 -- 172.21.15.99:0/177372413 wait complete. 2024-01-31T05:11:13.980 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:13 smithi099 ceph-mon[31615]: pgmap v344: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-01-31T05:11:13.980 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:13 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/1663407697' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:11:13.980 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:13 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/3935205624' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:11:13.980 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:13 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/1278039432' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-31T05:11:13.980 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:13 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/533500319' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-31T05:11:13.981 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T05:11:14.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:13 smithi181 ceph-mon[36434]: pgmap v344: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-01-31T05:11:14.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:13 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/1663407697' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:11:14.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:13 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/3935205624' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:11:14.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:13 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/1278039432' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-31T05:11:14.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:13 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/533500319' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-31T05:11:14.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.082+0000 7f7854fc4640 1 -- 172.21.15.99:0/4174338524 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7850100e00 msgr2=0x7f7850101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:14.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.082+0000 7f7854fc4640 1 --2- 172.21.15.99:0/4174338524 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7850100e00 0x7f7850101280 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7844009900 tx=0x7f784402bc30 comp rx=0 tx=0).stop 2024-01-31T05:11:14.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.082+0000 7f7854fc4640 1 -- 172.21.15.99:0/4174338524 shutdown_connections 2024-01-31T05:11:14.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.082+0000 7f7854fc4640 1 --2- 172.21.15.99:0/4174338524 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78501017c0 0x7f7850108050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.082+0000 7f7854fc4640 1 --2- 172.21.15.99:0/4174338524 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7850100e00 0x7f7850101280 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.082+0000 7f7854fc4640 1 --2- 172.21.15.99:0/4174338524 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f78500ffc10 0x7f7850100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.082+0000 7f7854fc4640 1 -- 172.21.15.99:0/4174338524 >> 172.21.15.99:0/4174338524 conn(0x7f78500fb180 msgr2=0x7f78500fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:14.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.083+0000 7f7854fc4640 1 -- 172.21.15.99:0/4174338524 shutdown_connections 2024-01-31T05:11:14.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.083+0000 7f7854fc4640 1 -- 172.21.15.99:0/4174338524 wait complete. 2024-01-31T05:11:14.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.083+0000 7f7854fc4640 1 Processor -- start 2024-01-31T05:11:14.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.083+0000 7f7854fc4640 1 -- start start 2024-01-31T05:11:14.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.083+0000 7f7854fc4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78500ffc10 0x7f7850196d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:14.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.083+0000 7f7854fc4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7850100e00 0x7f7850197290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:14.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.083+0000 7f7854fc4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f78501017c0 0x7f785019e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:14.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.083+0000 7f7854fc4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f785019e840 con 0x7f7850100e00 2024-01-31T05:11:14.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.083+0000 7f7854fc4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f785019e9b0 con 0x7f78500ffc10 2024-01-31T05:11:14.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.083+0000 7f7854fc4640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f785019eb70 con 0x7f78501017c0 2024-01-31T05:11:14.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.083+0000 7f784dd9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7850100e00 0x7f7850197290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:14.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.084+0000 7f784dd9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7850100e00 0x7f7850197290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54264/0 (socket says 172.21.15.99:54264) 2024-01-31T05:11:14.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.084+0000 7f784dd9b640 1 -- 172.21.15.99:0/2386591946 learned_addr learned my addr 172.21.15.99:0/2386591946 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:14.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.084+0000 7f784ed9d640 1 --2- 172.21.15.99:0/2386591946 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f78501017c0 0x7f785019e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:14.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.084+0000 7f784dd9b640 1 -- 172.21.15.99:0/2386591946 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f78501017c0 msgr2=0x7f785019e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:14.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.084+0000 7f784dd9b640 1 --2- 172.21.15.99:0/2386591946 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f78501017c0 0x7f785019e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.084+0000 7f784dd9b640 1 -- 172.21.15.99:0/2386591946 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78500ffc10 msgr2=0x7f7850196d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:14.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.084+0000 7f784dd9b640 1 --2- 172.21.15.99:0/2386591946 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78500ffc10 0x7f7850196d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.084+0000 7f784dd9b640 1 -- 172.21.15.99:0/2386591946 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7844009560 con 0x7f7850100e00 2024-01-31T05:11:14.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.084+0000 7f784dd9b640 1 --2- 172.21.15.99:0/2386591946 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7850100e00 0x7f7850197290 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7844009230 tx=0x7f78440042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:14.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.084+0000 7f783f7fe640 1 -- 172.21.15.99:0/2386591946 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78440044e0 con 0x7f7850100e00 2024-01-31T05:11:14.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.084+0000 7f783f7fe640 1 -- 172.21.15.99:0/2386591946 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f78440035f0 con 0x7f7850100e00 2024-01-31T05:11:14.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.084+0000 7f7854fc4640 1 -- 172.21.15.99:0/2386591946 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f785019edf0 con 0x7f7850100e00 2024-01-31T05:11:14.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.084+0000 7f783f7fe640 1 -- 172.21.15.99:0/2386591946 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784403e6b0 con 0x7f7850100e00 2024-01-31T05:11:14.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.084+0000 7f7854fc4640 1 -- 172.21.15.99:0/2386591946 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f785019f280 con 0x7f7850100e00 2024-01-31T05:11:14.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.085+0000 7f7854fc4640 1 -- 172.21.15.99:0/2386591946 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f785010b4d0 con 0x7f7850100e00 2024-01-31T05:11:14.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.086+0000 7f783f7fe640 1 -- 172.21.15.99:0/2386591946 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f7844003960 con 0x7f7850100e00 2024-01-31T05:11:14.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.087+0000 7f783f7fe640 1 --2- 172.21.15.99:0/2386591946 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f78380a1360 0x7f78380a3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:14.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.087+0000 7f784e59c640 1 --2- 172.21.15.99:0/2386591946 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f78380a1360 0x7f78380a3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:14.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.087+0000 7f783f7fe640 1 -- 172.21.15.99:0/2386591946 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f78440ef8f0 con 0x7f7850100e00 2024-01-31T05:11:14.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.087+0000 7f784e59c640 1 --2- 172.21.15.99:0/2386591946 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f78380a1360 0x7f78380a3820 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7850100c60 tx=0x7f7840005c10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:14.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.090+0000 7f783f7fe640 1 -- 172.21.15.99:0/2386591946 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f78440b8e30 con 0x7f7850100e00 2024-01-31T05:11:14.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:13 smithi179 ceph-mon[35652]: pgmap v344: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-01-31T05:11:14.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:13 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/1663407697' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:11:14.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:13 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/3935205624' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:11:14.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:13 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/1278039432' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-31T05:11:14.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:13 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/533500319' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-31T05:11:14.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.298+0000 7f7854fc4640 1 -- 172.21.15.99:0/2386591946 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f785010b690 con 0x7f7850100e00 2024-01-31T05:11:14.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.299+0000 7f783f7fe640 1 -- 172.21.15.99:0/2386591946 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11385 (secure 0 0 0) 0x7f7844043090 con 0x7f7850100e00 2024-01-31T05:11:14.300 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:11:14.300 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/1488539026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1488539026},{"type":"v1","addr":"172.21.15.99:6835","nonce":1488539026}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/1649552652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1649552652},{"type":"v1","addr":"172.21.15.99:6837","nonce":1649552652}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-01-31T05:09:20.564215+0000","modified":"2024-01-31T05:09:28.172314+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24461,"mds_2":24457,"mds_3":24439,"mds_4":14619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6839/4070477446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4070477446},{"type":"v1","addr":"172.21.15.99:6839","nonce":4070477446}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.99:6841/3069939345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6840","nonce":3069939345},{"type":"v1","addr":"172.21.15.99:6841","nonce":3069939345}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24376":{"gid":24376,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6833/427201290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":427201290},{"type":"v1","addr":"172.21.15.181:6833","nonce":427201290}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24401":{"gid":24401,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/472161020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":472161020},{"type":"v1","addr":"172.21.15.179:6833","nonce":472161020}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24427":{"gid":24427,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/1038715471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1038715471},{"type":"v1","addr":"172.21.15.181:6835","nonce":1038715471}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24434":{"gid":24434,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/966976592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":966976592},{"type":"v1","addr":"172.21.15.179:6835","nonce":966976592}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24439":{"gid":24439,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.181:6837/3875964154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3875964154},{"type":"v1","addr":"172.21.15.181:6837","nonce":3875964154}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24457":{"gid":24457,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.181:6839/996120687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":996120687},{"type":"v1","addr":"172.21.15.181:6839","nonce":996120687}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6837/837402830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":837402830},{"type":"v1","addr":"172.21.15.179:6837","nonce":837402830}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6839/754762785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":754762785},{"type":"v1","addr":"172.21.15.179:6839","nonce":754762785}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-31T05:11:14.300 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 26 2024-01-31T05:11:14.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.301+0000 7f7854fc4640 1 -- 172.21.15.99:0/2386591946 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f78380a1360 msgr2=0x7f78380a3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:14.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.301+0000 7f7854fc4640 1 --2- 172.21.15.99:0/2386591946 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f78380a1360 0x7f78380a3820 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7850100c60 tx=0x7f7840005c10 comp rx=0 tx=0).stop 2024-01-31T05:11:14.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.301+0000 7f7854fc4640 1 -- 172.21.15.99:0/2386591946 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7850100e00 msgr2=0x7f7850197290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:14.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.301+0000 7f7854fc4640 1 --2- 172.21.15.99:0/2386591946 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7850100e00 0x7f7850197290 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7844009230 tx=0x7f78440042f0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.301+0000 7f7854fc4640 1 -- 172.21.15.99:0/2386591946 shutdown_connections 2024-01-31T05:11:14.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.301+0000 7f7854fc4640 1 --2- 172.21.15.99:0/2386591946 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f78380a1360 0x7f78380a3820 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.301+0000 7f7854fc4640 1 --2- 172.21.15.99:0/2386591946 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f78501017c0 0x7f785019e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.301+0000 7f7854fc4640 1 --2- 172.21.15.99:0/2386591946 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7850100e00 0x7f7850197290 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.301+0000 7f7854fc4640 1 --2- 172.21.15.99:0/2386591946 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78500ffc10 0x7f7850196d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.301+0000 7f7854fc4640 1 -- 172.21.15.99:0/2386591946 >> 172.21.15.99:0/2386591946 conn(0x7f78500fb180 msgr2=0x7f7850067e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:14.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.301+0000 7f7854fc4640 1 -- 172.21.15.99:0/2386591946 shutdown_connections 2024-01-31T05:11:14.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.301+0000 7f7854fc4640 1 -- 172.21.15.99:0/2386591946 wait complete. 2024-01-31T05:11:14.313 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:11:14.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.414+0000 7f6c7e33b640 1 -- 172.21.15.99:0/2954039130 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c780ffc10 msgr2=0x7f6c78100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:14.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.414+0000 7f6c7e33b640 1 --2- 172.21.15.99:0/2954039130 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c780ffc10 0x7f6c78100030 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6c60009900 tx=0x7f6c6002bc30 comp rx=0 tx=0).stop 2024-01-31T05:11:14.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.415+0000 7f6c7e33b640 1 -- 172.21.15.99:0/2954039130 shutdown_connections 2024-01-31T05:11:14.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.415+0000 7f6c7e33b640 1 --2- 172.21.15.99:0/2954039130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c781017c0 0x7f6c78108050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.415+0000 7f6c7e33b640 1 --2- 172.21.15.99:0/2954039130 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6c78100e00 0x7f6c78101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.415+0000 7f6c7e33b640 1 --2- 172.21.15.99:0/2954039130 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c780ffc10 0x7f6c78100030 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.415+0000 7f6c7e33b640 1 -- 172.21.15.99:0/2954039130 >> 172.21.15.99:0/2954039130 conn(0x7f6c780fb180 msgr2=0x7f6c780fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:14.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.415+0000 7f6c7e33b640 1 -- 172.21.15.99:0/2954039130 shutdown_connections 2024-01-31T05:11:14.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.415+0000 7f6c7e33b640 1 -- 172.21.15.99:0/2954039130 wait complete. 2024-01-31T05:11:14.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.415+0000 7f6c7e33b640 1 Processor -- start 2024-01-31T05:11:14.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.415+0000 7f6c7e33b640 1 -- start start 2024-01-31T05:11:14.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.415+0000 7f6c7e33b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6c780ffc10 0x7f6c78196d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:14.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.415+0000 7f6c7e33b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c78100e00 0x7f6c78197290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:14.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.415+0000 7f6c7e33b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c781017c0 0x7f6c7819e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:14.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.415+0000 7f6c7e33b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7819e830 con 0x7f6c781017c0 2024-01-31T05:11:14.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.415+0000 7f6c7e33b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7819e9a0 con 0x7f6c78100e00 2024-01-31T05:11:14.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.415+0000 7f6c7e33b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7819eb60 con 0x7f6c780ffc10 2024-01-31T05:11:14.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.416+0000 7f6c7c8d8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c781017c0 0x7f6c7819e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:14.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.416+0000 7f6c7c8d8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c781017c0 0x7f6c7819e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54282/0 (socket says 172.21.15.99:54282) 2024-01-31T05:11:14.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.416+0000 7f6c7c8d8640 1 -- 172.21.15.99:0/716335439 learned_addr learned my addr 172.21.15.99:0/716335439 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:14.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.416+0000 7f6c77fff640 1 --2- 172.21.15.99:0/716335439 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6c780ffc10 0x7f6c78196d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:14.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.416+0000 7f6c777fe640 1 --2- 172.21.15.99:0/716335439 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c78100e00 0x7f6c78197290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:14.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.416+0000 7f6c7c8d8640 1 -- 172.21.15.99:0/716335439 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6c780ffc10 msgr2=0x7f6c78196d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:14.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.416+0000 7f6c7c8d8640 1 --2- 172.21.15.99:0/716335439 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6c780ffc10 0x7f6c78196d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.416+0000 7f6c7c8d8640 1 -- 172.21.15.99:0/716335439 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c78100e00 msgr2=0x7f6c78197290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:14.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.416+0000 7f6c7c8d8640 1 --2- 172.21.15.99:0/716335439 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c78100e00 0x7f6c78197290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.416+0000 7f6c7c8d8640 1 -- 172.21.15.99:0/716335439 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c60009560 con 0x7f6c781017c0 2024-01-31T05:11:14.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.416+0000 7f6c777fe640 1 --2- 172.21.15.99:0/716335439 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c78100e00 0x7f6c78197290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:11:14.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.416+0000 7f6c7c8d8640 1 --2- 172.21.15.99:0/716335439 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c781017c0 0x7f6c7819e2c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6c7000b970 tx=0x7f6c7000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:14.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.416+0000 7f6c757fa640 1 -- 172.21.15.99:0/716335439 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7000cb40 con 0x7f6c781017c0 2024-01-31T05:11:14.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.416+0000 7f6c7e33b640 1 -- 172.21.15.99:0/716335439 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c7819ee40 con 0x7f6c781017c0 2024-01-31T05:11:14.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.416+0000 7f6c757fa640 1 -- 172.21.15.99:0/716335439 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6c7000cca0 con 0x7f6c781017c0 2024-01-31T05:11:14.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.416+0000 7f6c757fa640 1 -- 172.21.15.99:0/716335439 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c70007770 con 0x7f6c781017c0 2024-01-31T05:11:14.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.416+0000 7f6c7e33b640 1 -- 172.21.15.99:0/716335439 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c7819f2e0 con 0x7f6c781017c0 2024-01-31T05:11:14.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.417+0000 7f6c7e33b640 1 -- 172.21.15.99:0/716335439 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c7810b520 con 0x7f6c781017c0 2024-01-31T05:11:14.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.418+0000 7f6c757fa640 1 -- 172.21.15.99:0/716335439 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f6c70014440 con 0x7f6c781017c0 2024-01-31T05:11:14.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.419+0000 7f6c757fa640 1 --2- 172.21.15.99:0/716335439 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f6c640a12e0 0x7f6c640a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:14.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.419+0000 7f6c77fff640 1 --2- 172.21.15.99:0/716335439 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f6c640a12e0 0x7f6c640a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:14.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.419+0000 7f6c757fa640 1 -- 172.21.15.99:0/716335439 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f6c700cc3d0 con 0x7f6c781017c0 2024-01-31T05:11:14.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.419+0000 7f6c77fff640 1 --2- 172.21.15.99:0/716335439 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f6c640a12e0 0x7f6c640a37a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6c60000c00 tx=0x7f6c6002c5d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:14.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.423+0000 7f6c757fa640 1 -- 172.21.15.99:0/716335439 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f6c7004f600 con 0x7f6c781017c0 2024-01-31T05:11:14.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.594+0000 7f6c7e33b640 1 -- 172.21.15.99:0/716335439 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c7819f950 con 0x7f6c781017c0 2024-01-31T05:11:14.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.595+0000 7f6c757fa640 1 -- 172.21.15.99:0/716335439 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22426 (secure 0 0 0) 0x7f6c70095930 con 0x7f6c781017c0 2024-01-31T05:11:14.596 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:11:14.596 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":88,"fsid":"9288ff44-bff5-11ee-95b3-87774f69a715","created":"2024-01-31T05:01:26.130917+0000","modified":"2024-01-31T05:10:21.675877+0000","last_up_change":"2024-01-31T05:08:31.228478+0000","last_in_change":"2024-01-31T05:08:10.799511+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:46.842423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:09:18.693558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-31T05:09:19.734003+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b45878d9-28f1-4821-ba72-26a32d3fc780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6803","nonce":1213805280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6805","nonce":1213805280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6809","nonce":1213805280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6807","nonce":1213805280}]},"public_addr":"172.21.15.99:6803/1213805280","cluster_addr":"172.21.15.99:6805/1213805280","heartbeat_back_addr":"172.21.15.99:6809/1213805280","heartbeat_front_addr":"172.21.15.99:6807/1213805280","state":["exists","up"]},{"osd":1,"uuid":"e0b71ff3-5d97-4659-8dea-4c9091e1beb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6801","nonce":2019451677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6803","nonce":2019451677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6807","nonce":2019451677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6805","nonce":2019451677}]},"public_addr":"172.21.15.179:6801/2019451677","cluster_addr":"172.21.15.179:6803/2019451677","heartbeat_back_addr":"172.21.15.179:6807/2019451677","heartbeat_front_addr":"172.21.15.179:6805/2019451677","state":["exists","up"]},{"osd":2,"uuid":"11c919c8-19a9-48b0-8880-3002efcb64f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6801","nonce":3934284457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6803","nonce":3934284457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6807","nonce":3934284457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6805","nonce":3934284457}]},"public_addr":"172.21.15.181:6801/3934284457","cluster_addr":"172.21.15.181:6803/3934284457","heartbeat_back_addr":"172.21.15.181:6807/3934284457","heartbeat_front_addr":"172.21.15.181:6805/3934284457","state":["exists","up"]},{"osd":3,"uuid":"bcab5135-a5d1-45ae-a9b8-674425d3999e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6811","nonce":4207675427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6813","nonce":4207675427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6817","nonce":4207675427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6815","nonce":4207675427}]},"public_addr":"172.21.15.99:6811/4207675427","cluster_addr":"172.21.15.99:6813/4207675427","heartbeat_back_addr":"172.21.15.99:6817/4207675427","heartbeat_front_addr":"172.21.15.99:6815/4207675427","state":["exists","up"]},{"osd":4,"uuid":"0250d7ac-3894-457a-9c04-cc7205d61eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6809","nonce":2861083896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6811","nonce":2861083896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6815","nonce":2861083896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6813","nonce":2861083896}]},"public_addr":"172.21.15.179:6809/2861083896","cluster_addr":"172.21.15.179:6811/2861083896","heartbeat_back_addr":"172.21.15.179:6815/2861083896","heartbeat_front_addr":"172.21.15.179:6813/2861083896","state":["exists","up"]},{"osd":5,"uuid":"5e19222a-c2a4-45bc-8445-1d302f26d11c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6809","nonce":1485017095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6811","nonce":1485017095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6815","nonce":1485017095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6813","nonce":1485017095}]},"public_addr":"172.21.15.181:6809/1485017095","cluster_addr":"172.21.15.181:6811/1485017095","heartbeat_back_addr":"172.21.15.181:6815/1485017095","heartbeat_front_addr":"172.21.15.181:6813/1485017095","state":["exists","up"]},{"osd":6,"uuid":"56555035-f9fc-4e91-96dd-caa632d58adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6819","nonce":1534047839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6821","nonce":1534047839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6825","nonce":1534047839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6823","nonce":1534047839}]},"public_addr":"172.21.15.99:6819/1534047839","cluster_addr":"172.21.15.99:6821/1534047839","heartbeat_back_addr":"172.21.15.99:6825/1534047839","heartbeat_front_addr":"172.21.15.99:6823/1534047839","state":["exists","up"]},{"osd":7,"uuid":"5e079cf5-1340-4599-88a6-df410ef0148e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6817","nonce":3875950553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6819","nonce":3875950553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6823","nonce":3875950553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6821","nonce":3875950553}]},"public_addr":"172.21.15.179:6817/3875950553","cluster_addr":"172.21.15.179:6819/3875950553","heartbeat_back_addr":"172.21.15.179:6823/3875950553","heartbeat_front_addr":"172.21.15.179:6821/3875950553","state":["exists","up"]},{"osd":8,"uuid":"10a73592-4251-4492-b67d-ce9b9d7fff32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6817","nonce":179568936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6819","nonce":179568936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6823","nonce":179568936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6821","nonce":179568936}]},"public_addr":"172.21.15.181:6817/179568936","cluster_addr":"172.21.15.181:6819/179568936","heartbeat_back_addr":"172.21.15.181:6823/179568936","heartbeat_front_addr":"172.21.15.181:6821/179568936","state":["exists","up"]},{"osd":9,"uuid":"f6620e1e-f761-4f1c-917f-cbc748df32a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6827","nonce":315759515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6829","nonce":315759515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6833","nonce":315759515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6831","nonce":315759515}]},"public_addr":"172.21.15.99:6827/315759515","cluster_addr":"172.21.15.99:6829/315759515","heartbeat_back_addr":"172.21.15.99:6833/315759515","heartbeat_front_addr":"172.21.15.99:6831/315759515","state":["exists","up"]},{"osd":10,"uuid":"ee86af7d-66f8-4795-bcc3-dfec79e4680c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6825","nonce":2985063934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6827","nonce":2985063934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6831","nonce":2985063934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6829","nonce":2985063934}]},"public_addr":"172.21.15.179:6825/2985063934","cluster_addr":"172.21.15.179:6827/2985063934","heartbeat_back_addr":"172.21.15.179:6831/2985063934","heartbeat_front_addr":"172.21.15.179:6829/2985063934","state":["exists","up"]},{"osd":11,"uuid":"82f04fee-f6ae-4630-a75b-b12a9c4ab2e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6825","nonce":1858219600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6827","nonce":1858219600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6831","nonce":1858219600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6829","nonce":1858219600}]},"public_addr":"172.21.15.181:6825/1858219600","cluster_addr":"172.21.15.181:6827/1858219600","heartbeat_back_addr":"172.21.15.181:6831/1858219600","heartbeat_front_addr":"172.21.15.181:6829/1858219600","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:55.518970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:04:19.936339+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:04:44.064814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:09.331683+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:34.616774+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:58.881810+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:06:23.869838+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:06:49.127331+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:07:12.847187+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:07:38.231045+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:08:03.949162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:08:28.471802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:0/401101729":"2024-02-01T05:02:20.510858+0000","172.21.15.99:6801/1993198206":"2024-02-01T05:02:20.510858+0000","172.21.15.99:0/3819754569":"2024-02-01T05:02:20.510858+0000","172.21.15.99:0/475390265":"2024-02-01T05:01:53.732026+0000","172.21.15.99:6800/1993198206":"2024-02-01T05:02:20.510858+0000","172.21.15.99:6800/1706888338":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/4150146075":"2024-02-01T05:01:53.732026+0000","172.21.15.99:6801/1706888338":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/2851066598":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/1865156424":"2024-02-01T05:02:20.510858+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:11:14.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.597+0000 7f6c7e33b640 1 -- 172.21.15.99:0/716335439 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f6c640a12e0 msgr2=0x7f6c640a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:14.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.597+0000 7f6c7e33b640 1 --2- 172.21.15.99:0/716335439 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f6c640a12e0 0x7f6c640a37a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6c60000c00 tx=0x7f6c6002c5d0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.597+0000 7f6c7e33b640 1 -- 172.21.15.99:0/716335439 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c781017c0 msgr2=0x7f6c7819e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:14.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.597+0000 7f6c7e33b640 1 --2- 172.21.15.99:0/716335439 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c781017c0 0x7f6c7819e2c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6c7000b970 tx=0x7f6c7000be30 comp rx=0 tx=0).stop 2024-01-31T05:11:14.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.597+0000 7f6c7e33b640 1 -- 172.21.15.99:0/716335439 shutdown_connections 2024-01-31T05:11:14.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.597+0000 7f6c7e33b640 1 --2- 172.21.15.99:0/716335439 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f6c640a12e0 0x7f6c640a37a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.597+0000 7f6c7e33b640 1 --2- 172.21.15.99:0/716335439 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c781017c0 0x7f6c7819e2c0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.597+0000 7f6c7e33b640 1 --2- 172.21.15.99:0/716335439 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c78100e00 0x7f6c78197290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.597+0000 7f6c7e33b640 1 --2- 172.21.15.99:0/716335439 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6c780ffc10 0x7f6c78196d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.597+0000 7f6c7e33b640 1 -- 172.21.15.99:0/716335439 >> 172.21.15.99:0/716335439 conn(0x7f6c780fb180 msgr2=0x7f6c780fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:14.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.597+0000 7f6c7e33b640 1 -- 172.21.15.99:0/716335439 shutdown_connections 2024-01-31T05:11:14.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.597+0000 7f6c7e33b640 1 -- 172.21.15.99:0/716335439 wait complete. 2024-01-31T05:11:14.609 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-01-31T05:09:20.564215+0000', 'modified': '2024-01-31T05:09:28.172314+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24497, 'mds_1': 24461, 'mds_2': 24457, 'mds_3': 24439, 'mds_4': 14619}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14607': {'gid': 14607, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.99:6839/4070477446', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6838', 'nonce': 4070477446}, {'type': 'v1', 'addr': '172.21.15.99:6839', 'nonce': 4070477446}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_14619': {'gid': 14619, 'name': 'a', 'rank': 4, 'incarnation': 24, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.99:6841/3069939345', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6840', 'nonce': 3069939345}, {'type': 'v1', 'addr': '172.21.15.99:6841', 'nonce': 3069939345}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24376': {'gid': 24376, 'name': 'l', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.181:6833/427201290', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6832', 'nonce': 427201290}, {'type': 'v1', 'addr': '172.21.15.181:6833', 'nonce': 427201290}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24401': {'gid': 24401, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.179:6833/472161020', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6832', 'nonce': 472161020}, {'type': 'v1', 'addr': '172.21.15.179:6833', 'nonce': 472161020}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24427': {'gid': 24427, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.181:6835/1038715471', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6834', 'nonce': 1038715471}, {'type': 'v1', 'addr': '172.21.15.181:6835', 'nonce': 1038715471}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24434': {'gid': 24434, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.179:6835/966976592', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6834', 'nonce': 966976592}, {'type': 'v1', 'addr': '172.21.15.179:6835', 'nonce': 966976592}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24439': {'gid': 24439, 'name': 'c', 'rank': 3, 'incarnation': 22, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.181:6837/3875964154', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6836', 'nonce': 3875964154}, {'type': 'v1', 'addr': '172.21.15.181:6837', 'nonce': 3875964154}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24457': {'gid': 24457, 'name': 'i', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.181:6839/996120687', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6838', 'nonce': 996120687}, {'type': 'v1', 'addr': '172.21.15.181:6839', 'nonce': 996120687}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24461': {'gid': 24461, 'name': 'h', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.179:6837/837402830', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6836', 'nonce': 837402830}, {'type': 'v1', 'addr': '172.21.15.179:6837', 'nonce': 837402830}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24497': {'gid': 24497, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.179:6839/754762785', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6838', 'nonce': 754762785}, {'type': 'v1', 'addr': '172.21.15.179:6839', 'nonce': 754762785}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-01-31T05:11:14.609 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-01-31T05:11:14.610 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-01-31T05:11:14.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.711+0000 7f3471c09640 1 -- 172.21.15.99:0/4250301271 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f346c106a50 msgr2=0x7f346c108e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:14.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.711+0000 7f3471c09640 1 --2- 172.21.15.99:0/4250301271 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f346c106a50 0x7f346c108e40 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3464009ca0 tx=0x7f346402c0f0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.711+0000 7f3471c09640 1 -- 172.21.15.99:0/4250301271 shutdown_connections 2024-01-31T05:11:14.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.711+0000 7f3471c09640 1 --2- 172.21.15.99:0/4250301271 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f346c106a50 0x7f346c108e40 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.711+0000 7f3471c09640 1 --2- 172.21.15.99:0/4250301271 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f346c104120 0x7f346c106510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.711+0000 7f3471c09640 1 --2- 172.21.15.99:0/4250301271 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f346c1017f0 0x7f346c103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.711+0000 7f3471c09640 1 -- 172.21.15.99:0/4250301271 >> 172.21.15.99:0/4250301271 conn(0x7f346c0fb180 msgr2=0x7f346c0fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:14.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.712+0000 7f3471c09640 1 -- 172.21.15.99:0/4250301271 shutdown_connections 2024-01-31T05:11:14.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.712+0000 7f3471c09640 1 -- 172.21.15.99:0/4250301271 wait complete. 2024-01-31T05:11:14.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.712+0000 7f3471c09640 1 Processor -- start 2024-01-31T05:11:14.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.712+0000 7f3471c09640 1 -- start start 2024-01-31T05:11:14.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.712+0000 7f3471c09640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f346c1017f0 0x7f346c196cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:14.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.712+0000 7f3471c09640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f346c104120 0x7f346c1971f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:14.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.712+0000 7f3471c09640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f346c106a50 0x7f346c19e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:14.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.712+0000 7f3471c09640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346c19e7c0 con 0x7f346c106a50 2024-01-31T05:11:14.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.712+0000 7f3471c09640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346c19e930 con 0x7f346c1017f0 2024-01-31T05:11:14.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.712+0000 7f3471c09640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346c19eaf0 con 0x7f346c104120 2024-01-31T05:11:14.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.712+0000 7f346bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f346c106a50 0x7f346c19e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:14.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.712+0000 7f346bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f346c106a50 0x7f346c19e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54298/0 (socket says 172.21.15.99:54298) 2024-01-31T05:11:14.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.713+0000 7f346bfff640 1 -- 172.21.15.99:0/2218561640 learned_addr learned my addr 172.21.15.99:0/2218561640 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:14.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.713+0000 7f346b7fe640 1 --2- 172.21.15.99:0/2218561640 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f346c1017f0 0x7f346c196cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:14.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.713+0000 7f346affd640 1 --2- 172.21.15.99:0/2218561640 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f346c104120 0x7f346c1971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:14.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.713+0000 7f346bfff640 1 -- 172.21.15.99:0/2218561640 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f346c104120 msgr2=0x7f346c1971f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:14.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.713+0000 7f346bfff640 1 --2- 172.21.15.99:0/2218561640 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f346c104120 0x7f346c1971f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.713+0000 7f346bfff640 1 -- 172.21.15.99:0/2218561640 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f346c1017f0 msgr2=0x7f346c196cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:14.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.713+0000 7f346bfff640 1 --2- 172.21.15.99:0/2218561640 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f346c1017f0 0x7f346c196cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.713+0000 7f346bfff640 1 -- 172.21.15.99:0/2218561640 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3464009900 con 0x7f346c106a50 2024-01-31T05:11:14.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.713+0000 7f346bfff640 1 --2- 172.21.15.99:0/2218561640 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f346c106a50 0x7f346c19e250 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3464037040 tx=0x7f3464032810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:14.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.713+0000 7f3468ff9640 1 -- 172.21.15.99:0/2218561640 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3464034e80 con 0x7f346c106a50 2024-01-31T05:11:14.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.713+0000 7f3468ff9640 1 -- 172.21.15.99:0/2218561640 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3464003e30 con 0x7f346c106a50 2024-01-31T05:11:14.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.713+0000 7f3471c09640 1 -- 172.21.15.99:0/2218561640 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f346c19ed70 con 0x7f346c106a50 2024-01-31T05:11:14.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.713+0000 7f3468ff9640 1 -- 172.21.15.99:0/2218561640 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346403d3f0 con 0x7f346c106a50 2024-01-31T05:11:14.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.713+0000 7f3471c09640 1 -- 172.21.15.99:0/2218561640 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f346c19f1d0 con 0x7f346c106a50 2024-01-31T05:11:14.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.715+0000 7f3468ff9640 1 -- 172.21.15.99:0/2218561640 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f346403b040 con 0x7f346c106a50 2024-01-31T05:11:14.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.715+0000 7f34749d0740 1 Processor -- start 2024-01-31T05:11:14.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.715+0000 7f34749d0740 1 -- start start 2024-01-31T05:11:14.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.716+0000 7f3468ff9640 1 --2- 172.21.15.99:0/2218561640 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f34540a12e0 0x7f34540a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:14.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.716+0000 7f34749d0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d0ed89670 0x555d0ed89a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:14.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.716+0000 7f34749d0740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555d0ed8a060 0x555d0ed8eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:14.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.716+0000 7f34749d0740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d0ed8f1d0 0x555d0ed91660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:14.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.716+0000 7f346affd640 1 --2- 172.21.15.99:0/2218561640 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f34540a12e0 0x7f34540a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:14.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.716+0000 7f34749d0740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d0ecf8000 con 0x555d0ed8f1d0 2024-01-31T05:11:14.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.716+0000 7f34749d0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d0ecf56f0 con 0x555d0ed89670 2024-01-31T05:11:14.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.716+0000 7f34749d0740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d0ecf0fe0 con 0x555d0ed8a060 2024-01-31T05:11:14.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.716+0000 7f3468ff9640 1 -- 172.21.15.99:0/2218561640 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f34640ef270 con 0x7f346c106a50 2024-01-31T05:11:14.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.716+0000 7f346bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d0ed8f1d0 0x555d0ed91660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:14.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.716+0000 7f346bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d0ed8f1d0 0x555d0ed91660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54312/0 (socket says 172.21.15.99:54312) 2024-01-31T05:11:14.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.716+0000 7f346bfff640 1 -- 172.21.15.99:0/2744353547 learned_addr learned my addr 172.21.15.99:0/2744353547 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:14.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.716+0000 7f346b7fe640 1 --2- 172.21.15.99:0/2744353547 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d0ed89670 0x555d0ed89a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:14.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.716+0000 7f346affd640 1 --2- 172.21.15.99:0/2744353547 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555d0ed8a060 0x555d0ed8eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:14.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.716+0000 7f346bfff640 1 -- 172.21.15.99:0/2744353547 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555d0ed8a060 msgr2=0x555d0ed8eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:14.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.716+0000 7f346bfff640 1 --2- 172.21.15.99:0/2744353547 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555d0ed8a060 0x555d0ed8eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.716+0000 7f346bfff640 1 -- 172.21.15.99:0/2744353547 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d0ed89670 msgr2=0x555d0ed89a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:14.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.716+0000 7f346bfff640 1 --2- 172.21.15.99:0/2744353547 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d0ed89670 0x555d0ed89a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.716+0000 7f346affd640 1 --2- 172.21.15.99:0/2218561640 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f34540a12e0 0x7f34540a37a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3460005fd0 tx=0x7f346000f360 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:14.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.716+0000 7f346bfff640 1 -- 172.21.15.99:0/2744353547 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d0ecb3650 con 0x555d0ed8f1d0 2024-01-31T05:11:14.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.716+0000 7f346bfff640 1 --2- 172.21.15.99:0/2744353547 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d0ed8f1d0 0x555d0ed91660 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3464006010 tx=0x7f3464004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a97f11f684ef0fce server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:14.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.716+0000 7f3451ffb640 1 -- 172.21.15.99:0/2744353547 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34640bcb70 con 0x555d0ed8f1d0 2024-01-31T05:11:14.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.716+0000 7f3451ffb640 1 -- 172.21.15.99:0/2744353547 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f34640bc470 con 0x555d0ed8f1d0 2024-01-31T05:11:14.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.716+0000 7f3451ffb640 1 -- 172.21.15.99:0/2744353547 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34640b8b80 con 0x555d0ed8f1d0 2024-01-31T05:11:14.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.717+0000 7f34749d0740 1 -- 172.21.15.99:0/2744353547 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d0ed8f1d0 msgr2=0x555d0ed91660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:14.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.717+0000 7f34749d0740 1 --2- 172.21.15.99:0/2744353547 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d0ed8f1d0 0x555d0ed91660 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3464006010 tx=0x7f3464004a40 comp rx=0 tx=0).stop 2024-01-31T05:11:14.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.717+0000 7f34749d0740 1 -- 172.21.15.99:0/2744353547 shutdown_connections 2024-01-31T05:11:14.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.717+0000 7f34749d0740 1 --2- 172.21.15.99:0/2744353547 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d0ed8f1d0 0x555d0ed91660 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.717+0000 7f34749d0740 1 --2- 172.21.15.99:0/2744353547 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555d0ed8a060 0x555d0ed8eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.717+0000 7f34749d0740 1 --2- 172.21.15.99:0/2744353547 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d0ed89670 0x555d0ed89a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.717+0000 7f34749d0740 1 -- 172.21.15.99:0/2744353547 >> 172.21.15.99:0/2744353547 conn(0x555d0ed84be0 msgr2=0x555d0ed84fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:14.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.717+0000 7f34749d0740 1 -- 172.21.15.99:0/2744353547 shutdown_connections 2024-01-31T05:11:14.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.717+0000 7f34749d0740 1 -- 172.21.15.99:0/2744353547 wait complete. 2024-01-31T05:11:14.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.717+0000 7f34749d0740 1 -- start start 2024-01-31T05:11:14.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.718+0000 7f34749d0740 1 Processor -- start 2024-01-31T05:11:14.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.718+0000 7f34749d0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d0ed89670 0x555d0ed934f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:14.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.718+0000 7f34749d0740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555d0ed8a060 0x555d0ed93a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:14.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.718+0000 7f34749d0740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d0ed8f1d0 0x555d0ed9aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:14.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.718+0000 7f34749d0740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d0ecaa5c0 con 0x555d0ed8f1d0 2024-01-31T05:11:14.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.718+0000 7f34749d0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d0ecaa260 con 0x555d0ed89670 2024-01-31T05:11:14.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.718+0000 7f34749d0740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d0ec6f2d0 con 0x555d0ed8a060 2024-01-31T05:11:14.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.718+0000 7f34749d0740 10 client.0 _ll_register_callbacks cb 0x555d0eca5230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:11:14.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.718+0000 7f346bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d0ed8f1d0 0x555d0ed9aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:14.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.718+0000 7f346bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d0ed8f1d0 0x555d0ed9aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54328/0 (socket says 172.21.15.99:54328) 2024-01-31T05:11:14.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.718+0000 7f346bfff640 1 -- 172.21.15.99:0/17893074 learned_addr learned my addr 172.21.15.99:0/17893074 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:14.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.718+0000 7f346b7fe640 1 --2- 172.21.15.99:0/17893074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d0ed89670 0x555d0ed934f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:14.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.718+0000 7f346affd640 1 --2- 172.21.15.99:0/17893074 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555d0ed8a060 0x555d0ed93a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:14.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.718+0000 7f346bfff640 1 -- 172.21.15.99:0/17893074 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555d0ed8a060 msgr2=0x555d0ed93a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:14.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.718+0000 7f346bfff640 1 --2- 172.21.15.99:0/17893074 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555d0ed8a060 0x555d0ed93a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.718+0000 7f346bfff640 1 -- 172.21.15.99:0/17893074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d0ed89670 msgr2=0x555d0ed934f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:14.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.718+0000 7f346bfff640 1 --2- 172.21.15.99:0/17893074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d0ed89670 0x555d0ed934f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.718+0000 7f346bfff640 1 -- 172.21.15.99:0/17893074 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f346c19f1d0 con 0x555d0ed8f1d0 2024-01-31T05:11:14.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.718+0000 7f346bfff640 1 --2- 172.21.15.99:0/17893074 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d0ed8f1d0 0x555d0ed9aa70 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f34640b8ee0 tx=0x7f34640042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12dacfb0eb87f128 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:14.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.718+0000 7f344affd640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:11:14.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.718+0000 7f344affd640 1 -- 172.21.15.99:0/17893074 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34640da070 con 0x555d0ed8f1d0 2024-01-31T05:11:14.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.718+0000 7f344affd640 1 -- 172.21.15.99:0/17893074 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f34640c05c0 con 0x555d0ed8f1d0 2024-01-31T05:11:14.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.718+0000 7f34749d0740 1 -- 172.21.15.99:0/17893074 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555d0ece9e70 con 0x555d0ed8f1d0 2024-01-31T05:11:14.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.719+0000 7f344affd640 1 -- 172.21.15.99:0/17893074 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f34640bcb70 con 0x555d0ed8f1d0 2024-01-31T05:11:14.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.719+0000 7f34749d0740 10 client.15228 fetch_fsmap learned FSMap version 26 2024-01-31T05:11:14.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.719+0000 7f34749d0740 1 -- 172.21.15.99:0/17893074 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x555d0ecef660 con 0x555d0ed8f1d0 2024-01-31T05:11:14.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.719+0000 7f344affd640 1 -- 172.21.15.99:0/17893074 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x555d0ece9e70 con 0x555d0ed8f1d0 2024-01-31T05:11:14.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.719+0000 7f344affd640 1 -- 172.21.15.99:0/17893074 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f34640b8260 con 0x555d0ed8f1d0 2024-01-31T05:11:14.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.719+0000 7f34749d0740 10 client.15228 fetch_fsmap finished waiting for FSMap version 26 2024-01-31T05:11:14.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.719+0000 7f34749d0740 10 client.15228 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-31T05:11:14.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.719+0000 7f34749d0740 20 client.15228 populate_metadata read hostname 'smithi099' 2024-01-31T05:11:14.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.719+0000 7f34749d0740 1 --2- 172.21.15.99:0/17893074 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x555d0eda00b0 0x555d0ed9ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:14.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.719+0000 7f34749d0740 4 client.15228 mds_command: new command op to 14619 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:11:14.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.719+0000 7f34749d0740 1 -- 172.21.15.99:0/17893074 --> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555d0ece9b90 con 0x555d0eda00b0 2024-01-31T05:11:14.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.719+0000 7f346b7fe640 1 --2- 172.21.15.99:0/17893074 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x555d0eda00b0 0x555d0ed9ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:14.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.719+0000 7f344affd640 10 client.15228 ms_handle_connect on v2:172.21.15.99:6840/3069939345 2024-01-31T05:11:14.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.719+0000 7f346b7fe640 1 --2- 172.21.15.99:0/17893074 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x555d0eda00b0 0x555d0ed9ef60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=dbd8b65a71f877a8 server_cookie=c76e64b6a375dd4f in_seq=0 out_seq=0 2024-01-31T05:11:14.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.720+0000 7f344affd640 1 -- 172.21.15.99:0/17893074 <== mds.4 v2:172.21.15.99:6840/3069939345 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555d0ece9b90 con 0x555d0eda00b0 2024-01-31T05:11:14.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.720+0000 7f344affd640 10 client.15228 handle_command_reply: tid=0 2024-01-31T05:11:14.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.720+0000 7f34749d0740 1 client.15228 shutdown 2024-01-31T05:11:14.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.720+0000 7f34749d0740 1 -- 172.21.15.99:0/17893074 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d0ed8f1d0 msgr2=0x555d0ed9aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:14.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.720+0000 7f34749d0740 1 --2- 172.21.15.99:0/17893074 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d0ed8f1d0 0x555d0ed9aa70 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f34640b8ee0 tx=0x7f34640042c0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.720+0000 7f34749d0740 1 -- 172.21.15.99:0/17893074 shutdown_connections 2024-01-31T05:11:14.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.720+0000 7f34749d0740 1 --2- 172.21.15.99:0/17893074 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x555d0eda00b0 0x555d0ed9ef60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.720+0000 7f34749d0740 1 --2- 172.21.15.99:0/17893074 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d0ed8f1d0 0x555d0ed9aa70 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.720+0000 7f34749d0740 1 --2- 172.21.15.99:0/17893074 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555d0ed8a060 0x555d0ed93a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.720+0000 7f344affd640 0 client.15228 ms_handle_reset on v2:172.21.15.99:6840/3069939345 2024-01-31T05:11:14.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.720+0000 7f34749d0740 1 --2- 172.21.15.99:0/17893074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d0ed89670 0x555d0ed934f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.720+0000 7f34749d0740 1 -- 172.21.15.99:0/17893074 >> 172.21.15.99:0/17893074 conn(0x555d0ed84be0 msgr2=0x555d0ed83d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:14.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.720+0000 7f34749d0740 1 -- 172.21.15.99:0/17893074 shutdown_connections 2024-01-31T05:11:14.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.720+0000 7f34749d0740 1 -- 172.21.15.99:0/17893074 wait complete. 2024-01-31T05:11:14.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.720+0000 7f34749d0740 20 client.15228 trim_cache size 0 max 16384 2024-01-31T05:11:14.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.738+0000 7f34749d0740 1 Processor -- start 2024-01-31T05:11:14.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.738+0000 7f34749d0740 1 -- start start 2024-01-31T05:11:14.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.738+0000 7f34749d0740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d0ed89670 0x555d0ed834e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:14.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.738+0000 7f34749d0740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555d0ed8a060 0x555d0ed9aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:14.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.738+0000 7f34749d0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d0ed8f1d0 0x555d0ed83a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:14.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.738+0000 7f34749d0740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d0ecf56f0 con 0x555d0ed89670 2024-01-31T05:11:14.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.738+0000 7f34749d0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d0ecaa260 con 0x555d0ed8f1d0 2024-01-31T05:11:14.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.738+0000 7f34749d0740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d0ed851f0 con 0x555d0ed8a060 2024-01-31T05:11:14.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.738+0000 7f346b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d0ed89670 0x555d0ed834e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:14.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.738+0000 7f346b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d0ed89670 0x555d0ed834e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54344/0 (socket says 172.21.15.99:54344) 2024-01-31T05:11:14.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.738+0000 7f346b7fe640 1 -- 172.21.15.99:0/2457540934 learned_addr learned my addr 172.21.15.99:0/2457540934 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:14.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.738+0000 7f346bfff640 1 --2- 172.21.15.99:0/2457540934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d0ed8f1d0 0x555d0ed83a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:14.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.738+0000 7f346affd640 1 --2- 172.21.15.99:0/2457540934 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555d0ed8a060 0x555d0ed9aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:14.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.738+0000 7f346b7fe640 1 -- 172.21.15.99:0/2457540934 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555d0ed8a060 msgr2=0x555d0ed9aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:14.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.738+0000 7f346b7fe640 1 --2- 172.21.15.99:0/2457540934 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555d0ed8a060 0x555d0ed9aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.738+0000 7f346b7fe640 1 -- 172.21.15.99:0/2457540934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d0ed8f1d0 msgr2=0x555d0ed83a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:14.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.738+0000 7f346b7fe640 1 --2- 172.21.15.99:0/2457540934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d0ed8f1d0 0x555d0ed83a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.738+0000 7f346b7fe640 1 -- 172.21.15.99:0/2457540934 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d0ec8c360 con 0x555d0ed89670 2024-01-31T05:11:14.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.738+0000 7f346b7fe640 1 --2- 172.21.15.99:0/2457540934 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d0ed89670 0x555d0ed834e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f346c197b80 tx=0x7f345c00b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34fbfb6cc2802e28 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:14.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.740+0000 7f34517fa640 1 -- 172.21.15.99:0/2457540934 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345c003d60 con 0x555d0ed89670 2024-01-31T05:11:14.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.740+0000 7f34517fa640 1 -- 172.21.15.99:0/2457540934 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f345c017040 con 0x555d0ed89670 2024-01-31T05:11:14.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.740+0000 7f34517fa640 1 -- 172.21.15.99:0/2457540934 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345c004ea0 con 0x555d0ed89670 2024-01-31T05:11:14.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.740+0000 7f34749d0740 1 -- 172.21.15.99:0/2457540934 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d0ed89670 msgr2=0x555d0ed834e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:14.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.740+0000 7f34749d0740 1 --2- 172.21.15.99:0/2457540934 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d0ed89670 0x555d0ed834e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f346c197b80 tx=0x7f345c00b390 comp rx=0 tx=0).stop 2024-01-31T05:11:14.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.740+0000 7f34749d0740 1 -- 172.21.15.99:0/2457540934 shutdown_connections 2024-01-31T05:11:14.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.740+0000 7f34749d0740 1 --2- 172.21.15.99:0/2457540934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d0ed8f1d0 0x555d0ed83a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.740+0000 7f34749d0740 1 --2- 172.21.15.99:0/2457540934 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555d0ed8a060 0x555d0ed9aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.740+0000 7f34749d0740 1 --2- 172.21.15.99:0/2457540934 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d0ed89670 0x555d0ed834e0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.740+0000 7f34749d0740 1 -- 172.21.15.99:0/2457540934 >> 172.21.15.99:0/2457540934 conn(0x555d0ed84be0 msgr2=0x555d0ed8b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:14.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.740+0000 7f34749d0740 1 -- 172.21.15.99:0/2457540934 shutdown_connections 2024-01-31T05:11:14.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.740+0000 7f34749d0740 1 -- 172.21.15.99:0/2457540934 wait complete. 2024-01-31T05:11:14.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.741+0000 7f34749d0740 1 -- start start 2024-01-31T05:11:14.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.741+0000 7f34749d0740 1 Processor -- start 2024-01-31T05:11:14.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.741+0000 7f34749d0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d0ed89670 0x555d0ed984b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:14.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.741+0000 7f34749d0740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555d0ed8a060 0x555d0ed989f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:14.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.741+0000 7f34749d0740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d0ed8f1d0 0x555d0ed99a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:14.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.741+0000 7f34749d0740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d0ed8ad30 con 0x555d0ed8f1d0 2024-01-31T05:11:14.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.741+0000 7f34749d0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d0eda0940 con 0x555d0ed89670 2024-01-31T05:11:14.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.741+0000 7f34749d0740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d0ecf8000 con 0x555d0ed8a060 2024-01-31T05:11:14.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.741+0000 7f34749d0740 10 client.0 _ll_register_callbacks cb 0x7f34640b8040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:11:14.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.741+0000 7f346bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d0ed8f1d0 0x555d0ed99a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:14.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.741+0000 7f346bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d0ed8f1d0 0x555d0ed99a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54350/0 (socket says 172.21.15.99:54350) 2024-01-31T05:11:14.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.741+0000 7f346bfff640 1 -- 172.21.15.99:0/2047229741 learned_addr learned my addr 172.21.15.99:0/2047229741 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:14.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.741+0000 7f346b7fe640 1 --2- 172.21.15.99:0/2047229741 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d0ed89670 0x555d0ed984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:14.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.741+0000 7f346affd640 1 --2- 172.21.15.99:0/2047229741 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555d0ed8a060 0x555d0ed989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:14.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.741+0000 7f346bfff640 1 -- 172.21.15.99:0/2047229741 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555d0ed8a060 msgr2=0x555d0ed989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:14.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.741+0000 7f346bfff640 1 --2- 172.21.15.99:0/2047229741 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555d0ed8a060 0x555d0ed989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.741+0000 7f346bfff640 1 -- 172.21.15.99:0/2047229741 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d0ed89670 msgr2=0x555d0ed984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:14.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.741+0000 7f346bfff640 1 --2- 172.21.15.99:0/2047229741 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d0ed89670 0x555d0ed984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.741+0000 7f346bfff640 1 -- 172.21.15.99:0/2047229741 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f345c004340 con 0x555d0ed8f1d0 2024-01-31T05:11:14.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.742+0000 7f346bfff640 1 --2- 172.21.15.99:0/2047229741 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d0ed8f1d0 0x555d0ed99a00 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f3464005e30 tx=0x7f3464004370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeb147d737048987 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:14.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.742+0000 7f344affd640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:11:14.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.742+0000 7f344affd640 1 -- 172.21.15.99:0/2047229741 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34640da040 con 0x555d0ed8f1d0 2024-01-31T05:11:14.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.742+0000 7f344affd640 1 -- 172.21.15.99:0/2047229741 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f34640c4800 con 0x555d0ed8f1d0 2024-01-31T05:11:14.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.742+0000 7f34749d0740 1 -- 172.21.15.99:0/2047229741 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555d0eda0a80 con 0x555d0ed8f1d0 2024-01-31T05:11:14.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.742+0000 7f344affd640 1 -- 172.21.15.99:0/2047229741 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f34640c0360 con 0x555d0ed8f1d0 2024-01-31T05:11:14.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.742+0000 7f34749d0740 10 client.15234 fetch_fsmap learned FSMap version 26 2024-01-31T05:11:14.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.742+0000 7f34749d0740 1 -- 172.21.15.99:0/2047229741 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x555d0ecb1eb0 con 0x555d0ed8f1d0 2024-01-31T05:11:14.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.742+0000 7f344affd640 1 -- 172.21.15.99:0/2047229741 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x555d0eda0a80 con 0x555d0ed8f1d0 2024-01-31T05:11:14.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.742+0000 7f344affd640 1 -- 172.21.15.99:0/2047229741 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f346402cca0 con 0x555d0ed8f1d0 2024-01-31T05:11:14.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.742+0000 7f34749d0740 10 client.15234 fetch_fsmap finished waiting for FSMap version 26 2024-01-31T05:11:14.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.742+0000 7f34749d0740 10 client.15234 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-31T05:11:14.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.742+0000 7f34749d0740 20 client.15234 populate_metadata read hostname 'smithi099' 2024-01-31T05:11:14.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.742+0000 7f34749d0740 1 --2- 172.21.15.99:0/2047229741 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x555d0eda00b0 0x555d0edf71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:14.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.742+0000 7f34749d0740 4 client.15234 mds_command: new command op to 14619 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-31T05:11:14.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.742+0000 7f34749d0740 1 -- 172.21.15.99:0/2047229741 --> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555d0ed9fdc0 con 0x555d0eda00b0 2024-01-31T05:11:14.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.742+0000 7f346b7fe640 1 --2- 172.21.15.99:0/2047229741 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x555d0eda00b0 0x555d0edf71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:14.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.743+0000 7f344affd640 10 client.15234 ms_handle_connect on v2:172.21.15.99:6840/3069939345 2024-01-31T05:11:14.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.743+0000 7f346b7fe640 1 --2- 172.21.15.99:0/2047229741 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x555d0eda00b0 0x555d0edf71c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=85b680740a7ed23b server_cookie=20fad59ee3d28071 in_seq=0 out_seq=0 2024-01-31T05:11:14.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.743+0000 7f344affd640 1 -- 172.21.15.99:0/2047229741 <== mds.4 v2:172.21.15.99:6840/3069939345 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x555d0ed9fdc0 con 0x555d0eda00b0 2024-01-31T05:11:14.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.743+0000 7f344affd640 10 client.15234 handle_command_reply: tid=0 2024-01-31T05:11:14.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.743+0000 7f34749d0740 1 client.15234 shutdown 2024-01-31T05:11:14.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.743+0000 7f34749d0740 1 -- 172.21.15.99:0/2047229741 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d0ed8f1d0 msgr2=0x555d0ed99a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:14.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.743+0000 7f34749d0740 1 --2- 172.21.15.99:0/2047229741 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d0ed8f1d0 0x555d0ed99a00 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f3464005e30 tx=0x7f3464004370 comp rx=0 tx=0).stop 2024-01-31T05:11:14.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.743+0000 7f34749d0740 1 -- 172.21.15.99:0/2047229741 shutdown_connections 2024-01-31T05:11:14.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.743+0000 7f34749d0740 1 --2- 172.21.15.99:0/2047229741 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x555d0eda00b0 0x555d0edf71c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.743+0000 7f34749d0740 1 --2- 172.21.15.99:0/2047229741 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d0ed8f1d0 0x555d0ed99a00 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.743+0000 7f344affd640 0 client.15234 ms_handle_reset on v2:172.21.15.99:6840/3069939345 2024-01-31T05:11:14.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.743+0000 7f34749d0740 1 --2- 172.21.15.99:0/2047229741 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555d0ed8a060 0x555d0ed989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.743+0000 7f34749d0740 1 --2- 172.21.15.99:0/2047229741 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d0ed89670 0x555d0ed984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.743+0000 7f34749d0740 1 -- 172.21.15.99:0/2047229741 >> 172.21.15.99:0/2047229741 conn(0x555d0ed84be0 msgr2=0x555d0ed834e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:14.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.743+0000 7f34749d0740 1 -- 172.21.15.99:0/2047229741 shutdown_connections 2024-01-31T05:11:14.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.743+0000 7f34749d0740 1 -- 172.21.15.99:0/2047229741 wait complete. 2024-01-31T05:11:14.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.743+0000 7f34749d0740 20 client.15234 trim_cache size 0 max 16384 2024-01-31T05:11:14.750 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-01-31T05:11:14.750 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_fsid": "9288ff44-bff5-11ee-95b3-87774f69a715", 2024-01-31T05:11:14.750 INFO:teuthology.orchestra.run.smithi099.stdout: "whoami": 4, 2024-01-31T05:11:14.750 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 14619, 2024-01-31T05:11:14.750 INFO:teuthology.orchestra.run.smithi099.stdout: "want_state": "up:active", 2024-01-31T05:11:14.750 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "up:active", 2024-01-31T05:11:14.750 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "cephfs", 2024-01-31T05:11:14.750 INFO:teuthology.orchestra.run.smithi099.stdout: "rank_uptime": 107.57617469900001, 2024-01-31T05:11:14.750 INFO:teuthology.orchestra.run.smithi099.stdout: "mdsmap_epoch": 26, 2024-01-31T05:11:14.751 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch": 88, 2024-01-31T05:11:14.751 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch_barrier": 86, 2024-01-31T05:11:14.751 INFO:teuthology.orchestra.run.smithi099.stdout: "uptime": 121.57560727000001 2024-01-31T05:11:14.751 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-01-31T05:11:14.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.744+0000 7f3471c09640 1 -- 172.21.15.99:0/2218561640 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f34540a12e0 msgr2=0x7f34540a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:14.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.744+0000 7f3471c09640 1 --2- 172.21.15.99:0/2218561640 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f34540a12e0 0x7f34540a37a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3460005fd0 tx=0x7f346000f360 comp rx=0 tx=0).stop 2024-01-31T05:11:14.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.744+0000 7f3471c09640 1 -- 172.21.15.99:0/2218561640 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f346c106a50 msgr2=0x7f346c19e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:14.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.744+0000 7f3471c09640 1 --2- 172.21.15.99:0/2218561640 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f346c106a50 0x7f346c19e250 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3464037040 tx=0x7f3464032810 comp rx=0 tx=0).stop 2024-01-31T05:11:14.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.744+0000 7f3471c09640 1 -- 172.21.15.99:0/2218561640 shutdown_connections 2024-01-31T05:11:14.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.744+0000 7f3471c09640 1 --2- 172.21.15.99:0/2218561640 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f34540a12e0 0x7f34540a37a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.744+0000 7f3471c09640 1 --2- 172.21.15.99:0/2218561640 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f346c106a50 0x7f346c19e250 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.744+0000 7f3471c09640 1 --2- 172.21.15.99:0/2218561640 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f346c104120 0x7f346c1971f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.744+0000 7f3471c09640 1 --2- 172.21.15.99:0/2218561640 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f346c1017f0 0x7f346c196cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.744+0000 7f3471c09640 1 -- 172.21.15.99:0/2218561640 >> 172.21.15.99:0/2218561640 conn(0x7f346c0fb180 msgr2=0x7f346c102210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:14.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.744+0000 7f3471c09640 1 -- 172.21.15.99:0/2218561640 shutdown_connections 2024-01-31T05:11:14.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.744+0000 7f3471c09640 1 -- 172.21.15.99:0/2218561640 wait complete. 2024-01-31T05:11:14.755 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-01-31T05:11:14.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.857+0000 7f33efddd640 1 -- 172.21.15.99:0/130258765 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f33e81017b0 msgr2=0x7f33e8108040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:14.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.857+0000 7f33efddd640 1 --2- 172.21.15.99:0/130258765 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f33e81017b0 0x7f33e8108040 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f33e0009ca0 tx=0x7f33e002c0f0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.857+0000 7f33efddd640 1 -- 172.21.15.99:0/130258765 shutdown_connections 2024-01-31T05:11:14.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.857+0000 7f33efddd640 1 --2- 172.21.15.99:0/130258765 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f33e81017b0 0x7f33e8108040 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.857+0000 7f33efddd640 1 --2- 172.21.15.99:0/130258765 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f33e8100df0 0x7f33e8101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.857+0000 7f33efddd640 1 --2- 172.21.15.99:0/130258765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33e80ffc00 0x7f33e8100020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.857+0000 7f33efddd640 1 -- 172.21.15.99:0/130258765 >> 172.21.15.99:0/130258765 conn(0x7f33e80fb190 msgr2=0x7f33e80fd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:14.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.857+0000 7f33efddd640 1 -- 172.21.15.99:0/130258765 shutdown_connections 2024-01-31T05:11:14.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.857+0000 7f33efddd640 1 -- 172.21.15.99:0/130258765 wait complete. 2024-01-31T05:11:14.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.857+0000 7f33efddd640 1 Processor -- start 2024-01-31T05:11:14.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.857+0000 7f33efddd640 1 -- start start 2024-01-31T05:11:14.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.858+0000 7f33efddd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33e80ffc00 0x7f33e8069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:14.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.858+0000 7f33efddd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f33e8100df0 0x7f33e819b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:14.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.858+0000 7f33efddd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f33e81017b0 0x7f33e819e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:14.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.858+0000 7f33efddd640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e819e7f0 con 0x7f33e81017b0 2024-01-31T05:11:14.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.858+0000 7f33efddd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e819e960 con 0x7f33e80ffc00 2024-01-31T05:11:14.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.858+0000 7f33efddd640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e819eb20 con 0x7f33e8100df0 2024-01-31T05:11:14.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.858+0000 7f33ee37a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f33e81017b0 0x7f33e819e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:14.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.858+0000 7f33ee37a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f33e81017b0 0x7f33e819e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54372/0 (socket says 172.21.15.99:54372) 2024-01-31T05:11:14.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.858+0000 7f33ee37a640 1 -- 172.21.15.99:0/670522744 learned_addr learned my addr 172.21.15.99:0/670522744 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:14.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.858+0000 7f33ed378640 1 --2- 172.21.15.99:0/670522744 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f33e8100df0 0x7f33e819b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:14.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.858+0000 7f33ee37a640 1 -- 172.21.15.99:0/670522744 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f33e8100df0 msgr2=0x7f33e819b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:14.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.858+0000 7f33ee37a640 1 --2- 172.21.15.99:0/670522744 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f33e8100df0 0x7f33e819b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.858+0000 7f33ee37a640 1 -- 172.21.15.99:0/670522744 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33e80ffc00 msgr2=0x7f33e8069e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:14.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.858+0000 7f33edb79640 1 --2- 172.21.15.99:0/670522744 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33e80ffc00 0x7f33e8069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:14.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.858+0000 7f33ee37a640 1 --2- 172.21.15.99:0/670522744 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33e80ffc00 0x7f33e8069e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.858+0000 7f33ee37a640 1 -- 172.21.15.99:0/670522744 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e0009900 con 0x7f33e81017b0 2024-01-31T05:11:14.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.858+0000 7f33ed378640 1 --2- 172.21.15.99:0/670522744 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f33e8100df0 0x7f33e819b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:11:14.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.858+0000 7f33edb79640 1 --2- 172.21.15.99:0/670522744 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33e80ffc00 0x7f33e8069e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:11:14.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.858+0000 7f33ee37a640 1 --2- 172.21.15.99:0/670522744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f33e81017b0 0x7f33e819e010 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f33e0037040 tx=0x7f33e0032810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:14.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.858+0000 7f33deffd640 1 -- 172.21.15.99:0/670522744 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e0034e80 con 0x7f33e81017b0 2024-01-31T05:11:14.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.858+0000 7f33deffd640 1 -- 172.21.15.99:0/670522744 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f33e0003e30 con 0x7f33e81017b0 2024-01-31T05:11:14.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.858+0000 7f33efddd640 1 -- 172.21.15.99:0/670522744 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33e819ed40 con 0x7f33e81017b0 2024-01-31T05:11:14.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.858+0000 7f33deffd640 1 -- 172.21.15.99:0/670522744 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e003d3f0 con 0x7f33e81017b0 2024-01-31T05:11:14.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.858+0000 7f33efddd640 1 -- 172.21.15.99:0/670522744 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33e819f1a0 con 0x7f33e81017b0 2024-01-31T05:11:14.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.861+0000 7f33deffd640 1 -- 172.21.15.99:0/670522744 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f33e003b040 con 0x7f33e81017b0 2024-01-31T05:11:14.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.861+0000 7f33f2ba1740 1 Processor -- start 2024-01-31T05:11:14.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.861+0000 7f33f2ba1740 1 -- start start 2024-01-31T05:11:14.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.861+0000 7f33f2ba1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556a0fc06670 0x556a0fc06a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:14.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.861+0000 7f33deffd640 1 --2- 172.21.15.99:0/670522744 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f33d40a12e0 0x7f33d40a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:14.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.861+0000 7f33f2ba1740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556a0fc07060 0x556a0fc0bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:14.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.861+0000 7f33f2ba1740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556a0fc0c1d0 0x556a0fc0e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:14.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.861+0000 7f33f2ba1740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a0fb75000 con 0x556a0fc0c1d0 2024-01-31T05:11:14.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.861+0000 7f33f2ba1740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a0fb726f0 con 0x556a0fc07060 2024-01-31T05:11:14.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.861+0000 7f33f2ba1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a0fb6dfe0 con 0x556a0fc06670 2024-01-31T05:11:14.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.862+0000 7f33ee37a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556a0fc0c1d0 0x556a0fc0e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:14.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.862+0000 7f33ee37a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556a0fc0c1d0 0x556a0fc0e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54374/0 (socket says 172.21.15.99:54374) 2024-01-31T05:11:14.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.862+0000 7f33ee37a640 1 -- 172.21.15.99:0/2100344084 learned_addr learned my addr 172.21.15.99:0/2100344084 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:14.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.862+0000 7f33edb79640 1 --2- 172.21.15.99:0/670522744 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f33d40a12e0 0x7f33d40a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:14.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.862+0000 7f33deffd640 1 -- 172.21.15.99:0/670522744 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f33e00ef320 con 0x7f33e81017b0 2024-01-31T05:11:14.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.862+0000 7f33ed378640 1 --2- 172.21.15.99:0/2100344084 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556a0fc06670 0x556a0fc06a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:14.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.862+0000 7f33ed378640 1 --2- 172.21.15.99:0/2100344084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556a0fc07060 0x556a0fc0bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:14.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.862+0000 7f33ee37a640 1 -- 172.21.15.99:0/2100344084 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556a0fc06670 msgr2=0x556a0fc06a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:14.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.862+0000 7f33ee37a640 1 --2- 172.21.15.99:0/2100344084 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556a0fc06670 0x556a0fc06a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.862+0000 7f33ee37a640 1 -- 172.21.15.99:0/2100344084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556a0fc07060 msgr2=0x556a0fc0bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:14.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.862+0000 7f33ee37a640 1 --2- 172.21.15.99:0/2100344084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556a0fc07060 0x556a0fc0bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.862+0000 7f33ee37a640 1 -- 172.21.15.99:0/2100344084 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a0fb30650 con 0x556a0fc0c1d0 2024-01-31T05:11:14.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.862+0000 7f33ed378640 1 --2- 172.21.15.99:0/2100344084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556a0fc07060 0x556a0fc0bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:11:14.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.862+0000 7f33edb79640 1 --2- 172.21.15.99:0/670522744 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f33d40a12e0 0x7f33d40a37a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f33e40058c0 tx=0x7f33e4005d50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:14.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.862+0000 7f33ee37a640 1 --2- 172.21.15.99:0/2100344084 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556a0fc0c1d0 0x556a0fc0e660 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f33e00ece20 tx=0x7f33e004bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9792e88ffdb5039 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:14.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.862+0000 7f33d3fff640 1 -- 172.21.15.99:0/2100344084 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e00071c0 con 0x556a0fc0c1d0 2024-01-31T05:11:14.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.862+0000 7f33d3fff640 1 -- 172.21.15.99:0/2100344084 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f33e00bcc20 con 0x556a0fc0c1d0 2024-01-31T05:11:14.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.862+0000 7f33d3fff640 1 -- 172.21.15.99:0/2100344084 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e00c4940 con 0x556a0fc0c1d0 2024-01-31T05:11:14.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.863+0000 7f33f2ba1740 1 -- 172.21.15.99:0/2100344084 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556a0fc0c1d0 msgr2=0x556a0fc0e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:14.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.863+0000 7f33f2ba1740 1 --2- 172.21.15.99:0/2100344084 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556a0fc0c1d0 0x556a0fc0e660 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f33e00ece20 tx=0x7f33e004bb90 comp rx=0 tx=0).stop 2024-01-31T05:11:14.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.863+0000 7f33f2ba1740 1 -- 172.21.15.99:0/2100344084 shutdown_connections 2024-01-31T05:11:14.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.863+0000 7f33f2ba1740 1 --2- 172.21.15.99:0/2100344084 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556a0fc0c1d0 0x556a0fc0e660 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.863+0000 7f33f2ba1740 1 --2- 172.21.15.99:0/2100344084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556a0fc07060 0x556a0fc0bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.863+0000 7f33f2ba1740 1 --2- 172.21.15.99:0/2100344084 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556a0fc06670 0x556a0fc06a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.863+0000 7f33f2ba1740 1 -- 172.21.15.99:0/2100344084 >> 172.21.15.99:0/2100344084 conn(0x556a0fc01be0 msgr2=0x556a0fc01fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:14.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.863+0000 7f33f2ba1740 1 -- 172.21.15.99:0/2100344084 shutdown_connections 2024-01-31T05:11:14.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.863+0000 7f33f2ba1740 1 -- 172.21.15.99:0/2100344084 wait complete. 2024-01-31T05:11:14.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.863+0000 7f33f2ba1740 1 -- start start 2024-01-31T05:11:14.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.863+0000 7f33f2ba1740 1 Processor -- start 2024-01-31T05:11:14.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.864+0000 7f33f2ba1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556a0fc06670 0x556a0fc10440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:14.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.864+0000 7f33f2ba1740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556a0fc07060 0x556a0fc10980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:14.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.864+0000 7f33f2ba1740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556a0fc0c1d0 0x556a0fc179c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:14.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.864+0000 7f33f2ba1740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a0fb275c0 con 0x556a0fc07060 2024-01-31T05:11:14.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.864+0000 7f33f2ba1740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a0fb27260 con 0x556a0fc0c1d0 2024-01-31T05:11:14.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.864+0000 7f33f2ba1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a0faec2d0 con 0x556a0fc06670 2024-01-31T05:11:14.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.864+0000 7f33f2ba1740 10 client.0 _ll_register_callbacks cb 0x556a0fb22230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:11:14.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.864+0000 7f33ed378640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556a0fc07060 0x556a0fc10980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:14.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.864+0000 7f33ed378640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556a0fc07060 0x556a0fc10980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54384/0 (socket says 172.21.15.99:54384) 2024-01-31T05:11:14.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.864+0000 7f33ed378640 1 -- 172.21.15.99:0/1573627541 learned_addr learned my addr 172.21.15.99:0/1573627541 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:14.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.864+0000 7f33ee37a640 1 --2- 172.21.15.99:0/1573627541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556a0fc0c1d0 0x556a0fc179c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:14.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.864+0000 7f33ed378640 1 -- 172.21.15.99:0/1573627541 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556a0fc06670 msgr2=0x556a0fc10440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:14.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.864+0000 7f33edb79640 1 --2- 172.21.15.99:0/1573627541 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556a0fc06670 0x556a0fc10440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:14.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.864+0000 7f33ed378640 1 --2- 172.21.15.99:0/1573627541 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556a0fc06670 0x556a0fc10440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.864+0000 7f33ed378640 1 -- 172.21.15.99:0/1573627541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556a0fc0c1d0 msgr2=0x556a0fc179c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:14.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.864+0000 7f33ed378640 1 --2- 172.21.15.99:0/1573627541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556a0fc0c1d0 0x556a0fc179c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.864+0000 7f33ed378640 1 -- 172.21.15.99:0/1573627541 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33e819f1a0 con 0x556a0fc07060 2024-01-31T05:11:14.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.864+0000 7f33ee37a640 1 --2- 172.21.15.99:0/1573627541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556a0fc0c1d0 0x556a0fc179c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:11:14.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.864+0000 7f33ed378640 1 --2- 172.21.15.99:0/1573627541 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556a0fc07060 0x556a0fc10980 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f33d80127c0 tx=0x7f33d8012c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=433ab9dafc1615dd server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:14.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.864+0000 7f33d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:11:14.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.864+0000 7f33d17fa640 1 -- 172.21.15.99:0/1573627541 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d8011dd0 con 0x556a0fc07060 2024-01-31T05:11:14.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.865+0000 7f33d17fa640 1 -- 172.21.15.99:0/1573627541 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f33d8004020 con 0x556a0fc07060 2024-01-31T05:11:14.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.865+0000 7f33f2ba1740 1 -- 172.21.15.99:0/1573627541 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556a0fb66e70 con 0x556a0fc07060 2024-01-31T05:11:14.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.865+0000 7f33d17fa640 1 -- 172.21.15.99:0/1573627541 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f33d80041e0 con 0x556a0fc07060 2024-01-31T05:11:14.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.865+0000 7f33f2ba1740 10 client.15246 fetch_fsmap learned FSMap version 26 2024-01-31T05:11:14.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.865+0000 7f33f2ba1740 1 -- 172.21.15.99:0/1573627541 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x556a0fb6c660 con 0x556a0fc07060 2024-01-31T05:11:14.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.865+0000 7f33d17fa640 1 -- 172.21.15.99:0/1573627541 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556a0fb66e70 con 0x556a0fc07060 2024-01-31T05:11:14.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.865+0000 7f33d17fa640 1 -- 172.21.15.99:0/1573627541 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f33d800f450 con 0x556a0fc07060 2024-01-31T05:11:14.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.865+0000 7f33f2ba1740 10 client.15246 fetch_fsmap finished waiting for FSMap version 26 2024-01-31T05:11:14.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.865+0000 7f33f2ba1740 10 client.15246 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-31T05:11:14.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.865+0000 7f33f2ba1740 20 client.15246 populate_metadata read hostname 'smithi099' 2024-01-31T05:11:14.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.865+0000 7f33f2ba1740 1 --2- 172.21.15.99:0/1573627541 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x556a0fc1d6f0 0x556a0fc1c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:14.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.865+0000 7f33f2ba1740 4 client.15246 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:11:14.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.865+0000 7f33f2ba1740 1 -- 172.21.15.99:0/1573627541 --> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556a0fb66b90 con 0x556a0fc1d6f0 2024-01-31T05:11:14.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.865+0000 7f33edb79640 1 --2- 172.21.15.99:0/1573627541 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x556a0fc1d6f0 0x556a0fc1c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:14.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.866+0000 7f33edb79640 1 --2- 172.21.15.99:0/1573627541 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x556a0fc1d6f0 0x556a0fc1c060 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d56219f561a78cd5 server_cookie=3c68054130c2cab2 in_seq=0 out_seq=0 2024-01-31T05:11:14.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.866+0000 7f33d17fa640 10 client.15246 ms_handle_connect on v2:172.21.15.181:6836/3875964154 2024-01-31T05:11:14.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.866+0000 7f33d17fa640 1 -- 172.21.15.99:0/1573627541 <== mds.3 v2:172.21.15.181:6836/3875964154 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556a0fb66b90 con 0x556a0fc1d6f0 2024-01-31T05:11:14.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.866+0000 7f33d17fa640 10 client.15246 handle_command_reply: tid=0 2024-01-31T05:11:14.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.866+0000 7f33f2ba1740 1 client.15246 shutdown 2024-01-31T05:11:14.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.866+0000 7f33f2ba1740 1 -- 172.21.15.99:0/1573627541 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556a0fc07060 msgr2=0x556a0fc10980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:14.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.866+0000 7f33f2ba1740 1 --2- 172.21.15.99:0/1573627541 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556a0fc07060 0x556a0fc10980 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f33d80127c0 tx=0x7f33d8012c80 comp rx=0 tx=0).stop 2024-01-31T05:11:14.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.867+0000 7f33f2ba1740 1 -- 172.21.15.99:0/1573627541 shutdown_connections 2024-01-31T05:11:14.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.867+0000 7f33f2ba1740 1 --2- 172.21.15.99:0/1573627541 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x556a0fc1d6f0 0x556a0fc1c060 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.867+0000 7f33f2ba1740 1 --2- 172.21.15.99:0/1573627541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556a0fc0c1d0 0x556a0fc179c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.867+0000 7f33f2ba1740 1 --2- 172.21.15.99:0/1573627541 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556a0fc07060 0x556a0fc10980 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.867+0000 7f33d17fa640 0 client.15246 ms_handle_reset on v2:172.21.15.181:6836/3875964154 2024-01-31T05:11:14.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.867+0000 7f33f2ba1740 1 --2- 172.21.15.99:0/1573627541 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556a0fc06670 0x556a0fc10440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.867+0000 7f33f2ba1740 1 -- 172.21.15.99:0/1573627541 >> 172.21.15.99:0/1573627541 conn(0x556a0fc01be0 msgr2=0x556a0fc00d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:14.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.867+0000 7f33f2ba1740 1 -- 172.21.15.99:0/1573627541 shutdown_connections 2024-01-31T05:11:14.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.867+0000 7f33f2ba1740 1 -- 172.21.15.99:0/1573627541 wait complete. 2024-01-31T05:11:14.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.867+0000 7f33f2ba1740 20 client.15246 trim_cache size 0 max 16384 2024-01-31T05:11:14.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.882+0000 7f33f2ba1740 1 Processor -- start 2024-01-31T05:11:14.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.882+0000 7f33f2ba1740 1 -- start start 2024-01-31T05:11:14.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.882+0000 7f33f2ba1740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556a0fc06670 0x556a0fc083e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:14.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.882+0000 7f33f2ba1740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556a0fc07060 0x556a0fc08920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:14.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.882+0000 7f33f2ba1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556a0fc0c1d0 0x556a0fc17980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:14.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.882+0000 7f33f2ba1740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a0fc0e7f0 con 0x556a0fc06670 2024-01-31T05:11:14.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.882+0000 7f33f2ba1740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a0fc1ecc0 con 0x556a0fc07060 2024-01-31T05:11:14.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.882+0000 7f33f2ba1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a0fc021f0 con 0x556a0fc0c1d0 2024-01-31T05:11:14.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.882+0000 7f33edb79640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556a0fc06670 0x556a0fc083e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:14.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.882+0000 7f33edb79640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556a0fc06670 0x556a0fc083e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54400/0 (socket says 172.21.15.99:54400) 2024-01-31T05:11:14.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.882+0000 7f33edb79640 1 -- 172.21.15.99:0/873172608 learned_addr learned my addr 172.21.15.99:0/873172608 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:14.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.883+0000 7f33edb79640 1 -- 172.21.15.99:0/873172608 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556a0fc0c1d0 msgr2=0x556a0fc17980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:14.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.883+0000 7f33ee37a640 1 --2- 172.21.15.99:0/873172608 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556a0fc0c1d0 0x556a0fc17980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:14.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.883+0000 7f33edb79640 1 --2- 172.21.15.99:0/873172608 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556a0fc0c1d0 0x556a0fc17980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.883+0000 7f33edb79640 1 -- 172.21.15.99:0/873172608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556a0fc07060 msgr2=0x556a0fc08920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:14.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.883+0000 7f33edb79640 1 --2- 172.21.15.99:0/873172608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556a0fc07060 0x556a0fc08920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.883+0000 7f33edb79640 1 -- 172.21.15.99:0/873172608 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a0fb09360 con 0x556a0fc06670 2024-01-31T05:11:14.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.883+0000 7f33edb79640 1 --2- 172.21.15.99:0/873172608 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556a0fc06670 0x556a0fc083e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f33e400bfd0 tx=0x7f33e4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef5b7fad82cc784f server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:14.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.883+0000 7f33d37fe640 1 -- 172.21.15.99:0/873172608 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e4022b00 con 0x556a0fc06670 2024-01-31T05:11:14.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.883+0000 7f33d37fe640 1 -- 172.21.15.99:0/873172608 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f33e4022040 con 0x556a0fc06670 2024-01-31T05:11:14.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.883+0000 7f33d37fe640 1 -- 172.21.15.99:0/873172608 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e400f660 con 0x556a0fc06670 2024-01-31T05:11:14.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.883+0000 7f33f2ba1740 1 -- 172.21.15.99:0/873172608 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556a0fc06670 msgr2=0x556a0fc083e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:14.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.883+0000 7f33f2ba1740 1 --2- 172.21.15.99:0/873172608 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556a0fc06670 0x556a0fc083e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f33e400bfd0 tx=0x7f33e4013000 comp rx=0 tx=0).stop 2024-01-31T05:11:14.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.883+0000 7f33f2ba1740 1 -- 172.21.15.99:0/873172608 shutdown_connections 2024-01-31T05:11:14.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.883+0000 7f33f2ba1740 1 --2- 172.21.15.99:0/873172608 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556a0fc0c1d0 0x556a0fc17980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.883+0000 7f33f2ba1740 1 --2- 172.21.15.99:0/873172608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556a0fc07060 0x556a0fc08920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.883+0000 7f33f2ba1740 1 --2- 172.21.15.99:0/873172608 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556a0fc06670 0x556a0fc083e0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.883+0000 7f33f2ba1740 1 -- 172.21.15.99:0/873172608 >> 172.21.15.99:0/873172608 conn(0x556a0fc01be0 msgr2=0x556a0fc10440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:14.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.883+0000 7f33f2ba1740 1 -- 172.21.15.99:0/873172608 shutdown_connections 2024-01-31T05:11:14.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.884+0000 7f33f2ba1740 1 -- 172.21.15.99:0/873172608 wait complete. 2024-01-31T05:11:14.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.884+0000 7f33f2ba1740 1 -- start start 2024-01-31T05:11:14.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.884+0000 7f33f2ba1740 1 Processor -- start 2024-01-31T05:11:14.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.884+0000 7f33f2ba1740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556a0fc06670 0x556a0fc14b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:14.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.884+0000 7f33f2ba1740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556a0fc07060 0x556a0fc15090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:14.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.884+0000 7f33f2ba1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556a0fc0c1d0 0x556a0fc16000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:14.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.884+0000 7f33f2ba1740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a0fc0bc80 con 0x556a0fc06670 2024-01-31T05:11:14.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.884+0000 7f33f2ba1740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a0fc16540 con 0x556a0fc07060 2024-01-31T05:11:14.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.884+0000 7f33f2ba1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a0fc16700 con 0x556a0fc0c1d0 2024-01-31T05:11:14.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.884+0000 7f33f2ba1740 10 client.0 _ll_register_callbacks cb 0x7f33d800b700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:11:14.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.884+0000 7f33edb79640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556a0fc06670 0x556a0fc14b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:14.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.884+0000 7f33edb79640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556a0fc06670 0x556a0fc14b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54402/0 (socket says 172.21.15.99:54402) 2024-01-31T05:11:14.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.884+0000 7f33edb79640 1 -- 172.21.15.99:0/2767047299 learned_addr learned my addr 172.21.15.99:0/2767047299 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:14.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.884+0000 7f33ee37a640 1 --2- 172.21.15.99:0/2767047299 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556a0fc0c1d0 0x556a0fc16000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:14.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.884+0000 7f33ed378640 1 --2- 172.21.15.99:0/2767047299 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556a0fc07060 0x556a0fc15090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:14.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.885+0000 7f33edb79640 1 -- 172.21.15.99:0/2767047299 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556a0fc0c1d0 msgr2=0x556a0fc16000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:14.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.885+0000 7f33edb79640 1 --2- 172.21.15.99:0/2767047299 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556a0fc0c1d0 0x556a0fc16000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.885+0000 7f33edb79640 1 -- 172.21.15.99:0/2767047299 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556a0fc07060 msgr2=0x556a0fc15090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:14.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.885+0000 7f33edb79640 1 --2- 172.21.15.99:0/2767047299 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556a0fc07060 0x556a0fc15090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.885+0000 7f33edb79640 1 -- 172.21.15.99:0/2767047299 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33e400da50 con 0x556a0fc06670 2024-01-31T05:11:14.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.885+0000 7f33ed378640 1 --2- 172.21.15.99:0/2767047299 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556a0fc07060 0x556a0fc15090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:11:14.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.885+0000 7f33edb79640 1 --2- 172.21.15.99:0/2767047299 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556a0fc06670 0x556a0fc14b50 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f33e4005e50 tx=0x7f33e40225b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0d50728204152bb server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:14.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.885+0000 7f33d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:11:14.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.885+0000 7f33d17fa640 1 -- 172.21.15.99:0/2767047299 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e4022e00 con 0x556a0fc06670 2024-01-31T05:11:14.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.885+0000 7f33d17fa640 1 -- 172.21.15.99:0/2767047299 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f33e4033470 con 0x556a0fc06670 2024-01-31T05:11:14.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.885+0000 7f33f2ba1740 1 -- 172.21.15.99:0/2767047299 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556a0fc1d400 con 0x556a0fc06670 2024-01-31T05:11:14.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.885+0000 7f33d17fa640 1 -- 172.21.15.99:0/2767047299 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f33e4033630 con 0x556a0fc06670 2024-01-31T05:11:14.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.885+0000 7f33f2ba1740 10 client.15252 fetch_fsmap learned FSMap version 26 2024-01-31T05:11:14.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.885+0000 7f33f2ba1740 1 -- 172.21.15.99:0/2767047299 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x556a0fb2eeb0 con 0x556a0fc06670 2024-01-31T05:11:14.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.885+0000 7f33d17fa640 1 -- 172.21.15.99:0/2767047299 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556a0fc1d400 con 0x556a0fc06670 2024-01-31T05:11:14.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.885+0000 7f33d17fa640 1 -- 172.21.15.99:0/2767047299 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f33e4028020 con 0x556a0fc06670 2024-01-31T05:11:14.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.885+0000 7f33f2ba1740 10 client.15252 fetch_fsmap finished waiting for FSMap version 26 2024-01-31T05:11:14.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.885+0000 7f33f2ba1740 10 client.15252 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-31T05:11:14.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.885+0000 7f33f2ba1740 20 client.15252 populate_metadata read hostname 'smithi099' 2024-01-31T05:11:14.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.885+0000 7f33f2ba1740 1 --2- 172.21.15.99:0/2767047299 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x556a0fc78120 0x556a0fc74640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:14.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.885+0000 7f33f2ba1740 4 client.15252 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-31T05:11:14.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.885+0000 7f33f2ba1740 1 -- 172.21.15.99:0/2767047299 --> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f33e00bcc20 con 0x556a0fc78120 2024-01-31T05:11:14.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.886+0000 7f33ed378640 1 --2- 172.21.15.99:0/2767047299 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x556a0fc78120 0x556a0fc74640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:14.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.886+0000 7f33d17fa640 10 client.15252 ms_handle_connect on v2:172.21.15.181:6836/3875964154 2024-01-31T05:11:14.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.886+0000 7f33ed378640 1 --2- 172.21.15.99:0/2767047299 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x556a0fc78120 0x556a0fc74640 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=616f8c76bf20e9f1 server_cookie=37e35598fc84c5da in_seq=0 out_seq=0 2024-01-31T05:11:14.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.886+0000 7f33d17fa640 1 -- 172.21.15.99:0/2767047299 <== mds.3 v2:172.21.15.181:6836/3875964154 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x7f33e00bcc20 con 0x556a0fc78120 2024-01-31T05:11:14.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.886+0000 7f33d17fa640 10 client.15252 handle_command_reply: tid=0 2024-01-31T05:11:14.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.886+0000 7f33f2ba1740 1 client.15252 shutdown 2024-01-31T05:11:14.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.886+0000 7f33f2ba1740 1 -- 172.21.15.99:0/2767047299 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556a0fc06670 msgr2=0x556a0fc14b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:14.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.886+0000 7f33f2ba1740 1 --2- 172.21.15.99:0/2767047299 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556a0fc06670 0x556a0fc14b50 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f33e4005e50 tx=0x7f33e40225b0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.886+0000 7f33f2ba1740 1 -- 172.21.15.99:0/2767047299 shutdown_connections 2024-01-31T05:11:14.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.886+0000 7f33f2ba1740 1 --2- 172.21.15.99:0/2767047299 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x556a0fc78120 0x556a0fc74640 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.886+0000 7f33f2ba1740 1 --2- 172.21.15.99:0/2767047299 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556a0fc0c1d0 0x556a0fc16000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.886+0000 7f33f2ba1740 1 --2- 172.21.15.99:0/2767047299 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556a0fc07060 0x556a0fc15090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.886+0000 7f33f2ba1740 1 --2- 172.21.15.99:0/2767047299 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556a0fc06670 0x556a0fc14b50 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.886+0000 7f33d17fa640 0 client.15252 ms_handle_reset on v2:172.21.15.181:6836/3875964154 2024-01-31T05:11:14.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.886+0000 7f33f2ba1740 1 -- 172.21.15.99:0/2767047299 >> 172.21.15.99:0/2767047299 conn(0x556a0fc01be0 msgr2=0x556a0fc10440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:14.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.886+0000 7f33f2ba1740 1 -- 172.21.15.99:0/2767047299 shutdown_connections 2024-01-31T05:11:14.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.886+0000 7f33f2ba1740 1 -- 172.21.15.99:0/2767047299 wait complete. 2024-01-31T05:11:14.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.887+0000 7f33f2ba1740 20 client.15252 trim_cache size 0 max 16384 2024-01-31T05:11:14.894 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-01-31T05:11:14.894 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_fsid": "9288ff44-bff5-11ee-95b3-87774f69a715", 2024-01-31T05:11:14.894 INFO:teuthology.orchestra.run.smithi099.stdout: "whoami": 3, 2024-01-31T05:11:14.894 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 24439, 2024-01-31T05:11:14.894 INFO:teuthology.orchestra.run.smithi099.stdout: "want_state": "up:active", 2024-01-31T05:11:14.894 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "up:active", 2024-01-31T05:11:14.894 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "cephfs", 2024-01-31T05:11:14.894 INFO:teuthology.orchestra.run.smithi099.stdout: "rank_uptime": 108.70112632199999, 2024-01-31T05:11:14.894 INFO:teuthology.orchestra.run.smithi099.stdout: "mdsmap_epoch": 26, 2024-01-31T05:11:14.895 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch": 88, 2024-01-31T05:11:14.895 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch_barrier": 86, 2024-01-31T05:11:14.895 INFO:teuthology.orchestra.run.smithi099.stdout: "uptime": 132.80535129800001 2024-01-31T05:11:14.895 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-01-31T05:11:14.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.887+0000 7f33efddd640 1 -- 172.21.15.99:0/670522744 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f33d40a12e0 msgr2=0x7f33d40a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:14.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.887+0000 7f33efddd640 1 --2- 172.21.15.99:0/670522744 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f33d40a12e0 0x7f33d40a37a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f33e40058c0 tx=0x7f33e4005d50 comp rx=0 tx=0).stop 2024-01-31T05:11:14.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.887+0000 7f33efddd640 1 -- 172.21.15.99:0/670522744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f33e81017b0 msgr2=0x7f33e819e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:14.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.887+0000 7f33efddd640 1 --2- 172.21.15.99:0/670522744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f33e81017b0 0x7f33e819e010 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f33e0037040 tx=0x7f33e0032810 comp rx=0 tx=0).stop 2024-01-31T05:11:14.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.887+0000 7f33efddd640 1 -- 172.21.15.99:0/670522744 shutdown_connections 2024-01-31T05:11:14.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.887+0000 7f33efddd640 1 --2- 172.21.15.99:0/670522744 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f33d40a12e0 0x7f33d40a37a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.887+0000 7f33efddd640 1 --2- 172.21.15.99:0/670522744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f33e81017b0 0x7f33e819e010 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.887+0000 7f33efddd640 1 --2- 172.21.15.99:0/670522744 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f33e8100df0 0x7f33e819b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.887+0000 7f33efddd640 1 --2- 172.21.15.99:0/670522744 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33e80ffc00 0x7f33e8069e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:14.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.887+0000 7f33efddd640 1 -- 172.21.15.99:0/670522744 >> 172.21.15.99:0/670522744 conn(0x7f33e80fb190 msgr2=0x7f33e8104110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:14.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.887+0000 7f33efddd640 1 -- 172.21.15.99:0/670522744 shutdown_connections 2024-01-31T05:11:14.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:14.887+0000 7f33efddd640 1 -- 172.21.15.99:0/670522744 wait complete. 2024-01-31T05:11:14.897 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:14 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/177372413' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-31T05:11:14.897 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:14 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/2386591946' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:11:14.897 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:14 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/716335439' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:11:14.898 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-01-31T05:11:15.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.000+0000 7f035e342640 1 -- 172.21.15.99:0/979502206 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0358100de0 msgr2=0x7f0358101260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:15.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.000+0000 7f035e342640 1 --2- 172.21.15.99:0/979502206 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0358100de0 0x7f0358101260 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f034c009900 tx=0x7f034c02bc30 comp rx=0 tx=0).stop 2024-01-31T05:11:15.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.000+0000 7f035e342640 1 -- 172.21.15.99:0/979502206 shutdown_connections 2024-01-31T05:11:15.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.000+0000 7f035e342640 1 --2- 172.21.15.99:0/979502206 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03581017a0 0x7f0358108030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.000+0000 7f035e342640 1 --2- 172.21.15.99:0/979502206 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0358100de0 0x7f0358101260 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.000+0000 7f035e342640 1 --2- 172.21.15.99:0/979502206 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03580ffbf0 0x7f0358100010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.000+0000 7f035e342640 1 -- 172.21.15.99:0/979502206 >> 172.21.15.99:0/979502206 conn(0x7f03580fb180 msgr2=0x7f03580fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:15.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.000+0000 7f035e342640 1 -- 172.21.15.99:0/979502206 shutdown_connections 2024-01-31T05:11:15.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.000+0000 7f035e342640 1 -- 172.21.15.99:0/979502206 wait complete. 2024-01-31T05:11:15.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.001+0000 7f035e342640 1 Processor -- start 2024-01-31T05:11:15.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.001+0000 7f035e342640 1 -- start start 2024-01-31T05:11:15.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.001+0000 7f035e342640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03580ffbf0 0x7f03580689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.001+0000 7f035e342640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0358100de0 0x7f035819ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.001+0000 7f035e342640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03581017a0 0x7f035819e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.001+0000 7f035e342640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f035819e820 con 0x7f0358100de0 2024-01-31T05:11:15.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.001+0000 7f035e342640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f035819e990 con 0x7f03580ffbf0 2024-01-31T05:11:15.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.001+0000 7f035e342640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f035819eb50 con 0x7f03581017a0 2024-01-31T05:11:15.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.001+0000 7f03577fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0358100de0 0x7f035819ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:15.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.001+0000 7f03577fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0358100de0 0x7f035819ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54426/0 (socket says 172.21.15.99:54426) 2024-01-31T05:11:15.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.001+0000 7f03577fe640 1 -- 172.21.15.99:0/3481706605 learned_addr learned my addr 172.21.15.99:0/3481706605 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:15.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.002+0000 7f03577fe640 1 -- 172.21.15.99:0/3481706605 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03581017a0 msgr2=0x7f035819e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:15.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.002+0000 7f03577fe640 1 --2- 172.21.15.99:0/3481706605 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03581017a0 0x7f035819e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.002+0000 7f03577fe640 1 -- 172.21.15.99:0/3481706605 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03580ffbf0 msgr2=0x7f03580689c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:15.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.002+0000 7f03577fe640 1 --2- 172.21.15.99:0/3481706605 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03580ffbf0 0x7f03580689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.002+0000 7f03577fe640 1 -- 172.21.15.99:0/3481706605 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f034c009560 con 0x7f0358100de0 2024-01-31T05:11:15.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.002+0000 7f03577fe640 1 --2- 172.21.15.99:0/3481706605 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0358100de0 0x7f035819ba20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f034c009230 tx=0x7f034c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:15.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.002+0000 7f03557fa640 1 -- 172.21.15.99:0/3481706605 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034c0044e0 con 0x7f0358100de0 2024-01-31T05:11:15.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.002+0000 7f03557fa640 1 -- 172.21.15.99:0/3481706605 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f034c0035f0 con 0x7f0358100de0 2024-01-31T05:11:15.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.002+0000 7f035e342640 1 -- 172.21.15.99:0/3481706605 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f035819ed70 con 0x7f0358100de0 2024-01-31T05:11:15.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.002+0000 7f03557fa640 1 -- 172.21.15.99:0/3481706605 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034c03e6b0 con 0x7f0358100de0 2024-01-31T05:11:15.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.002+0000 7f035e342640 1 -- 172.21.15.99:0/3481706605 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f035819f2a0 con 0x7f0358100de0 2024-01-31T05:11:15.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.004+0000 7f03557fa640 1 -- 172.21.15.99:0/3481706605 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f034c003960 con 0x7f0358100de0 2024-01-31T05:11:15.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.004+0000 7f03611e9740 1 Processor -- start 2024-01-31T05:11:15.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.004+0000 7f03611e9740 1 -- start start 2024-01-31T05:11:15.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.005+0000 7f03611e9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5600b10b9670 0x5600b10b9a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.005+0000 7f03611e9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5600b10ba060 0x5600b10beb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.005+0000 7f03611e9740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5600b10bf1d0 0x5600b10c1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.005+0000 7f03611e9740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600b1028000 con 0x5600b10bf1d0 2024-01-31T05:11:15.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.005+0000 7f03611e9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600b10256f0 con 0x5600b10ba060 2024-01-31T05:11:15.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.005+0000 7f03611e9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600b1020fe0 con 0x5600b10b9670 2024-01-31T05:11:15.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.005+0000 7f03557fa640 1 --2- 172.21.15.99:0/3481706605 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f03400a12e0 0x7f03400a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.005+0000 7f03577fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5600b10bf1d0 0x5600b10c1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:15.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.005+0000 7f035c8df640 1 --2- 172.21.15.99:0/3481706605 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f03400a12e0 0x7f03400a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:15.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.005+0000 7f03577fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5600b10bf1d0 0x5600b10c1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54434/0 (socket says 172.21.15.99:54434) 2024-01-31T05:11:15.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.005+0000 7f03577fe640 1 -- 172.21.15.99:0/815838062 learned_addr learned my addr 172.21.15.99:0/815838062 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:15.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.005+0000 7f0357fff640 1 --2- 172.21.15.99:0/815838062 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5600b10ba060 0x5600b10beb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:15.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.005+0000 7f035c8df640 1 --2- 172.21.15.99:0/815838062 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5600b10b9670 0x5600b10b9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:15.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.005+0000 7f03557fa640 1 -- 172.21.15.99:0/3481706605 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f034c0ef650 con 0x7f0358100de0 2024-01-31T05:11:15.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.005+0000 7f03577fe640 1 -- 172.21.15.99:0/815838062 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5600b10b9670 msgr2=0x5600b10b9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:15.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.005+0000 7f03577fe640 1 --2- 172.21.15.99:0/815838062 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5600b10b9670 0x5600b10b9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.005+0000 7f03577fe640 1 -- 172.21.15.99:0/815838062 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5600b10ba060 msgr2=0x5600b10beb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:15.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.005+0000 7f03577fe640 1 --2- 172.21.15.99:0/815838062 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5600b10ba060 0x5600b10beb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.005+0000 7f03577fe640 1 -- 172.21.15.99:0/815838062 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600b0fe3650 con 0x5600b10bf1d0 2024-01-31T05:11:15.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.005+0000 7f0357fff640 1 --2- 172.21.15.99:0/815838062 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5600b10ba060 0x5600b10beb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:11:15.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.005+0000 7f035c8df640 1 --2- 172.21.15.99:0/815838062 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5600b10b9670 0x5600b10b9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:11:15.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.005+0000 7f035c8df640 1 --2- 172.21.15.99:0/3481706605 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f03400a12e0 0x7f03400a37a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0350013460 tx=0x7f0350001ba0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:15.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.005+0000 7f03577fe640 1 --2- 172.21.15.99:0/815838062 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5600b10bf1d0 0x5600b10c1660 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f034c005bd0 tx=0x7f034c003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0f160402a095530 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:15.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.005+0000 7f033e7fc640 1 -- 172.21.15.99:0/815838062 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034c0bc110 con 0x5600b10bf1d0 2024-01-31T05:11:15.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.006+0000 7f033e7fc640 1 -- 172.21.15.99:0/815838062 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f034c0a5de0 con 0x5600b10bf1d0 2024-01-31T05:11:15.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.006+0000 7f033e7fc640 1 -- 172.21.15.99:0/815838062 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034c0c4b40 con 0x5600b10bf1d0 2024-01-31T05:11:15.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.006+0000 7f03611e9740 1 -- 172.21.15.99:0/815838062 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5600b10bf1d0 msgr2=0x5600b10c1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:15.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.006+0000 7f03611e9740 1 --2- 172.21.15.99:0/815838062 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5600b10bf1d0 0x5600b10c1660 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f034c005bd0 tx=0x7f034c003d00 comp rx=0 tx=0).stop 2024-01-31T05:11:15.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.006+0000 7f03611e9740 1 -- 172.21.15.99:0/815838062 shutdown_connections 2024-01-31T05:11:15.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.006+0000 7f03611e9740 1 --2- 172.21.15.99:0/815838062 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5600b10bf1d0 0x5600b10c1660 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.006+0000 7f03611e9740 1 --2- 172.21.15.99:0/815838062 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5600b10ba060 0x5600b10beb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.006+0000 7f03611e9740 1 --2- 172.21.15.99:0/815838062 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5600b10b9670 0x5600b10b9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.006+0000 7f03611e9740 1 -- 172.21.15.99:0/815838062 >> 172.21.15.99:0/815838062 conn(0x5600b10b4be0 msgr2=0x5600b10b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:15.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.006+0000 7f03611e9740 1 -- 172.21.15.99:0/815838062 shutdown_connections 2024-01-31T05:11:15.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.006+0000 7f03611e9740 1 -- 172.21.15.99:0/815838062 wait complete. 2024-01-31T05:11:15.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.006+0000 7f03611e9740 1 -- start start 2024-01-31T05:11:15.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.007+0000 7f03611e9740 1 Processor -- start 2024-01-31T05:11:15.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.007+0000 7f03611e9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5600b10b9670 0x5600b10c3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.007+0000 7f03611e9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5600b10ba060 0x5600b10c3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.007+0000 7f03611e9740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5600b10bf1d0 0x5600b10caae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.007+0000 7f03611e9740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600b0fda5c0 con 0x5600b10bf1d0 2024-01-31T05:11:15.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.007+0000 7f03611e9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600b0fda260 con 0x5600b10ba060 2024-01-31T05:11:15.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.007+0000 7f03611e9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600b0f9f2d0 con 0x5600b10b9670 2024-01-31T05:11:15.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.007+0000 7f03611e9740 10 client.0 _ll_register_callbacks cb 0x5600b0fd5230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:11:15.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.007+0000 7f035c8df640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5600b10bf1d0 0x5600b10caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:15.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.007+0000 7f035c8df640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5600b10bf1d0 0x5600b10caae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54444/0 (socket says 172.21.15.99:54444) 2024-01-31T05:11:15.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.007+0000 7f035c8df640 1 -- 172.21.15.99:0/3070183355 learned_addr learned my addr 172.21.15.99:0/3070183355 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:15.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.007+0000 7f035c8df640 1 -- 172.21.15.99:0/3070183355 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5600b10b9670 msgr2=0x5600b10c3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:15.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.007+0000 7f035c8df640 1 --2- 172.21.15.99:0/3070183355 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5600b10b9670 0x5600b10c3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.007+0000 7f035c8df640 1 -- 172.21.15.99:0/3070183355 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5600b10ba060 msgr2=0x5600b10c3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:15.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.007+0000 7f035c8df640 1 --2- 172.21.15.99:0/3070183355 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5600b10ba060 0x5600b10c3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.007+0000 7f035c8df640 1 -- 172.21.15.99:0/3070183355 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f035819f2a0 con 0x5600b10bf1d0 2024-01-31T05:11:15.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.007+0000 7f035c8df640 1 --2- 172.21.15.99:0/3070183355 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5600b10bf1d0 0x5600b10caae0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0350007570 tx=0x7f03500013c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcd7ac0af36531ab server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:15.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.007+0000 7f03377fe640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:11:15.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.008+0000 7f03377fe640 1 -- 172.21.15.99:0/3070183355 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035001e070 con 0x5600b10bf1d0 2024-01-31T05:11:15.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.008+0000 7f03377fe640 1 -- 172.21.15.99:0/3070183355 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f0350019b30 con 0x5600b10bf1d0 2024-01-31T05:11:15.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.008+0000 7f03611e9740 1 -- 172.21.15.99:0/3070183355 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5600b1019e70 con 0x5600b10bf1d0 2024-01-31T05:11:15.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.008+0000 7f03377fe640 1 -- 172.21.15.99:0/3070183355 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0350019cf0 con 0x5600b10bf1d0 2024-01-31T05:11:15.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.008+0000 7f03611e9740 10 client.15264 fetch_fsmap learned FSMap version 26 2024-01-31T05:11:15.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.008+0000 7f03611e9740 1 -- 172.21.15.99:0/3070183355 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5600b101f660 con 0x5600b10bf1d0 2024-01-31T05:11:15.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.008+0000 7f03377fe640 1 -- 172.21.15.99:0/3070183355 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5600b1019e70 con 0x5600b10bf1d0 2024-01-31T05:11:15.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.008+0000 7f03377fe640 1 -- 172.21.15.99:0/3070183355 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0350017410 con 0x5600b10bf1d0 2024-01-31T05:11:15.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.008+0000 7f03611e9740 10 client.15264 fetch_fsmap finished waiting for FSMap version 26 2024-01-31T05:11:15.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.008+0000 7f03611e9740 10 client.15264 resolve_mds: resolved name 'i' to daemon mds.i 2024-01-31T05:11:15.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.008+0000 7f03611e9740 20 client.15264 populate_metadata read hostname 'smithi099' 2024-01-31T05:11:15.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.008+0000 7f03611e9740 1 --2- 172.21.15.99:0/3070183355 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x5600b10d0880 0x5600b10cf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.008+0000 7f03611e9740 4 client.15264 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:11:15.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.008+0000 7f03611e9740 1 -- 172.21.15.99:0/3070183355 --> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5600b1019b90 con 0x5600b10d0880 2024-01-31T05:11:15.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.008+0000 7f0357fff640 1 --2- 172.21.15.99:0/3070183355 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x5600b10d0880 0x5600b10cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:15.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.009+0000 7f03377fe640 10 client.15264 ms_handle_connect on v2:172.21.15.181:6838/996120687 2024-01-31T05:11:15.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.009+0000 7f0357fff640 1 --2- 172.21.15.99:0/3070183355 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x5600b10d0880 0x5600b10cf200 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=48fd16339b8616da server_cookie=85de3981e9ac7a70 in_seq=0 out_seq=0 2024-01-31T05:11:15.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.009+0000 7f03377fe640 1 -- 172.21.15.99:0/3070183355 <== mds.2 v2:172.21.15.181:6838/996120687 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5600b1019b90 con 0x5600b10d0880 2024-01-31T05:11:15.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.009+0000 7f03377fe640 10 client.15264 handle_command_reply: tid=0 2024-01-31T05:11:15.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.009+0000 7f03611e9740 1 client.15264 shutdown 2024-01-31T05:11:15.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.010+0000 7f03611e9740 1 -- 172.21.15.99:0/3070183355 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5600b10bf1d0 msgr2=0x5600b10caae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:15.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.010+0000 7f03611e9740 1 --2- 172.21.15.99:0/3070183355 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5600b10bf1d0 0x5600b10caae0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0350007570 tx=0x7f03500013c0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.010+0000 7f03611e9740 1 -- 172.21.15.99:0/3070183355 shutdown_connections 2024-01-31T05:11:15.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.010+0000 7f03611e9740 1 --2- 172.21.15.99:0/3070183355 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5600b10bf1d0 0x5600b10caae0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.010+0000 7f03611e9740 1 --2- 172.21.15.99:0/3070183355 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5600b10ba060 0x5600b10c3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.010+0000 7f03611e9740 1 --2- 172.21.15.99:0/3070183355 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x5600b10d0880 0x5600b10cf200 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.010+0000 7f03611e9740 1 --2- 172.21.15.99:0/3070183355 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5600b10b9670 0x5600b10c3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.010+0000 7f03377fe640 0 client.15264 ms_handle_reset on v2:172.21.15.181:6838/996120687 2024-01-31T05:11:15.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.010+0000 7f03611e9740 1 -- 172.21.15.99:0/3070183355 >> 172.21.15.99:0/3070183355 conn(0x5600b10b4be0 msgr2=0x5600b10b3d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:15.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.010+0000 7f03611e9740 1 -- 172.21.15.99:0/3070183355 shutdown_connections 2024-01-31T05:11:15.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.010+0000 7f03611e9740 1 -- 172.21.15.99:0/3070183355 wait complete. 2024-01-31T05:11:15.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.010+0000 7f03611e9740 20 client.15264 trim_cache size 0 max 16384 2024-01-31T05:11:15.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.025+0000 7f03611e9740 1 Processor -- start 2024-01-31T05:11:15.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.025+0000 7f03611e9740 1 -- start start 2024-01-31T05:11:15.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.025+0000 7f03611e9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5600b10b9670 0x5600b10cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.025+0000 7f03611e9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5600b10ba060 0x5600b10caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.025+0000 7f03611e9740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5600b10bf1d0 0x5600b10b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.025+0000 7f03611e9740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600b0fc8650 con 0x5600b10bf1d0 2024-01-31T05:11:15.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.025+0000 7f03611e9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600b10d86d0 con 0x5600b10ba060 2024-01-31T05:11:15.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.025+0000 7f03611e9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600b1019bc0 con 0x5600b10b9670 2024-01-31T05:11:15.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.025+0000 7f035c8df640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5600b10bf1d0 0x5600b10b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:15.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.026+0000 7f035c8df640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5600b10bf1d0 0x5600b10b34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54460/0 (socket says 172.21.15.99:54460) 2024-01-31T05:11:15.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.026+0000 7f035c8df640 1 -- 172.21.15.99:0/1232931720 learned_addr learned my addr 172.21.15.99:0/1232931720 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:15.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.026+0000 7f035c8df640 1 -- 172.21.15.99:0/1232931720 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5600b10b9670 msgr2=0x5600b10cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:15.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.026+0000 7f035c8df640 1 --2- 172.21.15.99:0/1232931720 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5600b10b9670 0x5600b10cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.026+0000 7f035c8df640 1 -- 172.21.15.99:0/1232931720 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5600b10ba060 msgr2=0x5600b10caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:15.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.026+0000 7f035c8df640 1 --2- 172.21.15.99:0/1232931720 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5600b10ba060 0x5600b10caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.026+0000 7f035c8df640 1 -- 172.21.15.99:0/1232931720 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600b0fbc360 con 0x5600b10bf1d0 2024-01-31T05:11:15.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.026+0000 7f035c8df640 1 --2- 172.21.15.99:0/1232931720 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5600b10bf1d0 0x5600b10b34e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0350004fd0 tx=0x7f03500132e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fec431c68a330ffd server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:15.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.026+0000 7f033dffb640 1 -- 172.21.15.99:0/1232931720 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035001e070 con 0x5600b10bf1d0 2024-01-31T05:11:15.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.026+0000 7f033dffb640 1 -- 172.21.15.99:0/1232931720 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0350017550 con 0x5600b10bf1d0 2024-01-31T05:11:15.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.026+0000 7f033dffb640 1 -- 172.21.15.99:0/1232931720 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0350003c00 con 0x5600b10bf1d0 2024-01-31T05:11:15.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.027+0000 7f03611e9740 1 -- 172.21.15.99:0/1232931720 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5600b10bf1d0 msgr2=0x5600b10b34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:15.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.027+0000 7f03611e9740 1 --2- 172.21.15.99:0/1232931720 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5600b10bf1d0 0x5600b10b34e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0350004fd0 tx=0x7f03500132e0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.027+0000 7f03611e9740 1 -- 172.21.15.99:0/1232931720 shutdown_connections 2024-01-31T05:11:15.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.027+0000 7f03611e9740 1 --2- 172.21.15.99:0/1232931720 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5600b10bf1d0 0x5600b10b34e0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.027+0000 7f03611e9740 1 --2- 172.21.15.99:0/1232931720 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5600b10ba060 0x5600b10caaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.027+0000 7f03611e9740 1 --2- 172.21.15.99:0/1232931720 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5600b10b9670 0x5600b10cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.027+0000 7f03611e9740 1 -- 172.21.15.99:0/1232931720 >> 172.21.15.99:0/1232931720 conn(0x5600b10b4be0 msgr2=0x5600b10cf200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:15.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.027+0000 7f03611e9740 1 -- 172.21.15.99:0/1232931720 shutdown_connections 2024-01-31T05:11:15.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.027+0000 7f03611e9740 1 -- 172.21.15.99:0/1232931720 wait complete. 2024-01-31T05:11:15.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.027+0000 7f03611e9740 1 -- start start 2024-01-31T05:11:15.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.027+0000 7f03611e9740 1 Processor -- start 2024-01-31T05:11:15.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.027+0000 7f03611e9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5600b10b9670 0x5600b10c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.027+0000 7f03611e9740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5600b10ba060 0x5600b10c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.027+0000 7f03611e9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5600b10bf1d0 0x5600b10c92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.027+0000 7f03611e9740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600b10c9800 con 0x5600b10ba060 2024-01-31T05:11:15.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.027+0000 7f03611e9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600b10c9970 con 0x5600b10bf1d0 2024-01-31T05:11:15.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.027+0000 7f03611e9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600b10c9b30 con 0x5600b10b9670 2024-01-31T05:11:15.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.027+0000 7f03611e9740 10 client.0 _ll_register_callbacks cb 0x7f0350007270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:11:15.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.027+0000 7f03577fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5600b10ba060 0x5600b10c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:15.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.027+0000 7f03577fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5600b10ba060 0x5600b10c83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54476/0 (socket says 172.21.15.99:54476) 2024-01-31T05:11:15.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.027+0000 7f03577fe640 1 -- 172.21.15.99:0/479786401 learned_addr learned my addr 172.21.15.99:0/479786401 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:15.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.027+0000 7f0357fff640 1 --2- 172.21.15.99:0/479786401 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5600b10b9670 0x5600b10c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:15.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.028+0000 7f035c8df640 1 --2- 172.21.15.99:0/479786401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5600b10bf1d0 0x5600b10c92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:15.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.028+0000 7f03577fe640 1 -- 172.21.15.99:0/479786401 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5600b10b9670 msgr2=0x5600b10c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:15.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.028+0000 7f03577fe640 1 --2- 172.21.15.99:0/479786401 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5600b10b9670 0x5600b10c7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.028+0000 7f03577fe640 1 -- 172.21.15.99:0/479786401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5600b10bf1d0 msgr2=0x5600b10c92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:15.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.028+0000 7f03577fe640 1 --2- 172.21.15.99:0/479786401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5600b10bf1d0 0x5600b10c92c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.028+0000 7f03577fe640 1 -- 172.21.15.99:0/479786401 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5600b101f660 con 0x5600b10ba060 2024-01-31T05:11:15.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.028+0000 7f03577fe640 1 --2- 172.21.15.99:0/479786401 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5600b10ba060 0x5600b10c83c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f034c02c6b0 tx=0x7f034c0ef890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e363ee5dde51d4 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:15.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.028+0000 7f03377fe640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:11:15.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.028+0000 7f03377fe640 1 -- 172.21.15.99:0/479786401 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034c0a72e0 con 0x5600b10ba060 2024-01-31T05:11:15.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.028+0000 7f03377fe640 1 -- 172.21.15.99:0/479786401 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f034c0bceb0 con 0x5600b10ba060 2024-01-31T05:11:15.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.028+0000 7f03611e9740 1 -- 172.21.15.99:0/479786401 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5600b10d0590 con 0x5600b10ba060 2024-01-31T05:11:15.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.028+0000 7f03377fe640 1 -- 172.21.15.99:0/479786401 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f034c003760 con 0x5600b10ba060 2024-01-31T05:11:15.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.028+0000 7f03611e9740 10 client.15270 fetch_fsmap learned FSMap version 26 2024-01-31T05:11:15.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.028+0000 7f03611e9740 1 -- 172.21.15.99:0/479786401 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5600b0fe1eb0 con 0x5600b10ba060 2024-01-31T05:11:15.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.028+0000 7f03377fe640 1 -- 172.21.15.99:0/479786401 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5600b10d0590 con 0x5600b10ba060 2024-01-31T05:11:15.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.028+0000 7f03377fe640 1 -- 172.21.15.99:0/479786401 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f034c03c070 con 0x5600b10ba060 2024-01-31T05:11:15.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.028+0000 7f03611e9740 10 client.15270 fetch_fsmap finished waiting for FSMap version 26 2024-01-31T05:11:15.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.028+0000 7f03611e9740 10 client.15270 resolve_mds: resolved name 'i' to daemon mds.i 2024-01-31T05:11:15.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.028+0000 7f03611e9740 20 client.15270 populate_metadata read hostname 'smithi099' 2024-01-31T05:11:15.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.028+0000 7f03611e9740 1 --2- 172.21.15.99:0/479786401 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x5600b112b090 0x5600b11277d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.028+0000 7f03611e9740 4 client.15270 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-31T05:11:15.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.028+0000 7f03611e9740 1 -- 172.21.15.99:0/479786401 --> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f034c0a5de0 con 0x5600b112b090 2024-01-31T05:11:15.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.029+0000 7f0357fff640 1 --2- 172.21.15.99:0/479786401 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x5600b112b090 0x5600b11277d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:15.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.029+0000 7f0357fff640 1 --2- 172.21.15.99:0/479786401 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x5600b112b090 0x5600b11277d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1885d2fd91a71095 server_cookie=9b99b7c5237b9abe in_seq=0 out_seq=0 2024-01-31T05:11:15.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.029+0000 7f03377fe640 10 client.15270 ms_handle_connect on v2:172.21.15.181:6838/996120687 2024-01-31T05:11:15.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.029+0000 7f03377fe640 1 -- 172.21.15.99:0/479786401 <== mds.2 v2:172.21.15.181:6838/996120687 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x7f034c0a5de0 con 0x5600b112b090 2024-01-31T05:11:15.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.029+0000 7f03377fe640 10 client.15270 handle_command_reply: tid=0 2024-01-31T05:11:15.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.029+0000 7f03611e9740 1 client.15270 shutdown 2024-01-31T05:11:15.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.029+0000 7f03611e9740 1 -- 172.21.15.99:0/479786401 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5600b10ba060 msgr2=0x5600b10c83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:15.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.029+0000 7f03611e9740 1 --2- 172.21.15.99:0/479786401 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5600b10ba060 0x5600b10c83c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f034c02c6b0 tx=0x7f034c0ef890 comp rx=0 tx=0).stop 2024-01-31T05:11:15.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.029+0000 7f03611e9740 1 -- 172.21.15.99:0/479786401 shutdown_connections 2024-01-31T05:11:15.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.029+0000 7f03611e9740 1 --2- 172.21.15.99:0/479786401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5600b10bf1d0 0x5600b10c92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.029+0000 7f03611e9740 1 --2- 172.21.15.99:0/479786401 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5600b10ba060 0x5600b10c83c0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.029+0000 7f03611e9740 1 --2- 172.21.15.99:0/479786401 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x5600b112b090 0x5600b11277d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.029+0000 7f03611e9740 1 --2- 172.21.15.99:0/479786401 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5600b10b9670 0x5600b10c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.029+0000 7f03377fe640 0 client.15270 ms_handle_reset on v2:172.21.15.181:6838/996120687 2024-01-31T05:11:15.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.029+0000 7f03611e9740 1 -- 172.21.15.99:0/479786401 >> 172.21.15.99:0/479786401 conn(0x5600b10b4be0 msgr2=0x5600b10b34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:15.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.029+0000 7f03611e9740 1 -- 172.21.15.99:0/479786401 shutdown_connections 2024-01-31T05:11:15.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.029+0000 7f03611e9740 1 -- 172.21.15.99:0/479786401 wait complete. 2024-01-31T05:11:15.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.030+0000 7f03611e9740 20 client.15270 trim_cache size 0 max 16384 2024-01-31T05:11:15.036 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-01-31T05:11:15.036 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_fsid": "9288ff44-bff5-11ee-95b3-87774f69a715", 2024-01-31T05:11:15.036 INFO:teuthology.orchestra.run.smithi099.stdout: "whoami": 2, 2024-01-31T05:11:15.036 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 24457, 2024-01-31T05:11:15.036 INFO:teuthology.orchestra.run.smithi099.stdout: "want_state": "up:active", 2024-01-31T05:11:15.037 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "up:active", 2024-01-31T05:11:15.037 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "cephfs", 2024-01-31T05:11:15.037 INFO:teuthology.orchestra.run.smithi099.stdout: "rank_uptime": 109.850550955, 2024-01-31T05:11:15.037 INFO:teuthology.orchestra.run.smithi099.stdout: "mdsmap_epoch": 26, 2024-01-31T05:11:15.037 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch": 88, 2024-01-31T05:11:15.037 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch_barrier": 86, 2024-01-31T05:11:15.037 INFO:teuthology.orchestra.run.smithi099.stdout: "uptime": 127.56222524499999 2024-01-31T05:11:15.037 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-01-31T05:11:15.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.030+0000 7f035e342640 1 -- 172.21.15.99:0/3481706605 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f03400a12e0 msgr2=0x7f03400a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:15.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.030+0000 7f035e342640 1 --2- 172.21.15.99:0/3481706605 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f03400a12e0 0x7f03400a37a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0350013460 tx=0x7f0350001ba0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.030+0000 7f035e342640 1 -- 172.21.15.99:0/3481706605 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0358100de0 msgr2=0x7f035819ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:15.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.030+0000 7f035e342640 1 --2- 172.21.15.99:0/3481706605 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0358100de0 0x7f035819ba20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f034c009230 tx=0x7f034c0042f0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.030+0000 7f035e342640 1 -- 172.21.15.99:0/3481706605 shutdown_connections 2024-01-31T05:11:15.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.030+0000 7f035e342640 1 --2- 172.21.15.99:0/3481706605 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f03400a12e0 0x7f03400a37a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.030+0000 7f035e342640 1 --2- 172.21.15.99:0/3481706605 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03581017a0 0x7f035819e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.030+0000 7f035e342640 1 --2- 172.21.15.99:0/3481706605 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0358100de0 0x7f035819ba20 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.030+0000 7f035e342640 1 --2- 172.21.15.99:0/3481706605 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03580ffbf0 0x7f03580689c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.030+0000 7f035e342640 1 -- 172.21.15.99:0/3481706605 >> 172.21.15.99:0/3481706605 conn(0x7f03580fb180 msgr2=0x7f0358104160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:15.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.030+0000 7f035e342640 1 -- 172.21.15.99:0/3481706605 shutdown_connections 2024-01-31T05:11:15.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.030+0000 7f035e342640 1 -- 172.21.15.99:0/3481706605 wait complete. 2024-01-31T05:11:15.041 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-01-31T05:11:15.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:14 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/177372413' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-31T05:11:15.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:14 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/2386591946' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:11:15.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:14 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/716335439' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:11:15.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:14 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/177372413' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-31T05:11:15.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:14 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/2386591946' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:11:15.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:14 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/716335439' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:11:15.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.143+0000 7fcc8335d640 1 -- 172.21.15.99:0/2188466191 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc7c0fed60 msgr2=0x7fcc7c0ff1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:15.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.143+0000 7fcc8335d640 1 --2- 172.21.15.99:0/2188466191 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc7c0fed60 0x7fcc7c0ff1e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fcc78009900 tx=0x7fcc7802bc30 comp rx=0 tx=0).stop 2024-01-31T05:11:15.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.144+0000 7fcc8335d640 1 -- 172.21.15.99:0/2188466191 shutdown_connections 2024-01-31T05:11:15.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.144+0000 7fcc8335d640 1 --2- 172.21.15.99:0/2188466191 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc7c0ff720 0x7fcc7c1092d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.144+0000 7fcc8335d640 1 --2- 172.21.15.99:0/2188466191 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc7c0fed60 0x7fcc7c0ff1e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.144+0000 7fcc8335d640 1 --2- 172.21.15.99:0/2188466191 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc7c1022f0 0x7fcc7c102710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.144+0000 7fcc8335d640 1 -- 172.21.15.99:0/2188466191 >> 172.21.15.99:0/2188466191 conn(0x7fcc7c0fa920 msgr2=0x7fcc7c0fcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:15.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.144+0000 7fcc8335d640 1 -- 172.21.15.99:0/2188466191 shutdown_connections 2024-01-31T05:11:15.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.144+0000 7fcc8335d640 1 -- 172.21.15.99:0/2188466191 wait complete. 2024-01-31T05:11:15.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.144+0000 7fcc8335d640 1 Processor -- start 2024-01-31T05:11:15.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.144+0000 7fcc8335d640 1 -- start start 2024-01-31T05:11:15.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.144+0000 7fcc8335d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc7c0fed60 0x7fcc7c196d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.144+0000 7fcc8335d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc7c0ff720 0x7fcc7c197250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.144+0000 7fcc8335d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc7c1022f0 0x7fcc7c19e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.144+0000 7fcc8335d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7c19e7f0 con 0x7fcc7c0fed60 2024-01-31T05:11:15.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.144+0000 7fcc8335d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7c19e960 con 0x7fcc7c1022f0 2024-01-31T05:11:15.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.144+0000 7fcc8335d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7c19eb20 con 0x7fcc7c0ff720 2024-01-31T05:11:15.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.144+0000 7fcc810f9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc7c0fed60 0x7fcc7c196d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:15.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.144+0000 7fcc810f9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc7c0fed60 0x7fcc7c196d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54502/0 (socket says 172.21.15.99:54502) 2024-01-31T05:11:15.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.144+0000 7fcc810f9640 1 -- 172.21.15.99:0/111311770 learned_addr learned my addr 172.21.15.99:0/111311770 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:15.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.145+0000 7fcc808f8640 1 --2- 172.21.15.99:0/111311770 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc7c0ff720 0x7fcc7c197250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:15.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.145+0000 7fcc818fa640 1 --2- 172.21.15.99:0/111311770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc7c1022f0 0x7fcc7c19e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:15.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.145+0000 7fcc810f9640 1 -- 172.21.15.99:0/111311770 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc7c0ff720 msgr2=0x7fcc7c197250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:15.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.145+0000 7fcc810f9640 1 --2- 172.21.15.99:0/111311770 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc7c0ff720 0x7fcc7c197250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.145+0000 7fcc810f9640 1 -- 172.21.15.99:0/111311770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc7c1022f0 msgr2=0x7fcc7c19e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:15.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.145+0000 7fcc810f9640 1 --2- 172.21.15.99:0/111311770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc7c1022f0 0x7fcc7c19e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.145+0000 7fcc810f9640 1 -- 172.21.15.99:0/111311770 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc78009560 con 0x7fcc7c0fed60 2024-01-31T05:11:15.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.145+0000 7fcc808f8640 1 --2- 172.21.15.99:0/111311770 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc7c0ff720 0x7fcc7c197250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:11:15.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.145+0000 7fcc810f9640 1 --2- 172.21.15.99:0/111311770 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc7c0fed60 0x7fcc7c196d10 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c00d770 tx=0x7fcc6c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:15.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.145+0000 7fcc727fc640 1 -- 172.21.15.99:0/111311770 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c009c30 con 0x7fcc7c0fed60 2024-01-31T05:11:15.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.145+0000 7fcc8335d640 1 -- 172.21.15.99:0/111311770 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc7c19ee00 con 0x7fcc7c0fed60 2024-01-31T05:11:15.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.145+0000 7fcc727fc640 1 -- 172.21.15.99:0/111311770 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcc6c00de80 con 0x7fcc7c0fed60 2024-01-31T05:11:15.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.145+0000 7fcc727fc640 1 -- 172.21.15.99:0/111311770 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c003e20 con 0x7fcc7c0fed60 2024-01-31T05:11:15.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.145+0000 7fcc8335d640 1 -- 172.21.15.99:0/111311770 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc7c19f220 con 0x7fcc7c0fed60 2024-01-31T05:11:15.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.148+0000 7fcc727fc640 1 -- 172.21.15.99:0/111311770 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) v1 ==== 135895+0+0 (secure 0 0 0) 0x7fcc6c003f80 con 0x7fcc7c0fed60 2024-01-31T05:11:15.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.148+0000 7fcc86204740 1 Processor -- start 2024-01-31T05:11:15.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.148+0000 7fcc86204740 1 -- start start 2024-01-31T05:11:15.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.148+0000 7fcc86204740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b68d735670 0x55b68d735a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.148+0000 7fcc86204740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b68d736060 0x55b68d73ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.148+0000 7fcc86204740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b68d73b1d0 0x55b68d73d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.148+0000 7fcc86204740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b68d6a4000 con 0x55b68d735670 2024-01-31T05:11:15.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.148+0000 7fcc86204740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b68d6a16f0 con 0x55b68d73b1d0 2024-01-31T05:11:15.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.148+0000 7fcc86204740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b68d69cfe0 con 0x55b68d736060 2024-01-31T05:11:15.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.148+0000 7fcc727fc640 1 --2- 172.21.15.99:0/111311770 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fcc680a12e0 0x7fcc680a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.148+0000 7fcc818fa640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b68d735670 0x55b68d735a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:15.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.148+0000 7fcc818fa640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b68d735670 0x55b68d735a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54514/0 (socket says 172.21.15.99:54514) 2024-01-31T05:11:15.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.148+0000 7fcc818fa640 1 -- 172.21.15.99:0/3501156113 learned_addr learned my addr 172.21.15.99:0/3501156113 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:15.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.148+0000 7fcc818fa640 1 --2- 172.21.15.99:0/111311770 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fcc680a12e0 0x7fcc680a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:15.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.148+0000 7fcc727fc640 1 -- 172.21.15.99:0/111311770 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fcc6c0cc5e0 con 0x7fcc7c0fed60 2024-01-31T05:11:15.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.149+0000 7fcc810f9640 1 --2- 172.21.15.99:0/3501156113 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b68d736060 0x55b68d73ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:15.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.149+0000 7fcc808f8640 1 --2- 172.21.15.99:0/3501156113 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b68d73b1d0 0x55b68d73d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:15.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.149+0000 7fcc818fa640 1 -- 172.21.15.99:0/3501156113 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b68d736060 msgr2=0x55b68d73ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:15.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.149+0000 7fcc818fa640 1 --2- 172.21.15.99:0/3501156113 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b68d736060 0x55b68d73ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.149+0000 7fcc818fa640 1 -- 172.21.15.99:0/3501156113 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b68d73b1d0 msgr2=0x55b68d73d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:15.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.149+0000 7fcc818fa640 1 --2- 172.21.15.99:0/3501156113 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b68d73b1d0 0x55b68d73d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.149+0000 7fcc818fa640 1 -- 172.21.15.99:0/3501156113 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b68d65f650 con 0x55b68d735670 2024-01-31T05:11:15.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.149+0000 7fcc808f8640 1 --2- 172.21.15.99:0/3501156113 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b68d73b1d0 0x55b68d73d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:11:15.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.149+0000 7fcc818fa640 1 --2- 172.21.15.99:0/3501156113 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b68d735670 0x55b68d735a90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fcc74012d00 tx=0x7fcc74010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae67a75ff49f41d6 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:15.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.149+0000 7fcc818fa640 1 --2- 172.21.15.99:0/111311770 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fcc680a12e0 0x7fcc680a37a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcc74009fd0 tx=0x7fcc74017000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:15.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.149+0000 7fcc677fe640 1 -- 172.21.15.99:0/3501156113 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc740124f0 con 0x55b68d735670 2024-01-31T05:11:15.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.149+0000 7fcc677fe640 1 -- 172.21.15.99:0/3501156113 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcc74009c80 con 0x55b68d735670 2024-01-31T05:11:15.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.149+0000 7fcc677fe640 1 -- 172.21.15.99:0/3501156113 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc74005020 con 0x55b68d735670 2024-01-31T05:11:15.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.150+0000 7fcc86204740 1 -- 172.21.15.99:0/3501156113 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b68d735670 msgr2=0x55b68d735a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:15.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.150+0000 7fcc86204740 1 --2- 172.21.15.99:0/3501156113 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b68d735670 0x55b68d735a90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fcc74012d00 tx=0x7fcc74010740 comp rx=0 tx=0).stop 2024-01-31T05:11:15.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.150+0000 7fcc86204740 1 -- 172.21.15.99:0/3501156113 shutdown_connections 2024-01-31T05:11:15.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.150+0000 7fcc86204740 1 --2- 172.21.15.99:0/3501156113 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b68d73b1d0 0x55b68d73d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.150+0000 7fcc86204740 1 --2- 172.21.15.99:0/3501156113 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b68d736060 0x55b68d73ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.150+0000 7fcc86204740 1 --2- 172.21.15.99:0/3501156113 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b68d735670 0x55b68d735a90 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.150+0000 7fcc86204740 1 -- 172.21.15.99:0/3501156113 >> 172.21.15.99:0/3501156113 conn(0x55b68d730be0 msgr2=0x55b68d730fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:15.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.150+0000 7fcc86204740 1 -- 172.21.15.99:0/3501156113 shutdown_connections 2024-01-31T05:11:15.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.150+0000 7fcc86204740 1 -- 172.21.15.99:0/3501156113 wait complete. 2024-01-31T05:11:15.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.150+0000 7fcc86204740 1 -- start start 2024-01-31T05:11:15.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.150+0000 7fcc86204740 1 Processor -- start 2024-01-31T05:11:15.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.150+0000 7fcc86204740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b68d735670 0x55b68d73f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.150+0000 7fcc86204740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b68d736060 0x55b68d73fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.150+0000 7fcc86204740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b68d73b1d0 0x55b68d746e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.150+0000 7fcc86204740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b68d6565c0 con 0x55b68d73b1d0 2024-01-31T05:11:15.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.150+0000 7fcc86204740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b68d656260 con 0x55b68d736060 2024-01-31T05:11:15.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.150+0000 7fcc86204740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b68d61b2d0 con 0x55b68d735670 2024-01-31T05:11:15.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.150+0000 7fcc86204740 10 client.0 _ll_register_callbacks cb 0x55b68d651230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:11:15.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.151+0000 7fcc818fa640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b68d73b1d0 0x55b68d746e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:15.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.151+0000 7fcc818fa640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b68d73b1d0 0x55b68d746e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54522/0 (socket says 172.21.15.99:54522) 2024-01-31T05:11:15.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.151+0000 7fcc818fa640 1 -- 172.21.15.99:0/3760697623 learned_addr learned my addr 172.21.15.99:0/3760697623 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:15.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.151+0000 7fcc810f9640 1 --2- 172.21.15.99:0/3760697623 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b68d735670 0x55b68d73f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:15.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.151+0000 7fcc808f8640 1 --2- 172.21.15.99:0/3760697623 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b68d736060 0x55b68d73fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:15.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.151+0000 7fcc818fa640 1 -- 172.21.15.99:0/3760697623 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b68d735670 msgr2=0x55b68d73f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:15.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.151+0000 7fcc818fa640 1 --2- 172.21.15.99:0/3760697623 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b68d735670 0x55b68d73f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.151+0000 7fcc818fa640 1 -- 172.21.15.99:0/3760697623 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b68d736060 msgr2=0x55b68d73fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:15.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.151+0000 7fcc818fa640 1 --2- 172.21.15.99:0/3760697623 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b68d736060 0x55b68d73fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.151+0000 7fcc818fa640 1 -- 172.21.15.99:0/3760697623 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc7401a040 con 0x55b68d73b1d0 2024-01-31T05:11:15.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.151+0000 7fcc818fa640 1 --2- 172.21.15.99:0/3760697623 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b68d73b1d0 0x55b68d746e30 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fcc74006010 tx=0x7fcc7400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=880df1ae76b67f0b server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:15.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.151+0000 7fcc64ff9640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:11:15.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.151+0000 7fcc64ff9640 1 -- 172.21.15.99:0/3760697623 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc740049e0 con 0x55b68d73b1d0 2024-01-31T05:11:15.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.151+0000 7fcc64ff9640 1 -- 172.21.15.99:0/3760697623 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fcc74004b40 con 0x55b68d73b1d0 2024-01-31T05:11:15.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.151+0000 7fcc86204740 1 -- 172.21.15.99:0/3760697623 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b68d695e70 con 0x55b68d73b1d0 2024-01-31T05:11:15.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.151+0000 7fcc64ff9640 1 -- 172.21.15.99:0/3760697623 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcc74004d00 con 0x55b68d73b1d0 2024-01-31T05:11:15.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.151+0000 7fcc86204740 10 client.15282 fetch_fsmap learned FSMap version 26 2024-01-31T05:11:15.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.151+0000 7fcc86204740 1 -- 172.21.15.99:0/3760697623 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b68d69b660 con 0x55b68d73b1d0 2024-01-31T05:11:15.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.151+0000 7fcc64ff9640 1 -- 172.21.15.99:0/3760697623 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b68d695e70 con 0x55b68d73b1d0 2024-01-31T05:11:15.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.152+0000 7fcc64ff9640 1 -- 172.21.15.99:0/3760697623 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fcc74026540 con 0x55b68d73b1d0 2024-01-31T05:11:15.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.152+0000 7fcc86204740 10 client.15282 fetch_fsmap finished waiting for FSMap version 26 2024-01-31T05:11:15.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.152+0000 7fcc86204740 10 client.15282 resolve_mds: resolved name 'h' to daemon mds.h 2024-01-31T05:11:15.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.152+0000 7fcc86204740 20 client.15282 populate_metadata read hostname 'smithi099' 2024-01-31T05:11:15.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.152+0000 7fcc86204740 1 --2- 172.21.15.99:0/3760697623 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x55b68d74ca00 0x55b68d74b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.152+0000 7fcc86204740 4 client.15282 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:11:15.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.152+0000 7fcc86204740 1 -- 172.21.15.99:0/3760697623 --> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b68d695b90 con 0x55b68d74ca00 2024-01-31T05:11:15.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.152+0000 7fcc810f9640 1 --2- 172.21.15.99:0/3760697623 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x55b68d74ca00 0x55b68d74b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:15.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.152+0000 7fcc64ff9640 10 client.15282 ms_handle_connect on v2:172.21.15.179:6836/837402830 2024-01-31T05:11:15.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.152+0000 7fcc810f9640 1 --2- 172.21.15.99:0/3760697623 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x55b68d74ca00 0x55b68d74b470 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1ca5ef08b14912a4 server_cookie=16ffeb899b81cb7d in_seq=0 out_seq=0 2024-01-31T05:11:15.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.153+0000 7fcc64ff9640 1 -- 172.21.15.99:0/3760697623 <== mds.1 v2:172.21.15.179:6836/837402830 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b68d695b90 con 0x55b68d74ca00 2024-01-31T05:11:15.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.153+0000 7fcc64ff9640 10 client.15282 handle_command_reply: tid=0 2024-01-31T05:11:15.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.153+0000 7fcc86204740 1 client.15282 shutdown 2024-01-31T05:11:15.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.153+0000 7fcc86204740 1 -- 172.21.15.99:0/3760697623 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b68d73b1d0 msgr2=0x55b68d746e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:15.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.153+0000 7fcc86204740 1 --2- 172.21.15.99:0/3760697623 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b68d73b1d0 0x55b68d746e30 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fcc74006010 tx=0x7fcc7400cc00 comp rx=0 tx=0).stop 2024-01-31T05:11:15.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.153+0000 7fcc86204740 1 -- 172.21.15.99:0/3760697623 shutdown_connections 2024-01-31T05:11:15.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.153+0000 7fcc86204740 1 --2- 172.21.15.99:0/3760697623 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x55b68d74ca00 0x55b68d74b470 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.153+0000 7fcc86204740 1 --2- 172.21.15.99:0/3760697623 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b68d73b1d0 0x55b68d746e30 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.153+0000 7fcc86204740 1 --2- 172.21.15.99:0/3760697623 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b68d736060 0x55b68d73fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.153+0000 7fcc64ff9640 0 client.15282 ms_handle_reset on v2:172.21.15.179:6836/837402830 2024-01-31T05:11:15.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.153+0000 7fcc86204740 1 --2- 172.21.15.99:0/3760697623 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b68d735670 0x55b68d73f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.153+0000 7fcc86204740 1 -- 172.21.15.99:0/3760697623 >> 172.21.15.99:0/3760697623 conn(0x55b68d730be0 msgr2=0x55b68d72fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:15.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.153+0000 7fcc86204740 1 -- 172.21.15.99:0/3760697623 shutdown_connections 2024-01-31T05:11:15.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.153+0000 7fcc86204740 1 -- 172.21.15.99:0/3760697623 wait complete. 2024-01-31T05:11:15.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.153+0000 7fcc86204740 20 client.15282 trim_cache size 0 max 16384 2024-01-31T05:11:15.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.168+0000 7fcc86204740 1 Processor -- start 2024-01-31T05:11:15.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.169+0000 7fcc86204740 1 -- start start 2024-01-31T05:11:15.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.169+0000 7fcc86204740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b68d735670 0x55b68d7375c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.169+0000 7fcc86204740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b68d736060 0x55b68d737b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.169+0000 7fcc86204740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b68d73b1d0 0x55b68d746df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.169+0000 7fcc86204740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b68d730a90 con 0x55b68d736060 2024-01-31T05:11:15.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.169+0000 7fcc86204740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b68d74dd20 con 0x55b68d73b1d0 2024-01-31T05:11:15.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.169+0000 7fcc86204740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b68d695b90 con 0x55b68d735670 2024-01-31T05:11:15.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.169+0000 7fcc808f8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b68d736060 0x55b68d737b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:15.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.169+0000 7fcc808f8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b68d736060 0x55b68d737b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54530/0 (socket says 172.21.15.99:54530) 2024-01-31T05:11:15.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.169+0000 7fcc808f8640 1 -- 172.21.15.99:0/177359208 learned_addr learned my addr 172.21.15.99:0/177359208 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:15.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.169+0000 7fcc818fa640 1 --2- 172.21.15.99:0/177359208 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b68d73b1d0 0x55b68d746df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:15.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.169+0000 7fcc808f8640 1 -- 172.21.15.99:0/177359208 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b68d735670 msgr2=0x55b68d7375c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:15.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.169+0000 7fcc808f8640 1 --2- 172.21.15.99:0/177359208 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b68d735670 0x55b68d7375c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.169+0000 7fcc808f8640 1 -- 172.21.15.99:0/177359208 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b68d73b1d0 msgr2=0x55b68d746df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:15.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.169+0000 7fcc808f8640 1 --2- 172.21.15.99:0/177359208 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b68d73b1d0 0x55b68d746df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.169+0000 7fcc808f8640 1 -- 172.21.15.99:0/177359208 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b68d638360 con 0x55b68d736060 2024-01-31T05:11:15.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.169+0000 7fcc818fa640 1 --2- 172.21.15.99:0/177359208 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b68d73b1d0 0x55b68d746df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:11:15.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.169+0000 7fcc808f8640 1 --2- 172.21.15.99:0/177359208 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b68d736060 0x55b68d737b00 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fcc7802c610 tx=0x7fcc78004f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75528d11a80e7c25 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:15.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.169+0000 7fcc66ffd640 1 -- 172.21.15.99:0/177359208 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7802c980 con 0x55b68d736060 2024-01-31T05:11:15.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.169+0000 7fcc66ffd640 1 -- 172.21.15.99:0/177359208 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcc7802cae0 con 0x55b68d736060 2024-01-31T05:11:15.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.169+0000 7fcc66ffd640 1 -- 172.21.15.99:0/177359208 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc78005360 con 0x55b68d736060 2024-01-31T05:11:15.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.170+0000 7fcc86204740 1 -- 172.21.15.99:0/177359208 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b68d736060 msgr2=0x55b68d737b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:15.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.170+0000 7fcc86204740 1 --2- 172.21.15.99:0/177359208 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b68d736060 0x55b68d737b00 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fcc7802c610 tx=0x7fcc78004f00 comp rx=0 tx=0).stop 2024-01-31T05:11:15.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.170+0000 7fcc86204740 1 -- 172.21.15.99:0/177359208 shutdown_connections 2024-01-31T05:11:15.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.170+0000 7fcc86204740 1 --2- 172.21.15.99:0/177359208 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b68d73b1d0 0x55b68d746df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.170+0000 7fcc86204740 1 --2- 172.21.15.99:0/177359208 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b68d736060 0x55b68d737b00 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.170+0000 7fcc86204740 1 --2- 172.21.15.99:0/177359208 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b68d735670 0x55b68d7375c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.170+0000 7fcc86204740 1 -- 172.21.15.99:0/177359208 >> 172.21.15.99:0/177359208 conn(0x55b68d730be0 msgr2=0x55b68d73f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:15.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.170+0000 7fcc86204740 1 -- 172.21.15.99:0/177359208 shutdown_connections 2024-01-31T05:11:15.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.170+0000 7fcc86204740 1 -- 172.21.15.99:0/177359208 wait complete. 2024-01-31T05:11:15.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.170+0000 7fcc86204740 1 -- start start 2024-01-31T05:11:15.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.170+0000 7fcc86204740 1 Processor -- start 2024-01-31T05:11:15.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.171+0000 7fcc86204740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b68d735670 0x55b68d743c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.171+0000 7fcc86204740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b68d736060 0x55b68d744140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.171+0000 7fcc86204740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b68d73b1d0 0x55b68d7a1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.171+0000 7fcc86204740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b68d744750 con 0x55b68d735670 2024-01-31T05:11:15.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.171+0000 7fcc86204740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b68d7a1e80 con 0x55b68d736060 2024-01-31T05:11:15.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.171+0000 7fcc86204740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b68d7a1fc0 con 0x55b68d73b1d0 2024-01-31T05:11:15.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.171+0000 7fcc86204740 10 client.0 _ll_register_callbacks cb 0x7fcc74009ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:11:15.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.171+0000 7fcc810f9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b68d735670 0x55b68d743c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:15.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.171+0000 7fcc810f9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b68d735670 0x55b68d743c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54538/0 (socket says 172.21.15.99:54538) 2024-01-31T05:11:15.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.171+0000 7fcc810f9640 1 -- 172.21.15.99:0/1465070745 learned_addr learned my addr 172.21.15.99:0/1465070745 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:15.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.171+0000 7fcc808f8640 1 --2- 172.21.15.99:0/1465070745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b68d736060 0x55b68d744140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:15.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.171+0000 7fcc818fa640 1 --2- 172.21.15.99:0/1465070745 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b68d73b1d0 0x55b68d7a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:15.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.171+0000 7fcc810f9640 1 -- 172.21.15.99:0/1465070745 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b68d73b1d0 msgr2=0x55b68d7a1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:15.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.171+0000 7fcc810f9640 1 --2- 172.21.15.99:0/1465070745 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b68d73b1d0 0x55b68d7a1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.171+0000 7fcc810f9640 1 -- 172.21.15.99:0/1465070745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b68d736060 msgr2=0x55b68d744140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:15.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.171+0000 7fcc810f9640 1 --2- 172.21.15.99:0/1465070745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b68d736060 0x55b68d744140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.171+0000 7fcc810f9640 1 -- 172.21.15.99:0/1465070745 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc7c109a50 con 0x55b68d735670 2024-01-31T05:11:15.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.171+0000 7fcc818fa640 1 --2- 172.21.15.99:0/1465070745 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b68d73b1d0 0x55b68d7a1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:11:15.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.171+0000 7fcc810f9640 1 --2- 172.21.15.99:0/1465070745 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b68d735670 0x55b68d743c00 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c0994e0 tx=0x7fcc6c009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99fcc09cd9a26de1 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:15.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.171+0000 7fcc64ff9640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:11:15.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.171+0000 7fcc64ff9640 1 -- 172.21.15.99:0/1465070745 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c0979c0 con 0x55b68d735670 2024-01-31T05:11:15.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.171+0000 7fcc64ff9640 1 -- 172.21.15.99:0/1465070745 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fcc6c099ee0 con 0x55b68d735670 2024-01-31T05:11:15.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.171+0000 7fcc86204740 1 -- 172.21.15.99:0/1465070745 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcc74009c80 con 0x55b68d735670 2024-01-31T05:11:15.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.171+0000 7fcc64ff9640 1 -- 172.21.15.99:0/1465070745 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcc6c0997e0 con 0x55b68d735670 2024-01-31T05:11:15.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.171+0000 7fcc86204740 10 client.15288 fetch_fsmap learned FSMap version 26 2024-01-31T05:11:15.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.171+0000 7fcc86204740 1 -- 172.21.15.99:0/1465070745 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b68d65deb0 con 0x55b68d735670 2024-01-31T05:11:15.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.172+0000 7fcc64ff9640 1 -- 172.21.15.99:0/1465070745 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcc74009c80 con 0x55b68d735670 2024-01-31T05:11:15.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.172+0000 7fcc64ff9640 1 -- 172.21.15.99:0/1465070745 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fcc6c004230 con 0x55b68d735670 2024-01-31T05:11:15.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.172+0000 7fcc86204740 10 client.15288 fetch_fsmap finished waiting for FSMap version 26 2024-01-31T05:11:15.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.172+0000 7fcc86204740 10 client.15288 resolve_mds: resolved name 'h' to daemon mds.h 2024-01-31T05:11:15.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.172+0000 7fcc86204740 20 client.15288 populate_metadata read hostname 'smithi099' 2024-01-31T05:11:15.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.172+0000 7fcc86204740 1 --2- 172.21.15.99:0/1465070745 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x55b68d7a7170 0x55b68d7a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.172+0000 7fcc86204740 4 client.15288 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-31T05:11:15.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.172+0000 7fcc86204740 1 -- 172.21.15.99:0/1465070745 --> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b68d39c6c0 con 0x55b68d7a7170 2024-01-31T05:11:15.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.172+0000 7fcc808f8640 1 --2- 172.21.15.99:0/1465070745 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x55b68d7a7170 0x55b68d7a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:15.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.172+0000 7fcc64ff9640 10 client.15288 ms_handle_connect on v2:172.21.15.179:6836/837402830 2024-01-31T05:11:15.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.172+0000 7fcc808f8640 1 --2- 172.21.15.99:0/1465070745 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x55b68d7a7170 0x55b68d7a36c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8cc996de5a7bd3c6 server_cookie=e236518c2f71f0a4 in_seq=0 out_seq=0 2024-01-31T05:11:15.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.173+0000 7fcc64ff9640 1 -- 172.21.15.99:0/1465070745 <== mds.1 v2:172.21.15.179:6836/837402830 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55b68d39c6c0 con 0x55b68d7a7170 2024-01-31T05:11:15.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.173+0000 7fcc64ff9640 10 client.15288 handle_command_reply: tid=0 2024-01-31T05:11:15.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.173+0000 7fcc86204740 1 client.15288 shutdown 2024-01-31T05:11:15.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.173+0000 7fcc86204740 1 -- 172.21.15.99:0/1465070745 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b68d735670 msgr2=0x55b68d743c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:15.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.173+0000 7fcc86204740 1 --2- 172.21.15.99:0/1465070745 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b68d735670 0x55b68d743c00 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c0994e0 tx=0x7fcc6c009f60 comp rx=0 tx=0).stop 2024-01-31T05:11:15.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.173+0000 7fcc86204740 1 -- 172.21.15.99:0/1465070745 shutdown_connections 2024-01-31T05:11:15.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.173+0000 7fcc86204740 1 --2- 172.21.15.99:0/1465070745 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x55b68d7a7170 0x55b68d7a36c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.173+0000 7fcc86204740 1 --2- 172.21.15.99:0/1465070745 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b68d73b1d0 0x55b68d7a1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.173+0000 7fcc64ff9640 0 client.15288 ms_handle_reset on v2:172.21.15.179:6836/837402830 2024-01-31T05:11:15.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.173+0000 7fcc86204740 1 --2- 172.21.15.99:0/1465070745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b68d736060 0x55b68d744140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.173+0000 7fcc86204740 1 --2- 172.21.15.99:0/1465070745 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b68d735670 0x55b68d743c00 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.173+0000 7fcc86204740 1 -- 172.21.15.99:0/1465070745 >> 172.21.15.99:0/1465070745 conn(0x55b68d730be0 msgr2=0x55b68d73f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:15.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.173+0000 7fcc86204740 1 -- 172.21.15.99:0/1465070745 shutdown_connections 2024-01-31T05:11:15.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.173+0000 7fcc86204740 1 -- 172.21.15.99:0/1465070745 wait complete. 2024-01-31T05:11:15.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.173+0000 7fcc86204740 20 client.15288 trim_cache size 0 max 16384 2024-01-31T05:11:15.180 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-01-31T05:11:15.180 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_fsid": "9288ff44-bff5-11ee-95b3-87774f69a715", 2024-01-31T05:11:15.180 INFO:teuthology.orchestra.run.smithi099.stdout: "whoami": 1, 2024-01-31T05:11:15.180 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 24461, 2024-01-31T05:11:15.180 INFO:teuthology.orchestra.run.smithi099.stdout: "want_state": "up:active", 2024-01-31T05:11:15.180 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "up:active", 2024-01-31T05:11:15.180 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "cephfs", 2024-01-31T05:11:15.180 INFO:teuthology.orchestra.run.smithi099.stdout: "rank_uptime": 111.00025610100001, 2024-01-31T05:11:15.180 INFO:teuthology.orchestra.run.smithi099.stdout: "mdsmap_epoch": 26, 2024-01-31T05:11:15.180 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch": 88, 2024-01-31T05:11:15.180 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch_barrier": 86, 2024-01-31T05:11:15.181 INFO:teuthology.orchestra.run.smithi099.stdout: "uptime": 130.316156971 2024-01-31T05:11:15.181 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-01-31T05:11:15.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.173+0000 7fcc8335d640 1 -- 172.21.15.99:0/111311770 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fcc680a12e0 msgr2=0x7fcc680a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:15.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.173+0000 7fcc8335d640 1 --2- 172.21.15.99:0/111311770 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fcc680a12e0 0x7fcc680a37a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcc74009fd0 tx=0x7fcc74017000 comp rx=0 tx=0).stop 2024-01-31T05:11:15.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.173+0000 7fcc8335d640 1 -- 172.21.15.99:0/111311770 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc7c0fed60 msgr2=0x7fcc7c196d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:15.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.173+0000 7fcc8335d640 1 --2- 172.21.15.99:0/111311770 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc7c0fed60 0x7fcc7c196d10 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c00d770 tx=0x7fcc6c00dc30 comp rx=0 tx=0).stop 2024-01-31T05:11:15.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.173+0000 7fcc8335d640 1 -- 172.21.15.99:0/111311770 shutdown_connections 2024-01-31T05:11:15.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.173+0000 7fcc8335d640 1 --2- 172.21.15.99:0/111311770 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fcc680a12e0 0x7fcc680a37a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.173+0000 7fcc8335d640 1 --2- 172.21.15.99:0/111311770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc7c1022f0 0x7fcc7c19e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.173+0000 7fcc8335d640 1 --2- 172.21.15.99:0/111311770 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcc7c0ff720 0x7fcc7c197250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.173+0000 7fcc8335d640 1 --2- 172.21.15.99:0/111311770 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc7c0fed60 0x7fcc7c196d10 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.173+0000 7fcc8335d640 1 -- 172.21.15.99:0/111311770 >> 172.21.15.99:0/111311770 conn(0x7fcc7c0fa920 msgr2=0x7fcc7c1053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:15.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.174+0000 7fcc8335d640 1 -- 172.21.15.99:0/111311770 shutdown_connections 2024-01-31T05:11:15.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.174+0000 7fcc8335d640 1 -- 172.21.15.99:0/111311770 wait complete. 2024-01-31T05:11:15.184 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-01-31T05:11:15.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.286+0000 7f1f875ee640 1 -- 172.21.15.99:0/1528949333 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f80100e00 msgr2=0x7f1f80101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:15.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.286+0000 7f1f875ee640 1 --2- 172.21.15.99:0/1528949333 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f80100e00 0x7f1f80101280 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c009900 tx=0x7f1f7c02bc30 comp rx=0 tx=0).stop 2024-01-31T05:11:15.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.286+0000 7f1f875ee640 1 -- 172.21.15.99:0/1528949333 shutdown_connections 2024-01-31T05:11:15.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.286+0000 7f1f875ee640 1 --2- 172.21.15.99:0/1528949333 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f801017c0 0x7f1f80108050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.286+0000 7f1f875ee640 1 --2- 172.21.15.99:0/1528949333 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f80100e00 0x7f1f80101280 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.286+0000 7f1f875ee640 1 --2- 172.21.15.99:0/1528949333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f800ffc10 0x7f1f80100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.286+0000 7f1f875ee640 1 -- 172.21.15.99:0/1528949333 >> 172.21.15.99:0/1528949333 conn(0x7f1f800fb1a0 msgr2=0x7f1f800fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:15.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.286+0000 7f1f875ee640 1 -- 172.21.15.99:0/1528949333 shutdown_connections 2024-01-31T05:11:15.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.286+0000 7f1f875ee640 1 -- 172.21.15.99:0/1528949333 wait complete. 2024-01-31T05:11:15.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.286+0000 7f1f875ee640 1 Processor -- start 2024-01-31T05:11:15.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.286+0000 7f1f875ee640 1 -- start start 2024-01-31T05:11:15.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.286+0000 7f1f875ee640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f800ffc10 0x7f1f80069e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.287+0000 7f1f875ee640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f80100e00 0x7f1f8019ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.287+0000 7f1f875ee640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f801017c0 0x7f1f8019e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.287+0000 7f1f875ee640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8019e840 con 0x7f1f801017c0 2024-01-31T05:11:15.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.287+0000 7f1f875ee640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8019e9b0 con 0x7f1f80100e00 2024-01-31T05:11:15.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.287+0000 7f1f875ee640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8019eb70 con 0x7f1f800ffc10 2024-01-31T05:11:15.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.287+0000 7f1f85b8b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f801017c0 0x7f1f8019e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:15.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.287+0000 7f1f85b8b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f801017c0 0x7f1f8019e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54544/0 (socket says 172.21.15.99:54544) 2024-01-31T05:11:15.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.287+0000 7f1f85b8b640 1 -- 172.21.15.99:0/197802344 learned_addr learned my addr 172.21.15.99:0/197802344 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:15.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.287+0000 7f1f8538a640 1 --2- 172.21.15.99:0/197802344 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f800ffc10 0x7f1f80069e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:15.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.287+0000 7f1f84b89640 1 --2- 172.21.15.99:0/197802344 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f80100e00 0x7f1f8019ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:15.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.287+0000 7f1f85b8b640 1 -- 172.21.15.99:0/197802344 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f800ffc10 msgr2=0x7f1f80069e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:15.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.287+0000 7f1f85b8b640 1 --2- 172.21.15.99:0/197802344 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f800ffc10 0x7f1f80069e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.287+0000 7f1f85b8b640 1 -- 172.21.15.99:0/197802344 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f80100e00 msgr2=0x7f1f8019ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:15.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.287+0000 7f1f85b8b640 1 --2- 172.21.15.99:0/197802344 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f80100e00 0x7f1f8019ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.287+0000 7f1f85b8b640 1 -- 172.21.15.99:0/197802344 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f7c009560 con 0x7f1f801017c0 2024-01-31T05:11:15.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.287+0000 7f1f85b8b640 1 --2- 172.21.15.99:0/197802344 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f801017c0 0x7f1f8019e060 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1f7800eaa0 tx=0x7f1f7800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:15.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.287+0000 7f1f767fc640 1 -- 172.21.15.99:0/197802344 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7800cdb0 con 0x7f1f801017c0 2024-01-31T05:11:15.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.287+0000 7f1f767fc640 1 -- 172.21.15.99:0/197802344 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1f78005020 con 0x7f1f801017c0 2024-01-31T05:11:15.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.287+0000 7f1f875ee640 1 -- 172.21.15.99:0/197802344 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f8019edf0 con 0x7f1f801017c0 2024-01-31T05:11:15.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.287+0000 7f1f767fc640 1 -- 172.21.15.99:0/197802344 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f780116d0 con 0x7f1f801017c0 2024-01-31T05:11:15.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.287+0000 7f1f875ee640 1 -- 172.21.15.99:0/197802344 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f8019f270 con 0x7f1f801017c0 2024-01-31T05:11:15.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.289+0000 7f1f767fc640 1 -- 172.21.15.99:0/197802344 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f1f78005190 con 0x7f1f801017c0 2024-01-31T05:11:15.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.290+0000 7f1f8a3b9740 1 Processor -- start 2024-01-31T05:11:15.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.290+0000 7f1f8a3b9740 1 -- start start 2024-01-31T05:11:15.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.290+0000 7f1f767fc640 1 --2- 172.21.15.99:0/197802344 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f1f6c0a12e0 0x7f1f6c0a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.290+0000 7f1f8a3b9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56389c94d670 0x56389c94da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.290+0000 7f1f8a3b9740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56389c94e060 0x56389c952b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.290+0000 7f1f8a3b9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56389c9531d0 0x56389c955660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.290+0000 7f1f8a3b9740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56389c8bc000 con 0x56389c94e060 2024-01-31T05:11:15.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.290+0000 7f1f8a3b9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x56389c8b96f0 con 0x56389c9531d0 2024-01-31T05:11:15.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.290+0000 7f1f8a3b9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x56389c8b4fe0 con 0x56389c94d670 2024-01-31T05:11:15.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.290+0000 7f1f84b89640 1 --2- 172.21.15.99:0/197802344 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f1f6c0a12e0 0x7f1f6c0a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:15.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.290+0000 7f1f767fc640 1 -- 172.21.15.99:0/197802344 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f1f780ccbe0 con 0x7f1f801017c0 2024-01-31T05:11:15.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.290+0000 7f1f84b89640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56389c94e060 0x56389c952b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:15.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.290+0000 7f1f84b89640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56389c94e060 0x56389c952b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54548/0 (socket says 172.21.15.99:54548) 2024-01-31T05:11:15.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.290+0000 7f1f84b89640 1 -- 172.21.15.99:0/3534637082 learned_addr learned my addr 172.21.15.99:0/3534637082 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:15.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.290+0000 7f1f85b8b640 1 --2- 172.21.15.99:0/3534637082 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56389c9531d0 0x56389c955660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:15.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.290+0000 7f1f8538a640 1 --2- 172.21.15.99:0/3534637082 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56389c94d670 0x56389c94da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:15.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.291+0000 7f1f84b89640 1 -- 172.21.15.99:0/3534637082 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56389c94d670 msgr2=0x56389c94da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:15.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.291+0000 7f1f84b89640 1 --2- 172.21.15.99:0/3534637082 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56389c94d670 0x56389c94da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.291+0000 7f1f84b89640 1 -- 172.21.15.99:0/3534637082 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56389c9531d0 msgr2=0x56389c955660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:15.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.291+0000 7f1f84b89640 1 --2- 172.21.15.99:0/3534637082 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56389c9531d0 0x56389c955660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.291+0000 7f1f84b89640 1 -- 172.21.15.99:0/3534637082 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56389c877650 con 0x56389c94e060 2024-01-31T05:11:15.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.291+0000 7f1f8538a640 1 --2- 172.21.15.99:0/3534637082 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56389c94d670 0x56389c94da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:11:15.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.291+0000 7f1f84b89640 1 --2- 172.21.15.99:0/3534637082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56389c94e060 0x56389c952b60 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c036040 tx=0x7f1f7c004ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fcc00f83577e403 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:15.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.291+0000 7f1f84b89640 1 --2- 172.21.15.99:0/197802344 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f1f6c0a12e0 0x7f1f6c0a37a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c009900 tx=0x7f1f7c03b000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:15.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.291+0000 7f1f6b7fe640 1 -- 172.21.15.99:0/3534637082 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c048070 con 0x56389c94e060 2024-01-31T05:11:15.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.291+0000 7f1f6b7fe640 1 -- 172.21.15.99:0/3534637082 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1f7c004e10 con 0x56389c94e060 2024-01-31T05:11:15.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.291+0000 7f1f6b7fe640 1 -- 172.21.15.99:0/3534637082 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c003ae0 con 0x56389c94e060 2024-01-31T05:11:15.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.292+0000 7f1f8a3b9740 1 -- 172.21.15.99:0/3534637082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56389c94e060 msgr2=0x56389c952b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:15.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.292+0000 7f1f8a3b9740 1 --2- 172.21.15.99:0/3534637082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56389c94e060 0x56389c952b60 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c036040 tx=0x7f1f7c004ae0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.292+0000 7f1f8a3b9740 1 -- 172.21.15.99:0/3534637082 shutdown_connections 2024-01-31T05:11:15.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.292+0000 7f1f8a3b9740 1 --2- 172.21.15.99:0/3534637082 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56389c9531d0 0x56389c955660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.292+0000 7f1f8a3b9740 1 --2- 172.21.15.99:0/3534637082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56389c94e060 0x56389c952b60 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.292+0000 7f1f8a3b9740 1 --2- 172.21.15.99:0/3534637082 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56389c94d670 0x56389c94da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.292+0000 7f1f8a3b9740 1 -- 172.21.15.99:0/3534637082 >> 172.21.15.99:0/3534637082 conn(0x56389c948be0 msgr2=0x56389c948fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:15.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.292+0000 7f1f8a3b9740 1 -- 172.21.15.99:0/3534637082 shutdown_connections 2024-01-31T05:11:15.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.292+0000 7f1f8a3b9740 1 -- 172.21.15.99:0/3534637082 wait complete. 2024-01-31T05:11:15.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.292+0000 7f1f8a3b9740 1 -- start start 2024-01-31T05:11:15.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.292+0000 7f1f8a3b9740 1 Processor -- start 2024-01-31T05:11:15.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.292+0000 7f1f8a3b9740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56389c94d670 0x56389c9578e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.292+0000 7f1f8a3b9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56389c94e060 0x56389c957e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.292+0000 7f1f8a3b9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56389c9531d0 0x56389c95ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.292+0000 7f1f8a3b9740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56389c86e5c0 con 0x56389c94d670 2024-01-31T05:11:15.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.292+0000 7f1f8a3b9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x56389c86e260 con 0x56389c94e060 2024-01-31T05:11:15.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.292+0000 7f1f8a3b9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x56389c8332d0 con 0x56389c9531d0 2024-01-31T05:11:15.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.292+0000 7f1f8a3b9740 10 client.0 _ll_register_callbacks cb 0x56389c869230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:11:15.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.293+0000 7f1f8538a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56389c94d670 0x56389c9578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:15.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.293+0000 7f1f8538a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56389c94d670 0x56389c9578e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54558/0 (socket says 172.21.15.99:54558) 2024-01-31T05:11:15.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.293+0000 7f1f8538a640 1 -- 172.21.15.99:0/209244212 learned_addr learned my addr 172.21.15.99:0/209244212 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:15.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.293+0000 7f1f85b8b640 1 --2- 172.21.15.99:0/209244212 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56389c9531d0 0x56389c95ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:15.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.293+0000 7f1f84b89640 1 --2- 172.21.15.99:0/209244212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56389c94e060 0x56389c957e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:15.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.293+0000 7f1f8538a640 1 -- 172.21.15.99:0/209244212 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56389c9531d0 msgr2=0x56389c95ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:15.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.293+0000 7f1f8538a640 1 --2- 172.21.15.99:0/209244212 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56389c9531d0 0x56389c95ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.293+0000 7f1f8538a640 1 -- 172.21.15.99:0/209244212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56389c94e060 msgr2=0x56389c957e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:15.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.293+0000 7f1f8538a640 1 --2- 172.21.15.99:0/209244212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56389c94e060 0x56389c957e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.293+0000 7f1f8538a640 1 -- 172.21.15.99:0/209244212 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f80108950 con 0x56389c94d670 2024-01-31T05:11:15.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.293+0000 7f1f85b8b640 1 --2- 172.21.15.99:0/209244212 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56389c9531d0 0x56389c95ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:11:15.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.293+0000 7f1f84b89640 1 --2- 172.21.15.99:0/209244212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56389c94e060 0x56389c957e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:11:15.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.293+0000 7f1f8538a640 1 --2- 172.21.15.99:0/209244212 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56389c94d670 0x56389c9578e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1f7000be90 tx=0x7f1f700117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1eb2738630e5596 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:15.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.293+0000 7f1f68ff9640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:11:15.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.293+0000 7f1f68ff9640 1 -- 172.21.15.99:0/209244212 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f70004230 con 0x56389c94d670 2024-01-31T05:11:15.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.293+0000 7f1f68ff9640 1 -- 172.21.15.99:0/209244212 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f1f70018070 con 0x56389c94d670 2024-01-31T05:11:15.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.293+0000 7f1f8a3b9740 1 -- 172.21.15.99:0/209244212 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56389c8ade70 con 0x56389c94d670 2024-01-31T05:11:15.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.293+0000 7f1f68ff9640 1 -- 172.21.15.99:0/209244212 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f70004390 con 0x56389c94d670 2024-01-31T05:11:15.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.293+0000 7f1f8a3b9740 10 client.15300 fetch_fsmap learned FSMap version 26 2024-01-31T05:11:15.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.293+0000 7f1f8a3b9740 1 -- 172.21.15.99:0/209244212 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56389c8b3660 con 0x56389c94d670 2024-01-31T05:11:15.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.293+0000 7f1f68ff9640 1 -- 172.21.15.99:0/209244212 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56389c8ade70 con 0x56389c94d670 2024-01-31T05:11:15.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.294+0000 7f1f68ff9640 1 -- 172.21.15.99:0/209244212 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1f70003850 con 0x56389c94d670 2024-01-31T05:11:15.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.294+0000 7f1f8a3b9740 10 client.15300 fetch_fsmap finished waiting for FSMap version 26 2024-01-31T05:11:15.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.294+0000 7f1f8a3b9740 10 client.15300 resolve_mds: resolved name 'b' to daemon mds.b 2024-01-31T05:11:15.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.294+0000 7f1f8a3b9740 20 client.15300 populate_metadata read hostname 'smithi099' 2024-01-31T05:11:15.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.294+0000 7f1f8a3b9740 1 --2- 172.21.15.99:0/209244212 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x56389c964b90 0x56389c963550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.294+0000 7f1f8a3b9740 4 client.15300 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:11:15.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.294+0000 7f1f8a3b9740 1 -- 172.21.15.99:0/209244212 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56389c8adb90 con 0x56389c964b90 2024-01-31T05:11:15.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.294+0000 7f1f84b89640 1 --2- 172.21.15.99:0/209244212 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x56389c964b90 0x56389c963550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:15.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.294+0000 7f1f68ff9640 10 client.15300 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:11:15.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.294+0000 7f1f84b89640 1 --2- 172.21.15.99:0/209244212 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x56389c964b90 0x56389c963550 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ab0b5fc0436e8a6 server_cookie=3a1251a9a9165802 in_seq=0 out_seq=0 2024-01-31T05:11:15.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.295+0000 7f1f68ff9640 1 -- 172.21.15.99:0/209244212 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56389c8adb90 con 0x56389c964b90 2024-01-31T05:11:15.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.295+0000 7f1f68ff9640 10 client.15300 handle_command_reply: tid=0 2024-01-31T05:11:15.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.295+0000 7f1f8a3b9740 1 client.15300 shutdown 2024-01-31T05:11:15.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.295+0000 7f1f8a3b9740 1 -- 172.21.15.99:0/209244212 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56389c94d670 msgr2=0x56389c9578e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:15.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.295+0000 7f1f8a3b9740 1 --2- 172.21.15.99:0/209244212 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56389c94d670 0x56389c9578e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1f7000be90 tx=0x7f1f700117b0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.295+0000 7f1f8a3b9740 1 -- 172.21.15.99:0/209244212 shutdown_connections 2024-01-31T05:11:15.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.295+0000 7f1f8a3b9740 1 --2- 172.21.15.99:0/209244212 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56389c9531d0 0x56389c95ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.295+0000 7f1f8a3b9740 1 --2- 172.21.15.99:0/209244212 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x56389c964b90 0x56389c963550 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.295+0000 7f1f8a3b9740 1 --2- 172.21.15.99:0/209244212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56389c94e060 0x56389c957e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.295+0000 7f1f8a3b9740 1 --2- 172.21.15.99:0/209244212 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56389c94d670 0x56389c9578e0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.295+0000 7f1f68ff9640 0 client.15300 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:11:15.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.295+0000 7f1f8a3b9740 1 -- 172.21.15.99:0/209244212 >> 172.21.15.99:0/209244212 conn(0x56389c948be0 msgr2=0x56389c947d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:15.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.295+0000 7f1f8a3b9740 1 -- 172.21.15.99:0/209244212 shutdown_connections 2024-01-31T05:11:15.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.295+0000 7f1f8a3b9740 1 -- 172.21.15.99:0/209244212 wait complete. 2024-01-31T05:11:15.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.295+0000 7f1f8a3b9740 20 client.15300 trim_cache size 0 max 16384 2024-01-31T05:11:15.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.310+0000 7f1f8a3b9740 1 Processor -- start 2024-01-31T05:11:15.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.311+0000 7f1f8a3b9740 1 -- start start 2024-01-31T05:11:15.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.311+0000 7f1f8a3b9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56389c94d670 0x56389c948fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.311+0000 7f1f8a3b9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56389c94e060 0x56389c95ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.311+0000 7f1f8a3b9740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56389c9531d0 0x56389c963c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.311+0000 7f1f8a3b9740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56389c8adb90 con 0x56389c9531d0 2024-01-31T05:11:15.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.311+0000 7f1f8a3b9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x56389c8ade70 con 0x56389c94e060 2024-01-31T05:11:15.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.311+0000 7f1f8a3b9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x56389c9444b0 con 0x56389c94d670 2024-01-31T05:11:15.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.311+0000 7f1f85b8b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56389c9531d0 0x56389c963c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:15.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.311+0000 7f1f85b8b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56389c9531d0 0x56389c963c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54572/0 (socket says 172.21.15.99:54572) 2024-01-31T05:11:15.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.311+0000 7f1f85b8b640 1 -- 172.21.15.99:0/2011050981 learned_addr learned my addr 172.21.15.99:0/2011050981 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:15.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.311+0000 7f1f85b8b640 1 -- 172.21.15.99:0/2011050981 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56389c94d670 msgr2=0x56389c948fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:15.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.311+0000 7f1f85b8b640 1 --2- 172.21.15.99:0/2011050981 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56389c94d670 0x56389c948fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.311+0000 7f1f85b8b640 1 -- 172.21.15.99:0/2011050981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56389c94e060 msgr2=0x56389c95ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:15.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.311+0000 7f1f85b8b640 1 --2- 172.21.15.99:0/2011050981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56389c94e060 0x56389c95ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.311+0000 7f1f85b8b640 1 -- 172.21.15.99:0/2011050981 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56389c850360 con 0x56389c9531d0 2024-01-31T05:11:15.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.311+0000 7f1f85b8b640 1 --2- 172.21.15.99:0/2011050981 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56389c9531d0 0x56389c963c60 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1f78009270 tx=0x7f1f78099f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12031f504ded92e6 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:15.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.311+0000 7f1f6affd640 1 -- 172.21.15.99:0/2011050981 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f78097fd0 con 0x56389c9531d0 2024-01-31T05:11:15.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.311+0000 7f1f6affd640 1 -- 172.21.15.99:0/2011050981 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1f78098230 con 0x56389c9531d0 2024-01-31T05:11:15.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.311+0000 7f1f6affd640 1 -- 172.21.15.99:0/2011050981 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f780a1f40 con 0x56389c9531d0 2024-01-31T05:11:15.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.312+0000 7f1f8a3b9740 1 -- 172.21.15.99:0/2011050981 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56389c9531d0 msgr2=0x56389c963c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:15.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.312+0000 7f1f8a3b9740 1 --2- 172.21.15.99:0/2011050981 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56389c9531d0 0x56389c963c60 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1f78009270 tx=0x7f1f78099f50 comp rx=0 tx=0).stop 2024-01-31T05:11:15.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.312+0000 7f1f8a3b9740 1 -- 172.21.15.99:0/2011050981 shutdown_connections 2024-01-31T05:11:15.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.312+0000 7f1f8a3b9740 1 --2- 172.21.15.99:0/2011050981 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56389c9531d0 0x56389c963c60 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.312+0000 7f1f8a3b9740 1 --2- 172.21.15.99:0/2011050981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56389c94e060 0x56389c95ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.312+0000 7f1f8a3b9740 1 --2- 172.21.15.99:0/2011050981 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56389c94d670 0x56389c948fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.312+0000 7f1f8a3b9740 1 -- 172.21.15.99:0/2011050981 >> 172.21.15.99:0/2011050981 conn(0x56389c948be0 msgr2=0x56389c963550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:15.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.312+0000 7f1f8a3b9740 1 -- 172.21.15.99:0/2011050981 shutdown_connections 2024-01-31T05:11:15.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.312+0000 7f1f8a3b9740 1 -- 172.21.15.99:0/2011050981 wait complete. 2024-01-31T05:11:15.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.312+0000 7f1f8a3b9740 1 -- start start 2024-01-31T05:11:15.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.312+0000 7f1f8a3b9740 1 Processor -- start 2024-01-31T05:11:15.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.313+0000 7f1f8a3b9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56389c94d670 0x56389c95c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.313+0000 7f1f8a3b9740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56389c94e060 0x56389c95c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.313+0000 7f1f8a3b9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56389c9531d0 0x56389c95d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.313+0000 7f1f8a3b9740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56389c95db90 con 0x56389c94e060 2024-01-31T05:11:15.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.313+0000 7f1f8a3b9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x56389c95dd00 con 0x56389c9531d0 2024-01-31T05:11:15.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.313+0000 7f1f8a3b9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x56389c95dec0 con 0x56389c94d670 2024-01-31T05:11:15.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.313+0000 7f1f8a3b9740 10 client.0 _ll_register_callbacks cb 0x7f1f7c02c900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:11:15.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.313+0000 7f1f84b89640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56389c94e060 0x56389c95c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:15.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.313+0000 7f1f84b89640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56389c94e060 0x56389c95c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54584/0 (socket says 172.21.15.99:54584) 2024-01-31T05:11:15.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.313+0000 7f1f84b89640 1 -- 172.21.15.99:0/4017229230 learned_addr learned my addr 172.21.15.99:0/4017229230 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:15.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.313+0000 7f1f8538a640 1 --2- 172.21.15.99:0/4017229230 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56389c94d670 0x56389c95c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:15.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.313+0000 7f1f84b89640 1 -- 172.21.15.99:0/4017229230 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56389c94d670 msgr2=0x56389c95c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:15.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.313+0000 7f1f84b89640 1 --2- 172.21.15.99:0/4017229230 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56389c94d670 0x56389c95c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.313+0000 7f1f84b89640 1 -- 172.21.15.99:0/4017229230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56389c9531d0 msgr2=0x56389c95d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:15.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.313+0000 7f1f84b89640 1 --2- 172.21.15.99:0/4017229230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56389c9531d0 0x56389c95d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.313+0000 7f1f84b89640 1 -- 172.21.15.99:0/4017229230 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f8019f270 con 0x56389c94e060 2024-01-31T05:11:15.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.313+0000 7f1f84b89640 1 --2- 172.21.15.99:0/4017229230 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56389c94e060 0x56389c95c6e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c005ab0 tx=0x7f1f7c02c5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=926ef43e1b10b5ab server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:15.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.313+0000 7f1f68ff9640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:11:15.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.313+0000 7f1f68ff9640 1 -- 172.21.15.99:0/4017229230 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c05b070 con 0x56389c94e060 2024-01-31T05:11:15.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.313+0000 7f1f68ff9640 1 -- 172.21.15.99:0/4017229230 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f1f7c003ae0 con 0x56389c94e060 2024-01-31T05:11:15.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.313+0000 7f1f8a3b9740 1 -- 172.21.15.99:0/4017229230 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56389c956690 con 0x56389c94e060 2024-01-31T05:11:15.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.313+0000 7f1f68ff9640 1 -- 172.21.15.99:0/4017229230 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f7c048040 con 0x56389c94e060 2024-01-31T05:11:15.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.313+0000 7f1f8a3b9740 10 client.15306 fetch_fsmap learned FSMap version 26 2024-01-31T05:11:15.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.313+0000 7f1f8a3b9740 1 -- 172.21.15.99:0/4017229230 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56389c875eb0 con 0x56389c94e060 2024-01-31T05:11:15.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.314+0000 7f1f68ff9640 1 -- 172.21.15.99:0/4017229230 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56389c956690 con 0x56389c94e060 2024-01-31T05:11:15.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.314+0000 7f1f68ff9640 1 -- 172.21.15.99:0/4017229230 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1f7c04d470 con 0x56389c94e060 2024-01-31T05:11:15.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.314+0000 7f1f8a3b9740 10 client.15306 fetch_fsmap finished waiting for FSMap version 26 2024-01-31T05:11:15.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.314+0000 7f1f8a3b9740 10 client.15306 resolve_mds: resolved name 'b' to daemon mds.b 2024-01-31T05:11:15.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.314+0000 7f1f8a3b9740 20 client.15306 populate_metadata read hostname 'smithi099' 2024-01-31T05:11:15.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.314+0000 7f1f8a3b9740 1 --2- 172.21.15.99:0/4017229230 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x56389c9bf630 0x56389c9bbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:15.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.314+0000 7f1f8a3b9740 4 client.15306 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-31T05:11:15.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.314+0000 7f1f8a3b9740 1 -- 172.21.15.99:0/4017229230 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f1f7c004e10 con 0x56389c9bf630 2024-01-31T05:11:15.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.314+0000 7f1f8538a640 1 --2- 172.21.15.99:0/4017229230 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x56389c9bf630 0x56389c9bbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:15.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.314+0000 7f1f68ff9640 10 client.15306 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:11:15.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.314+0000 7f1f8538a640 1 --2- 172.21.15.99:0/4017229230 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x56389c9bf630 0x56389c9bbae0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1dd2e03207aec4b2 server_cookie=75842fcc1cacf5c1 in_seq=0 out_seq=0 2024-01-31T05:11:15.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.315+0000 7f1f68ff9640 1 -- 172.21.15.99:0/4017229230 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+322 (crc 0 0 0) 0x7f1f7c004e10 con 0x56389c9bf630 2024-01-31T05:11:15.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.315+0000 7f1f68ff9640 10 client.15306 handle_command_reply: tid=0 2024-01-31T05:11:15.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.315+0000 7f1f8a3b9740 1 client.15306 shutdown 2024-01-31T05:11:15.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.315+0000 7f1f8a3b9740 1 -- 172.21.15.99:0/4017229230 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56389c94e060 msgr2=0x56389c95c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:15.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.315+0000 7f1f8a3b9740 1 --2- 172.21.15.99:0/4017229230 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56389c94e060 0x56389c95c6e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c005ab0 tx=0x7f1f7c02c5d0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.315+0000 7f1f8a3b9740 1 -- 172.21.15.99:0/4017229230 shutdown_connections 2024-01-31T05:11:15.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.315+0000 7f1f8a3b9740 1 --2- 172.21.15.99:0/4017229230 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x56389c9bf630 0x56389c9bbae0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.315+0000 7f1f8a3b9740 1 --2- 172.21.15.99:0/4017229230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56389c9531d0 0x56389c95d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.315+0000 7f1f68ff9640 0 client.15306 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:11:15.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.315+0000 7f1f8a3b9740 1 --2- 172.21.15.99:0/4017229230 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56389c94e060 0x56389c95c6e0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.315+0000 7f1f8a3b9740 1 --2- 172.21.15.99:0/4017229230 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56389c94d670 0x56389c95c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.315+0000 7f1f8a3b9740 1 -- 172.21.15.99:0/4017229230 >> 172.21.15.99:0/4017229230 conn(0x56389c948be0 msgr2=0x56389c9474e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:15.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.315+0000 7f1f8a3b9740 1 -- 172.21.15.99:0/4017229230 shutdown_connections 2024-01-31T05:11:15.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.315+0000 7f1f8a3b9740 1 -- 172.21.15.99:0/4017229230 wait complete. 2024-01-31T05:11:15.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.315+0000 7f1f8a3b9740 20 client.15306 trim_cache size 0 max 16384 2024-01-31T05:11:15.323 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-01-31T05:11:15.323 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_fsid": "9288ff44-bff5-11ee-95b3-87774f69a715", 2024-01-31T05:11:15.323 INFO:teuthology.orchestra.run.smithi099.stdout: "whoami": 0, 2024-01-31T05:11:15.323 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 24497, 2024-01-31T05:11:15.323 INFO:teuthology.orchestra.run.smithi099.stdout: "want_state": "up:active", 2024-01-31T05:11:15.323 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "up:active", 2024-01-31T05:11:15.323 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "cephfs", 2024-01-31T05:11:15.323 INFO:teuthology.orchestra.run.smithi099.stdout: "rank_uptime": 113.751994763, 2024-01-31T05:11:15.323 INFO:teuthology.orchestra.run.smithi099.stdout: "mdsmap_epoch": 26, 2024-01-31T05:11:15.323 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch": 88, 2024-01-31T05:11:15.323 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch_barrier": 86, 2024-01-31T05:11:15.324 INFO:teuthology.orchestra.run.smithi099.stdout: "uptime": 119.327337404 2024-01-31T05:11:15.324 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-01-31T05:11:15.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.315+0000 7f1f875ee640 1 -- 172.21.15.99:0/197802344 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f1f6c0a12e0 msgr2=0x7f1f6c0a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:15.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.315+0000 7f1f875ee640 1 --2- 172.21.15.99:0/197802344 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f1f6c0a12e0 0x7f1f6c0a37a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c009900 tx=0x7f1f7c03b000 comp rx=0 tx=0).stop 2024-01-31T05:11:15.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.315+0000 7f1f875ee640 1 -- 172.21.15.99:0/197802344 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f801017c0 msgr2=0x7f1f8019e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:15.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.315+0000 7f1f875ee640 1 --2- 172.21.15.99:0/197802344 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f801017c0 0x7f1f8019e060 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1f7800eaa0 tx=0x7f1f7800ef60 comp rx=0 tx=0).stop 2024-01-31T05:11:15.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.315+0000 7f1f875ee640 1 -- 172.21.15.99:0/197802344 shutdown_connections 2024-01-31T05:11:15.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.315+0000 7f1f875ee640 1 --2- 172.21.15.99:0/197802344 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f1f6c0a12e0 0x7f1f6c0a37a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.315+0000 7f1f875ee640 1 --2- 172.21.15.99:0/197802344 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f801017c0 0x7f1f8019e060 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.315+0000 7f1f875ee640 1 --2- 172.21.15.99:0/197802344 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f80100e00 0x7f1f8019ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.315+0000 7f1f875ee640 1 --2- 172.21.15.99:0/197802344 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f800ffc10 0x7f1f80069e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:15.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.315+0000 7f1f875ee640 1 -- 172.21.15.99:0/197802344 >> 172.21.15.99:0/197802344 conn(0x7f1f800fb1a0 msgr2=0x7f1f801041d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:15.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.316+0000 7f1f875ee640 1 -- 172.21.15.99:0/197802344 shutdown_connections 2024-01-31T05:11:15.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:15.316+0000 7f1f875ee640 1 -- 172.21.15.99:0/197802344 wait complete. 2024-01-31T05:11:15.326 INFO:teuthology.run_tasks:Running task kclient... 2024-01-31T05:11:15.352 INFO:tasks.kclient:Mounting kernel clients... 2024-01-31T05:11:15.352 INFO:tasks.kclient:config is {'client.0': {}} 2024-01-31T05:11:15.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:11:15.353 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2024-01-31T05:11:15.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:11:15.368 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link delete ceph-brx 2024-01-31T05:11:15.437 INFO:teuthology.orchestra.run.smithi099.stderr:Cannot find device "ceph-brx" 2024-01-31T05:11:15.438 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T05:11:15.438 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'nowsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-01-31T05:11:15.438 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-31T05:11:15.438 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-31T05:11:15.439 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph fs ls 2024-01-31T05:11:15.715 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:11:16.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:15 smithi099 ceph-mon[31615]: pgmap v345: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-01-31T05:11:16.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:15 smithi181 ceph-mon[36434]: pgmap v345: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-01-31T05:11:16.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:15 smithi179 ceph-mon[35652]: pgmap v345: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-01-31T05:11:17.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.545+0000 7f0fb9b03700 1 -- 172.21.15.99:0/1617259407 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fb41077a0 msgr2=0x7f0fb4107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:17.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.545+0000 7f0fb9b03700 1 --2- 172.21.15.99:0/1617259407 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fb41077a0 0x7f0fb4107b80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f0fa40099c0 tx=0x7f0fa4009cd0 comp rx=0 tx=0).stop 2024-01-31T05:11:17.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.545+0000 7f0fb9b03700 1 -- 172.21.15.99:0/1617259407 shutdown_connections 2024-01-31T05:11:17.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.545+0000 7f0fb9b03700 1 --2- 172.21.15.99:0/1617259407 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0fb4069e30 0x7f0fb410e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:17.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.545+0000 7f0fb9b03700 1 --2- 172.21.15.99:0/1617259407 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fb41077a0 0x7f0fb4107b80 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:17.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.545+0000 7f0fb9b03700 1 --2- 172.21.15.99:0/1617259407 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fb4069490 0x7f0fb40698f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:17.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.545+0000 7f0fb9b03700 1 -- 172.21.15.99:0/1617259407 >> 172.21.15.99:0/1617259407 conn(0x7f0fb4077610 msgr2=0x7f0fb4077a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:17.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.545+0000 7f0fb9b03700 1 -- 172.21.15.99:0/1617259407 shutdown_connections 2024-01-31T05:11:17.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.545+0000 7f0fb9b03700 1 -- 172.21.15.99:0/1617259407 wait complete. 2024-01-31T05:11:17.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.546+0000 7f0fb9b03700 1 Processor -- start 2024-01-31T05:11:17.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.546+0000 7f0fb9b03700 1 -- start start 2024-01-31T05:11:17.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.546+0000 7f0fb9b03700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0fb4069490 0x7f0fb419d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:17.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.546+0000 7f0fb9b03700 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fb4069e30 0x7f0fb419de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:17.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.546+0000 7f0fb9b03700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fb41077a0 0x7f0fb4197ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:17.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.546+0000 7f0fb9b03700 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb4198130 con 0x7f0fb41077a0 2024-01-31T05:11:17.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.546+0000 7f0fb9b03700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb4198270 con 0x7f0fb4069490 2024-01-31T05:11:17.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.546+0000 7f0fb9b03700 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb4198430 con 0x7f0fb4069e30 2024-01-31T05:11:17.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.546+0000 7f0fb3fff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fb41077a0 0x7f0fb4197ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:17.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.546+0000 7f0fb3fff700 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fb41077a0 0x7f0fb4197ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33976/0 (socket says 172.21.15.99:33976) 2024-01-31T05:11:17.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.546+0000 7f0fb3fff700 1 -- 172.21.15.99:0/1499332006 learned_addr learned my addr 172.21.15.99:0/1499332006 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:17.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.546+0000 7f0faaffd700 1 --2- 172.21.15.99:0/1499332006 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fb4069e30 0x7f0fb419de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:17.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.547+0000 7f0fb37fe700 1 --2- 172.21.15.99:0/1499332006 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0fb4069490 0x7f0fb419d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:17.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.547+0000 7f0fb3fff700 1 -- 172.21.15.99:0/1499332006 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fb4069e30 msgr2=0x7f0fb419de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:17.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.547+0000 7f0fb3fff700 1 --2- 172.21.15.99:0/1499332006 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fb4069e30 0x7f0fb419de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:17.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.547+0000 7f0fb3fff700 1 -- 172.21.15.99:0/1499332006 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0fb4069490 msgr2=0x7f0fb419d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:17.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.547+0000 7f0fb3fff700 1 --2- 172.21.15.99:0/1499332006 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0fb4069490 0x7f0fb419d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:17.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.547+0000 7f0fb3fff700 1 -- 172.21.15.99:0/1499332006 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa40095f0 con 0x7f0fb41077a0 2024-01-31T05:11:17.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.547+0000 7f0fb37fe700 1 --2- 172.21.15.99:0/1499332006 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0fb4069490 0x7f0fb419d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:11:17.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.547+0000 7f0faaffd700 1 --2- 172.21.15.99:0/1499332006 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fb4069e30 0x7f0fb419de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:11:17.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.547+0000 7f0fb3fff700 1 --2- 172.21.15.99:0/1499332006 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fb41077a0 0x7f0fb4197ad0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f0fac007ee0 tx=0x7f0fac00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:17.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.547+0000 7f0fb17fa700 1 -- 172.21.15.99:0/1499332006 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fac017070 con 0x7f0fb41077a0 2024-01-31T05:11:17.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.547+0000 7f0fb9b03700 1 -- 172.21.15.99:0/1499332006 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fb4198710 con 0x7f0fb41077a0 2024-01-31T05:11:17.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.547+0000 7f0fb17fa700 1 -- 172.21.15.99:0/1499332006 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0fac00f040 con 0x7f0fb41077a0 2024-01-31T05:11:17.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.547+0000 7f0fb17fa700 1 -- 172.21.15.99:0/1499332006 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fac005740 con 0x7f0fb41077a0 2024-01-31T05:11:17.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.547+0000 7f0fb9b03700 1 -- 172.21.15.99:0/1499332006 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fb41a49b0 con 0x7f0fb41077a0 2024-01-31T05:11:17.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.548+0000 7f0fb9b03700 1 -- 172.21.15.99:0/1499332006 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fb4109d50 con 0x7f0fb41077a0 2024-01-31T05:11:17.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.549+0000 7f0fb17fa700 1 -- 172.21.15.99:0/1499332006 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f0fac0058a0 con 0x7f0fb41077a0 2024-01-31T05:11:17.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.549+0000 7f0fb17fa700 1 --2- 172.21.15.99:0/1499332006 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f0fa00a1370 0x7f0fa00a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:17.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.550+0000 7f0fb37fe700 1 --2- 172.21.15.99:0/1499332006 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f0fa00a1370 0x7f0fa00a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:17.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.550+0000 7f0fb17fa700 1 -- 172.21.15.99:0/1499332006 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f0fac0cc350 con 0x7f0fb41077a0 2024-01-31T05:11:17.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.550+0000 7f0fb37fe700 1 --2- 172.21.15.99:0/1499332006 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f0fa00a1370 0x7f0fa00a3830 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4006010 tx=0x7f0fa4009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:17.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.554+0000 7f0fb17fa700 1 -- 172.21.15.99:0/1499332006 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f0fac095890 con 0x7f0fb41077a0 2024-01-31T05:11:17.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.791+0000 7f0fb9b03700 1 -- 172.21.15.99:0/1499332006 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0fb40684a0 con 0x7f0fb41077a0 2024-01-31T05:11:17.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.791+0000 7f0fb17fa700 1 -- 172.21.15.99:0/1499332006 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0fac098eb0 con 0x7f0fb41077a0 2024-01-31T05:11:17.792 INFO:teuthology.orchestra.run.smithi099.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-31T05:11:17.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.793+0000 7f0fb9b03700 1 -- 172.21.15.99:0/1499332006 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f0fa00a1370 msgr2=0x7f0fa00a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:17.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.793+0000 7f0fb9b03700 1 --2- 172.21.15.99:0/1499332006 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f0fa00a1370 0x7f0fa00a3830 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4006010 tx=0x7f0fa4009f10 comp rx=0 tx=0).stop 2024-01-31T05:11:17.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.793+0000 7f0fb9b03700 1 -- 172.21.15.99:0/1499332006 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fb41077a0 msgr2=0x7f0fb4197ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:17.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.793+0000 7f0fb9b03700 1 --2- 172.21.15.99:0/1499332006 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fb41077a0 0x7f0fb4197ad0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f0fac007ee0 tx=0x7f0fac00d3b0 comp rx=0 tx=0).stop 2024-01-31T05:11:17.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.794+0000 7f0fb9b03700 1 -- 172.21.15.99:0/1499332006 shutdown_connections 2024-01-31T05:11:17.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.794+0000 7f0fb9b03700 1 --2- 172.21.15.99:0/1499332006 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fb41077a0 0x7f0fb4197ad0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:17.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.794+0000 7f0fb9b03700 1 --2- 172.21.15.99:0/1499332006 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f0fa00a1370 0x7f0fa00a3830 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:17.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.794+0000 7f0fb9b03700 1 --2- 172.21.15.99:0/1499332006 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0fb4069490 0x7f0fb419d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:17.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.794+0000 7f0fb9b03700 1 --2- 172.21.15.99:0/1499332006 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fb4069e30 0x7f0fb419de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:17.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.794+0000 7f0fb9b03700 1 -- 172.21.15.99:0/1499332006 >> 172.21.15.99:0/1499332006 conn(0x7f0fb4077610 msgr2=0x7f0fb40fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:17.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.794+0000 7f0fb9b03700 1 -- 172.21.15.99:0/1499332006 shutdown_connections 2024-01-31T05:11:17.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:17.794+0000 7f0fb9b03700 1 -- 172.21.15.99:0/1499332006 wait complete. 2024-01-31T05:11:18.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:17 smithi099 ceph-mon[31615]: pgmap v346: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-01-31T05:11:18.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:17 smithi181 ceph-mon[36434]: pgmap v346: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-01-31T05:11:18.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:17 smithi179 ceph-mon[35652]: pgmap v346: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-01-31T05:11:18.585 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-31T05:11:18.585 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-31T05:11:18.585 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi099.front.sepia.ceph.com 2024-01-31T05:11:18.585 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-31T05:11:18.585 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-31T05:11:18.585 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-31T05:11:18.585 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-31T05:11:18.586 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-31T05:11:18.586 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-31T05:11:18.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:11:18.586 DEBUG:teuthology.orchestra.run.smithi099:> ip addr 2024-01-31T05:11:18.602 INFO:teuthology.orchestra.run.smithi099.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-31T05:11:18.602 INFO:teuthology.orchestra.run.smithi099.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-31T05:11:18.602 INFO:teuthology.orchestra.run.smithi099.stdout: inet 127.0.0.1/8 scope host lo 2024-01-31T05:11:18.602 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:11:18.602 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 ::1/128 scope host 2024-01-31T05:11:18.602 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:11:18.602 INFO:teuthology.orchestra.run.smithi099.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-31T05:11:18.603 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:10 brd ff:ff:ff:ff:ff:ff 2024-01-31T05:11:18.603 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f0 2024-01-31T05:11:18.603 INFO:teuthology.orchestra.run.smithi099.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-31T05:11:18.603 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:11 brd ff:ff:ff:ff:ff:ff 2024-01-31T05:11:18.603 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f1 2024-01-31T05:11:18.603 INFO:teuthology.orchestra.run.smithi099.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-31T05:11:18.603 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:02 brd ff:ff:ff:ff:ff:ff 2024-01-31T05:11:18.603 INFO:teuthology.orchestra.run.smithi099.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-31T05:11:18.603 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:03 brd ff:ff:ff:ff:ff:ff 2024-01-31T05:11:18.603 INFO:teuthology.orchestra.run.smithi099.stdout: inet 172.21.15.99/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-31T05:11:18.603 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft 42115sec preferred_lft 42115sec 2024-01-31T05:11:18.603 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::ec4:7aff:fe8f:d803/64 scope link 2024-01-31T05:11:18.603 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-01-31T05:11:18.604 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-01-31T05:11:18.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:11:18.604 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec bash -c ' 2024-01-31T05:11:18.604 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-01-31T05:11:18.604 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link add name ceph-brx type bridge 2024-01-31T05:11:18.604 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip addr flush dev ceph-brx 2024-01-31T05:11:18.604 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set ceph-brx up 2024-01-31T05:11:18.604 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-01-31T05:11:18.604 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-01-31T05:11:18.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:11:18.783 DEBUG:teuthology.orchestra.run.smithi099:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-31T05:11:18.807 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:18 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/1499332006' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-01-31T05:11:18.810 INFO:teuthology.orchestra.run.smithi099.stdout:1 2024-01-31T05:11:18.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:11:18.811 DEBUG:teuthology.orchestra.run.smithi099:> route 2024-01-31T05:11:18.881 INFO:teuthology.orchestra.run.smithi099.stdout:Kernel IP routing table 2024-01-31T05:11:18.881 INFO:teuthology.orchestra.run.smithi099.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-31T05:11:18.881 INFO:teuthology.orchestra.run.smithi099.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-31T05:11:18.881 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-31T05:11:18.881 INFO:teuthology.orchestra.run.smithi099.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-31T05:11:18.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:11:18.882 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec bash -c ' 2024-01-31T05:11:18.882 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-01-31T05:11:18.882 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-31T05:11:18.882 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-31T05:11:18.882 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-31T05:11:18.882 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-01-31T05:11:19.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:18 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/1499332006' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-01-31T05:11:19.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:18 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/1499332006' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-01-31T05:11:19.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:11:19.186 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2024-01-31T05:11:19.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:11:19.202 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list-id 2024-01-31T05:11:19.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:11:19.257 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec bash -c ' 2024-01-31T05:11:19.257 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-01-31T05:11:19.257 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-31T05:11:19.257 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-01-31T05:11:19.257 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-01-31T05:11:19.340 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-01-31T05:11:19.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:11:19.340 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec bash -c ' 2024-01-31T05:11:19.340 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-01-31T05:11:19.340 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-01-31T05:11:19.340 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-01-31T05:11:19.340 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-01-31T05:11:19.340 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-01-31T05:11:19.341 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-01-31T05:11:19.341 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-01-31T05:11:19.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:11:19.483 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec bash -c ' 2024-01-31T05:11:19.483 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-01-31T05:11:19.484 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set brx.0 up 2024-01-31T05:11:19.484 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set dev brx.0 master ceph-brx 2024-01-31T05:11:19.484 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-01-31T05:11:19.525 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-31T05:11:19.526 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-31T05:11:19.581 INFO:teuthology.orchestra.run.smithi099.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-31T05:11:19.581 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-31T05:11:19.581 DEBUG:teuthology.orchestra.run.smithi099:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-31T05:11:19.635 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-01-31T05:11:19.636 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-01-31T05:11:19.636 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f 2024-01-31T05:11:19.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:11:19.636 DEBUG:teuthology.orchestra.run.smithi099:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync 2024-01-31T05:11:19.753 INFO:teuthology.orchestra.run.smithi099.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync 2024-01-31T05:11:19.753 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync". 2024-01-31T05:11:19.753 INFO:teuthology.orchestra.run.smithi099.stdout:invalid new device string format 2024-01-31T05:11:19.864 INFO:teuthology.orchestra.run.smithi099.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync 2024-01-31T05:11:19.865 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync". 2024-01-31T05:11:19.865 INFO:teuthology.orchestra.run.smithi099.stdout:invalid new device string format 2024-01-31T05:11:19.865 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: resolved to: "172.21.15.99:3300,172.21.15.179:3300,172.21.15.181:3300" 2024-01-31T05:11:19.865 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.99:3300,172.21.15.179:3300,172.21.15.181:3300:/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f 2024-01-31T05:11:19.865 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync,key=0,fsid=9288ff44-bff5-11ee-95b3-87774f69a715" will pass to kernel 2024-01-31T05:11:19.866 INFO:teuthology.orchestra.run.smithi099.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-01-31T05:11:19.866 INFO:teuthology.orchestra.run.smithi099.stdout: You just mounted a file system that supports labels which does not 2024-01-31T05:11:19.866 INFO:teuthology.orchestra.run.smithi099.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-01-31T05:11:19.866 INFO:teuthology.orchestra.run.smithi099.stdout: applications will generate AVC messages and not be allowed access to 2024-01-31T05:11:19.866 INFO:teuthology.orchestra.run.smithi099.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-01-31T05:11:19.867 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-31T05:11:19.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:11:19.868 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-31T05:11:19.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:11:19.907 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-31T05:11:19.963 INFO:teuthology.orchestra.run.smithi099.stdout:client15315 2024-01-31T05:11:19.964 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-31T05:11:19.964 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-31T05:11:20.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:11:20.020 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-31T05:11:20.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:19 smithi099 ceph-mon[31615]: pgmap v347: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-01-31T05:11:20.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:19 smithi181 ceph-mon[36434]: pgmap v347: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-01-31T05:11:20.076 INFO:teuthology.orchestra.run.smithi099.stdout:client15315 2024-01-31T05:11:20.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:11:20.077 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-31T05:11:20.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:19 smithi179 ceph-mon[35652]: pgmap v347: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-01-31T05:11:20.133 INFO:teuthology.orchestra.run.smithi099.stdout:client15315 2024-01-31T05:11:20.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:11:20.133 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/9288ff44-bff5-11ee-95b3-87774f69a715.client15315/status') 2024-01-31T05:11:20.200 INFO:teuthology.orchestra.run.smithi099.stdout:instance: client.15315 (3)192.168.0.1:0/2502235466 2024-01-31T05:11:20.200 INFO:teuthology.orchestra.run.smithi099.stdout:blocklisted: false 2024-01-31T05:11:20.200 INFO:teuthology.orchestra.run.smithi099.stderr:0+1 records in 2024-01-31T05:11:20.200 INFO:teuthology.orchestra.run.smithi099.stderr:0+1 records out 2024-01-31T05:11:20.201 INFO:teuthology.orchestra.run.smithi099.stderr:70 bytes copied, 2.1326e-05 s, 3.3 MB/s 2024-01-31T05:11:20.202 INFO:teuthology.run_tasks:Running task exec... 2024-01-31T05:11:20.212 INFO:teuthology.task.exec:Executing custom commands... 2024-01-31T05:11:20.212 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi099.front.sepia.ceph.com 2024-01-31T05:11:20.212 DEBUG:teuthology.orchestra.run.smithi099:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-01-31T05:11:20.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.345+0000 7ff15722e640 1 -- 172.21.15.99:0/696695148 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff150101f10 msgr2=0x7ff150102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:20.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.345+0000 7ff15722e640 1 --2- 172.21.15.99:0/696695148 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff150101f10 0x7ff150102390 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff13c009900 tx=0x7ff13c02bc30 comp rx=0 tx=0).stop 2024-01-31T05:11:20.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.345+0000 7ff15722e640 1 -- 172.21.15.99:0/696695148 shutdown_connections 2024-01-31T05:11:20.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.345+0000 7ff15722e640 1 --2- 172.21.15.99:0/696695148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1501028d0 0x7ff150109160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:20.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.345+0000 7ff15722e640 1 --2- 172.21.15.99:0/696695148 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff150101f10 0x7ff150102390 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:20.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.345+0000 7ff15722e640 1 --2- 172.21.15.99:0/696695148 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff150100d20 0x7ff150101140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:20.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.345+0000 7ff15722e640 1 -- 172.21.15.99:0/696695148 >> 172.21.15.99:0/696695148 conn(0x7ff1500fc2b0 msgr2=0x7ff1500fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:20.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.345+0000 7ff15722e640 1 -- 172.21.15.99:0/696695148 shutdown_connections 2024-01-31T05:11:20.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.345+0000 7ff15722e640 1 -- 172.21.15.99:0/696695148 wait complete. 2024-01-31T05:11:20.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.346+0000 7ff15722e640 1 Processor -- start 2024-01-31T05:11:20.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.346+0000 7ff15722e640 1 -- start start 2024-01-31T05:11:20.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.346+0000 7ff15722e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff150100d20 0x7ff150196c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:20.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.346+0000 7ff15722e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff150101f10 0x7ff150197160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:20.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.346+0000 7ff15722e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1501028d0 0x7ff15019e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:20.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.346+0000 7ff15722e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff15019e700 con 0x7ff150100d20 2024-01-31T05:11:20.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.346+0000 7ff15722e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff15019e870 con 0x7ff1501028d0 2024-01-31T05:11:20.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.346+0000 7ff15722e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff15019ea30 con 0x7ff150101f10 2024-01-31T05:11:20.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.346+0000 7ff154fca640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff150100d20 0x7ff150196c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:20.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.346+0000 7ff154fca640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff150100d20 0x7ff150196c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34002/0 (socket says 172.21.15.99:34002) 2024-01-31T05:11:20.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.346+0000 7ff154fca640 1 -- 172.21.15.99:0/2668515646 learned_addr learned my addr 172.21.15.99:0/2668515646 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:20.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.346+0000 7ff14ffff640 1 --2- 172.21.15.99:0/2668515646 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff150101f10 0x7ff150197160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:20.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.346+0000 7ff1557cb640 1 --2- 172.21.15.99:0/2668515646 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1501028d0 0x7ff15019e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:20.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.346+0000 7ff154fca640 1 -- 172.21.15.99:0/2668515646 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff150101f10 msgr2=0x7ff150197160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:20.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.347+0000 7ff154fca640 1 --2- 172.21.15.99:0/2668515646 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff150101f10 0x7ff150197160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:20.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.347+0000 7ff154fca640 1 -- 172.21.15.99:0/2668515646 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1501028d0 msgr2=0x7ff15019e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:20.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.347+0000 7ff154fca640 1 --2- 172.21.15.99:0/2668515646 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1501028d0 0x7ff15019e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:20.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.347+0000 7ff154fca640 1 -- 172.21.15.99:0/2668515646 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff13c009560 con 0x7ff150100d20 2024-01-31T05:11:20.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.347+0000 7ff14ffff640 1 --2- 172.21.15.99:0/2668515646 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff150101f10 0x7ff150197160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:11:20.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.347+0000 7ff154fca640 1 --2- 172.21.15.99:0/2668515646 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff150100d20 0x7ff150196c20 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff14400d770 tx=0x7ff14400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:20.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.347+0000 7ff14dffb640 1 -- 172.21.15.99:0/2668515646 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff144009c30 con 0x7ff150100d20 2024-01-31T05:11:20.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.347+0000 7ff14dffb640 1 -- 172.21.15.99:0/2668515646 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff14400de80 con 0x7ff150100d20 2024-01-31T05:11:20.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.347+0000 7ff14dffb640 1 -- 172.21.15.99:0/2668515646 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff144003e20 con 0x7ff150100d20 2024-01-31T05:11:20.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.347+0000 7ff15722e640 1 -- 172.21.15.99:0/2668515646 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff15019ed10 con 0x7ff150100d20 2024-01-31T05:11:20.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.347+0000 7ff15722e640 1 -- 172.21.15.99:0/2668515646 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff15019f1c0 con 0x7ff150100d20 2024-01-31T05:11:20.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.348+0000 7ff15722e640 1 -- 172.21.15.99:0/2668515646 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff150107fe0 con 0x7ff150100d20 2024-01-31T05:11:20.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.349+0000 7ff14dffb640 1 -- 172.21.15.99:0/2668515646 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) v1 ==== 135895+0+0 (secure 0 0 0) 0x7ff144003f80 con 0x7ff150100d20 2024-01-31T05:11:20.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.350+0000 7ff14dffb640 1 --2- 172.21.15.99:0/2668515646 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff1400a1400 0x7ff1400a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:20.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.350+0000 7ff14ffff640 1 --2- 172.21.15.99:0/2668515646 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff1400a1400 0x7ff1400a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:20.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.350+0000 7ff14dffb640 1 -- 172.21.15.99:0/2668515646 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7ff1440cc4b0 con 0x7ff150100d20 2024-01-31T05:11:20.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.350+0000 7ff14ffff640 1 --2- 172.21.15.99:0/2668515646 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff1400a1400 0x7ff1400a38c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff13c02c240 tx=0x7ff13c02c5d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:20.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.355+0000 7ff14dffb640 1 -- 172.21.15.99:0/2668515646 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7ff144095960 con 0x7ff150100d20 2024-01-31T05:11:20.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.564+0000 7ff15722e640 1 -- 172.21.15.99:0/2668515646 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) v1 -- 0x7ff15010c840 con 0x7ff150100d20 2024-01-31T05:11:20.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.763+0000 7ff14dffb640 1 -- 172.21.15.99:0/2668515646 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v27) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff144097890 con 0x7ff150100d20 2024-01-31T05:11:20.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.765+0000 7ff15722e640 1 -- 172.21.15.99:0/2668515646 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff1400a1400 msgr2=0x7ff1400a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:20.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.765+0000 7ff15722e640 1 --2- 172.21.15.99:0/2668515646 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff1400a1400 0x7ff1400a38c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff13c02c240 tx=0x7ff13c02c5d0 comp rx=0 tx=0).stop 2024-01-31T05:11:20.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.765+0000 7ff15722e640 1 -- 172.21.15.99:0/2668515646 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff150100d20 msgr2=0x7ff150196c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:20.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.765+0000 7ff15722e640 1 --2- 172.21.15.99:0/2668515646 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff150100d20 0x7ff150196c20 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff14400d770 tx=0x7ff14400dc30 comp rx=0 tx=0).stop 2024-01-31T05:11:20.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.765+0000 7ff15722e640 1 -- 172.21.15.99:0/2668515646 shutdown_connections 2024-01-31T05:11:20.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.765+0000 7ff15722e640 1 --2- 172.21.15.99:0/2668515646 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff1400a1400 0x7ff1400a38c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:20.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.765+0000 7ff15722e640 1 --2- 172.21.15.99:0/2668515646 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1501028d0 0x7ff15019e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:20.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.765+0000 7ff15722e640 1 --2- 172.21.15.99:0/2668515646 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff150101f10 0x7ff150197160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:20.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.765+0000 7ff15722e640 1 --2- 172.21.15.99:0/2668515646 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff150100d20 0x7ff150196c20 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:20.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.765+0000 7ff15722e640 1 -- 172.21.15.99:0/2668515646 >> 172.21.15.99:0/2668515646 conn(0x7ff1500fc2b0 msgr2=0x7ff1501051b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:20.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.765+0000 7ff15722e640 1 -- 172.21.15.99:0/2668515646 shutdown_connections 2024-01-31T05:11:20.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.765+0000 7ff15722e640 1 -- 172.21.15.99:0/2668515646 wait complete. 2024-01-31T05:11:20.775 DEBUG:teuthology.orchestra.run.smithi099:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-01-31T05:11:20.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.879+0000 7fa6a9099640 1 -- 172.21.15.99:0/2036149978 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6a41069f0 msgr2=0x7fa6a4108e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:20.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.879+0000 7fa6a9099640 1 --2- 172.21.15.99:0/2036149978 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6a41069f0 0x7fa6a4108e40 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fa69c009ca0 tx=0x7fa69c02c0f0 comp rx=0 tx=0).stop 2024-01-31T05:11:20.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.880+0000 7fa6a9099640 1 -- 172.21.15.99:0/2036149978 shutdown_connections 2024-01-31T05:11:20.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.880+0000 7fa6a9099640 1 --2- 172.21.15.99:0/2036149978 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6a41069f0 0x7fa6a4108e40 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:20.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.880+0000 7fa6a9099640 1 --2- 172.21.15.99:0/2036149978 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6a41040c0 0x7fa6a41064b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:20.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.880+0000 7fa6a9099640 1 --2- 172.21.15.99:0/2036149978 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6a4101790 0x7fa6a4103b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:20.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.880+0000 7fa6a9099640 1 -- 172.21.15.99:0/2036149978 >> 172.21.15.99:0/2036149978 conn(0x7fa6a40fb180 msgr2=0x7fa6a40fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:20.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.880+0000 7fa6a9099640 1 -- 172.21.15.99:0/2036149978 shutdown_connections 2024-01-31T05:11:20.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.880+0000 7fa6a9099640 1 -- 172.21.15.99:0/2036149978 wait complete. 2024-01-31T05:11:20.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.880+0000 7fa6a9099640 1 Processor -- start 2024-01-31T05:11:20.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.880+0000 7fa6a9099640 1 -- start start 2024-01-31T05:11:20.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.880+0000 7fa6a9099640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6a4101790 0x7fa6a4101100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:20.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.880+0000 7fa6a9099640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6a41040c0 0x7fa6a40ff740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:20.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.880+0000 7fa6a9099640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6a41069f0 0x7fa6a40ffc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:20.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.880+0000 7fa6a9099640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a41003e0 con 0x7fa6a4101790 2024-01-31T05:11:20.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.880+0000 7fa6a9099640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a4100550 con 0x7fa6a41069f0 2024-01-31T05:11:20.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.880+0000 7fa6a9099640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a41a0cc0 con 0x7fa6a41040c0 2024-01-31T05:11:20.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.881+0000 7fa6a2d9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6a4101790 0x7fa6a4101100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:20.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.881+0000 7fa6a2d9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6a4101790 0x7fa6a4101100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34016/0 (socket says 172.21.15.99:34016) 2024-01-31T05:11:20.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.881+0000 7fa6a2d9d640 1 -- 172.21.15.99:0/1830603700 learned_addr learned my addr 172.21.15.99:0/1830603700 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:20.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.881+0000 7fa69bfff640 1 --2- 172.21.15.99:0/1830603700 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6a41040c0 0x7fa6a40ff740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:20.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.881+0000 7fa6a359e640 1 --2- 172.21.15.99:0/1830603700 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6a41069f0 0x7fa6a40ffc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:20.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.881+0000 7fa6a2d9d640 1 -- 172.21.15.99:0/1830603700 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6a41040c0 msgr2=0x7fa6a40ff740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:20.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.881+0000 7fa6a2d9d640 1 --2- 172.21.15.99:0/1830603700 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6a41040c0 0x7fa6a40ff740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:20.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.881+0000 7fa6a2d9d640 1 -- 172.21.15.99:0/1830603700 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6a41069f0 msgr2=0x7fa6a40ffc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:20.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.881+0000 7fa6a2d9d640 1 --2- 172.21.15.99:0/1830603700 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6a41069f0 0x7fa6a40ffc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:20.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.881+0000 7fa6a2d9d640 1 -- 172.21.15.99:0/1830603700 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa69c009900 con 0x7fa6a4101790 2024-01-31T05:11:20.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.881+0000 7fa6a2d9d640 1 --2- 172.21.15.99:0/1830603700 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6a4101790 0x7fa6a4101100 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fa69400d980 tx=0x7fa69400dd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:20.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.881+0000 7fa6a0d99640 1 -- 172.21.15.99:0/1830603700 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa694009c30 con 0x7fa6a4101790 2024-01-31T05:11:20.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.881+0000 7fa6a0d99640 1 -- 172.21.15.99:0/1830603700 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa69400bea0 con 0x7fa6a4101790 2024-01-31T05:11:20.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.881+0000 7fa6a9099640 1 -- 172.21.15.99:0/1830603700 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6a41a0f70 con 0x7fa6a4101790 2024-01-31T05:11:20.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.881+0000 7fa6a0d99640 1 -- 172.21.15.99:0/1830603700 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69400f620 con 0x7fa6a4101790 2024-01-31T05:11:20.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.881+0000 7fa6a9099640 1 -- 172.21.15.99:0/1830603700 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6a41a1410 con 0x7fa6a4101790 2024-01-31T05:11:20.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.882+0000 7fa6a9099640 1 -- 172.21.15.99:0/1830603700 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6a40fcc70 con 0x7fa6a4101790 2024-01-31T05:11:20.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.883+0000 7fa6a0d99640 1 -- 172.21.15.99:0/1830603700 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) v1 ==== 135895+0+0 (secure 0 0 0) 0x7fa694010460 con 0x7fa6a4101790 2024-01-31T05:11:20.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.884+0000 7fa6a0d99640 1 --2- 172.21.15.99:0/1830603700 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa6900a1380 0x7fa6900a3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:20.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.884+0000 7fa69bfff640 1 --2- 172.21.15.99:0/1830603700 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa6900a1380 0x7fa6900a3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:20.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.884+0000 7fa6a0d99640 1 -- 172.21.15.99:0/1830603700 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fa6940cc560 con 0x7fa6a4101790 2024-01-31T05:11:20.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.884+0000 7fa69bfff640 1 --2- 172.21.15.99:0/1830603700 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa6900a1380 0x7fa6900a3840 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4100e70 tx=0x7fa68c009110 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:20.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:20.888+0000 7fa6a0d99640 1 -- 172.21.15.99:0/1830603700 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fa694095aa0 con 0x7fa6a4101790 2024-01-31T05:11:21.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:20 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/2668515646' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-01-31T05:11:21.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:20 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/2668515646' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-01-31T05:11:21.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.087+0000 7fa6a9099640 1 -- 172.21.15.99:0/1830603700 --> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) v1 -- 0x7fa6a402cd50 con 0x7fa6900a1380 2024-01-31T05:11:21.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.103+0000 7fa6a0d99640 1 -- 172.21.15.99:0/1830603700 <== mgr.14152 v2:172.21.15.99:6800/3925720924 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3 (secure 0 0 0) 0x7fa6a402cd50 con 0x7fa6900a1380 2024-01-31T05:11:21.102 INFO:teuthology.orchestra.run.smithi099.stdout:{} 2024-01-31T05:11:21.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.105+0000 7fa6a9099640 1 -- 172.21.15.99:0/1830603700 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa6900a1380 msgr2=0x7fa6900a3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:21.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.105+0000 7fa6a9099640 1 --2- 172.21.15.99:0/1830603700 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa6900a1380 0x7fa6900a3840 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4100e70 tx=0x7fa68c009110 comp rx=0 tx=0).stop 2024-01-31T05:11:21.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.105+0000 7fa6a9099640 1 -- 172.21.15.99:0/1830603700 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6a4101790 msgr2=0x7fa6a4101100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:21.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.105+0000 7fa6a9099640 1 --2- 172.21.15.99:0/1830603700 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6a4101790 0x7fa6a4101100 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fa69400d980 tx=0x7fa69400dd80 comp rx=0 tx=0).stop 2024-01-31T05:11:21.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.105+0000 7fa6a9099640 1 -- 172.21.15.99:0/1830603700 shutdown_connections 2024-01-31T05:11:21.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.105+0000 7fa6a9099640 1 --2- 172.21.15.99:0/1830603700 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa6900a1380 0x7fa6900a3840 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:21.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.105+0000 7fa6a9099640 1 --2- 172.21.15.99:0/1830603700 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6a41069f0 0x7fa6a40ffc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:21.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.105+0000 7fa6a9099640 1 --2- 172.21.15.99:0/1830603700 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6a41040c0 0x7fa6a40ff740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:21.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.105+0000 7fa6a9099640 1 --2- 172.21.15.99:0/1830603700 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6a4101790 0x7fa6a4101100 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:21.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.105+0000 7fa6a9099640 1 -- 172.21.15.99:0/1830603700 >> 172.21.15.99:0/1830603700 conn(0x7fa6a40fb180 msgr2=0x7fa6a41021b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:21.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.105+0000 7fa6a9099640 1 -- 172.21.15.99:0/1830603700 shutdown_connections 2024-01-31T05:11:21.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.105+0000 7fa6a9099640 1 -- 172.21.15.99:0/1830603700 wait complete. 2024-01-31T05:11:21.116 INFO:teuthology.run_tasks:Running task check-counter... 2024-01-31T05:11:21.126 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-01-31T05:11:21.140 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:11:21.140 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:20 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/2668515646' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-01-31T05:11:21.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.243+0000 7f4769699640 1 -- 172.21.15.99:0/488191325 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4764100e00 msgr2=0x7f4764101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:21.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.243+0000 7f4769699640 1 --2- 172.21.15.99:0/488191325 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4764100e00 0x7f4764101280 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4758009900 tx=0x7f475802bc30 comp rx=0 tx=0).stop 2024-01-31T05:11:21.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.243+0000 7f4769699640 1 -- 172.21.15.99:0/488191325 shutdown_connections 2024-01-31T05:11:21.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.243+0000 7f4769699640 1 --2- 172.21.15.99:0/488191325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47641017c0 0x7f4764108050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:21.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.243+0000 7f4769699640 1 --2- 172.21.15.99:0/488191325 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4764100e00 0x7f4764101280 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:21.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.243+0000 7f4769699640 1 --2- 172.21.15.99:0/488191325 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47640ffc10 0x7f4764100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:21.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.243+0000 7f4769699640 1 -- 172.21.15.99:0/488191325 >> 172.21.15.99:0/488191325 conn(0x7f47640fb180 msgr2=0x7f47640fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:21.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.243+0000 7f4769699640 1 -- 172.21.15.99:0/488191325 shutdown_connections 2024-01-31T05:11:21.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.243+0000 7f4769699640 1 -- 172.21.15.99:0/488191325 wait complete. 2024-01-31T05:11:21.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.244+0000 7f4769699640 1 Processor -- start 2024-01-31T05:11:21.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.244+0000 7f4769699640 1 -- start start 2024-01-31T05:11:21.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.244+0000 7f4769699640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47640ffc10 0x7f47640689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:21.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.244+0000 7f4769699640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4764100e00 0x7f476419ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:21.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.244+0000 7f4769699640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47641017c0 0x7f476419e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:21.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.244+0000 7f4769699640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476419e850 con 0x7f4764100e00 2024-01-31T05:11:21.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.244+0000 7f4769699640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476419e9c0 con 0x7f47641017c0 2024-01-31T05:11:21.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.244+0000 7f4769699640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476419eb80 con 0x7f47640ffc10 2024-01-31T05:11:21.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.244+0000 7f47627fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4764100e00 0x7f476419ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:21.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.244+0000 7f47627fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4764100e00 0x7f476419ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34036/0 (socket says 172.21.15.99:34036) 2024-01-31T05:11:21.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.244+0000 7f47627fc640 1 -- 172.21.15.99:0/1425585249 learned_addr learned my addr 172.21.15.99:0/1425585249 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:21.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.245+0000 7f4762ffd640 1 --2- 172.21.15.99:0/1425585249 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47640ffc10 0x7f47640689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:21.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.245+0000 7f47627fc640 1 -- 172.21.15.99:0/1425585249 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47640ffc10 msgr2=0x7f47640689c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:21.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.245+0000 7f47627fc640 1 --2- 172.21.15.99:0/1425585249 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47640ffc10 0x7f47640689c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:21.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.245+0000 7f47627fc640 1 -- 172.21.15.99:0/1425585249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47641017c0 msgr2=0x7f476419e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:21.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.245+0000 7f47637fe640 1 --2- 172.21.15.99:0/1425585249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47641017c0 0x7f476419e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:21.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.245+0000 7f47627fc640 1 --2- 172.21.15.99:0/1425585249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47641017c0 0x7f476419e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:21.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.245+0000 7f47627fc640 1 -- 172.21.15.99:0/1425585249 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4758009560 con 0x7f4764100e00 2024-01-31T05:11:21.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.245+0000 7f4762ffd640 1 --2- 172.21.15.99:0/1425585249 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47640ffc10 0x7f47640689c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:11:21.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.245+0000 7f47637fe640 1 --2- 172.21.15.99:0/1425585249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47641017c0 0x7f476419e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:11:21.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.245+0000 7f47627fc640 1 --2- 172.21.15.99:0/1425585249 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4764100e00 0x7f476419ba50 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4758009230 tx=0x7f4758004ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:21.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.245+0000 7f474bfff640 1 -- 172.21.15.99:0/1425585249 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4758004350 con 0x7f4764100e00 2024-01-31T05:11:21.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.245+0000 7f474bfff640 1 -- 172.21.15.99:0/1425585249 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f47580044b0 con 0x7f4764100e00 2024-01-31T05:11:21.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.245+0000 7f4769699640 1 -- 172.21.15.99:0/1425585249 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f476419eda0 con 0x7f4764100e00 2024-01-31T05:11:21.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.245+0000 7f474bfff640 1 -- 172.21.15.99:0/1425585249 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4758003e10 con 0x7f4764100e00 2024-01-31T05:11:21.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.245+0000 7f4769699640 1 -- 172.21.15.99:0/1425585249 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f476419f250 con 0x7f4764100e00 2024-01-31T05:11:21.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.246+0000 7f4769699640 1 -- 172.21.15.99:0/1425585249 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4764107000 con 0x7f4764100e00 2024-01-31T05:11:21.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.247+0000 7f474bfff640 1 -- 172.21.15.99:0/1425585249 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f4758005000 con 0x7f4764100e00 2024-01-31T05:11:21.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.247+0000 7f474bfff640 1 --2- 172.21.15.99:0/1425585249 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f474c0a12e0 0x7f474c0a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:21.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.248+0000 7f4762ffd640 1 --2- 172.21.15.99:0/1425585249 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f474c0a12e0 0x7f474c0a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:21.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.248+0000 7f474bfff640 1 -- 172.21.15.99:0/1425585249 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f47580ef450 con 0x7f4764100e00 2024-01-31T05:11:21.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.248+0000 7f4762ffd640 1 --2- 172.21.15.99:0/1425585249 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f474c0a12e0 0x7f474c0a37a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4764100c60 tx=0x7f4754009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:21.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.252+0000 7f474bfff640 1 -- 172.21.15.99:0/1425585249 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f47580b8990 con 0x7f4764100e00 2024-01-31T05:11:21.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.426+0000 7f4769699640 1 -- 172.21.15.99:0/1425585249 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f476410b740 con 0x7f4764100e00 2024-01-31T05:11:21.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.428+0000 7f474bfff640 1 -- 172.21.15.99:0/1425585249 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22426 (secure 0 0 0) 0x7f47580bbfb0 con 0x7f4764100e00 2024-01-31T05:11:21.427 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:11:21.427 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":88,"fsid":"9288ff44-bff5-11ee-95b3-87774f69a715","created":"2024-01-31T05:01:26.130917+0000","modified":"2024-01-31T05:10:21.675877+0000","last_up_change":"2024-01-31T05:08:31.228478+0000","last_in_change":"2024-01-31T05:08:10.799511+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:46.842423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:09:18.693558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-31T05:09:19.734003+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b45878d9-28f1-4821-ba72-26a32d3fc780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6803","nonce":1213805280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6805","nonce":1213805280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6809","nonce":1213805280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6807","nonce":1213805280}]},"public_addr":"172.21.15.99:6803/1213805280","cluster_addr":"172.21.15.99:6805/1213805280","heartbeat_back_addr":"172.21.15.99:6809/1213805280","heartbeat_front_addr":"172.21.15.99:6807/1213805280","state":["exists","up"]},{"osd":1,"uuid":"e0b71ff3-5d97-4659-8dea-4c9091e1beb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6801","nonce":2019451677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6803","nonce":2019451677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6807","nonce":2019451677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6805","nonce":2019451677}]},"public_addr":"172.21.15.179:6801/2019451677","cluster_addr":"172.21.15.179:6803/2019451677","heartbeat_back_addr":"172.21.15.179:6807/2019451677","heartbeat_front_addr":"172.21.15.179:6805/2019451677","state":["exists","up"]},{"osd":2,"uuid":"11c919c8-19a9-48b0-8880-3002efcb64f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6801","nonce":3934284457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6803","nonce":3934284457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6807","nonce":3934284457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6805","nonce":3934284457}]},"public_addr":"172.21.15.181:6801/3934284457","cluster_addr":"172.21.15.181:6803/3934284457","heartbeat_back_addr":"172.21.15.181:6807/3934284457","heartbeat_front_addr":"172.21.15.181:6805/3934284457","state":["exists","up"]},{"osd":3,"uuid":"bcab5135-a5d1-45ae-a9b8-674425d3999e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6811","nonce":4207675427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6813","nonce":4207675427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6817","nonce":4207675427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6815","nonce":4207675427}]},"public_addr":"172.21.15.99:6811/4207675427","cluster_addr":"172.21.15.99:6813/4207675427","heartbeat_back_addr":"172.21.15.99:6817/4207675427","heartbeat_front_addr":"172.21.15.99:6815/4207675427","state":["exists","up"]},{"osd":4,"uuid":"0250d7ac-3894-457a-9c04-cc7205d61eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6809","nonce":2861083896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6811","nonce":2861083896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6815","nonce":2861083896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6813","nonce":2861083896}]},"public_addr":"172.21.15.179:6809/2861083896","cluster_addr":"172.21.15.179:6811/2861083896","heartbeat_back_addr":"172.21.15.179:6815/2861083896","heartbeat_front_addr":"172.21.15.179:6813/2861083896","state":["exists","up"]},{"osd":5,"uuid":"5e19222a-c2a4-45bc-8445-1d302f26d11c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6809","nonce":1485017095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6811","nonce":1485017095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6815","nonce":1485017095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6813","nonce":1485017095}]},"public_addr":"172.21.15.181:6809/1485017095","cluster_addr":"172.21.15.181:6811/1485017095","heartbeat_back_addr":"172.21.15.181:6815/1485017095","heartbeat_front_addr":"172.21.15.181:6813/1485017095","state":["exists","up"]},{"osd":6,"uuid":"56555035-f9fc-4e91-96dd-caa632d58adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6819","nonce":1534047839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6821","nonce":1534047839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6825","nonce":1534047839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6823","nonce":1534047839}]},"public_addr":"172.21.15.99:6819/1534047839","cluster_addr":"172.21.15.99:6821/1534047839","heartbeat_back_addr":"172.21.15.99:6825/1534047839","heartbeat_front_addr":"172.21.15.99:6823/1534047839","state":["exists","up"]},{"osd":7,"uuid":"5e079cf5-1340-4599-88a6-df410ef0148e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6817","nonce":3875950553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6819","nonce":3875950553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6823","nonce":3875950553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6821","nonce":3875950553}]},"public_addr":"172.21.15.179:6817/3875950553","cluster_addr":"172.21.15.179:6819/3875950553","heartbeat_back_addr":"172.21.15.179:6823/3875950553","heartbeat_front_addr":"172.21.15.179:6821/3875950553","state":["exists","up"]},{"osd":8,"uuid":"10a73592-4251-4492-b67d-ce9b9d7fff32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6817","nonce":179568936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6819","nonce":179568936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6823","nonce":179568936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6821","nonce":179568936}]},"public_addr":"172.21.15.181:6817/179568936","cluster_addr":"172.21.15.181:6819/179568936","heartbeat_back_addr":"172.21.15.181:6823/179568936","heartbeat_front_addr":"172.21.15.181:6821/179568936","state":["exists","up"]},{"osd":9,"uuid":"f6620e1e-f761-4f1c-917f-cbc748df32a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6827","nonce":315759515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6829","nonce":315759515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6833","nonce":315759515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6831","nonce":315759515}]},"public_addr":"172.21.15.99:6827/315759515","cluster_addr":"172.21.15.99:6829/315759515","heartbeat_back_addr":"172.21.15.99:6833/315759515","heartbeat_front_addr":"172.21.15.99:6831/315759515","state":["exists","up"]},{"osd":10,"uuid":"ee86af7d-66f8-4795-bcc3-dfec79e4680c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6825","nonce":2985063934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6827","nonce":2985063934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6831","nonce":2985063934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6829","nonce":2985063934}]},"public_addr":"172.21.15.179:6825/2985063934","cluster_addr":"172.21.15.179:6827/2985063934","heartbeat_back_addr":"172.21.15.179:6831/2985063934","heartbeat_front_addr":"172.21.15.179:6829/2985063934","state":["exists","up"]},{"osd":11,"uuid":"82f04fee-f6ae-4630-a75b-b12a9c4ab2e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6825","nonce":1858219600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6827","nonce":1858219600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6831","nonce":1858219600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6829","nonce":1858219600}]},"public_addr":"172.21.15.181:6825/1858219600","cluster_addr":"172.21.15.181:6827/1858219600","heartbeat_back_addr":"172.21.15.181:6831/1858219600","heartbeat_front_addr":"172.21.15.181:6829/1858219600","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:55.518970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:04:19.936339+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:04:44.064814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:09.331683+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:34.616774+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:58.881810+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:06:23.869838+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:06:49.127331+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:07:12.847187+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:07:38.231045+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:08:03.949162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:08:28.471802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:0/401101729":"2024-02-01T05:02:20.510858+0000","172.21.15.99:6801/1993198206":"2024-02-01T05:02:20.510858+0000","172.21.15.99:0/3819754569":"2024-02-01T05:02:20.510858+0000","172.21.15.99:0/475390265":"2024-02-01T05:01:53.732026+0000","172.21.15.99:6800/1993198206":"2024-02-01T05:02:20.510858+0000","172.21.15.99:6800/1706888338":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/4150146075":"2024-02-01T05:01:53.732026+0000","172.21.15.99:6801/1706888338":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/2851066598":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/1865156424":"2024-02-01T05:02:20.510858+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:11:21.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.430+0000 7f4769699640 1 -- 172.21.15.99:0/1425585249 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f474c0a12e0 msgr2=0x7f474c0a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:21.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.430+0000 7f4769699640 1 --2- 172.21.15.99:0/1425585249 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f474c0a12e0 0x7f474c0a37a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4764100c60 tx=0x7f4754009500 comp rx=0 tx=0).stop 2024-01-31T05:11:21.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.430+0000 7f4769699640 1 -- 172.21.15.99:0/1425585249 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4764100e00 msgr2=0x7f476419ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:21.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.430+0000 7f4769699640 1 --2- 172.21.15.99:0/1425585249 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4764100e00 0x7f476419ba50 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4758009230 tx=0x7f4758004ec0 comp rx=0 tx=0).stop 2024-01-31T05:11:21.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.430+0000 7f4769699640 1 -- 172.21.15.99:0/1425585249 shutdown_connections 2024-01-31T05:11:21.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.430+0000 7f4769699640 1 --2- 172.21.15.99:0/1425585249 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f474c0a12e0 0x7f474c0a37a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:21.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.430+0000 7f4769699640 1 --2- 172.21.15.99:0/1425585249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47641017c0 0x7f476419e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:21.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.430+0000 7f4769699640 1 --2- 172.21.15.99:0/1425585249 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4764100e00 0x7f476419ba50 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:21.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.430+0000 7f4769699640 1 --2- 172.21.15.99:0/1425585249 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47640ffc10 0x7f47640689c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:21.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.430+0000 7f4769699640 1 -- 172.21.15.99:0/1425585249 >> 172.21.15.99:0/1425585249 conn(0x7f47640fb180 msgr2=0x7f47641041d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:21.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.430+0000 7f4769699640 1 -- 172.21.15.99:0/1425585249 shutdown_connections 2024-01-31T05:11:21.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.430+0000 7f4769699640 1 -- 172.21.15.99:0/1425585249 wait complete. 2024-01-31T05:11:21.439 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:11:21 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:11:21.091+0000 7f4921dbf700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-31T05:11:21.439 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:11:21 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:11:21.091+0000 7f4921dbf700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-31T05:11:21.439 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:11:21 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:11:21.091+0000 7f4921dbf700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-31T05:11:21.439 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:11:21 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:11:21.091+0000 7f4921dbf700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-31T05:11:21.439 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:11:21 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:11:21.091+0000 7f4921dbf700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-31T05:11:21.440 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-31T05:04:46.842423+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-31T05:09:18.693558+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-31T05:09:19.734003+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-31T05:11:21.441 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-31T05:11:21.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.546+0000 7f29e6d1f640 1 -- 172.21.15.99:0/314818969 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29e0100df0 msgr2=0x7f29e0101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:21.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.546+0000 7f29e6d1f640 1 --2- 172.21.15.99:0/314818969 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29e0100df0 0x7f29e0101270 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f29cc009900 tx=0x7f29cc02bc30 comp rx=0 tx=0).stop 2024-01-31T05:11:21.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.546+0000 7f29e6d1f640 1 -- 172.21.15.99:0/314818969 shutdown_connections 2024-01-31T05:11:21.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.546+0000 7f29e6d1f640 1 --2- 172.21.15.99:0/314818969 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29e01017b0 0x7f29e0108040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:21.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.546+0000 7f29e6d1f640 1 --2- 172.21.15.99:0/314818969 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29e0100df0 0x7f29e0101270 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:21.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.546+0000 7f29e6d1f640 1 --2- 172.21.15.99:0/314818969 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f29e00ffc00 0x7f29e0100020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:21.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.546+0000 7f29e6d1f640 1 -- 172.21.15.99:0/314818969 >> 172.21.15.99:0/314818969 conn(0x7f29e00fb190 msgr2=0x7f29e00fd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:21.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.546+0000 7f29e6d1f640 1 -- 172.21.15.99:0/314818969 shutdown_connections 2024-01-31T05:11:21.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.546+0000 7f29e6d1f640 1 -- 172.21.15.99:0/314818969 wait complete. 2024-01-31T05:11:21.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.546+0000 7f29e6d1f640 1 Processor -- start 2024-01-31T05:11:21.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.547+0000 7f29e6d1f640 1 -- start start 2024-01-31T05:11:21.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.547+0000 7f29e6d1f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29e00ffc00 0x7f29e0196d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:21.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.547+0000 7f29e6d1f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f29e0100df0 0x7f29e0197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:21.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.547+0000 7f29e6d1f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29e01017b0 0x7f29e019e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:21.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.547+0000 7f29e6d1f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e019e810 con 0x7f29e01017b0 2024-01-31T05:11:21.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.547+0000 7f29e6d1f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e019e980 con 0x7f29e00ffc00 2024-01-31T05:11:21.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.547+0000 7f29e6d1f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e019eb40 con 0x7f29e0100df0 2024-01-31T05:11:21.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.547+0000 7f29e52bc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29e01017b0 0x7f29e019e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:21.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.547+0000 7f29e52bc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29e01017b0 0x7f29e019e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34046/0 (socket says 172.21.15.99:34046) 2024-01-31T05:11:21.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.547+0000 7f29e52bc640 1 -- 172.21.15.99:0/3278349803 learned_addr learned my addr 172.21.15.99:0/3278349803 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:21.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.547+0000 7f29e4abb640 1 --2- 172.21.15.99:0/3278349803 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29e00ffc00 0x7f29e0196d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:21.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.547+0000 7f29e52bc640 1 -- 172.21.15.99:0/3278349803 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f29e0100df0 msgr2=0x7f29e0197270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:21.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.547+0000 7f29dffff640 1 --2- 172.21.15.99:0/3278349803 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f29e0100df0 0x7f29e0197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:21.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.547+0000 7f29e52bc640 1 --2- 172.21.15.99:0/3278349803 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f29e0100df0 0x7f29e0197270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:21.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.547+0000 7f29e52bc640 1 -- 172.21.15.99:0/3278349803 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29e00ffc00 msgr2=0x7f29e0196d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:21.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.547+0000 7f29e52bc640 1 --2- 172.21.15.99:0/3278349803 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29e00ffc00 0x7f29e0196d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:21.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.547+0000 7f29e52bc640 1 -- 172.21.15.99:0/3278349803 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29cc009560 con 0x7f29e01017b0 2024-01-31T05:11:21.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.547+0000 7f29e52bc640 1 --2- 172.21.15.99:0/3278349803 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29e01017b0 0x7f29e019e2a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f29d800eaa0 tx=0x7f29d800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:21.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.547+0000 7f29ddffb640 1 -- 172.21.15.99:0/3278349803 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d800cdb0 con 0x7f29e01017b0 2024-01-31T05:11:21.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.547+0000 7f29ddffb640 1 -- 172.21.15.99:0/3278349803 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f29d8005020 con 0x7f29e01017b0 2024-01-31T05:11:21.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.547+0000 7f29e6d1f640 1 -- 172.21.15.99:0/3278349803 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29e019ee20 con 0x7f29e01017b0 2024-01-31T05:11:21.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.547+0000 7f29ddffb640 1 -- 172.21.15.99:0/3278349803 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d80116d0 con 0x7f29e01017b0 2024-01-31T05:11:21.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.548+0000 7f29e6d1f640 1 -- 172.21.15.99:0/3278349803 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29e019f1f0 con 0x7f29e01017b0 2024-01-31T05:11:21.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.549+0000 7f29e6d1f640 1 -- 172.21.15.99:0/3278349803 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29e010b4c0 con 0x7f29e01017b0 2024-01-31T05:11:21.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.549+0000 7f29ddffb640 1 -- 172.21.15.99:0/3278349803 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f29d8005190 con 0x7f29e01017b0 2024-01-31T05:11:21.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.550+0000 7f29ddffb640 1 --2- 172.21.15.99:0/3278349803 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f29d00a12e0 0x7f29d00a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:21.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.550+0000 7f29e4abb640 1 --2- 172.21.15.99:0/3278349803 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f29d00a12e0 0x7f29d00a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:21.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.550+0000 7f29ddffb640 1 -- 172.21.15.99:0/3278349803 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f29d80ccd70 con 0x7f29e01017b0 2024-01-31T05:11:21.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.551+0000 7f29e4abb640 1 --2- 172.21.15.99:0/3278349803 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f29d00a12e0 0x7f29d00a37a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f29d40058c0 tx=0x7f29d400a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:21.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.554+0000 7f29ddffb640 1 -- 172.21.15.99:0/3278349803 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f29d8096220 con 0x7f29e01017b0 2024-01-31T05:11:21.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.726+0000 7f29e6d1f640 1 -- 172.21.15.99:0/3278349803 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f29e019f520 con 0x7f29e01017b0 2024-01-31T05:11:21.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.726+0000 7f29ddffb640 1 -- 172.21.15.99:0/3278349803 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f29d801f020 con 0x7f29e01017b0 2024-01-31T05:11:21.726 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-01-31T05:11:21.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.728+0000 7f29e6d1f640 1 -- 172.21.15.99:0/3278349803 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f29d00a12e0 msgr2=0x7f29d00a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:21.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.728+0000 7f29e6d1f640 1 --2- 172.21.15.99:0/3278349803 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f29d00a12e0 0x7f29d00a37a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f29d40058c0 tx=0x7f29d400a2d0 comp rx=0 tx=0).stop 2024-01-31T05:11:21.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.728+0000 7f29e6d1f640 1 -- 172.21.15.99:0/3278349803 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29e01017b0 msgr2=0x7f29e019e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:21.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.728+0000 7f29e6d1f640 1 --2- 172.21.15.99:0/3278349803 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29e01017b0 0x7f29e019e2a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f29d800eaa0 tx=0x7f29d800ef60 comp rx=0 tx=0).stop 2024-01-31T05:11:21.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.728+0000 7f29e6d1f640 1 -- 172.21.15.99:0/3278349803 shutdown_connections 2024-01-31T05:11:21.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.728+0000 7f29e6d1f640 1 --2- 172.21.15.99:0/3278349803 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f29d00a12e0 0x7f29d00a37a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:21.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.728+0000 7f29e6d1f640 1 --2- 172.21.15.99:0/3278349803 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29e01017b0 0x7f29e019e2a0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:21.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.728+0000 7f29e6d1f640 1 --2- 172.21.15.99:0/3278349803 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f29e0100df0 0x7f29e0197270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:21.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.728+0000 7f29e6d1f640 1 --2- 172.21.15.99:0/3278349803 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29e00ffc00 0x7f29e0196d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:21.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.728+0000 7f29e6d1f640 1 -- 172.21.15.99:0/3278349803 >> 172.21.15.99:0/3278349803 conn(0x7f29e00fb190 msgr2=0x7f29e0069310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:21.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.728+0000 7f29e6d1f640 1 -- 172.21.15.99:0/3278349803 shutdown_connections 2024-01-31T05:11:21.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.729+0000 7f29e6d1f640 1 -- 172.21.15.99:0/3278349803 wait complete. 2024-01-31T05:11:21.738 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-31T05:11:21.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.847+0000 7fb179678640 1 -- 172.21.15.99:0/895628271 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1740ffbf0 msgr2=0x7fb174100010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:21.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.847+0000 7fb179678640 1 --2- 172.21.15.99:0/895628271 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1740ffbf0 0x7fb174100010 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb164009900 tx=0x7fb16402bc30 comp rx=0 tx=0).stop 2024-01-31T05:11:21.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.847+0000 7fb179678640 1 -- 172.21.15.99:0/895628271 shutdown_connections 2024-01-31T05:11:21.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.847+0000 7fb179678640 1 --2- 172.21.15.99:0/895628271 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1741017a0 0x7fb174108030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:21.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.847+0000 7fb179678640 1 --2- 172.21.15.99:0/895628271 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb174100de0 0x7fb174101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:21.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.847+0000 7fb179678640 1 --2- 172.21.15.99:0/895628271 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1740ffbf0 0x7fb174100010 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:21.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.847+0000 7fb179678640 1 -- 172.21.15.99:0/895628271 >> 172.21.15.99:0/895628271 conn(0x7fb1740fb180 msgr2=0x7fb1740fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:21.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.847+0000 7fb179678640 1 -- 172.21.15.99:0/895628271 shutdown_connections 2024-01-31T05:11:21.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.847+0000 7fb179678640 1 -- 172.21.15.99:0/895628271 wait complete. 2024-01-31T05:11:21.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.847+0000 7fb179678640 1 Processor -- start 2024-01-31T05:11:21.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.848+0000 7fb179678640 1 -- start start 2024-01-31T05:11:21.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.848+0000 7fb179678640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1740ffbf0 0x7fb1740689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:21.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.848+0000 7fb179678640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb174100de0 0x7fb17419ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:21.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.848+0000 7fb179678640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1741017a0 0x7fb17419e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:21.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.848+0000 7fb179678640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17419e890 con 0x7fb174100de0 2024-01-31T05:11:21.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.848+0000 7fb179678640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17419ea00 con 0x7fb1740ffbf0 2024-01-31T05:11:21.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.848+0000 7fb179678640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17419ebc0 con 0x7fb1741017a0 2024-01-31T05:11:21.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.848+0000 7fb1727fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb174100de0 0x7fb17419ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:21.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.848+0000 7fb1727fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb174100de0 0x7fb17419ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34066/0 (socket says 172.21.15.99:34066) 2024-01-31T05:11:21.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.848+0000 7fb1727fc640 1 -- 172.21.15.99:0/2022619719 learned_addr learned my addr 172.21.15.99:0/2022619719 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:21.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.848+0000 7fb172ffd640 1 --2- 172.21.15.99:0/2022619719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1740ffbf0 0x7fb1740689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:21.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.848+0000 7fb1737fe640 1 --2- 172.21.15.99:0/2022619719 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1741017a0 0x7fb17419e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:21.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.848+0000 7fb1727fc640 1 -- 172.21.15.99:0/2022619719 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1741017a0 msgr2=0x7fb17419e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:21.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.848+0000 7fb1727fc640 1 --2- 172.21.15.99:0/2022619719 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1741017a0 0x7fb17419e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:21.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.848+0000 7fb1727fc640 1 -- 172.21.15.99:0/2022619719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1740ffbf0 msgr2=0x7fb1740689c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:21.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.848+0000 7fb1727fc640 1 --2- 172.21.15.99:0/2022619719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1740ffbf0 0x7fb1740689c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:21.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.848+0000 7fb1727fc640 1 -- 172.21.15.99:0/2022619719 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb164009560 con 0x7fb174100de0 2024-01-31T05:11:21.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.848+0000 7fb1737fe640 1 --2- 172.21.15.99:0/2022619719 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1741017a0 0x7fb17419e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:11:21.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.848+0000 7fb1727fc640 1 --2- 172.21.15.99:0/2022619719 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb174100de0 0x7fb17419ba90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb16800e9f0 tx=0x7fb16800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:21.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.848+0000 7fb15bfff640 1 -- 172.21.15.99:0/2022619719 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb168009720 con 0x7fb174100de0 2024-01-31T05:11:21.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.848+0000 7fb15bfff640 1 -- 172.21.15.99:0/2022619719 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb16800cd80 con 0x7fb174100de0 2024-01-31T05:11:21.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.849+0000 7fb179678640 1 -- 172.21.15.99:0/2022619719 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb17419ee40 con 0x7fb174100de0 2024-01-31T05:11:21.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.849+0000 7fb15bfff640 1 -- 172.21.15.99:0/2022619719 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb168010430 con 0x7fb174100de0 2024-01-31T05:11:21.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.849+0000 7fb179678640 1 -- 172.21.15.99:0/2022619719 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb17419f270 con 0x7fb174100de0 2024-01-31T05:11:21.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.850+0000 7fb179678640 1 -- 172.21.15.99:0/2022619719 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb174107080 con 0x7fb174100de0 2024-01-31T05:11:21.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.851+0000 7fb15bfff640 1 -- 172.21.15.99:0/2022619719 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 135946+0+0 (secure 0 0 0) 0x7fb168005020 con 0x7fb174100de0 2024-01-31T05:11:21.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.851+0000 7fb15bfff640 1 --2- 172.21.15.99:0/2022619719 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb15c0a1370 0x7fb15c0a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:21.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.851+0000 7fb172ffd640 1 --2- 172.21.15.99:0/2022619719 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb15c0a1370 0x7fb15c0a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:21.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.851+0000 7fb15bfff640 1 -- 172.21.15.99:0/2022619719 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fb168014070 con 0x7fb174100de0 2024-01-31T05:11:21.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.852+0000 7fb172ffd640 1 --2- 172.21.15.99:0/2022619719 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb15c0a1370 0x7fb15c0a3830 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb164000c00 tx=0x7fb16402c5d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:21.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:21.856+0000 7fb15bfff640 1 -- 172.21.15.99:0/2022619719 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fb1680963d0 con 0x7fb174100de0 2024-01-31T05:11:22.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.026+0000 7fb179678640 1 -- 172.21.15.99:0/2022619719 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb17410b6f0 con 0x7fb174100de0 2024-01-31T05:11:22.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.027+0000 7fb15bfff640 1 -- 172.21.15.99:0/2022619719 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb1680999f0 con 0x7fb174100de0 2024-01-31T05:11:22.026 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-01-31T05:11:22.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.029+0000 7fb179678640 1 -- 172.21.15.99:0/2022619719 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb15c0a1370 msgr2=0x7fb15c0a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:22.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.029+0000 7fb179678640 1 --2- 172.21.15.99:0/2022619719 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb15c0a1370 0x7fb15c0a3830 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb164000c00 tx=0x7fb16402c5d0 comp rx=0 tx=0).stop 2024-01-31T05:11:22.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.029+0000 7fb179678640 1 -- 172.21.15.99:0/2022619719 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb174100de0 msgr2=0x7fb17419ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:22.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.029+0000 7fb179678640 1 --2- 172.21.15.99:0/2022619719 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb174100de0 0x7fb17419ba90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb16800e9f0 tx=0x7fb16800edf0 comp rx=0 tx=0).stop 2024-01-31T05:11:22.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.029+0000 7fb179678640 1 -- 172.21.15.99:0/2022619719 shutdown_connections 2024-01-31T05:11:22.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.029+0000 7fb179678640 1 --2- 172.21.15.99:0/2022619719 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb15c0a1370 0x7fb15c0a3830 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:22.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.029+0000 7fb179678640 1 --2- 172.21.15.99:0/2022619719 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1741017a0 0x7fb17419e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:22.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.029+0000 7fb179678640 1 --2- 172.21.15.99:0/2022619719 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb174100de0 0x7fb17419ba90 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:22.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.029+0000 7fb179678640 1 --2- 172.21.15.99:0/2022619719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1740ffbf0 0x7fb1740689c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:22.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.029+0000 7fb179678640 1 -- 172.21.15.99:0/2022619719 >> 172.21.15.99:0/2022619719 conn(0x7fb1740fb180 msgr2=0x7fb174104250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:22.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.029+0000 7fb179678640 1 -- 172.21.15.99:0/2022619719 shutdown_connections 2024-01-31T05:11:22.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.029+0000 7fb179678640 1 -- 172.21.15.99:0/2022619719 wait complete. 2024-01-31T05:11:22.038 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:21 smithi099 ceph-mon[31615]: pgmap v348: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-01-31T05:11:22.038 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:21 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/2668515646' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-01-31T05:11:22.038 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:21 smithi099 ceph-mon[31615]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:11:22.038 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:21 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/1425585249' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:11:22.038 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:21 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/3278349803' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-31T05:11:22.039 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-31T05:11:22.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:21 smithi181 ceph-mon[36434]: pgmap v348: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-01-31T05:11:22.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:21 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/2668515646' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-01-31T05:11:22.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:21 smithi181 ceph-mon[36434]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:11:22.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:21 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/1425585249' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:11:22.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:21 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/3278349803' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-31T05:11:22.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:21 smithi179 ceph-mon[35652]: pgmap v348: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-01-31T05:11:22.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:21 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/2668515646' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-01-31T05:11:22.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:21 smithi179 ceph-mon[35652]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:11:22.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:21 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/1425585249' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:11:22.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:21 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/3278349803' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-31T05:11:22.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.145+0000 7f1df9699640 1 -- 172.21.15.99:0/4157208581 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1df4108bd0 msgr2=0x7f1df410b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:22.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.145+0000 7f1df9699640 1 --2- 172.21.15.99:0/4157208581 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1df4108bd0 0x7f1df410b060 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1dec009900 tx=0x7f1dec02bcd0 comp rx=0 tx=0).stop 2024-01-31T05:11:22.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.145+0000 7f1df9699640 1 -- 172.21.15.99:0/4157208581 shutdown_connections 2024-01-31T05:11:22.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.145+0000 7f1df9699640 1 --2- 172.21.15.99:0/4157208581 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1df4108bd0 0x7f1df410b060 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:22.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.145+0000 7f1df9699640 1 --2- 172.21.15.99:0/4157208581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1df40736d0 0x7f1df4073b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:22.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.145+0000 7f1df9699640 1 --2- 172.21.15.99:0/4157208581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1df4074cb0 0x7f1df4073100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:22.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.145+0000 7f1df9699640 1 -- 172.21.15.99:0/4157208581 >> 172.21.15.99:0/4157208581 conn(0x7f1df40fc290 msgr2=0x7f1df40fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:22.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.145+0000 7f1df9699640 1 -- 172.21.15.99:0/4157208581 shutdown_connections 2024-01-31T05:11:22.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.145+0000 7f1df9699640 1 -- 172.21.15.99:0/4157208581 wait complete. 2024-01-31T05:11:22.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.146+0000 7f1df9699640 1 Processor -- start 2024-01-31T05:11:22.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.146+0000 7f1df9699640 1 -- start start 2024-01-31T05:11:22.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.146+0000 7f1df9699640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1df40736d0 0x7f1df4198ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:22.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.146+0000 7f1df9699640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1df4074cb0 0x7f1df4199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:22.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.146+0000 7f1df9699640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1df4108bd0 0x7f1df41a0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:22.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.146+0000 7f1df9699640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df41a09c0 con 0x7f1df4108bd0 2024-01-31T05:11:22.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.146+0000 7f1df9699640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df41a0b30 con 0x7f1df40736d0 2024-01-31T05:11:22.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.146+0000 7f1df9699640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df41a0cf0 con 0x7f1df4074cb0 2024-01-31T05:11:22.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.146+0000 7f1df37fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1df4108bd0 0x7f1df41a0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:22.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.146+0000 7f1df37fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1df4108bd0 0x7f1df41a0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34094/0 (socket says 172.21.15.99:34094) 2024-01-31T05:11:22.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.146+0000 7f1df37fe640 1 -- 172.21.15.99:0/2028045022 learned_addr learned my addr 172.21.15.99:0/2028045022 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:22.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.146+0000 7f1df27fc640 1 --2- 172.21.15.99:0/2028045022 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1df4074cb0 0x7f1df4199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:22.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.147+0000 7f1df2ffd640 1 --2- 172.21.15.99:0/2028045022 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1df40736d0 0x7f1df4198ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:22.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.147+0000 7f1df37fe640 1 -- 172.21.15.99:0/2028045022 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1df4074cb0 msgr2=0x7f1df4199410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:22.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.147+0000 7f1df37fe640 1 --2- 172.21.15.99:0/2028045022 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1df4074cb0 0x7f1df4199410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:22.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.147+0000 7f1df37fe640 1 -- 172.21.15.99:0/2028045022 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1df40736d0 msgr2=0x7f1df4198ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:22.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.147+0000 7f1df37fe640 1 --2- 172.21.15.99:0/2028045022 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1df40736d0 0x7f1df4198ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:22.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.147+0000 7f1df37fe640 1 -- 172.21.15.99:0/2028045022 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dec009560 con 0x7f1df4108bd0 2024-01-31T05:11:22.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.147+0000 7f1df37fe640 1 --2- 172.21.15.99:0/2028045022 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1df4108bd0 0x7f1df41a0480 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1dec02c880 tx=0x7f1dec0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:22.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.147+0000 7f1debfff640 1 -- 172.21.15.99:0/2028045022 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dec02dcc0 con 0x7f1df4108bd0 2024-01-31T05:11:22.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.147+0000 7f1debfff640 1 -- 172.21.15.99:0/2028045022 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1dec02de20 con 0x7f1df4108bd0 2024-01-31T05:11:22.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.147+0000 7f1debfff640 1 -- 172.21.15.99:0/2028045022 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dec003d70 con 0x7f1df4108bd0 2024-01-31T05:11:22.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.147+0000 7f1df9699640 1 -- 172.21.15.99:0/2028045022 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1df41a0f70 con 0x7f1df4108bd0 2024-01-31T05:11:22.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.147+0000 7f1df9699640 1 -- 172.21.15.99:0/2028045022 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1df41a13f0 con 0x7f1df4108bd0 2024-01-31T05:11:22.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.148+0000 7f1df9699640 1 -- 172.21.15.99:0/2028045022 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1df4107990 con 0x7f1df4108bd0 2024-01-31T05:11:22.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.149+0000 7f1debfff640 1 -- 172.21.15.99:0/2028045022 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f1dec005000 con 0x7f1df4108bd0 2024-01-31T05:11:22.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.149+0000 7f1debfff640 1 --2- 172.21.15.99:0/2028045022 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f1de00a1370 0x7f1de00a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:22.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.150+0000 7f1df2ffd640 1 --2- 172.21.15.99:0/2028045022 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f1de00a1370 0x7f1de00a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:22.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.150+0000 7f1debfff640 1 -- 172.21.15.99:0/2028045022 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f1dec0ef260 con 0x7f1df4108bd0 2024-01-31T05:11:22.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.150+0000 7f1df2ffd640 1 --2- 172.21.15.99:0/2028045022 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f1de00a1370 0x7f1de00a3830 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1de4005c40 tx=0x7f1de400a590 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:22.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.154+0000 7f1debfff640 1 -- 172.21.15.99:0/2028045022 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f1dec0b87b0 con 0x7f1df4108bd0 2024-01-31T05:11:22.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.329+0000 7f1df9699640 1 -- 172.21.15.99:0/2028045022 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1df402cad0 con 0x7f1df4108bd0 2024-01-31T05:11:22.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.330+0000 7f1debfff640 1 -- 172.21.15.99:0/2028045022 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1dec0430a0 con 0x7f1df4108bd0 2024-01-31T05:11:22.329 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 64 2024-01-31T05:11:22.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.332+0000 7f1df9699640 1 -- 172.21.15.99:0/2028045022 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f1de00a1370 msgr2=0x7f1de00a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:22.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.332+0000 7f1df9699640 1 --2- 172.21.15.99:0/2028045022 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f1de00a1370 0x7f1de00a3830 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1de4005c40 tx=0x7f1de400a590 comp rx=0 tx=0).stop 2024-01-31T05:11:22.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.332+0000 7f1df9699640 1 -- 172.21.15.99:0/2028045022 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1df4108bd0 msgr2=0x7f1df41a0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:22.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.332+0000 7f1df9699640 1 --2- 172.21.15.99:0/2028045022 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1df4108bd0 0x7f1df41a0480 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1dec02c880 tx=0x7f1dec0045e0 comp rx=0 tx=0).stop 2024-01-31T05:11:22.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.332+0000 7f1df9699640 1 -- 172.21.15.99:0/2028045022 shutdown_connections 2024-01-31T05:11:22.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.332+0000 7f1df9699640 1 --2- 172.21.15.99:0/2028045022 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f1de00a1370 0x7f1de00a3830 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:22.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.332+0000 7f1df9699640 1 --2- 172.21.15.99:0/2028045022 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1df4108bd0 0x7f1df41a0480 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:22.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.332+0000 7f1df9699640 1 --2- 172.21.15.99:0/2028045022 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1df4074cb0 0x7f1df4199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:22.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.332+0000 7f1df9699640 1 --2- 172.21.15.99:0/2028045022 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1df40736d0 0x7f1df4198ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:22.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.332+0000 7f1df9699640 1 -- 172.21.15.99:0/2028045022 >> 172.21.15.99:0/2028045022 conn(0x7f1df40fc290 msgr2=0x7f1df4104b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:22.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.332+0000 7f1df9699640 1 -- 172.21.15.99:0/2028045022 shutdown_connections 2024-01-31T05:11:22.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.332+0000 7f1df9699640 1 -- 172.21.15.99:0/2028045022 wait complete. 2024-01-31T05:11:22.342 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:11:22.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.444+0000 7ff4eb6c9640 1 -- 172.21.15.99:0/3234033503 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4e4100e80 msgr2=0x7ff4e4101300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:22.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.444+0000 7ff4eb6c9640 1 --2- 172.21.15.99:0/3234033503 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4e4100e80 0x7ff4e4101300 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0009900 tx=0x7ff4e002bc30 comp rx=0 tx=0).stop 2024-01-31T05:11:22.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.444+0000 7ff4eb6c9640 1 -- 172.21.15.99:0/3234033503 shutdown_connections 2024-01-31T05:11:22.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.444+0000 7ff4eb6c9640 1 --2- 172.21.15.99:0/3234033503 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff4e4101840 0x7ff4e41080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:22.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.444+0000 7ff4eb6c9640 1 --2- 172.21.15.99:0/3234033503 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4e4100e80 0x7ff4e4101300 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:22.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.444+0000 7ff4eb6c9640 1 --2- 172.21.15.99:0/3234033503 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4e40ffc90 0x7ff4e41000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:22.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.444+0000 7ff4eb6c9640 1 -- 172.21.15.99:0/3234033503 >> 172.21.15.99:0/3234033503 conn(0x7ff4e40fb220 msgr2=0x7ff4e40fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:22.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.444+0000 7ff4eb6c9640 1 -- 172.21.15.99:0/3234033503 shutdown_connections 2024-01-31T05:11:22.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.444+0000 7ff4eb6c9640 1 -- 172.21.15.99:0/3234033503 wait complete. 2024-01-31T05:11:22.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.444+0000 7ff4eb6c9640 1 Processor -- start 2024-01-31T05:11:22.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.444+0000 7ff4eb6c9640 1 -- start start 2024-01-31T05:11:22.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.445+0000 7ff4eb6c9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff4e40ffc90 0x7ff4e4196d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:22.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.445+0000 7ff4eb6c9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4e4100e80 0x7ff4e4197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:22.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.445+0000 7ff4eb6c9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4e4101840 0x7ff4e419e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:22.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.445+0000 7ff4eb6c9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e419e820 con 0x7ff4e4100e80 2024-01-31T05:11:22.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.445+0000 7ff4eb6c9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e419e990 con 0x7ff4e4101840 2024-01-31T05:11:22.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.445+0000 7ff4eb6c9640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e419eb50 con 0x7ff4e40ffc90 2024-01-31T05:11:22.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.445+0000 7ff4e8c64640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4e4100e80 0x7ff4e4197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:22.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.445+0000 7ff4e8c64640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4e4100e80 0x7ff4e4197280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34118/0 (socket says 172.21.15.99:34118) 2024-01-31T05:11:22.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.445+0000 7ff4e8c64640 1 -- 172.21.15.99:0/1481263632 learned_addr learned my addr 172.21.15.99:0/1481263632 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:22.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.445+0000 7ff4e9465640 1 --2- 172.21.15.99:0/1481263632 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff4e40ffc90 0x7ff4e4196d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:22.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.445+0000 7ff4e8c64640 1 -- 172.21.15.99:0/1481263632 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff4e40ffc90 msgr2=0x7ff4e4196d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:22.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.445+0000 7ff4e8c64640 1 --2- 172.21.15.99:0/1481263632 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff4e40ffc90 0x7ff4e4196d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:22.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.445+0000 7ff4e9c66640 1 --2- 172.21.15.99:0/1481263632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4e4101840 0x7ff4e419e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:22.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.445+0000 7ff4e8c64640 1 -- 172.21.15.99:0/1481263632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4e4101840 msgr2=0x7ff4e419e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:22.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.445+0000 7ff4e8c64640 1 --2- 172.21.15.99:0/1481263632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4e4101840 0x7ff4e419e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:22.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.445+0000 7ff4e8c64640 1 -- 172.21.15.99:0/1481263632 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e0009560 con 0x7ff4e4100e80 2024-01-31T05:11:22.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.445+0000 7ff4e9c66640 1 --2- 172.21.15.99:0/1481263632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4e4101840 0x7ff4e419e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:11:22.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.445+0000 7ff4e8c64640 1 --2- 172.21.15.99:0/1481263632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4e4100e80 0x7ff4e4197280 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0009230 tx=0x7ff4e0004ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:22.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.445+0000 7ff4d67fc640 1 -- 172.21.15.99:0/1481263632 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e00043d0 con 0x7ff4e4100e80 2024-01-31T05:11:22.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.445+0000 7ff4d67fc640 1 -- 172.21.15.99:0/1481263632 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff4e00054c0 con 0x7ff4e4100e80 2024-01-31T05:11:22.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.445+0000 7ff4eb6c9640 1 -- 172.21.15.99:0/1481263632 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4e419edd0 con 0x7ff4e4100e80 2024-01-31T05:11:22.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.445+0000 7ff4d67fc640 1 -- 172.21.15.99:0/1481263632 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e003e450 con 0x7ff4e4100e80 2024-01-31T05:11:22.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.446+0000 7ff4eb6c9640 1 -- 172.21.15.99:0/1481263632 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4e419f220 con 0x7ff4e4100e80 2024-01-31T05:11:22.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.447+0000 7ff4eb6c9640 1 -- 172.21.15.99:0/1481263632 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4e410b4c0 con 0x7ff4e4100e80 2024-01-31T05:11:22.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.448+0000 7ff4d67fc640 1 -- 172.21.15.99:0/1481263632 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 135946+0+0 (secure 0 0 0) 0x7ff4e00035f0 con 0x7ff4e4100e80 2024-01-31T05:11:22.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.448+0000 7ff4d67fc640 1 --2- 172.21.15.99:0/1481263632 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff4d00a1370 0x7ff4d00a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:22.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.448+0000 7ff4e9465640 1 --2- 172.21.15.99:0/1481263632 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff4d00a1370 0x7ff4d00a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:22.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.448+0000 7ff4d67fc640 1 -- 172.21.15.99:0/1481263632 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7ff4e00ef600 con 0x7ff4e4100e80 2024-01-31T05:11:22.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.449+0000 7ff4e9465640 1 --2- 172.21.15.99:0/1481263632 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff4d00a1370 0x7ff4d00a3830 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff4d8005fd0 tx=0x7ff4d8005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:22.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.453+0000 7ff4d67fc640 1 -- 172.21.15.99:0/1481263632 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7ff4e00b8ac0 con 0x7ff4e4100e80 2024-01-31T05:11:22.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.625+0000 7ff4eb6c9640 1 -- 172.21.15.99:0/1481263632 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4e410b680 con 0x7ff4e4100e80 2024-01-31T05:11:22.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.626+0000 7ff4d67fc640 1 -- 172.21.15.99:0/1481263632 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22426 (secure 0 0 0) 0x7ff4e00ba9f0 con 0x7ff4e4100e80 2024-01-31T05:11:22.626 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:11:22.626 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":88,"fsid":"9288ff44-bff5-11ee-95b3-87774f69a715","created":"2024-01-31T05:01:26.130917+0000","modified":"2024-01-31T05:10:21.675877+0000","last_up_change":"2024-01-31T05:08:31.228478+0000","last_in_change":"2024-01-31T05:08:10.799511+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:46.842423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:09:18.693558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-31T05:09:19.734003+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b45878d9-28f1-4821-ba72-26a32d3fc780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6803","nonce":1213805280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6805","nonce":1213805280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6809","nonce":1213805280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6807","nonce":1213805280}]},"public_addr":"172.21.15.99:6803/1213805280","cluster_addr":"172.21.15.99:6805/1213805280","heartbeat_back_addr":"172.21.15.99:6809/1213805280","heartbeat_front_addr":"172.21.15.99:6807/1213805280","state":["exists","up"]},{"osd":1,"uuid":"e0b71ff3-5d97-4659-8dea-4c9091e1beb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6801","nonce":2019451677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6803","nonce":2019451677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6807","nonce":2019451677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6805","nonce":2019451677}]},"public_addr":"172.21.15.179:6801/2019451677","cluster_addr":"172.21.15.179:6803/2019451677","heartbeat_back_addr":"172.21.15.179:6807/2019451677","heartbeat_front_addr":"172.21.15.179:6805/2019451677","state":["exists","up"]},{"osd":2,"uuid":"11c919c8-19a9-48b0-8880-3002efcb64f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6801","nonce":3934284457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6803","nonce":3934284457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6807","nonce":3934284457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6805","nonce":3934284457}]},"public_addr":"172.21.15.181:6801/3934284457","cluster_addr":"172.21.15.181:6803/3934284457","heartbeat_back_addr":"172.21.15.181:6807/3934284457","heartbeat_front_addr":"172.21.15.181:6805/3934284457","state":["exists","up"]},{"osd":3,"uuid":"bcab5135-a5d1-45ae-a9b8-674425d3999e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6811","nonce":4207675427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6813","nonce":4207675427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6817","nonce":4207675427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6815","nonce":4207675427}]},"public_addr":"172.21.15.99:6811/4207675427","cluster_addr":"172.21.15.99:6813/4207675427","heartbeat_back_addr":"172.21.15.99:6817/4207675427","heartbeat_front_addr":"172.21.15.99:6815/4207675427","state":["exists","up"]},{"osd":4,"uuid":"0250d7ac-3894-457a-9c04-cc7205d61eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6809","nonce":2861083896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6811","nonce":2861083896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6815","nonce":2861083896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6813","nonce":2861083896}]},"public_addr":"172.21.15.179:6809/2861083896","cluster_addr":"172.21.15.179:6811/2861083896","heartbeat_back_addr":"172.21.15.179:6815/2861083896","heartbeat_front_addr":"172.21.15.179:6813/2861083896","state":["exists","up"]},{"osd":5,"uuid":"5e19222a-c2a4-45bc-8445-1d302f26d11c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6809","nonce":1485017095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6811","nonce":1485017095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6815","nonce":1485017095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6813","nonce":1485017095}]},"public_addr":"172.21.15.181:6809/1485017095","cluster_addr":"172.21.15.181:6811/1485017095","heartbeat_back_addr":"172.21.15.181:6815/1485017095","heartbeat_front_addr":"172.21.15.181:6813/1485017095","state":["exists","up"]},{"osd":6,"uuid":"56555035-f9fc-4e91-96dd-caa632d58adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6819","nonce":1534047839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6821","nonce":1534047839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6825","nonce":1534047839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6823","nonce":1534047839}]},"public_addr":"172.21.15.99:6819/1534047839","cluster_addr":"172.21.15.99:6821/1534047839","heartbeat_back_addr":"172.21.15.99:6825/1534047839","heartbeat_front_addr":"172.21.15.99:6823/1534047839","state":["exists","up"]},{"osd":7,"uuid":"5e079cf5-1340-4599-88a6-df410ef0148e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6817","nonce":3875950553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6819","nonce":3875950553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6823","nonce":3875950553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6821","nonce":3875950553}]},"public_addr":"172.21.15.179:6817/3875950553","cluster_addr":"172.21.15.179:6819/3875950553","heartbeat_back_addr":"172.21.15.179:6823/3875950553","heartbeat_front_addr":"172.21.15.179:6821/3875950553","state":["exists","up"]},{"osd":8,"uuid":"10a73592-4251-4492-b67d-ce9b9d7fff32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6817","nonce":179568936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6819","nonce":179568936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6823","nonce":179568936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6821","nonce":179568936}]},"public_addr":"172.21.15.181:6817/179568936","cluster_addr":"172.21.15.181:6819/179568936","heartbeat_back_addr":"172.21.15.181:6823/179568936","heartbeat_front_addr":"172.21.15.181:6821/179568936","state":["exists","up"]},{"osd":9,"uuid":"f6620e1e-f761-4f1c-917f-cbc748df32a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6827","nonce":315759515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6829","nonce":315759515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6833","nonce":315759515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6831","nonce":315759515}]},"public_addr":"172.21.15.99:6827/315759515","cluster_addr":"172.21.15.99:6829/315759515","heartbeat_back_addr":"172.21.15.99:6833/315759515","heartbeat_front_addr":"172.21.15.99:6831/315759515","state":["exists","up"]},{"osd":10,"uuid":"ee86af7d-66f8-4795-bcc3-dfec79e4680c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6825","nonce":2985063934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6827","nonce":2985063934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6831","nonce":2985063934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6829","nonce":2985063934}]},"public_addr":"172.21.15.179:6825/2985063934","cluster_addr":"172.21.15.179:6827/2985063934","heartbeat_back_addr":"172.21.15.179:6831/2985063934","heartbeat_front_addr":"172.21.15.179:6829/2985063934","state":["exists","up"]},{"osd":11,"uuid":"82f04fee-f6ae-4630-a75b-b12a9c4ab2e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6825","nonce":1858219600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6827","nonce":1858219600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6831","nonce":1858219600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6829","nonce":1858219600}]},"public_addr":"172.21.15.181:6825/1858219600","cluster_addr":"172.21.15.181:6827/1858219600","heartbeat_back_addr":"172.21.15.181:6831/1858219600","heartbeat_front_addr":"172.21.15.181:6829/1858219600","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:55.518970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:04:19.936339+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:04:44.064814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:09.331683+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:34.616774+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:58.881810+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:06:23.869838+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:06:49.127331+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:07:12.847187+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:07:38.231045+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:08:03.949162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:08:28.471802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:0/401101729":"2024-02-01T05:02:20.510858+0000","172.21.15.99:6801/1993198206":"2024-02-01T05:02:20.510858+0000","172.21.15.99:0/3819754569":"2024-02-01T05:02:20.510858+0000","172.21.15.99:0/475390265":"2024-02-01T05:01:53.732026+0000","172.21.15.99:6800/1993198206":"2024-02-01T05:02:20.510858+0000","172.21.15.99:6800/1706888338":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/4150146075":"2024-02-01T05:01:53.732026+0000","172.21.15.99:6801/1706888338":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/2851066598":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/1865156424":"2024-02-01T05:02:20.510858+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:11:22.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.628+0000 7ff4eb6c9640 1 -- 172.21.15.99:0/1481263632 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff4d00a1370 msgr2=0x7ff4d00a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:22.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.628+0000 7ff4eb6c9640 1 --2- 172.21.15.99:0/1481263632 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff4d00a1370 0x7ff4d00a3830 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff4d8005fd0 tx=0x7ff4d8005850 comp rx=0 tx=0).stop 2024-01-31T05:11:22.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.628+0000 7ff4eb6c9640 1 -- 172.21.15.99:0/1481263632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4e4100e80 msgr2=0x7ff4e4197280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:22.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.628+0000 7ff4eb6c9640 1 --2- 172.21.15.99:0/1481263632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4e4100e80 0x7ff4e4197280 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0009230 tx=0x7ff4e0004ee0 comp rx=0 tx=0).stop 2024-01-31T05:11:22.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.628+0000 7ff4eb6c9640 1 -- 172.21.15.99:0/1481263632 shutdown_connections 2024-01-31T05:11:22.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.628+0000 7ff4eb6c9640 1 --2- 172.21.15.99:0/1481263632 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff4d00a1370 0x7ff4d00a3830 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:22.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.628+0000 7ff4eb6c9640 1 --2- 172.21.15.99:0/1481263632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4e4101840 0x7ff4e419e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:22.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.628+0000 7ff4eb6c9640 1 --2- 172.21.15.99:0/1481263632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4e4100e80 0x7ff4e4197280 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:22.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.628+0000 7ff4eb6c9640 1 --2- 172.21.15.99:0/1481263632 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff4e40ffc90 0x7ff4e4196d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:22.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.628+0000 7ff4eb6c9640 1 -- 172.21.15.99:0/1481263632 >> 172.21.15.99:0/1481263632 conn(0x7ff4e40fb220 msgr2=0x7ff4e40fcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:22.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.628+0000 7ff4eb6c9640 1 -- 172.21.15.99:0/1481263632 shutdown_connections 2024-01-31T05:11:22.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.628+0000 7ff4eb6c9640 1 -- 172.21.15.99:0/1481263632 wait complete. 2024-01-31T05:11:22.639 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-31T05:04:46.842423+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-31T05:09:18.693558+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-31T05:09:19.734003+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-31T05:11:22.639 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-31T05:11:22.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.744+0000 7fdf1aa60640 1 -- 172.21.15.99:0/2511586512 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf141028d0 msgr2=0x7fdf14109160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:22.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.744+0000 7fdf1aa60640 1 --2- 172.21.15.99:0/2511586512 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf141028d0 0x7fdf14109160 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c009ca0 tx=0x7fdf0c02c0f0 comp rx=0 tx=0).stop 2024-01-31T05:11:22.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.744+0000 7fdf1aa60640 1 -- 172.21.15.99:0/2511586512 shutdown_connections 2024-01-31T05:11:22.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.744+0000 7fdf1aa60640 1 --2- 172.21.15.99:0/2511586512 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf141028d0 0x7fdf14109160 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:22.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.744+0000 7fdf1aa60640 1 --2- 172.21.15.99:0/2511586512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf14101f10 0x7fdf14102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:22.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.744+0000 7fdf1aa60640 1 --2- 172.21.15.99:0/2511586512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf14100d20 0x7fdf14101140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:22.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.745+0000 7fdf1aa60640 1 -- 172.21.15.99:0/2511586512 >> 172.21.15.99:0/2511586512 conn(0x7fdf140fc290 msgr2=0x7fdf140fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:22.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.745+0000 7fdf1aa60640 1 -- 172.21.15.99:0/2511586512 shutdown_connections 2024-01-31T05:11:22.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.745+0000 7fdf1aa60640 1 -- 172.21.15.99:0/2511586512 wait complete. 2024-01-31T05:11:22.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.745+0000 7fdf1aa60640 1 Processor -- start 2024-01-31T05:11:22.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.745+0000 7fdf1aa60640 1 -- start start 2024-01-31T05:11:22.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.745+0000 7fdf1aa60640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf14100d20 0x7fdf14196d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:22.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.745+0000 7fdf1aa60640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf14101f10 0x7fdf14197260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:22.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.745+0000 7fdf1aa60640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf141028d0 0x7fdf1419e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:22.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.745+0000 7fdf1aa60640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1419e800 con 0x7fdf14100d20 2024-01-31T05:11:22.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.745+0000 7fdf1aa60640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1419e970 con 0x7fdf14101f10 2024-01-31T05:11:22.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.745+0000 7fdf1aa60640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1419eb30 con 0x7fdf141028d0 2024-01-31T05:11:22.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.745+0000 7fdf13fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf14100d20 0x7fdf14196d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:22.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.746+0000 7fdf13fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf14100d20 0x7fdf14196d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34144/0 (socket says 172.21.15.99:34144) 2024-01-31T05:11:22.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.746+0000 7fdf13fff640 1 -- 172.21.15.99:0/975755427 learned_addr learned my addr 172.21.15.99:0/975755427 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:22.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.746+0000 7fdf18ffd640 1 --2- 172.21.15.99:0/975755427 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf141028d0 0x7fdf1419e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:22.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.746+0000 7fdf137fe640 1 --2- 172.21.15.99:0/975755427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf14101f10 0x7fdf14197260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:22.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.746+0000 7fdf13fff640 1 -- 172.21.15.99:0/975755427 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf141028d0 msgr2=0x7fdf1419e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:22.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.746+0000 7fdf13fff640 1 --2- 172.21.15.99:0/975755427 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf141028d0 0x7fdf1419e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:22.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.746+0000 7fdf13fff640 1 -- 172.21.15.99:0/975755427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf14101f10 msgr2=0x7fdf14197260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:22.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.746+0000 7fdf13fff640 1 --2- 172.21.15.99:0/975755427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf14101f10 0x7fdf14197260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:22.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.746+0000 7fdf13fff640 1 -- 172.21.15.99:0/975755427 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0c009900 con 0x7fdf14100d20 2024-01-31T05:11:22.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.746+0000 7fdf137fe640 1 --2- 172.21.15.99:0/975755427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf14101f10 0x7fdf14197260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:11:22.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.746+0000 7fdf13fff640 1 --2- 172.21.15.99:0/975755427 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf14100d20 0x7fdf14196d20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fdf0400b450 tx=0x7fdf0400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:22.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.746+0000 7fdf117fa640 1 -- 172.21.15.99:0/975755427 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf04011890 con 0x7fdf14100d20 2024-01-31T05:11:22.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.746+0000 7fdf117fa640 1 -- 172.21.15.99:0/975755427 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf040103e0 con 0x7fdf14100d20 2024-01-31T05:11:22.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.746+0000 7fdf1aa60640 1 -- 172.21.15.99:0/975755427 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf1419ee10 con 0x7fdf14100d20 2024-01-31T05:11:22.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.746+0000 7fdf117fa640 1 -- 172.21.15.99:0/975755427 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0400f5a0 con 0x7fdf14100d20 2024-01-31T05:11:22.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.746+0000 7fdf1aa60640 1 -- 172.21.15.99:0/975755427 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf1419f2b0 con 0x7fdf14100d20 2024-01-31T05:11:22.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.747+0000 7fdf1aa60640 1 -- 172.21.15.99:0/975755427 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf14108090 con 0x7fdf14100d20 2024-01-31T05:11:22.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.748+0000 7fdf117fa640 1 -- 172.21.15.99:0/975755427 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 135946+0+0 (secure 0 0 0) 0x7fdf04010850 con 0x7fdf14100d20 2024-01-31T05:11:22.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.749+0000 7fdf117fa640 1 --2- 172.21.15.99:0/975755427 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fdefc0a1370 0x7fdefc0a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:22.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.749+0000 7fdf137fe640 1 --2- 172.21.15.99:0/975755427 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fdefc0a1370 0x7fdefc0a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:22.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.749+0000 7fdf117fa640 1 -- 172.21.15.99:0/975755427 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fdf040cc850 con 0x7fdf14100d20 2024-01-31T05:11:22.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.749+0000 7fdf137fe640 1 --2- 172.21.15.99:0/975755427 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fdefc0a1370 0x7fdefc0a3830 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fdf080058c0 tx=0x7fdf08005ec0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:22.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.753+0000 7fdf117fa640 1 -- 172.21.15.99:0/975755427 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fdf04095d10 con 0x7fdf14100d20 2024-01-31T05:11:22.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.925+0000 7fdf1aa60640 1 -- 172.21.15.99:0/975755427 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdf1410c8a0 con 0x7fdf14100d20 2024-01-31T05:11:22.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.925+0000 7fdf117fa640 1 -- 172.21.15.99:0/975755427 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdf04097c40 con 0x7fdf14100d20 2024-01-31T05:11:22.924 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-01-31T05:11:22.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.927+0000 7fdf1aa60640 1 -- 172.21.15.99:0/975755427 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fdefc0a1370 msgr2=0x7fdefc0a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:22.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.927+0000 7fdf1aa60640 1 --2- 172.21.15.99:0/975755427 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fdefc0a1370 0x7fdefc0a3830 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fdf080058c0 tx=0x7fdf08005ec0 comp rx=0 tx=0).stop 2024-01-31T05:11:22.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.927+0000 7fdf1aa60640 1 -- 172.21.15.99:0/975755427 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf14100d20 msgr2=0x7fdf14196d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:22.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.927+0000 7fdf1aa60640 1 --2- 172.21.15.99:0/975755427 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf14100d20 0x7fdf14196d20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fdf0400b450 tx=0x7fdf0400b910 comp rx=0 tx=0).stop 2024-01-31T05:11:22.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.927+0000 7fdf1aa60640 1 -- 172.21.15.99:0/975755427 shutdown_connections 2024-01-31T05:11:22.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.927+0000 7fdf1aa60640 1 --2- 172.21.15.99:0/975755427 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fdefc0a1370 0x7fdefc0a3830 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:22.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.927+0000 7fdf1aa60640 1 --2- 172.21.15.99:0/975755427 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdf141028d0 0x7fdf1419e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:22.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.927+0000 7fdf1aa60640 1 --2- 172.21.15.99:0/975755427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf14101f10 0x7fdf14197260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:22.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.927+0000 7fdf1aa60640 1 --2- 172.21.15.99:0/975755427 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf14100d20 0x7fdf14196d20 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:22.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.927+0000 7fdf1aa60640 1 -- 172.21.15.99:0/975755427 >> 172.21.15.99:0/975755427 conn(0x7fdf140fc290 msgr2=0x7fdf14105260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:22.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.927+0000 7fdf1aa60640 1 -- 172.21.15.99:0/975755427 shutdown_connections 2024-01-31T05:11:22.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:22.927+0000 7fdf1aa60640 1 -- 172.21.15.99:0/975755427 wait complete. 2024-01-31T05:11:22.937 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:22 smithi099 ceph-mon[31615]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:11:22.937 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:22 smithi099 ceph-mon[31615]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-01-31T05:11:22.937 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:22 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/2022619719' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-31T05:11:22.937 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:22 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/2028045022' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-31T05:11:22.937 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:22 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/1481263632' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:11:22.938 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-31T05:11:23.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.043+0000 7fa8ddf24640 1 -- 172.21.15.99:0/66895046 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8d80fed60 msgr2=0x7fa8d80ff1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:23.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.043+0000 7fa8ddf24640 1 --2- 172.21.15.99:0/66895046 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8d80fed60 0x7fa8d80ff1e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc009900 tx=0x7fa8cc02bc30 comp rx=0 tx=0).stop 2024-01-31T05:11:23.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.043+0000 7fa8ddf24640 1 -- 172.21.15.99:0/66895046 shutdown_connections 2024-01-31T05:11:23.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.043+0000 7fa8ddf24640 1 --2- 172.21.15.99:0/66895046 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8d80ff720 0x7fa8d81092d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:23.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.043+0000 7fa8ddf24640 1 --2- 172.21.15.99:0/66895046 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8d80fed60 0x7fa8d80ff1e0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:23.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.043+0000 7fa8ddf24640 1 --2- 172.21.15.99:0/66895046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8d81022f0 0x7fa8d8102710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:23.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.043+0000 7fa8ddf24640 1 -- 172.21.15.99:0/66895046 >> 172.21.15.99:0/66895046 conn(0x7fa8d80fa900 msgr2=0x7fa8d80fcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:23.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.043+0000 7fa8ddf24640 1 -- 172.21.15.99:0/66895046 shutdown_connections 2024-01-31T05:11:23.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.043+0000 7fa8ddf24640 1 -- 172.21.15.99:0/66895046 wait complete. 2024-01-31T05:11:23.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.044+0000 7fa8ddf24640 1 Processor -- start 2024-01-31T05:11:23.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.044+0000 7fa8ddf24640 1 -- start start 2024-01-31T05:11:23.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.044+0000 7fa8ddf24640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8d80fed60 0x7fa8d8198ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:23.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.044+0000 7fa8ddf24640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8d80ff720 0x7fa8d8199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:23.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.044+0000 7fa8ddf24640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8d81022f0 0x7fa8d81a04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:23.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.044+0000 7fa8ddf24640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d81a09e0 con 0x7fa8d80ff720 2024-01-31T05:11:23.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.044+0000 7fa8ddf24640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d81a0b50 con 0x7fa8d80fed60 2024-01-31T05:11:23.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.044+0000 7fa8ddf24640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d81a0d10 con 0x7fa8d81022f0 2024-01-31T05:11:23.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.044+0000 7fa8d6ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8d80ff720 0x7fa8d8199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:23.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.044+0000 7fa8d6ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8d80ff720 0x7fa8d8199430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34168/0 (socket says 172.21.15.99:34168) 2024-01-31T05:11:23.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.044+0000 7fa8d6ffd640 1 -- 172.21.15.99:0/2593316417 learned_addr learned my addr 172.21.15.99:0/2593316417 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:23.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.044+0000 7fa8d7fff640 1 --2- 172.21.15.99:0/2593316417 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8d81022f0 0x7fa8d81a04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:23.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.044+0000 7fa8d77fe640 1 --2- 172.21.15.99:0/2593316417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8d80fed60 0x7fa8d8198ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:23.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.044+0000 7fa8d6ffd640 1 -- 172.21.15.99:0/2593316417 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8d81022f0 msgr2=0x7fa8d81a04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:23.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.045+0000 7fa8d6ffd640 1 --2- 172.21.15.99:0/2593316417 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8d81022f0 0x7fa8d81a04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:23.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.045+0000 7fa8d6ffd640 1 -- 172.21.15.99:0/2593316417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8d80fed60 msgr2=0x7fa8d8198ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:23.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.045+0000 7fa8d6ffd640 1 --2- 172.21.15.99:0/2593316417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8d80fed60 0x7fa8d8198ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:23.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.045+0000 7fa8d6ffd640 1 -- 172.21.15.99:0/2593316417 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8cc009560 con 0x7fa8d80ff720 2024-01-31T05:11:23.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.045+0000 7fa8d77fe640 1 --2- 172.21.15.99:0/2593316417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8d80fed60 0x7fa8d8198ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:11:23.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.045+0000 7fa8d6ffd640 1 --2- 172.21.15.99:0/2593316417 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8d80ff720 0x7fa8d8199430 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc02c610 tx=0x7fa8cc004ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:23.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.045+0000 7fa8d4ff9640 1 -- 172.21.15.99:0/2593316417 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc004350 con 0x7fa8d80ff720 2024-01-31T05:11:23.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.045+0000 7fa8d4ff9640 1 -- 172.21.15.99:0/2593316417 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa8cc0044b0 con 0x7fa8d80ff720 2024-01-31T05:11:23.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.045+0000 7fa8ddf24640 1 -- 172.21.15.99:0/2593316417 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8d81a0f90 con 0x7fa8d80ff720 2024-01-31T05:11:23.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.045+0000 7fa8d4ff9640 1 -- 172.21.15.99:0/2593316417 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc03e450 con 0x7fa8d80ff720 2024-01-31T05:11:23.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.045+0000 7fa8ddf24640 1 -- 172.21.15.99:0/2593316417 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d81a1410 con 0x7fa8d80ff720 2024-01-31T05:11:23.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.046+0000 7fa8ddf24640 1 -- 172.21.15.99:0/2593316417 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8d810c5e0 con 0x7fa8d80ff720 2024-01-31T05:11:23.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.047+0000 7fa8d4ff9640 1 -- 172.21.15.99:0/2593316417 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 135946+0+0 (secure 0 0 0) 0x7fa8cc0035f0 con 0x7fa8d80ff720 2024-01-31T05:11:23.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.047+0000 7fa8d4ff9640 1 --2- 172.21.15.99:0/2593316417 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa8c00a1370 0x7fa8c00a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:23.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.047+0000 7fa8d4ff9640 1 -- 172.21.15.99:0/2593316417 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fa8cc0ef470 con 0x7fa8d80ff720 2024-01-31T05:11:23.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.047+0000 7fa8d77fe640 1 --2- 172.21.15.99:0/2593316417 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa8c00a1370 0x7fa8c00a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:23.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.048+0000 7fa8d77fe640 1 --2- 172.21.15.99:0/2593316417 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa8c00a1370 0x7fa8c00a3830 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa8d8069000 tx=0x7fa8c8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:23.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.052+0000 7fa8d4ff9640 1 -- 172.21.15.99:0/2593316417 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fa8cc0b89c0 con 0x7fa8d80ff720 2024-01-31T05:11:23.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:22 smithi181 ceph-mon[36434]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:11:23.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:22 smithi181 ceph-mon[36434]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-01-31T05:11:23.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:22 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/2022619719' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-31T05:11:23.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:22 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/2028045022' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-31T05:11:23.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:22 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/1481263632' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:11:23.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:22 smithi179 ceph-mon[35652]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-01-31T05:11:23.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:22 smithi179 ceph-mon[35652]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-01-31T05:11:23.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:22 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/2022619719' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-31T05:11:23.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:22 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/2028045022' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-31T05:11:23.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:22 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/1481263632' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:11:23.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.222+0000 7fa8ddf24640 1 -- 172.21.15.99:0/2593316417 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa8d81a1640 con 0x7fa8d80ff720 2024-01-31T05:11:23.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.223+0000 7fa8d4ff9640 1 -- 172.21.15.99:0/2593316417 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa8cc0bbfe0 con 0x7fa8d80ff720 2024-01-31T05:11:23.222 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-01-31T05:11:23.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.225+0000 7fa8ddf24640 1 -- 172.21.15.99:0/2593316417 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa8c00a1370 msgr2=0x7fa8c00a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:23.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.225+0000 7fa8ddf24640 1 --2- 172.21.15.99:0/2593316417 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa8c00a1370 0x7fa8c00a3830 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa8d8069000 tx=0x7fa8c8005f90 comp rx=0 tx=0).stop 2024-01-31T05:11:23.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.225+0000 7fa8ddf24640 1 -- 172.21.15.99:0/2593316417 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8d80ff720 msgr2=0x7fa8d8199430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:23.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.225+0000 7fa8ddf24640 1 --2- 172.21.15.99:0/2593316417 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8d80ff720 0x7fa8d8199430 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc02c610 tx=0x7fa8cc004ec0 comp rx=0 tx=0).stop 2024-01-31T05:11:23.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.225+0000 7fa8ddf24640 1 -- 172.21.15.99:0/2593316417 shutdown_connections 2024-01-31T05:11:23.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.225+0000 7fa8ddf24640 1 --2- 172.21.15.99:0/2593316417 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa8c00a1370 0x7fa8c00a3830 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:23.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.225+0000 7fa8ddf24640 1 --2- 172.21.15.99:0/2593316417 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8d81022f0 0x7fa8d81a04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:23.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.225+0000 7fa8ddf24640 1 --2- 172.21.15.99:0/2593316417 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8d80ff720 0x7fa8d8199430 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:23.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.225+0000 7fa8ddf24640 1 --2- 172.21.15.99:0/2593316417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8d80fed60 0x7fa8d8198ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:23.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.225+0000 7fa8ddf24640 1 -- 172.21.15.99:0/2593316417 >> 172.21.15.99:0/2593316417 conn(0x7fa8d80fa900 msgr2=0x7fa8d80ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:23.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.225+0000 7fa8ddf24640 1 -- 172.21.15.99:0/2593316417 shutdown_connections 2024-01-31T05:11:23.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.225+0000 7fa8ddf24640 1 -- 172.21.15.99:0/2593316417 wait complete. 2024-01-31T05:11:23.235 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-31T05:11:23.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.341+0000 7f1449c3e640 1 -- 172.21.15.99:0/3541032569 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14440ffbf0 msgr2=0x7f1444100010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:23.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.341+0000 7f1449c3e640 1 --2- 172.21.15.99:0/3541032569 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14440ffbf0 0x7f1444100010 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f1434009900 tx=0x7f143402bc30 comp rx=0 tx=0).stop 2024-01-31T05:11:23.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.341+0000 7f1449c3e640 1 -- 172.21.15.99:0/3541032569 shutdown_connections 2024-01-31T05:11:23.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.341+0000 7f1449c3e640 1 --2- 172.21.15.99:0/3541032569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14441017a0 0x7f1444108030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:23.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.341+0000 7f1449c3e640 1 --2- 172.21.15.99:0/3541032569 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1444100de0 0x7f1444101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:23.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.341+0000 7f1449c3e640 1 --2- 172.21.15.99:0/3541032569 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14440ffbf0 0x7f1444100010 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:23.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.341+0000 7f1449c3e640 1 -- 172.21.15.99:0/3541032569 >> 172.21.15.99:0/3541032569 conn(0x7f14440fb180 msgr2=0x7f14440fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:23.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.341+0000 7f1449c3e640 1 -- 172.21.15.99:0/3541032569 shutdown_connections 2024-01-31T05:11:23.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.341+0000 7f1449c3e640 1 -- 172.21.15.99:0/3541032569 wait complete. 2024-01-31T05:11:23.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.342+0000 7f1449c3e640 1 Processor -- start 2024-01-31T05:11:23.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.342+0000 7f1449c3e640 1 -- start start 2024-01-31T05:11:23.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.342+0000 7f1449c3e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14440ffbf0 0x7f1444196d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:23.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.342+0000 7f1449c3e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1444100de0 0x7f1444197290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:23.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.342+0000 7f1449c3e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14441017a0 0x7f144419e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:23.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.342+0000 7f1449c3e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144419e830 con 0x7f14441017a0 2024-01-31T05:11:23.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.342+0000 7f1449c3e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144419e9a0 con 0x7f14440ffbf0 2024-01-31T05:11:23.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.342+0000 7f1449c3e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144419eb60 con 0x7f1444100de0 2024-01-31T05:11:23.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.342+0000 7f1443fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14441017a0 0x7f144419e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:23.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.342+0000 7f1443fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14441017a0 0x7f144419e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34180/0 (socket says 172.21.15.99:34180) 2024-01-31T05:11:23.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.342+0000 7f1443fff640 1 -- 172.21.15.99:0/4060231626 learned_addr learned my addr 172.21.15.99:0/4060231626 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:23.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.343+0000 7f14437fe640 1 --2- 172.21.15.99:0/4060231626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14440ffbf0 0x7f1444196d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:23.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.343+0000 7f143affd640 1 --2- 172.21.15.99:0/4060231626 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1444100de0 0x7f1444197290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:23.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.343+0000 7f1443fff640 1 -- 172.21.15.99:0/4060231626 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1444100de0 msgr2=0x7f1444197290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:23.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.343+0000 7f1443fff640 1 --2- 172.21.15.99:0/4060231626 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1444100de0 0x7f1444197290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:23.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.343+0000 7f1443fff640 1 -- 172.21.15.99:0/4060231626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14440ffbf0 msgr2=0x7f1444196d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:23.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.343+0000 7f1443fff640 1 --2- 172.21.15.99:0/4060231626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14440ffbf0 0x7f1444196d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:23.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.343+0000 7f1443fff640 1 -- 172.21.15.99:0/4060231626 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1434009560 con 0x7f14441017a0 2024-01-31T05:11:23.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.343+0000 7f14437fe640 1 --2- 172.21.15.99:0/4060231626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14440ffbf0 0x7f1444196d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:11:23.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.343+0000 7f1443fff640 1 --2- 172.21.15.99:0/4060231626 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14441017a0 0x7f144419e2c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f143c00cad0 tx=0x7f143c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:23.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.343+0000 7f14417fa640 1 -- 172.21.15.99:0/4060231626 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143c00ae20 con 0x7f14441017a0 2024-01-31T05:11:23.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.343+0000 7f14417fa640 1 -- 172.21.15.99:0/4060231626 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f143c005020 con 0x7f14441017a0 2024-01-31T05:11:23.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.343+0000 7f1449c3e640 1 -- 172.21.15.99:0/4060231626 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f144419ee40 con 0x7f14441017a0 2024-01-31T05:11:23.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.343+0000 7f14417fa640 1 -- 172.21.15.99:0/4060231626 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143c00f6b0 con 0x7f14441017a0 2024-01-31T05:11:23.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.343+0000 7f1449c3e640 1 -- 172.21.15.99:0/4060231626 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f144419f260 con 0x7f14441017a0 2024-01-31T05:11:23.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.344+0000 7f1449c3e640 1 -- 172.21.15.99:0/4060231626 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1444107020 con 0x7f14441017a0 2024-01-31T05:11:23.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.345+0000 7f14417fa640 1 -- 172.21.15.99:0/4060231626 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f143c005190 con 0x7f14441017a0 2024-01-31T05:11:23.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.345+0000 7f14417fa640 1 --2- 172.21.15.99:0/4060231626 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f14300a13f0 0x7f14300a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:23.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.346+0000 7f14417fa640 1 -- 172.21.15.99:0/4060231626 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f143c0ccdb0 con 0x7f14441017a0 2024-01-31T05:11:23.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.346+0000 7f14437fe640 1 --2- 172.21.15.99:0/4060231626 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f14300a13f0 0x7f14300a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:23.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.346+0000 7f14437fe640 1 --2- 172.21.15.99:0/4060231626 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f14300a13f0 0x7f14300a38b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1434006010 tx=0x7f1434000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:23.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.350+0000 7f14417fa640 1 -- 172.21.15.99:0/4060231626 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f143c096160 con 0x7f14441017a0 2024-01-31T05:11:23.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.522+0000 7f1449c3e640 1 -- 172.21.15.99:0/4060231626 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f144410c7e0 con 0x7f14441017a0 2024-01-31T05:11:23.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.523+0000 7f14417fa640 1 -- 172.21.15.99:0/4060231626 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f143c01d0a0 con 0x7f14441017a0 2024-01-31T05:11:23.522 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 64 2024-01-31T05:11:23.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.524+0000 7f1449c3e640 1 -- 172.21.15.99:0/4060231626 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f14300a13f0 msgr2=0x7f14300a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:23.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.524+0000 7f1449c3e640 1 --2- 172.21.15.99:0/4060231626 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f14300a13f0 0x7f14300a38b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1434006010 tx=0x7f1434000bc0 comp rx=0 tx=0).stop 2024-01-31T05:11:23.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.524+0000 7f1449c3e640 1 -- 172.21.15.99:0/4060231626 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14441017a0 msgr2=0x7f144419e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:23.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.524+0000 7f1449c3e640 1 --2- 172.21.15.99:0/4060231626 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14441017a0 0x7f144419e2c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f143c00cad0 tx=0x7f143c00cf90 comp rx=0 tx=0).stop 2024-01-31T05:11:23.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.525+0000 7f1449c3e640 1 -- 172.21.15.99:0/4060231626 shutdown_connections 2024-01-31T05:11:23.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.525+0000 7f1449c3e640 1 --2- 172.21.15.99:0/4060231626 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f14300a13f0 0x7f14300a38b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:23.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.525+0000 7f1449c3e640 1 --2- 172.21.15.99:0/4060231626 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14441017a0 0x7f144419e2c0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:23.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.525+0000 7f1449c3e640 1 --2- 172.21.15.99:0/4060231626 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1444100de0 0x7f1444197290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:23.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.525+0000 7f1449c3e640 1 --2- 172.21.15.99:0/4060231626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14440ffbf0 0x7f1444196d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:23.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.525+0000 7f1449c3e640 1 -- 172.21.15.99:0/4060231626 >> 172.21.15.99:0/4060231626 conn(0x7f14440fb180 msgr2=0x7f14441041f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:23.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.525+0000 7f1449c3e640 1 -- 172.21.15.99:0/4060231626 shutdown_connections 2024-01-31T05:11:23.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.525+0000 7f1449c3e640 1 -- 172.21.15.99:0/4060231626 wait complete. 2024-01-31T05:11:23.535 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-01-31T05:11:23.535 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T05:11:23.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.637+0000 7f2cfcb5a640 1 -- 172.21.15.99:0/2129116215 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cf8101f00 msgr2=0x7f2cf8102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:23.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.637+0000 7f2cfcb5a640 1 --2- 172.21.15.99:0/2129116215 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cf8101f00 0x7f2cf8102380 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2cec009900 tx=0x7f2cec02bc30 comp rx=0 tx=0).stop 2024-01-31T05:11:23.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.637+0000 7f2cfcb5a640 1 -- 172.21.15.99:0/2129116215 shutdown_connections 2024-01-31T05:11:23.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.637+0000 7f2cfcb5a640 1 --2- 172.21.15.99:0/2129116215 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2cf81028c0 0x7f2cf8109150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:23.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.637+0000 7f2cfcb5a640 1 --2- 172.21.15.99:0/2129116215 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cf8101f00 0x7f2cf8102380 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:23.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.637+0000 7f2cfcb5a640 1 --2- 172.21.15.99:0/2129116215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cf8100d10 0x7f2cf8101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:23.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.637+0000 7f2cfcb5a640 1 -- 172.21.15.99:0/2129116215 >> 172.21.15.99:0/2129116215 conn(0x7f2cf80fc2a0 msgr2=0x7f2cf80fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:23.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.637+0000 7f2cfcb5a640 1 -- 172.21.15.99:0/2129116215 shutdown_connections 2024-01-31T05:11:23.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.637+0000 7f2cfcb5a640 1 -- 172.21.15.99:0/2129116215 wait complete. 2024-01-31T05:11:23.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.638+0000 7f2cfcb5a640 1 Processor -- start 2024-01-31T05:11:23.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.638+0000 7f2cfcb5a640 1 -- start start 2024-01-31T05:11:23.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.638+0000 7f2cfcb5a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2cf8100d10 0x7f2cf8196ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:23.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.638+0000 7f2cfcb5a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cf8101f00 0x7f2cf81971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:23.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.638+0000 7f2cfcb5a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cf81028c0 0x7f2cf819e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:23.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.638+0000 7f2cfcb5a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf819e7b0 con 0x7f2cf81028c0 2024-01-31T05:11:23.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.638+0000 7f2cfcb5a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf819e920 con 0x7f2cf8101f00 2024-01-31T05:11:23.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.638+0000 7f2cfcb5a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf819eae0 con 0x7f2cf8100d10 2024-01-31T05:11:23.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.638+0000 7f2cf6d9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cf81028c0 0x7f2cf819e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:23.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.638+0000 7f2cf6d9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cf81028c0 0x7f2cf819e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34194/0 (socket says 172.21.15.99:34194) 2024-01-31T05:11:23.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.638+0000 7f2cf6d9d640 1 -- 172.21.15.99:0/2248995480 learned_addr learned my addr 172.21.15.99:0/2248995480 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:23.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.638+0000 7f2cf5d9b640 1 --2- 172.21.15.99:0/2248995480 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cf8101f00 0x7f2cf81971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:23.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.638+0000 7f2cf659c640 1 --2- 172.21.15.99:0/2248995480 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2cf8100d10 0x7f2cf8196ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:23.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.638+0000 7f2cf6d9d640 1 -- 172.21.15.99:0/2248995480 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2cf8100d10 msgr2=0x7f2cf8196ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:23.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.638+0000 7f2cf6d9d640 1 --2- 172.21.15.99:0/2248995480 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2cf8100d10 0x7f2cf8196ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:23.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.638+0000 7f2cf6d9d640 1 -- 172.21.15.99:0/2248995480 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cf8101f00 msgr2=0x7f2cf81971e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:23.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.638+0000 7f2cf6d9d640 1 --2- 172.21.15.99:0/2248995480 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cf8101f00 0x7f2cf81971e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:23.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.638+0000 7f2cf6d9d640 1 -- 172.21.15.99:0/2248995480 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cec009560 con 0x7f2cf81028c0 2024-01-31T05:11:23.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.638+0000 7f2cf5d9b640 1 --2- 172.21.15.99:0/2248995480 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cf8101f00 0x7f2cf81971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:11:23.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.639+0000 7f2cf6d9d640 1 --2- 172.21.15.99:0/2248995480 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cf81028c0 0x7f2cf819e240 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2cf000eaa0 tx=0x7f2cf000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:23.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.639+0000 7f2ce77fe640 1 -- 172.21.15.99:0/2248995480 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf000cdb0 con 0x7f2cf81028c0 2024-01-31T05:11:23.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.639+0000 7f2ce77fe640 1 -- 172.21.15.99:0/2248995480 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2cf0005020 con 0x7f2cf81028c0 2024-01-31T05:11:23.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.639+0000 7f2cfcb5a640 1 -- 172.21.15.99:0/2248995480 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cf819edc0 con 0x7f2cf81028c0 2024-01-31T05:11:23.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.639+0000 7f2ce77fe640 1 -- 172.21.15.99:0/2248995480 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf00116d0 con 0x7f2cf81028c0 2024-01-31T05:11:23.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.639+0000 7f2cfcb5a640 1 -- 172.21.15.99:0/2248995480 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cf819f220 con 0x7f2cf81028c0 2024-01-31T05:11:23.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.640+0000 7f2cfcb5a640 1 -- 172.21.15.99:0/2248995480 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cf8108080 con 0x7f2cf81028c0 2024-01-31T05:11:23.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.641+0000 7f2ce77fe640 1 -- 172.21.15.99:0/2248995480 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f2cf0005190 con 0x7f2cf81028c0 2024-01-31T05:11:23.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.641+0000 7f2ce77fe640 1 --2- 172.21.15.99:0/2248995480 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2ce00a1370 0x7f2ce00a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:23.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.641+0000 7f2ce77fe640 1 -- 172.21.15.99:0/2248995480 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f2cf00ccef0 con 0x7f2cf81028c0 2024-01-31T05:11:23.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.641+0000 7f2cf659c640 1 --2- 172.21.15.99:0/2248995480 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2ce00a1370 0x7f2ce00a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:23.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.642+0000 7f2cf659c640 1 --2- 172.21.15.99:0/2248995480 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2ce00a1370 0x7f2ce00a3830 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8197b70 tx=0x7f2ce8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:23.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.645+0000 7f2ce77fe640 1 -- 172.21.15.99:0/2248995480 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f2cf0096330 con 0x7f2cf81028c0 2024-01-31T05:11:23.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:23 smithi099 ceph-mon[31615]: pgmap v349: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 341 B/s wr, 10 op/s 2024-01-31T05:11:23.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:23 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/975755427' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-31T05:11:23.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:23 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/2593316417' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-31T05:11:23.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:23 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/4060231626' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-31T05:11:23.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.856+0000 7f2cfcb5a640 1 -- 172.21.15.99:0/2248995480 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2cf810c7b0 con 0x7f2cf81028c0 2024-01-31T05:11:23.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.857+0000 7f2ce77fe640 1 -- 172.21.15.99:0/2248995480 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11385 (secure 0 0 0) 0x7f2cf001f020 con 0x7f2cf81028c0 2024-01-31T05:11:23.856 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:11:23.856 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/1488539026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1488539026},{"type":"v1","addr":"172.21.15.99:6835","nonce":1488539026}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/1649552652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1649552652},{"type":"v1","addr":"172.21.15.99:6837","nonce":1649552652}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-01-31T05:09:20.564215+0000","modified":"2024-01-31T05:11:20.565526+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24461,"mds_2":24457,"mds_3":24439,"mds_4":14619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6839/4070477446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4070477446},{"type":"v1","addr":"172.21.15.99:6839","nonce":4070477446}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.99:6841/3069939345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6840","nonce":3069939345},{"type":"v1","addr":"172.21.15.99:6841","nonce":3069939345}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24376":{"gid":24376,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6833/427201290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":427201290},{"type":"v1","addr":"172.21.15.181:6833","nonce":427201290}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24401":{"gid":24401,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/472161020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":472161020},{"type":"v1","addr":"172.21.15.179:6833","nonce":472161020}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24427":{"gid":24427,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/1038715471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1038715471},{"type":"v1","addr":"172.21.15.181:6835","nonce":1038715471}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24434":{"gid":24434,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/966976592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":966976592},{"type":"v1","addr":"172.21.15.179:6835","nonce":966976592}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24439":{"gid":24439,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.181:6837/3875964154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3875964154},{"type":"v1","addr":"172.21.15.181:6837","nonce":3875964154}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24457":{"gid":24457,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.181:6839/996120687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":996120687},{"type":"v1","addr":"172.21.15.181:6839","nonce":996120687}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6837/837402830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":837402830},{"type":"v1","addr":"172.21.15.179:6837","nonce":837402830}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6839/754762785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":754762785},{"type":"v1","addr":"172.21.15.179:6839","nonce":754762785}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-31T05:11:23.857 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 27 2024-01-31T05:11:23.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.859+0000 7f2cfcb5a640 1 -- 172.21.15.99:0/2248995480 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2ce00a1370 msgr2=0x7f2ce00a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:23.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.859+0000 7f2cfcb5a640 1 --2- 172.21.15.99:0/2248995480 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2ce00a1370 0x7f2ce00a3830 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8197b70 tx=0x7f2ce8005f90 comp rx=0 tx=0).stop 2024-01-31T05:11:23.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.859+0000 7f2cfcb5a640 1 -- 172.21.15.99:0/2248995480 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cf81028c0 msgr2=0x7f2cf819e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:23.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.859+0000 7f2cfcb5a640 1 --2- 172.21.15.99:0/2248995480 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cf81028c0 0x7f2cf819e240 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2cf000eaa0 tx=0x7f2cf000ef60 comp rx=0 tx=0).stop 2024-01-31T05:11:23.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.859+0000 7f2cfcb5a640 1 -- 172.21.15.99:0/2248995480 shutdown_connections 2024-01-31T05:11:23.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.859+0000 7f2cfcb5a640 1 --2- 172.21.15.99:0/2248995480 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f2ce00a1370 0x7f2ce00a3830 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:23.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.859+0000 7f2cfcb5a640 1 --2- 172.21.15.99:0/2248995480 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cf81028c0 0x7f2cf819e240 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:23.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.859+0000 7f2cfcb5a640 1 --2- 172.21.15.99:0/2248995480 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cf8101f00 0x7f2cf81971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:23.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.859+0000 7f2cfcb5a640 1 --2- 172.21.15.99:0/2248995480 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2cf8100d10 0x7f2cf8196ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:23.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.859+0000 7f2cfcb5a640 1 -- 172.21.15.99:0/2248995480 >> 172.21.15.99:0/2248995480 conn(0x7f2cf80fc2a0 msgr2=0x7f2cf8105250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:23.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.859+0000 7f2cfcb5a640 1 -- 172.21.15.99:0/2248995480 shutdown_connections 2024-01-31T05:11:23.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.859+0000 7f2cfcb5a640 1 -- 172.21.15.99:0/2248995480 wait complete. 2024-01-31T05:11:23.869 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-01-31T05:11:23.870 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-01-31T05:11:23.870 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-31T05:11:23.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.972+0000 7f08a5596640 1 -- 172.21.15.99:0/956128466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08a0101fd0 msgr2=0x7f08a0102450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:23.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.972+0000 7f08a5596640 1 --2- 172.21.15.99:0/956128466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08a0101fd0 0x7f08a0102450 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0890009900 tx=0x7f089002bc30 comp rx=0 tx=0).stop 2024-01-31T05:11:23.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.972+0000 7f08a5596640 1 -- 172.21.15.99:0/956128466 shutdown_connections 2024-01-31T05:11:23.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.972+0000 7f08a5596640 1 --2- 172.21.15.99:0/956128466 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f08a0102990 0x7f08a0109220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:23.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.972+0000 7f08a5596640 1 --2- 172.21.15.99:0/956128466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08a0101fd0 0x7f08a0102450 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:23.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.972+0000 7f08a5596640 1 --2- 172.21.15.99:0/956128466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08a00ff000 0x7f08a00ff420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:23.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.972+0000 7f08a5596640 1 -- 172.21.15.99:0/956128466 >> 172.21.15.99:0/956128466 conn(0x7f08a00fa930 msgr2=0x7f08a00fcd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:23.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.972+0000 7f08a5596640 1 -- 172.21.15.99:0/956128466 shutdown_connections 2024-01-31T05:11:23.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.972+0000 7f08a5596640 1 -- 172.21.15.99:0/956128466 wait complete. 2024-01-31T05:11:23.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.972+0000 7f08a5596640 1 Processor -- start 2024-01-31T05:11:23.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.972+0000 7f08a5596640 1 -- start start 2024-01-31T05:11:23.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.972+0000 7f08a5596640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f08a00ff000 0x7f08a0196c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:23.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.972+0000 7f08a5596640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08a0101fd0 0x7f08a01971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:23.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.972+0000 7f08a5596640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08a0102990 0x7f08a019e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:23.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.972+0000 7f08a5596640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a019e740 con 0x7f08a0101fd0 2024-01-31T05:11:23.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.972+0000 7f08a5596640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a019e8b0 con 0x7f08a0102990 2024-01-31T05:11:23.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.972+0000 7f08a5596640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a019ea70 con 0x7f08a00ff000 2024-01-31T05:11:23.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.973+0000 7f089e7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08a0101fd0 0x7f08a01971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:23.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.973+0000 7f089e7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08a0101fd0 0x7f08a01971a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34222/0 (socket says 172.21.15.99:34222) 2024-01-31T05:11:23.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.973+0000 7f089e7fc640 1 -- 172.21.15.99:0/2315290040 learned_addr learned my addr 172.21.15.99:0/2315290040 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:23.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.973+0000 7f089effd640 1 --2- 172.21.15.99:0/2315290040 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f08a00ff000 0x7f08a0196c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:23.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.973+0000 7f089f7fe640 1 --2- 172.21.15.99:0/2315290040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08a0102990 0x7f08a019e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:23.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.973+0000 7f089e7fc640 1 -- 172.21.15.99:0/2315290040 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f08a00ff000 msgr2=0x7f08a0196c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:23.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.973+0000 7f089e7fc640 1 --2- 172.21.15.99:0/2315290040 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f08a00ff000 0x7f08a0196c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:23.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.973+0000 7f089e7fc640 1 -- 172.21.15.99:0/2315290040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08a0102990 msgr2=0x7f08a019e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:23.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.973+0000 7f089e7fc640 1 --2- 172.21.15.99:0/2315290040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08a0102990 0x7f08a019e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:23.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.973+0000 7f089e7fc640 1 -- 172.21.15.99:0/2315290040 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0890009560 con 0x7f08a0101fd0 2024-01-31T05:11:23.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.973+0000 7f089effd640 1 --2- 172.21.15.99:0/2315290040 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f08a00ff000 0x7f08a0196c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:11:23.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.973+0000 7f089e7fc640 1 --2- 172.21.15.99:0/2315290040 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08a0101fd0 0x7f08a01971a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0890009230 tx=0x7f0890004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:23.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.973+0000 7f0887fff640 1 -- 172.21.15.99:0/2315290040 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0890004440 con 0x7f08a0101fd0 2024-01-31T05:11:23.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.973+0000 7f0887fff640 1 -- 172.21.15.99:0/2315290040 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f08900054c0 con 0x7f08a0101fd0 2024-01-31T05:11:23.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.973+0000 7f08a5596640 1 -- 172.21.15.99:0/2315290040 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08a019ecf0 con 0x7f08a0101fd0 2024-01-31T05:11:23.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.973+0000 7f0887fff640 1 -- 172.21.15.99:0/2315290040 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0890003e50 con 0x7f08a0101fd0 2024-01-31T05:11:23.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.973+0000 7f08a5596640 1 -- 172.21.15.99:0/2315290040 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08a019f1b0 con 0x7f08a0101fd0 2024-01-31T05:11:23.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.974+0000 7f08a5596640 1 -- 172.21.15.99:0/2315290040 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08a0108100 con 0x7f08a0101fd0 2024-01-31T05:11:23.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.975+0000 7f0887fff640 1 -- 172.21.15.99:0/2315290040 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f08900035f0 con 0x7f08a0101fd0 2024-01-31T05:11:23.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.976+0000 7f0887fff640 1 --2- 172.21.15.99:0/2315290040 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f08880a1370 0x7f08880a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:23.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.976+0000 7f0887fff640 1 -- 172.21.15.99:0/2315290040 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f08900ef5d0 con 0x7f08a0101fd0 2024-01-31T05:11:23.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.976+0000 7f089effd640 1 --2- 172.21.15.99:0/2315290040 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f08880a1370 0x7f08880a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:23.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.976+0000 7f089effd640 1 --2- 172.21.15.99:0/2315290040 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f08880a1370 0x7f08880a3830 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f08940058c0 tx=0x7f0894005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:23.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:23.980+0000 7f0887fff640 1 -- 172.21.15.99:0/2315290040 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f08900b8a90 con 0x7f08a0101fd0 2024-01-31T05:11:24.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:23 smithi181 ceph-mon[36434]: pgmap v349: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 341 B/s wr, 10 op/s 2024-01-31T05:11:24.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:23 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/975755427' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-31T05:11:24.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:23 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/2593316417' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-31T05:11:24.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:23 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/4060231626' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-31T05:11:24.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:23 smithi179 ceph-mon[35652]: pgmap v349: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 341 B/s wr, 10 op/s 2024-01-31T05:11:24.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:23 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/975755427' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-31T05:11:24.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:23 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/2593316417' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-31T05:11:24.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:23 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/4060231626' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-31T05:11:24.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.147+0000 7f08a5596640 1 -- 172.21.15.99:0/2315290040 --> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f08a002cbb0 con 0x7f08880a1370 2024-01-31T05:11:24.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.158+0000 7f0887fff640 1 -- 172.21.15.99:0/2315290040 <== mgr.14152 v2:172.21.15.99:6800/3925720924 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345237 (secure 0 0 0) 0x7f08a002cbb0 con 0x7f08880a1370 2024-01-31T05:11:24.162 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:11:24.164 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-01-31T05:11:24.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.161+0000 7f08a5596640 1 -- 172.21.15.99:0/2315290040 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f08880a1370 msgr2=0x7f08880a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:24.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.161+0000 7f08a5596640 1 --2- 172.21.15.99:0/2315290040 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f08880a1370 0x7f08880a3830 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f08940058c0 tx=0x7f0894005850 comp rx=0 tx=0).stop 2024-01-31T05:11:24.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.161+0000 7f08a5596640 1 -- 172.21.15.99:0/2315290040 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08a0101fd0 msgr2=0x7f08a01971a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:24.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.161+0000 7f08a5596640 1 --2- 172.21.15.99:0/2315290040 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08a0101fd0 0x7f08a01971a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0890009230 tx=0x7f0890004040 comp rx=0 tx=0).stop 2024-01-31T05:11:24.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.161+0000 7f08a5596640 1 -- 172.21.15.99:0/2315290040 shutdown_connections 2024-01-31T05:11:24.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.161+0000 7f08a5596640 1 --2- 172.21.15.99:0/2315290040 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f08880a1370 0x7f08880a3830 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:24.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.161+0000 7f08a5596640 1 --2- 172.21.15.99:0/2315290040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08a0102990 0x7f08a019e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:24.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.161+0000 7f08a5596640 1 --2- 172.21.15.99:0/2315290040 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08a0101fd0 0x7f08a01971a0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:24.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.161+0000 7f08a5596640 1 --2- 172.21.15.99:0/2315290040 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f08a00ff000 0x7f08a0196c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:24.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.161+0000 7f08a5596640 1 -- 172.21.15.99:0/2315290040 >> 172.21.15.99:0/2315290040 conn(0x7f08a00fa930 msgr2=0x7f08a01052d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:24.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.161+0000 7f08a5596640 1 -- 172.21.15.99:0/2315290040 shutdown_connections 2024-01-31T05:11:24.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.161+0000 7f08a5596640 1 -- 172.21.15.99:0/2315290040 wait complete. 2024-01-31T05:11:24.172 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":349,"stamp":"2024-01-31T05:11:22.623024+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659028,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1296,"num_read_kb":767,"num_write":430,"num_write_kb":3083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":1180848,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":856,"ondisk_log_size":856,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":366772,"kb_used_data":13460,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575052,"statfs":{"total":1151940427776,"available":1151564853248,"internally_reserved":0,"allocated":13783040,"data_stored":7528316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":698,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":62,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002803"},"pg_stats":[{"pgid":"3.3f","version":"88'8","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.636203+0000","last_change":"2024-01-31T05:09:20.582274+0000","last_active":"2024-01-31T05:10:50.636203+0000","last_peered":"2024-01-31T05:10:50.636203+0000","last_clean":"2024-01-31T05:10:50.636203+0000","last_became_active":"2024-01-31T05:09:20.581511+0000","last_became_peered":"2024-01-31T05:09:20.581511+0000","last_unstale":"2024-01-31T05:10:50.636203+0000","last_undegraded":"2024-01-31T05:10:50.636203+0000","last_fullsized":"2024-01-31T05:10:50.636203+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:59:10.674456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"88'4","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.630950+0000","last_change":"2024-01-31T05:09:20.581752+0000","last_active":"2024-01-31T05:10:50.630950+0000","last_peered":"2024-01-31T05:10:50.630950+0000","last_clean":"2024-01-31T05:10:50.630950+0000","last_became_active":"2024-01-31T05:09:20.581035+0000","last_became_peered":"2024-01-31T05:09:20.581035+0000","last_unstale":"2024-01-31T05:10:50.630950+0000","last_undegraded":"2024-01-31T05:10:50.630950+0000","last_fullsized":"2024-01-31T05:10:50.630950+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:03:16.999371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"88'7","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.637658+0000","last_change":"2024-01-31T05:09:20.588191+0000","last_active":"2024-01-31T05:10:50.637658+0000","last_peered":"2024-01-31T05:10:50.637658+0000","last_clean":"2024-01-31T05:10:50.637658+0000","last_became_active":"2024-01-31T05:09:20.587466+0000","last_became_peered":"2024-01-31T05:09:20.587466+0000","last_unstale":"2024-01-31T05:10:50.637658+0000","last_undegraded":"2024-01-31T05:10:50.637658+0000","last_fullsized":"2024-01-31T05:10:50.637658+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:22:29.037408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"88'8","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.627306+0000","last_change":"2024-01-31T05:09:20.589377+0000","last_active":"2024-01-31T05:10:50.627306+0000","last_peered":"2024-01-31T05:10:50.627306+0000","last_clean":"2024-01-31T05:10:50.627306+0000","last_became_active":"2024-01-31T05:09:20.589065+0000","last_became_peered":"2024-01-31T05:09:20.589065+0000","last_unstale":"2024-01-31T05:10:50.627306+0000","last_undegraded":"2024-01-31T05:10:50.627306+0000","last_fullsized":"2024-01-31T05:10:50.627306+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:57:11.612654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"88'4","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.625701+0000","last_change":"2024-01-31T05:09:20.578919+0000","last_active":"2024-01-31T05:10:50.625701+0000","last_peered":"2024-01-31T05:10:50.625701+0000","last_clean":"2024-01-31T05:10:50.625701+0000","last_became_active":"2024-01-31T05:09:20.578594+0000","last_became_peered":"2024-01-31T05:09:20.578594+0000","last_unstale":"2024-01-31T05:10:50.625701+0000","last_undegraded":"2024-01-31T05:10:50.625701+0000","last_fullsized":"2024-01-31T05:10:50.625701+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:16:57.168457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"88'6","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.634482+0000","last_change":"2024-01-31T05:09:20.586620+0000","last_active":"2024-01-31T05:10:50.634482+0000","last_peered":"2024-01-31T05:10:50.634482+0000","last_clean":"2024-01-31T05:10:50.634482+0000","last_became_active":"2024-01-31T05:09:20.586323+0000","last_became_peered":"2024-01-31T05:09:20.586323+0000","last_unstale":"2024-01-31T05:10:50.634482+0000","last_undegraded":"2024-01-31T05:10:50.634482+0000","last_fullsized":"2024-01-31T05:10:50.634482+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:03:31.479078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"88'5","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.639286+0000","last_change":"2024-01-31T05:09:20.595122+0000","last_active":"2024-01-31T05:10:50.639286+0000","last_peered":"2024-01-31T05:10:50.639286+0000","last_clean":"2024-01-31T05:10:50.639286+0000","last_became_active":"2024-01-31T05:09:20.594766+0000","last_became_peered":"2024-01-31T05:09:20.594766+0000","last_unstale":"2024-01-31T05:10:50.639286+0000","last_undegraded":"2024-01-31T05:10:50.639286+0000","last_fullsized":"2024-01-31T05:10:50.639286+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:18:40.002855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"88'9","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.635983+0000","last_change":"2024-01-31T05:10:21.686734+0000","last_active":"2024-01-31T05:10:50.635983+0000","last_peered":"2024-01-31T05:10:50.635983+0000","last_clean":"2024-01-31T05:10:50.635983+0000","last_became_active":"2024-01-31T05:10:21.686293+0000","last_became_peered":"2024-01-31T05:10:21.686293+0000","last_unstale":"2024-01-31T05:10:50.635983+0000","last_undegraded":"2024-01-31T05:10:50.635983+0000","last_fullsized":"2024-01-31T05:10:50.635983+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:19:35.416043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"88'11","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.639501+0000","last_change":"2024-01-31T05:09:20.588892+0000","last_active":"2024-01-31T05:10:50.639501+0000","last_peered":"2024-01-31T05:10:50.639501+0000","last_clean":"2024-01-31T05:10:50.639501+0000","last_became_active":"2024-01-31T05:09:20.588212+0000","last_became_peered":"2024-01-31T05:09:20.588212+0000","last_unstale":"2024-01-31T05:10:50.639501+0000","last_undegraded":"2024-01-31T05:10:50.639501+0000","last_fullsized":"2024-01-31T05:10:50.639501+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:49:45.270341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"88'16","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.627823+0000","last_change":"2024-01-31T05:09:20.589396+0000","last_active":"2024-01-31T05:10:50.627823+0000","last_peered":"2024-01-31T05:10:50.627823+0000","last_clean":"2024-01-31T05:10:50.627823+0000","last_became_active":"2024-01-31T05:09:20.589058+0000","last_became_peered":"2024-01-31T05:09:20.589058+0000","last_unstale":"2024-01-31T05:10:50.627823+0000","last_undegraded":"2024-01-31T05:10:50.627823+0000","last_fullsized":"2024-01-31T05:10:50.627823+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:05:53.403136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"88'6","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.641135+0000","last_change":"2024-01-31T05:09:20.592010+0000","last_active":"2024-01-31T05:10:50.641135+0000","last_peered":"2024-01-31T05:10:50.641135+0000","last_clean":"2024-01-31T05:10:50.641135+0000","last_became_active":"2024-01-31T05:09:20.591714+0000","last_became_peered":"2024-01-31T05:09:20.591714+0000","last_unstale":"2024-01-31T05:10:50.641135+0000","last_undegraded":"2024-01-31T05:10:50.641135+0000","last_fullsized":"2024-01-31T05:10:50.641135+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:56:11.651035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"88'7","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.636699+0000","last_change":"2024-01-31T05:10:21.685195+0000","last_active":"2024-01-31T05:10:50.636699+0000","last_peered":"2024-01-31T05:10:50.636699+0000","last_clean":"2024-01-31T05:10:50.636699+0000","last_became_active":"2024-01-31T05:10:21.684742+0000","last_became_peered":"2024-01-31T05:10:21.684742+0000","last_unstale":"2024-01-31T05:10:50.636699+0000","last_undegraded":"2024-01-31T05:10:50.636699+0000","last_fullsized":"2024-01-31T05:10:50.636699+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:18:59.674766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"88'10","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.629382+0000","last_change":"2024-01-31T05:09:20.582167+0000","last_active":"2024-01-31T05:10:50.629382+0000","last_peered":"2024-01-31T05:10:50.629382+0000","last_clean":"2024-01-31T05:10:50.629382+0000","last_became_active":"2024-01-31T05:09:20.581860+0000","last_became_peered":"2024-01-31T05:09:20.581860+0000","last_unstale":"2024-01-31T05:10:50.629382+0000","last_undegraded":"2024-01-31T05:10:50.629382+0000","last_fullsized":"2024-01-31T05:10:50.629382+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:46:05.891545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"88'7","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.634991+0000","last_change":"2024-01-31T05:09:20.587899+0000","last_active":"2024-01-31T05:10:50.634991+0000","last_peered":"2024-01-31T05:10:50.634991+0000","last_clean":"2024-01-31T05:10:50.634991+0000","last_became_active":"2024-01-31T05:09:20.587068+0000","last_became_peered":"2024-01-31T05:09:20.587068+0000","last_unstale":"2024-01-31T05:10:50.634991+0000","last_undegraded":"2024-01-31T05:10:50.634991+0000","last_fullsized":"2024-01-31T05:10:50.634991+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:59:44.747928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"88'7","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.635917+0000","last_change":"2024-01-31T05:09:20.590392+0000","last_active":"2024-01-31T05:10:50.635917+0000","last_peered":"2024-01-31T05:10:50.635917+0000","last_clean":"2024-01-31T05:10:50.635917+0000","last_became_active":"2024-01-31T05:09:20.590082+0000","last_became_peered":"2024-01-31T05:09:20.590082+0000","last_unstale":"2024-01-31T05:10:50.635917+0000","last_undegraded":"2024-01-31T05:10:50.635917+0000","last_fullsized":"2024-01-31T05:10:50.635917+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:59:10.672890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"88'9","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.642526+0000","last_change":"2024-01-31T05:09:20.584822+0000","last_active":"2024-01-31T05:10:50.642526+0000","last_peered":"2024-01-31T05:10:50.642526+0000","last_clean":"2024-01-31T05:10:50.642526+0000","last_became_active":"2024-01-31T05:09:20.584531+0000","last_became_peered":"2024-01-31T05:09:20.584531+0000","last_unstale":"2024-01-31T05:10:50.642526+0000","last_undegraded":"2024-01-31T05:10:50.642526+0000","last_fullsized":"2024-01-31T05:10:50.642526+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:35:44.793407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"88'8","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.636505+0000","last_change":"2024-01-31T05:09:20.582615+0000","last_active":"2024-01-31T05:10:50.636505+0000","last_peered":"2024-01-31T05:10:50.636505+0000","last_clean":"2024-01-31T05:10:50.636505+0000","last_became_active":"2024-01-31T05:09:20.581959+0000","last_became_peered":"2024-01-31T05:09:20.581959+0000","last_unstale":"2024-01-31T05:10:50.636505+0000","last_undegraded":"2024-01-31T05:10:50.636505+0000","last_fullsized":"2024-01-31T05:10:50.636505+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:29:06.817822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"88'10","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.641157+0000","last_change":"2024-01-31T05:09:20.582421+0000","last_active":"2024-01-31T05:10:50.641157+0000","last_peered":"2024-01-31T05:10:50.641157+0000","last_clean":"2024-01-31T05:10:50.641157+0000","last_became_active":"2024-01-31T05:09:20.582099+0000","last_became_peered":"2024-01-31T05:09:20.582099+0000","last_unstale":"2024-01-31T05:10:50.641157+0000","last_undegraded":"2024-01-31T05:10:50.641157+0000","last_fullsized":"2024-01-31T05:10:50.641157+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:08:03.802219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"88'7","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.630744+0000","last_change":"2024-01-31T05:09:20.580511+0000","last_active":"2024-01-31T05:10:50.630744+0000","last_peered":"2024-01-31T05:10:50.630744+0000","last_clean":"2024-01-31T05:10:50.630744+0000","last_became_active":"2024-01-31T05:09:20.579596+0000","last_became_peered":"2024-01-31T05:09:20.579596+0000","last_unstale":"2024-01-31T05:10:50.630744+0000","last_undegraded":"2024-01-31T05:10:50.630744+0000","last_fullsized":"2024-01-31T05:10:50.630744+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:07:01.206181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'14","reported_seq":147,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:11:20.329291+0000","last_change":"2024-01-31T05:09:20.187398+0000","last_active":"2024-01-31T05:11:20.329291+0000","last_peered":"2024-01-31T05:11:20.329291+0000","last_clean":"2024-01-31T05:11:20.329291+0000","last_became_active":"2024-01-31T05:09:20.186925+0000","last_became_peered":"2024-01-31T05:09:20.186925+0000","last_unstale":"2024-01-31T05:11:20.329291+0000","last_undegraded":"2024-01-31T05:11:20.329291+0000","last_fullsized":"2024-01-31T05:11:20.329291+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:33:34.624017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"88'5","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.627275+0000","last_change":"2024-01-31T05:09:20.582800+0000","last_active":"2024-01-31T05:10:50.627275+0000","last_peered":"2024-01-31T05:10:50.627275+0000","last_clean":"2024-01-31T05:10:50.627275+0000","last_became_active":"2024-01-31T05:09:20.582523+0000","last_became_peered":"2024-01-31T05:09:20.582523+0000","last_unstale":"2024-01-31T05:10:50.627275+0000","last_undegraded":"2024-01-31T05:10:50.627275+0000","last_fullsized":"2024-01-31T05:10:50.627275+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:19:57.975954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.685174+0000","last_change":"2024-01-31T05:09:20.191566+0000","last_active":"2024-01-31T05:10:21.685174+0000","last_peered":"2024-01-31T05:10:21.685174+0000","last_clean":"2024-01-31T05:10:21.685174+0000","last_became_active":"2024-01-31T05:09:20.191268+0000","last_became_peered":"2024-01-31T05:09:20.191268+0000","last_unstale":"2024-01-31T05:10:21.685174+0000","last_undegraded":"2024-01-31T05:10:21.685174+0000","last_fullsized":"2024-01-31T05:10:21.685174+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:45:40.042374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"88'6","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.637694+0000","last_change":"2024-01-31T05:09:20.579061+0000","last_active":"2024-01-31T05:10:50.637694+0000","last_peered":"2024-01-31T05:10:50.637694+0000","last_clean":"2024-01-31T05:10:50.637694+0000","last_became_active":"2024-01-31T05:09:20.578728+0000","last_became_peered":"2024-01-31T05:09:20.578728+0000","last_unstale":"2024-01-31T05:10:50.637694+0000","last_undegraded":"2024-01-31T05:10:50.637694+0000","last_fullsized":"2024-01-31T05:10:50.637694+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:57:12.142419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.683895+0000","last_change":"2024-01-31T05:09:20.187366+0000","last_active":"2024-01-31T05:10:21.683895+0000","last_peered":"2024-01-31T05:10:21.683895+0000","last_clean":"2024-01-31T05:10:21.683895+0000","last_became_active":"2024-01-31T05:09:20.186616+0000","last_became_peered":"2024-01-31T05:09:20.186616+0000","last_unstale":"2024-01-31T05:10:21.683895+0000","last_undegraded":"2024-01-31T05:10:21.683895+0000","last_fullsized":"2024-01-31T05:10:21.683895+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:39:28.802810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"88'9","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.643134+0000","last_change":"2024-01-31T05:09:20.590538+0000","last_active":"2024-01-31T05:10:50.643134+0000","last_peered":"2024-01-31T05:10:50.643134+0000","last_clean":"2024-01-31T05:10:50.643134+0000","last_became_active":"2024-01-31T05:09:20.590254+0000","last_became_peered":"2024-01-31T05:09:20.590254+0000","last_unstale":"2024-01-31T05:10:50.643134+0000","last_undegraded":"2024-01-31T05:10:50.643134+0000","last_fullsized":"2024-01-31T05:10:50.643134+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:06:38.209930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.683304+0000","last_change":"2024-01-31T05:09:20.183808+0000","last_active":"2024-01-31T05:10:21.683304+0000","last_peered":"2024-01-31T05:10:21.683304+0000","last_clean":"2024-01-31T05:10:21.683304+0000","last_became_active":"2024-01-31T05:09:20.183514+0000","last_became_peered":"2024-01-31T05:09:20.183514+0000","last_unstale":"2024-01-31T05:10:21.683304+0000","last_undegraded":"2024-01-31T05:10:21.683304+0000","last_fullsized":"2024-01-31T05:10:21.683304+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:32:43.392640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"88'15","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.644160+0000","last_change":"2024-01-31T05:09:20.590871+0000","last_active":"2024-01-31T05:10:50.644160+0000","last_peered":"2024-01-31T05:10:50.644160+0000","last_clean":"2024-01-31T05:10:50.644160+0000","last_became_active":"2024-01-31T05:09:20.588533+0000","last_became_peered":"2024-01-31T05:09:20.588533+0000","last_unstale":"2024-01-31T05:10:50.644160+0000","last_undegraded":"2024-01-31T05:10:50.644160+0000","last_fullsized":"2024-01-31T05:10:50.644160+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:44:26.772616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"88'7","reported_seq":144,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:11:20.331163+0000","last_change":"2024-01-31T05:09:20.183455+0000","last_active":"2024-01-31T05:11:20.331163+0000","last_peered":"2024-01-31T05:11:20.331163+0000","last_clean":"2024-01-31T05:11:20.331163+0000","last_became_active":"2024-01-31T05:09:20.183070+0000","last_became_peered":"2024-01-31T05:09:20.183070+0000","last_unstale":"2024-01-31T05:11:20.331163+0000","last_undegraded":"2024-01-31T05:11:20.331163+0000","last_fullsized":"2024-01-31T05:11:20.331163+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:15:29.503830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1153,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":3,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"88'7","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.603912+0000","last_change":"2024-01-31T05:09:20.580755+0000","last_active":"2024-01-31T05:10:50.603912+0000","last_peered":"2024-01-31T05:10:50.603912+0000","last_clean":"2024-01-31T05:10:50.603912+0000","last_became_active":"2024-01-31T05:09:20.580452+0000","last_became_peered":"2024-01-31T05:09:20.580452+0000","last_unstale":"2024-01-31T05:10:50.603912+0000","last_undegraded":"2024-01-31T05:10:50.603912+0000","last_fullsized":"2024-01-31T05:10:50.603912+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:29:08.383532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681549+0000","last_change":"2024-01-31T05:09:20.182129+0000","last_active":"2024-01-31T05:10:21.681549+0000","last_peered":"2024-01-31T05:10:21.681549+0000","last_clean":"2024-01-31T05:10:21.681549+0000","last_became_active":"2024-01-31T05:09:20.181781+0000","last_became_peered":"2024-01-31T05:09:20.181781+0000","last_unstale":"2024-01-31T05:10:21.681549+0000","last_undegraded":"2024-01-31T05:10:21.681549+0000","last_fullsized":"2024-01-31T05:10:21.681549+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:05:57.854213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"88'8","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.626614+0000","last_change":"2024-01-31T05:09:20.591696+0000","last_active":"2024-01-31T05:10:50.626614+0000","last_peered":"2024-01-31T05:10:50.626614+0000","last_clean":"2024-01-31T05:10:50.626614+0000","last_became_active":"2024-01-31T05:09:20.591307+0000","last_became_peered":"2024-01-31T05:09:20.591307+0000","last_unstale":"2024-01-31T05:10:50.626614+0000","last_undegraded":"2024-01-31T05:10:50.626614+0000","last_fullsized":"2024-01-31T05:10:50.626614+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:59:56.884326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.679697+0000","last_change":"2024-01-31T05:09:20.179846+0000","last_active":"2024-01-31T05:10:21.679697+0000","last_peered":"2024-01-31T05:10:21.679697+0000","last_clean":"2024-01-31T05:10:21.679697+0000","last_became_active":"2024-01-31T05:09:20.179524+0000","last_became_peered":"2024-01-31T05:09:20.179524+0000","last_unstale":"2024-01-31T05:10:21.679697+0000","last_undegraded":"2024-01-31T05:10:21.679697+0000","last_fullsized":"2024-01-31T05:10:21.679697+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:13:51.085861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"88'8","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.632540+0000","last_change":"2024-01-31T05:09:20.580076+0000","last_active":"2024-01-31T05:10:50.632540+0000","last_peered":"2024-01-31T05:10:50.632540+0000","last_clean":"2024-01-31T05:10:50.632540+0000","last_became_active":"2024-01-31T05:09:20.579764+0000","last_became_peered":"2024-01-31T05:09:20.579764+0000","last_unstale":"2024-01-31T05:10:50.632540+0000","last_undegraded":"2024-01-31T05:10:50.632540+0000","last_fullsized":"2024-01-31T05:10:50.632540+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:02:13.861848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.685470+0000","last_change":"2024-01-31T05:09:20.183941+0000","last_active":"2024-01-31T05:10:21.685470+0000","last_peered":"2024-01-31T05:10:21.685470+0000","last_clean":"2024-01-31T05:10:21.685470+0000","last_became_active":"2024-01-31T05:09:20.183631+0000","last_became_peered":"2024-01-31T05:09:20.183631+0000","last_unstale":"2024-01-31T05:10:21.685470+0000","last_undegraded":"2024-01-31T05:10:21.685470+0000","last_fullsized":"2024-01-31T05:10:21.685470+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:31:31.419345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"88'11","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.636836+0000","last_change":"2024-01-31T05:09:20.589275+0000","last_active":"2024-01-31T05:10:50.636836+0000","last_peered":"2024-01-31T05:10:50.636836+0000","last_clean":"2024-01-31T05:10:50.636836+0000","last_became_active":"2024-01-31T05:09:20.588891+0000","last_became_peered":"2024-01-31T05:09:20.588891+0000","last_unstale":"2024-01-31T05:10:50.636836+0000","last_undegraded":"2024-01-31T05:10:50.636836+0000","last_fullsized":"2024-01-31T05:10:50.636836+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:30:27.665553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"88'6","reported_seq":247,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:11:17.326414+0000","last_change":"2024-01-31T05:09:20.182836+0000","last_active":"2024-01-31T05:11:17.326414+0000","last_peered":"2024-01-31T05:11:17.326414+0000","last_clean":"2024-01-31T05:11:17.326414+0000","last_became_active":"2024-01-31T05:09:20.182376+0000","last_became_peered":"2024-01-31T05:09:20.182376+0000","last_unstale":"2024-01-31T05:11:17.326414+0000","last_undegraded":"2024-01-31T05:11:17.326414+0000","last_fullsized":"2024-01-31T05:11:17.326414+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:55:52.354323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":222,"num_read_kb":222,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"88'10","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.643818+0000","last_change":"2024-01-31T05:09:20.583592+0000","last_active":"2024-01-31T05:10:50.643818+0000","last_peered":"2024-01-31T05:10:50.643818+0000","last_clean":"2024-01-31T05:10:50.643818+0000","last_became_active":"2024-01-31T05:09:20.583247+0000","last_became_peered":"2024-01-31T05:09:20.583247+0000","last_unstale":"2024-01-31T05:10:50.643818+0000","last_undegraded":"2024-01-31T05:10:50.643818+0000","last_fullsized":"2024-01-31T05:10:50.643818+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:28:04.946620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681815+0000","last_change":"2024-01-31T05:09:20.188171+0000","last_active":"2024-01-31T05:10:21.681815+0000","last_peered":"2024-01-31T05:10:21.681815+0000","last_clean":"2024-01-31T05:10:21.681815+0000","last_became_active":"2024-01-31T05:09:20.187807+0000","last_became_peered":"2024-01-31T05:09:20.187807+0000","last_unstale":"2024-01-31T05:10:21.681815+0000","last_undegraded":"2024-01-31T05:10:21.681815+0000","last_fullsized":"2024-01-31T05:10:21.681815+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:53:22.765389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"88'9","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.635239+0000","last_change":"2024-01-31T05:09:20.589462+0000","last_active":"2024-01-31T05:10:50.635239+0000","last_peered":"2024-01-31T05:10:50.635239+0000","last_clean":"2024-01-31T05:10:50.635239+0000","last_became_active":"2024-01-31T05:09:20.589002+0000","last_became_peered":"2024-01-31T05:09:20.589002+0000","last_unstale":"2024-01-31T05:10:50.635239+0000","last_undegraded":"2024-01-31T05:10:50.635239+0000","last_fullsized":"2024-01-31T05:10:50.635239+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:41:35.918827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684998+0000","last_change":"2024-01-31T05:09:20.184963+0000","last_active":"2024-01-31T05:10:21.684998+0000","last_peered":"2024-01-31T05:10:21.684998+0000","last_clean":"2024-01-31T05:10:21.684998+0000","last_became_active":"2024-01-31T05:09:20.184590+0000","last_became_peered":"2024-01-31T05:09:20.184590+0000","last_unstale":"2024-01-31T05:10:21.684998+0000","last_undegraded":"2024-01-31T05:10:21.684998+0000","last_fullsized":"2024-01-31T05:10:21.684998+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:06:31.291846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"88'11","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.640851+0000","last_change":"2024-01-31T05:09:20.589237+0000","last_active":"2024-01-31T05:10:50.640851+0000","last_peered":"2024-01-31T05:10:50.640851+0000","last_clean":"2024-01-31T05:10:50.640851+0000","last_became_active":"2024-01-31T05:09:20.588656+0000","last_became_peered":"2024-01-31T05:09:20.588656+0000","last_unstale":"2024-01-31T05:10:50.640851+0000","last_undegraded":"2024-01-31T05:10:50.640851+0000","last_fullsized":"2024-01-31T05:10:50.640851+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:02:02.025136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"88'32","reported_seq":281,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:11:17.325862+0000","last_change":"2024-01-31T05:09:20.182539+0000","last_active":"2024-01-31T05:11:17.325862+0000","last_peered":"2024-01-31T05:11:17.325862+0000","last_clean":"2024-01-31T05:11:17.325862+0000","last_became_active":"2024-01-31T05:09:20.182229+0000","last_became_peered":"2024-01-31T05:09:20.182229+0000","last_unstale":"2024-01-31T05:11:17.325862+0000","last_undegraded":"2024-01-31T05:11:17.325862+0000","last_fullsized":"2024-01-31T05:11:17.325862+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:56:21.974450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59713,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":230,"num_read_kb":173,"num_write":34,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"88'6","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.633432+0000","last_change":"2024-01-31T05:09:20.587838+0000","last_active":"2024-01-31T05:10:50.633432+0000","last_peered":"2024-01-31T05:10:50.633432+0000","last_clean":"2024-01-31T05:10:50.633432+0000","last_became_active":"2024-01-31T05:09:20.587523+0000","last_became_peered":"2024-01-31T05:09:20.587523+0000","last_unstale":"2024-01-31T05:10:50.633432+0000","last_undegraded":"2024-01-31T05:10:50.633432+0000","last_fullsized":"2024-01-31T05:10:50.633432+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:36:17.582890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.683191+0000","last_change":"2024-01-31T05:09:20.191935+0000","last_active":"2024-01-31T05:10:21.683191+0000","last_peered":"2024-01-31T05:10:21.683191+0000","last_clean":"2024-01-31T05:10:21.683191+0000","last_became_active":"2024-01-31T05:09:20.191614+0000","last_became_peered":"2024-01-31T05:09:20.191614+0000","last_unstale":"2024-01-31T05:10:21.683191+0000","last_undegraded":"2024-01-31T05:10:21.683191+0000","last_fullsized":"2024-01-31T05:10:21.683191+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:12:38.245944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"88'9","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.632956+0000","last_change":"2024-01-31T05:09:20.585705+0000","last_active":"2024-01-31T05:10:50.632956+0000","last_peered":"2024-01-31T05:10:50.632956+0000","last_clean":"2024-01-31T05:10:50.632956+0000","last_became_active":"2024-01-31T05:09:20.585413+0000","last_became_peered":"2024-01-31T05:09:20.585413+0000","last_unstale":"2024-01-31T05:10:50.632956+0000","last_undegraded":"2024-01-31T05:10:50.632956+0000","last_fullsized":"2024-01-31T05:10:50.632956+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:35:34.686300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684861+0000","last_change":"2024-01-31T05:09:20.191975+0000","last_active":"2024-01-31T05:10:21.684861+0000","last_peered":"2024-01-31T05:10:21.684861+0000","last_clean":"2024-01-31T05:10:21.684861+0000","last_became_active":"2024-01-31T05:09:20.191666+0000","last_became_peered":"2024-01-31T05:09:20.191666+0000","last_unstale":"2024-01-31T05:10:21.684861+0000","last_undegraded":"2024-01-31T05:10:21.684861+0000","last_fullsized":"2024-01-31T05:10:21.684861+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:00:01.162509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"88'15","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.641585+0000","last_change":"2024-01-31T05:10:21.684093+0000","last_active":"2024-01-31T05:10:50.641585+0000","last_peered":"2024-01-31T05:10:50.641585+0000","last_clean":"2024-01-31T05:10:50.641585+0000","last_became_active":"2024-01-31T05:10:21.683777+0000","last_became_peered":"2024-01-31T05:10:21.683777+0000","last_unstale":"2024-01-31T05:10:50.641585+0000","last_undegraded":"2024-01-31T05:10:50.641585+0000","last_fullsized":"2024-01-31T05:10:50.641585+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:54:18.618017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'7","reported_seq":140,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:11:16.341112+0000","last_change":"2024-01-31T05:09:20.183752+0000","last_active":"2024-01-31T05:11:16.341112+0000","last_peered":"2024-01-31T05:11:16.341112+0000","last_clean":"2024-01-31T05:11:16.341112+0000","last_became_active":"2024-01-31T05:09:20.183421+0000","last_became_peered":"2024-01-31T05:09:20.183421+0000","last_unstale":"2024-01-31T05:11:16.341112+0000","last_undegraded":"2024-01-31T05:11:16.341112+0000","last_fullsized":"2024-01-31T05:11:16.341112+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:04:12.919266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1119,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":115,"num_read_kb":4,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"88'6","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.639648+0000","last_change":"2024-01-31T05:09:20.593893+0000","last_active":"2024-01-31T05:10:50.639648+0000","last_peered":"2024-01-31T05:10:50.639648+0000","last_clean":"2024-01-31T05:10:50.639648+0000","last_became_active":"2024-01-31T05:09:20.593604+0000","last_became_peered":"2024-01-31T05:09:20.593604+0000","last_unstale":"2024-01-31T05:10:50.639648+0000","last_undegraded":"2024-01-31T05:10:50.639648+0000","last_fullsized":"2024-01-31T05:10:50.639648+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:50:31.534607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.696407+0000","last_change":"2024-01-31T05:10:21.696407+0000","last_active":"2024-01-31T05:10:21.696407+0000","last_peered":"2024-01-31T05:10:21.696407+0000","last_clean":"2024-01-31T05:10:21.696407+0000","last_became_active":"2024-01-31T05:10:21.684807+0000","last_became_peered":"2024-01-31T05:10:21.684807+0000","last_unstale":"2024-01-31T05:10:21.696407+0000","last_undegraded":"2024-01-31T05:10:21.696407+0000","last_fullsized":"2024-01-31T05:10:21.696407+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:21:51.260528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"88'6","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.643658+0000","last_change":"2024-01-31T05:09:20.588049+0000","last_active":"2024-01-31T05:10:50.643658+0000","last_peered":"2024-01-31T05:10:50.643658+0000","last_clean":"2024-01-31T05:10:50.643658+0000","last_became_active":"2024-01-31T05:09:20.587542+0000","last_became_peered":"2024-01-31T05:09:20.587542+0000","last_unstale":"2024-01-31T05:10:50.643658+0000","last_undegraded":"2024-01-31T05:10:50.643658+0000","last_fullsized":"2024-01-31T05:10:50.643658+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:19:55.948269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.683712+0000","last_change":"2024-01-31T05:09:20.185328+0000","last_active":"2024-01-31T05:10:21.683712+0000","last_peered":"2024-01-31T05:10:21.683712+0000","last_clean":"2024-01-31T05:10:21.683712+0000","last_became_active":"2024-01-31T05:09:20.184551+0000","last_became_peered":"2024-01-31T05:09:20.184551+0000","last_unstale":"2024-01-31T05:10:21.683712+0000","last_undegraded":"2024-01-31T05:10:21.683712+0000","last_fullsized":"2024-01-31T05:10:21.683712+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:19:36.143101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"88'5","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.626669+0000","last_change":"2024-01-31T05:09:20.586286+0000","last_active":"2024-01-31T05:10:50.626669+0000","last_peered":"2024-01-31T05:10:50.626669+0000","last_clean":"2024-01-31T05:10:50.626669+0000","last_became_active":"2024-01-31T05:09:20.586011+0000","last_became_peered":"2024-01-31T05:09:20.586011+0000","last_unstale":"2024-01-31T05:10:50.626669+0000","last_undegraded":"2024-01-31T05:10:50.626669+0000","last_fullsized":"2024-01-31T05:10:50.626669+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:21:23.064829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681935+0000","last_change":"2024-01-31T05:09:20.183083+0000","last_active":"2024-01-31T05:10:21.681935+0000","last_peered":"2024-01-31T05:10:21.681935+0000","last_clean":"2024-01-31T05:10:21.681935+0000","last_became_active":"2024-01-31T05:09:20.182742+0000","last_became_peered":"2024-01-31T05:09:20.182742+0000","last_unstale":"2024-01-31T05:10:21.681935+0000","last_undegraded":"2024-01-31T05:10:21.681935+0000","last_fullsized":"2024-01-31T05:10:21.681935+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:12:02.081688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"88'5","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.624298+0000","last_change":"2024-01-31T05:09:20.591522+0000","last_active":"2024-01-31T05:10:50.624298+0000","last_peered":"2024-01-31T05:10:50.624298+0000","last_clean":"2024-01-31T05:10:50.624298+0000","last_became_active":"2024-01-31T05:09:20.591224+0000","last_became_peered":"2024-01-31T05:09:20.591224+0000","last_unstale":"2024-01-31T05:10:50.624298+0000","last_undegraded":"2024-01-31T05:10:50.624298+0000","last_fullsized":"2024-01-31T05:10:50.624298+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:24:17.153662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'6","reported_seq":141,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:11:21.331128+0000","last_change":"2024-01-31T05:09:20.186176+0000","last_active":"2024-01-31T05:11:21.331128+0000","last_peered":"2024-01-31T05:11:21.331128+0000","last_clean":"2024-01-31T05:11:21.331128+0000","last_became_active":"2024-01-31T05:09:20.185873+0000","last_became_peered":"2024-01-31T05:09:20.185873+0000","last_unstale":"2024-01-31T05:11:21.331128+0000","last_undegraded":"2024-01-31T05:11:21.331128+0000","last_fullsized":"2024-01-31T05:11:21.331128+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:55:12.689664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"88'7","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.622708+0000","last_change":"2024-01-31T05:09:20.587556+0000","last_active":"2024-01-31T05:10:50.622708+0000","last_peered":"2024-01-31T05:10:50.622708+0000","last_clean":"2024-01-31T05:10:50.622708+0000","last_became_active":"2024-01-31T05:09:20.587275+0000","last_became_peered":"2024-01-31T05:09:20.587275+0000","last_unstale":"2024-01-31T05:10:50.622708+0000","last_undegraded":"2024-01-31T05:10:50.622708+0000","last_fullsized":"2024-01-31T05:10:50.622708+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:35:16.022422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"88'8","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.628254+0000","last_change":"2024-01-31T05:09:20.588044+0000","last_active":"2024-01-31T05:10:50.628254+0000","last_peered":"2024-01-31T05:10:50.628254+0000","last_clean":"2024-01-31T05:10:50.628254+0000","last_became_active":"2024-01-31T05:09:20.587526+0000","last_became_peered":"2024-01-31T05:09:20.587526+0000","last_unstale":"2024-01-31T05:10:50.628254+0000","last_undegraded":"2024-01-31T05:10:50.628254+0000","last_fullsized":"2024-01-31T05:10:50.628254+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:49:07.270009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'6","reported_seq":141,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:11:20.346466+0000","last_change":"2024-01-31T05:09:20.194791+0000","last_active":"2024-01-31T05:11:20.346466+0000","last_peered":"2024-01-31T05:11:20.346466+0000","last_clean":"2024-01-31T05:11:20.346466+0000","last_became_active":"2024-01-31T05:09:20.194454+0000","last_became_peered":"2024-01-31T05:09:20.194454+0000","last_unstale":"2024-01-31T05:11:20.346466+0000","last_undegraded":"2024-01-31T05:11:20.346466+0000","last_fullsized":"2024-01-31T05:11:20.346466+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:31:26.809960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":116,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"88'8","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.624590+0000","last_change":"2024-01-31T05:09:20.585022+0000","last_active":"2024-01-31T05:10:50.624590+0000","last_peered":"2024-01-31T05:10:50.624590+0000","last_clean":"2024-01-31T05:10:50.624590+0000","last_became_active":"2024-01-31T05:09:20.584709+0000","last_became_peered":"2024-01-31T05:09:20.584709+0000","last_unstale":"2024-01-31T05:10:50.624590+0000","last_undegraded":"2024-01-31T05:10:50.624590+0000","last_fullsized":"2024-01-31T05:10:50.624590+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:10:45.616985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.688980+0000","last_change":"2024-01-31T05:09:20.183779+0000","last_active":"2024-01-31T05:10:21.688980+0000","last_peered":"2024-01-31T05:10:21.688980+0000","last_clean":"2024-01-31T05:10:21.688980+0000","last_became_active":"2024-01-31T05:09:20.183399+0000","last_became_peered":"2024-01-31T05:09:20.183399+0000","last_unstale":"2024-01-31T05:10:21.688980+0000","last_undegraded":"2024-01-31T05:10:21.688980+0000","last_fullsized":"2024-01-31T05:10:21.688980+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:48:43.831022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":346,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681361+0000","last_change":"2024-01-31T05:08:10.168270+0000","last_active":"2024-01-31T05:10:21.681361+0000","last_peered":"2024-01-31T05:10:21.681361+0000","last_clean":"2024-01-31T05:10:21.681361+0000","last_became_active":"2024-01-31T05:08:10.167743+0000","last_became_peered":"2024-01-31T05:08:10.167743+0000","last_unstale":"2024-01-31T05:10:21.681361+0000","last_undegraded":"2024-01-31T05:10:21.681361+0000","last_fullsized":"2024-01-31T05:10:21.681361+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:46.976985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:46.976985+0000","last_clean_scrub_stamp":"2024-01-31T05:04:46.976985+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:21:54.724227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"88'5","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.633053+0000","last_change":"2024-01-31T05:09:20.583135+0000","last_active":"2024-01-31T05:10:50.633053+0000","last_peered":"2024-01-31T05:10:50.633053+0000","last_clean":"2024-01-31T05:10:50.633053+0000","last_became_active":"2024-01-31T05:09:20.582850+0000","last_became_peered":"2024-01-31T05:09:20.582850+0000","last_unstale":"2024-01-31T05:10:50.633053+0000","last_undegraded":"2024-01-31T05:10:50.633053+0000","last_fullsized":"2024-01-31T05:10:50.633053+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:04:51.204561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681522+0000","last_change":"2024-01-31T05:09:20.188181+0000","last_active":"2024-01-31T05:10:21.681522+0000","last_peered":"2024-01-31T05:10:21.681522+0000","last_clean":"2024-01-31T05:10:21.681522+0000","last_became_active":"2024-01-31T05:09:20.187801+0000","last_became_peered":"2024-01-31T05:09:20.187801+0000","last_unstale":"2024-01-31T05:10:21.681522+0000","last_undegraded":"2024-01-31T05:10:21.681522+0000","last_fullsized":"2024-01-31T05:10:21.681522+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:27:05.269615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.683769+0000","last_change":"2024-01-31T05:09:20.186242+0000","last_active":"2024-01-31T05:10:21.683769+0000","last_peered":"2024-01-31T05:10:21.683769+0000","last_clean":"2024-01-31T05:10:21.683769+0000","last_became_active":"2024-01-31T05:09:20.185908+0000","last_became_peered":"2024-01-31T05:09:20.185908+0000","last_unstale":"2024-01-31T05:10:21.683769+0000","last_undegraded":"2024-01-31T05:10:21.683769+0000","last_fullsized":"2024-01-31T05:10:21.683769+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:33:40.859324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"88'9","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.629900+0000","last_change":"2024-01-31T05:09:20.590896+0000","last_active":"2024-01-31T05:10:50.629900+0000","last_peered":"2024-01-31T05:10:50.629900+0000","last_clean":"2024-01-31T05:10:50.629900+0000","last_became_active":"2024-01-31T05:09:20.590546+0000","last_became_peered":"2024-01-31T05:09:20.590546+0000","last_unstale":"2024-01-31T05:10:50.629900+0000","last_undegraded":"2024-01-31T05:10:50.629900+0000","last_fullsized":"2024-01-31T05:10:50.629900+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:39:05.969756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"88'11","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.994781+0000","last_change":"2024-01-31T05:09:20.185811+0000","last_active":"2024-01-31T05:10:50.994781+0000","last_peered":"2024-01-31T05:10:50.994781+0000","last_clean":"2024-01-31T05:10:50.994781+0000","last_became_active":"2024-01-31T05:09:20.185490+0000","last_became_peered":"2024-01-31T05:09:20.185490+0000","last_unstale":"2024-01-31T05:10:50.994781+0000","last_undegraded":"2024-01-31T05:10:50.994781+0000","last_fullsized":"2024-01-31T05:10:50.994781+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:16:25.446046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"88'5","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.631208+0000","last_change":"2024-01-31T05:09:20.585298+0000","last_active":"2024-01-31T05:10:50.631208+0000","last_peered":"2024-01-31T05:10:50.631208+0000","last_clean":"2024-01-31T05:10:50.631208+0000","last_became_active":"2024-01-31T05:09:20.584256+0000","last_became_peered":"2024-01-31T05:09:20.584256+0000","last_unstale":"2024-01-31T05:10:50.631208+0000","last_undegraded":"2024-01-31T05:10:50.631208+0000","last_fullsized":"2024-01-31T05:10:50.631208+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:48:10.331714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.689153+0000","last_change":"2024-01-31T05:09:20.184960+0000","last_active":"2024-01-31T05:10:21.689153+0000","last_peered":"2024-01-31T05:10:21.689153+0000","last_clean":"2024-01-31T05:10:21.689153+0000","last_became_active":"2024-01-31T05:09:20.184599+0000","last_became_peered":"2024-01-31T05:09:20.184599+0000","last_unstale":"2024-01-31T05:10:21.689153+0000","last_undegraded":"2024-01-31T05:10:21.689153+0000","last_fullsized":"2024-01-31T05:10:21.689153+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:07:01.846976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"88'7","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.635507+0000","last_change":"2024-01-31T05:09:20.588597+0000","last_active":"2024-01-31T05:10:50.635507+0000","last_peered":"2024-01-31T05:10:50.635507+0000","last_clean":"2024-01-31T05:10:50.635507+0000","last_became_active":"2024-01-31T05:09:20.588326+0000","last_became_peered":"2024-01-31T05:09:20.588326+0000","last_unstale":"2024-01-31T05:10:50.635507+0000","last_undegraded":"2024-01-31T05:10:50.635507+0000","last_fullsized":"2024-01-31T05:10:50.635507+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:31:53.873261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684381+0000","last_change":"2024-01-31T05:09:20.186196+0000","last_active":"2024-01-31T05:10:21.684381+0000","last_peered":"2024-01-31T05:10:21.684381+0000","last_clean":"2024-01-31T05:10:21.684381+0000","last_became_active":"2024-01-31T05:09:20.185373+0000","last_became_peered":"2024-01-31T05:09:20.185373+0000","last_unstale":"2024-01-31T05:10:21.684381+0000","last_undegraded":"2024-01-31T05:10:21.684381+0000","last_fullsized":"2024-01-31T05:10:21.684381+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:13:07.826906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"88'2","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.595768+0000","last_change":"2024-01-31T05:09:20.589183+0000","last_active":"2024-01-31T05:10:50.595768+0000","last_peered":"2024-01-31T05:10:50.595768+0000","last_clean":"2024-01-31T05:10:50.595768+0000","last_became_active":"2024-01-31T05:09:20.588884+0000","last_became_peered":"2024-01-31T05:09:20.588884+0000","last_unstale":"2024-01-31T05:10:50.595768+0000","last_undegraded":"2024-01-31T05:10:50.595768+0000","last_fullsized":"2024-01-31T05:10:50.595768+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:23:49.878076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684293+0000","last_change":"2024-01-31T05:09:20.184849+0000","last_active":"2024-01-31T05:10:21.684293+0000","last_peered":"2024-01-31T05:10:21.684293+0000","last_clean":"2024-01-31T05:10:21.684293+0000","last_became_active":"2024-01-31T05:09:20.184491+0000","last_became_peered":"2024-01-31T05:09:20.184491+0000","last_unstale":"2024-01-31T05:10:21.684293+0000","last_undegraded":"2024-01-31T05:10:21.684293+0000","last_fullsized":"2024-01-31T05:10:21.684293+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:36:31.757646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"88'9","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.634337+0000","last_change":"2024-01-31T05:09:20.585917+0000","last_active":"2024-01-31T05:10:50.634337+0000","last_peered":"2024-01-31T05:10:50.634337+0000","last_clean":"2024-01-31T05:10:50.634337+0000","last_became_active":"2024-01-31T05:09:20.585082+0000","last_became_peered":"2024-01-31T05:09:20.585082+0000","last_unstale":"2024-01-31T05:10:50.634337+0000","last_undegraded":"2024-01-31T05:10:50.634337+0000","last_fullsized":"2024-01-31T05:10:50.634337+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:30:17.670739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.699341+0000","last_change":"2024-01-31T05:10:21.699341+0000","last_active":"2024-01-31T05:10:21.699341+0000","last_peered":"2024-01-31T05:10:21.699341+0000","last_clean":"2024-01-31T05:10:21.699341+0000","last_became_active":"2024-01-31T05:10:21.684981+0000","last_became_peered":"2024-01-31T05:10:21.684981+0000","last_unstale":"2024-01-31T05:10:21.699341+0000","last_undegraded":"2024-01-31T05:10:21.699341+0000","last_fullsized":"2024-01-31T05:10:21.699341+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:36:33.975341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"88'8","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.616883+0000","last_change":"2024-01-31T05:09:20.580332+0000","last_active":"2024-01-31T05:10:50.616883+0000","last_peered":"2024-01-31T05:10:50.616883+0000","last_clean":"2024-01-31T05:10:50.616883+0000","last_became_active":"2024-01-31T05:09:20.580014+0000","last_became_peered":"2024-01-31T05:09:20.580014+0000","last_unstale":"2024-01-31T05:10:50.616883+0000","last_undegraded":"2024-01-31T05:10:50.616883+0000","last_fullsized":"2024-01-31T05:10:50.616883+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:38:52.507575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.683162+0000","last_change":"2024-01-31T05:09:20.186065+0000","last_active":"2024-01-31T05:10:21.683162+0000","last_peered":"2024-01-31T05:10:21.683162+0000","last_clean":"2024-01-31T05:10:21.683162+0000","last_became_active":"2024-01-31T05:09:20.185798+0000","last_became_peered":"2024-01-31T05:09:20.185798+0000","last_unstale":"2024-01-31T05:10:21.683162+0000","last_undegraded":"2024-01-31T05:10:21.683162+0000","last_fullsized":"2024-01-31T05:10:21.683162+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:25:05.792886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"88'5","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.640228+0000","last_change":"2024-01-31T05:09:20.589746+0000","last_active":"2024-01-31T05:10:50.640228+0000","last_peered":"2024-01-31T05:10:50.640228+0000","last_clean":"2024-01-31T05:10:50.640228+0000","last_became_active":"2024-01-31T05:09:20.589452+0000","last_became_peered":"2024-01-31T05:09:20.589452+0000","last_unstale":"2024-01-31T05:10:50.640228+0000","last_undegraded":"2024-01-31T05:10:50.640228+0000","last_fullsized":"2024-01-31T05:10:50.640228+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:04:39.773280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'8","reported_seq":147,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:11:20.331308+0000","last_change":"2024-01-31T05:09:20.181920+0000","last_active":"2024-01-31T05:11:20.331308+0000","last_peered":"2024-01-31T05:11:20.331308+0000","last_clean":"2024-01-31T05:11:20.331308+0000","last_became_active":"2024-01-31T05:09:20.181603+0000","last_became_peered":"2024-01-31T05:09:20.181603+0000","last_unstale":"2024-01-31T05:11:20.331308+0000","last_undegraded":"2024-01-31T05:11:20.331308+0000","last_fullsized":"2024-01-31T05:11:20.331308+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:11:30.696322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2009,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"88'7","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.638413+0000","last_change":"2024-01-31T05:09:20.592244+0000","last_active":"2024-01-31T05:10:50.638413+0000","last_peered":"2024-01-31T05:10:50.638413+0000","last_clean":"2024-01-31T05:10:50.638413+0000","last_became_active":"2024-01-31T05:09:20.591940+0000","last_became_peered":"2024-01-31T05:09:20.591940+0000","last_unstale":"2024-01-31T05:10:50.638413+0000","last_undegraded":"2024-01-31T05:10:50.638413+0000","last_fullsized":"2024-01-31T05:10:50.638413+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:16:02.284216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684890+0000","last_change":"2024-01-31T05:09:20.192018+0000","last_active":"2024-01-31T05:10:21.684890+0000","last_peered":"2024-01-31T05:10:21.684890+0000","last_clean":"2024-01-31T05:10:21.684890+0000","last_became_active":"2024-01-31T05:09:20.191721+0000","last_became_peered":"2024-01-31T05:09:20.191721+0000","last_unstale":"2024-01-31T05:10:21.684890+0000","last_undegraded":"2024-01-31T05:10:21.684890+0000","last_fullsized":"2024-01-31T05:10:21.684890+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:53:56.199730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"88'7","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.639751+0000","last_change":"2024-01-31T05:09:20.593153+0000","last_active":"2024-01-31T05:10:50.639751+0000","last_peered":"2024-01-31T05:10:50.639751+0000","last_clean":"2024-01-31T05:10:50.639751+0000","last_became_active":"2024-01-31T05:09:20.592869+0000","last_became_peered":"2024-01-31T05:09:20.592869+0000","last_unstale":"2024-01-31T05:10:50.639751+0000","last_undegraded":"2024-01-31T05:10:50.639751+0000","last_fullsized":"2024-01-31T05:10:50.639751+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:35:42.234519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.679538+0000","last_change":"2024-01-31T05:09:20.191998+0000","last_active":"2024-01-31T05:10:21.679538+0000","last_peered":"2024-01-31T05:10:21.679538+0000","last_clean":"2024-01-31T05:10:21.679538+0000","last_became_active":"2024-01-31T05:09:20.191658+0000","last_became_peered":"2024-01-31T05:09:20.191658+0000","last_unstale":"2024-01-31T05:10:21.679538+0000","last_undegraded":"2024-01-31T05:10:21.679538+0000","last_fullsized":"2024-01-31T05:10:21.679538+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T17:06:39.916765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"88'9","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.641520+0000","last_change":"2024-01-31T05:09:20.586822+0000","last_active":"2024-01-31T05:10:50.641520+0000","last_peered":"2024-01-31T05:10:50.641520+0000","last_clean":"2024-01-31T05:10:50.641520+0000","last_became_active":"2024-01-31T05:09:20.586523+0000","last_became_peered":"2024-01-31T05:09:20.586523+0000","last_unstale":"2024-01-31T05:10:50.641520+0000","last_undegraded":"2024-01-31T05:10:50.641520+0000","last_fullsized":"2024-01-31T05:10:50.641520+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:02:59.311443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"88'9","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.627950+0000","last_change":"2024-01-31T05:09:20.586141+0000","last_active":"2024-01-31T05:10:50.627950+0000","last_peered":"2024-01-31T05:10:50.627950+0000","last_clean":"2024-01-31T05:10:50.627950+0000","last_became_active":"2024-01-31T05:09:20.585626+0000","last_became_peered":"2024-01-31T05:09:20.585626+0000","last_unstale":"2024-01-31T05:10:50.627950+0000","last_undegraded":"2024-01-31T05:10:50.627950+0000","last_fullsized":"2024-01-31T05:10:50.627950+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:39:18.023044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"88'12","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.635250+0000","last_change":"2024-01-31T05:09:20.588203+0000","last_active":"2024-01-31T05:10:50.635250+0000","last_peered":"2024-01-31T05:10:50.635250+0000","last_clean":"2024-01-31T05:10:50.635250+0000","last_became_active":"2024-01-31T05:09:20.586660+0000","last_became_peered":"2024-01-31T05:09:20.586660+0000","last_unstale":"2024-01-31T05:10:50.635250+0000","last_undegraded":"2024-01-31T05:10:50.635250+0000","last_fullsized":"2024-01-31T05:10:50.635250+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:27:41.249756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"88'8","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.630397+0000","last_change":"2024-01-31T05:09:20.591708+0000","last_active":"2024-01-31T05:10:50.630397+0000","last_peered":"2024-01-31T05:10:50.630397+0000","last_clean":"2024-01-31T05:10:50.630397+0000","last_became_active":"2024-01-31T05:09:20.590874+0000","last_became_peered":"2024-01-31T05:09:20.590874+0000","last_unstale":"2024-01-31T05:10:50.630397+0000","last_undegraded":"2024-01-31T05:10:50.630397+0000","last_fullsized":"2024-01-31T05:10:50.630397+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:13:30.221125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"88'7","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.635702+0000","last_change":"2024-01-31T05:09:20.587566+0000","last_active":"2024-01-31T05:10:50.635702+0000","last_peered":"2024-01-31T05:10:50.635702+0000","last_clean":"2024-01-31T05:10:50.635702+0000","last_became_active":"2024-01-31T05:09:20.587260+0000","last_became_peered":"2024-01-31T05:09:20.587260+0000","last_unstale":"2024-01-31T05:10:50.635702+0000","last_undegraded":"2024-01-31T05:10:50.635702+0000","last_fullsized":"2024-01-31T05:10:50.635702+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:32:46.030539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"88'4","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.635094+0000","last_change":"2024-01-31T05:09:20.587259+0000","last_active":"2024-01-31T05:10:50.635094+0000","last_peered":"2024-01-31T05:10:50.635094+0000","last_clean":"2024-01-31T05:10:50.635094+0000","last_became_active":"2024-01-31T05:09:20.586935+0000","last_became_peered":"2024-01-31T05:09:20.586935+0000","last_unstale":"2024-01-31T05:10:50.635094+0000","last_undegraded":"2024-01-31T05:10:50.635094+0000","last_fullsized":"2024-01-31T05:10:50.635094+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:28:23.217392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"88'6","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.627076+0000","last_change":"2024-01-31T05:09:20.587213+0000","last_active":"2024-01-31T05:10:50.627076+0000","last_peered":"2024-01-31T05:10:50.627076+0000","last_clean":"2024-01-31T05:10:50.627076+0000","last_became_active":"2024-01-31T05:09:20.586918+0000","last_became_peered":"2024-01-31T05:09:20.586918+0000","last_unstale":"2024-01-31T05:10:50.627076+0000","last_undegraded":"2024-01-31T05:10:50.627076+0000","last_fullsized":"2024-01-31T05:10:50.627076+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:39:27.541560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"88'15","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.635659+0000","last_change":"2024-01-31T05:09:20.584532+0000","last_active":"2024-01-31T05:10:50.635659+0000","last_peered":"2024-01-31T05:10:50.635659+0000","last_clean":"2024-01-31T05:10:50.635659+0000","last_became_active":"2024-01-31T05:09:20.583512+0000","last_became_peered":"2024-01-31T05:09:20.583512+0000","last_unstale":"2024-01-31T05:10:50.635659+0000","last_undegraded":"2024-01-31T05:10:50.635659+0000","last_fullsized":"2024-01-31T05:10:50.635659+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:04:33.848498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"88'2","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.627581+0000","last_change":"2024-01-31T05:09:20.587561+0000","last_active":"2024-01-31T05:10:50.627581+0000","last_peered":"2024-01-31T05:10:50.627581+0000","last_clean":"2024-01-31T05:10:50.627581+0000","last_became_active":"2024-01-31T05:09:20.587232+0000","last_became_peered":"2024-01-31T05:09:20.587232+0000","last_unstale":"2024-01-31T05:10:50.627581+0000","last_undegraded":"2024-01-31T05:10:50.627581+0000","last_fullsized":"2024-01-31T05:10:50.627581+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:17:01.913186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"88'6","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.625110+0000","last_change":"2024-01-31T05:09:20.581823+0000","last_active":"2024-01-31T05:10:50.625110+0000","last_peered":"2024-01-31T05:10:50.625110+0000","last_clean":"2024-01-31T05:10:50.625110+0000","last_became_active":"2024-01-31T05:09:20.581560+0000","last_became_peered":"2024-01-31T05:09:20.581560+0000","last_unstale":"2024-01-31T05:10:50.625110+0000","last_undegraded":"2024-01-31T05:10:50.625110+0000","last_fullsized":"2024-01-31T05:10:50.625110+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:48:50.057303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"88'8","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.629758+0000","last_change":"2024-01-31T05:09:20.582477+0000","last_active":"2024-01-31T05:10:50.629758+0000","last_peered":"2024-01-31T05:10:50.629758+0000","last_clean":"2024-01-31T05:10:50.629758+0000","last_became_active":"2024-01-31T05:09:20.582051+0000","last_became_peered":"2024-01-31T05:09:20.582051+0000","last_unstale":"2024-01-31T05:10:50.629758+0000","last_undegraded":"2024-01-31T05:10:50.629758+0000","last_fullsized":"2024-01-31T05:10:50.629758+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:24:36.665707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"88'10","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.643219+0000","last_change":"2024-01-31T05:09:20.587281+0000","last_active":"2024-01-31T05:10:50.643219+0000","last_peered":"2024-01-31T05:10:50.643219+0000","last_clean":"2024-01-31T05:10:50.643219+0000","last_became_active":"2024-01-31T05:09:20.586976+0000","last_became_peered":"2024-01-31T05:09:20.586976+0000","last_unstale":"2024-01-31T05:10:50.643219+0000","last_undegraded":"2024-01-31T05:10:50.643219+0000","last_fullsized":"2024-01-31T05:10:50.643219+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:33:59.065647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"88'11","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.633364+0000","last_change":"2024-01-31T05:09:20.585953+0000","last_active":"2024-01-31T05:10:50.633364+0000","last_peered":"2024-01-31T05:10:50.633364+0000","last_clean":"2024-01-31T05:10:50.633364+0000","last_became_active":"2024-01-31T05:09:20.585406+0000","last_became_peered":"2024-01-31T05:09:20.585406+0000","last_unstale":"2024-01-31T05:10:50.633364+0000","last_undegraded":"2024-01-31T05:10:50.633364+0000","last_fullsized":"2024-01-31T05:10:50.633364+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:14:24.622166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"88'8","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.625149+0000","last_change":"2024-01-31T05:09:20.587073+0000","last_active":"2024-01-31T05:10:50.625149+0000","last_peered":"2024-01-31T05:10:50.625149+0000","last_clean":"2024-01-31T05:10:50.625149+0000","last_became_active":"2024-01-31T05:09:20.586753+0000","last_became_peered":"2024-01-31T05:09:20.586753+0000","last_unstale":"2024-01-31T05:10:50.625149+0000","last_undegraded":"2024-01-31T05:10:50.625149+0000","last_fullsized":"2024-01-31T05:10:50.625149+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:13:20.291390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68426,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1170,"num_read_kb":658,"num_write":247,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":214994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351014,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":970752,"data_stored":463936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.53700000000000003,"15min":0.54400000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.63800000000000001,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.59699999999999998,"15min":0.60499999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.753,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.47899999999999998}]},{"osd":1,"last update":"Wed Jan 31 05:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.63600000000000001,"15min":0.629},"min":{"1min":0.49299999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.60199999999999998,"15min":0.59599999999999997},"min":{"1min":0.48599999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82699999999999996,"5min":0.872,"15min":0.872},"last":0.42899999999999999}]},{"osd":2,"last update":"Wed Jan 31 05:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.48899999999999999,"15min":0.49299999999999999},"min":{"1min":0.33700000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.66200000000000003,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.371},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.498,"15min":0.502},"min":{"1min":0.34300000000000003,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.51600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":4,"last update":"Wed Jan 31 05:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.63600000000000001,"15min":0.63500000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.66600000000000004,"15min":0.66800000000000004},"min":{"1min":0.44900000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.77900000000000003,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.72899999999999998}]},{"osd":5,"last update":"Wed Jan 31 05:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.61499999999999999,"15min":0.62},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.59999999999999998,"15min":0.60899999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71499999999999997,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.71099999999999997}]},{"osd":6,"last update":"Wed Jan 31 05:09:32 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.432},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.58999999999999997}]},{"osd":7,"last update":"Wed Jan 31 05:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.73599999999999999,"15min":0.74099999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.90000000000000002,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.74299999999999999,"15min":0.75},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.88800000000000001,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.77900000000000003}]},{"osd":8,"last update":"Wed Jan 31 05:10:20 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.79500000000000004}]},{"osd":9,"last update":"Wed Jan 31 05:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.78400000000000003,"15min":0.78700000000000003},"min":{"1min":0.63,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.96699999999999997,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.56299999999999994,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.93500000000000005,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.84599999999999997}]},{"osd":10,"last update":"Wed Jan 31 05:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.78700000000000003,"15min":0.79200000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.89800000000000002,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.82099999999999995,"15min":0.82499999999999996},"min":{"1min":0.69899999999999995,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.94399999999999995,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.748}]}]},{"osd":10,"up_from":73,"seq":313532612651,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36960,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708192,"statfs":{"total":95995035648,"available":95957188608,"internally_reserved":0,"allocated":1662976,"data_stored":1114258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":36174273},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:10:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.48499999999999999}]},{"osd":1,"last update":"Wed Jan 31 05:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.47599999999999998,"15min":0.48399999999999999},"min":{"1min":0.313,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.67100000000000004,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.501,"15min":0.51300000000000001},"min":{"1min":0.316,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70699999999999996,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.623}]},{"osd":2,"last update":"Wed Jan 31 05:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59299999999999997,"15min":0.58699999999999997},"min":{"1min":0.40600000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63700000000000001,"15min":0.63300000000000001},"min":{"1min":0.439,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80100000000000005,"5min":0.874,"15min":0.874},"last":0.66700000000000004}]},{"osd":3,"last update":"Wed Jan 31 05:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.60899999999999999,"15min":0.625},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77000000000000002,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.63900000000000001,"15min":0.65600000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.79300000000000004,"5min":1.115,"15min":1.115},"last":0.56999999999999995}]},{"osd":4,"last update":"Wed Jan 31 05:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.32700000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.77500000000000002,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.76000000000000001,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.53500000000000003}]},{"osd":5,"last update":"Wed Jan 31 05:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.65700000000000003,"15min":0.65300000000000002},"min":{"1min":0.45900000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.876,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.66800000000000004,"15min":0.65600000000000003},"min":{"1min":0.51900000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.91200000000000003,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.77900000000000003}]},{"osd":6,"last update":"Wed Jan 31 05:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.70699999999999996,"15min":0.71699999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.85899999999999999,"5min":1.022,"15min":1.022},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.70799999999999996,"15min":0.72699999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.83799999999999997,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.68000000000000005}]},{"osd":7,"last update":"Wed Jan 31 05:09:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.57199999999999995}]},{"osd":8,"last update":"Wed Jan 31 05:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.749,"15min":0.76100000000000001},"min":{"1min":0.53400000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.94999999999999996,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.76400000000000001,"15min":0.77700000000000002},"min":{"1min":0.56200000000000006,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93600000000000005,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.83899999999999997}]},{"osd":9,"last update":"Wed Jan 31 05:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.78000000000000003,"15min":0.79800000000000004},"min":{"1min":0.51000000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.96299999999999997,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.77800000000000002,"15min":0.79900000000000004},"min":{"1min":0.52200000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.94999999999999996,"5min":1.452,"15min":1.452},"last":0.64800000000000002}]},{"osd":11,"last update":"Wed Jan 31 05:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.75,"15min":0.746},"min":{"1min":0.64500000000000002,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.90200000000000002,"5min":1.026,"15min":1.026},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77100000000000002,"15min":0.77000000000000002},"min":{"1min":0.61099999999999999,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.94199999999999995,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.90400000000000003}]}]},{"osd":9,"up_from":67,"seq":287762808880,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":987136,"data_stored":462915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:10:46 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.41599999999999998,"15min":0.434},"min":{"1min":0.27500000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.49099999999999999,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.53000000000000003,"15min":0.50800000000000001},"min":{"1min":0.29999999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.65700000000000003,"5min":7.8330000000000002,"15min":7.8330000000000002},"last":0.27000000000000002}]},{"osd":1,"last update":"Wed Jan 31 05:10:46 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69399999999999995,"5min":2.661,"15min":2.661},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.59599999999999997,"15min":0.61199999999999999},"min":{"1min":0.44800000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.67900000000000005,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.46200000000000002}]},{"osd":2,"last update":"Wed Jan 31 05:10:46 2024","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":0.79000000000000004,"15min":0.66200000000000003},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":19.556999999999999,"5min":19.556999999999999,"15min":19.556999999999999},"last":0.44},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.59799999999999998,"15min":0.62},"min":{"1min":0.40300000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.76800000000000002,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.51300000000000001}]},{"osd":3,"last update":"Wed Jan 31 05:10:46 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.68799999999999994,"15min":0.59199999999999997},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.65700000000000003,"5min":19.687000000000001,"15min":19.687000000000001},"last":0.312},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.57199999999999995,"15min":0.53700000000000003},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.64000000000000001,"5min":10.478,"15min":10.478},"last":0.32800000000000001}]},{"osd":4,"last update":"Wed Jan 31 05:10:46 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.63500000000000001,"15min":0.65100000000000002},"min":{"1min":0.46000000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.83599999999999997,"5min":1.002,"15min":1.002},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.69899999999999995,"15min":0.66400000000000003},"min":{"1min":0.46100000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.876,"5min":8.2289999999999992,"15min":8.2289999999999992},"last":0.60899999999999999}]},{"osd":5,"last update":"Wed Jan 31 05:10:46 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.73799999999999999,"15min":0.70099999999999996},"min":{"1min":0.41999999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.92800000000000005,"5min":9.9339999999999993,"15min":9.9339999999999993},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.68899999999999995,"15min":0.70699999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.75600000000000001,"5min":2.8130000000000002,"15min":2.8130000000000002},"last":0.48399999999999999}]},{"osd":6,"last update":"Wed Jan 31 05:10:46 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.60699999999999998,"15min":0.63500000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.75,"5min":3.141,"15min":3.141},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.68400000000000005,"15min":0.70799999999999996},"min":{"1min":0.38400000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.877,"5min":2.9350000000000001,"15min":2.9350000000000001},"last":0.376}]},{"osd":7,"last update":"Wed Jan 31 05:10:46 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.78700000000000003,"15min":0.75700000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.84499999999999997,"5min":8.2639999999999993,"15min":8.2639999999999993},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.81699999999999995,"15min":0.78500000000000003},"min":{"1min":0.50800000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.87,"5min":10.438000000000001,"15min":10.438000000000001},"last":0.52700000000000002}]},{"osd":8,"last update":"Wed Jan 31 05:10:46 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.77400000000000002,"15min":0.78600000000000003},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.4490000000000001,"5min":2.8889999999999998,"15min":2.8889999999999998},"last":0.496},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.91000000000000003,"15min":0.83399999999999996},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.95499999999999996,"5min":17.093,"15min":17.093},"last":0.55300000000000005}]},{"osd":10,"last update":"Wed Jan 31 05:11:15 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.748,"15min":0.76700000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.89900000000000002,"5min":1.111,"15min":1.111},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.82199999999999995,"15min":0.78500000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.81399999999999995,"5min":9.5899999999999999,"15min":9.5899999999999999},"last":0.67200000000000004}]}]},{"osd":8,"up_from":59,"seq":253403070517,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":974848,"data_stored":463181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.60799999999999998,"15min":0.58799999999999997},"min":{"1min":0.373,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":3.5819999999999999,"5min":3.5819999999999999,"15min":3.5819999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.57499999999999996,"15min":0.58599999999999997},"min":{"1min":0.38800000000000001,"5min":0.316,"15min":0.316},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.85799999999999998}]},{"osd":1,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.63700000000000001,"15min":0.61299999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":2.7679999999999998,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.65800000000000003,"15min":0.63400000000000001},"min":{"1min":0.47699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":3.2389999999999999,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.73399999999999999}]},{"osd":2,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.48999999999999999,"15min":0.48399999999999999},"min":{"1min":0.32600000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.52900000000000003,"15min":0.51300000000000001},"min":{"1min":0.41799999999999998,"5min":0.251,"15min":0.251},"max":{"1min":3.9729999999999999,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":0.46100000000000002}]},{"osd":3,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.57899999999999996,"15min":0.58499999999999996},"min":{"1min":0.34100000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.64500000000000002,"15min":0.65100000000000002},"min":{"1min":0.435,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":2.8050000000000002,"5min":2.8050000000000002,"15min":2.8050000000000002},"last":0.91700000000000004}]},{"osd":4,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.68899999999999995,"15min":0.65100000000000002},"min":{"1min":0.51800000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":5.1820000000000004,"5min":5.1820000000000004,"15min":5.1820000000000004},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.68600000000000005,"15min":0.66400000000000003},"min":{"1min":0.56200000000000006,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":3.0150000000000001,"5min":3.0150000000000001,"15min":3.0150000000000001},"last":0.88900000000000001}]},{"osd":5,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.627,"15min":0.61899999999999999},"min":{"1min":0.48899999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":3.617,"5min":3.617,"15min":3.617},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.61299999999999999,"15min":0.60499999999999998},"min":{"1min":0.35899999999999999,"5min":0.317,"15min":0.317},"max":{"1min":2.9540000000000002,"5min":2.9540000000000002,"15min":2.9540000000000002},"last":0.51700000000000002}]},{"osd":6,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.70999999999999996,"15min":0.72099999999999997},"min":{"1min":0.47399999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":2.3740000000000001,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.74299999999999999,"15min":0.73799999999999999},"min":{"1min":0.54800000000000004,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":3.2749999999999999,"5min":3.2749999999999999,"15min":3.2749999999999999},"last":0.80200000000000005}]},{"osd":7,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":0.76900000000000002,"15min":0.73899999999999999},"min":{"1min":0.64100000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":4.1970000000000001,"5min":4.1970000000000001,"15min":4.1970000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.94699999999999995,"15min":0.79900000000000004},"min":{"1min":0.67900000000000005,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":2.181,"5min":19.677,"15min":19.677},"last":0.76900000000000002}]},{"osd":9,"last update":"Wed Jan 31 05:10:43 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":1.302,"15min":1.544},"min":{"1min":0.53900000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.91800000000000004,"5min":19.695,"15min":19.695},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.74199999999999999,"15min":0.69999999999999996},"min":{"1min":0.629,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0109999999999999,"5min":3.306,"15min":3.306},"last":0.878}]},{"osd":10,"last update":"Wed Jan 31 05:11:12 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.76900000000000002,"15min":0.71299999999999997},"min":{"1min":0.58099999999999996,"5min":0.439,"15min":0.439},"max":{"1min":1.0780000000000001,"5min":4.3760000000000003,"15min":4.3760000000000003},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.83199999999999996,"15min":0.76200000000000001},"min":{"1min":0.54900000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0589999999999999,"5min":6.875,"15min":6.875},"last":0.84299999999999997}]},{"osd":11,"last update":"Wed Jan 31 05:10:21 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.78400000000000003}]}]},{"osd":7,"up_from":51,"seq":219043332154,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28560,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716592,"statfs":{"total":95995035648,"available":95965790208,"internally_reserved":0,"allocated":1581056,"data_stored":1056872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:08:52 2024","interfaces":[{"interface":"back","average":{"1min":1.669,"5min":0.75600000000000001,"15min":0.60399999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":19.462,"5min":19.462,"15min":19.462},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.52900000000000003,"15min":0.51900000000000002},"min":{"1min":0.40899999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.45500000000000002}]},{"osd":1,"last update":"Wed Jan 31 05:10:57 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.41999999999999998,"15min":0.41299999999999998},"min":{"1min":0.31900000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.54300000000000004,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.46100000000000002,"15min":0.44600000000000001},"min":{"1min":0.33100000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.64300000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.42999999999999999}]},{"osd":2,"last update":"Wed Jan 31 05:10:57 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.60799999999999998,"15min":0.58999999999999997},"min":{"1min":0.46600000000000003,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60299999999999998,"15min":0.60199999999999998},"min":{"1min":0.46400000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.74199999999999999,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.60099999999999998}]},{"osd":3,"last update":"Wed Jan 31 05:10:57 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55900000000000005,"15min":0.55300000000000005},"min":{"1min":0.43099999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.80100000000000005,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.57099999999999995,"15min":0.57399999999999995},"min":{"1min":0.39800000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.70799999999999996,"5min":0.87,"15min":0.87},"last":0.51300000000000001}]},{"osd":4,"last update":"Wed Jan 31 05:10:57 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.48099999999999998,"15min":0.47799999999999998},"min":{"1min":0.32400000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.65000000000000002,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.502,"15min":0.50600000000000001},"min":{"1min":0.36399999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.63500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.56100000000000005}]},{"osd":5,"last update":"Wed Jan 31 05:10:57 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.64400000000000002,"15min":0.63},"min":{"1min":0.49299999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.64500000000000002,"15min":0.64300000000000002},"min":{"1min":0.52500000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.77100000000000002,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.753}]},{"osd":6,"last update":"Wed Jan 31 05:10:57 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.63800000000000001,"15min":0.63100000000000001},"min":{"1min":0.51000000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.751,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.88,"15min":0.72999999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.82799999999999996,"5min":19.425000000000001,"15min":19.425000000000001},"last":0.62}]},{"osd":8,"last update":"Wed Jan 31 05:10:21 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.68799999999999994,"15min":0.68200000000000005},"min":{"1min":0.61799999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.85099999999999998,"5min":0.875,"15min":0.875},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.70799999999999996,"15min":0.71199999999999997},"min":{"1min":0.56899999999999995,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.85899999999999999,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.81699999999999995}]},{"osd":9,"last update":"Wed Jan 31 05:10:42 2024","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":0.82799999999999996,"15min":0.752},"min":{"1min":0.498,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":11.433999999999999,"5min":11.433999999999999,"15min":11.433999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":1.3089999999999999,"5min":0.82099999999999995,"15min":0.73599999999999999},"min":{"1min":0.54500000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":11.416,"5min":11.416,"15min":11.416},"last":0.71799999999999997}]},{"osd":10,"last update":"Wed Jan 31 05:11:13 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.52600000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.70399999999999996,"15min":0.70599999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.63800000000000001}]},{"osd":11,"last update":"Wed Jan 31 05:10:21 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.84699999999999998}]}]},{"osd":6,"up_from":46,"seq":197568495679,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":970752,"data_stored":463022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:10:34 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.378,"15min":0.37},"min":{"1min":0.28100000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.53400000000000003,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.378},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.40600000000000003,"15min":0.40799999999999997},"min":{"1min":0.28499999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.35799999999999998}]},{"osd":1,"last update":"Wed Jan 31 05:10:34 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.54700000000000004,"15min":0.53900000000000003},"min":{"1min":0.40899999999999997,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56200000000000006,"15min":0.55400000000000005},"min":{"1min":0.42699999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.83599999999999997,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.622}]},{"osd":2,"last update":"Wed Jan 31 05:10:34 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.55400000000000005,"15min":0.55200000000000005},"min":{"1min":0.39000000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.77600000000000002,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.55200000000000005,"15min":0.54600000000000004},"min":{"1min":0.372,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73599999999999999,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.65200000000000002}]},{"osd":3,"last update":"Wed Jan 31 05:10:34 2024","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.437,"15min":0.44700000000000001},"min":{"1min":0.30199999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.56100000000000005,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.47499999999999998,"15min":0.47999999999999998},"min":{"1min":0.316,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.61199999999999999,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.44600000000000001}]},{"osd":4,"last update":"Wed Jan 31 05:10:34 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.58499999999999996,"15min":0.59099999999999997},"min":{"1min":0.443,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58499999999999996,"15min":0.57599999999999996},"min":{"1min":0.41099999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.86199999999999999,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.69399999999999995}]},{"osd":5,"last update":"Wed Jan 31 05:10:34 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.44,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.70299999999999996,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.61399999999999999,"15min":0.63},"min":{"1min":0.42599999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.82099999999999995,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.56399999999999995}]},{"osd":7,"last update":"Wed Jan 31 05:10:58 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.629,"15min":0.63200000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.78000000000000003,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.47699999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.91300000000000003,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.68400000000000005}]},{"osd":8,"last update":"Wed Jan 31 05:10:17 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.67100000000000004,"15min":0.68700000000000006},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81399999999999995,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.747,"15min":0.79400000000000004},"min":{"1min":0.48599999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.80200000000000005,"5min":3.3130000000000002,"15min":3.3130000000000002},"last":0.67500000000000004}]},{"osd":9,"last update":"Wed Jan 31 05:10:45 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.65400000000000003,"15min":0.69299999999999995},"min":{"1min":0.40000000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76600000000000001,"5min":1,"15min":1},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.63700000000000001,"15min":0.66700000000000004},"min":{"1min":0.41899999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82499999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.59199999999999997}]},{"osd":10,"last update":"Wed Jan 31 05:11:12 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.73799999999999999,"15min":0.76700000000000002},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.89400000000000002,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.748},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.73199999999999998,"15min":0.749},"min":{"1min":0.51000000000000001,"5min":0.501,"15min":0.501},"max":{"1min":0.88700000000000001,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.73899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1036288,"data_stored":528660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:10:34 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51800000000000002,"15min":0.49399999999999999},"min":{"1min":0.36199999999999999,"5min":0.29999999999999999,"15min":0.29399999999999998},"max":{"1min":0.76600000000000001,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.497},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.55100000000000005,"15min":0.51700000000000002},"min":{"1min":0.39200000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.84399999999999997,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.51300000000000001}]},{"osd":2,"last update":"Wed Jan 31 05:10:59 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.61599999999999999,"15min":0.54000000000000004},"min":{"1min":0.48299999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.58899999999999997,"15min":0.52100000000000002},"min":{"1min":0.42199999999999999,"5min":0.36799999999999999,"15min":0.316},"max":{"1min":0.82099999999999995,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.67900000000000005}]},{"osd":3,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.52100000000000002,"15min":0.49399999999999999},"min":{"1min":0.40899999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.56699999999999995,"15min":0.51200000000000001},"min":{"1min":0.496,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.91600000000000004,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.45100000000000001}]},{"osd":4,"last update":"Wed Jan 31 05:10:47 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.47099999999999997,"15min":0.443},"min":{"1min":0.33100000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.78000000000000003,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.48499999999999999,"15min":0.45100000000000001},"min":{"1min":0.36299999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.71499999999999997,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.38700000000000001}]},{"osd":5,"last update":"Wed Jan 31 05:11:08 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.65000000000000002,"15min":0.57499999999999996},"min":{"1min":0.55900000000000005,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.64500000000000002,"15min":0.58199999999999996},"min":{"1min":0.57099999999999995,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.58599999999999997}]},{"osd":6,"last update":"Wed Jan 31 05:10:34 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.59699999999999998,"15min":0.58499999999999996},"min":{"1min":0.48199999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83899999999999997,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.65000000000000002,"15min":0.61899999999999999},"min":{"1min":0.54100000000000004,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.98899999999999999,"5min":0.998,"15min":0.998},"last":0.66100000000000003}]},{"osd":7,"last update":"Wed Jan 31 05:10:59 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.625,"15min":0.58799999999999997},"min":{"1min":0.437,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.95999999999999996,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.61399999999999999,"15min":0.59899999999999998},"min":{"1min":0.47299999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88200000000000001,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.59899999999999998}]},{"osd":8,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.69899999999999995,"15min":0.67300000000000004},"min":{"1min":0.51200000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.69199999999999995,"15min":0.66900000000000004},"min":{"1min":0.58999999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.64400000000000002}]},{"osd":9,"last update":"Wed Jan 31 05:10:47 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.749,"15min":0.74099999999999999},"min":{"1min":0.63400000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.036,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.70299999999999996,"15min":0.69599999999999995},"min":{"1min":0.56100000000000005,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.94299999999999995,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.63100000000000001}]},{"osd":10,"last update":"Wed Jan 31 05:11:14 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.77700000000000002,"15min":0.752},"min":{"1min":0.68500000000000005,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0860000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.76800000000000002,"15min":0.749},"min":{"1min":0.66600000000000004,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.72499999999999998}]},{"osd":11,"last update":"Wed Jan 31 05:10:25 2024","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.747}]}]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":991232,"data_stored":464502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 31 05:10:33 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":0.62,"15min":0.56100000000000005},"min":{"1min":0.40500000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":9.5289999999999999,"5min":9.5289999999999999,"15min":9.5289999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54700000000000004,"15min":0.53300000000000003},"min":{"1min":0.38700000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.74399999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.48799999999999999}]},{"osd":2,"last update":"Wed Jan 31 05:11:04 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.57399999999999995,"15min":0.55200000000000005},"min":{"1min":0.46999999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.79900000000000004,"5min":0.873,"15min":0.873},"last":0.626},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.753,"15min":0.628},"min":{"1min":0.39200000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.77200000000000002,"5min":9.4990000000000006,"15min":9.4990000000000006},"last":0.65500000000000003}]},{"osd":3,"last update":"Wed Jan 31 05:10:23 2024","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.54400000000000004}]},{"osd":4,"last update":"Wed Jan 31 05:10:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54000000000000004,"15min":0.52300000000000002},"min":{"1min":0.40600000000000003,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72999999999999998,"5min":0.748,"15min":0.748},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.0880000000000001,"5min":0.66800000000000004,"15min":0.55300000000000005},"min":{"1min":0.434,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":9.5150000000000006,"5min":9.5150000000000006,"15min":9.5150000000000006},"last":0.67600000000000005}]},{"osd":5,"last update":"Wed Jan 31 05:11:16 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56999999999999995,"15min":0.55100000000000005},"min":{"1min":0.46899999999999997,"5min":0.371,"15min":0.371},"max":{"1min":0.72199999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.74099999999999999},{"interface":"front","average":{"1min":1.256,"5min":0.93600000000000005,"15min":0.69199999999999995},"min":{"1min":0.501,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":13.021000000000001,"5min":13.021000000000001,"15min":13.021000000000001},"last":0.71799999999999997}]},{"osd":6,"last update":"Wed Jan 31 05:10:33 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.49399999999999999,"15min":0.51100000000000001},"min":{"1min":0.317,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.75700000000000001,"5min":0.878,"15min":0.878},"last":0.753},{"interface":"front","average":{"1min":0.503,"5min":0.51000000000000001,"15min":0.51400000000000001},"min":{"1min":0.308,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.68999999999999995}]},{"osd":7,"last update":"Wed Jan 31 05:08:59 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.627,"15min":0.622},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80900000000000005,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.64400000000000002,"15min":0.64200000000000002},"min":{"1min":0.47899999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.81699999999999995,"5min":0.874,"15min":0.874},"last":0.54600000000000004}]},{"osd":8,"last update":"Wed Jan 31 05:10:23 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.71899999999999997,"15min":0.67500000000000004},"min":{"1min":0.40000000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.133,"5min":9.2840000000000007,"15min":9.2840000000000007},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70199999999999996,"15min":0.71999999999999997},"min":{"1min":0.52500000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.85399999999999998,"5min":1.006,"15min":1.006},"last":0.82399999999999995}]},{"osd":9,"last update":"Wed Jan 31 05:10:44 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.63700000000000001,"15min":0.68300000000000005},"min":{"1min":0.38600000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.72099999999999997,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.625,"15min":0.67300000000000004},"min":{"1min":0.34999999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73299999999999998,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.76600000000000001}]},{"osd":10,"last update":"Wed Jan 31 05:11:16 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.64400000000000002,"15min":0.65400000000000003},"min":{"1min":0.497,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.81000000000000005,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68999999999999995,"15min":0.70099999999999996},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.90900000000000003,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.86599999999999999}]},{"osd":11,"last update":"Wed Jan 31 05:10:33 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.65100000000000002,"15min":0.64300000000000002},"min":{"1min":0.56100000000000005,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.79400000000000004,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71499999999999997,"15min":0.71399999999999997},"min":{"1min":0.57499999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.84599999999999997,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.84799999999999998}]}]},{"osd":2,"up_from":18,"seq":77309411411,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1056768,"data_stored":529860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:10:59 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.54100000000000004,"15min":0.48699999999999999},"min":{"1min":0.34000000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.53400000000000003,"15min":0.504},"min":{"1min":0.41599999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.73299999999999998,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.42099999999999999}]},{"osd":1,"last update":"Wed Jan 31 05:10:59 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.56200000000000006,"15min":0.52100000000000002},"min":{"1min":0.372,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80800000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.58999999999999997,"15min":0.53700000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.48099999999999998}]},{"osd":3,"last update":"Wed Jan 31 05:10:22 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.57199999999999995,"15min":0.53000000000000003},"min":{"1min":0.48699999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57199999999999995,"15min":0.53800000000000003},"min":{"1min":0.41099999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.753,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.442}]},{"osd":4,"last update":"Wed Jan 31 05:10:22 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.52300000000000002}]},{"osd":5,"last update":"Wed Jan 31 05:11:03 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.47699999999999998,"15min":0.42599999999999999},"min":{"1min":0.39500000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.495,"15min":0.45200000000000001},"min":{"1min":0.40500000000000003,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.89500000000000002,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.34000000000000002}]},{"osd":6,"last update":"Wed Jan 31 05:10:34 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.61399999999999999,"15min":0.56200000000000006},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.89700000000000002,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.60299999999999998,"15min":0.57699999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.68600000000000005}]},{"osd":7,"last update":"Wed Jan 31 05:08:55 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.77600000000000002,"15min":0.80300000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.77000000000000002,"5min":3.9449999999999998,"15min":3.9449999999999998},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.78600000000000003,"15min":0.80900000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.80600000000000005,"5min":4.1230000000000002,"15min":4.1230000000000002},"last":0.44}]},{"osd":8,"last update":"Wed Jan 31 05:11:20 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.59699999999999998,"15min":0.57799999999999996},"min":{"1min":0.33000000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.92700000000000005,"5min":1.036,"15min":1.036},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.65400000000000003,"15min":0.63100000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.96799999999999997,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.626}]},{"osd":9,"last update":"Wed Jan 31 05:10:50 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.72899999999999998,"15min":0.72399999999999998},"min":{"1min":0.56100000000000005,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.95099999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.5740000000000001,"5min":0.85699999999999998,"15min":0.73699999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":19.821999999999999,"5min":19.821999999999999,"15min":19.821999999999999},"last":0.61799999999999999}]},{"osd":10,"last update":"Wed Jan 31 05:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.69599999999999995,"15min":0.69499999999999995},"min":{"1min":0.56100000000000005,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.74199999999999999,"15min":0.71399999999999997},"min":{"1min":0.58999999999999997,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.66300000000000003}]},{"osd":11,"last update":"Wed Jan 31 05:10:22 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.70299999999999996}]}]},{"osd":3,"up_from":25,"seq":107374182477,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":987136,"data_stored":462457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:10:25 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.36099999999999999,"15min":0.32300000000000001},"min":{"1min":0.25600000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.38700000000000001,"15min":0.34699999999999998},"min":{"1min":0.23899999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.47199999999999998}]},{"osd":1,"last update":"Wed Jan 31 05:10:25 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.54600000000000004,"15min":0.51200000000000001},"min":{"1min":0.42799999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.621},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.54000000000000004,"15min":0.50700000000000001},"min":{"1min":0.32600000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.55400000000000005}]},{"osd":2,"last update":"Wed Jan 31 05:10:25 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.56999999999999995,"15min":0.51300000000000001},"min":{"1min":0.44,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.55200000000000005,"15min":0.51700000000000002},"min":{"1min":0.35599999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.438}]},{"osd":4,"last update":"Wed Jan 31 05:10:47 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55400000000000005,"15min":0.52400000000000002},"min":{"1min":0.36499999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71999999999999997,"5min":1.202,"15min":1.202},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59099999999999997,"15min":0.52600000000000002},"min":{"1min":0.38300000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.94599999999999995,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.64600000000000002}]},{"osd":5,"last update":"Wed Jan 31 05:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57199999999999995,"15min":0.56399999999999995},"min":{"1min":0.40600000000000003,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.81299999999999994,"5min":1.129,"15min":1.129},"last":0.499},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60999999999999999,"15min":0.58599999999999997},"min":{"1min":0.42399999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.82499999999999996,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.41799999999999998}]},{"osd":6,"last update":"Wed Jan 31 05:10:33 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.51400000000000001,"15min":0.47599999999999998},"min":{"1min":0.318,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":2.5600000000000001,"5min":2.5600000000000001,"15min":2.5600000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.51000000000000001,"15min":0.48599999999999999},"min":{"1min":0.34399999999999997,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.7210000000000001,"5min":2.7210000000000001,"15min":2.7210000000000001},"last":0.53600000000000003}]},{"osd":7,"last update":"Wed Jan 31 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.71899999999999997,"15min":0.66900000000000004},"min":{"1min":0.49199999999999999,"5min":0.443,"15min":0.443},"max":{"1min":5.29,"5min":5.29,"15min":5.29},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.70699999999999996,"15min":0.66400000000000003},"min":{"1min":0.499,"5min":0.442,"15min":0.442},"max":{"1min":5.306,"5min":5.306,"15min":5.306},"last":0.65900000000000003}]},{"osd":8,"last update":"Wed Jan 31 05:08:16 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.68200000000000005}]},{"osd":9,"last update":"Wed Jan 31 05:10:44 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.69099999999999995,"15min":0.71899999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90400000000000003,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.63300000000000001,"15min":0.65500000000000003},"min":{"1min":0.39200000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.78900000000000003,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.57299999999999995}]},{"osd":10,"last update":"Wed Jan 31 05:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.70299999999999996,"15min":0.72299999999999998},"min":{"1min":0.50900000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.92300000000000004,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.76800000000000002,"15min":0.79400000000000004},"min":{"1min":0.55700000000000005,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.96699999999999997,"5min":1.696,"15min":1.696},"last":0.70899999999999996}]},{"osd":11,"last update":"Wed Jan 31 05:10:25 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.69499999999999995}]}]},{"osd":4,"up_from":33,"seq":141733920840,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":970752,"data_stored":463024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.502,"15min":0.497},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.51900000000000002,"15min":0.51600000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.51300000000000001}]},{"osd":1,"last update":"Wed Jan 31 05:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.39100000000000001,"15min":0.34999999999999998},"min":{"1min":0.29899999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.56299999999999994,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.376},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.41199999999999998,"15min":0.38},"min":{"1min":0.27700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.621,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.40100000000000002}]},{"osd":2,"last update":"Wed Jan 31 05:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.57299999999999995,"15min":0.54300000000000004},"min":{"1min":0.41099999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.60799999999999998,"15min":0.54600000000000004},"min":{"1min":0.45800000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.89100000000000001,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.58899999999999997}]},{"osd":3,"last update":"Wed Jan 31 05:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.58199999999999996,"15min":0.54600000000000004},"min":{"1min":0.39800000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.72999999999999998,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.55800000000000005,"15min":0.54500000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.77200000000000002,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.67200000000000004}]},{"osd":5,"last update":"Wed Jan 31 05:11:05 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.59899999999999998,"15min":0.55000000000000004},"min":{"1min":0.46200000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.86499999999999999,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.495},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.61499999999999999,"15min":0.55700000000000005},"min":{"1min":0.49099999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.80700000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.64800000000000002}]},{"osd":6,"last update":"Wed Jan 31 05:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.60499999999999998,"15min":0.58299999999999996},"min":{"1min":0.44800000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.79400000000000004,"5min":0.87,"15min":0.87},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.59899999999999998,"15min":0.58699999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.85799999999999998,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.73099999999999998}]},{"osd":7,"last update":"Wed Jan 31 05:10:55 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57699999999999996,"15min":0.54800000000000004},"min":{"1min":0.374,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.84699999999999998,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.60599999999999998,"15min":0.59399999999999997},"min":{"1min":0.42999999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82399999999999995,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.55800000000000005}]},{"osd":8,"last update":"Wed Jan 31 05:10:23 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.68000000000000005,"15min":0.67200000000000004},"min":{"1min":0.48599999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.68400000000000005,"15min":0.66900000000000004},"min":{"1min":0.495,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89300000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.62}]},{"osd":9,"last update":"Wed Jan 31 05:10:45 2024","interfaces":[{"interface":"back","average":{"1min":1.5509999999999999,"5min":0.88100000000000001,"15min":0.76700000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":19.009,"5min":19.009,"15min":19.009},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.71899999999999997,"15min":0.70899999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.89400000000000002,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.76100000000000001}]},{"osd":10,"last update":"Wed Jan 31 05:11:12 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.74399999999999999,"15min":0.74199999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95199999999999996,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.76000000000000001,"15min":0.76400000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.69699999999999995}]},{"osd":11,"last update":"Wed Jan 31 05:10:23 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.77400000000000002}]}]},{"osd":5,"up_from":38,"seq":163208757316,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32732,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712420,"statfs":{"total":95995035648,"available":95961518080,"internally_reserved":0,"allocated":1593344,"data_stored":1055629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51700000000000002,"15min":0.47699999999999998},"min":{"1min":0.33800000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.67900000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.53100000000000003,"15min":0.502},"min":{"1min":0.32400000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.76400000000000001,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.55300000000000005}]},{"osd":1,"last update":"Wed Jan 31 05:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.57799999999999996,"15min":0.53600000000000003},"min":{"1min":0.41199999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.499},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57799999999999996,"15min":0.55600000000000005},"min":{"1min":0.39000000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.77500000000000002,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.51700000000000002}]},{"osd":2,"last update":"Wed Jan 31 05:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.43099999999999999,"15min":0.40300000000000002},"min":{"1min":0.27900000000000003,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.65700000000000003,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.434,"15min":0.42099999999999999},"min":{"1min":0.32000000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.434}]},{"osd":3,"last update":"Wed Jan 31 05:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.56000000000000005,"15min":0.53000000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.70799999999999996,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.56200000000000006,"15min":0.53600000000000003},"min":{"1min":0.35799999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.79300000000000004,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.53900000000000003}]},{"osd":4,"last update":"Wed Jan 31 05:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.63900000000000001,"15min":0.60799999999999998},"min":{"1min":0.496,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.65200000000000002,"15min":0.61599999999999999},"min":{"1min":0.437,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.88500000000000001,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.73299999999999998}]},{"osd":6,"last update":"Wed Jan 31 05:10:32 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59399999999999997,"15min":0.57999999999999996},"min":{"1min":0.38700000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.82499999999999996,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60399999999999998,"15min":0.59299999999999997},"min":{"1min":0.437,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.75800000000000001,"5min":0.873,"15min":0.873},"last":0.57199999999999995}]},{"osd":7,"last update":"Wed Jan 31 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.64500000000000002,"15min":0.60699999999999998},"min":{"1min":0.42999999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.67800000000000005,"15min":0.65000000000000002},"min":{"1min":0.55800000000000005,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.58899999999999997}]},{"osd":8,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.36599999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.77500000000000002,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58199999999999996,"15min":0.58399999999999996},"min":{"1min":0.39600000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.79500000000000004,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.76400000000000001}]},{"osd":9,"last update":"Wed Jan 31 05:10:47 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68300000000000005,"15min":0.68100000000000005},"min":{"1min":0.47399999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.97399999999999998,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.68999999999999995,"15min":0.68400000000000005},"min":{"1min":0.48499999999999999,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.69799999999999995}]},{"osd":10,"last update":"Wed Jan 31 05:11:17 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.70499999999999996,"15min":0.68799999999999994},"min":{"1min":0.56100000000000005,"5min":0.497,"15min":0.497},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.73499999999999999,"15min":0.72099999999999997},"min":{"1min":0.57799999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.747}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":66867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":68067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":61980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-31T05:11:24.178 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-31T05:11:24.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.314+0000 7fb88d589640 1 -- 172.21.15.99:0/3175959797 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb888108bf0 msgr2=0x7fb88810b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:24.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.314+0000 7fb88d589640 1 --2- 172.21.15.99:0/3175959797 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb888108bf0 0x7fb88810b080 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb880009ca0 tx=0x7fb88002c180 comp rx=0 tx=0).stop 2024-01-31T05:11:24.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.314+0000 7fb88d589640 1 -- 172.21.15.99:0/3175959797 shutdown_connections 2024-01-31T05:11:24.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.314+0000 7fb88d589640 1 --2- 172.21.15.99:0/3175959797 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb888108bf0 0x7fb88810b080 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:24.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.314+0000 7fb88d589640 1 --2- 172.21.15.99:0/3175959797 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8880736d0 0x7fb888073b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:24.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.314+0000 7fb88d589640 1 --2- 172.21.15.99:0/3175959797 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb888074cb0 0x7fb888073100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:24.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.314+0000 7fb88d589640 1 -- 172.21.15.99:0/3175959797 >> 172.21.15.99:0/3175959797 conn(0x7fb8880fc290 msgr2=0x7fb8880fe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:24.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.314+0000 7fb88d589640 1 -- 172.21.15.99:0/3175959797 shutdown_connections 2024-01-31T05:11:24.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.314+0000 7fb88d589640 1 -- 172.21.15.99:0/3175959797 wait complete. 2024-01-31T05:11:24.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.315+0000 7fb88d589640 1 Processor -- start 2024-01-31T05:11:24.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.315+0000 7fb88d589640 1 -- start start 2024-01-31T05:11:24.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.315+0000 7fb88d589640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8880736d0 0x7fb888198e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:24.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.315+0000 7fb88d589640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb888074cb0 0x7fb8881993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:24.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.315+0000 7fb88d589640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb888108bf0 0x7fb8881a0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:24.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.315+0000 7fb88d589640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8881a0970 con 0x7fb888074cb0 2024-01-31T05:11:24.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.315+0000 7fb88d589640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8881a0ae0 con 0x7fb8880736d0 2024-01-31T05:11:24.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.315+0000 7fb88d589640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8881a0ca0 con 0x7fb888108bf0 2024-01-31T05:11:24.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.315+0000 7fb87e7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb888074cb0 0x7fb8881993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:24.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.315+0000 7fb87e7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb888074cb0 0x7fb8881993c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34232/0 (socket says 172.21.15.99:34232) 2024-01-31T05:11:24.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.315+0000 7fb87e7fc640 1 -- 172.21.15.99:0/1290577912 learned_addr learned my addr 172.21.15.99:0/1290577912 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:24.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.316+0000 7fb8877fe640 1 --2- 172.21.15.99:0/1290577912 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb888108bf0 0x7fb8881a0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:24.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.316+0000 7fb886ffd640 1 --2- 172.21.15.99:0/1290577912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8880736d0 0x7fb888198e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:24.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.316+0000 7fb87e7fc640 1 -- 172.21.15.99:0/1290577912 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb888108bf0 msgr2=0x7fb8881a0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:24.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.316+0000 7fb87e7fc640 1 --2- 172.21.15.99:0/1290577912 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb888108bf0 0x7fb8881a0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:24.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.316+0000 7fb87e7fc640 1 -- 172.21.15.99:0/1290577912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8880736d0 msgr2=0x7fb888198e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:24.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.316+0000 7fb87e7fc640 1 --2- 172.21.15.99:0/1290577912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8880736d0 0x7fb888198e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:24.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.316+0000 7fb87e7fc640 1 -- 172.21.15.99:0/1290577912 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb880009900 con 0x7fb888074cb0 2024-01-31T05:11:24.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.316+0000 7fb886ffd640 1 --2- 172.21.15.99:0/1290577912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8880736d0 0x7fb888198e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:11:24.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.316+0000 7fb87e7fc640 1 --2- 172.21.15.99:0/1290577912 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb888074cb0 0x7fb8881993c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb87000d950 tx=0x7fb87000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:24.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.316+0000 7fb884ff9640 1 -- 172.21.15.99:0/1290577912 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb870009c30 con 0x7fb888074cb0 2024-01-31T05:11:24.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.316+0000 7fb884ff9640 1 -- 172.21.15.99:0/1290577912 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb870009d90 con 0x7fb888074cb0 2024-01-31T05:11:24.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.316+0000 7fb88d589640 1 -- 172.21.15.99:0/1290577912 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8881a0f80 con 0x7fb888074cb0 2024-01-31T05:11:24.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.316+0000 7fb884ff9640 1 -- 172.21.15.99:0/1290577912 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87000f740 con 0x7fb888074cb0 2024-01-31T05:11:24.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.316+0000 7fb88d589640 1 -- 172.21.15.99:0/1290577912 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8881a1400 con 0x7fb888074cb0 2024-01-31T05:11:24.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.317+0000 7fb88d589640 1 -- 172.21.15.99:0/1290577912 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8881079b0 con 0x7fb888074cb0 2024-01-31T05:11:24.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.318+0000 7fb884ff9640 1 -- 172.21.15.99:0/1290577912 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 135946+0+0 (secure 0 0 0) 0x7fb870010a20 con 0x7fb888074cb0 2024-01-31T05:11:24.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.319+0000 7fb884ff9640 1 --2- 172.21.15.99:0/1290577912 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb8740a1370 0x7fb8740a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:24.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.319+0000 7fb886ffd640 1 --2- 172.21.15.99:0/1290577912 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb8740a1370 0x7fb8740a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:24.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.319+0000 7fb884ff9640 1 -- 172.21.15.99:0/1290577912 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fb8700cc820 con 0x7fb888074cb0 2024-01-31T05:11:24.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.319+0000 7fb886ffd640 1 --2- 172.21.15.99:0/1290577912 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb8740a1370 0x7fb8740a3830 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb878009b40 tx=0x7fb878005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:24.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.322+0000 7fb884ff9640 1 -- 172.21.15.99:0/1290577912 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fb870095c60 con 0x7fb888074cb0 2024-01-31T05:11:24.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.488+0000 7fb88d589640 1 -- 172.21.15.99:0/1290577912 --> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb88802cc20 con 0x7fb8740a1370 2024-01-31T05:11:24.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.498+0000 7fb884ff9640 1 -- 172.21.15.99:0/1290577912 <== mgr.14152 v2:172.21.15.99:6800/3925720924 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345237 (secure 0 0 0) 0x7fb88802cc20 con 0x7fb8740a1370 2024-01-31T05:11:24.501 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:11:24.503 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-01-31T05:11:24.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.501+0000 7fb88d589640 1 -- 172.21.15.99:0/1290577912 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb8740a1370 msgr2=0x7fb8740a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:24.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.501+0000 7fb88d589640 1 --2- 172.21.15.99:0/1290577912 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb8740a1370 0x7fb8740a3830 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb878009b40 tx=0x7fb878005e50 comp rx=0 tx=0).stop 2024-01-31T05:11:24.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.501+0000 7fb88d589640 1 -- 172.21.15.99:0/1290577912 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb888074cb0 msgr2=0x7fb8881993c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:24.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.501+0000 7fb88d589640 1 --2- 172.21.15.99:0/1290577912 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb888074cb0 0x7fb8881993c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb87000d950 tx=0x7fb87000de10 comp rx=0 tx=0).stop 2024-01-31T05:11:24.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.501+0000 7fb88d589640 1 -- 172.21.15.99:0/1290577912 shutdown_connections 2024-01-31T05:11:24.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.501+0000 7fb88d589640 1 --2- 172.21.15.99:0/1290577912 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb8740a1370 0x7fb8740a3830 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:24.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.501+0000 7fb88d589640 1 --2- 172.21.15.99:0/1290577912 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb888108bf0 0x7fb8881a0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:24.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.501+0000 7fb88d589640 1 --2- 172.21.15.99:0/1290577912 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb888074cb0 0x7fb8881993c0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:24.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.501+0000 7fb88d589640 1 --2- 172.21.15.99:0/1290577912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8880736d0 0x7fb888198e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:24.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.501+0000 7fb88d589640 1 -- 172.21.15.99:0/1290577912 >> 172.21.15.99:0/1290577912 conn(0x7fb8880fc290 msgr2=0x7fb888104b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:24.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.502+0000 7fb88d589640 1 -- 172.21.15.99:0/1290577912 shutdown_connections 2024-01-31T05:11:24.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.502+0000 7fb88d589640 1 -- 172.21.15.99:0/1290577912 wait complete. 2024-01-31T05:11:24.512 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":349,"stamp":"2024-01-31T05:11:22.623024+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659028,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1296,"num_read_kb":767,"num_write":430,"num_write_kb":3083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":1180848,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":856,"ondisk_log_size":856,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":366772,"kb_used_data":13460,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575052,"statfs":{"total":1151940427776,"available":1151564853248,"internally_reserved":0,"allocated":13783040,"data_stored":7528316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":698,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":62,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002803"},"pg_stats":[{"pgid":"3.3f","version":"88'8","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.636203+0000","last_change":"2024-01-31T05:09:20.582274+0000","last_active":"2024-01-31T05:10:50.636203+0000","last_peered":"2024-01-31T05:10:50.636203+0000","last_clean":"2024-01-31T05:10:50.636203+0000","last_became_active":"2024-01-31T05:09:20.581511+0000","last_became_peered":"2024-01-31T05:09:20.581511+0000","last_unstale":"2024-01-31T05:10:50.636203+0000","last_undegraded":"2024-01-31T05:10:50.636203+0000","last_fullsized":"2024-01-31T05:10:50.636203+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:59:10.674456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"88'4","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.630950+0000","last_change":"2024-01-31T05:09:20.581752+0000","last_active":"2024-01-31T05:10:50.630950+0000","last_peered":"2024-01-31T05:10:50.630950+0000","last_clean":"2024-01-31T05:10:50.630950+0000","last_became_active":"2024-01-31T05:09:20.581035+0000","last_became_peered":"2024-01-31T05:09:20.581035+0000","last_unstale":"2024-01-31T05:10:50.630950+0000","last_undegraded":"2024-01-31T05:10:50.630950+0000","last_fullsized":"2024-01-31T05:10:50.630950+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:03:16.999371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"88'7","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.637658+0000","last_change":"2024-01-31T05:09:20.588191+0000","last_active":"2024-01-31T05:10:50.637658+0000","last_peered":"2024-01-31T05:10:50.637658+0000","last_clean":"2024-01-31T05:10:50.637658+0000","last_became_active":"2024-01-31T05:09:20.587466+0000","last_became_peered":"2024-01-31T05:09:20.587466+0000","last_unstale":"2024-01-31T05:10:50.637658+0000","last_undegraded":"2024-01-31T05:10:50.637658+0000","last_fullsized":"2024-01-31T05:10:50.637658+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:22:29.037408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"88'8","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.627306+0000","last_change":"2024-01-31T05:09:20.589377+0000","last_active":"2024-01-31T05:10:50.627306+0000","last_peered":"2024-01-31T05:10:50.627306+0000","last_clean":"2024-01-31T05:10:50.627306+0000","last_became_active":"2024-01-31T05:09:20.589065+0000","last_became_peered":"2024-01-31T05:09:20.589065+0000","last_unstale":"2024-01-31T05:10:50.627306+0000","last_undegraded":"2024-01-31T05:10:50.627306+0000","last_fullsized":"2024-01-31T05:10:50.627306+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:57:11.612654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"88'4","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.625701+0000","last_change":"2024-01-31T05:09:20.578919+0000","last_active":"2024-01-31T05:10:50.625701+0000","last_peered":"2024-01-31T05:10:50.625701+0000","last_clean":"2024-01-31T05:10:50.625701+0000","last_became_active":"2024-01-31T05:09:20.578594+0000","last_became_peered":"2024-01-31T05:09:20.578594+0000","last_unstale":"2024-01-31T05:10:50.625701+0000","last_undegraded":"2024-01-31T05:10:50.625701+0000","last_fullsized":"2024-01-31T05:10:50.625701+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:16:57.168457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"88'6","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.634482+0000","last_change":"2024-01-31T05:09:20.586620+0000","last_active":"2024-01-31T05:10:50.634482+0000","last_peered":"2024-01-31T05:10:50.634482+0000","last_clean":"2024-01-31T05:10:50.634482+0000","last_became_active":"2024-01-31T05:09:20.586323+0000","last_became_peered":"2024-01-31T05:09:20.586323+0000","last_unstale":"2024-01-31T05:10:50.634482+0000","last_undegraded":"2024-01-31T05:10:50.634482+0000","last_fullsized":"2024-01-31T05:10:50.634482+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:03:31.479078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"88'5","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.639286+0000","last_change":"2024-01-31T05:09:20.595122+0000","last_active":"2024-01-31T05:10:50.639286+0000","last_peered":"2024-01-31T05:10:50.639286+0000","last_clean":"2024-01-31T05:10:50.639286+0000","last_became_active":"2024-01-31T05:09:20.594766+0000","last_became_peered":"2024-01-31T05:09:20.594766+0000","last_unstale":"2024-01-31T05:10:50.639286+0000","last_undegraded":"2024-01-31T05:10:50.639286+0000","last_fullsized":"2024-01-31T05:10:50.639286+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:18:40.002855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"88'9","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.635983+0000","last_change":"2024-01-31T05:10:21.686734+0000","last_active":"2024-01-31T05:10:50.635983+0000","last_peered":"2024-01-31T05:10:50.635983+0000","last_clean":"2024-01-31T05:10:50.635983+0000","last_became_active":"2024-01-31T05:10:21.686293+0000","last_became_peered":"2024-01-31T05:10:21.686293+0000","last_unstale":"2024-01-31T05:10:50.635983+0000","last_undegraded":"2024-01-31T05:10:50.635983+0000","last_fullsized":"2024-01-31T05:10:50.635983+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:19:35.416043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"88'11","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.639501+0000","last_change":"2024-01-31T05:09:20.588892+0000","last_active":"2024-01-31T05:10:50.639501+0000","last_peered":"2024-01-31T05:10:50.639501+0000","last_clean":"2024-01-31T05:10:50.639501+0000","last_became_active":"2024-01-31T05:09:20.588212+0000","last_became_peered":"2024-01-31T05:09:20.588212+0000","last_unstale":"2024-01-31T05:10:50.639501+0000","last_undegraded":"2024-01-31T05:10:50.639501+0000","last_fullsized":"2024-01-31T05:10:50.639501+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:49:45.270341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"88'16","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.627823+0000","last_change":"2024-01-31T05:09:20.589396+0000","last_active":"2024-01-31T05:10:50.627823+0000","last_peered":"2024-01-31T05:10:50.627823+0000","last_clean":"2024-01-31T05:10:50.627823+0000","last_became_active":"2024-01-31T05:09:20.589058+0000","last_became_peered":"2024-01-31T05:09:20.589058+0000","last_unstale":"2024-01-31T05:10:50.627823+0000","last_undegraded":"2024-01-31T05:10:50.627823+0000","last_fullsized":"2024-01-31T05:10:50.627823+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:05:53.403136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"88'6","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.641135+0000","last_change":"2024-01-31T05:09:20.592010+0000","last_active":"2024-01-31T05:10:50.641135+0000","last_peered":"2024-01-31T05:10:50.641135+0000","last_clean":"2024-01-31T05:10:50.641135+0000","last_became_active":"2024-01-31T05:09:20.591714+0000","last_became_peered":"2024-01-31T05:09:20.591714+0000","last_unstale":"2024-01-31T05:10:50.641135+0000","last_undegraded":"2024-01-31T05:10:50.641135+0000","last_fullsized":"2024-01-31T05:10:50.641135+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:56:11.651035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"88'7","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.636699+0000","last_change":"2024-01-31T05:10:21.685195+0000","last_active":"2024-01-31T05:10:50.636699+0000","last_peered":"2024-01-31T05:10:50.636699+0000","last_clean":"2024-01-31T05:10:50.636699+0000","last_became_active":"2024-01-31T05:10:21.684742+0000","last_became_peered":"2024-01-31T05:10:21.684742+0000","last_unstale":"2024-01-31T05:10:50.636699+0000","last_undegraded":"2024-01-31T05:10:50.636699+0000","last_fullsized":"2024-01-31T05:10:50.636699+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:18:59.674766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"88'10","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.629382+0000","last_change":"2024-01-31T05:09:20.582167+0000","last_active":"2024-01-31T05:10:50.629382+0000","last_peered":"2024-01-31T05:10:50.629382+0000","last_clean":"2024-01-31T05:10:50.629382+0000","last_became_active":"2024-01-31T05:09:20.581860+0000","last_became_peered":"2024-01-31T05:09:20.581860+0000","last_unstale":"2024-01-31T05:10:50.629382+0000","last_undegraded":"2024-01-31T05:10:50.629382+0000","last_fullsized":"2024-01-31T05:10:50.629382+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:46:05.891545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"88'7","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.634991+0000","last_change":"2024-01-31T05:09:20.587899+0000","last_active":"2024-01-31T05:10:50.634991+0000","last_peered":"2024-01-31T05:10:50.634991+0000","last_clean":"2024-01-31T05:10:50.634991+0000","last_became_active":"2024-01-31T05:09:20.587068+0000","last_became_peered":"2024-01-31T05:09:20.587068+0000","last_unstale":"2024-01-31T05:10:50.634991+0000","last_undegraded":"2024-01-31T05:10:50.634991+0000","last_fullsized":"2024-01-31T05:10:50.634991+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:59:44.747928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"88'7","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.635917+0000","last_change":"2024-01-31T05:09:20.590392+0000","last_active":"2024-01-31T05:10:50.635917+0000","last_peered":"2024-01-31T05:10:50.635917+0000","last_clean":"2024-01-31T05:10:50.635917+0000","last_became_active":"2024-01-31T05:09:20.590082+0000","last_became_peered":"2024-01-31T05:09:20.590082+0000","last_unstale":"2024-01-31T05:10:50.635917+0000","last_undegraded":"2024-01-31T05:10:50.635917+0000","last_fullsized":"2024-01-31T05:10:50.635917+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:59:10.672890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"88'9","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.642526+0000","last_change":"2024-01-31T05:09:20.584822+0000","last_active":"2024-01-31T05:10:50.642526+0000","last_peered":"2024-01-31T05:10:50.642526+0000","last_clean":"2024-01-31T05:10:50.642526+0000","last_became_active":"2024-01-31T05:09:20.584531+0000","last_became_peered":"2024-01-31T05:09:20.584531+0000","last_unstale":"2024-01-31T05:10:50.642526+0000","last_undegraded":"2024-01-31T05:10:50.642526+0000","last_fullsized":"2024-01-31T05:10:50.642526+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:35:44.793407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"88'8","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.636505+0000","last_change":"2024-01-31T05:09:20.582615+0000","last_active":"2024-01-31T05:10:50.636505+0000","last_peered":"2024-01-31T05:10:50.636505+0000","last_clean":"2024-01-31T05:10:50.636505+0000","last_became_active":"2024-01-31T05:09:20.581959+0000","last_became_peered":"2024-01-31T05:09:20.581959+0000","last_unstale":"2024-01-31T05:10:50.636505+0000","last_undegraded":"2024-01-31T05:10:50.636505+0000","last_fullsized":"2024-01-31T05:10:50.636505+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:29:06.817822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"88'10","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.641157+0000","last_change":"2024-01-31T05:09:20.582421+0000","last_active":"2024-01-31T05:10:50.641157+0000","last_peered":"2024-01-31T05:10:50.641157+0000","last_clean":"2024-01-31T05:10:50.641157+0000","last_became_active":"2024-01-31T05:09:20.582099+0000","last_became_peered":"2024-01-31T05:09:20.582099+0000","last_unstale":"2024-01-31T05:10:50.641157+0000","last_undegraded":"2024-01-31T05:10:50.641157+0000","last_fullsized":"2024-01-31T05:10:50.641157+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:08:03.802219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"88'7","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.630744+0000","last_change":"2024-01-31T05:09:20.580511+0000","last_active":"2024-01-31T05:10:50.630744+0000","last_peered":"2024-01-31T05:10:50.630744+0000","last_clean":"2024-01-31T05:10:50.630744+0000","last_became_active":"2024-01-31T05:09:20.579596+0000","last_became_peered":"2024-01-31T05:09:20.579596+0000","last_unstale":"2024-01-31T05:10:50.630744+0000","last_undegraded":"2024-01-31T05:10:50.630744+0000","last_fullsized":"2024-01-31T05:10:50.630744+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:07:01.206181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'14","reported_seq":147,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:11:20.329291+0000","last_change":"2024-01-31T05:09:20.187398+0000","last_active":"2024-01-31T05:11:20.329291+0000","last_peered":"2024-01-31T05:11:20.329291+0000","last_clean":"2024-01-31T05:11:20.329291+0000","last_became_active":"2024-01-31T05:09:20.186925+0000","last_became_peered":"2024-01-31T05:09:20.186925+0000","last_unstale":"2024-01-31T05:11:20.329291+0000","last_undegraded":"2024-01-31T05:11:20.329291+0000","last_fullsized":"2024-01-31T05:11:20.329291+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:33:34.624017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"88'5","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.627275+0000","last_change":"2024-01-31T05:09:20.582800+0000","last_active":"2024-01-31T05:10:50.627275+0000","last_peered":"2024-01-31T05:10:50.627275+0000","last_clean":"2024-01-31T05:10:50.627275+0000","last_became_active":"2024-01-31T05:09:20.582523+0000","last_became_peered":"2024-01-31T05:09:20.582523+0000","last_unstale":"2024-01-31T05:10:50.627275+0000","last_undegraded":"2024-01-31T05:10:50.627275+0000","last_fullsized":"2024-01-31T05:10:50.627275+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:19:57.975954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.685174+0000","last_change":"2024-01-31T05:09:20.191566+0000","last_active":"2024-01-31T05:10:21.685174+0000","last_peered":"2024-01-31T05:10:21.685174+0000","last_clean":"2024-01-31T05:10:21.685174+0000","last_became_active":"2024-01-31T05:09:20.191268+0000","last_became_peered":"2024-01-31T05:09:20.191268+0000","last_unstale":"2024-01-31T05:10:21.685174+0000","last_undegraded":"2024-01-31T05:10:21.685174+0000","last_fullsized":"2024-01-31T05:10:21.685174+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:45:40.042374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"88'6","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.637694+0000","last_change":"2024-01-31T05:09:20.579061+0000","last_active":"2024-01-31T05:10:50.637694+0000","last_peered":"2024-01-31T05:10:50.637694+0000","last_clean":"2024-01-31T05:10:50.637694+0000","last_became_active":"2024-01-31T05:09:20.578728+0000","last_became_peered":"2024-01-31T05:09:20.578728+0000","last_unstale":"2024-01-31T05:10:50.637694+0000","last_undegraded":"2024-01-31T05:10:50.637694+0000","last_fullsized":"2024-01-31T05:10:50.637694+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:57:12.142419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.683895+0000","last_change":"2024-01-31T05:09:20.187366+0000","last_active":"2024-01-31T05:10:21.683895+0000","last_peered":"2024-01-31T05:10:21.683895+0000","last_clean":"2024-01-31T05:10:21.683895+0000","last_became_active":"2024-01-31T05:09:20.186616+0000","last_became_peered":"2024-01-31T05:09:20.186616+0000","last_unstale":"2024-01-31T05:10:21.683895+0000","last_undegraded":"2024-01-31T05:10:21.683895+0000","last_fullsized":"2024-01-31T05:10:21.683895+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:39:28.802810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"88'9","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.643134+0000","last_change":"2024-01-31T05:09:20.590538+0000","last_active":"2024-01-31T05:10:50.643134+0000","last_peered":"2024-01-31T05:10:50.643134+0000","last_clean":"2024-01-31T05:10:50.643134+0000","last_became_active":"2024-01-31T05:09:20.590254+0000","last_became_peered":"2024-01-31T05:09:20.590254+0000","last_unstale":"2024-01-31T05:10:50.643134+0000","last_undegraded":"2024-01-31T05:10:50.643134+0000","last_fullsized":"2024-01-31T05:10:50.643134+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:06:38.209930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.683304+0000","last_change":"2024-01-31T05:09:20.183808+0000","last_active":"2024-01-31T05:10:21.683304+0000","last_peered":"2024-01-31T05:10:21.683304+0000","last_clean":"2024-01-31T05:10:21.683304+0000","last_became_active":"2024-01-31T05:09:20.183514+0000","last_became_peered":"2024-01-31T05:09:20.183514+0000","last_unstale":"2024-01-31T05:10:21.683304+0000","last_undegraded":"2024-01-31T05:10:21.683304+0000","last_fullsized":"2024-01-31T05:10:21.683304+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:32:43.392640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"88'15","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.644160+0000","last_change":"2024-01-31T05:09:20.590871+0000","last_active":"2024-01-31T05:10:50.644160+0000","last_peered":"2024-01-31T05:10:50.644160+0000","last_clean":"2024-01-31T05:10:50.644160+0000","last_became_active":"2024-01-31T05:09:20.588533+0000","last_became_peered":"2024-01-31T05:09:20.588533+0000","last_unstale":"2024-01-31T05:10:50.644160+0000","last_undegraded":"2024-01-31T05:10:50.644160+0000","last_fullsized":"2024-01-31T05:10:50.644160+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:44:26.772616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"88'7","reported_seq":144,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:11:20.331163+0000","last_change":"2024-01-31T05:09:20.183455+0000","last_active":"2024-01-31T05:11:20.331163+0000","last_peered":"2024-01-31T05:11:20.331163+0000","last_clean":"2024-01-31T05:11:20.331163+0000","last_became_active":"2024-01-31T05:09:20.183070+0000","last_became_peered":"2024-01-31T05:09:20.183070+0000","last_unstale":"2024-01-31T05:11:20.331163+0000","last_undegraded":"2024-01-31T05:11:20.331163+0000","last_fullsized":"2024-01-31T05:11:20.331163+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:15:29.503830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1153,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":3,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"88'7","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.603912+0000","last_change":"2024-01-31T05:09:20.580755+0000","last_active":"2024-01-31T05:10:50.603912+0000","last_peered":"2024-01-31T05:10:50.603912+0000","last_clean":"2024-01-31T05:10:50.603912+0000","last_became_active":"2024-01-31T05:09:20.580452+0000","last_became_peered":"2024-01-31T05:09:20.580452+0000","last_unstale":"2024-01-31T05:10:50.603912+0000","last_undegraded":"2024-01-31T05:10:50.603912+0000","last_fullsized":"2024-01-31T05:10:50.603912+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:29:08.383532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681549+0000","last_change":"2024-01-31T05:09:20.182129+0000","last_active":"2024-01-31T05:10:21.681549+0000","last_peered":"2024-01-31T05:10:21.681549+0000","last_clean":"2024-01-31T05:10:21.681549+0000","last_became_active":"2024-01-31T05:09:20.181781+0000","last_became_peered":"2024-01-31T05:09:20.181781+0000","last_unstale":"2024-01-31T05:10:21.681549+0000","last_undegraded":"2024-01-31T05:10:21.681549+0000","last_fullsized":"2024-01-31T05:10:21.681549+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:05:57.854213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"88'8","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.626614+0000","last_change":"2024-01-31T05:09:20.591696+0000","last_active":"2024-01-31T05:10:50.626614+0000","last_peered":"2024-01-31T05:10:50.626614+0000","last_clean":"2024-01-31T05:10:50.626614+0000","last_became_active":"2024-01-31T05:09:20.591307+0000","last_became_peered":"2024-01-31T05:09:20.591307+0000","last_unstale":"2024-01-31T05:10:50.626614+0000","last_undegraded":"2024-01-31T05:10:50.626614+0000","last_fullsized":"2024-01-31T05:10:50.626614+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:59:56.884326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.679697+0000","last_change":"2024-01-31T05:09:20.179846+0000","last_active":"2024-01-31T05:10:21.679697+0000","last_peered":"2024-01-31T05:10:21.679697+0000","last_clean":"2024-01-31T05:10:21.679697+0000","last_became_active":"2024-01-31T05:09:20.179524+0000","last_became_peered":"2024-01-31T05:09:20.179524+0000","last_unstale":"2024-01-31T05:10:21.679697+0000","last_undegraded":"2024-01-31T05:10:21.679697+0000","last_fullsized":"2024-01-31T05:10:21.679697+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:13:51.085861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"88'8","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.632540+0000","last_change":"2024-01-31T05:09:20.580076+0000","last_active":"2024-01-31T05:10:50.632540+0000","last_peered":"2024-01-31T05:10:50.632540+0000","last_clean":"2024-01-31T05:10:50.632540+0000","last_became_active":"2024-01-31T05:09:20.579764+0000","last_became_peered":"2024-01-31T05:09:20.579764+0000","last_unstale":"2024-01-31T05:10:50.632540+0000","last_undegraded":"2024-01-31T05:10:50.632540+0000","last_fullsized":"2024-01-31T05:10:50.632540+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:02:13.861848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.685470+0000","last_change":"2024-01-31T05:09:20.183941+0000","last_active":"2024-01-31T05:10:21.685470+0000","last_peered":"2024-01-31T05:10:21.685470+0000","last_clean":"2024-01-31T05:10:21.685470+0000","last_became_active":"2024-01-31T05:09:20.183631+0000","last_became_peered":"2024-01-31T05:09:20.183631+0000","last_unstale":"2024-01-31T05:10:21.685470+0000","last_undegraded":"2024-01-31T05:10:21.685470+0000","last_fullsized":"2024-01-31T05:10:21.685470+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:31:31.419345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"88'11","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.636836+0000","last_change":"2024-01-31T05:09:20.589275+0000","last_active":"2024-01-31T05:10:50.636836+0000","last_peered":"2024-01-31T05:10:50.636836+0000","last_clean":"2024-01-31T05:10:50.636836+0000","last_became_active":"2024-01-31T05:09:20.588891+0000","last_became_peered":"2024-01-31T05:09:20.588891+0000","last_unstale":"2024-01-31T05:10:50.636836+0000","last_undegraded":"2024-01-31T05:10:50.636836+0000","last_fullsized":"2024-01-31T05:10:50.636836+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:30:27.665553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"88'6","reported_seq":247,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:11:17.326414+0000","last_change":"2024-01-31T05:09:20.182836+0000","last_active":"2024-01-31T05:11:17.326414+0000","last_peered":"2024-01-31T05:11:17.326414+0000","last_clean":"2024-01-31T05:11:17.326414+0000","last_became_active":"2024-01-31T05:09:20.182376+0000","last_became_peered":"2024-01-31T05:09:20.182376+0000","last_unstale":"2024-01-31T05:11:17.326414+0000","last_undegraded":"2024-01-31T05:11:17.326414+0000","last_fullsized":"2024-01-31T05:11:17.326414+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:55:52.354323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":222,"num_read_kb":222,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"88'10","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.643818+0000","last_change":"2024-01-31T05:09:20.583592+0000","last_active":"2024-01-31T05:10:50.643818+0000","last_peered":"2024-01-31T05:10:50.643818+0000","last_clean":"2024-01-31T05:10:50.643818+0000","last_became_active":"2024-01-31T05:09:20.583247+0000","last_became_peered":"2024-01-31T05:09:20.583247+0000","last_unstale":"2024-01-31T05:10:50.643818+0000","last_undegraded":"2024-01-31T05:10:50.643818+0000","last_fullsized":"2024-01-31T05:10:50.643818+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:28:04.946620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681815+0000","last_change":"2024-01-31T05:09:20.188171+0000","last_active":"2024-01-31T05:10:21.681815+0000","last_peered":"2024-01-31T05:10:21.681815+0000","last_clean":"2024-01-31T05:10:21.681815+0000","last_became_active":"2024-01-31T05:09:20.187807+0000","last_became_peered":"2024-01-31T05:09:20.187807+0000","last_unstale":"2024-01-31T05:10:21.681815+0000","last_undegraded":"2024-01-31T05:10:21.681815+0000","last_fullsized":"2024-01-31T05:10:21.681815+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:53:22.765389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"88'9","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.635239+0000","last_change":"2024-01-31T05:09:20.589462+0000","last_active":"2024-01-31T05:10:50.635239+0000","last_peered":"2024-01-31T05:10:50.635239+0000","last_clean":"2024-01-31T05:10:50.635239+0000","last_became_active":"2024-01-31T05:09:20.589002+0000","last_became_peered":"2024-01-31T05:09:20.589002+0000","last_unstale":"2024-01-31T05:10:50.635239+0000","last_undegraded":"2024-01-31T05:10:50.635239+0000","last_fullsized":"2024-01-31T05:10:50.635239+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:41:35.918827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684998+0000","last_change":"2024-01-31T05:09:20.184963+0000","last_active":"2024-01-31T05:10:21.684998+0000","last_peered":"2024-01-31T05:10:21.684998+0000","last_clean":"2024-01-31T05:10:21.684998+0000","last_became_active":"2024-01-31T05:09:20.184590+0000","last_became_peered":"2024-01-31T05:09:20.184590+0000","last_unstale":"2024-01-31T05:10:21.684998+0000","last_undegraded":"2024-01-31T05:10:21.684998+0000","last_fullsized":"2024-01-31T05:10:21.684998+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:06:31.291846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"88'11","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.640851+0000","last_change":"2024-01-31T05:09:20.589237+0000","last_active":"2024-01-31T05:10:50.640851+0000","last_peered":"2024-01-31T05:10:50.640851+0000","last_clean":"2024-01-31T05:10:50.640851+0000","last_became_active":"2024-01-31T05:09:20.588656+0000","last_became_peered":"2024-01-31T05:09:20.588656+0000","last_unstale":"2024-01-31T05:10:50.640851+0000","last_undegraded":"2024-01-31T05:10:50.640851+0000","last_fullsized":"2024-01-31T05:10:50.640851+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:02:02.025136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"88'32","reported_seq":281,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:11:17.325862+0000","last_change":"2024-01-31T05:09:20.182539+0000","last_active":"2024-01-31T05:11:17.325862+0000","last_peered":"2024-01-31T05:11:17.325862+0000","last_clean":"2024-01-31T05:11:17.325862+0000","last_became_active":"2024-01-31T05:09:20.182229+0000","last_became_peered":"2024-01-31T05:09:20.182229+0000","last_unstale":"2024-01-31T05:11:17.325862+0000","last_undegraded":"2024-01-31T05:11:17.325862+0000","last_fullsized":"2024-01-31T05:11:17.325862+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:56:21.974450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59713,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":230,"num_read_kb":173,"num_write":34,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"88'6","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.633432+0000","last_change":"2024-01-31T05:09:20.587838+0000","last_active":"2024-01-31T05:10:50.633432+0000","last_peered":"2024-01-31T05:10:50.633432+0000","last_clean":"2024-01-31T05:10:50.633432+0000","last_became_active":"2024-01-31T05:09:20.587523+0000","last_became_peered":"2024-01-31T05:09:20.587523+0000","last_unstale":"2024-01-31T05:10:50.633432+0000","last_undegraded":"2024-01-31T05:10:50.633432+0000","last_fullsized":"2024-01-31T05:10:50.633432+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:36:17.582890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.683191+0000","last_change":"2024-01-31T05:09:20.191935+0000","last_active":"2024-01-31T05:10:21.683191+0000","last_peered":"2024-01-31T05:10:21.683191+0000","last_clean":"2024-01-31T05:10:21.683191+0000","last_became_active":"2024-01-31T05:09:20.191614+0000","last_became_peered":"2024-01-31T05:09:20.191614+0000","last_unstale":"2024-01-31T05:10:21.683191+0000","last_undegraded":"2024-01-31T05:10:21.683191+0000","last_fullsized":"2024-01-31T05:10:21.683191+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:12:38.245944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"88'9","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.632956+0000","last_change":"2024-01-31T05:09:20.585705+0000","last_active":"2024-01-31T05:10:50.632956+0000","last_peered":"2024-01-31T05:10:50.632956+0000","last_clean":"2024-01-31T05:10:50.632956+0000","last_became_active":"2024-01-31T05:09:20.585413+0000","last_became_peered":"2024-01-31T05:09:20.585413+0000","last_unstale":"2024-01-31T05:10:50.632956+0000","last_undegraded":"2024-01-31T05:10:50.632956+0000","last_fullsized":"2024-01-31T05:10:50.632956+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:35:34.686300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684861+0000","last_change":"2024-01-31T05:09:20.191975+0000","last_active":"2024-01-31T05:10:21.684861+0000","last_peered":"2024-01-31T05:10:21.684861+0000","last_clean":"2024-01-31T05:10:21.684861+0000","last_became_active":"2024-01-31T05:09:20.191666+0000","last_became_peered":"2024-01-31T05:09:20.191666+0000","last_unstale":"2024-01-31T05:10:21.684861+0000","last_undegraded":"2024-01-31T05:10:21.684861+0000","last_fullsized":"2024-01-31T05:10:21.684861+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:00:01.162509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"88'15","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.641585+0000","last_change":"2024-01-31T05:10:21.684093+0000","last_active":"2024-01-31T05:10:50.641585+0000","last_peered":"2024-01-31T05:10:50.641585+0000","last_clean":"2024-01-31T05:10:50.641585+0000","last_became_active":"2024-01-31T05:10:21.683777+0000","last_became_peered":"2024-01-31T05:10:21.683777+0000","last_unstale":"2024-01-31T05:10:50.641585+0000","last_undegraded":"2024-01-31T05:10:50.641585+0000","last_fullsized":"2024-01-31T05:10:50.641585+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:54:18.618017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'7","reported_seq":140,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:11:16.341112+0000","last_change":"2024-01-31T05:09:20.183752+0000","last_active":"2024-01-31T05:11:16.341112+0000","last_peered":"2024-01-31T05:11:16.341112+0000","last_clean":"2024-01-31T05:11:16.341112+0000","last_became_active":"2024-01-31T05:09:20.183421+0000","last_became_peered":"2024-01-31T05:09:20.183421+0000","last_unstale":"2024-01-31T05:11:16.341112+0000","last_undegraded":"2024-01-31T05:11:16.341112+0000","last_fullsized":"2024-01-31T05:11:16.341112+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:04:12.919266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1119,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":115,"num_read_kb":4,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"88'6","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.639648+0000","last_change":"2024-01-31T05:09:20.593893+0000","last_active":"2024-01-31T05:10:50.639648+0000","last_peered":"2024-01-31T05:10:50.639648+0000","last_clean":"2024-01-31T05:10:50.639648+0000","last_became_active":"2024-01-31T05:09:20.593604+0000","last_became_peered":"2024-01-31T05:09:20.593604+0000","last_unstale":"2024-01-31T05:10:50.639648+0000","last_undegraded":"2024-01-31T05:10:50.639648+0000","last_fullsized":"2024-01-31T05:10:50.639648+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:50:31.534607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.696407+0000","last_change":"2024-01-31T05:10:21.696407+0000","last_active":"2024-01-31T05:10:21.696407+0000","last_peered":"2024-01-31T05:10:21.696407+0000","last_clean":"2024-01-31T05:10:21.696407+0000","last_became_active":"2024-01-31T05:10:21.684807+0000","last_became_peered":"2024-01-31T05:10:21.684807+0000","last_unstale":"2024-01-31T05:10:21.696407+0000","last_undegraded":"2024-01-31T05:10:21.696407+0000","last_fullsized":"2024-01-31T05:10:21.696407+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:21:51.260528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"88'6","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.643658+0000","last_change":"2024-01-31T05:09:20.588049+0000","last_active":"2024-01-31T05:10:50.643658+0000","last_peered":"2024-01-31T05:10:50.643658+0000","last_clean":"2024-01-31T05:10:50.643658+0000","last_became_active":"2024-01-31T05:09:20.587542+0000","last_became_peered":"2024-01-31T05:09:20.587542+0000","last_unstale":"2024-01-31T05:10:50.643658+0000","last_undegraded":"2024-01-31T05:10:50.643658+0000","last_fullsized":"2024-01-31T05:10:50.643658+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:19:55.948269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.683712+0000","last_change":"2024-01-31T05:09:20.185328+0000","last_active":"2024-01-31T05:10:21.683712+0000","last_peered":"2024-01-31T05:10:21.683712+0000","last_clean":"2024-01-31T05:10:21.683712+0000","last_became_active":"2024-01-31T05:09:20.184551+0000","last_became_peered":"2024-01-31T05:09:20.184551+0000","last_unstale":"2024-01-31T05:10:21.683712+0000","last_undegraded":"2024-01-31T05:10:21.683712+0000","last_fullsized":"2024-01-31T05:10:21.683712+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:19:36.143101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"88'5","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.626669+0000","last_change":"2024-01-31T05:09:20.586286+0000","last_active":"2024-01-31T05:10:50.626669+0000","last_peered":"2024-01-31T05:10:50.626669+0000","last_clean":"2024-01-31T05:10:50.626669+0000","last_became_active":"2024-01-31T05:09:20.586011+0000","last_became_peered":"2024-01-31T05:09:20.586011+0000","last_unstale":"2024-01-31T05:10:50.626669+0000","last_undegraded":"2024-01-31T05:10:50.626669+0000","last_fullsized":"2024-01-31T05:10:50.626669+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:21:23.064829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681935+0000","last_change":"2024-01-31T05:09:20.183083+0000","last_active":"2024-01-31T05:10:21.681935+0000","last_peered":"2024-01-31T05:10:21.681935+0000","last_clean":"2024-01-31T05:10:21.681935+0000","last_became_active":"2024-01-31T05:09:20.182742+0000","last_became_peered":"2024-01-31T05:09:20.182742+0000","last_unstale":"2024-01-31T05:10:21.681935+0000","last_undegraded":"2024-01-31T05:10:21.681935+0000","last_fullsized":"2024-01-31T05:10:21.681935+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:12:02.081688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"88'5","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.624298+0000","last_change":"2024-01-31T05:09:20.591522+0000","last_active":"2024-01-31T05:10:50.624298+0000","last_peered":"2024-01-31T05:10:50.624298+0000","last_clean":"2024-01-31T05:10:50.624298+0000","last_became_active":"2024-01-31T05:09:20.591224+0000","last_became_peered":"2024-01-31T05:09:20.591224+0000","last_unstale":"2024-01-31T05:10:50.624298+0000","last_undegraded":"2024-01-31T05:10:50.624298+0000","last_fullsized":"2024-01-31T05:10:50.624298+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:24:17.153662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'6","reported_seq":141,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:11:21.331128+0000","last_change":"2024-01-31T05:09:20.186176+0000","last_active":"2024-01-31T05:11:21.331128+0000","last_peered":"2024-01-31T05:11:21.331128+0000","last_clean":"2024-01-31T05:11:21.331128+0000","last_became_active":"2024-01-31T05:09:20.185873+0000","last_became_peered":"2024-01-31T05:09:20.185873+0000","last_unstale":"2024-01-31T05:11:21.331128+0000","last_undegraded":"2024-01-31T05:11:21.331128+0000","last_fullsized":"2024-01-31T05:11:21.331128+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:55:12.689664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"88'7","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.622708+0000","last_change":"2024-01-31T05:09:20.587556+0000","last_active":"2024-01-31T05:10:50.622708+0000","last_peered":"2024-01-31T05:10:50.622708+0000","last_clean":"2024-01-31T05:10:50.622708+0000","last_became_active":"2024-01-31T05:09:20.587275+0000","last_became_peered":"2024-01-31T05:09:20.587275+0000","last_unstale":"2024-01-31T05:10:50.622708+0000","last_undegraded":"2024-01-31T05:10:50.622708+0000","last_fullsized":"2024-01-31T05:10:50.622708+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:35:16.022422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"88'8","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.628254+0000","last_change":"2024-01-31T05:09:20.588044+0000","last_active":"2024-01-31T05:10:50.628254+0000","last_peered":"2024-01-31T05:10:50.628254+0000","last_clean":"2024-01-31T05:10:50.628254+0000","last_became_active":"2024-01-31T05:09:20.587526+0000","last_became_peered":"2024-01-31T05:09:20.587526+0000","last_unstale":"2024-01-31T05:10:50.628254+0000","last_undegraded":"2024-01-31T05:10:50.628254+0000","last_fullsized":"2024-01-31T05:10:50.628254+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:49:07.270009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'6","reported_seq":141,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:11:20.346466+0000","last_change":"2024-01-31T05:09:20.194791+0000","last_active":"2024-01-31T05:11:20.346466+0000","last_peered":"2024-01-31T05:11:20.346466+0000","last_clean":"2024-01-31T05:11:20.346466+0000","last_became_active":"2024-01-31T05:09:20.194454+0000","last_became_peered":"2024-01-31T05:09:20.194454+0000","last_unstale":"2024-01-31T05:11:20.346466+0000","last_undegraded":"2024-01-31T05:11:20.346466+0000","last_fullsized":"2024-01-31T05:11:20.346466+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:31:26.809960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":116,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"88'8","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.624590+0000","last_change":"2024-01-31T05:09:20.585022+0000","last_active":"2024-01-31T05:10:50.624590+0000","last_peered":"2024-01-31T05:10:50.624590+0000","last_clean":"2024-01-31T05:10:50.624590+0000","last_became_active":"2024-01-31T05:09:20.584709+0000","last_became_peered":"2024-01-31T05:09:20.584709+0000","last_unstale":"2024-01-31T05:10:50.624590+0000","last_undegraded":"2024-01-31T05:10:50.624590+0000","last_fullsized":"2024-01-31T05:10:50.624590+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:10:45.616985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.688980+0000","last_change":"2024-01-31T05:09:20.183779+0000","last_active":"2024-01-31T05:10:21.688980+0000","last_peered":"2024-01-31T05:10:21.688980+0000","last_clean":"2024-01-31T05:10:21.688980+0000","last_became_active":"2024-01-31T05:09:20.183399+0000","last_became_peered":"2024-01-31T05:09:20.183399+0000","last_unstale":"2024-01-31T05:10:21.688980+0000","last_undegraded":"2024-01-31T05:10:21.688980+0000","last_fullsized":"2024-01-31T05:10:21.688980+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:48:43.831022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":346,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681361+0000","last_change":"2024-01-31T05:08:10.168270+0000","last_active":"2024-01-31T05:10:21.681361+0000","last_peered":"2024-01-31T05:10:21.681361+0000","last_clean":"2024-01-31T05:10:21.681361+0000","last_became_active":"2024-01-31T05:08:10.167743+0000","last_became_peered":"2024-01-31T05:08:10.167743+0000","last_unstale":"2024-01-31T05:10:21.681361+0000","last_undegraded":"2024-01-31T05:10:21.681361+0000","last_fullsized":"2024-01-31T05:10:21.681361+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:46.976985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:46.976985+0000","last_clean_scrub_stamp":"2024-01-31T05:04:46.976985+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:21:54.724227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"88'5","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.633053+0000","last_change":"2024-01-31T05:09:20.583135+0000","last_active":"2024-01-31T05:10:50.633053+0000","last_peered":"2024-01-31T05:10:50.633053+0000","last_clean":"2024-01-31T05:10:50.633053+0000","last_became_active":"2024-01-31T05:09:20.582850+0000","last_became_peered":"2024-01-31T05:09:20.582850+0000","last_unstale":"2024-01-31T05:10:50.633053+0000","last_undegraded":"2024-01-31T05:10:50.633053+0000","last_fullsized":"2024-01-31T05:10:50.633053+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:04:51.204561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681522+0000","last_change":"2024-01-31T05:09:20.188181+0000","last_active":"2024-01-31T05:10:21.681522+0000","last_peered":"2024-01-31T05:10:21.681522+0000","last_clean":"2024-01-31T05:10:21.681522+0000","last_became_active":"2024-01-31T05:09:20.187801+0000","last_became_peered":"2024-01-31T05:09:20.187801+0000","last_unstale":"2024-01-31T05:10:21.681522+0000","last_undegraded":"2024-01-31T05:10:21.681522+0000","last_fullsized":"2024-01-31T05:10:21.681522+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:27:05.269615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.683769+0000","last_change":"2024-01-31T05:09:20.186242+0000","last_active":"2024-01-31T05:10:21.683769+0000","last_peered":"2024-01-31T05:10:21.683769+0000","last_clean":"2024-01-31T05:10:21.683769+0000","last_became_active":"2024-01-31T05:09:20.185908+0000","last_became_peered":"2024-01-31T05:09:20.185908+0000","last_unstale":"2024-01-31T05:10:21.683769+0000","last_undegraded":"2024-01-31T05:10:21.683769+0000","last_fullsized":"2024-01-31T05:10:21.683769+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:33:40.859324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"88'9","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.629900+0000","last_change":"2024-01-31T05:09:20.590896+0000","last_active":"2024-01-31T05:10:50.629900+0000","last_peered":"2024-01-31T05:10:50.629900+0000","last_clean":"2024-01-31T05:10:50.629900+0000","last_became_active":"2024-01-31T05:09:20.590546+0000","last_became_peered":"2024-01-31T05:09:20.590546+0000","last_unstale":"2024-01-31T05:10:50.629900+0000","last_undegraded":"2024-01-31T05:10:50.629900+0000","last_fullsized":"2024-01-31T05:10:50.629900+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:39:05.969756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"88'11","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.994781+0000","last_change":"2024-01-31T05:09:20.185811+0000","last_active":"2024-01-31T05:10:50.994781+0000","last_peered":"2024-01-31T05:10:50.994781+0000","last_clean":"2024-01-31T05:10:50.994781+0000","last_became_active":"2024-01-31T05:09:20.185490+0000","last_became_peered":"2024-01-31T05:09:20.185490+0000","last_unstale":"2024-01-31T05:10:50.994781+0000","last_undegraded":"2024-01-31T05:10:50.994781+0000","last_fullsized":"2024-01-31T05:10:50.994781+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:16:25.446046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"88'5","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.631208+0000","last_change":"2024-01-31T05:09:20.585298+0000","last_active":"2024-01-31T05:10:50.631208+0000","last_peered":"2024-01-31T05:10:50.631208+0000","last_clean":"2024-01-31T05:10:50.631208+0000","last_became_active":"2024-01-31T05:09:20.584256+0000","last_became_peered":"2024-01-31T05:09:20.584256+0000","last_unstale":"2024-01-31T05:10:50.631208+0000","last_undegraded":"2024-01-31T05:10:50.631208+0000","last_fullsized":"2024-01-31T05:10:50.631208+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:48:10.331714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.689153+0000","last_change":"2024-01-31T05:09:20.184960+0000","last_active":"2024-01-31T05:10:21.689153+0000","last_peered":"2024-01-31T05:10:21.689153+0000","last_clean":"2024-01-31T05:10:21.689153+0000","last_became_active":"2024-01-31T05:09:20.184599+0000","last_became_peered":"2024-01-31T05:09:20.184599+0000","last_unstale":"2024-01-31T05:10:21.689153+0000","last_undegraded":"2024-01-31T05:10:21.689153+0000","last_fullsized":"2024-01-31T05:10:21.689153+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:07:01.846976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"88'7","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.635507+0000","last_change":"2024-01-31T05:09:20.588597+0000","last_active":"2024-01-31T05:10:50.635507+0000","last_peered":"2024-01-31T05:10:50.635507+0000","last_clean":"2024-01-31T05:10:50.635507+0000","last_became_active":"2024-01-31T05:09:20.588326+0000","last_became_peered":"2024-01-31T05:09:20.588326+0000","last_unstale":"2024-01-31T05:10:50.635507+0000","last_undegraded":"2024-01-31T05:10:50.635507+0000","last_fullsized":"2024-01-31T05:10:50.635507+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:31:53.873261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684381+0000","last_change":"2024-01-31T05:09:20.186196+0000","last_active":"2024-01-31T05:10:21.684381+0000","last_peered":"2024-01-31T05:10:21.684381+0000","last_clean":"2024-01-31T05:10:21.684381+0000","last_became_active":"2024-01-31T05:09:20.185373+0000","last_became_peered":"2024-01-31T05:09:20.185373+0000","last_unstale":"2024-01-31T05:10:21.684381+0000","last_undegraded":"2024-01-31T05:10:21.684381+0000","last_fullsized":"2024-01-31T05:10:21.684381+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:13:07.826906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"88'2","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.595768+0000","last_change":"2024-01-31T05:09:20.589183+0000","last_active":"2024-01-31T05:10:50.595768+0000","last_peered":"2024-01-31T05:10:50.595768+0000","last_clean":"2024-01-31T05:10:50.595768+0000","last_became_active":"2024-01-31T05:09:20.588884+0000","last_became_peered":"2024-01-31T05:09:20.588884+0000","last_unstale":"2024-01-31T05:10:50.595768+0000","last_undegraded":"2024-01-31T05:10:50.595768+0000","last_fullsized":"2024-01-31T05:10:50.595768+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:23:49.878076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684293+0000","last_change":"2024-01-31T05:09:20.184849+0000","last_active":"2024-01-31T05:10:21.684293+0000","last_peered":"2024-01-31T05:10:21.684293+0000","last_clean":"2024-01-31T05:10:21.684293+0000","last_became_active":"2024-01-31T05:09:20.184491+0000","last_became_peered":"2024-01-31T05:09:20.184491+0000","last_unstale":"2024-01-31T05:10:21.684293+0000","last_undegraded":"2024-01-31T05:10:21.684293+0000","last_fullsized":"2024-01-31T05:10:21.684293+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:36:31.757646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"88'9","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.634337+0000","last_change":"2024-01-31T05:09:20.585917+0000","last_active":"2024-01-31T05:10:50.634337+0000","last_peered":"2024-01-31T05:10:50.634337+0000","last_clean":"2024-01-31T05:10:50.634337+0000","last_became_active":"2024-01-31T05:09:20.585082+0000","last_became_peered":"2024-01-31T05:09:20.585082+0000","last_unstale":"2024-01-31T05:10:50.634337+0000","last_undegraded":"2024-01-31T05:10:50.634337+0000","last_fullsized":"2024-01-31T05:10:50.634337+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:30:17.670739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.699341+0000","last_change":"2024-01-31T05:10:21.699341+0000","last_active":"2024-01-31T05:10:21.699341+0000","last_peered":"2024-01-31T05:10:21.699341+0000","last_clean":"2024-01-31T05:10:21.699341+0000","last_became_active":"2024-01-31T05:10:21.684981+0000","last_became_peered":"2024-01-31T05:10:21.684981+0000","last_unstale":"2024-01-31T05:10:21.699341+0000","last_undegraded":"2024-01-31T05:10:21.699341+0000","last_fullsized":"2024-01-31T05:10:21.699341+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:36:33.975341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"88'8","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.616883+0000","last_change":"2024-01-31T05:09:20.580332+0000","last_active":"2024-01-31T05:10:50.616883+0000","last_peered":"2024-01-31T05:10:50.616883+0000","last_clean":"2024-01-31T05:10:50.616883+0000","last_became_active":"2024-01-31T05:09:20.580014+0000","last_became_peered":"2024-01-31T05:09:20.580014+0000","last_unstale":"2024-01-31T05:10:50.616883+0000","last_undegraded":"2024-01-31T05:10:50.616883+0000","last_fullsized":"2024-01-31T05:10:50.616883+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:38:52.507575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.683162+0000","last_change":"2024-01-31T05:09:20.186065+0000","last_active":"2024-01-31T05:10:21.683162+0000","last_peered":"2024-01-31T05:10:21.683162+0000","last_clean":"2024-01-31T05:10:21.683162+0000","last_became_active":"2024-01-31T05:09:20.185798+0000","last_became_peered":"2024-01-31T05:09:20.185798+0000","last_unstale":"2024-01-31T05:10:21.683162+0000","last_undegraded":"2024-01-31T05:10:21.683162+0000","last_fullsized":"2024-01-31T05:10:21.683162+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:25:05.792886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"88'5","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.640228+0000","last_change":"2024-01-31T05:09:20.589746+0000","last_active":"2024-01-31T05:10:50.640228+0000","last_peered":"2024-01-31T05:10:50.640228+0000","last_clean":"2024-01-31T05:10:50.640228+0000","last_became_active":"2024-01-31T05:09:20.589452+0000","last_became_peered":"2024-01-31T05:09:20.589452+0000","last_unstale":"2024-01-31T05:10:50.640228+0000","last_undegraded":"2024-01-31T05:10:50.640228+0000","last_fullsized":"2024-01-31T05:10:50.640228+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:04:39.773280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'8","reported_seq":147,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:11:20.331308+0000","last_change":"2024-01-31T05:09:20.181920+0000","last_active":"2024-01-31T05:11:20.331308+0000","last_peered":"2024-01-31T05:11:20.331308+0000","last_clean":"2024-01-31T05:11:20.331308+0000","last_became_active":"2024-01-31T05:09:20.181603+0000","last_became_peered":"2024-01-31T05:09:20.181603+0000","last_unstale":"2024-01-31T05:11:20.331308+0000","last_undegraded":"2024-01-31T05:11:20.331308+0000","last_fullsized":"2024-01-31T05:11:20.331308+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:11:30.696322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2009,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"88'7","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.638413+0000","last_change":"2024-01-31T05:09:20.592244+0000","last_active":"2024-01-31T05:10:50.638413+0000","last_peered":"2024-01-31T05:10:50.638413+0000","last_clean":"2024-01-31T05:10:50.638413+0000","last_became_active":"2024-01-31T05:09:20.591940+0000","last_became_peered":"2024-01-31T05:09:20.591940+0000","last_unstale":"2024-01-31T05:10:50.638413+0000","last_undegraded":"2024-01-31T05:10:50.638413+0000","last_fullsized":"2024-01-31T05:10:50.638413+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:16:02.284216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684890+0000","last_change":"2024-01-31T05:09:20.192018+0000","last_active":"2024-01-31T05:10:21.684890+0000","last_peered":"2024-01-31T05:10:21.684890+0000","last_clean":"2024-01-31T05:10:21.684890+0000","last_became_active":"2024-01-31T05:09:20.191721+0000","last_became_peered":"2024-01-31T05:09:20.191721+0000","last_unstale":"2024-01-31T05:10:21.684890+0000","last_undegraded":"2024-01-31T05:10:21.684890+0000","last_fullsized":"2024-01-31T05:10:21.684890+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:53:56.199730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"88'7","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.639751+0000","last_change":"2024-01-31T05:09:20.593153+0000","last_active":"2024-01-31T05:10:50.639751+0000","last_peered":"2024-01-31T05:10:50.639751+0000","last_clean":"2024-01-31T05:10:50.639751+0000","last_became_active":"2024-01-31T05:09:20.592869+0000","last_became_peered":"2024-01-31T05:09:20.592869+0000","last_unstale":"2024-01-31T05:10:50.639751+0000","last_undegraded":"2024-01-31T05:10:50.639751+0000","last_fullsized":"2024-01-31T05:10:50.639751+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:35:42.234519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.679538+0000","last_change":"2024-01-31T05:09:20.191998+0000","last_active":"2024-01-31T05:10:21.679538+0000","last_peered":"2024-01-31T05:10:21.679538+0000","last_clean":"2024-01-31T05:10:21.679538+0000","last_became_active":"2024-01-31T05:09:20.191658+0000","last_became_peered":"2024-01-31T05:09:20.191658+0000","last_unstale":"2024-01-31T05:10:21.679538+0000","last_undegraded":"2024-01-31T05:10:21.679538+0000","last_fullsized":"2024-01-31T05:10:21.679538+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T17:06:39.916765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"88'9","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.641520+0000","last_change":"2024-01-31T05:09:20.586822+0000","last_active":"2024-01-31T05:10:50.641520+0000","last_peered":"2024-01-31T05:10:50.641520+0000","last_clean":"2024-01-31T05:10:50.641520+0000","last_became_active":"2024-01-31T05:09:20.586523+0000","last_became_peered":"2024-01-31T05:09:20.586523+0000","last_unstale":"2024-01-31T05:10:50.641520+0000","last_undegraded":"2024-01-31T05:10:50.641520+0000","last_fullsized":"2024-01-31T05:10:50.641520+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:02:59.311443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"88'9","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.627950+0000","last_change":"2024-01-31T05:09:20.586141+0000","last_active":"2024-01-31T05:10:50.627950+0000","last_peered":"2024-01-31T05:10:50.627950+0000","last_clean":"2024-01-31T05:10:50.627950+0000","last_became_active":"2024-01-31T05:09:20.585626+0000","last_became_peered":"2024-01-31T05:09:20.585626+0000","last_unstale":"2024-01-31T05:10:50.627950+0000","last_undegraded":"2024-01-31T05:10:50.627950+0000","last_fullsized":"2024-01-31T05:10:50.627950+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:39:18.023044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"88'12","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.635250+0000","last_change":"2024-01-31T05:09:20.588203+0000","last_active":"2024-01-31T05:10:50.635250+0000","last_peered":"2024-01-31T05:10:50.635250+0000","last_clean":"2024-01-31T05:10:50.635250+0000","last_became_active":"2024-01-31T05:09:20.586660+0000","last_became_peered":"2024-01-31T05:09:20.586660+0000","last_unstale":"2024-01-31T05:10:50.635250+0000","last_undegraded":"2024-01-31T05:10:50.635250+0000","last_fullsized":"2024-01-31T05:10:50.635250+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:27:41.249756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"88'8","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.630397+0000","last_change":"2024-01-31T05:09:20.591708+0000","last_active":"2024-01-31T05:10:50.630397+0000","last_peered":"2024-01-31T05:10:50.630397+0000","last_clean":"2024-01-31T05:10:50.630397+0000","last_became_active":"2024-01-31T05:09:20.590874+0000","last_became_peered":"2024-01-31T05:09:20.590874+0000","last_unstale":"2024-01-31T05:10:50.630397+0000","last_undegraded":"2024-01-31T05:10:50.630397+0000","last_fullsized":"2024-01-31T05:10:50.630397+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:13:30.221125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"88'7","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.635702+0000","last_change":"2024-01-31T05:09:20.587566+0000","last_active":"2024-01-31T05:10:50.635702+0000","last_peered":"2024-01-31T05:10:50.635702+0000","last_clean":"2024-01-31T05:10:50.635702+0000","last_became_active":"2024-01-31T05:09:20.587260+0000","last_became_peered":"2024-01-31T05:09:20.587260+0000","last_unstale":"2024-01-31T05:10:50.635702+0000","last_undegraded":"2024-01-31T05:10:50.635702+0000","last_fullsized":"2024-01-31T05:10:50.635702+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:32:46.030539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"88'4","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.635094+0000","last_change":"2024-01-31T05:09:20.587259+0000","last_active":"2024-01-31T05:10:50.635094+0000","last_peered":"2024-01-31T05:10:50.635094+0000","last_clean":"2024-01-31T05:10:50.635094+0000","last_became_active":"2024-01-31T05:09:20.586935+0000","last_became_peered":"2024-01-31T05:09:20.586935+0000","last_unstale":"2024-01-31T05:10:50.635094+0000","last_undegraded":"2024-01-31T05:10:50.635094+0000","last_fullsized":"2024-01-31T05:10:50.635094+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:28:23.217392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"88'6","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.627076+0000","last_change":"2024-01-31T05:09:20.587213+0000","last_active":"2024-01-31T05:10:50.627076+0000","last_peered":"2024-01-31T05:10:50.627076+0000","last_clean":"2024-01-31T05:10:50.627076+0000","last_became_active":"2024-01-31T05:09:20.586918+0000","last_became_peered":"2024-01-31T05:09:20.586918+0000","last_unstale":"2024-01-31T05:10:50.627076+0000","last_undegraded":"2024-01-31T05:10:50.627076+0000","last_fullsized":"2024-01-31T05:10:50.627076+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:39:27.541560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"88'15","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.635659+0000","last_change":"2024-01-31T05:09:20.584532+0000","last_active":"2024-01-31T05:10:50.635659+0000","last_peered":"2024-01-31T05:10:50.635659+0000","last_clean":"2024-01-31T05:10:50.635659+0000","last_became_active":"2024-01-31T05:09:20.583512+0000","last_became_peered":"2024-01-31T05:09:20.583512+0000","last_unstale":"2024-01-31T05:10:50.635659+0000","last_undegraded":"2024-01-31T05:10:50.635659+0000","last_fullsized":"2024-01-31T05:10:50.635659+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:04:33.848498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"88'2","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.627581+0000","last_change":"2024-01-31T05:09:20.587561+0000","last_active":"2024-01-31T05:10:50.627581+0000","last_peered":"2024-01-31T05:10:50.627581+0000","last_clean":"2024-01-31T05:10:50.627581+0000","last_became_active":"2024-01-31T05:09:20.587232+0000","last_became_peered":"2024-01-31T05:09:20.587232+0000","last_unstale":"2024-01-31T05:10:50.627581+0000","last_undegraded":"2024-01-31T05:10:50.627581+0000","last_fullsized":"2024-01-31T05:10:50.627581+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:17:01.913186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"88'6","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.625110+0000","last_change":"2024-01-31T05:09:20.581823+0000","last_active":"2024-01-31T05:10:50.625110+0000","last_peered":"2024-01-31T05:10:50.625110+0000","last_clean":"2024-01-31T05:10:50.625110+0000","last_became_active":"2024-01-31T05:09:20.581560+0000","last_became_peered":"2024-01-31T05:09:20.581560+0000","last_unstale":"2024-01-31T05:10:50.625110+0000","last_undegraded":"2024-01-31T05:10:50.625110+0000","last_fullsized":"2024-01-31T05:10:50.625110+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:48:50.057303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"88'8","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.629758+0000","last_change":"2024-01-31T05:09:20.582477+0000","last_active":"2024-01-31T05:10:50.629758+0000","last_peered":"2024-01-31T05:10:50.629758+0000","last_clean":"2024-01-31T05:10:50.629758+0000","last_became_active":"2024-01-31T05:09:20.582051+0000","last_became_peered":"2024-01-31T05:09:20.582051+0000","last_unstale":"2024-01-31T05:10:50.629758+0000","last_undegraded":"2024-01-31T05:10:50.629758+0000","last_fullsized":"2024-01-31T05:10:50.629758+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:24:36.665707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"88'10","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.643219+0000","last_change":"2024-01-31T05:09:20.587281+0000","last_active":"2024-01-31T05:10:50.643219+0000","last_peered":"2024-01-31T05:10:50.643219+0000","last_clean":"2024-01-31T05:10:50.643219+0000","last_became_active":"2024-01-31T05:09:20.586976+0000","last_became_peered":"2024-01-31T05:09:20.586976+0000","last_unstale":"2024-01-31T05:10:50.643219+0000","last_undegraded":"2024-01-31T05:10:50.643219+0000","last_fullsized":"2024-01-31T05:10:50.643219+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:33:59.065647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"88'11","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.633364+0000","last_change":"2024-01-31T05:09:20.585953+0000","last_active":"2024-01-31T05:10:50.633364+0000","last_peered":"2024-01-31T05:10:50.633364+0000","last_clean":"2024-01-31T05:10:50.633364+0000","last_became_active":"2024-01-31T05:09:20.585406+0000","last_became_peered":"2024-01-31T05:09:20.585406+0000","last_unstale":"2024-01-31T05:10:50.633364+0000","last_undegraded":"2024-01-31T05:10:50.633364+0000","last_fullsized":"2024-01-31T05:10:50.633364+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:14:24.622166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"88'8","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.625149+0000","last_change":"2024-01-31T05:09:20.587073+0000","last_active":"2024-01-31T05:10:50.625149+0000","last_peered":"2024-01-31T05:10:50.625149+0000","last_clean":"2024-01-31T05:10:50.625149+0000","last_became_active":"2024-01-31T05:09:20.586753+0000","last_became_peered":"2024-01-31T05:09:20.586753+0000","last_unstale":"2024-01-31T05:10:50.625149+0000","last_undegraded":"2024-01-31T05:10:50.625149+0000","last_fullsized":"2024-01-31T05:10:50.625149+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:13:20.291390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68426,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1170,"num_read_kb":658,"num_write":247,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":214994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351014,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":970752,"data_stored":463936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.53700000000000003,"15min":0.54400000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.63800000000000001,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.59699999999999998,"15min":0.60499999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.753,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.47899999999999998}]},{"osd":1,"last update":"Wed Jan 31 05:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.63600000000000001,"15min":0.629},"min":{"1min":0.49299999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.60199999999999998,"15min":0.59599999999999997},"min":{"1min":0.48599999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82699999999999996,"5min":0.872,"15min":0.872},"last":0.42899999999999999}]},{"osd":2,"last update":"Wed Jan 31 05:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.48899999999999999,"15min":0.49299999999999999},"min":{"1min":0.33700000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.66200000000000003,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.371},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.498,"15min":0.502},"min":{"1min":0.34300000000000003,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.51600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":4,"last update":"Wed Jan 31 05:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.63600000000000001,"15min":0.63500000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.66600000000000004,"15min":0.66800000000000004},"min":{"1min":0.44900000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.77900000000000003,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.72899999999999998}]},{"osd":5,"last update":"Wed Jan 31 05:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.61499999999999999,"15min":0.62},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.59999999999999998,"15min":0.60899999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71499999999999997,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.71099999999999997}]},{"osd":6,"last update":"Wed Jan 31 05:09:32 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.432},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.58999999999999997}]},{"osd":7,"last update":"Wed Jan 31 05:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.73599999999999999,"15min":0.74099999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.90000000000000002,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.74299999999999999,"15min":0.75},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.88800000000000001,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.77900000000000003}]},{"osd":8,"last update":"Wed Jan 31 05:10:20 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.79500000000000004}]},{"osd":9,"last update":"Wed Jan 31 05:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.78400000000000003,"15min":0.78700000000000003},"min":{"1min":0.63,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.96699999999999997,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.56299999999999994,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.93500000000000005,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.84599999999999997}]},{"osd":10,"last update":"Wed Jan 31 05:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.78700000000000003,"15min":0.79200000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.89800000000000002,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.82099999999999995,"15min":0.82499999999999996},"min":{"1min":0.69899999999999995,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.94399999999999995,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.748}]}]},{"osd":10,"up_from":73,"seq":313532612651,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36960,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708192,"statfs":{"total":95995035648,"available":95957188608,"internally_reserved":0,"allocated":1662976,"data_stored":1114258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":36174273},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:10:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.48499999999999999}]},{"osd":1,"last update":"Wed Jan 31 05:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.47599999999999998,"15min":0.48399999999999999},"min":{"1min":0.313,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.67100000000000004,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.501,"15min":0.51300000000000001},"min":{"1min":0.316,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70699999999999996,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.623}]},{"osd":2,"last update":"Wed Jan 31 05:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59299999999999997,"15min":0.58699999999999997},"min":{"1min":0.40600000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63700000000000001,"15min":0.63300000000000001},"min":{"1min":0.439,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80100000000000005,"5min":0.874,"15min":0.874},"last":0.66700000000000004}]},{"osd":3,"last update":"Wed Jan 31 05:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.60899999999999999,"15min":0.625},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77000000000000002,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.63900000000000001,"15min":0.65600000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.79300000000000004,"5min":1.115,"15min":1.115},"last":0.56999999999999995}]},{"osd":4,"last update":"Wed Jan 31 05:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.32700000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.77500000000000002,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.76000000000000001,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.53500000000000003}]},{"osd":5,"last update":"Wed Jan 31 05:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.65700000000000003,"15min":0.65300000000000002},"min":{"1min":0.45900000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.876,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.66800000000000004,"15min":0.65600000000000003},"min":{"1min":0.51900000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.91200000000000003,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.77900000000000003}]},{"osd":6,"last update":"Wed Jan 31 05:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.70699999999999996,"15min":0.71699999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.85899999999999999,"5min":1.022,"15min":1.022},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.70799999999999996,"15min":0.72699999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.83799999999999997,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.68000000000000005}]},{"osd":7,"last update":"Wed Jan 31 05:09:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.57199999999999995}]},{"osd":8,"last update":"Wed Jan 31 05:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.749,"15min":0.76100000000000001},"min":{"1min":0.53400000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.94999999999999996,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.76400000000000001,"15min":0.77700000000000002},"min":{"1min":0.56200000000000006,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93600000000000005,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.83899999999999997}]},{"osd":9,"last update":"Wed Jan 31 05:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.78000000000000003,"15min":0.79800000000000004},"min":{"1min":0.51000000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.96299999999999997,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.77800000000000002,"15min":0.79900000000000004},"min":{"1min":0.52200000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.94999999999999996,"5min":1.452,"15min":1.452},"last":0.64800000000000002}]},{"osd":11,"last update":"Wed Jan 31 05:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.75,"15min":0.746},"min":{"1min":0.64500000000000002,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.90200000000000002,"5min":1.026,"15min":1.026},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77100000000000002,"15min":0.77000000000000002},"min":{"1min":0.61099999999999999,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.94199999999999995,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.90400000000000003}]}]},{"osd":9,"up_from":67,"seq":287762808880,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":987136,"data_stored":462915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:10:46 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.41599999999999998,"15min":0.434},"min":{"1min":0.27500000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.49099999999999999,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.53000000000000003,"15min":0.50800000000000001},"min":{"1min":0.29999999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.65700000000000003,"5min":7.8330000000000002,"15min":7.8330000000000002},"last":0.27000000000000002}]},{"osd":1,"last update":"Wed Jan 31 05:10:46 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69399999999999995,"5min":2.661,"15min":2.661},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.59599999999999997,"15min":0.61199999999999999},"min":{"1min":0.44800000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.67900000000000005,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.46200000000000002}]},{"osd":2,"last update":"Wed Jan 31 05:10:46 2024","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":0.79000000000000004,"15min":0.66200000000000003},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":19.556999999999999,"5min":19.556999999999999,"15min":19.556999999999999},"last":0.44},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.59799999999999998,"15min":0.62},"min":{"1min":0.40300000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.76800000000000002,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.51300000000000001}]},{"osd":3,"last update":"Wed Jan 31 05:10:46 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.68799999999999994,"15min":0.59199999999999997},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.65700000000000003,"5min":19.687000000000001,"15min":19.687000000000001},"last":0.312},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.57199999999999995,"15min":0.53700000000000003},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.64000000000000001,"5min":10.478,"15min":10.478},"last":0.32800000000000001}]},{"osd":4,"last update":"Wed Jan 31 05:10:46 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.63500000000000001,"15min":0.65100000000000002},"min":{"1min":0.46000000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.83599999999999997,"5min":1.002,"15min":1.002},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.69899999999999995,"15min":0.66400000000000003},"min":{"1min":0.46100000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.876,"5min":8.2289999999999992,"15min":8.2289999999999992},"last":0.60899999999999999}]},{"osd":5,"last update":"Wed Jan 31 05:10:46 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.73799999999999999,"15min":0.70099999999999996},"min":{"1min":0.41999999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.92800000000000005,"5min":9.9339999999999993,"15min":9.9339999999999993},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.68899999999999995,"15min":0.70699999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.75600000000000001,"5min":2.8130000000000002,"15min":2.8130000000000002},"last":0.48399999999999999}]},{"osd":6,"last update":"Wed Jan 31 05:10:46 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.60699999999999998,"15min":0.63500000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.75,"5min":3.141,"15min":3.141},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.68400000000000005,"15min":0.70799999999999996},"min":{"1min":0.38400000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.877,"5min":2.9350000000000001,"15min":2.9350000000000001},"last":0.376}]},{"osd":7,"last update":"Wed Jan 31 05:10:46 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.78700000000000003,"15min":0.75700000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.84499999999999997,"5min":8.2639999999999993,"15min":8.2639999999999993},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.81699999999999995,"15min":0.78500000000000003},"min":{"1min":0.50800000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.87,"5min":10.438000000000001,"15min":10.438000000000001},"last":0.52700000000000002}]},{"osd":8,"last update":"Wed Jan 31 05:10:46 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.77400000000000002,"15min":0.78600000000000003},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.4490000000000001,"5min":2.8889999999999998,"15min":2.8889999999999998},"last":0.496},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.91000000000000003,"15min":0.83399999999999996},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.95499999999999996,"5min":17.093,"15min":17.093},"last":0.55300000000000005}]},{"osd":10,"last update":"Wed Jan 31 05:11:15 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.748,"15min":0.76700000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.89900000000000002,"5min":1.111,"15min":1.111},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.82199999999999995,"15min":0.78500000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.81399999999999995,"5min":9.5899999999999999,"15min":9.5899999999999999},"last":0.67200000000000004}]}]},{"osd":8,"up_from":59,"seq":253403070517,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":974848,"data_stored":463181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.60799999999999998,"15min":0.58799999999999997},"min":{"1min":0.373,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":3.5819999999999999,"5min":3.5819999999999999,"15min":3.5819999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.57499999999999996,"15min":0.58599999999999997},"min":{"1min":0.38800000000000001,"5min":0.316,"15min":0.316},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.85799999999999998}]},{"osd":1,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.63700000000000001,"15min":0.61299999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":2.7679999999999998,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.65800000000000003,"15min":0.63400000000000001},"min":{"1min":0.47699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":3.2389999999999999,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.73399999999999999}]},{"osd":2,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.48999999999999999,"15min":0.48399999999999999},"min":{"1min":0.32600000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.52900000000000003,"15min":0.51300000000000001},"min":{"1min":0.41799999999999998,"5min":0.251,"15min":0.251},"max":{"1min":3.9729999999999999,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":0.46100000000000002}]},{"osd":3,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.57899999999999996,"15min":0.58499999999999996},"min":{"1min":0.34100000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.64500000000000002,"15min":0.65100000000000002},"min":{"1min":0.435,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":2.8050000000000002,"5min":2.8050000000000002,"15min":2.8050000000000002},"last":0.91700000000000004}]},{"osd":4,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.68899999999999995,"15min":0.65100000000000002},"min":{"1min":0.51800000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":5.1820000000000004,"5min":5.1820000000000004,"15min":5.1820000000000004},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.68600000000000005,"15min":0.66400000000000003},"min":{"1min":0.56200000000000006,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":3.0150000000000001,"5min":3.0150000000000001,"15min":3.0150000000000001},"last":0.88900000000000001}]},{"osd":5,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.627,"15min":0.61899999999999999},"min":{"1min":0.48899999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":3.617,"5min":3.617,"15min":3.617},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.61299999999999999,"15min":0.60499999999999998},"min":{"1min":0.35899999999999999,"5min":0.317,"15min":0.317},"max":{"1min":2.9540000000000002,"5min":2.9540000000000002,"15min":2.9540000000000002},"last":0.51700000000000002}]},{"osd":6,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.70999999999999996,"15min":0.72099999999999997},"min":{"1min":0.47399999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":2.3740000000000001,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.74299999999999999,"15min":0.73799999999999999},"min":{"1min":0.54800000000000004,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":3.2749999999999999,"5min":3.2749999999999999,"15min":3.2749999999999999},"last":0.80200000000000005}]},{"osd":7,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":0.76900000000000002,"15min":0.73899999999999999},"min":{"1min":0.64100000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":4.1970000000000001,"5min":4.1970000000000001,"15min":4.1970000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.94699999999999995,"15min":0.79900000000000004},"min":{"1min":0.67900000000000005,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":2.181,"5min":19.677,"15min":19.677},"last":0.76900000000000002}]},{"osd":9,"last update":"Wed Jan 31 05:10:43 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":1.302,"15min":1.544},"min":{"1min":0.53900000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.91800000000000004,"5min":19.695,"15min":19.695},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.74199999999999999,"15min":0.69999999999999996},"min":{"1min":0.629,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0109999999999999,"5min":3.306,"15min":3.306},"last":0.878}]},{"osd":10,"last update":"Wed Jan 31 05:11:12 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.76900000000000002,"15min":0.71299999999999997},"min":{"1min":0.58099999999999996,"5min":0.439,"15min":0.439},"max":{"1min":1.0780000000000001,"5min":4.3760000000000003,"15min":4.3760000000000003},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.83199999999999996,"15min":0.76200000000000001},"min":{"1min":0.54900000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0589999999999999,"5min":6.875,"15min":6.875},"last":0.84299999999999997}]},{"osd":11,"last update":"Wed Jan 31 05:10:21 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.78400000000000003}]}]},{"osd":7,"up_from":51,"seq":219043332154,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28560,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716592,"statfs":{"total":95995035648,"available":95965790208,"internally_reserved":0,"allocated":1581056,"data_stored":1056872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:08:52 2024","interfaces":[{"interface":"back","average":{"1min":1.669,"5min":0.75600000000000001,"15min":0.60399999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":19.462,"5min":19.462,"15min":19.462},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.52900000000000003,"15min":0.51900000000000002},"min":{"1min":0.40899999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.45500000000000002}]},{"osd":1,"last update":"Wed Jan 31 05:10:57 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.41999999999999998,"15min":0.41299999999999998},"min":{"1min":0.31900000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.54300000000000004,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.46100000000000002,"15min":0.44600000000000001},"min":{"1min":0.33100000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.64300000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.42999999999999999}]},{"osd":2,"last update":"Wed Jan 31 05:10:57 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.60799999999999998,"15min":0.58999999999999997},"min":{"1min":0.46600000000000003,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60299999999999998,"15min":0.60199999999999998},"min":{"1min":0.46400000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.74199999999999999,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.60099999999999998}]},{"osd":3,"last update":"Wed Jan 31 05:10:57 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55900000000000005,"15min":0.55300000000000005},"min":{"1min":0.43099999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.80100000000000005,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.57099999999999995,"15min":0.57399999999999995},"min":{"1min":0.39800000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.70799999999999996,"5min":0.87,"15min":0.87},"last":0.51300000000000001}]},{"osd":4,"last update":"Wed Jan 31 05:10:57 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.48099999999999998,"15min":0.47799999999999998},"min":{"1min":0.32400000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.65000000000000002,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.502,"15min":0.50600000000000001},"min":{"1min":0.36399999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.63500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.56100000000000005}]},{"osd":5,"last update":"Wed Jan 31 05:10:57 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.64400000000000002,"15min":0.63},"min":{"1min":0.49299999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.64500000000000002,"15min":0.64300000000000002},"min":{"1min":0.52500000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.77100000000000002,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.753}]},{"osd":6,"last update":"Wed Jan 31 05:10:57 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.63800000000000001,"15min":0.63100000000000001},"min":{"1min":0.51000000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.751,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.88,"15min":0.72999999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.82799999999999996,"5min":19.425000000000001,"15min":19.425000000000001},"last":0.62}]},{"osd":8,"last update":"Wed Jan 31 05:10:21 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.68799999999999994,"15min":0.68200000000000005},"min":{"1min":0.61799999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.85099999999999998,"5min":0.875,"15min":0.875},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.70799999999999996,"15min":0.71199999999999997},"min":{"1min":0.56899999999999995,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.85899999999999999,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.81699999999999995}]},{"osd":9,"last update":"Wed Jan 31 05:10:42 2024","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":0.82799999999999996,"15min":0.752},"min":{"1min":0.498,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":11.433999999999999,"5min":11.433999999999999,"15min":11.433999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":1.3089999999999999,"5min":0.82099999999999995,"15min":0.73599999999999999},"min":{"1min":0.54500000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":11.416,"5min":11.416,"15min":11.416},"last":0.71799999999999997}]},{"osd":10,"last update":"Wed Jan 31 05:11:13 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.52600000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.70399999999999996,"15min":0.70599999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.63800000000000001}]},{"osd":11,"last update":"Wed Jan 31 05:10:21 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.84699999999999998}]}]},{"osd":6,"up_from":46,"seq":197568495679,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":970752,"data_stored":463022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:10:34 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.378,"15min":0.37},"min":{"1min":0.28100000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.53400000000000003,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.378},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.40600000000000003,"15min":0.40799999999999997},"min":{"1min":0.28499999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.35799999999999998}]},{"osd":1,"last update":"Wed Jan 31 05:10:34 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.54700000000000004,"15min":0.53900000000000003},"min":{"1min":0.40899999999999997,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56200000000000006,"15min":0.55400000000000005},"min":{"1min":0.42699999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.83599999999999997,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.622}]},{"osd":2,"last update":"Wed Jan 31 05:10:34 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.55400000000000005,"15min":0.55200000000000005},"min":{"1min":0.39000000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.77600000000000002,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.55200000000000005,"15min":0.54600000000000004},"min":{"1min":0.372,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73599999999999999,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.65200000000000002}]},{"osd":3,"last update":"Wed Jan 31 05:10:34 2024","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.437,"15min":0.44700000000000001},"min":{"1min":0.30199999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.56100000000000005,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.47499999999999998,"15min":0.47999999999999998},"min":{"1min":0.316,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.61199999999999999,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.44600000000000001}]},{"osd":4,"last update":"Wed Jan 31 05:10:34 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.58499999999999996,"15min":0.59099999999999997},"min":{"1min":0.443,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58499999999999996,"15min":0.57599999999999996},"min":{"1min":0.41099999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.86199999999999999,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.69399999999999995}]},{"osd":5,"last update":"Wed Jan 31 05:10:34 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.44,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.70299999999999996,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.61399999999999999,"15min":0.63},"min":{"1min":0.42599999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.82099999999999995,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.56399999999999995}]},{"osd":7,"last update":"Wed Jan 31 05:10:58 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.629,"15min":0.63200000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.78000000000000003,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.47699999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.91300000000000003,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.68400000000000005}]},{"osd":8,"last update":"Wed Jan 31 05:10:17 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.67100000000000004,"15min":0.68700000000000006},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81399999999999995,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.747,"15min":0.79400000000000004},"min":{"1min":0.48599999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.80200000000000005,"5min":3.3130000000000002,"15min":3.3130000000000002},"last":0.67500000000000004}]},{"osd":9,"last update":"Wed Jan 31 05:10:45 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.65400000000000003,"15min":0.69299999999999995},"min":{"1min":0.40000000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76600000000000001,"5min":1,"15min":1},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.63700000000000001,"15min":0.66700000000000004},"min":{"1min":0.41899999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82499999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.59199999999999997}]},{"osd":10,"last update":"Wed Jan 31 05:11:12 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.73799999999999999,"15min":0.76700000000000002},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.89400000000000002,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.748},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.73199999999999998,"15min":0.749},"min":{"1min":0.51000000000000001,"5min":0.501,"15min":0.501},"max":{"1min":0.88700000000000001,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.73899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1036288,"data_stored":528660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:10:34 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51800000000000002,"15min":0.49399999999999999},"min":{"1min":0.36199999999999999,"5min":0.29999999999999999,"15min":0.29399999999999998},"max":{"1min":0.76600000000000001,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.497},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.55100000000000005,"15min":0.51700000000000002},"min":{"1min":0.39200000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.84399999999999997,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.51300000000000001}]},{"osd":2,"last update":"Wed Jan 31 05:10:59 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.61599999999999999,"15min":0.54000000000000004},"min":{"1min":0.48299999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.58899999999999997,"15min":0.52100000000000002},"min":{"1min":0.42199999999999999,"5min":0.36799999999999999,"15min":0.316},"max":{"1min":0.82099999999999995,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.67900000000000005}]},{"osd":3,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.52100000000000002,"15min":0.49399999999999999},"min":{"1min":0.40899999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.56699999999999995,"15min":0.51200000000000001},"min":{"1min":0.496,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.91600000000000004,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.45100000000000001}]},{"osd":4,"last update":"Wed Jan 31 05:10:47 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.47099999999999997,"15min":0.443},"min":{"1min":0.33100000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.78000000000000003,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.48499999999999999,"15min":0.45100000000000001},"min":{"1min":0.36299999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.71499999999999997,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.38700000000000001}]},{"osd":5,"last update":"Wed Jan 31 05:11:08 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.65000000000000002,"15min":0.57499999999999996},"min":{"1min":0.55900000000000005,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.64500000000000002,"15min":0.58199999999999996},"min":{"1min":0.57099999999999995,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.58599999999999997}]},{"osd":6,"last update":"Wed Jan 31 05:10:34 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.59699999999999998,"15min":0.58499999999999996},"min":{"1min":0.48199999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83899999999999997,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.65000000000000002,"15min":0.61899999999999999},"min":{"1min":0.54100000000000004,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.98899999999999999,"5min":0.998,"15min":0.998},"last":0.66100000000000003}]},{"osd":7,"last update":"Wed Jan 31 05:10:59 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.625,"15min":0.58799999999999997},"min":{"1min":0.437,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.95999999999999996,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.61399999999999999,"15min":0.59899999999999998},"min":{"1min":0.47299999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88200000000000001,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.59899999999999998}]},{"osd":8,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.69899999999999995,"15min":0.67300000000000004},"min":{"1min":0.51200000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.69199999999999995,"15min":0.66900000000000004},"min":{"1min":0.58999999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.64400000000000002}]},{"osd":9,"last update":"Wed Jan 31 05:10:47 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.749,"15min":0.74099999999999999},"min":{"1min":0.63400000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.036,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.70299999999999996,"15min":0.69599999999999995},"min":{"1min":0.56100000000000005,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.94299999999999995,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.63100000000000001}]},{"osd":10,"last update":"Wed Jan 31 05:11:14 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.77700000000000002,"15min":0.752},"min":{"1min":0.68500000000000005,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0860000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.76800000000000002,"15min":0.749},"min":{"1min":0.66600000000000004,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.72499999999999998}]},{"osd":11,"last update":"Wed Jan 31 05:10:25 2024","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.747}]}]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":991232,"data_stored":464502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 31 05:10:33 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":0.62,"15min":0.56100000000000005},"min":{"1min":0.40500000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":9.5289999999999999,"5min":9.5289999999999999,"15min":9.5289999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54700000000000004,"15min":0.53300000000000003},"min":{"1min":0.38700000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.74399999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.48799999999999999}]},{"osd":2,"last update":"Wed Jan 31 05:11:04 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.57399999999999995,"15min":0.55200000000000005},"min":{"1min":0.46999999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.79900000000000004,"5min":0.873,"15min":0.873},"last":0.626},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.753,"15min":0.628},"min":{"1min":0.39200000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.77200000000000002,"5min":9.4990000000000006,"15min":9.4990000000000006},"last":0.65500000000000003}]},{"osd":3,"last update":"Wed Jan 31 05:10:23 2024","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.54400000000000004}]},{"osd":4,"last update":"Wed Jan 31 05:10:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54000000000000004,"15min":0.52300000000000002},"min":{"1min":0.40600000000000003,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72999999999999998,"5min":0.748,"15min":0.748},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.0880000000000001,"5min":0.66800000000000004,"15min":0.55300000000000005},"min":{"1min":0.434,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":9.5150000000000006,"5min":9.5150000000000006,"15min":9.5150000000000006},"last":0.67600000000000005}]},{"osd":5,"last update":"Wed Jan 31 05:11:16 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56999999999999995,"15min":0.55100000000000005},"min":{"1min":0.46899999999999997,"5min":0.371,"15min":0.371},"max":{"1min":0.72199999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.74099999999999999},{"interface":"front","average":{"1min":1.256,"5min":0.93600000000000005,"15min":0.69199999999999995},"min":{"1min":0.501,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":13.021000000000001,"5min":13.021000000000001,"15min":13.021000000000001},"last":0.71799999999999997}]},{"osd":6,"last update":"Wed Jan 31 05:10:33 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.49399999999999999,"15min":0.51100000000000001},"min":{"1min":0.317,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.75700000000000001,"5min":0.878,"15min":0.878},"last":0.753},{"interface":"front","average":{"1min":0.503,"5min":0.51000000000000001,"15min":0.51400000000000001},"min":{"1min":0.308,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.68999999999999995}]},{"osd":7,"last update":"Wed Jan 31 05:08:59 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.627,"15min":0.622},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80900000000000005,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.64400000000000002,"15min":0.64200000000000002},"min":{"1min":0.47899999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.81699999999999995,"5min":0.874,"15min":0.874},"last":0.54600000000000004}]},{"osd":8,"last update":"Wed Jan 31 05:10:23 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.71899999999999997,"15min":0.67500000000000004},"min":{"1min":0.40000000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.133,"5min":9.2840000000000007,"15min":9.2840000000000007},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70199999999999996,"15min":0.71999999999999997},"min":{"1min":0.52500000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.85399999999999998,"5min":1.006,"15min":1.006},"last":0.82399999999999995}]},{"osd":9,"last update":"Wed Jan 31 05:10:44 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.63700000000000001,"15min":0.68300000000000005},"min":{"1min":0.38600000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.72099999999999997,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.625,"15min":0.67300000000000004},"min":{"1min":0.34999999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73299999999999998,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.76600000000000001}]},{"osd":10,"last update":"Wed Jan 31 05:11:16 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.64400000000000002,"15min":0.65400000000000003},"min":{"1min":0.497,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.81000000000000005,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68999999999999995,"15min":0.70099999999999996},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.90900000000000003,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.86599999999999999}]},{"osd":11,"last update":"Wed Jan 31 05:10:33 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.65100000000000002,"15min":0.64300000000000002},"min":{"1min":0.56100000000000005,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.79400000000000004,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71499999999999997,"15min":0.71399999999999997},"min":{"1min":0.57499999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.84599999999999997,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.84799999999999998}]}]},{"osd":2,"up_from":18,"seq":77309411411,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1056768,"data_stored":529860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:10:59 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.54100000000000004,"15min":0.48699999999999999},"min":{"1min":0.34000000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.53400000000000003,"15min":0.504},"min":{"1min":0.41599999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.73299999999999998,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.42099999999999999}]},{"osd":1,"last update":"Wed Jan 31 05:10:59 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.56200000000000006,"15min":0.52100000000000002},"min":{"1min":0.372,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80800000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.58999999999999997,"15min":0.53700000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.48099999999999998}]},{"osd":3,"last update":"Wed Jan 31 05:10:22 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.57199999999999995,"15min":0.53000000000000003},"min":{"1min":0.48699999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57199999999999995,"15min":0.53800000000000003},"min":{"1min":0.41099999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.753,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.442}]},{"osd":4,"last update":"Wed Jan 31 05:10:22 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.52300000000000002}]},{"osd":5,"last update":"Wed Jan 31 05:11:03 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.47699999999999998,"15min":0.42599999999999999},"min":{"1min":0.39500000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.495,"15min":0.45200000000000001},"min":{"1min":0.40500000000000003,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.89500000000000002,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.34000000000000002}]},{"osd":6,"last update":"Wed Jan 31 05:10:34 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.61399999999999999,"15min":0.56200000000000006},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.89700000000000002,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.60299999999999998,"15min":0.57699999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.68600000000000005}]},{"osd":7,"last update":"Wed Jan 31 05:08:55 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.77600000000000002,"15min":0.80300000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.77000000000000002,"5min":3.9449999999999998,"15min":3.9449999999999998},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.78600000000000003,"15min":0.80900000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.80600000000000005,"5min":4.1230000000000002,"15min":4.1230000000000002},"last":0.44}]},{"osd":8,"last update":"Wed Jan 31 05:11:20 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.59699999999999998,"15min":0.57799999999999996},"min":{"1min":0.33000000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.92700000000000005,"5min":1.036,"15min":1.036},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.65400000000000003,"15min":0.63100000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.96799999999999997,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.626}]},{"osd":9,"last update":"Wed Jan 31 05:10:50 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.72899999999999998,"15min":0.72399999999999998},"min":{"1min":0.56100000000000005,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.95099999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.5740000000000001,"5min":0.85699999999999998,"15min":0.73699999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":19.821999999999999,"5min":19.821999999999999,"15min":19.821999999999999},"last":0.61799999999999999}]},{"osd":10,"last update":"Wed Jan 31 05:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.69599999999999995,"15min":0.69499999999999995},"min":{"1min":0.56100000000000005,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.74199999999999999,"15min":0.71399999999999997},"min":{"1min":0.58999999999999997,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.66300000000000003}]},{"osd":11,"last update":"Wed Jan 31 05:10:22 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.70299999999999996}]}]},{"osd":3,"up_from":25,"seq":107374182477,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":987136,"data_stored":462457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:10:25 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.36099999999999999,"15min":0.32300000000000001},"min":{"1min":0.25600000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.38700000000000001,"15min":0.34699999999999998},"min":{"1min":0.23899999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.47199999999999998}]},{"osd":1,"last update":"Wed Jan 31 05:10:25 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.54600000000000004,"15min":0.51200000000000001},"min":{"1min":0.42799999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.621},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.54000000000000004,"15min":0.50700000000000001},"min":{"1min":0.32600000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.55400000000000005}]},{"osd":2,"last update":"Wed Jan 31 05:10:25 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.56999999999999995,"15min":0.51300000000000001},"min":{"1min":0.44,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.55200000000000005,"15min":0.51700000000000002},"min":{"1min":0.35599999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.438}]},{"osd":4,"last update":"Wed Jan 31 05:10:47 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55400000000000005,"15min":0.52400000000000002},"min":{"1min":0.36499999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71999999999999997,"5min":1.202,"15min":1.202},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59099999999999997,"15min":0.52600000000000002},"min":{"1min":0.38300000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.94599999999999995,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.64600000000000002}]},{"osd":5,"last update":"Wed Jan 31 05:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57199999999999995,"15min":0.56399999999999995},"min":{"1min":0.40600000000000003,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.81299999999999994,"5min":1.129,"15min":1.129},"last":0.499},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60999999999999999,"15min":0.58599999999999997},"min":{"1min":0.42399999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.82499999999999996,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.41799999999999998}]},{"osd":6,"last update":"Wed Jan 31 05:10:33 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.51400000000000001,"15min":0.47599999999999998},"min":{"1min":0.318,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":2.5600000000000001,"5min":2.5600000000000001,"15min":2.5600000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.51000000000000001,"15min":0.48599999999999999},"min":{"1min":0.34399999999999997,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.7210000000000001,"5min":2.7210000000000001,"15min":2.7210000000000001},"last":0.53600000000000003}]},{"osd":7,"last update":"Wed Jan 31 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.71899999999999997,"15min":0.66900000000000004},"min":{"1min":0.49199999999999999,"5min":0.443,"15min":0.443},"max":{"1min":5.29,"5min":5.29,"15min":5.29},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.70699999999999996,"15min":0.66400000000000003},"min":{"1min":0.499,"5min":0.442,"15min":0.442},"max":{"1min":5.306,"5min":5.306,"15min":5.306},"last":0.65900000000000003}]},{"osd":8,"last update":"Wed Jan 31 05:08:16 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.68200000000000005}]},{"osd":9,"last update":"Wed Jan 31 05:10:44 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.69099999999999995,"15min":0.71899999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90400000000000003,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.63300000000000001,"15min":0.65500000000000003},"min":{"1min":0.39200000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.78900000000000003,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.57299999999999995}]},{"osd":10,"last update":"Wed Jan 31 05:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.70299999999999996,"15min":0.72299999999999998},"min":{"1min":0.50900000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.92300000000000004,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.76800000000000002,"15min":0.79400000000000004},"min":{"1min":0.55700000000000005,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.96699999999999997,"5min":1.696,"15min":1.696},"last":0.70899999999999996}]},{"osd":11,"last update":"Wed Jan 31 05:10:25 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.69499999999999995}]}]},{"osd":4,"up_from":33,"seq":141733920840,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":970752,"data_stored":463024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.502,"15min":0.497},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.51900000000000002,"15min":0.51600000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.51300000000000001}]},{"osd":1,"last update":"Wed Jan 31 05:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.39100000000000001,"15min":0.34999999999999998},"min":{"1min":0.29899999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.56299999999999994,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.376},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.41199999999999998,"15min":0.38},"min":{"1min":0.27700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.621,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.40100000000000002}]},{"osd":2,"last update":"Wed Jan 31 05:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.57299999999999995,"15min":0.54300000000000004},"min":{"1min":0.41099999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.60799999999999998,"15min":0.54600000000000004},"min":{"1min":0.45800000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.89100000000000001,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.58899999999999997}]},{"osd":3,"last update":"Wed Jan 31 05:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.58199999999999996,"15min":0.54600000000000004},"min":{"1min":0.39800000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.72999999999999998,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.55800000000000005,"15min":0.54500000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.77200000000000002,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.67200000000000004}]},{"osd":5,"last update":"Wed Jan 31 05:11:05 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.59899999999999998,"15min":0.55000000000000004},"min":{"1min":0.46200000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.86499999999999999,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.495},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.61499999999999999,"15min":0.55700000000000005},"min":{"1min":0.49099999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.80700000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.64800000000000002}]},{"osd":6,"last update":"Wed Jan 31 05:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.60499999999999998,"15min":0.58299999999999996},"min":{"1min":0.44800000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.79400000000000004,"5min":0.87,"15min":0.87},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.59899999999999998,"15min":0.58699999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.85799999999999998,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.73099999999999998}]},{"osd":7,"last update":"Wed Jan 31 05:10:55 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57699999999999996,"15min":0.54800000000000004},"min":{"1min":0.374,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.84699999999999998,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.60599999999999998,"15min":0.59399999999999997},"min":{"1min":0.42999999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82399999999999995,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.55800000000000005}]},{"osd":8,"last update":"Wed Jan 31 05:10:23 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.68000000000000005,"15min":0.67200000000000004},"min":{"1min":0.48599999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.68400000000000005,"15min":0.66900000000000004},"min":{"1min":0.495,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89300000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.62}]},{"osd":9,"last update":"Wed Jan 31 05:10:45 2024","interfaces":[{"interface":"back","average":{"1min":1.5509999999999999,"5min":0.88100000000000001,"15min":0.76700000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":19.009,"5min":19.009,"15min":19.009},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.71899999999999997,"15min":0.70899999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.89400000000000002,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.76100000000000001}]},{"osd":10,"last update":"Wed Jan 31 05:11:12 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.74399999999999999,"15min":0.74199999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95199999999999996,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.76000000000000001,"15min":0.76400000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.69699999999999995}]},{"osd":11,"last update":"Wed Jan 31 05:10:23 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.77400000000000002}]}]},{"osd":5,"up_from":38,"seq":163208757316,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32732,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712420,"statfs":{"total":95995035648,"available":95961518080,"internally_reserved":0,"allocated":1593344,"data_stored":1055629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51700000000000002,"15min":0.47699999999999998},"min":{"1min":0.33800000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.67900000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.53100000000000003,"15min":0.502},"min":{"1min":0.32400000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.76400000000000001,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.55300000000000005}]},{"osd":1,"last update":"Wed Jan 31 05:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.57799999999999996,"15min":0.53600000000000003},"min":{"1min":0.41199999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.499},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57799999999999996,"15min":0.55600000000000005},"min":{"1min":0.39000000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.77500000000000002,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.51700000000000002}]},{"osd":2,"last update":"Wed Jan 31 05:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.43099999999999999,"15min":0.40300000000000002},"min":{"1min":0.27900000000000003,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.65700000000000003,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.434,"15min":0.42099999999999999},"min":{"1min":0.32000000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.434}]},{"osd":3,"last update":"Wed Jan 31 05:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.56000000000000005,"15min":0.53000000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.70799999999999996,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.56200000000000006,"15min":0.53600000000000003},"min":{"1min":0.35799999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.79300000000000004,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.53900000000000003}]},{"osd":4,"last update":"Wed Jan 31 05:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.63900000000000001,"15min":0.60799999999999998},"min":{"1min":0.496,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.65200000000000002,"15min":0.61599999999999999},"min":{"1min":0.437,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.88500000000000001,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.73299999999999998}]},{"osd":6,"last update":"Wed Jan 31 05:10:32 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59399999999999997,"15min":0.57999999999999996},"min":{"1min":0.38700000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.82499999999999996,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60399999999999998,"15min":0.59299999999999997},"min":{"1min":0.437,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.75800000000000001,"5min":0.873,"15min":0.873},"last":0.57199999999999995}]},{"osd":7,"last update":"Wed Jan 31 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.64500000000000002,"15min":0.60699999999999998},"min":{"1min":0.42999999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.67800000000000005,"15min":0.65000000000000002},"min":{"1min":0.55800000000000005,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.58899999999999997}]},{"osd":8,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.36599999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.77500000000000002,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58199999999999996,"15min":0.58399999999999996},"min":{"1min":0.39600000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.79500000000000004,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.76400000000000001}]},{"osd":9,"last update":"Wed Jan 31 05:10:47 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68300000000000005,"15min":0.68100000000000005},"min":{"1min":0.47399999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.97399999999999998,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.68999999999999995,"15min":0.68400000000000005},"min":{"1min":0.48499999999999999,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.69799999999999995}]},{"osd":10,"last update":"Wed Jan 31 05:11:17 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.70499999999999996,"15min":0.68799999999999994},"min":{"1min":0.56100000000000005,"5min":0.497,"15min":0.497},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.73499999999999999,"15min":0.72099999999999997},"min":{"1min":0.57799999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.747}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":66867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":68067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":61980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-31T05:11:24.518 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-01-31T05:11:24.518 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-31T05:11:24.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.655+0000 7fc168609640 1 -- 172.21.15.99:0/1163064809 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc160100e80 msgr2=0x7fc160101300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:24.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.655+0000 7fc168609640 1 --2- 172.21.15.99:0/1163064809 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc160100e80 0x7fc160101300 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc150009900 tx=0x7fc15002bc30 comp rx=0 tx=0).stop 2024-01-31T05:11:24.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.655+0000 7fc168609640 1 -- 172.21.15.99:0/1163064809 shutdown_connections 2024-01-31T05:11:24.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.655+0000 7fc168609640 1 --2- 172.21.15.99:0/1163064809 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc160101840 0x7fc1601080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:24.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.655+0000 7fc168609640 1 --2- 172.21.15.99:0/1163064809 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc160100e80 0x7fc160101300 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:24.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.655+0000 7fc168609640 1 --2- 172.21.15.99:0/1163064809 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc1600ffc90 0x7fc1601000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:24.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.655+0000 7fc168609640 1 -- 172.21.15.99:0/1163064809 >> 172.21.15.99:0/1163064809 conn(0x7fc1600fb220 msgr2=0x7fc1600fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:24.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.655+0000 7fc168609640 1 -- 172.21.15.99:0/1163064809 shutdown_connections 2024-01-31T05:11:24.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.655+0000 7fc168609640 1 -- 172.21.15.99:0/1163064809 wait complete. 2024-01-31T05:11:24.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.656+0000 7fc168609640 1 Processor -- start 2024-01-31T05:11:24.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.656+0000 7fc168609640 1 -- start start 2024-01-31T05:11:24.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.656+0000 7fc168609640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1600ffc90 0x7fc160196ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:24.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.656+0000 7fc168609640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc160100e80 0x7fc1601971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:24.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.656+0000 7fc168609640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc160101840 0x7fc16019e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:24.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.656+0000 7fc168609640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc16019e7b0 con 0x7fc160101840 2024-01-31T05:11:24.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.656+0000 7fc168609640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc16019e920 con 0x7fc1600ffc90 2024-01-31T05:11:24.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.656+0000 7fc168609640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc16019eae0 con 0x7fc160100e80 2024-01-31T05:11:24.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.656+0000 7fc166ba6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc160101840 0x7fc16019e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:24.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.656+0000 7fc166ba6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc160101840 0x7fc16019e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34254/0 (socket says 172.21.15.99:34254) 2024-01-31T05:11:24.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.656+0000 7fc166ba6640 1 -- 172.21.15.99:0/3065183119 learned_addr learned my addr 172.21.15.99:0/3065183119 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:24.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.656+0000 7fc1663a5640 1 --2- 172.21.15.99:0/3065183119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1600ffc90 0x7fc160196ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:24.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.656+0000 7fc165ba4640 1 --2- 172.21.15.99:0/3065183119 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc160100e80 0x7fc1601971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:24.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.656+0000 7fc166ba6640 1 -- 172.21.15.99:0/3065183119 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc160100e80 msgr2=0x7fc1601971e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:24.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.656+0000 7fc166ba6640 1 --2- 172.21.15.99:0/3065183119 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc160100e80 0x7fc1601971e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:24.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.656+0000 7fc166ba6640 1 -- 172.21.15.99:0/3065183119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1600ffc90 msgr2=0x7fc160196ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:24.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.656+0000 7fc166ba6640 1 --2- 172.21.15.99:0/3065183119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1600ffc90 0x7fc160196ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:24.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.656+0000 7fc166ba6640 1 -- 172.21.15.99:0/3065183119 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc150009560 con 0x7fc160101840 2024-01-31T05:11:24.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.656+0000 7fc166ba6640 1 --2- 172.21.15.99:0/3065183119 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc160101840 0x7fc16019e240 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc15800cce0 tx=0x7fc15800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:24.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.657+0000 7fc1577fe640 1 -- 172.21.15.99:0/3065183119 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15800f450 con 0x7fc160101840 2024-01-31T05:11:24.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.657+0000 7fc168609640 1 -- 172.21.15.99:0/3065183119 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc16019edc0 con 0x7fc160101840 2024-01-31T05:11:24.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.657+0000 7fc1577fe640 1 -- 172.21.15.99:0/3065183119 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc15800fa70 con 0x7fc160101840 2024-01-31T05:11:24.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.657+0000 7fc1577fe640 1 -- 172.21.15.99:0/3065183119 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc158018b40 con 0x7fc160101840 2024-01-31T05:11:24.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.657+0000 7fc168609640 1 -- 172.21.15.99:0/3065183119 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc16019f240 con 0x7fc160101840 2024-01-31T05:11:24.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.658+0000 7fc168609640 1 -- 172.21.15.99:0/3065183119 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc16010b4c0 con 0x7fc160101840 2024-01-31T05:11:24.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.659+0000 7fc1577fe640 1 -- 172.21.15.99:0/3065183119 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 135946+0+0 (secure 0 0 0) 0x7fc15800fbe0 con 0x7fc160101840 2024-01-31T05:11:24.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.659+0000 7fc1577fe640 1 --2- 172.21.15.99:0/3065183119 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc14c0a1370 0x7fc14c0a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:24.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.659+0000 7fc1663a5640 1 --2- 172.21.15.99:0/3065183119 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc14c0a1370 0x7fc14c0a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:24.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.659+0000 7fc1577fe640 1 -- 172.21.15.99:0/3065183119 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fc1580cd3c0 con 0x7fc160101840 2024-01-31T05:11:24.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.660+0000 7fc1663a5640 1 --2- 172.21.15.99:0/3065183119 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc14c0a1370 0x7fc14c0a3830 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc160197b70 tx=0x7fc15c00a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:24.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.663+0000 7fc1577fe640 1 -- 172.21.15.99:0/3065183119 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fc158096890 con 0x7fc160101840 2024-01-31T05:11:24.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.833+0000 7fc168609640 1 -- 172.21.15.99:0/3065183119 --> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc160069a30 con 0x7fc14c0a1370 2024-01-31T05:11:24.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.843+0000 7fc1577fe640 1 -- 172.21.15.99:0/3065183119 <== mgr.14152 v2:172.21.15.99:6800/3925720924 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345252 (secure 0 0 0) 0x7fc160069a30 con 0x7fc14c0a1370 2024-01-31T05:11:24.847 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:11:24.848 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-01-31T05:11:24.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.847+0000 7fc168609640 1 -- 172.21.15.99:0/3065183119 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc14c0a1370 msgr2=0x7fc14c0a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:24.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.847+0000 7fc168609640 1 --2- 172.21.15.99:0/3065183119 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc14c0a1370 0x7fc14c0a3830 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc160197b70 tx=0x7fc15c00a2d0 comp rx=0 tx=0).stop 2024-01-31T05:11:24.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.847+0000 7fc168609640 1 -- 172.21.15.99:0/3065183119 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc160101840 msgr2=0x7fc16019e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:24.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.847+0000 7fc168609640 1 --2- 172.21.15.99:0/3065183119 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc160101840 0x7fc16019e240 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc15800cce0 tx=0x7fc15800a620 comp rx=0 tx=0).stop 2024-01-31T05:11:24.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.847+0000 7fc168609640 1 -- 172.21.15.99:0/3065183119 shutdown_connections 2024-01-31T05:11:24.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.847+0000 7fc168609640 1 --2- 172.21.15.99:0/3065183119 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc14c0a1370 0x7fc14c0a3830 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:24.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.847+0000 7fc168609640 1 --2- 172.21.15.99:0/3065183119 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc160101840 0x7fc16019e240 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:24.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.847+0000 7fc168609640 1 --2- 172.21.15.99:0/3065183119 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc160100e80 0x7fc1601971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:24.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.847+0000 7fc168609640 1 --2- 172.21.15.99:0/3065183119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1600ffc90 0x7fc160196ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:24.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.847+0000 7fc168609640 1 -- 172.21.15.99:0/3065183119 >> 172.21.15.99:0/3065183119 conn(0x7fc1600fb220 msgr2=0x7fc160069320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:24.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.847+0000 7fc168609640 1 -- 172.21.15.99:0/3065183119 shutdown_connections 2024-01-31T05:11:24.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:24.847+0000 7fc168609640 1 -- 172.21.15.99:0/3065183119 wait complete. 2024-01-31T05:11:24.857 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":350,"stamp":"2024-01-31T05:11:24.623521+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":664040,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1323,"num_read_kb":788,"num_write":435,"num_write_kb":3092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":1180848,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":861,"ondisk_log_size":861,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":366776,"kb_used_data":13464,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575048,"statfs":{"total":1151940427776,"available":1151564849152,"internally_reserved":0,"allocated":13787136,"data_stored":7533636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5710,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":73,"num_write":10,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002920"},"pg_stats":[{"pgid":"3.3f","version":"88'8","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.636203+0000","last_change":"2024-01-31T05:09:20.582274+0000","last_active":"2024-01-31T05:10:50.636203+0000","last_peered":"2024-01-31T05:10:50.636203+0000","last_clean":"2024-01-31T05:10:50.636203+0000","last_became_active":"2024-01-31T05:09:20.581511+0000","last_became_peered":"2024-01-31T05:09:20.581511+0000","last_unstale":"2024-01-31T05:10:50.636203+0000","last_undegraded":"2024-01-31T05:10:50.636203+0000","last_fullsized":"2024-01-31T05:10:50.636203+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:59:10.674456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"88'4","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.630950+0000","last_change":"2024-01-31T05:09:20.581752+0000","last_active":"2024-01-31T05:10:50.630950+0000","last_peered":"2024-01-31T05:10:50.630950+0000","last_clean":"2024-01-31T05:10:50.630950+0000","last_became_active":"2024-01-31T05:09:20.581035+0000","last_became_peered":"2024-01-31T05:09:20.581035+0000","last_unstale":"2024-01-31T05:10:50.630950+0000","last_undegraded":"2024-01-31T05:10:50.630950+0000","last_fullsized":"2024-01-31T05:10:50.630950+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:03:16.999371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"88'7","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.637658+0000","last_change":"2024-01-31T05:09:20.588191+0000","last_active":"2024-01-31T05:10:50.637658+0000","last_peered":"2024-01-31T05:10:50.637658+0000","last_clean":"2024-01-31T05:10:50.637658+0000","last_became_active":"2024-01-31T05:09:20.587466+0000","last_became_peered":"2024-01-31T05:09:20.587466+0000","last_unstale":"2024-01-31T05:10:50.637658+0000","last_undegraded":"2024-01-31T05:10:50.637658+0000","last_fullsized":"2024-01-31T05:10:50.637658+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:22:29.037408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"88'8","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.627481+0000","last_change":"2024-01-31T05:09:20.589377+0000","last_active":"2024-01-31T05:10:50.627481+0000","last_peered":"2024-01-31T05:10:50.627481+0000","last_clean":"2024-01-31T05:10:50.627481+0000","last_became_active":"2024-01-31T05:09:20.589065+0000","last_became_peered":"2024-01-31T05:09:20.589065+0000","last_unstale":"2024-01-31T05:10:50.627481+0000","last_undegraded":"2024-01-31T05:10:50.627481+0000","last_fullsized":"2024-01-31T05:10:50.627481+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:57:11.612654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"88'4","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.625701+0000","last_change":"2024-01-31T05:09:20.578919+0000","last_active":"2024-01-31T05:10:50.625701+0000","last_peered":"2024-01-31T05:10:50.625701+0000","last_clean":"2024-01-31T05:10:50.625701+0000","last_became_active":"2024-01-31T05:09:20.578594+0000","last_became_peered":"2024-01-31T05:09:20.578594+0000","last_unstale":"2024-01-31T05:10:50.625701+0000","last_undegraded":"2024-01-31T05:10:50.625701+0000","last_fullsized":"2024-01-31T05:10:50.625701+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:16:57.168457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"88'6","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.634482+0000","last_change":"2024-01-31T05:09:20.586620+0000","last_active":"2024-01-31T05:10:50.634482+0000","last_peered":"2024-01-31T05:10:50.634482+0000","last_clean":"2024-01-31T05:10:50.634482+0000","last_became_active":"2024-01-31T05:09:20.586323+0000","last_became_peered":"2024-01-31T05:09:20.586323+0000","last_unstale":"2024-01-31T05:10:50.634482+0000","last_undegraded":"2024-01-31T05:10:50.634482+0000","last_fullsized":"2024-01-31T05:10:50.634482+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:03:31.479078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"88'5","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.639286+0000","last_change":"2024-01-31T05:09:20.595122+0000","last_active":"2024-01-31T05:10:50.639286+0000","last_peered":"2024-01-31T05:10:50.639286+0000","last_clean":"2024-01-31T05:10:50.639286+0000","last_became_active":"2024-01-31T05:09:20.594766+0000","last_became_peered":"2024-01-31T05:09:20.594766+0000","last_unstale":"2024-01-31T05:10:50.639286+0000","last_undegraded":"2024-01-31T05:10:50.639286+0000","last_fullsized":"2024-01-31T05:10:50.639286+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:18:40.002855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"88'9","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.635983+0000","last_change":"2024-01-31T05:10:21.686734+0000","last_active":"2024-01-31T05:10:50.635983+0000","last_peered":"2024-01-31T05:10:50.635983+0000","last_clean":"2024-01-31T05:10:50.635983+0000","last_became_active":"2024-01-31T05:10:21.686293+0000","last_became_peered":"2024-01-31T05:10:21.686293+0000","last_unstale":"2024-01-31T05:10:50.635983+0000","last_undegraded":"2024-01-31T05:10:50.635983+0000","last_fullsized":"2024-01-31T05:10:50.635983+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:19:35.416043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"88'11","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.639501+0000","last_change":"2024-01-31T05:09:20.588892+0000","last_active":"2024-01-31T05:10:50.639501+0000","last_peered":"2024-01-31T05:10:50.639501+0000","last_clean":"2024-01-31T05:10:50.639501+0000","last_became_active":"2024-01-31T05:09:20.588212+0000","last_became_peered":"2024-01-31T05:09:20.588212+0000","last_unstale":"2024-01-31T05:10:50.639501+0000","last_undegraded":"2024-01-31T05:10:50.639501+0000","last_fullsized":"2024-01-31T05:10:50.639501+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:49:45.270341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"88'16","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.627823+0000","last_change":"2024-01-31T05:09:20.589396+0000","last_active":"2024-01-31T05:10:50.627823+0000","last_peered":"2024-01-31T05:10:50.627823+0000","last_clean":"2024-01-31T05:10:50.627823+0000","last_became_active":"2024-01-31T05:09:20.589058+0000","last_became_peered":"2024-01-31T05:09:20.589058+0000","last_unstale":"2024-01-31T05:10:50.627823+0000","last_undegraded":"2024-01-31T05:10:50.627823+0000","last_fullsized":"2024-01-31T05:10:50.627823+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:05:53.403136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"88'6","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.641135+0000","last_change":"2024-01-31T05:09:20.592010+0000","last_active":"2024-01-31T05:10:50.641135+0000","last_peered":"2024-01-31T05:10:50.641135+0000","last_clean":"2024-01-31T05:10:50.641135+0000","last_became_active":"2024-01-31T05:09:20.591714+0000","last_became_peered":"2024-01-31T05:09:20.591714+0000","last_unstale":"2024-01-31T05:10:50.641135+0000","last_undegraded":"2024-01-31T05:10:50.641135+0000","last_fullsized":"2024-01-31T05:10:50.641135+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:56:11.651035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"88'7","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.636699+0000","last_change":"2024-01-31T05:10:21.685195+0000","last_active":"2024-01-31T05:10:50.636699+0000","last_peered":"2024-01-31T05:10:50.636699+0000","last_clean":"2024-01-31T05:10:50.636699+0000","last_became_active":"2024-01-31T05:10:21.684742+0000","last_became_peered":"2024-01-31T05:10:21.684742+0000","last_unstale":"2024-01-31T05:10:50.636699+0000","last_undegraded":"2024-01-31T05:10:50.636699+0000","last_fullsized":"2024-01-31T05:10:50.636699+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:18:59.674766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"88'10","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.629382+0000","last_change":"2024-01-31T05:09:20.582167+0000","last_active":"2024-01-31T05:10:50.629382+0000","last_peered":"2024-01-31T05:10:50.629382+0000","last_clean":"2024-01-31T05:10:50.629382+0000","last_became_active":"2024-01-31T05:09:20.581860+0000","last_became_peered":"2024-01-31T05:09:20.581860+0000","last_unstale":"2024-01-31T05:10:50.629382+0000","last_undegraded":"2024-01-31T05:10:50.629382+0000","last_fullsized":"2024-01-31T05:10:50.629382+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:46:05.891545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"88'7","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.634991+0000","last_change":"2024-01-31T05:09:20.587899+0000","last_active":"2024-01-31T05:10:50.634991+0000","last_peered":"2024-01-31T05:10:50.634991+0000","last_clean":"2024-01-31T05:10:50.634991+0000","last_became_active":"2024-01-31T05:09:20.587068+0000","last_became_peered":"2024-01-31T05:09:20.587068+0000","last_unstale":"2024-01-31T05:10:50.634991+0000","last_undegraded":"2024-01-31T05:10:50.634991+0000","last_fullsized":"2024-01-31T05:10:50.634991+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:59:44.747928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"88'7","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.635917+0000","last_change":"2024-01-31T05:09:20.590392+0000","last_active":"2024-01-31T05:10:50.635917+0000","last_peered":"2024-01-31T05:10:50.635917+0000","last_clean":"2024-01-31T05:10:50.635917+0000","last_became_active":"2024-01-31T05:09:20.590082+0000","last_became_peered":"2024-01-31T05:09:20.590082+0000","last_unstale":"2024-01-31T05:10:50.635917+0000","last_undegraded":"2024-01-31T05:10:50.635917+0000","last_fullsized":"2024-01-31T05:10:50.635917+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:59:10.672890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"88'9","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.642526+0000","last_change":"2024-01-31T05:09:20.584822+0000","last_active":"2024-01-31T05:10:50.642526+0000","last_peered":"2024-01-31T05:10:50.642526+0000","last_clean":"2024-01-31T05:10:50.642526+0000","last_became_active":"2024-01-31T05:09:20.584531+0000","last_became_peered":"2024-01-31T05:09:20.584531+0000","last_unstale":"2024-01-31T05:10:50.642526+0000","last_undegraded":"2024-01-31T05:10:50.642526+0000","last_fullsized":"2024-01-31T05:10:50.642526+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:35:44.793407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"88'8","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.636505+0000","last_change":"2024-01-31T05:09:20.582615+0000","last_active":"2024-01-31T05:10:50.636505+0000","last_peered":"2024-01-31T05:10:50.636505+0000","last_clean":"2024-01-31T05:10:50.636505+0000","last_became_active":"2024-01-31T05:09:20.581959+0000","last_became_peered":"2024-01-31T05:09:20.581959+0000","last_unstale":"2024-01-31T05:10:50.636505+0000","last_undegraded":"2024-01-31T05:10:50.636505+0000","last_fullsized":"2024-01-31T05:10:50.636505+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:29:06.817822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"88'10","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.641157+0000","last_change":"2024-01-31T05:09:20.582421+0000","last_active":"2024-01-31T05:10:50.641157+0000","last_peered":"2024-01-31T05:10:50.641157+0000","last_clean":"2024-01-31T05:10:50.641157+0000","last_became_active":"2024-01-31T05:09:20.582099+0000","last_became_peered":"2024-01-31T05:09:20.582099+0000","last_unstale":"2024-01-31T05:10:50.641157+0000","last_undegraded":"2024-01-31T05:10:50.641157+0000","last_fullsized":"2024-01-31T05:10:50.641157+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:08:03.802219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"88'7","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.630744+0000","last_change":"2024-01-31T05:09:20.580511+0000","last_active":"2024-01-31T05:10:50.630744+0000","last_peered":"2024-01-31T05:10:50.630744+0000","last_clean":"2024-01-31T05:10:50.630744+0000","last_became_active":"2024-01-31T05:09:20.579596+0000","last_became_peered":"2024-01-31T05:09:20.579596+0000","last_unstale":"2024-01-31T05:10:50.630744+0000","last_undegraded":"2024-01-31T05:10:50.630744+0000","last_fullsized":"2024-01-31T05:10:50.630744+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:07:01.206181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'14","reported_seq":147,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:11:20.329291+0000","last_change":"2024-01-31T05:09:20.187398+0000","last_active":"2024-01-31T05:11:20.329291+0000","last_peered":"2024-01-31T05:11:20.329291+0000","last_clean":"2024-01-31T05:11:20.329291+0000","last_became_active":"2024-01-31T05:09:20.186925+0000","last_became_peered":"2024-01-31T05:09:20.186925+0000","last_unstale":"2024-01-31T05:11:20.329291+0000","last_undegraded":"2024-01-31T05:11:20.329291+0000","last_fullsized":"2024-01-31T05:11:20.329291+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:33:34.624017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"88'5","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.627275+0000","last_change":"2024-01-31T05:09:20.582800+0000","last_active":"2024-01-31T05:10:50.627275+0000","last_peered":"2024-01-31T05:10:50.627275+0000","last_clean":"2024-01-31T05:10:50.627275+0000","last_became_active":"2024-01-31T05:09:20.582523+0000","last_became_peered":"2024-01-31T05:09:20.582523+0000","last_unstale":"2024-01-31T05:10:50.627275+0000","last_undegraded":"2024-01-31T05:10:50.627275+0000","last_fullsized":"2024-01-31T05:10:50.627275+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:19:57.975954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.685174+0000","last_change":"2024-01-31T05:09:20.191566+0000","last_active":"2024-01-31T05:10:21.685174+0000","last_peered":"2024-01-31T05:10:21.685174+0000","last_clean":"2024-01-31T05:10:21.685174+0000","last_became_active":"2024-01-31T05:09:20.191268+0000","last_became_peered":"2024-01-31T05:09:20.191268+0000","last_unstale":"2024-01-31T05:10:21.685174+0000","last_undegraded":"2024-01-31T05:10:21.685174+0000","last_fullsized":"2024-01-31T05:10:21.685174+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:45:40.042374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"88'6","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.637694+0000","last_change":"2024-01-31T05:09:20.579061+0000","last_active":"2024-01-31T05:10:50.637694+0000","last_peered":"2024-01-31T05:10:50.637694+0000","last_clean":"2024-01-31T05:10:50.637694+0000","last_became_active":"2024-01-31T05:09:20.578728+0000","last_became_peered":"2024-01-31T05:09:20.578728+0000","last_unstale":"2024-01-31T05:10:50.637694+0000","last_undegraded":"2024-01-31T05:10:50.637694+0000","last_fullsized":"2024-01-31T05:10:50.637694+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:57:12.142419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.683895+0000","last_change":"2024-01-31T05:09:20.187366+0000","last_active":"2024-01-31T05:10:21.683895+0000","last_peered":"2024-01-31T05:10:21.683895+0000","last_clean":"2024-01-31T05:10:21.683895+0000","last_became_active":"2024-01-31T05:09:20.186616+0000","last_became_peered":"2024-01-31T05:09:20.186616+0000","last_unstale":"2024-01-31T05:10:21.683895+0000","last_undegraded":"2024-01-31T05:10:21.683895+0000","last_fullsized":"2024-01-31T05:10:21.683895+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:39:28.802810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"88'9","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.643134+0000","last_change":"2024-01-31T05:09:20.590538+0000","last_active":"2024-01-31T05:10:50.643134+0000","last_peered":"2024-01-31T05:10:50.643134+0000","last_clean":"2024-01-31T05:10:50.643134+0000","last_became_active":"2024-01-31T05:09:20.590254+0000","last_became_peered":"2024-01-31T05:09:20.590254+0000","last_unstale":"2024-01-31T05:10:50.643134+0000","last_undegraded":"2024-01-31T05:10:50.643134+0000","last_fullsized":"2024-01-31T05:10:50.643134+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:06:38.209930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.683304+0000","last_change":"2024-01-31T05:09:20.183808+0000","last_active":"2024-01-31T05:10:21.683304+0000","last_peered":"2024-01-31T05:10:21.683304+0000","last_clean":"2024-01-31T05:10:21.683304+0000","last_became_active":"2024-01-31T05:09:20.183514+0000","last_became_peered":"2024-01-31T05:09:20.183514+0000","last_unstale":"2024-01-31T05:10:21.683304+0000","last_undegraded":"2024-01-31T05:10:21.683304+0000","last_fullsized":"2024-01-31T05:10:21.683304+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:32:43.392640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"88'15","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.644160+0000","last_change":"2024-01-31T05:09:20.590871+0000","last_active":"2024-01-31T05:10:50.644160+0000","last_peered":"2024-01-31T05:10:50.644160+0000","last_clean":"2024-01-31T05:10:50.644160+0000","last_became_active":"2024-01-31T05:09:20.588533+0000","last_became_peered":"2024-01-31T05:09:20.588533+0000","last_unstale":"2024-01-31T05:10:50.644160+0000","last_undegraded":"2024-01-31T05:10:50.644160+0000","last_fullsized":"2024-01-31T05:10:50.644160+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:44:26.772616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"88'7","reported_seq":144,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:11:20.331163+0000","last_change":"2024-01-31T05:09:20.183455+0000","last_active":"2024-01-31T05:11:20.331163+0000","last_peered":"2024-01-31T05:11:20.331163+0000","last_clean":"2024-01-31T05:11:20.331163+0000","last_became_active":"2024-01-31T05:09:20.183070+0000","last_became_peered":"2024-01-31T05:09:20.183070+0000","last_unstale":"2024-01-31T05:11:20.331163+0000","last_undegraded":"2024-01-31T05:11:20.331163+0000","last_fullsized":"2024-01-31T05:11:20.331163+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:15:29.503830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1153,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":3,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"88'7","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.603912+0000","last_change":"2024-01-31T05:09:20.580755+0000","last_active":"2024-01-31T05:10:50.603912+0000","last_peered":"2024-01-31T05:10:50.603912+0000","last_clean":"2024-01-31T05:10:50.603912+0000","last_became_active":"2024-01-31T05:09:20.580452+0000","last_became_peered":"2024-01-31T05:09:20.580452+0000","last_unstale":"2024-01-31T05:10:50.603912+0000","last_undegraded":"2024-01-31T05:10:50.603912+0000","last_fullsized":"2024-01-31T05:10:50.603912+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:29:08.383532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681549+0000","last_change":"2024-01-31T05:09:20.182129+0000","last_active":"2024-01-31T05:10:21.681549+0000","last_peered":"2024-01-31T05:10:21.681549+0000","last_clean":"2024-01-31T05:10:21.681549+0000","last_became_active":"2024-01-31T05:09:20.181781+0000","last_became_peered":"2024-01-31T05:09:20.181781+0000","last_unstale":"2024-01-31T05:10:21.681549+0000","last_undegraded":"2024-01-31T05:10:21.681549+0000","last_fullsized":"2024-01-31T05:10:21.681549+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:05:57.854213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"88'8","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.626614+0000","last_change":"2024-01-31T05:09:20.591696+0000","last_active":"2024-01-31T05:10:50.626614+0000","last_peered":"2024-01-31T05:10:50.626614+0000","last_clean":"2024-01-31T05:10:50.626614+0000","last_became_active":"2024-01-31T05:09:20.591307+0000","last_became_peered":"2024-01-31T05:09:20.591307+0000","last_unstale":"2024-01-31T05:10:50.626614+0000","last_undegraded":"2024-01-31T05:10:50.626614+0000","last_fullsized":"2024-01-31T05:10:50.626614+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:59:56.884326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.679697+0000","last_change":"2024-01-31T05:09:20.179846+0000","last_active":"2024-01-31T05:10:21.679697+0000","last_peered":"2024-01-31T05:10:21.679697+0000","last_clean":"2024-01-31T05:10:21.679697+0000","last_became_active":"2024-01-31T05:09:20.179524+0000","last_became_peered":"2024-01-31T05:09:20.179524+0000","last_unstale":"2024-01-31T05:10:21.679697+0000","last_undegraded":"2024-01-31T05:10:21.679697+0000","last_fullsized":"2024-01-31T05:10:21.679697+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:13:51.085861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"88'8","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.632540+0000","last_change":"2024-01-31T05:09:20.580076+0000","last_active":"2024-01-31T05:10:50.632540+0000","last_peered":"2024-01-31T05:10:50.632540+0000","last_clean":"2024-01-31T05:10:50.632540+0000","last_became_active":"2024-01-31T05:09:20.579764+0000","last_became_peered":"2024-01-31T05:09:20.579764+0000","last_unstale":"2024-01-31T05:10:50.632540+0000","last_undegraded":"2024-01-31T05:10:50.632540+0000","last_fullsized":"2024-01-31T05:10:50.632540+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:02:13.861848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.685470+0000","last_change":"2024-01-31T05:09:20.183941+0000","last_active":"2024-01-31T05:10:21.685470+0000","last_peered":"2024-01-31T05:10:21.685470+0000","last_clean":"2024-01-31T05:10:21.685470+0000","last_became_active":"2024-01-31T05:09:20.183631+0000","last_became_peered":"2024-01-31T05:09:20.183631+0000","last_unstale":"2024-01-31T05:10:21.685470+0000","last_undegraded":"2024-01-31T05:10:21.685470+0000","last_fullsized":"2024-01-31T05:10:21.685470+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:31:31.419345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"88'11","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.636836+0000","last_change":"2024-01-31T05:09:20.589275+0000","last_active":"2024-01-31T05:10:50.636836+0000","last_peered":"2024-01-31T05:10:50.636836+0000","last_clean":"2024-01-31T05:10:50.636836+0000","last_became_active":"2024-01-31T05:09:20.588891+0000","last_became_peered":"2024-01-31T05:09:20.588891+0000","last_unstale":"2024-01-31T05:10:50.636836+0000","last_undegraded":"2024-01-31T05:10:50.636836+0000","last_fullsized":"2024-01-31T05:10:50.636836+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:30:27.665553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"88'7","reported_seq":258,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:11:22.333288+0000","last_change":"2024-01-31T05:09:20.182836+0000","last_active":"2024-01-31T05:11:22.333288+0000","last_peered":"2024-01-31T05:11:22.333288+0000","last_clean":"2024-01-31T05:11:22.333288+0000","last_became_active":"2024-01-31T05:09:20.182376+0000","last_became_peered":"2024-01-31T05:09:20.182376+0000","last_unstale":"2024-01-31T05:11:22.333288+0000","last_undegraded":"2024-01-31T05:11:22.333288+0000","last_fullsized":"2024-01-31T05:11:22.333288+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:55:52.354323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":232,"num_read_kb":232,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"88'10","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.643818+0000","last_change":"2024-01-31T05:09:20.583592+0000","last_active":"2024-01-31T05:10:50.643818+0000","last_peered":"2024-01-31T05:10:50.643818+0000","last_clean":"2024-01-31T05:10:50.643818+0000","last_became_active":"2024-01-31T05:09:20.583247+0000","last_became_peered":"2024-01-31T05:09:20.583247+0000","last_unstale":"2024-01-31T05:10:50.643818+0000","last_undegraded":"2024-01-31T05:10:50.643818+0000","last_fullsized":"2024-01-31T05:10:50.643818+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:28:04.946620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681815+0000","last_change":"2024-01-31T05:09:20.188171+0000","last_active":"2024-01-31T05:10:21.681815+0000","last_peered":"2024-01-31T05:10:21.681815+0000","last_clean":"2024-01-31T05:10:21.681815+0000","last_became_active":"2024-01-31T05:09:20.187807+0000","last_became_peered":"2024-01-31T05:09:20.187807+0000","last_unstale":"2024-01-31T05:10:21.681815+0000","last_undegraded":"2024-01-31T05:10:21.681815+0000","last_fullsized":"2024-01-31T05:10:21.681815+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:53:22.765389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"88'9","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.635239+0000","last_change":"2024-01-31T05:09:20.589462+0000","last_active":"2024-01-31T05:10:50.635239+0000","last_peered":"2024-01-31T05:10:50.635239+0000","last_clean":"2024-01-31T05:10:50.635239+0000","last_became_active":"2024-01-31T05:09:20.589002+0000","last_became_peered":"2024-01-31T05:09:20.589002+0000","last_unstale":"2024-01-31T05:10:50.635239+0000","last_undegraded":"2024-01-31T05:10:50.635239+0000","last_fullsized":"2024-01-31T05:10:50.635239+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:41:35.918827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684998+0000","last_change":"2024-01-31T05:09:20.184963+0000","last_active":"2024-01-31T05:10:21.684998+0000","last_peered":"2024-01-31T05:10:21.684998+0000","last_clean":"2024-01-31T05:10:21.684998+0000","last_became_active":"2024-01-31T05:09:20.184590+0000","last_became_peered":"2024-01-31T05:09:20.184590+0000","last_unstale":"2024-01-31T05:10:21.684998+0000","last_undegraded":"2024-01-31T05:10:21.684998+0000","last_fullsized":"2024-01-31T05:10:21.684998+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:06:31.291846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"88'11","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.640851+0000","last_change":"2024-01-31T05:09:20.589237+0000","last_active":"2024-01-31T05:10:50.640851+0000","last_peered":"2024-01-31T05:10:50.640851+0000","last_clean":"2024-01-31T05:10:50.640851+0000","last_became_active":"2024-01-31T05:09:20.588656+0000","last_became_peered":"2024-01-31T05:09:20.588656+0000","last_unstale":"2024-01-31T05:10:50.640851+0000","last_undegraded":"2024-01-31T05:10:50.640851+0000","last_fullsized":"2024-01-31T05:10:50.640851+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:02:02.025136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"88'36","reported_seq":297,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:11:22.333318+0000","last_change":"2024-01-31T05:09:20.182539+0000","last_active":"2024-01-31T05:11:22.333318+0000","last_peered":"2024-01-31T05:11:22.333318+0000","last_clean":"2024-01-31T05:11:22.333318+0000","last_became_active":"2024-01-31T05:09:20.182229+0000","last_became_peered":"2024-01-31T05:09:20.182229+0000","last_unstale":"2024-01-31T05:11:22.333318+0000","last_undegraded":"2024-01-31T05:11:22.333318+0000","last_fullsized":"2024-01-31T05:11:22.333318+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:56:21.974450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64725,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":242,"num_read_kb":184,"num_write":38,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"88'6","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.633432+0000","last_change":"2024-01-31T05:09:20.587838+0000","last_active":"2024-01-31T05:10:50.633432+0000","last_peered":"2024-01-31T05:10:50.633432+0000","last_clean":"2024-01-31T05:10:50.633432+0000","last_became_active":"2024-01-31T05:09:20.587523+0000","last_became_peered":"2024-01-31T05:09:20.587523+0000","last_unstale":"2024-01-31T05:10:50.633432+0000","last_undegraded":"2024-01-31T05:10:50.633432+0000","last_fullsized":"2024-01-31T05:10:50.633432+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:36:17.582890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.683191+0000","last_change":"2024-01-31T05:09:20.191935+0000","last_active":"2024-01-31T05:10:21.683191+0000","last_peered":"2024-01-31T05:10:21.683191+0000","last_clean":"2024-01-31T05:10:21.683191+0000","last_became_active":"2024-01-31T05:09:20.191614+0000","last_became_peered":"2024-01-31T05:09:20.191614+0000","last_unstale":"2024-01-31T05:10:21.683191+0000","last_undegraded":"2024-01-31T05:10:21.683191+0000","last_fullsized":"2024-01-31T05:10:21.683191+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:12:38.245944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"88'9","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.632956+0000","last_change":"2024-01-31T05:09:20.585705+0000","last_active":"2024-01-31T05:10:50.632956+0000","last_peered":"2024-01-31T05:10:50.632956+0000","last_clean":"2024-01-31T05:10:50.632956+0000","last_became_active":"2024-01-31T05:09:20.585413+0000","last_became_peered":"2024-01-31T05:09:20.585413+0000","last_unstale":"2024-01-31T05:10:50.632956+0000","last_undegraded":"2024-01-31T05:10:50.632956+0000","last_fullsized":"2024-01-31T05:10:50.632956+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:35:34.686300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684861+0000","last_change":"2024-01-31T05:09:20.191975+0000","last_active":"2024-01-31T05:10:21.684861+0000","last_peered":"2024-01-31T05:10:21.684861+0000","last_clean":"2024-01-31T05:10:21.684861+0000","last_became_active":"2024-01-31T05:09:20.191666+0000","last_became_peered":"2024-01-31T05:09:20.191666+0000","last_unstale":"2024-01-31T05:10:21.684861+0000","last_undegraded":"2024-01-31T05:10:21.684861+0000","last_fullsized":"2024-01-31T05:10:21.684861+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:00:01.162509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"88'15","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.641585+0000","last_change":"2024-01-31T05:10:21.684093+0000","last_active":"2024-01-31T05:10:50.641585+0000","last_peered":"2024-01-31T05:10:50.641585+0000","last_clean":"2024-01-31T05:10:50.641585+0000","last_became_active":"2024-01-31T05:10:21.683777+0000","last_became_peered":"2024-01-31T05:10:21.683777+0000","last_unstale":"2024-01-31T05:10:50.641585+0000","last_undegraded":"2024-01-31T05:10:50.641585+0000","last_fullsized":"2024-01-31T05:10:50.641585+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:54:18.618017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'7","reported_seq":145,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:11:21.348369+0000","last_change":"2024-01-31T05:09:20.183752+0000","last_active":"2024-01-31T05:11:21.348369+0000","last_peered":"2024-01-31T05:11:21.348369+0000","last_clean":"2024-01-31T05:11:21.348369+0000","last_became_active":"2024-01-31T05:09:20.183421+0000","last_became_peered":"2024-01-31T05:09:20.183421+0000","last_unstale":"2024-01-31T05:11:21.348369+0000","last_undegraded":"2024-01-31T05:11:21.348369+0000","last_fullsized":"2024-01-31T05:11:21.348369+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:04:12.919266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1119,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":4,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"88'6","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.639648+0000","last_change":"2024-01-31T05:09:20.593893+0000","last_active":"2024-01-31T05:10:50.639648+0000","last_peered":"2024-01-31T05:10:50.639648+0000","last_clean":"2024-01-31T05:10:50.639648+0000","last_became_active":"2024-01-31T05:09:20.593604+0000","last_became_peered":"2024-01-31T05:09:20.593604+0000","last_unstale":"2024-01-31T05:10:50.639648+0000","last_undegraded":"2024-01-31T05:10:50.639648+0000","last_fullsized":"2024-01-31T05:10:50.639648+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:50:31.534607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.696407+0000","last_change":"2024-01-31T05:10:21.696407+0000","last_active":"2024-01-31T05:10:21.696407+0000","last_peered":"2024-01-31T05:10:21.696407+0000","last_clean":"2024-01-31T05:10:21.696407+0000","last_became_active":"2024-01-31T05:10:21.684807+0000","last_became_peered":"2024-01-31T05:10:21.684807+0000","last_unstale":"2024-01-31T05:10:21.696407+0000","last_undegraded":"2024-01-31T05:10:21.696407+0000","last_fullsized":"2024-01-31T05:10:21.696407+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:21:51.260528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"88'6","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.643658+0000","last_change":"2024-01-31T05:09:20.588049+0000","last_active":"2024-01-31T05:10:50.643658+0000","last_peered":"2024-01-31T05:10:50.643658+0000","last_clean":"2024-01-31T05:10:50.643658+0000","last_became_active":"2024-01-31T05:09:20.587542+0000","last_became_peered":"2024-01-31T05:09:20.587542+0000","last_unstale":"2024-01-31T05:10:50.643658+0000","last_undegraded":"2024-01-31T05:10:50.643658+0000","last_fullsized":"2024-01-31T05:10:50.643658+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:19:55.948269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.683712+0000","last_change":"2024-01-31T05:09:20.185328+0000","last_active":"2024-01-31T05:10:21.683712+0000","last_peered":"2024-01-31T05:10:21.683712+0000","last_clean":"2024-01-31T05:10:21.683712+0000","last_became_active":"2024-01-31T05:09:20.184551+0000","last_became_peered":"2024-01-31T05:09:20.184551+0000","last_unstale":"2024-01-31T05:10:21.683712+0000","last_undegraded":"2024-01-31T05:10:21.683712+0000","last_fullsized":"2024-01-31T05:10:21.683712+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:19:36.143101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"88'5","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.626669+0000","last_change":"2024-01-31T05:09:20.586286+0000","last_active":"2024-01-31T05:10:50.626669+0000","last_peered":"2024-01-31T05:10:50.626669+0000","last_clean":"2024-01-31T05:10:50.626669+0000","last_became_active":"2024-01-31T05:09:20.586011+0000","last_became_peered":"2024-01-31T05:09:20.586011+0000","last_unstale":"2024-01-31T05:10:50.626669+0000","last_undegraded":"2024-01-31T05:10:50.626669+0000","last_fullsized":"2024-01-31T05:10:50.626669+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:21:23.064829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681935+0000","last_change":"2024-01-31T05:09:20.183083+0000","last_active":"2024-01-31T05:10:21.681935+0000","last_peered":"2024-01-31T05:10:21.681935+0000","last_clean":"2024-01-31T05:10:21.681935+0000","last_became_active":"2024-01-31T05:09:20.182742+0000","last_became_peered":"2024-01-31T05:09:20.182742+0000","last_unstale":"2024-01-31T05:10:21.681935+0000","last_undegraded":"2024-01-31T05:10:21.681935+0000","last_fullsized":"2024-01-31T05:10:21.681935+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:12:02.081688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"88'5","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.624298+0000","last_change":"2024-01-31T05:09:20.591522+0000","last_active":"2024-01-31T05:10:50.624298+0000","last_peered":"2024-01-31T05:10:50.624298+0000","last_clean":"2024-01-31T05:10:50.624298+0000","last_became_active":"2024-01-31T05:09:20.591224+0000","last_became_peered":"2024-01-31T05:09:20.591224+0000","last_unstale":"2024-01-31T05:10:50.624298+0000","last_undegraded":"2024-01-31T05:10:50.624298+0000","last_fullsized":"2024-01-31T05:10:50.624298+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:24:17.153662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'6","reported_seq":141,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:11:21.331128+0000","last_change":"2024-01-31T05:09:20.186176+0000","last_active":"2024-01-31T05:11:21.331128+0000","last_peered":"2024-01-31T05:11:21.331128+0000","last_clean":"2024-01-31T05:11:21.331128+0000","last_became_active":"2024-01-31T05:09:20.185873+0000","last_became_peered":"2024-01-31T05:09:20.185873+0000","last_unstale":"2024-01-31T05:11:21.331128+0000","last_undegraded":"2024-01-31T05:11:21.331128+0000","last_fullsized":"2024-01-31T05:11:21.331128+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:55:12.689664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"88'7","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.622708+0000","last_change":"2024-01-31T05:09:20.587556+0000","last_active":"2024-01-31T05:10:50.622708+0000","last_peered":"2024-01-31T05:10:50.622708+0000","last_clean":"2024-01-31T05:10:50.622708+0000","last_became_active":"2024-01-31T05:09:20.587275+0000","last_became_peered":"2024-01-31T05:09:20.587275+0000","last_unstale":"2024-01-31T05:10:50.622708+0000","last_undegraded":"2024-01-31T05:10:50.622708+0000","last_fullsized":"2024-01-31T05:10:50.622708+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:35:16.022422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"88'8","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.628254+0000","last_change":"2024-01-31T05:09:20.588044+0000","last_active":"2024-01-31T05:10:50.628254+0000","last_peered":"2024-01-31T05:10:50.628254+0000","last_clean":"2024-01-31T05:10:50.628254+0000","last_became_active":"2024-01-31T05:09:20.587526+0000","last_became_peered":"2024-01-31T05:09:20.587526+0000","last_unstale":"2024-01-31T05:10:50.628254+0000","last_undegraded":"2024-01-31T05:10:50.628254+0000","last_fullsized":"2024-01-31T05:10:50.628254+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:49:07.270009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'6","reported_seq":141,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:11:20.346466+0000","last_change":"2024-01-31T05:09:20.194791+0000","last_active":"2024-01-31T05:11:20.346466+0000","last_peered":"2024-01-31T05:11:20.346466+0000","last_clean":"2024-01-31T05:11:20.346466+0000","last_became_active":"2024-01-31T05:09:20.194454+0000","last_became_peered":"2024-01-31T05:09:20.194454+0000","last_unstale":"2024-01-31T05:11:20.346466+0000","last_undegraded":"2024-01-31T05:11:20.346466+0000","last_fullsized":"2024-01-31T05:11:20.346466+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:31:26.809960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":116,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"88'8","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.624590+0000","last_change":"2024-01-31T05:09:20.585022+0000","last_active":"2024-01-31T05:10:50.624590+0000","last_peered":"2024-01-31T05:10:50.624590+0000","last_clean":"2024-01-31T05:10:50.624590+0000","last_became_active":"2024-01-31T05:09:20.584709+0000","last_became_peered":"2024-01-31T05:09:20.584709+0000","last_unstale":"2024-01-31T05:10:50.624590+0000","last_undegraded":"2024-01-31T05:10:50.624590+0000","last_fullsized":"2024-01-31T05:10:50.624590+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:10:45.616985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.688980+0000","last_change":"2024-01-31T05:09:20.183779+0000","last_active":"2024-01-31T05:10:21.688980+0000","last_peered":"2024-01-31T05:10:21.688980+0000","last_clean":"2024-01-31T05:10:21.688980+0000","last_became_active":"2024-01-31T05:09:20.183399+0000","last_became_peered":"2024-01-31T05:09:20.183399+0000","last_unstale":"2024-01-31T05:10:21.688980+0000","last_undegraded":"2024-01-31T05:10:21.688980+0000","last_fullsized":"2024-01-31T05:10:21.688980+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:48:43.831022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":346,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681361+0000","last_change":"2024-01-31T05:08:10.168270+0000","last_active":"2024-01-31T05:10:21.681361+0000","last_peered":"2024-01-31T05:10:21.681361+0000","last_clean":"2024-01-31T05:10:21.681361+0000","last_became_active":"2024-01-31T05:08:10.167743+0000","last_became_peered":"2024-01-31T05:08:10.167743+0000","last_unstale":"2024-01-31T05:10:21.681361+0000","last_undegraded":"2024-01-31T05:10:21.681361+0000","last_fullsized":"2024-01-31T05:10:21.681361+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:04:46.976985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:04:46.976985+0000","last_clean_scrub_stamp":"2024-01-31T05:04:46.976985+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:21:54.724227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"88'5","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.633053+0000","last_change":"2024-01-31T05:09:20.583135+0000","last_active":"2024-01-31T05:10:50.633053+0000","last_peered":"2024-01-31T05:10:50.633053+0000","last_clean":"2024-01-31T05:10:50.633053+0000","last_became_active":"2024-01-31T05:09:20.582850+0000","last_became_peered":"2024-01-31T05:09:20.582850+0000","last_unstale":"2024-01-31T05:10:50.633053+0000","last_undegraded":"2024-01-31T05:10:50.633053+0000","last_fullsized":"2024-01-31T05:10:50.633053+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:04:51.204561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.681522+0000","last_change":"2024-01-31T05:09:20.188181+0000","last_active":"2024-01-31T05:10:21.681522+0000","last_peered":"2024-01-31T05:10:21.681522+0000","last_clean":"2024-01-31T05:10:21.681522+0000","last_became_active":"2024-01-31T05:09:20.187801+0000","last_became_peered":"2024-01-31T05:09:20.187801+0000","last_unstale":"2024-01-31T05:10:21.681522+0000","last_undegraded":"2024-01-31T05:10:21.681522+0000","last_fullsized":"2024-01-31T05:10:21.681522+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:27:05.269615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.683769+0000","last_change":"2024-01-31T05:09:20.186242+0000","last_active":"2024-01-31T05:10:21.683769+0000","last_peered":"2024-01-31T05:10:21.683769+0000","last_clean":"2024-01-31T05:10:21.683769+0000","last_became_active":"2024-01-31T05:09:20.185908+0000","last_became_peered":"2024-01-31T05:09:20.185908+0000","last_unstale":"2024-01-31T05:10:21.683769+0000","last_undegraded":"2024-01-31T05:10:21.683769+0000","last_fullsized":"2024-01-31T05:10:21.683769+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:33:40.859324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"88'9","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.629900+0000","last_change":"2024-01-31T05:09:20.590896+0000","last_active":"2024-01-31T05:10:50.629900+0000","last_peered":"2024-01-31T05:10:50.629900+0000","last_clean":"2024-01-31T05:10:50.629900+0000","last_became_active":"2024-01-31T05:09:20.590546+0000","last_became_peered":"2024-01-31T05:09:20.590546+0000","last_unstale":"2024-01-31T05:10:50.629900+0000","last_undegraded":"2024-01-31T05:10:50.629900+0000","last_fullsized":"2024-01-31T05:10:50.629900+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:39:05.969756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"88'11","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.994781+0000","last_change":"2024-01-31T05:09:20.185811+0000","last_active":"2024-01-31T05:10:50.994781+0000","last_peered":"2024-01-31T05:10:50.994781+0000","last_clean":"2024-01-31T05:10:50.994781+0000","last_became_active":"2024-01-31T05:09:20.185490+0000","last_became_peered":"2024-01-31T05:09:20.185490+0000","last_unstale":"2024-01-31T05:10:50.994781+0000","last_undegraded":"2024-01-31T05:10:50.994781+0000","last_fullsized":"2024-01-31T05:10:50.994781+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:16:25.446046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"88'5","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.631208+0000","last_change":"2024-01-31T05:09:20.585298+0000","last_active":"2024-01-31T05:10:50.631208+0000","last_peered":"2024-01-31T05:10:50.631208+0000","last_clean":"2024-01-31T05:10:50.631208+0000","last_became_active":"2024-01-31T05:09:20.584256+0000","last_became_peered":"2024-01-31T05:09:20.584256+0000","last_unstale":"2024-01-31T05:10:50.631208+0000","last_undegraded":"2024-01-31T05:10:50.631208+0000","last_fullsized":"2024-01-31T05:10:50.631208+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:48:10.331714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.689153+0000","last_change":"2024-01-31T05:09:20.184960+0000","last_active":"2024-01-31T05:10:21.689153+0000","last_peered":"2024-01-31T05:10:21.689153+0000","last_clean":"2024-01-31T05:10:21.689153+0000","last_became_active":"2024-01-31T05:09:20.184599+0000","last_became_peered":"2024-01-31T05:09:20.184599+0000","last_unstale":"2024-01-31T05:10:21.689153+0000","last_undegraded":"2024-01-31T05:10:21.689153+0000","last_fullsized":"2024-01-31T05:10:21.689153+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:07:01.846976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"88'7","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.635507+0000","last_change":"2024-01-31T05:09:20.588597+0000","last_active":"2024-01-31T05:10:50.635507+0000","last_peered":"2024-01-31T05:10:50.635507+0000","last_clean":"2024-01-31T05:10:50.635507+0000","last_became_active":"2024-01-31T05:09:20.588326+0000","last_became_peered":"2024-01-31T05:09:20.588326+0000","last_unstale":"2024-01-31T05:10:50.635507+0000","last_undegraded":"2024-01-31T05:10:50.635507+0000","last_fullsized":"2024-01-31T05:10:50.635507+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:31:53.873261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684381+0000","last_change":"2024-01-31T05:09:20.186196+0000","last_active":"2024-01-31T05:10:21.684381+0000","last_peered":"2024-01-31T05:10:21.684381+0000","last_clean":"2024-01-31T05:10:21.684381+0000","last_became_active":"2024-01-31T05:09:20.185373+0000","last_became_peered":"2024-01-31T05:09:20.185373+0000","last_unstale":"2024-01-31T05:10:21.684381+0000","last_undegraded":"2024-01-31T05:10:21.684381+0000","last_fullsized":"2024-01-31T05:10:21.684381+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:13:07.826906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"88'2","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.595768+0000","last_change":"2024-01-31T05:09:20.589183+0000","last_active":"2024-01-31T05:10:50.595768+0000","last_peered":"2024-01-31T05:10:50.595768+0000","last_clean":"2024-01-31T05:10:50.595768+0000","last_became_active":"2024-01-31T05:09:20.588884+0000","last_became_peered":"2024-01-31T05:09:20.588884+0000","last_unstale":"2024-01-31T05:10:50.595768+0000","last_undegraded":"2024-01-31T05:10:50.595768+0000","last_fullsized":"2024-01-31T05:10:50.595768+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:23:49.878076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684293+0000","last_change":"2024-01-31T05:09:20.184849+0000","last_active":"2024-01-31T05:10:21.684293+0000","last_peered":"2024-01-31T05:10:21.684293+0000","last_clean":"2024-01-31T05:10:21.684293+0000","last_became_active":"2024-01-31T05:09:20.184491+0000","last_became_peered":"2024-01-31T05:09:20.184491+0000","last_unstale":"2024-01-31T05:10:21.684293+0000","last_undegraded":"2024-01-31T05:10:21.684293+0000","last_fullsized":"2024-01-31T05:10:21.684293+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T08:36:31.757646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"88'9","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.634337+0000","last_change":"2024-01-31T05:09:20.585917+0000","last_active":"2024-01-31T05:10:50.634337+0000","last_peered":"2024-01-31T05:10:50.634337+0000","last_clean":"2024-01-31T05:10:50.634337+0000","last_became_active":"2024-01-31T05:09:20.585082+0000","last_became_peered":"2024-01-31T05:09:20.585082+0000","last_unstale":"2024-01-31T05:10:50.634337+0000","last_undegraded":"2024-01-31T05:10:50.634337+0000","last_fullsized":"2024-01-31T05:10:50.634337+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:30:17.670739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.699341+0000","last_change":"2024-01-31T05:10:21.699341+0000","last_active":"2024-01-31T05:10:21.699341+0000","last_peered":"2024-01-31T05:10:21.699341+0000","last_clean":"2024-01-31T05:10:21.699341+0000","last_became_active":"2024-01-31T05:10:21.684981+0000","last_became_peered":"2024-01-31T05:10:21.684981+0000","last_unstale":"2024-01-31T05:10:21.699341+0000","last_undegraded":"2024-01-31T05:10:21.699341+0000","last_fullsized":"2024-01-31T05:10:21.699341+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:36:33.975341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"88'8","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.616883+0000","last_change":"2024-01-31T05:09:20.580332+0000","last_active":"2024-01-31T05:10:50.616883+0000","last_peered":"2024-01-31T05:10:50.616883+0000","last_clean":"2024-01-31T05:10:50.616883+0000","last_became_active":"2024-01-31T05:09:20.580014+0000","last_became_peered":"2024-01-31T05:09:20.580014+0000","last_unstale":"2024-01-31T05:10:50.616883+0000","last_undegraded":"2024-01-31T05:10:50.616883+0000","last_fullsized":"2024-01-31T05:10:50.616883+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:38:52.507575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.683162+0000","last_change":"2024-01-31T05:09:20.186065+0000","last_active":"2024-01-31T05:10:21.683162+0000","last_peered":"2024-01-31T05:10:21.683162+0000","last_clean":"2024-01-31T05:10:21.683162+0000","last_became_active":"2024-01-31T05:09:20.185798+0000","last_became_peered":"2024-01-31T05:09:20.185798+0000","last_unstale":"2024-01-31T05:10:21.683162+0000","last_undegraded":"2024-01-31T05:10:21.683162+0000","last_fullsized":"2024-01-31T05:10:21.683162+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:25:05.792886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"88'5","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.640228+0000","last_change":"2024-01-31T05:09:20.589746+0000","last_active":"2024-01-31T05:10:50.640228+0000","last_peered":"2024-01-31T05:10:50.640228+0000","last_clean":"2024-01-31T05:10:50.640228+0000","last_became_active":"2024-01-31T05:09:20.589452+0000","last_became_peered":"2024-01-31T05:09:20.589452+0000","last_unstale":"2024-01-31T05:10:50.640228+0000","last_undegraded":"2024-01-31T05:10:50.640228+0000","last_fullsized":"2024-01-31T05:10:50.640228+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:04:39.773280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'8","reported_seq":147,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:11:20.331308+0000","last_change":"2024-01-31T05:09:20.181920+0000","last_active":"2024-01-31T05:11:20.331308+0000","last_peered":"2024-01-31T05:11:20.331308+0000","last_clean":"2024-01-31T05:11:20.331308+0000","last_became_active":"2024-01-31T05:09:20.181603+0000","last_became_peered":"2024-01-31T05:09:20.181603+0000","last_unstale":"2024-01-31T05:11:20.331308+0000","last_undegraded":"2024-01-31T05:11:20.331308+0000","last_fullsized":"2024-01-31T05:11:20.331308+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:11:30.696322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2009,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"88'7","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.638413+0000","last_change":"2024-01-31T05:09:20.592244+0000","last_active":"2024-01-31T05:10:50.638413+0000","last_peered":"2024-01-31T05:10:50.638413+0000","last_clean":"2024-01-31T05:10:50.638413+0000","last_became_active":"2024-01-31T05:09:20.591940+0000","last_became_peered":"2024-01-31T05:09:20.591940+0000","last_unstale":"2024-01-31T05:10:50.638413+0000","last_undegraded":"2024-01-31T05:10:50.638413+0000","last_fullsized":"2024-01-31T05:10:50.638413+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T14:16:02.284216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.684890+0000","last_change":"2024-01-31T05:09:20.192018+0000","last_active":"2024-01-31T05:10:21.684890+0000","last_peered":"2024-01-31T05:10:21.684890+0000","last_clean":"2024-01-31T05:10:21.684890+0000","last_became_active":"2024-01-31T05:09:20.191721+0000","last_became_peered":"2024-01-31T05:09:20.191721+0000","last_unstale":"2024-01-31T05:10:21.684890+0000","last_undegraded":"2024-01-31T05:10:21.684890+0000","last_fullsized":"2024-01-31T05:10:21.684890+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T07:53:56.199730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"88'7","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.639751+0000","last_change":"2024-01-31T05:09:20.593153+0000","last_active":"2024-01-31T05:10:50.639751+0000","last_peered":"2024-01-31T05:10:50.639751+0000","last_clean":"2024-01-31T05:10:50.639751+0000","last_became_active":"2024-01-31T05:09:20.592869+0000","last_became_peered":"2024-01-31T05:09:20.592869+0000","last_unstale":"2024-01-31T05:10:50.639751+0000","last_undegraded":"2024-01-31T05:10:50.639751+0000","last_fullsized":"2024-01-31T05:10:50.639751+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:35:42.234519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:21.679538+0000","last_change":"2024-01-31T05:09:20.191998+0000","last_active":"2024-01-31T05:10:21.679538+0000","last_peered":"2024-01-31T05:10:21.679538+0000","last_clean":"2024-01-31T05:10:21.679538+0000","last_became_active":"2024-01-31T05:09:20.191658+0000","last_became_peered":"2024-01-31T05:09:20.191658+0000","last_unstale":"2024-01-31T05:10:21.679538+0000","last_undegraded":"2024-01-31T05:10:21.679538+0000","last_fullsized":"2024-01-31T05:10:21.679538+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:19.160983+0000","last_clean_scrub_stamp":"2024-01-31T05:09:19.160983+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T17:06:39.916765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"88'9","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.641520+0000","last_change":"2024-01-31T05:09:20.586822+0000","last_active":"2024-01-31T05:10:50.641520+0000","last_peered":"2024-01-31T05:10:50.641520+0000","last_clean":"2024-01-31T05:10:50.641520+0000","last_became_active":"2024-01-31T05:09:20.586523+0000","last_became_peered":"2024-01-31T05:09:20.586523+0000","last_unstale":"2024-01-31T05:10:50.641520+0000","last_undegraded":"2024-01-31T05:10:50.641520+0000","last_fullsized":"2024-01-31T05:10:50.641520+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:02:59.311443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"88'9","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.627950+0000","last_change":"2024-01-31T05:09:20.586141+0000","last_active":"2024-01-31T05:10:50.627950+0000","last_peered":"2024-01-31T05:10:50.627950+0000","last_clean":"2024-01-31T05:10:50.627950+0000","last_became_active":"2024-01-31T05:09:20.585626+0000","last_became_peered":"2024-01-31T05:09:20.585626+0000","last_unstale":"2024-01-31T05:10:50.627950+0000","last_undegraded":"2024-01-31T05:10:50.627950+0000","last_fullsized":"2024-01-31T05:10:50.627950+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:39:18.023044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"88'12","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.635250+0000","last_change":"2024-01-31T05:09:20.588203+0000","last_active":"2024-01-31T05:10:50.635250+0000","last_peered":"2024-01-31T05:10:50.635250+0000","last_clean":"2024-01-31T05:10:50.635250+0000","last_became_active":"2024-01-31T05:09:20.586660+0000","last_became_peered":"2024-01-31T05:09:20.586660+0000","last_unstale":"2024-01-31T05:10:50.635250+0000","last_undegraded":"2024-01-31T05:10:50.635250+0000","last_fullsized":"2024-01-31T05:10:50.635250+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:27:41.249756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"88'8","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.630397+0000","last_change":"2024-01-31T05:09:20.591708+0000","last_active":"2024-01-31T05:10:50.630397+0000","last_peered":"2024-01-31T05:10:50.630397+0000","last_clean":"2024-01-31T05:10:50.630397+0000","last_became_active":"2024-01-31T05:09:20.590874+0000","last_became_peered":"2024-01-31T05:09:20.590874+0000","last_unstale":"2024-01-31T05:10:50.630397+0000","last_undegraded":"2024-01-31T05:10:50.630397+0000","last_fullsized":"2024-01-31T05:10:50.630397+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T11:13:30.221125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"88'7","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.635702+0000","last_change":"2024-01-31T05:09:20.587566+0000","last_active":"2024-01-31T05:10:50.635702+0000","last_peered":"2024-01-31T05:10:50.635702+0000","last_clean":"2024-01-31T05:10:50.635702+0000","last_became_active":"2024-01-31T05:09:20.587260+0000","last_became_peered":"2024-01-31T05:09:20.587260+0000","last_unstale":"2024-01-31T05:10:50.635702+0000","last_undegraded":"2024-01-31T05:10:50.635702+0000","last_fullsized":"2024-01-31T05:10:50.635702+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T10:32:46.030539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"88'4","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.635094+0000","last_change":"2024-01-31T05:09:20.587259+0000","last_active":"2024-01-31T05:10:50.635094+0000","last_peered":"2024-01-31T05:10:50.635094+0000","last_clean":"2024-01-31T05:10:50.635094+0000","last_became_active":"2024-01-31T05:09:20.586935+0000","last_became_peered":"2024-01-31T05:09:20.586935+0000","last_unstale":"2024-01-31T05:10:50.635094+0000","last_undegraded":"2024-01-31T05:10:50.635094+0000","last_fullsized":"2024-01-31T05:10:50.635094+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:28:23.217392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"88'6","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.627076+0000","last_change":"2024-01-31T05:09:20.587213+0000","last_active":"2024-01-31T05:10:50.627076+0000","last_peered":"2024-01-31T05:10:50.627076+0000","last_clean":"2024-01-31T05:10:50.627076+0000","last_became_active":"2024-01-31T05:09:20.586918+0000","last_became_peered":"2024-01-31T05:09:20.586918+0000","last_unstale":"2024-01-31T05:10:50.627076+0000","last_undegraded":"2024-01-31T05:10:50.627076+0000","last_fullsized":"2024-01-31T05:10:50.627076+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T15:39:27.541560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"88'15","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.635659+0000","last_change":"2024-01-31T05:09:20.584532+0000","last_active":"2024-01-31T05:10:50.635659+0000","last_peered":"2024-01-31T05:10:50.635659+0000","last_clean":"2024-01-31T05:10:50.635659+0000","last_became_active":"2024-01-31T05:09:20.583512+0000","last_became_peered":"2024-01-31T05:09:20.583512+0000","last_unstale":"2024-01-31T05:10:50.635659+0000","last_undegraded":"2024-01-31T05:10:50.635659+0000","last_fullsized":"2024-01-31T05:10:50.635659+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T16:04:33.848498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"88'2","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.627581+0000","last_change":"2024-01-31T05:09:20.587561+0000","last_active":"2024-01-31T05:10:50.627581+0000","last_peered":"2024-01-31T05:10:50.627581+0000","last_clean":"2024-01-31T05:10:50.627581+0000","last_became_active":"2024-01-31T05:09:20.587232+0000","last_became_peered":"2024-01-31T05:09:20.587232+0000","last_unstale":"2024-01-31T05:10:50.627581+0000","last_undegraded":"2024-01-31T05:10:50.627581+0000","last_fullsized":"2024-01-31T05:10:50.627581+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:17:01.913186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"88'6","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.625110+0000","last_change":"2024-01-31T05:09:20.581823+0000","last_active":"2024-01-31T05:10:50.625110+0000","last_peered":"2024-01-31T05:10:50.625110+0000","last_clean":"2024-01-31T05:10:50.625110+0000","last_became_active":"2024-01-31T05:09:20.581560+0000","last_became_peered":"2024-01-31T05:09:20.581560+0000","last_unstale":"2024-01-31T05:10:50.625110+0000","last_undegraded":"2024-01-31T05:10:50.625110+0000","last_fullsized":"2024-01-31T05:10:50.625110+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T06:48:50.057303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"88'8","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.629758+0000","last_change":"2024-01-31T05:09:20.582477+0000","last_active":"2024-01-31T05:10:50.629758+0000","last_peered":"2024-01-31T05:10:50.629758+0000","last_clean":"2024-01-31T05:10:50.629758+0000","last_became_active":"2024-01-31T05:09:20.582051+0000","last_became_peered":"2024-01-31T05:09:20.582051+0000","last_unstale":"2024-01-31T05:10:50.629758+0000","last_undegraded":"2024-01-31T05:10:50.629758+0000","last_fullsized":"2024-01-31T05:10:50.629758+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T13:24:36.665707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"88'10","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.643219+0000","last_change":"2024-01-31T05:09:20.587281+0000","last_active":"2024-01-31T05:10:50.643219+0000","last_peered":"2024-01-31T05:10:50.643219+0000","last_clean":"2024-01-31T05:10:50.643219+0000","last_became_active":"2024-01-31T05:09:20.586976+0000","last_became_peered":"2024-01-31T05:09:20.586976+0000","last_unstale":"2024-01-31T05:10:50.643219+0000","last_undegraded":"2024-01-31T05:10:50.643219+0000","last_fullsized":"2024-01-31T05:10:50.643219+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T05:33:59.065647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"88'11","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.633364+0000","last_change":"2024-01-31T05:09:20.585953+0000","last_active":"2024-01-31T05:10:50.633364+0000","last_peered":"2024-01-31T05:10:50.633364+0000","last_clean":"2024-01-31T05:10:50.633364+0000","last_became_active":"2024-01-31T05:09:20.585406+0000","last_became_peered":"2024-01-31T05:09:20.585406+0000","last_unstale":"2024-01-31T05:10:50.633364+0000","last_undegraded":"2024-01-31T05:10:50.633364+0000","last_fullsized":"2024-01-31T05:10:50.633364+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T12:14:24.622166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"88'8","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-01-31T05:10:50.625149+0000","last_change":"2024-01-31T05:09:20.587073+0000","last_active":"2024-01-31T05:10:50.625149+0000","last_peered":"2024-01-31T05:10:50.625149+0000","last_clean":"2024-01-31T05:10:50.625149+0000","last_became_active":"2024-01-31T05:09:20.586753+0000","last_became_peered":"2024-01-31T05:09:20.586753+0000","last_unstale":"2024-01-31T05:10:50.625149+0000","last_undegraded":"2024-01-31T05:10:50.625149+0000","last_fullsized":"2024-01-31T05:10:50.625149+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-31T05:09:20.165823+0000","last_clean_scrub_stamp":"2024-01-31T05:09:20.165823+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-01T09:13:20.291390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":73438,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1197,"num_read_kb":679,"num_write":252,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":220314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351014,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":970752,"data_stored":463936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.53700000000000003,"15min":0.54400000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.63800000000000001,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.59699999999999998,"15min":0.60499999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.753,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.47899999999999998}]},{"osd":1,"last update":"Wed Jan 31 05:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.63600000000000001,"15min":0.629},"min":{"1min":0.49299999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.60199999999999998,"15min":0.59599999999999997},"min":{"1min":0.48599999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82699999999999996,"5min":0.872,"15min":0.872},"last":0.42899999999999999}]},{"osd":2,"last update":"Wed Jan 31 05:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.48899999999999999,"15min":0.49299999999999999},"min":{"1min":0.33700000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.66200000000000003,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.371},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.498,"15min":0.502},"min":{"1min":0.34300000000000003,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.51600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":4,"last update":"Wed Jan 31 05:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.63600000000000001,"15min":0.63500000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.66600000000000004,"15min":0.66800000000000004},"min":{"1min":0.44900000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.77900000000000003,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.72899999999999998}]},{"osd":5,"last update":"Wed Jan 31 05:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.61499999999999999,"15min":0.62},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.59999999999999998,"15min":0.60899999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71499999999999997,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.71099999999999997}]},{"osd":6,"last update":"Wed Jan 31 05:09:32 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.432},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.58999999999999997}]},{"osd":7,"last update":"Wed Jan 31 05:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.73599999999999999,"15min":0.74099999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.90000000000000002,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.74299999999999999,"15min":0.75},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.88800000000000001,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.77900000000000003}]},{"osd":8,"last update":"Wed Jan 31 05:10:20 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.79500000000000004}]},{"osd":9,"last update":"Wed Jan 31 05:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.78400000000000003,"15min":0.78700000000000003},"min":{"1min":0.63,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.96699999999999997,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.56299999999999994,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.93500000000000005,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.84599999999999997}]},{"osd":10,"last update":"Wed Jan 31 05:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.78700000000000003,"15min":0.79200000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.89800000000000002,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.82099999999999995,"15min":0.82499999999999996},"min":{"1min":0.69899999999999995,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.94399999999999995,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.748}]}]},{"osd":10,"up_from":73,"seq":313532612652,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36964,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708188,"statfs":{"total":95995035648,"available":95957184512,"internally_reserved":0,"allocated":1667072,"data_stored":1119270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":36174273},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:10:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.46800000000000003}]},{"osd":1,"last update":"Wed Jan 31 05:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.47599999999999998,"15min":0.48399999999999999},"min":{"1min":0.313,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.67100000000000004,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.442},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.501,"15min":0.51300000000000001},"min":{"1min":0.316,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70699999999999996,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.42199999999999999}]},{"osd":2,"last update":"Wed Jan 31 05:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59299999999999997,"15min":0.58699999999999997},"min":{"1min":0.40600000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63700000000000001,"15min":0.63300000000000001},"min":{"1min":0.439,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80100000000000005,"5min":0.874,"15min":0.874},"last":0.62}]},{"osd":3,"last update":"Wed Jan 31 05:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.60899999999999999,"15min":0.625},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77000000000000002,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.63900000000000001,"15min":0.65600000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.79300000000000004,"5min":1.115,"15min":1.115},"last":0.60099999999999998}]},{"osd":4,"last update":"Wed Jan 31 05:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.32700000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.77500000000000002,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.76000000000000001,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.55100000000000005}]},{"osd":5,"last update":"Wed Jan 31 05:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.65700000000000003,"15min":0.65300000000000002},"min":{"1min":0.45900000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.876,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.66800000000000004,"15min":0.65600000000000003},"min":{"1min":0.51900000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.91200000000000003,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.67900000000000005}]},{"osd":6,"last update":"Wed Jan 31 05:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.70699999999999996,"15min":0.71699999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.85899999999999999,"5min":1.022,"15min":1.022},"last":0.751},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.70799999999999996,"15min":0.72699999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.83799999999999997,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.66800000000000004}]},{"osd":7,"last update":"Wed Jan 31 05:09:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.57199999999999995}]},{"osd":8,"last update":"Wed Jan 31 05:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.749,"15min":0.76100000000000001},"min":{"1min":0.53400000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.94999999999999996,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.76400000000000001,"15min":0.77700000000000002},"min":{"1min":0.56200000000000006,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93600000000000005,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.65400000000000003}]},{"osd":9,"last update":"Wed Jan 31 05:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.78000000000000003,"15min":0.79800000000000004},"min":{"1min":0.51000000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.96299999999999997,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.77800000000000002,"15min":0.79900000000000004},"min":{"1min":0.52200000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.94999999999999996,"5min":1.452,"15min":1.452},"last":0.71699999999999997}]},{"osd":11,"last update":"Wed Jan 31 05:10:36 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.75,"15min":0.746},"min":{"1min":0.64500000000000002,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.90200000000000002,"5min":1.026,"15min":1.026},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77100000000000002,"15min":0.77000000000000002},"min":{"1min":0.61099999999999999,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.94199999999999995,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.70399999999999996}]}]},{"osd":9,"up_from":67,"seq":287762808880,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":987136,"data_stored":462915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:10:46 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.41599999999999998,"15min":0.434},"min":{"1min":0.27500000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.49099999999999999,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.53000000000000003,"15min":0.50800000000000001},"min":{"1min":0.29999999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.65700000000000003,"5min":7.8330000000000002,"15min":7.8330000000000002},"last":0.27000000000000002}]},{"osd":1,"last update":"Wed Jan 31 05:10:46 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69399999999999995,"5min":2.661,"15min":2.661},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.59599999999999997,"15min":0.61199999999999999},"min":{"1min":0.44800000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.67900000000000005,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.46200000000000002}]},{"osd":2,"last update":"Wed Jan 31 05:10:46 2024","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":0.79000000000000004,"15min":0.66200000000000003},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":19.556999999999999,"5min":19.556999999999999,"15min":19.556999999999999},"last":0.44},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.59799999999999998,"15min":0.62},"min":{"1min":0.40300000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.76800000000000002,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.51300000000000001}]},{"osd":3,"last update":"Wed Jan 31 05:10:46 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.68799999999999994,"15min":0.59199999999999997},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.65700000000000003,"5min":19.687000000000001,"15min":19.687000000000001},"last":0.312},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.57199999999999995,"15min":0.53700000000000003},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.64000000000000001,"5min":10.478,"15min":10.478},"last":0.32800000000000001}]},{"osd":4,"last update":"Wed Jan 31 05:10:46 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.63500000000000001,"15min":0.65100000000000002},"min":{"1min":0.46000000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.83599999999999997,"5min":1.002,"15min":1.002},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.69899999999999995,"15min":0.66400000000000003},"min":{"1min":0.46100000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.876,"5min":8.2289999999999992,"15min":8.2289999999999992},"last":0.60899999999999999}]},{"osd":5,"last update":"Wed Jan 31 05:10:46 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.73799999999999999,"15min":0.70099999999999996},"min":{"1min":0.41999999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.92800000000000005,"5min":9.9339999999999993,"15min":9.9339999999999993},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.68899999999999995,"15min":0.70699999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.75600000000000001,"5min":2.8130000000000002,"15min":2.8130000000000002},"last":0.48399999999999999}]},{"osd":6,"last update":"Wed Jan 31 05:10:46 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.60699999999999998,"15min":0.63500000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.75,"5min":3.141,"15min":3.141},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.68400000000000005,"15min":0.70799999999999996},"min":{"1min":0.38400000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.877,"5min":2.9350000000000001,"15min":2.9350000000000001},"last":0.376}]},{"osd":7,"last update":"Wed Jan 31 05:10:46 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.78700000000000003,"15min":0.75700000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.84499999999999997,"5min":8.2639999999999993,"15min":8.2639999999999993},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.81699999999999995,"15min":0.78500000000000003},"min":{"1min":0.50800000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.87,"5min":10.438000000000001,"15min":10.438000000000001},"last":0.52700000000000002}]},{"osd":8,"last update":"Wed Jan 31 05:10:46 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.77400000000000002,"15min":0.78600000000000003},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.4490000000000001,"5min":2.8889999999999998,"15min":2.8889999999999998},"last":0.496},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.91000000000000003,"15min":0.83399999999999996},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.95499999999999996,"5min":17.093,"15min":17.093},"last":0.55300000000000005}]},{"osd":10,"last update":"Wed Jan 31 05:11:15 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.748,"15min":0.76700000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.89900000000000002,"5min":1.111,"15min":1.111},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.82199999999999995,"15min":0.78500000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.81399999999999995,"5min":9.5899999999999999,"15min":9.5899999999999999},"last":0.67200000000000004}]}]},{"osd":8,"up_from":59,"seq":253403070517,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":974848,"data_stored":463181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.60799999999999998,"15min":0.58799999999999997},"min":{"1min":0.373,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":3.5819999999999999,"5min":3.5819999999999999,"15min":3.5819999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.57499999999999996,"15min":0.58599999999999997},"min":{"1min":0.38800000000000001,"5min":0.316,"15min":0.316},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.85799999999999998}]},{"osd":1,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.63700000000000001,"15min":0.61299999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":2.7679999999999998,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.65800000000000003,"15min":0.63400000000000001},"min":{"1min":0.47699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":3.2389999999999999,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.73399999999999999}]},{"osd":2,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.48999999999999999,"15min":0.48399999999999999},"min":{"1min":0.32600000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.52900000000000003,"15min":0.51300000000000001},"min":{"1min":0.41799999999999998,"5min":0.251,"15min":0.251},"max":{"1min":3.9729999999999999,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":0.46100000000000002}]},{"osd":3,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.57899999999999996,"15min":0.58499999999999996},"min":{"1min":0.34100000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.64500000000000002,"15min":0.65100000000000002},"min":{"1min":0.435,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":2.8050000000000002,"5min":2.8050000000000002,"15min":2.8050000000000002},"last":0.91700000000000004}]},{"osd":4,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.68899999999999995,"15min":0.65100000000000002},"min":{"1min":0.51800000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":5.1820000000000004,"5min":5.1820000000000004,"15min":5.1820000000000004},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.68600000000000005,"15min":0.66400000000000003},"min":{"1min":0.56200000000000006,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":3.0150000000000001,"5min":3.0150000000000001,"15min":3.0150000000000001},"last":0.88900000000000001}]},{"osd":5,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.627,"15min":0.61899999999999999},"min":{"1min":0.48899999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":3.617,"5min":3.617,"15min":3.617},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.61299999999999999,"15min":0.60499999999999998},"min":{"1min":0.35899999999999999,"5min":0.317,"15min":0.317},"max":{"1min":2.9540000000000002,"5min":2.9540000000000002,"15min":2.9540000000000002},"last":0.51700000000000002}]},{"osd":6,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.70999999999999996,"15min":0.72099999999999997},"min":{"1min":0.47399999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":2.3740000000000001,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.74299999999999999,"15min":0.73799999999999999},"min":{"1min":0.54800000000000004,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":3.2749999999999999,"5min":3.2749999999999999,"15min":3.2749999999999999},"last":0.80200000000000005}]},{"osd":7,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":0.76900000000000002,"15min":0.73899999999999999},"min":{"1min":0.64100000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":4.1970000000000001,"5min":4.1970000000000001,"15min":4.1970000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.94699999999999995,"15min":0.79900000000000004},"min":{"1min":0.67900000000000005,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":2.181,"5min":19.677,"15min":19.677},"last":0.76900000000000002}]},{"osd":9,"last update":"Wed Jan 31 05:10:43 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":1.302,"15min":1.544},"min":{"1min":0.53900000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.91800000000000004,"5min":19.695,"15min":19.695},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.74199999999999999,"15min":0.69999999999999996},"min":{"1min":0.629,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0109999999999999,"5min":3.306,"15min":3.306},"last":0.878}]},{"osd":10,"last update":"Wed Jan 31 05:11:12 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.76900000000000002,"15min":0.71299999999999997},"min":{"1min":0.58099999999999996,"5min":0.439,"15min":0.439},"max":{"1min":1.0780000000000001,"5min":4.3760000000000003,"15min":4.3760000000000003},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.83199999999999996,"15min":0.76200000000000001},"min":{"1min":0.54900000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0589999999999999,"5min":6.875,"15min":6.875},"last":0.84299999999999997}]},{"osd":11,"last update":"Wed Jan 31 05:10:21 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.78400000000000003}]}]},{"osd":7,"up_from":51,"seq":219043332154,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28560,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716592,"statfs":{"total":95995035648,"available":95965790208,"internally_reserved":0,"allocated":1581056,"data_stored":1056872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:08:52 2024","interfaces":[{"interface":"back","average":{"1min":1.669,"5min":0.75600000000000001,"15min":0.60399999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":19.462,"5min":19.462,"15min":19.462},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.52900000000000003,"15min":0.51900000000000002},"min":{"1min":0.40899999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.45500000000000002}]},{"osd":1,"last update":"Wed Jan 31 05:10:57 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.41999999999999998,"15min":0.41299999999999998},"min":{"1min":0.31900000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.54300000000000004,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.46100000000000002,"15min":0.44600000000000001},"min":{"1min":0.33100000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.64300000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.42999999999999999}]},{"osd":2,"last update":"Wed Jan 31 05:10:57 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.60799999999999998,"15min":0.58999999999999997},"min":{"1min":0.46600000000000003,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60299999999999998,"15min":0.60199999999999998},"min":{"1min":0.46400000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.74199999999999999,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.60099999999999998}]},{"osd":3,"last update":"Wed Jan 31 05:10:57 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55900000000000005,"15min":0.55300000000000005},"min":{"1min":0.43099999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.80100000000000005,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.57099999999999995,"15min":0.57399999999999995},"min":{"1min":0.39800000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.70799999999999996,"5min":0.87,"15min":0.87},"last":0.51300000000000001}]},{"osd":4,"last update":"Wed Jan 31 05:10:57 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.48099999999999998,"15min":0.47799999999999998},"min":{"1min":0.32400000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.65000000000000002,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.502,"15min":0.50600000000000001},"min":{"1min":0.36399999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.63500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.56100000000000005}]},{"osd":5,"last update":"Wed Jan 31 05:10:57 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.64400000000000002,"15min":0.63},"min":{"1min":0.49299999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.64500000000000002,"15min":0.64300000000000002},"min":{"1min":0.52500000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.77100000000000002,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.753}]},{"osd":6,"last update":"Wed Jan 31 05:10:57 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.63800000000000001,"15min":0.63100000000000001},"min":{"1min":0.51000000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.751,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.88,"15min":0.72999999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.82799999999999996,"5min":19.425000000000001,"15min":19.425000000000001},"last":0.62}]},{"osd":8,"last update":"Wed Jan 31 05:10:21 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.68799999999999994,"15min":0.68200000000000005},"min":{"1min":0.61799999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.85099999999999998,"5min":0.875,"15min":0.875},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.70799999999999996,"15min":0.71199999999999997},"min":{"1min":0.56899999999999995,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.85899999999999999,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.81699999999999995}]},{"osd":9,"last update":"Wed Jan 31 05:10:42 2024","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":0.82799999999999996,"15min":0.752},"min":{"1min":0.498,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":11.433999999999999,"5min":11.433999999999999,"15min":11.433999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":1.3089999999999999,"5min":0.82099999999999995,"15min":0.73599999999999999},"min":{"1min":0.54500000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":11.416,"5min":11.416,"15min":11.416},"last":0.71799999999999997}]},{"osd":10,"last update":"Wed Jan 31 05:11:13 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.52600000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.70399999999999996,"15min":0.70599999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.63800000000000001}]},{"osd":11,"last update":"Wed Jan 31 05:10:21 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.84699999999999998}]}]},{"osd":6,"up_from":46,"seq":197568495679,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":970752,"data_stored":463022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:10:34 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.378,"15min":0.37},"min":{"1min":0.28100000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.53400000000000003,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.378},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.40600000000000003,"15min":0.40799999999999997},"min":{"1min":0.28499999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.35799999999999998}]},{"osd":1,"last update":"Wed Jan 31 05:10:34 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.54700000000000004,"15min":0.53900000000000003},"min":{"1min":0.40899999999999997,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56200000000000006,"15min":0.55400000000000005},"min":{"1min":0.42699999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.83599999999999997,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.622}]},{"osd":2,"last update":"Wed Jan 31 05:10:34 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.55400000000000005,"15min":0.55200000000000005},"min":{"1min":0.39000000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.77600000000000002,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.55200000000000005,"15min":0.54600000000000004},"min":{"1min":0.372,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73599999999999999,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.65200000000000002}]},{"osd":3,"last update":"Wed Jan 31 05:10:34 2024","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.437,"15min":0.44700000000000001},"min":{"1min":0.30199999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.56100000000000005,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.47499999999999998,"15min":0.47999999999999998},"min":{"1min":0.316,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.61199999999999999,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.44600000000000001}]},{"osd":4,"last update":"Wed Jan 31 05:10:34 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.58499999999999996,"15min":0.59099999999999997},"min":{"1min":0.443,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58499999999999996,"15min":0.57599999999999996},"min":{"1min":0.41099999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.86199999999999999,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.69399999999999995}]},{"osd":5,"last update":"Wed Jan 31 05:10:34 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.44,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.70299999999999996,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.61399999999999999,"15min":0.63},"min":{"1min":0.42599999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.82099999999999995,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.56399999999999995}]},{"osd":7,"last update":"Wed Jan 31 05:10:58 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.629,"15min":0.63200000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.78000000000000003,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.47699999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.91300000000000003,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.68400000000000005}]},{"osd":8,"last update":"Wed Jan 31 05:10:17 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.67100000000000004,"15min":0.68700000000000006},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81399999999999995,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.747,"15min":0.79400000000000004},"min":{"1min":0.48599999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.80200000000000005,"5min":3.3130000000000002,"15min":3.3130000000000002},"last":0.67500000000000004}]},{"osd":9,"last update":"Wed Jan 31 05:10:45 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.65400000000000003,"15min":0.69299999999999995},"min":{"1min":0.40000000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76600000000000001,"5min":1,"15min":1},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.63700000000000001,"15min":0.66700000000000004},"min":{"1min":0.41899999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82499999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.59199999999999997}]},{"osd":10,"last update":"Wed Jan 31 05:11:12 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.73799999999999999,"15min":0.76700000000000002},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.89400000000000002,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.748},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.73199999999999998,"15min":0.749},"min":{"1min":0.51000000000000001,"5min":0.501,"15min":0.501},"max":{"1min":0.88700000000000001,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.73899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1036288,"data_stored":528660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:10:34 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51800000000000002,"15min":0.49399999999999999},"min":{"1min":0.36199999999999999,"5min":0.29999999999999999,"15min":0.29399999999999998},"max":{"1min":0.76600000000000001,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.497},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.55100000000000005,"15min":0.51700000000000002},"min":{"1min":0.39200000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.84399999999999997,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.51300000000000001}]},{"osd":2,"last update":"Wed Jan 31 05:10:59 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.61599999999999999,"15min":0.54000000000000004},"min":{"1min":0.48299999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.58899999999999997,"15min":0.52100000000000002},"min":{"1min":0.42199999999999999,"5min":0.36799999999999999,"15min":0.316},"max":{"1min":0.82099999999999995,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.67900000000000005}]},{"osd":3,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.52100000000000002,"15min":0.49399999999999999},"min":{"1min":0.40899999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.56699999999999995,"15min":0.51200000000000001},"min":{"1min":0.496,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.91600000000000004,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.45100000000000001}]},{"osd":4,"last update":"Wed Jan 31 05:10:47 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.47099999999999997,"15min":0.443},"min":{"1min":0.33100000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.78000000000000003,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.48499999999999999,"15min":0.45100000000000001},"min":{"1min":0.36299999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.71499999999999997,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.38700000000000001}]},{"osd":5,"last update":"Wed Jan 31 05:11:08 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.65000000000000002,"15min":0.57499999999999996},"min":{"1min":0.55900000000000005,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.64500000000000002,"15min":0.58199999999999996},"min":{"1min":0.57099999999999995,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.58599999999999997}]},{"osd":6,"last update":"Wed Jan 31 05:10:34 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.59699999999999998,"15min":0.58499999999999996},"min":{"1min":0.48199999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83899999999999997,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.65000000000000002,"15min":0.61899999999999999},"min":{"1min":0.54100000000000004,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.98899999999999999,"5min":0.998,"15min":0.998},"last":0.66100000000000003}]},{"osd":7,"last update":"Wed Jan 31 05:10:59 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.625,"15min":0.58799999999999997},"min":{"1min":0.437,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.95999999999999996,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.61399999999999999,"15min":0.59899999999999998},"min":{"1min":0.47299999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88200000000000001,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.59899999999999998}]},{"osd":8,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.69899999999999995,"15min":0.67300000000000004},"min":{"1min":0.51200000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.69199999999999995,"15min":0.66900000000000004},"min":{"1min":0.58999999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.64400000000000002}]},{"osd":9,"last update":"Wed Jan 31 05:10:47 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.749,"15min":0.74099999999999999},"min":{"1min":0.63400000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.036,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.70299999999999996,"15min":0.69599999999999995},"min":{"1min":0.56100000000000005,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.94299999999999995,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.63100000000000001}]},{"osd":10,"last update":"Wed Jan 31 05:11:14 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.77700000000000002,"15min":0.752},"min":{"1min":0.68500000000000005,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0860000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.76800000000000002,"15min":0.749},"min":{"1min":0.66600000000000004,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.72499999999999998}]},{"osd":11,"last update":"Wed Jan 31 05:10:25 2024","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.747}]}]},{"osd":0,"up_from":8,"seq":34359738461,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":991232,"data_stored":464810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 31 05:10:33 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":0.62,"15min":0.56100000000000005},"min":{"1min":0.40500000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":9.5289999999999999,"5min":9.5289999999999999,"15min":9.5289999999999999},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54700000000000004,"15min":0.53300000000000003},"min":{"1min":0.38700000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.74399999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.53700000000000003}]},{"osd":2,"last update":"Wed Jan 31 05:11:04 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.57399999999999995,"15min":0.55200000000000005},"min":{"1min":0.46999999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.79900000000000004,"5min":0.873,"15min":0.873},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.753,"15min":0.628},"min":{"1min":0.39200000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.77200000000000002,"5min":9.4990000000000006,"15min":9.4990000000000006},"last":0.55800000000000005}]},{"osd":3,"last update":"Wed Jan 31 05:10:23 2024","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.35599999999999998}]},{"osd":4,"last update":"Wed Jan 31 05:10:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54000000000000004,"15min":0.52300000000000002},"min":{"1min":0.40600000000000003,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72999999999999998,"5min":0.748,"15min":0.748},"last":0.38100000000000001},{"interface":"front","average":{"1min":1.0880000000000001,"5min":0.66800000000000004,"15min":0.55300000000000005},"min":{"1min":0.434,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":9.5150000000000006,"5min":9.5150000000000006,"15min":9.5150000000000006},"last":0.46800000000000003}]},{"osd":5,"last update":"Wed Jan 31 05:11:16 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56999999999999995,"15min":0.55100000000000005},"min":{"1min":0.46899999999999997,"5min":0.371,"15min":0.371},"max":{"1min":0.72199999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.61299999999999999},{"interface":"front","average":{"1min":1.256,"5min":0.93600000000000005,"15min":0.69199999999999995},"min":{"1min":0.501,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":13.021000000000001,"5min":13.021000000000001,"15min":13.021000000000001},"last":0.60699999999999998}]},{"osd":6,"last update":"Wed Jan 31 05:10:33 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.49399999999999999,"15min":0.51100000000000001},"min":{"1min":0.317,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.75700000000000001,"5min":0.878,"15min":0.878},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.51000000000000001,"15min":0.51400000000000001},"min":{"1min":0.308,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.41499999999999998}]},{"osd":7,"last update":"Wed Jan 31 05:08:59 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.627,"15min":0.622},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80900000000000005,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.64400000000000002,"15min":0.64200000000000002},"min":{"1min":0.47899999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.81699999999999995,"5min":0.874,"15min":0.874},"last":0.54600000000000004}]},{"osd":8,"last update":"Wed Jan 31 05:10:23 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.71899999999999997,"15min":0.67500000000000004},"min":{"1min":0.40000000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.133,"5min":9.2840000000000007,"15min":9.2840000000000007},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70199999999999996,"15min":0.71999999999999997},"min":{"1min":0.52500000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.85399999999999998,"5min":1.006,"15min":1.006},"last":0.63700000000000001}]},{"osd":9,"last update":"Wed Jan 31 05:10:44 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.63700000000000001,"15min":0.68300000000000005},"min":{"1min":0.38600000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.72099999999999997,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.625,"15min":0.67300000000000004},"min":{"1min":0.34999999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73299999999999998,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.5}]},{"osd":10,"last update":"Wed Jan 31 05:11:16 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.64400000000000002,"15min":0.65400000000000003},"min":{"1min":0.497,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.81000000000000005,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68999999999999995,"15min":0.70099999999999996},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.90900000000000003,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.68799999999999994}]},{"osd":11,"last update":"Wed Jan 31 05:10:33 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.65100000000000002,"15min":0.64300000000000002},"min":{"1min":0.56100000000000005,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.79400000000000004,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71499999999999997,"15min":0.71399999999999997},"min":{"1min":0.57499999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.84599999999999997,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.67200000000000004}]}]},{"osd":2,"up_from":18,"seq":77309411411,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1056768,"data_stored":529860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:10:59 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.54100000000000004,"15min":0.48699999999999999},"min":{"1min":0.34000000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.53400000000000003,"15min":0.504},"min":{"1min":0.41599999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.73299999999999998,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.42099999999999999}]},{"osd":1,"last update":"Wed Jan 31 05:10:59 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.56200000000000006,"15min":0.52100000000000002},"min":{"1min":0.372,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80800000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.58999999999999997,"15min":0.53700000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.48099999999999998}]},{"osd":3,"last update":"Wed Jan 31 05:10:22 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.57199999999999995,"15min":0.53000000000000003},"min":{"1min":0.48699999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57199999999999995,"15min":0.53800000000000003},"min":{"1min":0.41099999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.753,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.442}]},{"osd":4,"last update":"Wed Jan 31 05:10:22 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.52300000000000002}]},{"osd":5,"last update":"Wed Jan 31 05:11:03 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.47699999999999998,"15min":0.42599999999999999},"min":{"1min":0.39500000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.495,"15min":0.45200000000000001},"min":{"1min":0.40500000000000003,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.89500000000000002,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.34000000000000002}]},{"osd":6,"last update":"Wed Jan 31 05:10:34 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.61399999999999999,"15min":0.56200000000000006},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.89700000000000002,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.60299999999999998,"15min":0.57699999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.68600000000000005}]},{"osd":7,"last update":"Wed Jan 31 05:08:55 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.77600000000000002,"15min":0.80300000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.77000000000000002,"5min":3.9449999999999998,"15min":3.9449999999999998},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.78600000000000003,"15min":0.80900000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.80600000000000005,"5min":4.1230000000000002,"15min":4.1230000000000002},"last":0.44}]},{"osd":8,"last update":"Wed Jan 31 05:11:20 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.59699999999999998,"15min":0.57799999999999996},"min":{"1min":0.33000000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.92700000000000005,"5min":1.036,"15min":1.036},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.65400000000000003,"15min":0.63100000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.96799999999999997,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.626}]},{"osd":9,"last update":"Wed Jan 31 05:10:50 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.72899999999999998,"15min":0.72399999999999998},"min":{"1min":0.56100000000000005,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.95099999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.5740000000000001,"5min":0.85699999999999998,"15min":0.73699999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":19.821999999999999,"5min":19.821999999999999,"15min":19.821999999999999},"last":0.61799999999999999}]},{"osd":10,"last update":"Wed Jan 31 05:11:10 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.69599999999999995,"15min":0.69499999999999995},"min":{"1min":0.56100000000000005,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.74199999999999999,"15min":0.71399999999999997},"min":{"1min":0.58999999999999997,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.66300000000000003}]},{"osd":11,"last update":"Wed Jan 31 05:10:22 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.70299999999999996}]}]},{"osd":3,"up_from":25,"seq":107374182477,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":987136,"data_stored":462457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:10:25 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.36099999999999999,"15min":0.32300000000000001},"min":{"1min":0.25600000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.38700000000000001,"15min":0.34699999999999998},"min":{"1min":0.23899999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.47199999999999998}]},{"osd":1,"last update":"Wed Jan 31 05:10:25 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.54600000000000004,"15min":0.51200000000000001},"min":{"1min":0.42799999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.621},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.54000000000000004,"15min":0.50700000000000001},"min":{"1min":0.32600000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.55400000000000005}]},{"osd":2,"last update":"Wed Jan 31 05:10:25 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.56999999999999995,"15min":0.51300000000000001},"min":{"1min":0.44,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.55200000000000005,"15min":0.51700000000000002},"min":{"1min":0.35599999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.438}]},{"osd":4,"last update":"Wed Jan 31 05:10:47 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55400000000000005,"15min":0.52400000000000002},"min":{"1min":0.36499999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71999999999999997,"5min":1.202,"15min":1.202},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59099999999999997,"15min":0.52600000000000002},"min":{"1min":0.38300000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.94599999999999995,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.64600000000000002}]},{"osd":5,"last update":"Wed Jan 31 05:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57199999999999995,"15min":0.56399999999999995},"min":{"1min":0.40600000000000003,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.81299999999999994,"5min":1.129,"15min":1.129},"last":0.499},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60999999999999999,"15min":0.58599999999999997},"min":{"1min":0.42399999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.82499999999999996,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.41799999999999998}]},{"osd":6,"last update":"Wed Jan 31 05:10:33 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.51400000000000001,"15min":0.47599999999999998},"min":{"1min":0.318,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":2.5600000000000001,"5min":2.5600000000000001,"15min":2.5600000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.51000000000000001,"15min":0.48599999999999999},"min":{"1min":0.34399999999999997,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.7210000000000001,"5min":2.7210000000000001,"15min":2.7210000000000001},"last":0.53600000000000003}]},{"osd":7,"last update":"Wed Jan 31 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.71899999999999997,"15min":0.66900000000000004},"min":{"1min":0.49199999999999999,"5min":0.443,"15min":0.443},"max":{"1min":5.29,"5min":5.29,"15min":5.29},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.70699999999999996,"15min":0.66400000000000003},"min":{"1min":0.499,"5min":0.442,"15min":0.442},"max":{"1min":5.306,"5min":5.306,"15min":5.306},"last":0.65900000000000003}]},{"osd":8,"last update":"Wed Jan 31 05:08:16 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.68200000000000005}]},{"osd":9,"last update":"Wed Jan 31 05:10:44 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.69099999999999995,"15min":0.71899999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90400000000000003,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.63300000000000001,"15min":0.65500000000000003},"min":{"1min":0.39200000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.78900000000000003,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.57299999999999995}]},{"osd":10,"last update":"Wed Jan 31 05:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.70299999999999996,"15min":0.72299999999999998},"min":{"1min":0.50900000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.92300000000000004,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.76800000000000002,"15min":0.79400000000000004},"min":{"1min":0.55700000000000005,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.96699999999999997,"5min":1.696,"15min":1.696},"last":0.70899999999999996}]},{"osd":11,"last update":"Wed Jan 31 05:10:25 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.69499999999999995}]}]},{"osd":4,"up_from":33,"seq":141733920841,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":970752,"data_stored":463024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:08:39 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.502,"15min":0.497},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.51900000000000002,"15min":0.51600000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.51300000000000001}]},{"osd":1,"last update":"Wed Jan 31 05:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.39100000000000001,"15min":0.34999999999999998},"min":{"1min":0.29899999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.56299999999999994,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.41199999999999998,"15min":0.38},"min":{"1min":0.27700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.621,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.42799999999999999}]},{"osd":2,"last update":"Wed Jan 31 05:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.57299999999999995,"15min":0.54300000000000004},"min":{"1min":0.41099999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.60799999999999998,"15min":0.54600000000000004},"min":{"1min":0.45800000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.89100000000000001,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.68400000000000005}]},{"osd":3,"last update":"Wed Jan 31 05:10:41 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.58199999999999996,"15min":0.54600000000000004},"min":{"1min":0.39800000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.72999999999999998,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.55800000000000005,"15min":0.54500000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.77200000000000002,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.48499999999999999}]},{"osd":5,"last update":"Wed Jan 31 05:11:05 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.59899999999999998,"15min":0.55000000000000004},"min":{"1min":0.46200000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.86499999999999999,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.61499999999999999,"15min":0.55700000000000005},"min":{"1min":0.49099999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.80700000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.63100000000000001}]},{"osd":6,"last update":"Wed Jan 31 05:10:37 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.60499999999999998,"15min":0.58299999999999996},"min":{"1min":0.44800000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.79400000000000004,"5min":0.87,"15min":0.87},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.59899999999999998,"15min":0.58699999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.85799999999999998,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.59299999999999997}]},{"osd":7,"last update":"Wed Jan 31 05:10:55 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57699999999999996,"15min":0.54800000000000004},"min":{"1min":0.374,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.84699999999999998,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.60599999999999998,"15min":0.59399999999999997},"min":{"1min":0.42999999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82399999999999995,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.64700000000000002}]},{"osd":8,"last update":"Wed Jan 31 05:10:23 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.68000000000000005,"15min":0.67200000000000004},"min":{"1min":0.48599999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.748},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.68400000000000005,"15min":0.66900000000000004},"min":{"1min":0.495,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89300000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.80300000000000005}]},{"osd":9,"last update":"Wed Jan 31 05:10:45 2024","interfaces":[{"interface":"back","average":{"1min":1.5509999999999999,"5min":0.88100000000000001,"15min":0.76700000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":19.009,"5min":19.009,"15min":19.009},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.71899999999999997,"15min":0.70899999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.89400000000000002,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.72999999999999998}]},{"osd":10,"last update":"Wed Jan 31 05:11:12 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.74399999999999999,"15min":0.74199999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95199999999999996,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.746,"5min":0.76000000000000001,"15min":0.76400000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.65800000000000003}]},{"osd":11,"last update":"Wed Jan 31 05:10:23 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.76300000000000001}]}]},{"osd":5,"up_from":38,"seq":163208757316,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32732,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712420,"statfs":{"total":95995035648,"available":95961518080,"internally_reserved":0,"allocated":1593344,"data_stored":1055629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 31 05:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51700000000000002,"15min":0.47699999999999998},"min":{"1min":0.33800000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.67900000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.53100000000000003,"15min":0.502},"min":{"1min":0.32400000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.76400000000000001,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.55300000000000005}]},{"osd":1,"last update":"Wed Jan 31 05:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.57799999999999996,"15min":0.53600000000000003},"min":{"1min":0.41199999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.499},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57799999999999996,"15min":0.55600000000000005},"min":{"1min":0.39000000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.77500000000000002,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.51700000000000002}]},{"osd":2,"last update":"Wed Jan 31 05:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.43099999999999999,"15min":0.40300000000000002},"min":{"1min":0.27900000000000003,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.65700000000000003,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.434,"15min":0.42099999999999999},"min":{"1min":0.32000000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.434}]},{"osd":3,"last update":"Wed Jan 31 05:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.56000000000000005,"15min":0.53000000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.70799999999999996,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.56200000000000006,"15min":0.53600000000000003},"min":{"1min":0.35799999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.79300000000000004,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.53900000000000003}]},{"osd":4,"last update":"Wed Jan 31 05:11:11 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.63900000000000001,"15min":0.60799999999999998},"min":{"1min":0.496,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.65200000000000002,"15min":0.61599999999999999},"min":{"1min":0.437,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.88500000000000001,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.73299999999999998}]},{"osd":6,"last update":"Wed Jan 31 05:10:32 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59399999999999997,"15min":0.57999999999999996},"min":{"1min":0.38700000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.82499999999999996,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60399999999999998,"15min":0.59299999999999997},"min":{"1min":0.437,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.75800000000000001,"5min":0.873,"15min":0.873},"last":0.57199999999999995}]},{"osd":7,"last update":"Wed Jan 31 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.64500000000000002,"15min":0.60699999999999998},"min":{"1min":0.42999999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.67800000000000005,"15min":0.65000000000000002},"min":{"1min":0.55800000000000005,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.58899999999999997}]},{"osd":8,"last update":"Wed Jan 31 05:10:19 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.36599999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.77500000000000002,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58199999999999996,"15min":0.58399999999999996},"min":{"1min":0.39600000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.79500000000000004,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.76400000000000001}]},{"osd":9,"last update":"Wed Jan 31 05:10:47 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68300000000000005,"15min":0.68100000000000005},"min":{"1min":0.47399999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.97399999999999998,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.68999999999999995,"15min":0.68400000000000005},"min":{"1min":0.48499999999999999,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.69799999999999995}]},{"osd":10,"last update":"Wed Jan 31 05:11:17 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.70499999999999996,"15min":0.68799999999999994},"min":{"1min":0.56100000000000005,"5min":0.497,"15min":0.497},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.73499999999999999,"15min":0.72099999999999997},"min":{"1min":0.57799999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.747}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":66867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":68067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":66992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-31T05:11:24.863 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:11:25.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.001+0000 7f600c11f640 1 -- 172.21.15.99:0/2728412923 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6004106a50 msgr2=0x7f6004108e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:25.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.001+0000 7f600c11f640 1 --2- 172.21.15.99:0/2728412923 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6004106a50 0x7f6004108e40 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc009ca0 tx=0x7f5ffc02c0f0 comp rx=0 tx=0).stop 2024-01-31T05:11:25.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.001+0000 7f600c11f640 1 -- 172.21.15.99:0/2728412923 shutdown_connections 2024-01-31T05:11:25.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.001+0000 7f600c11f640 1 --2- 172.21.15.99:0/2728412923 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6004106a50 0x7f6004108e40 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:25.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.001+0000 7f600c11f640 1 --2- 172.21.15.99:0/2728412923 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6004104120 0x7f6004106510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:25.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.001+0000 7f600c11f640 1 --2- 172.21.15.99:0/2728412923 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60041017f0 0x7f6004103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:25.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.001+0000 7f600c11f640 1 -- 172.21.15.99:0/2728412923 >> 172.21.15.99:0/2728412923 conn(0x7f60040fb180 msgr2=0x7f60040fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:25.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.001+0000 7f600c11f640 1 -- 172.21.15.99:0/2728412923 shutdown_connections 2024-01-31T05:11:25.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.001+0000 7f600c11f640 1 -- 172.21.15.99:0/2728412923 wait complete. 2024-01-31T05:11:25.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.001+0000 7f600c11f640 1 Processor -- start 2024-01-31T05:11:25.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.001+0000 7f600c11f640 1 -- start start 2024-01-31T05:11:25.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.002+0000 7f600c11f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f60041017f0 0x7f6004196c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:25.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.002+0000 7f600c11f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6004104120 0x7f60041971d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:25.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.002+0000 7f600c11f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6004106a50 0x7f600419e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:25.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.002+0000 7f600c11f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600419e7a0 con 0x7f6004106a50 2024-01-31T05:11:25.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.002+0000 7f600c11f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600419e910 con 0x7f6004104120 2024-01-31T05:11:25.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.002+0000 7f600c11f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600419ead0 con 0x7f60041017f0 2024-01-31T05:11:25.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.002+0000 7f600a6bc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6004106a50 0x7f600419e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:25.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.002+0000 7f600a6bc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6004106a50 0x7f600419e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34264/0 (socket says 172.21.15.99:34264) 2024-01-31T05:11:25.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.002+0000 7f600a6bc640 1 -- 172.21.15.99:0/972485480 learned_addr learned my addr 172.21.15.99:0/972485480 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:25.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.002+0000 7f60096ba640 1 --2- 172.21.15.99:0/972485480 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6004104120 0x7f60041971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:25.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.002+0000 7f6009ebb640 1 --2- 172.21.15.99:0/972485480 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f60041017f0 0x7f6004196c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:25.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.002+0000 7f600a6bc640 1 -- 172.21.15.99:0/972485480 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f60041017f0 msgr2=0x7f6004196c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:25.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.002+0000 7f600a6bc640 1 --2- 172.21.15.99:0/972485480 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f60041017f0 0x7f6004196c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:25.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.002+0000 7f600a6bc640 1 -- 172.21.15.99:0/972485480 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6004104120 msgr2=0x7f60041971d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:25.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.002+0000 7f600a6bc640 1 --2- 172.21.15.99:0/972485480 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6004104120 0x7f60041971d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:25.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.002+0000 7f600a6bc640 1 -- 172.21.15.99:0/972485480 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ffc009900 con 0x7f6004106a50 2024-01-31T05:11:25.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.002+0000 7f600a6bc640 1 --2- 172.21.15.99:0/972485480 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6004106a50 0x7f600419e230 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc037040 tx=0x7f5ffc032810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:25.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.002+0000 7f5ffaffd640 1 -- 172.21.15.99:0/972485480 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc034e80 con 0x7f6004106a50 2024-01-31T05:11:25.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.002+0000 7f5ffaffd640 1 -- 172.21.15.99:0/972485480 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5ffc003e30 con 0x7f6004106a50 2024-01-31T05:11:25.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.002+0000 7f600c11f640 1 -- 172.21.15.99:0/972485480 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f600419ed50 con 0x7f6004106a50 2024-01-31T05:11:25.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.002+0000 7f5ffaffd640 1 -- 172.21.15.99:0/972485480 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc03d3f0 con 0x7f6004106a50 2024-01-31T05:11:25.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.002+0000 7f600c11f640 1 -- 172.21.15.99:0/972485480 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f600419f1f0 con 0x7f6004106a50 2024-01-31T05:11:25.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.003+0000 7f600c11f640 1 -- 172.21.15.99:0/972485480 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60040fcc70 con 0x7f6004106a50 2024-01-31T05:11:25.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.004+0000 7f5ffaffd640 1 -- 172.21.15.99:0/972485480 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f5ffc03b040 con 0x7f6004106a50 2024-01-31T05:11:25.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.005+0000 7f5ffaffd640 1 --2- 172.21.15.99:0/972485480 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f5ff00a13f0 0x7f5ff00a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:25.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.005+0000 7f6009ebb640 1 --2- 172.21.15.99:0/972485480 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f5ff00a13f0 0x7f5ff00a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:25.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.005+0000 7f5ffaffd640 1 -- 172.21.15.99:0/972485480 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f5ffc0ef290 con 0x7f6004106a50 2024-01-31T05:11:25.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.006+0000 7f6009ebb640 1 --2- 172.21.15.99:0/972485480 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f5ff00a13f0 0x7f5ff00a38b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6000005fd0 tx=0x7f6000005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:25.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.009+0000 7f5ffaffd640 1 -- 172.21.15.99:0/972485480 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f5ffc0b87e0 con 0x7f6004106a50 2024-01-31T05:11:25.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:24 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/2248995480' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:11:25.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:24 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/2248995480' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:11:25.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:24 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/2248995480' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:11:25.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.183+0000 7f600c11f640 1 -- 172.21.15.99:0/972485480 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f600410c840 con 0x7f6004106a50 2024-01-31T05:11:25.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.185+0000 7f5ffaffd640 1 -- 172.21.15.99:0/972485480 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22426 (secure 0 0 0) 0x7f5ffc0bbe00 con 0x7f6004106a50 2024-01-31T05:11:25.184 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:11:25.185 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":88,"fsid":"9288ff44-bff5-11ee-95b3-87774f69a715","created":"2024-01-31T05:01:26.130917+0000","modified":"2024-01-31T05:10:21.675877+0000","last_up_change":"2024-01-31T05:08:31.228478+0000","last_in_change":"2024-01-31T05:08:10.799511+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:46.842423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:09:18.693558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-31T05:09:19.734003+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b45878d9-28f1-4821-ba72-26a32d3fc780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6803","nonce":1213805280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6805","nonce":1213805280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6809","nonce":1213805280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6807","nonce":1213805280}]},"public_addr":"172.21.15.99:6803/1213805280","cluster_addr":"172.21.15.99:6805/1213805280","heartbeat_back_addr":"172.21.15.99:6809/1213805280","heartbeat_front_addr":"172.21.15.99:6807/1213805280","state":["exists","up"]},{"osd":1,"uuid":"e0b71ff3-5d97-4659-8dea-4c9091e1beb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6801","nonce":2019451677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6803","nonce":2019451677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6807","nonce":2019451677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6805","nonce":2019451677}]},"public_addr":"172.21.15.179:6801/2019451677","cluster_addr":"172.21.15.179:6803/2019451677","heartbeat_back_addr":"172.21.15.179:6807/2019451677","heartbeat_front_addr":"172.21.15.179:6805/2019451677","state":["exists","up"]},{"osd":2,"uuid":"11c919c8-19a9-48b0-8880-3002efcb64f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6801","nonce":3934284457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6803","nonce":3934284457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6807","nonce":3934284457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6805","nonce":3934284457}]},"public_addr":"172.21.15.181:6801/3934284457","cluster_addr":"172.21.15.181:6803/3934284457","heartbeat_back_addr":"172.21.15.181:6807/3934284457","heartbeat_front_addr":"172.21.15.181:6805/3934284457","state":["exists","up"]},{"osd":3,"uuid":"bcab5135-a5d1-45ae-a9b8-674425d3999e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6811","nonce":4207675427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6813","nonce":4207675427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6817","nonce":4207675427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6815","nonce":4207675427}]},"public_addr":"172.21.15.99:6811/4207675427","cluster_addr":"172.21.15.99:6813/4207675427","heartbeat_back_addr":"172.21.15.99:6817/4207675427","heartbeat_front_addr":"172.21.15.99:6815/4207675427","state":["exists","up"]},{"osd":4,"uuid":"0250d7ac-3894-457a-9c04-cc7205d61eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6809","nonce":2861083896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6811","nonce":2861083896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6815","nonce":2861083896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6813","nonce":2861083896}]},"public_addr":"172.21.15.179:6809/2861083896","cluster_addr":"172.21.15.179:6811/2861083896","heartbeat_back_addr":"172.21.15.179:6815/2861083896","heartbeat_front_addr":"172.21.15.179:6813/2861083896","state":["exists","up"]},{"osd":5,"uuid":"5e19222a-c2a4-45bc-8445-1d302f26d11c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6809","nonce":1485017095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6811","nonce":1485017095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6815","nonce":1485017095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6813","nonce":1485017095}]},"public_addr":"172.21.15.181:6809/1485017095","cluster_addr":"172.21.15.181:6811/1485017095","heartbeat_back_addr":"172.21.15.181:6815/1485017095","heartbeat_front_addr":"172.21.15.181:6813/1485017095","state":["exists","up"]},{"osd":6,"uuid":"56555035-f9fc-4e91-96dd-caa632d58adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6819","nonce":1534047839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6821","nonce":1534047839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6825","nonce":1534047839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6823","nonce":1534047839}]},"public_addr":"172.21.15.99:6819/1534047839","cluster_addr":"172.21.15.99:6821/1534047839","heartbeat_back_addr":"172.21.15.99:6825/1534047839","heartbeat_front_addr":"172.21.15.99:6823/1534047839","state":["exists","up"]},{"osd":7,"uuid":"5e079cf5-1340-4599-88a6-df410ef0148e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6817","nonce":3875950553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6819","nonce":3875950553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6823","nonce":3875950553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6821","nonce":3875950553}]},"public_addr":"172.21.15.179:6817/3875950553","cluster_addr":"172.21.15.179:6819/3875950553","heartbeat_back_addr":"172.21.15.179:6823/3875950553","heartbeat_front_addr":"172.21.15.179:6821/3875950553","state":["exists","up"]},{"osd":8,"uuid":"10a73592-4251-4492-b67d-ce9b9d7fff32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6817","nonce":179568936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6819","nonce":179568936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6823","nonce":179568936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6821","nonce":179568936}]},"public_addr":"172.21.15.181:6817/179568936","cluster_addr":"172.21.15.181:6819/179568936","heartbeat_back_addr":"172.21.15.181:6823/179568936","heartbeat_front_addr":"172.21.15.181:6821/179568936","state":["exists","up"]},{"osd":9,"uuid":"f6620e1e-f761-4f1c-917f-cbc748df32a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6827","nonce":315759515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6829","nonce":315759515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6833","nonce":315759515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6831","nonce":315759515}]},"public_addr":"172.21.15.99:6827/315759515","cluster_addr":"172.21.15.99:6829/315759515","heartbeat_back_addr":"172.21.15.99:6833/315759515","heartbeat_front_addr":"172.21.15.99:6831/315759515","state":["exists","up"]},{"osd":10,"uuid":"ee86af7d-66f8-4795-bcc3-dfec79e4680c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6825","nonce":2985063934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6827","nonce":2985063934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6831","nonce":2985063934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6829","nonce":2985063934}]},"public_addr":"172.21.15.179:6825/2985063934","cluster_addr":"172.21.15.179:6827/2985063934","heartbeat_back_addr":"172.21.15.179:6831/2985063934","heartbeat_front_addr":"172.21.15.179:6829/2985063934","state":["exists","up"]},{"osd":11,"uuid":"82f04fee-f6ae-4630-a75b-b12a9c4ab2e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6825","nonce":1858219600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6827","nonce":1858219600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6831","nonce":1858219600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6829","nonce":1858219600}]},"public_addr":"172.21.15.181:6825/1858219600","cluster_addr":"172.21.15.181:6827/1858219600","heartbeat_back_addr":"172.21.15.181:6831/1858219600","heartbeat_front_addr":"172.21.15.181:6829/1858219600","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:55.518970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:04:19.936339+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:04:44.064814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:09.331683+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:34.616774+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:58.881810+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:06:23.869838+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:06:49.127331+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:07:12.847187+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:07:38.231045+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:08:03.949162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:08:28.471802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:0/401101729":"2024-02-01T05:02:20.510858+0000","172.21.15.99:6801/1993198206":"2024-02-01T05:02:20.510858+0000","172.21.15.99:0/3819754569":"2024-02-01T05:02:20.510858+0000","172.21.15.99:0/475390265":"2024-02-01T05:01:53.732026+0000","172.21.15.99:6800/1993198206":"2024-02-01T05:02:20.510858+0000","172.21.15.99:6800/1706888338":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/4150146075":"2024-02-01T05:01:53.732026+0000","172.21.15.99:6801/1706888338":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/2851066598":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/1865156424":"2024-02-01T05:02:20.510858+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:11:25.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.187+0000 7f600c11f640 1 -- 172.21.15.99:0/972485480 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f5ff00a13f0 msgr2=0x7f5ff00a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:25.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.187+0000 7f600c11f640 1 --2- 172.21.15.99:0/972485480 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f5ff00a13f0 0x7f5ff00a38b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6000005fd0 tx=0x7f6000005850 comp rx=0 tx=0).stop 2024-01-31T05:11:25.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.187+0000 7f600c11f640 1 -- 172.21.15.99:0/972485480 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6004106a50 msgr2=0x7f600419e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:25.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.187+0000 7f600c11f640 1 --2- 172.21.15.99:0/972485480 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6004106a50 0x7f600419e230 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc037040 tx=0x7f5ffc032810 comp rx=0 tx=0).stop 2024-01-31T05:11:25.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.187+0000 7f600c11f640 1 -- 172.21.15.99:0/972485480 shutdown_connections 2024-01-31T05:11:25.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.187+0000 7f600c11f640 1 --2- 172.21.15.99:0/972485480 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f5ff00a13f0 0x7f5ff00a38b0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:25.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.187+0000 7f600c11f640 1 --2- 172.21.15.99:0/972485480 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6004106a50 0x7f600419e230 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:25.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.187+0000 7f600c11f640 1 --2- 172.21.15.99:0/972485480 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6004104120 0x7f60041971d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:25.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.187+0000 7f600c11f640 1 --2- 172.21.15.99:0/972485480 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f60041017f0 0x7f6004196c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:25.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.187+0000 7f600c11f640 1 -- 172.21.15.99:0/972485480 >> 172.21.15.99:0/972485480 conn(0x7f60040fb180 msgr2=0x7f6004102130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:25.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.187+0000 7f600c11f640 1 -- 172.21.15.99:0/972485480 shutdown_connections 2024-01-31T05:11:25.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.187+0000 7f600c11f640 1 -- 172.21.15.99:0/972485480 wait complete. 2024-01-31T05:11:25.198 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-31T05:04:46.842423+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-31T05:09:18.693558+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-31T05:09:19.734003+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-31T05:11:25.198 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-31T05:11:25.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.303+0000 7fe1ef3d9640 1 -- 172.21.15.99:0/913260578 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1e8106a70 msgr2=0x7fe1e8108e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:25.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.303+0000 7fe1ef3d9640 1 --2- 172.21.15.99:0/913260578 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1e8106a70 0x7fe1e8108e60 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0009900 tx=0x7fe1e002bc30 comp rx=0 tx=0).stop 2024-01-31T05:11:25.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.303+0000 7fe1ef3d9640 1 -- 172.21.15.99:0/913260578 shutdown_connections 2024-01-31T05:11:25.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.303+0000 7fe1ef3d9640 1 --2- 172.21.15.99:0/913260578 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1e8106a70 0x7fe1e8108e60 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:25.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.303+0000 7fe1ef3d9640 1 --2- 172.21.15.99:0/913260578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1e8104140 0x7fe1e8106530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:25.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.303+0000 7fe1ef3d9640 1 --2- 172.21.15.99:0/913260578 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe1e8101810 0x7fe1e8103c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:25.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.303+0000 7fe1ef3d9640 1 -- 172.21.15.99:0/913260578 >> 172.21.15.99:0/913260578 conn(0x7fe1e80fb180 msgr2=0x7fe1e80fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:25.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.304+0000 7fe1ef3d9640 1 -- 172.21.15.99:0/913260578 shutdown_connections 2024-01-31T05:11:25.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.304+0000 7fe1ef3d9640 1 -- 172.21.15.99:0/913260578 wait complete. 2024-01-31T05:11:25.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.304+0000 7fe1ef3d9640 1 Processor -- start 2024-01-31T05:11:25.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.304+0000 7fe1ef3d9640 1 -- start start 2024-01-31T05:11:25.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.304+0000 7fe1ef3d9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe1e8101810 0x7fe1e8196e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:25.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.304+0000 7fe1ef3d9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1e8104140 0x7fe1e8197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:25.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.304+0000 7fe1ef3d9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1e8106a70 0x7fe1e819e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:25.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.304+0000 7fe1ef3d9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e819e910 con 0x7fe1e8104140 2024-01-31T05:11:25.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.304+0000 7fe1ef3d9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e819ea80 con 0x7fe1e8106a70 2024-01-31T05:11:25.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.304+0000 7fe1ef3d9640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e819ec40 con 0x7fe1e8101810 2024-01-31T05:11:25.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.304+0000 7fe1ec974640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1e8104140 0x7fe1e8197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:25.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.304+0000 7fe1ec974640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1e8104140 0x7fe1e8197360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34292/0 (socket says 172.21.15.99:34292) 2024-01-31T05:11:25.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.304+0000 7fe1ec974640 1 -- 172.21.15.99:0/1142690984 learned_addr learned my addr 172.21.15.99:0/1142690984 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:25.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.305+0000 7fe1ed175640 1 --2- 172.21.15.99:0/1142690984 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe1e8101810 0x7fe1e8196e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:25.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.305+0000 7fe1ec974640 1 -- 172.21.15.99:0/1142690984 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe1e8101810 msgr2=0x7fe1e8196e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:25.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.305+0000 7fe1ec974640 1 --2- 172.21.15.99:0/1142690984 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe1e8101810 0x7fe1e8196e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:25.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.305+0000 7fe1ec974640 1 -- 172.21.15.99:0/1142690984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1e8106a70 msgr2=0x7fe1e819e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:25.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.305+0000 7fe1ec974640 1 --2- 172.21.15.99:0/1142690984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1e8106a70 0x7fe1e819e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:25.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.305+0000 7fe1ec974640 1 -- 172.21.15.99:0/1142690984 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e0009560 con 0x7fe1e8104140 2024-01-31T05:11:25.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.305+0000 7fe1ec974640 1 --2- 172.21.15.99:0/1142690984 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1e8104140 0x7fe1e8197360 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe1d800b450 tx=0x7fe1d800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:25.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.305+0000 7fe1de7fc640 1 -- 172.21.15.99:0/1142690984 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d8011890 con 0x7fe1e8104140 2024-01-31T05:11:25.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.305+0000 7fe1de7fc640 1 -- 172.21.15.99:0/1142690984 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe1d80103e0 con 0x7fe1e8104140 2024-01-31T05:11:25.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.305+0000 7fe1ef3d9640 1 -- 172.21.15.99:0/1142690984 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e819ef20 con 0x7fe1e8104140 2024-01-31T05:11:25.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.305+0000 7fe1de7fc640 1 -- 172.21.15.99:0/1142690984 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d800f5a0 con 0x7fe1e8104140 2024-01-31T05:11:25.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.305+0000 7fe1ef3d9640 1 -- 172.21.15.99:0/1142690984 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e819f420 con 0x7fe1e8104140 2024-01-31T05:11:25.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.306+0000 7fe1ef3d9640 1 -- 172.21.15.99:0/1142690984 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1e80fcc70 con 0x7fe1e8104140 2024-01-31T05:11:25.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.307+0000 7fe1de7fc640 1 -- 172.21.15.99:0/1142690984 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 135946+0+0 (secure 0 0 0) 0x7fe1d8010850 con 0x7fe1e8104140 2024-01-31T05:11:25.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.307+0000 7fe1de7fc640 1 --2- 172.21.15.99:0/1142690984 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe1d40a1370 0x7fe1d40a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:25.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.308+0000 7fe1ed175640 1 --2- 172.21.15.99:0/1142690984 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe1d40a1370 0x7fe1d40a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:25.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.308+0000 7fe1de7fc640 1 -- 172.21.15.99:0/1142690984 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fe1d80cc7c0 con 0x7fe1e8104140 2024-01-31T05:11:25.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.308+0000 7fe1ed175640 1 --2- 172.21.15.99:0/1142690984 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe1d40a1370 0x7fe1d40a3830 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe1e400a400 tx=0x7fe1e400d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:25.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.312+0000 7fe1de7fc640 1 -- 172.21.15.99:0/1142690984 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fe1d8095d10 con 0x7fe1e8104140 2024-01-31T05:11:25.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.482+0000 7fe1ef3d9640 1 -- 172.21.15.99:0/1142690984 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe1e802cad0 con 0x7fe1e8104140 2024-01-31T05:11:25.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.483+0000 7fe1de7fc640 1 -- 172.21.15.99:0/1142690984 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe1d8099330 con 0x7fe1e8104140 2024-01-31T05:11:25.482 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-01-31T05:11:25.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.484+0000 7fe1ef3d9640 1 -- 172.21.15.99:0/1142690984 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe1d40a1370 msgr2=0x7fe1d40a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:25.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.484+0000 7fe1ef3d9640 1 --2- 172.21.15.99:0/1142690984 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe1d40a1370 0x7fe1d40a3830 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe1e400a400 tx=0x7fe1e400d040 comp rx=0 tx=0).stop 2024-01-31T05:11:25.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.484+0000 7fe1ef3d9640 1 -- 172.21.15.99:0/1142690984 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1e8104140 msgr2=0x7fe1e8197360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:25.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.484+0000 7fe1ef3d9640 1 --2- 172.21.15.99:0/1142690984 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1e8104140 0x7fe1e8197360 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe1d800b450 tx=0x7fe1d800b910 comp rx=0 tx=0).stop 2024-01-31T05:11:25.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.484+0000 7fe1ef3d9640 1 -- 172.21.15.99:0/1142690984 shutdown_connections 2024-01-31T05:11:25.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.484+0000 7fe1ef3d9640 1 --2- 172.21.15.99:0/1142690984 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe1d40a1370 0x7fe1d40a3830 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:25.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.484+0000 7fe1ef3d9640 1 --2- 172.21.15.99:0/1142690984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1e8106a70 0x7fe1e819e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:25.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.484+0000 7fe1ef3d9640 1 --2- 172.21.15.99:0/1142690984 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1e8104140 0x7fe1e8197360 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:25.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.484+0000 7fe1ef3d9640 1 --2- 172.21.15.99:0/1142690984 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe1e8101810 0x7fe1e8196e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:25.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.484+0000 7fe1ef3d9640 1 -- 172.21.15.99:0/1142690984 >> 172.21.15.99:0/1142690984 conn(0x7fe1e80fb180 msgr2=0x7fe1e81022f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:25.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.485+0000 7fe1ef3d9640 1 -- 172.21.15.99:0/1142690984 shutdown_connections 2024-01-31T05:11:25.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.485+0000 7fe1ef3d9640 1 -- 172.21.15.99:0/1142690984 wait complete. 2024-01-31T05:11:25.495 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-31T05:11:25.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.600+0000 7f984335e640 1 -- 172.21.15.99:0/419295934 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f983c100d00 msgr2=0x7f983c101120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:25.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.600+0000 7f984335e640 1 --2- 172.21.15.99:0/419295934 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f983c100d00 0x7f983c101120 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f9838009900 tx=0x7f983802bc30 comp rx=0 tx=0).stop 2024-01-31T05:11:25.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.601+0000 7f984335e640 1 -- 172.21.15.99:0/419295934 shutdown_connections 2024-01-31T05:11:25.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.601+0000 7f984335e640 1 --2- 172.21.15.99:0/419295934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f983c1028b0 0x7f983c109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:25.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.601+0000 7f984335e640 1 --2- 172.21.15.99:0/419295934 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f983c101ef0 0x7f983c102370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:25.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.601+0000 7f984335e640 1 --2- 172.21.15.99:0/419295934 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f983c100d00 0x7f983c101120 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:25.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.601+0000 7f984335e640 1 -- 172.21.15.99:0/419295934 >> 172.21.15.99:0/419295934 conn(0x7f983c0fc290 msgr2=0x7f983c0fe6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:25.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.601+0000 7f984335e640 1 -- 172.21.15.99:0/419295934 shutdown_connections 2024-01-31T05:11:25.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.601+0000 7f984335e640 1 -- 172.21.15.99:0/419295934 wait complete. 2024-01-31T05:11:25.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.601+0000 7f984335e640 1 Processor -- start 2024-01-31T05:11:25.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.601+0000 7f984335e640 1 -- start start 2024-01-31T05:11:25.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.601+0000 7f984335e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f983c100d00 0x7f983c196d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:25.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.601+0000 7f984335e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f983c101ef0 0x7f983c197250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:25.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.601+0000 7f984335e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f983c1028b0 0x7f983c19e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:25.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.601+0000 7f984335e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f983c19e7f0 con 0x7f983c101ef0 2024-01-31T05:11:25.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.601+0000 7f984335e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f983c19e960 con 0x7f983c100d00 2024-01-31T05:11:25.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.601+0000 7f984335e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f983c19eb20 con 0x7f983c1028b0 2024-01-31T05:11:25.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.601+0000 7f98408f9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f983c101ef0 0x7f983c197250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:25.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.602+0000 7f98408f9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f983c101ef0 0x7f983c197250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37922/0 (socket says 172.21.15.99:37922) 2024-01-31T05:11:25.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.602+0000 7f98408f9640 1 -- 172.21.15.99:0/1656795360 learned_addr learned my addr 172.21.15.99:0/1656795360 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:25.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.602+0000 7f98418fb640 1 --2- 172.21.15.99:0/1656795360 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f983c1028b0 0x7f983c19e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:25.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.602+0000 7f98410fa640 1 --2- 172.21.15.99:0/1656795360 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f983c100d00 0x7f983c196d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:25.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.602+0000 7f98408f9640 1 -- 172.21.15.99:0/1656795360 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f983c1028b0 msgr2=0x7f983c19e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:25.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.602+0000 7f98408f9640 1 --2- 172.21.15.99:0/1656795360 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f983c1028b0 0x7f983c19e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:25.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.602+0000 7f98408f9640 1 -- 172.21.15.99:0/1656795360 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f983c100d00 msgr2=0x7f983c196d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:25.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.602+0000 7f98408f9640 1 --2- 172.21.15.99:0/1656795360 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f983c100d00 0x7f983c196d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:25.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.602+0000 7f98408f9640 1 -- 172.21.15.99:0/1656795360 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9838009560 con 0x7f983c101ef0 2024-01-31T05:11:25.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.602+0000 7f98408f9640 1 --2- 172.21.15.99:0/1656795360 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f983c101ef0 0x7f983c197250 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f982c00d770 tx=0x7f982c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:25.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.602+0000 7f98327fc640 1 -- 172.21.15.99:0/1656795360 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982c009c30 con 0x7f983c101ef0 2024-01-31T05:11:25.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.602+0000 7f98327fc640 1 -- 172.21.15.99:0/1656795360 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f982c00de80 con 0x7f983c101ef0 2024-01-31T05:11:25.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.602+0000 7f984335e640 1 -- 172.21.15.99:0/1656795360 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f983c19ee00 con 0x7f983c101ef0 2024-01-31T05:11:25.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.602+0000 7f98327fc640 1 -- 172.21.15.99:0/1656795360 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982c004de0 con 0x7f983c101ef0 2024-01-31T05:11:25.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.602+0000 7f984335e640 1 -- 172.21.15.99:0/1656795360 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f983c19f230 con 0x7f983c101ef0 2024-01-31T05:11:25.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.603+0000 7f984335e640 1 -- 172.21.15.99:0/1656795360 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f983c1080f0 con 0x7f983c101ef0 2024-01-31T05:11:25.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.604+0000 7f98327fc640 1 -- 172.21.15.99:0/1656795360 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f982c004f40 con 0x7f983c101ef0 2024-01-31T05:11:25.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.605+0000 7f98327fc640 1 --2- 172.21.15.99:0/1656795360 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f98280a1370 0x7f98280a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:25.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.605+0000 7f98410fa640 1 --2- 172.21.15.99:0/1656795360 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f98280a1370 0x7f98280a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:25.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.605+0000 7f98327fc640 1 -- 172.21.15.99:0/1656795360 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f982c0cc6b0 con 0x7f983c101ef0 2024-01-31T05:11:25.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.605+0000 7f98410fa640 1 --2- 172.21.15.99:0/1656795360 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f98280a1370 0x7f98280a3830 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f983c1981e0 tx=0x7f983802c5d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:25.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.609+0000 7f98327fc640 1 -- 172.21.15.99:0/1656795360 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f982c095a60 con 0x7f983c101ef0 2024-01-31T05:11:25.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.780+0000 7f984335e640 1 -- 172.21.15.99:0/1656795360 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f983c10c7b0 con 0x7f983c101ef0 2024-01-31T05:11:25.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.781+0000 7f98327fc640 1 -- 172.21.15.99:0/1656795360 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f982c097990 con 0x7f983c101ef0 2024-01-31T05:11:25.780 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-01-31T05:11:25.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.783+0000 7f984335e640 1 -- 172.21.15.99:0/1656795360 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f98280a1370 msgr2=0x7f98280a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:25.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.783+0000 7f984335e640 1 --2- 172.21.15.99:0/1656795360 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f98280a1370 0x7f98280a3830 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f983c1981e0 tx=0x7f983802c5d0 comp rx=0 tx=0).stop 2024-01-31T05:11:25.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.783+0000 7f984335e640 1 -- 172.21.15.99:0/1656795360 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f983c101ef0 msgr2=0x7f983c197250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:25.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.783+0000 7f984335e640 1 --2- 172.21.15.99:0/1656795360 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f983c101ef0 0x7f983c197250 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f982c00d770 tx=0x7f982c00dc30 comp rx=0 tx=0).stop 2024-01-31T05:11:25.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.783+0000 7f984335e640 1 -- 172.21.15.99:0/1656795360 shutdown_connections 2024-01-31T05:11:25.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.783+0000 7f984335e640 1 --2- 172.21.15.99:0/1656795360 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f98280a1370 0x7f98280a3830 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:25.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.783+0000 7f984335e640 1 --2- 172.21.15.99:0/1656795360 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f983c1028b0 0x7f983c19e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:25.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.783+0000 7f984335e640 1 --2- 172.21.15.99:0/1656795360 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f983c101ef0 0x7f983c197250 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:25.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.783+0000 7f984335e640 1 --2- 172.21.15.99:0/1656795360 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f983c100d00 0x7f983c196d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:25.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.783+0000 7f984335e640 1 -- 172.21.15.99:0/1656795360 >> 172.21.15.99:0/1656795360 conn(0x7f983c0fc290 msgr2=0x7f983c1052c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:25.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.783+0000 7f984335e640 1 -- 172.21.15.99:0/1656795360 shutdown_connections 2024-01-31T05:11:25.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.783+0000 7f984335e640 1 -- 172.21.15.99:0/1656795360 wait complete. 2024-01-31T05:11:25.794 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-31T05:11:25.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.899+0000 7fda69b3b640 1 -- 172.21.15.99:0/200777335 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda641017e0 msgr2=0x7fda64103bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:25.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.899+0000 7fda69b3b640 1 --2- 172.21.15.99:0/200777335 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda641017e0 0x7fda64103bd0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fda54009900 tx=0x7fda5402bc30 comp rx=0 tx=0).stop 2024-01-31T05:11:25.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.899+0000 7fda69b3b640 1 -- 172.21.15.99:0/200777335 shutdown_connections 2024-01-31T05:11:25.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.899+0000 7fda69b3b640 1 --2- 172.21.15.99:0/200777335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda64106a40 0x7fda64108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:25.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.899+0000 7fda69b3b640 1 --2- 172.21.15.99:0/200777335 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fda64104110 0x7fda64106500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:25.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.899+0000 7fda69b3b640 1 --2- 172.21.15.99:0/200777335 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda641017e0 0x7fda64103bd0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:25.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.899+0000 7fda69b3b640 1 -- 172.21.15.99:0/200777335 >> 172.21.15.99:0/200777335 conn(0x7fda640fb190 msgr2=0x7fda640fd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:25.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.899+0000 7fda69b3b640 1 -- 172.21.15.99:0/200777335 shutdown_connections 2024-01-31T05:11:25.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.899+0000 7fda69b3b640 1 -- 172.21.15.99:0/200777335 wait complete. 2024-01-31T05:11:25.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.899+0000 7fda69b3b640 1 Processor -- start 2024-01-31T05:11:25.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.900+0000 7fda69b3b640 1 -- start start 2024-01-31T05:11:25.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.900+0000 7fda69b3b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fda641017e0 0x7fda64196db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:25.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.900+0000 7fda69b3b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda64104110 0x7fda641972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:25.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.900+0000 7fda69b3b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda64106a40 0x7fda6419e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:25.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.900+0000 7fda69b3b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6419e890 con 0x7fda64104110 2024-01-31T05:11:25.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.900+0000 7fda69b3b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6419ea00 con 0x7fda64106a40 2024-01-31T05:11:25.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.900+0000 7fda69b3b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6419ebc0 con 0x7fda641017e0 2024-01-31T05:11:25.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.900+0000 7fda62ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda64104110 0x7fda641972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:25.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.900+0000 7fda62ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda64104110 0x7fda641972f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37930/0 (socket says 172.21.15.99:37930) 2024-01-31T05:11:25.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.900+0000 7fda62ffd640 1 -- 172.21.15.99:0/170222300 learned_addr learned my addr 172.21.15.99:0/170222300 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:25.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.900+0000 7fda637fe640 1 --2- 172.21.15.99:0/170222300 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fda641017e0 0x7fda64196db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:25.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.900+0000 7fda63fff640 1 --2- 172.21.15.99:0/170222300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda64106a40 0x7fda6419e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:25.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.900+0000 7fda62ffd640 1 -- 172.21.15.99:0/170222300 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fda641017e0 msgr2=0x7fda64196db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:25.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.900+0000 7fda62ffd640 1 --2- 172.21.15.99:0/170222300 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fda641017e0 0x7fda64196db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:25.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.900+0000 7fda62ffd640 1 -- 172.21.15.99:0/170222300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda64106a40 msgr2=0x7fda6419e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:25.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.900+0000 7fda62ffd640 1 --2- 172.21.15.99:0/170222300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda64106a40 0x7fda6419e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:25.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.900+0000 7fda62ffd640 1 -- 172.21.15.99:0/170222300 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda54009560 con 0x7fda64104110 2024-01-31T05:11:25.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.900+0000 7fda63fff640 1 --2- 172.21.15.99:0/170222300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda64106a40 0x7fda6419e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:11:25.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.900+0000 7fda62ffd640 1 --2- 172.21.15.99:0/170222300 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda64104110 0x7fda641972f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fda5800d740 tx=0x7fda5800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:25.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.900+0000 7fda60ff9640 1 -- 172.21.15.99:0/170222300 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda58009c30 con 0x7fda64104110 2024-01-31T05:11:25.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.900+0000 7fda60ff9640 1 -- 172.21.15.99:0/170222300 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fda5800de50 con 0x7fda64104110 2024-01-31T05:11:25.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.901+0000 7fda69b3b640 1 -- 172.21.15.99:0/170222300 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda6419eea0 con 0x7fda64104110 2024-01-31T05:11:25.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.901+0000 7fda60ff9640 1 -- 172.21.15.99:0/170222300 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda58004ea0 con 0x7fda64104110 2024-01-31T05:11:25.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.901+0000 7fda69b3b640 1 -- 172.21.15.99:0/170222300 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda6419f270 con 0x7fda64104110 2024-01-31T05:11:25.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.902+0000 7fda69b3b640 1 -- 172.21.15.99:0/170222300 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda640fcc80 con 0x7fda64104110 2024-01-31T05:11:25.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.903+0000 7fda60ff9640 1 -- 172.21.15.99:0/170222300 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 135946+0+0 (secure 0 0 0) 0x7fda58005020 con 0x7fda64104110 2024-01-31T05:11:25.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.903+0000 7fda60ff9640 1 --2- 172.21.15.99:0/170222300 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fda4c0a1370 0x7fda4c0a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:25.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.903+0000 7fda637fe640 1 --2- 172.21.15.99:0/170222300 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fda4c0a1370 0x7fda4c0a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:25.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.903+0000 7fda60ff9640 1 -- 172.21.15.99:0/170222300 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fda580cc610 con 0x7fda64104110 2024-01-31T05:11:25.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.904+0000 7fda637fe640 1 --2- 172.21.15.99:0/170222300 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fda4c0a1370 0x7fda4c0a3830 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fda54005ab0 tx=0x7fda5402c5d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:25.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:25.907+0000 7fda60ff9640 1 -- 172.21.15.99:0/170222300 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fda580959c0 con 0x7fda64104110 2024-01-31T05:11:26.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:25 smithi099 ceph-mon[31615]: from='client.15393 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-31T05:11:26.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:25 smithi099 ceph-mon[31615]: from='client.15399 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-31T05:11:26.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:25 smithi099 ceph-mon[31615]: pgmap v350: 97 pgs: 97 active+clean; 648 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-01-31T05:11:26.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:25 smithi099 ceph-mon[31615]: from='client.15405 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-31T05:11:26.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:25 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/972485480' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:11:26.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:25 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/1142690984' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-31T05:11:26.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:25 smithi181 ceph-mon[36434]: from='client.15393 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-31T05:11:26.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:25 smithi181 ceph-mon[36434]: from='client.15399 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-31T05:11:26.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:25 smithi181 ceph-mon[36434]: pgmap v350: 97 pgs: 97 active+clean; 648 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-01-31T05:11:26.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:25 smithi181 ceph-mon[36434]: from='client.15405 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-31T05:11:26.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:25 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/972485480' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:11:26.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:25 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/1142690984' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-31T05:11:26.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.080+0000 7fda69b3b640 1 -- 172.21.15.99:0/170222300 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fda6410c790 con 0x7fda64104110 2024-01-31T05:11:26.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.080+0000 7fda60ff9640 1 -- 172.21.15.99:0/170222300 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7fda580978f0 con 0x7fda64104110 2024-01-31T05:11:26.080 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 64 2024-01-31T05:11:26.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.082+0000 7fda69b3b640 1 -- 172.21.15.99:0/170222300 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fda4c0a1370 msgr2=0x7fda4c0a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:26.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.082+0000 7fda69b3b640 1 --2- 172.21.15.99:0/170222300 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fda4c0a1370 0x7fda4c0a3830 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fda54005ab0 tx=0x7fda5402c5d0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.082+0000 7fda69b3b640 1 -- 172.21.15.99:0/170222300 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda64104110 msgr2=0x7fda641972f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:26.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.082+0000 7fda69b3b640 1 --2- 172.21.15.99:0/170222300 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda64104110 0x7fda641972f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fda5800d740 tx=0x7fda5800dc00 comp rx=0 tx=0).stop 2024-01-31T05:11:26.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.082+0000 7fda69b3b640 1 -- 172.21.15.99:0/170222300 shutdown_connections 2024-01-31T05:11:26.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.082+0000 7fda69b3b640 1 --2- 172.21.15.99:0/170222300 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fda4c0a1370 0x7fda4c0a3830 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.082+0000 7fda69b3b640 1 --2- 172.21.15.99:0/170222300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda64106a40 0x7fda6419e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.082+0000 7fda69b3b640 1 --2- 172.21.15.99:0/170222300 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda64104110 0x7fda641972f0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.082+0000 7fda69b3b640 1 --2- 172.21.15.99:0/170222300 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fda641017e0 0x7fda64196db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.082+0000 7fda69b3b640 1 -- 172.21.15.99:0/170222300 >> 172.21.15.99:0/170222300 conn(0x7fda640fb190 msgr2=0x7fda64102140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:26.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.082+0000 7fda69b3b640 1 -- 172.21.15.99:0/170222300 shutdown_connections 2024-01-31T05:11:26.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.083+0000 7fda69b3b640 1 -- 172.21.15.99:0/170222300 wait complete. 2024-01-31T05:11:26.093 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T05:11:26.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:25 smithi179 ceph-mon[35652]: from='client.15393 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-31T05:11:26.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:25 smithi179 ceph-mon[35652]: from='client.15399 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-31T05:11:26.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:25 smithi179 ceph-mon[35652]: pgmap v350: 97 pgs: 97 active+clean; 648 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-01-31T05:11:26.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:25 smithi179 ceph-mon[35652]: from='client.15405 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-31T05:11:26.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:25 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/972485480' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:11:26.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:25 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/1142690984' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-31T05:11:26.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.195+0000 7f15c2b16640 1 -- 172.21.15.99:0/2938256093 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15bc101f00 msgr2=0x7f15bc102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:26.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.195+0000 7f15c2b16640 1 --2- 172.21.15.99:0/2938256093 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15bc101f00 0x7f15bc102380 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f15a8009900 tx=0x7f15a802bc30 comp rx=0 tx=0).stop 2024-01-31T05:11:26.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.195+0000 7f15c2b16640 1 -- 172.21.15.99:0/2938256093 shutdown_connections 2024-01-31T05:11:26.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.195+0000 7f15c2b16640 1 --2- 172.21.15.99:0/2938256093 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15bc1028c0 0x7f15bc109150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.195+0000 7f15c2b16640 1 --2- 172.21.15.99:0/2938256093 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15bc101f00 0x7f15bc102380 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.195+0000 7f15c2b16640 1 --2- 172.21.15.99:0/2938256093 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15bc100d10 0x7f15bc101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.195+0000 7f15c2b16640 1 -- 172.21.15.99:0/2938256093 >> 172.21.15.99:0/2938256093 conn(0x7f15bc0fc2a0 msgr2=0x7f15bc0fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:26.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.195+0000 7f15c2b16640 1 -- 172.21.15.99:0/2938256093 shutdown_connections 2024-01-31T05:11:26.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.195+0000 7f15c2b16640 1 -- 172.21.15.99:0/2938256093 wait complete. 2024-01-31T05:11:26.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.196+0000 7f15c2b16640 1 Processor -- start 2024-01-31T05:11:26.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.196+0000 7f15c2b16640 1 -- start start 2024-01-31T05:11:26.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.196+0000 7f15c2b16640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15bc100d10 0x7f15bc196c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:26.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.196+0000 7f15c2b16640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15bc101f00 0x7f15bc197160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:26.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.196+0000 7f15c2b16640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15bc1028c0 0x7f15bc19e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:26.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.196+0000 7f15c2b16640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc19e700 con 0x7f15bc1028c0 2024-01-31T05:11:26.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.196+0000 7f15c2b16640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc19e870 con 0x7f15bc101f00 2024-01-31T05:11:26.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.196+0000 7f15c2b16640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc19ea30 con 0x7f15bc100d10 2024-01-31T05:11:26.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.196+0000 7f15c10b3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15bc1028c0 0x7f15bc19e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:26.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.196+0000 7f15c10b3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15bc1028c0 0x7f15bc19e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37958/0 (socket says 172.21.15.99:37958) 2024-01-31T05:11:26.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.196+0000 7f15c10b3640 1 -- 172.21.15.99:0/1236883051 learned_addr learned my addr 172.21.15.99:0/1236883051 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:26.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.196+0000 7f15bbfff640 1 --2- 172.21.15.99:0/1236883051 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15bc101f00 0x7f15bc197160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:26.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.196+0000 7f15c10b3640 1 -- 172.21.15.99:0/1236883051 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15bc100d10 msgr2=0x7f15bc196c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:26.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.196+0000 7f15c10b3640 1 --2- 172.21.15.99:0/1236883051 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15bc100d10 0x7f15bc196c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.196+0000 7f15c10b3640 1 -- 172.21.15.99:0/1236883051 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15bc101f00 msgr2=0x7f15bc197160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:26.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.196+0000 7f15c10b3640 1 --2- 172.21.15.99:0/1236883051 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15bc101f00 0x7f15bc197160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.196+0000 7f15c10b3640 1 -- 172.21.15.99:0/1236883051 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a8009560 con 0x7f15bc1028c0 2024-01-31T05:11:26.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.196+0000 7f15c10b3640 1 --2- 172.21.15.99:0/1236883051 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15bc1028c0 0x7f15bc19e190 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f15b400cce0 tx=0x7f15b400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:26.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.197+0000 7f15b9ffb640 1 -- 172.21.15.99:0/1236883051 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b400f450 con 0x7f15bc1028c0 2024-01-31T05:11:26.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.197+0000 7f15b9ffb640 1 -- 172.21.15.99:0/1236883051 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f15b400fa70 con 0x7f15bc1028c0 2024-01-31T05:11:26.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.197+0000 7f15c2b16640 1 -- 172.21.15.99:0/1236883051 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15bc19ed10 con 0x7f15bc1028c0 2024-01-31T05:11:26.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.197+0000 7f15b9ffb640 1 -- 172.21.15.99:0/1236883051 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b4018b40 con 0x7f15bc1028c0 2024-01-31T05:11:26.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.197+0000 7f15c2b16640 1 -- 172.21.15.99:0/1236883051 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15bc19f1d0 con 0x7f15bc1028c0 2024-01-31T05:11:26.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.198+0000 7f15c2b16640 1 -- 172.21.15.99:0/1236883051 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15bc107fd0 con 0x7f15bc1028c0 2024-01-31T05:11:26.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.199+0000 7f15b9ffb640 1 -- 172.21.15.99:0/1236883051 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f15b400fbe0 con 0x7f15bc1028c0 2024-01-31T05:11:26.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.199+0000 7f15b9ffb640 1 --2- 172.21.15.99:0/1236883051 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f15ac0a1370 0x7f15ac0a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:26.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.199+0000 7f15c08b2640 1 --2- 172.21.15.99:0/1236883051 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f15ac0a1370 0x7f15ac0a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:26.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.199+0000 7f15b9ffb640 1 -- 172.21.15.99:0/1236883051 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f15b40cd4a0 con 0x7f15bc1028c0 2024-01-31T05:11:26.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.200+0000 7f15c08b2640 1 --2- 172.21.15.99:0/1236883051 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f15ac0a1370 0x7f15ac0a3830 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f15bc1980f0 tx=0x7f15b0005c90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:26.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.203+0000 7f15b9ffb640 1 -- 172.21.15.99:0/1236883051 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f15b4096850 con 0x7f15bc1028c0 2024-01-31T05:11:26.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.413+0000 7f15c2b16640 1 -- 172.21.15.99:0/1236883051 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f15bc10c780 con 0x7f15bc1028c0 2024-01-31T05:11:26.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.414+0000 7f15b9ffb640 1 -- 172.21.15.99:0/1236883051 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11385 (secure 0 0 0) 0x7f15b4098780 con 0x7f15bc1028c0 2024-01-31T05:11:26.413 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:11:26.413 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/1488539026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1488539026},{"type":"v1","addr":"172.21.15.99:6835","nonce":1488539026}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/1649552652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1649552652},{"type":"v1","addr":"172.21.15.99:6837","nonce":1649552652}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-01-31T05:09:20.564215+0000","modified":"2024-01-31T05:11:20.565526+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24461,"mds_2":24457,"mds_3":24439,"mds_4":14619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6839/4070477446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4070477446},{"type":"v1","addr":"172.21.15.99:6839","nonce":4070477446}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.99:6841/3069939345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6840","nonce":3069939345},{"type":"v1","addr":"172.21.15.99:6841","nonce":3069939345}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24376":{"gid":24376,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6833/427201290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":427201290},{"type":"v1","addr":"172.21.15.181:6833","nonce":427201290}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24401":{"gid":24401,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/472161020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":472161020},{"type":"v1","addr":"172.21.15.179:6833","nonce":472161020}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24427":{"gid":24427,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/1038715471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1038715471},{"type":"v1","addr":"172.21.15.181:6835","nonce":1038715471}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24434":{"gid":24434,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/966976592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":966976592},{"type":"v1","addr":"172.21.15.179:6835","nonce":966976592}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24439":{"gid":24439,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.181:6837/3875964154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3875964154},{"type":"v1","addr":"172.21.15.181:6837","nonce":3875964154}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24457":{"gid":24457,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.181:6839/996120687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":996120687},{"type":"v1","addr":"172.21.15.181:6839","nonce":996120687}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6837/837402830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":837402830},{"type":"v1","addr":"172.21.15.179:6837","nonce":837402830}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6839/754762785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":754762785},{"type":"v1","addr":"172.21.15.179:6839","nonce":754762785}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-31T05:11:26.414 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 27 2024-01-31T05:11:26.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.416+0000 7f15c2b16640 1 -- 172.21.15.99:0/1236883051 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f15ac0a1370 msgr2=0x7f15ac0a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:26.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.416+0000 7f15c2b16640 1 --2- 172.21.15.99:0/1236883051 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f15ac0a1370 0x7f15ac0a3830 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f15bc1980f0 tx=0x7f15b0005c90 comp rx=0 tx=0).stop 2024-01-31T05:11:26.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.416+0000 7f15c2b16640 1 -- 172.21.15.99:0/1236883051 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15bc1028c0 msgr2=0x7f15bc19e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:26.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.416+0000 7f15c2b16640 1 --2- 172.21.15.99:0/1236883051 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15bc1028c0 0x7f15bc19e190 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f15b400cce0 tx=0x7f15b400a620 comp rx=0 tx=0).stop 2024-01-31T05:11:26.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.416+0000 7f15c2b16640 1 -- 172.21.15.99:0/1236883051 shutdown_connections 2024-01-31T05:11:26.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.416+0000 7f15c2b16640 1 --2- 172.21.15.99:0/1236883051 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f15ac0a1370 0x7f15ac0a3830 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.416+0000 7f15c2b16640 1 --2- 172.21.15.99:0/1236883051 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15bc1028c0 0x7f15bc19e190 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.416+0000 7f15c2b16640 1 --2- 172.21.15.99:0/1236883051 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15bc101f00 0x7f15bc197160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.416+0000 7f15c2b16640 1 --2- 172.21.15.99:0/1236883051 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15bc100d10 0x7f15bc196c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.416+0000 7f15c2b16640 1 -- 172.21.15.99:0/1236883051 >> 172.21.15.99:0/1236883051 conn(0x7f15bc0fc2a0 msgr2=0x7f15bc1051a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:26.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.416+0000 7f15c2b16640 1 -- 172.21.15.99:0/1236883051 shutdown_connections 2024-01-31T05:11:26.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.416+0000 7f15c2b16640 1 -- 172.21.15.99:0/1236883051 wait complete. 2024-01-31T05:11:26.427 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:11:26.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.529+0000 7f5f8b699640 1 -- 172.21.15.99:0/1495907833 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5f84100d10 msgr2=0x7f5f84101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:26.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.529+0000 7f5f8b699640 1 --2- 172.21.15.99:0/1495907833 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5f84100d10 0x7f5f84101130 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f5f74009ca0 tx=0x7f5f7402c0f0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.529+0000 7f5f8b699640 1 -- 172.21.15.99:0/1495907833 shutdown_connections 2024-01-31T05:11:26.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.529+0000 7f5f8b699640 1 --2- 172.21.15.99:0/1495907833 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f841028c0 0x7f5f84109150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.529+0000 7f5f8b699640 1 --2- 172.21.15.99:0/1495907833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f84101f00 0x7f5f84102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.529+0000 7f5f8b699640 1 --2- 172.21.15.99:0/1495907833 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5f84100d10 0x7f5f84101130 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.529+0000 7f5f8b699640 1 -- 172.21.15.99:0/1495907833 >> 172.21.15.99:0/1495907833 conn(0x7f5f840fc2a0 msgr2=0x7f5f840fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:26.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.529+0000 7f5f8b699640 1 -- 172.21.15.99:0/1495907833 shutdown_connections 2024-01-31T05:11:26.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.529+0000 7f5f8b699640 1 -- 172.21.15.99:0/1495907833 wait complete. 2024-01-31T05:11:26.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.529+0000 7f5f8b699640 1 Processor -- start 2024-01-31T05:11:26.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.529+0000 7f5f8b699640 1 -- start start 2024-01-31T05:11:26.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.530+0000 7f5f8b699640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5f84100d10 0x7f5f84196cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:26.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.530+0000 7f5f8b699640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f84101f00 0x7f5f841971f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:26.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.530+0000 7f5f8b699640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f841028c0 0x7f5f8419e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:26.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.530+0000 7f5f8b699640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8419e7c0 con 0x7f5f84100d10 2024-01-31T05:11:26.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.530+0000 7f5f8b699640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8419e930 con 0x7f5f84101f00 2024-01-31T05:11:26.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.530+0000 7f5f8b699640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8419eaf0 con 0x7f5f841028c0 2024-01-31T05:11:26.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.530+0000 7f5f89435640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5f84100d10 0x7f5f84196cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:26.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.530+0000 7f5f89435640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5f84100d10 0x7f5f84196cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37972/0 (socket says 172.21.15.99:37972) 2024-01-31T05:11:26.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.530+0000 7f5f89435640 1 -- 172.21.15.99:0/1801312955 learned_addr learned my addr 172.21.15.99:0/1801312955 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:26.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.530+0000 7f5f89c36640 1 --2- 172.21.15.99:0/1801312955 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f841028c0 0x7f5f8419e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:26.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.530+0000 7f5f88c34640 1 --2- 172.21.15.99:0/1801312955 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f84101f00 0x7f5f841971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:26.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.530+0000 7f5f89435640 1 -- 172.21.15.99:0/1801312955 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f841028c0 msgr2=0x7f5f8419e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:26.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.530+0000 7f5f89435640 1 --2- 172.21.15.99:0/1801312955 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f841028c0 0x7f5f8419e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.530+0000 7f5f89435640 1 -- 172.21.15.99:0/1801312955 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f84101f00 msgr2=0x7f5f841971f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:26.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.530+0000 7f5f89435640 1 --2- 172.21.15.99:0/1801312955 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f84101f00 0x7f5f841971f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.530+0000 7f5f89435640 1 -- 172.21.15.99:0/1801312955 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f74009900 con 0x7f5f84100d10 2024-01-31T05:11:26.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.530+0000 7f5f88c34640 1 --2- 172.21.15.99:0/1801312955 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f84101f00 0x7f5f841971f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:11:26.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.530+0000 7f5f89435640 1 --2- 172.21.15.99:0/1801312955 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5f84100d10 0x7f5f84196cb0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f5f74037040 tx=0x7f5f74032810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:26.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.530+0000 7f5f827fc640 1 -- 172.21.15.99:0/1801312955 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f74034c70 con 0x7f5f84100d10 2024-01-31T05:11:26.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.530+0000 7f5f827fc640 1 -- 172.21.15.99:0/1801312955 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5f74003e30 con 0x7f5f84100d10 2024-01-31T05:11:26.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.530+0000 7f5f8b699640 1 -- 172.21.15.99:0/1801312955 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f8419ed70 con 0x7f5f84100d10 2024-01-31T05:11:26.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.530+0000 7f5f827fc640 1 -- 172.21.15.99:0/1801312955 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7403d3f0 con 0x7f5f84100d10 2024-01-31T05:11:26.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.530+0000 7f5f8b699640 1 -- 172.21.15.99:0/1801312955 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f8419f1d0 con 0x7f5f84100d10 2024-01-31T05:11:26.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.531+0000 7f5f8b699640 1 -- 172.21.15.99:0/1801312955 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f84108050 con 0x7f5f84100d10 2024-01-31T05:11:26.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.532+0000 7f5f827fc640 1 -- 172.21.15.99:0/1801312955 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f5f7403b040 con 0x7f5f84100d10 2024-01-31T05:11:26.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.533+0000 7f5f827fc640 1 --2- 172.21.15.99:0/1801312955 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f5f6c0a1370 0x7f5f6c0a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:26.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.533+0000 7f5f88c34640 1 --2- 172.21.15.99:0/1801312955 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f5f6c0a1370 0x7f5f6c0a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:26.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.533+0000 7f5f827fc640 1 -- 172.21.15.99:0/1801312955 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f5f740ef200 con 0x7f5f84100d10 2024-01-31T05:11:26.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.533+0000 7f5f88c34640 1 --2- 172.21.15.99:0/1801312955 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f5f6c0a1370 0x7f5f6c0a3830 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5f841981b0 tx=0x7f5f78005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:26.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.537+0000 7f5f827fc640 1 -- 172.21.15.99:0/1801312955 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f5f740b8750 con 0x7f5f84100d10 2024-01-31T05:11:26.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.712+0000 7f5f8b699640 1 -- 172.21.15.99:0/1801312955 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f8410c7d0 con 0x7f5f84100d10 2024-01-31T05:11:26.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.714+0000 7f5f827fc640 1 -- 172.21.15.99:0/1801312955 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22426 (secure 0 0 0) 0x7f5f740bbd70 con 0x7f5f84100d10 2024-01-31T05:11:26.713 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:11:26.713 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":88,"fsid":"9288ff44-bff5-11ee-95b3-87774f69a715","created":"2024-01-31T05:01:26.130917+0000","modified":"2024-01-31T05:10:21.675877+0000","last_up_change":"2024-01-31T05:08:31.228478+0000","last_in_change":"2024-01-31T05:08:10.799511+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:46.842423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:09:18.693558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-31T05:09:19.734003+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b45878d9-28f1-4821-ba72-26a32d3fc780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6803","nonce":1213805280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6805","nonce":1213805280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6809","nonce":1213805280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6807","nonce":1213805280}]},"public_addr":"172.21.15.99:6803/1213805280","cluster_addr":"172.21.15.99:6805/1213805280","heartbeat_back_addr":"172.21.15.99:6809/1213805280","heartbeat_front_addr":"172.21.15.99:6807/1213805280","state":["exists","up"]},{"osd":1,"uuid":"e0b71ff3-5d97-4659-8dea-4c9091e1beb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6801","nonce":2019451677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6803","nonce":2019451677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6807","nonce":2019451677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6805","nonce":2019451677}]},"public_addr":"172.21.15.179:6801/2019451677","cluster_addr":"172.21.15.179:6803/2019451677","heartbeat_back_addr":"172.21.15.179:6807/2019451677","heartbeat_front_addr":"172.21.15.179:6805/2019451677","state":["exists","up"]},{"osd":2,"uuid":"11c919c8-19a9-48b0-8880-3002efcb64f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6801","nonce":3934284457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6803","nonce":3934284457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6807","nonce":3934284457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6805","nonce":3934284457}]},"public_addr":"172.21.15.181:6801/3934284457","cluster_addr":"172.21.15.181:6803/3934284457","heartbeat_back_addr":"172.21.15.181:6807/3934284457","heartbeat_front_addr":"172.21.15.181:6805/3934284457","state":["exists","up"]},{"osd":3,"uuid":"bcab5135-a5d1-45ae-a9b8-674425d3999e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6811","nonce":4207675427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6813","nonce":4207675427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6817","nonce":4207675427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6815","nonce":4207675427}]},"public_addr":"172.21.15.99:6811/4207675427","cluster_addr":"172.21.15.99:6813/4207675427","heartbeat_back_addr":"172.21.15.99:6817/4207675427","heartbeat_front_addr":"172.21.15.99:6815/4207675427","state":["exists","up"]},{"osd":4,"uuid":"0250d7ac-3894-457a-9c04-cc7205d61eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6809","nonce":2861083896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6811","nonce":2861083896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6815","nonce":2861083896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6813","nonce":2861083896}]},"public_addr":"172.21.15.179:6809/2861083896","cluster_addr":"172.21.15.179:6811/2861083896","heartbeat_back_addr":"172.21.15.179:6815/2861083896","heartbeat_front_addr":"172.21.15.179:6813/2861083896","state":["exists","up"]},{"osd":5,"uuid":"5e19222a-c2a4-45bc-8445-1d302f26d11c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6809","nonce":1485017095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6811","nonce":1485017095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6815","nonce":1485017095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6813","nonce":1485017095}]},"public_addr":"172.21.15.181:6809/1485017095","cluster_addr":"172.21.15.181:6811/1485017095","heartbeat_back_addr":"172.21.15.181:6815/1485017095","heartbeat_front_addr":"172.21.15.181:6813/1485017095","state":["exists","up"]},{"osd":6,"uuid":"56555035-f9fc-4e91-96dd-caa632d58adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6819","nonce":1534047839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6821","nonce":1534047839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6825","nonce":1534047839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6823","nonce":1534047839}]},"public_addr":"172.21.15.99:6819/1534047839","cluster_addr":"172.21.15.99:6821/1534047839","heartbeat_back_addr":"172.21.15.99:6825/1534047839","heartbeat_front_addr":"172.21.15.99:6823/1534047839","state":["exists","up"]},{"osd":7,"uuid":"5e079cf5-1340-4599-88a6-df410ef0148e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6817","nonce":3875950553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6819","nonce":3875950553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6823","nonce":3875950553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6821","nonce":3875950553}]},"public_addr":"172.21.15.179:6817/3875950553","cluster_addr":"172.21.15.179:6819/3875950553","heartbeat_back_addr":"172.21.15.179:6823/3875950553","heartbeat_front_addr":"172.21.15.179:6821/3875950553","state":["exists","up"]},{"osd":8,"uuid":"10a73592-4251-4492-b67d-ce9b9d7fff32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6817","nonce":179568936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6819","nonce":179568936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6823","nonce":179568936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6821","nonce":179568936}]},"public_addr":"172.21.15.181:6817/179568936","cluster_addr":"172.21.15.181:6819/179568936","heartbeat_back_addr":"172.21.15.181:6823/179568936","heartbeat_front_addr":"172.21.15.181:6821/179568936","state":["exists","up"]},{"osd":9,"uuid":"f6620e1e-f761-4f1c-917f-cbc748df32a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6827","nonce":315759515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6829","nonce":315759515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6833","nonce":315759515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6831","nonce":315759515}]},"public_addr":"172.21.15.99:6827/315759515","cluster_addr":"172.21.15.99:6829/315759515","heartbeat_back_addr":"172.21.15.99:6833/315759515","heartbeat_front_addr":"172.21.15.99:6831/315759515","state":["exists","up"]},{"osd":10,"uuid":"ee86af7d-66f8-4795-bcc3-dfec79e4680c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6825","nonce":2985063934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6827","nonce":2985063934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6831","nonce":2985063934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6829","nonce":2985063934}]},"public_addr":"172.21.15.179:6825/2985063934","cluster_addr":"172.21.15.179:6827/2985063934","heartbeat_back_addr":"172.21.15.179:6831/2985063934","heartbeat_front_addr":"172.21.15.179:6829/2985063934","state":["exists","up"]},{"osd":11,"uuid":"82f04fee-f6ae-4630-a75b-b12a9c4ab2e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6825","nonce":1858219600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6827","nonce":1858219600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6831","nonce":1858219600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6829","nonce":1858219600}]},"public_addr":"172.21.15.181:6825/1858219600","cluster_addr":"172.21.15.181:6827/1858219600","heartbeat_back_addr":"172.21.15.181:6831/1858219600","heartbeat_front_addr":"172.21.15.181:6829/1858219600","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:55.518970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:04:19.936339+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:04:44.064814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:09.331683+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:34.616774+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:58.881810+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:06:23.869838+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:06:49.127331+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:07:12.847187+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:07:38.231045+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:08:03.949162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:08:28.471802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:0/401101729":"2024-02-01T05:02:20.510858+0000","172.21.15.99:6801/1993198206":"2024-02-01T05:02:20.510858+0000","172.21.15.99:0/3819754569":"2024-02-01T05:02:20.510858+0000","172.21.15.99:0/475390265":"2024-02-01T05:01:53.732026+0000","172.21.15.99:6800/1993198206":"2024-02-01T05:02:20.510858+0000","172.21.15.99:6800/1706888338":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/4150146075":"2024-02-01T05:01:53.732026+0000","172.21.15.99:6801/1706888338":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/2851066598":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/1865156424":"2024-02-01T05:02:20.510858+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:11:26.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.716+0000 7f5f8b699640 1 -- 172.21.15.99:0/1801312955 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f5f6c0a1370 msgr2=0x7f5f6c0a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:26.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.716+0000 7f5f8b699640 1 --2- 172.21.15.99:0/1801312955 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f5f6c0a1370 0x7f5f6c0a3830 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5f841981b0 tx=0x7f5f78005e50 comp rx=0 tx=0).stop 2024-01-31T05:11:26.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.716+0000 7f5f8b699640 1 -- 172.21.15.99:0/1801312955 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5f84100d10 msgr2=0x7f5f84196cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:26.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.716+0000 7f5f8b699640 1 --2- 172.21.15.99:0/1801312955 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5f84100d10 0x7f5f84196cb0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f5f74037040 tx=0x7f5f74032810 comp rx=0 tx=0).stop 2024-01-31T05:11:26.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.716+0000 7f5f8b699640 1 -- 172.21.15.99:0/1801312955 shutdown_connections 2024-01-31T05:11:26.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.716+0000 7f5f8b699640 1 --2- 172.21.15.99:0/1801312955 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f5f6c0a1370 0x7f5f6c0a3830 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.716+0000 7f5f8b699640 1 --2- 172.21.15.99:0/1801312955 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f841028c0 0x7f5f8419e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.716+0000 7f5f8b699640 1 --2- 172.21.15.99:0/1801312955 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f84101f00 0x7f5f841971f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.716+0000 7f5f8b699640 1 --2- 172.21.15.99:0/1801312955 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5f84100d10 0x7f5f84196cb0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.716+0000 7f5f8b699640 1 -- 172.21.15.99:0/1801312955 >> 172.21.15.99:0/1801312955 conn(0x7f5f840fc2a0 msgr2=0x7f5f84105220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:26.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.716+0000 7f5f8b699640 1 -- 172.21.15.99:0/1801312955 shutdown_connections 2024-01-31T05:11:26.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.716+0000 7f5f8b699640 1 -- 172.21.15.99:0/1801312955 wait complete. 2024-01-31T05:11:26.729 DEBUG:tasks.fwd_scrub:Yielding 2024-01-31T05:11:26.729 INFO:teuthology.run_tasks:Running task background_exec... 2024-01-31T05:11:26.739 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi099.front.sepia.ceph.com 2024-01-31T05:11:26.739 DEBUG:teuthology.orchestra.run.smithi099:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-01-31T05:11:26.740 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-01-31T05:11:26.740 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-01-31T05:11:26.740 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-01-31T05:11:26.742 INFO:teuthology.run_tasks:Running task workunit... 2024-01-31T05:11:26.768 INFO:tasks.workunit:Pulling workunits from ref 661946e7044723130c03627323f6a879a9848cb5 2024-01-31T05:11:26.768 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-01-31T05:11:26.768 INFO:tasks.workunit:timeout=6h 2024-01-31T05:11:26.768 INFO:tasks.workunit:cleanup=True 2024-01-31T05:11:26.769 DEBUG:teuthology.orchestra.run.smithi099:> stat -- /home/ubuntu/cephtest/mnt.0 2024-01-31T05:11:26.785 INFO:teuthology.orchestra.run.smithi099.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-01-31T05:11:26.785 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-01-31T05:11:26.785 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 77h/119d Inode: 1099511628283 Links: 2 2024-01-31T05:11:26.785 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-31T05:11:26.785 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-01-31T05:11:26.785 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-01-31 05:09:28.209398266 +0000 2024-01-31T05:11:26.785 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-01-31 05:09:28.209398266 +0000 2024-01-31T05:11:26.785 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-01-31 05:11:19.900826500 +0000 2024-01-31T05:11:26.785 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2024-01-31 05:09:28.209398266 +0000 2024-01-31T05:11:26.786 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-01-31T05:11:26.786 DEBUG:teuthology.orchestra.run.smithi099:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-01-31T05:11:26.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.851+0000 7fa0ff375640 1 -- 172.21.15.99:0/35468515 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa0f81017a0 msgr2=0x7fa0f8108030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:26.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.851+0000 7fa0ff375640 1 --2- 172.21.15.99:0/35468515 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa0f81017a0 0x7fa0f8108030 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4009ca0 tx=0x7fa0f402c0f0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.851+0000 7fa0ff375640 1 -- 172.21.15.99:0/35468515 shutdown_connections 2024-01-31T05:11:26.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.851+0000 7fa0ff375640 1 --2- 172.21.15.99:0/35468515 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa0f81017a0 0x7fa0f8108030 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.851+0000 7fa0ff375640 1 --2- 172.21.15.99:0/35468515 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa0f8100de0 0x7fa0f8101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.851+0000 7fa0ff375640 1 --2- 172.21.15.99:0/35468515 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0f80ffbf0 0x7fa0f8100010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.851+0000 7fa0ff375640 1 -- 172.21.15.99:0/35468515 >> 172.21.15.99:0/35468515 conn(0x7fa0f80fb180 msgr2=0x7fa0f80fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:26.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.851+0000 7fa0ff375640 1 -- 172.21.15.99:0/35468515 shutdown_connections 2024-01-31T05:11:26.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.851+0000 7fa0ff375640 1 -- 172.21.15.99:0/35468515 wait complete. 2024-01-31T05:11:26.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.852+0000 7fa0ff375640 1 Processor -- start 2024-01-31T05:11:26.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.852+0000 7fa0ff375640 1 -- start start 2024-01-31T05:11:26.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.852+0000 7fa0ff375640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa0f80ffbf0 0x7fa0f8103b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:26.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.852+0000 7fa0ff375640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa0f8100de0 0x7fa0f81021c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:26.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.852+0000 7fa0ff375640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0f81017a0 0x7fa0f8102700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:26.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.852+0000 7fa0ff375640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f8102e60 con 0x7fa0f8100de0 2024-01-31T05:11:26.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.852+0000 7fa0ff375640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f8102fd0 con 0x7fa0f81017a0 2024-01-31T05:11:26.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.852+0000 7fa0ff375640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f81a0d20 con 0x7fa0f80ffbf0 2024-01-31T05:11:26.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.852+0000 7fa0fc910640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa0f8100de0 0x7fa0f81021c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:26.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.852+0000 7fa0fc910640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa0f8100de0 0x7fa0f81021c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37994/0 (socket says 172.21.15.99:37994) 2024-01-31T05:11:26.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.852+0000 7fa0fc910640 1 -- 172.21.15.99:0/4184906722 learned_addr learned my addr 172.21.15.99:0/4184906722 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:26.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.852+0000 7fa0fd912640 1 --2- 172.21.15.99:0/4184906722 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0f81017a0 0x7fa0f8102700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:26.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.852+0000 7fa0fd111640 1 --2- 172.21.15.99:0/4184906722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa0f80ffbf0 0x7fa0f8103b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:26.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.852+0000 7fa0fc910640 1 -- 172.21.15.99:0/4184906722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa0f80ffbf0 msgr2=0x7fa0f8103b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:26.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.852+0000 7fa0fc910640 1 --2- 172.21.15.99:0/4184906722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa0f80ffbf0 0x7fa0f8103b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.852+0000 7fa0fc910640 1 -- 172.21.15.99:0/4184906722 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0f81017a0 msgr2=0x7fa0f8102700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:26.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.852+0000 7fa0fc910640 1 --2- 172.21.15.99:0/4184906722 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0f81017a0 0x7fa0f8102700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.852+0000 7fa0fc910640 1 -- 172.21.15.99:0/4184906722 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f4009900 con 0x7fa0f8100de0 2024-01-31T05:11:26.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.852+0000 7fa0fd912640 1 --2- 172.21.15.99:0/4184906722 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0f81017a0 0x7fa0f8102700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:11:26.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.852+0000 7fa0fc910640 1 --2- 172.21.15.99:0/4184906722 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa0f8100de0 0x7fa0f81021c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa0e800c8c0 tx=0x7fa0e800cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:26.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.853+0000 7fa0ee7fc640 1 -- 172.21.15.99:0/4184906722 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e8004220 con 0x7fa0f8100de0 2024-01-31T05:11:26.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.853+0000 7fa0ee7fc640 1 -- 172.21.15.99:0/4184906722 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa0e8007e70 con 0x7fa0f8100de0 2024-01-31T05:11:26.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.853+0000 7fa0ff375640 1 -- 172.21.15.99:0/4184906722 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0f81a0fd0 con 0x7fa0f8100de0 2024-01-31T05:11:26.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.853+0000 7fa0ee7fc640 1 -- 172.21.15.99:0/4184906722 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e8004a00 con 0x7fa0f8100de0 2024-01-31T05:11:26.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.853+0000 7fa0ff375640 1 -- 172.21.15.99:0/4184906722 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0f81a14a0 con 0x7fa0f8100de0 2024-01-31T05:11:26.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.855+0000 7fa0ee7fc640 1 -- 172.21.15.99:0/4184906722 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 135946+0+0 (secure 0 0 0) 0x7fa0e80079b0 con 0x7fa0f8100de0 2024-01-31T05:11:26.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.855+0000 7fa102213740 1 Processor -- start 2024-01-31T05:11:26.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.855+0000 7fa102213740 1 -- start start 2024-01-31T05:11:26.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.856+0000 7fa102213740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a3789d050 0x557a3789d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:26.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.856+0000 7fa102213740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557a3789da40 0x557a378a2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:26.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.856+0000 7fa102213740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557a378a2bb0 0x557a378a5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:26.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.856+0000 7fa102213740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a37873bf0 con 0x557a3789d050 2024-01-31T05:11:26.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.856+0000 7fa102213740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a3780bf50 con 0x557a3789da40 2024-01-31T05:11:26.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.856+0000 7fa102213740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a37809640 con 0x557a378a2bb0 2024-01-31T05:11:26.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.856+0000 7fa0ee7fc640 1 --2- 172.21.15.99:0/4184906722 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa0e40a13f0 0x7fa0e40a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:26.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.856+0000 7fa0fd111640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557a3789da40 0x557a378a2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:26.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.856+0000 7fa0fd111640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557a3789da40 0x557a378a2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.99:50928/0 (socket says 172.21.15.99:50928) 2024-01-31T05:11:26.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.856+0000 7fa0fd912640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a3789d050 0x557a3789d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:26.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.856+0000 7fa0fd111640 1 -- 172.21.15.99:0/1135495129 learned_addr learned my addr 172.21.15.99:0/1135495129 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:26.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.856+0000 7fa0fd912640 1 --2- 172.21.15.99:0/4184906722 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa0e40a13f0 0x7fa0e40a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:26.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.856+0000 7fa0ee7fc640 1 -- 172.21.15.99:0/4184906722 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fa0e80cc8b0 con 0x7fa0f8100de0 2024-01-31T05:11:26.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.856+0000 7fa0fc910640 1 --2- 172.21.15.99:0/1135495129 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557a378a2bb0 0x557a378a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:26.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.856+0000 7fa0fd111640 1 -- 172.21.15.99:0/1135495129 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557a378a2bb0 msgr2=0x557a378a5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:26.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.856+0000 7fa0fd111640 1 --2- 172.21.15.99:0/1135495129 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557a378a2bb0 0x557a378a5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.856+0000 7fa0fd111640 1 -- 172.21.15.99:0/1135495129 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a3789d050 msgr2=0x557a3789d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:26.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.856+0000 7fa0fd111640 1 --2- 172.21.15.99:0/1135495129 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a3789d050 0x557a3789d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.856+0000 7fa0fd111640 1 -- 172.21.15.99:0/1135495129 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a377fcd50 con 0x557a3789da40 2024-01-31T05:11:26.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.856+0000 7fa0fd912640 1 --2- 172.21.15.99:0/1135495129 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a3789d050 0x557a3789d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:11:26.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.856+0000 7fa0fd912640 1 --2- 172.21.15.99:0/4184906722 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa0e40a13f0 0x7fa0e40a38b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4033000 tx=0x7fa0f40095c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:26.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.856+0000 7fa0fd111640 1 --2- 172.21.15.99:0/1135495129 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557a3789da40 0x557a378a2540 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa0f000cbb0 tx=0x7fa0f000e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=254d475dd3dc2316 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:26.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.857+0000 7fa0e37fe640 1 -- 172.21.15.99:0/1135495129 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f0005220 con 0x557a3789da40 2024-01-31T05:11:26.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.857+0000 7fa0e37fe640 1 -- 172.21.15.99:0/1135495129 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa0f0004c60 con 0x557a3789da40 2024-01-31T05:11:26.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.857+0000 7fa0e37fe640 1 -- 172.21.15.99:0/1135495129 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f0010690 con 0x557a3789da40 2024-01-31T05:11:26.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.858+0000 7fa102213740 1 -- 172.21.15.99:0/1135495129 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557a3789da40 msgr2=0x557a378a2540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:26.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.858+0000 7fa102213740 1 --2- 172.21.15.99:0/1135495129 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557a3789da40 0x557a378a2540 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa0f000cbb0 tx=0x7fa0f000e720 comp rx=0 tx=0).stop 2024-01-31T05:11:26.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.858+0000 7fa102213740 1 -- 172.21.15.99:0/1135495129 shutdown_connections 2024-01-31T05:11:26.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.858+0000 7fa102213740 1 --2- 172.21.15.99:0/1135495129 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557a378a2bb0 0x557a378a5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.858+0000 7fa102213740 1 --2- 172.21.15.99:0/1135495129 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557a3789da40 0x557a378a2540 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.858+0000 7fa102213740 1 --2- 172.21.15.99:0/1135495129 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a3789d050 0x557a3789d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.858+0000 7fa102213740 1 -- 172.21.15.99:0/1135495129 >> 172.21.15.99:0/1135495129 conn(0x557a378985c0 msgr2=0x557a378989c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:26.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.858+0000 7fa102213740 1 -- 172.21.15.99:0/1135495129 shutdown_connections 2024-01-31T05:11:26.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.858+0000 7fa102213740 1 -- 172.21.15.99:0/1135495129 wait complete. 2024-01-31T05:11:26.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.858+0000 7fa102213740 1 -- start start 2024-01-31T05:11:26.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.858+0000 7fa102213740 1 Processor -- start 2024-01-31T05:11:26.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.859+0000 7fa102213740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a3789d050 0x557a378a7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:26.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.859+0000 7fa102213740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557a3789da40 0x557a378a7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:26.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.859+0000 7fa102213740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557a378a2bb0 0x557a378ae6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:26.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.859+0000 7fa102213740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a37804f30 con 0x557a3789d050 2024-01-31T05:11:26.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.859+0000 7fa102213740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a377be0c0 con 0x557a3789da40 2024-01-31T05:11:26.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.859+0000 7fa102213740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a377bdd60 con 0x557a378a2bb0 2024-01-31T05:11:26.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.859+0000 7fa0fd111640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a3789d050 0x557a378a7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:26.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.859+0000 7fa102213740 10 client.0 _ll_register_callbacks cb 0x557a377a3fc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:11:26.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.859+0000 7fa0fd111640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a3789d050 0x557a378a7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38022/0 (socket says 172.21.15.99:38022) 2024-01-31T05:11:26.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.859+0000 7fa0fd111640 1 -- 172.21.15.99:0/2669070052 learned_addr learned my addr 172.21.15.99:0/2669070052 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:26.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.859+0000 7fa0fc910640 1 --2- 172.21.15.99:0/2669070052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557a3789da40 0x557a378a7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:26.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.859+0000 7fa0fd912640 1 --2- 172.21.15.99:0/2669070052 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557a378a2bb0 0x557a378ae6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:26.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.859+0000 7fa0fd111640 1 -- 172.21.15.99:0/2669070052 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557a378a2bb0 msgr2=0x557a378ae6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:26.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.859+0000 7fa0fd111640 1 --2- 172.21.15.99:0/2669070052 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557a378a2bb0 0x557a378ae6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.859+0000 7fa0fd111640 1 -- 172.21.15.99:0/2669070052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557a3789da40 msgr2=0x557a378a7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:26.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.859+0000 7fa0fd111640 1 --2- 172.21.15.99:0/2669070052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557a3789da40 0x557a378a7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.859+0000 7fa0fd111640 1 -- 172.21.15.99:0/2669070052 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0f000c810 con 0x557a3789d050 2024-01-31T05:11:26.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.859+0000 7fa0fd111640 1 --2- 172.21.15.99:0/2669070052 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a3789d050 0x557a378a7140 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0005000 tx=0x7fa0f0005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=364396094550f635 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:26.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.859+0000 7fa0e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:11:26.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.859+0000 7fa0e0ff9640 1 -- 172.21.15.99:0/2669070052 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f0020070 con 0x557a3789d050 2024-01-31T05:11:26.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.859+0000 7fa0e0ff9640 1 -- 172.21.15.99:0/2669070052 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fa0f0004a80 con 0x557a3789d050 2024-01-31T05:11:26.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.859+0000 7fa102213740 1 -- 172.21.15.99:0/2669070052 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557a377fdf20 con 0x557a3789d050 2024-01-31T05:11:26.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.860+0000 7fa0e0ff9640 1 -- 172.21.15.99:0/2669070052 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa0f000ceb0 con 0x557a3789d050 2024-01-31T05:11:26.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.860+0000 7fa102213740 10 client.15453 fetch_fsmap learned FSMap version 27 2024-01-31T05:11:26.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.860+0000 7fa102213740 1 -- 172.21.15.99:0/2669070052 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x557a378035b0 con 0x557a3789d050 2024-01-31T05:11:26.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.860+0000 7fa0e0ff9640 1 -- 172.21.15.99:0/2669070052 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557a377fdf20 con 0x557a3789d050 2024-01-31T05:11:26.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.860+0000 7fa0e0ff9640 1 -- 172.21.15.99:0/2669070052 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa0f0003bf0 con 0x557a3789d050 2024-01-31T05:11:26.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.860+0000 7fa102213740 10 client.15453 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:11:26.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.860+0000 7fa102213740 10 client.15453 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-01-31T05:11:26.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.860+0000 7fa102213740 20 client.15453 populate_metadata read hostname 'smithi099' 2024-01-31T05:11:26.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.860+0000 7fa102213740 1 --2- 172.21.15.99:0/2669070052 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x557a378b32b0 0x557a378b56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:26.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.860+0000 7fa102213740 4 client.15453 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:11:26.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.860+0000 7fa102213740 1 -- 172.21.15.99:0/2669070052 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557a377fdc40 con 0x557a378b32b0 2024-01-31T05:11:26.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.860+0000 7fa0fc910640 1 --2- 172.21.15.99:0/2669070052 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x557a378b32b0 0x557a378b56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:26.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.861+0000 7fa0e0ff9640 10 client.15453 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:11:26.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.861+0000 7fa0fc910640 1 --2- 172.21.15.99:0/2669070052 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x557a378b32b0 0x557a378b56a0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9313462160b0ba9 server_cookie=4ac1cdd1c8590656 in_seq=0 out_seq=0 2024-01-31T05:11:26.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.863+0000 7fa0e0ff9640 1 -- 172.21.15.99:0/2669070052 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557a377fdc40 con 0x557a378b32b0 2024-01-31T05:11:26.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.863+0000 7fa0e0ff9640 10 client.15453 handle_command_reply: tid=0 2024-01-31T05:11:26.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.863+0000 7fa102213740 1 client.15453 shutdown 2024-01-31T05:11:26.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.863+0000 7fa102213740 1 -- 172.21.15.99:0/2669070052 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a3789d050 msgr2=0x557a378a7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:26.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.863+0000 7fa102213740 1 --2- 172.21.15.99:0/2669070052 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a3789d050 0x557a378a7140 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0005000 tx=0x7fa0f0005030 comp rx=0 tx=0).stop 2024-01-31T05:11:26.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.863+0000 7fa102213740 1 -- 172.21.15.99:0/2669070052 shutdown_connections 2024-01-31T05:11:26.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.863+0000 7fa102213740 1 --2- 172.21.15.99:0/2669070052 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557a378a2bb0 0x557a378ae6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.863+0000 7fa102213740 1 --2- 172.21.15.99:0/2669070052 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x557a378b32b0 0x557a378b56a0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.863+0000 7fa102213740 1 --2- 172.21.15.99:0/2669070052 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557a3789da40 0x557a378a7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.863+0000 7fa102213740 1 --2- 172.21.15.99:0/2669070052 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a3789d050 0x557a378a7140 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.863+0000 7fa0e0ff9640 0 client.15453 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:11:26.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.863+0000 7fa102213740 1 -- 172.21.15.99:0/2669070052 >> 172.21.15.99:0/2669070052 conn(0x557a378985c0 msgr2=0x557a37897960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:26.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.864+0000 7fa102213740 1 -- 172.21.15.99:0/2669070052 shutdown_connections 2024-01-31T05:11:26.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.864+0000 7fa102213740 1 -- 172.21.15.99:0/2669070052 wait complete. 2024-01-31T05:11:26.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.864+0000 7fa102213740 20 client.15453 trim_cache size 0 max 16384 2024-01-31T05:11:26.868 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 661946e7044723130c03627323f6a879a9848cb5 2024-01-31T05:11:26.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.879+0000 7fa102213740 1 Processor -- start 2024-01-31T05:11:26.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.879+0000 7fa102213740 1 -- start start 2024-01-31T05:11:26.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.879+0000 7fa102213740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557a3789d050 0x557a3789ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:26.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.879+0000 7fa102213740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557a3789da40 0x557a3789f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:26.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.879+0000 7fa102213740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a378a2bb0 0x557a378ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:26.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.879+0000 7fa102213740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a37782e30 con 0x557a378a2bb0 2024-01-31T05:11:26.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.879+0000 7fa102213740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a377fdc40 con 0x557a3789da40 2024-01-31T05:11:26.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.879+0000 7fa102213740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a377fdf20 con 0x557a3789d050 2024-01-31T05:11:26.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.879+0000 7fa0fd912640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a378a2bb0 0x557a378ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:26.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.879+0000 7fa0fd912640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a378a2bb0 0x557a378ae5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38036/0 (socket says 172.21.15.99:38036) 2024-01-31T05:11:26.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.879+0000 7fa0fd912640 1 -- 172.21.15.99:0/721035092 learned_addr learned my addr 172.21.15.99:0/721035092 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:26.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.879+0000 7fa0fc910640 1 --2- 172.21.15.99:0/721035092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557a3789da40 0x557a3789f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:26.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.879+0000 7fa0fd111640 1 --2- 172.21.15.99:0/721035092 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557a3789d050 0x557a3789ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:26.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.879+0000 7fa0fd912640 1 -- 172.21.15.99:0/721035092 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557a3789d050 msgr2=0x557a3789ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:26.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.879+0000 7fa0fd912640 1 --2- 172.21.15.99:0/721035092 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557a3789d050 0x557a3789ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.879+0000 7fa0fd912640 1 -- 172.21.15.99:0/721035092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557a3789da40 msgr2=0x557a3789f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:26.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.879+0000 7fa0fd912640 1 --2- 172.21.15.99:0/721035092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557a3789da40 0x557a3789f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.879+0000 7fa0fd912640 1 -- 172.21.15.99:0/721035092 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a3779fd50 con 0x557a378a2bb0 2024-01-31T05:11:26.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.880+0000 7fa0fd912640 1 --2- 172.21.15.99:0/721035092 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a378a2bb0 0x557a378ae5e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4009ca0 tx=0x7fa0f4041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7ffb15707ab9213 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:26.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.880+0000 7fa0e2ffd640 1 -- 172.21.15.99:0/721035092 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f4048040 con 0x557a378a2bb0 2024-01-31T05:11:26.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.880+0000 7fa0e2ffd640 1 -- 172.21.15.99:0/721035092 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa0f4032a30 con 0x557a378a2bb0 2024-01-31T05:11:26.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.880+0000 7fa0e2ffd640 1 -- 172.21.15.99:0/721035092 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f40042a0 con 0x557a378a2bb0 2024-01-31T05:11:26.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.880+0000 7fa102213740 1 -- 172.21.15.99:0/721035092 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a378a2bb0 msgr2=0x557a378ae5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:26.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.880+0000 7fa102213740 1 --2- 172.21.15.99:0/721035092 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a378a2bb0 0x557a378ae5e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4009ca0 tx=0x7fa0f4041000 comp rx=0 tx=0).stop 2024-01-31T05:11:26.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.881+0000 7fa102213740 1 -- 172.21.15.99:0/721035092 shutdown_connections 2024-01-31T05:11:26.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.881+0000 7fa102213740 1 --2- 172.21.15.99:0/721035092 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a378a2bb0 0x557a378ae5e0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.881+0000 7fa102213740 1 --2- 172.21.15.99:0/721035092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557a3789da40 0x557a3789f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.881+0000 7fa102213740 1 --2- 172.21.15.99:0/721035092 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557a3789d050 0x557a3789ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.881+0000 7fa102213740 1 -- 172.21.15.99:0/721035092 >> 172.21.15.99:0/721035092 conn(0x557a378985c0 msgr2=0x557a378ba040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:26.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.881+0000 7fa102213740 1 -- 172.21.15.99:0/721035092 shutdown_connections 2024-01-31T05:11:26.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.881+0000 7fa102213740 1 -- 172.21.15.99:0/721035092 wait complete. 2024-01-31T05:11:26.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.881+0000 7fa102213740 1 -- start start 2024-01-31T05:11:26.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.881+0000 7fa102213740 1 Processor -- start 2024-01-31T05:11:26.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.881+0000 7fa102213740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557a3789d050 0x557a378ad790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:26.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.881+0000 7fa102213740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557a3789da40 0x557a378adcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:26.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.881+0000 7fa102213740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a378a2bb0 0x557a379097f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:26.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.881+0000 7fa102213740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a37909d30 con 0x557a378a2bb0 2024-01-31T05:11:26.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.881+0000 7fa102213740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a37909e70 con 0x557a3789da40 2024-01-31T05:11:26.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.881+0000 7fa102213740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a3790a030 con 0x557a3789d050 2024-01-31T05:11:26.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.881+0000 7fa102213740 10 client.0 _ll_register_callbacks cb 0x7fa0f000c370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:11:26.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.881+0000 7fa0fd912640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a378a2bb0 0x557a379097f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:26.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.881+0000 7fa0fd912640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a378a2bb0 0x557a379097f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38046/0 (socket says 172.21.15.99:38046) 2024-01-31T05:11:26.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.881+0000 7fa0fd912640 1 -- 172.21.15.99:0/2537716304 learned_addr learned my addr 172.21.15.99:0/2537716304 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:26.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.881+0000 7fa0fd111640 1 --2- 172.21.15.99:0/2537716304 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557a3789d050 0x557a378ad790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:26.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.882+0000 7fa0fc910640 1 --2- 172.21.15.99:0/2537716304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557a3789da40 0x557a378adcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:26.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.882+0000 7fa0fd912640 1 -- 172.21.15.99:0/2537716304 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557a3789d050 msgr2=0x557a378ad790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:26.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.882+0000 7fa0fd912640 1 --2- 172.21.15.99:0/2537716304 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557a3789d050 0x557a378ad790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.882+0000 7fa0fd912640 1 -- 172.21.15.99:0/2537716304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557a3789da40 msgr2=0x557a378adcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:26.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.882+0000 7fa0fd912640 1 --2- 172.21.15.99:0/2537716304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557a3789da40 0x557a378adcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.882+0000 7fa0fd912640 1 -- 172.21.15.99:0/2537716304 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0f4030070 con 0x557a378a2bb0 2024-01-31T05:11:26.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.882+0000 7fa0fd912640 1 --2- 172.21.15.99:0/2537716304 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a378a2bb0 0x557a379097f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4034ca0 tx=0x7fa0f4034cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2df5410b492e6244 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:26.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.882+0000 7fa0e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:11:26.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.882+0000 7fa0e0ff9640 1 -- 172.21.15.99:0/2537716304 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f4048030 con 0x557a378a2bb0 2024-01-31T05:11:26.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.882+0000 7fa0e0ff9640 1 -- 172.21.15.99:0/2537716304 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fa0f4004d40 con 0x557a378a2bb0 2024-01-31T05:11:26.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.882+0000 7fa102213740 1 -- 172.21.15.99:0/2537716304 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa0f0004c60 con 0x557a378a2bb0 2024-01-31T05:11:26.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.882+0000 7fa0e0ff9640 1 -- 172.21.15.99:0/2537716304 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa0f4004040 con 0x557a378a2bb0 2024-01-31T05:11:26.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.882+0000 7fa102213740 10 client.15459 fetch_fsmap learned FSMap version 27 2024-01-31T05:11:26.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.882+0000 7fa102213740 1 -- 172.21.15.99:0/2537716304 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x557a377c5960 con 0x557a378a2bb0 2024-01-31T05:11:26.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.882+0000 7fa0e0ff9640 1 -- 172.21.15.99:0/2537716304 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa0f0004c60 con 0x557a378a2bb0 2024-01-31T05:11:26.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.882+0000 7fa0e0ff9640 1 -- 172.21.15.99:0/2537716304 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa0f4043950 con 0x557a378a2bb0 2024-01-31T05:11:26.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.882+0000 7fa102213740 10 client.15459 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:11:26.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.882+0000 7fa102213740 10 client.15459 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-01-31T05:11:26.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.882+0000 7fa102213740 20 client.15459 populate_metadata read hostname 'smithi099' 2024-01-31T05:11:26.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.883+0000 7fa102213740 1 --2- 172.21.15.99:0/2537716304 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x557a3790b830 0x557a3790dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:26.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.883+0000 7fa102213740 4 client.15459 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-01-31T05:11:26.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.883+0000 7fa102213740 1 -- 172.21.15.99:0/2537716304 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x557a37504860 con 0x557a3790b830 2024-01-31T05:11:26.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.883+0000 7fa0fd111640 1 --2- 172.21.15.99:0/2537716304 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x557a3790b830 0x557a3790dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:26.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.883+0000 7fa0e0ff9640 10 client.15459 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:11:26.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.883+0000 7fa0fd111640 1 --2- 172.21.15.99:0/2537716304 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x557a3790b830 0x557a3790dc50 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59e0cbe483524057 server_cookie=bf3eb2a85d8eaf91 in_seq=0 out_seq=0 2024-01-31T05:11:26.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.884+0000 7fa0e0ff9640 1 -- 172.21.15.99:0/2537716304 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x557a37504860 con 0x557a3790b830 2024-01-31T05:11:26.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.884+0000 7fa0e0ff9640 10 client.15459 handle_command_reply: tid=0 2024-01-31T05:11:26.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.884+0000 7fa102213740 1 client.15459 shutdown 2024-01-31T05:11:26.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.884+0000 7fa102213740 1 -- 172.21.15.99:0/2537716304 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a378a2bb0 msgr2=0x557a379097f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:26.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.884+0000 7fa102213740 1 --2- 172.21.15.99:0/2537716304 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a378a2bb0 0x557a379097f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4034ca0 tx=0x7fa0f4034cd0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.884+0000 7fa102213740 1 -- 172.21.15.99:0/2537716304 shutdown_connections 2024-01-31T05:11:26.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.884+0000 7fa102213740 1 --2- 172.21.15.99:0/2537716304 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a378a2bb0 0x557a379097f0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.884+0000 7fa102213740 1 --2- 172.21.15.99:0/2537716304 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x557a3790b830 0x557a3790dc50 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.884+0000 7fa102213740 1 --2- 172.21.15.99:0/2537716304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557a3789da40 0x557a378adcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.884+0000 7fa0e0ff9640 0 client.15459 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:11:26.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.884+0000 7fa102213740 1 --2- 172.21.15.99:0/2537716304 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557a3789d050 0x557a378ad790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.884+0000 7fa102213740 1 -- 172.21.15.99:0/2537716304 >> 172.21.15.99:0/2537716304 conn(0x557a378985c0 msgr2=0x557a3789ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:26.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.885+0000 7fa102213740 1 -- 172.21.15.99:0/2537716304 shutdown_connections 2024-01-31T05:11:26.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.885+0000 7fa102213740 1 -- 172.21.15.99:0/2537716304 wait complete. 2024-01-31T05:11:26.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.885+0000 7fa102213740 20 client.15459 trim_cache size 0 max 16384 2024-01-31T05:11:26.890 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-01-31T05:11:26.890 INFO:teuthology.orchestra.run.smithi099.stdout: "return_code": 0, 2024-01-31T05:11:26.890 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_tag": "473c38bc-aba4-487e-849a-3dd930c34b52", 2024-01-31T05:11:26.890 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": "asynchronous" 2024-01-31T05:11:26.890 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-01-31T05:11:26.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.885+0000 7fa0ff375640 1 -- 172.21.15.99:0/4184906722 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa0e40a13f0 msgr2=0x7fa0e40a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:26.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.885+0000 7fa0ff375640 1 --2- 172.21.15.99:0/4184906722 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa0e40a13f0 0x7fa0e40a38b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4033000 tx=0x7fa0f40095c0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.885+0000 7fa0ff375640 1 -- 172.21.15.99:0/4184906722 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa0f8100de0 msgr2=0x7fa0f81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:26.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.885+0000 7fa0ff375640 1 --2- 172.21.15.99:0/4184906722 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa0f8100de0 0x7fa0f81021c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa0e800c8c0 tx=0x7fa0e800cd80 comp rx=0 tx=0).stop 2024-01-31T05:11:26.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.885+0000 7fa0ff375640 1 -- 172.21.15.99:0/4184906722 shutdown_connections 2024-01-31T05:11:26.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.885+0000 7fa0ff375640 1 --2- 172.21.15.99:0/4184906722 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa0e40a13f0 0x7fa0e40a38b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.885+0000 7fa0ff375640 1 --2- 172.21.15.99:0/4184906722 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0f81017a0 0x7fa0f8102700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.885+0000 7fa0ff375640 1 --2- 172.21.15.99:0/4184906722 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa0f8100de0 0x7fa0f81021c0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.885+0000 7fa0ff375640 1 --2- 172.21.15.99:0/4184906722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa0f80ffbf0 0x7fa0f8103b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:26.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.885+0000 7fa0ff375640 1 -- 172.21.15.99:0/4184906722 >> 172.21.15.99:0/4184906722 conn(0x7fa0f80fb180 msgr2=0x7fa0f80fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:26.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.885+0000 7fa0ff375640 1 -- 172.21.15.99:0/4184906722 shutdown_connections 2024-01-31T05:11:26.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:26.885+0000 7fa0ff375640 1 -- 172.21.15.99:0/4184906722 wait complete. 2024-01-31T05:11:26.893 INFO:tasks.workunit.client.0.smithi099.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-01-31T05:11:26.896 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-01-31T05:11:27.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.044+0000 7f6831478640 1 -- 172.21.15.99:0/2580987677 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f682c0ffbf0 msgr2=0x7f682c100010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:27.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.044+0000 7f6831478640 1 --2- 172.21.15.99:0/2580987677 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f682c0ffbf0 0x7f682c100010 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f681c009900 tx=0x7f681c02bc30 comp rx=0 tx=0).stop 2024-01-31T05:11:27.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.044+0000 7f6831478640 1 -- 172.21.15.99:0/2580987677 shutdown_connections 2024-01-31T05:11:27.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.044+0000 7f6831478640 1 --2- 172.21.15.99:0/2580987677 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f682c1017a0 0x7f682c108030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:27.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.044+0000 7f6831478640 1 --2- 172.21.15.99:0/2580987677 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f682c100de0 0x7f682c101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:27.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.044+0000 7f6831478640 1 --2- 172.21.15.99:0/2580987677 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f682c0ffbf0 0x7f682c100010 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:27.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.044+0000 7f6831478640 1 -- 172.21.15.99:0/2580987677 >> 172.21.15.99:0/2580987677 conn(0x7f682c0fb180 msgr2=0x7f682c0fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:27.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.044+0000 7f6831478640 1 -- 172.21.15.99:0/2580987677 shutdown_connections 2024-01-31T05:11:27.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.044+0000 7f6831478640 1 -- 172.21.15.99:0/2580987677 wait complete. 2024-01-31T05:11:27.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.045+0000 7f6831478640 1 Processor -- start 2024-01-31T05:11:27.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.045+0000 7f6831478640 1 -- start start 2024-01-31T05:11:27.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.045+0000 7f6831478640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f682c0ffbf0 0x7f682c196d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:27.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.045+0000 7f6831478640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f682c100de0 0x7f682c197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:27.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.045+0000 7f6831478640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f682c1017a0 0x7f682c19e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:27.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.045+0000 7f6831478640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682c19e830 con 0x7f682c1017a0 2024-01-31T05:11:27.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.045+0000 7f6831478640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682c19e9a0 con 0x7f682c100de0 2024-01-31T05:11:27.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.045+0000 7f6831478640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682c19eb60 con 0x7f682c0ffbf0 2024-01-31T05:11:27.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.045+0000 7f682b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f682c1017a0 0x7f682c19e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:27.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.045+0000 7f682b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f682c1017a0 0x7f682c19e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38062/0 (socket says 172.21.15.99:38062) 2024-01-31T05:11:27.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.045+0000 7f682b7fe640 1 -- 172.21.15.99:0/1465702351 learned_addr learned my addr 172.21.15.99:0/1465702351 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:27.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.045+0000 7f682affd640 1 --2- 172.21.15.99:0/1465702351 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f682c0ffbf0 0x7f682c196d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:27.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.046+0000 7f682a7fc640 1 --2- 172.21.15.99:0/1465702351 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f682c100de0 0x7f682c197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:27.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.046+0000 7f682b7fe640 1 -- 172.21.15.99:0/1465702351 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f682c0ffbf0 msgr2=0x7f682c196d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:27.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.046+0000 7f682b7fe640 1 --2- 172.21.15.99:0/1465702351 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f682c0ffbf0 0x7f682c196d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:27.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.046+0000 7f682b7fe640 1 -- 172.21.15.99:0/1465702351 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f682c100de0 msgr2=0x7f682c197280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:27.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.046+0000 7f682b7fe640 1 --2- 172.21.15.99:0/1465702351 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f682c100de0 0x7f682c197280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:27.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.046+0000 7f682b7fe640 1 -- 172.21.15.99:0/1465702351 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f681c009560 con 0x7f682c1017a0 2024-01-31T05:11:27.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.046+0000 7f682a7fc640 1 --2- 172.21.15.99:0/1465702351 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f682c100de0 0x7f682c197280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:11:27.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.046+0000 7f682b7fe640 1 --2- 172.21.15.99:0/1465702351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f682c1017a0 0x7f682c19e2f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f682400eb10 tx=0x7f682400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:27.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.046+0000 7f6813fff640 1 -- 172.21.15.99:0/1465702351 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6824004b20 con 0x7f682c1017a0 2024-01-31T05:11:27.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.046+0000 7f6813fff640 1 -- 172.21.15.99:0/1465702351 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6824004c80 con 0x7f682c1017a0 2024-01-31T05:11:27.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.046+0000 7f6831478640 1 -- 172.21.15.99:0/1465702351 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f682c19ee40 con 0x7f682c1017a0 2024-01-31T05:11:27.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.046+0000 7f6813fff640 1 -- 172.21.15.99:0/1465702351 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6824010690 con 0x7f682c1017a0 2024-01-31T05:11:27.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.046+0000 7f6831478640 1 -- 172.21.15.99:0/1465702351 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f682c19f2c0 con 0x7f682c1017a0 2024-01-31T05:11:27.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.048+0000 7f6813fff640 1 -- 172.21.15.99:0/1465702351 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f6824005020 con 0x7f682c1017a0 2024-01-31T05:11:27.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.049+0000 7f6813fff640 1 --2- 172.21.15.99:0/1465702351 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f68140a1370 0x7f68140a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:27.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.049+0000 7f683423e740 1 Processor -- start 2024-01-31T05:11:27.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.049+0000 7f682affd640 1 --2- 172.21.15.99:0/1465702351 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f68140a1370 0x7f68140a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:27.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.049+0000 7f683423e740 1 -- start start 2024-01-31T05:11:27.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.049+0000 7f6813fff640 1 -- 172.21.15.99:0/1465702351 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f6824014070 con 0x7f682c1017a0 2024-01-31T05:11:27.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.049+0000 7f683423e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ac826fa20 0x559ac826fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:27.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.049+0000 7f683423e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559ac8270410 0x559ac8274f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:27.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.049+0000 7f683423e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ac8275580 0x559ac8277a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:27.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.049+0000 7f683423e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ac81de380 con 0x559ac826fa20 2024-01-31T05:11:27.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.049+0000 7f683423e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ac81dba70 con 0x559ac8270410 2024-01-31T05:11:27.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.049+0000 7f683423e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ac81d7360 con 0x559ac8275580 2024-01-31T05:11:27.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.049+0000 7f682affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ac826fa20 0x559ac826fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:27.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.049+0000 7f682affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ac826fa20 0x559ac826fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38070/0 (socket says 172.21.15.99:38070) 2024-01-31T05:11:27.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.049+0000 7f682affd640 1 -- 172.21.15.99:0/446502389 learned_addr learned my addr 172.21.15.99:0/446502389 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:27.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.049+0000 7f682a7fc640 1 --2- 172.21.15.99:0/446502389 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559ac8270410 0x559ac8274f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:27.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.049+0000 7f682affd640 1 --2- 172.21.15.99:0/1465702351 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f68140a1370 0x7f68140a3830 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f681c000c00 tx=0x7f681c02c880 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:27.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.049+0000 7f682affd640 1 -- 172.21.15.99:0/446502389 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ac8275580 msgr2=0x559ac8277a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:27.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.049+0000 7f682affd640 1 --2- 172.21.15.99:0/446502389 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ac8275580 0x559ac8277a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:27.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.049+0000 7f682affd640 1 -- 172.21.15.99:0/446502389 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559ac8270410 msgr2=0x559ac8274f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:27.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.049+0000 7f682affd640 1 --2- 172.21.15.99:0/446502389 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559ac8270410 0x559ac8274f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:27.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.049+0000 7f682affd640 1 -- 172.21.15.99:0/446502389 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ac81997e0 con 0x559ac826fa20 2024-01-31T05:11:27.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.050+0000 7f682affd640 1 --2- 172.21.15.99:0/446502389 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ac826fa20 0x559ac826fe40 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f681c02c6b0 tx=0x7f681c047000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d090793137ca8196 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:27.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.050+0000 7f68117fa640 1 -- 172.21.15.99:0/446502389 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681c004040 con 0x559ac826fa20 2024-01-31T05:11:27.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.050+0000 7f68117fa640 1 -- 172.21.15.99:0/446502389 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f681c005000 con 0x559ac826fa20 2024-01-31T05:11:27.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.050+0000 7f68117fa640 1 -- 172.21.15.99:0/446502389 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681c003ab0 con 0x559ac826fa20 2024-01-31T05:11:27.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.050+0000 7f683423e740 1 -- 172.21.15.99:0/446502389 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ac826fa20 msgr2=0x559ac826fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:27.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.050+0000 7f683423e740 1 --2- 172.21.15.99:0/446502389 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ac826fa20 0x559ac826fe40 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f681c02c6b0 tx=0x7f681c047000 comp rx=0 tx=0).stop 2024-01-31T05:11:27.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.050+0000 7f683423e740 1 -- 172.21.15.99:0/446502389 shutdown_connections 2024-01-31T05:11:27.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.050+0000 7f683423e740 1 --2- 172.21.15.99:0/446502389 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ac8275580 0x559ac8277a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:27.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.050+0000 7f683423e740 1 --2- 172.21.15.99:0/446502389 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559ac8270410 0x559ac8274f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:27.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.050+0000 7f683423e740 1 --2- 172.21.15.99:0/446502389 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ac826fa20 0x559ac826fe40 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:27.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.050+0000 7f683423e740 1 -- 172.21.15.99:0/446502389 >> 172.21.15.99:0/446502389 conn(0x559ac826af90 msgr2=0x559ac826b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:27.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.050+0000 7f683423e740 1 -- 172.21.15.99:0/446502389 shutdown_connections 2024-01-31T05:11:27.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.051+0000 7f683423e740 1 -- 172.21.15.99:0/446502389 wait complete. 2024-01-31T05:11:27.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.051+0000 7f683423e740 1 -- start start 2024-01-31T05:11:27.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.051+0000 7f683423e740 1 Processor -- start 2024-01-31T05:11:27.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.051+0000 7f683423e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559ac826fa20 0x559ac8279ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:27.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.051+0000 7f683423e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ac8270410 0x559ac827a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:27.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.051+0000 7f683423e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ac8275580 0x559ac8281120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:27.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.051+0000 7f683423e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ac8190750 con 0x559ac8270410 2024-01-31T05:11:27.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.051+0000 7f683423e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ac81903f0 con 0x559ac826fa20 2024-01-31T05:11:27.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.051+0000 7f683423e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ac81553f0 con 0x559ac8275580 2024-01-31T05:11:27.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.051+0000 7f683423e740 10 client.0 _ll_register_callbacks cb 0x559ac8192b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:11:27.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.051+0000 7f682a7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ac8270410 0x559ac827a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:27.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.051+0000 7f682a7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ac8270410 0x559ac827a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38080/0 (socket says 172.21.15.99:38080) 2024-01-31T05:11:27.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.051+0000 7f682a7fc640 1 -- 172.21.15.99:0/3748629715 learned_addr learned my addr 172.21.15.99:0/3748629715 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:27.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.051+0000 7f682affd640 1 --2- 172.21.15.99:0/3748629715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559ac826fa20 0x559ac8279ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:27.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.051+0000 7f682a7fc640 1 -- 172.21.15.99:0/3748629715 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ac8275580 msgr2=0x559ac8281120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:27.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.051+0000 7f682a7fc640 1 --2- 172.21.15.99:0/3748629715 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ac8275580 0x559ac8281120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:27.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.051+0000 7f682a7fc640 1 -- 172.21.15.99:0/3748629715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559ac826fa20 msgr2=0x559ac8279ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:27.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.051+0000 7f682a7fc640 1 --2- 172.21.15.99:0/3748629715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559ac826fa20 0x559ac8279ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:27.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.051+0000 7f682a7fc640 1 -- 172.21.15.99:0/3748629715 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f682c108930 con 0x559ac8270410 2024-01-31T05:11:27.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.052+0000 7f682a7fc640 1 --2- 172.21.15.99:0/3748629715 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ac8270410 0x559ac827a0e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f68200126a0 tx=0x7f6820012b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fedbe62f325eafca server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:27.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.052+0000 7f680eff5640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:11:27.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.052+0000 7f680eff5640 1 -- 172.21.15.99:0/3748629715 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6820004460 con 0x559ac8270410 2024-01-31T05:11:27.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.052+0000 7f680eff5640 1 -- 172.21.15.99:0/3748629715 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f68200108f0 con 0x559ac8270410 2024-01-31T05:11:27.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.052+0000 7f683423e740 1 -- 172.21.15.99:0/3748629715 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559ac81ac210 con 0x559ac8270410 2024-01-31T05:11:27.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.052+0000 7f680eff5640 1 -- 172.21.15.99:0/3748629715 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6820010ab0 con 0x559ac8270410 2024-01-31T05:11:27.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.052+0000 7f683423e740 10 client.15471 fetch_fsmap learned FSMap version 27 2024-01-31T05:11:27.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.052+0000 7f683423e740 1 -- 172.21.15.99:0/3748629715 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x559ac81d59e0 con 0x559ac8270410 2024-01-31T05:11:27.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.052+0000 7f680eff5640 1 -- 172.21.15.99:0/3748629715 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559ac81ac210 con 0x559ac8270410 2024-01-31T05:11:27.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.052+0000 7f680eff5640 1 -- 172.21.15.99:0/3748629715 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f682001b440 con 0x559ac8270410 2024-01-31T05:11:27.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.052+0000 7f683423e740 10 client.15471 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:11:27.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.052+0000 7f683423e740 10 client.15471 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-01-31T05:11:27.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.052+0000 7f683423e740 20 client.15471 populate_metadata read hostname 'smithi099' 2024-01-31T05:11:27.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.052+0000 7f683423e740 1 --2- 172.21.15.99:0/3748629715 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x559ac8285f90 0x559ac82883b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:27.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.052+0000 7f683423e740 4 client.15471 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:11:27.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.052+0000 7f683423e740 1 -- 172.21.15.99:0/3748629715 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559ac81a9b20 con 0x559ac8285f90 2024-01-31T05:11:27.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.053+0000 7f682affd640 1 --2- 172.21.15.99:0/3748629715 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x559ac8285f90 0x559ac82883b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:27.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.053+0000 7f682affd640 1 --2- 172.21.15.99:0/3748629715 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x559ac8285f90 0x559ac82883b0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f18a9db9c0f1c55 server_cookie=5a782230a03a5890 in_seq=0 out_seq=0 2024-01-31T05:11:27.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.053+0000 7f680eff5640 10 client.15471 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:11:27.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.054+0000 7f680eff5640 1 -- 172.21.15.99:0/3748629715 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559ac81a9b20 con 0x559ac8285f90 2024-01-31T05:11:27.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.054+0000 7f680eff5640 10 client.15471 handle_command_reply: tid=0 2024-01-31T05:11:27.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.054+0000 7f683423e740 1 client.15471 shutdown 2024-01-31T05:11:27.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.054+0000 7f683423e740 1 -- 172.21.15.99:0/3748629715 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ac8270410 msgr2=0x559ac827a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:27.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.054+0000 7f683423e740 1 --2- 172.21.15.99:0/3748629715 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ac8270410 0x559ac827a0e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f68200126a0 tx=0x7f6820012b60 comp rx=0 tx=0).stop 2024-01-31T05:11:27.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.054+0000 7f683423e740 1 -- 172.21.15.99:0/3748629715 shutdown_connections 2024-01-31T05:11:27.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.054+0000 7f683423e740 1 --2- 172.21.15.99:0/3748629715 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ac8275580 0x559ac8281120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:27.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.054+0000 7f683423e740 1 --2- 172.21.15.99:0/3748629715 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ac8270410 0x559ac827a0e0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:27.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.054+0000 7f683423e740 1 --2- 172.21.15.99:0/3748629715 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x559ac8285f90 0x559ac82883b0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:27.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.054+0000 7f683423e740 1 --2- 172.21.15.99:0/3748629715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559ac826fa20 0x559ac8279ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:27.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.054+0000 7f680eff5640 0 client.15471 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:11:27.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.054+0000 7f683423e740 1 -- 172.21.15.99:0/3748629715 >> 172.21.15.99:0/3748629715 conn(0x559ac826af90 msgr2=0x559ac826a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:27.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.054+0000 7f683423e740 1 -- 172.21.15.99:0/3748629715 shutdown_connections 2024-01-31T05:11:27.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.054+0000 7f683423e740 1 -- 172.21.15.99:0/3748629715 wait complete. 2024-01-31T05:11:27.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.054+0000 7f683423e740 20 client.15471 trim_cache size 0 max 16384 2024-01-31T05:11:27.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.069+0000 7f683423e740 1 Processor -- start 2024-01-31T05:11:27.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.069+0000 7f683423e740 1 -- start start 2024-01-31T05:11:27.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.069+0000 7f683423e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ac826fa20 0x559ac8271960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:27.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.069+0000 7f683423e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ac8270410 0x559ac8271ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:27.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.069+0000 7f683423e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559ac8275580 0x559ac82810e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:27.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.069+0000 7f683423e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ac81a9b20 con 0x559ac8270410 2024-01-31T05:11:27.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.069+0000 7f683423e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ac81ac210 con 0x559ac8275580 2024-01-31T05:11:27.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.069+0000 7f683423e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ac82707f0 con 0x559ac826fa20 2024-01-31T05:11:27.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:26 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/1656795360' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-31T05:11:27.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:26 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/170222300' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-31T05:11:27.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:26 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/1236883051' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:11:27.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:26 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/1801312955' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:11:27.074 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:26 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/1656795360' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-31T05:11:27.074 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:26 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/170222300' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-31T05:11:27.074 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:26 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/1236883051' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:11:27.074 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:26 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/1801312955' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:11:27.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.069+0000 7f682a7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ac8270410 0x559ac8271ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:27.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.069+0000 7f682a7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ac8270410 0x559ac8271ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38084/0 (socket says 172.21.15.99:38084) 2024-01-31T05:11:27.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.069+0000 7f682a7fc640 1 -- 172.21.15.99:0/3371612246 learned_addr learned my addr 172.21.15.99:0/3371612246 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:27.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.069+0000 7f682b7fe640 1 --2- 172.21.15.99:0/3371612246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559ac8275580 0x559ac82810e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:27.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.069+0000 7f682affd640 1 --2- 172.21.15.99:0/3371612246 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ac826fa20 0x559ac8271960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:27.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.069+0000 7f682a7fc640 1 -- 172.21.15.99:0/3371612246 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ac826fa20 msgr2=0x559ac8271960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:27.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.069+0000 7f682a7fc640 1 --2- 172.21.15.99:0/3371612246 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ac826fa20 0x559ac8271960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:27.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.069+0000 7f682a7fc640 1 -- 172.21.15.99:0/3371612246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559ac8275580 msgr2=0x559ac82810e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:27.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.069+0000 7f682a7fc640 1 --2- 172.21.15.99:0/3371612246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559ac8275580 0x559ac82810e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:27.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.069+0000 7f682a7fc640 1 -- 172.21.15.99:0/3371612246 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ac81724f0 con 0x559ac8270410 2024-01-31T05:11:27.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.069+0000 7f682a7fc640 1 --2- 172.21.15.99:0/3371612246 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ac8270410 0x559ac8271ea0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f6820009c10 tx=0x7f68200096d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e0bbaefd01164b server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:27.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.070+0000 7f6810ff9640 1 -- 172.21.15.99:0/3371612246 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682001bc70 con 0x559ac8270410 2024-01-31T05:11:27.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.070+0000 7f6810ff9640 1 -- 172.21.15.99:0/3371612246 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f68200054f0 con 0x559ac8270410 2024-01-31T05:11:27.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.070+0000 7f6810ff9640 1 -- 172.21.15.99:0/3371612246 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68200035f0 con 0x559ac8270410 2024-01-31T05:11:27.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.070+0000 7f683423e740 1 -- 172.21.15.99:0/3371612246 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ac8270410 msgr2=0x559ac8271ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:27.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.070+0000 7f683423e740 1 --2- 172.21.15.99:0/3371612246 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ac8270410 0x559ac8271ea0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f6820009c10 tx=0x7f68200096d0 comp rx=0 tx=0).stop 2024-01-31T05:11:27.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.070+0000 7f683423e740 1 -- 172.21.15.99:0/3371612246 shutdown_connections 2024-01-31T05:11:27.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.070+0000 7f683423e740 1 --2- 172.21.15.99:0/3371612246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559ac8275580 0x559ac82810e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:27.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.070+0000 7f683423e740 1 --2- 172.21.15.99:0/3371612246 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ac8270410 0x559ac8271ea0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:27.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.070+0000 7f683423e740 1 --2- 172.21.15.99:0/3371612246 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ac826fa20 0x559ac8271960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:27.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.070+0000 7f683423e740 1 -- 172.21.15.99:0/3371612246 >> 172.21.15.99:0/3371612246 conn(0x559ac826af90 msgr2=0x559ac828cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:27.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.070+0000 7f683423e740 1 -- 172.21.15.99:0/3371612246 shutdown_connections 2024-01-31T05:11:27.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.070+0000 7f683423e740 1 -- 172.21.15.99:0/3371612246 wait complete. 2024-01-31T05:11:27.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.071+0000 7f683423e740 1 -- start start 2024-01-31T05:11:27.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.071+0000 7f683423e740 1 Processor -- start 2024-01-31T05:11:27.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.071+0000 7f683423e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559ac826fa20 0x559ac82811b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:27.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.071+0000 7f683423e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ac8270410 0x559ac827dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:27.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.071+0000 7f683423e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ac8275580 0x559ac827e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:27.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.071+0000 7f683423e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ac82e08b0 con 0x559ac8275580 2024-01-31T05:11:27.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.071+0000 7f683423e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ac82e09f0 con 0x559ac826fa20 2024-01-31T05:11:27.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.071+0000 7f683423e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ac82e0b30 con 0x559ac8270410 2024-01-31T05:11:27.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.071+0000 7f683423e740 10 client.0 _ll_register_callbacks cb 0x7f6820009550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:11:27.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.071+0000 7f682b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ac8275580 0x559ac827e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:27.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.071+0000 7f682b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ac8275580 0x559ac827e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38096/0 (socket says 172.21.15.99:38096) 2024-01-31T05:11:27.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.071+0000 7f682b7fe640 1 -- 172.21.15.99:0/2933171632 learned_addr learned my addr 172.21.15.99:0/2933171632 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:27.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.071+0000 7f682a7fc640 1 --2- 172.21.15.99:0/2933171632 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ac8270410 0x559ac827dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:27.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.071+0000 7f682affd640 1 --2- 172.21.15.99:0/2933171632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559ac826fa20 0x559ac82811b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:27.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.071+0000 7f682b7fe640 1 -- 172.21.15.99:0/2933171632 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ac8270410 msgr2=0x559ac827dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:27.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.071+0000 7f682b7fe640 1 --2- 172.21.15.99:0/2933171632 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ac8270410 0x559ac827dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:27.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.071+0000 7f682b7fe640 1 -- 172.21.15.99:0/2933171632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559ac826fa20 msgr2=0x559ac82811b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:27.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.071+0000 7f682b7fe640 1 --2- 172.21.15.99:0/2933171632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559ac826fa20 0x559ac82811b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:27.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.071+0000 7f682b7fe640 1 -- 172.21.15.99:0/2933171632 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559ac81d59e0 con 0x559ac8275580 2024-01-31T05:11:27.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.071+0000 7f682a7fc640 1 --2- 172.21.15.99:0/2933171632 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ac8270410 0x559ac827dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:11:27.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.072+0000 7f682b7fe640 1 --2- 172.21.15.99:0/2933171632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ac8275580 0x559ac827e260 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f682409a210 tx=0x7f6824099cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75ed0f3a6553179e server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:27.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.072+0000 7f680eff5640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:11:27.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.072+0000 7f680eff5640 1 -- 172.21.15.99:0/2933171632 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68240caea0 con 0x559ac8275580 2024-01-31T05:11:27.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.072+0000 7f680eff5640 1 -- 172.21.15.99:0/2933171632 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f6824004df0 con 0x559ac8275580 2024-01-31T05:11:27.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.072+0000 7f683423e740 1 -- 172.21.15.99:0/2933171632 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559ac81febd0 con 0x559ac8275580 2024-01-31T05:11:27.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.072+0000 7f680eff5640 1 -- 172.21.15.99:0/2933171632 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f682409a980 con 0x559ac8275580 2024-01-31T05:11:27.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.072+0000 7f683423e740 10 client.15477 fetch_fsmap learned FSMap version 27 2024-01-31T05:11:27.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.072+0000 7f683423e740 1 -- 172.21.15.99:0/2933171632 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x559ac8198040 con 0x559ac8275580 2024-01-31T05:11:27.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.072+0000 7f680eff5640 1 -- 172.21.15.99:0/2933171632 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f68240b8030 con 0x559ac8275580 2024-01-31T05:11:27.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.072+0000 7f680eff5640 1 -- 172.21.15.99:0/2933171632 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f682401f060 con 0x559ac8275580 2024-01-31T05:11:27.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.072+0000 7f683423e740 10 client.15477 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:11:27.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.072+0000 7f683423e740 10 client.15477 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-01-31T05:11:27.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.072+0000 7f683423e740 20 client.15477 populate_metadata read hostname 'smithi099' 2024-01-31T05:11:27.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.072+0000 7f683423e740 1 --2- 172.21.15.99:0/2933171632 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x559ac82e2510 0x559ac82e4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:27.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.072+0000 7f683423e740 4 client.15477 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-01-31T05:11:27.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.072+0000 7f683423e740 1 -- 172.21.15.99:0/2933171632 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559ac81d01f0 con 0x559ac82e2510 2024-01-31T05:11:27.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.072+0000 7f682affd640 1 --2- 172.21.15.99:0/2933171632 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x559ac82e2510 0x559ac82e4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:27.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.073+0000 7f682affd640 1 --2- 172.21.15.99:0/2933171632 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x559ac82e2510 0x559ac82e4930 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eaddd3aae773737b server_cookie=9969c8bd7a4f682f in_seq=0 out_seq=0 2024-01-31T05:11:27.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.073+0000 7f680eff5640 10 client.15477 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:11:27.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.073+0000 7f680eff5640 1 -- 172.21.15.99:0/2933171632 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x559ac81d01f0 con 0x559ac82e2510 2024-01-31T05:11:27.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.073+0000 7f680eff5640 10 client.15477 handle_command_reply: tid=0 2024-01-31T05:11:27.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.073+0000 7f683423e740 1 client.15477 shutdown 2024-01-31T05:11:27.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.073+0000 7f683423e740 1 -- 172.21.15.99:0/2933171632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ac8275580 msgr2=0x559ac827e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:27.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.073+0000 7f683423e740 1 --2- 172.21.15.99:0/2933171632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ac8275580 0x559ac827e260 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f682409a210 tx=0x7f6824099cd0 comp rx=0 tx=0).stop 2024-01-31T05:11:27.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.073+0000 7f683423e740 1 -- 172.21.15.99:0/2933171632 shutdown_connections 2024-01-31T05:11:27.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.073+0000 7f683423e740 1 --2- 172.21.15.99:0/2933171632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ac8275580 0x559ac827e260 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:27.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.073+0000 7f683423e740 1 --2- 172.21.15.99:0/2933171632 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ac8270410 0x559ac827dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:27.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.073+0000 7f683423e740 1 --2- 172.21.15.99:0/2933171632 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x559ac82e2510 0x559ac82e4930 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:27.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.073+0000 7f683423e740 1 --2- 172.21.15.99:0/2933171632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559ac826fa20 0x559ac82811b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:27.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.073+0000 7f680eff5640 0 client.15477 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:11:27.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.073+0000 7f683423e740 1 -- 172.21.15.99:0/2933171632 >> 172.21.15.99:0/2933171632 conn(0x559ac826af90 msgr2=0x559ac8271960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:27.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.073+0000 7f683423e740 1 -- 172.21.15.99:0/2933171632 shutdown_connections 2024-01-31T05:11:27.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.073+0000 7f683423e740 1 -- 172.21.15.99:0/2933171632 wait complete. 2024-01-31T05:11:27.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.073+0000 7f683423e740 20 client.15477 trim_cache size 0 max 16384 2024-01-31T05:11:27.082 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-01-31T05:11:27.082 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "IDLE (waiting for more scrubs)", 2024-01-31T05:11:27.082 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": { 2024-01-31T05:11:27.082 INFO:teuthology.orchestra.run.smithi099.stdout: "473c38bc-aba4-487e-849a-3dd930c34b52": { 2024-01-31T05:11:27.082 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-01-31T05:11:27.082 INFO:teuthology.orchestra.run.smithi099.stdout: "tag": "473c38bc-aba4-487e-849a-3dd930c34b52", 2024-01-31T05:11:27.082 INFO:teuthology.orchestra.run.smithi099.stdout: "options": "recursive,force" 2024-01-31T05:11:27.083 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:11:27.083 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:11:27.083 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-01-31T05:11:27.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.074+0000 7f6831478640 1 -- 172.21.15.99:0/1465702351 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f68140a1370 msgr2=0x7f68140a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:27.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.074+0000 7f6831478640 1 --2- 172.21.15.99:0/1465702351 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f68140a1370 0x7f68140a3830 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f681c000c00 tx=0x7f681c02c880 comp rx=0 tx=0).stop 2024-01-31T05:11:27.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.074+0000 7f6831478640 1 -- 172.21.15.99:0/1465702351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f682c1017a0 msgr2=0x7f682c19e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:27.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.074+0000 7f6831478640 1 --2- 172.21.15.99:0/1465702351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f682c1017a0 0x7f682c19e2f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f682400eb10 tx=0x7f682400c2d0 comp rx=0 tx=0).stop 2024-01-31T05:11:27.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.074+0000 7f6831478640 1 -- 172.21.15.99:0/1465702351 shutdown_connections 2024-01-31T05:11:27.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.074+0000 7f6831478640 1 --2- 172.21.15.99:0/1465702351 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f68140a1370 0x7f68140a3830 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:27.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.074+0000 7f6831478640 1 --2- 172.21.15.99:0/1465702351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f682c1017a0 0x7f682c19e2f0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:27.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.074+0000 7f6831478640 1 --2- 172.21.15.99:0/1465702351 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f682c100de0 0x7f682c197280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:27.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.074+0000 7f6831478640 1 --2- 172.21.15.99:0/1465702351 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f682c0ffbf0 0x7f682c196d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:27.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.074+0000 7f6831478640 1 -- 172.21.15.99:0/1465702351 >> 172.21.15.99:0/1465702351 conn(0x7f682c0fb180 msgr2=0x7f682c067ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:27.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.074+0000 7f6831478640 1 -- 172.21.15.99:0/1465702351 shutdown_connections 2024-01-31T05:11:27.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:27.074+0000 7f6831478640 1 -- 172.21.15.99:0/1465702351 wait complete. 2024-01-31T05:11:27.085 INFO:tasks.cephfs.filesystem:scrub status for tag:473c38bc-aba4-487e-849a-3dd930c34b52 - {'path': '/', 'tag': '473c38bc-aba4-487e-849a-3dd930c34b52', 'options': 'recursive,force'} 2024-01-31T05:11:27.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:26 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/1656795360' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-31T05:11:27.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:26 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/170222300' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-31T05:11:27.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:26 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/1236883051' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:11:27.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:26 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/1801312955' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:11:28.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:27 smithi099 ceph-mon[31615]: pgmap v351: 97 pgs: 97 active+clean; 648 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-01-31T05:11:28.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:27 smithi099 ceph-mon[31615]: scrub queued for path: / 2024-01-31T05:11:28.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:27 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:11:28.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:27 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:11:28.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:27 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:11:28.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:27 smithi181 ceph-mon[36434]: pgmap v351: 97 pgs: 97 active+clean; 648 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-01-31T05:11:28.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:27 smithi181 ceph-mon[36434]: scrub queued for path: / 2024-01-31T05:11:28.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:27 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:11:28.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:27 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:11:28.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:27 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:11:28.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:27 smithi179 ceph-mon[35652]: pgmap v351: 97 pgs: 97 active+clean; 648 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-01-31T05:11:28.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:27 smithi179 ceph-mon[35652]: scrub queued for path: / 2024-01-31T05:11:28.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:27 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:11:28.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:27 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:11:28.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:27 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:11:30.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:29 smithi099 ceph-mon[31615]: pgmap v352: 97 pgs: 97 active+clean; 657 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-01-31T05:11:30.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:29 smithi181 ceph-mon[36434]: pgmap v352: 97 pgs: 97 active+clean; 657 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-01-31T05:11:30.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:29 smithi179 ceph-mon[35652]: pgmap v352: 97 pgs: 97 active+clean; 657 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-01-31T05:11:32.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:31 smithi099 ceph-mon[31615]: pgmap v353: 97 pgs: 97 active+clean; 657 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-01-31T05:11:32.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:31 smithi099 ceph-mon[31615]: scrub summary: idle 2024-01-31T05:11:32.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:31 smithi181 ceph-mon[36434]: pgmap v353: 97 pgs: 97 active+clean; 657 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-01-31T05:11:32.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:31 smithi181 ceph-mon[36434]: scrub summary: idle 2024-01-31T05:11:32.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:31 smithi179 ceph-mon[35652]: pgmap v353: 97 pgs: 97 active+clean; 657 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-01-31T05:11:32.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:31 smithi179 ceph-mon[35652]: scrub summary: idle 2024-01-31T05:11:33.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:33 smithi099 ceph-mon[31615]: pgmap v354: 97 pgs: 97 active+clean; 657 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.5 KiB/s wr, 13 op/s 2024-01-31T05:11:33.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:33 smithi181 ceph-mon[36434]: pgmap v354: 97 pgs: 97 active+clean; 657 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.5 KiB/s wr, 13 op/s 2024-01-31T05:11:33.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:33 smithi179 ceph-mon[35652]: pgmap v354: 97 pgs: 97 active+clean; 657 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.5 KiB/s wr, 13 op/s 2024-01-31T05:11:36.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:35 smithi099 ceph-mon[31615]: pgmap v355: 97 pgs: 97 active+clean; 657 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2024-01-31T05:11:36.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:35 smithi181 ceph-mon[36434]: pgmap v355: 97 pgs: 97 active+clean; 657 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2024-01-31T05:11:36.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:35 smithi179 ceph-mon[35652]: pgmap v355: 97 pgs: 97 active+clean; 657 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2024-01-31T05:11:38.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:37 smithi099 ceph-mon[31615]: pgmap v356: 97 pgs: 97 active+clean; 657 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-01-31T05:11:38.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:37 smithi181 ceph-mon[36434]: pgmap v356: 97 pgs: 97 active+clean; 657 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-01-31T05:11:38.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:37 smithi179 ceph-mon[35652]: pgmap v356: 97 pgs: 97 active+clean; 657 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-01-31T05:11:39.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:38 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:11:39.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:38 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:11:39.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:38 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:11:39.688 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:39 smithi179 ceph-mon[35652]: pgmap v357: 97 pgs: 97 active+clean; 657 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-01-31T05:11:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.879+0000 7fd7fc5a7640 1 -- 172.21.15.99:0/353502133 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd7f4109530 msgr2=0x7fd7f4109950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.879+0000 7fd7fc5a7640 1 --2- 172.21.15.99:0/353502133 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd7f4109530 0x7fd7f4109950 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0009900 tx=0x7fd7f002bc30 comp rx=0 tx=0).stop 2024-01-31T05:11:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.879+0000 7fd7fc5a7640 1 -- 172.21.15.99:0/353502133 shutdown_connections 2024-01-31T05:11:39.879 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.879+0000 7fd7fc5a7640 1 --2- 172.21.15.99:0/353502133 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7f410b0e0 0x7fd7f4111970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:39.879 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.879+0000 7fd7fc5a7640 1 --2- 172.21.15.99:0/353502133 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7f410a720 0x7fd7f410aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:39.879 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.879+0000 7fd7fc5a7640 1 --2- 172.21.15.99:0/353502133 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd7f4109530 0x7fd7f4109950 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:39.879 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.879+0000 7fd7fc5a7640 1 -- 172.21.15.99:0/353502133 >> 172.21.15.99:0/353502133 conn(0x7fd7f406fcd0 msgr2=0x7fd7f4072110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:39.879 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.879+0000 7fd7fc5a7640 1 -- 172.21.15.99:0/353502133 shutdown_connections 2024-01-31T05:11:39.879 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.879+0000 7fd7fc5a7640 1 -- 172.21.15.99:0/353502133 wait complete. 2024-01-31T05:11:39.881 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.880+0000 7fd7fc5a7640 1 Processor -- start 2024-01-31T05:11:39.881 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.880+0000 7fd7fc5a7640 1 -- start start 2024-01-31T05:11:39.882 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.880+0000 7fd7fc5a7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd7f4109530 0x7fd7f419f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:39.882 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.880+0000 7fd7fc5a7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7f410a720 0x7fd7f419f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:39.882 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.880+0000 7fd7fc5a7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7f410b0e0 0x7fd7f41a69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:39.882 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.880+0000 7fd7fc5a7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f41a6f20 con 0x7fd7f4109530 2024-01-31T05:11:39.882 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.880+0000 7fd7fc5a7640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f41a7090 con 0x7fd7f410a720 2024-01-31T05:11:39.882 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.880+0000 7fd7fc5a7640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f41a7250 con 0x7fd7f410b0e0 2024-01-31T05:11:39.882 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.880+0000 7fd7fa343640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd7f4109530 0x7fd7f419f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:39.882 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.880+0000 7fd7fa343640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd7f4109530 0x7fd7f419f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42000/0 (socket says 172.21.15.99:42000) 2024-01-31T05:11:39.882 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.880+0000 7fd7fa343640 1 -- 172.21.15.99:0/647785417 learned_addr learned my addr 172.21.15.99:0/647785417 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:39.882 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.880+0000 7fd7fab44640 1 --2- 172.21.15.99:0/647785417 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7f410b0e0 0x7fd7f41a69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:39.882 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.880+0000 7fd7f9b42640 1 --2- 172.21.15.99:0/647785417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7f410a720 0x7fd7f419f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:39.882 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.880+0000 7fd7fa343640 1 -- 172.21.15.99:0/647785417 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7f410b0e0 msgr2=0x7fd7f41a69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:39.882 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.880+0000 7fd7fa343640 1 --2- 172.21.15.99:0/647785417 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7f410b0e0 0x7fd7f41a69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:39.882 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.880+0000 7fd7fa343640 1 -- 172.21.15.99:0/647785417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7f410a720 msgr2=0x7fd7f419f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:39.882 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.880+0000 7fd7fa343640 1 --2- 172.21.15.99:0/647785417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7f410a720 0x7fd7f419f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:39.883 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.880+0000 7fd7fa343640 1 -- 172.21.15.99:0/647785417 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f0009560 con 0x7fd7f4109530 2024-01-31T05:11:39.883 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.880+0000 7fd7f9b42640 1 --2- 172.21.15.99:0/647785417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7f410a720 0x7fd7f419f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:11:39.883 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.881+0000 7fd7fa343640 1 --2- 172.21.15.99:0/647785417 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd7f4109530 0x7fd7f419f430 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0009230 tx=0x7fd7f0004dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:39.883 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.881+0000 7fd7eb7fe640 1 -- 172.21.15.99:0/647785417 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f00042d0 con 0x7fd7f4109530 2024-01-31T05:11:39.883 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.881+0000 7fd7fc5a7640 1 -- 172.21.15.99:0/647785417 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7f41a74d0 con 0x7fd7f4109530 2024-01-31T05:11:39.883 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.881+0000 7fd7eb7fe640 1 -- 172.21.15.99:0/647785417 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd7f0004430 con 0x7fd7f4109530 2024-01-31T05:11:39.883 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.881+0000 7fd7eb7fe640 1 -- 172.21.15.99:0/647785417 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f0003d10 con 0x7fd7f4109530 2024-01-31T05:11:39.884 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.881+0000 7fd7fc5a7640 1 -- 172.21.15.99:0/647785417 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7f41a7a30 con 0x7fd7f4109530 2024-01-31T05:11:39.890 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.883+0000 7fd7eb7fe640 1 -- 172.21.15.99:0/647785417 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 135946+0+0 (secure 0 0 0) 0x7fd7f0005000 con 0x7fd7f4109530 2024-01-31T05:11:39.890 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.884+0000 7fd7ff36d740 1 Processor -- start 2024-01-31T05:11:39.890 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.884+0000 7fd7ff36d740 1 -- start start 2024-01-31T05:11:39.890 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.884+0000 7fd7eb7fe640 1 --2- 172.21.15.99:0/647785417 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd7e00a1420 0x7fd7e00a38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:39.890 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.884+0000 7fd7ff36d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d62992270 0x564d62992690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:39.890 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.884+0000 7fd7ff36d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564d62992c60 0x564d62997760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:39.890 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.884+0000 7fd7ff36d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d62997dd0 0x564d6299a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:39.891 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.884+0000 7fd7ff36d740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d62902040 con 0x564d62992c60 2024-01-31T05:11:39.891 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.884+0000 7fd7ff36d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d628ff730 con 0x564d62997dd0 2024-01-31T05:11:39.891 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.884+0000 7fd7ff36d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d628fb020 con 0x564d62992270 2024-01-31T05:11:39.891 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.884+0000 7fd7fab44640 1 --2- 172.21.15.99:0/647785417 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd7e00a1420 0x7fd7e00a38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:39.891 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.884+0000 7fd7eb7fe640 1 -- 172.21.15.99:0/647785417 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fd7f00ef2e0 con 0x7fd7f4109530 2024-01-31T05:11:39.891 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.884+0000 7fd7fa343640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d62992270 0x564d62992690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:39.891 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.884+0000 7fd7f9b42640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564d62992c60 0x564d62997760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:39.891 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.884+0000 7fd7fa343640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d62992270 0x564d62992690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:52834/0 (socket says 172.21.15.99:52834) 2024-01-31T05:11:39.891 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.884+0000 7fd7f9b42640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564d62992c60 0x564d62997760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42004/0 (socket says 172.21.15.99:42004) 2024-01-31T05:11:39.891 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.884+0000 7fd7fa343640 1 -- 172.21.15.99:0/814219217 learned_addr learned my addr 172.21.15.99:0/814219217 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:39.891 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.885+0000 7fd7fab44640 1 --2- 172.21.15.99:0/814219217 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d62997dd0 0x564d6299a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:39.891 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.885+0000 7fd7fa343640 1 -- 172.21.15.99:0/814219217 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d62997dd0 msgr2=0x564d6299a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:39.892 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.885+0000 7fd7fa343640 1 --2- 172.21.15.99:0/814219217 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d62997dd0 0x564d6299a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:39.892 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.885+0000 7fd7fa343640 1 -- 172.21.15.99:0/814219217 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564d62992c60 msgr2=0x564d62997760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:39.892 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.885+0000 7fd7fa343640 1 --2- 172.21.15.99:0/814219217 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564d62992c60 0x564d62997760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:39.892 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.885+0000 7fd7fa343640 1 -- 172.21.15.99:0/814219217 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d628f2e40 con 0x564d62992270 2024-01-31T05:11:39.892 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.885+0000 7fd7f9b42640 1 --2- 172.21.15.99:0/814219217 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564d62992c60 0x564d62997760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:11:39.892 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.885+0000 7fd7fab44640 1 --2- 172.21.15.99:0/647785417 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd7e00a1420 0x7fd7e00a38e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec005fd0 tx=0x7fd7ec009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:39.892 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.885+0000 7fd7fa343640 1 --2- 172.21.15.99:0/814219217 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d62992270 0x564d62992690 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0006010 tx=0x7fd7f00b8960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33d35c09a3322fb4 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:39.892 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.885+0000 7fd7e8bfe640 1 -- 172.21.15.99:0/814219217 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f0099b40 con 0x564d62992270 2024-01-31T05:11:39.892 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.885+0000 7fd7e8bfe640 1 -- 172.21.15.99:0/814219217 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd7f00bcbf0 con 0x564d62992270 2024-01-31T05:11:39.892 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.885+0000 7fd7e8bfe640 1 -- 172.21.15.99:0/814219217 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f00c4880 con 0x564d62992270 2024-01-31T05:11:39.892 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.886+0000 7fd7ff36d740 1 -- 172.21.15.99:0/814219217 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d62992270 msgr2=0x564d62992690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:39.892 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.886+0000 7fd7ff36d740 1 --2- 172.21.15.99:0/814219217 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d62992270 0x564d62992690 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0006010 tx=0x7fd7f00b8960 comp rx=0 tx=0).stop 2024-01-31T05:11:39.893 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.886+0000 7fd7ff36d740 1 -- 172.21.15.99:0/814219217 shutdown_connections 2024-01-31T05:11:39.893 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.886+0000 7fd7ff36d740 1 --2- 172.21.15.99:0/814219217 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d62997dd0 0x564d6299a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:39.893 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.886+0000 7fd7ff36d740 1 --2- 172.21.15.99:0/814219217 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564d62992c60 0x564d62997760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:39.893 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.886+0000 7fd7ff36d740 1 --2- 172.21.15.99:0/814219217 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d62992270 0x564d62992690 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:39.893 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.886+0000 7fd7ff36d740 1 -- 172.21.15.99:0/814219217 >> 172.21.15.99:0/814219217 conn(0x564d6298d7e0 msgr2=0x564d6298dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:39.893 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.886+0000 7fd7ff36d740 1 -- 172.21.15.99:0/814219217 shutdown_connections 2024-01-31T05:11:39.893 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.886+0000 7fd7ff36d740 1 -- 172.21.15.99:0/814219217 wait complete. 2024-01-31T05:11:39.893 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.886+0000 7fd7ff36d740 1 -- start start 2024-01-31T05:11:39.893 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.886+0000 7fd7ff36d740 1 Processor -- start 2024-01-31T05:11:39.893 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.887+0000 7fd7ff36d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d62992270 0x564d6299bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:39.893 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.887+0000 7fd7ff36d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d62992c60 0x564d6299c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:39.894 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.887+0000 7fd7ff36d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564d62997dd0 0x564d629a3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:39.894 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.887+0000 7fd7ff36d740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d628b41b0 con 0x564d62997dd0 2024-01-31T05:11:39.894 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.887+0000 7fd7ff36d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d628b3e50 con 0x564d62992c60 2024-01-31T05:11:39.894 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.887+0000 7fd7ff36d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d62879090 con 0x564d62992270 2024-01-31T05:11:39.894 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.887+0000 7fd7ff36d740 10 client.0 _ll_register_callbacks cb 0x564d6289ea90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:11:39.894 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.887+0000 7fd7fab44640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564d62997dd0 0x564d629a3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:39.894 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.887+0000 7fd7fab44640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564d62997dd0 0x564d629a3430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42010/0 (socket says 172.21.15.99:42010) 2024-01-31T05:11:39.894 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.887+0000 7fd7fab44640 1 -- 172.21.15.99:0/44337095 learned_addr learned my addr 172.21.15.99:0/44337095 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:39.894 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.887+0000 7fd7fa343640 1 --2- 172.21.15.99:0/44337095 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d62992270 0x564d6299bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:39.894 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.887+0000 7fd7f9b42640 1 --2- 172.21.15.99:0/44337095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d62992c60 0x564d6299c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:39.895 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.887+0000 7fd7fab44640 1 -- 172.21.15.99:0/44337095 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d62992270 msgr2=0x564d6299bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:39.895 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.887+0000 7fd7fab44640 1 --2- 172.21.15.99:0/44337095 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d62992270 0x564d6299bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:39.895 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.887+0000 7fd7fab44640 1 -- 172.21.15.99:0/44337095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d62992c60 msgr2=0x564d6299c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:39.895 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.887+0000 7fd7fab44640 1 --2- 172.21.15.99:0/44337095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d62992c60 0x564d6299c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:39.895 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.887+0000 7fd7fab44640 1 -- 172.21.15.99:0/44337095 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7f41a7a30 con 0x564d62997dd0 2024-01-31T05:11:39.895 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.887+0000 7fd7fa343640 1 --2- 172.21.15.99:0/44337095 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d62992270 0x564d6299bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:11:39.895 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.887+0000 7fd7fab44640 1 --2- 172.21.15.99:0/44337095 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564d62997dd0 0x564d629a3430 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec01e570 tx=0x7fd7ec01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f140ef4df73de026 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:39.895 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.887+0000 7fd7ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:11:39.895 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.887+0000 7fd7ddffb640 1 -- 172.21.15.99:0/44337095 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ec016040 con 0x564d62997dd0 2024-01-31T05:11:39.895 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.887+0000 7fd7ddffb640 1 -- 172.21.15.99:0/44337095 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fd7ec0206c0 con 0x564d62997dd0 2024-01-31T05:11:39.895 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.887+0000 7fd7ff36d740 1 -- 172.21.15.99:0/44337095 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564d628f4010 con 0x564d62997dd0 2024-01-31T05:11:39.895 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.887+0000 7fd7ddffb640 1 -- 172.21.15.99:0/44337095 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7ec020880 con 0x564d62997dd0 2024-01-31T05:11:39.896 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.888+0000 7fd7ff36d740 10 client.15489 fetch_fsmap learned FSMap version 27 2024-01-31T05:11:39.896 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.888+0000 7fd7ff36d740 1 -- 172.21.15.99:0/44337095 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x564d628f96a0 con 0x564d62997dd0 2024-01-31T05:11:39.896 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.888+0000 7fd7ddffb640 1 -- 172.21.15.99:0/44337095 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564d628f4010 con 0x564d62997dd0 2024-01-31T05:11:39.896 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.888+0000 7fd7ddffb640 1 -- 172.21.15.99:0/44337095 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd7ec035780 con 0x564d62997dd0 2024-01-31T05:11:39.896 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.888+0000 7fd7ff36d740 10 client.15489 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:11:39.896 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.888+0000 7fd7ff36d740 10 client.15489 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-01-31T05:11:39.896 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.888+0000 7fd7ff36d740 20 client.15489 populate_metadata read hostname 'smithi099' 2024-01-31T05:11:39.896 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.888+0000 7fd7ff36d740 1 --2- 172.21.15.99:0/44337095 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x564d629a7e00 0x564d629aa220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:39.896 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.888+0000 7fd7ff36d740 4 client.15489 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:11:39.896 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.888+0000 7fd7ff36d740 1 -- 172.21.15.99:0/44337095 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564d628f3d30 con 0x564d629a7e00 2024-01-31T05:11:39.896 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.888+0000 7fd7fa343640 1 --2- 172.21.15.99:0/44337095 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x564d629a7e00 0x564d629aa220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:39.896 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.888+0000 7fd7ddffb640 10 client.15489 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:11:39.897 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.888+0000 7fd7fa343640 1 --2- 172.21.15.99:0/44337095 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x564d629a7e00 0x564d629aa220 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d318dbccbdacd948 server_cookie=736f528e556e8758 in_seq=0 out_seq=0 2024-01-31T05:11:39.897 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.889+0000 7fd7ddffb640 1 -- 172.21.15.99:0/44337095 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564d628f3d30 con 0x564d629a7e00 2024-01-31T05:11:39.897 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.889+0000 7fd7ddffb640 10 client.15489 handle_command_reply: tid=0 2024-01-31T05:11:39.897 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.889+0000 7fd7ff36d740 1 client.15489 shutdown 2024-01-31T05:11:39.897 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.889+0000 7fd7ff36d740 1 -- 172.21.15.99:0/44337095 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564d62997dd0 msgr2=0x564d629a3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:39.897 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.889+0000 7fd7ff36d740 1 --2- 172.21.15.99:0/44337095 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564d62997dd0 0x564d629a3430 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec01e570 tx=0x7fd7ec01d000 comp rx=0 tx=0).stop 2024-01-31T05:11:39.897 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.889+0000 7fd7ff36d740 1 -- 172.21.15.99:0/44337095 shutdown_connections 2024-01-31T05:11:39.897 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.889+0000 7fd7ff36d740 1 --2- 172.21.15.99:0/44337095 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564d62997dd0 0x564d629a3430 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:39.897 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.890+0000 7fd7ff36d740 1 --2- 172.21.15.99:0/44337095 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x564d629a7e00 0x564d629aa220 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:39.897 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.890+0000 7fd7ff36d740 1 --2- 172.21.15.99:0/44337095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d62992c60 0x564d6299c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:39.897 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.890+0000 7fd7ff36d740 1 --2- 172.21.15.99:0/44337095 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d62992270 0x564d6299bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:39.898 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.890+0000 7fd7ddffb640 0 client.15489 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:11:39.898 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.890+0000 7fd7ff36d740 1 -- 172.21.15.99:0/44337095 >> 172.21.15.99:0/44337095 conn(0x564d6298d7e0 msgr2=0x564d6298ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:39.898 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.890+0000 7fd7ff36d740 1 -- 172.21.15.99:0/44337095 shutdown_connections 2024-01-31T05:11:39.898 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.890+0000 7fd7ff36d740 1 -- 172.21.15.99:0/44337095 wait complete. 2024-01-31T05:11:39.898 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.890+0000 7fd7ff36d740 20 client.15489 trim_cache size 0 max 16384 2024-01-31T05:11:39.903 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.903+0000 7fd7ff36d740 1 Processor -- start 2024-01-31T05:11:39.903 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.903+0000 7fd7ff36d740 1 -- start start 2024-01-31T05:11:39.903 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.903+0000 7fd7ff36d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d62992270 0x564d6299bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:39.903 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.903+0000 7fd7ff36d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d62992c60 0x564d6299c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:39.903 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.903+0000 7fd7ff36d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564d62997dd0 0x564d629a33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:39.904 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.903+0000 7fd7ff36d740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d6298e7d0 con 0x564d62997dd0 2024-01-31T05:11:39.904 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.903+0000 7fd7ff36d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d6298d1a0 con 0x564d62992270 2024-01-31T05:11:39.904 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.903+0000 7fd7ff36d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d628f4010 con 0x564d62992c60 2024-01-31T05:11:39.904 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.903+0000 7fd7fab44640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564d62997dd0 0x564d629a33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:39.904 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.903+0000 7fd7fab44640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564d62997dd0 0x564d629a33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42020/0 (socket says 172.21.15.99:42020) 2024-01-31T05:11:39.904 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.903+0000 7fd7fab44640 1 -- 172.21.15.99:0/326887598 learned_addr learned my addr 172.21.15.99:0/326887598 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:39.904 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.903+0000 7fd7fa343640 1 --2- 172.21.15.99:0/326887598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d62992270 0x564d6299bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:39.904 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.903+0000 7fd7f9b42640 1 --2- 172.21.15.99:0/326887598 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d62992c60 0x564d6299c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:39.904 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.903+0000 7fd7fab44640 1 -- 172.21.15.99:0/326887598 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d62992c60 msgr2=0x564d6299c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:39.904 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.903+0000 7fd7fab44640 1 --2- 172.21.15.99:0/326887598 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d62992c60 0x564d6299c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:39.904 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.903+0000 7fd7fab44640 1 -- 172.21.15.99:0/326887598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d62992270 msgr2=0x564d6299bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:39.905 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.903+0000 7fd7fab44640 1 --2- 172.21.15.99:0/326887598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d62992270 0x564d6299bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:39.905 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.903+0000 7fd7fab44640 1 -- 172.21.15.99:0/326887598 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d62896030 con 0x564d62997dd0 2024-01-31T05:11:39.905 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.903+0000 7fd7fab44640 1 --2- 172.21.15.99:0/326887598 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564d62997dd0 0x564d629a33f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec035c00 tx=0x7fd7ec01e400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d503626a4e60c68 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:39.905 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.904+0000 7fd7dffff640 1 -- 172.21.15.99:0/326887598 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ec03a030 con 0x564d62997dd0 2024-01-31T05:11:39.905 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.904+0000 7fd7dffff640 1 -- 172.21.15.99:0/326887598 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd7ec01ed40 con 0x564d62997dd0 2024-01-31T05:11:39.905 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.904+0000 7fd7dffff640 1 -- 172.21.15.99:0/326887598 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ec016070 con 0x564d62997dd0 2024-01-31T05:11:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.905+0000 7fd7ff36d740 1 -- 172.21.15.99:0/326887598 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564d62997dd0 msgr2=0x564d629a33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.905+0000 7fd7ff36d740 1 --2- 172.21.15.99:0/326887598 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564d62997dd0 0x564d629a33f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec035c00 tx=0x7fd7ec01e400 comp rx=0 tx=0).stop 2024-01-31T05:11:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.905+0000 7fd7ff36d740 1 -- 172.21.15.99:0/326887598 shutdown_connections 2024-01-31T05:11:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.905+0000 7fd7ff36d740 1 --2- 172.21.15.99:0/326887598 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564d62997dd0 0x564d629a33f0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.905+0000 7fd7ff36d740 1 --2- 172.21.15.99:0/326887598 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d62992c60 0x564d6299c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.905+0000 7fd7ff36d740 1 --2- 172.21.15.99:0/326887598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d62992270 0x564d6299bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.905+0000 7fd7ff36d740 1 -- 172.21.15.99:0/326887598 >> 172.21.15.99:0/326887598 conn(0x564d6298d7e0 msgr2=0x564d6298dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.905+0000 7fd7ff36d740 1 -- 172.21.15.99:0/326887598 shutdown_connections 2024-01-31T05:11:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.905+0000 7fd7ff36d740 1 -- 172.21.15.99:0/326887598 wait complete. 2024-01-31T05:11:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.905+0000 7fd7ff36d740 1 -- start start 2024-01-31T05:11:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.905+0000 7fd7ff36d740 1 Processor -- start 2024-01-31T05:11:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.905+0000 7fd7ff36d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d62992270 0x564d629a30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.905+0000 7fd7ff36d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564d62992c60 0x564d629a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:39.911 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.906+0000 7fd7ff36d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d62997dd0 0x564d629a1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:39.911 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.906+0000 7fd7ff36d740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d629a2160 con 0x564d62992c60 2024-01-31T05:11:39.911 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.906+0000 7fd7ff36d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d629a22d0 con 0x564d62992270 2024-01-31T05:11:39.911 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.906+0000 7fd7ff36d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d629a2490 con 0x564d62997dd0 2024-01-31T05:11:39.911 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.906+0000 7fd7ff36d740 10 client.0 _ll_register_callbacks cb 0x7fd7ec009720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:11:39.911 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.906+0000 7fd7f9b42640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564d62992c60 0x564d629a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:39.911 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.906+0000 7fd7f9b42640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564d62992c60 0x564d629a16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42026/0 (socket says 172.21.15.99:42026) 2024-01-31T05:11:39.911 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.906+0000 7fd7f9b42640 1 -- 172.21.15.99:0/2737437289 learned_addr learned my addr 172.21.15.99:0/2737437289 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:39.911 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.906+0000 7fd7fa343640 1 --2- 172.21.15.99:0/2737437289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d62992270 0x564d629a30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:39.911 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.906+0000 7fd7fab44640 1 --2- 172.21.15.99:0/2737437289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d62997dd0 0x564d629a1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:39.911 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.906+0000 7fd7f9b42640 1 -- 172.21.15.99:0/2737437289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d62997dd0 msgr2=0x564d629a1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:39.911 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.906+0000 7fd7f9b42640 1 --2- 172.21.15.99:0/2737437289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d62997dd0 0x564d629a1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:39.911 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.906+0000 7fd7f9b42640 1 -- 172.21.15.99:0/2737437289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d62992270 msgr2=0x564d629a30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:39.912 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.906+0000 7fd7f9b42640 1 --2- 172.21.15.99:0/2737437289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d62992270 0x564d629a30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:39.912 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.906+0000 7fd7f9b42640 1 -- 172.21.15.99:0/2737437289 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564d628f96a0 con 0x564d62992c60 2024-01-31T05:11:39.912 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.906+0000 7fd7fab44640 1 --2- 172.21.15.99:0/2737437289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d62997dd0 0x564d629a1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:11:39.912 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.906+0000 7fd7f9b42640 1 --2- 172.21.15.99:0/2737437289 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564d62992c60 0x564d629a16e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x564d629936d0 tx=0x7fd7e4012de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e02d4ce9fbc6f0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:39.912 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.906+0000 7fd7ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:11:39.912 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.906+0000 7fd7ddffb640 1 -- 172.21.15.99:0/2737437289 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e4011ca0 con 0x564d62992c60 2024-01-31T05:11:39.912 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.906+0000 7fd7ddffb640 1 -- 172.21.15.99:0/2737437289 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fd7e4011e00 con 0x564d62992c60 2024-01-31T05:11:39.912 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.906+0000 7fd7ff36d740 1 -- 172.21.15.99:0/2737437289 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd7f00bcbf0 con 0x564d62992c60 2024-01-31T05:11:39.912 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.906+0000 7fd7ddffb640 1 -- 172.21.15.99:0/2737437289 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7e401d3f0 con 0x564d62992c60 2024-01-31T05:11:39.912 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.906+0000 7fd7ff36d740 10 client.15495 fetch_fsmap learned FSMap version 27 2024-01-31T05:11:39.912 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.906+0000 7fd7ff36d740 1 -- 172.21.15.99:0/2737437289 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x564d628bba50 con 0x564d62992c60 2024-01-31T05:11:39.912 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.907+0000 7fd7ddffb640 1 -- 172.21.15.99:0/2737437289 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd7f00bcbf0 con 0x564d62992c60 2024-01-31T05:11:39.913 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.907+0000 7fd7ddffb640 1 -- 172.21.15.99:0/2737437289 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd7e40286d0 con 0x564d62992c60 2024-01-31T05:11:39.913 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.907+0000 7fd7ff36d740 10 client.15495 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:11:39.913 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.907+0000 7fd7ff36d740 10 client.15495 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-01-31T05:11:39.913 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.907+0000 7fd7ff36d740 20 client.15495 populate_metadata read hostname 'smithi099' 2024-01-31T05:11:39.913 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.907+0000 7fd7ff36d740 1 --2- 172.21.15.99:0/2737437289 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x564d629ffba0 0x564d62a01fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:39.913 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.907+0000 7fd7ff36d740 4 client.15495 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-01-31T05:11:39.913 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.907+0000 7fd7ff36d740 1 -- 172.21.15.99:0/2737437289 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564d625fa600 con 0x564d629ffba0 2024-01-31T05:11:39.913 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.907+0000 7fd7fa343640 1 --2- 172.21.15.99:0/2737437289 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x564d629ffba0 0x564d62a01fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:39.913 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.907+0000 7fd7fa343640 1 --2- 172.21.15.99:0/2737437289 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x564d629ffba0 0x564d62a01fc0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5398d8c8611e9fce server_cookie=21b68bdea857efb2 in_seq=0 out_seq=0 2024-01-31T05:11:39.913 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.907+0000 7fd7ddffb640 10 client.15495 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:11:39.918 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.918+0000 7fd7ddffb640 1 -- 172.21.15.99:0/2737437289 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564d625fa600 con 0x564d629ffba0 2024-01-31T05:11:39.918 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.918+0000 7fd7ddffb640 10 client.15495 handle_command_reply: tid=0 2024-01-31T05:11:39.918 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.918+0000 7fd7ff36d740 1 client.15495 shutdown 2024-01-31T05:11:39.918 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.918+0000 7fd7ff36d740 1 -- 172.21.15.99:0/2737437289 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564d62992c60 msgr2=0x564d629a16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:39.918 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.918+0000 7fd7ff36d740 1 --2- 172.21.15.99:0/2737437289 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564d62992c60 0x564d629a16e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x564d629936d0 tx=0x7fd7e4012de0 comp rx=0 tx=0).stop 2024-01-31T05:11:39.918 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.918+0000 7fd7ff36d740 1 -- 172.21.15.99:0/2737437289 shutdown_connections 2024-01-31T05:11:39.918 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.918+0000 7fd7ff36d740 1 --2- 172.21.15.99:0/2737437289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564d62997dd0 0x564d629a1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:39.918 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.918+0000 7fd7ff36d740 1 --2- 172.21.15.99:0/2737437289 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564d62992c60 0x564d629a16e0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:39.918 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.918+0000 7fd7ff36d740 1 --2- 172.21.15.99:0/2737437289 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x564d629ffba0 0x564d62a01fc0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:39.919 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.918+0000 7fd7ff36d740 1 --2- 172.21.15.99:0/2737437289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d62992270 0x564d629a30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:39.919 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.918+0000 7fd7ddffb640 0 client.15495 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:11:39.919 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.918+0000 7fd7ff36d740 1 -- 172.21.15.99:0/2737437289 >> 172.21.15.99:0/2737437289 conn(0x564d6298d7e0 msgr2=0x564d62993e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:39.919 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.918+0000 7fd7ff36d740 1 -- 172.21.15.99:0/2737437289 shutdown_connections 2024-01-31T05:11:39.919 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.918+0000 7fd7ff36d740 1 -- 172.21.15.99:0/2737437289 wait complete. 2024-01-31T05:11:39.919 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.918+0000 7fd7ff36d740 20 client.15495 trim_cache size 0 max 16384 2024-01-31T05:11:39.919 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout:{ 2024-01-31T05:11:39.919 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout: "message": "", 2024-01-31T05:11:39.920 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout: "return_code": 0 2024-01-31T05:11:39.920 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout:} 2024-01-31T05:11:39.921 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.918+0000 7fd7fc5a7640 1 -- 172.21.15.99:0/647785417 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd7e00a1420 msgr2=0x7fd7e00a38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:39.921 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.918+0000 7fd7fc5a7640 1 --2- 172.21.15.99:0/647785417 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd7e00a1420 0x7fd7e00a38e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec005fd0 tx=0x7fd7ec009f10 comp rx=0 tx=0).stop 2024-01-31T05:11:39.921 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.919+0000 7fd7fc5a7640 1 -- 172.21.15.99:0/647785417 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd7f4109530 msgr2=0x7fd7f419f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:39.921 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.919+0000 7fd7fc5a7640 1 --2- 172.21.15.99:0/647785417 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd7f4109530 0x7fd7f419f430 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0009230 tx=0x7fd7f0004dd0 comp rx=0 tx=0).stop 2024-01-31T05:11:39.921 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.919+0000 7fd7fc5a7640 1 -- 172.21.15.99:0/647785417 shutdown_connections 2024-01-31T05:11:39.921 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.919+0000 7fd7fc5a7640 1 --2- 172.21.15.99:0/647785417 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd7e00a1420 0x7fd7e00a38e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:39.921 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.919+0000 7fd7fc5a7640 1 --2- 172.21.15.99:0/647785417 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd7f410b0e0 0x7fd7f41a69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:39.921 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.919+0000 7fd7fc5a7640 1 --2- 172.21.15.99:0/647785417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7f410a720 0x7fd7f419f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:39.921 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.919+0000 7fd7fc5a7640 1 --2- 172.21.15.99:0/647785417 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd7f4109530 0x7fd7f419f430 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:39.921 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.919+0000 7fd7fc5a7640 1 -- 172.21.15.99:0/647785417 >> 172.21.15.99:0/647785417 conn(0x7fd7f406fcd0 msgr2=0x7fd7f410da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:39.921 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.919+0000 7fd7fc5a7640 1 -- 172.21.15.99:0/647785417 shutdown_connections 2024-01-31T05:11:39.921 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:39.919+0000 7fd7fc5a7640 1 -- 172.21.15.99:0/647785417 wait complete. 2024-01-31T05:11:40.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:39 smithi099 ceph-mon[31615]: pgmap v357: 97 pgs: 97 active+clean; 657 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-01-31T05:11:40.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:39 smithi181 ceph-mon[36434]: pgmap v357: 97 pgs: 97 active+clean; 657 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-01-31T05:11:41.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:41 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:11:41.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:41 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:11:41.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:41 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:11:41.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:41 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:11:41.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:41 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:11:41.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:41 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:11:41.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:41 smithi099 ceph-mon[31615]: pgmap v358: 97 pgs: 97 active+clean; 657 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 341 B/s wr, 8 op/s 2024-01-31T05:11:41.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:41 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:11:41.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:41 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:11:41.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:41 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:11:41.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:41 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:11:41.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:41 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:11:41.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:41 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:11:41.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:41 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:11:41.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:41 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:11:41.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:41 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:11:41.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:41 smithi181 ceph-mon[36434]: pgmap v358: 97 pgs: 97 active+clean; 657 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 341 B/s wr, 8 op/s 2024-01-31T05:11:41.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:41 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:11:41.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:41 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:11:41.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:41 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:11:41.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:41 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:11:41.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:41 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:11:41.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:41 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:11:41.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:41 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:11:41.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:41 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:11:41.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:41 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:11:41.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:41 smithi179 ceph-mon[35652]: pgmap v358: 97 pgs: 97 active+clean; 657 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 341 B/s wr, 8 op/s 2024-01-31T05:11:41.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:41 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:11:41.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:41 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:11:41.633 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:41 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:11:43.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:43 smithi099 ceph-mon[31615]: pgmap v359: 97 pgs: 97 active+clean; 657 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2024-01-31T05:11:43.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:43 smithi181 ceph-mon[36434]: pgmap v359: 97 pgs: 97 active+clean; 657 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2024-01-31T05:11:43.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:43 smithi179 ceph-mon[35652]: pgmap v359: 97 pgs: 97 active+clean; 657 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2024-01-31T05:11:46.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:45 smithi099 ceph-mon[31615]: pgmap v360: 97 pgs: 97 active+clean; 658 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.5 KiB/s wr, 14 op/s 2024-01-31T05:11:46.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:45 smithi181 ceph-mon[36434]: pgmap v360: 97 pgs: 97 active+clean; 658 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.5 KiB/s wr, 14 op/s 2024-01-31T05:11:46.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:45 smithi179 ceph-mon[35652]: pgmap v360: 97 pgs: 97 active+clean; 658 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.5 KiB/s wr, 14 op/s 2024-01-31T05:11:48.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:47 smithi099 ceph-mon[31615]: pgmap v361: 97 pgs: 97 active+clean; 658 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-01-31T05:11:48.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:47 smithi181 ceph-mon[36434]: pgmap v361: 97 pgs: 97 active+clean; 658 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-01-31T05:11:48.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:47 smithi179 ceph-mon[35652]: pgmap v361: 97 pgs: 97 active+clean; 658 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-01-31T05:11:50.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:49 smithi099 ceph-mon[31615]: pgmap v362: 97 pgs: 97 active+clean; 658 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.5 KiB/s wr, 16 op/s 2024-01-31T05:11:50.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:49 smithi181 ceph-mon[36434]: pgmap v362: 97 pgs: 97 active+clean; 658 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.5 KiB/s wr, 16 op/s 2024-01-31T05:11:50.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:49 smithi179 ceph-mon[35652]: pgmap v362: 97 pgs: 97 active+clean; 658 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.5 KiB/s wr, 16 op/s 2024-01-31T05:11:52.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:51 smithi099 ceph-mon[31615]: pgmap v363: 97 pgs: 97 active+clean; 658 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-01-31T05:11:52.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:51 smithi181 ceph-mon[36434]: pgmap v363: 97 pgs: 97 active+clean; 658 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-01-31T05:11:52.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:51 smithi179 ceph-mon[35652]: pgmap v363: 97 pgs: 97 active+clean; 658 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-01-31T05:11:53.017 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.015+0000 7f68c8489640 1 -- 172.21.15.99:0/1526125030 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68c0100d20 msgr2=0x7f68c0101140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:53.017 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.015+0000 7f68c8489640 1 --2- 172.21.15.99:0/1526125030 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68c0100d20 0x7f68c0101140 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f68b0009900 tx=0x7f68b002bc30 comp rx=0 tx=0).stop 2024-01-31T05:11:53.017 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.016+0000 7f68c8489640 1 -- 172.21.15.99:0/1526125030 shutdown_connections 2024-01-31T05:11:53.017 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.016+0000 7f68c8489640 1 --2- 172.21.15.99:0/1526125030 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68c01028d0 0x7f68c0109160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:53.018 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.016+0000 7f68c8489640 1 --2- 172.21.15.99:0/1526125030 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68c0101f10 0x7f68c0102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:53.018 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.016+0000 7f68c8489640 1 --2- 172.21.15.99:0/1526125030 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68c0100d20 0x7f68c0101140 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:53.018 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.016+0000 7f68c8489640 1 -- 172.21.15.99:0/1526125030 >> 172.21.15.99:0/1526125030 conn(0x7f68c00fc2b0 msgr2=0x7f68c00fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:53.018 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.016+0000 7f68c8489640 1 -- 172.21.15.99:0/1526125030 shutdown_connections 2024-01-31T05:11:53.018 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.016+0000 7f68c8489640 1 -- 172.21.15.99:0/1526125030 wait complete. 2024-01-31T05:11:53.018 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.016+0000 7f68c8489640 1 Processor -- start 2024-01-31T05:11:53.018 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.016+0000 7f68c8489640 1 -- start start 2024-01-31T05:11:53.018 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.016+0000 7f68c8489640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68c0100d20 0x7f68c0196c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:53.018 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.016+0000 7f68c8489640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68c0101f10 0x7f68c0197190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:53.018 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.016+0000 7f68c8489640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68c01028d0 0x7f68c019e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:53.018 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.016+0000 7f68c8489640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c019e730 con 0x7f68c01028d0 2024-01-31T05:11:53.018 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.016+0000 7f68c8489640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c019e8a0 con 0x7f68c0100d20 2024-01-31T05:11:53.018 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.016+0000 7f68c8489640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c019ea60 con 0x7f68c0101f10 2024-01-31T05:11:53.018 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.016+0000 7f68c6a26640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68c01028d0 0x7f68c019e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:53.018 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.016+0000 7f68c6a26640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68c01028d0 0x7f68c019e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50900/0 (socket says 172.21.15.99:50900) 2024-01-31T05:11:53.019 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.016+0000 7f68c6a26640 1 -- 172.21.15.99:0/3728544410 learned_addr learned my addr 172.21.15.99:0/3728544410 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:53.019 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.017+0000 7f68c6225640 1 --2- 172.21.15.99:0/3728544410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68c0100d20 0x7f68c0196c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:53.019 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.017+0000 7f68c5a24640 1 --2- 172.21.15.99:0/3728544410 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68c0101f10 0x7f68c0197190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:53.019 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.017+0000 7f68c6a26640 1 -- 172.21.15.99:0/3728544410 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68c0101f10 msgr2=0x7f68c0197190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:53.019 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.017+0000 7f68c6a26640 1 --2- 172.21.15.99:0/3728544410 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68c0101f10 0x7f68c0197190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:53.019 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.017+0000 7f68c6a26640 1 -- 172.21.15.99:0/3728544410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68c0100d20 msgr2=0x7f68c0196c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:53.019 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.017+0000 7f68c6a26640 1 --2- 172.21.15.99:0/3728544410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68c0100d20 0x7f68c0196c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:53.019 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.017+0000 7f68c6a26640 1 -- 172.21.15.99:0/3728544410 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b0009560 con 0x7f68c01028d0 2024-01-31T05:11:53.019 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.017+0000 7f68c5a24640 1 --2- 172.21.15.99:0/3728544410 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68c0101f10 0x7f68c0197190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:11:53.019 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.017+0000 7f68c6a26640 1 --2- 172.21.15.99:0/3728544410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68c01028d0 0x7f68c019e1c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f68b800eaa0 tx=0x7f68b800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:53.019 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.017+0000 7f68b77fe640 1 -- 172.21.15.99:0/3728544410 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b800cdb0 con 0x7f68c01028d0 2024-01-31T05:11:53.019 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.017+0000 7f68b77fe640 1 -- 172.21.15.99:0/3728544410 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f68b8005020 con 0x7f68c01028d0 2024-01-31T05:11:53.019 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.017+0000 7f68c8489640 1 -- 172.21.15.99:0/3728544410 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68c019ed40 con 0x7f68c01028d0 2024-01-31T05:11:53.019 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.017+0000 7f68b77fe640 1 -- 172.21.15.99:0/3728544410 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b80116d0 con 0x7f68c01028d0 2024-01-31T05:11:53.020 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.017+0000 7f68c8489640 1 -- 172.21.15.99:0/3728544410 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68c019f1a0 con 0x7f68c01028d0 2024-01-31T05:11:53.026 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.019+0000 7f68b77fe640 1 -- 172.21.15.99:0/3728544410 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f68b8005190 con 0x7f68c01028d0 2024-01-31T05:11:53.026 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.020+0000 7f68cb24b740 1 Processor -- start 2024-01-31T05:11:53.026 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.020+0000 7f68cb24b740 1 -- start start 2024-01-31T05:11:53.026 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.020+0000 7f68cb24b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612dcad6270 0x5612dcad6690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:53.026 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.020+0000 7f68cb24b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612dcad6c60 0x5612dcadb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:53.026 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.020+0000 7f68cb24b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5612dcadbdd0 0x5612dcade260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.020+0000 7f68cb24b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612dca46040 con 0x5612dcad6c60 2024-01-31T05:11:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.020+0000 7f68cb24b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612dca43730 con 0x5612dcad6270 2024-01-31T05:11:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.020+0000 7f68cb24b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612dca3f020 con 0x5612dcadbdd0 2024-01-31T05:11:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.020+0000 7f68b77fe640 1 --2- 172.21.15.99:0/3728544410 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f68ac0a14a0 0x7f68ac0a3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.020+0000 7f68c6225640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612dcad6c60 0x5612dcadb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.020+0000 7f68c6225640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612dcad6c60 0x5612dcadb760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50910/0 (socket says 172.21.15.99:50910) 2024-01-31T05:11:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.020+0000 7f68c6225640 1 -- 172.21.15.99:0/1183996408 learned_addr learned my addr 172.21.15.99:0/1183996408 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.021+0000 7f68c6a26640 1 --2- 172.21.15.99:0/3728544410 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f68ac0a14a0 0x7f68ac0a3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.021+0000 7f68c5a24640 1 --2- 172.21.15.99:0/1183996408 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5612dcadbdd0 0x5612dcade260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.021+0000 7f68c5a24640 1 --2- 172.21.15.99:0/1183996408 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612dcad6270 0x5612dcad6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.021+0000 7f68b77fe640 1 -- 172.21.15.99:0/3728544410 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f68b80cce60 con 0x7f68c01028d0 2024-01-31T05:11:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.021+0000 7f68c6225640 1 -- 172.21.15.99:0/1183996408 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5612dcadbdd0 msgr2=0x5612dcade260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.021+0000 7f68c6225640 1 --2- 172.21.15.99:0/1183996408 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5612dcadbdd0 0x5612dcade260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.021+0000 7f68c6225640 1 -- 172.21.15.99:0/1183996408 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612dcad6270 msgr2=0x5612dcad6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.021+0000 7f68c6225640 1 --2- 172.21.15.99:0/1183996408 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612dcad6270 0x5612dcad6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.021+0000 7f68c6225640 1 -- 172.21.15.99:0/1183996408 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5612dca36e40 con 0x5612dcad6c60 2024-01-31T05:11:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.021+0000 7f68c5a24640 1 --2- 172.21.15.99:0/1183996408 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612dcad6270 0x5612dcad6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:11:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.021+0000 7f68c6a26640 1 --2- 172.21.15.99:0/3728544410 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f68ac0a14a0 0x7f68ac0a3960 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f68b80a1dc0 tx=0x7f68b806bf80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.021+0000 7f68c6225640 1 --2- 172.21.15.99:0/1183996408 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612dcad6c60 0x5612dcadb760 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f68b0006010 tx=0x7f68b0004e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=842b784873223ed server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.021+0000 7f68b4bfe640 1 -- 172.21.15.99:0/1183996408 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b002cc40 con 0x5612dcad6c60 2024-01-31T05:11:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.021+0000 7f68b4bfe640 1 -- 172.21.15.99:0/1183996408 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f68b0004040 con 0x5612dcad6c60 2024-01-31T05:11:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.021+0000 7f68b4bfe640 1 -- 172.21.15.99:0/1183996408 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b0005530 con 0x5612dcad6c60 2024-01-31T05:11:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.022+0000 7f68cb24b740 1 -- 172.21.15.99:0/1183996408 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612dcad6c60 msgr2=0x5612dcadb760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.022+0000 7f68cb24b740 1 --2- 172.21.15.99:0/1183996408 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612dcad6c60 0x5612dcadb760 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f68b0006010 tx=0x7f68b0004e80 comp rx=0 tx=0).stop 2024-01-31T05:11:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.022+0000 7f68cb24b740 1 -- 172.21.15.99:0/1183996408 shutdown_connections 2024-01-31T05:11:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.022+0000 7f68cb24b740 1 --2- 172.21.15.99:0/1183996408 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5612dcadbdd0 0x5612dcade260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.022+0000 7f68cb24b740 1 --2- 172.21.15.99:0/1183996408 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612dcad6c60 0x5612dcadb760 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.022+0000 7f68cb24b740 1 --2- 172.21.15.99:0/1183996408 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612dcad6270 0x5612dcad6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.022+0000 7f68cb24b740 1 -- 172.21.15.99:0/1183996408 >> 172.21.15.99:0/1183996408 conn(0x5612dcad17e0 msgr2=0x5612dcad1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.022+0000 7f68cb24b740 1 -- 172.21.15.99:0/1183996408 shutdown_connections 2024-01-31T05:11:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.022+0000 7f68cb24b740 1 -- 172.21.15.99:0/1183996408 wait complete. 2024-01-31T05:11:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.022+0000 7f68cb24b740 1 -- start start 2024-01-31T05:11:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.023+0000 7f68cb24b740 1 Processor -- start 2024-01-31T05:11:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.023+0000 7f68cb24b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612dcad6270 0x5612dcae00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.023+0000 7f68cb24b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5612dcad6c60 0x5612dcae0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.023+0000 7f68cb24b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612dcadbdd0 0x5612dcae7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.023+0000 7f68cb24b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612dc9f81b0 con 0x5612dcadbdd0 2024-01-31T05:11:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.023+0000 7f68cb24b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612dc9f7e50 con 0x5612dcad6270 2024-01-31T05:11:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.023+0000 7f68cb24b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612dc9bd090 con 0x5612dcad6c60 2024-01-31T05:11:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.023+0000 7f68cb24b740 10 client.0 _ll_register_callbacks cb 0x5612dc9e2a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:11:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.023+0000 7f68c5a24640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612dcadbdd0 0x5612dcae7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.023+0000 7f68c5a24640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612dcadbdd0 0x5612dcae7670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50912/0 (socket says 172.21.15.99:50912) 2024-01-31T05:11:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.023+0000 7f68c5a24640 1 -- 172.21.15.99:0/3412344432 learned_addr learned my addr 172.21.15.99:0/3412344432 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.023+0000 7f68c5a24640 1 --2- 172.21.15.99:0/3412344432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612dcad6270 0x5612dcae00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.023+0000 7f68c6225640 1 --2- 172.21.15.99:0/3412344432 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5612dcad6c60 0x5612dcae0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.023+0000 7f68c5a24640 1 -- 172.21.15.99:0/3412344432 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5612dcad6c60 msgr2=0x5612dcae0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.023+0000 7f68c5a24640 1 --2- 172.21.15.99:0/3412344432 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5612dcad6c60 0x5612dcae0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.023+0000 7f68c5a24640 1 -- 172.21.15.99:0/3412344432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612dcad6270 msgr2=0x5612dcae00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.023+0000 7f68c5a24640 1 --2- 172.21.15.99:0/3412344432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612dcad6270 0x5612dcae00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.023+0000 7f68c5a24640 1 -- 172.21.15.99:0/3412344432 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68c0109a60 con 0x5612dcadbdd0 2024-01-31T05:11:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.023+0000 7f68c5a24640 1 --2- 172.21.15.99:0/3412344432 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612dcadbdd0 0x5612dcae7670 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f68bc012e10 tx=0x7f68bc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa1fc56b8f38e646 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.023+0000 7f68a9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:11:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.023+0000 7f68a9ffb640 1 -- 172.21.15.99:0/3412344432 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68bc010ee0 con 0x5612dcadbdd0 2024-01-31T05:11:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.024+0000 7f68a9ffb640 1 -- 172.21.15.99:0/3412344432 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f68bc012260 con 0x5612dcadbdd0 2024-01-31T05:11:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.024+0000 7f68cb24b740 1 -- 172.21.15.99:0/3412344432 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5612dca38010 con 0x5612dcadbdd0 2024-01-31T05:11:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.024+0000 7f68a9ffb640 1 -- 172.21.15.99:0/3412344432 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68bc0047a0 con 0x5612dcadbdd0 2024-01-31T05:11:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.024+0000 7f68cb24b740 10 client.15507 fetch_fsmap learned FSMap version 27 2024-01-31T05:11:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.024+0000 7f68cb24b740 1 -- 172.21.15.99:0/3412344432 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5612dca3d6a0 con 0x5612dcadbdd0 2024-01-31T05:11:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.024+0000 7f68a9ffb640 1 -- 172.21.15.99:0/3412344432 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5612dca38010 con 0x5612dcadbdd0 2024-01-31T05:11:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.024+0000 7f68a9ffb640 1 -- 172.21.15.99:0/3412344432 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f68bc0054d0 con 0x5612dcadbdd0 2024-01-31T05:11:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.024+0000 7f68cb24b740 10 client.15507 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:11:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.024+0000 7f68cb24b740 10 client.15507 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-01-31T05:11:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.024+0000 7f68cb24b740 20 client.15507 populate_metadata read hostname 'smithi099' 2024-01-31T05:11:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.024+0000 7f68cb24b740 1 --2- 172.21.15.99:0/3412344432 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5612dcaebf70 0x5612dcaee3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.024+0000 7f68cb24b740 4 client.15507 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:11:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.024+0000 7f68cb24b740 1 -- 172.21.15.99:0/3412344432 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5612dca37d30 con 0x5612dcaebf70 2024-01-31T05:11:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.024+0000 7f68c6225640 1 --2- 172.21.15.99:0/3412344432 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5612dcaebf70 0x5612dcaee3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.025+0000 7f68a9ffb640 10 client.15507 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:11:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.025+0000 7f68c6225640 1 --2- 172.21.15.99:0/3412344432 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5612dcaebf70 0x5612dcaee3b0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa2bcfe59c0f4495 server_cookie=1ff483dcdc289750 in_seq=0 out_seq=0 2024-01-31T05:11:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.025+0000 7f68a9ffb640 1 -- 172.21.15.99:0/3412344432 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5612dca37d30 con 0x5612dcaebf70 2024-01-31T05:11:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.025+0000 7f68a9ffb640 10 client.15507 handle_command_reply: tid=0 2024-01-31T05:11:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.026+0000 7f68cb24b740 1 client.15507 shutdown 2024-01-31T05:11:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.026+0000 7f68cb24b740 1 -- 172.21.15.99:0/3412344432 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612dcadbdd0 msgr2=0x5612dcae7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.026+0000 7f68cb24b740 1 --2- 172.21.15.99:0/3412344432 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612dcadbdd0 0x5612dcae7670 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f68bc012e10 tx=0x7f68bc004730 comp rx=0 tx=0).stop 2024-01-31T05:11:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.026+0000 7f68cb24b740 1 -- 172.21.15.99:0/3412344432 shutdown_connections 2024-01-31T05:11:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.026+0000 7f68cb24b740 1 --2- 172.21.15.99:0/3412344432 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612dcadbdd0 0x5612dcae7670 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.026+0000 7f68cb24b740 1 --2- 172.21.15.99:0/3412344432 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5612dcad6c60 0x5612dcae0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.026+0000 7f68cb24b740 1 --2- 172.21.15.99:0/3412344432 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5612dcaebf70 0x5612dcaee3b0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.026+0000 7f68cb24b740 1 --2- 172.21.15.99:0/3412344432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612dcad6270 0x5612dcae00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.026+0000 7f68cb24b740 1 -- 172.21.15.99:0/3412344432 >> 172.21.15.99:0/3412344432 conn(0x5612dcad17e0 msgr2=0x5612dcad0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.026+0000 7f68a9ffb640 0 client.15507 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:11:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.026+0000 7f68cb24b740 1 -- 172.21.15.99:0/3412344432 shutdown_connections 2024-01-31T05:11:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.026+0000 7f68cb24b740 1 -- 172.21.15.99:0/3412344432 wait complete. 2024-01-31T05:11:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.026+0000 7f68cb24b740 20 client.15507 trim_cache size 0 max 16384 2024-01-31T05:11:53.043 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.039+0000 7f68cb24b740 1 Processor -- start 2024-01-31T05:11:53.043 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.039+0000 7f68cb24b740 1 -- start start 2024-01-31T05:11:53.044 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.039+0000 7f68cb24b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5612dcad6270 0x5612dcad7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:53.044 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.039+0000 7f68cb24b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612dcad6c60 0x5612dcae7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:53.044 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.039+0000 7f68cb24b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612dcadbdd0 0x5612dcad83a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:53.044 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.039+0000 7f68cb24b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612dca38010 con 0x5612dcadbdd0 2024-01-31T05:11:53.044 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.039+0000 7f68cb24b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612dcacbe30 con 0x5612dcad6c60 2024-01-31T05:11:53.044 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.039+0000 7f68cb24b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612dcaea590 con 0x5612dcad6270 2024-01-31T05:11:53.044 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.039+0000 7f68c5a24640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612dcadbdd0 0x5612dcad83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:53.044 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.039+0000 7f68c5a24640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612dcadbdd0 0x5612dcad83a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50920/0 (socket says 172.21.15.99:50920) 2024-01-31T05:11:53.044 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.039+0000 7f68c5a24640 1 -- 172.21.15.99:0/4063259171 learned_addr learned my addr 172.21.15.99:0/4063259171 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:53.044 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.039+0000 7f68c5a24640 1 --2- 172.21.15.99:0/4063259171 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5612dcad6270 0x5612dcad7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:53.044 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.039+0000 7f68c6225640 1 --2- 172.21.15.99:0/4063259171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612dcad6c60 0x5612dcae7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:53.044 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.040+0000 7f68c5a24640 1 -- 172.21.15.99:0/4063259171 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5612dcad6270 msgr2=0x5612dcad7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:53.044 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.040+0000 7f68c5a24640 1 --2- 172.21.15.99:0/4063259171 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5612dcad6270 0x5612dcad7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:53.045 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.040+0000 7f68c5a24640 1 -- 172.21.15.99:0/4063259171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612dcad6c60 msgr2=0x5612dcae7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:53.045 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.040+0000 7f68c5a24640 1 --2- 172.21.15.99:0/4063259171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612dcad6c60 0x5612dcae7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:53.045 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.040+0000 7f68c5a24640 1 -- 172.21.15.99:0/4063259171 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5612dc9da030 con 0x5612dcadbdd0 2024-01-31T05:11:53.045 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.040+0000 7f68c6225640 1 --2- 172.21.15.99:0/4063259171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612dcad6c60 0x5612dcae7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:11:53.045 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.040+0000 7f68c5a24640 1 --2- 172.21.15.99:0/4063259171 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612dcadbdd0 0x5612dcad83a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f68bc0126c0 tx=0x7f68bc005cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a5ed278451df40a server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:53.045 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.040+0000 7f68abfff640 1 -- 172.21.15.99:0/4063259171 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68bc011580 con 0x5612dcadbdd0 2024-01-31T05:11:53.045 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.040+0000 7f68abfff640 1 -- 172.21.15.99:0/4063259171 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f68bc018030 con 0x5612dcadbdd0 2024-01-31T05:11:53.045 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.040+0000 7f68abfff640 1 -- 172.21.15.99:0/4063259171 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68bc02b720 con 0x5612dcadbdd0 2024-01-31T05:11:53.045 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.040+0000 7f68cb24b740 1 -- 172.21.15.99:0/4063259171 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612dcadbdd0 msgr2=0x5612dcad83a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:53.045 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.040+0000 7f68cb24b740 1 --2- 172.21.15.99:0/4063259171 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612dcadbdd0 0x5612dcad83a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f68bc0126c0 tx=0x7f68bc005cc0 comp rx=0 tx=0).stop 2024-01-31T05:11:53.045 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.040+0000 7f68cb24b740 1 -- 172.21.15.99:0/4063259171 shutdown_connections 2024-01-31T05:11:53.045 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.040+0000 7f68cb24b740 1 --2- 172.21.15.99:0/4063259171 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612dcadbdd0 0x5612dcad83a0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:53.045 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.040+0000 7f68cb24b740 1 --2- 172.21.15.99:0/4063259171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612dcad6c60 0x5612dcae7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:53.046 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.040+0000 7f68cb24b740 1 --2- 172.21.15.99:0/4063259171 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5612dcad6270 0x5612dcad7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:53.046 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.040+0000 7f68cb24b740 1 -- 172.21.15.99:0/4063259171 >> 172.21.15.99:0/4063259171 conn(0x5612dcad17e0 msgr2=0x5612dcae00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:53.046 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.041+0000 7f68cb24b740 1 -- 172.21.15.99:0/4063259171 shutdown_connections 2024-01-31T05:11:53.046 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.041+0000 7f68cb24b740 1 -- 172.21.15.99:0/4063259171 wait complete. 2024-01-31T05:11:53.046 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.041+0000 7f68cb24b740 1 -- start start 2024-01-31T05:11:53.046 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.041+0000 7f68cb24b740 1 Processor -- start 2024-01-31T05:11:53.046 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.041+0000 7f68cb24b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612dcad6270 0x5612dcae5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:53.046 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.041+0000 7f68cb24b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5612dcad6c60 0x5612dcae62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:53.046 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.041+0000 7f68cb24b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612dcadbdd0 0x5612dcae6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:53.046 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.041+0000 7f68cb24b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612dcae79e0 con 0x5612dcadbdd0 2024-01-31T05:11:53.046 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.041+0000 7f68cb24b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612dcb424c0 con 0x5612dcad6270 2024-01-31T05:11:53.046 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.041+0000 7f68cb24b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612dcb42680 con 0x5612dcad6c60 2024-01-31T05:11:53.046 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.041+0000 7f68cb24b740 10 client.0 _ll_register_callbacks cb 0x7f68b0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:11:53.046 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.041+0000 7f68c5a24640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612dcadbdd0 0x5612dcae6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:53.047 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.041+0000 7f68c5a24640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612dcadbdd0 0x5612dcae6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50924/0 (socket says 172.21.15.99:50924) 2024-01-31T05:11:53.047 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.041+0000 7f68c5a24640 1 -- 172.21.15.99:0/3862383883 learned_addr learned my addr 172.21.15.99:0/3862383883 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:53.047 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.041+0000 7f68c5a24640 1 --2- 172.21.15.99:0/3862383883 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612dcad6270 0x5612dcae5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:53.047 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.041+0000 7f68c6225640 1 --2- 172.21.15.99:0/3862383883 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5612dcad6c60 0x5612dcae62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:53.047 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.042+0000 7f68c5a24640 1 -- 172.21.15.99:0/3862383883 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5612dcad6c60 msgr2=0x5612dcae62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:53.047 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.042+0000 7f68c5a24640 1 --2- 172.21.15.99:0/3862383883 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5612dcad6c60 0x5612dcae62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:53.047 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.042+0000 7f68c5a24640 1 -- 172.21.15.99:0/3862383883 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612dcad6270 msgr2=0x5612dcae5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:53.047 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.042+0000 7f68c5a24640 1 --2- 172.21.15.99:0/3862383883 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612dcad6270 0x5612dcae5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:53.047 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.042+0000 7f68c5a24640 1 -- 172.21.15.99:0/3862383883 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5612dca3d6a0 con 0x5612dcadbdd0 2024-01-31T05:11:53.047 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.042+0000 7f68c6225640 1 --2- 172.21.15.99:0/3862383883 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5612dcad6c60 0x5612dcae62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:11:53.047 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.042+0000 7f68c5a24640 1 --2- 172.21.15.99:0/3862383883 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612dcadbdd0 0x5612dcae6810 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f68bc005ff0 tx=0x7f68bc005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78fee040e66fda25 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:53.047 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.042+0000 7f68a9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:11:53.047 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.042+0000 7f68a9ffb640 1 -- 172.21.15.99:0/3862383883 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68bc02b6a0 con 0x5612dcadbdd0 2024-01-31T05:11:53.047 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.042+0000 7f68a9ffb640 1 -- 172.21.15.99:0/3862383883 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f68bc031060 con 0x5612dcadbdd0 2024-01-31T05:11:53.047 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.042+0000 7f68cb24b740 1 -- 172.21.15.99:0/3862383883 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f68b0004040 con 0x5612dcadbdd0 2024-01-31T05:11:53.048 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.042+0000 7f68a9ffb640 1 -- 172.21.15.99:0/3862383883 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68bc02b800 con 0x5612dcadbdd0 2024-01-31T05:11:53.048 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.042+0000 7f68cb24b740 10 client.15513 fetch_fsmap learned FSMap version 27 2024-01-31T05:11:53.048 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.042+0000 7f68cb24b740 1 -- 172.21.15.99:0/3862383883 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5612dc9ffa50 con 0x5612dcadbdd0 2024-01-31T05:11:53.048 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.042+0000 7f68a9ffb640 1 -- 172.21.15.99:0/3862383883 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f68bc043020 con 0x5612dcadbdd0 2024-01-31T05:11:53.048 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.042+0000 7f68a9ffb640 1 -- 172.21.15.99:0/3862383883 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f68bc03e820 con 0x5612dcadbdd0 2024-01-31T05:11:53.048 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.042+0000 7f68cb24b740 10 client.15513 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:11:53.048 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.042+0000 7f68cb24b740 10 client.15513 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-01-31T05:11:53.048 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.042+0000 7f68cb24b740 20 client.15513 populate_metadata read hostname 'smithi099' 2024-01-31T05:11:53.048 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.042+0000 7f68cb24b740 1 --2- 172.21.15.99:0/3862383883 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5612dcb43ef0 0x5612dcb46310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:53.048 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.042+0000 7f68cb24b740 4 client.15513 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-01-31T05:11:53.048 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.042+0000 7f68cb24b740 1 -- 172.21.15.99:0/3862383883 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5612dc73e600 con 0x5612dcb43ef0 2024-01-31T05:11:53.048 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.043+0000 7f68c6225640 1 --2- 172.21.15.99:0/3862383883 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5612dcb43ef0 0x5612dcb46310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:53.048 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.043+0000 7f68c6225640 1 --2- 172.21.15.99:0/3862383883 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5612dcb43ef0 0x5612dcb46310 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f53ab475ed78824 server_cookie=4a585660b1bdac40 in_seq=0 out_seq=0 2024-01-31T05:11:53.049 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.043+0000 7f68a9ffb640 10 client.15513 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:11:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.047+0000 7f68a9ffb640 1 -- 172.21.15.99:0/3862383883 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5612dc73e600 con 0x5612dcb43ef0 2024-01-31T05:11:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.047+0000 7f68a9ffb640 10 client.15513 handle_command_reply: tid=0 2024-01-31T05:11:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.047+0000 7f68cb24b740 1 client.15513 shutdown 2024-01-31T05:11:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.047+0000 7f68cb24b740 1 -- 172.21.15.99:0/3862383883 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612dcadbdd0 msgr2=0x5612dcae6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.047+0000 7f68cb24b740 1 --2- 172.21.15.99:0/3862383883 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612dcadbdd0 0x5612dcae6810 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f68bc005ff0 tx=0x7f68bc005740 comp rx=0 tx=0).stop 2024-01-31T05:11:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.047+0000 7f68cb24b740 1 -- 172.21.15.99:0/3862383883 shutdown_connections 2024-01-31T05:11:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.047+0000 7f68cb24b740 1 --2- 172.21.15.99:0/3862383883 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612dcadbdd0 0x5612dcae6810 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.047+0000 7f68cb24b740 1 --2- 172.21.15.99:0/3862383883 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5612dcad6c60 0x5612dcae62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.047+0000 7f68cb24b740 1 --2- 172.21.15.99:0/3862383883 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5612dcb43ef0 0x5612dcb46310 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.047+0000 7f68cb24b740 1 --2- 172.21.15.99:0/3862383883 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5612dcad6270 0x5612dcae5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.047+0000 7f68a9ffb640 0 client.15513 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:11:53.051 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.047+0000 7f68cb24b740 1 -- 172.21.15.99:0/3862383883 >> 172.21.15.99:0/3862383883 conn(0x5612dcad17e0 msgr2=0x5612dcae0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:53.051 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.047+0000 7f68cb24b740 1 -- 172.21.15.99:0/3862383883 shutdown_connections 2024-01-31T05:11:53.051 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.047+0000 7f68cb24b740 1 -- 172.21.15.99:0/3862383883 wait complete. 2024-01-31T05:11:53.051 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.047+0000 7f68cb24b740 20 client.15513 trim_cache size 0 max 16384 2024-01-31T05:11:53.051 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout:{ 2024-01-31T05:11:53.051 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout: "message": "", 2024-01-31T05:11:53.051 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout: "return_code": 0 2024-01-31T05:11:53.051 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout:} 2024-01-31T05:11:53.052 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.047+0000 7f68c8489640 1 -- 172.21.15.99:0/3728544410 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f68ac0a14a0 msgr2=0x7f68ac0a3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:53.052 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.047+0000 7f68c8489640 1 --2- 172.21.15.99:0/3728544410 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f68ac0a14a0 0x7f68ac0a3960 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f68b80a1dc0 tx=0x7f68b806bf80 comp rx=0 tx=0).stop 2024-01-31T05:11:53.052 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.047+0000 7f68c8489640 1 -- 172.21.15.99:0/3728544410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68c01028d0 msgr2=0x7f68c019e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:53.052 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.047+0000 7f68c8489640 1 --2- 172.21.15.99:0/3728544410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68c01028d0 0x7f68c019e1c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f68b800eaa0 tx=0x7f68b800ef60 comp rx=0 tx=0).stop 2024-01-31T05:11:53.052 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.047+0000 7f68c8489640 1 -- 172.21.15.99:0/3728544410 shutdown_connections 2024-01-31T05:11:53.052 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.047+0000 7f68c8489640 1 --2- 172.21.15.99:0/3728544410 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f68ac0a14a0 0x7f68ac0a3960 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:53.052 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.047+0000 7f68c8489640 1 --2- 172.21.15.99:0/3728544410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68c01028d0 0x7f68c019e1c0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:53.052 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.047+0000 7f68c8489640 1 --2- 172.21.15.99:0/3728544410 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68c0101f10 0x7f68c0197190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:53.053 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.047+0000 7f68c8489640 1 --2- 172.21.15.99:0/3728544410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68c0100d20 0x7f68c0196c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:53.053 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.047+0000 7f68c8489640 1 -- 172.21.15.99:0/3728544410 >> 172.21.15.99:0/3728544410 conn(0x7f68c00fc2b0 msgr2=0x7f68c0105140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:53.053 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.048+0000 7f68c8489640 1 -- 172.21.15.99:0/3728544410 shutdown_connections 2024-01-31T05:11:53.053 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:11:53.048+0000 7f68c8489640 1 -- 172.21.15.99:0/3728544410 wait complete. 2024-01-31T05:11:53.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:53 smithi099 ceph-mon[31615]: pgmap v364: 97 pgs: 97 active+clean; 658 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.5 KiB/s wr, 14 op/s 2024-01-31T05:11:53.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:53 smithi181 ceph-mon[36434]: pgmap v364: 97 pgs: 97 active+clean; 658 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.5 KiB/s wr, 14 op/s 2024-01-31T05:11:53.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:53 smithi179 ceph-mon[35652]: pgmap v364: 97 pgs: 97 active+clean; 658 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.5 KiB/s wr, 14 op/s 2024-01-31T05:11:56.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:55 smithi099 ceph-mon[31615]: pgmap v365: 97 pgs: 97 active+clean; 658 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 682 B/s wr, 11 op/s 2024-01-31T05:11:56.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:55 smithi181 ceph-mon[36434]: pgmap v365: 97 pgs: 97 active+clean; 658 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 682 B/s wr, 11 op/s 2024-01-31T05:11:56.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:55 smithi179 ceph-mon[35652]: pgmap v365: 97 pgs: 97 active+clean; 658 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 682 B/s wr, 11 op/s 2024-01-31T05:11:57.087 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-01-31T05:11:57.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.207+0000 7f34a5f05640 1 -- 172.21.15.99:0/1915532466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f34a01040a0 msgr2=0x7f34a0106490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:57.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.207+0000 7f34a5f05640 1 --2- 172.21.15.99:0/1915532466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f34a01040a0 0x7f34a0106490 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f3490009900 tx=0x7f349002bc30 comp rx=0 tx=0).stop 2024-01-31T05:11:57.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.207+0000 7f34a5f05640 1 -- 172.21.15.99:0/1915532466 shutdown_connections 2024-01-31T05:11:57.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.207+0000 7f34a5f05640 1 --2- 172.21.15.99:0/1915532466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34a01069d0 0x7f34a0108e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.207+0000 7f34a5f05640 1 --2- 172.21.15.99:0/1915532466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f34a01040a0 0x7f34a0106490 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.207+0000 7f34a5f05640 1 --2- 172.21.15.99:0/1915532466 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34a0101770 0x7f34a0103b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.207+0000 7f34a5f05640 1 -- 172.21.15.99:0/1915532466 >> 172.21.15.99:0/1915532466 conn(0x7f34a00fb180 msgr2=0x7f34a00fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:57.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.207+0000 7f34a5f05640 1 -- 172.21.15.99:0/1915532466 shutdown_connections 2024-01-31T05:11:57.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.207+0000 7f34a5f05640 1 -- 172.21.15.99:0/1915532466 wait complete. 2024-01-31T05:11:57.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.208+0000 7f34a5f05640 1 Processor -- start 2024-01-31T05:11:57.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.208+0000 7f34a5f05640 1 -- start start 2024-01-31T05:11:57.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.208+0000 7f34a5f05640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34a0101770 0x7f34a0196ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.208+0000 7f34a5f05640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f34a01040a0 0x7f34a01971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.208+0000 7f34a5f05640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34a01069d0 0x7f34a019e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.208+0000 7f34a5f05640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a019e7b0 con 0x7f34a01040a0 2024-01-31T05:11:57.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.208+0000 7f34a5f05640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a019e920 con 0x7f34a01069d0 2024-01-31T05:11:57.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.208+0000 7f34a5f05640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a019eae0 con 0x7f34a0101770 2024-01-31T05:11:57.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.208+0000 7f349effd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f34a01040a0 0x7f34a01971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.208+0000 7f349effd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f34a01040a0 0x7f34a01971e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47946/0 (socket says 172.21.15.99:47946) 2024-01-31T05:11:57.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.208+0000 7f349effd640 1 -- 172.21.15.99:0/3941315379 learned_addr learned my addr 172.21.15.99:0/3941315379 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:57.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.208+0000 7f349ffff640 1 --2- 172.21.15.99:0/3941315379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34a01069d0 0x7f34a019e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.208+0000 7f349f7fe640 1 --2- 172.21.15.99:0/3941315379 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34a0101770 0x7f34a0196ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.209+0000 7f349effd640 1 -- 172.21.15.99:0/3941315379 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34a0101770 msgr2=0x7f34a0196ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:57.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.209+0000 7f349effd640 1 --2- 172.21.15.99:0/3941315379 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34a0101770 0x7f34a0196ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.209+0000 7f349effd640 1 -- 172.21.15.99:0/3941315379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34a01069d0 msgr2=0x7f34a019e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:57.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.209+0000 7f349effd640 1 --2- 172.21.15.99:0/3941315379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34a01069d0 0x7f34a019e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.209+0000 7f349effd640 1 -- 172.21.15.99:0/3941315379 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3490009560 con 0x7f34a01040a0 2024-01-31T05:11:57.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.209+0000 7f349f7fe640 1 --2- 172.21.15.99:0/3941315379 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34a0101770 0x7f34a0196ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:11:57.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.209+0000 7f349effd640 1 --2- 172.21.15.99:0/3941315379 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f34a01040a0 0x7f34a01971e0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f3490000c00 tx=0x7f34900042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:57.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.209+0000 7f349cff9640 1 -- 172.21.15.99:0/3941315379 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3490004ac0 con 0x7f34a01040a0 2024-01-31T05:11:57.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.209+0000 7f349cff9640 1 -- 172.21.15.99:0/3941315379 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f34900044e0 con 0x7f34a01040a0 2024-01-31T05:11:57.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.209+0000 7f34a5f05640 1 -- 172.21.15.99:0/3941315379 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a019ed60 con 0x7f34a01040a0 2024-01-31T05:11:57.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.209+0000 7f349cff9640 1 -- 172.21.15.99:0/3941315379 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349003e450 con 0x7f34a01040a0 2024-01-31T05:11:57.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.209+0000 7f34a5f05640 1 -- 172.21.15.99:0/3941315379 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a019f230 con 0x7f34a01040a0 2024-01-31T05:11:57.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.211+0000 7f349cff9640 1 -- 172.21.15.99:0/3941315379 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f3490004dd0 con 0x7f34a01040a0 2024-01-31T05:11:57.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.212+0000 7f34a8da5740 1 Processor -- start 2024-01-31T05:11:57.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.212+0000 7f34a8da5740 1 -- start start 2024-01-31T05:11:57.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.212+0000 7f34a8da5740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8f52fea20 0x55f8f52fee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.212+0000 7f34a8da5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f8f52ff410 0x55f8f5303f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.212+0000 7f34a8da5740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8f5304580 0x55f8f5306a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.212+0000 7f34a8da5740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8f526d380 con 0x55f8f5304580 2024-01-31T05:11:57.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.212+0000 7f34a8da5740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8f526aa70 con 0x55f8f52fea20 2024-01-31T05:11:57.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.212+0000 7f34a8da5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8f5266360 con 0x55f8f52ff410 2024-01-31T05:11:57.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.212+0000 7f349cff9640 1 --2- 172.21.15.99:0/3941315379 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f34880a13f0 0x7f34880a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.212+0000 7f349effd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8f5304580 0x55f8f5306a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.212+0000 7f349effd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8f5304580 0x55f8f5306a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47954/0 (socket says 172.21.15.99:47954) 2024-01-31T05:11:57.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.212+0000 7f349effd640 1 -- 172.21.15.99:0/3143755894 learned_addr learned my addr 172.21.15.99:0/3143755894 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:57.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.212+0000 7f349ffff640 1 --2- 172.21.15.99:0/3941315379 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f34880a13f0 0x7f34880a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.212+0000 7f349f7fe640 1 --2- 172.21.15.99:0/3143755894 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f8f52ff410 0x55f8f5303f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.212+0000 7f349ffff640 1 --2- 172.21.15.99:0/3143755894 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8f52fea20 0x55f8f52fee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.212+0000 7f349cff9640 1 -- 172.21.15.99:0/3941315379 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f34900ef310 con 0x7f34a01040a0 2024-01-31T05:11:57.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.212+0000 7f349effd640 1 -- 172.21.15.99:0/3143755894 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f8f52ff410 msgr2=0x55f8f5303f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:57.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.212+0000 7f349effd640 1 --2- 172.21.15.99:0/3143755894 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f8f52ff410 0x55f8f5303f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.212+0000 7f349effd640 1 -- 172.21.15.99:0/3143755894 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8f52fea20 msgr2=0x55f8f52fee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:57.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.212+0000 7f349effd640 1 --2- 172.21.15.99:0/3143755894 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8f52fea20 0x55f8f52fee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.212+0000 7f349effd640 1 -- 172.21.15.99:0/3143755894 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8f52287e0 con 0x55f8f5304580 2024-01-31T05:11:57.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.213+0000 7f349ffff640 1 --2- 172.21.15.99:0/3941315379 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f34880a13f0 0x7f34880a38b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3498007310 tx=0x7f3498007dd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:57.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.213+0000 7f349effd640 1 --2- 172.21.15.99:0/3143755894 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8f5304580 0x55f8f5306a10 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f3490049000 tx=0x7f349004f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0abd3979ef6d20 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:57.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.213+0000 7f3485ffb640 1 -- 172.21.15.99:0/3143755894 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34900ef170 con 0x55f8f5304580 2024-01-31T05:11:57.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.213+0000 7f3485ffb640 1 -- 172.21.15.99:0/3143755894 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f34900bcd40 con 0x55f8f5304580 2024-01-31T05:11:57.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.213+0000 7f3485ffb640 1 -- 172.21.15.99:0/3143755894 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34900b8d50 con 0x55f8f5304580 2024-01-31T05:11:57.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.213+0000 7f34a8da5740 1 -- 172.21.15.99:0/3143755894 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8f5304580 msgr2=0x55f8f5306a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:57.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.213+0000 7f34a8da5740 1 --2- 172.21.15.99:0/3143755894 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8f5304580 0x55f8f5306a10 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f3490049000 tx=0x7f349004f000 comp rx=0 tx=0).stop 2024-01-31T05:11:57.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.213+0000 7f34a8da5740 1 -- 172.21.15.99:0/3143755894 shutdown_connections 2024-01-31T05:11:57.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.213+0000 7f34a8da5740 1 --2- 172.21.15.99:0/3143755894 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8f5304580 0x55f8f5306a10 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.213+0000 7f34a8da5740 1 --2- 172.21.15.99:0/3143755894 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f8f52ff410 0x55f8f5303f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.213+0000 7f34a8da5740 1 --2- 172.21.15.99:0/3143755894 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8f52fea20 0x55f8f52fee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.213+0000 7f34a8da5740 1 -- 172.21.15.99:0/3143755894 >> 172.21.15.99:0/3143755894 conn(0x55f8f52f9f90 msgr2=0x55f8f52fa390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:57.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.214+0000 7f34a8da5740 1 -- 172.21.15.99:0/3143755894 shutdown_connections 2024-01-31T05:11:57.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.214+0000 7f34a8da5740 1 -- 172.21.15.99:0/3143755894 wait complete. 2024-01-31T05:11:57.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.214+0000 7f34a8da5740 1 -- start start 2024-01-31T05:11:57.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.214+0000 7f34a8da5740 1 Processor -- start 2024-01-31T05:11:57.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.214+0000 7f34a8da5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f8f52fea20 0x55f8f5308970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.214+0000 7f34a8da5740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8f52ff410 0x55f8f5308eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.214+0000 7f34a8da5740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8f5304580 0x55f8f530fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.214+0000 7f34a8da5740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8f521f750 con 0x55f8f5304580 2024-01-31T05:11:57.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.214+0000 7f34a8da5740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8f521f3f0 con 0x55f8f52ff410 2024-01-31T05:11:57.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.214+0000 7f34a8da5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8f51e43f0 con 0x55f8f52fea20 2024-01-31T05:11:57.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.214+0000 7f34a8da5740 10 client.0 _ll_register_callbacks cb 0x55f8f5221b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:11:57.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.214+0000 7f349ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8f5304580 0x55f8f530fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.214+0000 7f349ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8f5304580 0x55f8f530fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47968/0 (socket says 172.21.15.99:47968) 2024-01-31T05:11:57.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.214+0000 7f349ffff640 1 -- 172.21.15.99:0/1176822918 learned_addr learned my addr 172.21.15.99:0/1176822918 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:57.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.215+0000 7f349effd640 1 --2- 172.21.15.99:0/1176822918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8f52ff410 0x55f8f5308eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.215+0000 7f349f7fe640 1 --2- 172.21.15.99:0/1176822918 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f8f52fea20 0x55f8f5308970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.215+0000 7f349ffff640 1 -- 172.21.15.99:0/1176822918 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f8f52fea20 msgr2=0x55f8f5308970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:57.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.215+0000 7f349ffff640 1 --2- 172.21.15.99:0/1176822918 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f8f52fea20 0x55f8f5308970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.215+0000 7f349ffff640 1 -- 172.21.15.99:0/1176822918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8f52ff410 msgr2=0x55f8f5308eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:57.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.215+0000 7f349ffff640 1 --2- 172.21.15.99:0/1176822918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8f52ff410 0x55f8f5308eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.215+0000 7f349ffff640 1 -- 172.21.15.99:0/1176822918 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a019f230 con 0x55f8f5304580 2024-01-31T05:11:57.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.215+0000 7f349ffff640 1 --2- 172.21.15.99:0/1176822918 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8f5304580 0x55f8f530fef0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f34980126b0 tx=0x7f3498007520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28f78fb6861a9b93 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:57.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.215+0000 7f347effd640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:11:57.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.215+0000 7f347effd640 1 -- 172.21.15.99:0/1176822918 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3498004d20 con 0x55f8f5304580 2024-01-31T05:11:57.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.215+0000 7f347effd640 1 -- 172.21.15.99:0/1176822918 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f3498020660 con 0x55f8f5304580 2024-01-31T05:11:57.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.215+0000 7f34a8da5740 1 -- 172.21.15.99:0/1176822918 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f8f523b210 con 0x55f8f5304580 2024-01-31T05:11:57.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.215+0000 7f347effd640 1 -- 172.21.15.99:0/1176822918 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3498004e80 con 0x55f8f5304580 2024-01-31T05:11:57.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.215+0000 7f34a8da5740 10 client.15525 fetch_fsmap learned FSMap version 27 2024-01-31T05:11:57.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.215+0000 7f34a8da5740 1 -- 172.21.15.99:0/1176822918 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55f8f52649e0 con 0x55f8f5304580 2024-01-31T05:11:57.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.215+0000 7f347effd640 1 -- 172.21.15.99:0/1176822918 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f8f523b210 con 0x55f8f5304580 2024-01-31T05:11:57.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.215+0000 7f347effd640 1 -- 172.21.15.99:0/1176822918 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3498005380 con 0x55f8f5304580 2024-01-31T05:11:57.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.215+0000 7f34a8da5740 10 client.15525 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:11:57.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.215+0000 7f34a8da5740 10 client.15525 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-01-31T05:11:57.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.215+0000 7f34a8da5740 20 client.15525 populate_metadata read hostname 'smithi099' 2024-01-31T05:11:57.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.216+0000 7f34a8da5740 1 --2- 172.21.15.99:0/1176822918 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55f8f5314bf0 0x55f8f5317010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.216+0000 7f34a8da5740 4 client.15525 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:11:57.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.216+0000 7f34a8da5740 1 -- 172.21.15.99:0/1176822918 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f8f5238b20 con 0x55f8f5314bf0 2024-01-31T05:11:57.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.216+0000 7f349f7fe640 1 --2- 172.21.15.99:0/1176822918 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55f8f5314bf0 0x55f8f5317010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.216+0000 7f349f7fe640 1 --2- 172.21.15.99:0/1176822918 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55f8f5314bf0 0x55f8f5317010 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=258ca4d9d3066f6 server_cookie=c781d6f29c8996bb in_seq=0 out_seq=0 2024-01-31T05:11:57.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.216+0000 7f347effd640 10 client.15525 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:11:57.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.217+0000 7f347effd640 1 -- 172.21.15.99:0/1176822918 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f8f5238b20 con 0x55f8f5314bf0 2024-01-31T05:11:57.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.217+0000 7f347effd640 10 client.15525 handle_command_reply: tid=0 2024-01-31T05:11:57.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.217+0000 7f34a8da5740 1 client.15525 shutdown 2024-01-31T05:11:57.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.217+0000 7f34a8da5740 1 -- 172.21.15.99:0/1176822918 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8f5304580 msgr2=0x55f8f530fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:57.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.217+0000 7f34a8da5740 1 --2- 172.21.15.99:0/1176822918 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8f5304580 0x55f8f530fef0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f34980126b0 tx=0x7f3498007520 comp rx=0 tx=0).stop 2024-01-31T05:11:57.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.217+0000 7f34a8da5740 1 -- 172.21.15.99:0/1176822918 shutdown_connections 2024-01-31T05:11:57.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.217+0000 7f34a8da5740 1 --2- 172.21.15.99:0/1176822918 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8f5304580 0x55f8f530fef0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.217+0000 7f34a8da5740 1 --2- 172.21.15.99:0/1176822918 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55f8f5314bf0 0x55f8f5317010 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.217+0000 7f34a8da5740 1 --2- 172.21.15.99:0/1176822918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8f52ff410 0x55f8f5308eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.217+0000 7f34a8da5740 1 --2- 172.21.15.99:0/1176822918 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f8f52fea20 0x55f8f5308970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.217+0000 7f347effd640 0 client.15525 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:11:57.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.217+0000 7f34a8da5740 1 -- 172.21.15.99:0/1176822918 >> 172.21.15.99:0/1176822918 conn(0x55f8f52f9f90 msgr2=0x55f8f52f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:57.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.217+0000 7f34a8da5740 1 -- 172.21.15.99:0/1176822918 shutdown_connections 2024-01-31T05:11:57.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.217+0000 7f34a8da5740 1 -- 172.21.15.99:0/1176822918 wait complete. 2024-01-31T05:11:57.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.217+0000 7f34a8da5740 20 client.15525 trim_cache size 0 max 16384 2024-01-31T05:11:57.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.232+0000 7f34a8da5740 1 Processor -- start 2024-01-31T05:11:57.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.232+0000 7f34a8da5740 1 -- start start 2024-01-31T05:11:57.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.232+0000 7f34a8da5740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8f52fea20 0x55f8f5308970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.232+0000 7f34a8da5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f8f52ff410 0x55f8f5308eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.232+0000 7f34a8da5740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8f5304580 0x55f8f530feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.232+0000 7f34a8da5740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8f526d380 con 0x55f8f52fea20 2024-01-31T05:11:57.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.232+0000 7f34a8da5740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8f5307690 con 0x55f8f5304580 2024-01-31T05:11:57.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.232+0000 7f34a8da5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8f5310b70 con 0x55f8f52ff410 2024-01-31T05:11:57.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.233+0000 7f349f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8f52fea20 0x55f8f5308970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.233+0000 7f349f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8f52fea20 0x55f8f5308970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47970/0 (socket says 172.21.15.99:47970) 2024-01-31T05:11:57.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.233+0000 7f349f7fe640 1 -- 172.21.15.99:0/1739957024 learned_addr learned my addr 172.21.15.99:0/1739957024 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:57.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.233+0000 7f349f7fe640 1 -- 172.21.15.99:0/1739957024 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f8f52ff410 msgr2=0x55f8f5308eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:57.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.233+0000 7f349f7fe640 1 --2- 172.21.15.99:0/1739957024 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f8f52ff410 0x55f8f5308eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.233+0000 7f349f7fe640 1 -- 172.21.15.99:0/1739957024 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8f5304580 msgr2=0x55f8f530feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:57.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.233+0000 7f349f7fe640 1 --2- 172.21.15.99:0/1739957024 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8f5304580 0x55f8f530feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.233+0000 7f349f7fe640 1 -- 172.21.15.99:0/1739957024 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8f52014f0 con 0x55f8f52fea20 2024-01-31T05:11:57.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.233+0000 7f349f7fe640 1 --2- 172.21.15.99:0/1739957024 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8f52fea20 0x55f8f5308970 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f3494004550 tx=0x7f3494009e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7fc0557a5985d5a server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:57.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.233+0000 7f34857fa640 1 -- 172.21.15.99:0/1739957024 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3494017040 con 0x55f8f52fea20 2024-01-31T05:11:57.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.233+0000 7f34857fa640 1 -- 172.21.15.99:0/1739957024 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f349401d8d0 con 0x55f8f52fea20 2024-01-31T05:11:57.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.233+0000 7f34857fa640 1 -- 172.21.15.99:0/1739957024 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3494012d50 con 0x55f8f52fea20 2024-01-31T05:11:57.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.234+0000 7f34a8da5740 1 -- 172.21.15.99:0/1739957024 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8f52fea20 msgr2=0x55f8f5308970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:57.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.234+0000 7f34a8da5740 1 --2- 172.21.15.99:0/1739957024 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8f52fea20 0x55f8f5308970 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f3494004550 tx=0x7f3494009e80 comp rx=0 tx=0).stop 2024-01-31T05:11:57.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.234+0000 7f34a8da5740 1 -- 172.21.15.99:0/1739957024 shutdown_connections 2024-01-31T05:11:57.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.234+0000 7f34a8da5740 1 --2- 172.21.15.99:0/1739957024 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8f5304580 0x55f8f530feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.234+0000 7f34a8da5740 1 --2- 172.21.15.99:0/1739957024 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f8f52ff410 0x55f8f5308eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.234+0000 7f34a8da5740 1 --2- 172.21.15.99:0/1739957024 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8f52fea20 0x55f8f5308970 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.234+0000 7f34a8da5740 1 -- 172.21.15.99:0/1739957024 >> 172.21.15.99:0/1739957024 conn(0x55f8f52f9f90 msgr2=0x55f8f531b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:57.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.234+0000 7f34a8da5740 1 -- 172.21.15.99:0/1739957024 shutdown_connections 2024-01-31T05:11:57.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.234+0000 7f34a8da5740 1 -- 172.21.15.99:0/1739957024 wait complete. 2024-01-31T05:11:57.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.234+0000 7f34a8da5740 1 -- start start 2024-01-31T05:11:57.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.234+0000 7f34a8da5740 1 Processor -- start 2024-01-31T05:11:57.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.234+0000 7f34a8da5740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8f52fea20 0x55f8f530fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.234+0000 7f34a8da5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f8f52ff410 0x55f8f530e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.234+0000 7f34a8da5740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8f5304580 0x55f8f530e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.234+0000 7f34a8da5740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8f52f9d00 con 0x55f8f52fea20 2024-01-31T05:11:57.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.234+0000 7f34a8da5740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8f530eca0 con 0x55f8f5304580 2024-01-31T05:11:57.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.234+0000 7f34a8da5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8f530ee60 con 0x55f8f52ff410 2024-01-31T05:11:57.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.234+0000 7f34a8da5740 10 client.0 _ll_register_callbacks cb 0x7f3498007940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:11:57.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.235+0000 7f349f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8f52fea20 0x55f8f530fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.235+0000 7f349f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8f52fea20 0x55f8f530fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47980/0 (socket says 172.21.15.99:47980) 2024-01-31T05:11:57.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.235+0000 7f349f7fe640 1 -- 172.21.15.99:0/2510361019 learned_addr learned my addr 172.21.15.99:0/2510361019 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:57.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.235+0000 7f349effd640 1 --2- 172.21.15.99:0/2510361019 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f8f52ff410 0x55f8f530e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.235+0000 7f349f7fe640 1 -- 172.21.15.99:0/2510361019 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f8f52ff410 msgr2=0x55f8f530e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:57.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.235+0000 7f349f7fe640 1 --2- 172.21.15.99:0/2510361019 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f8f52ff410 0x55f8f530e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.235+0000 7f349f7fe640 1 -- 172.21.15.99:0/2510361019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8f5304580 msgr2=0x55f8f530e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:57.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.235+0000 7f349f7fe640 1 --2- 172.21.15.99:0/2510361019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8f5304580 0x55f8f530e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.235+0000 7f349f7fe640 1 -- 172.21.15.99:0/2510361019 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3494009720 con 0x55f8f52fea20 2024-01-31T05:11:57.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.235+0000 7f349f7fe640 1 --2- 172.21.15.99:0/2510361019 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8f52fea20 0x55f8f530fba0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f3494000c00 tx=0x7f3494012670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1e5834dde8ca8cf server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:57.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.235+0000 7f347effd640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:11:57.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.235+0000 7f347effd640 1 -- 172.21.15.99:0/2510361019 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3494017040 con 0x55f8f52fea20 2024-01-31T05:11:57.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.235+0000 7f347effd640 1 -- 172.21.15.99:0/2510361019 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f349401d6d0 con 0x55f8f52fea20 2024-01-31T05:11:57.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.235+0000 7f34a8da5740 1 -- 172.21.15.99:0/2510361019 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f8f528dbd0 con 0x55f8f52fea20 2024-01-31T05:11:57.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.235+0000 7f347effd640 1 -- 172.21.15.99:0/2510361019 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3494003c40 con 0x55f8f52fea20 2024-01-31T05:11:57.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.235+0000 7f34a8da5740 10 client.15531 fetch_fsmap learned FSMap version 27 2024-01-31T05:11:57.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.235+0000 7f34a8da5740 1 -- 172.21.15.99:0/2510361019 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55f8f5227040 con 0x55f8f52fea20 2024-01-31T05:11:57.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.235+0000 7f347effd640 1 -- 172.21.15.99:0/2510361019 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f8f528dbd0 con 0x55f8f52fea20 2024-01-31T05:11:57.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.236+0000 7f347effd640 1 -- 172.21.15.99:0/2510361019 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3494026a00 con 0x55f8f52fea20 2024-01-31T05:11:57.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.236+0000 7f34a8da5740 10 client.15531 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:11:57.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.236+0000 7f34a8da5740 10 client.15531 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-01-31T05:11:57.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.236+0000 7f34a8da5740 20 client.15531 populate_metadata read hostname 'smithi099' 2024-01-31T05:11:57.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.236+0000 7f34a8da5740 1 --2- 172.21.15.99:0/2510361019 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55f8f536c690 0x55f8f536eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.236+0000 7f34a8da5740 4 client.15531 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-01-31T05:11:57.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.236+0000 7f34a8da5740 1 -- 172.21.15.99:0/2510361019 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f8f525f1f0 con 0x55f8f536c690 2024-01-31T05:11:57.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.236+0000 7f349effd640 1 --2- 172.21.15.99:0/2510361019 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55f8f536c690 0x55f8f536eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.236+0000 7f347effd640 10 client.15531 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:11:57.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.236+0000 7f349effd640 1 --2- 172.21.15.99:0/2510361019 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55f8f536c690 0x55f8f536eab0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d78637c3fb58d838 server_cookie=2b29ac0f4d1818e8 in_seq=0 out_seq=0 2024-01-31T05:11:57.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.236+0000 7f347effd640 1 -- 172.21.15.99:0/2510361019 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55f8f525f1f0 con 0x55f8f536c690 2024-01-31T05:11:57.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.236+0000 7f347effd640 10 client.15531 handle_command_reply: tid=0 2024-01-31T05:11:57.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.236+0000 7f34a8da5740 1 client.15531 shutdown 2024-01-31T05:11:57.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.237+0000 7f34a8da5740 1 -- 172.21.15.99:0/2510361019 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8f52fea20 msgr2=0x55f8f530fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:57.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.237+0000 7f34a8da5740 1 --2- 172.21.15.99:0/2510361019 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8f52fea20 0x55f8f530fba0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f3494000c00 tx=0x7f3494012670 comp rx=0 tx=0).stop 2024-01-31T05:11:57.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.237+0000 7f34a8da5740 1 -- 172.21.15.99:0/2510361019 shutdown_connections 2024-01-31T05:11:57.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.237+0000 7f34a8da5740 1 --2- 172.21.15.99:0/2510361019 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55f8f536c690 0x55f8f536eab0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.237+0000 7f34a8da5740 1 --2- 172.21.15.99:0/2510361019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8f5304580 0x55f8f530e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.237+0000 7f34a8da5740 1 --2- 172.21.15.99:0/2510361019 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f8f52ff410 0x55f8f530e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.237+0000 7f347effd640 0 client.15531 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:11:57.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.237+0000 7f34a8da5740 1 --2- 172.21.15.99:0/2510361019 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8f52fea20 0x55f8f530fba0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.237+0000 7f34a8da5740 1 -- 172.21.15.99:0/2510361019 >> 172.21.15.99:0/2510361019 conn(0x55f8f52f9f90 msgr2=0x55f8f5300960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:57.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.237+0000 7f34a8da5740 1 -- 172.21.15.99:0/2510361019 shutdown_connections 2024-01-31T05:11:57.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.237+0000 7f34a8da5740 1 -- 172.21.15.99:0/2510361019 wait complete. 2024-01-31T05:11:57.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.237+0000 7f34a8da5740 20 client.15531 trim_cache size 0 max 16384 2024-01-31T05:11:57.243 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-01-31T05:11:57.243 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "no active scrubs running", 2024-01-31T05:11:57.243 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": {} 2024-01-31T05:11:57.243 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-01-31T05:11:57.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.237+0000 7f34a5f05640 1 -- 172.21.15.99:0/3941315379 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f34880a13f0 msgr2=0x7f34880a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:57.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.237+0000 7f34a5f05640 1 --2- 172.21.15.99:0/3941315379 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f34880a13f0 0x7f34880a38b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3498007310 tx=0x7f3498007dd0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.237+0000 7f34a5f05640 1 -- 172.21.15.99:0/3941315379 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f34a01040a0 msgr2=0x7f34a01971e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:57.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.237+0000 7f34a5f05640 1 --2- 172.21.15.99:0/3941315379 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f34a01040a0 0x7f34a01971e0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f3490000c00 tx=0x7f34900042f0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.237+0000 7f34a5f05640 1 -- 172.21.15.99:0/3941315379 shutdown_connections 2024-01-31T05:11:57.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.237+0000 7f34a5f05640 1 --2- 172.21.15.99:0/3941315379 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f34880a13f0 0x7f34880a38b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.237+0000 7f34a5f05640 1 --2- 172.21.15.99:0/3941315379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34a01069d0 0x7f34a019e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.237+0000 7f34a5f05640 1 --2- 172.21.15.99:0/3941315379 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f34a01040a0 0x7f34a01971e0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.237+0000 7f34a5f05640 1 --2- 172.21.15.99:0/3941315379 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34a0101770 0x7f34a0196ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.237+0000 7f34a5f05640 1 -- 172.21.15.99:0/3941315379 >> 172.21.15.99:0/3941315379 conn(0x7f34a00fb180 msgr2=0x7f34a01020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:57.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.238+0000 7f34a5f05640 1 -- 172.21.15.99:0/3941315379 shutdown_connections 2024-01-31T05:11:57.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.238+0000 7f34a5f05640 1 -- 172.21.15.99:0/3941315379 wait complete. 2024-01-31T05:11:57.248 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-01-31T05:11:57.249 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T05:11:57.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.350+0000 7fb29e461640 1 -- 172.21.15.99:0/2689115499 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb298101fb0 msgr2=0x7fb298102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:57.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.350+0000 7fb29e461640 1 --2- 172.21.15.99:0/2689115499 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb298101fb0 0x7fb298102430 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fb28c009900 tx=0x7fb28c02bc30 comp rx=0 tx=0).stop 2024-01-31T05:11:57.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.350+0000 7fb29e461640 1 -- 172.21.15.99:0/2689115499 shutdown_connections 2024-01-31T05:11:57.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.350+0000 7fb29e461640 1 --2- 172.21.15.99:0/2689115499 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb298102970 0x7fb298109200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.350+0000 7fb29e461640 1 --2- 172.21.15.99:0/2689115499 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb298101fb0 0x7fb298102430 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.350+0000 7fb29e461640 1 --2- 172.21.15.99:0/2689115499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb2980fefe0 0x7fb2980ff400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.350+0000 7fb29e461640 1 -- 172.21.15.99:0/2689115499 >> 172.21.15.99:0/2689115499 conn(0x7fb2980fa910 msgr2=0x7fb2980fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:57.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.350+0000 7fb29e461640 1 -- 172.21.15.99:0/2689115499 shutdown_connections 2024-01-31T05:11:57.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.350+0000 7fb29e461640 1 -- 172.21.15.99:0/2689115499 wait complete. 2024-01-31T05:11:57.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.350+0000 7fb29e461640 1 Processor -- start 2024-01-31T05:11:57.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.351+0000 7fb29e461640 1 -- start start 2024-01-31T05:11:57.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.351+0000 7fb29e461640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb2980fefe0 0x7fb298196ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.351+0000 7fb29e461640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb298101fb0 0x7fb2981971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.351+0000 7fb29e461640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb298102970 0x7fb29819e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.351+0000 7fb29e461640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29819e730 con 0x7fb298102970 2024-01-31T05:11:57.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.351+0000 7fb29e461640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29819e8a0 con 0x7fb298101fb0 2024-01-31T05:11:57.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.351+0000 7fb29e461640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29819ea60 con 0x7fb2980fefe0 2024-01-31T05:11:57.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.351+0000 7fb29c9fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb298102970 0x7fb29819e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.351+0000 7fb29c9fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb298102970 0x7fb29819e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48000/0 (socket says 172.21.15.99:48000) 2024-01-31T05:11:57.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.351+0000 7fb29c9fe640 1 -- 172.21.15.99:0/1090751230 learned_addr learned my addr 172.21.15.99:0/1090751230 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:57.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.351+0000 7fb2977fe640 1 --2- 172.21.15.99:0/1090751230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb298101fb0 0x7fb2981971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.351+0000 7fb297fff640 1 --2- 172.21.15.99:0/1090751230 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb2980fefe0 0x7fb298196ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.351+0000 7fb29c9fe640 1 -- 172.21.15.99:0/1090751230 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb2980fefe0 msgr2=0x7fb298196ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:57.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.351+0000 7fb29c9fe640 1 --2- 172.21.15.99:0/1090751230 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb2980fefe0 0x7fb298196ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.351+0000 7fb29c9fe640 1 -- 172.21.15.99:0/1090751230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb298101fb0 msgr2=0x7fb2981971e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:57.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.351+0000 7fb29c9fe640 1 --2- 172.21.15.99:0/1090751230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb298101fb0 0x7fb2981971e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.351+0000 7fb29c9fe640 1 -- 172.21.15.99:0/1090751230 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb28c009560 con 0x7fb298102970 2024-01-31T05:11:57.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.351+0000 7fb297fff640 1 --2- 172.21.15.99:0/1090751230 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb2980fefe0 0x7fb298196ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:11:57.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.351+0000 7fb29c9fe640 1 --2- 172.21.15.99:0/1090751230 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb298102970 0x7fb29819e1c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fb29000cad0 tx=0x7fb29000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:57.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.352+0000 7fb2957fa640 1 -- 172.21.15.99:0/1090751230 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29000ae20 con 0x7fb298102970 2024-01-31T05:11:57.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.352+0000 7fb2957fa640 1 -- 172.21.15.99:0/1090751230 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb290005020 con 0x7fb298102970 2024-01-31T05:11:57.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.352+0000 7fb29e461640 1 -- 172.21.15.99:0/1090751230 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb29819ed40 con 0x7fb298102970 2024-01-31T05:11:57.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.352+0000 7fb2957fa640 1 -- 172.21.15.99:0/1090751230 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29000f6b0 con 0x7fb298102970 2024-01-31T05:11:57.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.352+0000 7fb29e461640 1 -- 172.21.15.99:0/1090751230 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb29819f1a0 con 0x7fb298102970 2024-01-31T05:11:57.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.353+0000 7fb29e461640 1 -- 172.21.15.99:0/1090751230 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb298108160 con 0x7fb298102970 2024-01-31T05:11:57.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.354+0000 7fb2957fa640 1 -- 172.21.15.99:0/1090751230 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 135946+0+0 (secure 0 0 0) 0x7fb290005190 con 0x7fb298102970 2024-01-31T05:11:57.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.354+0000 7fb2957fa640 1 --2- 172.21.15.99:0/1090751230 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb2800a1370 0x7fb2800a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.354+0000 7fb2957fa640 1 -- 172.21.15.99:0/1090751230 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fb2900ccd10 con 0x7fb298102970 2024-01-31T05:11:57.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.354+0000 7fb297fff640 1 --2- 172.21.15.99:0/1090751230 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb2800a1370 0x7fb2800a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.355+0000 7fb297fff640 1 --2- 172.21.15.99:0/1090751230 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb2800a1370 0x7fb2800a3830 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb298198120 tx=0x7fb288005dd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:57.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.359+0000 7fb2957fa640 1 -- 172.21.15.99:0/1090751230 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fb2900960c0 con 0x7fb298102970 2024-01-31T05:11:57.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.565+0000 7fb29e461640 1 -- 172.21.15.99:0/1090751230 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb29810c880 con 0x7fb298102970 2024-01-31T05:11:57.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.566+0000 7fb2957fa640 1 -- 172.21.15.99:0/1090751230 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11385 (secure 0 0 0) 0x7fb29001d090 con 0x7fb298102970 2024-01-31T05:11:57.566 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:11:57.566 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/1488539026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1488539026},{"type":"v1","addr":"172.21.15.99:6835","nonce":1488539026}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/1649552652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1649552652},{"type":"v1","addr":"172.21.15.99:6837","nonce":1649552652}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-01-31T05:09:20.564215+0000","modified":"2024-01-31T05:11:20.565526+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24461,"mds_2":24457,"mds_3":24439,"mds_4":14619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6839/4070477446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4070477446},{"type":"v1","addr":"172.21.15.99:6839","nonce":4070477446}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.99:6841/3069939345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6840","nonce":3069939345},{"type":"v1","addr":"172.21.15.99:6841","nonce":3069939345}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24376":{"gid":24376,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6833/427201290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":427201290},{"type":"v1","addr":"172.21.15.181:6833","nonce":427201290}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24401":{"gid":24401,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/472161020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":472161020},{"type":"v1","addr":"172.21.15.179:6833","nonce":472161020}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24427":{"gid":24427,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/1038715471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1038715471},{"type":"v1","addr":"172.21.15.181:6835","nonce":1038715471}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24434":{"gid":24434,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/966976592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":966976592},{"type":"v1","addr":"172.21.15.179:6835","nonce":966976592}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24439":{"gid":24439,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.181:6837/3875964154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3875964154},{"type":"v1","addr":"172.21.15.181:6837","nonce":3875964154}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24457":{"gid":24457,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.181:6839/996120687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":996120687},{"type":"v1","addr":"172.21.15.181:6839","nonce":996120687}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6837/837402830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":837402830},{"type":"v1","addr":"172.21.15.179:6837","nonce":837402830}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6839/754762785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":754762785},{"type":"v1","addr":"172.21.15.179:6839","nonce":754762785}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-31T05:11:57.566 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 27 2024-01-31T05:11:57.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.567+0000 7fb29e461640 1 -- 172.21.15.99:0/1090751230 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb2800a1370 msgr2=0x7fb2800a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:57.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.567+0000 7fb29e461640 1 --2- 172.21.15.99:0/1090751230 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb2800a1370 0x7fb2800a3830 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb298198120 tx=0x7fb288005dd0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.567+0000 7fb29e461640 1 -- 172.21.15.99:0/1090751230 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb298102970 msgr2=0x7fb29819e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:57.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.567+0000 7fb29e461640 1 --2- 172.21.15.99:0/1090751230 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb298102970 0x7fb29819e1c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fb29000cad0 tx=0x7fb29000cf90 comp rx=0 tx=0).stop 2024-01-31T05:11:57.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.568+0000 7fb29e461640 1 -- 172.21.15.99:0/1090751230 shutdown_connections 2024-01-31T05:11:57.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.568+0000 7fb29e461640 1 --2- 172.21.15.99:0/1090751230 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb2800a1370 0x7fb2800a3830 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.568+0000 7fb29e461640 1 --2- 172.21.15.99:0/1090751230 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb298102970 0x7fb29819e1c0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.568+0000 7fb29e461640 1 --2- 172.21.15.99:0/1090751230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb298101fb0 0x7fb2981971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.568+0000 7fb29e461640 1 --2- 172.21.15.99:0/1090751230 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb2980fefe0 0x7fb298196ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.568+0000 7fb29e461640 1 -- 172.21.15.99:0/1090751230 >> 172.21.15.99:0/1090751230 conn(0x7fb2980fa910 msgr2=0x7fb298105330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:57.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.568+0000 7fb29e461640 1 -- 172.21.15.99:0/1090751230 shutdown_connections 2024-01-31T05:11:57.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.568+0000 7fb29e461640 1 -- 172.21.15.99:0/1090751230 wait complete. 2024-01-31T05:11:57.579 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-01-31T05:11:57.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.683+0000 7f3acfb2b640 1 -- 172.21.15.99:0/986025199 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ac80fed80 msgr2=0x7f3ac80ff200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:57.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.683+0000 7f3acfb2b640 1 --2- 172.21.15.99:0/986025199 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ac80fed80 0x7f3ac80ff200 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f3ab8009900 tx=0x7f3ab802bc30 comp rx=0 tx=0).stop 2024-01-31T05:11:57.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.683+0000 7f3acfb2b640 1 -- 172.21.15.99:0/986025199 shutdown_connections 2024-01-31T05:11:57.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.683+0000 7f3acfb2b640 1 --2- 172.21.15.99:0/986025199 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ac80ff740 0x7f3ac81092f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.683+0000 7f3acfb2b640 1 --2- 172.21.15.99:0/986025199 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ac80fed80 0x7f3ac80ff200 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.683+0000 7f3acfb2b640 1 --2- 172.21.15.99:0/986025199 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ac8102310 0x7f3ac8102730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.683+0000 7f3acfb2b640 1 -- 172.21.15.99:0/986025199 >> 172.21.15.99:0/986025199 conn(0x7f3ac80fa920 msgr2=0x7f3ac80fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:57.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.683+0000 7f3acfb2b640 1 -- 172.21.15.99:0/986025199 shutdown_connections 2024-01-31T05:11:57.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.683+0000 7f3acfb2b640 1 -- 172.21.15.99:0/986025199 wait complete. 2024-01-31T05:11:57.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.683+0000 7f3acfb2b640 1 Processor -- start 2024-01-31T05:11:57.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.684+0000 7f3acfb2b640 1 -- start start 2024-01-31T05:11:57.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.684+0000 7f3acfb2b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ac80fed80 0x7f3ac8196d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.684+0000 7f3acfb2b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ac80ff740 0x7f3ac8197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.684+0000 7f3acfb2b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ac8102310 0x7f3ac819e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.684+0000 7f3acfb2b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac819e810 con 0x7f3ac80ff740 2024-01-31T05:11:57.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.684+0000 7f3acfb2b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac819e980 con 0x7f3ac8102310 2024-01-31T05:11:57.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.684+0000 7f3acfb2b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac819eb40 con 0x7f3ac80fed80 2024-01-31T05:11:57.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.684+0000 7f3acd0c6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ac80ff740 0x7f3ac8197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.684+0000 7f3acd0c6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ac80ff740 0x7f3ac8197270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48008/0 (socket says 172.21.15.99:48008) 2024-01-31T05:11:57.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.684+0000 7f3acd0c6640 1 -- 172.21.15.99:0/1297815100 learned_addr learned my addr 172.21.15.99:0/1297815100 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:57.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.684+0000 7f3acd8c7640 1 --2- 172.21.15.99:0/1297815100 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ac80fed80 0x7f3ac8196d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.684+0000 7f3acd0c6640 1 -- 172.21.15.99:0/1297815100 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ac80fed80 msgr2=0x7f3ac8196d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:57.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.684+0000 7f3acd0c6640 1 --2- 172.21.15.99:0/1297815100 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ac80fed80 0x7f3ac8196d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.684+0000 7f3acd0c6640 1 -- 172.21.15.99:0/1297815100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ac8102310 msgr2=0x7f3ac819e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:57.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.684+0000 7f3acd0c6640 1 --2- 172.21.15.99:0/1297815100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ac8102310 0x7f3ac819e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.684+0000 7f3acd0c6640 1 -- 172.21.15.99:0/1297815100 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab8009560 con 0x7f3ac80ff740 2024-01-31T05:11:57.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.684+0000 7f3acd0c6640 1 --2- 172.21.15.99:0/1297815100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ac80ff740 0x7f3ac8197270 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f3ab8009230 tx=0x7f3ab8004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:57.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.684+0000 7f3abeffd640 1 -- 172.21.15.99:0/1297815100 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab8004440 con 0x7f3ac80ff740 2024-01-31T05:11:57.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.684+0000 7f3abeffd640 1 -- 172.21.15.99:0/1297815100 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3ab80054c0 con 0x7f3ac80ff740 2024-01-31T05:11:57.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.684+0000 7f3acfb2b640 1 -- 172.21.15.99:0/1297815100 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ac819edc0 con 0x7f3ac80ff740 2024-01-31T05:11:57.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.684+0000 7f3abeffd640 1 -- 172.21.15.99:0/1297815100 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab8003e50 con 0x7f3ac80ff740 2024-01-31T05:11:57.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.684+0000 7f3acfb2b640 1 -- 172.21.15.99:0/1297815100 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ac819f210 con 0x7f3ac80ff740 2024-01-31T05:11:57.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.687+0000 7f3abeffd640 1 -- 172.21.15.99:0/1297815100 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f3ab80035f0 con 0x7f3ac80ff740 2024-01-31T05:11:57.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.687+0000 7f3ad29c9740 1 Processor -- start 2024-01-31T05:11:57.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.688+0000 7f3abeffd640 1 --2- 172.21.15.99:0/1297815100 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f3ab40a1370 0x7f3ab40a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.688+0000 7f3ad29c9740 1 -- start start 2024-01-31T05:11:57.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.688+0000 7f3ad29c9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562e485ebf10 0x562e485ec330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.688+0000 7f3ad29c9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e485ec900 0x562e485f1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.688+0000 7f3ad29c9740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e485f1a70 0x562e485f3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.688+0000 7f3ad29c9740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e4855a240 con 0x562e485f1a70 2024-01-31T05:11:57.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.688+0000 7f3ad29c9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e48557930 con 0x562e485ebf10 2024-01-31T05:11:57.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.688+0000 7f3ad29c9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e48553220 con 0x562e485ec900 2024-01-31T05:11:57.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.688+0000 7f3ace0c8640 1 --2- 172.21.15.99:0/1297815100 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f3ab40a1370 0x7f3ab40a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.688+0000 7f3abeffd640 1 -- 172.21.15.99:0/1297815100 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f3ab80ef5d0 con 0x7f3ac80ff740 2024-01-31T05:11:57.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.688+0000 7f3ace0c8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e485f1a70 0x562e485f3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.688+0000 7f3acd8c7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562e485ebf10 0x562e485ec330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.688+0000 7f3ace0c8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e485f1a70 0x562e485f3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48024/0 (socket says 172.21.15.99:48024) 2024-01-31T05:11:57.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.688+0000 7f3acd8c7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562e485ebf10 0x562e485ec330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.99:33430/0 (socket says 172.21.15.99:33430) 2024-01-31T05:11:57.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.688+0000 7f3ace0c8640 1 -- 172.21.15.99:0/2195938973 learned_addr learned my addr 172.21.15.99:0/2195938973 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:57.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.688+0000 7f3acd0c6640 1 --2- 172.21.15.99:0/2195938973 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e485ec900 0x562e485f1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.688+0000 7f3ace0c8640 1 --2- 172.21.15.99:0/1297815100 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f3ab40a1370 0x7f3ab40a3830 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0015610 tx=0x7f3ac0015a10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:57.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.688+0000 7f3ace0c8640 1 -- 172.21.15.99:0/2195938973 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e485ec900 msgr2=0x562e485f1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:57.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.688+0000 7f3ace0c8640 1 --2- 172.21.15.99:0/2195938973 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e485ec900 0x562e485f1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.688+0000 7f3ace0c8640 1 -- 172.21.15.99:0/2195938973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562e485ebf10 msgr2=0x562e485ec330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:57.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.688+0000 7f3ace0c8640 1 --2- 172.21.15.99:0/2195938973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562e485ebf10 0x562e485ec330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.688+0000 7f3ace0c8640 1 -- 172.21.15.99:0/2195938973 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e485157c0 con 0x562e485f1a70 2024-01-31T05:11:57.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.688+0000 7f3acd8c7640 1 --2- 172.21.15.99:0/2195938973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562e485ebf10 0x562e485ec330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:11:57.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.688+0000 7f3ace0c8640 1 --2- 172.21.15.99:0/2195938973 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e485f1a70 0x562e485f3f00 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0009270 tx=0x7f3ac001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=380318cac695c86f server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:57.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.690+0000 7f3ab3fff640 1 -- 172.21.15.99:0/2195938973 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac0004b20 con 0x562e485f1a70 2024-01-31T05:11:57.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.690+0000 7f3ab3fff640 1 -- 172.21.15.99:0/2195938973 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3ac0004c80 con 0x562e485f1a70 2024-01-31T05:11:57.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.690+0000 7f3ab3fff640 1 -- 172.21.15.99:0/2195938973 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac001f6b0 con 0x562e485f1a70 2024-01-31T05:11:57.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.691+0000 7f3ad29c9740 1 -- 172.21.15.99:0/2195938973 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e485f1a70 msgr2=0x562e485f3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:57.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.691+0000 7f3ad29c9740 1 --2- 172.21.15.99:0/2195938973 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e485f1a70 0x562e485f3f00 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0009270 tx=0x7f3ac001c000 comp rx=0 tx=0).stop 2024-01-31T05:11:57.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.691+0000 7f3ad29c9740 1 -- 172.21.15.99:0/2195938973 shutdown_connections 2024-01-31T05:11:57.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.691+0000 7f3ad29c9740 1 --2- 172.21.15.99:0/2195938973 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e485f1a70 0x562e485f3f00 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.691+0000 7f3ad29c9740 1 --2- 172.21.15.99:0/2195938973 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e485ec900 0x562e485f1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.691+0000 7f3ad29c9740 1 --2- 172.21.15.99:0/2195938973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562e485ebf10 0x562e485ec330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.691+0000 7f3ad29c9740 1 -- 172.21.15.99:0/2195938973 >> 172.21.15.99:0/2195938973 conn(0x562e485e7480 msgr2=0x562e485e7880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:57.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.691+0000 7f3ad29c9740 1 -- 172.21.15.99:0/2195938973 shutdown_connections 2024-01-31T05:11:57.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.691+0000 7f3ad29c9740 1 -- 172.21.15.99:0/2195938973 wait complete. 2024-01-31T05:11:57.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.691+0000 7f3ad29c9740 1 -- start start 2024-01-31T05:11:57.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.691+0000 7f3ad29c9740 1 Processor -- start 2024-01-31T05:11:57.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.691+0000 7f3ad29c9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e485ebf10 0x562e485f6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.691+0000 7f3ad29c9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562e485ec900 0x562e485f6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.691+0000 7f3ad29c9740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e485f1a70 0x562e485fd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.692+0000 7f3ad29c9740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e4850c5e0 con 0x562e485f1a70 2024-01-31T05:11:57.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.692+0000 7f3ad29c9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e4850c280 con 0x562e485ec900 2024-01-31T05:11:57.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.692+0000 7f3ad29c9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e484d13d0 con 0x562e485ebf10 2024-01-31T05:11:57.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.692+0000 7f3ad29c9740 10 client.0 _ll_register_callbacks cb 0x562e48549eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:11:57.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.692+0000 7f3ace0c8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e485f1a70 0x562e485fd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.692+0000 7f3ace0c8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e485f1a70 0x562e485fd5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48028/0 (socket says 172.21.15.99:48028) 2024-01-31T05:11:57.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.692+0000 7f3ace0c8640 1 -- 172.21.15.99:0/3657346610 learned_addr learned my addr 172.21.15.99:0/3657346610 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:57.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.692+0000 7f3acd8c7640 1 --2- 172.21.15.99:0/3657346610 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e485ebf10 0x562e485f6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.692+0000 7f3acd0c6640 1 --2- 172.21.15.99:0/3657346610 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562e485ec900 0x562e485f6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.692+0000 7f3ace0c8640 1 -- 172.21.15.99:0/3657346610 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e485ebf10 msgr2=0x562e485f6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:57.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.692+0000 7f3ace0c8640 1 --2- 172.21.15.99:0/3657346610 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e485ebf10 0x562e485f6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.692+0000 7f3ace0c8640 1 -- 172.21.15.99:0/3657346610 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562e485ec900 msgr2=0x562e485f6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:57.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.692+0000 7f3ace0c8640 1 --2- 172.21.15.99:0/3657346610 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562e485ec900 0x562e485f6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.692+0000 7f3ace0c8640 1 -- 172.21.15.99:0/3657346610 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ac001b070 con 0x562e485f1a70 2024-01-31T05:11:57.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.692+0000 7f3ace0c8640 1 --2- 172.21.15.99:0/3657346610 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e485f1a70 0x562e485fd5c0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0009810 tx=0x7f3ac0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7414fab64a8d4f server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:57.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.692+0000 7f3ab17fa640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:11:57.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.692+0000 7f3ab17fa640 1 -- 172.21.15.99:0/3657346610 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac001f650 con 0x562e485f1a70 2024-01-31T05:11:57.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.692+0000 7f3ab17fa640 1 -- 172.21.15.99:0/3657346610 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f3ac001f930 con 0x562e485f1a70 2024-01-31T05:11:57.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.692+0000 7f3ad29c9740 1 -- 172.21.15.99:0/3657346610 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562e4854c0b0 con 0x562e485f1a70 2024-01-31T05:11:57.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.692+0000 7f3ab17fa640 1 -- 172.21.15.99:0/3657346610 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ac001faf0 con 0x562e485f1a70 2024-01-31T05:11:57.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.692+0000 7f3ad29c9740 10 client.15549 fetch_fsmap learned FSMap version 27 2024-01-31T05:11:57.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.692+0000 7f3ad29c9740 1 -- 172.21.15.99:0/3657346610 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x562e485518a0 con 0x562e485f1a70 2024-01-31T05:11:57.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.693+0000 7f3ab17fa640 1 -- 172.21.15.99:0/3657346610 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562e4854c0b0 con 0x562e485f1a70 2024-01-31T05:11:57.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.693+0000 7f3ab17fa640 1 -- 172.21.15.99:0/3657346610 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3ac0013400 con 0x562e485f1a70 2024-01-31T05:11:57.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.693+0000 7f3ad29c9740 10 client.15549 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:11:57.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.693+0000 7f3ad29c9740 10 client.15549 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-01-31T05:11:57.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.693+0000 7f3ad29c9740 20 client.15549 populate_metadata read hostname 'smithi099' 2024-01-31T05:11:57.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.693+0000 7f3ad29c9740 1 --2- 172.21.15.99:0/3657346610 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x562e48601e40 0x562e48604260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.693+0000 7f3ad29c9740 4 client.15549 mds_command: new command op to 14619 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:11:57.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.693+0000 7f3ad29c9740 1 -- 172.21.15.99:0/3657346610 --> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562e4854bdd0 con 0x562e48601e40 2024-01-31T05:11:57.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.693+0000 7f3acd8c7640 1 --2- 172.21.15.99:0/3657346610 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x562e48601e40 0x562e48604260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.693+0000 7f3ab17fa640 10 client.15549 ms_handle_connect on v2:172.21.15.99:6840/3069939345 2024-01-31T05:11:57.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.693+0000 7f3acd8c7640 1 --2- 172.21.15.99:0/3657346610 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x562e48601e40 0x562e48604260 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=72ab0272a7b10a76 server_cookie=b631fe1d3f7f551b in_seq=0 out_seq=0 2024-01-31T05:11:57.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.694+0000 7f3ab17fa640 1 -- 172.21.15.99:0/3657346610 <== mds.4 v2:172.21.15.99:6840/3069939345 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562e4854bdd0 con 0x562e48601e40 2024-01-31T05:11:57.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.694+0000 7f3ab17fa640 10 client.15549 handle_command_reply: tid=0 2024-01-31T05:11:57.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.694+0000 7f3ad29c9740 1 client.15549 shutdown 2024-01-31T05:11:57.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.694+0000 7f3ad29c9740 1 -- 172.21.15.99:0/3657346610 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e485f1a70 msgr2=0x562e485fd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:57.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.694+0000 7f3ad29c9740 1 --2- 172.21.15.99:0/3657346610 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e485f1a70 0x562e485fd5c0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0009810 tx=0x7f3ac0004a40 comp rx=0 tx=0).stop 2024-01-31T05:11:57.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.694+0000 7f3ad29c9740 1 -- 172.21.15.99:0/3657346610 shutdown_connections 2024-01-31T05:11:57.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.694+0000 7f3ad29c9740 1 --2- 172.21.15.99:0/3657346610 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x562e48601e40 0x562e48604260 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.694+0000 7f3ad29c9740 1 --2- 172.21.15.99:0/3657346610 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e485f1a70 0x562e485fd5c0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.694+0000 7f3ad29c9740 1 --2- 172.21.15.99:0/3657346610 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562e485ec900 0x562e485f6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.694+0000 7f3ad29c9740 1 --2- 172.21.15.99:0/3657346610 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e485ebf10 0x562e485f6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.694+0000 7f3ab17fa640 0 client.15549 ms_handle_reset on v2:172.21.15.99:6840/3069939345 2024-01-31T05:11:57.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.694+0000 7f3ad29c9740 1 -- 172.21.15.99:0/3657346610 >> 172.21.15.99:0/3657346610 conn(0x562e485e7480 msgr2=0x562e485e67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:57.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.694+0000 7f3ad29c9740 1 -- 172.21.15.99:0/3657346610 shutdown_connections 2024-01-31T05:11:57.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.694+0000 7f3ad29c9740 1 -- 172.21.15.99:0/3657346610 wait complete. 2024-01-31T05:11:57.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.694+0000 7f3ad29c9740 20 client.15549 trim_cache size 0 max 16384 2024-01-31T05:11:57.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.706+0000 7f3ad29c9740 1 Processor -- start 2024-01-31T05:11:57.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.706+0000 7f3ad29c9740 1 -- start start 2024-01-31T05:11:57.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.706+0000 7f3ad29c9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e485ebf10 0x562e48608be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.706+0000 7f3ad29c9740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e485ec900 0x562e485fd580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.706+0000 7f3ad29c9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562e485f1a70 0x562e485f6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.706+0000 7f3ad29c9740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e4854c0b0 con 0x562e485ec900 2024-01-31T05:11:57.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.706+0000 7f3ad29c9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e485ecff0 con 0x562e485f1a70 2024-01-31T05:11:57.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.706+0000 7f3ad29c9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e485e2fa0 con 0x562e485ebf10 2024-01-31T05:11:57.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.706+0000 7f3acd0c6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e485ec900 0x562e485fd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.706+0000 7f3acd0c6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e485ec900 0x562e485fd580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48034/0 (socket says 172.21.15.99:48034) 2024-01-31T05:11:57.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.706+0000 7f3acd0c6640 1 -- 172.21.15.99:0/1735215458 learned_addr learned my addr 172.21.15.99:0/1735215458 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:57.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.706+0000 7f3acd8c7640 1 --2- 172.21.15.99:0/1735215458 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e485ebf10 0x562e48608be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.706+0000 7f3acd0c6640 1 -- 172.21.15.99:0/1735215458 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e485ebf10 msgr2=0x562e48608be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:57.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.706+0000 7f3acd0c6640 1 --2- 172.21.15.99:0/1735215458 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e485ebf10 0x562e48608be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.706+0000 7f3acd0c6640 1 -- 172.21.15.99:0/1735215458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562e485f1a70 msgr2=0x562e485f6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:57.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.706+0000 7f3acd0c6640 1 --2- 172.21.15.99:0/1735215458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562e485f1a70 0x562e485f6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.706+0000 7f3acd0c6640 1 -- 172.21.15.99:0/1735215458 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e484ee4d0 con 0x562e485ec900 2024-01-31T05:11:57.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.706+0000 7f3acd8c7640 1 --2- 172.21.15.99:0/1735215458 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e485ebf10 0x562e48608be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:11:57.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.706+0000 7f3acd0c6640 1 --2- 172.21.15.99:0/1735215458 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e485ec900 0x562e485fd580 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f3ab80ed1e0 tx=0x7f3ab80a7040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2520fcc89d2014f server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:57.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.706+0000 7f3ab37fe640 1 -- 172.21.15.99:0/1735215458 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab80bcee0 con 0x562e485ec900 2024-01-31T05:11:57.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.707+0000 7f3ab37fe640 1 -- 172.21.15.99:0/1735215458 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3ab80ef3d0 con 0x562e485ec900 2024-01-31T05:11:57.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.707+0000 7f3ab37fe640 1 -- 172.21.15.99:0/1735215458 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab80b8e60 con 0x562e485ec900 2024-01-31T05:11:57.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.707+0000 7f3ad29c9740 1 -- 172.21.15.99:0/1735215458 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e485ec900 msgr2=0x562e485fd580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:57.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.707+0000 7f3ad29c9740 1 --2- 172.21.15.99:0/1735215458 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e485ec900 0x562e485fd580 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f3ab80ed1e0 tx=0x7f3ab80a7040 comp rx=0 tx=0).stop 2024-01-31T05:11:57.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.707+0000 7f3ad29c9740 1 -- 172.21.15.99:0/1735215458 shutdown_connections 2024-01-31T05:11:57.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.707+0000 7f3ad29c9740 1 --2- 172.21.15.99:0/1735215458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562e485f1a70 0x562e485f6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.707+0000 7f3ad29c9740 1 --2- 172.21.15.99:0/1735215458 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e485ec900 0x562e485fd580 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.707+0000 7f3ad29c9740 1 --2- 172.21.15.99:0/1735215458 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e485ebf10 0x562e48608be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.707+0000 7f3ad29c9740 1 -- 172.21.15.99:0/1735215458 >> 172.21.15.99:0/1735215458 conn(0x562e485e7480 msgr2=0x562e485e7860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:57.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.707+0000 7f3ad29c9740 1 -- 172.21.15.99:0/1735215458 shutdown_connections 2024-01-31T05:11:57.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.707+0000 7f3ad29c9740 1 -- 172.21.15.99:0/1735215458 wait complete. 2024-01-31T05:11:57.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.707+0000 7f3ad29c9740 1 -- start start 2024-01-31T05:11:57.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.707+0000 7f3ad29c9740 1 Processor -- start 2024-01-31T05:11:57.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.708+0000 7f3ad29c9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e485ebf10 0x562e485fbc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.708+0000 7f3ad29c9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562e485ec900 0x562e485fc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.708+0000 7f3ad29c9740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e485f1a70 0x562e485fc710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.708+0000 7f3ad29c9740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e485fd890 con 0x562e485f1a70 2024-01-31T05:11:57.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.708+0000 7f3ad29c9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e485fda00 con 0x562e485ec900 2024-01-31T05:11:57.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.708+0000 7f3ad29c9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e486583d0 con 0x562e485ebf10 2024-01-31T05:11:57.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.708+0000 7f3ad29c9740 10 client.0 _ll_register_callbacks cb 0x7f3ac0009aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:11:57.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.708+0000 7f3ace0c8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e485f1a70 0x562e485fc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.708+0000 7f3ace0c8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e485f1a70 0x562e485fc710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48050/0 (socket says 172.21.15.99:48050) 2024-01-31T05:11:57.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.708+0000 7f3ace0c8640 1 -- 172.21.15.99:0/3048233315 learned_addr learned my addr 172.21.15.99:0/3048233315 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:57.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.708+0000 7f3acd0c6640 1 --2- 172.21.15.99:0/3048233315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562e485ec900 0x562e485fc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.708+0000 7f3ace0c8640 1 -- 172.21.15.99:0/3048233315 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e485ebf10 msgr2=0x562e485fbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:57.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.708+0000 7f3acd8c7640 1 --2- 172.21.15.99:0/3048233315 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e485ebf10 0x562e485fbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.708+0000 7f3ace0c8640 1 --2- 172.21.15.99:0/3048233315 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e485ebf10 0x562e485fbc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.708+0000 7f3ace0c8640 1 -- 172.21.15.99:0/3048233315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562e485ec900 msgr2=0x562e485fc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:57.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.708+0000 7f3ace0c8640 1 --2- 172.21.15.99:0/3048233315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562e485ec900 0x562e485fc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.708+0000 7f3ace0c8640 1 -- 172.21.15.99:0/3048233315 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ac819f210 con 0x562e485f1a70 2024-01-31T05:11:57.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.708+0000 7f3acd0c6640 1 --2- 172.21.15.99:0/3048233315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562e485ec900 0x562e485fc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:11:57.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.708+0000 7f3acd8c7640 1 --2- 172.21.15.99:0/3048233315 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e485ebf10 0x562e485fbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:11:57.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.708+0000 7f3ace0c8640 1 --2- 172.21.15.99:0/3048233315 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e485f1a70 0x562e485fc710 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0004a80 tx=0x7f3ac0013630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f223b32e432d5d server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:57.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.708+0000 7f3ab17fa640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:11:57.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.708+0000 7f3ab17fa640 1 -- 172.21.15.99:0/3048233315 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac0005200 con 0x562e485f1a70 2024-01-31T05:11:57.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.709+0000 7f3ab17fa640 1 -- 172.21.15.99:0/3048233315 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f3ac0009e80 con 0x562e485f1a70 2024-01-31T05:11:57.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.709+0000 7f3ad29c9740 1 -- 172.21.15.99:0/3048233315 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3ac0004c80 con 0x562e485f1a70 2024-01-31T05:11:57.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.709+0000 7f3ab17fa640 1 -- 172.21.15.99:0/3048233315 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ac0005360 con 0x562e485f1a70 2024-01-31T05:11:57.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.709+0000 7f3ad29c9740 10 client.15555 fetch_fsmap learned FSMap version 27 2024-01-31T05:11:57.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.709+0000 7f3ad29c9740 1 -- 172.21.15.99:0/3048233315 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x562e48514020 con 0x562e485f1a70 2024-01-31T05:11:57.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.709+0000 7f3ab17fa640 1 -- 172.21.15.99:0/3048233315 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3ac0004c80 con 0x562e485f1a70 2024-01-31T05:11:57.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.709+0000 7f3ab17fa640 1 -- 172.21.15.99:0/3048233315 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3ac003b070 con 0x562e485f1a70 2024-01-31T05:11:57.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.709+0000 7f3ad29c9740 10 client.15555 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:11:57.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.709+0000 7f3ad29c9740 10 client.15555 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-01-31T05:11:57.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.709+0000 7f3ad29c9740 20 client.15555 populate_metadata read hostname 'smithi099' 2024-01-31T05:11:57.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.709+0000 7f3ad29c9740 1 --2- 172.21.15.99:0/3048233315 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x562e48659af0 0x562e4865bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.709+0000 7f3ad29c9740 4 client.15555 mds_command: new command op to 14619 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-01-31T05:11:57.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.709+0000 7f3ad29c9740 1 -- 172.21.15.99:0/3048233315 --> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562e482527e0 con 0x562e48659af0 2024-01-31T05:11:57.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.709+0000 7f3acd8c7640 1 --2- 172.21.15.99:0/3048233315 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x562e48659af0 0x562e4865bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.709+0000 7f3ab17fa640 10 client.15555 ms_handle_connect on v2:172.21.15.99:6840/3069939345 2024-01-31T05:11:57.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.709+0000 7f3acd8c7640 1 --2- 172.21.15.99:0/3048233315 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x562e48659af0 0x562e4865bf10 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=90e37e564b6b28ab server_cookie=6d87d2da2a2a399c in_seq=0 out_seq=0 2024-01-31T05:11:57.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.710+0000 7f3ab17fa640 1 -- 172.21.15.99:0/3048233315 <== mds.4 v2:172.21.15.99:6840/3069939345 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x562e482527e0 con 0x562e48659af0 2024-01-31T05:11:57.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.710+0000 7f3ab17fa640 10 client.15555 handle_command_reply: tid=0 2024-01-31T05:11:57.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.710+0000 7f3ad29c9740 1 client.15555 shutdown 2024-01-31T05:11:57.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.710+0000 7f3ad29c9740 1 -- 172.21.15.99:0/3048233315 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e485f1a70 msgr2=0x562e485fc710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:57.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.710+0000 7f3ad29c9740 1 --2- 172.21.15.99:0/3048233315 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e485f1a70 0x562e485fc710 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0004a80 tx=0x7f3ac0013630 comp rx=0 tx=0).stop 2024-01-31T05:11:57.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.710+0000 7f3ad29c9740 1 -- 172.21.15.99:0/3048233315 shutdown_connections 2024-01-31T05:11:57.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.710+0000 7f3ad29c9740 1 --2- 172.21.15.99:0/3048233315 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x562e48659af0 0x562e4865bf10 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.710+0000 7f3ad29c9740 1 --2- 172.21.15.99:0/3048233315 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e485f1a70 0x562e485fc710 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.710+0000 7f3ad29c9740 1 --2- 172.21.15.99:0/3048233315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562e485ec900 0x562e485fc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.710+0000 7f3ad29c9740 1 --2- 172.21.15.99:0/3048233315 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e485ebf10 0x562e485fbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.710+0000 7f3ab17fa640 0 client.15555 ms_handle_reset on v2:172.21.15.99:6840/3069939345 2024-01-31T05:11:57.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.710+0000 7f3ad29c9740 1 -- 172.21.15.99:0/3048233315 >> 172.21.15.99:0/3048233315 conn(0x562e485e7480 msgr2=0x562e48608be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:57.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.710+0000 7f3ad29c9740 1 -- 172.21.15.99:0/3048233315 shutdown_connections 2024-01-31T05:11:57.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.710+0000 7f3ad29c9740 1 -- 172.21.15.99:0/3048233315 wait complete. 2024-01-31T05:11:57.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.710+0000 7f3ad29c9740 20 client.15555 trim_cache size 0 max 16384 2024-01-31T05:11:57.718 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-01-31T05:11:57.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.710+0000 7f3acfb2b640 1 -- 172.21.15.99:0/1297815100 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f3ab40a1370 msgr2=0x7f3ab40a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:57.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.710+0000 7f3acfb2b640 1 --2- 172.21.15.99:0/1297815100 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f3ab40a1370 0x7f3ab40a3830 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0015610 tx=0x7f3ac0015a10 comp rx=0 tx=0).stop 2024-01-31T05:11:57.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.710+0000 7f3acfb2b640 1 -- 172.21.15.99:0/1297815100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ac80ff740 msgr2=0x7f3ac8197270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:57.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.710+0000 7f3acfb2b640 1 --2- 172.21.15.99:0/1297815100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ac80ff740 0x7f3ac8197270 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f3ab8009230 tx=0x7f3ab8004040 comp rx=0 tx=0).stop 2024-01-31T05:11:57.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.710+0000 7f3acfb2b640 1 -- 172.21.15.99:0/1297815100 shutdown_connections 2024-01-31T05:11:57.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.710+0000 7f3acfb2b640 1 --2- 172.21.15.99:0/1297815100 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f3ab40a1370 0x7f3ab40a3830 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.710+0000 7f3acfb2b640 1 --2- 172.21.15.99:0/1297815100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ac8102310 0x7f3ac819e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.710+0000 7f3acfb2b640 1 --2- 172.21.15.99:0/1297815100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ac80ff740 0x7f3ac8197270 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.710+0000 7f3acfb2b640 1 --2- 172.21.15.99:0/1297815100 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ac80fed80 0x7f3ac8196d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.710+0000 7f3acfb2b640 1 -- 172.21.15.99:0/1297815100 >> 172.21.15.99:0/1297815100 conn(0x7f3ac80fa920 msgr2=0x7f3ac81053c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:57.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.711+0000 7f3acfb2b640 1 -- 172.21.15.99:0/1297815100 shutdown_connections 2024-01-31T05:11:57.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.711+0000 7f3acfb2b640 1 -- 172.21.15.99:0/1297815100 wait complete. 2024-01-31T05:11:57.721 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-01-31T05:11:57.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.823+0000 7f777ad42640 1 -- 172.21.15.99:0/2883172990 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7774100de0 msgr2=0x7f7774101260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:57.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.823+0000 7f777ad42640 1 --2- 172.21.15.99:0/2883172990 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7774100de0 0x7f7774101260 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f775c009900 tx=0x7f775c02bc30 comp rx=0 tx=0).stop 2024-01-31T05:11:57.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.823+0000 7f777ad42640 1 -- 172.21.15.99:0/2883172990 shutdown_connections 2024-01-31T05:11:57.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.823+0000 7f777ad42640 1 --2- 172.21.15.99:0/2883172990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77741017a0 0x7f7774108030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.823+0000 7f777ad42640 1 --2- 172.21.15.99:0/2883172990 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7774100de0 0x7f7774101260 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.823+0000 7f777ad42640 1 --2- 172.21.15.99:0/2883172990 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f77740ffbf0 0x7f7774100010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.823+0000 7f777ad42640 1 -- 172.21.15.99:0/2883172990 >> 172.21.15.99:0/2883172990 conn(0x7f77740fb180 msgr2=0x7f77740fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:57.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.823+0000 7f777ad42640 1 -- 172.21.15.99:0/2883172990 shutdown_connections 2024-01-31T05:11:57.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.823+0000 7f777ad42640 1 -- 172.21.15.99:0/2883172990 wait complete. 2024-01-31T05:11:57.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.824+0000 7f777ad42640 1 Processor -- start 2024-01-31T05:11:57.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.824+0000 7f777ad42640 1 -- start start 2024-01-31T05:11:57.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.824+0000 7f777ad42640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f77740ffbf0 0x7f7774068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.824+0000 7f777ad42640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7774100de0 0x7f777419ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.824+0000 7f777ad42640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f77741017a0 0x7f777419e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.824+0000 7f777ad42640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777419e830 con 0x7f77741017a0 2024-01-31T05:11:57.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.824+0000 7f777ad42640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777419e9a0 con 0x7f7774100de0 2024-01-31T05:11:57.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.824+0000 7f777ad42640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777419eb60 con 0x7f77740ffbf0 2024-01-31T05:11:57.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.824+0000 7f77792df640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f77741017a0 0x7f777419e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.824+0000 7f77792df640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f77741017a0 0x7f777419e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48080/0 (socket says 172.21.15.99:48080) 2024-01-31T05:11:57.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.824+0000 7f77792df640 1 -- 172.21.15.99:0/3787581471 learned_addr learned my addr 172.21.15.99:0/3787581471 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:57.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.824+0000 7f7773fff640 1 --2- 172.21.15.99:0/3787581471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7774100de0 0x7f777419ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.824+0000 7f7778ade640 1 --2- 172.21.15.99:0/3787581471 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f77740ffbf0 0x7f7774068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.825+0000 7f77792df640 1 -- 172.21.15.99:0/3787581471 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f77740ffbf0 msgr2=0x7f7774068a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:57.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.825+0000 7f77792df640 1 --2- 172.21.15.99:0/3787581471 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f77740ffbf0 0x7f7774068a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.825+0000 7f77792df640 1 -- 172.21.15.99:0/3787581471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7774100de0 msgr2=0x7f777419ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:57.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.825+0000 7f77792df640 1 --2- 172.21.15.99:0/3787581471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7774100de0 0x7f777419ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.825+0000 7f77792df640 1 -- 172.21.15.99:0/3787581471 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f775c009560 con 0x7f77741017a0 2024-01-31T05:11:57.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.825+0000 7f77792df640 1 --2- 172.21.15.99:0/3787581471 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f77741017a0 0x7f777419e0a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f776c00c970 tx=0x7f776c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:57.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.825+0000 7f7771ffb640 1 -- 172.21.15.99:0/3787581471 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776c007bb0 con 0x7f77741017a0 2024-01-31T05:11:57.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.825+0000 7f7771ffb640 1 -- 172.21.15.99:0/3787581471 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f776c007d10 con 0x7f77741017a0 2024-01-31T05:11:57.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.825+0000 7f7771ffb640 1 -- 172.21.15.99:0/3787581471 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776c004e20 con 0x7f77741017a0 2024-01-31T05:11:57.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.825+0000 7f777ad42640 1 -- 172.21.15.99:0/3787581471 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f777419ee40 con 0x7f77741017a0 2024-01-31T05:11:57.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.825+0000 7f777ad42640 1 -- 172.21.15.99:0/3787581471 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f777419f270 con 0x7f77741017a0 2024-01-31T05:11:57.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.827+0000 7f7771ffb640 1 -- 172.21.15.99:0/3787581471 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f776c005020 con 0x7f77741017a0 2024-01-31T05:11:57.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.827+0000 7f777dbe5740 1 Processor -- start 2024-01-31T05:11:57.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.827+0000 7f777dbe5740 1 -- start start 2024-01-31T05:11:57.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.827+0000 7f7771ffb640 1 --2- 172.21.15.99:0/3787581471 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f77600a1370 0x7f77600a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.828+0000 7f777dbe5740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a50fdb3f10 0x55a50fdb4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.828+0000 7f777dbe5740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a50fdb4900 0x55a50fdb9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.828+0000 7f777dbe5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a50fdb9a70 0x55a50fdbbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.828+0000 7f7771ffb640 1 -- 172.21.15.99:0/3787581471 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f776c0cc7e0 con 0x7f77741017a0 2024-01-31T05:11:57.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.828+0000 7f7773fff640 1 --2- 172.21.15.99:0/3787581471 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f77600a1370 0x7f77600a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.828+0000 7f777dbe5740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a50fd22240 con 0x55a50fdb3f10 2024-01-31T05:11:57.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.828+0000 7f777dbe5740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a50fd1f930 con 0x55a50fdb4900 2024-01-31T05:11:57.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.828+0000 7f777dbe5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a50fd1b220 con 0x55a50fdb9a70 2024-01-31T05:11:57.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.828+0000 7f7778ade640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a50fdb3f10 0x55a50fdb4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.828+0000 7f7778ade640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a50fdb3f10 0x55a50fdb4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48090/0 (socket says 172.21.15.99:48090) 2024-01-31T05:11:57.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.828+0000 7f7778ade640 1 -- 172.21.15.99:0/1587541064 learned_addr learned my addr 172.21.15.99:0/1587541064 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:57.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.828+0000 7f77792df640 1 --2- 172.21.15.99:0/1587541064 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a50fdb9a70 0x55a50fdbbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.828+0000 7f7778ade640 1 -- 172.21.15.99:0/1587541064 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a50fdb9a70 msgr2=0x55a50fdbbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:57.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.828+0000 7f7778ade640 1 --2- 172.21.15.99:0/1587541064 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a50fdb9a70 0x55a50fdbbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.828+0000 7f7778ade640 1 -- 172.21.15.99:0/1587541064 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a50fdb4900 msgr2=0x55a50fdb9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:57.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.828+0000 7f7778ade640 1 --2- 172.21.15.99:0/1587541064 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a50fdb4900 0x55a50fdb9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.828+0000 7f7778ade640 1 -- 172.21.15.99:0/1587541064 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a50fcdd7c0 con 0x55a50fdb3f10 2024-01-31T05:11:57.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.828+0000 7f7773fff640 1 --2- 172.21.15.99:0/3787581471 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f77600a1370 0x7f77600a3830 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f775c005ab0 tx=0x7f775c02c980 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:57.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.828+0000 7f7778ade640 1 --2- 172.21.15.99:0/1587541064 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a50fdb3f10 0x55a50fdb4330 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f7764009fd0 tx=0x7f7764010880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c96544a009671552 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:57.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.828+0000 7f776affd640 1 -- 172.21.15.99:0/1587541064 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7764009b50 con 0x55a50fdb3f10 2024-01-31T05:11:57.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.828+0000 7f776affd640 1 -- 172.21.15.99:0/1587541064 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7764003b70 con 0x55a50fdb3f10 2024-01-31T05:11:57.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.828+0000 7f776affd640 1 -- 172.21.15.99:0/1587541064 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7764012930 con 0x55a50fdb3f10 2024-01-31T05:11:57.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.829+0000 7f777dbe5740 1 -- 172.21.15.99:0/1587541064 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a50fdb3f10 msgr2=0x55a50fdb4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:57.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.829+0000 7f777dbe5740 1 --2- 172.21.15.99:0/1587541064 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a50fdb3f10 0x55a50fdb4330 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f7764009fd0 tx=0x7f7764010880 comp rx=0 tx=0).stop 2024-01-31T05:11:57.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.829+0000 7f777dbe5740 1 -- 172.21.15.99:0/1587541064 shutdown_connections 2024-01-31T05:11:57.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.829+0000 7f777dbe5740 1 --2- 172.21.15.99:0/1587541064 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a50fdb9a70 0x55a50fdbbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.829+0000 7f777dbe5740 1 --2- 172.21.15.99:0/1587541064 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a50fdb4900 0x55a50fdb9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.829+0000 7f777dbe5740 1 --2- 172.21.15.99:0/1587541064 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a50fdb3f10 0x55a50fdb4330 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.829+0000 7f777dbe5740 1 -- 172.21.15.99:0/1587541064 >> 172.21.15.99:0/1587541064 conn(0x55a50fdaf480 msgr2=0x55a50fdaf880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:57.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.829+0000 7f777dbe5740 1 -- 172.21.15.99:0/1587541064 shutdown_connections 2024-01-31T05:11:57.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.829+0000 7f777dbe5740 1 -- 172.21.15.99:0/1587541064 wait complete. 2024-01-31T05:11:57.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.829+0000 7f777dbe5740 1 -- start start 2024-01-31T05:11:57.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.830+0000 7f777dbe5740 1 Processor -- start 2024-01-31T05:11:57.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.830+0000 7f777dbe5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a50fdb3f10 0x55a50fdc2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.830+0000 7f777dbe5740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a50fdb4900 0x55a50fdc2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.830+0000 7f777dbe5740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a50fdb9a70 0x55a50fdc9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.830+0000 7f777dbe5740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a50fcd45e0 con 0x55a50fdb9a70 2024-01-31T05:11:57.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.830+0000 7f777dbe5740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a50fcd4280 con 0x55a50fdb4900 2024-01-31T05:11:57.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.830+0000 7f777dbe5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a50fc993d0 con 0x55a50fdb3f10 2024-01-31T05:11:57.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.830+0000 7f777dbe5740 10 client.0 _ll_register_callbacks cb 0x55a50fd11eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:11:57.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.830+0000 7f77792df640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a50fdb9a70 0x55a50fdc9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.830+0000 7f77792df640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a50fdb9a70 0x55a50fdc9b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48100/0 (socket says 172.21.15.99:48100) 2024-01-31T05:11:57.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.830+0000 7f77792df640 1 -- 172.21.15.99:0/4037529668 learned_addr learned my addr 172.21.15.99:0/4037529668 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:57.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.830+0000 7f7778ade640 1 --2- 172.21.15.99:0/4037529668 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a50fdb3f10 0x55a50fdc2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.830+0000 7f7773fff640 1 --2- 172.21.15.99:0/4037529668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a50fdb4900 0x55a50fdc2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.830+0000 7f77792df640 1 -- 172.21.15.99:0/4037529668 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a50fdb3f10 msgr2=0x55a50fdc2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:57.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.830+0000 7f77792df640 1 --2- 172.21.15.99:0/4037529668 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a50fdb3f10 0x55a50fdc2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.830+0000 7f77792df640 1 -- 172.21.15.99:0/4037529668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a50fdb4900 msgr2=0x55a50fdc2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:57.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.830+0000 7f77792df640 1 --2- 172.21.15.99:0/4037529668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a50fdb4900 0x55a50fdc2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.830+0000 7f77792df640 1 -- 172.21.15.99:0/4037529668 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7764009cb0 con 0x55a50fdb9a70 2024-01-31T05:11:57.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.830+0000 7f7773fff640 1 --2- 172.21.15.99:0/4037529668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a50fdb4900 0x55a50fdc2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:11:57.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.830+0000 7f77792df640 1 --2- 172.21.15.99:0/4037529668 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a50fdb9a70 0x55a50fdc9b10 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f776c096400 tx=0x7f776c099ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f86826d719ff1016 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:57.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.830+0000 7f7753fff640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:11:57.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.831+0000 7f7753fff640 1 -- 172.21.15.99:0/4037529668 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776c099080 con 0x55a50fdb9a70 2024-01-31T05:11:57.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.831+0000 7f7753fff640 1 -- 172.21.15.99:0/4037529668 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f776c0a17e0 con 0x55a50fdb9a70 2024-01-31T05:11:57.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.831+0000 7f777dbe5740 1 -- 172.21.15.99:0/4037529668 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a50fd140b0 con 0x55a50fdb9a70 2024-01-31T05:11:57.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.831+0000 7f7753fff640 1 -- 172.21.15.99:0/4037529668 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f776c0b9130 con 0x55a50fdb9a70 2024-01-31T05:11:57.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.831+0000 7f777dbe5740 10 client.15567 fetch_fsmap learned FSMap version 27 2024-01-31T05:11:57.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.831+0000 7f777dbe5740 1 -- 172.21.15.99:0/4037529668 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55a50fd198a0 con 0x55a50fdb9a70 2024-01-31T05:11:57.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.831+0000 7f7753fff640 1 -- 172.21.15.99:0/4037529668 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a50fd140b0 con 0x55a50fdb9a70 2024-01-31T05:11:57.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.831+0000 7f7753fff640 1 -- 172.21.15.99:0/4037529668 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f776c016030 con 0x55a50fdb9a70 2024-01-31T05:11:57.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.831+0000 7f777dbe5740 10 client.15567 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:11:57.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.831+0000 7f777dbe5740 10 client.15567 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-01-31T05:11:57.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.831+0000 7f777dbe5740 20 client.15567 populate_metadata read hostname 'smithi099' 2024-01-31T05:11:57.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.831+0000 7f777dbe5740 1 --2- 172.21.15.99:0/4037529668 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x55a50fdce460 0x55a50fdd0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.831+0000 7f777dbe5740 4 client.15567 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:11:57.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.831+0000 7f777dbe5740 1 -- 172.21.15.99:0/4037529668 --> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a50fd13dd0 con 0x55a50fdce460 2024-01-31T05:11:57.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.831+0000 7f7778ade640 1 --2- 172.21.15.99:0/4037529668 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x55a50fdce460 0x55a50fdd0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.832+0000 7f7753fff640 10 client.15567 ms_handle_connect on v2:172.21.15.181:6836/3875964154 2024-01-31T05:11:57.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.832+0000 7f7778ade640 1 --2- 172.21.15.99:0/4037529668 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x55a50fdce460 0x55a50fdd0850 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=278912e5924b92b1 server_cookie=2658bd36fe7a8188 in_seq=0 out_seq=0 2024-01-31T05:11:57.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.832+0000 7f7753fff640 1 -- 172.21.15.99:0/4037529668 <== mds.3 v2:172.21.15.181:6836/3875964154 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a50fd13dd0 con 0x55a50fdce460 2024-01-31T05:11:57.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.832+0000 7f7753fff640 10 client.15567 handle_command_reply: tid=0 2024-01-31T05:11:57.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.833+0000 7f777dbe5740 1 client.15567 shutdown 2024-01-31T05:11:57.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.833+0000 7f777dbe5740 1 -- 172.21.15.99:0/4037529668 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a50fdb9a70 msgr2=0x55a50fdc9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:57.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.833+0000 7f777dbe5740 1 --2- 172.21.15.99:0/4037529668 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a50fdb9a70 0x55a50fdc9b10 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f776c096400 tx=0x7f776c099ad0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.833+0000 7f777dbe5740 1 -- 172.21.15.99:0/4037529668 shutdown_connections 2024-01-31T05:11:57.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.833+0000 7f777dbe5740 1 --2- 172.21.15.99:0/4037529668 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x55a50fdce460 0x55a50fdd0850 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.833+0000 7f777dbe5740 1 --2- 172.21.15.99:0/4037529668 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a50fdb9a70 0x55a50fdc9b10 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.833+0000 7f777dbe5740 1 --2- 172.21.15.99:0/4037529668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a50fdb4900 0x55a50fdc2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.833+0000 7f777dbe5740 1 --2- 172.21.15.99:0/4037529668 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a50fdb3f10 0x55a50fdc2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.833+0000 7f7753fff640 0 client.15567 ms_handle_reset on v2:172.21.15.181:6836/3875964154 2024-01-31T05:11:57.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.833+0000 7f777dbe5740 1 -- 172.21.15.99:0/4037529668 >> 172.21.15.99:0/4037529668 conn(0x55a50fdaf480 msgr2=0x55a50fdae7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:57.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.833+0000 7f777dbe5740 1 -- 172.21.15.99:0/4037529668 shutdown_connections 2024-01-31T05:11:57.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.833+0000 7f777dbe5740 1 -- 172.21.15.99:0/4037529668 wait complete. 2024-01-31T05:11:57.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.833+0000 7f777dbe5740 20 client.15567 trim_cache size 0 max 16384 2024-01-31T05:11:57.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.844+0000 7f777dbe5740 1 Processor -- start 2024-01-31T05:11:57.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.844+0000 7f777dbe5740 1 -- start start 2024-01-31T05:11:57.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.844+0000 7f777dbe5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a50fdb3f10 0x55a50fdc1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.844+0000 7f777dbe5740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a50fdb4900 0x55a50fdc9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.844+0000 7f777dbe5740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a50fdb9a70 0x55a50fdc1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.844+0000 7f777dbe5740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a50fdc2c00 con 0x55a50fdb4900 2024-01-31T05:11:57.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.844+0000 7f777dbe5740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a50fd13dd0 con 0x55a50fdb9a70 2024-01-31T05:11:57.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.844+0000 7f777dbe5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a50fdb4ff0 con 0x55a50fdb3f10 2024-01-31T05:11:57.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.845+0000 7f7773fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a50fdb4900 0x55a50fdc9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.845+0000 7f7773fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a50fdb4900 0x55a50fdc9ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48110/0 (socket says 172.21.15.99:48110) 2024-01-31T05:11:57.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.845+0000 7f7773fff640 1 -- 172.21.15.99:0/1227201834 learned_addr learned my addr 172.21.15.99:0/1227201834 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:57.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.845+0000 7f7778ade640 1 --2- 172.21.15.99:0/1227201834 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a50fdb3f10 0x55a50fdc1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.845+0000 7f7773fff640 1 -- 172.21.15.99:0/1227201834 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a50fdb3f10 msgr2=0x55a50fdc1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:57.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.845+0000 7f7773fff640 1 --2- 172.21.15.99:0/1227201834 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a50fdb3f10 0x55a50fdc1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.845+0000 7f7773fff640 1 -- 172.21.15.99:0/1227201834 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a50fdb9a70 msgr2=0x55a50fdc1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:57.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.845+0000 7f7773fff640 1 --2- 172.21.15.99:0/1227201834 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a50fdb9a70 0x55a50fdc1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.845+0000 7f7773fff640 1 -- 172.21.15.99:0/1227201834 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a50fcb64d0 con 0x55a50fdb4900 2024-01-31T05:11:57.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.845+0000 7f7773fff640 1 --2- 172.21.15.99:0/1227201834 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a50fdb4900 0x55a50fdc9ad0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f775c009900 tx=0x7f775c041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=896c5cf2ace54e1a server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:57.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.845+0000 7f776a7fc640 1 -- 172.21.15.99:0/1227201834 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f775c0041c0 con 0x55a50fdb4900 2024-01-31T05:11:57.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.845+0000 7f776a7fc640 1 -- 172.21.15.99:0/1227201834 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f775c0054c0 con 0x55a50fdb4900 2024-01-31T05:11:57.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.845+0000 7f776a7fc640 1 -- 172.21.15.99:0/1227201834 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f775c003c20 con 0x55a50fdb4900 2024-01-31T05:11:57.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.846+0000 7f777dbe5740 1 -- 172.21.15.99:0/1227201834 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a50fdb4900 msgr2=0x55a50fdc9ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:57.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.846+0000 7f777dbe5740 1 --2- 172.21.15.99:0/1227201834 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a50fdb4900 0x55a50fdc9ad0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f775c009900 tx=0x7f775c041000 comp rx=0 tx=0).stop 2024-01-31T05:11:57.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.846+0000 7f777dbe5740 1 -- 172.21.15.99:0/1227201834 shutdown_connections 2024-01-31T05:11:57.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.846+0000 7f777dbe5740 1 --2- 172.21.15.99:0/1227201834 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a50fdb9a70 0x55a50fdc1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.846+0000 7f777dbe5740 1 --2- 172.21.15.99:0/1227201834 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a50fdb4900 0x55a50fdc9ad0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.846+0000 7f777dbe5740 1 --2- 172.21.15.99:0/1227201834 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a50fdb3f10 0x55a50fdc1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.846+0000 7f777dbe5740 1 -- 172.21.15.99:0/1227201834 >> 172.21.15.99:0/1227201834 conn(0x55a50fdaf480 msgr2=0x55a50fdc0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:57.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.846+0000 7f777dbe5740 1 -- 172.21.15.99:0/1227201834 shutdown_connections 2024-01-31T05:11:57.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.846+0000 7f777dbe5740 1 -- 172.21.15.99:0/1227201834 wait complete. 2024-01-31T05:11:57.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.846+0000 7f777dbe5740 1 -- start start 2024-01-31T05:11:57.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.846+0000 7f777dbe5740 1 Processor -- start 2024-01-31T05:11:57.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.847+0000 7f777dbe5740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a50fdb3f10 0x55a50fdc83c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.847+0000 7f777dbe5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a50fdb4900 0x55a50fdc8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.847+0000 7f777dbe5740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a50fdb9a70 0x55a50fdc8e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.847+0000 7f777dbe5740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a50fe24900 con 0x55a50fdb3f10 2024-01-31T05:11:57.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.847+0000 7f777dbe5740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a50fe24a40 con 0x55a50fdb9a70 2024-01-31T05:11:57.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.847+0000 7f777dbe5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a50fe24c00 con 0x55a50fdb4900 2024-01-31T05:11:57.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.847+0000 7f777dbe5740 10 client.0 _ll_register_callbacks cb 0x7f7764009a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:11:57.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.847+0000 7f7778ade640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a50fdb3f10 0x55a50fdc83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.847+0000 7f7778ade640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a50fdb3f10 0x55a50fdc83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48114/0 (socket says 172.21.15.99:48114) 2024-01-31T05:11:57.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.847+0000 7f7778ade640 1 -- 172.21.15.99:0/2958068066 learned_addr learned my addr 172.21.15.99:0/2958068066 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:57.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.847+0000 7f7773fff640 1 --2- 172.21.15.99:0/2958068066 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a50fdb4900 0x55a50fdc8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.847+0000 7f7778ade640 1 -- 172.21.15.99:0/2958068066 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a50fdb4900 msgr2=0x55a50fdc8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:57.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.847+0000 7f7778ade640 1 --2- 172.21.15.99:0/2958068066 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a50fdb4900 0x55a50fdc8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.847+0000 7f7778ade640 1 -- 172.21.15.99:0/2958068066 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a50fdb9a70 msgr2=0x55a50fdc8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:57.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.847+0000 7f7778ade640 1 --2- 172.21.15.99:0/2958068066 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a50fdb9a70 0x55a50fdc8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.847+0000 7f7778ade640 1 -- 172.21.15.99:0/2958068066 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7774108930 con 0x55a50fdb3f10 2024-01-31T05:11:57.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.847+0000 7f7778ade640 1 --2- 172.21.15.99:0/2958068066 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a50fdb3f10 0x55a50fdc83c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f7764009760 tx=0x7f7764004bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea1488c22bee9052 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:57.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.847+0000 7f7753fff640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:11:57.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.847+0000 7f7753fff640 1 -- 172.21.15.99:0/2958068066 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7764021040 con 0x55a50fdb3f10 2024-01-31T05:11:57.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.847+0000 7f7753fff640 1 -- 172.21.15.99:0/2958068066 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f77640287a0 con 0x55a50fdb3f10 2024-01-31T05:11:57.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.847+0000 7f777dbe5740 1 -- 172.21.15.99:0/2958068066 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7764003b70 con 0x55a50fdb3f10 2024-01-31T05:11:57.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.847+0000 7f7753fff640 1 -- 172.21.15.99:0/2958068066 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7764004e60 con 0x55a50fdb3f10 2024-01-31T05:11:57.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.847+0000 7f777dbe5740 10 client.15573 fetch_fsmap learned FSMap version 27 2024-01-31T05:11:57.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.847+0000 7f777dbe5740 1 -- 172.21.15.99:0/2958068066 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55a50fcdc020 con 0x55a50fdb3f10 2024-01-31T05:11:57.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.848+0000 7f7753fff640 1 -- 172.21.15.99:0/2958068066 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7764003b70 con 0x55a50fdb3f10 2024-01-31T05:11:57.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.848+0000 7f7753fff640 1 -- 172.21.15.99:0/2958068066 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7764027040 con 0x55a50fdb3f10 2024-01-31T05:11:57.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.848+0000 7f777dbe5740 10 client.15573 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:11:57.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.848+0000 7f777dbe5740 10 client.15573 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-01-31T05:11:57.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.848+0000 7f777dbe5740 20 client.15573 populate_metadata read hostname 'smithi099' 2024-01-31T05:11:57.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.848+0000 7f777dbe5740 1 --2- 172.21.15.99:0/2958068066 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x55a50fe26700 0x55a50fe28b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.848+0000 7f777dbe5740 4 client.15573 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-01-31T05:11:57.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.848+0000 7f777dbe5740 1 -- 172.21.15.99:0/2958068066 --> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55a50fa1a7e0 con 0x55a50fe26700 2024-01-31T05:11:57.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.848+0000 7f7773fff640 1 --2- 172.21.15.99:0/2958068066 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x55a50fe26700 0x55a50fe28b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.849+0000 7f7773fff640 1 --2- 172.21.15.99:0/2958068066 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x55a50fe26700 0x55a50fe28b20 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=67008cbb8e2e5299 server_cookie=805b9904f9c9d801 in_seq=0 out_seq=0 2024-01-31T05:11:57.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.849+0000 7f7753fff640 10 client.15573 ms_handle_connect on v2:172.21.15.181:6836/3875964154 2024-01-31T05:11:57.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.849+0000 7f7753fff640 1 -- 172.21.15.99:0/2958068066 <== mds.3 v2:172.21.15.181:6836/3875964154 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55a50fa1a7e0 con 0x55a50fe26700 2024-01-31T05:11:57.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.849+0000 7f7753fff640 10 client.15573 handle_command_reply: tid=0 2024-01-31T05:11:57.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.849+0000 7f777dbe5740 1 client.15573 shutdown 2024-01-31T05:11:57.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.849+0000 7f777dbe5740 1 -- 172.21.15.99:0/2958068066 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a50fdb3f10 msgr2=0x55a50fdc83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:57.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.849+0000 7f777dbe5740 1 --2- 172.21.15.99:0/2958068066 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a50fdb3f10 0x55a50fdc83c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f7764009760 tx=0x7f7764004bf0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.849+0000 7f777dbe5740 1 -- 172.21.15.99:0/2958068066 shutdown_connections 2024-01-31T05:11:57.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.849+0000 7f777dbe5740 1 --2- 172.21.15.99:0/2958068066 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x55a50fe26700 0x55a50fe28b20 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.849+0000 7f777dbe5740 1 --2- 172.21.15.99:0/2958068066 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a50fdb9a70 0x55a50fdc8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.849+0000 7f777dbe5740 1 --2- 172.21.15.99:0/2958068066 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a50fdb4900 0x55a50fdc8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.849+0000 7f777dbe5740 1 --2- 172.21.15.99:0/2958068066 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a50fdb3f10 0x55a50fdc83c0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.849+0000 7f7753fff640 0 client.15573 ms_handle_reset on v2:172.21.15.181:6836/3875964154 2024-01-31T05:11:57.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.849+0000 7f777dbe5740 1 -- 172.21.15.99:0/2958068066 >> 172.21.15.99:0/2958068066 conn(0x55a50fdaf480 msgr2=0x55a50fdb26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:57.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.849+0000 7f777dbe5740 1 -- 172.21.15.99:0/2958068066 shutdown_connections 2024-01-31T05:11:57.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.849+0000 7f777dbe5740 1 -- 172.21.15.99:0/2958068066 wait complete. 2024-01-31T05:11:57.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.849+0000 7f777dbe5740 20 client.15573 trim_cache size 0 max 16384 2024-01-31T05:11:57.856 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-01-31T05:11:57.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.850+0000 7f777ad42640 1 -- 172.21.15.99:0/3787581471 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f77600a1370 msgr2=0x7f77600a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:57.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.850+0000 7f777ad42640 1 --2- 172.21.15.99:0/3787581471 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f77600a1370 0x7f77600a3830 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f775c005ab0 tx=0x7f775c02c980 comp rx=0 tx=0).stop 2024-01-31T05:11:57.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.850+0000 7f777ad42640 1 -- 172.21.15.99:0/3787581471 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f77741017a0 msgr2=0x7f777419e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:57.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.850+0000 7f777ad42640 1 --2- 172.21.15.99:0/3787581471 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f77741017a0 0x7f777419e0a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f776c00c970 tx=0x7f776c00ce30 comp rx=0 tx=0).stop 2024-01-31T05:11:57.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.850+0000 7f777ad42640 1 -- 172.21.15.99:0/3787581471 shutdown_connections 2024-01-31T05:11:57.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.850+0000 7f777ad42640 1 --2- 172.21.15.99:0/3787581471 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f77600a1370 0x7f77600a3830 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.850+0000 7f777ad42640 1 --2- 172.21.15.99:0/3787581471 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f77741017a0 0x7f777419e0a0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.850+0000 7f777ad42640 1 --2- 172.21.15.99:0/3787581471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7774100de0 0x7f777419ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.850+0000 7f777ad42640 1 --2- 172.21.15.99:0/3787581471 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f77740ffbf0 0x7f7774068a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.850+0000 7f777ad42640 1 -- 172.21.15.99:0/3787581471 >> 172.21.15.99:0/3787581471 conn(0x7f77740fb180 msgr2=0x7f77741041b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:57.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.850+0000 7f777ad42640 1 -- 172.21.15.99:0/3787581471 shutdown_connections 2024-01-31T05:11:57.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.850+0000 7f777ad42640 1 -- 172.21.15.99:0/3787581471 wait complete. 2024-01-31T05:11:57.860 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:57 smithi099 ceph-mon[31615]: pgmap v366: 97 pgs: 97 active+clean; 658 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-01-31T05:11:57.860 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:57 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/1090751230' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:11:57.861 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-01-31T05:11:57.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.964+0000 7f116ec62640 1 -- 172.21.15.99:0/1225188121 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f116810d2b0 msgr2=0x7f1168113b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:57.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.964+0000 7f116ec62640 1 --2- 172.21.15.99:0/1225188121 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f116810d2b0 0x7f1168113b40 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f1160009ca0 tx=0x7f116002c0f0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.964+0000 7f116ec62640 1 -- 172.21.15.99:0/1225188121 shutdown_connections 2024-01-31T05:11:57.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.964+0000 7f116ec62640 1 --2- 172.21.15.99:0/1225188121 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f116810d2b0 0x7f1168113b40 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.964+0000 7f116ec62640 1 --2- 172.21.15.99:0/1225188121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f116810c8f0 0x7f116810cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.964+0000 7f116ec62640 1 --2- 172.21.15.99:0/1225188121 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f116810b700 0x7f116810bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.964+0000 7f116ec62640 1 -- 172.21.15.99:0/1225188121 >> 172.21.15.99:0/1225188121 conn(0x7f116806b730 msgr2=0x7f116806bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:57.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.964+0000 7f116ec62640 1 -- 172.21.15.99:0/1225188121 shutdown_connections 2024-01-31T05:11:57.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.964+0000 7f116ec62640 1 -- 172.21.15.99:0/1225188121 wait complete. 2024-01-31T05:11:57.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.965+0000 7f116ec62640 1 Processor -- start 2024-01-31T05:11:57.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.965+0000 7f116ec62640 1 -- start start 2024-01-31T05:11:57.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.965+0000 7f116ec62640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f116810b700 0x7f11681a15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.965+0000 7f116ec62640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f116810c8f0 0x7f11681a1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.965+0000 7f116ec62640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f116810d2b0 0x7f11681a8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.965+0000 7f116ec62640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11681a90c0 con 0x7f116810b700 2024-01-31T05:11:57.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.965+0000 7f116ec62640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11681a9230 con 0x7f116810d2b0 2024-01-31T05:11:57.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.965+0000 7f116ec62640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11681a93f0 con 0x7f116810c8f0 2024-01-31T05:11:57.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.965+0000 7f116c9fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f116810b700 0x7f11681a15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.965+0000 7f116c9fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f116810b700 0x7f11681a15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48140/0 (socket says 172.21.15.99:48140) 2024-01-31T05:11:57.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.965+0000 7f116c9fe640 1 -- 172.21.15.99:0/1730884380 learned_addr learned my addr 172.21.15.99:0/1730884380 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:57.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.965+0000 7f116d1ff640 1 --2- 172.21.15.99:0/1730884380 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f116810d2b0 0x7f11681a8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.965+0000 7f1167fff640 1 --2- 172.21.15.99:0/1730884380 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f116810c8f0 0x7f11681a1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.965+0000 7f116c9fe640 1 -- 172.21.15.99:0/1730884380 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f116810c8f0 msgr2=0x7f11681a1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:57.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.965+0000 7f116c9fe640 1 --2- 172.21.15.99:0/1730884380 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f116810c8f0 0x7f11681a1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.965+0000 7f116c9fe640 1 -- 172.21.15.99:0/1730884380 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f116810d2b0 msgr2=0x7f11681a8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:57.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.965+0000 7f116c9fe640 1 --2- 172.21.15.99:0/1730884380 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f116810d2b0 0x7f11681a8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.965+0000 7f116c9fe640 1 -- 172.21.15.99:0/1730884380 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1160009900 con 0x7f116810b700 2024-01-31T05:11:57.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.965+0000 7f116c9fe640 1 --2- 172.21.15.99:0/1730884380 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f116810b700 0x7f11681a15d0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f115c00c970 tx=0x7f115c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:57.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.965+0000 7f1165ffb640 1 -- 172.21.15.99:0/1730884380 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c007c10 con 0x7f116810b700 2024-01-31T05:11:57.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.966+0000 7f1165ffb640 1 -- 172.21.15.99:0/1730884380 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f115c007d70 con 0x7f116810b700 2024-01-31T05:11:57.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.966+0000 7f116ec62640 1 -- 172.21.15.99:0/1730884380 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11681a96d0 con 0x7f116810b700 2024-01-31T05:11:57.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.966+0000 7f1165ffb640 1 -- 172.21.15.99:0/1730884380 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c00f800 con 0x7f116810b700 2024-01-31T05:11:57.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.966+0000 7f116ec62640 1 -- 172.21.15.99:0/1730884380 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11681a9be0 con 0x7f116810b700 2024-01-31T05:11:57.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.968+0000 7f1165ffb640 1 -- 172.21.15.99:0/1730884380 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f115c018a40 con 0x7f116810b700 2024-01-31T05:11:57.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.968+0000 7f1171a1f740 1 Processor -- start 2024-01-31T05:11:57.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.968+0000 7f1171a1f740 1 -- start start 2024-01-31T05:11:57.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.968+0000 7f1165ffb640 1 --2- 172.21.15.99:0/1730884380 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f11580a1370 0x7f11580a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.968+0000 7f1171a1f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645fd42ef10 0x5645fd42f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.968+0000 7f1171a1f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645fd42f900 0x5645fd434400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.968+0000 7f1171a1f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5645fd434a70 0x5645fd436f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.968+0000 7f1171a1f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645fd39d240 con 0x5645fd42f900 2024-01-31T05:11:57.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.968+0000 7f1171a1f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645fd39a930 con 0x5645fd434a70 2024-01-31T05:11:57.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.968+0000 7f1171a1f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645fd396220 con 0x5645fd42ef10 2024-01-31T05:11:57.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.968+0000 7f1167fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645fd42f900 0x5645fd434400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.968+0000 7f116d1ff640 1 --2- 172.21.15.99:0/1730884380 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f11580a1370 0x7f11580a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.968+0000 7f1167fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645fd42f900 0x5645fd434400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48146/0 (socket says 172.21.15.99:48146) 2024-01-31T05:11:57.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.968+0000 7f1167fff640 1 -- 172.21.15.99:0/2272984940 learned_addr learned my addr 172.21.15.99:0/2272984940 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:57.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.968+0000 7f1165ffb640 1 -- 172.21.15.99:0/1730884380 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f115c013070 con 0x7f116810b700 2024-01-31T05:11:57.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.968+0000 7f116c9fe640 1 --2- 172.21.15.99:0/2272984940 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645fd42ef10 0x5645fd42f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.969+0000 7f1167fff640 1 -- 172.21.15.99:0/2272984940 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645fd42ef10 msgr2=0x5645fd42f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:57.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.969+0000 7f1167fff640 1 --2- 172.21.15.99:0/2272984940 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645fd42ef10 0x5645fd42f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.969+0000 7f1167fff640 1 -- 172.21.15.99:0/2272984940 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5645fd434a70 msgr2=0x5645fd436f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:57.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.969+0000 7f1167fff640 1 --2- 172.21.15.99:0/2272984940 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5645fd434a70 0x5645fd436f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.969+0000 7f1167fff640 1 -- 172.21.15.99:0/2272984940 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5645fd3587c0 con 0x5645fd42f900 2024-01-31T05:11:57.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.969+0000 7f116d1ff640 1 --2- 172.21.15.99:0/1730884380 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f11580a1370 0x7f11580a3830 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1160005e30 tx=0x7f1160009360 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:57.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.969+0000 7f1167fff640 1 --2- 172.21.15.99:0/2272984940 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645fd42f900 0x5645fd434400 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f1154009c90 tx=0x7f1154011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22f14c0013a49f24 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:57.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.969+0000 7f1152ffd640 1 -- 172.21.15.99:0/2272984940 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1154009e40 con 0x5645fd42f900 2024-01-31T05:11:57.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.969+0000 7f1152ffd640 1 -- 172.21.15.99:0/2272984940 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f11540054e0 con 0x5645fd42f900 2024-01-31T05:11:57.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.969+0000 7f1152ffd640 1 -- 172.21.15.99:0/2272984940 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1154019670 con 0x5645fd42f900 2024-01-31T05:11:57.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.970+0000 7f1171a1f740 1 -- 172.21.15.99:0/2272984940 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645fd42f900 msgr2=0x5645fd434400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:57.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.970+0000 7f1171a1f740 1 --2- 172.21.15.99:0/2272984940 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645fd42f900 0x5645fd434400 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f1154009c90 tx=0x7f1154011810 comp rx=0 tx=0).stop 2024-01-31T05:11:57.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.970+0000 7f1171a1f740 1 -- 172.21.15.99:0/2272984940 shutdown_connections 2024-01-31T05:11:57.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.970+0000 7f1171a1f740 1 --2- 172.21.15.99:0/2272984940 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5645fd434a70 0x5645fd436f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.970+0000 7f1171a1f740 1 --2- 172.21.15.99:0/2272984940 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645fd42f900 0x5645fd434400 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.970+0000 7f1171a1f740 1 --2- 172.21.15.99:0/2272984940 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645fd42ef10 0x5645fd42f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.970+0000 7f1171a1f740 1 -- 172.21.15.99:0/2272984940 >> 172.21.15.99:0/2272984940 conn(0x5645fd42a480 msgr2=0x5645fd42a880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:57.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.970+0000 7f1171a1f740 1 -- 172.21.15.99:0/2272984940 shutdown_connections 2024-01-31T05:11:57.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.970+0000 7f1171a1f740 1 -- 172.21.15.99:0/2272984940 wait complete. 2024-01-31T05:11:57.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.970+0000 7f1171a1f740 1 -- start start 2024-01-31T05:11:57.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.970+0000 7f1171a1f740 1 Processor -- start 2024-01-31T05:11:57.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.970+0000 7f1171a1f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645fd42ef10 0x5645fd4390a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.970+0000 7f1171a1f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5645fd42f900 0x5645fd4395e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.971+0000 7f1171a1f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645fd434a70 0x5645fd440620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.971+0000 7f1171a1f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645fd34f5e0 con 0x5645fd42ef10 2024-01-31T05:11:57.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.971+0000 7f1171a1f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645fd34f280 con 0x5645fd42f900 2024-01-31T05:11:57.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.971+0000 7f1171a1f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645fd3143d0 con 0x5645fd434a70 2024-01-31T05:11:57.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.971+0000 7f1171a1f740 10 client.0 _ll_register_callbacks cb 0x5645fd38ceb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:11:57.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.971+0000 7f116c9fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645fd42ef10 0x5645fd4390a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.971+0000 7f116c9fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645fd42ef10 0x5645fd4390a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48154/0 (socket says 172.21.15.99:48154) 2024-01-31T05:11:57.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.971+0000 7f116c9fe640 1 -- 172.21.15.99:0/3578442851 learned_addr learned my addr 172.21.15.99:0/3578442851 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:57.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.971+0000 7f116d1ff640 1 --2- 172.21.15.99:0/3578442851 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645fd434a70 0x5645fd440620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.971+0000 7f1167fff640 1 --2- 172.21.15.99:0/3578442851 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5645fd42f900 0x5645fd4395e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.971+0000 7f116c9fe640 1 -- 172.21.15.99:0/3578442851 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645fd434a70 msgr2=0x5645fd440620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:57.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.971+0000 7f116c9fe640 1 --2- 172.21.15.99:0/3578442851 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645fd434a70 0x5645fd440620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.971+0000 7f116c9fe640 1 -- 172.21.15.99:0/3578442851 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5645fd42f900 msgr2=0x5645fd4395e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:57.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.971+0000 7f116c9fe640 1 --2- 172.21.15.99:0/3578442851 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5645fd42f900 0x5645fd4395e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.971+0000 7f116c9fe640 1 -- 172.21.15.99:0/3578442851 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11540098f0 con 0x5645fd42ef10 2024-01-31T05:11:57.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.971+0000 7f116c9fe640 1 --2- 172.21.15.99:0/3578442851 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645fd42ef10 0x5645fd4390a0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f115c00c940 tx=0x7f115c099c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d9b3d2fdf309614 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:57.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.971+0000 7f1147fff640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:11:57.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.971+0000 7f1147fff640 1 -- 172.21.15.99:0/3578442851 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c09eea0 con 0x5645fd42ef10 2024-01-31T05:11:57.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.971+0000 7f1147fff640 1 -- 172.21.15.99:0/3578442851 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f115c09e160 con 0x5645fd42ef10 2024-01-31T05:11:57.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.971+0000 7f1171a1f740 1 -- 172.21.15.99:0/3578442851 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5645fd38f0b0 con 0x5645fd42ef10 2024-01-31T05:11:57.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.971+0000 7f1147fff640 1 -- 172.21.15.99:0/3578442851 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f115c0a2310 con 0x5645fd42ef10 2024-01-31T05:11:57.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.971+0000 7f1171a1f740 10 client.15585 fetch_fsmap learned FSMap version 27 2024-01-31T05:11:57.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.971+0000 7f1171a1f740 1 -- 172.21.15.99:0/3578442851 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5645fd3948a0 con 0x5645fd42ef10 2024-01-31T05:11:57.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.971+0000 7f1147fff640 1 -- 172.21.15.99:0/3578442851 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f115c07c070 con 0x5645fd42ef10 2024-01-31T05:11:57.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.972+0000 7f1147fff640 1 -- 172.21.15.99:0/3578442851 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f115c099500 con 0x5645fd42ef10 2024-01-31T05:11:57.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.972+0000 7f1171a1f740 10 client.15585 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:11:57.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.972+0000 7f1171a1f740 10 client.15585 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-01-31T05:11:57.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.972+0000 7f1171a1f740 20 client.15585 populate_metadata read hostname 'smithi099' 2024-01-31T05:11:57.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.972+0000 7f1171a1f740 1 --2- 172.21.15.99:0/3578442851 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x5645fd444fb0 0x5645fd4473f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.972+0000 7f1171a1f740 4 client.15585 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:11:57.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.972+0000 7f1171a1f740 1 -- 172.21.15.99:0/3578442851 --> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5645fd38edd0 con 0x5645fd444fb0 2024-01-31T05:11:57.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.972+0000 7f1167fff640 1 --2- 172.21.15.99:0/3578442851 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x5645fd444fb0 0x5645fd4473f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.972+0000 7f1147fff640 10 client.15585 ms_handle_connect on v2:172.21.15.181:6838/996120687 2024-01-31T05:11:57.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.972+0000 7f1167fff640 1 --2- 172.21.15.99:0/3578442851 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x5645fd444fb0 0x5645fd4473f0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ccb835fd70e3b642 server_cookie=94b3a111675ae7a2 in_seq=0 out_seq=0 2024-01-31T05:11:57.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.973+0000 7f1147fff640 1 -- 172.21.15.99:0/3578442851 <== mds.2 v2:172.21.15.181:6838/996120687 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5645fd38edd0 con 0x5645fd444fb0 2024-01-31T05:11:57.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.973+0000 7f1147fff640 10 client.15585 handle_command_reply: tid=0 2024-01-31T05:11:57.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.973+0000 7f1171a1f740 1 client.15585 shutdown 2024-01-31T05:11:57.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.973+0000 7f1171a1f740 1 -- 172.21.15.99:0/3578442851 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645fd42ef10 msgr2=0x5645fd4390a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:57.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.973+0000 7f1171a1f740 1 --2- 172.21.15.99:0/3578442851 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645fd42ef10 0x5645fd4390a0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f115c00c940 tx=0x7f115c099c10 comp rx=0 tx=0).stop 2024-01-31T05:11:57.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.973+0000 7f1171a1f740 1 -- 172.21.15.99:0/3578442851 shutdown_connections 2024-01-31T05:11:57.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.973+0000 7f1171a1f740 1 --2- 172.21.15.99:0/3578442851 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x5645fd444fb0 0x5645fd4473f0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.973+0000 7f1171a1f740 1 --2- 172.21.15.99:0/3578442851 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645fd434a70 0x5645fd440620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.973+0000 7f1171a1f740 1 --2- 172.21.15.99:0/3578442851 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5645fd42f900 0x5645fd4395e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.973+0000 7f1171a1f740 1 --2- 172.21.15.99:0/3578442851 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645fd42ef10 0x5645fd4390a0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.973+0000 7f1171a1f740 1 -- 172.21.15.99:0/3578442851 >> 172.21.15.99:0/3578442851 conn(0x5645fd42a480 msgr2=0x5645fd4297c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:57.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.973+0000 7f1147fff640 0 client.15585 ms_handle_reset on v2:172.21.15.181:6838/996120687 2024-01-31T05:11:57.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.974+0000 7f1171a1f740 1 -- 172.21.15.99:0/3578442851 shutdown_connections 2024-01-31T05:11:57.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.974+0000 7f1171a1f740 1 -- 172.21.15.99:0/3578442851 wait complete. 2024-01-31T05:11:57.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.974+0000 7f1171a1f740 20 client.15585 trim_cache size 0 max 16384 2024-01-31T05:11:57.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.985+0000 7f1171a1f740 1 Processor -- start 2024-01-31T05:11:57.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.985+0000 7f1171a1f740 1 -- start start 2024-01-31T05:11:57.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.985+0000 7f1171a1f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5645fd42ef10 0x5645fd438cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.985+0000 7f1171a1f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645fd42f900 0x5645fd4405b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.985+0000 7f1171a1f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645fd434a70 0x5645fd4391f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.985+0000 7f1171a1f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645fd42fd30 con 0x5645fd434a70 2024-01-31T05:11:57.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.985+0000 7f1171a1f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645fd443540 con 0x5645fd42ef10 2024-01-31T05:11:57.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.985+0000 7f1171a1f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645fd42b420 con 0x5645fd42f900 2024-01-31T05:11:57.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.986+0000 7f116d1ff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645fd434a70 0x5645fd4391f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.986+0000 7f116d1ff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645fd434a70 0x5645fd4391f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48160/0 (socket says 172.21.15.99:48160) 2024-01-31T05:11:57.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.986+0000 7f116d1ff640 1 -- 172.21.15.99:0/733420870 learned_addr learned my addr 172.21.15.99:0/733420870 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:57.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.986+0000 7f116c9fe640 1 --2- 172.21.15.99:0/733420870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5645fd42ef10 0x5645fd438cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.986+0000 7f1167fff640 1 --2- 172.21.15.99:0/733420870 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645fd42f900 0x5645fd4405b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.986+0000 7f116d1ff640 1 -- 172.21.15.99:0/733420870 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645fd42f900 msgr2=0x5645fd4405b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:57.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.986+0000 7f116d1ff640 1 --2- 172.21.15.99:0/733420870 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645fd42f900 0x5645fd4405b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.986+0000 7f116d1ff640 1 -- 172.21.15.99:0/733420870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5645fd42ef10 msgr2=0x5645fd438cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:57.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.986+0000 7f116d1ff640 1 --2- 172.21.15.99:0/733420870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5645fd42ef10 0x5645fd438cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.986+0000 7f116d1ff640 1 -- 172.21.15.99:0/733420870 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5645fd3314d0 con 0x5645fd434a70 2024-01-31T05:11:57.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.986+0000 7f116d1ff640 1 --2- 172.21.15.99:0/733420870 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645fd434a70 0x5645fd4391f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f11600325c0 tx=0x7f1160041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9a93a4023bc51b8 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:57.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.986+0000 7f11527fc640 1 -- 172.21.15.99:0/733420870 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1160034a70 con 0x5645fd434a70 2024-01-31T05:11:57.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.986+0000 7f11527fc640 1 -- 172.21.15.99:0/733420870 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1160047040 con 0x5645fd434a70 2024-01-31T05:11:57.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.986+0000 7f11527fc640 1 -- 172.21.15.99:0/733420870 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1160004400 con 0x5645fd434a70 2024-01-31T05:11:57.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.987+0000 7f1171a1f740 1 -- 172.21.15.99:0/733420870 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645fd434a70 msgr2=0x5645fd4391f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:57.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.987+0000 7f1171a1f740 1 --2- 172.21.15.99:0/733420870 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645fd434a70 0x5645fd4391f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f11600325c0 tx=0x7f1160041000 comp rx=0 tx=0).stop 2024-01-31T05:11:57.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.987+0000 7f1171a1f740 1 -- 172.21.15.99:0/733420870 shutdown_connections 2024-01-31T05:11:57.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.987+0000 7f1171a1f740 1 --2- 172.21.15.99:0/733420870 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645fd434a70 0x5645fd4391f0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.987+0000 7f1171a1f740 1 --2- 172.21.15.99:0/733420870 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645fd42f900 0x5645fd4405b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.987+0000 7f1171a1f740 1 --2- 172.21.15.99:0/733420870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5645fd42ef10 0x5645fd438cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.987+0000 7f1171a1f740 1 -- 172.21.15.99:0/733420870 >> 172.21.15.99:0/733420870 conn(0x5645fd42a480 msgr2=0x5645fd430e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:57.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.987+0000 7f1171a1f740 1 -- 172.21.15.99:0/733420870 shutdown_connections 2024-01-31T05:11:57.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.987+0000 7f1171a1f740 1 -- 172.21.15.99:0/733420870 wait complete. 2024-01-31T05:11:57.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.987+0000 7f1171a1f740 1 -- start start 2024-01-31T05:11:57.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.987+0000 7f1171a1f740 1 Processor -- start 2024-01-31T05:11:57.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.987+0000 7f1171a1f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5645fd42ef10 0x5645fd43f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.987+0000 7f1171a1f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645fd42f900 0x5645fd43faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.987+0000 7f1171a1f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645fd434a70 0x5645fd49b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.987+0000 7f1171a1f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645fd49ba80 con 0x5645fd42f900 2024-01-31T05:11:57.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.987+0000 7f1171a1f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645fd49bbc0 con 0x5645fd42ef10 2024-01-31T05:11:57.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.987+0000 7f1171a1f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645fd49bd00 con 0x5645fd434a70 2024-01-31T05:11:57.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.987+0000 7f1171a1f740 10 client.0 _ll_register_callbacks cb 0x7f11540097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:11:57.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.988+0000 7f1167fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645fd42f900 0x5645fd43faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.988+0000 7f1167fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645fd42f900 0x5645fd43faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48168/0 (socket says 172.21.15.99:48168) 2024-01-31T05:11:57.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.988+0000 7f1167fff640 1 -- 172.21.15.99:0/482879655 learned_addr learned my addr 172.21.15.99:0/482879655 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:57.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.988+0000 7f116c9fe640 1 --2- 172.21.15.99:0/482879655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5645fd42ef10 0x5645fd43f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.988+0000 7f116d1ff640 1 --2- 172.21.15.99:0/482879655 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645fd434a70 0x5645fd49b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.988+0000 7f1167fff640 1 -- 172.21.15.99:0/482879655 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645fd434a70 msgr2=0x5645fd49b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:57.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.988+0000 7f1167fff640 1 --2- 172.21.15.99:0/482879655 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645fd434a70 0x5645fd49b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.988+0000 7f1167fff640 1 -- 172.21.15.99:0/482879655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5645fd42ef10 msgr2=0x5645fd43f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:57.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.988+0000 7f1167fff640 1 --2- 172.21.15.99:0/482879655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5645fd42ef10 0x5645fd43f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.988+0000 7f1167fff640 1 -- 172.21.15.99:0/482879655 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1168114440 con 0x5645fd42f900 2024-01-31T05:11:57.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.988+0000 7f116d1ff640 1 --2- 172.21.15.99:0/482879655 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645fd434a70 0x5645fd49b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:11:57.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.988+0000 7f1167fff640 1 --2- 172.21.15.99:0/482879655 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645fd42f900 0x5645fd43faf0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f11540058c0 tx=0x7f1154009dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44ca954e8cf7a15a server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:57.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.988+0000 7f1147fff640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:11:57.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.988+0000 7f1147fff640 1 -- 172.21.15.99:0/482879655 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1154005650 con 0x5645fd42f900 2024-01-31T05:11:57.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.988+0000 7f1147fff640 1 -- 172.21.15.99:0/482879655 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f1154027040 con 0x5645fd42f900 2024-01-31T05:11:57.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.988+0000 7f1171a1f740 1 -- 172.21.15.99:0/482879655 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f11540054e0 con 0x5645fd42f900 2024-01-31T05:11:57.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.988+0000 7f1147fff640 1 -- 172.21.15.99:0/482879655 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1154028b00 con 0x5645fd42f900 2024-01-31T05:11:57.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.988+0000 7f1171a1f740 10 client.15591 fetch_fsmap learned FSMap version 27 2024-01-31T05:11:57.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.988+0000 7f1171a1f740 1 -- 172.21.15.99:0/482879655 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5645fd357020 con 0x5645fd42f900 2024-01-31T05:11:57.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.988+0000 7f1147fff640 1 -- 172.21.15.99:0/482879655 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f11540054e0 con 0x5645fd42f900 2024-01-31T05:11:57.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.989+0000 7f1147fff640 1 -- 172.21.15.99:0/482879655 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f11540283c0 con 0x5645fd42f900 2024-01-31T05:11:57.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.989+0000 7f1171a1f740 10 client.15591 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:11:57.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.989+0000 7f1171a1f740 10 client.15591 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-01-31T05:11:57.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.989+0000 7f1171a1f740 20 client.15591 populate_metadata read hostname 'smithi099' 2024-01-31T05:11:57.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.989+0000 7f1171a1f740 1 --2- 172.21.15.99:0/482879655 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x5645fd49d7b0 0x5645fd49fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:57.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.989+0000 7f1171a1f740 4 client.15591 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-01-31T05:11:57.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.989+0000 7f1171a1f740 1 -- 172.21.15.99:0/482879655 --> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5645fd0957e0 con 0x5645fd49d7b0 2024-01-31T05:11:57.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.989+0000 7f116c9fe640 1 --2- 172.21.15.99:0/482879655 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x5645fd49d7b0 0x5645fd49fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:57.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.989+0000 7f1147fff640 10 client.15591 ms_handle_connect on v2:172.21.15.181:6838/996120687 2024-01-31T05:11:57.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.989+0000 7f116c9fe640 1 --2- 172.21.15.99:0/482879655 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x5645fd49d7b0 0x5645fd49fbd0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4ad9f80cacf16c7d server_cookie=4551703935f8e92d in_seq=0 out_seq=0 2024-01-31T05:11:57.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.989+0000 7f1147fff640 1 -- 172.21.15.99:0/482879655 <== mds.2 v2:172.21.15.181:6838/996120687 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5645fd0957e0 con 0x5645fd49d7b0 2024-01-31T05:11:57.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.989+0000 7f1147fff640 10 client.15591 handle_command_reply: tid=0 2024-01-31T05:11:57.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.989+0000 7f1171a1f740 1 client.15591 shutdown 2024-01-31T05:11:57.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.990+0000 7f1171a1f740 1 -- 172.21.15.99:0/482879655 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645fd42f900 msgr2=0x5645fd43faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:57.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.990+0000 7f1171a1f740 1 --2- 172.21.15.99:0/482879655 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645fd42f900 0x5645fd43faf0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f11540058c0 tx=0x7f1154009dd0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.990+0000 7f1171a1f740 1 -- 172.21.15.99:0/482879655 shutdown_connections 2024-01-31T05:11:57.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.990+0000 7f1171a1f740 1 --2- 172.21.15.99:0/482879655 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x5645fd49d7b0 0x5645fd49fbd0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.990+0000 7f1171a1f740 1 --2- 172.21.15.99:0/482879655 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645fd434a70 0x5645fd49b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.990+0000 7f1171a1f740 1 --2- 172.21.15.99:0/482879655 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645fd42f900 0x5645fd43faf0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.990+0000 7f1147fff640 0 client.15591 ms_handle_reset on v2:172.21.15.181:6838/996120687 2024-01-31T05:11:57.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.990+0000 7f1171a1f740 1 --2- 172.21.15.99:0/482879655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5645fd42ef10 0x5645fd43f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.990+0000 7f1171a1f740 1 -- 172.21.15.99:0/482879655 >> 172.21.15.99:0/482879655 conn(0x5645fd42a480 msgr2=0x5645fd438cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:57.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.990+0000 7f1171a1f740 1 -- 172.21.15.99:0/482879655 shutdown_connections 2024-01-31T05:11:57.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.990+0000 7f1171a1f740 1 -- 172.21.15.99:0/482879655 wait complete. 2024-01-31T05:11:57.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.990+0000 7f1171a1f740 20 client.15591 trim_cache size 0 max 16384 2024-01-31T05:11:57.997 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-01-31T05:11:57.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.990+0000 7f116ec62640 1 -- 172.21.15.99:0/1730884380 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f11580a1370 msgr2=0x7f11580a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:57.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.990+0000 7f116ec62640 1 --2- 172.21.15.99:0/1730884380 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f11580a1370 0x7f11580a3830 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1160005e30 tx=0x7f1160009360 comp rx=0 tx=0).stop 2024-01-31T05:11:57.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.990+0000 7f116ec62640 1 -- 172.21.15.99:0/1730884380 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f116810b700 msgr2=0x7f11681a15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:57.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.990+0000 7f116ec62640 1 --2- 172.21.15.99:0/1730884380 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f116810b700 0x7f11681a15d0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f115c00c970 tx=0x7f115c00ce30 comp rx=0 tx=0).stop 2024-01-31T05:11:57.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.990+0000 7f116ec62640 1 -- 172.21.15.99:0/1730884380 shutdown_connections 2024-01-31T05:11:57.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.990+0000 7f116ec62640 1 --2- 172.21.15.99:0/1730884380 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f11580a1370 0x7f11580a3830 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.990+0000 7f116ec62640 1 --2- 172.21.15.99:0/1730884380 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f116810d2b0 0x7f11681a8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.990+0000 7f116ec62640 1 --2- 172.21.15.99:0/1730884380 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f116810c8f0 0x7f11681a1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.990+0000 7f116ec62640 1 --2- 172.21.15.99:0/1730884380 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f116810b700 0x7f11681a15d0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:57.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.990+0000 7f116ec62640 1 -- 172.21.15.99:0/1730884380 >> 172.21.15.99:0/1730884380 conn(0x7f116806b730 msgr2=0x7f116810fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:57.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.990+0000 7f116ec62640 1 -- 172.21.15.99:0/1730884380 shutdown_connections 2024-01-31T05:11:57.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:57.990+0000 7f116ec62640 1 -- 172.21.15.99:0/1730884380 wait complete. 2024-01-31T05:11:58.002 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-01-31T05:11:58.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:57 smithi181 ceph-mon[36434]: pgmap v366: 97 pgs: 97 active+clean; 658 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-01-31T05:11:58.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:57 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/1090751230' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:11:58.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.104+0000 7f004bd5d640 1 -- 172.21.15.99:0/1032578278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0044100d20 msgr2=0x7f0044101140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:58.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.104+0000 7f004bd5d640 1 --2- 172.21.15.99:0/1032578278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0044100d20 0x7f0044101140 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f0040009900 tx=0x7f004002bc30 comp rx=0 tx=0).stop 2024-01-31T05:11:58.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.104+0000 7f004bd5d640 1 -- 172.21.15.99:0/1032578278 shutdown_connections 2024-01-31T05:11:58.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.104+0000 7f004bd5d640 1 --2- 172.21.15.99:0/1032578278 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00441028d0 0x7f0044109160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.104+0000 7f004bd5d640 1 --2- 172.21.15.99:0/1032578278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0044101f10 0x7f0044102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.104+0000 7f004bd5d640 1 --2- 172.21.15.99:0/1032578278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0044100d20 0x7f0044101140 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.104+0000 7f004bd5d640 1 -- 172.21.15.99:0/1032578278 >> 172.21.15.99:0/1032578278 conn(0x7f00440fc290 msgr2=0x7f00440fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:58.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.105+0000 7f004bd5d640 1 -- 172.21.15.99:0/1032578278 shutdown_connections 2024-01-31T05:11:58.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.105+0000 7f004bd5d640 1 -- 172.21.15.99:0/1032578278 wait complete. 2024-01-31T05:11:58.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.105+0000 7f004bd5d640 1 Processor -- start 2024-01-31T05:11:58.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.105+0000 7f004bd5d640 1 -- start start 2024-01-31T05:11:58.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.105+0000 7f004bd5d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0044100d20 0x7f0044196d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:58.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.105+0000 7f004bd5d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0044101f10 0x7f00441972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:58.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.105+0000 7f004bd5d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00441028d0 0x7f004419e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:58.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.105+0000 7f004bd5d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004419e850 con 0x7f00441028d0 2024-01-31T05:11:58.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.105+0000 7f004bd5d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004419e9c0 con 0x7f0044100d20 2024-01-31T05:11:58.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.105+0000 7f004bd5d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004419eb80 con 0x7f0044101f10 2024-01-31T05:11:58.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.105+0000 7f004a2fa640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00441028d0 0x7f004419e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:58.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.105+0000 7f004a2fa640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00441028d0 0x7f004419e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48190/0 (socket says 172.21.15.99:48190) 2024-01-31T05:11:58.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.105+0000 7f004a2fa640 1 -- 172.21.15.99:0/4093427376 learned_addr learned my addr 172.21.15.99:0/4093427376 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:58.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.105+0000 7f0049af9640 1 --2- 172.21.15.99:0/4093427376 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0044100d20 0x7f0044196d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:58.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.106+0000 7f00492f8640 1 --2- 172.21.15.99:0/4093427376 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0044101f10 0x7f00441972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:58.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.106+0000 7f004a2fa640 1 -- 172.21.15.99:0/4093427376 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0044101f10 msgr2=0x7f00441972a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:58.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.106+0000 7f004a2fa640 1 --2- 172.21.15.99:0/4093427376 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0044101f10 0x7f00441972a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.106+0000 7f004a2fa640 1 -- 172.21.15.99:0/4093427376 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0044100d20 msgr2=0x7f0044196d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:58.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.106+0000 7f004a2fa640 1 --2- 172.21.15.99:0/4093427376 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0044100d20 0x7f0044196d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.106+0000 7f004a2fa640 1 -- 172.21.15.99:0/4093427376 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0040009560 con 0x7f00441028d0 2024-01-31T05:11:58.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.106+0000 7f004a2fa640 1 --2- 172.21.15.99:0/4093427376 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00441028d0 0x7f004419e310 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f003c00b970 tx=0x7f003c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:58.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.106+0000 7f003affd640 1 -- 172.21.15.99:0/4093427376 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c00cb40 con 0x7f00441028d0 2024-01-31T05:11:58.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.106+0000 7f003affd640 1 -- 172.21.15.99:0/4093427376 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f003c00cca0 con 0x7f00441028d0 2024-01-31T05:11:58.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.106+0000 7f004bd5d640 1 -- 172.21.15.99:0/4093427376 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f004419ee60 con 0x7f00441028d0 2024-01-31T05:11:58.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.106+0000 7f003affd640 1 -- 172.21.15.99:0/4093427376 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c007770 con 0x7f00441028d0 2024-01-31T05:11:58.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.106+0000 7f004bd5d640 1 -- 172.21.15.99:0/4093427376 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f004419f3b0 con 0x7f00441028d0 2024-01-31T05:11:58.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.108+0000 7f003affd640 1 -- 172.21.15.99:0/4093427376 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f003c014440 con 0x7f00441028d0 2024-01-31T05:11:58.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.109+0000 7f004ebfe740 1 Processor -- start 2024-01-31T05:11:58.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.109+0000 7f004ebfe740 1 -- start start 2024-01-31T05:11:58.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.109+0000 7f003affd640 1 --2- 172.21.15.99:0/4093427376 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f00300a13f0 0x7f00300a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:58.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.109+0000 7f004ebfe740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557d56482f10 0x557d56483330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:58.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.109+0000 7f004ebfe740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d56483900 0x557d56488400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:58.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.109+0000 7f004ebfe740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d56488a70 0x557d5648af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:58.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.109+0000 7f004ebfe740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d563f1240 con 0x557d56482f10 2024-01-31T05:11:58.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.109+0000 7f004ebfe740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d563ee930 con 0x557d56483900 2024-01-31T05:11:58.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.109+0000 7f004ebfe740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d563ea220 con 0x557d56488a70 2024-01-31T05:11:58.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.109+0000 7f00492f8640 1 --2- 172.21.15.99:0/4093427376 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f00300a13f0 0x7f00300a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:58.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.109+0000 7f0049af9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557d56482f10 0x557d56483330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:58.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.109+0000 7f0049af9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557d56482f10 0x557d56483330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48198/0 (socket says 172.21.15.99:48198) 2024-01-31T05:11:58.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.109+0000 7f0049af9640 1 -- 172.21.15.99:0/1620491340 learned_addr learned my addr 172.21.15.99:0/1620491340 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:58.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.109+0000 7f003affd640 1 -- 172.21.15.99:0/4093427376 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f003c0cc290 con 0x7f00441028d0 2024-01-31T05:11:58.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.109+0000 7f004a2fa640 1 --2- 172.21.15.99:0/1620491340 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d56488a70 0x557d5648af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:58.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.109+0000 7f0049af9640 1 -- 172.21.15.99:0/1620491340 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d56488a70 msgr2=0x557d5648af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:58.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.109+0000 7f0049af9640 1 --2- 172.21.15.99:0/1620491340 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d56488a70 0x557d5648af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.110+0000 7f0049af9640 1 -- 172.21.15.99:0/1620491340 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d56483900 msgr2=0x557d56488400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:58.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.110+0000 7f0049af9640 1 --2- 172.21.15.99:0/1620491340 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d56483900 0x557d56488400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.110+0000 7f0049af9640 1 -- 172.21.15.99:0/1620491340 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557d563ac7c0 con 0x557d56482f10 2024-01-31T05:11:58.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.110+0000 7f00492f8640 1 --2- 172.21.15.99:0/4093427376 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f00300a13f0 0x7f00300a38b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0034005fd0 tx=0x7f0034009540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:58.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.110+0000 7f0049af9640 1 --2- 172.21.15.99:0/1620491340 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557d56482f10 0x557d56483330 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0040005ab0 tx=0x7f004002c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b404994c649f5c server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:58.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.110+0000 7f002ffff640 1 -- 172.21.15.99:0/1620491340 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004002cb30 con 0x557d56482f10 2024-01-31T05:11:58.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.110+0000 7f002ffff640 1 -- 172.21.15.99:0/1620491340 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0040004040 con 0x557d56482f10 2024-01-31T05:11:58.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.110+0000 7f002ffff640 1 -- 172.21.15.99:0/1620491340 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0040005420 con 0x557d56482f10 2024-01-31T05:11:58.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.111+0000 7f004ebfe740 1 -- 172.21.15.99:0/1620491340 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557d56482f10 msgr2=0x557d56483330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:58.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.111+0000 7f004ebfe740 1 --2- 172.21.15.99:0/1620491340 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557d56482f10 0x557d56483330 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0040005ab0 tx=0x7f004002c900 comp rx=0 tx=0).stop 2024-01-31T05:11:58.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.111+0000 7f004ebfe740 1 -- 172.21.15.99:0/1620491340 shutdown_connections 2024-01-31T05:11:58.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.111+0000 7f004ebfe740 1 --2- 172.21.15.99:0/1620491340 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d56488a70 0x557d5648af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.111+0000 7f004ebfe740 1 --2- 172.21.15.99:0/1620491340 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d56483900 0x557d56488400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.111+0000 7f004ebfe740 1 --2- 172.21.15.99:0/1620491340 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557d56482f10 0x557d56483330 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.111+0000 7f004ebfe740 1 -- 172.21.15.99:0/1620491340 >> 172.21.15.99:0/1620491340 conn(0x557d5647e480 msgr2=0x557d5647e880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:58.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.111+0000 7f004ebfe740 1 -- 172.21.15.99:0/1620491340 shutdown_connections 2024-01-31T05:11:58.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.111+0000 7f004ebfe740 1 -- 172.21.15.99:0/1620491340 wait complete. 2024-01-31T05:11:58.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.111+0000 7f004ebfe740 1 -- start start 2024-01-31T05:11:58.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.111+0000 7f004ebfe740 1 Processor -- start 2024-01-31T05:11:58.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.111+0000 7f004ebfe740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d56482f10 0x557d5648d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:58.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.111+0000 7f004ebfe740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d56483900 0x557d5648d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:58.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.111+0000 7f004ebfe740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557d56488a70 0x557d56494640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:58.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.112+0000 7f004ebfe740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d563a35e0 con 0x557d56488a70 2024-01-31T05:11:58.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.112+0000 7f004ebfe740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d563a3280 con 0x557d56483900 2024-01-31T05:11:58.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.112+0000 7f004ebfe740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d563683d0 con 0x557d56482f10 2024-01-31T05:11:58.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.112+0000 7f004ebfe740 10 client.0 _ll_register_callbacks cb 0x557d563e0eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:11:58.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.112+0000 7f004a2fa640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557d56488a70 0x557d56494640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:58.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.112+0000 7f004a2fa640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557d56488a70 0x557d56494640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48206/0 (socket says 172.21.15.99:48206) 2024-01-31T05:11:58.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.112+0000 7f004a2fa640 1 -- 172.21.15.99:0/1066196909 learned_addr learned my addr 172.21.15.99:0/1066196909 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:58.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.112+0000 7f00492f8640 1 --2- 172.21.15.99:0/1066196909 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d56483900 0x557d5648d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:58.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.112+0000 7f0049af9640 1 --2- 172.21.15.99:0/1066196909 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d56482f10 0x557d5648d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:58.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.112+0000 7f004a2fa640 1 -- 172.21.15.99:0/1066196909 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d56482f10 msgr2=0x557d5648d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:58.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.112+0000 7f004a2fa640 1 --2- 172.21.15.99:0/1066196909 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d56482f10 0x557d5648d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.112+0000 7f004a2fa640 1 -- 172.21.15.99:0/1066196909 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d56483900 msgr2=0x557d5648d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:58.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.112+0000 7f004a2fa640 1 --2- 172.21.15.99:0/1066196909 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d56483900 0x557d5648d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.112+0000 7f004a2fa640 1 -- 172.21.15.99:0/1066196909 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0044109a60 con 0x557d56488a70 2024-01-31T05:11:58.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.112+0000 7f004a2fa640 1 --2- 172.21.15.99:0/1066196909 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557d56488a70 0x557d56494640 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f003c0994e0 tx=0x7f003c065e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2dc9f5f3959141 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:58.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.112+0000 7f002d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:11:58.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.112+0000 7f002d7fa640 1 -- 172.21.15.99:0/1066196909 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c09d5f0 con 0x557d56488a70 2024-01-31T05:11:58.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.112+0000 7f002d7fa640 1 -- 172.21.15.99:0/1066196909 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f003c0a1830 con 0x557d56488a70 2024-01-31T05:11:58.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.112+0000 7f004ebfe740 1 -- 172.21.15.99:0/1066196909 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557d563e30b0 con 0x557d56488a70 2024-01-31T05:11:58.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.112+0000 7f002d7fa640 1 -- 172.21.15.99:0/1066196909 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f003c00ce10 con 0x557d56488a70 2024-01-31T05:11:58.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.112+0000 7f004ebfe740 10 client.15603 fetch_fsmap learned FSMap version 27 2024-01-31T05:11:58.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.112+0000 7f004ebfe740 1 -- 172.21.15.99:0/1066196909 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x557d563e88a0 con 0x557d56488a70 2024-01-31T05:11:58.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.113+0000 7f002d7fa640 1 -- 172.21.15.99:0/1066196909 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557d563e30b0 con 0x557d56488a70 2024-01-31T05:11:58.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.113+0000 7f002d7fa640 1 -- 172.21.15.99:0/1066196909 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f003c09d170 con 0x557d56488a70 2024-01-31T05:11:58.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.113+0000 7f004ebfe740 10 client.15603 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:11:58.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.113+0000 7f004ebfe740 10 client.15603 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-01-31T05:11:58.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.113+0000 7f004ebfe740 20 client.15603 populate_metadata read hostname 'smithi099' 2024-01-31T05:11:58.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.113+0000 7f004ebfe740 1 --2- 172.21.15.99:0/1066196909 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x557d56498f40 0x557d5649b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:58.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.113+0000 7f004ebfe740 4 client.15603 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:11:58.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.113+0000 7f004ebfe740 1 -- 172.21.15.99:0/1066196909 --> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557d563e2dd0 con 0x557d56498f40 2024-01-31T05:11:58.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.113+0000 7f0049af9640 1 --2- 172.21.15.99:0/1066196909 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x557d56498f40 0x557d5649b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:58.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.113+0000 7f002d7fa640 10 client.15603 ms_handle_connect on v2:172.21.15.179:6836/837402830 2024-01-31T05:11:58.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.113+0000 7f0049af9640 1 --2- 172.21.15.99:0/1066196909 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x557d56498f40 0x557d5649b360 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=82bb05b07dfb4829 server_cookie=c8c8be9ec39593c2 in_seq=0 out_seq=0 2024-01-31T05:11:58.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.114+0000 7f002d7fa640 1 -- 172.21.15.99:0/1066196909 <== mds.1 v2:172.21.15.179:6836/837402830 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557d563e2dd0 con 0x557d56498f40 2024-01-31T05:11:58.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.114+0000 7f002d7fa640 10 client.15603 handle_command_reply: tid=0 2024-01-31T05:11:58.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.114+0000 7f004ebfe740 1 client.15603 shutdown 2024-01-31T05:11:58.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.114+0000 7f004ebfe740 1 -- 172.21.15.99:0/1066196909 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557d56488a70 msgr2=0x557d56494640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:58.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.114+0000 7f004ebfe740 1 --2- 172.21.15.99:0/1066196909 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557d56488a70 0x557d56494640 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f003c0994e0 tx=0x7f003c065e10 comp rx=0 tx=0).stop 2024-01-31T05:11:58.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.114+0000 7f004ebfe740 1 -- 172.21.15.99:0/1066196909 shutdown_connections 2024-01-31T05:11:58.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.114+0000 7f004ebfe740 1 --2- 172.21.15.99:0/1066196909 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x557d56498f40 0x557d5649b360 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.114+0000 7f004ebfe740 1 --2- 172.21.15.99:0/1066196909 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557d56488a70 0x557d56494640 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.114+0000 7f004ebfe740 1 --2- 172.21.15.99:0/1066196909 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d56483900 0x557d5648d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.114+0000 7f002d7fa640 0 client.15603 ms_handle_reset on v2:172.21.15.179:6836/837402830 2024-01-31T05:11:58.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.114+0000 7f004ebfe740 1 --2- 172.21.15.99:0/1066196909 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d56482f10 0x557d5648d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.114+0000 7f004ebfe740 1 -- 172.21.15.99:0/1066196909 >> 172.21.15.99:0/1066196909 conn(0x557d5647e480 msgr2=0x557d5647d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:58.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.114+0000 7f004ebfe740 1 -- 172.21.15.99:0/1066196909 shutdown_connections 2024-01-31T05:11:58.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.114+0000 7f004ebfe740 1 -- 172.21.15.99:0/1066196909 wait complete. 2024-01-31T05:11:58.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.115+0000 7f004ebfe740 20 client.15603 trim_cache size 0 max 16384 2024-01-31T05:11:58.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:57 smithi179 ceph-mon[35652]: pgmap v366: 97 pgs: 97 active+clean; 658 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-01-31T05:11:58.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:57 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/1090751230' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:11:58.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.126+0000 7f004ebfe740 1 Processor -- start 2024-01-31T05:11:58.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.126+0000 7f004ebfe740 1 -- start start 2024-01-31T05:11:58.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.126+0000 7f004ebfe740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d56482f10 0x557d5648d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:58.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.126+0000 7f004ebfe740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d56483900 0x557d5648d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:58.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.126+0000 7f004ebfe740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557d56488a70 0x557d56494600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:58.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.126+0000 7f004ebfe740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d56484a10 con 0x557d56488a70 2024-01-31T05:11:58.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.126+0000 7f004ebfe740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d5647a260 con 0x557d56482f10 2024-01-31T05:11:58.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.126+0000 7f004ebfe740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d56470620 con 0x557d56483900 2024-01-31T05:11:58.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.126+0000 7f004a2fa640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557d56488a70 0x557d56494600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:58.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.126+0000 7f004a2fa640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557d56488a70 0x557d56494600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48208/0 (socket says 172.21.15.99:48208) 2024-01-31T05:11:58.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.126+0000 7f004a2fa640 1 -- 172.21.15.99:0/2561278415 learned_addr learned my addr 172.21.15.99:0/2561278415 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:58.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.127+0000 7f00492f8640 1 --2- 172.21.15.99:0/2561278415 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d56483900 0x557d5648d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:58.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.127+0000 7f004a2fa640 1 -- 172.21.15.99:0/2561278415 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d56483900 msgr2=0x557d5648d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:58.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.127+0000 7f004a2fa640 1 --2- 172.21.15.99:0/2561278415 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d56483900 0x557d5648d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.127+0000 7f004a2fa640 1 -- 172.21.15.99:0/2561278415 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d56482f10 msgr2=0x557d5648d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:58.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.127+0000 7f0049af9640 1 --2- 172.21.15.99:0/2561278415 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d56482f10 0x557d5648d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:58.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.127+0000 7f004a2fa640 1 --2- 172.21.15.99:0/2561278415 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d56482f10 0x557d5648d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.127+0000 7f004a2fa640 1 -- 172.21.15.99:0/2561278415 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557d563854d0 con 0x557d56488a70 2024-01-31T05:11:58.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.127+0000 7f00492f8640 1 --2- 172.21.15.99:0/2561278415 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d56483900 0x557d5648d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:11:58.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.127+0000 7f004a2fa640 1 --2- 172.21.15.99:0/2561278415 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557d56488a70 0x557d56494600 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f003c000f80 tx=0x7f003c014dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76335cb4f34b2ccf server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:58.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.127+0000 7f002f7fe640 1 -- 172.21.15.99:0/2561278415 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c0b5070 con 0x557d56488a70 2024-01-31T05:11:58.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.127+0000 7f002f7fe640 1 -- 172.21.15.99:0/2561278415 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f003c084040 con 0x557d56488a70 2024-01-31T05:11:58.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.127+0000 7f002f7fe640 1 -- 172.21.15.99:0/2561278415 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c09d680 con 0x557d56488a70 2024-01-31T05:11:58.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.128+0000 7f004ebfe740 1 -- 172.21.15.99:0/2561278415 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557d56488a70 msgr2=0x557d56494600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:58.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.128+0000 7f004ebfe740 1 --2- 172.21.15.99:0/2561278415 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557d56488a70 0x557d56494600 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f003c000f80 tx=0x7f003c014dd0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.128+0000 7f004ebfe740 1 -- 172.21.15.99:0/2561278415 shutdown_connections 2024-01-31T05:11:58.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.128+0000 7f004ebfe740 1 --2- 172.21.15.99:0/2561278415 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557d56488a70 0x557d56494600 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.128+0000 7f004ebfe740 1 --2- 172.21.15.99:0/2561278415 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d56483900 0x557d5648d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.128+0000 7f004ebfe740 1 --2- 172.21.15.99:0/2561278415 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d56482f10 0x557d5648d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.128+0000 7f004ebfe740 1 -- 172.21.15.99:0/2561278415 >> 172.21.15.99:0/2561278415 conn(0x557d5647e480 msgr2=0x557d56479650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:58.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.128+0000 7f004ebfe740 1 -- 172.21.15.99:0/2561278415 shutdown_connections 2024-01-31T05:11:58.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.128+0000 7f004ebfe740 1 -- 172.21.15.99:0/2561278415 wait complete. 2024-01-31T05:11:58.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.128+0000 7f004ebfe740 1 -- start start 2024-01-31T05:11:58.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.128+0000 7f004ebfe740 1 Processor -- start 2024-01-31T05:11:58.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.128+0000 7f004ebfe740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d56482f10 0x557d56493050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:58.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.128+0000 7f004ebfe740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557d56483900 0x557d56493590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:58.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.128+0000 7f004ebfe740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d56488a70 0x557d56493ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:58.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.128+0000 7f004ebfe740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d564ef450 con 0x557d56483900 2024-01-31T05:11:58.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.128+0000 7f004ebfe740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d564ef590 con 0x557d56482f10 2024-01-31T05:11:58.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.128+0000 7f004ebfe740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d564ef750 con 0x557d56488a70 2024-01-31T05:11:58.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.128+0000 7f004ebfe740 10 client.0 _ll_register_callbacks cb 0x7f0040005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:11:58.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.128+0000 7f00492f8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557d56483900 0x557d56493590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:58.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.128+0000 7f00492f8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557d56483900 0x557d56493590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48210/0 (socket says 172.21.15.99:48210) 2024-01-31T05:11:58.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.128+0000 7f00492f8640 1 -- 172.21.15.99:0/3094965904 learned_addr learned my addr 172.21.15.99:0/3094965904 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:58.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.129+0000 7f004a2fa640 1 --2- 172.21.15.99:0/3094965904 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d56488a70 0x557d56493ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:58.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.129+0000 7f0049af9640 1 --2- 172.21.15.99:0/3094965904 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d56482f10 0x557d56493050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:58.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.129+0000 7f00492f8640 1 -- 172.21.15.99:0/3094965904 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d56488a70 msgr2=0x557d56493ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:58.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.129+0000 7f00492f8640 1 --2- 172.21.15.99:0/3094965904 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d56488a70 0x557d56493ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.129+0000 7f00492f8640 1 -- 172.21.15.99:0/3094965904 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d56482f10 msgr2=0x557d56493050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:58.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.129+0000 7f00492f8640 1 --2- 172.21.15.99:0/3094965904 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d56482f10 0x557d56493050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.129+0000 7f00492f8640 1 -- 172.21.15.99:0/3094965904 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557d563e88a0 con 0x557d56483900 2024-01-31T05:11:58.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.129+0000 7f00492f8640 1 --2- 172.21.15.99:0/3094965904 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557d56483900 0x557d56493590 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f0034010ee0 tx=0x7f00340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2455e9fff7944c92 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:58.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.129+0000 7f002d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:11:58.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.129+0000 7f002d7fa640 1 -- 172.21.15.99:0/3094965904 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0034005220 con 0x557d56483900 2024-01-31T05:11:58.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.129+0000 7f002d7fa640 1 -- 172.21.15.99:0/3094965904 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f0034018040 con 0x557d56483900 2024-01-31T05:11:58.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.129+0000 7f004ebfe740 1 -- 172.21.15.99:0/3094965904 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0040004040 con 0x557d56483900 2024-01-31T05:11:58.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.129+0000 7f002d7fa640 1 -- 172.21.15.99:0/3094965904 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f003402f070 con 0x557d56483900 2024-01-31T05:11:58.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.129+0000 7f004ebfe740 10 client.15609 fetch_fsmap learned FSMap version 27 2024-01-31T05:11:58.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.129+0000 7f004ebfe740 1 -- 172.21.15.99:0/3094965904 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x557d563ab020 con 0x557d56483900 2024-01-31T05:11:58.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.129+0000 7f002d7fa640 1 -- 172.21.15.99:0/3094965904 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0040004040 con 0x557d56483900 2024-01-31T05:11:58.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.129+0000 7f002d7fa640 1 -- 172.21.15.99:0/3094965904 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0034027030 con 0x557d56483900 2024-01-31T05:11:58.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.130+0000 7f004ebfe740 10 client.15609 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:11:58.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.130+0000 7f004ebfe740 10 client.15609 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-01-31T05:11:58.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.130+0000 7f004ebfe740 20 client.15609 populate_metadata read hostname 'smithi099' 2024-01-31T05:11:58.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.130+0000 7f004ebfe740 1 --2- 172.21.15.99:0/3094965904 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x557d564f12f0 0x557d564f3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:58.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.130+0000 7f004ebfe740 4 client.15609 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-01-31T05:11:58.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.130+0000 7f004ebfe740 1 -- 172.21.15.99:0/3094965904 --> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x557d560e97e0 con 0x557d564f12f0 2024-01-31T05:11:58.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.130+0000 7f0049af9640 1 --2- 172.21.15.99:0/3094965904 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x557d564f12f0 0x557d564f3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:58.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.130+0000 7f0049af9640 1 --2- 172.21.15.99:0/3094965904 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x557d564f12f0 0x557d564f3710 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=13cfa615fc039a55 server_cookie=c0d69faf91c44d86 in_seq=0 out_seq=0 2024-01-31T05:11:58.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.130+0000 7f002d7fa640 10 client.15609 ms_handle_connect on v2:172.21.15.179:6836/837402830 2024-01-31T05:11:58.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.130+0000 7f002d7fa640 1 -- 172.21.15.99:0/3094965904 <== mds.1 v2:172.21.15.179:6836/837402830 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x557d560e97e0 con 0x557d564f12f0 2024-01-31T05:11:58.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.130+0000 7f002d7fa640 10 client.15609 handle_command_reply: tid=0 2024-01-31T05:11:58.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.130+0000 7f004ebfe740 1 client.15609 shutdown 2024-01-31T05:11:58.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.130+0000 7f004ebfe740 1 -- 172.21.15.99:0/3094965904 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557d56483900 msgr2=0x557d56493590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:58.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.130+0000 7f004ebfe740 1 --2- 172.21.15.99:0/3094965904 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557d56483900 0x557d56493590 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f0034010ee0 tx=0x7f00340046c0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.131+0000 7f004ebfe740 1 -- 172.21.15.99:0/3094965904 shutdown_connections 2024-01-31T05:11:58.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.131+0000 7f004ebfe740 1 --2- 172.21.15.99:0/3094965904 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x557d564f12f0 0x557d564f3710 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.131+0000 7f004ebfe740 1 --2- 172.21.15.99:0/3094965904 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557d56488a70 0x557d56493ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.131+0000 7f004ebfe740 1 --2- 172.21.15.99:0/3094965904 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557d56483900 0x557d56493590 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.131+0000 7f002d7fa640 0 client.15609 ms_handle_reset on v2:172.21.15.179:6836/837402830 2024-01-31T05:11:58.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.131+0000 7f004ebfe740 1 --2- 172.21.15.99:0/3094965904 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d56482f10 0x557d56493050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.131+0000 7f004ebfe740 1 -- 172.21.15.99:0/3094965904 >> 172.21.15.99:0/3094965904 conn(0x557d5647e480 msgr2=0x557d56484e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:58.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.131+0000 7f004ebfe740 1 -- 172.21.15.99:0/3094965904 shutdown_connections 2024-01-31T05:11:58.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.131+0000 7f004ebfe740 1 -- 172.21.15.99:0/3094965904 wait complete. 2024-01-31T05:11:58.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.131+0000 7f004ebfe740 20 client.15609 trim_cache size 0 max 16384 2024-01-31T05:11:58.140 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-01-31T05:11:58.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.131+0000 7f004bd5d640 1 -- 172.21.15.99:0/4093427376 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f00300a13f0 msgr2=0x7f00300a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:58.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.131+0000 7f004bd5d640 1 --2- 172.21.15.99:0/4093427376 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f00300a13f0 0x7f00300a38b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0034005fd0 tx=0x7f0034009540 comp rx=0 tx=0).stop 2024-01-31T05:11:58.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.131+0000 7f004bd5d640 1 -- 172.21.15.99:0/4093427376 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00441028d0 msgr2=0x7f004419e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:58.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.131+0000 7f004bd5d640 1 --2- 172.21.15.99:0/4093427376 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00441028d0 0x7f004419e310 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f003c00b970 tx=0x7f003c00be30 comp rx=0 tx=0).stop 2024-01-31T05:11:58.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.131+0000 7f004bd5d640 1 -- 172.21.15.99:0/4093427376 shutdown_connections 2024-01-31T05:11:58.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.131+0000 7f004bd5d640 1 --2- 172.21.15.99:0/4093427376 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f00300a13f0 0x7f00300a38b0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.131+0000 7f004bd5d640 1 --2- 172.21.15.99:0/4093427376 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00441028d0 0x7f004419e310 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.131+0000 7f004bd5d640 1 --2- 172.21.15.99:0/4093427376 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0044101f10 0x7f00441972a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.131+0000 7f004bd5d640 1 --2- 172.21.15.99:0/4093427376 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0044100d20 0x7f0044196d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.131+0000 7f004bd5d640 1 -- 172.21.15.99:0/4093427376 >> 172.21.15.99:0/4093427376 conn(0x7f00440fc290 msgr2=0x7f0044105280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:58.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.131+0000 7f004bd5d640 1 -- 172.21.15.99:0/4093427376 shutdown_connections 2024-01-31T05:11:58.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.131+0000 7f004bd5d640 1 -- 172.21.15.99:0/4093427376 wait complete. 2024-01-31T05:11:58.143 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-01-31T05:11:58.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.246+0000 7fbe561fb640 1 -- 172.21.15.99:0/1439900242 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe50100e00 msgr2=0x7fbe50101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:58.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.246+0000 7fbe561fb640 1 --2- 172.21.15.99:0/1439900242 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe50100e00 0x7fbe50101280 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fbe44009900 tx=0x7fbe4402bc30 comp rx=0 tx=0).stop 2024-01-31T05:11:58.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.246+0000 7fbe561fb640 1 -- 172.21.15.99:0/1439900242 shutdown_connections 2024-01-31T05:11:58.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.246+0000 7fbe561fb640 1 --2- 172.21.15.99:0/1439900242 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe501017c0 0x7fbe50108050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.246+0000 7fbe561fb640 1 --2- 172.21.15.99:0/1439900242 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe50100e00 0x7fbe50101280 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.246+0000 7fbe561fb640 1 --2- 172.21.15.99:0/1439900242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe500ffc10 0x7fbe50100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.246+0000 7fbe561fb640 1 -- 172.21.15.99:0/1439900242 >> 172.21.15.99:0/1439900242 conn(0x7fbe500fb1a0 msgr2=0x7fbe500fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:58.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.246+0000 7fbe561fb640 1 -- 172.21.15.99:0/1439900242 shutdown_connections 2024-01-31T05:11:58.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.246+0000 7fbe561fb640 1 -- 172.21.15.99:0/1439900242 wait complete. 2024-01-31T05:11:58.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.246+0000 7fbe561fb640 1 Processor -- start 2024-01-31T05:11:58.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.247+0000 7fbe561fb640 1 -- start start 2024-01-31T05:11:58.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.247+0000 7fbe561fb640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe500ffc10 0x7fbe50196c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:58.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.247+0000 7fbe561fb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe50100e00 0x7fbe501971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:58.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.247+0000 7fbe561fb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe501017c0 0x7fbe5019e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:58.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.247+0000 7fbe561fb640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5019e790 con 0x7fbe501017c0 2024-01-31T05:11:58.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.247+0000 7fbe561fb640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5019e900 con 0x7fbe500ffc10 2024-01-31T05:11:58.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.247+0000 7fbe561fb640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5019eac0 con 0x7fbe50100e00 2024-01-31T05:11:58.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.247+0000 7fbe4ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe501017c0 0x7fbe5019e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:58.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.247+0000 7fbe4ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe501017c0 0x7fbe5019e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48230/0 (socket says 172.21.15.99:48230) 2024-01-31T05:11:58.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.247+0000 7fbe4ffff640 1 -- 172.21.15.99:0/2138634002 learned_addr learned my addr 172.21.15.99:0/2138634002 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:58.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.247+0000 7fbe4effd640 1 --2- 172.21.15.99:0/2138634002 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe50100e00 0x7fbe501971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:58.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.247+0000 7fbe4f7fe640 1 --2- 172.21.15.99:0/2138634002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe500ffc10 0x7fbe50196c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:58.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.247+0000 7fbe4ffff640 1 -- 172.21.15.99:0/2138634002 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe50100e00 msgr2=0x7fbe501971c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:58.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.247+0000 7fbe4ffff640 1 --2- 172.21.15.99:0/2138634002 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe50100e00 0x7fbe501971c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.247+0000 7fbe4ffff640 1 -- 172.21.15.99:0/2138634002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe500ffc10 msgr2=0x7fbe50196c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:58.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.247+0000 7fbe4ffff640 1 --2- 172.21.15.99:0/2138634002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe500ffc10 0x7fbe50196c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.247+0000 7fbe4ffff640 1 -- 172.21.15.99:0/2138634002 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe44009560 con 0x7fbe501017c0 2024-01-31T05:11:58.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.247+0000 7fbe4f7fe640 1 --2- 172.21.15.99:0/2138634002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe500ffc10 0x7fbe50196c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:11:58.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.247+0000 7fbe4ffff640 1 --2- 172.21.15.99:0/2138634002 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe501017c0 0x7fbe5019e220 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fbe4800cce0 tx=0x7fbe4800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:58.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.247+0000 7fbe4cff9640 1 -- 172.21.15.99:0/2138634002 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4800f450 con 0x7fbe501017c0 2024-01-31T05:11:58.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.247+0000 7fbe561fb640 1 -- 172.21.15.99:0/2138634002 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe5019eda0 con 0x7fbe501017c0 2024-01-31T05:11:58.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.247+0000 7fbe4cff9640 1 -- 172.21.15.99:0/2138634002 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbe4800fa70 con 0x7fbe501017c0 2024-01-31T05:11:58.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.247+0000 7fbe4cff9640 1 -- 172.21.15.99:0/2138634002 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe48018b40 con 0x7fbe501017c0 2024-01-31T05:11:58.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.247+0000 7fbe561fb640 1 -- 172.21.15.99:0/2138634002 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe5019f220 con 0x7fbe501017c0 2024-01-31T05:11:58.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.249+0000 7fbe4cff9640 1 -- 172.21.15.99:0/2138634002 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 135946+0+0 (secure 0 0 0) 0x7fbe4800fbe0 con 0x7fbe501017c0 2024-01-31T05:11:58.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.250+0000 7fbe58fbf740 1 Processor -- start 2024-01-31T05:11:58.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.250+0000 7fbe58fbf740 1 -- start start 2024-01-31T05:11:58.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.250+0000 7fbe4cff9640 1 --2- 172.21.15.99:0/2138634002 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fbe380a1370 0x7fbe380a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:58.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.250+0000 7fbe58fbf740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c67e377320 0x55c67e377740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:58.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.250+0000 7fbe58fbf740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c67e377d10 0x55c67e37c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:58.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.250+0000 7fbe58fbf740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c67e37ce80 0x55c67e37f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:58.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.250+0000 7fbe58fbf740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c67e2e1240 con 0x55c67e37ce80 2024-01-31T05:11:58.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.250+0000 7fbe58fbf740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c67e2de930 con 0x55c67e377320 2024-01-31T05:11:58.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.250+0000 7fbe58fbf740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c67e2da220 con 0x55c67e377d10 2024-01-31T05:11:58.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.250+0000 7fbe4effd640 1 --2- 172.21.15.99:0/2138634002 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fbe380a1370 0x7fbe380a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:58.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.250+0000 7fbe4cff9640 1 -- 172.21.15.99:0/2138634002 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fbe480cd410 con 0x7fbe501017c0 2024-01-31T05:11:58.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.250+0000 7fbe4ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c67e37ce80 0x55c67e37f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:58.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.250+0000 7fbe4ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c67e37ce80 0x55c67e37f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48246/0 (socket says 172.21.15.99:48246) 2024-01-31T05:11:58.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.250+0000 7fbe4ffff640 1 -- 172.21.15.99:0/1638885725 learned_addr learned my addr 172.21.15.99:0/1638885725 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:58.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.250+0000 7fbe4f7fe640 1 --2- 172.21.15.99:0/1638885725 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c67e377320 0x55c67e377740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:58.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.250+0000 7fbe4effd640 1 --2- 172.21.15.99:0/1638885725 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c67e377d10 0x55c67e37c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:58.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.250+0000 7fbe4ffff640 1 -- 172.21.15.99:0/1638885725 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c67e377d10 msgr2=0x55c67e37c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:58.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.250+0000 7fbe4ffff640 1 --2- 172.21.15.99:0/1638885725 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c67e377d10 0x55c67e37c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.251+0000 7fbe4ffff640 1 -- 172.21.15.99:0/1638885725 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c67e377320 msgr2=0x55c67e377740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:58.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.251+0000 7fbe4ffff640 1 --2- 172.21.15.99:0/1638885725 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c67e377320 0x55c67e377740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.251+0000 7fbe4ffff640 1 -- 172.21.15.99:0/1638885725 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c67e29c7c0 con 0x55c67e37ce80 2024-01-31T05:11:58.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.251+0000 7fbe4effd640 1 --2- 172.21.15.99:0/1638885725 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c67e377d10 0x55c67e37c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:11:58.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.251+0000 7fbe4effd640 1 --2- 172.21.15.99:0/2138634002 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fbe380a1370 0x7fbe380a3830 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbe44005ab0 tx=0x7fbe44004800 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:58.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.251+0000 7fbe4ffff640 1 --2- 172.21.15.99:0/1638885725 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c67e37ce80 0x55c67e37f310 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fbe48096a10 tx=0x7fbe48099e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dbeadcaac0e8470 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:58.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.251+0000 7fbe35ffb640 1 -- 172.21.15.99:0/1638885725 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe480cc050 con 0x55c67e37ce80 2024-01-31T05:11:58.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.251+0000 7fbe35ffb640 1 -- 172.21.15.99:0/1638885725 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbe480cd250 con 0x55c67e37ce80 2024-01-31T05:11:58.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.251+0000 7fbe35ffb640 1 -- 172.21.15.99:0/1638885725 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe48099c60 con 0x55c67e37ce80 2024-01-31T05:11:58.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.251+0000 7fbe58fbf740 1 -- 172.21.15.99:0/1638885725 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c67e37ce80 msgr2=0x55c67e37f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:58.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.251+0000 7fbe58fbf740 1 --2- 172.21.15.99:0/1638885725 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c67e37ce80 0x55c67e37f310 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fbe48096a10 tx=0x7fbe48099e70 comp rx=0 tx=0).stop 2024-01-31T05:11:58.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.251+0000 7fbe58fbf740 1 -- 172.21.15.99:0/1638885725 shutdown_connections 2024-01-31T05:11:58.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.251+0000 7fbe58fbf740 1 --2- 172.21.15.99:0/1638885725 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c67e37ce80 0x55c67e37f310 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.251+0000 7fbe58fbf740 1 --2- 172.21.15.99:0/1638885725 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c67e377d10 0x55c67e37c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.251+0000 7fbe58fbf740 1 --2- 172.21.15.99:0/1638885725 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c67e377320 0x55c67e377740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.251+0000 7fbe58fbf740 1 -- 172.21.15.99:0/1638885725 >> 172.21.15.99:0/1638885725 conn(0x55c67e36e480 msgr2=0x55c67e36e880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:58.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.252+0000 7fbe58fbf740 1 -- 172.21.15.99:0/1638885725 shutdown_connections 2024-01-31T05:11:58.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.252+0000 7fbe58fbf740 1 -- 172.21.15.99:0/1638885725 wait complete. 2024-01-31T05:11:58.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.252+0000 7fbe58fbf740 1 -- start start 2024-01-31T05:11:58.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.252+0000 7fbe58fbf740 1 Processor -- start 2024-01-31T05:11:58.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.252+0000 7fbe58fbf740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c67e377320 0x55c67e381410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:58.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.252+0000 7fbe58fbf740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c67e377d10 0x55c67e381950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:58.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.252+0000 7fbe58fbf740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c67e37ce80 0x55c67e388990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:58.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.252+0000 7fbe58fbf740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c67e2935e0 con 0x55c67e377d10 2024-01-31T05:11:58.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.252+0000 7fbe58fbf740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c67e293280 con 0x55c67e377320 2024-01-31T05:11:58.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.252+0000 7fbe58fbf740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c67e2583d0 con 0x55c67e37ce80 2024-01-31T05:11:58.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.252+0000 7fbe58fbf740 10 client.0 _ll_register_callbacks cb 0x55c67e2d0eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:11:58.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.252+0000 7fbe4effd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c67e377d10 0x55c67e381950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:58.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.252+0000 7fbe4effd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c67e377d10 0x55c67e381950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48254/0 (socket says 172.21.15.99:48254) 2024-01-31T05:11:58.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.252+0000 7fbe4effd640 1 -- 172.21.15.99:0/2753182416 learned_addr learned my addr 172.21.15.99:0/2753182416 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:58.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.253+0000 7fbe4ffff640 1 --2- 172.21.15.99:0/2753182416 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c67e37ce80 0x55c67e388990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:58.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.253+0000 7fbe4f7fe640 1 --2- 172.21.15.99:0/2753182416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c67e377320 0x55c67e381410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:58.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.253+0000 7fbe4effd640 1 -- 172.21.15.99:0/2753182416 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c67e37ce80 msgr2=0x55c67e388990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:58.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.253+0000 7fbe4effd640 1 --2- 172.21.15.99:0/2753182416 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c67e37ce80 0x55c67e388990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.253+0000 7fbe4effd640 1 -- 172.21.15.99:0/2753182416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c67e377320 msgr2=0x55c67e381410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:58.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.253+0000 7fbe4effd640 1 --2- 172.21.15.99:0/2753182416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c67e377320 0x55c67e381410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.253+0000 7fbe4effd640 1 -- 172.21.15.99:0/2753182416 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe5019f220 con 0x55c67e377d10 2024-01-31T05:11:58.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.253+0000 7fbe4ffff640 1 --2- 172.21.15.99:0/2753182416 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c67e37ce80 0x55c67e388990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:11:58.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.253+0000 7fbe4effd640 1 --2- 172.21.15.99:0/2753182416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c67e377d10 0x55c67e381950 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fbe44004f80 tx=0x7fbe4402bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff1c258da55e5cdd server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:58.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.253+0000 7fbe2effd640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:11:58.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.253+0000 7fbe2effd640 1 -- 172.21.15.99:0/2753182416 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe440052d0 con 0x55c67e377d10 2024-01-31T05:11:58.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.253+0000 7fbe58fbf740 1 -- 172.21.15.99:0/2753182416 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c67e2d30b0 con 0x55c67e377d10 2024-01-31T05:11:58.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.253+0000 7fbe2effd640 1 -- 172.21.15.99:0/2753182416 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fbe44005430 con 0x55c67e377d10 2024-01-31T05:11:58.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.253+0000 7fbe2effd640 1 -- 172.21.15.99:0/2753182416 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe440055f0 con 0x55c67e377d10 2024-01-31T05:11:58.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.253+0000 7fbe58fbf740 10 client.15621 fetch_fsmap learned FSMap version 27 2024-01-31T05:11:58.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.253+0000 7fbe58fbf740 1 -- 172.21.15.99:0/2753182416 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55c67e2d88a0 con 0x55c67e377d10 2024-01-31T05:11:58.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.253+0000 7fbe2effd640 1 -- 172.21.15.99:0/2753182416 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c67e2d30b0 con 0x55c67e377d10 2024-01-31T05:11:58.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.253+0000 7fbe2effd640 1 -- 172.21.15.99:0/2753182416 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fbe4403c070 con 0x55c67e377d10 2024-01-31T05:11:58.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.253+0000 7fbe58fbf740 10 client.15621 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:11:58.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.253+0000 7fbe58fbf740 10 client.15621 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-01-31T05:11:58.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.254+0000 7fbe58fbf740 20 client.15621 populate_metadata read hostname 'smithi099' 2024-01-31T05:11:58.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.254+0000 7fbe58fbf740 1 --2- 172.21.15.99:0/2753182416 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55c67e38d2e0 0x55c67e38f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:58.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.254+0000 7fbe58fbf740 4 client.15621 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:11:58.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.254+0000 7fbe58fbf740 1 -- 172.21.15.99:0/2753182416 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c67e2d2dd0 con 0x55c67e38d2e0 2024-01-31T05:11:58.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.254+0000 7fbe4f7fe640 1 --2- 172.21.15.99:0/2753182416 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55c67e38d2e0 0x55c67e38f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:58.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.254+0000 7fbe2effd640 10 client.15621 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:11:58.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.254+0000 7fbe4f7fe640 1 --2- 172.21.15.99:0/2753182416 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55c67e38d2e0 0x55c67e38f700 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63316e7977d3c99d server_cookie=f5faca71f01aa967 in_seq=0 out_seq=0 2024-01-31T05:11:58.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.255+0000 7fbe2effd640 1 -- 172.21.15.99:0/2753182416 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c67e2d2dd0 con 0x55c67e38d2e0 2024-01-31T05:11:58.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.255+0000 7fbe2effd640 10 client.15621 handle_command_reply: tid=0 2024-01-31T05:11:58.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.255+0000 7fbe58fbf740 1 client.15621 shutdown 2024-01-31T05:11:58.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.255+0000 7fbe58fbf740 1 -- 172.21.15.99:0/2753182416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c67e377d10 msgr2=0x55c67e381950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:58.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.255+0000 7fbe58fbf740 1 --2- 172.21.15.99:0/2753182416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c67e377d10 0x55c67e381950 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fbe44004f80 tx=0x7fbe4402bc30 comp rx=0 tx=0).stop 2024-01-31T05:11:58.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.255+0000 7fbe58fbf740 1 -- 172.21.15.99:0/2753182416 shutdown_connections 2024-01-31T05:11:58.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.255+0000 7fbe58fbf740 1 --2- 172.21.15.99:0/2753182416 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c67e37ce80 0x55c67e388990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.255+0000 7fbe58fbf740 1 --2- 172.21.15.99:0/2753182416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c67e377d10 0x55c67e381950 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.255+0000 7fbe58fbf740 1 --2- 172.21.15.99:0/2753182416 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55c67e38d2e0 0x55c67e38f700 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.255+0000 7fbe58fbf740 1 --2- 172.21.15.99:0/2753182416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c67e377320 0x55c67e381410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.255+0000 7fbe58fbf740 1 -- 172.21.15.99:0/2753182416 >> 172.21.15.99:0/2753182416 conn(0x55c67e36e480 msgr2=0x55c67e36d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:58.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.255+0000 7fbe2effd640 0 client.15621 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:11:58.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.255+0000 7fbe58fbf740 1 -- 172.21.15.99:0/2753182416 shutdown_connections 2024-01-31T05:11:58.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.255+0000 7fbe58fbf740 1 -- 172.21.15.99:0/2753182416 wait complete. 2024-01-31T05:11:58.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.255+0000 7fbe58fbf740 20 client.15621 trim_cache size 0 max 16384 2024-01-31T05:11:58.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.266+0000 7fbe58fbf740 1 Processor -- start 2024-01-31T05:11:58.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.266+0000 7fbe58fbf740 1 -- start start 2024-01-31T05:11:58.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.267+0000 7fbe58fbf740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c67e377320 0x55c67e37ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:58.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.267+0000 7fbe58fbf740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c67e377d10 0x55c67e380470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:58.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.267+0000 7fbe58fbf740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c67e37ce80 0x55c67e388950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:58.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.267+0000 7fbe58fbf740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c67e2d2dd0 con 0x55c67e377320 2024-01-31T05:11:58.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.267+0000 7fbe58fbf740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c67e2d30b0 con 0x55c67e377d10 2024-01-31T05:11:58.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.267+0000 7fbe58fbf740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c67e378400 con 0x55c67e37ce80 2024-01-31T05:11:58.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.267+0000 7fbe4f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c67e377320 0x55c67e37ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:58.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.267+0000 7fbe4f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c67e377320 0x55c67e37ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48258/0 (socket says 172.21.15.99:48258) 2024-01-31T05:11:58.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.267+0000 7fbe4f7fe640 1 -- 172.21.15.99:0/2607351707 learned_addr learned my addr 172.21.15.99:0/2607351707 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:58.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.267+0000 7fbe4f7fe640 1 -- 172.21.15.99:0/2607351707 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c67e37ce80 msgr2=0x55c67e388950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:58.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.267+0000 7fbe4ffff640 1 --2- 172.21.15.99:0/2607351707 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c67e37ce80 0x55c67e388950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:58.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.267+0000 7fbe4f7fe640 1 --2- 172.21.15.99:0/2607351707 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c67e37ce80 0x55c67e388950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.267+0000 7fbe4f7fe640 1 -- 172.21.15.99:0/2607351707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c67e377d10 msgr2=0x55c67e380470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:58.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.267+0000 7fbe4f7fe640 1 --2- 172.21.15.99:0/2607351707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c67e377d10 0x55c67e380470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.267+0000 7fbe4f7fe640 1 -- 172.21.15.99:0/2607351707 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c67e2754d0 con 0x55c67e377320 2024-01-31T05:11:58.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.267+0000 7fbe4f7fe640 1 --2- 172.21.15.99:0/2607351707 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c67e377320 0x55c67e37ff30 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fbe4000cb70 tx=0x7fbe40010970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63bf3aabb04e66a2 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:58.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.267+0000 7fbe357fa640 1 -- 172.21.15.99:0/2607351707 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe40016040 con 0x55c67e377320 2024-01-31T05:11:58.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.267+0000 7fbe357fa640 1 -- 172.21.15.99:0/2607351707 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbe40005020 con 0x55c67e377320 2024-01-31T05:11:58.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.267+0000 7fbe357fa640 1 -- 172.21.15.99:0/2607351707 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe40004bc0 con 0x55c67e377320 2024-01-31T05:11:58.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.268+0000 7fbe58fbf740 1 -- 172.21.15.99:0/2607351707 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c67e377320 msgr2=0x55c67e37ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:58.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.268+0000 7fbe58fbf740 1 --2- 172.21.15.99:0/2607351707 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c67e377320 0x55c67e37ff30 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fbe4000cb70 tx=0x7fbe40010970 comp rx=0 tx=0).stop 2024-01-31T05:11:58.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.268+0000 7fbe58fbf740 1 -- 172.21.15.99:0/2607351707 shutdown_connections 2024-01-31T05:11:58.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.268+0000 7fbe58fbf740 1 --2- 172.21.15.99:0/2607351707 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c67e37ce80 0x55c67e388950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.268+0000 7fbe58fbf740 1 --2- 172.21.15.99:0/2607351707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c67e377d10 0x55c67e380470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.268+0000 7fbe58fbf740 1 --2- 172.21.15.99:0/2607351707 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c67e377320 0x55c67e37ff30 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.268+0000 7fbe58fbf740 1 -- 172.21.15.99:0/2607351707 >> 172.21.15.99:0/2607351707 conn(0x55c67e36e480 msgr2=0x55c67e381410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:58.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.268+0000 7fbe58fbf740 1 -- 172.21.15.99:0/2607351707 shutdown_connections 2024-01-31T05:11:58.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.268+0000 7fbe58fbf740 1 -- 172.21.15.99:0/2607351707 wait complete. 2024-01-31T05:11:58.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.268+0000 7fbe58fbf740 1 -- start start 2024-01-31T05:11:58.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.268+0000 7fbe58fbf740 1 Processor -- start 2024-01-31T05:11:58.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.269+0000 7fbe58fbf740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c67e377320 0x55c67e387020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:58.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.269+0000 7fbe58fbf740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c67e377d10 0x55c67e387560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:58.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.269+0000 7fbe58fbf740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c67e37ce80 0x55c67e387aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:58.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.269+0000 7fbe58fbf740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c67e388c70 con 0x55c67e37ce80 2024-01-31T05:11:58.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.269+0000 7fbe58fbf740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c67e3e37f0 con 0x55c67e377d10 2024-01-31T05:11:58.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.269+0000 7fbe58fbf740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c67e3e3930 con 0x55c67e377320 2024-01-31T05:11:58.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.269+0000 7fbe58fbf740 10 client.0 _ll_register_callbacks cb 0x7fbe480077a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:11:58.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.269+0000 7fbe4ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c67e37ce80 0x55c67e387aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:58.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.269+0000 7fbe4ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c67e37ce80 0x55c67e387aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48270/0 (socket says 172.21.15.99:48270) 2024-01-31T05:11:58.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.269+0000 7fbe4ffff640 1 -- 172.21.15.99:0/187800997 learned_addr learned my addr 172.21.15.99:0/187800997 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:58.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.269+0000 7fbe4f7fe640 1 --2- 172.21.15.99:0/187800997 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c67e377320 0x55c67e387020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:58.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.269+0000 7fbe4effd640 1 --2- 172.21.15.99:0/187800997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c67e377d10 0x55c67e387560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:58.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.269+0000 7fbe4ffff640 1 -- 172.21.15.99:0/187800997 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c67e377320 msgr2=0x55c67e387020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:58.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.269+0000 7fbe4ffff640 1 --2- 172.21.15.99:0/187800997 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c67e377320 0x55c67e387020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.269+0000 7fbe4ffff640 1 -- 172.21.15.99:0/187800997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c67e377d10 msgr2=0x55c67e387560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:58.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.269+0000 7fbe4ffff640 1 --2- 172.21.15.99:0/187800997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c67e377d10 0x55c67e387560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.269+0000 7fbe4ffff640 1 -- 172.21.15.99:0/187800997 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe4000cdc0 con 0x55c67e37ce80 2024-01-31T05:11:58.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.269+0000 7fbe4effd640 1 --2- 172.21.15.99:0/187800997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c67e377d10 0x55c67e387560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:11:58.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.269+0000 7fbe4ffff640 1 --2- 172.21.15.99:0/187800997 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c67e37ce80 0x55c67e387aa0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fbe4800ab20 tx=0x7fbe48099c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=704d1554e8346502 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:58.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.269+0000 7fbe2effd640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:11:58.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.269+0000 7fbe2effd640 1 -- 172.21.15.99:0/187800997 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4809e660 con 0x55c67e37ce80 2024-01-31T05:11:58.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.269+0000 7fbe2effd640 1 -- 172.21.15.99:0/187800997 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fbe480a28a0 con 0x55c67e37ce80 2024-01-31T05:11:58.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.269+0000 7fbe58fbf740 1 -- 172.21.15.99:0/187800997 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbe480cd250 con 0x55c67e37ce80 2024-01-31T05:11:58.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.269+0000 7fbe2effd640 1 -- 172.21.15.99:0/187800997 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe480cc030 con 0x55c67e37ce80 2024-01-31T05:11:58.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.269+0000 7fbe58fbf740 10 client.15627 fetch_fsmap learned FSMap version 27 2024-01-31T05:11:58.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.269+0000 7fbe58fbf740 1 -- 172.21.15.99:0/187800997 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55c67e29b020 con 0x55c67e37ce80 2024-01-31T05:11:58.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.270+0000 7fbe2effd640 1 -- 172.21.15.99:0/187800997 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbe4807f080 con 0x55c67e37ce80 2024-01-31T05:11:58.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.270+0000 7fbe2effd640 1 -- 172.21.15.99:0/187800997 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fbe48016020 con 0x55c67e37ce80 2024-01-31T05:11:58.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.270+0000 7fbe58fbf740 10 client.15627 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:11:58.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.270+0000 7fbe58fbf740 10 client.15627 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-01-31T05:11:58.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.270+0000 7fbe58fbf740 20 client.15627 populate_metadata read hostname 'smithi099' 2024-01-31T05:11:58.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.270+0000 7fbe58fbf740 1 --2- 172.21.15.99:0/187800997 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55c67e3e5000 0x55c67e3e7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:58.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.270+0000 7fbe58fbf740 4 client.15627 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-01-31T05:11:58.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.270+0000 7fbe58fbf740 1 -- 172.21.15.99:0/187800997 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55c67dfd97e0 con 0x55c67e3e5000 2024-01-31T05:11:58.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.270+0000 7fbe4f7fe640 1 --2- 172.21.15.99:0/187800997 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55c67e3e5000 0x55c67e3e7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:58.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.270+0000 7fbe4f7fe640 1 --2- 172.21.15.99:0/187800997 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55c67e3e5000 0x55c67e3e7420 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9422f73cb6a21221 server_cookie=32028365bdf7e415 in_seq=0 out_seq=0 2024-01-31T05:11:58.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.270+0000 7fbe2effd640 10 client.15627 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:11:58.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.271+0000 7fbe2effd640 1 -- 172.21.15.99:0/187800997 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55c67dfd97e0 con 0x55c67e3e5000 2024-01-31T05:11:58.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.271+0000 7fbe2effd640 10 client.15627 handle_command_reply: tid=0 2024-01-31T05:11:58.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.271+0000 7fbe58fbf740 1 client.15627 shutdown 2024-01-31T05:11:58.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.271+0000 7fbe58fbf740 1 -- 172.21.15.99:0/187800997 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c67e37ce80 msgr2=0x55c67e387aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:58.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.271+0000 7fbe58fbf740 1 --2- 172.21.15.99:0/187800997 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c67e37ce80 0x55c67e387aa0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fbe4800ab20 tx=0x7fbe48099c30 comp rx=0 tx=0).stop 2024-01-31T05:11:58.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.271+0000 7fbe58fbf740 1 -- 172.21.15.99:0/187800997 shutdown_connections 2024-01-31T05:11:58.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.271+0000 7fbe58fbf740 1 --2- 172.21.15.99:0/187800997 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c67e37ce80 0x55c67e387aa0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.271+0000 7fbe58fbf740 1 --2- 172.21.15.99:0/187800997 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55c67e3e5000 0x55c67e3e7420 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.271+0000 7fbe58fbf740 1 --2- 172.21.15.99:0/187800997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c67e377d10 0x55c67e387560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.271+0000 7fbe58fbf740 1 --2- 172.21.15.99:0/187800997 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c67e377320 0x55c67e387020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.271+0000 7fbe2effd640 0 client.15627 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:11:58.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.271+0000 7fbe58fbf740 1 -- 172.21.15.99:0/187800997 >> 172.21.15.99:0/187800997 conn(0x55c67e36e480 msgr2=0x55c67e379230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:58.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.271+0000 7fbe58fbf740 1 -- 172.21.15.99:0/187800997 shutdown_connections 2024-01-31T05:11:58.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.271+0000 7fbe58fbf740 1 -- 172.21.15.99:0/187800997 wait complete. 2024-01-31T05:11:58.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.271+0000 7fbe58fbf740 20 client.15627 trim_cache size 0 max 16384 2024-01-31T05:11:58.290 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-01-31T05:11:58.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.271+0000 7fbe561fb640 1 -- 172.21.15.99:0/2138634002 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fbe380a1370 msgr2=0x7fbe380a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:58.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.271+0000 7fbe561fb640 1 --2- 172.21.15.99:0/2138634002 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fbe380a1370 0x7fbe380a3830 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbe44005ab0 tx=0x7fbe44004800 comp rx=0 tx=0).stop 2024-01-31T05:11:58.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.271+0000 7fbe561fb640 1 -- 172.21.15.99:0/2138634002 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe501017c0 msgr2=0x7fbe5019e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:58.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.271+0000 7fbe561fb640 1 --2- 172.21.15.99:0/2138634002 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe501017c0 0x7fbe5019e220 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fbe4800cce0 tx=0x7fbe4800a620 comp rx=0 tx=0).stop 2024-01-31T05:11:58.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.271+0000 7fbe561fb640 1 -- 172.21.15.99:0/2138634002 shutdown_connections 2024-01-31T05:11:58.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.271+0000 7fbe561fb640 1 --2- 172.21.15.99:0/2138634002 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fbe380a1370 0x7fbe380a3830 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.271+0000 7fbe561fb640 1 --2- 172.21.15.99:0/2138634002 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe501017c0 0x7fbe5019e220 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.271+0000 7fbe561fb640 1 --2- 172.21.15.99:0/2138634002 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe50100e00 0x7fbe501971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.271+0000 7fbe561fb640 1 --2- 172.21.15.99:0/2138634002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe500ffc10 0x7fbe50196c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:58.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.271+0000 7fbe561fb640 1 -- 172.21.15.99:0/2138634002 >> 172.21.15.99:0/2138634002 conn(0x7fbe500fb1a0 msgr2=0x7fbe50104220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:58.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.271+0000 7fbe561fb640 1 -- 172.21.15.99:0/2138634002 shutdown_connections 2024-01-31T05:11:58.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:58.271+0000 7fbe561fb640 1 -- 172.21.15.99:0/2138634002 wait complete. 2024-01-31T05:11:59.295 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-01-31T05:11:59.295 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-01-31T05:11:59.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.412+0000 7fa5f5e6e640 1 -- 172.21.15.99:0/988448259 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5f0100d00 msgr2=0x7fa5f0101120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:59.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.412+0000 7fa5f5e6e640 1 --2- 172.21.15.99:0/988448259 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5f0100d00 0x7fa5f0101120 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0009900 tx=0x7fa5e002bc30 comp rx=0 tx=0).stop 2024-01-31T05:11:59.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.412+0000 7fa5f5e6e640 1 -- 172.21.15.99:0/988448259 shutdown_connections 2024-01-31T05:11:59.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.412+0000 7fa5f5e6e640 1 --2- 172.21.15.99:0/988448259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5f01028b0 0x7fa5f0109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.412+0000 7fa5f5e6e640 1 --2- 172.21.15.99:0/988448259 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa5f0101ef0 0x7fa5f0102370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.412+0000 7fa5f5e6e640 1 --2- 172.21.15.99:0/988448259 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5f0100d00 0x7fa5f0101120 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.412+0000 7fa5f5e6e640 1 -- 172.21.15.99:0/988448259 >> 172.21.15.99:0/988448259 conn(0x7fa5f00fc290 msgr2=0x7fa5f00fe6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:59.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.412+0000 7fa5f5e6e640 1 -- 172.21.15.99:0/988448259 shutdown_connections 2024-01-31T05:11:59.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.412+0000 7fa5f5e6e640 1 -- 172.21.15.99:0/988448259 wait complete. 2024-01-31T05:11:59.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.413+0000 7fa5f5e6e640 1 Processor -- start 2024-01-31T05:11:59.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.413+0000 7fa5f5e6e640 1 -- start start 2024-01-31T05:11:59.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.413+0000 7fa5f5e6e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa5f0100d00 0x7fa5f0196d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:59.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.413+0000 7fa5f5e6e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5f0101ef0 0x7fa5f0197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:59.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.413+0000 7fa5f5e6e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5f01028b0 0x7fa5f019e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:59.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.413+0000 7fa5f5e6e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f019e830 con 0x7fa5f0101ef0 2024-01-31T05:11:59.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.413+0000 7fa5f5e6e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f019e9a0 con 0x7fa5f01028b0 2024-01-31T05:11:59.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.413+0000 7fa5f5e6e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f019eb60 con 0x7fa5f0100d00 2024-01-31T05:11:59.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.413+0000 7fa5e7fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5f0101ef0 0x7fa5f0197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:59.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.413+0000 7fa5e7fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5f0101ef0 0x7fa5f0197280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48290/0 (socket says 172.21.15.99:48290) 2024-01-31T05:11:59.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.413+0000 7fa5e7fff640 1 -- 172.21.15.99:0/1939512974 learned_addr learned my addr 172.21.15.99:0/1939512974 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:59.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.413+0000 7fa5effff640 1 --2- 172.21.15.99:0/1939512974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5f01028b0 0x7fa5f019e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:59.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.413+0000 7fa5ef7fe640 1 --2- 172.21.15.99:0/1939512974 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa5f0100d00 0x7fa5f0196d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:59.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.413+0000 7fa5e7fff640 1 -- 172.21.15.99:0/1939512974 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa5f0100d00 msgr2=0x7fa5f0196d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:59.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.413+0000 7fa5e7fff640 1 --2- 172.21.15.99:0/1939512974 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa5f0100d00 0x7fa5f0196d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.413+0000 7fa5e7fff640 1 -- 172.21.15.99:0/1939512974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5f01028b0 msgr2=0x7fa5f019e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:59.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.413+0000 7fa5e7fff640 1 --2- 172.21.15.99:0/1939512974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5f01028b0 0x7fa5f019e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.413+0000 7fa5e7fff640 1 -- 172.21.15.99:0/1939512974 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e0009560 con 0x7fa5f0101ef0 2024-01-31T05:11:59.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.413+0000 7fa5effff640 1 --2- 172.21.15.99:0/1939512974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5f01028b0 0x7fa5f019e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:11:59.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.413+0000 7fa5e7fff640 1 --2- 172.21.15.99:0/1939512974 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5f0101ef0 0x7fa5f0197280 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fa5d800b4a0 tx=0x7fa5d800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:59.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.414+0000 7fa5ed7fa640 1 -- 172.21.15.99:0/1939512974 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d8010610 con 0x7fa5f0101ef0 2024-01-31T05:11:59.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.414+0000 7fa5ed7fa640 1 -- 172.21.15.99:0/1939512974 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa5d8010c30 con 0x7fa5f0101ef0 2024-01-31T05:11:59.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.414+0000 7fa5f5e6e640 1 -- 172.21.15.99:0/1939512974 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f019ee40 con 0x7fa5f0101ef0 2024-01-31T05:11:59.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.414+0000 7fa5ed7fa640 1 -- 172.21.15.99:0/1939512974 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d8017dd0 con 0x7fa5f0101ef0 2024-01-31T05:11:59.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.414+0000 7fa5f5e6e640 1 -- 172.21.15.99:0/1939512974 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f019f2f0 con 0x7fa5f0101ef0 2024-01-31T05:11:59.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.416+0000 7fa5ed7fa640 1 -- 172.21.15.99:0/1939512974 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 135946+0+0 (secure 0 0 0) 0x7fa5d80173f0 con 0x7fa5f0101ef0 2024-01-31T05:11:59.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.416+0000 7fa5f8c37740 1 Processor -- start 2024-01-31T05:11:59.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.416+0000 7fa5f8c37740 1 -- start start 2024-01-31T05:11:59.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.416+0000 7fa5ed7fa640 1 --2- 172.21.15.99:0/1939512974 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa5dc0a1370 0x7fa5dc0a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:59.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.416+0000 7fa5f8c37740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55601afe7050 0x55601afe7470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:59.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.416+0000 7fa5f8c37740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55601afe7a40 0x55601afec540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:59.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.417+0000 7fa5f8c37740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55601afecbb0 0x55601afef040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:59.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.417+0000 7fa5f8c37740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55601afbdbf0 con 0x55601afe7050 2024-01-31T05:11:59.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.417+0000 7fa5f8c37740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55601af55f50 con 0x55601afe7a40 2024-01-31T05:11:59.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.417+0000 7fa5f8c37740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55601af53640 con 0x55601afecbb0 2024-01-31T05:11:59.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.417+0000 7fa5effff640 1 --2- 172.21.15.99:0/1939512974 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa5dc0a1370 0x7fa5dc0a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:59.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.417+0000 7fa5ed7fa640 1 -- 172.21.15.99:0/1939512974 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fa5d80cc1f0 con 0x7fa5f0101ef0 2024-01-31T05:11:59.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.417+0000 7fa5ef7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55601afe7050 0x55601afe7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:59.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.417+0000 7fa5ef7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55601afe7050 0x55601afe7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48294/0 (socket says 172.21.15.99:48294) 2024-01-31T05:11:59.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.417+0000 7fa5ef7fe640 1 -- 172.21.15.99:0/2849412195 learned_addr learned my addr 172.21.15.99:0/2849412195 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:59.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.417+0000 7fa5e7fff640 1 --2- 172.21.15.99:0/2849412195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55601afe7a40 0x55601afec540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:59.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.417+0000 7fa5effff640 1 --2- 172.21.15.99:0/2849412195 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55601afecbb0 0x55601afef040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:59.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.417+0000 7fa5ef7fe640 1 -- 172.21.15.99:0/2849412195 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55601afecbb0 msgr2=0x55601afef040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:59.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.417+0000 7fa5ef7fe640 1 --2- 172.21.15.99:0/2849412195 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55601afecbb0 0x55601afef040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.417+0000 7fa5ef7fe640 1 -- 172.21.15.99:0/2849412195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55601afe7a40 msgr2=0x55601afec540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:59.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.417+0000 7fa5ef7fe640 1 --2- 172.21.15.99:0/2849412195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55601afe7a40 0x55601afec540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.417+0000 7fa5ef7fe640 1 -- 172.21.15.99:0/2849412195 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55601af46d50 con 0x55601afe7050 2024-01-31T05:11:59.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.417+0000 7fa5effff640 1 --2- 172.21.15.99:0/1939512974 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa5dc0a1370 0x7fa5dc0a3830 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8009270 tx=0x7fa5e80137d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:59.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.417+0000 7fa5ef7fe640 1 --2- 172.21.15.99:0/2849412195 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55601afe7050 0x55601afe7470 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa5e002c610 tx=0x7fa5e0004e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7c26fed7d7ea304 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:59.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.417+0000 7fa5e5ffb640 1 -- 172.21.15.99:0/2849412195 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e002cb00 con 0x55601afe7050 2024-01-31T05:11:59.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.417+0000 7fa5e5ffb640 1 -- 172.21.15.99:0/2849412195 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa5e0004040 con 0x55601afe7050 2024-01-31T05:11:59.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.417+0000 7fa5e5ffb640 1 -- 172.21.15.99:0/2849412195 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e00054a0 con 0x55601afe7050 2024-01-31T05:11:59.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.418+0000 7fa5f8c37740 1 -- 172.21.15.99:0/2849412195 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55601afe7050 msgr2=0x55601afe7470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:59.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.418+0000 7fa5f8c37740 1 --2- 172.21.15.99:0/2849412195 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55601afe7050 0x55601afe7470 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa5e002c610 tx=0x7fa5e0004e80 comp rx=0 tx=0).stop 2024-01-31T05:11:59.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.418+0000 7fa5f8c37740 1 -- 172.21.15.99:0/2849412195 shutdown_connections 2024-01-31T05:11:59.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.418+0000 7fa5f8c37740 1 --2- 172.21.15.99:0/2849412195 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55601afecbb0 0x55601afef040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.418+0000 7fa5f8c37740 1 --2- 172.21.15.99:0/2849412195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55601afe7a40 0x55601afec540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.418+0000 7fa5f8c37740 1 --2- 172.21.15.99:0/2849412195 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55601afe7050 0x55601afe7470 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.418+0000 7fa5f8c37740 1 -- 172.21.15.99:0/2849412195 >> 172.21.15.99:0/2849412195 conn(0x55601afe25c0 msgr2=0x55601afe29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:59.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.418+0000 7fa5f8c37740 1 -- 172.21.15.99:0/2849412195 shutdown_connections 2024-01-31T05:11:59.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.418+0000 7fa5f8c37740 1 -- 172.21.15.99:0/2849412195 wait complete. 2024-01-31T05:11:59.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.418+0000 7fa5f8c37740 1 -- start start 2024-01-31T05:11:59.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.419+0000 7fa5f8c37740 1 Processor -- start 2024-01-31T05:11:59.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.419+0000 7fa5f8c37740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55601afe7050 0x55601aff10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:59.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.419+0000 7fa5f8c37740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55601afe7a40 0x55601aff15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:59.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.419+0000 7fa5f8c37740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55601afecbb0 0x55601aff8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:59.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.419+0000 7fa5f8c37740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55601af4ef30 con 0x55601afe7a40 2024-01-31T05:11:59.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.419+0000 7fa5f8c37740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55601af080c0 con 0x55601afecbb0 2024-01-31T05:11:59.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.419+0000 7fa5f8c37740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55601af07d60 con 0x55601afe7050 2024-01-31T05:11:59.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.419+0000 7fa5f8c37740 10 client.0 _ll_register_callbacks cb 0x55601aeedfc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:11:59.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.419+0000 7fa5e7fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55601afe7a40 0x55601aff15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:59.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.419+0000 7fa5e7fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55601afe7a40 0x55601aff15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48302/0 (socket says 172.21.15.99:48302) 2024-01-31T05:11:59.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.419+0000 7fa5e7fff640 1 -- 172.21.15.99:0/2679257020 learned_addr learned my addr 172.21.15.99:0/2679257020 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:59.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.419+0000 7fa5effff640 1 --2- 172.21.15.99:0/2679257020 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55601afecbb0 0x55601aff8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:59.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.419+0000 7fa5e7fff640 1 -- 172.21.15.99:0/2679257020 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55601afe7050 msgr2=0x55601aff10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:59.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.419+0000 7fa5e7fff640 1 --2- 172.21.15.99:0/2679257020 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55601afe7050 0x55601aff10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.419+0000 7fa5e7fff640 1 -- 172.21.15.99:0/2679257020 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55601afecbb0 msgr2=0x55601aff8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:59.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.419+0000 7fa5e7fff640 1 --2- 172.21.15.99:0/2679257020 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55601afecbb0 0x55601aff8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.419+0000 7fa5e7fff640 1 -- 172.21.15.99:0/2679257020 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f0109a40 con 0x55601afe7a40 2024-01-31T05:11:59.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.419+0000 7fa5effff640 1 --2- 172.21.15.99:0/2679257020 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55601afecbb0 0x55601aff8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:11:59.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.419+0000 7fa5e7fff640 1 --2- 172.21.15.99:0/2679257020 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55601afe7a40 0x55601aff15f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fa5d800b470 tx=0x7fa5d8099c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b2598c5d60d41cc server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:59.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.419+0000 7fa5ceffd640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:11:59.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.419+0000 7fa5ceffd640 1 -- 172.21.15.99:0/2679257020 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d80cc020 con 0x55601afe7a40 2024-01-31T05:11:59.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.420+0000 7fa5ceffd640 1 -- 172.21.15.99:0/2679257020 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fa5d80a1790 con 0x55601afe7a40 2024-01-31T05:11:59.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.420+0000 7fa5f8c37740 1 -- 172.21.15.99:0/2679257020 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55601af47f20 con 0x55601afe7a40 2024-01-31T05:11:59.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.420+0000 7fa5ceffd640 1 -- 172.21.15.99:0/2679257020 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5d80977a0 con 0x55601afe7a40 2024-01-31T05:11:59.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.420+0000 7fa5f8c37740 10 client.15639 fetch_fsmap learned FSMap version 27 2024-01-31T05:11:59.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.420+0000 7fa5f8c37740 1 -- 172.21.15.99:0/2679257020 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55601af4d5b0 con 0x55601afe7a40 2024-01-31T05:11:59.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.420+0000 7fa5ceffd640 1 -- 172.21.15.99:0/2679257020 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55601af47f20 con 0x55601afe7a40 2024-01-31T05:11:59.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.420+0000 7fa5ceffd640 1 -- 172.21.15.99:0/2679257020 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa5d80a1390 con 0x55601afe7a40 2024-01-31T05:11:59.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.420+0000 7fa5f8c37740 10 client.15639 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:11:59.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.420+0000 7fa5f8c37740 10 client.15639 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-01-31T05:11:59.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.420+0000 7fa5f8c37740 20 client.15639 populate_metadata read hostname 'smithi099' 2024-01-31T05:11:59.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.420+0000 7fa5f8c37740 1 --2- 172.21.15.99:0/2679257020 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55601affd340 0x55601afff7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:59.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.420+0000 7fa5f8c37740 4 client.15639 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:11:59.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.420+0000 7fa5f8c37740 1 -- 172.21.15.99:0/2679257020 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55601af47c40 con 0x55601affd340 2024-01-31T05:11:59.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.420+0000 7fa5ef7fe640 1 --2- 172.21.15.99:0/2679257020 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55601affd340 0x55601afff7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:59.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.421+0000 7fa5ceffd640 10 client.15639 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:11:59.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.421+0000 7fa5ef7fe640 1 --2- 172.21.15.99:0/2679257020 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55601affd340 0x55601afff7a0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acdb8ddf51131f9b server_cookie=ce911dbef82eba96 in_seq=0 out_seq=0 2024-01-31T05:11:59.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.421+0000 7fa5ceffd640 1 -- 172.21.15.99:0/2679257020 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55601af47c40 con 0x55601affd340 2024-01-31T05:11:59.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.421+0000 7fa5ceffd640 10 client.15639 handle_command_reply: tid=0 2024-01-31T05:11:59.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.421+0000 7fa5f8c37740 1 client.15639 shutdown 2024-01-31T05:11:59.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.422+0000 7fa5f8c37740 1 -- 172.21.15.99:0/2679257020 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55601afe7a40 msgr2=0x55601aff15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:59.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.422+0000 7fa5f8c37740 1 --2- 172.21.15.99:0/2679257020 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55601afe7a40 0x55601aff15f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fa5d800b470 tx=0x7fa5d8099c40 comp rx=0 tx=0).stop 2024-01-31T05:11:59.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.422+0000 7fa5f8c37740 1 -- 172.21.15.99:0/2679257020 shutdown_connections 2024-01-31T05:11:59.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.422+0000 7fa5f8c37740 1 --2- 172.21.15.99:0/2679257020 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55601affd340 0x55601afff7a0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.422+0000 7fa5f8c37740 1 --2- 172.21.15.99:0/2679257020 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55601afecbb0 0x55601aff8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.422+0000 7fa5f8c37740 1 --2- 172.21.15.99:0/2679257020 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55601afe7a40 0x55601aff15f0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.422+0000 7fa5f8c37740 1 --2- 172.21.15.99:0/2679257020 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55601afe7050 0x55601aff10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.422+0000 7fa5ceffd640 0 client.15639 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:11:59.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.422+0000 7fa5f8c37740 1 -- 172.21.15.99:0/2679257020 >> 172.21.15.99:0/2679257020 conn(0x55601afe25c0 msgr2=0x55601afe1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:59.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.422+0000 7fa5f8c37740 1 -- 172.21.15.99:0/2679257020 shutdown_connections 2024-01-31T05:11:59.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.422+0000 7fa5f8c37740 1 -- 172.21.15.99:0/2679257020 wait complete. 2024-01-31T05:11:59.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.422+0000 7fa5f8c37740 20 client.15639 trim_cache size 0 max 16384 2024-01-31T05:11:59.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.437+0000 7fa5f8c37740 1 Processor -- start 2024-01-31T05:11:59.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.437+0000 7fa5f8c37740 1 -- start start 2024-01-31T05:11:59.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.437+0000 7fa5f8c37740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55601afe7050 0x55601afe8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:59.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.437+0000 7fa5f8c37740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55601afe7a40 0x55601aff85f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:59.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.437+0000 7fa5f8c37740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55601afecbb0 0x55601afe9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:59.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.437+0000 7fa5f8c37740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55601aecce30 con 0x55601afecbb0 2024-01-31T05:11:59.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.437+0000 7fa5f8c37740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55601af47c70 con 0x55601afe7050 2024-01-31T05:11:59.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.437+0000 7fa5f8c37740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55601afe8130 con 0x55601afe7a40 2024-01-31T05:11:59.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.437+0000 7fa5effff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55601afecbb0 0x55601afe9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:59.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.437+0000 7fa5effff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55601afecbb0 0x55601afe9300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48306/0 (socket says 172.21.15.99:48306) 2024-01-31T05:11:59.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.437+0000 7fa5effff640 1 -- 172.21.15.99:0/610639899 learned_addr learned my addr 172.21.15.99:0/610639899 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:59.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.437+0000 7fa5ef7fe640 1 --2- 172.21.15.99:0/610639899 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55601afe7050 0x55601afe8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:59.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.437+0000 7fa5effff640 1 -- 172.21.15.99:0/610639899 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55601afe7a40 msgr2=0x55601aff85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:59.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.437+0000 7fa5effff640 1 --2- 172.21.15.99:0/610639899 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55601afe7a40 0x55601aff85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.437+0000 7fa5effff640 1 -- 172.21.15.99:0/610639899 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55601afe7050 msgr2=0x55601afe8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:59.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.437+0000 7fa5effff640 1 --2- 172.21.15.99:0/610639899 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55601afe7050 0x55601afe8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.437+0000 7fa5effff640 1 -- 172.21.15.99:0/610639899 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55601aee9d50 con 0x55601afecbb0 2024-01-31T05:11:59.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.437+0000 7fa5effff640 1 --2- 172.21.15.99:0/610639899 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55601afecbb0 0x55601afe9300 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fa5e800a010 tx=0x7fa5e8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d2df6e774a23500 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:59.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.438+0000 7fa5e57fa640 1 -- 172.21.15.99:0/610639899 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e801e710 con 0x55601afecbb0 2024-01-31T05:11:59.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.438+0000 7fa5e57fa640 1 -- 172.21.15.99:0/610639899 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa5e8023070 con 0x55601afecbb0 2024-01-31T05:11:59.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.438+0000 7fa5e57fa640 1 -- 172.21.15.99:0/610639899 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e801fc40 con 0x55601afecbb0 2024-01-31T05:11:59.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.438+0000 7fa5f8c37740 1 -- 172.21.15.99:0/610639899 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55601afecbb0 msgr2=0x55601afe9300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:59.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.438+0000 7fa5f8c37740 1 --2- 172.21.15.99:0/610639899 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55601afecbb0 0x55601afe9300 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fa5e800a010 tx=0x7fa5e8016000 comp rx=0 tx=0).stop 2024-01-31T05:11:59.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.438+0000 7fa5f8c37740 1 -- 172.21.15.99:0/610639899 shutdown_connections 2024-01-31T05:11:59.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.438+0000 7fa5f8c37740 1 --2- 172.21.15.99:0/610639899 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55601afecbb0 0x55601afe9300 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.438+0000 7fa5f8c37740 1 --2- 172.21.15.99:0/610639899 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55601afe7a40 0x55601aff85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.438+0000 7fa5f8c37740 1 --2- 172.21.15.99:0/610639899 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55601afe7050 0x55601afe8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.438+0000 7fa5f8c37740 1 -- 172.21.15.99:0/610639899 >> 172.21.15.99:0/610639899 conn(0x55601afe25c0 msgr2=0x55601aff10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:59.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.438+0000 7fa5f8c37740 1 -- 172.21.15.99:0/610639899 shutdown_connections 2024-01-31T05:11:59.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.438+0000 7fa5f8c37740 1 -- 172.21.15.99:0/610639899 wait complete. 2024-01-31T05:11:59.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.438+0000 7fa5f8c37740 1 -- start start 2024-01-31T05:11:59.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.439+0000 7fa5f8c37740 1 Processor -- start 2024-01-31T05:11:59.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.439+0000 7fa5f8c37740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55601afe7050 0x55601aff7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:59.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.439+0000 7fa5f8c37740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55601afe7a40 0x55601aff7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:59.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.439+0000 7fa5f8c37740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55601afecbb0 0x55601b053c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:59.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.439+0000 7fa5f8c37740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55601b054190 con 0x55601afe7050 2024-01-31T05:11:59.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.439+0000 7fa5f8c37740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55601b0542d0 con 0x55601afecbb0 2024-01-31T05:11:59.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.439+0000 7fa5f8c37740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55601b054440 con 0x55601afe7a40 2024-01-31T05:11:59.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.439+0000 7fa5f8c37740 10 client.0 _ll_register_callbacks cb 0x7fa5e0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:11:59.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.439+0000 7fa5ef7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55601afe7050 0x55601aff7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:59.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.439+0000 7fa5ef7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55601afe7050 0x55601aff7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48308/0 (socket says 172.21.15.99:48308) 2024-01-31T05:11:59.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.439+0000 7fa5ef7fe640 1 -- 172.21.15.99:0/4023165085 learned_addr learned my addr 172.21.15.99:0/4023165085 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:59.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.439+0000 7fa5e7fff640 1 --2- 172.21.15.99:0/4023165085 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55601afe7a40 0x55601aff7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:59.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.439+0000 7fa5effff640 1 --2- 172.21.15.99:0/4023165085 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55601afecbb0 0x55601b053c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:59.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.439+0000 7fa5ef7fe640 1 -- 172.21.15.99:0/4023165085 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55601afe7a40 msgr2=0x55601aff7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:59.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.439+0000 7fa5ef7fe640 1 --2- 172.21.15.99:0/4023165085 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55601afe7a40 0x55601aff7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.439+0000 7fa5ef7fe640 1 -- 172.21.15.99:0/4023165085 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55601afecbb0 msgr2=0x55601b053c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:59.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.439+0000 7fa5ef7fe640 1 --2- 172.21.15.99:0/4023165085 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55601afecbb0 0x55601b053c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.439+0000 7fa5ef7fe640 1 -- 172.21.15.99:0/4023165085 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5e8019070 con 0x55601afe7050 2024-01-31T05:11:59.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.439+0000 7fa5effff640 1 --2- 172.21.15.99:0/4023165085 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55601afecbb0 0x55601b053c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:11:59.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.439+0000 7fa5ef7fe640 1 --2- 172.21.15.99:0/4023165085 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55601afe7050 0x55601aff7a70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fa5e002c6b0 tx=0x7fa5e0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd88dd7d92eaf427 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:59.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.439+0000 7fa5ceffd640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:11:59.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.440+0000 7fa5ceffd640 1 -- 172.21.15.99:0/4023165085 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0004ad0 con 0x55601afe7050 2024-01-31T05:11:59.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.440+0000 7fa5ceffd640 1 -- 172.21.15.99:0/4023165085 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fa5e004c040 con 0x55601afe7050 2024-01-31T05:11:59.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.440+0000 7fa5f8c37740 1 -- 172.21.15.99:0/4023165085 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa5e0004040 con 0x55601afe7050 2024-01-31T05:11:59.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.440+0000 7fa5ceffd640 1 -- 172.21.15.99:0/4023165085 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5e002c2b0 con 0x55601afe7050 2024-01-31T05:11:59.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.440+0000 7fa5f8c37740 10 client.15645 fetch_fsmap learned FSMap version 27 2024-01-31T05:11:59.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.440+0000 7fa5f8c37740 1 -- 172.21.15.99:0/4023165085 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55601af0f960 con 0x55601afe7050 2024-01-31T05:11:59.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.440+0000 7fa5ceffd640 1 -- 172.21.15.99:0/4023165085 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa5e0063020 con 0x55601afe7050 2024-01-31T05:11:59.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.440+0000 7fa5ceffd640 1 -- 172.21.15.99:0/4023165085 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa5e003c040 con 0x55601afe7050 2024-01-31T05:11:59.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.440+0000 7fa5f8c37740 10 client.15645 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:11:59.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.440+0000 7fa5f8c37740 10 client.15645 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-01-31T05:11:59.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.440+0000 7fa5f8c37740 20 client.15645 populate_metadata read hostname 'smithi099' 2024-01-31T05:11:59.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.440+0000 7fa5f8c37740 1 --2- 172.21.15.99:0/4023165085 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55601b055be0 0x55601b058000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:59.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.440+0000 7fa5f8c37740 4 client.15645 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-01-31T05:11:59.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.440+0000 7fa5f8c37740 1 -- 172.21.15.99:0/4023165085 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55601ac4e860 con 0x55601b055be0 2024-01-31T05:11:59.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.440+0000 7fa5e7fff640 1 --2- 172.21.15.99:0/4023165085 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55601b055be0 0x55601b058000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:59.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.441+0000 7fa5e7fff640 1 --2- 172.21.15.99:0/4023165085 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55601b055be0 0x55601b058000 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29e5a0961d8ddba2 server_cookie=7c332bde163f5176 in_seq=0 out_seq=0 2024-01-31T05:11:59.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.441+0000 7fa5ceffd640 10 client.15645 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:11:59.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.442+0000 7fa5ceffd640 1 -- 172.21.15.99:0/4023165085 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55601ac4e860 con 0x55601b055be0 2024-01-31T05:11:59.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.442+0000 7fa5ceffd640 10 client.15645 handle_command_reply: tid=0 2024-01-31T05:11:59.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.442+0000 7fa5f8c37740 1 client.15645 shutdown 2024-01-31T05:11:59.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.442+0000 7fa5f8c37740 1 -- 172.21.15.99:0/4023165085 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55601afe7050 msgr2=0x55601aff7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:59.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.442+0000 7fa5f8c37740 1 --2- 172.21.15.99:0/4023165085 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55601afe7050 0x55601aff7a70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fa5e002c6b0 tx=0x7fa5e0000bc0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.442+0000 7fa5f8c37740 1 -- 172.21.15.99:0/4023165085 shutdown_connections 2024-01-31T05:11:59.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.442+0000 7fa5f8c37740 1 --2- 172.21.15.99:0/4023165085 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55601b055be0 0x55601b058000 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.442+0000 7fa5f8c37740 1 --2- 172.21.15.99:0/4023165085 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55601afecbb0 0x55601b053c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.442+0000 7fa5ceffd640 0 client.15645 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:11:59.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.442+0000 7fa5f8c37740 1 --2- 172.21.15.99:0/4023165085 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55601afe7a40 0x55601aff7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.442+0000 7fa5f8c37740 1 --2- 172.21.15.99:0/4023165085 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55601afe7050 0x55601aff7a70 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.442+0000 7fa5f8c37740 1 -- 172.21.15.99:0/4023165085 >> 172.21.15.99:0/4023165085 conn(0x55601afe25c0 msgr2=0x55601aff1060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:59.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.442+0000 7fa5f8c37740 1 -- 172.21.15.99:0/4023165085 shutdown_connections 2024-01-31T05:11:59.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.442+0000 7fa5f8c37740 1 -- 172.21.15.99:0/4023165085 wait complete. 2024-01-31T05:11:59.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.442+0000 7fa5f8c37740 20 client.15645 trim_cache size 0 max 16384 2024-01-31T05:11:59.449 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-01-31T05:11:59.449 INFO:teuthology.orchestra.run.smithi099.stdout: "return_code": 0, 2024-01-31T05:11:59.450 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_tag": "9fd30a2f-265e-4bce-84ca-113c5fe747dd", 2024-01-31T05:11:59.450 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": "asynchronous" 2024-01-31T05:11:59.450 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-01-31T05:11:59.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.443+0000 7fa5f5e6e640 1 -- 172.21.15.99:0/1939512974 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa5dc0a1370 msgr2=0x7fa5dc0a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:59.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.443+0000 7fa5f5e6e640 1 --2- 172.21.15.99:0/1939512974 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa5dc0a1370 0x7fa5dc0a3830 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8009270 tx=0x7fa5e80137d0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.443+0000 7fa5f5e6e640 1 -- 172.21.15.99:0/1939512974 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5f0101ef0 msgr2=0x7fa5f0197280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:59.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.443+0000 7fa5f5e6e640 1 --2- 172.21.15.99:0/1939512974 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5f0101ef0 0x7fa5f0197280 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fa5d800b4a0 tx=0x7fa5d800b960 comp rx=0 tx=0).stop 2024-01-31T05:11:59.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.443+0000 7fa5f5e6e640 1 -- 172.21.15.99:0/1939512974 shutdown_connections 2024-01-31T05:11:59.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.443+0000 7fa5f5e6e640 1 --2- 172.21.15.99:0/1939512974 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa5dc0a1370 0x7fa5dc0a3830 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.443+0000 7fa5f5e6e640 1 --2- 172.21.15.99:0/1939512974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5f01028b0 0x7fa5f019e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.443+0000 7fa5f5e6e640 1 --2- 172.21.15.99:0/1939512974 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5f0101ef0 0x7fa5f0197280 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.443+0000 7fa5f5e6e640 1 --2- 172.21.15.99:0/1939512974 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa5f0100d00 0x7fa5f0196d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.443+0000 7fa5f5e6e640 1 -- 172.21.15.99:0/1939512974 >> 172.21.15.99:0/1939512974 conn(0x7fa5f00fc290 msgr2=0x7fa5f0105360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:59.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.443+0000 7fa5f5e6e640 1 -- 172.21.15.99:0/1939512974 shutdown_connections 2024-01-31T05:11:59.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.443+0000 7fa5f5e6e640 1 -- 172.21.15.99:0/1939512974 wait complete. 2024-01-31T05:11:59.454 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-01-31T05:11:59.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.557+0000 7fc8c2637640 1 -- 172.21.15.99:0/830801540 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8bc1017e0 msgr2=0x7fc8bc103bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:59.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.557+0000 7fc8c2637640 1 --2- 172.21.15.99:0/830801540 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8bc1017e0 0x7fc8bc103bd0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac009900 tx=0x7fc8ac02bc30 comp rx=0 tx=0).stop 2024-01-31T05:11:59.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.557+0000 7fc8c2637640 1 -- 172.21.15.99:0/830801540 shutdown_connections 2024-01-31T05:11:59.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.557+0000 7fc8c2637640 1 --2- 172.21.15.99:0/830801540 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8bc106a40 0x7fc8bc108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.557+0000 7fc8c2637640 1 --2- 172.21.15.99:0/830801540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8bc104110 0x7fc8bc106500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.557+0000 7fc8c2637640 1 --2- 172.21.15.99:0/830801540 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8bc1017e0 0x7fc8bc103bd0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.557+0000 7fc8c2637640 1 -- 172.21.15.99:0/830801540 >> 172.21.15.99:0/830801540 conn(0x7fc8bc0fb190 msgr2=0x7fc8bc0fd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:59.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.557+0000 7fc8c2637640 1 -- 172.21.15.99:0/830801540 shutdown_connections 2024-01-31T05:11:59.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.557+0000 7fc8c2637640 1 -- 172.21.15.99:0/830801540 wait complete. 2024-01-31T05:11:59.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.557+0000 7fc8c2637640 1 Processor -- start 2024-01-31T05:11:59.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.557+0000 7fc8c2637640 1 -- start start 2024-01-31T05:11:59.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.558+0000 7fc8c2637640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8bc1017e0 0x7fc8bc196d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:59.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.558+0000 7fc8c2637640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8bc104110 0x7fc8bc197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:59.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.558+0000 7fc8c2637640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8bc106a40 0x7fc8bc19e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:59.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.558+0000 7fc8c2637640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc19e820 con 0x7fc8bc104110 2024-01-31T05:11:59.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.558+0000 7fc8c2637640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc19e990 con 0x7fc8bc1017e0 2024-01-31T05:11:59.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.558+0000 7fc8c2637640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc19eb50 con 0x7fc8bc106a40 2024-01-31T05:11:59.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.558+0000 7fc8bb7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8bc104110 0x7fc8bc197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:59.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.558+0000 7fc8bb7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8bc104110 0x7fc8bc197280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48328/0 (socket says 172.21.15.99:48328) 2024-01-31T05:11:59.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.558+0000 7fc8bb7fe640 1 -- 172.21.15.99:0/2095736665 learned_addr learned my addr 172.21.15.99:0/2095736665 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:59.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.558+0000 7fc8bbfff640 1 --2- 172.21.15.99:0/2095736665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8bc1017e0 0x7fc8bc196d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:59.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.558+0000 7fc8c0bd4640 1 --2- 172.21.15.99:0/2095736665 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8bc106a40 0x7fc8bc19e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:59.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.558+0000 7fc8bb7fe640 1 -- 172.21.15.99:0/2095736665 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8bc106a40 msgr2=0x7fc8bc19e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:59.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.558+0000 7fc8bb7fe640 1 --2- 172.21.15.99:0/2095736665 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8bc106a40 0x7fc8bc19e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.558+0000 7fc8bb7fe640 1 -- 172.21.15.99:0/2095736665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8bc1017e0 msgr2=0x7fc8bc196d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:59.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.558+0000 7fc8bb7fe640 1 --2- 172.21.15.99:0/2095736665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8bc1017e0 0x7fc8bc196d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.558+0000 7fc8bb7fe640 1 -- 172.21.15.99:0/2095736665 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8ac009560 con 0x7fc8bc104110 2024-01-31T05:11:59.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.558+0000 7fc8bb7fe640 1 --2- 172.21.15.99:0/2095736665 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8bc104110 0x7fc8bc197280 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc8b000d770 tx=0x7fc8b000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:59.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.558+0000 7fc8b97fa640 1 -- 172.21.15.99:0/2095736665 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b0009c30 con 0x7fc8bc104110 2024-01-31T05:11:59.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.558+0000 7fc8b97fa640 1 -- 172.21.15.99:0/2095736665 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc8b000de80 con 0x7fc8bc104110 2024-01-31T05:11:59.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.558+0000 7fc8c2637640 1 -- 172.21.15.99:0/2095736665 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8bc19ee30 con 0x7fc8bc104110 2024-01-31T05:11:59.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.559+0000 7fc8b97fa640 1 -- 172.21.15.99:0/2095736665 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b000f620 con 0x7fc8bc104110 2024-01-31T05:11:59.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.559+0000 7fc8c2637640 1 -- 172.21.15.99:0/2095736665 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8bc19f250 con 0x7fc8bc104110 2024-01-31T05:11:59.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.561+0000 7fc8b97fa640 1 -- 172.21.15.99:0/2095736665 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 135946+0+0 (secure 0 0 0) 0x7fc8b0010460 con 0x7fc8bc104110 2024-01-31T05:11:59.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.561+0000 7fc8c53ff740 1 Processor -- start 2024-01-31T05:11:59.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.561+0000 7fc8c53ff740 1 -- start start 2024-01-31T05:11:59.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.561+0000 7fc8b97fa640 1 --2- 172.21.15.99:0/2095736665 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc8a40a1370 0x7fc8a40a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:59.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.561+0000 7fc8c53ff740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f28443da20 0x55f28443de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:59.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.561+0000 7fc8c53ff740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f28443e410 0x55f284442f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:59.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.561+0000 7fc8c53ff740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f284443580 0x55f284445a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:59.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.561+0000 7fc8c53ff740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2843ac380 con 0x55f28443da20 2024-01-31T05:11:59.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.561+0000 7fc8c53ff740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2843a9a70 con 0x55f28443e410 2024-01-31T05:11:59.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.561+0000 7fc8c53ff740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2843a5360 con 0x55f284443580 2024-01-31T05:11:59.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.561+0000 7fc8bbfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f28443da20 0x55f28443de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:59.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.561+0000 7fc8c0bd4640 1 --2- 172.21.15.99:0/2095736665 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc8a40a1370 0x7fc8a40a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:59.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.561+0000 7fc8bbfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f28443da20 0x55f28443de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48334/0 (socket says 172.21.15.99:48334) 2024-01-31T05:11:59.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.561+0000 7fc8bbfff640 1 -- 172.21.15.99:0/3773044659 learned_addr learned my addr 172.21.15.99:0/3773044659 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:59.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.561+0000 7fc8b97fa640 1 -- 172.21.15.99:0/2095736665 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fc8b00cc9e0 con 0x7fc8bc104110 2024-01-31T05:11:59.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.561+0000 7fc8c0bd4640 1 --2- 172.21.15.99:0/3773044659 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f284443580 0x55f284445a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:59.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.561+0000 7fc8bb7fe640 1 --2- 172.21.15.99:0/3773044659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f28443e410 0x55f284442f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:59.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.562+0000 7fc8bbfff640 1 -- 172.21.15.99:0/3773044659 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f284443580 msgr2=0x55f284445a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:59.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.562+0000 7fc8bbfff640 1 --2- 172.21.15.99:0/3773044659 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f284443580 0x55f284445a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.562+0000 7fc8bbfff640 1 -- 172.21.15.99:0/3773044659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f28443e410 msgr2=0x55f284442f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:59.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.562+0000 7fc8bbfff640 1 --2- 172.21.15.99:0/3773044659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f28443e410 0x55f284442f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.562+0000 7fc8bbfff640 1 -- 172.21.15.99:0/3773044659 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2843677e0 con 0x55f28443da20 2024-01-31T05:11:59.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.562+0000 7fc8bb7fe640 1 --2- 172.21.15.99:0/3773044659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f28443e410 0x55f284442f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:11:59.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.562+0000 7fc8c0bd4640 1 --2- 172.21.15.99:0/2095736665 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc8a40a1370 0x7fc8a40a3830 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4005c40 tx=0x7fc8b4012af0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:59.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.562+0000 7fc8bbfff640 1 --2- 172.21.15.99:0/3773044659 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f28443da20 0x55f28443de40 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac02c6b0 tx=0x7fc8ac004f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=579bb52680b67117 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:59.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.562+0000 7fc8a27fc640 1 -- 172.21.15.99:0/3773044659 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac02c980 con 0x55f28443da20 2024-01-31T05:11:59.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.562+0000 7fc8a27fc640 1 -- 172.21.15.99:0/3773044659 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc8ac02cae0 con 0x55f28443da20 2024-01-31T05:11:59.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.562+0000 7fc8a27fc640 1 -- 172.21.15.99:0/3773044659 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac005290 con 0x55f28443da20 2024-01-31T05:11:59.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.562+0000 7fc8c53ff740 1 -- 172.21.15.99:0/3773044659 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f28443da20 msgr2=0x55f28443de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:59.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.562+0000 7fc8c53ff740 1 --2- 172.21.15.99:0/3773044659 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f28443da20 0x55f28443de40 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac02c6b0 tx=0x7fc8ac004f00 comp rx=0 tx=0).stop 2024-01-31T05:11:59.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.563+0000 7fc8c53ff740 1 -- 172.21.15.99:0/3773044659 shutdown_connections 2024-01-31T05:11:59.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.563+0000 7fc8c53ff740 1 --2- 172.21.15.99:0/3773044659 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f284443580 0x55f284445a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.563+0000 7fc8c53ff740 1 --2- 172.21.15.99:0/3773044659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f28443e410 0x55f284442f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.563+0000 7fc8c53ff740 1 --2- 172.21.15.99:0/3773044659 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f28443da20 0x55f28443de40 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.563+0000 7fc8c53ff740 1 -- 172.21.15.99:0/3773044659 >> 172.21.15.99:0/3773044659 conn(0x55f284438f90 msgr2=0x55f284439390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:59.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.563+0000 7fc8c53ff740 1 -- 172.21.15.99:0/3773044659 shutdown_connections 2024-01-31T05:11:59.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.563+0000 7fc8c53ff740 1 -- 172.21.15.99:0/3773044659 wait complete. 2024-01-31T05:11:59.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.563+0000 7fc8c53ff740 1 -- start start 2024-01-31T05:11:59.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.563+0000 7fc8c53ff740 1 Processor -- start 2024-01-31T05:11:59.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.563+0000 7fc8c53ff740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f28443da20 0x55f284447b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:59.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.563+0000 7fc8c53ff740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f28443e410 0x55f2844480b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:59.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.563+0000 7fc8c53ff740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f284443580 0x55f28444f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:59.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.563+0000 7fc8c53ff740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f28435e750 con 0x55f28443e410 2024-01-31T05:11:59.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.563+0000 7fc8c53ff740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f28435e3f0 con 0x55f28443da20 2024-01-31T05:11:59.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.563+0000 7fc8c53ff740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2843233f0 con 0x55f284443580 2024-01-31T05:11:59.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.563+0000 7fc8c53ff740 10 client.0 _ll_register_callbacks cb 0x55f284360b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:11:59.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.563+0000 7fc8bb7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f28443e410 0x55f2844480b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:59.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.563+0000 7fc8bb7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f28443e410 0x55f2844480b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48344/0 (socket says 172.21.15.99:48344) 2024-01-31T05:11:59.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.563+0000 7fc8bb7fe640 1 -- 172.21.15.99:0/4049863058 learned_addr learned my addr 172.21.15.99:0/4049863058 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:59.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.564+0000 7fc8c0bd4640 1 --2- 172.21.15.99:0/4049863058 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f284443580 0x55f28444f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:59.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.564+0000 7fc8bb7fe640 1 -- 172.21.15.99:0/4049863058 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f284443580 msgr2=0x55f28444f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:59.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.564+0000 7fc8bb7fe640 1 --2- 172.21.15.99:0/4049863058 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f284443580 0x55f28444f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.564+0000 7fc8bb7fe640 1 -- 172.21.15.99:0/4049863058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f28443da20 msgr2=0x55f284447b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:59.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.564+0000 7fc8bb7fe640 1 --2- 172.21.15.99:0/4049863058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f28443da20 0x55f284447b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.564+0000 7fc8bb7fe640 1 -- 172.21.15.99:0/4049863058 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8bc109a10 con 0x55f28443e410 2024-01-31T05:11:59.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.564+0000 7fc8bb7fe640 1 --2- 172.21.15.99:0/4049863058 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f28443e410 0x55f2844480b0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fc8b00ca4e0 tx=0x7fc8b009a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaa8dc3dbd85de85 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:59.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.564+0000 7fc89b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:11:59.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.564+0000 7fc89b7fe640 1 -- 172.21.15.99:0/4049863058 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b00a1e70 con 0x55f28443e410 2024-01-31T05:11:59.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.564+0000 7fc89b7fe640 1 -- 172.21.15.99:0/4049863058 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fc8b00c3320 con 0x55f28443e410 2024-01-31T05:11:59.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.564+0000 7fc8c53ff740 1 -- 172.21.15.99:0/4049863058 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f28437a210 con 0x55f28443e410 2024-01-31T05:11:59.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.564+0000 7fc89b7fe640 1 -- 172.21.15.99:0/4049863058 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8b00c3500 con 0x55f28443e410 2024-01-31T05:11:59.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.564+0000 7fc8c53ff740 10 client.15657 fetch_fsmap learned FSMap version 27 2024-01-31T05:11:59.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.564+0000 7fc8c53ff740 1 -- 172.21.15.99:0/4049863058 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55f2843a39e0 con 0x55f28443e410 2024-01-31T05:11:59.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.564+0000 7fc89b7fe640 1 -- 172.21.15.99:0/4049863058 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f28437a210 con 0x55f28443e410 2024-01-31T05:11:59.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.564+0000 7fc89b7fe640 1 -- 172.21.15.99:0/4049863058 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc8b00b2080 con 0x55f28443e410 2024-01-31T05:11:59.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.564+0000 7fc8c53ff740 10 client.15657 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:11:59.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.564+0000 7fc8c53ff740 10 client.15657 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-01-31T05:11:59.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.564+0000 7fc8c53ff740 20 client.15657 populate_metadata read hostname 'smithi099' 2024-01-31T05:11:59.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.564+0000 7fc8c53ff740 1 --2- 172.21.15.99:0/4049863058 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55f284453d20 0x55f284456130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:59.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.565+0000 7fc8c53ff740 4 client.15657 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:11:59.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.565+0000 7fc8c53ff740 1 -- 172.21.15.99:0/4049863058 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f284377b20 con 0x55f284453d20 2024-01-31T05:11:59.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.565+0000 7fc8bbfff640 1 --2- 172.21.15.99:0/4049863058 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55f284453d20 0x55f284456130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:59.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.565+0000 7fc89b7fe640 10 client.15657 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:11:59.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.565+0000 7fc8bbfff640 1 --2- 172.21.15.99:0/4049863058 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55f284453d20 0x55f284456130 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12d9c41d624e1e04 server_cookie=448af7806cd357e7 in_seq=0 out_seq=0 2024-01-31T05:11:59.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.566+0000 7fc89b7fe640 1 -- 172.21.15.99:0/4049863058 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f284377b20 con 0x55f284453d20 2024-01-31T05:11:59.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.566+0000 7fc89b7fe640 10 client.15657 handle_command_reply: tid=0 2024-01-31T05:11:59.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.566+0000 7fc8c53ff740 1 client.15657 shutdown 2024-01-31T05:11:59.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.567+0000 7fc8c53ff740 1 -- 172.21.15.99:0/4049863058 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f28443e410 msgr2=0x55f2844480b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:59.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.567+0000 7fc8c53ff740 1 --2- 172.21.15.99:0/4049863058 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f28443e410 0x55f2844480b0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fc8b00ca4e0 tx=0x7fc8b009a1e0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.567+0000 7fc8c53ff740 1 -- 172.21.15.99:0/4049863058 shutdown_connections 2024-01-31T05:11:59.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.567+0000 7fc8c53ff740 1 --2- 172.21.15.99:0/4049863058 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f284443580 0x55f28444f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.567+0000 7fc8c53ff740 1 --2- 172.21.15.99:0/4049863058 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f28443e410 0x55f2844480b0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.567+0000 7fc8c53ff740 1 --2- 172.21.15.99:0/4049863058 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55f284453d20 0x55f284456130 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.567+0000 7fc8c53ff740 1 --2- 172.21.15.99:0/4049863058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f28443da20 0x55f284447b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.567+0000 7fc89b7fe640 0 client.15657 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:11:59.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.567+0000 7fc8c53ff740 1 -- 172.21.15.99:0/4049863058 >> 172.21.15.99:0/4049863058 conn(0x55f284438f90 msgr2=0x55f284438210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:59.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.567+0000 7fc8c53ff740 1 -- 172.21.15.99:0/4049863058 shutdown_connections 2024-01-31T05:11:59.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.567+0000 7fc8c53ff740 1 -- 172.21.15.99:0/4049863058 wait complete. 2024-01-31T05:11:59.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.567+0000 7fc8c53ff740 20 client.15657 trim_cache size 0 max 16384 2024-01-31T05:11:59.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.581+0000 7fc8c53ff740 1 Processor -- start 2024-01-31T05:11:59.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.582+0000 7fc8c53ff740 1 -- start start 2024-01-31T05:11:59.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.582+0000 7fc8c53ff740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f28443da20 0x55f28445aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:59.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.582+0000 7fc8c53ff740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f28443e410 0x55f284447b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:59.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.582+0000 7fc8c53ff740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f284443580 0x55f2844480b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:59.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.582+0000 7fc8c53ff740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f28443eb00 con 0x55f284443580 2024-01-31T05:11:59.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.582+0000 7fc8c53ff740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f284438e00 con 0x55f28443da20 2024-01-31T05:11:59.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.582+0000 7fc8c53ff740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f284439d70 con 0x55f28443e410 2024-01-31T05:11:59.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.582+0000 7fc8c0bd4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f284443580 0x55f2844480b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:59.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.582+0000 7fc8c0bd4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f284443580 0x55f2844480b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48354/0 (socket says 172.21.15.99:48354) 2024-01-31T05:11:59.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.582+0000 7fc8c0bd4640 1 -- 172.21.15.99:0/2640973936 learned_addr learned my addr 172.21.15.99:0/2640973936 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:59.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.582+0000 7fc8bb7fe640 1 --2- 172.21.15.99:0/2640973936 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f28443e410 0x55f284447b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:59.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.582+0000 7fc8c0bd4640 1 -- 172.21.15.99:0/2640973936 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f28443e410 msgr2=0x55f284447b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:59.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.582+0000 7fc8c0bd4640 1 --2- 172.21.15.99:0/2640973936 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f28443e410 0x55f284447b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.582+0000 7fc8c0bd4640 1 -- 172.21.15.99:0/2640973936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f28443da20 msgr2=0x55f28445aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:59.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.582+0000 7fc8c0bd4640 1 --2- 172.21.15.99:0/2640973936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f28443da20 0x55f28445aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.582+0000 7fc8c0bd4640 1 -- 172.21.15.99:0/2640973936 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2843404f0 con 0x55f284443580 2024-01-31T05:11:59.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.582+0000 7fc8bb7fe640 1 --2- 172.21.15.99:0/2640973936 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f28443e410 0x55f284447b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:11:59.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.582+0000 7fc8c0bd4640 1 --2- 172.21.15.99:0/2640973936 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f284443580 0x55f2844480b0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4003bb0 tx=0x7fc8b401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=911078db5c9da24b server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:59.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.582+0000 7fc8a1ffb640 1 -- 172.21.15.99:0/2640973936 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b4004040 con 0x55f284443580 2024-01-31T05:11:59.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.582+0000 7fc8a1ffb640 1 -- 172.21.15.99:0/2640973936 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc8b4004660 con 0x55f284443580 2024-01-31T05:11:59.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.582+0000 7fc8a1ffb640 1 -- 172.21.15.99:0/2640973936 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b401fd60 con 0x55f284443580 2024-01-31T05:11:59.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.583+0000 7fc8c53ff740 1 -- 172.21.15.99:0/2640973936 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f284443580 msgr2=0x55f2844480b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:59.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.583+0000 7fc8c53ff740 1 --2- 172.21.15.99:0/2640973936 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f284443580 0x55f2844480b0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4003bb0 tx=0x7fc8b401e000 comp rx=0 tx=0).stop 2024-01-31T05:11:59.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.583+0000 7fc8c53ff740 1 -- 172.21.15.99:0/2640973936 shutdown_connections 2024-01-31T05:11:59.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.583+0000 7fc8c53ff740 1 --2- 172.21.15.99:0/2640973936 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f284443580 0x55f2844480b0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.583+0000 7fc8c53ff740 1 --2- 172.21.15.99:0/2640973936 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f28443e410 0x55f284447b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.583+0000 7fc8c53ff740 1 --2- 172.21.15.99:0/2640973936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f28443da20 0x55f28445aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.583+0000 7fc8c53ff740 1 -- 172.21.15.99:0/2640973936 >> 172.21.15.99:0/2640973936 conn(0x55f284438f90 msgr2=0x55f284447190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:59.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.583+0000 7fc8c53ff740 1 -- 172.21.15.99:0/2640973936 shutdown_connections 2024-01-31T05:11:59.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.583+0000 7fc8c53ff740 1 -- 172.21.15.99:0/2640973936 wait complete. 2024-01-31T05:11:59.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.583+0000 7fc8c53ff740 1 -- start start 2024-01-31T05:11:59.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.584+0000 7fc8c53ff740 1 Processor -- start 2024-01-31T05:11:59.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.584+0000 7fc8c53ff740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f28443da20 0x55f2844a69c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:59.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.584+0000 7fc8c53ff740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f28443e410 0x55f2844a6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:59.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.584+0000 7fc8c53ff740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f284443580 0x55f2844adea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:59.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.584+0000 7fc8c53ff740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2844ae3e0 con 0x55f28443e410 2024-01-31T05:11:59.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.584+0000 7fc8c53ff740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2844ae520 con 0x55f28443da20 2024-01-31T05:11:59.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.584+0000 7fc8c53ff740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2844ae690 con 0x55f284443580 2024-01-31T05:11:59.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.584+0000 7fc8c53ff740 10 client.0 _ll_register_callbacks cb 0x7fc8b0010c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:11:59.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.584+0000 7fc8bb7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f28443e410 0x55f2844a6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:59.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.584+0000 7fc8bb7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f28443e410 0x55f2844a6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48362/0 (socket says 172.21.15.99:48362) 2024-01-31T05:11:59.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.584+0000 7fc8bb7fe640 1 -- 172.21.15.99:0/3715747812 learned_addr learned my addr 172.21.15.99:0/3715747812 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:11:59.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.584+0000 7fc8c0bd4640 1 --2- 172.21.15.99:0/3715747812 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f284443580 0x55f2844adea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:59.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.584+0000 7fc8bbfff640 1 --2- 172.21.15.99:0/3715747812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f28443da20 0x55f2844a69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:59.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.584+0000 7fc8bb7fe640 1 -- 172.21.15.99:0/3715747812 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f284443580 msgr2=0x55f2844adea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:59.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.584+0000 7fc8bb7fe640 1 --2- 172.21.15.99:0/3715747812 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f284443580 0x55f2844adea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.584+0000 7fc8bb7fe640 1 -- 172.21.15.99:0/3715747812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f28443da20 msgr2=0x55f2844a69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:11:59.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.584+0000 7fc8bb7fe640 1 --2- 172.21.15.99:0/3715747812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f28443da20 0x55f2844a69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.584+0000 7fc8bb7fe640 1 -- 172.21.15.99:0/3715747812 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8b4003970 con 0x55f28443e410 2024-01-31T05:11:59.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.584+0000 7fc8bbfff640 1 --2- 172.21.15.99:0/3715747812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f28443da20 0x55f2844a69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:11:59.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.584+0000 7fc8bb7fe640 1 --2- 172.21.15.99:0/3715747812 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f28443e410 0x55f2844a6f00 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0009610 tx=0x7fc8b0095ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ebb29e4e88b0ed7 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:11:59.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.584+0000 7fc89b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:11:59.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.584+0000 7fc89b7fe640 1 -- 172.21.15.99:0/3715747812 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b0014020 con 0x55f28443e410 2024-01-31T05:11:59.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.584+0000 7fc89b7fe640 1 -- 172.21.15.99:0/3715747812 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fc8b00b92d0 con 0x55f28443e410 2024-01-31T05:11:59.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.584+0000 7fc8c53ff740 1 -- 172.21.15.99:0/3715747812 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f284446c90 con 0x55f28443e410 2024-01-31T05:11:59.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.584+0000 7fc89b7fe640 1 -- 172.21.15.99:0/3715747812 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8b00998b0 con 0x55f28443e410 2024-01-31T05:11:59.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.585+0000 7fc8c53ff740 10 client.15663 fetch_fsmap learned FSMap version 27 2024-01-31T05:11:59.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.585+0000 7fc8c53ff740 1 -- 172.21.15.99:0/3715747812 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55f284366040 con 0x55f28443e410 2024-01-31T05:11:59.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.585+0000 7fc89b7fe640 1 -- 172.21.15.99:0/3715747812 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f284446c90 con 0x55f28443e410 2024-01-31T05:11:59.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.585+0000 7fc89b7fe640 1 -- 172.21.15.99:0/3715747812 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc8b0098a40 con 0x55f28443e410 2024-01-31T05:11:59.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.585+0000 7fc8c53ff740 10 client.15663 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:11:59.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.585+0000 7fc8c53ff740 10 client.15663 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-01-31T05:11:59.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.585+0000 7fc8c53ff740 20 client.15663 populate_metadata read hostname 'smithi099' 2024-01-31T05:11:59.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.585+0000 7fc8c53ff740 1 --2- 172.21.15.99:0/3715747812 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55f2844afde0 0x55f2844b2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:11:59.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.585+0000 7fc8c53ff740 4 client.15663 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-01-31T05:11:59.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.585+0000 7fc8c53ff740 1 -- 172.21.15.99:0/3715747812 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f2843ccbd0 con 0x55f2844afde0 2024-01-31T05:11:59.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.585+0000 7fc8bbfff640 1 --2- 172.21.15.99:0/3715747812 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55f2844afde0 0x55f2844b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:11:59.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.585+0000 7fc89b7fe640 10 client.15663 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:11:59.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.585+0000 7fc8bbfff640 1 --2- 172.21.15.99:0/3715747812 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55f2844afde0 0x55f2844b2200 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca0bc548ed5ec1d7 server_cookie=59cfba0dc24254c5 in_seq=0 out_seq=0 2024-01-31T05:11:59.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.586+0000 7fc89b7fe640 1 -- 172.21.15.99:0/3715747812 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55f2843ccbd0 con 0x55f2844afde0 2024-01-31T05:11:59.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.586+0000 7fc89b7fe640 10 client.15663 handle_command_reply: tid=0 2024-01-31T05:11:59.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.586+0000 7fc8c53ff740 1 client.15663 shutdown 2024-01-31T05:11:59.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.586+0000 7fc8c53ff740 1 -- 172.21.15.99:0/3715747812 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f28443e410 msgr2=0x55f2844a6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:59.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.586+0000 7fc8c53ff740 1 --2- 172.21.15.99:0/3715747812 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f28443e410 0x55f2844a6f00 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0009610 tx=0x7fc8b0095ac0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.586+0000 7fc8c53ff740 1 -- 172.21.15.99:0/3715747812 shutdown_connections 2024-01-31T05:11:59.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.586+0000 7fc8c53ff740 1 --2- 172.21.15.99:0/3715747812 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f284443580 0x55f2844adea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.586+0000 7fc8c53ff740 1 --2- 172.21.15.99:0/3715747812 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f28443e410 0x55f2844a6f00 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.586+0000 7fc8c53ff740 1 --2- 172.21.15.99:0/3715747812 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55f2844afde0 0x55f2844b2200 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.586+0000 7fc8c53ff740 1 --2- 172.21.15.99:0/3715747812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f28443da20 0x55f2844a69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.586+0000 7fc89b7fe640 0 client.15663 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:11:59.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.586+0000 7fc8c53ff740 1 -- 172.21.15.99:0/3715747812 >> 172.21.15.99:0/3715747812 conn(0x55f284438f90 msgr2=0x55f28443f890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:59.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.586+0000 7fc8c53ff740 1 -- 172.21.15.99:0/3715747812 shutdown_connections 2024-01-31T05:11:59.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.586+0000 7fc8c53ff740 1 -- 172.21.15.99:0/3715747812 wait complete. 2024-01-31T05:11:59.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.586+0000 7fc8c53ff740 20 client.15663 trim_cache size 0 max 16384 2024-01-31T05:11:59.594 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-01-31T05:11:59.594 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "IDLE (waiting for more scrubs)", 2024-01-31T05:11:59.594 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": { 2024-01-31T05:11:59.594 INFO:teuthology.orchestra.run.smithi099.stdout: "9fd30a2f-265e-4bce-84ca-113c5fe747dd": { 2024-01-31T05:11:59.594 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-01-31T05:11:59.594 INFO:teuthology.orchestra.run.smithi099.stdout: "tag": "9fd30a2f-265e-4bce-84ca-113c5fe747dd", 2024-01-31T05:11:59.594 INFO:teuthology.orchestra.run.smithi099.stdout: "options": "recursive,force" 2024-01-31T05:11:59.595 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:11:59.595 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:11:59.595 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-01-31T05:11:59.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.586+0000 7fc8c2637640 1 -- 172.21.15.99:0/2095736665 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc8a40a1370 msgr2=0x7fc8a40a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:59.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.586+0000 7fc8c2637640 1 --2- 172.21.15.99:0/2095736665 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc8a40a1370 0x7fc8a40a3830 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4005c40 tx=0x7fc8b4012af0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.586+0000 7fc8c2637640 1 -- 172.21.15.99:0/2095736665 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8bc104110 msgr2=0x7fc8bc197280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:11:59.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.586+0000 7fc8c2637640 1 --2- 172.21.15.99:0/2095736665 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8bc104110 0x7fc8bc197280 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc8b000d770 tx=0x7fc8b000dc30 comp rx=0 tx=0).stop 2024-01-31T05:11:59.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.586+0000 7fc8c2637640 1 -- 172.21.15.99:0/2095736665 shutdown_connections 2024-01-31T05:11:59.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.587+0000 7fc8c2637640 1 --2- 172.21.15.99:0/2095736665 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc8a40a1370 0x7fc8a40a3830 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.587+0000 7fc8c2637640 1 --2- 172.21.15.99:0/2095736665 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8bc106a40 0x7fc8bc19e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.587+0000 7fc8c2637640 1 --2- 172.21.15.99:0/2095736665 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8bc104110 0x7fc8bc197280 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.587+0000 7fc8c2637640 1 --2- 172.21.15.99:0/2095736665 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8bc1017e0 0x7fc8bc196d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:11:59.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.587+0000 7fc8c2637640 1 -- 172.21.15.99:0/2095736665 >> 172.21.15.99:0/2095736665 conn(0x7fc8bc0fb190 msgr2=0x7fc8bc102360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:11:59.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.587+0000 7fc8c2637640 1 -- 172.21.15.99:0/2095736665 shutdown_connections 2024-01-31T05:11:59.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:11:59.587+0000 7fc8c2637640 1 -- 172.21.15.99:0/2095736665 wait complete. 2024-01-31T05:11:59.597 INFO:tasks.cephfs.filesystem:scrub status for tag:9fd30a2f-265e-4bce-84ca-113c5fe747dd - {'path': '/', 'tag': '9fd30a2f-265e-4bce-84ca-113c5fe747dd', 'options': 'recursive,force'} 2024-01-31T05:12:00.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:11:59 smithi099 ceph-mon[31615]: pgmap v367: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2024-01-31T05:12:00.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:11:59 smithi181 ceph-mon[36434]: pgmap v367: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2024-01-31T05:12:00.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:11:59 smithi179 ceph-mon[35652]: pgmap v367: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2024-01-31T05:12:01.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:00 smithi099 ceph-mon[31615]: scrub queued for path: / 2024-01-31T05:12:01.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:00 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:12:01.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:00 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:12:01.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:00 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:12:01.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:00 smithi181 ceph-mon[36434]: scrub queued for path: / 2024-01-31T05:12:01.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:00 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:12:01.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:00 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:12:01.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:00 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:12:01.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:00 smithi179 ceph-mon[35652]: scrub queued for path: / 2024-01-31T05:12:01.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:00 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:12:01.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:00 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:12:01.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:00 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:12:01.972 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:01 smithi181 ceph-mon[36434]: pgmap v368: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-01-31T05:12:01.973 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:01 smithi181 ceph-mon[36434]: scrub summary: idle 2024-01-31T05:12:02.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:01 smithi099 ceph-mon[31615]: pgmap v368: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-01-31T05:12:02.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:01 smithi099 ceph-mon[31615]: scrub summary: idle 2024-01-31T05:12:02.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:01 smithi179 ceph-mon[35652]: pgmap v368: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-01-31T05:12:02.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:01 smithi179 ceph-mon[35652]: scrub summary: idle 2024-01-31T05:12:03.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:03 smithi099 ceph-mon[31615]: pgmap v369: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 341 B/s wr, 11 op/s 2024-01-31T05:12:03.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:03 smithi181 ceph-mon[36434]: pgmap v369: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 341 B/s wr, 11 op/s 2024-01-31T05:12:03.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:03 smithi179 ceph-mon[35652]: pgmap v369: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 341 B/s wr, 11 op/s 2024-01-31T05:12:06.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:05 smithi099 ceph-mon[31615]: pgmap v370: 97 pgs: 97 active+clean; 668 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-01-31T05:12:06.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:05 smithi181 ceph-mon[36434]: pgmap v370: 97 pgs: 97 active+clean; 668 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-01-31T05:12:06.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:05 smithi179 ceph-mon[35652]: pgmap v370: 97 pgs: 97 active+clean; 668 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-01-31T05:12:06.156 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.140+0000 7faf61389640 1 -- 172.21.15.99:0/2179184038 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf5c1069f0 msgr2=0x7faf5c108e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:06.156 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.141+0000 7faf61389640 1 --2- 172.21.15.99:0/2179184038 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf5c1069f0 0x7faf5c108e40 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7faf54009ca0 tx=0x7faf5402c0f0 comp rx=0 tx=0).stop 2024-01-31T05:12:06.156 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.141+0000 7faf61389640 1 -- 172.21.15.99:0/2179184038 shutdown_connections 2024-01-31T05:12:06.156 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.141+0000 7faf61389640 1 --2- 172.21.15.99:0/2179184038 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf5c1069f0 0x7faf5c108e40 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:06.156 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.141+0000 7faf61389640 1 --2- 172.21.15.99:0/2179184038 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf5c1040c0 0x7faf5c1064b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:06.156 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.141+0000 7faf61389640 1 --2- 172.21.15.99:0/2179184038 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf5c101790 0x7faf5c103b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:06.157 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.141+0000 7faf61389640 1 -- 172.21.15.99:0/2179184038 >> 172.21.15.99:0/2179184038 conn(0x7faf5c0fb180 msgr2=0x7faf5c0fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:06.157 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.141+0000 7faf61389640 1 -- 172.21.15.99:0/2179184038 shutdown_connections 2024-01-31T05:12:06.157 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.141+0000 7faf61389640 1 -- 172.21.15.99:0/2179184038 wait complete. 2024-01-31T05:12:06.157 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.141+0000 7faf61389640 1 Processor -- start 2024-01-31T05:12:06.157 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.141+0000 7faf61389640 1 -- start start 2024-01-31T05:12:06.157 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.141+0000 7faf61389640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf5c101790 0x7faf5c101100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:06.157 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.141+0000 7faf61389640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf5c1040c0 0x7faf5c0ff740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:06.158 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.141+0000 7faf61389640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf5c1069f0 0x7faf5c0ffc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:06.158 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.141+0000 7faf61389640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c1003e0 con 0x7faf5c1040c0 2024-01-31T05:12:06.158 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.141+0000 7faf61389640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c100550 con 0x7faf5c1069f0 2024-01-31T05:12:06.158 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.141+0000 7faf61389640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c1a0bc0 con 0x7faf5c101790 2024-01-31T05:12:06.158 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.142+0000 7faf5a7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf5c1040c0 0x7faf5c0ff740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:06.158 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.142+0000 7faf5a7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf5c1040c0 0x7faf5c0ff740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41488/0 (socket says 172.21.15.99:41488) 2024-01-31T05:12:06.159 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.142+0000 7faf5a7fc640 1 -- 172.21.15.99:0/1031799765 learned_addr learned my addr 172.21.15.99:0/1031799765 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:06.159 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.142+0000 7faf5affd640 1 --2- 172.21.15.99:0/1031799765 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf5c101790 0x7faf5c101100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:06.159 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.142+0000 7faf5b7fe640 1 --2- 172.21.15.99:0/1031799765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf5c1069f0 0x7faf5c0ffc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:06.159 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.142+0000 7faf5a7fc640 1 -- 172.21.15.99:0/1031799765 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf5c101790 msgr2=0x7faf5c101100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:06.159 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.142+0000 7faf5a7fc640 1 --2- 172.21.15.99:0/1031799765 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf5c101790 0x7faf5c101100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:06.159 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.142+0000 7faf5a7fc640 1 -- 172.21.15.99:0/1031799765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf5c1069f0 msgr2=0x7faf5c0ffc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:06.159 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.142+0000 7faf5a7fc640 1 --2- 172.21.15.99:0/1031799765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf5c1069f0 0x7faf5c0ffc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:06.159 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.142+0000 7faf5a7fc640 1 -- 172.21.15.99:0/1031799765 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf54009900 con 0x7faf5c1040c0 2024-01-31T05:12:06.160 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.142+0000 7faf5a7fc640 1 --2- 172.21.15.99:0/1031799765 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf5c1040c0 0x7faf5c0ff740 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7faf5000d7a0 tx=0x7faf5000dba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:06.160 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.142+0000 7faf43fff640 1 -- 172.21.15.99:0/1031799765 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf50009a20 con 0x7faf5c1040c0 2024-01-31T05:12:06.160 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.142+0000 7faf43fff640 1 -- 172.21.15.99:0/1031799765 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faf50009b80 con 0x7faf5c1040c0 2024-01-31T05:12:06.160 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.142+0000 7faf61389640 1 -- 172.21.15.99:0/1031799765 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf5c1a0e70 con 0x7faf5c1040c0 2024-01-31T05:12:06.160 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.142+0000 7faf43fff640 1 -- 172.21.15.99:0/1031799765 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5000f620 con 0x7faf5c1040c0 2024-01-31T05:12:06.160 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.142+0000 7faf61389640 1 -- 172.21.15.99:0/1031799765 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf5c1a12f0 con 0x7faf5c1040c0 2024-01-31T05:12:06.161 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.145+0000 7faf43fff640 1 -- 172.21.15.99:0/1031799765 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 135946+0+0 (secure 0 0 0) 0x7faf50010460 con 0x7faf5c1040c0 2024-01-31T05:12:06.161 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.145+0000 7faf6421f740 1 Processor -- start 2024-01-31T05:12:06.161 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.145+0000 7faf43fff640 1 --2- 172.21.15.99:0/1031799765 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7faf440a1420 0x7faf440a38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:06.161 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.145+0000 7faf6421f740 1 -- start start 2024-01-31T05:12:06.161 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.145+0000 7faf43fff640 1 -- 172.21.15.99:0/1031799765 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7faf500cc820 con 0x7faf5c1040c0 2024-01-31T05:12:06.161 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.145+0000 7faf5b7fe640 1 --2- 172.21.15.99:0/1031799765 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7faf440a1420 0x7faf440a38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:06.161 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.145+0000 7faf6421f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559363dae270 0x559363dae690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:06.162 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.145+0000 7faf6421f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559363daec60 0x559363db3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:06.162 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.145+0000 7faf6421f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559363db3dd0 0x559363db6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:06.162 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.145+0000 7faf6421f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x559363d1e040 con 0x559363dae270 2024-01-31T05:12:06.162 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.145+0000 7faf6421f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x559363d1b730 con 0x559363daec60 2024-01-31T05:12:06.162 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.145+0000 7faf6421f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x559363d17020 con 0x559363db3dd0 2024-01-31T05:12:06.162 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.146+0000 7faf5affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559363dae270 0x559363dae690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:06.163 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.146+0000 7faf5affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559363dae270 0x559363dae690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41500/0 (socket says 172.21.15.99:41500) 2024-01-31T05:12:06.163 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.146+0000 7faf5affd640 1 -- 172.21.15.99:0/3102791225 learned_addr learned my addr 172.21.15.99:0/3102791225 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:06.163 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.146+0000 7faf5a7fc640 1 --2- 172.21.15.99:0/3102791225 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559363daec60 0x559363db3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:06.163 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.146+0000 7faf5b7fe640 1 --2- 172.21.15.99:0/3102791225 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559363db3dd0 0x559363db6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:06.163 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.146+0000 7faf5affd640 1 -- 172.21.15.99:0/3102791225 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559363db3dd0 msgr2=0x559363db6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:06.163 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.146+0000 7faf5affd640 1 --2- 172.21.15.99:0/3102791225 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559363db3dd0 0x559363db6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:06.163 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.146+0000 7faf5affd640 1 -- 172.21.15.99:0/3102791225 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559363daec60 msgr2=0x559363db3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:06.163 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.146+0000 7faf5affd640 1 --2- 172.21.15.99:0/3102791225 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559363daec60 0x559363db3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.146+0000 7faf5affd640 1 -- 172.21.15.99:0/3102791225 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559363d0ee40 con 0x559363dae270 2024-01-31T05:12:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.146+0000 7faf5a7fc640 1 --2- 172.21.15.99:0/3102791225 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559363daec60 0x559363db3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:12:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.146+0000 7faf5b7fe640 1 --2- 172.21.15.99:0/3102791225 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559363db3dd0 0x559363db6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:12:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.146+0000 7faf5b7fe640 1 --2- 172.21.15.99:0/1031799765 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7faf440a1420 0x7faf440a38e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7faf54005e30 tx=0x7faf54032460 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.146+0000 7faf5affd640 1 --2- 172.21.15.99:0/3102791225 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559363dae270 0x559363dae690 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7faf4c00ad00 tx=0x7faf4c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4408349fdd4e20fc server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.146+0000 7faf417fa640 1 -- 172.21.15.99:0/3102791225 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c00a800 con 0x559363dae270 2024-01-31T05:12:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.146+0000 7faf417fa640 1 -- 172.21.15.99:0/3102791225 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faf4c018b00 con 0x559363dae270 2024-01-31T05:12:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.146+0000 7faf417fa640 1 -- 172.21.15.99:0/3102791225 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c010c20 con 0x559363dae270 2024-01-31T05:12:06.165 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.147+0000 7faf6421f740 1 -- 172.21.15.99:0/3102791225 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559363dae270 msgr2=0x559363dae690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:06.165 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.147+0000 7faf6421f740 1 --2- 172.21.15.99:0/3102791225 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559363dae270 0x559363dae690 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7faf4c00ad00 tx=0x7faf4c00f790 comp rx=0 tx=0).stop 2024-01-31T05:12:06.165 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.147+0000 7faf6421f740 1 -- 172.21.15.99:0/3102791225 shutdown_connections 2024-01-31T05:12:06.165 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.147+0000 7faf6421f740 1 --2- 172.21.15.99:0/3102791225 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559363db3dd0 0x559363db6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:06.165 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.147+0000 7faf6421f740 1 --2- 172.21.15.99:0/3102791225 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559363daec60 0x559363db3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:06.165 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.147+0000 7faf6421f740 1 --2- 172.21.15.99:0/3102791225 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559363dae270 0x559363dae690 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:06.165 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.147+0000 7faf6421f740 1 -- 172.21.15.99:0/3102791225 >> 172.21.15.99:0/3102791225 conn(0x559363da97e0 msgr2=0x559363da9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:06.165 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.147+0000 7faf6421f740 1 -- 172.21.15.99:0/3102791225 shutdown_connections 2024-01-31T05:12:06.165 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.147+0000 7faf6421f740 1 -- 172.21.15.99:0/3102791225 wait complete. 2024-01-31T05:12:06.166 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.147+0000 7faf6421f740 1 -- start start 2024-01-31T05:12:06.166 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.148+0000 7faf6421f740 1 Processor -- start 2024-01-31T05:12:06.166 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.148+0000 7faf6421f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559363dae270 0x559363db8180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:06.166 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.148+0000 7faf6421f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559363daec60 0x559363db86c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:06.166 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.148+0000 7faf6421f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559363db3dd0 0x559363dbf700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:06.166 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.148+0000 7faf6421f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x559363cd01b0 con 0x559363daec60 2024-01-31T05:12:06.166 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.148+0000 7faf6421f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x559363ccfe50 con 0x559363dae270 2024-01-31T05:12:06.166 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.148+0000 7faf6421f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x559363c95090 con 0x559363db3dd0 2024-01-31T05:12:06.167 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.148+0000 7faf5a7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559363daec60 0x559363db86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:06.167 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.148+0000 7faf6421f740 10 client.0 _ll_register_callbacks cb 0x559363cbaa90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:12:06.167 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.148+0000 7faf5a7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559363daec60 0x559363db86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41502/0 (socket says 172.21.15.99:41502) 2024-01-31T05:12:06.167 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.148+0000 7faf5a7fc640 1 -- 172.21.15.99:0/1313548441 learned_addr learned my addr 172.21.15.99:0/1313548441 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:06.167 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.148+0000 7faf5affd640 1 --2- 172.21.15.99:0/1313548441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559363dae270 0x559363db8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:06.167 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.148+0000 7faf5a7fc640 1 -- 172.21.15.99:0/1313548441 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559363db3dd0 msgr2=0x559363dbf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:06.167 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.148+0000 7faf5a7fc640 1 --2- 172.21.15.99:0/1313548441 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559363db3dd0 0x559363dbf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:06.168 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.148+0000 7faf5a7fc640 1 -- 172.21.15.99:0/1313548441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559363dae270 msgr2=0x559363db8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:06.168 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.148+0000 7faf5a7fc640 1 --2- 172.21.15.99:0/1313548441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559363dae270 0x559363db8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:06.168 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.148+0000 7faf5a7fc640 1 -- 172.21.15.99:0/1313548441 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf4c00a960 con 0x559363daec60 2024-01-31T05:12:06.168 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.148+0000 7faf5a7fc640 1 --2- 172.21.15.99:0/1313548441 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559363daec60 0x559363db86c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7faf50095e20 tx=0x7faf50099370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73a6ca2647a9e181 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:06.168 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.148+0000 7faf3eff5640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:12:06.168 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.149+0000 7faf3eff5640 1 -- 172.21.15.99:0/1313548441 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5009da70 con 0x559363daec60 2024-01-31T05:12:06.168 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.149+0000 7faf3eff5640 1 -- 172.21.15.99:0/1313548441 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7faf500a1cb0 con 0x559363daec60 2024-01-31T05:12:06.169 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.149+0000 7faf6421f740 1 -- 172.21.15.99:0/1313548441 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559363d10010 con 0x559363daec60 2024-01-31T05:12:06.169 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.149+0000 7faf3eff5640 1 -- 172.21.15.99:0/1313548441 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf500a1820 con 0x559363daec60 2024-01-31T05:12:06.169 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.149+0000 7faf6421f740 10 client.15675 fetch_fsmap learned FSMap version 27 2024-01-31T05:12:06.169 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.149+0000 7faf6421f740 1 -- 172.21.15.99:0/1313548441 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x559363d156a0 con 0x559363daec60 2024-01-31T05:12:06.169 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.149+0000 7faf3eff5640 1 -- 172.21.15.99:0/1313548441 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559363d10010 con 0x559363daec60 2024-01-31T05:12:06.169 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.149+0000 7faf3eff5640 1 -- 172.21.15.99:0/1313548441 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7faf50095710 con 0x559363daec60 2024-01-31T05:12:06.169 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.149+0000 7faf6421f740 10 client.15675 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:12:06.170 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.149+0000 7faf6421f740 10 client.15675 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-01-31T05:12:06.170 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.149+0000 7faf6421f740 20 client.15675 populate_metadata read hostname 'smithi099' 2024-01-31T05:12:06.170 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.149+0000 7faf6421f740 1 --2- 172.21.15.99:0/1313548441 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x559363dc4000 0x559363dc63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:06.170 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.149+0000 7faf6421f740 4 client.15675 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:12:06.170 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.149+0000 7faf6421f740 1 -- 172.21.15.99:0/1313548441 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559363d0fd30 con 0x559363dc4000 2024-01-31T05:12:06.170 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.149+0000 7faf5affd640 1 --2- 172.21.15.99:0/1313548441 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x559363dc4000 0x559363dc63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:06.170 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.150+0000 7faf5affd640 1 --2- 172.21.15.99:0/1313548441 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x559363dc4000 0x559363dc63f0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17e915592f4d528d server_cookie=f7642358410c50fb in_seq=0 out_seq=0 2024-01-31T05:12:06.171 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.150+0000 7faf3eff5640 10 client.15675 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:12:06.171 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.150+0000 7faf3eff5640 1 -- 172.21.15.99:0/1313548441 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559363d0fd30 con 0x559363dc4000 2024-01-31T05:12:06.171 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.150+0000 7faf3eff5640 10 client.15675 handle_command_reply: tid=0 2024-01-31T05:12:06.171 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.150+0000 7faf6421f740 1 client.15675 shutdown 2024-01-31T05:12:06.171 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.150+0000 7faf6421f740 1 -- 172.21.15.99:0/1313548441 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559363daec60 msgr2=0x559363db86c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:06.171 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.150+0000 7faf6421f740 1 --2- 172.21.15.99:0/1313548441 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559363daec60 0x559363db86c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7faf50095e20 tx=0x7faf50099370 comp rx=0 tx=0).stop 2024-01-31T05:12:06.171 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.150+0000 7faf6421f740 1 -- 172.21.15.99:0/1313548441 shutdown_connections 2024-01-31T05:12:06.171 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.150+0000 7faf6421f740 1 --2- 172.21.15.99:0/1313548441 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559363db3dd0 0x559363dbf700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.150+0000 7faf6421f740 1 --2- 172.21.15.99:0/1313548441 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559363daec60 0x559363db86c0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.151+0000 7faf6421f740 1 --2- 172.21.15.99:0/1313548441 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x559363dc4000 0x559363dc63f0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.151+0000 7faf3eff5640 0 client.15675 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:12:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.151+0000 7faf6421f740 1 --2- 172.21.15.99:0/1313548441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559363dae270 0x559363db8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.151+0000 7faf6421f740 1 -- 172.21.15.99:0/1313548441 >> 172.21.15.99:0/1313548441 conn(0x559363da97e0 msgr2=0x559363da8a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.151+0000 7faf6421f740 1 -- 172.21.15.99:0/1313548441 shutdown_connections 2024-01-31T05:12:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.151+0000 7faf6421f740 1 -- 172.21.15.99:0/1313548441 wait complete. 2024-01-31T05:12:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.151+0000 7faf6421f740 20 client.15675 trim_cache size 0 max 16384 2024-01-31T05:12:06.185 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.164+0000 7faf6421f740 1 Processor -- start 2024-01-31T05:12:06.185 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.164+0000 7faf6421f740 1 -- start start 2024-01-31T05:12:06.185 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.164+0000 7faf6421f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559363dae270 0x559363dafea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:06.185 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.164+0000 7faf6421f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559363daec60 0x559363dbf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:06.185 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.164+0000 7faf6421f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559363db3dd0 0x559363db03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:06.185 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.164+0000 7faf6421f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x559363d10010 con 0x559363db3dd0 2024-01-31T05:12:06.185 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.164+0000 7faf6421f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x559363dc2590 con 0x559363dae270 2024-01-31T05:12:06.185 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.164+0000 7faf6421f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x559363dc3ba0 con 0x559363daec60 2024-01-31T05:12:06.185 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.164+0000 7faf5b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559363db3dd0 0x559363db03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:06.186 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.164+0000 7faf5b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559363db3dd0 0x559363db03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41504/0 (socket says 172.21.15.99:41504) 2024-01-31T05:12:06.186 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.164+0000 7faf5b7fe640 1 -- 172.21.15.99:0/911682777 learned_addr learned my addr 172.21.15.99:0/911682777 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:06.186 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.164+0000 7faf5affd640 1 --2- 172.21.15.99:0/911682777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559363dae270 0x559363dafea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:06.186 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.164+0000 7faf5a7fc640 1 --2- 172.21.15.99:0/911682777 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559363daec60 0x559363dbf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:06.186 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.164+0000 7faf5b7fe640 1 -- 172.21.15.99:0/911682777 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559363daec60 msgr2=0x559363dbf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:06.186 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.164+0000 7faf5b7fe640 1 --2- 172.21.15.99:0/911682777 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559363daec60 0x559363dbf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:06.186 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.164+0000 7faf5b7fe640 1 -- 172.21.15.99:0/911682777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559363dae270 msgr2=0x559363dafea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:06.186 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.164+0000 7faf5b7fe640 1 --2- 172.21.15.99:0/911682777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559363dae270 0x559363dafea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:06.186 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.164+0000 7faf5b7fe640 1 -- 172.21.15.99:0/911682777 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559363cb2030 con 0x559363db3dd0 2024-01-31T05:12:06.186 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.164+0000 7faf5a7fc640 1 --2- 172.21.15.99:0/911682777 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559363daec60 0x559363dbf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:12:06.186 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.164+0000 7faf5affd640 1 --2- 172.21.15.99:0/911682777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559363dae270 0x559363dafea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:12:06.186 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.164+0000 7faf5b7fe640 1 --2- 172.21.15.99:0/911682777 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559363db3dd0 0x559363db03e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7faf54006010 tx=0x7faf5402e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=221312129bc35719 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:06.186 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.165+0000 7faf40ff9640 1 -- 172.21.15.99:0/911682777 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf54046040 con 0x559363db3dd0 2024-01-31T05:12:06.186 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.165+0000 7faf40ff9640 1 -- 172.21.15.99:0/911682777 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faf54032ad0 con 0x559363db3dd0 2024-01-31T05:12:06.187 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.165+0000 7faf40ff9640 1 -- 172.21.15.99:0/911682777 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf54004320 con 0x559363db3dd0 2024-01-31T05:12:06.187 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.165+0000 7faf6421f740 1 -- 172.21.15.99:0/911682777 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559363db3dd0 msgr2=0x559363db03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:06.187 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.165+0000 7faf6421f740 1 --2- 172.21.15.99:0/911682777 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559363db3dd0 0x559363db03e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7faf54006010 tx=0x7faf5402e050 comp rx=0 tx=0).stop 2024-01-31T05:12:06.187 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.166+0000 7faf6421f740 1 -- 172.21.15.99:0/911682777 shutdown_connections 2024-01-31T05:12:06.187 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.166+0000 7faf6421f740 1 --2- 172.21.15.99:0/911682777 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559363db3dd0 0x559363db03e0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:06.187 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.166+0000 7faf6421f740 1 --2- 172.21.15.99:0/911682777 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559363daec60 0x559363dbf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:06.187 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.166+0000 7faf6421f740 1 --2- 172.21.15.99:0/911682777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559363dae270 0x559363dafea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:06.187 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.166+0000 7faf6421f740 1 -- 172.21.15.99:0/911682777 >> 172.21.15.99:0/911682777 conn(0x559363da97e0 msgr2=0x559363db8160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:06.187 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.166+0000 7faf6421f740 1 -- 172.21.15.99:0/911682777 shutdown_connections 2024-01-31T05:12:06.187 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.166+0000 7faf6421f740 1 -- 172.21.15.99:0/911682777 wait complete. 2024-01-31T05:12:06.187 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.166+0000 7faf6421f740 1 -- start start 2024-01-31T05:12:06.187 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.166+0000 7faf6421f740 1 Processor -- start 2024-01-31T05:12:06.187 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.166+0000 7faf6421f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559363dae270 0x559363dbe1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:06.187 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.166+0000 7faf6421f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559363daec60 0x559363dbe6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:06.187 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.166+0000 7faf6421f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559363db3dd0 0x559363dbec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:06.188 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.166+0000 7faf6421f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x559363e1a5b0 con 0x559363db3dd0 2024-01-31T05:12:06.188 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.166+0000 7faf6421f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x559363e1a720 con 0x559363dae270 2024-01-31T05:12:06.188 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.166+0000 7faf6421f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x559363e1a8e0 con 0x559363daec60 2024-01-31T05:12:06.188 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.166+0000 7faf6421f740 10 client.0 _ll_register_callbacks cb 0x7faf4c00a730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:12:06.188 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.166+0000 7faf5b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559363db3dd0 0x559363dbec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:06.188 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.167+0000 7faf5b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559363db3dd0 0x559363dbec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41508/0 (socket says 172.21.15.99:41508) 2024-01-31T05:12:06.188 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.167+0000 7faf5b7fe640 1 -- 172.21.15.99:0/1405097981 learned_addr learned my addr 172.21.15.99:0/1405097981 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:06.188 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.167+0000 7faf5a7fc640 1 --2- 172.21.15.99:0/1405097981 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559363daec60 0x559363dbe6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:06.188 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.167+0000 7faf5affd640 1 --2- 172.21.15.99:0/1405097981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559363dae270 0x559363dbe1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:06.188 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.167+0000 7faf5b7fe640 1 -- 172.21.15.99:0/1405097981 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559363daec60 msgr2=0x559363dbe6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:06.188 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.167+0000 7faf5b7fe640 1 --2- 172.21.15.99:0/1405097981 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559363daec60 0x559363dbe6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:06.188 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.167+0000 7faf5b7fe640 1 -- 172.21.15.99:0/1405097981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559363dae270 msgr2=0x559363dbe1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:06.188 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.167+0000 7faf5b7fe640 1 --2- 172.21.15.99:0/1405097981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559363dae270 0x559363dbe1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:06.189 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.167+0000 7faf5b7fe640 1 -- 172.21.15.99:0/1405097981 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf5c109a20 con 0x559363db3dd0 2024-01-31T05:12:06.189 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.167+0000 7faf5b7fe640 1 --2- 172.21.15.99:0/1405097981 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559363db3dd0 0x559363dbec20 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7faf54032520 tx=0x7faf54034c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2b67a4fe958bd92 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:06.189 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.167+0000 7faf3eff5640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:12:06.189 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.167+0000 7faf3eff5640 1 -- 172.21.15.99:0/1405097981 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf540040a0 con 0x559363db3dd0 2024-01-31T05:12:06.189 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.167+0000 7faf3eff5640 1 -- 172.21.15.99:0/1405097981 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7faf54004200 con 0x559363db3dd0 2024-01-31T05:12:06.189 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.167+0000 7faf6421f740 1 -- 172.21.15.99:0/1405097981 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faf4c018b00 con 0x559363db3dd0 2024-01-31T05:12:06.189 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.167+0000 7faf3eff5640 1 -- 172.21.15.99:0/1405097981 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf540043c0 con 0x559363db3dd0 2024-01-31T05:12:06.189 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.167+0000 7faf6421f740 10 client.15681 fetch_fsmap learned FSMap version 27 2024-01-31T05:12:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.167+0000 7faf6421f740 1 -- 172.21.15.99:0/1405097981 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x559363cd7a50 con 0x559363db3dd0 2024-01-31T05:12:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.167+0000 7faf3eff5640 1 -- 172.21.15.99:0/1405097981 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faf4c018b00 con 0x559363db3dd0 2024-01-31T05:12:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.168+0000 7faf3eff5640 1 -- 172.21.15.99:0/1405097981 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7faf54056d10 con 0x559363db3dd0 2024-01-31T05:12:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.168+0000 7faf6421f740 10 client.15681 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:12:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.168+0000 7faf6421f740 10 client.15681 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-01-31T05:12:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.168+0000 7faf6421f740 20 client.15681 populate_metadata read hostname 'smithi099' 2024-01-31T05:12:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.168+0000 7faf6421f740 1 --2- 172.21.15.99:0/1405097981 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x559363dc4000 0x559363e1df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.168+0000 7faf6421f740 4 client.15681 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-01-31T05:12:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.168+0000 7faf6421f740 1 -- 172.21.15.99:0/1405097981 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559363a16600 con 0x559363dc4000 2024-01-31T05:12:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.168+0000 7faf5affd640 1 --2- 172.21.15.99:0/1405097981 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x559363dc4000 0x559363e1df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.168+0000 7faf5affd640 1 --2- 172.21.15.99:0/1405097981 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x559363dc4000 0x559363e1df90 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=479f96c4de49725d server_cookie=fec53c6a92f20f66 in_seq=0 out_seq=0 2024-01-31T05:12:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.168+0000 7faf3eff5640 10 client.15681 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:12:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.175+0000 7faf3eff5640 1 -- 172.21.15.99:0/1405097981 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559363a16600 con 0x559363dc4000 2024-01-31T05:12:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.175+0000 7faf3eff5640 10 client.15681 handle_command_reply: tid=0 2024-01-31T05:12:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.175+0000 7faf6421f740 1 client.15681 shutdown 2024-01-31T05:12:06.191 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.175+0000 7faf6421f740 1 -- 172.21.15.99:0/1405097981 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559363db3dd0 msgr2=0x559363dbec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:06.191 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.175+0000 7faf6421f740 1 --2- 172.21.15.99:0/1405097981 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559363db3dd0 0x559363dbec20 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7faf54032520 tx=0x7faf54034c80 comp rx=0 tx=0).stop 2024-01-31T05:12:06.191 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.175+0000 7faf6421f740 1 -- 172.21.15.99:0/1405097981 shutdown_connections 2024-01-31T05:12:06.191 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.175+0000 7faf6421f740 1 --2- 172.21.15.99:0/1405097981 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559363db3dd0 0x559363dbec20 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:06.191 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.175+0000 7faf6421f740 1 --2- 172.21.15.99:0/1405097981 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559363daec60 0x559363dbe6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:06.191 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.175+0000 7faf6421f740 1 --2- 172.21.15.99:0/1405097981 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x559363dc4000 0x559363e1df90 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:06.191 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.175+0000 7faf6421f740 1 --2- 172.21.15.99:0/1405097981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559363dae270 0x559363dbe1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:06.191 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.175+0000 7faf3eff5640 0 client.15681 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:12:06.191 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.175+0000 7faf6421f740 1 -- 172.21.15.99:0/1405097981 >> 172.21.15.99:0/1405097981 conn(0x559363da97e0 msgr2=0x559363db8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:06.191 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.175+0000 7faf6421f740 1 -- 172.21.15.99:0/1405097981 shutdown_connections 2024-01-31T05:12:06.191 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.175+0000 7faf6421f740 1 -- 172.21.15.99:0/1405097981 wait complete. 2024-01-31T05:12:06.191 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.175+0000 7faf6421f740 20 client.15681 trim_cache size 0 max 16384 2024-01-31T05:12:06.192 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout:{ 2024-01-31T05:12:06.192 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout: "message": "", 2024-01-31T05:12:06.192 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout: "return_code": 0 2024-01-31T05:12:06.192 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout:} 2024-01-31T05:12:06.193 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.176+0000 7faf61389640 1 -- 172.21.15.99:0/1031799765 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7faf440a1420 msgr2=0x7faf440a38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:06.193 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.176+0000 7faf61389640 1 --2- 172.21.15.99:0/1031799765 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7faf440a1420 0x7faf440a38e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7faf54005e30 tx=0x7faf54032460 comp rx=0 tx=0).stop 2024-01-31T05:12:06.193 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.176+0000 7faf61389640 1 -- 172.21.15.99:0/1031799765 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf5c1040c0 msgr2=0x7faf5c0ff740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:06.193 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.176+0000 7faf61389640 1 --2- 172.21.15.99:0/1031799765 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf5c1040c0 0x7faf5c0ff740 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7faf5000d7a0 tx=0x7faf5000dba0 comp rx=0 tx=0).stop 2024-01-31T05:12:06.193 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.176+0000 7faf61389640 1 -- 172.21.15.99:0/1031799765 shutdown_connections 2024-01-31T05:12:06.193 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.176+0000 7faf61389640 1 --2- 172.21.15.99:0/1031799765 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7faf440a1420 0x7faf440a38e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:06.193 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.176+0000 7faf61389640 1 --2- 172.21.15.99:0/1031799765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf5c1069f0 0x7faf5c0ffc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:06.193 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.176+0000 7faf61389640 1 --2- 172.21.15.99:0/1031799765 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf5c1040c0 0x7faf5c0ff740 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:06.193 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.176+0000 7faf61389640 1 --2- 172.21.15.99:0/1031799765 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf5c101790 0x7faf5c101100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:06.193 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.176+0000 7faf61389640 1 -- 172.21.15.99:0/1031799765 >> 172.21.15.99:0/1031799765 conn(0x7faf5c0fb180 msgr2=0x7faf5c1020d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:06.193 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.176+0000 7faf61389640 1 -- 172.21.15.99:0/1031799765 shutdown_connections 2024-01-31T05:12:06.194 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:06.176+0000 7faf61389640 1 -- 172.21.15.99:0/1031799765 wait complete. 2024-01-31T05:12:08.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:07 smithi099 ceph-mon[31615]: pgmap v371: 97 pgs: 97 active+clean; 668 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-01-31T05:12:08.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:07 smithi181 ceph-mon[36434]: pgmap v371: 97 pgs: 97 active+clean; 668 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-01-31T05:12:08.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:07 smithi179 ceph-mon[35652]: pgmap v371: 97 pgs: 97 active+clean; 668 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-01-31T05:12:10.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:09 smithi099 ceph-mon[31615]: pgmap v372: 97 pgs: 97 active+clean; 669 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-01-31T05:12:10.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:09 smithi181 ceph-mon[36434]: pgmap v372: 97 pgs: 97 active+clean; 669 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-01-31T05:12:10.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:09 smithi179 ceph-mon[35652]: pgmap v372: 97 pgs: 97 active+clean; 669 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-01-31T05:12:12.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:11 smithi099 ceph-mon[31615]: pgmap v373: 97 pgs: 97 active+clean; 669 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-01-31T05:12:12.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:11 smithi181 ceph-mon[36434]: pgmap v373: 97 pgs: 97 active+clean; 669 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-01-31T05:12:12.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:11 smithi179 ceph-mon[35652]: pgmap v373: 97 pgs: 97 active+clean; 669 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-01-31T05:12:13.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:13 smithi099 ceph-mon[31615]: pgmap v374: 97 pgs: 97 active+clean; 669 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-01-31T05:12:13.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:13 smithi181 ceph-mon[36434]: pgmap v374: 97 pgs: 97 active+clean; 669 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-01-31T05:12:13.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:13 smithi179 ceph-mon[35652]: pgmap v374: 97 pgs: 97 active+clean; 669 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-01-31T05:12:16.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:15 smithi099 ceph-mon[31615]: pgmap v375: 97 pgs: 97 active+clean; 669 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-01-31T05:12:16.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:15 smithi181 ceph-mon[36434]: pgmap v375: 97 pgs: 97 active+clean; 669 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-01-31T05:12:16.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:15 smithi179 ceph-mon[35652]: pgmap v375: 97 pgs: 97 active+clean; 669 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-01-31T05:12:18.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:17 smithi099 ceph-mon[31615]: pgmap v376: 97 pgs: 97 active+clean; 669 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 10 op/s 2024-01-31T05:12:18.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:17 smithi181 ceph-mon[36434]: pgmap v376: 97 pgs: 97 active+clean; 669 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 10 op/s 2024-01-31T05:12:18.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:17 smithi179 ceph-mon[35652]: pgmap v376: 97 pgs: 97 active+clean; 669 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 10 op/s 2024-01-31T05:12:19.297 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.295+0000 7faf082ae640 1 -- 172.21.15.99:0/2546348342 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf001017c0 msgr2=0x7faf00108050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:19.297 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.295+0000 7faf082ae640 1 --2- 172.21.15.99:0/2546348342 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf001017c0 0x7faf00108050 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7faef8009ca0 tx=0x7faef802c0f0 comp rx=0 tx=0).stop 2024-01-31T05:12:19.297 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.295+0000 7faf082ae640 1 -- 172.21.15.99:0/2546348342 shutdown_connections 2024-01-31T05:12:19.297 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.295+0000 7faf082ae640 1 --2- 172.21.15.99:0/2546348342 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf001017c0 0x7faf00108050 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:19.297 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.295+0000 7faf082ae640 1 --2- 172.21.15.99:0/2546348342 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf00100e00 0x7faf00101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:19.297 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.295+0000 7faf082ae640 1 --2- 172.21.15.99:0/2546348342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf000ffc10 0x7faf00100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:19.297 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.295+0000 7faf082ae640 1 -- 172.21.15.99:0/2546348342 >> 172.21.15.99:0/2546348342 conn(0x7faf000fb180 msgr2=0x7faf000fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:19.297 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.295+0000 7faf082ae640 1 -- 172.21.15.99:0/2546348342 shutdown_connections 2024-01-31T05:12:19.298 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.295+0000 7faf082ae640 1 -- 172.21.15.99:0/2546348342 wait complete. 2024-01-31T05:12:19.298 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.296+0000 7faf082ae640 1 Processor -- start 2024-01-31T05:12:19.298 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.296+0000 7faf082ae640 1 -- start start 2024-01-31T05:12:19.298 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.296+0000 7faf082ae640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf000ffc10 0x7faf00195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:19.298 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.296+0000 7faf082ae640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf00100e00 0x7faf00196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:19.298 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.296+0000 7faf082ae640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf001017c0 0x7faf0019d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:19.298 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.296+0000 7faf082ae640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0019d5d0 con 0x7faf000ffc10 2024-01-31T05:12:19.298 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.296+0000 7faf082ae640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0019d740 con 0x7faf00100e00 2024-01-31T05:12:19.298 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.296+0000 7faf082ae640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0019d900 con 0x7faf001017c0 2024-01-31T05:12:19.298 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.296+0000 7faf0604a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf000ffc10 0x7faf00195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:19.298 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.296+0000 7faf0604a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf000ffc10 0x7faf00195ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36570/0 (socket says 172.21.15.99:36570) 2024-01-31T05:12:19.298 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.296+0000 7faf0604a640 1 -- 172.21.15.99:0/93670725 learned_addr learned my addr 172.21.15.99:0/93670725 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:19.298 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.296+0000 7faf05849640 1 --2- 172.21.15.99:0/93670725 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf00100e00 0x7faf00196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:19.299 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.296+0000 7faf0684b640 1 --2- 172.21.15.99:0/93670725 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf001017c0 0x7faf0019d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:19.299 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.296+0000 7faf0604a640 1 -- 172.21.15.99:0/93670725 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf001017c0 msgr2=0x7faf0019d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:19.299 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.297+0000 7faf0604a640 1 --2- 172.21.15.99:0/93670725 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf001017c0 0x7faf0019d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:19.299 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.297+0000 7faf0604a640 1 -- 172.21.15.99:0/93670725 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf00100e00 msgr2=0x7faf00196020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:19.299 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.297+0000 7faf0604a640 1 --2- 172.21.15.99:0/93670725 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf00100e00 0x7faf00196020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:19.299 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.297+0000 7faf0604a640 1 -- 172.21.15.99:0/93670725 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef8009900 con 0x7faf000ffc10 2024-01-31T05:12:19.299 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.297+0000 7faf05849640 1 --2- 172.21.15.99:0/93670725 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf00100e00 0x7faf00196020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:12:19.299 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.297+0000 7faf0684b640 1 --2- 172.21.15.99:0/93670725 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf001017c0 0x7faf0019d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:12:19.299 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.297+0000 7faf0604a640 1 --2- 172.21.15.99:0/93670725 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf000ffc10 0x7faf00195ae0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7faefc00d770 tx=0x7faefc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:19.299 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.297+0000 7faef77fe640 1 -- 172.21.15.99:0/93670725 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc009c30 con 0x7faf000ffc10 2024-01-31T05:12:19.299 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.297+0000 7faef77fe640 1 -- 172.21.15.99:0/93670725 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faefc00de80 con 0x7faf000ffc10 2024-01-31T05:12:19.299 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.297+0000 7faf082ae640 1 -- 172.21.15.99:0/93670725 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf0019dbe0 con 0x7faf000ffc10 2024-01-31T05:12:19.299 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.297+0000 7faef77fe640 1 -- 172.21.15.99:0/93670725 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc003e20 con 0x7faf000ffc10 2024-01-31T05:12:19.299 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.297+0000 7faf082ae640 1 -- 172.21.15.99:0/93670725 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf0019e0f0 con 0x7faf000ffc10 2024-01-31T05:12:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.300+0000 7faef77fe640 1 -- 172.21.15.99:0/93670725 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 135946+0+0 (secure 0 0 0) 0x7faefc003f80 con 0x7faf000ffc10 2024-01-31T05:12:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.300+0000 7faf0b071740 1 Processor -- start 2024-01-31T05:12:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.301+0000 7faf0b071740 1 -- start start 2024-01-31T05:12:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.301+0000 7faf0b071740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55945afc3480 0x55945afc38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.301+0000 7faf0b071740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55945afc3e70 0x55945afc8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.301+0000 7faf0b071740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55945afc8fe0 0x55945afcb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.301+0000 7faf0b071740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55945af31040 con 0x55945afc3480 2024-01-31T05:12:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.301+0000 7faf0b071740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55945af2e730 con 0x55945afc3e70 2024-01-31T05:12:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.301+0000 7faf0b071740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55945af2a020 con 0x55945afc8fe0 2024-01-31T05:12:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.301+0000 7faf0684b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55945afc3480 0x55945afc38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.301+0000 7faf0684b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55945afc3480 0x55945afc38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36576/0 (socket says 172.21.15.99:36576) 2024-01-31T05:12:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.301+0000 7faf0684b640 1 -- 172.21.15.99:0/4240799563 learned_addr learned my addr 172.21.15.99:0/4240799563 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.301+0000 7faef77fe640 1 --2- 172.21.15.99:0/93670725 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7faeec0a5830 0x7faeec0a7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.301+0000 7faf0604a640 1 --2- 172.21.15.99:0/4240799563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55945afc3e70 0x55945afc8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.301+0000 7faf05849640 1 --2- 172.21.15.99:0/4240799563 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55945afc8fe0 0x55945afcb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.301+0000 7faf0684b640 1 --2- 172.21.15.99:0/93670725 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7faeec0a5830 0x7faeec0a7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.301+0000 7faef77fe640 1 -- 172.21.15.99:0/93670725 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7faefc0cc680 con 0x7faf000ffc10 2024-01-31T05:12:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.301+0000 7faf0684b640 1 -- 172.21.15.99:0/4240799563 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55945afc8fe0 msgr2=0x55945afcb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.301+0000 7faf0684b640 1 --2- 172.21.15.99:0/4240799563 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55945afc8fe0 0x55945afcb470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.301+0000 7faf0684b640 1 -- 172.21.15.99:0/4240799563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55945afc3e70 msgr2=0x55945afc8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.301+0000 7faf0684b640 1 --2- 172.21.15.99:0/4240799563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55945afc3e70 0x55945afc8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.301+0000 7faf0684b640 1 -- 172.21.15.99:0/4240799563 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55945af21e40 con 0x55945afc3480 2024-01-31T05:12:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.302+0000 7faf0604a640 1 --2- 172.21.15.99:0/4240799563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55945afc3e70 0x55945afc8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:12:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.302+0000 7faf0684b640 1 --2- 172.21.15.99:0/4240799563 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55945afc3480 0x55945afc38a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7faef80098d0 tx=0x7faef8034890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3a1b00609d3af5d server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.302+0000 7faf0684b640 1 --2- 172.21.15.99:0/93670725 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7faeec0a5830 0x7faeec0a7cf0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7faef8009430 tx=0x7faef8049000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.302+0000 7faef4bfe640 1 -- 172.21.15.99:0/4240799563 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef8032df0 con 0x55945afc3480 2024-01-31T05:12:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.302+0000 7faef4bfe640 1 -- 172.21.15.99:0/4240799563 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faef8003970 con 0x55945afc3480 2024-01-31T05:12:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.302+0000 7faef4bfe640 1 -- 172.21.15.99:0/4240799563 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef8004280 con 0x55945afc3480 2024-01-31T05:12:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.303+0000 7faf0b071740 1 -- 172.21.15.99:0/4240799563 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55945afc3480 msgr2=0x55945afc38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.303+0000 7faf0b071740 1 --2- 172.21.15.99:0/4240799563 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55945afc3480 0x55945afc38a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7faef80098d0 tx=0x7faef8034890 comp rx=0 tx=0).stop 2024-01-31T05:12:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.303+0000 7faf0b071740 1 -- 172.21.15.99:0/4240799563 shutdown_connections 2024-01-31T05:12:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.303+0000 7faf0b071740 1 --2- 172.21.15.99:0/4240799563 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55945afc8fe0 0x55945afcb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.303+0000 7faf0b071740 1 --2- 172.21.15.99:0/4240799563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55945afc3e70 0x55945afc8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.303+0000 7faf0b071740 1 --2- 172.21.15.99:0/4240799563 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55945afc3480 0x55945afc38a0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.303+0000 7faf0b071740 1 -- 172.21.15.99:0/4240799563 >> 172.21.15.99:0/4240799563 conn(0x55945afbc7e0 msgr2=0x55945afbcbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.303+0000 7faf0b071740 1 -- 172.21.15.99:0/4240799563 shutdown_connections 2024-01-31T05:12:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.303+0000 7faf0b071740 1 -- 172.21.15.99:0/4240799563 wait complete. 2024-01-31T05:12:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.303+0000 7faf0b071740 1 -- start start 2024-01-31T05:12:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.304+0000 7faf0b071740 1 Processor -- start 2024-01-31T05:12:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.304+0000 7faf0b071740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55945afc3480 0x55945afcdd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.304+0000 7faf0b071740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55945afc3e70 0x55945afd02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.304+0000 7faf0b071740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55945afc8fe0 0x55945afd2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.304+0000 7faf0b071740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55945aee31b0 con 0x55945afc3e70 2024-01-31T05:12:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.304+0000 7faf0b071740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55945aee2e50 con 0x55945afc8fe0 2024-01-31T05:12:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.304+0000 7faf0b071740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55945aea8090 con 0x55945afc3480 2024-01-31T05:12:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.304+0000 7faf0b071740 10 client.0 _ll_register_callbacks cb 0x55945aecda90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:12:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.304+0000 7faf05849640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55945afc3e70 0x55945afd02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.304+0000 7faf05849640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55945afc3e70 0x55945afd02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36586/0 (socket says 172.21.15.99:36586) 2024-01-31T05:12:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.304+0000 7faf05849640 1 -- 172.21.15.99:0/306552909 learned_addr learned my addr 172.21.15.99:0/306552909 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.304+0000 7faf0684b640 1 --2- 172.21.15.99:0/306552909 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55945afc8fe0 0x55945afd2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.304+0000 7faf0604a640 1 --2- 172.21.15.99:0/306552909 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55945afc3480 0x55945afcdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.304+0000 7faf0684b640 1 -- 172.21.15.99:0/306552909 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55945afc3480 msgr2=0x55945afcdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.304+0000 7faf0684b640 1 --2- 172.21.15.99:0/306552909 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55945afc3480 0x55945afcdd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.304+0000 7faf0684b640 1 -- 172.21.15.99:0/306552909 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55945afc3e70 msgr2=0x55945afd02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.304+0000 7faf0684b640 1 --2- 172.21.15.99:0/306552909 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55945afc3e70 0x55945afd02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.304+0000 7faf0684b640 1 -- 172.21.15.99:0/306552909 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf00108950 con 0x55945afc8fe0 2024-01-31T05:12:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.304+0000 7faf05849640 1 --2- 172.21.15.99:0/306552909 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55945afc3e70 0x55945afd02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:12:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.305+0000 7faf0684b640 1 --2- 172.21.15.99:0/306552909 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55945afc8fe0 0x55945afd2800 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faef8004af0 tx=0x7faef8004dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da57e31f16a43610 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.305+0000 7faee9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-01-31T05:12:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.305+0000 7faee9ffb640 1 -- 172.21.15.99:0/306552909 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef8032dd0 con 0x55945afc8fe0 2024-01-31T05:12:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.305+0000 7faf0b071740 1 -- 172.21.15.99:0/306552909 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55945af23010 con 0x55945afc8fe0 2024-01-31T05:12:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.305+0000 7faee9ffb640 1 -- 172.21.15.99:0/306552909 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7faef804a070 con 0x55945afc8fe0 2024-01-31T05:12:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.305+0000 7faee9ffb640 1 -- 172.21.15.99:0/306552909 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7faef8003cf0 con 0x55945afc8fe0 2024-01-31T05:12:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.305+0000 7faf0b071740 10 client.25142 fetch_fsmap learned FSMap version 27 2024-01-31T05:12:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.305+0000 7faf0b071740 1 -- 172.21.15.99:0/306552909 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55945af286a0 con 0x55945afc8fe0 2024-01-31T05:12:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.306+0000 7faee9ffb640 1 -- 172.21.15.99:0/306552909 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55945af23010 con 0x55945afc8fe0 2024-01-31T05:12:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.306+0000 7faee9ffb640 1 -- 172.21.15.99:0/306552909 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7faef805f070 con 0x55945afc8fe0 2024-01-31T05:12:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.306+0000 7faf0b071740 10 client.25142 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:12:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.306+0000 7faf0b071740 10 client.25142 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-01-31T05:12:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.306+0000 7faf0b071740 20 client.25142 populate_metadata read hostname 'smithi099' 2024-01-31T05:12:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.306+0000 7faf0b071740 1 --2- 172.21.15.99:0/306552909 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55945afd6e00 0x55945afd91f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.306+0000 7faf0b071740 4 client.25142 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:12:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.306+0000 7faf0b071740 1 -- 172.21.15.99:0/306552909 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55945af22d30 con 0x55945afd6e00 2024-01-31T05:12:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.306+0000 7faf0604a640 1 --2- 172.21.15.99:0/306552909 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55945afd6e00 0x55945afd91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.306+0000 7faee9ffb640 10 client.25142 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:12:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.306+0000 7faf0604a640 1 --2- 172.21.15.99:0/306552909 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55945afd6e00 0x55945afd91f0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ad234619191c851 server_cookie=fb2034bf1250cff0 in_seq=0 out_seq=0 2024-01-31T05:12:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.307+0000 7faee9ffb640 1 -- 172.21.15.99:0/306552909 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55945af22d30 con 0x55945afd6e00 2024-01-31T05:12:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.307+0000 7faee9ffb640 10 client.25142 handle_command_reply: tid=0 2024-01-31T05:12:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.307+0000 7faf0b071740 1 client.25142 shutdown 2024-01-31T05:12:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.307+0000 7faf0b071740 1 -- 172.21.15.99:0/306552909 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55945afc8fe0 msgr2=0x55945afd2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.307+0000 7faf0b071740 1 --2- 172.21.15.99:0/306552909 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55945afc8fe0 0x55945afd2800 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faef8004af0 tx=0x7faef8004dd0 comp rx=0 tx=0).stop 2024-01-31T05:12:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.307+0000 7faf0b071740 1 -- 172.21.15.99:0/306552909 shutdown_connections 2024-01-31T05:12:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.307+0000 7faf0b071740 1 --2- 172.21.15.99:0/306552909 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55945afd6e00 0x55945afd91f0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.307+0000 7faf0b071740 1 --2- 172.21.15.99:0/306552909 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55945afc8fe0 0x55945afd2800 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.307+0000 7faf0b071740 1 --2- 172.21.15.99:0/306552909 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55945afc3e70 0x55945afd02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.307+0000 7faee9ffb640 0 client.25142 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:12:19.317 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.307+0000 7faf0b071740 1 --2- 172.21.15.99:0/306552909 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55945afc3480 0x55945afcdd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:19.317 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.307+0000 7faf0b071740 1 -- 172.21.15.99:0/306552909 >> 172.21.15.99:0/306552909 conn(0x55945afbc7e0 msgr2=0x55945afbba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:19.317 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.307+0000 7faf0b071740 1 -- 172.21.15.99:0/306552909 shutdown_connections 2024-01-31T05:12:19.317 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.307+0000 7faf0b071740 1 -- 172.21.15.99:0/306552909 wait complete. 2024-01-31T05:12:19.317 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.307+0000 7faf0b071740 20 client.25142 trim_cache size 0 max 16384 2024-01-31T05:12:19.324 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.320+0000 7faf0b071740 1 Processor -- start 2024-01-31T05:12:19.324 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.320+0000 7faf0b071740 1 -- start start 2024-01-31T05:12:19.325 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.321+0000 7faf0b071740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55945afc3480 0x55945afcfd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:19.325 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.321+0000 7faf0b071740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55945afc3e70 0x55945afd0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:19.325 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.321+0000 7faf0b071740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55945afc8fe0 0x55945afc6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:19.325 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.321+0000 7faf0b071740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55945af22d30 con 0x55945afc3480 2024-01-31T05:12:19.325 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.321+0000 7faf0b071740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55945af23010 con 0x55945afc3e70 2024-01-31T05:12:19.325 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.321+0000 7faf0b071740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55945afbd750 con 0x55945afc8fe0 2024-01-31T05:12:19.325 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.321+0000 7faf0604a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55945afc3480 0x55945afcfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:19.325 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.321+0000 7faf0604a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55945afc3480 0x55945afcfd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36592/0 (socket says 172.21.15.99:36592) 2024-01-31T05:12:19.325 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.321+0000 7faf0604a640 1 -- 172.21.15.99:0/4114206884 learned_addr learned my addr 172.21.15.99:0/4114206884 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:19.325 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.321+0000 7faf0684b640 1 --2- 172.21.15.99:0/4114206884 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55945afc8fe0 0x55945afc6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:19.325 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.321+0000 7faf05849640 1 --2- 172.21.15.99:0/4114206884 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55945afc3e70 0x55945afd0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:19.325 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.321+0000 7faf0604a640 1 -- 172.21.15.99:0/4114206884 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55945afc8fe0 msgr2=0x55945afc6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.321+0000 7faf0604a640 1 --2- 172.21.15.99:0/4114206884 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55945afc8fe0 0x55945afc6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.321+0000 7faf0604a640 1 -- 172.21.15.99:0/4114206884 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55945afc3e70 msgr2=0x55945afd0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.321+0000 7faf0604a640 1 --2- 172.21.15.99:0/4114206884 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55945afc3e70 0x55945afd0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.321+0000 7faf0604a640 1 -- 172.21.15.99:0/4114206884 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55945aec5030 con 0x55945afc3480 2024-01-31T05:12:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.321+0000 7faf0604a640 1 --2- 172.21.15.99:0/4114206884 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55945afc3480 0x55945afcfd10 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7faefc0038c0 tx=0x7faefc0cebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef55f50cab4202bf server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.321+0000 7faeebfff640 1 -- 172.21.15.99:0/4114206884 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc099550 con 0x55945afc3480 2024-01-31T05:12:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.321+0000 7faeebfff640 1 -- 172.21.15.99:0/4114206884 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faefc099e80 con 0x55945afc3480 2024-01-31T05:12:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.321+0000 7faeebfff640 1 -- 172.21.15.99:0/4114206884 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc095e90 con 0x55945afc3480 2024-01-31T05:12:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.322+0000 7faf0b071740 1 -- 172.21.15.99:0/4114206884 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55945afc3480 msgr2=0x55945afcfd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.322+0000 7faf0b071740 1 --2- 172.21.15.99:0/4114206884 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55945afc3480 0x55945afcfd10 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7faefc0038c0 tx=0x7faefc0cebc0 comp rx=0 tx=0).stop 2024-01-31T05:12:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.322+0000 7faf0b071740 1 -- 172.21.15.99:0/4114206884 shutdown_connections 2024-01-31T05:12:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.322+0000 7faf0b071740 1 --2- 172.21.15.99:0/4114206884 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55945afc8fe0 0x55945afc6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.322+0000 7faf0b071740 1 --2- 172.21.15.99:0/4114206884 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55945afc3e70 0x55945afd0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.322+0000 7faf0b071740 1 --2- 172.21.15.99:0/4114206884 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55945afc3480 0x55945afcfd10 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.322+0000 7faf0b071740 1 -- 172.21.15.99:0/4114206884 >> 172.21.15.99:0/4114206884 conn(0x55945afbc7e0 msgr2=0x55945afbf440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.322+0000 7faf0b071740 1 -- 172.21.15.99:0/4114206884 shutdown_connections 2024-01-31T05:12:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.322+0000 7faf0b071740 1 -- 172.21.15.99:0/4114206884 wait complete. 2024-01-31T05:12:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.322+0000 7faf0b071740 1 -- start start 2024-01-31T05:12:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.323+0000 7faf0b071740 1 Processor -- start 2024-01-31T05:12:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.323+0000 7faf0b071740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55945afc3480 0x55945afcfd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.323+0000 7faf0b071740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55945afc3e70 0x55945afce410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.323+0000 7faf0b071740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55945afc8fe0 0x55945afce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.323+0000 7faf0b071740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55945afd0580 con 0x55945afc8fe0 2024-01-31T05:12:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.323+0000 7faf0b071740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55945afcee90 con 0x55945afc3480 2024-01-31T05:12:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.323+0000 7faf0b071740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55945afcf050 con 0x55945afc3e70 2024-01-31T05:12:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.323+0000 7faf0b071740 10 client.0 _ll_register_callbacks cb 0x7faef8037070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:12:19.328 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.323+0000 7faf0684b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55945afc8fe0 0x55945afce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:19.328 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.323+0000 7faf0684b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55945afc8fe0 0x55945afce950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36598/0 (socket says 172.21.15.99:36598) 2024-01-31T05:12:19.328 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.323+0000 7faf0684b640 1 -- 172.21.15.99:0/2350592292 learned_addr learned my addr 172.21.15.99:0/2350592292 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:19.328 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.323+0000 7faf05849640 1 --2- 172.21.15.99:0/2350592292 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55945afc3e70 0x55945afce410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:19.328 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.323+0000 7faf0604a640 1 --2- 172.21.15.99:0/2350592292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55945afc3480 0x55945afcfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:19.328 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.323+0000 7faf0684b640 1 -- 172.21.15.99:0/2350592292 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55945afc3e70 msgr2=0x55945afce410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:19.328 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.323+0000 7faf0684b640 1 --2- 172.21.15.99:0/2350592292 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55945afc3e70 0x55945afce410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:19.328 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.323+0000 7faf0684b640 1 -- 172.21.15.99:0/2350592292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55945afc3480 msgr2=0x55945afcfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:19.328 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.323+0000 7faf0684b640 1 --2- 172.21.15.99:0/2350592292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55945afc3480 0x55945afcfd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:19.328 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.323+0000 7faf0684b640 1 -- 172.21.15.99:0/2350592292 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf0019dbe0 con 0x55945afc8fe0 2024-01-31T05:12:19.328 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.323+0000 7faf05849640 1 --2- 172.21.15.99:0/2350592292 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55945afc3e70 0x55945afce410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:12:19.329 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.323+0000 7faf0604a640 1 --2- 172.21.15.99:0/2350592292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55945afc3480 0x55945afcfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:12:19.329 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.324+0000 7faf0684b640 1 --2- 172.21.15.99:0/2350592292 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55945afc8fe0 0x55945afce950 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7faef8009ca0 tx=0x7faef8004d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=686bba044f558482 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:19.329 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.324+0000 7faee9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:12:19.329 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.324+0000 7faee9ffb640 1 -- 172.21.15.99:0/2350592292 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef804ebb0 con 0x55945afc8fe0 2024-01-31T05:12:19.329 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.324+0000 7faee9ffb640 1 -- 172.21.15.99:0/2350592292 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7faef804a040 con 0x55945afc8fe0 2024-01-31T05:12:19.329 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.324+0000 7faf0b071740 1 -- 172.21.15.99:0/2350592292 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faef8003970 con 0x55945afc8fe0 2024-01-31T05:12:19.329 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.324+0000 7faee9ffb640 1 -- 172.21.15.99:0/2350592292 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7faef8070070 con 0x55945afc8fe0 2024-01-31T05:12:19.329 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.324+0000 7faf0b071740 10 client.15699 fetch_fsmap learned FSMap version 27 2024-01-31T05:12:19.329 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.324+0000 7faf0b071740 1 -- 172.21.15.99:0/2350592292 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55945aeeaa50 con 0x55945afc8fe0 2024-01-31T05:12:19.329 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.324+0000 7faee9ffb640 1 -- 172.21.15.99:0/2350592292 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faef8003970 con 0x55945afc8fe0 2024-01-31T05:12:19.329 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.324+0000 7faee9ffb640 1 -- 172.21.15.99:0/2350592292 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7faef805f040 con 0x55945afc8fe0 2024-01-31T05:12:19.329 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.324+0000 7faf0b071740 10 client.15699 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:12:19.330 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.324+0000 7faf0b071740 10 client.15699 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-01-31T05:12:19.330 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.324+0000 7faf0b071740 20 client.15699 populate_metadata read hostname 'smithi099' 2024-01-31T05:12:19.330 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.324+0000 7faf0b071740 1 --2- 172.21.15.99:0/2350592292 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55945b02e560 0x55945b030980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:19.330 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.324+0000 7faf0b071740 4 client.15699 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-01-31T05:12:19.330 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.324+0000 7faf0b071740 1 -- 172.21.15.99:0/2350592292 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55945ac29600 con 0x55945b02e560 2024-01-31T05:12:19.330 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.325+0000 7faf0604a640 1 --2- 172.21.15.99:0/2350592292 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55945b02e560 0x55945b030980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:19.330 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.325+0000 7faee9ffb640 10 client.15699 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:12:19.330 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.325+0000 7faf0604a640 1 --2- 172.21.15.99:0/2350592292 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55945b02e560 0x55945b030980 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=853abc2211421c08 server_cookie=6f186ec39dbfc936 in_seq=0 out_seq=0 2024-01-31T05:12:19.331 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.329+0000 7faee9ffb640 1 -- 172.21.15.99:0/2350592292 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55945ac29600 con 0x55945b02e560 2024-01-31T05:12:19.331 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.329+0000 7faee9ffb640 10 client.15699 handle_command_reply: tid=0 2024-01-31T05:12:19.331 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.329+0000 7faf0b071740 1 client.15699 shutdown 2024-01-31T05:12:19.331 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.329+0000 7faf0b071740 1 -- 172.21.15.99:0/2350592292 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55945afc8fe0 msgr2=0x55945afce950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:19.331 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.329+0000 7faf0b071740 1 --2- 172.21.15.99:0/2350592292 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55945afc8fe0 0x55945afce950 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7faef8009ca0 tx=0x7faef8004d50 comp rx=0 tx=0).stop 2024-01-31T05:12:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.329+0000 7faf0b071740 1 -- 172.21.15.99:0/2350592292 shutdown_connections 2024-01-31T05:12:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.329+0000 7faf0b071740 1 --2- 172.21.15.99:0/2350592292 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55945afc8fe0 0x55945afce950 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.329+0000 7faf0b071740 1 --2- 172.21.15.99:0/2350592292 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55945afc3e70 0x55945afce410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.329+0000 7faf0b071740 1 --2- 172.21.15.99:0/2350592292 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55945b02e560 0x55945b030980 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.329+0000 7faf0b071740 1 --2- 172.21.15.99:0/2350592292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55945afc3480 0x55945afcfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.329+0000 7faf0b071740 1 -- 172.21.15.99:0/2350592292 >> 172.21.15.99:0/2350592292 conn(0x55945afbc7e0 msgr2=0x55945afd27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.329+0000 7faee9ffb640 0 client.15699 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:12:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.329+0000 7faf0b071740 1 -- 172.21.15.99:0/2350592292 shutdown_connections 2024-01-31T05:12:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.329+0000 7faf0b071740 1 -- 172.21.15.99:0/2350592292 wait complete. 2024-01-31T05:12:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.329+0000 7faf0b071740 20 client.15699 trim_cache size 0 max 16384 2024-01-31T05:12:19.333 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout:{ 2024-01-31T05:12:19.333 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout: "message": "", 2024-01-31T05:12:19.333 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout: "return_code": 0 2024-01-31T05:12:19.333 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout:} 2024-01-31T05:12:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.330+0000 7faf082ae640 1 -- 172.21.15.99:0/93670725 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7faeec0a5830 msgr2=0x7faeec0a7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.330+0000 7faf082ae640 1 --2- 172.21.15.99:0/93670725 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7faeec0a5830 0x7faeec0a7cf0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7faef8009430 tx=0x7faef8049000 comp rx=0 tx=0).stop 2024-01-31T05:12:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.330+0000 7faf082ae640 1 -- 172.21.15.99:0/93670725 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf000ffc10 msgr2=0x7faf00195ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.330+0000 7faf082ae640 1 --2- 172.21.15.99:0/93670725 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf000ffc10 0x7faf00195ae0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7faefc00d770 tx=0x7faefc00dc30 comp rx=0 tx=0).stop 2024-01-31T05:12:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.330+0000 7faf082ae640 1 -- 172.21.15.99:0/93670725 shutdown_connections 2024-01-31T05:12:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.330+0000 7faf082ae640 1 --2- 172.21.15.99:0/93670725 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7faeec0a5830 0x7faeec0a7cf0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.330+0000 7faf082ae640 1 --2- 172.21.15.99:0/93670725 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf001017c0 0x7faf0019d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.330+0000 7faf082ae640 1 --2- 172.21.15.99:0/93670725 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf00100e00 0x7faf00196020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.330+0000 7faf082ae640 1 --2- 172.21.15.99:0/93670725 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf000ffc10 0x7faf00195ae0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:19.335 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.330+0000 7faf082ae640 1 -- 172.21.15.99:0/93670725 >> 172.21.15.99:0/93670725 conn(0x7faf000fb180 msgr2=0x7faf00104100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:19.335 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.330+0000 7faf082ae640 1 -- 172.21.15.99:0/93670725 shutdown_connections 2024-01-31T05:12:19.335 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:19.330+0000 7faf082ae640 1 -- 172.21.15.99:0/93670725 wait complete. 2024-01-31T05:12:20.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:19 smithi099 ceph-mon[31615]: pgmap v377: 97 pgs: 97 active+clean; 669 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 682 B/s wr, 13 op/s 2024-01-31T05:12:20.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:19 smithi181 ceph-mon[36434]: pgmap v377: 97 pgs: 97 active+clean; 669 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 682 B/s wr, 13 op/s 2024-01-31T05:12:20.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:19 smithi179 ceph-mon[35652]: pgmap v377: 97 pgs: 97 active+clean; 669 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 682 B/s wr, 13 op/s 2024-01-31T05:12:22.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:21 smithi099 ceph-mon[31615]: pgmap v378: 97 pgs: 97 active+clean; 669 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-01-31T05:12:22.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:21 smithi181 ceph-mon[36434]: pgmap v378: 97 pgs: 97 active+clean; 669 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-01-31T05:12:22.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:21 smithi179 ceph-mon[35652]: pgmap v378: 97 pgs: 97 active+clean; 669 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-01-31T05:12:23.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:23 smithi099 ceph-mon[31615]: pgmap v379: 97 pgs: 97 active+clean; 669 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 170 B/s wr, 11 op/s 2024-01-31T05:12:23.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:23 smithi181 ceph-mon[36434]: pgmap v379: 97 pgs: 97 active+clean; 669 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 170 B/s wr, 11 op/s 2024-01-31T05:12:23.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:23 smithi179 ceph-mon[35652]: pgmap v379: 97 pgs: 97 active+clean; 669 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 170 B/s wr, 11 op/s 2024-01-31T05:12:26.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:25 smithi099 ceph-mon[31615]: pgmap v380: 97 pgs: 97 active+clean; 670 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-01-31T05:12:26.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:25 smithi181 ceph-mon[36434]: pgmap v380: 97 pgs: 97 active+clean; 670 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-01-31T05:12:26.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:25 smithi179 ceph-mon[35652]: pgmap v380: 97 pgs: 97 active+clean; 670 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-01-31T05:12:28.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:27 smithi099 ceph-mon[31615]: pgmap v381: 97 pgs: 97 active+clean; 670 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-01-31T05:12:28.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:27 smithi181 ceph-mon[36434]: pgmap v381: 97 pgs: 97 active+clean; 670 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-01-31T05:12:28.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:27 smithi179 ceph-mon[35652]: pgmap v381: 97 pgs: 97 active+clean; 670 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-01-31T05:12:29.599 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-01-31T05:12:29.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.726+0000 7fc0f7819640 1 -- 172.21.15.99:0/1871902225 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0f01069f0 msgr2=0x7fc0f0108e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:29.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.726+0000 7fc0f7819640 1 --2- 172.21.15.99:0/1871902225 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0f01069f0 0x7fc0f0108e40 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8009ca0 tx=0x7fc0e802c0f0 comp rx=0 tx=0).stop 2024-01-31T05:12:29.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.726+0000 7fc0f7819640 1 -- 172.21.15.99:0/1871902225 shutdown_connections 2024-01-31T05:12:29.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.726+0000 7fc0f7819640 1 --2- 172.21.15.99:0/1871902225 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0f01069f0 0x7fc0f0108e40 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:29.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.726+0000 7fc0f7819640 1 --2- 172.21.15.99:0/1871902225 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc0f01040c0 0x7fc0f01064b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:29.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.726+0000 7fc0f7819640 1 --2- 172.21.15.99:0/1871902225 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0f0101790 0x7fc0f0103b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:29.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.726+0000 7fc0f7819640 1 -- 172.21.15.99:0/1871902225 >> 172.21.15.99:0/1871902225 conn(0x7fc0f00fb180 msgr2=0x7fc0f00fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:29.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.726+0000 7fc0f7819640 1 -- 172.21.15.99:0/1871902225 shutdown_connections 2024-01-31T05:12:29.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.726+0000 7fc0f7819640 1 -- 172.21.15.99:0/1871902225 wait complete. 2024-01-31T05:12:29.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.727+0000 7fc0f7819640 1 Processor -- start 2024-01-31T05:12:29.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.727+0000 7fc0f7819640 1 -- start start 2024-01-31T05:12:29.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.728+0000 7fc0f7819640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0f0101790 0x7fc0f0196d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:29.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.728+0000 7fc0f7819640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc0f01040c0 0x7fc0f0197250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:29.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.728+0000 7fc0f7819640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0f01069f0 0x7fc0f019e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:29.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.728+0000 7fc0f7819640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f019e7f0 con 0x7fc0f01069f0 2024-01-31T05:12:29.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.728+0000 7fc0f7819640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f019e960 con 0x7fc0f0101790 2024-01-31T05:12:29.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.728+0000 7fc0f7819640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f019eb20 con 0x7fc0f01040c0 2024-01-31T05:12:29.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.728+0000 7fc0f5db6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0f01069f0 0x7fc0f019e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:29.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.728+0000 7fc0f5db6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0f01069f0 0x7fc0f019e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33450/0 (socket says 172.21.15.99:33450) 2024-01-31T05:12:29.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.728+0000 7fc0f5db6640 1 -- 172.21.15.99:0/2850814482 learned_addr learned my addr 172.21.15.99:0/2850814482 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:29.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.728+0000 7fc0f55b5640 1 --2- 172.21.15.99:0/2850814482 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0f0101790 0x7fc0f0196d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:29.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.728+0000 7fc0f4db4640 1 --2- 172.21.15.99:0/2850814482 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc0f01040c0 0x7fc0f0197250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:29.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.728+0000 7fc0f5db6640 1 -- 172.21.15.99:0/2850814482 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc0f01040c0 msgr2=0x7fc0f0197250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:29.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.728+0000 7fc0f5db6640 1 --2- 172.21.15.99:0/2850814482 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc0f01040c0 0x7fc0f0197250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:29.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.728+0000 7fc0f5db6640 1 -- 172.21.15.99:0/2850814482 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0f0101790 msgr2=0x7fc0f0196d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:29.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.728+0000 7fc0f5db6640 1 --2- 172.21.15.99:0/2850814482 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0f0101790 0x7fc0f0196d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:29.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.728+0000 7fc0f5db6640 1 -- 172.21.15.99:0/2850814482 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e8009900 con 0x7fc0f01069f0 2024-01-31T05:12:29.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.728+0000 7fc0f5db6640 1 --2- 172.21.15.99:0/2850814482 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0f01069f0 0x7fc0f019e280 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8005cc0 tx=0x7fc0e8032a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:29.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.728+0000 7fc0e67fc640 1 -- 172.21.15.99:0/2850814482 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e8034e80 con 0x7fc0f01069f0 2024-01-31T05:12:29.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.729+0000 7fc0f7819640 1 -- 172.21.15.99:0/2850814482 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0f019eda0 con 0x7fc0f01069f0 2024-01-31T05:12:29.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.729+0000 7fc0e67fc640 1 -- 172.21.15.99:0/2850814482 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc0e8032e90 con 0x7fc0f01069f0 2024-01-31T05:12:29.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.729+0000 7fc0e67fc640 1 -- 172.21.15.99:0/2850814482 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e803d3f0 con 0x7fc0f01069f0 2024-01-31T05:12:29.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.729+0000 7fc0f7819640 1 -- 172.21.15.99:0/2850814482 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0f019f1c0 con 0x7fc0f01069f0 2024-01-31T05:12:29.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.731+0000 7fc0e67fc640 1 -- 172.21.15.99:0/2850814482 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 135946+0+0 (secure 0 0 0) 0x7fc0e803b040 con 0x7fc0f01069f0 2024-01-31T05:12:29.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.732+0000 7fc0e67fc640 1 --2- 172.21.15.99:0/2850814482 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc0dc0a1370 0x7fc0dc0a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:29.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.732+0000 7fc0f55b5640 1 --2- 172.21.15.99:0/2850814482 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc0dc0a1370 0x7fc0dc0a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:29.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.732+0000 7fc0e67fc640 1 -- 172.21.15.99:0/2850814482 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fc0e80ef390 con 0x7fc0f01069f0 2024-01-31T05:12:29.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.733+0000 7fc0f55b5640 1 --2- 172.21.15.99:0/2850814482 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc0dc0a1370 0x7fc0dc0a3830 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc0f01981e0 tx=0x7fc0ec00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:29.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.733+0000 7fc0fa5d9740 1 Processor -- start 2024-01-31T05:12:29.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.733+0000 7fc0fa5d9740 1 -- start start 2024-01-31T05:12:29.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.733+0000 7fc0fa5d9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5607f8f91a20 0x5607f8f91e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:29.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.733+0000 7fc0fa5d9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607f8f92410 0x5607f8f96f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:29.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.733+0000 7fc0fa5d9740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607f8f97580 0x5607f8f99a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:29.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.733+0000 7fc0fa5d9740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607f8f00380 con 0x5607f8f97580 2024-01-31T05:12:29.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.733+0000 7fc0fa5d9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607f8efda70 con 0x5607f8f92410 2024-01-31T05:12:29.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.733+0000 7fc0fa5d9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607f8ef9360 con 0x5607f8f91a20 2024-01-31T05:12:29.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.733+0000 7fc0f5db6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607f8f97580 0x5607f8f99a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:29.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.733+0000 7fc0f5db6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607f8f97580 0x5607f8f99a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33458/0 (socket says 172.21.15.99:33458) 2024-01-31T05:12:29.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.733+0000 7fc0f5db6640 1 -- 172.21.15.99:0/331063795 learned_addr learned my addr 172.21.15.99:0/331063795 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:29.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.733+0000 7fc0f4db4640 1 --2- 172.21.15.99:0/331063795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607f8f92410 0x5607f8f96f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:29.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.734+0000 7fc0f55b5640 1 --2- 172.21.15.99:0/331063795 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5607f8f91a20 0x5607f8f91e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:29.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.734+0000 7fc0f5db6640 1 -- 172.21.15.99:0/331063795 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5607f8f91a20 msgr2=0x5607f8f91e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:29.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.734+0000 7fc0f5db6640 1 --2- 172.21.15.99:0/331063795 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5607f8f91a20 0x5607f8f91e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:29.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.734+0000 7fc0f5db6640 1 -- 172.21.15.99:0/331063795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607f8f92410 msgr2=0x5607f8f96f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:29.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.734+0000 7fc0f5db6640 1 --2- 172.21.15.99:0/331063795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607f8f92410 0x5607f8f96f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:29.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.734+0000 7fc0f5db6640 1 -- 172.21.15.99:0/331063795 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5607f8ebb7e0 con 0x5607f8f97580 2024-01-31T05:12:29.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.734+0000 7fc0f5db6640 1 --2- 172.21.15.99:0/331063795 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607f8f97580 0x5607f8f99a10 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fc0e80c4400 tx=0x7fc0e80bc1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc28991eaa1af4c0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:29.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.734+0000 7fc0db7fe640 1 -- 172.21.15.99:0/331063795 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e80ef1f0 con 0x5607f8f97580 2024-01-31T05:12:29.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.734+0000 7fc0db7fe640 1 -- 172.21.15.99:0/331063795 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc0e80bcca0 con 0x5607f8f97580 2024-01-31T05:12:29.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.734+0000 7fc0db7fe640 1 -- 172.21.15.99:0/331063795 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e80bbc90 con 0x5607f8f97580 2024-01-31T05:12:29.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.735+0000 7fc0fa5d9740 1 -- 172.21.15.99:0/331063795 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607f8f97580 msgr2=0x5607f8f99a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:29.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.735+0000 7fc0fa5d9740 1 --2- 172.21.15.99:0/331063795 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607f8f97580 0x5607f8f99a10 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fc0e80c4400 tx=0x7fc0e80bc1a0 comp rx=0 tx=0).stop 2024-01-31T05:12:29.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.735+0000 7fc0fa5d9740 1 -- 172.21.15.99:0/331063795 shutdown_connections 2024-01-31T05:12:29.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.735+0000 7fc0fa5d9740 1 --2- 172.21.15.99:0/331063795 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607f8f97580 0x5607f8f99a10 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:29.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.735+0000 7fc0fa5d9740 1 --2- 172.21.15.99:0/331063795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607f8f92410 0x5607f8f96f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:29.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.735+0000 7fc0fa5d9740 1 --2- 172.21.15.99:0/331063795 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5607f8f91a20 0x5607f8f91e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:29.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.735+0000 7fc0fa5d9740 1 -- 172.21.15.99:0/331063795 >> 172.21.15.99:0/331063795 conn(0x5607f8f8cf90 msgr2=0x5607f8f8d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:29.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.735+0000 7fc0fa5d9740 1 -- 172.21.15.99:0/331063795 shutdown_connections 2024-01-31T05:12:29.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.735+0000 7fc0fa5d9740 1 -- 172.21.15.99:0/331063795 wait complete. 2024-01-31T05:12:29.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.735+0000 7fc0fa5d9740 1 -- start start 2024-01-31T05:12:29.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.735+0000 7fc0fa5d9740 1 Processor -- start 2024-01-31T05:12:29.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.736+0000 7fc0fa5d9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607f8f91a20 0x5607f8f9b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:29.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.736+0000 7fc0fa5d9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5607f8f92410 0x5607f8f9bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:29.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.736+0000 7fc0fa5d9740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607f8f97580 0x5607f8fa2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:29.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.736+0000 7fc0fa5d9740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607f8eb2750 con 0x5607f8f97580 2024-01-31T05:12:29.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.736+0000 7fc0fa5d9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607f8eb23f0 con 0x5607f8f91a20 2024-01-31T05:12:29.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.736+0000 7fc0fa5d9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607f8e773f0 con 0x5607f8f92410 2024-01-31T05:12:29.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.736+0000 7fc0f5db6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607f8f97580 0x5607f8fa2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:29.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.736+0000 7fc0f5db6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607f8f97580 0x5607f8fa2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33472/0 (socket says 172.21.15.99:33472) 2024-01-31T05:12:29.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.736+0000 7fc0f5db6640 1 -- 172.21.15.99:0/1428541007 learned_addr learned my addr 172.21.15.99:0/1428541007 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:29.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.736+0000 7fc0f55b5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607f8f91a20 0x5607f8f9b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:29.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.736+0000 7fc0fa5d9740 10 client.0 _ll_register_callbacks cb 0x5607f8eb4b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:12:29.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.736+0000 7fc0f4db4640 1 --2- 172.21.15.99:0/1428541007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5607f8f92410 0x5607f8f9bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:29.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.736+0000 7fc0f5db6640 1 -- 172.21.15.99:0/1428541007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5607f8f92410 msgr2=0x5607f8f9bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:29.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.736+0000 7fc0f5db6640 1 --2- 172.21.15.99:0/1428541007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5607f8f92410 0x5607f8f9bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:29.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.736+0000 7fc0f5db6640 1 -- 172.21.15.99:0/1428541007 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607f8f91a20 msgr2=0x5607f8f9b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:29.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.736+0000 7fc0f5db6640 1 --2- 172.21.15.99:0/1428541007 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607f8f91a20 0x5607f8f9b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:29.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.736+0000 7fc0f5db6640 1 -- 172.21.15.99:0/1428541007 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0f019f1c0 con 0x5607f8f97580 2024-01-31T05:12:29.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.737+0000 7fc0f4db4640 1 --2- 172.21.15.99:0/1428541007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5607f8f92410 0x5607f8f9bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:12:29.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.737+0000 7fc0f5db6640 1 --2- 172.21.15.99:0/1428541007 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607f8f97580 0x5607f8fa2d90 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fc0e802c130 tx=0x7fc0e80c49a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e321be5dec5304c server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:29.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.737+0000 7fc0d8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:12:29.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.737+0000 7fc0d8ff9640 1 -- 172.21.15.99:0/1428541007 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e80bbc90 con 0x5607f8f97580 2024-01-31T05:12:29.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.737+0000 7fc0d8ff9640 1 -- 172.21.15.99:0/1428541007 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fc0e80bc5a0 con 0x5607f8f97580 2024-01-31T05:12:29.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.737+0000 7fc0fa5d9740 1 -- 172.21.15.99:0/1428541007 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5607f8ece210 con 0x5607f8f97580 2024-01-31T05:12:29.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.737+0000 7fc0d8ff9640 1 -- 172.21.15.99:0/1428541007 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc0e80bcca0 con 0x5607f8f97580 2024-01-31T05:12:29.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.737+0000 7fc0fa5d9740 10 client.15711 fetch_fsmap learned FSMap version 27 2024-01-31T05:12:29.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.737+0000 7fc0fa5d9740 1 -- 172.21.15.99:0/1428541007 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5607f8ef79e0 con 0x5607f8f97580 2024-01-31T05:12:29.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.737+0000 7fc0d8ff9640 1 -- 172.21.15.99:0/1428541007 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc0e80a1020 con 0x5607f8f97580 2024-01-31T05:12:29.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.737+0000 7fc0d8ff9640 1 -- 172.21.15.99:0/1428541007 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc0e8004cd0 con 0x5607f8f97580 2024-01-31T05:12:29.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.738+0000 7fc0fa5d9740 10 client.15711 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:12:29.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.738+0000 7fc0fa5d9740 10 client.15711 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-01-31T05:12:29.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.738+0000 7fc0fa5d9740 20 client.15711 populate_metadata read hostname 'smithi099' 2024-01-31T05:12:29.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.738+0000 7fc0fa5d9740 1 --2- 172.21.15.99:0/1428541007 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5607f8fa7530 0x5607f8fa9940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:29.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.738+0000 7fc0fa5d9740 4 client.15711 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:12:29.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.738+0000 7fc0fa5d9740 1 -- 172.21.15.99:0/1428541007 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5607f8ece210 con 0x5607f8fa7530 2024-01-31T05:12:29.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.738+0000 7fc0f55b5640 1 --2- 172.21.15.99:0/1428541007 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5607f8fa7530 0x5607f8fa9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:29.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.738+0000 7fc0d8ff9640 10 client.15711 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:12:29.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.738+0000 7fc0f55b5640 1 --2- 172.21.15.99:0/1428541007 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5607f8fa7530 0x5607f8fa9940 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce0bef2caada4c34 server_cookie=d99eabd799d0a427 in_seq=0 out_seq=0 2024-01-31T05:12:29.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.739+0000 7fc0d8ff9640 1 -- 172.21.15.99:0/1428541007 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5607f8ece210 con 0x5607f8fa7530 2024-01-31T05:12:29.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.739+0000 7fc0d8ff9640 10 client.15711 handle_command_reply: tid=0 2024-01-31T05:12:29.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.739+0000 7fc0fa5d9740 1 client.15711 shutdown 2024-01-31T05:12:29.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.739+0000 7fc0fa5d9740 1 -- 172.21.15.99:0/1428541007 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607f8f97580 msgr2=0x5607f8fa2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:29.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.739+0000 7fc0fa5d9740 1 --2- 172.21.15.99:0/1428541007 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607f8f97580 0x5607f8fa2d90 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fc0e802c130 tx=0x7fc0e80c49a0 comp rx=0 tx=0).stop 2024-01-31T05:12:29.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.739+0000 7fc0fa5d9740 1 -- 172.21.15.99:0/1428541007 shutdown_connections 2024-01-31T05:12:29.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.739+0000 7fc0fa5d9740 1 --2- 172.21.15.99:0/1428541007 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607f8f97580 0x5607f8fa2d90 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:29.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.739+0000 7fc0fa5d9740 1 --2- 172.21.15.99:0/1428541007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5607f8f92410 0x5607f8f9bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:29.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.739+0000 7fc0fa5d9740 1 --2- 172.21.15.99:0/1428541007 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5607f8fa7530 0x5607f8fa9940 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:29.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.739+0000 7fc0fa5d9740 1 --2- 172.21.15.99:0/1428541007 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607f8f91a20 0x5607f8f9b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:29.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.739+0000 7fc0fa5d9740 1 -- 172.21.15.99:0/1428541007 >> 172.21.15.99:0/1428541007 conn(0x5607f8f8cf90 msgr2=0x5607f8f8c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:29.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.739+0000 7fc0d8ff9640 0 client.15711 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:12:29.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.739+0000 7fc0fa5d9740 1 -- 172.21.15.99:0/1428541007 shutdown_connections 2024-01-31T05:12:29.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.739+0000 7fc0fa5d9740 1 -- 172.21.15.99:0/1428541007 wait complete. 2024-01-31T05:12:29.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.740+0000 7fc0fa5d9740 20 client.15711 trim_cache size 0 max 16384 2024-01-31T05:12:29.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.754+0000 7fc0fa5d9740 1 Processor -- start 2024-01-31T05:12:29.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.754+0000 7fc0fa5d9740 1 -- start start 2024-01-31T05:12:29.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.755+0000 7fc0fa5d9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607f8f91a20 0x5607f8f9b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:29.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.755+0000 7fc0fa5d9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5607f8f92410 0x5607f8f9bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:29.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.755+0000 7fc0fa5d9740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607f8f97580 0x5607f8fa2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:29.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.755+0000 7fc0fa5d9740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607f8ece210 con 0x5607f8f97580 2024-01-31T05:12:29.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.755+0000 7fc0fa5d9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607f8f92b00 con 0x5607f8f91a20 2024-01-31T05:12:29.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.755+0000 7fc0fa5d9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607f8f88a60 con 0x5607f8f92410 2024-01-31T05:12:29.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.755+0000 7fc0f5db6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607f8f97580 0x5607f8fa2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:29.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.755+0000 7fc0f5db6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607f8f97580 0x5607f8fa2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33488/0 (socket says 172.21.15.99:33488) 2024-01-31T05:12:29.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.755+0000 7fc0f5db6640 1 -- 172.21.15.99:0/2854908323 learned_addr learned my addr 172.21.15.99:0/2854908323 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:29.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.755+0000 7fc0f4db4640 1 --2- 172.21.15.99:0/2854908323 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5607f8f92410 0x5607f8f9bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:29.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.755+0000 7fc0f55b5640 1 --2- 172.21.15.99:0/2854908323 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607f8f91a20 0x5607f8f9b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:29.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.755+0000 7fc0f5db6640 1 -- 172.21.15.99:0/2854908323 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5607f8f92410 msgr2=0x5607f8f9bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:29.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.755+0000 7fc0f5db6640 1 --2- 172.21.15.99:0/2854908323 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5607f8f92410 0x5607f8f9bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:29.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.755+0000 7fc0f5db6640 1 -- 172.21.15.99:0/2854908323 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607f8f91a20 msgr2=0x5607f8f9b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:29.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.755+0000 7fc0f5db6640 1 --2- 172.21.15.99:0/2854908323 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607f8f91a20 0x5607f8f9b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:29.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.755+0000 7fc0f5db6640 1 -- 172.21.15.99:0/2854908323 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5607f8e944f0 con 0x5607f8f97580 2024-01-31T05:12:29.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.755+0000 7fc0f55b5640 1 --2- 172.21.15.99:0/2854908323 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607f8f91a20 0x5607f8f9b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:12:29.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.755+0000 7fc0f5db6640 1 --2- 172.21.15.99:0/2854908323 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607f8f97580 0x5607f8fa2d50 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fc0e80bc530 tx=0x7fc0e80b88e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57071442476b4297 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:29.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.756+0000 7fc0daffd640 1 -- 172.21.15.99:0/2854908323 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e80c06f0 con 0x5607f8f97580 2024-01-31T05:12:29.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.756+0000 7fc0daffd640 1 -- 172.21.15.99:0/2854908323 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc0e80a1040 con 0x5607f8f97580 2024-01-31T05:12:29.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.756+0000 7fc0daffd640 1 -- 172.21.15.99:0/2854908323 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e80bcca0 con 0x5607f8f97580 2024-01-31T05:12:29.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.756+0000 7fc0fa5d9740 1 -- 172.21.15.99:0/2854908323 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607f8f97580 msgr2=0x5607f8fa2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:29.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.756+0000 7fc0fa5d9740 1 --2- 172.21.15.99:0/2854908323 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607f8f97580 0x5607f8fa2d50 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fc0e80bc530 tx=0x7fc0e80b88e0 comp rx=0 tx=0).stop 2024-01-31T05:12:29.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.756+0000 7fc0fa5d9740 1 -- 172.21.15.99:0/2854908323 shutdown_connections 2024-01-31T05:12:29.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.756+0000 7fc0fa5d9740 1 --2- 172.21.15.99:0/2854908323 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607f8f97580 0x5607f8fa2d50 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:29.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.756+0000 7fc0fa5d9740 1 --2- 172.21.15.99:0/2854908323 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5607f8f92410 0x5607f8f9bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:29.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.756+0000 7fc0fa5d9740 1 --2- 172.21.15.99:0/2854908323 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607f8f91a20 0x5607f8f9b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:29.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.756+0000 7fc0fa5d9740 1 -- 172.21.15.99:0/2854908323 >> 172.21.15.99:0/2854908323 conn(0x5607f8f8cf90 msgr2=0x5607f8f8d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:29.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.756+0000 7fc0fa5d9740 1 -- 172.21.15.99:0/2854908323 shutdown_connections 2024-01-31T05:12:29.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.757+0000 7fc0fa5d9740 1 -- 172.21.15.99:0/2854908323 wait complete. 2024-01-31T05:12:29.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.757+0000 7fc0fa5d9740 1 -- start start 2024-01-31T05:12:29.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.757+0000 7fc0fa5d9740 1 Processor -- start 2024-01-31T05:12:29.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.757+0000 7fc0fa5d9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607f8f91a20 0x5607f8fa2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:29.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.757+0000 7fc0fa5d9740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607f8f92410 0x5607f8fa0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:29.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.757+0000 7fc0fa5d9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5607f8f97580 0x5607f8fa13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:29.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.757+0000 7fc0fa5d9740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607f8fa3050 con 0x5607f8f92410 2024-01-31T05:12:29.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.757+0000 7fc0f4db4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607f8f92410 0x5607f8fa0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:29.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.757+0000 7fc0f4db4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607f8f92410 0x5607f8fa0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33492/0 (socket says 172.21.15.99:33492) 2024-01-31T05:12:29.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.757+0000 7fc0f4db4640 1 -- 172.21.15.99:0/462301062 learned_addr learned my addr 172.21.15.99:0/462301062 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:29.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.758+0000 7fc0f55b5640 1 --2- 172.21.15.99:0/462301062 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607f8f91a20 0x5607f8fa2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:29.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.757+0000 7fc0fa5d9740 1 -- 172.21.15.99:0/462301062 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607f8fa18f0 con 0x5607f8f91a20 2024-01-31T05:12:29.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.758+0000 7fc0fa5d9740 1 -- 172.21.15.99:0/462301062 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607f8fa1ab0 con 0x5607f8f97580 2024-01-31T05:12:29.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.758+0000 7fc0fa5d9740 10 client.0 _ll_register_callbacks cb 0x7fc0e80ecee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:12:29.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.758+0000 7fc0f5db6640 1 --2- 172.21.15.99:0/462301062 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5607f8f97580 0x5607f8fa13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:29.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.758+0000 7fc0f4db4640 1 -- 172.21.15.99:0/462301062 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5607f8f97580 msgr2=0x5607f8fa13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:29.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.758+0000 7fc0f4db4640 1 --2- 172.21.15.99:0/462301062 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5607f8f97580 0x5607f8fa13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:29.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.758+0000 7fc0f4db4640 1 -- 172.21.15.99:0/462301062 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607f8f91a20 msgr2=0x5607f8fa2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:29.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.758+0000 7fc0f4db4640 1 --2- 172.21.15.99:0/462301062 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607f8f91a20 0x5607f8fa2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:29.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.758+0000 7fc0f4db4640 1 -- 172.21.15.99:0/462301062 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5607f8ef79e0 con 0x5607f8f92410 2024-01-31T05:12:29.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.758+0000 7fc0f4db4640 1 --2- 172.21.15.99:0/462301062 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607f8f92410 0x5607f8fa0e70 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0069af0 tx=0x7fc0e00138f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cb89617022aefd3 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:29.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.758+0000 7fc0d8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:12:29.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.758+0000 7fc0d8ff9640 1 -- 172.21.15.99:0/462301062 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e0018070 con 0x5607f8f92410 2024-01-31T05:12:29.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.758+0000 7fc0fa5d9740 1 -- 172.21.15.99:0/462301062 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5607f8f20bd0 con 0x5607f8f92410 2024-01-31T05:12:29.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.758+0000 7fc0d8ff9640 1 -- 172.21.15.99:0/462301062 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fc0e00047a0 con 0x5607f8f92410 2024-01-31T05:12:29.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.758+0000 7fc0d8ff9640 1 -- 172.21.15.99:0/462301062 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc0e0004960 con 0x5607f8f92410 2024-01-31T05:12:29.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.758+0000 7fc0fa5d9740 10 client.15717 fetch_fsmap learned FSMap version 27 2024-01-31T05:12:29.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.758+0000 7fc0fa5d9740 1 -- 172.21.15.99:0/462301062 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5607f8eba040 con 0x5607f8f92410 2024-01-31T05:12:29.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.759+0000 7fc0d8ff9640 1 -- 172.21.15.99:0/462301062 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5607f8f20bd0 con 0x5607f8f92410 2024-01-31T05:12:29.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.759+0000 7fc0d8ff9640 1 -- 172.21.15.99:0/462301062 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc0e00117a0 con 0x5607f8f92410 2024-01-31T05:12:29.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.759+0000 7fc0fa5d9740 10 client.15717 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:12:29.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.759+0000 7fc0fa5d9740 10 client.15717 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-01-31T05:12:29.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.759+0000 7fc0fa5d9740 20 client.15717 populate_metadata read hostname 'smithi099' 2024-01-31T05:12:29.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.759+0000 7fc0fa5d9740 1 --2- 172.21.15.99:0/462301062 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5607f8fff150 0x5607f9001570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:29.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.759+0000 7fc0fa5d9740 4 client.15717 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-01-31T05:12:29.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.759+0000 7fc0fa5d9740 1 -- 172.21.15.99:0/462301062 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5607f8ecbb20 con 0x5607f8fff150 2024-01-31T05:12:29.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.759+0000 7fc0f55b5640 1 --2- 172.21.15.99:0/462301062 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5607f8fff150 0x5607f9001570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:29.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.760+0000 7fc0d8ff9640 10 client.15717 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:12:29.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.760+0000 7fc0f55b5640 1 --2- 172.21.15.99:0/462301062 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5607f8fff150 0x5607f9001570 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1549aabbd9a9e5d5 server_cookie=f26271ec70c4bea0 in_seq=0 out_seq=0 2024-01-31T05:12:29.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.760+0000 7fc0d8ff9640 1 -- 172.21.15.99:0/462301062 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5607f8ecbb20 con 0x5607f8fff150 2024-01-31T05:12:29.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.760+0000 7fc0d8ff9640 10 client.15717 handle_command_reply: tid=0 2024-01-31T05:12:29.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.760+0000 7fc0fa5d9740 1 client.15717 shutdown 2024-01-31T05:12:29.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.760+0000 7fc0fa5d9740 1 -- 172.21.15.99:0/462301062 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607f8f92410 msgr2=0x5607f8fa0e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:29.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.760+0000 7fc0fa5d9740 1 --2- 172.21.15.99:0/462301062 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607f8f92410 0x5607f8fa0e70 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0069af0 tx=0x7fc0e00138f0 comp rx=0 tx=0).stop 2024-01-31T05:12:29.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.760+0000 7fc0fa5d9740 1 -- 172.21.15.99:0/462301062 shutdown_connections 2024-01-31T05:12:29.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.760+0000 7fc0fa5d9740 1 --2- 172.21.15.99:0/462301062 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5607f8f97580 0x5607f8fa13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:29.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.760+0000 7fc0fa5d9740 1 --2- 172.21.15.99:0/462301062 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607f8f92410 0x5607f8fa0e70 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:29.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.760+0000 7fc0fa5d9740 1 --2- 172.21.15.99:0/462301062 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5607f8fff150 0x5607f9001570 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:29.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.760+0000 7fc0fa5d9740 1 --2- 172.21.15.99:0/462301062 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607f8f91a20 0x5607f8fa2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:29.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.760+0000 7fc0fa5d9740 1 -- 172.21.15.99:0/462301062 >> 172.21.15.99:0/462301062 conn(0x5607f8f8cf90 msgr2=0x5607f8f93830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:29.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.760+0000 7fc0d8ff9640 0 client.15717 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:12:29.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.760+0000 7fc0fa5d9740 1 -- 172.21.15.99:0/462301062 shutdown_connections 2024-01-31T05:12:29.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.760+0000 7fc0fa5d9740 1 -- 172.21.15.99:0/462301062 wait complete. 2024-01-31T05:12:29.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.760+0000 7fc0fa5d9740 20 client.15717 trim_cache size 0 max 16384 2024-01-31T05:12:29.765 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-01-31T05:12:29.765 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "no active scrubs running", 2024-01-31T05:12:29.765 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": {} 2024-01-31T05:12:29.765 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-01-31T05:12:29.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.761+0000 7fc0f7819640 1 -- 172.21.15.99:0/2850814482 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc0dc0a1370 msgr2=0x7fc0dc0a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:29.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.761+0000 7fc0f7819640 1 --2- 172.21.15.99:0/2850814482 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc0dc0a1370 0x7fc0dc0a3830 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc0f01981e0 tx=0x7fc0ec00b390 comp rx=0 tx=0).stop 2024-01-31T05:12:29.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.761+0000 7fc0f7819640 1 -- 172.21.15.99:0/2850814482 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0f01069f0 msgr2=0x7fc0f019e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:29.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.761+0000 7fc0f7819640 1 --2- 172.21.15.99:0/2850814482 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0f01069f0 0x7fc0f019e280 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8005cc0 tx=0x7fc0e8032a40 comp rx=0 tx=0).stop 2024-01-31T05:12:29.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.761+0000 7fc0f7819640 1 -- 172.21.15.99:0/2850814482 shutdown_connections 2024-01-31T05:12:29.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.761+0000 7fc0f7819640 1 --2- 172.21.15.99:0/2850814482 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc0dc0a1370 0x7fc0dc0a3830 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:29.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.761+0000 7fc0f7819640 1 --2- 172.21.15.99:0/2850814482 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0f01069f0 0x7fc0f019e280 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:29.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.761+0000 7fc0f7819640 1 --2- 172.21.15.99:0/2850814482 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc0f01040c0 0x7fc0f0197250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:29.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.761+0000 7fc0f7819640 1 --2- 172.21.15.99:0/2850814482 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0f0101790 0x7fc0f0196d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:29.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.761+0000 7fc0f7819640 1 -- 172.21.15.99:0/2850814482 >> 172.21.15.99:0/2850814482 conn(0x7fc0f00fb180 msgr2=0x7fc0f0102250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:29.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.761+0000 7fc0f7819640 1 -- 172.21.15.99:0/2850814482 shutdown_connections 2024-01-31T05:12:29.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.761+0000 7fc0f7819640 1 -- 172.21.15.99:0/2850814482 wait complete. 2024-01-31T05:12:29.771 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-01-31T05:12:29.771 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T05:12:29.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.874+0000 7efda2f85640 1 -- 172.21.15.99:0/783448747 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efd9c106a70 msgr2=0x7efd9c108e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:29.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.874+0000 7efda2f85640 1 --2- 172.21.15.99:0/783448747 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efd9c106a70 0x7efd9c108e60 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7efd94009ca0 tx=0x7efd9402c0f0 comp rx=0 tx=0).stop 2024-01-31T05:12:29.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.874+0000 7efda2f85640 1 -- 172.21.15.99:0/783448747 shutdown_connections 2024-01-31T05:12:29.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.874+0000 7efda2f85640 1 --2- 172.21.15.99:0/783448747 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efd9c106a70 0x7efd9c108e60 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:29.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.874+0000 7efda2f85640 1 --2- 172.21.15.99:0/783448747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd9c104140 0x7efd9c106530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:29.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.874+0000 7efda2f85640 1 --2- 172.21.15.99:0/783448747 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efd9c101810 0x7efd9c103c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:29.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.874+0000 7efda2f85640 1 -- 172.21.15.99:0/783448747 >> 172.21.15.99:0/783448747 conn(0x7efd9c0fb1a0 msgr2=0x7efd9c0fd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:29.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.874+0000 7efda2f85640 1 -- 172.21.15.99:0/783448747 shutdown_connections 2024-01-31T05:12:29.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.875+0000 7efda2f85640 1 -- 172.21.15.99:0/783448747 wait complete. 2024-01-31T05:12:29.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.875+0000 7efda2f85640 1 Processor -- start 2024-01-31T05:12:29.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.875+0000 7efda2f85640 1 -- start start 2024-01-31T05:12:29.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.875+0000 7efda2f85640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efd9c101810 0x7efd9c196d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:29.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.875+0000 7efda2f85640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd9c104140 0x7efd9c197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:29.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.875+0000 7efda2f85640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efd9c106a70 0x7efd9c19e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:29.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.875+0000 7efda2f85640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9c19e810 con 0x7efd9c106a70 2024-01-31T05:12:29.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.875+0000 7efda2f85640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9c19e980 con 0x7efd9c104140 2024-01-31T05:12:29.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.875+0000 7efda2f85640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9c19eb40 con 0x7efd9c101810 2024-01-31T05:12:29.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.875+0000 7efda1522640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efd9c106a70 0x7efd9c19e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:29.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.875+0000 7efda1522640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efd9c106a70 0x7efd9c19e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33510/0 (socket says 172.21.15.99:33510) 2024-01-31T05:12:29.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.875+0000 7efda1522640 1 -- 172.21.15.99:0/1995826880 learned_addr learned my addr 172.21.15.99:0/1995826880 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:29.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.876+0000 7efda0d21640 1 --2- 172.21.15.99:0/1995826880 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efd9c101810 0x7efd9c196d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:29.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.876+0000 7efd9bfff640 1 --2- 172.21.15.99:0/1995826880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd9c104140 0x7efd9c197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:29.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.876+0000 7efda1522640 1 -- 172.21.15.99:0/1995826880 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efd9c101810 msgr2=0x7efd9c196d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:29.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.876+0000 7efda1522640 1 --2- 172.21.15.99:0/1995826880 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efd9c101810 0x7efd9c196d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:29.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.876+0000 7efda1522640 1 -- 172.21.15.99:0/1995826880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd9c104140 msgr2=0x7efd9c197270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:29.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.876+0000 7efda1522640 1 --2- 172.21.15.99:0/1995826880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd9c104140 0x7efd9c197270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:29.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.876+0000 7efda1522640 1 -- 172.21.15.99:0/1995826880 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd88009490 con 0x7efd9c106a70 2024-01-31T05:12:29.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.876+0000 7efda0d21640 1 --2- 172.21.15.99:0/1995826880 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efd9c101810 0x7efd9c196d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:12:29.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.876+0000 7efda1522640 1 --2- 172.21.15.99:0/1995826880 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efd9c106a70 0x7efd9c19e2a0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7efd94005cc0 tx=0x7efd94032790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:29.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.876+0000 7efd99ffb640 1 -- 172.21.15.99:0/1995826880 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd94034c70 con 0x7efd9c106a70 2024-01-31T05:12:29.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.876+0000 7efda2f85640 1 -- 172.21.15.99:0/1995826880 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd94009900 con 0x7efd9c106a70 2024-01-31T05:12:29.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.876+0000 7efd99ffb640 1 -- 172.21.15.99:0/1995826880 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efd94003e30 con 0x7efd9c106a70 2024-01-31T05:12:29.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.876+0000 7efd99ffb640 1 -- 172.21.15.99:0/1995826880 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd940047f0 con 0x7efd9c106a70 2024-01-31T05:12:29.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.876+0000 7efda2f85640 1 -- 172.21.15.99:0/1995826880 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd9c19f100 con 0x7efd9c106a70 2024-01-31T05:12:29.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.878+0000 7efda2f85640 1 -- 172.21.15.99:0/1995826880 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd9c0fcc90 con 0x7efd9c106a70 2024-01-31T05:12:29.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.879+0000 7efd99ffb640 1 -- 172.21.15.99:0/1995826880 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 135946+0+0 (secure 0 0 0) 0x7efd9403b040 con 0x7efd9c106a70 2024-01-31T05:12:29.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.880+0000 7efd99ffb640 1 --2- 172.21.15.99:0/1995826880 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7efd8c0a13f0 0x7efd8c0a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:29.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.880+0000 7efda0d21640 1 --2- 172.21.15.99:0/1995826880 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7efd8c0a13f0 0x7efd8c0a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:29.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.880+0000 7efd99ffb640 1 -- 172.21.15.99:0/1995826880 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7efd940ef420 con 0x7efd9c106a70 2024-01-31T05:12:29.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.881+0000 7efda0d21640 1 --2- 172.21.15.99:0/1995826880 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7efd8c0a13f0 0x7efd8c0a38b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7efd9c198200 tx=0x7efd90005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:29.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:29.884+0000 7efd99ffb640 1 -- 172.21.15.99:0/1995826880 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7efd940b88e0 con 0x7efd9c106a70 2024-01-31T05:12:30.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:29 smithi099 ceph-mon[31615]: pgmap v382: 97 pgs: 97 active+clean; 670 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2024-01-31T05:12:30.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:29 smithi181 ceph-mon[36434]: pgmap v382: 97 pgs: 97 active+clean; 670 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2024-01-31T05:12:30.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.101+0000 7efda2f85640 1 -- 172.21.15.99:0/1995826880 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efd9c10c7d0 con 0x7efd9c106a70 2024-01-31T05:12:30.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.102+0000 7efd99ffb640 1 -- 172.21.15.99:0/1995826880 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11385 (secure 0 0 0) 0x7efd940ba810 con 0x7efd9c106a70 2024-01-31T05:12:30.101 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:12:30.101 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/1488539026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1488539026},{"type":"v1","addr":"172.21.15.99:6835","nonce":1488539026}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/1649552652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1649552652},{"type":"v1","addr":"172.21.15.99:6837","nonce":1649552652}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-01-31T05:09:20.564215+0000","modified":"2024-01-31T05:11:20.565526+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24461,"mds_2":24457,"mds_3":24439,"mds_4":14619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6839/4070477446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4070477446},{"type":"v1","addr":"172.21.15.99:6839","nonce":4070477446}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.99:6841/3069939345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6840","nonce":3069939345},{"type":"v1","addr":"172.21.15.99:6841","nonce":3069939345}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24376":{"gid":24376,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6833/427201290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":427201290},{"type":"v1","addr":"172.21.15.181:6833","nonce":427201290}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24401":{"gid":24401,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/472161020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":472161020},{"type":"v1","addr":"172.21.15.179:6833","nonce":472161020}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24427":{"gid":24427,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/1038715471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1038715471},{"type":"v1","addr":"172.21.15.181:6835","nonce":1038715471}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24434":{"gid":24434,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/966976592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":966976592},{"type":"v1","addr":"172.21.15.179:6835","nonce":966976592}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24439":{"gid":24439,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.181:6837/3875964154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3875964154},{"type":"v1","addr":"172.21.15.181:6837","nonce":3875964154}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24457":{"gid":24457,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.181:6839/996120687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":996120687},{"type":"v1","addr":"172.21.15.181:6839","nonce":996120687}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6837/837402830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":837402830},{"type":"v1","addr":"172.21.15.179:6837","nonce":837402830}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6839/754762785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":754762785},{"type":"v1","addr":"172.21.15.179:6839","nonce":754762785}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-31T05:12:30.102 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 27 2024-01-31T05:12:30.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.104+0000 7efda2f85640 1 -- 172.21.15.99:0/1995826880 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7efd8c0a13f0 msgr2=0x7efd8c0a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:30.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.104+0000 7efda2f85640 1 --2- 172.21.15.99:0/1995826880 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7efd8c0a13f0 0x7efd8c0a38b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7efd9c198200 tx=0x7efd90005f90 comp rx=0 tx=0).stop 2024-01-31T05:12:30.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.104+0000 7efda2f85640 1 -- 172.21.15.99:0/1995826880 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efd9c106a70 msgr2=0x7efd9c19e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:30.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.104+0000 7efda2f85640 1 --2- 172.21.15.99:0/1995826880 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efd9c106a70 0x7efd9c19e2a0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7efd94005cc0 tx=0x7efd94032790 comp rx=0 tx=0).stop 2024-01-31T05:12:30.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.104+0000 7efda2f85640 1 -- 172.21.15.99:0/1995826880 shutdown_connections 2024-01-31T05:12:30.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.104+0000 7efda2f85640 1 --2- 172.21.15.99:0/1995826880 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7efd8c0a13f0 0x7efd8c0a38b0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.104+0000 7efda2f85640 1 --2- 172.21.15.99:0/1995826880 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efd9c106a70 0x7efd9c19e2a0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.104+0000 7efda2f85640 1 --2- 172.21.15.99:0/1995826880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd9c104140 0x7efd9c197270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.104+0000 7efda2f85640 1 --2- 172.21.15.99:0/1995826880 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efd9c101810 0x7efd9c196d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.104+0000 7efda2f85640 1 -- 172.21.15.99:0/1995826880 >> 172.21.15.99:0/1995826880 conn(0x7efd9c0fb1a0 msgr2=0x7efd9c1020d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:30.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.104+0000 7efda2f85640 1 -- 172.21.15.99:0/1995826880 shutdown_connections 2024-01-31T05:12:30.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.105+0000 7efda2f85640 1 -- 172.21.15.99:0/1995826880 wait complete. 2024-01-31T05:12:30.115 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-01-31T05:12:30.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:29 smithi179 ceph-mon[35652]: pgmap v382: 97 pgs: 97 active+clean; 670 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2024-01-31T05:12:30.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.221+0000 7fb652bee640 1 -- 172.21.15.99:0/2216917899 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb64c100d20 msgr2=0x7fb64c101140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:30.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.221+0000 7fb652bee640 1 --2- 172.21.15.99:0/2216917899 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb64c100d20 0x7fb64c101140 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fb640009900 tx=0x7fb64002bc30 comp rx=0 tx=0).stop 2024-01-31T05:12:30.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.221+0000 7fb652bee640 1 -- 172.21.15.99:0/2216917899 shutdown_connections 2024-01-31T05:12:30.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.221+0000 7fb652bee640 1 --2- 172.21.15.99:0/2216917899 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb64c1028d0 0x7fb64c109160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.221+0000 7fb652bee640 1 --2- 172.21.15.99:0/2216917899 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb64c101f10 0x7fb64c102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.221+0000 7fb652bee640 1 --2- 172.21.15.99:0/2216917899 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb64c100d20 0x7fb64c101140 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.221+0000 7fb652bee640 1 -- 172.21.15.99:0/2216917899 >> 172.21.15.99:0/2216917899 conn(0x7fb64c0fc290 msgr2=0x7fb64c0fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:30.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.221+0000 7fb652bee640 1 -- 172.21.15.99:0/2216917899 shutdown_connections 2024-01-31T05:12:30.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.221+0000 7fb652bee640 1 -- 172.21.15.99:0/2216917899 wait complete. 2024-01-31T05:12:30.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.222+0000 7fb652bee640 1 Processor -- start 2024-01-31T05:12:30.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.222+0000 7fb652bee640 1 -- start start 2024-01-31T05:12:30.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.222+0000 7fb652bee640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb64c100d20 0x7fb64c196c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.222+0000 7fb652bee640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb64c101f10 0x7fb64c1971d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.222+0000 7fb652bee640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb64c1028d0 0x7fb64c19e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.222+0000 7fb652bee640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64c19e7a0 con 0x7fb64c101f10 2024-01-31T05:12:30.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.222+0000 7fb652bee640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64c19e910 con 0x7fb64c1028d0 2024-01-31T05:12:30.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.222+0000 7fb652bee640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64c19ead0 con 0x7fb64c100d20 2024-01-31T05:12:30.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.222+0000 7fb64bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb64c101f10 0x7fb64c1971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.222+0000 7fb64bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb64c101f10 0x7fb64c1971d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33520/0 (socket says 172.21.15.99:33520) 2024-01-31T05:12:30.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.222+0000 7fb64bfff640 1 -- 172.21.15.99:0/1713215027 learned_addr learned my addr 172.21.15.99:0/1713215027 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:30.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.222+0000 7fb65098a640 1 --2- 172.21.15.99:0/1713215027 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb64c100d20 0x7fb64c196c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.222+0000 7fb65118b640 1 --2- 172.21.15.99:0/1713215027 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb64c1028d0 0x7fb64c19e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.223+0000 7fb64bfff640 1 -- 172.21.15.99:0/1713215027 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb64c100d20 msgr2=0x7fb64c196c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:30.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.223+0000 7fb64bfff640 1 --2- 172.21.15.99:0/1713215027 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb64c100d20 0x7fb64c196c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.223+0000 7fb64bfff640 1 -- 172.21.15.99:0/1713215027 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb64c1028d0 msgr2=0x7fb64c19e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:30.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.223+0000 7fb64bfff640 1 --2- 172.21.15.99:0/1713215027 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb64c1028d0 0x7fb64c19e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.223+0000 7fb64bfff640 1 -- 172.21.15.99:0/1713215027 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb640009560 con 0x7fb64c101f10 2024-01-31T05:12:30.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.223+0000 7fb64bfff640 1 --2- 172.21.15.99:0/1713215027 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb64c101f10 0x7fb64c1971d0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fb63800d950 tx=0x7fb63800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:30.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.223+0000 7fb649ffb640 1 -- 172.21.15.99:0/1713215027 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb638009a30 con 0x7fb64c101f10 2024-01-31T05:12:30.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.223+0000 7fb652bee640 1 -- 172.21.15.99:0/1713215027 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb64c19edb0 con 0x7fb64c101f10 2024-01-31T05:12:30.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.223+0000 7fb649ffb640 1 -- 172.21.15.99:0/1713215027 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb638009b90 con 0x7fb64c101f10 2024-01-31T05:12:30.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.223+0000 7fb649ffb640 1 -- 172.21.15.99:0/1713215027 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6380047a0 con 0x7fb64c101f10 2024-01-31T05:12:30.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.223+0000 7fb652bee640 1 -- 172.21.15.99:0/1713215027 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb64c19f280 con 0x7fb64c101f10 2024-01-31T05:12:30.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.226+0000 7fb6559b2740 1 Processor -- start 2024-01-31T05:12:30.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.226+0000 7fb6559b2740 1 -- start start 2024-01-31T05:12:30.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.226+0000 7fb6559b2740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5cc9b0f10 0x55b5cc9b1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.226+0000 7fb6559b2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5cc9b1900 0x55b5cc9b6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.226+0000 7fb6559b2740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5cc9b6a70 0x55b5cc9b8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.226+0000 7fb6559b2740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5cc91f240 con 0x55b5cc9b6a70 2024-01-31T05:12:30.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.226+0000 7fb6559b2740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5cc91c930 con 0x55b5cc9b0f10 2024-01-31T05:12:30.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.226+0000 7fb6559b2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5cc918220 con 0x55b5cc9b1900 2024-01-31T05:12:30.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.226+0000 7fb65118b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5cc9b0f10 0x55b5cc9b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.226+0000 7fb649ffb640 1 -- 172.21.15.99:0/1713215027 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 135946+0+0 (secure 0 0 0) 0x7fb638009d00 con 0x7fb64c101f10 2024-01-31T05:12:30.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.226+0000 7fb65118b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5cc9b0f10 0x55b5cc9b1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.99:34776/0 (socket says 172.21.15.99:34776) 2024-01-31T05:12:30.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.226+0000 7fb65118b640 1 -- 172.21.15.99:0/1851211825 learned_addr learned my addr 172.21.15.99:0/1851211825 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:30.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.227+0000 7fb65098a640 1 --2- 172.21.15.99:0/1851211825 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5cc9b1900 0x55b5cc9b6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.227+0000 7fb65118b640 1 -- 172.21.15.99:0/1851211825 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5cc9b1900 msgr2=0x55b5cc9b6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:30.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.227+0000 7fb64bfff640 1 --2- 172.21.15.99:0/1851211825 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5cc9b6a70 0x55b5cc9b8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.227+0000 7fb65118b640 1 --2- 172.21.15.99:0/1851211825 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5cc9b1900 0x55b5cc9b6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.227+0000 7fb65118b640 1 -- 172.21.15.99:0/1851211825 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5cc9b6a70 msgr2=0x55b5cc9b8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:30.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.227+0000 7fb65118b640 1 --2- 172.21.15.99:0/1851211825 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5cc9b6a70 0x55b5cc9b8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.227+0000 7fb65118b640 1 -- 172.21.15.99:0/1851211825 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5cc8da7c0 con 0x55b5cc9b0f10 2024-01-31T05:12:30.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.227+0000 7fb64bfff640 1 --2- 172.21.15.99:0/1851211825 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5cc9b6a70 0x55b5cc9b8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:12:30.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.227+0000 7fb649ffb640 1 --2- 172.21.15.99:0/1713215027 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb63c0a13f0 0x7fb63c0a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.227+0000 7fb65118b640 1 --2- 172.21.15.99:0/1851211825 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5cc9b0f10 0x55b5cc9b1330 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb644007dd0 tx=0x7fb64400e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a62d72a9cad29924 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:30.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.227+0000 7fb649ffb640 1 -- 172.21.15.99:0/1713215027 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fb6380cc640 con 0x7fb64c101f10 2024-01-31T05:12:30.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.227+0000 7fb636ffd640 1 -- 172.21.15.99:0/1851211825 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb644004d20 con 0x55b5cc9b0f10 2024-01-31T05:12:30.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.227+0000 7fb636ffd640 1 -- 172.21.15.99:0/1851211825 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb644004e80 con 0x55b5cc9b0f10 2024-01-31T05:12:30.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.227+0000 7fb636ffd640 1 -- 172.21.15.99:0/1851211825 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb644010880 con 0x55b5cc9b0f10 2024-01-31T05:12:30.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.227+0000 7fb65098a640 1 --2- 172.21.15.99:0/1713215027 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb63c0a13f0 0x7fb63c0a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.228+0000 7fb6559b2740 1 -- 172.21.15.99:0/1851211825 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5cc9b0f10 msgr2=0x55b5cc9b1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:30.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.228+0000 7fb65098a640 1 --2- 172.21.15.99:0/1713215027 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb63c0a13f0 0x7fb63c0a38b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb640000c00 tx=0x7fb64002c5d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:30.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.228+0000 7fb6559b2740 1 --2- 172.21.15.99:0/1851211825 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5cc9b0f10 0x55b5cc9b1330 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb644007dd0 tx=0x7fb64400e720 comp rx=0 tx=0).stop 2024-01-31T05:12:30.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.228+0000 7fb6559b2740 1 -- 172.21.15.99:0/1851211825 shutdown_connections 2024-01-31T05:12:30.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.228+0000 7fb6559b2740 1 --2- 172.21.15.99:0/1851211825 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5cc9b6a70 0x55b5cc9b8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.228+0000 7fb6559b2740 1 --2- 172.21.15.99:0/1851211825 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5cc9b1900 0x55b5cc9b6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.228+0000 7fb6559b2740 1 --2- 172.21.15.99:0/1851211825 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5cc9b0f10 0x55b5cc9b1330 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.228+0000 7fb6559b2740 1 -- 172.21.15.99:0/1851211825 >> 172.21.15.99:0/1851211825 conn(0x55b5cc9ac480 msgr2=0x55b5cc9ac880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:30.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.228+0000 7fb6559b2740 1 -- 172.21.15.99:0/1851211825 shutdown_connections 2024-01-31T05:12:30.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.228+0000 7fb6559b2740 1 -- 172.21.15.99:0/1851211825 wait complete. 2024-01-31T05:12:30.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.229+0000 7fb6559b2740 1 -- start start 2024-01-31T05:12:30.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.229+0000 7fb6559b2740 1 Processor -- start 2024-01-31T05:12:30.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.229+0000 7fb6559b2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5cc9b0f10 0x55b5cc9bb130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.229+0000 7fb6559b2740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5cc9b1900 0x55b5cc9bb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.229+0000 7fb6559b2740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5cc9b6a70 0x55b5cc9c26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.229+0000 7fb6559b2740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5cc8d15e0 con 0x55b5cc9b6a70 2024-01-31T05:12:30.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.229+0000 7fb6559b2740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5cc8d1280 con 0x55b5cc9b1900 2024-01-31T05:12:30.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.229+0000 7fb6559b2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5cc8963d0 con 0x55b5cc9b0f10 2024-01-31T05:12:30.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.229+0000 7fb6559b2740 10 client.0 _ll_register_callbacks cb 0x55b5cc90eeb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:12:30.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.229+0000 7fb65118b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5cc9b6a70 0x55b5cc9c26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.229+0000 7fb65118b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5cc9b6a70 0x55b5cc9c26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33532/0 (socket says 172.21.15.99:33532) 2024-01-31T05:12:30.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.229+0000 7fb65118b640 1 -- 172.21.15.99:0/362327576 learned_addr learned my addr 172.21.15.99:0/362327576 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:30.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.229+0000 7fb65098a640 1 --2- 172.21.15.99:0/362327576 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5cc9b0f10 0x55b5cc9bb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.230+0000 7fb65118b640 1 -- 172.21.15.99:0/362327576 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5cc9b0f10 msgr2=0x55b5cc9bb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:30.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.230+0000 7fb65118b640 1 --2- 172.21.15.99:0/362327576 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5cc9b0f10 0x55b5cc9bb130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.230+0000 7fb65118b640 1 -- 172.21.15.99:0/362327576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5cc9b1900 msgr2=0x55b5cc9bb670 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-01-31T05:12:30.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.230+0000 7fb65118b640 1 --2- 172.21.15.99:0/362327576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5cc9b1900 0x55b5cc9bb670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.230+0000 7fb65118b640 1 -- 172.21.15.99:0/362327576 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb644007a00 con 0x55b5cc9b6a70 2024-01-31T05:12:30.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.230+0000 7fb65118b640 1 --2- 172.21.15.99:0/362327576 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5cc9b6a70 0x55b5cc9c26b0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fb64400ec20 tx=0x7fb6440118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=159d2dcbaddef8cb server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:30.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.230+0000 7fb62bfff640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:12:30.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.230+0000 7fb62bfff640 1 -- 172.21.15.99:0/362327576 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64401e070 con 0x55b5cc9b6a70 2024-01-31T05:12:30.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.230+0000 7fb62bfff640 1 -- 172.21.15.99:0/362327576 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fb644011c50 con 0x55b5cc9b6a70 2024-01-31T05:12:30.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.230+0000 7fb6559b2740 1 -- 172.21.15.99:0/362327576 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b5cc910dd0 con 0x55b5cc9b6a70 2024-01-31T05:12:30.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.230+0000 7fb62bfff640 1 -- 172.21.15.99:0/362327576 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb644011e10 con 0x55b5cc9b6a70 2024-01-31T05:12:30.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.230+0000 7fb6559b2740 10 client.15732 fetch_fsmap learned FSMap version 27 2024-01-31T05:12:30.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.230+0000 7fb6559b2740 1 -- 172.21.15.99:0/362327576 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55b5cc9168a0 con 0x55b5cc9b6a70 2024-01-31T05:12:30.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.230+0000 7fb62bfff640 1 -- 172.21.15.99:0/362327576 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b5cc910dd0 con 0x55b5cc9b6a70 2024-01-31T05:12:30.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.231+0000 7fb62bfff640 1 -- 172.21.15.99:0/362327576 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb64402b070 con 0x55b5cc9b6a70 2024-01-31T05:12:30.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.231+0000 7fb6559b2740 10 client.15732 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:12:30.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.231+0000 7fb6559b2740 10 client.15732 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-01-31T05:12:30.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.231+0000 7fb6559b2740 20 client.15732 populate_metadata read hostname 'smithi099' 2024-01-31T05:12:30.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.231+0000 7fb6559b2740 1 --2- 172.21.15.99:0/362327576 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x55b5cc9c6dd0 0x55b5cc9c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.231+0000 7fb6559b2740 4 client.15732 mds_command: new command op to 14619 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:12:30.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.231+0000 7fb6559b2740 1 -- 172.21.15.99:0/362327576 --> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b5cc6177e0 con 0x55b5cc9c6dd0 2024-01-31T05:12:30.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.231+0000 7fb65098a640 1 --2- 172.21.15.99:0/362327576 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x55b5cc9c6dd0 0x55b5cc9c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.231+0000 7fb65098a640 1 --2- 172.21.15.99:0/362327576 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x55b5cc9c6dd0 0x55b5cc9c91f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=fd22e13305560788 server_cookie=5f43e681c8968fe5 in_seq=0 out_seq=0 2024-01-31T05:12:30.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.231+0000 7fb62bfff640 10 client.15732 ms_handle_connect on v2:172.21.15.99:6840/3069939345 2024-01-31T05:12:30.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.232+0000 7fb62bfff640 1 -- 172.21.15.99:0/362327576 <== mds.4 v2:172.21.15.99:6840/3069939345 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b5cc6177e0 con 0x55b5cc9c6dd0 2024-01-31T05:12:30.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.232+0000 7fb62bfff640 10 client.15732 handle_command_reply: tid=0 2024-01-31T05:12:30.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.232+0000 7fb6559b2740 1 client.15732 shutdown 2024-01-31T05:12:30.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.232+0000 7fb6559b2740 1 -- 172.21.15.99:0/362327576 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5cc9b6a70 msgr2=0x55b5cc9c26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:30.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.232+0000 7fb6559b2740 1 --2- 172.21.15.99:0/362327576 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5cc9b6a70 0x55b5cc9c26b0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fb64400ec20 tx=0x7fb6440118d0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.232+0000 7fb6559b2740 1 -- 172.21.15.99:0/362327576 shutdown_connections 2024-01-31T05:12:30.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.232+0000 7fb6559b2740 1 --2- 172.21.15.99:0/362327576 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x55b5cc9c6dd0 0x55b5cc9c91f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.232+0000 7fb6559b2740 1 --2- 172.21.15.99:0/362327576 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5cc9b6a70 0x55b5cc9c26b0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.232+0000 7fb6559b2740 1 --2- 172.21.15.99:0/362327576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5cc9b1900 0x55b5cc9bb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.232+0000 7fb62bfff640 0 client.15732 ms_handle_reset on v2:172.21.15.99:6840/3069939345 2024-01-31T05:12:30.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.232+0000 7fb6559b2740 1 --2- 172.21.15.99:0/362327576 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5cc9b0f10 0x55b5cc9bb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.232+0000 7fb6559b2740 1 -- 172.21.15.99:0/362327576 >> 172.21.15.99:0/362327576 conn(0x55b5cc9ac480 msgr2=0x55b5cc9ab7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:30.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.232+0000 7fb6559b2740 1 -- 172.21.15.99:0/362327576 shutdown_connections 2024-01-31T05:12:30.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.232+0000 7fb6559b2740 1 -- 172.21.15.99:0/362327576 wait complete. 2024-01-31T05:12:30.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.233+0000 7fb6559b2740 20 client.15732 trim_cache size 0 max 16384 2024-01-31T05:12:30.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.244+0000 7fb6559b2740 1 Processor -- start 2024-01-31T05:12:30.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.244+0000 7fb6559b2740 1 -- start start 2024-01-31T05:12:30.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.244+0000 7fb6559b2740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5cc9b0f10 0x55b5cc9b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.244+0000 7fb6559b2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5cc9b1900 0x55b5cc9c2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.244+0000 7fb6559b2740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5cc9b6a70 0x55b5cc9b3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.244+0000 7fb6559b2740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5cc6177e0 con 0x55b5cc9b6a70 2024-01-31T05:12:30.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.244+0000 7fb6559b2740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5cc910dd0 con 0x55b5cc9b0f10 2024-01-31T05:12:30.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.244+0000 7fb6559b2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5cc9a7f50 con 0x55b5cc9b1900 2024-01-31T05:12:30.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.245+0000 7fb65118b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5cc9b6a70 0x55b5cc9b3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.245+0000 7fb65098a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5cc9b0f10 0x55b5cc9b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.245+0000 7fb65118b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5cc9b6a70 0x55b5cc9b3390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33534/0 (socket says 172.21.15.99:33534) 2024-01-31T05:12:30.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.245+0000 7fb65098a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5cc9b0f10 0x55b5cc9b2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.99:34798/0 (socket says 172.21.15.99:34798) 2024-01-31T05:12:30.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.245+0000 7fb65118b640 1 -- 172.21.15.99:0/2092501901 learned_addr learned my addr 172.21.15.99:0/2092501901 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:30.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.245+0000 7fb64bfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5cc9b1900 0x55b5cc9c2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.245+0000 7fb65098a640 1 -- 172.21.15.99:0/2092501901 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5cc9b1900 msgr2=0x55b5cc9c2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:30.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.245+0000 7fb65098a640 1 --2- 172.21.15.99:0/2092501901 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5cc9b1900 0x55b5cc9c2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.245+0000 7fb65098a640 1 -- 172.21.15.99:0/2092501901 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5cc9b6a70 msgr2=0x55b5cc9b3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:30.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.245+0000 7fb65098a640 1 --2- 172.21.15.99:0/2092501901 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5cc9b6a70 0x55b5cc9b3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.245+0000 7fb65098a640 1 -- 172.21.15.99:0/2092501901 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5cc8b34d0 con 0x55b5cc9b0f10 2024-01-31T05:12:30.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.245+0000 7fb65098a640 1 --2- 172.21.15.99:0/2092501901 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5cc9b0f10 0x55b5cc9b2e50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb64002c170 tx=0x7fb640045000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3ca40b15793fb5c server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:30.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.245+0000 7fb6367fc640 1 -- 172.21.15.99:0/2092501901 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb640057070 con 0x55b5cc9b0f10 2024-01-31T05:12:30.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.245+0000 7fb6367fc640 1 -- 172.21.15.99:0/2092501901 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb640043070 con 0x55b5cc9b0f10 2024-01-31T05:12:30.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.245+0000 7fb6367fc640 1 -- 172.21.15.99:0/2092501901 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb640051040 con 0x55b5cc9b0f10 2024-01-31T05:12:30.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.246+0000 7fb6559b2740 1 -- 172.21.15.99:0/2092501901 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5cc9b0f10 msgr2=0x55b5cc9b2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:30.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.246+0000 7fb6559b2740 1 --2- 172.21.15.99:0/2092501901 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5cc9b0f10 0x55b5cc9b2e50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb64002c170 tx=0x7fb640045000 comp rx=0 tx=0).stop 2024-01-31T05:12:30.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.246+0000 7fb6559b2740 1 -- 172.21.15.99:0/2092501901 shutdown_connections 2024-01-31T05:12:30.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.246+0000 7fb6559b2740 1 --2- 172.21.15.99:0/2092501901 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5cc9b6a70 0x55b5cc9b3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.246+0000 7fb6559b2740 1 --2- 172.21.15.99:0/2092501901 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5cc9b1900 0x55b5cc9c2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.246+0000 7fb6559b2740 1 --2- 172.21.15.99:0/2092501901 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5cc9b0f10 0x55b5cc9b2e50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.246+0000 7fb6559b2740 1 -- 172.21.15.99:0/2092501901 >> 172.21.15.99:0/2092501901 conn(0x55b5cc9ac480 msgr2=0x55b5cc9ac860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:30.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.246+0000 7fb6559b2740 1 -- 172.21.15.99:0/2092501901 shutdown_connections 2024-01-31T05:12:30.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.246+0000 7fb6559b2740 1 -- 172.21.15.99:0/2092501901 wait complete. 2024-01-31T05:12:30.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.246+0000 7fb6559b2740 1 -- start start 2024-01-31T05:12:30.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.246+0000 7fb6559b2740 1 Processor -- start 2024-01-31T05:12:30.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.247+0000 7fb6559b2740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5cc9b0f10 0x55b5cc9c0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.247+0000 7fb6559b2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5cc9b1900 0x55b5cc9c1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.247+0000 7fb6559b2740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5cc9b6a70 0x55b5cc9c1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.247+0000 7fb6559b2740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5cca25a90 con 0x55b5cc9b6a70 2024-01-31T05:12:30.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.247+0000 7fb6559b2740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5cca25c00 con 0x55b5cc9b0f10 2024-01-31T05:12:30.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.247+0000 7fb6559b2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5cca25dc0 con 0x55b5cc9b1900 2024-01-31T05:12:30.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.247+0000 7fb6559b2740 10 client.0 _ll_register_callbacks cb 0x7fb644007560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:12:30.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.247+0000 7fb65098a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5cc9b0f10 0x55b5cc9c0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.247+0000 7fb65118b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5cc9b6a70 0x55b5cc9c1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.247+0000 7fb65098a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5cc9b0f10 0x55b5cc9c0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.99:34814/0 (socket says 172.21.15.99:34814) 2024-01-31T05:12:30.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.247+0000 7fb65118b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5cc9b6a70 0x55b5cc9c1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33548/0 (socket says 172.21.15.99:33548) 2024-01-31T05:12:30.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.247+0000 7fb65098a640 1 -- 172.21.15.99:0/1605909848 learned_addr learned my addr 172.21.15.99:0/1605909848 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:30.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.247+0000 7fb64bfff640 1 --2- 172.21.15.99:0/1605909848 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5cc9b1900 0x55b5cc9c1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.247+0000 7fb65098a640 1 -- 172.21.15.99:0/1605909848 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5cc9b1900 msgr2=0x55b5cc9c1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:30.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.247+0000 7fb65098a640 1 --2- 172.21.15.99:0/1605909848 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5cc9b1900 0x55b5cc9c1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.247+0000 7fb65098a640 1 -- 172.21.15.99:0/1605909848 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5cc9b6a70 msgr2=0x55b5cc9c1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:30.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.247+0000 7fb65098a640 1 --2- 172.21.15.99:0/1605909848 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5cc9b6a70 0x55b5cc9c1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.247+0000 7fb65098a640 1 -- 172.21.15.99:0/1605909848 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb64c109a60 con 0x55b5cc9b0f10 2024-01-31T05:12:30.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.248+0000 7fb65098a640 1 --2- 172.21.15.99:0/1605909848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5cc9b0f10 0x55b5cc9c0fc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb640036040 tx=0x7fb6400040d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6537b2fc42b260e9 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:30.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.248+0000 7fb62bfff640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-01-31T05:12:30.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.248+0000 7fb62bfff640 1 -- 172.21.15.99:0/1605909848 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb640057070 con 0x55b5cc9b0f10 2024-01-31T05:12:30.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.248+0000 7fb6559b2740 1 -- 172.21.15.99:0/1605909848 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b5cc9110b0 con 0x55b5cc9b0f10 2024-01-31T05:12:30.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.248+0000 7fb62bfff640 1 -- 172.21.15.99:0/1605909848 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fb640005000 con 0x55b5cc9b0f10 2024-01-31T05:12:30.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.248+0000 7fb62bfff640 1 -- 172.21.15.99:0/1605909848 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb640062070 con 0x55b5cc9b0f10 2024-01-31T05:12:30.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.248+0000 7fb6559b2740 10 client.25184 fetch_fsmap learned FSMap version 27 2024-01-31T05:12:30.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.248+0000 7fb6559b2740 1 -- 172.21.15.99:0/1605909848 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55b5cc8d9020 con 0x55b5cc9b0f10 2024-01-31T05:12:30.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.248+0000 7fb62bfff640 1 -- 172.21.15.99:0/1605909848 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b5cc9110b0 con 0x55b5cc9b0f10 2024-01-31T05:12:30.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.248+0000 7fb62bfff640 1 -- 172.21.15.99:0/1605909848 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb640047040 con 0x55b5cc9b0f10 2024-01-31T05:12:30.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.248+0000 7fb6559b2740 10 client.25184 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:12:30.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.248+0000 7fb6559b2740 10 client.25184 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-01-31T05:12:30.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.248+0000 7fb6559b2740 20 client.25184 populate_metadata read hostname 'smithi099' 2024-01-31T05:12:30.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.248+0000 7fb6559b2740 1 --2- 172.21.15.99:0/1605909848 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x55b5cca276d0 0x55b5cca29af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.249+0000 7fb6559b2740 4 client.25184 mds_command: new command op to 14619 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-01-31T05:12:30.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.249+0000 7fb6559b2740 1 -- 172.21.15.99:0/1605909848 --> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b5cc66ae30 con 0x55b5cca276d0 2024-01-31T05:12:30.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.249+0000 7fb64bfff640 1 --2- 172.21.15.99:0/1605909848 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x55b5cca276d0 0x55b5cca29af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.249+0000 7fb62bfff640 10 client.25184 ms_handle_connect on v2:172.21.15.99:6840/3069939345 2024-01-31T05:12:30.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.250+0000 7fb64bfff640 1 --2- 172.21.15.99:0/1605909848 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x55b5cca276d0 0x55b5cca29af0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c1f8564fa5f6f8ef server_cookie=6fc6b67c7ed43063 in_seq=0 out_seq=0 2024-01-31T05:12:30.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.250+0000 7fb62bfff640 1 -- 172.21.15.99:0/1605909848 <== mds.4 v2:172.21.15.99:6840/3069939345 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b5cc66ae30 con 0x55b5cca276d0 2024-01-31T05:12:30.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.250+0000 7fb62bfff640 10 client.25184 handle_command_reply: tid=0 2024-01-31T05:12:30.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.250+0000 7fb6559b2740 1 client.25184 shutdown 2024-01-31T05:12:30.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.250+0000 7fb6559b2740 1 -- 172.21.15.99:0/1605909848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5cc9b0f10 msgr2=0x55b5cc9c0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:30.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.250+0000 7fb6559b2740 1 --2- 172.21.15.99:0/1605909848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5cc9b0f10 0x55b5cc9c0fc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb640036040 tx=0x7fb6400040d0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.250+0000 7fb6559b2740 1 -- 172.21.15.99:0/1605909848 shutdown_connections 2024-01-31T05:12:30.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.250+0000 7fb6559b2740 1 --2- 172.21.15.99:0/1605909848 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x55b5cca276d0 0x55b5cca29af0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.250+0000 7fb6559b2740 1 --2- 172.21.15.99:0/1605909848 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5cc9b6a70 0x55b5cc9c1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.250+0000 7fb62bfff640 0 client.25184 ms_handle_reset on v2:172.21.15.99:6840/3069939345 2024-01-31T05:12:30.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.250+0000 7fb6559b2740 1 --2- 172.21.15.99:0/1605909848 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b5cc9b1900 0x55b5cc9c1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.250+0000 7fb6559b2740 1 --2- 172.21.15.99:0/1605909848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5cc9b0f10 0x55b5cc9c0fc0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.250+0000 7fb6559b2740 1 -- 172.21.15.99:0/1605909848 >> 172.21.15.99:0/1605909848 conn(0x55b5cc9ac480 msgr2=0x55b5cc9b2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:30.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.250+0000 7fb6559b2740 1 -- 172.21.15.99:0/1605909848 shutdown_connections 2024-01-31T05:12:30.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.250+0000 7fb6559b2740 1 -- 172.21.15.99:0/1605909848 wait complete. 2024-01-31T05:12:30.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.250+0000 7fb6559b2740 20 client.25184 trim_cache size 0 max 16384 2024-01-31T05:12:30.261 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-01-31T05:12:30.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.251+0000 7fb652bee640 1 -- 172.21.15.99:0/1713215027 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb63c0a13f0 msgr2=0x7fb63c0a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:30.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.251+0000 7fb652bee640 1 --2- 172.21.15.99:0/1713215027 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb63c0a13f0 0x7fb63c0a38b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb640000c00 tx=0x7fb64002c5d0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.251+0000 7fb652bee640 1 -- 172.21.15.99:0/1713215027 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb64c101f10 msgr2=0x7fb64c1971d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:30.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.251+0000 7fb652bee640 1 --2- 172.21.15.99:0/1713215027 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb64c101f10 0x7fb64c1971d0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fb63800d950 tx=0x7fb63800de10 comp rx=0 tx=0).stop 2024-01-31T05:12:30.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.251+0000 7fb652bee640 1 -- 172.21.15.99:0/1713215027 shutdown_connections 2024-01-31T05:12:30.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.251+0000 7fb652bee640 1 --2- 172.21.15.99:0/1713215027 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb63c0a13f0 0x7fb63c0a38b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.251+0000 7fb652bee640 1 --2- 172.21.15.99:0/1713215027 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb64c1028d0 0x7fb64c19e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.251+0000 7fb652bee640 1 --2- 172.21.15.99:0/1713215027 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb64c101f10 0x7fb64c1971d0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.251+0000 7fb652bee640 1 --2- 172.21.15.99:0/1713215027 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb64c100d20 0x7fb64c196c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.251+0000 7fb652bee640 1 -- 172.21.15.99:0/1713215027 >> 172.21.15.99:0/1713215027 conn(0x7fb64c0fc290 msgr2=0x7fb64c105330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:30.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.251+0000 7fb652bee640 1 -- 172.21.15.99:0/1713215027 shutdown_connections 2024-01-31T05:12:30.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.251+0000 7fb652bee640 1 -- 172.21.15.99:0/1713215027 wait complete. 2024-01-31T05:12:30.264 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-01-31T05:12:30.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.371+0000 7f3845a78640 1 -- 172.21.15.99:0/2884544461 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3840101810 msgr2=0x7f3840103c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:30.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.371+0000 7f3845a78640 1 --2- 172.21.15.99:0/2884544461 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3840101810 0x7f3840103c00 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f3830009900 tx=0x7f383002bc30 comp rx=0 tx=0).stop 2024-01-31T05:12:30.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.371+0000 7f3845a78640 1 -- 172.21.15.99:0/2884544461 shutdown_connections 2024-01-31T05:12:30.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.371+0000 7f3845a78640 1 --2- 172.21.15.99:0/2884544461 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3840106a70 0x7f3840108e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.371+0000 7f3845a78640 1 --2- 172.21.15.99:0/2884544461 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3840104140 0x7f3840106530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.371+0000 7f3845a78640 1 --2- 172.21.15.99:0/2884544461 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3840101810 0x7f3840103c00 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.371+0000 7f3845a78640 1 -- 172.21.15.99:0/2884544461 >> 172.21.15.99:0/2884544461 conn(0x7f38400fb1a0 msgr2=0x7f38400fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:30.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.372+0000 7f3845a78640 1 -- 172.21.15.99:0/2884544461 shutdown_connections 2024-01-31T05:12:30.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.372+0000 7f3845a78640 1 -- 172.21.15.99:0/2884544461 wait complete. 2024-01-31T05:12:30.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.372+0000 7f3845a78640 1 Processor -- start 2024-01-31T05:12:30.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.373+0000 7f3845a78640 1 -- start start 2024-01-31T05:12:30.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.373+0000 7f3845a78640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3840101810 0x7f3840196d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.373+0000 7f3845a78640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3840104140 0x7f3840197260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.373+0000 7f3845a78640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3840106a70 0x7f384019e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.373+0000 7f3845a78640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384019e800 con 0x7f3840101810 2024-01-31T05:12:30.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.373+0000 7f3845a78640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384019e970 con 0x7f3840106a70 2024-01-31T05:12:30.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.373+0000 7f3845a78640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384019eb30 con 0x7f3840104140 2024-01-31T05:12:30.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.373+0000 7f383f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3840101810 0x7f3840196d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.373+0000 7f383f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3840101810 0x7f3840196d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33564/0 (socket says 172.21.15.99:33564) 2024-01-31T05:12:30.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.373+0000 7f383f7fe640 1 -- 172.21.15.99:0/3806499801 learned_addr learned my addr 172.21.15.99:0/3806499801 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:30.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.373+0000 7f383effd640 1 --2- 172.21.15.99:0/3806499801 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3840104140 0x7f3840197260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.373+0000 7f383ffff640 1 --2- 172.21.15.99:0/3806499801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3840106a70 0x7f384019e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.373+0000 7f383f7fe640 1 -- 172.21.15.99:0/3806499801 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3840104140 msgr2=0x7f3840197260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:30.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.373+0000 7f383f7fe640 1 --2- 172.21.15.99:0/3806499801 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3840104140 0x7f3840197260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.373+0000 7f383f7fe640 1 -- 172.21.15.99:0/3806499801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3840106a70 msgr2=0x7f384019e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:30.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.373+0000 7f383f7fe640 1 --2- 172.21.15.99:0/3806499801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3840106a70 0x7f384019e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.373+0000 7f383f7fe640 1 -- 172.21.15.99:0/3806499801 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3830009560 con 0x7f3840101810 2024-01-31T05:12:30.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.374+0000 7f383f7fe640 1 --2- 172.21.15.99:0/3806499801 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3840101810 0x7f3840196d20 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f3830009230 tx=0x7f3830004ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:30.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.374+0000 7f383cff9640 1 -- 172.21.15.99:0/3806499801 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38300043d0 con 0x7f3840101810 2024-01-31T05:12:30.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.374+0000 7f383cff9640 1 -- 172.21.15.99:0/3806499801 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f38300054c0 con 0x7f3840101810 2024-01-31T05:12:30.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.374+0000 7f3845a78640 1 -- 172.21.15.99:0/3806499801 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f384019edb0 con 0x7f3840101810 2024-01-31T05:12:30.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.374+0000 7f383cff9640 1 -- 172.21.15.99:0/3806499801 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383003e450 con 0x7f3840101810 2024-01-31T05:12:30.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.374+0000 7f3845a78640 1 -- 172.21.15.99:0/3806499801 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f384019f1b0 con 0x7f3840101810 2024-01-31T05:12:30.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.377+0000 7f3848841740 1 Processor -- start 2024-01-31T05:12:30.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.377+0000 7f3848841740 1 -- start start 2024-01-31T05:12:30.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.377+0000 7f3848841740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55642b022d10 0x55642b023130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.377+0000 7f3848841740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55642b023700 0x55642b027c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.377+0000 7f3848841740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55642b028300 0x55642b02a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.377+0000 7f3848841740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55642af88240 con 0x55642b028300 2024-01-31T05:12:30.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.377+0000 7f3848841740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55642af85930 con 0x55642b023700 2024-01-31T05:12:30.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.377+0000 7f3848841740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55642af81220 con 0x55642b022d10 2024-01-31T05:12:30.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.377+0000 7f383effd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55642b028300 0x55642b02a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.377+0000 7f383effd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55642b028300 0x55642b02a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33578/0 (socket says 172.21.15.99:33578) 2024-01-31T05:12:30.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.377+0000 7f383effd640 1 -- 172.21.15.99:0/1228461262 learned_addr learned my addr 172.21.15.99:0/1228461262 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:30.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.377+0000 7f383cff9640 1 -- 172.21.15.99:0/3806499801 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f38300035f0 con 0x7f3840101810 2024-01-31T05:12:30.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.377+0000 7f383ffff640 1 --2- 172.21.15.99:0/1228461262 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55642b022d10 0x55642b023130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.377+0000 7f383effd640 1 -- 172.21.15.99:0/1228461262 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55642b022d10 msgr2=0x55642b023130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:30.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.377+0000 7f383effd640 1 --2- 172.21.15.99:0/1228461262 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55642b022d10 0x55642b023130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.377+0000 7f383effd640 1 -- 172.21.15.99:0/1228461262 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55642b023700 msgr2=0x55642b027c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-31T05:12:30.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.377+0000 7f383effd640 1 --2- 172.21.15.99:0/1228461262 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55642b023700 0x55642b027c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.377+0000 7f383effd640 1 -- 172.21.15.99:0/1228461262 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55642af437c0 con 0x55642b028300 2024-01-31T05:12:30.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.378+0000 7f383effd640 1 --2- 172.21.15.99:0/1228461262 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55642b028300 0x55642b02a770 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f383400bd10 tx=0x7f38340107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c24fd76686510eef server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:30.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.378+0000 7f3825ffb640 1 -- 172.21.15.99:0/1228461262 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3834005220 con 0x55642b028300 2024-01-31T05:12:30.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.378+0000 7f3825ffb640 1 -- 172.21.15.99:0/1228461262 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3834015070 con 0x55642b028300 2024-01-31T05:12:30.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.378+0000 7f3825ffb640 1 -- 172.21.15.99:0/1228461262 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3834011680 con 0x55642b028300 2024-01-31T05:12:30.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.378+0000 7f383cff9640 1 --2- 172.21.15.99:0/3806499801 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f38280a1370 0x7f38280a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.378+0000 7f383cff9640 1 -- 172.21.15.99:0/3806499801 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f38300ef4a0 con 0x7f3840101810 2024-01-31T05:12:30.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.379+0000 7f3848841740 1 -- 172.21.15.99:0/1228461262 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55642b028300 msgr2=0x55642b02a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:30.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.379+0000 7f3848841740 1 --2- 172.21.15.99:0/1228461262 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55642b028300 0x55642b02a770 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f383400bd10 tx=0x7f38340107a0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.379+0000 7f383ffff640 1 --2- 172.21.15.99:0/3806499801 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f38280a1370 0x7f38280a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.380+0000 7f3848841740 1 -- 172.21.15.99:0/1228461262 shutdown_connections 2024-01-31T05:12:30.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.380+0000 7f3848841740 1 --2- 172.21.15.99:0/1228461262 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55642b028300 0x55642b02a770 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.380+0000 7f3848841740 1 --2- 172.21.15.99:0/1228461262 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55642b023700 0x55642b027c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.380+0000 7f3848841740 1 --2- 172.21.15.99:0/1228461262 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55642b022d10 0x55642b023130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.380+0000 7f3848841740 1 -- 172.21.15.99:0/1228461262 >> 172.21.15.99:0/1228461262 conn(0x55642b015400 msgr2=0x55642b015800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:30.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.380+0000 7f383ffff640 1 --2- 172.21.15.99:0/3806499801 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f38280a1370 0x7f38280a3830 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x55642b0190c0 tx=0x7f3838009600 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:30.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.380+0000 7f3848841740 1 -- 172.21.15.99:0/1228461262 shutdown_connections 2024-01-31T05:12:30.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.380+0000 7f3848841740 1 -- 172.21.15.99:0/1228461262 wait complete. 2024-01-31T05:12:30.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.380+0000 7f3848841740 1 -- start start 2024-01-31T05:12:30.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.380+0000 7f3848841740 1 Processor -- start 2024-01-31T05:12:30.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.381+0000 7f3848841740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55642b022d10 0x55642b02c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.381+0000 7f3848841740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55642b023700 0x55642b02cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.381+0000 7f3848841740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55642b028300 0x55642b033f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.381+0000 7f3848841740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55642af3a5e0 con 0x55642b028300 2024-01-31T05:12:30.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.381+0000 7f3848841740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55642af3a280 con 0x55642b022d10 2024-01-31T05:12:30.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.381+0000 7f3848841740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55642aeff3d0 con 0x55642b023700 2024-01-31T05:12:30.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.381+0000 7f383ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55642b028300 0x55642b033f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.381+0000 7f383ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55642b028300 0x55642b033f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33594/0 (socket says 172.21.15.99:33594) 2024-01-31T05:12:30.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.381+0000 7f383ffff640 1 -- 172.21.15.99:0/2456710989 learned_addr learned my addr 172.21.15.99:0/2456710989 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:30.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.381+0000 7f3848841740 10 client.0 _ll_register_callbacks cb 0x55642af77eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:12:30.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.381+0000 7f383effd640 1 --2- 172.21.15.99:0/2456710989 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55642b023700 0x55642b02cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.381+0000 7f383f7fe640 1 --2- 172.21.15.99:0/2456710989 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55642b022d10 0x55642b02c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.381+0000 7f383ffff640 1 -- 172.21.15.99:0/2456710989 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55642b023700 msgr2=0x55642b02cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:30.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.381+0000 7f383ffff640 1 --2- 172.21.15.99:0/2456710989 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55642b023700 0x55642b02cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.381+0000 7f383ffff640 1 -- 172.21.15.99:0/2456710989 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55642b022d10 msgr2=0x55642b02c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:30.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.381+0000 7f383ffff640 1 --2- 172.21.15.99:0/2456710989 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55642b022d10 0x55642b02c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.381+0000 7f383ffff640 1 -- 172.21.15.99:0/2456710989 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f383400b940 con 0x55642b028300 2024-01-31T05:12:30.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.381+0000 7f383ffff640 1 --2- 172.21.15.99:0/2456710989 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55642b028300 0x55642b033f00 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f38380049d0 tx=0x7f3838004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0fbcbfe822ffc64 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:30.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.381+0000 7f381effd640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:12:30.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.381+0000 7f381effd640 1 -- 172.21.15.99:0/2456710989 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3838010d70 con 0x55642b028300 2024-01-31T05:12:30.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.382+0000 7f381effd640 1 -- 172.21.15.99:0/2456710989 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f3838004b20 con 0x55642b028300 2024-01-31T05:12:30.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.382+0000 7f3848841740 1 -- 172.21.15.99:0/2456710989 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55642af7a0b0 con 0x55642b028300 2024-01-31T05:12:30.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.382+0000 7f381effd640 1 -- 172.21.15.99:0/2456710989 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3838010ed0 con 0x55642b028300 2024-01-31T05:12:30.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.382+0000 7f3848841740 10 client.15750 fetch_fsmap learned FSMap version 27 2024-01-31T05:12:30.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.382+0000 7f3848841740 1 -- 172.21.15.99:0/2456710989 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55642af7f8a0 con 0x55642b028300 2024-01-31T05:12:30.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.382+0000 7f381effd640 1 -- 172.21.15.99:0/2456710989 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55642af7a0b0 con 0x55642b028300 2024-01-31T05:12:30.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.382+0000 7f381effd640 1 -- 172.21.15.99:0/2456710989 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3838027420 con 0x55642b028300 2024-01-31T05:12:30.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.382+0000 7f3848841740 10 client.15750 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:12:30.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.382+0000 7f3848841740 10 client.15750 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-01-31T05:12:30.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.382+0000 7f3848841740 20 client.15750 populate_metadata read hostname 'smithi099' 2024-01-31T05:12:30.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.382+0000 7f3848841740 1 --2- 172.21.15.99:0/2456710989 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x55642b038840 0x55642b03ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.382+0000 7f3848841740 4 client.15750 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:12:30.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.382+0000 7f3848841740 1 -- 172.21.15.99:0/2456710989 --> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55642af79dd0 con 0x55642b038840 2024-01-31T05:12:30.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.383+0000 7f383f7fe640 1 --2- 172.21.15.99:0/2456710989 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x55642b038840 0x55642b03ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.383+0000 7f381effd640 10 client.15750 ms_handle_connect on v2:172.21.15.181:6836/3875964154 2024-01-31T05:12:30.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.383+0000 7f383f7fe640 1 --2- 172.21.15.99:0/2456710989 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x55642b038840 0x55642b03ac80 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=efa0e5dd9a269276 server_cookie=5e2afad536c92968 in_seq=0 out_seq=0 2024-01-31T05:12:30.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.384+0000 7f381effd640 1 -- 172.21.15.99:0/2456710989 <== mds.3 v2:172.21.15.181:6836/3875964154 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55642af79dd0 con 0x55642b038840 2024-01-31T05:12:30.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.384+0000 7f381effd640 10 client.15750 handle_command_reply: tid=0 2024-01-31T05:12:30.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.384+0000 7f3848841740 1 client.15750 shutdown 2024-01-31T05:12:30.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.384+0000 7f3848841740 1 -- 172.21.15.99:0/2456710989 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55642b028300 msgr2=0x55642b033f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:30.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.384+0000 7f3848841740 1 --2- 172.21.15.99:0/2456710989 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55642b028300 0x55642b033f00 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f38380049d0 tx=0x7f3838004a40 comp rx=0 tx=0).stop 2024-01-31T05:12:30.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.384+0000 7f3848841740 1 -- 172.21.15.99:0/2456710989 shutdown_connections 2024-01-31T05:12:30.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.384+0000 7f3848841740 1 --2- 172.21.15.99:0/2456710989 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x55642b038840 0x55642b03ac80 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.384+0000 7f3848841740 1 --2- 172.21.15.99:0/2456710989 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55642b028300 0x55642b033f00 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.384+0000 7f381effd640 0 client.15750 ms_handle_reset on v2:172.21.15.181:6836/3875964154 2024-01-31T05:12:30.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.384+0000 7f3848841740 1 --2- 172.21.15.99:0/2456710989 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55642b023700 0x55642b02cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.384+0000 7f3848841740 1 --2- 172.21.15.99:0/2456710989 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55642b022d10 0x55642b02c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.384+0000 7f3848841740 1 -- 172.21.15.99:0/2456710989 >> 172.21.15.99:0/2456710989 conn(0x55642b015400 msgr2=0x55642b0147c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:30.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.384+0000 7f3848841740 1 -- 172.21.15.99:0/2456710989 shutdown_connections 2024-01-31T05:12:30.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.385+0000 7f3848841740 1 -- 172.21.15.99:0/2456710989 wait complete. 2024-01-31T05:12:30.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.385+0000 7f3848841740 20 client.15750 trim_cache size 0 max 16384 2024-01-31T05:12:30.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.396+0000 7f3848841740 1 Processor -- start 2024-01-31T05:12:30.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.396+0000 7f3848841740 1 -- start start 2024-01-31T05:12:30.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.396+0000 7f3848841740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55642b022d10 0x55642b010650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.396+0000 7f3848841740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55642b023700 0x55642b033ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.396+0000 7f3848841740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55642b028300 0x55642b023b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.396+0000 7f3848841740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55642af79dd0 con 0x55642b023700 2024-01-31T05:12:30.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.396+0000 7f3848841740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55642af7a0b0 con 0x55642b022d10 2024-01-31T05:12:30.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.396+0000 7f3848841740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55642b010fa0 con 0x55642b028300 2024-01-31T05:12:30.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.397+0000 7f383effd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55642b023700 0x55642b033ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.397+0000 7f383effd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55642b023700 0x55642b033ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33604/0 (socket says 172.21.15.99:33604) 2024-01-31T05:12:30.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.397+0000 7f383effd640 1 -- 172.21.15.99:0/3732626129 learned_addr learned my addr 172.21.15.99:0/3732626129 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:30.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.397+0000 7f383ffff640 1 --2- 172.21.15.99:0/3732626129 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55642b028300 0x55642b023b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.397+0000 7f383f7fe640 1 --2- 172.21.15.99:0/3732626129 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55642b022d10 0x55642b010650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.397+0000 7f383effd640 1 -- 172.21.15.99:0/3732626129 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55642b028300 msgr2=0x55642b023b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:30.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.397+0000 7f383effd640 1 --2- 172.21.15.99:0/3732626129 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55642b028300 0x55642b023b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.397+0000 7f383effd640 1 -- 172.21.15.99:0/3732626129 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55642b022d10 msgr2=0x55642b010650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:30.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.397+0000 7f383effd640 1 --2- 172.21.15.99:0/3732626129 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55642b022d10 0x55642b010650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.397+0000 7f383effd640 1 -- 172.21.15.99:0/3732626129 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55642af1c4d0 con 0x55642b023700 2024-01-31T05:12:30.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.397+0000 7f383effd640 1 --2- 172.21.15.99:0/3732626129 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55642b023700 0x55642b033ec0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x55642b016370 tx=0x7f3834005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df7b6daac2cfaa28 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:30.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.397+0000 7f38257fa640 1 -- 172.21.15.99:0/3732626129 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383401f050 con 0x55642b023700 2024-01-31T05:12:30.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.397+0000 7f38257fa640 1 -- 172.21.15.99:0/3732626129 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3834020040 con 0x55642b023700 2024-01-31T05:12:30.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.397+0000 7f38257fa640 1 -- 172.21.15.99:0/3732626129 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38340256d0 con 0x55642b023700 2024-01-31T05:12:30.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.398+0000 7f3848841740 1 -- 172.21.15.99:0/3732626129 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55642b023700 msgr2=0x55642b033ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:30.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.398+0000 7f3848841740 1 --2- 172.21.15.99:0/3732626129 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55642b023700 0x55642b033ec0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x55642b016370 tx=0x7f3834005040 comp rx=0 tx=0).stop 2024-01-31T05:12:30.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.398+0000 7f3848841740 1 -- 172.21.15.99:0/3732626129 shutdown_connections 2024-01-31T05:12:30.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.398+0000 7f3848841740 1 --2- 172.21.15.99:0/3732626129 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55642b028300 0x55642b023b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.398+0000 7f3848841740 1 --2- 172.21.15.99:0/3732626129 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55642b023700 0x55642b033ec0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.398+0000 7f3848841740 1 --2- 172.21.15.99:0/3732626129 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55642b022d10 0x55642b010650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.398+0000 7f3848841740 1 -- 172.21.15.99:0/3732626129 >> 172.21.15.99:0/3732626129 conn(0x55642b015400 msgr2=0x55642b02b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:30.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.398+0000 7f3848841740 1 -- 172.21.15.99:0/3732626129 shutdown_connections 2024-01-31T05:12:30.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.398+0000 7f3848841740 1 -- 172.21.15.99:0/3732626129 wait complete. 2024-01-31T05:12:30.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.399+0000 7f3848841740 1 -- start start 2024-01-31T05:12:30.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.399+0000 7f3848841740 1 Processor -- start 2024-01-31T05:12:30.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.399+0000 7f3848841740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55642b022d10 0x55642b033e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.399+0000 7f3848841740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55642b023700 0x55642b032430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.399+0000 7f3848841740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55642b028300 0x55642b032970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.399+0000 7f3848841740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55642b033020 con 0x55642b022d10 2024-01-31T05:12:30.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.399+0000 7f3848841740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55642b033190 con 0x55642b028300 2024-01-31T05:12:30.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.399+0000 7f3848841740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55642b08ed90 con 0x55642b023700 2024-01-31T05:12:30.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.399+0000 7f383f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55642b022d10 0x55642b033e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.399+0000 7f3848841740 10 client.0 _ll_register_callbacks cb 0x7f383400b810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:12:30.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.399+0000 7f383f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55642b022d10 0x55642b033e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33606/0 (socket says 172.21.15.99:33606) 2024-01-31T05:12:30.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.399+0000 7f383f7fe640 1 -- 172.21.15.99:0/1670036359 learned_addr learned my addr 172.21.15.99:0/1670036359 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:30.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.400+0000 7f383effd640 1 --2- 172.21.15.99:0/1670036359 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55642b023700 0x55642b032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.400+0000 7f383ffff640 1 --2- 172.21.15.99:0/1670036359 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55642b028300 0x55642b032970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.400+0000 7f383f7fe640 1 -- 172.21.15.99:0/1670036359 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55642b023700 msgr2=0x55642b032430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:30.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.400+0000 7f383f7fe640 1 --2- 172.21.15.99:0/1670036359 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55642b023700 0x55642b032430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.400+0000 7f383f7fe640 1 -- 172.21.15.99:0/1670036359 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55642b028300 msgr2=0x55642b032970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:30.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.400+0000 7f383f7fe640 1 --2- 172.21.15.99:0/1670036359 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55642b028300 0x55642b032970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.400+0000 7f383f7fe640 1 -- 172.21.15.99:0/1670036359 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55642af437c0 con 0x55642b022d10 2024-01-31T05:12:30.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.400+0000 7f383ffff640 1 --2- 172.21.15.99:0/1670036359 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55642b028300 0x55642b032970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:12:30.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.400+0000 7f383f7fe640 1 --2- 172.21.15.99:0/1670036359 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55642b022d10 0x55642b033e20 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f38300b8b20 tx=0x7f38300bc480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2540eebffef1ed03 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:30.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.400+0000 7f381effd640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:12:30.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.400+0000 7f381effd640 1 -- 172.21.15.99:0/1670036359 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38300ba890 con 0x55642b022d10 2024-01-31T05:12:30.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.400+0000 7f381effd640 1 -- 172.21.15.99:0/1670036359 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f38300bcdb0 con 0x55642b022d10 2024-01-31T05:12:30.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.400+0000 7f3848841740 1 -- 172.21.15.99:0/1670036359 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3834015070 con 0x55642b022d10 2024-01-31T05:12:30.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.400+0000 7f381effd640 1 -- 172.21.15.99:0/1670036359 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f38300ef2a0 con 0x55642b022d10 2024-01-31T05:12:30.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.400+0000 7f3848841740 10 client.15756 fetch_fsmap learned FSMap version 27 2024-01-31T05:12:30.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.400+0000 7f3848841740 1 -- 172.21.15.99:0/1670036359 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55642af42020 con 0x55642b022d10 2024-01-31T05:12:30.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.401+0000 7f381effd640 1 -- 172.21.15.99:0/1670036359 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f383009f080 con 0x55642b022d10 2024-01-31T05:12:30.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.401+0000 7f381effd640 1 -- 172.21.15.99:0/1670036359 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f383003c070 con 0x55642b022d10 2024-01-31T05:12:30.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.401+0000 7f3848841740 10 client.15756 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:12:30.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.401+0000 7f3848841740 10 client.15756 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-01-31T05:12:30.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.401+0000 7f3848841740 20 client.15756 populate_metadata read hostname 'smithi099' 2024-01-31T05:12:30.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.401+0000 7f3848841740 1 --2- 172.21.15.99:0/1670036359 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x55642b090340 0x55642b092760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.401+0000 7f3848841740 4 client.15756 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-01-31T05:12:30.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.401+0000 7f3848841740 1 -- 172.21.15.99:0/1670036359 --> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55642ac807e0 con 0x55642b090340 2024-01-31T05:12:30.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.401+0000 7f383effd640 1 --2- 172.21.15.99:0/1670036359 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x55642b090340 0x55642b092760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.402+0000 7f381effd640 10 client.15756 ms_handle_connect on v2:172.21.15.181:6836/3875964154 2024-01-31T05:12:30.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.402+0000 7f383effd640 1 --2- 172.21.15.99:0/1670036359 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x55642b090340 0x55642b092760 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f6e4893bd04d2ebb server_cookie=5a2b4766b60dbbdd in_seq=0 out_seq=0 2024-01-31T05:12:30.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.402+0000 7f381effd640 1 -- 172.21.15.99:0/1670036359 <== mds.3 v2:172.21.15.181:6836/3875964154 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55642ac807e0 con 0x55642b090340 2024-01-31T05:12:30.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.402+0000 7f381effd640 10 client.15756 handle_command_reply: tid=0 2024-01-31T05:12:30.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.402+0000 7f3848841740 1 client.15756 shutdown 2024-01-31T05:12:30.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.402+0000 7f3848841740 1 -- 172.21.15.99:0/1670036359 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55642b022d10 msgr2=0x55642b033e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:30.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.402+0000 7f3848841740 1 --2- 172.21.15.99:0/1670036359 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55642b022d10 0x55642b033e20 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f38300b8b20 tx=0x7f38300bc480 comp rx=0 tx=0).stop 2024-01-31T05:12:30.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.402+0000 7f3848841740 1 -- 172.21.15.99:0/1670036359 shutdown_connections 2024-01-31T05:12:30.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.402+0000 7f3848841740 1 --2- 172.21.15.99:0/1670036359 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x55642b090340 0x55642b092760 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.402+0000 7f3848841740 1 --2- 172.21.15.99:0/1670036359 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55642b028300 0x55642b032970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.402+0000 7f3848841740 1 --2- 172.21.15.99:0/1670036359 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55642b023700 0x55642b032430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.402+0000 7f3848841740 1 --2- 172.21.15.99:0/1670036359 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55642b022d10 0x55642b033e20 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.402+0000 7f3848841740 1 -- 172.21.15.99:0/1670036359 >> 172.21.15.99:0/1670036359 conn(0x55642b015400 msgr2=0x55642b010650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:30.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.402+0000 7f381effd640 0 client.15756 ms_handle_reset on v2:172.21.15.181:6836/3875964154 2024-01-31T05:12:30.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.402+0000 7f3848841740 1 -- 172.21.15.99:0/1670036359 shutdown_connections 2024-01-31T05:12:30.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.403+0000 7f3848841740 1 -- 172.21.15.99:0/1670036359 wait complete. 2024-01-31T05:12:30.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.403+0000 7f3848841740 20 client.15756 trim_cache size 0 max 16384 2024-01-31T05:12:30.408 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-01-31T05:12:30.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.404+0000 7f3845a78640 1 -- 172.21.15.99:0/3806499801 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f38280a1370 msgr2=0x7f38280a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:30.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.404+0000 7f3845a78640 1 --2- 172.21.15.99:0/3806499801 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f38280a1370 0x7f38280a3830 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x55642b0190c0 tx=0x7f3838009600 comp rx=0 tx=0).stop 2024-01-31T05:12:30.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.404+0000 7f3845a78640 1 -- 172.21.15.99:0/3806499801 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3840101810 msgr2=0x7f3840196d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:30.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.404+0000 7f3845a78640 1 --2- 172.21.15.99:0/3806499801 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3840101810 0x7f3840196d20 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f3830009230 tx=0x7f3830004ee0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.404+0000 7f3845a78640 1 -- 172.21.15.99:0/3806499801 shutdown_connections 2024-01-31T05:12:30.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.404+0000 7f3845a78640 1 --2- 172.21.15.99:0/3806499801 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f38280a1370 0x7f38280a3830 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.404+0000 7f3845a78640 1 --2- 172.21.15.99:0/3806499801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3840106a70 0x7f384019e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.404+0000 7f3845a78640 1 --2- 172.21.15.99:0/3806499801 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3840104140 0x7f3840197260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.404+0000 7f3845a78640 1 --2- 172.21.15.99:0/3806499801 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3840101810 0x7f3840196d20 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.404+0000 7f3845a78640 1 -- 172.21.15.99:0/3806499801 >> 172.21.15.99:0/3806499801 conn(0x7f38400fb1a0 msgr2=0x7f38401022d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:30.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.404+0000 7f3845a78640 1 -- 172.21.15.99:0/3806499801 shutdown_connections 2024-01-31T05:12:30.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.404+0000 7f3845a78640 1 -- 172.21.15.99:0/3806499801 wait complete. 2024-01-31T05:12:30.414 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-01-31T05:12:30.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.521+0000 7fbbe27b5640 1 -- 172.21.15.99:0/3794249781 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbbdc0fff40 msgr2=0x7fbbdc1003a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:30.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.521+0000 7fbbe27b5640 1 --2- 172.21.15.99:0/3794249781 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbbdc0fff40 0x7fbbdc1003a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0009900 tx=0x7fbbd002bcd0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.521+0000 7fbbe27b5640 1 -- 172.21.15.99:0/3794249781 shutdown_connections 2024-01-31T05:12:30.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.521+0000 7fbbe27b5640 1 --2- 172.21.15.99:0/3794249781 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbdc1008e0 0x7fbbdc100d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.521+0000 7fbbe27b5640 1 --2- 172.21.15.99:0/3794249781 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbbdc0fff40 0x7fbbdc1003a0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.521+0000 7fbbe27b5640 1 --2- 172.21.15.99:0/3794249781 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbbdc0ff5e0 0x7fbbdc0ffa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.521+0000 7fbbe27b5640 1 -- 172.21.15.99:0/3794249781 >> 172.21.15.99:0/3794249781 conn(0x7fbbdc0fb180 msgr2=0x7fbbdc0fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:30.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.522+0000 7fbbe27b5640 1 -- 172.21.15.99:0/3794249781 shutdown_connections 2024-01-31T05:12:30.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.522+0000 7fbbe27b5640 1 -- 172.21.15.99:0/3794249781 wait complete. 2024-01-31T05:12:30.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.522+0000 7fbbe27b5640 1 Processor -- start 2024-01-31T05:12:30.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.522+0000 7fbbe27b5640 1 -- start start 2024-01-31T05:12:30.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.522+0000 7fbbe27b5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbdc0ff5e0 0x7fbbdc198f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.522+0000 7fbbe27b5640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbbdc0fff40 0x7fbbdc1994c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.522+0000 7fbbe27b5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbbdc1008e0 0x7fbbdc1a0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.523+0000 7fbbe27b5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc1a0a70 con 0x7fbbdc1008e0 2024-01-31T05:12:30.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.523+0000 7fbbe27b5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc1a0be0 con 0x7fbbdc0ff5e0 2024-01-31T05:12:30.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.523+0000 7fbbe27b5640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc1a0da0 con 0x7fbbdc0fff40 2024-01-31T05:12:30.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.523+0000 7fbbe0d52640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbbdc1008e0 0x7fbbdc1a0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.523+0000 7fbbdb7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbbdc0fff40 0x7fbbdc1994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.523+0000 7fbbe0d52640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbbdc1008e0 0x7fbbdc1a0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33626/0 (socket says 172.21.15.99:33626) 2024-01-31T05:12:30.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.523+0000 7fbbe0d52640 1 -- 172.21.15.99:0/4137899128 learned_addr learned my addr 172.21.15.99:0/4137899128 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:30.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.523+0000 7fbbdbfff640 1 --2- 172.21.15.99:0/4137899128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbdc0ff5e0 0x7fbbdc198f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.523+0000 7fbbdb7fe640 1 -- 172.21.15.99:0/4137899128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbdc0ff5e0 msgr2=0x7fbbdc198f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:30.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.523+0000 7fbbdb7fe640 1 --2- 172.21.15.99:0/4137899128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbdc0ff5e0 0x7fbbdc198f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.523+0000 7fbbdb7fe640 1 -- 172.21.15.99:0/4137899128 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbbdc1008e0 msgr2=0x7fbbdc1a0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:30.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.523+0000 7fbbdb7fe640 1 --2- 172.21.15.99:0/4137899128 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbbdc1008e0 0x7fbbdc1a0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.523+0000 7fbbdb7fe640 1 -- 172.21.15.99:0/4137899128 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd0009560 con 0x7fbbdc0fff40 2024-01-31T05:12:30.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.523+0000 7fbbe0d52640 1 --2- 172.21.15.99:0/4137899128 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbbdc1008e0 0x7fbbdc1a0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:12:30.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.523+0000 7fbbdb7fe640 1 --2- 172.21.15.99:0/4137899128 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbbdc0fff40 0x7fbbdc1994c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0009230 tx=0x7fbbd0004dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:30.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.523+0000 7fbbd97fa640 1 -- 172.21.15.99:0/4137899128 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd002dbc0 con 0x7fbbdc0fff40 2024-01-31T05:12:30.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.524+0000 7fbbe27b5640 1 -- 172.21.15.99:0/4137899128 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbdc1a1020 con 0x7fbbdc0fff40 2024-01-31T05:12:30.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.524+0000 7fbbd97fa640 1 -- 172.21.15.99:0/4137899128 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbbd002dd20 con 0x7fbbdc0fff40 2024-01-31T05:12:30.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.524+0000 7fbbe27b5640 1 -- 172.21.15.99:0/4137899128 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbdc1a1550 con 0x7fbbdc0fff40 2024-01-31T05:12:30.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.524+0000 7fbbd97fa640 1 -- 172.21.15.99:0/4137899128 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd0003c60 con 0x7fbbdc0fff40 2024-01-31T05:12:30.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.526+0000 7fbbd97fa640 1 -- 172.21.15.99:0/4137899128 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 19) v1 ==== 135946+0+0 (secure 0 0 0) 0x7fbbd0005000 con 0x7fbbdc0fff40 2024-01-31T05:12:30.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.526+0000 7fbbd97fa640 1 --2- 172.21.15.99:0/4137899128 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fbbc40a1470 0x7fbbc40a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.527+0000 7fbbd97fa640 1 -- 172.21.15.99:0/4137899128 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fbbd00ef210 con 0x7fbbdc0fff40 2024-01-31T05:12:30.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.527+0000 7fbbdbfff640 1 --2- 172.21.15.99:0/4137899128 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fbbc40a1470 0x7fbbc40a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.527+0000 7fbbdbfff640 1 --2- 172.21.15.99:0/4137899128 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fbbc40a1470 0x7fbbc40a3930 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc009bd0 tx=0x7fbbcc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:30.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.527+0000 7fbbe557a740 1 Processor -- start 2024-01-31T05:12:30.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.527+0000 7fbbe557a740 1 -- start start 2024-01-31T05:12:30.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.528+0000 7fbbe557a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fac12c6f10 0x55fac12c7330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.528+0000 7fbbe557a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fac12c7900 0x55fac12cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.528+0000 7fbbe557a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fac12cca70 0x55fac12cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.528+0000 7fbbe557a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fac1235240 con 0x55fac12c7900 2024-01-31T05:12:30.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.528+0000 7fbbe557a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fac1232930 con 0x55fac12c6f10 2024-01-31T05:12:30.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.528+0000 7fbbe557a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fac122e220 con 0x55fac12cca70 2024-01-31T05:12:30.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.528+0000 7fbbdb7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fac12c7900 0x55fac12cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.528+0000 7fbbdb7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fac12c7900 0x55fac12cc400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33636/0 (socket says 172.21.15.99:33636) 2024-01-31T05:12:30.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.528+0000 7fbbdb7fe640 1 -- 172.21.15.99:0/1526059343 learned_addr learned my addr 172.21.15.99:0/1526059343 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:30.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.528+0000 7fbbe0d52640 1 --2- 172.21.15.99:0/1526059343 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fac12cca70 0x55fac12cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.528+0000 7fbbdbfff640 1 --2- 172.21.15.99:0/1526059343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fac12c6f10 0x55fac12c7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.528+0000 7fbbdb7fe640 1 -- 172.21.15.99:0/1526059343 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fac12cca70 msgr2=0x55fac12cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:30.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.528+0000 7fbbdb7fe640 1 --2- 172.21.15.99:0/1526059343 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fac12cca70 0x55fac12cef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.528+0000 7fbbdb7fe640 1 -- 172.21.15.99:0/1526059343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fac12c6f10 msgr2=0x55fac12c7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:30.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.528+0000 7fbbdb7fe640 1 --2- 172.21.15.99:0/1526059343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fac12c6f10 0x55fac12c7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.528+0000 7fbbdb7fe640 1 -- 172.21.15.99:0/1526059343 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fac11f07c0 con 0x55fac12c7900 2024-01-31T05:12:30.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.528+0000 7fbbdb7fe640 1 --2- 172.21.15.99:0/1526059343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fac12c7900 0x55fac12cc400 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fbbd00c4180 tx=0x7fbbd0003760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e8cc2437c1a6ba7 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:30.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.529+0000 7fbbc27fc640 1 -- 172.21.15.99:0/1526059343 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd00ef020 con 0x55fac12c7900 2024-01-31T05:12:30.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.529+0000 7fbbc27fc640 1 -- 172.21.15.99:0/1526059343 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbbd00bc320 con 0x55fac12c7900 2024-01-31T05:12:30.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.529+0000 7fbbc27fc640 1 -- 172.21.15.99:0/1526059343 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd00c0120 con 0x55fac12c7900 2024-01-31T05:12:30.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.529+0000 7fbbe557a740 1 -- 172.21.15.99:0/1526059343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fac12c7900 msgr2=0x55fac12cc400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:30.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.529+0000 7fbbe557a740 1 --2- 172.21.15.99:0/1526059343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fac12c7900 0x55fac12cc400 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fbbd00c4180 tx=0x7fbbd0003760 comp rx=0 tx=0).stop 2024-01-31T05:12:30.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.530+0000 7fbbe557a740 1 -- 172.21.15.99:0/1526059343 shutdown_connections 2024-01-31T05:12:30.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.530+0000 7fbbe557a740 1 --2- 172.21.15.99:0/1526059343 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fac12cca70 0x55fac12cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.530+0000 7fbbe557a740 1 --2- 172.21.15.99:0/1526059343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fac12c7900 0x55fac12cc400 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.530+0000 7fbbe557a740 1 --2- 172.21.15.99:0/1526059343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fac12c6f10 0x55fac12c7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.530+0000 7fbbe557a740 1 -- 172.21.15.99:0/1526059343 >> 172.21.15.99:0/1526059343 conn(0x55fac12c2480 msgr2=0x55fac12c2880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:30.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.530+0000 7fbbe557a740 1 -- 172.21.15.99:0/1526059343 shutdown_connections 2024-01-31T05:12:30.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.530+0000 7fbbe557a740 1 -- 172.21.15.99:0/1526059343 wait complete. 2024-01-31T05:12:30.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.530+0000 7fbbe557a740 1 -- start start 2024-01-31T05:12:30.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.530+0000 7fbbe557a740 1 Processor -- start 2024-01-31T05:12:30.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.531+0000 7fbbe557a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fac12c6f10 0x55fac12d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.531+0000 7fbbe557a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fac12c7900 0x55fac12d1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.531+0000 7fbbdbfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fac12c6f10 0x55fac12d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.531+0000 7fbbdbfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fac12c6f10 0x55fac12d0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33650/0 (socket says 172.21.15.99:33650) 2024-01-31T05:12:30.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.531+0000 7fbbdbfff640 1 -- 172.21.15.99:0/2769050796 learned_addr learned my addr 172.21.15.99:0/2769050796 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:30.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.531+0000 7fbbe557a740 1 --2- 172.21.15.99:0/2769050796 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fac12cca70 0x55fac12d83d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.531+0000 7fbbe557a740 1 -- 172.21.15.99:0/2769050796 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fac11e75e0 con 0x55fac12c6f10 2024-01-31T05:12:30.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.531+0000 7fbbe557a740 1 -- 172.21.15.99:0/2769050796 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fac11e7280 con 0x55fac12c7900 2024-01-31T05:12:30.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.531+0000 7fbbe557a740 1 -- 172.21.15.99:0/2769050796 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fac11ac3d0 con 0x55fac12cca70 2024-01-31T05:12:30.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.531+0000 7fbbe557a740 10 client.0 _ll_register_callbacks cb 0x55fac1224eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:12:30.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.531+0000 7fbbdbfff640 1 -- 172.21.15.99:0/2769050796 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fac12cca70 msgr2=0x55fac12d83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:30.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.531+0000 7fbbdbfff640 1 --2- 172.21.15.99:0/2769050796 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fac12cca70 0x55fac12d83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.531+0000 7fbbdbfff640 1 -- 172.21.15.99:0/2769050796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fac12c7900 msgr2=0x55fac12d1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:30.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.531+0000 7fbbdb7fe640 1 --2- 172.21.15.99:0/2769050796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fac12c7900 0x55fac12d1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.531+0000 7fbbdbfff640 1 --2- 172.21.15.99:0/2769050796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fac12c7900 0x55fac12d1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.531+0000 7fbbdbfff640 1 -- 172.21.15.99:0/2769050796 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbdc1a1550 con 0x55fac12c6f10 2024-01-31T05:12:30.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.531+0000 7fbbdbfff640 1 --2- 172.21.15.99:0/2769050796 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fac12c6f10 0x55fac12d0e50 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc0039f0 tx=0x7fbbcc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1db6c9a1202e5bb server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:30.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.531+0000 7fbbbb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:12:30.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.531+0000 7fbbbb7fe640 1 -- 172.21.15.99:0/2769050796 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc01fe80 con 0x55fac12c6f10 2024-01-31T05:12:30.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.531+0000 7fbbbb7fe640 1 -- 172.21.15.99:0/2769050796 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fbbcc0047a0 con 0x55fac12c6f10 2024-01-31T05:12:30.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.531+0000 7fbbe557a740 1 -- 172.21.15.99:0/2769050796 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fac12270b0 con 0x55fac12c6f10 2024-01-31T05:12:30.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.532+0000 7fbbbb7fe640 1 -- 172.21.15.99:0/2769050796 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbbcc0049a0 con 0x55fac12c6f10 2024-01-31T05:12:30.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.532+0000 7fbbe557a740 10 client.15768 fetch_fsmap learned FSMap version 27 2024-01-31T05:12:30.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.532+0000 7fbbe557a740 1 -- 172.21.15.99:0/2769050796 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55fac122c8a0 con 0x55fac12c6f10 2024-01-31T05:12:30.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.532+0000 7fbbbb7fe640 1 -- 172.21.15.99:0/2769050796 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55fac12270b0 con 0x55fac12c6f10 2024-01-31T05:12:30.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.532+0000 7fbbbb7fe640 1 -- 172.21.15.99:0/2769050796 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fbbcc032430 con 0x55fac12c6f10 2024-01-31T05:12:30.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.532+0000 7fbbe557a740 10 client.15768 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:12:30.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.532+0000 7fbbe557a740 10 client.15768 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-01-31T05:12:30.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.532+0000 7fbbe557a740 20 client.15768 populate_metadata read hostname 'smithi099' 2024-01-31T05:12:30.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.532+0000 7fbbe557a740 1 --2- 172.21.15.99:0/2769050796 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x55fac12dce00 0x55fac12df260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.532+0000 7fbbe557a740 4 client.15768 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:12:30.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.532+0000 7fbbe557a740 1 -- 172.21.15.99:0/2769050796 --> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fac1226dd0 con 0x55fac12dce00 2024-01-31T05:12:30.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.533+0000 7fbbdb7fe640 1 --2- 172.21.15.99:0/2769050796 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x55fac12dce00 0x55fac12df260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.533+0000 7fbbdb7fe640 1 --2- 172.21.15.99:0/2769050796 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x55fac12dce00 0x55fac12df260 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3b69e98fdf22f3de server_cookie=36ce5b21f0497958 in_seq=0 out_seq=0 2024-01-31T05:12:30.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.533+0000 7fbbbb7fe640 10 client.15768 ms_handle_connect on v2:172.21.15.181:6838/996120687 2024-01-31T05:12:30.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.534+0000 7fbbbb7fe640 1 -- 172.21.15.99:0/2769050796 <== mds.2 v2:172.21.15.181:6838/996120687 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55fac1226dd0 con 0x55fac12dce00 2024-01-31T05:12:30.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.534+0000 7fbbbb7fe640 10 client.15768 handle_command_reply: tid=0 2024-01-31T05:12:30.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.534+0000 7fbbe557a740 1 client.15768 shutdown 2024-01-31T05:12:30.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.534+0000 7fbbe557a740 1 -- 172.21.15.99:0/2769050796 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fac12c6f10 msgr2=0x55fac12d0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:30.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.534+0000 7fbbe557a740 1 --2- 172.21.15.99:0/2769050796 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fac12c6f10 0x55fac12d0e50 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc0039f0 tx=0x7fbbcc004730 comp rx=0 tx=0).stop 2024-01-31T05:12:30.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.534+0000 7fbbe557a740 1 -- 172.21.15.99:0/2769050796 shutdown_connections 2024-01-31T05:12:30.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.534+0000 7fbbe557a740 1 --2- 172.21.15.99:0/2769050796 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x55fac12dce00 0x55fac12df260 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.534+0000 7fbbbb7fe640 0 client.15768 ms_handle_reset on v2:172.21.15.181:6838/996120687 2024-01-31T05:12:30.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.534+0000 7fbbe557a740 1 --2- 172.21.15.99:0/2769050796 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fac12cca70 0x55fac12d83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.534+0000 7fbbe557a740 1 --2- 172.21.15.99:0/2769050796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fac12c7900 0x55fac12d1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.534+0000 7fbbe557a740 1 --2- 172.21.15.99:0/2769050796 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fac12c6f10 0x55fac12d0e50 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.534+0000 7fbbe557a740 1 -- 172.21.15.99:0/2769050796 >> 172.21.15.99:0/2769050796 conn(0x55fac12c2480 msgr2=0x55fac12c17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:30.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.534+0000 7fbbe557a740 1 -- 172.21.15.99:0/2769050796 shutdown_connections 2024-01-31T05:12:30.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.534+0000 7fbbe557a740 1 -- 172.21.15.99:0/2769050796 wait complete. 2024-01-31T05:12:30.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.534+0000 7fbbe557a740 20 client.15768 trim_cache size 0 max 16384 2024-01-31T05:12:30.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.546+0000 7fbbe557a740 1 Processor -- start 2024-01-31T05:12:30.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.546+0000 7fbbe557a740 1 -- start start 2024-01-31T05:12:30.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.546+0000 7fbbe557a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fac12c6f10 0x55fac12d0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.546+0000 7fbbe557a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fac12c7900 0x55fac12d8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.546+0000 7fbbe557a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fac12cca70 0x55fac12d0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.546+0000 7fbbe557a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fac12c2ed0 con 0x55fac12c7900 2024-01-31T05:12:30.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.546+0000 7fbbe557a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fac12be260 con 0x55fac12c6f10 2024-01-31T05:12:30.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.546+0000 7fbbe557a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fac1226dd0 con 0x55fac12cca70 2024-01-31T05:12:30.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.546+0000 7fbbdb7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fac12c7900 0x55fac12d8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.546+0000 7fbbdb7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fac12c7900 0x55fac12d8390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33656/0 (socket says 172.21.15.99:33656) 2024-01-31T05:12:30.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.546+0000 7fbbdb7fe640 1 -- 172.21.15.99:0/2952323121 learned_addr learned my addr 172.21.15.99:0/2952323121 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:30.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.546+0000 7fbbdbfff640 1 --2- 172.21.15.99:0/2952323121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fac12c6f10 0x55fac12d0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.546+0000 7fbbe0d52640 1 --2- 172.21.15.99:0/2952323121 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fac12cca70 0x55fac12d0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.546+0000 7fbbdb7fe640 1 -- 172.21.15.99:0/2952323121 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fac12cca70 msgr2=0x55fac12d0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:30.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.546+0000 7fbbdb7fe640 1 --2- 172.21.15.99:0/2952323121 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fac12cca70 0x55fac12d0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.546+0000 7fbbdb7fe640 1 -- 172.21.15.99:0/2952323121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fac12c6f10 msgr2=0x55fac12d0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:30.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.546+0000 7fbbdb7fe640 1 --2- 172.21.15.99:0/2952323121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fac12c6f10 0x55fac12d0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.546+0000 7fbbdb7fe640 1 -- 172.21.15.99:0/2952323121 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fac11c94d0 con 0x55fac12c7900 2024-01-31T05:12:30.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.547+0000 7fbbdb7fe640 1 --2- 172.21.15.99:0/2952323121 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fac12c7900 0x55fac12d8390 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fbbd00b8d90 tx=0x7fbbd0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79564fe73dd85420 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:30.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.547+0000 7fbbc1ffb640 1 -- 172.21.15.99:0/2952323121 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd00055c0 con 0x55fac12c7900 2024-01-31T05:12:30.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.547+0000 7fbbc1ffb640 1 -- 172.21.15.99:0/2952323121 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbbd00c46b0 con 0x55fac12c7900 2024-01-31T05:12:30.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.547+0000 7fbbc1ffb640 1 -- 172.21.15.99:0/2952323121 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd00b8a30 con 0x55fac12c7900 2024-01-31T05:12:30.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.548+0000 7fbbe557a740 1 -- 172.21.15.99:0/2952323121 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fac12c7900 msgr2=0x55fac12d8390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:30.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.548+0000 7fbbe557a740 1 --2- 172.21.15.99:0/2952323121 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fac12c7900 0x55fac12d8390 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fbbd00b8d90 tx=0x7fbbd0000bc0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.548+0000 7fbbe557a740 1 -- 172.21.15.99:0/2952323121 shutdown_connections 2024-01-31T05:12:30.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.548+0000 7fbbe557a740 1 --2- 172.21.15.99:0/2952323121 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fac12cca70 0x55fac12d0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.548+0000 7fbbe557a740 1 --2- 172.21.15.99:0/2952323121 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fac12c7900 0x55fac12d8390 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.548+0000 7fbbe557a740 1 --2- 172.21.15.99:0/2952323121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fac12c6f10 0x55fac12d0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.548+0000 7fbbe557a740 1 -- 172.21.15.99:0/2952323121 >> 172.21.15.99:0/2952323121 conn(0x55fac12c2480 msgr2=0x55fac12c8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:30.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.548+0000 7fbbe557a740 1 -- 172.21.15.99:0/2952323121 shutdown_connections 2024-01-31T05:12:30.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.548+0000 7fbbe557a740 1 -- 172.21.15.99:0/2952323121 wait complete. 2024-01-31T05:12:30.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.548+0000 7fbbe557a740 1 -- start start 2024-01-31T05:12:30.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.548+0000 7fbbe557a740 1 Processor -- start 2024-01-31T05:12:30.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.548+0000 7fbbe557a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fac12c6f10 0x55fac12d82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.548+0000 7fbbe557a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fac12c7900 0x55fac12d68d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.548+0000 7fbbe557a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fac12cca70 0x55fac12d6e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.549+0000 7fbbe557a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fac12d7550 con 0x55fac12c7900 2024-01-31T05:12:30.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.549+0000 7fbbe557a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fac12d76c0 con 0x55fac12cca70 2024-01-31T05:12:30.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.549+0000 7fbbe557a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fac1333370 con 0x55fac12c6f10 2024-01-31T05:12:30.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.549+0000 7fbbe557a740 10 client.0 _ll_register_callbacks cb 0x7fbbd002de90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:12:30.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.549+0000 7fbbdbfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fac12c6f10 0x55fac12d82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.549+0000 7fbbdbfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fac12c6f10 0x55fac12d82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:41356/0 (socket says 172.21.15.99:41356) 2024-01-31T05:12:30.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.549+0000 7fbbdb7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fac12c7900 0x55fac12d68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.549+0000 7fbbdbfff640 1 -- 172.21.15.99:0/2711850484 learned_addr learned my addr 172.21.15.99:0/2711850484 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:30.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.549+0000 7fbbe0d52640 1 --2- 172.21.15.99:0/2711850484 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fac12cca70 0x55fac12d6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.549+0000 7fbbdb7fe640 1 -- 172.21.15.99:0/2711850484 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fac12c6f10 msgr2=0x55fac12d82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:30.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.549+0000 7fbbdb7fe640 1 --2- 172.21.15.99:0/2711850484 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fac12c6f10 0x55fac12d82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.549+0000 7fbbdb7fe640 1 -- 172.21.15.99:0/2711850484 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fac12cca70 msgr2=0x55fac12d6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:30.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.549+0000 7fbbdb7fe640 1 --2- 172.21.15.99:0/2711850484 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fac12cca70 0x55fac12d6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.549+0000 7fbbdb7fe640 1 -- 172.21.15.99:0/2711850484 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fac11f07c0 con 0x55fac12c7900 2024-01-31T05:12:30.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.549+0000 7fbbdbfff640 1 --2- 172.21.15.99:0/2711850484 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fac12c6f10 0x55fac12d82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:12:30.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.549+0000 7fbbdb7fe640 1 --2- 172.21.15.99:0/2711850484 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fac12c7900 0x55fac12d68d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fbbd002c750 tx=0x7fbbd0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d8913baaeb8c501 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:30.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.549+0000 7fbbbb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:12:30.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.549+0000 7fbbbb7fe640 1 -- 172.21.15.99:0/2711850484 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd00c04f0 con 0x55fac12c7900 2024-01-31T05:12:30.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.549+0000 7fbbbb7fe640 1 -- 172.21.15.99:0/2711850484 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fbbd00055c0 con 0x55fac12c7900 2024-01-31T05:12:30.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.549+0000 7fbbe557a740 1 -- 172.21.15.99:0/2711850484 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbbd00bc320 con 0x55fac12c7900 2024-01-31T05:12:30.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.550+0000 7fbbbb7fe640 1 -- 172.21.15.99:0/2711850484 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbbd00c0120 con 0x55fac12c7900 2024-01-31T05:12:30.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.550+0000 7fbbe557a740 10 client.15774 fetch_fsmap learned FSMap version 27 2024-01-31T05:12:30.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.550+0000 7fbbe557a740 1 -- 172.21.15.99:0/2711850484 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55fac11ef020 con 0x55fac12c7900 2024-01-31T05:12:30.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.550+0000 7fbbbb7fe640 1 -- 172.21.15.99:0/2711850484 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbbd00bc320 con 0x55fac12c7900 2024-01-31T05:12:30.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.550+0000 7fbbbb7fe640 1 -- 172.21.15.99:0/2711850484 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fbbd003c070 con 0x55fac12c7900 2024-01-31T05:12:30.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.550+0000 7fbbe557a740 10 client.15774 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:12:30.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.550+0000 7fbbe557a740 10 client.15774 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-01-31T05:12:30.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.550+0000 7fbbe557a740 20 client.15774 populate_metadata read hostname 'smithi099' 2024-01-31T05:12:30.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.550+0000 7fbbe557a740 1 --2- 172.21.15.99:0/2711850484 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x55fac12dce00 0x55fac13368d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.550+0000 7fbbe557a740 4 client.15774 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-01-31T05:12:30.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.550+0000 7fbbe557a740 1 -- 172.21.15.99:0/2711850484 --> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55fac0f2d7e0 con 0x55fac12dce00 2024-01-31T05:12:30.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.550+0000 7fbbdbfff640 1 --2- 172.21.15.99:0/2711850484 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x55fac12dce00 0x55fac13368d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.551+0000 7fbbbb7fe640 10 client.15774 ms_handle_connect on v2:172.21.15.181:6838/996120687 2024-01-31T05:12:30.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.551+0000 7fbbdbfff640 1 --2- 172.21.15.99:0/2711850484 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x55fac12dce00 0x55fac13368d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8510121e2feceab4 server_cookie=b2d636bccff14e44 in_seq=0 out_seq=0 2024-01-31T05:12:30.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.551+0000 7fbbbb7fe640 1 -- 172.21.15.99:0/2711850484 <== mds.2 v2:172.21.15.181:6838/996120687 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55fac0f2d7e0 con 0x55fac12dce00 2024-01-31T05:12:30.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.551+0000 7fbbbb7fe640 10 client.15774 handle_command_reply: tid=0 2024-01-31T05:12:30.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.551+0000 7fbbe557a740 1 client.15774 shutdown 2024-01-31T05:12:30.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.551+0000 7fbbe557a740 1 -- 172.21.15.99:0/2711850484 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fac12c7900 msgr2=0x55fac12d68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:30.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.551+0000 7fbbe557a740 1 --2- 172.21.15.99:0/2711850484 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fac12c7900 0x55fac12d68d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fbbd002c750 tx=0x7fbbd0009260 comp rx=0 tx=0).stop 2024-01-31T05:12:30.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.551+0000 7fbbe557a740 1 -- 172.21.15.99:0/2711850484 shutdown_connections 2024-01-31T05:12:30.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.551+0000 7fbbe557a740 1 --2- 172.21.15.99:0/2711850484 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fac12cca70 0x55fac12d6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.551+0000 7fbbe557a740 1 --2- 172.21.15.99:0/2711850484 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fac12c7900 0x55fac12d68d0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.551+0000 7fbbe557a740 1 --2- 172.21.15.99:0/2711850484 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x55fac12dce00 0x55fac13368d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.551+0000 7fbbe557a740 1 --2- 172.21.15.99:0/2711850484 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fac12c6f10 0x55fac12d82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.551+0000 7fbbbb7fe640 0 client.15774 ms_handle_reset on v2:172.21.15.181:6838/996120687 2024-01-31T05:12:30.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.551+0000 7fbbe557a740 1 -- 172.21.15.99:0/2711850484 >> 172.21.15.99:0/2711850484 conn(0x55fac12c2480 msgr2=0x55fac12d09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:30.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.551+0000 7fbbe557a740 1 -- 172.21.15.99:0/2711850484 shutdown_connections 2024-01-31T05:12:30.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.551+0000 7fbbe557a740 1 -- 172.21.15.99:0/2711850484 wait complete. 2024-01-31T05:12:30.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.551+0000 7fbbe557a740 20 client.15774 trim_cache size 0 max 16384 2024-01-31T05:12:30.558 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-01-31T05:12:30.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.552+0000 7fbbe27b5640 1 -- 172.21.15.99:0/4137899128 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fbbc40a1470 msgr2=0x7fbbc40a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:30.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.552+0000 7fbbe27b5640 1 --2- 172.21.15.99:0/4137899128 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fbbc40a1470 0x7fbbc40a3930 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc009bd0 tx=0x7fbbcc005f90 comp rx=0 tx=0).stop 2024-01-31T05:12:30.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.552+0000 7fbbe27b5640 1 -- 172.21.15.99:0/4137899128 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbbdc0fff40 msgr2=0x7fbbdc1994c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:30.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.552+0000 7fbbe27b5640 1 --2- 172.21.15.99:0/4137899128 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbbdc0fff40 0x7fbbdc1994c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0009230 tx=0x7fbbd0004dd0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.552+0000 7fbbe27b5640 1 -- 172.21.15.99:0/4137899128 shutdown_connections 2024-01-31T05:12:30.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.552+0000 7fbbe27b5640 1 --2- 172.21.15.99:0/4137899128 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fbbc40a1470 0x7fbbc40a3930 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.552+0000 7fbbe27b5640 1 --2- 172.21.15.99:0/4137899128 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbbdc1008e0 0x7fbbdc1a0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.552+0000 7fbbe27b5640 1 --2- 172.21.15.99:0/4137899128 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbbdc0fff40 0x7fbbdc1994c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.552+0000 7fbbe27b5640 1 --2- 172.21.15.99:0/4137899128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbbdc0ff5e0 0x7fbbdc198f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.552+0000 7fbbe27b5640 1 -- 172.21.15.99:0/4137899128 >> 172.21.15.99:0/4137899128 conn(0x7fbbdc0fb180 msgr2=0x7fbbdc0fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:30.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.552+0000 7fbbe27b5640 1 -- 172.21.15.99:0/4137899128 shutdown_connections 2024-01-31T05:12:30.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.552+0000 7fbbe27b5640 1 -- 172.21.15.99:0/4137899128 wait complete. 2024-01-31T05:12:30.562 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-01-31T05:12:30.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.668+0000 7f36282f8640 1 -- 172.21.15.99:0/191997889 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3620101770 msgr2=0x7f3620103b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:30.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.668+0000 7f36282f8640 1 --2- 172.21.15.99:0/191997889 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3620101770 0x7f3620103b60 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f361c009900 tx=0x7f361c02bc30 comp rx=0 tx=0).stop 2024-01-31T05:12:30.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.668+0000 7f36282f8640 1 -- 172.21.15.99:0/191997889 shutdown_connections 2024-01-31T05:12:30.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.668+0000 7f36282f8640 1 --2- 172.21.15.99:0/191997889 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36201069d0 0x7f3620108e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.668+0000 7f36282f8640 1 --2- 172.21.15.99:0/191997889 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36201040a0 0x7f3620106490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.668+0000 7f36282f8640 1 --2- 172.21.15.99:0/191997889 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3620101770 0x7f3620103b60 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.668+0000 7f36282f8640 1 -- 172.21.15.99:0/191997889 >> 172.21.15.99:0/191997889 conn(0x7f36200fb180 msgr2=0x7f36200fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:30.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.668+0000 7f36282f8640 1 -- 172.21.15.99:0/191997889 shutdown_connections 2024-01-31T05:12:30.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.668+0000 7f36282f8640 1 -- 172.21.15.99:0/191997889 wait complete. 2024-01-31T05:12:30.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.669+0000 7f36282f8640 1 Processor -- start 2024-01-31T05:12:30.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.669+0000 7f36282f8640 1 -- start start 2024-01-31T05:12:30.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.669+0000 7f36282f8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3620101770 0x7f3620196c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.669+0000 7f36282f8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36201040a0 0x7f36201971d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.669+0000 7f36282f8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36201069d0 0x7f362019e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.669+0000 7f3625893640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36201040a0 0x7f36201971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.670+0000 7f3625893640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36201040a0 0x7f36201971d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33684/0 (socket says 172.21.15.99:33684) 2024-01-31T05:12:30.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.670+0000 7f3625893640 1 -- 172.21.15.99:0/813318807 learned_addr learned my addr 172.21.15.99:0/813318807 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:30.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.670+0000 7f36282f8640 1 -- 172.21.15.99:0/813318807 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362019e7a0 con 0x7f36201040a0 2024-01-31T05:12:30.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.670+0000 7f36282f8640 1 -- 172.21.15.99:0/813318807 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362019e910 con 0x7f3620101770 2024-01-31T05:12:30.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.670+0000 7f36282f8640 1 -- 172.21.15.99:0/813318807 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362019ead0 con 0x7f36201069d0 2024-01-31T05:12:30.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.670+0000 7f3626094640 1 --2- 172.21.15.99:0/813318807 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3620101770 0x7f3620196c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.670+0000 7f3626895640 1 --2- 172.21.15.99:0/813318807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36201069d0 0x7f362019e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.670+0000 7f3625893640 1 -- 172.21.15.99:0/813318807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36201069d0 msgr2=0x7f362019e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:30.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.670+0000 7f3625893640 1 --2- 172.21.15.99:0/813318807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36201069d0 0x7f362019e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.670+0000 7f3625893640 1 -- 172.21.15.99:0/813318807 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3620101770 msgr2=0x7f3620196c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:30.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.670+0000 7f3625893640 1 --2- 172.21.15.99:0/813318807 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3620101770 0x7f3620196c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.670+0000 7f3625893640 1 -- 172.21.15.99:0/813318807 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f361c009560 con 0x7f36201040a0 2024-01-31T05:12:30.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.670+0000 7f3625893640 1 --2- 172.21.15.99:0/813318807 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36201040a0 0x7f36201971d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f361000c970 tx=0x7f361000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:30.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.670+0000 7f36177fe640 1 -- 172.21.15.99:0/813318807 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3610004440 con 0x7f36201040a0 2024-01-31T05:12:30.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.670+0000 7f36177fe640 1 -- 172.21.15.99:0/813318807 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3610007d20 con 0x7f36201040a0 2024-01-31T05:12:30.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.670+0000 7f36282f8640 1 -- 172.21.15.99:0/813318807 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f362019edb0 con 0x7f36201040a0 2024-01-31T05:12:30.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.671+0000 7f36177fe640 1 -- 172.21.15.99:0/813318807 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361000f450 con 0x7f36201040a0 2024-01-31T05:12:30.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.671+0000 7f36282f8640 1 -- 172.21.15.99:0/813318807 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f362019f280 con 0x7f36201040a0 2024-01-31T05:12:30.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.673+0000 7f362b197740 1 Processor -- start 2024-01-31T05:12:30.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.674+0000 7f362b197740 1 -- start start 2024-01-31T05:12:30.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.674+0000 7f362b197740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c620cdf10 0x562c620ce330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.674+0000 7f362b197740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c620ce900 0x562c620d3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.674+0000 7f362b197740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562c620d3a70 0x562c620d5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.674+0000 7f362b197740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c6203c240 con 0x562c620d3a70 2024-01-31T05:12:30.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.674+0000 7f362b197740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c62039930 con 0x562c620ce900 2024-01-31T05:12:30.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.674+0000 7f362b197740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c62035220 con 0x562c620cdf10 2024-01-31T05:12:30.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.674+0000 7f3626094640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c620ce900 0x562c620d3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.674+0000 7f36177fe640 1 -- 172.21.15.99:0/813318807 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f36100035f0 con 0x7f36201040a0 2024-01-31T05:12:30.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.674+0000 7f3626094640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c620ce900 0x562c620d3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.99:34952/0 (socket says 172.21.15.99:34952) 2024-01-31T05:12:30.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.674+0000 7f3626094640 1 -- 172.21.15.99:0/920678038 learned_addr learned my addr 172.21.15.99:0/920678038 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:30.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.674+0000 7f3625893640 1 --2- 172.21.15.99:0/920678038 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562c620d3a70 0x562c620d5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.674+0000 7f3626895640 1 --2- 172.21.15.99:0/920678038 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c620cdf10 0x562c620ce330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.675+0000 7f3626094640 1 -- 172.21.15.99:0/920678038 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c620cdf10 msgr2=0x562c620ce330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:30.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.675+0000 7f3626094640 1 --2- 172.21.15.99:0/920678038 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c620cdf10 0x562c620ce330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.675+0000 7f3626094640 1 -- 172.21.15.99:0/920678038 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562c620d3a70 msgr2=0x562c620d5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:30.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.675+0000 7f3626094640 1 --2- 172.21.15.99:0/920678038 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562c620d3a70 0x562c620d5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.675+0000 7f3626094640 1 -- 172.21.15.99:0/920678038 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c61ff77c0 con 0x562c620ce900 2024-01-31T05:12:30.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.675+0000 7f3625893640 1 --2- 172.21.15.99:0/920678038 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562c620d3a70 0x562c620d5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:12:30.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.675+0000 7f36177fe640 1 --2- 172.21.15.99:0/813318807 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f360c0a13f0 0x7f360c0a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.675+0000 7f36177fe640 1 -- 172.21.15.99:0/813318807 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f36100ccbd0 con 0x7f36201040a0 2024-01-31T05:12:30.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.675+0000 7f3626895640 1 --2- 172.21.15.99:0/813318807 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f360c0a13f0 0x7f360c0a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.676+0000 7f3626895640 1 --2- 172.21.15.99:0/813318807 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f360c0a13f0 0x7f360c0a38b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x562c620cf160 tx=0x7f3618009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:30.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.676+0000 7f3626094640 1 --2- 172.21.15.99:0/920678038 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c620ce900 0x562c620d3400 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f361c02c6b0 tx=0x7f361c02c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=739a38f0d5b9877d server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:30.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.676+0000 7f3614bfe640 1 -- 172.21.15.99:0/920678038 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361c02ca70 con 0x562c620ce900 2024-01-31T05:12:30.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.676+0000 7f3614bfe640 1 -- 172.21.15.99:0/920678038 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f361c02cbd0 con 0x562c620ce900 2024-01-31T05:12:30.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.676+0000 7f3614bfe640 1 -- 172.21.15.99:0/920678038 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361c0054c0 con 0x562c620ce900 2024-01-31T05:12:30.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.677+0000 7f362b197740 1 -- 172.21.15.99:0/920678038 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c620ce900 msgr2=0x562c620d3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:30.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.677+0000 7f362b197740 1 --2- 172.21.15.99:0/920678038 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c620ce900 0x562c620d3400 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f361c02c6b0 tx=0x7f361c02c880 comp rx=0 tx=0).stop 2024-01-31T05:12:30.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.677+0000 7f362b197740 1 -- 172.21.15.99:0/920678038 shutdown_connections 2024-01-31T05:12:30.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.677+0000 7f362b197740 1 --2- 172.21.15.99:0/920678038 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562c620d3a70 0x562c620d5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.677+0000 7f362b197740 1 --2- 172.21.15.99:0/920678038 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c620ce900 0x562c620d3400 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.677+0000 7f362b197740 1 --2- 172.21.15.99:0/920678038 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c620cdf10 0x562c620ce330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.677+0000 7f362b197740 1 -- 172.21.15.99:0/920678038 >> 172.21.15.99:0/920678038 conn(0x562c620c9480 msgr2=0x562c620c9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:30.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.677+0000 7f362b197740 1 -- 172.21.15.99:0/920678038 shutdown_connections 2024-01-31T05:12:30.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.677+0000 7f362b197740 1 -- 172.21.15.99:0/920678038 wait complete. 2024-01-31T05:12:30.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.677+0000 7f362b197740 1 -- start start 2024-01-31T05:12:30.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.677+0000 7f362b197740 1 Processor -- start 2024-01-31T05:12:30.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.678+0000 7f362b197740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c620cdf10 0x562c620d8060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.678+0000 7f362b197740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562c620ce900 0x562c620d85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.678+0000 7f362b197740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c620d3a70 0x562c620df5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.678+0000 7f362b197740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c61fee5e0 con 0x562c620ce900 2024-01-31T05:12:30.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.678+0000 7f362b197740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c61fee280 con 0x562c620d3a70 2024-01-31T05:12:30.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.678+0000 7f362b197740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c61fb33d0 con 0x562c620cdf10 2024-01-31T05:12:30.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.678+0000 7f362b197740 10 client.0 _ll_register_callbacks cb 0x562c6202beb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:12:30.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.678+0000 7f3625893640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562c620ce900 0x562c620d85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.678+0000 7f3626094640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c620cdf10 0x562c620d8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.678+0000 7f3625893640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562c620ce900 0x562c620d85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33700/0 (socket says 172.21.15.99:33700) 2024-01-31T05:12:30.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.678+0000 7f3625893640 1 -- 172.21.15.99:0/1638217433 learned_addr learned my addr 172.21.15.99:0/1638217433 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:30.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.678+0000 7f3626895640 1 --2- 172.21.15.99:0/1638217433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c620d3a70 0x562c620df5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.678+0000 7f3625893640 1 -- 172.21.15.99:0/1638217433 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c620cdf10 msgr2=0x562c620d8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:30.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.678+0000 7f3625893640 1 --2- 172.21.15.99:0/1638217433 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c620cdf10 0x562c620d8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.678+0000 7f3625893640 1 -- 172.21.15.99:0/1638217433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c620d3a70 msgr2=0x562c620df5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:30.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.678+0000 7f3625893640 1 --2- 172.21.15.99:0/1638217433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c620d3a70 0x562c620df5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.678+0000 7f3625893640 1 -- 172.21.15.99:0/1638217433 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3620109a00 con 0x562c620ce900 2024-01-31T05:12:30.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.678+0000 7f3626094640 1 --2- 172.21.15.99:0/1638217433 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c620cdf10 0x562c620d8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:12:30.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.678+0000 7f3625893640 1 --2- 172.21.15.99:0/1638217433 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562c620ce900 0x562c620d85a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f36100a1b30 tx=0x7f3610007f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a44b803e207ebd0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:30.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.678+0000 7f3609ffb640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:12:30.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.678+0000 7f3609ffb640 1 -- 172.21.15.99:0/1638217433 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3610099630 con 0x562c620ce900 2024-01-31T05:12:30.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.678+0000 7f3609ffb640 1 -- 172.21.15.99:0/1638217433 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f361009a3d0 con 0x562c620ce900 2024-01-31T05:12:30.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.678+0000 7f362b197740 1 -- 172.21.15.99:0/1638217433 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562c6202e0b0 con 0x562c620ce900 2024-01-31T05:12:30.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.679+0000 7f3609ffb640 1 -- 172.21.15.99:0/1638217433 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3610099cd0 con 0x562c620ce900 2024-01-31T05:12:30.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.679+0000 7f362b197740 10 client.15786 fetch_fsmap learned FSMap version 27 2024-01-31T05:12:30.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.679+0000 7f362b197740 1 -- 172.21.15.99:0/1638217433 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x562c620338a0 con 0x562c620ce900 2024-01-31T05:12:30.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.679+0000 7f3609ffb640 1 -- 172.21.15.99:0/1638217433 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562c6202e0b0 con 0x562c620ce900 2024-01-31T05:12:30.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.679+0000 7f3609ffb640 1 -- 172.21.15.99:0/1638217433 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f36100a1cf0 con 0x562c620ce900 2024-01-31T05:12:30.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.679+0000 7f362b197740 10 client.15786 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:12:30.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.679+0000 7f362b197740 10 client.15786 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-01-31T05:12:30.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.679+0000 7f362b197740 20 client.15786 populate_metadata read hostname 'smithi099' 2024-01-31T05:12:30.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.679+0000 7f362b197740 1 --2- 172.21.15.99:0/1638217433 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x562c620e3ee0 0x562c620e62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.679+0000 7f362b197740 4 client.15786 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:12:30.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.679+0000 7f362b197740 1 -- 172.21.15.99:0/1638217433 --> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562c6202ddd0 con 0x562c620e3ee0 2024-01-31T05:12:30.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.679+0000 7f3626094640 1 --2- 172.21.15.99:0/1638217433 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x562c620e3ee0 0x562c620e62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.680+0000 7f3626094640 1 --2- 172.21.15.99:0/1638217433 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x562c620e3ee0 0x562c620e62d0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f967edafc6af96d7 server_cookie=14f7d507e1a70379 in_seq=0 out_seq=0 2024-01-31T05:12:30.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.680+0000 7f3609ffb640 10 client.15786 ms_handle_connect on v2:172.21.15.179:6836/837402830 2024-01-31T05:12:30.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.680+0000 7f3609ffb640 1 -- 172.21.15.99:0/1638217433 <== mds.1 v2:172.21.15.179:6836/837402830 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562c6202ddd0 con 0x562c620e3ee0 2024-01-31T05:12:30.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.680+0000 7f3609ffb640 10 client.15786 handle_command_reply: tid=0 2024-01-31T05:12:30.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.681+0000 7f362b197740 1 client.15786 shutdown 2024-01-31T05:12:30.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.681+0000 7f362b197740 1 -- 172.21.15.99:0/1638217433 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562c620ce900 msgr2=0x562c620d85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:30.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.681+0000 7f362b197740 1 --2- 172.21.15.99:0/1638217433 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562c620ce900 0x562c620d85a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f36100a1b30 tx=0x7f3610007f80 comp rx=0 tx=0).stop 2024-01-31T05:12:30.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.681+0000 7f362b197740 1 -- 172.21.15.99:0/1638217433 shutdown_connections 2024-01-31T05:12:30.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.681+0000 7f362b197740 1 --2- 172.21.15.99:0/1638217433 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x562c620e3ee0 0x562c620e62d0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.681+0000 7f362b197740 1 --2- 172.21.15.99:0/1638217433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c620d3a70 0x562c620df5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.681+0000 7f362b197740 1 --2- 172.21.15.99:0/1638217433 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562c620ce900 0x562c620d85a0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.681+0000 7f3609ffb640 0 client.15786 ms_handle_reset on v2:172.21.15.179:6836/837402830 2024-01-31T05:12:30.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.681+0000 7f362b197740 1 --2- 172.21.15.99:0/1638217433 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c620cdf10 0x562c620d8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.681+0000 7f362b197740 1 -- 172.21.15.99:0/1638217433 >> 172.21.15.99:0/1638217433 conn(0x562c620c9480 msgr2=0x562c620c87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:30.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.681+0000 7f362b197740 1 -- 172.21.15.99:0/1638217433 shutdown_connections 2024-01-31T05:12:30.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.681+0000 7f362b197740 1 -- 172.21.15.99:0/1638217433 wait complete. 2024-01-31T05:12:30.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.681+0000 7f362b197740 20 client.15786 trim_cache size 0 max 16384 2024-01-31T05:12:30.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.692+0000 7f362b197740 1 Processor -- start 2024-01-31T05:12:30.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.692+0000 7f362b197740 1 -- start start 2024-01-31T05:12:30.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.693+0000 7f362b197740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c620cdf10 0x562c620c4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.693+0000 7f362b197740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562c620ce900 0x562c620df5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.693+0000 7f362b197740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c620d3a70 0x562c620cfd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.693+0000 7f362b197740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c620d8f00 con 0x562c620ce900 2024-01-31T05:12:30.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.693+0000 7f362b197740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c620c5260 con 0x562c620d3a70 2024-01-31T05:12:30.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.693+0000 7f362b197740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c620c9f70 con 0x562c620cdf10 2024-01-31T05:12:30.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.693+0000 7f3625893640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562c620ce900 0x562c620df5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.693+0000 7f3625893640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562c620ce900 0x562c620df5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33712/0 (socket says 172.21.15.99:33712) 2024-01-31T05:12:30.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.693+0000 7f3625893640 1 -- 172.21.15.99:0/2095571927 learned_addr learned my addr 172.21.15.99:0/2095571927 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:30.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.693+0000 7f3626895640 1 --2- 172.21.15.99:0/2095571927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c620d3a70 0x562c620cfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.693+0000 7f3626094640 1 --2- 172.21.15.99:0/2095571927 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c620cdf10 0x562c620c4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.693+0000 7f3625893640 1 -- 172.21.15.99:0/2095571927 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c620cdf10 msgr2=0x562c620c4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:30.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.693+0000 7f3625893640 1 --2- 172.21.15.99:0/2095571927 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c620cdf10 0x562c620c4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.693+0000 7f3625893640 1 -- 172.21.15.99:0/2095571927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c620d3a70 msgr2=0x562c620cfd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:30.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.693+0000 7f3625893640 1 --2- 172.21.15.99:0/2095571927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c620d3a70 0x562c620cfd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.693+0000 7f3625893640 1 -- 172.21.15.99:0/2095571927 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c61fd04d0 con 0x562c620ce900 2024-01-31T05:12:30.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.693+0000 7f3625893640 1 --2- 172.21.15.99:0/2095571927 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562c620ce900 0x562c620df5a0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f361000a670 tx=0x7f361000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d18fd7432edcaa server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:30.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.693+0000 7f360bfff640 1 -- 172.21.15.99:0/2095571927 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36100d02a0 con 0x562c620ce900 2024-01-31T05:12:30.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.694+0000 7f360bfff640 1 -- 172.21.15.99:0/2095571927 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f36100b2380 con 0x562c620ce900 2024-01-31T05:12:30.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.694+0000 7f360bfff640 1 -- 172.21.15.99:0/2095571927 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3610078e20 con 0x562c620ce900 2024-01-31T05:12:30.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.694+0000 7f362b197740 1 -- 172.21.15.99:0/2095571927 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562c620ce900 msgr2=0x562c620df5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:30.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.694+0000 7f362b197740 1 --2- 172.21.15.99:0/2095571927 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562c620ce900 0x562c620df5a0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f361000a670 tx=0x7f361000cf60 comp rx=0 tx=0).stop 2024-01-31T05:12:30.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.694+0000 7f362b197740 1 -- 172.21.15.99:0/2095571927 shutdown_connections 2024-01-31T05:12:30.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.694+0000 7f362b197740 1 --2- 172.21.15.99:0/2095571927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c620d3a70 0x562c620cfd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.694+0000 7f362b197740 1 --2- 172.21.15.99:0/2095571927 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562c620ce900 0x562c620df5a0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.694+0000 7f362b197740 1 --2- 172.21.15.99:0/2095571927 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c620cdf10 0x562c620c4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.694+0000 7f362b197740 1 -- 172.21.15.99:0/2095571927 >> 172.21.15.99:0/2095571927 conn(0x562c620c9480 msgr2=0x562c620c9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:30.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.694+0000 7f362b197740 1 -- 172.21.15.99:0/2095571927 shutdown_connections 2024-01-31T05:12:30.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.694+0000 7f362b197740 1 -- 172.21.15.99:0/2095571927 wait complete. 2024-01-31T05:12:30.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.694+0000 7f362b197740 1 -- start start 2024-01-31T05:12:30.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.695+0000 7f362b197740 1 Processor -- start 2024-01-31T05:12:30.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.695+0000 7f362b197740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c620cdf10 0x562c62136e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.695+0000 7f362b197740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562c620d3a70 0x562c62137340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.695+0000 7f362b197740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c620e3ee0 0x562c6213e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.695+0000 7f362b197740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c6213e870 con 0x562c620d3a70 2024-01-31T05:12:30.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.695+0000 7f362b197740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c6213e9b0 con 0x562c620e3ee0 2024-01-31T05:12:30.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.695+0000 7f362b197740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c6213eb20 con 0x562c620cdf10 2024-01-31T05:12:30.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.695+0000 7f3625893640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562c620d3a70 0x562c62137340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.695+0000 7f3625893640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562c620d3a70 0x562c62137340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33714/0 (socket says 172.21.15.99:33714) 2024-01-31T05:12:30.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.695+0000 7f3625893640 1 -- 172.21.15.99:0/761878647 learned_addr learned my addr 172.21.15.99:0/761878647 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:30.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.695+0000 7f362b197740 10 client.0 _ll_register_callbacks cb 0x7f361c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:12:30.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.695+0000 7f3626895640 1 --2- 172.21.15.99:0/761878647 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c620e3ee0 0x562c6213e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.695+0000 7f3626094640 1 --2- 172.21.15.99:0/761878647 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c620cdf10 0x562c62136e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.695+0000 7f3625893640 1 -- 172.21.15.99:0/761878647 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c620cdf10 msgr2=0x562c62136e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:30.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.695+0000 7f3625893640 1 --2- 172.21.15.99:0/761878647 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c620cdf10 0x562c62136e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.695+0000 7f3625893640 1 -- 172.21.15.99:0/761878647 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c620e3ee0 msgr2=0x562c6213e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:30.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.695+0000 7f3625893640 1 --2- 172.21.15.99:0/761878647 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c620e3ee0 0x562c6213e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.695+0000 7f3625893640 1 -- 172.21.15.99:0/761878647 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562c620338a0 con 0x562c620d3a70 2024-01-31T05:12:30.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.695+0000 7f3626094640 1 --2- 172.21.15.99:0/761878647 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c620cdf10 0x562c62136e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:12:30.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.695+0000 7f3625893640 1 --2- 172.21.15.99:0/761878647 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562c620d3a70 0x562c62137340 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f36100999d0 tx=0x7f3610000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11a8d3c0ff294c8e server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:30.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.695+0000 7f3609ffb640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:12:30.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.696+0000 7f3609ffb640 1 -- 172.21.15.99:0/761878647 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3610078de0 con 0x562c620d3a70 2024-01-31T05:12:30.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.696+0000 7f3609ffb640 1 -- 172.21.15.99:0/761878647 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f36100d0240 con 0x562c620d3a70 2024-01-31T05:12:30.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.696+0000 7f362b197740 1 -- 172.21.15.99:0/761878647 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562c61d347e0 con 0x562c620d3a70 2024-01-31T05:12:30.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.696+0000 7f3609ffb640 1 -- 172.21.15.99:0/761878647 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3610099cd0 con 0x562c620d3a70 2024-01-31T05:12:30.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.696+0000 7f362b197740 10 client.15792 fetch_fsmap learned FSMap version 27 2024-01-31T05:12:30.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.696+0000 7f362b197740 1 -- 172.21.15.99:0/761878647 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x562c61ff6020 con 0x562c620d3a70 2024-01-31T05:12:30.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.696+0000 7f3609ffb640 1 -- 172.21.15.99:0/761878647 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562c61d347e0 con 0x562c620d3a70 2024-01-31T05:12:30.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.696+0000 7f3609ffb640 1 -- 172.21.15.99:0/761878647 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f36100a3030 con 0x562c620d3a70 2024-01-31T05:12:30.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.697+0000 7f362b197740 10 client.15792 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:12:30.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.697+0000 7f362b197740 10 client.15792 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-01-31T05:12:30.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.697+0000 7f362b197740 20 client.15792 populate_metadata read hostname 'smithi099' 2024-01-31T05:12:30.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.697+0000 7f362b197740 1 --2- 172.21.15.99:0/761878647 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x562c621401d0 0x562c621425f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.697+0000 7f362b197740 4 client.15792 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-01-31T05:12:30.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.697+0000 7f362b197740 1 -- 172.21.15.99:0/761878647 --> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562c61d87e30 con 0x562c621401d0 2024-01-31T05:12:30.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.697+0000 7f3626094640 1 --2- 172.21.15.99:0/761878647 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x562c621401d0 0x562c621425f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.697+0000 7f3609ffb640 10 client.15792 ms_handle_connect on v2:172.21.15.179:6836/837402830 2024-01-31T05:12:30.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.697+0000 7f3626094640 1 --2- 172.21.15.99:0/761878647 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x562c621401d0 0x562c621425f0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3600c68201cea245 server_cookie=1220c09d80089a46 in_seq=0 out_seq=0 2024-01-31T05:12:30.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.697+0000 7f3609ffb640 1 -- 172.21.15.99:0/761878647 <== mds.1 v2:172.21.15.179:6836/837402830 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x562c61d87e30 con 0x562c621401d0 2024-01-31T05:12:30.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.697+0000 7f3609ffb640 10 client.15792 handle_command_reply: tid=0 2024-01-31T05:12:30.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.698+0000 7f362b197740 1 client.15792 shutdown 2024-01-31T05:12:30.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.698+0000 7f362b197740 1 -- 172.21.15.99:0/761878647 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562c620d3a70 msgr2=0x562c62137340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:30.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.698+0000 7f362b197740 1 --2- 172.21.15.99:0/761878647 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562c620d3a70 0x562c62137340 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f36100999d0 tx=0x7f3610000bc0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.698+0000 7f362b197740 1 -- 172.21.15.99:0/761878647 shutdown_connections 2024-01-31T05:12:30.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.698+0000 7f362b197740 1 --2- 172.21.15.99:0/761878647 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x562c621401d0 0x562c621425f0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.698+0000 7f362b197740 1 --2- 172.21.15.99:0/761878647 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c620e3ee0 0x562c6213e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.698+0000 7f362b197740 1 --2- 172.21.15.99:0/761878647 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562c620d3a70 0x562c62137340 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.698+0000 7f362b197740 1 --2- 172.21.15.99:0/761878647 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562c620cdf10 0x562c62136e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.698+0000 7f362b197740 1 -- 172.21.15.99:0/761878647 >> 172.21.15.99:0/761878647 conn(0x562c620c9480 msgr2=0x562c620d8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:30.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.698+0000 7f3609ffb640 0 client.15792 ms_handle_reset on v2:172.21.15.179:6836/837402830 2024-01-31T05:12:30.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.698+0000 7f362b197740 1 -- 172.21.15.99:0/761878647 shutdown_connections 2024-01-31T05:12:30.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.698+0000 7f362b197740 1 -- 172.21.15.99:0/761878647 wait complete. 2024-01-31T05:12:30.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.698+0000 7f362b197740 20 client.15792 trim_cache size 0 max 16384 2024-01-31T05:12:30.702 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-01-31T05:12:30.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.699+0000 7f36282f8640 1 -- 172.21.15.99:0/813318807 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f360c0a13f0 msgr2=0x7f360c0a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:30.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.699+0000 7f36282f8640 1 --2- 172.21.15.99:0/813318807 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f360c0a13f0 0x7f360c0a38b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x562c620cf160 tx=0x7f3618009500 comp rx=0 tx=0).stop 2024-01-31T05:12:30.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.699+0000 7f36282f8640 1 -- 172.21.15.99:0/813318807 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36201040a0 msgr2=0x7f36201971d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:30.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.699+0000 7f36282f8640 1 --2- 172.21.15.99:0/813318807 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36201040a0 0x7f36201971d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f361000c970 tx=0x7f361000ce30 comp rx=0 tx=0).stop 2024-01-31T05:12:30.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.699+0000 7f36282f8640 1 -- 172.21.15.99:0/813318807 shutdown_connections 2024-01-31T05:12:30.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.699+0000 7f36282f8640 1 --2- 172.21.15.99:0/813318807 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f360c0a13f0 0x7f360c0a38b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.699+0000 7f36282f8640 1 --2- 172.21.15.99:0/813318807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36201069d0 0x7f362019e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.699+0000 7f36282f8640 1 --2- 172.21.15.99:0/813318807 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36201040a0 0x7f36201971d0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.699+0000 7f36282f8640 1 --2- 172.21.15.99:0/813318807 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3620101770 0x7f3620196c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.699+0000 7f36282f8640 1 -- 172.21.15.99:0/813318807 >> 172.21.15.99:0/813318807 conn(0x7f36200fb180 msgr2=0x7f3620102270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:30.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.699+0000 7f36282f8640 1 -- 172.21.15.99:0/813318807 shutdown_connections 2024-01-31T05:12:30.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.699+0000 7f36282f8640 1 -- 172.21.15.99:0/813318807 wait complete. 2024-01-31T05:12:30.710 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-01-31T05:12:30.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.816+0000 7fa32c11f640 1 -- 172.21.15.99:0/974870460 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3240ff5c0 msgr2=0x7fa3240ff9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:30.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.816+0000 7fa32c11f640 1 --2- 172.21.15.99:0/974870460 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3240ff5c0 0x7fa3240ff9e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fa320009900 tx=0x7fa32002bc30 comp rx=0 tx=0).stop 2024-01-31T05:12:30.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.816+0000 7fa32c11f640 1 -- 172.21.15.99:0/974870460 shutdown_connections 2024-01-31T05:12:30.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.816+0000 7fa32c11f640 1 --2- 172.21.15.99:0/974870460 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3241008c0 0x7fa324100d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.816+0000 7fa32c11f640 1 --2- 172.21.15.99:0/974870460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3240fff20 0x7fa324100380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.816+0000 7fa32c11f640 1 --2- 172.21.15.99:0/974870460 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3240ff5c0 0x7fa3240ff9e0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.816+0000 7fa32c11f640 1 -- 172.21.15.99:0/974870460 >> 172.21.15.99:0/974870460 conn(0x7fa3240fb180 msgr2=0x7fa3240fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:30.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.816+0000 7fa32c11f640 1 -- 172.21.15.99:0/974870460 shutdown_connections 2024-01-31T05:12:30.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.816+0000 7fa32c11f640 1 -- 172.21.15.99:0/974870460 wait complete. 2024-01-31T05:12:30.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.817+0000 7fa32c11f640 1 Processor -- start 2024-01-31T05:12:30.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.817+0000 7fa32c11f640 1 -- start start 2024-01-31T05:12:30.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.817+0000 7fa32c11f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3240ff5c0 0x7fa324198ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.817+0000 7fa32c11f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3240fff20 0x7fa324199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.817+0000 7fa32c11f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3241008c0 0x7fa3241a04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.818+0000 7fa32c11f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3241a09e0 con 0x7fa3240fff20 2024-01-31T05:12:30.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.818+0000 7fa32c11f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3241a0b50 con 0x7fa3240ff5c0 2024-01-31T05:12:30.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.818+0000 7fa32c11f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3241a0d10 con 0x7fa3241008c0 2024-01-31T05:12:30.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.818+0000 7fa3296ba640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3240fff20 0x7fa324199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.818+0000 7fa3296ba640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3240fff20 0x7fa324199430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33746/0 (socket says 172.21.15.99:33746) 2024-01-31T05:12:30.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.818+0000 7fa3296ba640 1 -- 172.21.15.99:0/1107048458 learned_addr learned my addr 172.21.15.99:0/1107048458 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:30.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.818+0000 7fa32a6bc640 1 --2- 172.21.15.99:0/1107048458 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3241008c0 0x7fa3241a04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.818+0000 7fa329ebb640 1 --2- 172.21.15.99:0/1107048458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3240ff5c0 0x7fa324198ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.818+0000 7fa3296ba640 1 -- 172.21.15.99:0/1107048458 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3241008c0 msgr2=0x7fa3241a04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:30.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.818+0000 7fa3296ba640 1 --2- 172.21.15.99:0/1107048458 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3241008c0 0x7fa3241a04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.818+0000 7fa3296ba640 1 -- 172.21.15.99:0/1107048458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3240ff5c0 msgr2=0x7fa324198ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:30.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.818+0000 7fa3296ba640 1 --2- 172.21.15.99:0/1107048458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3240ff5c0 0x7fa324198ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.818+0000 7fa3296ba640 1 -- 172.21.15.99:0/1107048458 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa320009560 con 0x7fa3240fff20 2024-01-31T05:12:30.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.818+0000 7fa3296ba640 1 --2- 172.21.15.99:0/1107048458 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3240fff20 0x7fa324199430 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fa31400e9f0 tx=0x7fa31400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:30.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.818+0000 7fa31affd640 1 -- 172.21.15.99:0/1107048458 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa314009700 con 0x7fa3240fff20 2024-01-31T05:12:30.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.818+0000 7fa31affd640 1 -- 172.21.15.99:0/1107048458 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa31400cd80 con 0x7fa3240fff20 2024-01-31T05:12:30.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.818+0000 7fa32c11f640 1 -- 172.21.15.99:0/1107048458 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3241a0ff0 con 0x7fa3240fff20 2024-01-31T05:12:30.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.818+0000 7fa31affd640 1 -- 172.21.15.99:0/1107048458 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa314018860 con 0x7fa3240fff20 2024-01-31T05:12:30.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.819+0000 7fa32c11f640 1 -- 172.21.15.99:0/1107048458 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3241a1470 con 0x7fa3240fff20 2024-01-31T05:12:30.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.821+0000 7fa32efe1740 1 Processor -- start 2024-01-31T05:12:30.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.821+0000 7fa32efe1740 1 -- start start 2024-01-31T05:12:30.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.821+0000 7fa32efe1740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d85d0dff10 0x55d85d0e0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.821+0000 7fa32efe1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d85d0e0900 0x55d85d0e5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.821+0000 7fa32efe1740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d85d0e5a70 0x55d85d0e7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.821+0000 7fa32efe1740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d85d04e240 con 0x55d85d0e5a70 2024-01-31T05:12:30.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.821+0000 7fa32efe1740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d85d04b930 con 0x55d85d0dff10 2024-01-31T05:12:30.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.821+0000 7fa32efe1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d85d047220 con 0x55d85d0e0900 2024-01-31T05:12:30.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.822+0000 7fa32a6bc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d85d0dff10 0x55d85d0e0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.822+0000 7fa32a6bc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d85d0dff10 0x55d85d0e0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.99:35004/0 (socket says 172.21.15.99:35004) 2024-01-31T05:12:30.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.822+0000 7fa32a6bc640 1 -- 172.21.15.99:0/1313707471 learned_addr learned my addr 172.21.15.99:0/1313707471 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:30.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.822+0000 7fa32a6bc640 1 -- 172.21.15.99:0/1313707471 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d85d0e0900 msgr2=0x55d85d0e5400 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-31T05:12:30.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.822+0000 7fa32a6bc640 1 --2- 172.21.15.99:0/1313707471 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d85d0e0900 0x55d85d0e5400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.822+0000 7fa32a6bc640 1 -- 172.21.15.99:0/1313707471 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d85d0e5a70 msgr2=0x55d85d0e7f00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-31T05:12:30.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.822+0000 7fa32a6bc640 1 --2- 172.21.15.99:0/1313707471 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d85d0e5a70 0x55d85d0e7f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.822+0000 7fa32a6bc640 1 -- 172.21.15.99:0/1313707471 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d85d0097c0 con 0x55d85d0dff10 2024-01-31T05:12:30.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.822+0000 7fa31affd640 1 -- 172.21.15.99:0/1107048458 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 135946+0+0 (secure 0 0 0) 0x7fa3140189c0 con 0x7fa3240fff20 2024-01-31T05:12:30.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.822+0000 7fa32a6bc640 1 --2- 172.21.15.99:0/1313707471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d85d0dff10 0x55d85d0e0330 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa31c010370 tx=0x7fa31c010830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45eea62756034a9a server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:30.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.822+0000 7fa30ffff640 1 -- 172.21.15.99:0/1313707471 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31c004d20 con 0x55d85d0dff10 2024-01-31T05:12:30.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.822+0000 7fa30ffff640 1 -- 172.21.15.99:0/1313707471 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa31c004e80 con 0x55d85d0dff10 2024-01-31T05:12:30.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.822+0000 7fa30ffff640 1 -- 172.21.15.99:0/1313707471 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31c0054c0 con 0x55d85d0dff10 2024-01-31T05:12:30.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.823+0000 7fa31affd640 1 --2- 172.21.15.99:0/1107048458 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa3100a1370 0x7fa3100a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.823+0000 7fa32efe1740 1 -- 172.21.15.99:0/1313707471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d85d0dff10 msgr2=0x55d85d0e0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:30.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.823+0000 7fa329ebb640 1 --2- 172.21.15.99:0/1107048458 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa3100a1370 0x7fa3100a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.823+0000 7fa32efe1740 1 --2- 172.21.15.99:0/1313707471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d85d0dff10 0x55d85d0e0330 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa31c010370 tx=0x7fa31c010830 comp rx=0 tx=0).stop 2024-01-31T05:12:30.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.823+0000 7fa32efe1740 1 -- 172.21.15.99:0/1313707471 shutdown_connections 2024-01-31T05:12:30.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.823+0000 7fa32efe1740 1 --2- 172.21.15.99:0/1313707471 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d85d0e5a70 0x55d85d0e7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.823+0000 7fa32efe1740 1 --2- 172.21.15.99:0/1313707471 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d85d0e0900 0x55d85d0e5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.823+0000 7fa32efe1740 1 --2- 172.21.15.99:0/1313707471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d85d0dff10 0x55d85d0e0330 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.823+0000 7fa32efe1740 1 -- 172.21.15.99:0/1313707471 >> 172.21.15.99:0/1313707471 conn(0x55d85d0db480 msgr2=0x55d85d0db880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:30.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.823+0000 7fa32efe1740 1 -- 172.21.15.99:0/1313707471 shutdown_connections 2024-01-31T05:12:30.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.824+0000 7fa32efe1740 1 -- 172.21.15.99:0/1313707471 wait complete. 2024-01-31T05:12:30.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.824+0000 7fa31affd640 1 -- 172.21.15.99:0/1107048458 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fa314014070 con 0x7fa3240fff20 2024-01-31T05:12:30.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.824+0000 7fa329ebb640 1 --2- 172.21.15.99:0/1107048458 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa3100a1370 0x7fa3100a3830 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa320005ab0 tx=0x7fa32002c5d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:30.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.824+0000 7fa32efe1740 1 -- start start 2024-01-31T05:12:30.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.824+0000 7fa32efe1740 1 Processor -- start 2024-01-31T05:12:30.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.824+0000 7fa32efe1740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d85d0dff10 0x55d85d0ea100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.824+0000 7fa32efe1740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d85d0e0900 0x55d85d0ea640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.824+0000 7fa32efe1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d85d0e5a70 0x55d85d0f1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.825+0000 7fa32efe1740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d85d0005e0 con 0x55d85d0e0900 2024-01-31T05:12:30.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.825+0000 7fa32efe1740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d85d000280 con 0x55d85d0dff10 2024-01-31T05:12:30.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.825+0000 7fa32efe1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d85cfc53d0 con 0x55d85d0e5a70 2024-01-31T05:12:30.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.825+0000 7fa32efe1740 10 client.0 _ll_register_callbacks cb 0x55d85d03deb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:12:30.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.825+0000 7fa3296ba640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d85d0e0900 0x55d85d0ea640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.825+0000 7fa3296ba640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d85d0e0900 0x55d85d0ea640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33752/0 (socket says 172.21.15.99:33752) 2024-01-31T05:12:30.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.825+0000 7fa3296ba640 1 -- 172.21.15.99:0/216657162 learned_addr learned my addr 172.21.15.99:0/216657162 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:30.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.825+0000 7fa32a6bc640 1 --2- 172.21.15.99:0/216657162 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d85d0e5a70 0x55d85d0f1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.825+0000 7fa329ebb640 1 --2- 172.21.15.99:0/216657162 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d85d0dff10 0x55d85d0ea100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.825+0000 7fa3296ba640 1 -- 172.21.15.99:0/216657162 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d85d0e5a70 msgr2=0x55d85d0f1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:30.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.825+0000 7fa3296ba640 1 --2- 172.21.15.99:0/216657162 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d85d0e5a70 0x55d85d0f1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.825+0000 7fa3296ba640 1 -- 172.21.15.99:0/216657162 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d85d0dff10 msgr2=0x55d85d0ea100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:30.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.825+0000 7fa3296ba640 1 --2- 172.21.15.99:0/216657162 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d85d0dff10 0x55d85d0ea100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.825+0000 7fa3296ba640 1 -- 172.21.15.99:0/216657162 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa31c009c50 con 0x55d85d0e0900 2024-01-31T05:12:30.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.825+0000 7fa3296ba640 1 --2- 172.21.15.99:0/216657162 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d85d0e0900 0x55d85d0ea640 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fa3140a1f00 tx=0x7fa31409a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78cc5ecb7f98542 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:30.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.825+0000 7fa30d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:12:30.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.825+0000 7fa30d7fa640 1 -- 172.21.15.99:0/216657162 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3140a21a0 con 0x55d85d0e0900 2024-01-31T05:12:30.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.826+0000 7fa30d7fa640 1 -- 172.21.15.99:0/216657162 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fa3140a2430 con 0x55d85d0e0900 2024-01-31T05:12:30.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.826+0000 7fa32efe1740 1 -- 172.21.15.99:0/216657162 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d85d03fdd0 con 0x55d85d0e0900 2024-01-31T05:12:30.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.826+0000 7fa30d7fa640 1 -- 172.21.15.99:0/216657162 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa314095e90 con 0x55d85d0e0900 2024-01-31T05:12:30.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.826+0000 7fa32efe1740 10 client.15801 fetch_fsmap learned FSMap version 27 2024-01-31T05:12:30.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.826+0000 7fa32efe1740 1 -- 172.21.15.99:0/216657162 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55d85d0458a0 con 0x55d85d0e0900 2024-01-31T05:12:30.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.826+0000 7fa30d7fa640 1 -- 172.21.15.99:0/216657162 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d85d03fdd0 con 0x55d85d0e0900 2024-01-31T05:12:30.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.826+0000 7fa30d7fa640 1 -- 172.21.15.99:0/216657162 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa31409f050 con 0x55d85d0e0900 2024-01-31T05:12:30.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.826+0000 7fa32efe1740 10 client.15801 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:12:30.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.826+0000 7fa32efe1740 10 client.15801 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-01-31T05:12:30.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.826+0000 7fa32efe1740 20 client.15801 populate_metadata read hostname 'smithi099' 2024-01-31T05:12:30.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.826+0000 7fa32efe1740 1 --2- 172.21.15.99:0/216657162 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55d85d0f5f30 0x55d85d0f8320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.826+0000 7fa32efe1740 4 client.15801 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:12:30.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.826+0000 7fa32efe1740 1 -- 172.21.15.99:0/216657162 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d85cd467e0 con 0x55d85d0f5f30 2024-01-31T05:12:30.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.827+0000 7fa329ebb640 1 --2- 172.21.15.99:0/216657162 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55d85d0f5f30 0x55d85d0f8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.827+0000 7fa30d7fa640 10 client.15801 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:12:30.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.827+0000 7fa329ebb640 1 --2- 172.21.15.99:0/216657162 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55d85d0f5f30 0x55d85d0f8320 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=480ebaf45def3db server_cookie=f6583dd65d2c7f9 in_seq=0 out_seq=0 2024-01-31T05:12:30.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.828+0000 7fa30d7fa640 1 -- 172.21.15.99:0/216657162 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d85cd467e0 con 0x55d85d0f5f30 2024-01-31T05:12:30.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.828+0000 7fa30d7fa640 10 client.15801 handle_command_reply: tid=0 2024-01-31T05:12:30.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.828+0000 7fa32efe1740 1 client.15801 shutdown 2024-01-31T05:12:30.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.828+0000 7fa32efe1740 1 -- 172.21.15.99:0/216657162 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d85d0e0900 msgr2=0x55d85d0ea640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:30.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.828+0000 7fa32efe1740 1 --2- 172.21.15.99:0/216657162 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d85d0e0900 0x55d85d0ea640 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fa3140a1f00 tx=0x7fa31409a8a0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.828+0000 7fa32efe1740 1 -- 172.21.15.99:0/216657162 shutdown_connections 2024-01-31T05:12:30.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.828+0000 7fa32efe1740 1 --2- 172.21.15.99:0/216657162 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d85d0e5a70 0x55d85d0f1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.828+0000 7fa32efe1740 1 --2- 172.21.15.99:0/216657162 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d85d0e0900 0x55d85d0ea640 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.828+0000 7fa32efe1740 1 --2- 172.21.15.99:0/216657162 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55d85d0f5f30 0x55d85d0f8320 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.828+0000 7fa32efe1740 1 --2- 172.21.15.99:0/216657162 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d85d0dff10 0x55d85d0ea100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.828+0000 7fa32efe1740 1 -- 172.21.15.99:0/216657162 >> 172.21.15.99:0/216657162 conn(0x55d85d0db480 msgr2=0x55d85d0da7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:30.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.828+0000 7fa30d7fa640 0 client.15801 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:12:30.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.828+0000 7fa32efe1740 1 -- 172.21.15.99:0/216657162 shutdown_connections 2024-01-31T05:12:30.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.828+0000 7fa32efe1740 1 -- 172.21.15.99:0/216657162 wait complete. 2024-01-31T05:12:30.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.829+0000 7fa32efe1740 20 client.15801 trim_cache size 0 max 16384 2024-01-31T05:12:30.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.851+0000 7fa32efe1740 1 Processor -- start 2024-01-31T05:12:30.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.851+0000 7fa32efe1740 1 -- start start 2024-01-31T05:12:30.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.851+0000 7fa32efe1740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d85d0dff10 0x55d85d0ea100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.851+0000 7fa32efe1740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d85d0e0900 0x55d85d0ea640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.851+0000 7fa32efe1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d85d0e5a70 0x55d85d0f1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.851+0000 7fa32efe1740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d85d03fdd0 con 0x55d85d0dff10 2024-01-31T05:12:30.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.851+0000 7fa32efe1740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d85d0e0ff0 con 0x55d85d0e0900 2024-01-31T05:12:30.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.851+0000 7fa32efe1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d85d0d6fa0 con 0x55d85d0e5a70 2024-01-31T05:12:30.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.852+0000 7fa329ebb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d85d0dff10 0x55d85d0ea100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.852+0000 7fa329ebb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d85d0dff10 0x55d85d0ea100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33760/0 (socket says 172.21.15.99:33760) 2024-01-31T05:12:30.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.852+0000 7fa329ebb640 1 -- 172.21.15.99:0/2502332942 learned_addr learned my addr 172.21.15.99:0/2502332942 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:30.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.852+0000 7fa3296ba640 1 --2- 172.21.15.99:0/2502332942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d85d0e0900 0x55d85d0ea640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.852+0000 7fa32a6bc640 1 --2- 172.21.15.99:0/2502332942 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d85d0e5a70 0x55d85d0f1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.852+0000 7fa329ebb640 1 -- 172.21.15.99:0/2502332942 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d85d0e5a70 msgr2=0x55d85d0f1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:30.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.852+0000 7fa329ebb640 1 --2- 172.21.15.99:0/2502332942 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d85d0e5a70 0x55d85d0f1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.852+0000 7fa329ebb640 1 -- 172.21.15.99:0/2502332942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d85d0e0900 msgr2=0x55d85d0ea640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:30.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.852+0000 7fa329ebb640 1 --2- 172.21.15.99:0/2502332942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d85d0e0900 0x55d85d0ea640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.852+0000 7fa329ebb640 1 -- 172.21.15.99:0/2502332942 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d85cfe24d0 con 0x55d85d0dff10 2024-01-31T05:12:30.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.852+0000 7fa32a6bc640 1 --2- 172.21.15.99:0/2502332942 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d85d0e5a70 0x55d85d0f1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:12:30.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.852+0000 7fa329ebb640 1 --2- 172.21.15.99:0/2502332942 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d85d0dff10 0x55d85d0ea100 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fa320006010 tx=0x7fa320043000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c68505617437cece server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:30.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.852+0000 7fa30f7fe640 1 -- 172.21.15.99:0/2502332942 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa320054d00 con 0x55d85d0dff10 2024-01-31T05:12:30.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.852+0000 7fa30f7fe640 1 -- 172.21.15.99:0/2502332942 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa320054e60 con 0x55d85d0dff10 2024-01-31T05:12:30.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.852+0000 7fa30f7fe640 1 -- 172.21.15.99:0/2502332942 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3200053b0 con 0x55d85d0dff10 2024-01-31T05:12:30.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.853+0000 7fa32efe1740 1 -- 172.21.15.99:0/2502332942 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d85d0dff10 msgr2=0x55d85d0ea100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:30.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.853+0000 7fa32efe1740 1 --2- 172.21.15.99:0/2502332942 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d85d0dff10 0x55d85d0ea100 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fa320006010 tx=0x7fa320043000 comp rx=0 tx=0).stop 2024-01-31T05:12:30.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.853+0000 7fa32efe1740 1 -- 172.21.15.99:0/2502332942 shutdown_connections 2024-01-31T05:12:30.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.853+0000 7fa32efe1740 1 --2- 172.21.15.99:0/2502332942 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d85d0e5a70 0x55d85d0f1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.853+0000 7fa32efe1740 1 --2- 172.21.15.99:0/2502332942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d85d0e0900 0x55d85d0ea640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.853+0000 7fa32efe1740 1 --2- 172.21.15.99:0/2502332942 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d85d0dff10 0x55d85d0ea100 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.853+0000 7fa32efe1740 1 -- 172.21.15.99:0/2502332942 >> 172.21.15.99:0/2502332942 conn(0x55d85d0db480 msgr2=0x55d85d0fcc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:30.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.853+0000 7fa32efe1740 1 -- 172.21.15.99:0/2502332942 shutdown_connections 2024-01-31T05:12:30.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.853+0000 7fa32efe1740 1 -- 172.21.15.99:0/2502332942 wait complete. 2024-01-31T05:12:30.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.854+0000 7fa32efe1740 1 -- start start 2024-01-31T05:12:30.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.854+0000 7fa32efe1740 1 Processor -- start 2024-01-31T05:12:30.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.854+0000 7fa32efe1740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d85d0dff10 0x55d85d0f1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.854+0000 7fa32efe1740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d85d0e0900 0x55d85d0ef970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.855+0000 7fa32efe1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d85d0e5a70 0x55d85d0efeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.855+0000 7fa329ebb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d85d0dff10 0x55d85d0f1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.855+0000 7fa329ebb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d85d0dff10 0x55d85d0f1360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33762/0 (socket says 172.21.15.99:33762) 2024-01-31T05:12:30.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.855+0000 7fa329ebb640 1 -- 172.21.15.99:0/3414323215 learned_addr learned my addr 172.21.15.99:0/3414323215 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:30.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.855+0000 7fa32efe1740 1 -- 172.21.15.99:0/3414323215 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d85d0f03f0 con 0x55d85d0dff10 2024-01-31T05:12:30.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.855+0000 7fa32efe1740 1 -- 172.21.15.99:0/3414323215 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d85d0f0560 con 0x55d85d0e0900 2024-01-31T05:12:30.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.855+0000 7fa32efe1740 1 -- 172.21.15.99:0/3414323215 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d85d0f0720 con 0x55d85d0e5a70 2024-01-31T05:12:30.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.855+0000 7fa3296ba640 1 --2- 172.21.15.99:0/3414323215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d85d0e0900 0x55d85d0ef970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.855+0000 7fa32a6bc640 1 --2- 172.21.15.99:0/3414323215 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d85d0e5a70 0x55d85d0efeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.855+0000 7fa32efe1740 10 client.0 _ll_register_callbacks cb 0x7fa31c009a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:12:30.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.855+0000 7fa329ebb640 1 -- 172.21.15.99:0/3414323215 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d85d0e5a70 msgr2=0x55d85d0efeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:30.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.855+0000 7fa329ebb640 1 --2- 172.21.15.99:0/3414323215 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d85d0e5a70 0x55d85d0efeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.855+0000 7fa329ebb640 1 -- 172.21.15.99:0/3414323215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d85d0e0900 msgr2=0x55d85d0ef970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:30.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.855+0000 7fa329ebb640 1 --2- 172.21.15.99:0/3414323215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d85d0e0900 0x55d85d0ef970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.855+0000 7fa329ebb640 1 -- 172.21.15.99:0/3414323215 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa32410bc10 con 0x55d85d0dff10 2024-01-31T05:12:30.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.855+0000 7fa32efe1740 1 -- 172.21.15.99:0/3414323215 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d85d0400b0 con 0x55d85d0dff10 2024-01-31T05:12:30.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.855+0000 7fa329ebb640 1 --2- 172.21.15.99:0/3414323215 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d85d0dff10 0x55d85d0f1360 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fa32002c9a0 tx=0x7fa3200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60643bcca79499bb server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:30.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.855+0000 7fa30d7fa640 10 client.15807 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:12:30.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.855+0000 7fa30d7fa640 1 -- 172.21.15.99:0/3414323215 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa320004230 con 0x55d85d0dff10 2024-01-31T05:12:30.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.855+0000 7fa30d7fa640 1 -- 172.21.15.99:0/3414323215 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fa320047040 con 0x55d85d0dff10 2024-01-31T05:12:30.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.856+0000 7fa30d7fa640 1 -- 172.21.15.99:0/3414323215 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa320004ac0 con 0x55d85d0dff10 2024-01-31T05:12:30.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.856+0000 7fa32efe1740 10 client.15807 fetch_fsmap learned FSMap version 27 2024-01-31T05:12:30.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.856+0000 7fa32efe1740 1 -- 172.21.15.99:0/3414323215 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({fsmap=27}) v3 -- 0x55d85d008020 con 0x55d85d0dff10 2024-01-31T05:12:30.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.856+0000 7fa30d7fa640 1 -- 172.21.15.99:0/3414323215 <== mon.0 v2:172.21.15.99:3300/0 4 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa320005150 con 0x55d85d0dff10 2024-01-31T05:12:30.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.856+0000 7fa32efe1740 10 client.15807 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:12:30.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.856+0000 7fa32efe1740 10 client.15807 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-01-31T05:12:30.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.856+0000 7fa32efe1740 20 client.15807 populate_metadata read hostname 'smithi099' 2024-01-31T05:12:30.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.856+0000 7fa32efe1740 1 --2- 172.21.15.99:0/3414323215 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55d85d14d4a0 0x55d85d14f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:30.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.856+0000 7fa32efe1740 4 client.15807 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-01-31T05:12:30.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.856+0000 7fa32efe1740 1 -- 172.21.15.99:0/3414323215 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55d85cd99e30 con 0x55d85d14d4a0 2024-01-31T05:12:30.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.856+0000 7fa3296ba640 1 --2- 172.21.15.99:0/3414323215 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55d85d14d4a0 0x55d85d14f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:30.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.857+0000 7fa3296ba640 1 --2- 172.21.15.99:0/3414323215 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55d85d14d4a0 0x55d85d14f890 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57bba5f1e22a2e8b server_cookie=90fa29fcebcefa63 in_seq=0 out_seq=0 2024-01-31T05:12:30.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.857+0000 7fa30d7fa640 10 client.15807 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:12:30.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.857+0000 7fa30d7fa640 1 -- 172.21.15.99:0/3414323215 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55d85cd99e30 con 0x55d85d14d4a0 2024-01-31T05:12:30.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.857+0000 7fa30d7fa640 10 client.15807 handle_command_reply: tid=0 2024-01-31T05:12:30.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.857+0000 7fa32efe1740 1 client.15807 shutdown 2024-01-31T05:12:30.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.857+0000 7fa32efe1740 1 -- 172.21.15.99:0/3414323215 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d85d0dff10 msgr2=0x55d85d0f1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:30.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.857+0000 7fa32efe1740 1 --2- 172.21.15.99:0/3414323215 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d85d0dff10 0x55d85d0f1360 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fa32002c9a0 tx=0x7fa3200046c0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.857+0000 7fa32efe1740 1 -- 172.21.15.99:0/3414323215 shutdown_connections 2024-01-31T05:12:30.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.857+0000 7fa32efe1740 1 --2- 172.21.15.99:0/3414323215 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d85d0e5a70 0x55d85d0efeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.857+0000 7fa32efe1740 1 --2- 172.21.15.99:0/3414323215 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55d85d14d4a0 0x55d85d14f890 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.857+0000 7fa30d7fa640 0 client.15807 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:12:30.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.857+0000 7fa32efe1740 1 --2- 172.21.15.99:0/3414323215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d85d0e0900 0x55d85d0ef970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.857+0000 7fa32efe1740 1 --2- 172.21.15.99:0/3414323215 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d85d0dff10 0x55d85d0f1360 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.857+0000 7fa32efe1740 1 -- 172.21.15.99:0/3414323215 >> 172.21.15.99:0/3414323215 conn(0x55d85d0db480 msgr2=0x55d85d0ea100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:30.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.857+0000 7fa32efe1740 1 -- 172.21.15.99:0/3414323215 shutdown_connections 2024-01-31T05:12:30.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.857+0000 7fa32efe1740 1 -- 172.21.15.99:0/3414323215 wait complete. 2024-01-31T05:12:30.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.858+0000 7fa32efe1740 20 client.15807 trim_cache size 0 max 16384 2024-01-31T05:12:30.862 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-01-31T05:12:30.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.858+0000 7fa32c11f640 1 -- 172.21.15.99:0/1107048458 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa3100a1370 msgr2=0x7fa3100a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:30.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.858+0000 7fa32c11f640 1 --2- 172.21.15.99:0/1107048458 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa3100a1370 0x7fa3100a3830 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa320005ab0 tx=0x7fa32002c5d0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.858+0000 7fa32c11f640 1 -- 172.21.15.99:0/1107048458 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3240fff20 msgr2=0x7fa324199430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:30.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.858+0000 7fa32c11f640 1 --2- 172.21.15.99:0/1107048458 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3240fff20 0x7fa324199430 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fa31400e9f0 tx=0x7fa31400eeb0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.858+0000 7fa32c11f640 1 -- 172.21.15.99:0/1107048458 shutdown_connections 2024-01-31T05:12:30.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.858+0000 7fa32c11f640 1 --2- 172.21.15.99:0/1107048458 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa3100a1370 0x7fa3100a3830 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.858+0000 7fa32c11f640 1 --2- 172.21.15.99:0/1107048458 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3241008c0 0x7fa3241a04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.858+0000 7fa32c11f640 1 --2- 172.21.15.99:0/1107048458 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3240fff20 0x7fa324199430 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.858+0000 7fa32c11f640 1 --2- 172.21.15.99:0/1107048458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3240ff5c0 0x7fa324198ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:30.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.858+0000 7fa32c11f640 1 -- 172.21.15.99:0/1107048458 >> 172.21.15.99:0/1107048458 conn(0x7fa3240fb180 msgr2=0x7fa3240fc960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:30.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.858+0000 7fa32c11f640 1 -- 172.21.15.99:0/1107048458 shutdown_connections 2024-01-31T05:12:30.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:30.858+0000 7fa32c11f640 1 -- 172.21.15.99:0/1107048458 wait complete. 2024-01-31T05:12:31.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:30 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/1995826880' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:12:31.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:30 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/1995826880' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:12:31.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:30 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/1995826880' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:12:31.872 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-01-31T05:12:31.872 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-01-31T05:12:31.972 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:31 smithi181 ceph-mon[36434]: pgmap v383: 97 pgs: 97 active+clean; 670 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-01-31T05:12:31.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.981+0000 7fe2f1901640 1 -- 172.21.15.99:0/59658491 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2ec1028b0 msgr2=0x7fe2ec109140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:31.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.981+0000 7fe2f1901640 1 --2- 172.21.15.99:0/59658491 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2ec1028b0 0x7fe2ec109140 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4009ca0 tx=0x7fe2e402c0f0 comp rx=0 tx=0).stop 2024-01-31T05:12:31.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.981+0000 7fe2f1901640 1 -- 172.21.15.99:0/59658491 shutdown_connections 2024-01-31T05:12:31.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.981+0000 7fe2f1901640 1 --2- 172.21.15.99:0/59658491 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2ec1028b0 0x7fe2ec109140 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:31.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.981+0000 7fe2f1901640 1 --2- 172.21.15.99:0/59658491 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe2ec101ef0 0x7fe2ec102370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:31.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.981+0000 7fe2f1901640 1 --2- 172.21.15.99:0/59658491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2ec100d00 0x7fe2ec101120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:31.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.981+0000 7fe2f1901640 1 -- 172.21.15.99:0/59658491 >> 172.21.15.99:0/59658491 conn(0x7fe2ec0fc250 msgr2=0x7fe2ec0fe6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:31.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.982+0000 7fe2f1901640 1 -- 172.21.15.99:0/59658491 shutdown_connections 2024-01-31T05:12:31.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.982+0000 7fe2f1901640 1 -- 172.21.15.99:0/59658491 wait complete. 2024-01-31T05:12:31.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.982+0000 7fe2f1901640 1 Processor -- start 2024-01-31T05:12:31.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.982+0000 7fe2f1901640 1 -- start start 2024-01-31T05:12:31.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.983+0000 7fe2f1901640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2ec100d00 0x7fe2ec196ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:31.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.983+0000 7fe2f1901640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe2ec101ef0 0x7fe2ec1971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:31.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.983+0000 7fe2f1901640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2ec1028b0 0x7fe2ec19e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:31.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.983+0000 7fe2f1901640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec19e7b0 con 0x7fe2ec1028b0 2024-01-31T05:12:31.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.983+0000 7fe2f1901640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec19e920 con 0x7fe2ec100d00 2024-01-31T05:12:31.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.983+0000 7fe2f1901640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec19eae0 con 0x7fe2ec101ef0 2024-01-31T05:12:31.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.983+0000 7fe2eb7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2ec1028b0 0x7fe2ec19e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:31.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.983+0000 7fe2eb7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2ec1028b0 0x7fe2ec19e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33772/0 (socket says 172.21.15.99:33772) 2024-01-31T05:12:31.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.983+0000 7fe2eb7fe640 1 -- 172.21.15.99:0/1442886804 learned_addr learned my addr 172.21.15.99:0/1442886804 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:31.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.983+0000 7fe2ea7fc640 1 --2- 172.21.15.99:0/1442886804 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe2ec101ef0 0x7fe2ec1971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:31.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.983+0000 7fe2eaffd640 1 --2- 172.21.15.99:0/1442886804 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2ec100d00 0x7fe2ec196ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:31.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.983+0000 7fe2eb7fe640 1 -- 172.21.15.99:0/1442886804 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe2ec101ef0 msgr2=0x7fe2ec1971e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:31.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.983+0000 7fe2eb7fe640 1 --2- 172.21.15.99:0/1442886804 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe2ec101ef0 0x7fe2ec1971e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:31.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.983+0000 7fe2eb7fe640 1 -- 172.21.15.99:0/1442886804 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2ec100d00 msgr2=0x7fe2ec196ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:31.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.983+0000 7fe2eb7fe640 1 --2- 172.21.15.99:0/1442886804 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2ec100d00 0x7fe2ec196ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:31.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.983+0000 7fe2eb7fe640 1 -- 172.21.15.99:0/1442886804 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e4009900 con 0x7fe2ec1028b0 2024-01-31T05:12:31.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.983+0000 7fe2ea7fc640 1 --2- 172.21.15.99:0/1442886804 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe2ec101ef0 0x7fe2ec1971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:12:31.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.983+0000 7fe2eaffd640 1 --2- 172.21.15.99:0/1442886804 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2ec100d00 0x7fe2ec196ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:12:31.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.984+0000 7fe2eb7fe640 1 --2- 172.21.15.99:0/1442886804 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2ec1028b0 0x7fe2ec19e240 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4037040 tx=0x7fe2e40093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:31.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.984+0000 7fe2f08ff640 1 -- 172.21.15.99:0/1442886804 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e4034c70 con 0x7fe2ec1028b0 2024-01-31T05:12:31.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.984+0000 7fe2f1901640 1 -- 172.21.15.99:0/1442886804 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2ec19ed60 con 0x7fe2ec1028b0 2024-01-31T05:12:31.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.984+0000 7fe2f08ff640 1 -- 172.21.15.99:0/1442886804 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe2e4003e30 con 0x7fe2ec1028b0 2024-01-31T05:12:31.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.984+0000 7fe2f08ff640 1 -- 172.21.15.99:0/1442886804 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e4004800 con 0x7fe2ec1028b0 2024-01-31T05:12:31.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.984+0000 7fe2f1901640 1 -- 172.21.15.99:0/1442886804 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2ec19f1c0 con 0x7fe2ec1028b0 2024-01-31T05:12:31.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.987+0000 7fe2f479b740 1 Processor -- start 2024-01-31T05:12:31.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.987+0000 7fe2f08ff640 1 -- 172.21.15.99:0/1442886804 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 135946+0+0 (secure 0 0 0) 0x7fe2e403b040 con 0x7fe2ec1028b0 2024-01-31T05:12:31.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.987+0000 7fe2f479b740 1 -- start start 2024-01-31T05:12:31.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.988+0000 7fe2f479b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e3cb69a050 0x55e3cb69a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:31.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.988+0000 7fe2f479b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e3cb69aa40 0x55e3cb69f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:31.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.988+0000 7fe2f479b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e3cb69fbb0 0x55e3cb6a2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:31.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.988+0000 7fe2f479b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3cb670bf0 con 0x55e3cb69a050 2024-01-31T05:12:31.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.988+0000 7fe2f479b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3cb608f50 con 0x55e3cb69aa40 2024-01-31T05:12:31.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.988+0000 7fe2f479b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3cb606640 con 0x55e3cb69fbb0 2024-01-31T05:12:31.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.988+0000 7fe2ea7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e3cb69a050 0x55e3cb69a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:31.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.988+0000 7fe2ea7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e3cb69a050 0x55e3cb69a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33786/0 (socket says 172.21.15.99:33786) 2024-01-31T05:12:31.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.988+0000 7fe2ea7fc640 1 -- 172.21.15.99:0/2593660515 learned_addr learned my addr 172.21.15.99:0/2593660515 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:31.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.988+0000 7fe2eaffd640 1 --2- 172.21.15.99:0/2593660515 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e3cb69aa40 0x55e3cb69f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:31.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.988+0000 7fe2f08ff640 1 --2- 172.21.15.99:0/1442886804 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe2d40a1370 0x7fe2d40a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:31.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.988+0000 7fe2ea7fc640 1 --2- 172.21.15.99:0/2593660515 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e3cb69fbb0 0x55e3cb6a2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:31.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.988+0000 7fe2f08ff640 1 -- 172.21.15.99:0/1442886804 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fe2e40ee960 con 0x7fe2ec1028b0 2024-01-31T05:12:31.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.988+0000 7fe2ea7fc640 1 -- 172.21.15.99:0/2593660515 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e3cb69fbb0 msgr2=0x55e3cb6a2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:31.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.988+0000 7fe2ea7fc640 1 --2- 172.21.15.99:0/2593660515 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e3cb69fbb0 0x55e3cb6a2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:31.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.988+0000 7fe2ea7fc640 1 -- 172.21.15.99:0/2593660515 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e3cb69aa40 msgr2=0x55e3cb69f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:31.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.988+0000 7fe2ea7fc640 1 --2- 172.21.15.99:0/2593660515 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e3cb69aa40 0x55e3cb69f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:31.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.988+0000 7fe2ea7fc640 1 -- 172.21.15.99:0/2593660515 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3cb5f9d50 con 0x55e3cb69a050 2024-01-31T05:12:31.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.988+0000 7fe2eb7fe640 1 --2- 172.21.15.99:0/1442886804 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe2d40a1370 0x7fe2d40a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:31.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.989+0000 7fe2ea7fc640 1 --2- 172.21.15.99:0/2593660515 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e3cb69a050 0x55e3cb69a470 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fe2e000f970 tx=0x7fe2e0009d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87171b58dfae8731 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:31.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.989+0000 7fe2d1ffb640 1 -- 172.21.15.99:0/2593660515 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e0004250 con 0x55e3cb69a050 2024-01-31T05:12:31.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.989+0000 7fe2eb7fe640 1 --2- 172.21.15.99:0/1442886804 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe2d40a1370 0x7fe2d40a3830 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe2e40ec570 tx=0x7fe2e4004290 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:31.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.989+0000 7fe2d1ffb640 1 -- 172.21.15.99:0/2593660515 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe2e000edf0 con 0x55e3cb69a050 2024-01-31T05:12:31.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.989+0000 7fe2d1ffb640 1 -- 172.21.15.99:0/2593660515 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e00047a0 con 0x55e3cb69a050 2024-01-31T05:12:31.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.990+0000 7fe2f479b740 1 -- 172.21.15.99:0/2593660515 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e3cb69a050 msgr2=0x55e3cb69a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:31.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.990+0000 7fe2f479b740 1 --2- 172.21.15.99:0/2593660515 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e3cb69a050 0x55e3cb69a470 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fe2e000f970 tx=0x7fe2e0009d20 comp rx=0 tx=0).stop 2024-01-31T05:12:31.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.990+0000 7fe2f479b740 1 -- 172.21.15.99:0/2593660515 shutdown_connections 2024-01-31T05:12:31.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.990+0000 7fe2f479b740 1 --2- 172.21.15.99:0/2593660515 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e3cb69fbb0 0x55e3cb6a2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:31.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.990+0000 7fe2f479b740 1 --2- 172.21.15.99:0/2593660515 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e3cb69aa40 0x55e3cb69f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:31.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.990+0000 7fe2f479b740 1 --2- 172.21.15.99:0/2593660515 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e3cb69a050 0x55e3cb69a470 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:31.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.990+0000 7fe2f479b740 1 -- 172.21.15.99:0/2593660515 >> 172.21.15.99:0/2593660515 conn(0x55e3cb6955c0 msgr2=0x55e3cb6959c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:31.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.994+0000 7fe2f479b740 1 -- 172.21.15.99:0/2593660515 shutdown_connections 2024-01-31T05:12:31.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.994+0000 7fe2f479b740 1 -- 172.21.15.99:0/2593660515 wait complete. 2024-01-31T05:12:31.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.994+0000 7fe2f479b740 1 -- start start 2024-01-31T05:12:31.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.994+0000 7fe2f479b740 1 Processor -- start 2024-01-31T05:12:31.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.994+0000 7fe2f479b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e3cb69aa40 0x55e3cb69d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:31.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.994+0000 7fe2f479b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e3cb69fbb0 0x55e3cb69d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:31.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.994+0000 7fe2f479b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e3cb69e700 0x55e3cb69eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:31.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.994+0000 7fe2f479b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3cb601f30 con 0x55e3cb69fbb0 2024-01-31T05:12:31.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.994+0000 7fe2f479b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3cb5bb0c0 con 0x55e3cb69aa40 2024-01-31T05:12:31.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.994+0000 7fe2f479b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3cb5bad60 con 0x55e3cb69e700 2024-01-31T05:12:31.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.994+0000 7fe2f479b740 10 client.0 _ll_register_callbacks cb 0x55e3cb5a0fc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:12:31.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.995+0000 7fe2eaffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e3cb69fbb0 0x55e3cb69d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:31.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.995+0000 7fe2ea7fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e3cb69e700 0x55e3cb69eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:31.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.995+0000 7fe2eaffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e3cb69fbb0 0x55e3cb69d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33798/0 (socket says 172.21.15.99:33798) 2024-01-31T05:12:31.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.995+0000 7fe2eaffd640 1 -- 172.21.15.99:0/794709669 learned_addr learned my addr 172.21.15.99:0/794709669 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:31.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.995+0000 7fe2ea7fc640 1 --2- 172.21.15.99:0/794709669 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e3cb69aa40 0x55e3cb69d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:31.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.995+0000 7fe2ea7fc640 1 -- 172.21.15.99:0/794709669 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e3cb69e700 msgr2=0x55e3cb69eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:31.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.995+0000 7fe2ea7fc640 1 --2- 172.21.15.99:0/794709669 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e3cb69e700 0x55e3cb69eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:31.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.995+0000 7fe2ea7fc640 1 -- 172.21.15.99:0/794709669 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e3cb69fbb0 msgr2=0x55e3cb69d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:31.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.995+0000 7fe2ea7fc640 1 --2- 172.21.15.99:0/794709669 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e3cb69fbb0 0x55e3cb69d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:31.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.995+0000 7fe2ea7fc640 1 -- 172.21.15.99:0/794709669 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2e000f5a0 con 0x55e3cb69aa40 2024-01-31T05:12:31.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.995+0000 7fe2eaffd640 1 --2- 172.21.15.99:0/794709669 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e3cb69fbb0 0x55e3cb69d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:12:31.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.995+0000 7fe2ea7fc640 1 --2- 172.21.15.99:0/794709669 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e3cb69aa40 0x55e3cb69d200 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x55e3cb696560 tx=0x7fe2e000ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=552a3b32ba8193b3 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:32.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.995+0000 7fe2caffd640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-01-31T05:12:32.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.996+0000 7fe2caffd640 1 -- 172.21.15.99:0/794709669 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e0004af0 con 0x55e3cb69aa40 2024-01-31T05:12:32.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.996+0000 7fe2f479b740 1 -- 172.21.15.99:0/794709669 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e3cb5faf20 con 0x55e3cb69aa40 2024-01-31T05:12:32.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.996+0000 7fe2caffd640 1 -- 172.21.15.99:0/794709669 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fe2e0004c50 con 0x55e3cb69aa40 2024-01-31T05:12:32.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.996+0000 7fe2caffd640 1 -- 172.21.15.99:0/794709669 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2e003d070 con 0x55e3cb69aa40 2024-01-31T05:12:32.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.996+0000 7fe2f479b740 10 client.25259 fetch_fsmap learned FSMap version 27 2024-01-31T05:12:32.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.996+0000 7fe2f479b740 1 -- 172.21.15.99:0/794709669 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55e3cb6005b0 con 0x55e3cb69aa40 2024-01-31T05:12:32.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.996+0000 7fe2caffd640 1 -- 172.21.15.99:0/794709669 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e3cb5faf20 con 0x55e3cb69aa40 2024-01-31T05:12:32.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.996+0000 7fe2caffd640 1 -- 172.21.15.99:0/794709669 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe2e0037b50 con 0x55e3cb69aa40 2024-01-31T05:12:32.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.997+0000 7fe2f479b740 10 client.25259 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:12:32.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.997+0000 7fe2f479b740 10 client.25259 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-01-31T05:12:32.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.997+0000 7fe2f479b740 20 client.25259 populate_metadata read hostname 'smithi099' 2024-01-31T05:12:32.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.997+0000 7fe2f479b740 1 --2- 172.21.15.99:0/794709669 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55e3cb6b0790 0x55e3cb6b2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:32.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.997+0000 7fe2f479b740 4 client.25259 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:12:32.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.997+0000 7fe2f479b740 1 -- 172.21.15.99:0/794709669 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e3cb5fac40 con 0x55e3cb6b0790 2024-01-31T05:12:32.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.997+0000 7fe2eaffd640 1 --2- 172.21.15.99:0/794709669 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55e3cb6b0790 0x55e3cb6b2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:32.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.997+0000 7fe2caffd640 10 client.25259 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:12:32.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.997+0000 7fe2eaffd640 1 --2- 172.21.15.99:0/794709669 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55e3cb6b0790 0x55e3cb6b2b80 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4a318dd4ce1a112 server_cookie=9c2d1956b90343e4 in_seq=0 out_seq=0 2024-01-31T05:12:32.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.998+0000 7fe2caffd640 1 -- 172.21.15.99:0/794709669 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e3cb5fac40 con 0x55e3cb6b0790 2024-01-31T05:12:32.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.998+0000 7fe2caffd640 10 client.25259 handle_command_reply: tid=0 2024-01-31T05:12:32.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.998+0000 7fe2f479b740 1 client.25259 shutdown 2024-01-31T05:12:32.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.998+0000 7fe2f479b740 1 -- 172.21.15.99:0/794709669 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e3cb69aa40 msgr2=0x55e3cb69d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:32.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.998+0000 7fe2f479b740 1 --2- 172.21.15.99:0/794709669 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e3cb69aa40 0x55e3cb69d200 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x55e3cb696560 tx=0x7fe2e000ef60 comp rx=0 tx=0).stop 2024-01-31T05:12:32.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.998+0000 7fe2f479b740 1 -- 172.21.15.99:0/794709669 shutdown_connections 2024-01-31T05:12:32.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.998+0000 7fe2f479b740 1 --2- 172.21.15.99:0/794709669 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e3cb69e700 0x55e3cb69eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.998+0000 7fe2f479b740 1 --2- 172.21.15.99:0/794709669 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e3cb69fbb0 0x55e3cb69d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.998+0000 7fe2f479b740 1 --2- 172.21.15.99:0/794709669 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55e3cb6b0790 0x55e3cb6b2b80 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.998+0000 7fe2f479b740 1 --2- 172.21.15.99:0/794709669 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e3cb69aa40 0x55e3cb69d200 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.998+0000 7fe2caffd640 0 client.25259 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:12:32.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.998+0000 7fe2f479b740 1 -- 172.21.15.99:0/794709669 >> 172.21.15.99:0/794709669 conn(0x55e3cb6955c0 msgr2=0x55e3cb694960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:32.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.998+0000 7fe2f479b740 1 -- 172.21.15.99:0/794709669 shutdown_connections 2024-01-31T05:12:32.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.998+0000 7fe2f479b740 1 -- 172.21.15.99:0/794709669 wait complete. 2024-01-31T05:12:32.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:31.998+0000 7fe2f479b740 20 client.25259 trim_cache size 0 max 16384 2024-01-31T05:12:32.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.013+0000 7fe2f479b740 1 Processor -- start 2024-01-31T05:12:32.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.013+0000 7fe2f479b740 1 -- start start 2024-01-31T05:12:32.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.014+0000 7fe2f479b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e3cb69e700 0x55e3cb6a38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:32.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.014+0000 7fe2f479b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e3cb69fbb0 0x55e3cb6a3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:32.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.014+0000 7fe2f479b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e3cb69b860 0x55e3cb69bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:32.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.014+0000 7fe2f479b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3cb57fe30 con 0x55e3cb69b860 2024-01-31T05:12:32.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.014+0000 7fe2f479b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3cb6b7d90 con 0x55e3cb69fbb0 2024-01-31T05:12:32.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.014+0000 7fe2f479b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3cb691030 con 0x55e3cb69e700 2024-01-31T05:12:32.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.014+0000 7fe2ea7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e3cb69b860 0x55e3cb69bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:32.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.014+0000 7fe2ea7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e3cb69b860 0x55e3cb69bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33810/0 (socket says 172.21.15.99:33810) 2024-01-31T05:12:32.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.014+0000 7fe2ea7fc640 1 -- 172.21.15.99:0/4262846454 learned_addr learned my addr 172.21.15.99:0/4262846454 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:32.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.014+0000 7fe2ea7fc640 1 --2- 172.21.15.99:0/4262846454 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e3cb69e700 0x55e3cb6a38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:32.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.014+0000 7fe2eaffd640 1 --2- 172.21.15.99:0/4262846454 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e3cb69fbb0 0x55e3cb6a3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:32.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.014+0000 7fe2ea7fc640 1 -- 172.21.15.99:0/4262846454 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e3cb69e700 msgr2=0x55e3cb6a38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:32.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.014+0000 7fe2ea7fc640 1 --2- 172.21.15.99:0/4262846454 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e3cb69e700 0x55e3cb6a38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.014+0000 7fe2ea7fc640 1 -- 172.21.15.99:0/4262846454 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e3cb69fbb0 msgr2=0x55e3cb6a3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:32.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.014+0000 7fe2ea7fc640 1 --2- 172.21.15.99:0/4262846454 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e3cb69fbb0 0x55e3cb6a3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.014+0000 7fe2ea7fc640 1 -- 172.21.15.99:0/4262846454 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3cb59cd50 con 0x55e3cb69b860 2024-01-31T05:12:32.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.014+0000 7fe2eaffd640 1 --2- 172.21.15.99:0/4262846454 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e3cb69fbb0 0x55e3cb6a3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:12:32.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.015+0000 7fe2ea7fc640 1 --2- 172.21.15.99:0/4262846454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e3cb69b860 0x55e3cb69bce0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fe2e000f820 tx=0x7fe2e0005b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14d2fe75fd350c2 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:32.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.015+0000 7fe2d17fa640 1 -- 172.21.15.99:0/4262846454 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e003d070 con 0x55e3cb69b860 2024-01-31T05:12:32.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.015+0000 7fe2d17fa640 1 -- 172.21.15.99:0/4262846454 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe2e00264d0 con 0x55e3cb69b860 2024-01-31T05:12:32.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.015+0000 7fe2d17fa640 1 -- 172.21.15.99:0/4262846454 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e0037690 con 0x55e3cb69b860 2024-01-31T05:12:32.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.016+0000 7fe2f479b740 1 -- 172.21.15.99:0/4262846454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e3cb69b860 msgr2=0x55e3cb69bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:32.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.016+0000 7fe2f479b740 1 --2- 172.21.15.99:0/4262846454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e3cb69b860 0x55e3cb69bce0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fe2e000f820 tx=0x7fe2e0005b90 comp rx=0 tx=0).stop 2024-01-31T05:12:32.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.016+0000 7fe2f479b740 1 -- 172.21.15.99:0/4262846454 shutdown_connections 2024-01-31T05:12:32.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.016+0000 7fe2f479b740 1 --2- 172.21.15.99:0/4262846454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e3cb69b860 0x55e3cb69bce0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.016+0000 7fe2f479b740 1 --2- 172.21.15.99:0/4262846454 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e3cb69fbb0 0x55e3cb6a3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.016+0000 7fe2f479b740 1 --2- 172.21.15.99:0/4262846454 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e3cb69e700 0x55e3cb6a38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.016+0000 7fe2f479b740 1 -- 172.21.15.99:0/4262846454 >> 172.21.15.99:0/4262846454 conn(0x55e3cb6955c0 msgr2=0x55e3cb6959a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:32.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.016+0000 7fe2f479b740 1 -- 172.21.15.99:0/4262846454 shutdown_connections 2024-01-31T05:12:32.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.016+0000 7fe2f479b740 1 -- 172.21.15.99:0/4262846454 wait complete. 2024-01-31T05:12:32.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.016+0000 7fe2f479b740 1 -- start start 2024-01-31T05:12:32.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.016+0000 7fe2f479b740 1 Processor -- start 2024-01-31T05:12:32.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.017+0000 7fe2f479b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e3cb69b860 0x55e3cb6ac620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:32.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.017+0000 7fe2f479b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e3cb69e700 0x55e3cb6aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:32.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.017+0000 7fe2f479b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e3cb69fbb0 0x55e3cb6ab1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:32.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.017+0000 7fe2f479b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3cb6ab700 con 0x55e3cb69b860 2024-01-31T05:12:32.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.017+0000 7fe2f479b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3cb6ab870 con 0x55e3cb69fbb0 2024-01-31T05:12:32.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.017+0000 7fe2f479b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3cb6aba30 con 0x55e3cb69e700 2024-01-31T05:12:32.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.017+0000 7fe2f479b740 10 client.0 _ll_register_callbacks cb 0x7fe2e0009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:12:32.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.017+0000 7fe2ea7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e3cb69b860 0x55e3cb6ac620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:32.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.017+0000 7fe2ea7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e3cb69b860 0x55e3cb6ac620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33818/0 (socket says 172.21.15.99:33818) 2024-01-31T05:12:32.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.017+0000 7fe2ea7fc640 1 -- 172.21.15.99:0/114649080 learned_addr learned my addr 172.21.15.99:0/114649080 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:32.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.017+0000 7fe2eaffd640 1 --2- 172.21.15.99:0/114649080 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e3cb69e700 0x55e3cb6aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:32.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.017+0000 7fe2ea7fc640 1 --2- 172.21.15.99:0/114649080 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e3cb69fbb0 0x55e3cb6ab1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:32.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.017+0000 7fe2ea7fc640 1 -- 172.21.15.99:0/114649080 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e3cb69e700 msgr2=0x55e3cb6aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:32.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.017+0000 7fe2ea7fc640 1 --2- 172.21.15.99:0/114649080 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e3cb69e700 0x55e3cb6aac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.017+0000 7fe2ea7fc640 1 -- 172.21.15.99:0/114649080 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e3cb69fbb0 msgr2=0x55e3cb6ab1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:32.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.017+0000 7fe2ea7fc640 1 --2- 172.21.15.99:0/114649080 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e3cb69fbb0 0x55e3cb6ab1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.017+0000 7fe2ea7fc640 1 -- 172.21.15.99:0/114649080 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2dc012b00 con 0x55e3cb69b860 2024-01-31T05:12:32.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.017+0000 7fe2eaffd640 1 --2- 172.21.15.99:0/114649080 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e3cb69e700 0x55e3cb6aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:12:32.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.017+0000 7fe2ea7fc640 1 --2- 172.21.15.99:0/114649080 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e3cb69b860 0x55e3cb6ac620 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fe2e0026c00 tx=0x7fe2e000ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c82aac95b2a9c186 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:32.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.017+0000 7fe2caffd640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:12:32.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.018+0000 7fe2caffd640 1 -- 172.21.15.99:0/114649080 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e003d040 con 0x55e3cb69b860 2024-01-31T05:12:32.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.018+0000 7fe2caffd640 1 -- 172.21.15.99:0/114649080 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fe2e0037840 con 0x55e3cb69b860 2024-01-31T05:12:32.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.018+0000 7fe2f479b740 1 -- 172.21.15.99:0/114649080 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe2e000edf0 con 0x55e3cb69b860 2024-01-31T05:12:32.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.018+0000 7fe2caffd640 1 -- 172.21.15.99:0/114649080 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2e0037a00 con 0x55e3cb69b860 2024-01-31T05:12:32.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.018+0000 7fe2f479b740 10 client.15825 fetch_fsmap learned FSMap version 27 2024-01-31T05:12:32.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.018+0000 7fe2f479b740 1 -- 172.21.15.99:0/114649080 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55e3cb6005b0 con 0x55e3cb69b860 2024-01-31T05:12:32.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.018+0000 7fe2caffd640 1 -- 172.21.15.99:0/114649080 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe2e0058080 con 0x55e3cb69b860 2024-01-31T05:12:32.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.018+0000 7fe2caffd640 1 -- 172.21.15.99:0/114649080 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe2e0052030 con 0x55e3cb69b860 2024-01-31T05:12:32.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.018+0000 7fe2f479b740 10 client.15825 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:12:32.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.018+0000 7fe2f479b740 10 client.15825 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-01-31T05:12:32.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.018+0000 7fe2f479b740 20 client.15825 populate_metadata read hostname 'smithi099' 2024-01-31T05:12:32.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.018+0000 7fe2f479b740 1 --2- 172.21.15.99:0/114649080 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55e3cb707f60 0x55e3cb70a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:32.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.018+0000 7fe2f479b740 4 client.15825 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-01-31T05:12:32.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.018+0000 7fe2f479b740 1 -- 172.21.15.99:0/114649080 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x7fe2e000edf0 con 0x55e3cb707f60 2024-01-31T05:12:32.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.019+0000 7fe2eaffd640 1 --2- 172.21.15.99:0/114649080 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55e3cb707f60 0x55e3cb70a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:32.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.019+0000 7fe2caffd640 10 client.15825 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:12:32.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.019+0000 7fe2eaffd640 1 --2- 172.21.15.99:0/114649080 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55e3cb707f60 0x55e3cb70a380 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=baf619ba7a50ac60 server_cookie=f4f6ba13908d918b in_seq=0 out_seq=0 2024-01-31T05:12:32.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.020+0000 7fe2caffd640 1 -- 172.21.15.99:0/114649080 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x7fe2e000edf0 con 0x55e3cb707f60 2024-01-31T05:12:32.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.020+0000 7fe2caffd640 10 client.15825 handle_command_reply: tid=0 2024-01-31T05:12:32.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.020+0000 7fe2f479b740 1 client.15825 shutdown 2024-01-31T05:12:32.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.021+0000 7fe2f479b740 1 -- 172.21.15.99:0/114649080 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e3cb69b860 msgr2=0x55e3cb6ac620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:32.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.021+0000 7fe2f479b740 1 --2- 172.21.15.99:0/114649080 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e3cb69b860 0x55e3cb6ac620 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fe2e0026c00 tx=0x7fe2e000ec60 comp rx=0 tx=0).stop 2024-01-31T05:12:32.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.021+0000 7fe2f479b740 1 -- 172.21.15.99:0/114649080 shutdown_connections 2024-01-31T05:12:32.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.021+0000 7fe2f479b740 1 --2- 172.21.15.99:0/114649080 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55e3cb707f60 0x55e3cb70a380 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.021+0000 7fe2f479b740 1 --2- 172.21.15.99:0/114649080 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e3cb69fbb0 0x55e3cb6ab1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.021+0000 7fe2f479b740 1 --2- 172.21.15.99:0/114649080 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e3cb69e700 0x55e3cb6aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.021+0000 7fe2caffd640 0 client.15825 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:12:32.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.021+0000 7fe2f479b740 1 --2- 172.21.15.99:0/114649080 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e3cb69b860 0x55e3cb6ac620 secure :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fe2e0026c00 tx=0x7fe2e000ec60 comp rx=0 tx=0).stop 2024-01-31T05:12:32.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.021+0000 7fe2f479b740 1 -- 172.21.15.99:0/114649080 >> 172.21.15.99:0/114649080 conn(0x55e3cb6955c0 msgr2=0x55e3cb69bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:32.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.021+0000 7fe2f479b740 1 -- 172.21.15.99:0/114649080 shutdown_connections 2024-01-31T05:12:32.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.021+0000 7fe2f479b740 1 -- 172.21.15.99:0/114649080 wait complete. 2024-01-31T05:12:32.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.021+0000 7fe2f479b740 20 client.15825 trim_cache size 0 max 16384 2024-01-31T05:12:32.024 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-01-31T05:12:32.024 INFO:teuthology.orchestra.run.smithi099.stdout: "return_code": 0, 2024-01-31T05:12:32.024 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_tag": "f92cb97f-97d9-4e79-aa8e-d36a89adbcc9", 2024-01-31T05:12:32.024 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": "asynchronous" 2024-01-31T05:12:32.024 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-01-31T05:12:32.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.022+0000 7fe2f1901640 1 -- 172.21.15.99:0/1442886804 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe2d40a1370 msgr2=0x7fe2d40a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:32.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.022+0000 7fe2f1901640 1 --2- 172.21.15.99:0/1442886804 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe2d40a1370 0x7fe2d40a3830 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe2e40ec570 tx=0x7fe2e4004290 comp rx=0 tx=0).stop 2024-01-31T05:12:32.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.022+0000 7fe2f1901640 1 -- 172.21.15.99:0/1442886804 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2ec1028b0 msgr2=0x7fe2ec19e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:32.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.022+0000 7fe2f1901640 1 --2- 172.21.15.99:0/1442886804 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2ec1028b0 0x7fe2ec19e240 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4037040 tx=0x7fe2e40093d0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.022+0000 7fe2f1901640 1 -- 172.21.15.99:0/1442886804 shutdown_connections 2024-01-31T05:12:32.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.022+0000 7fe2f1901640 1 --2- 172.21.15.99:0/1442886804 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe2d40a1370 0x7fe2d40a3830 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.022+0000 7fe2f1901640 1 --2- 172.21.15.99:0/1442886804 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2ec1028b0 0x7fe2ec19e240 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.022+0000 7fe2f1901640 1 --2- 172.21.15.99:0/1442886804 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe2ec101ef0 0x7fe2ec1971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.022+0000 7fe2f1901640 1 --2- 172.21.15.99:0/1442886804 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2ec100d00 0x7fe2ec196ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.022+0000 7fe2f1901640 1 -- 172.21.15.99:0/1442886804 >> 172.21.15.99:0/1442886804 conn(0x7fe2ec0fc250 msgr2=0x7fe2ec105310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:32.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.022+0000 7fe2f1901640 1 -- 172.21.15.99:0/1442886804 shutdown_connections 2024-01-31T05:12:32.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.022+0000 7fe2f1901640 1 -- 172.21.15.99:0/1442886804 wait complete. 2024-01-31T05:12:32.031 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:31 smithi099 ceph-mon[31615]: pgmap v383: 97 pgs: 97 active+clean; 670 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-01-31T05:12:32.032 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-01-31T05:12:32.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:31 smithi179 ceph-mon[35652]: pgmap v383: 97 pgs: 97 active+clean; 670 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-01-31T05:12:32.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.141+0000 7f9143078640 1 -- 172.21.15.99:0/1391173547 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f913c1069d0 msgr2=0x7f913c108e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:32.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.141+0000 7f9143078640 1 --2- 172.21.15.99:0/1391173547 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f913c1069d0 0x7f913c108e20 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f9134009ca0 tx=0x7f913402c0f0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.141+0000 7f9143078640 1 -- 172.21.15.99:0/1391173547 shutdown_connections 2024-01-31T05:12:32.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.141+0000 7f9143078640 1 --2- 172.21.15.99:0/1391173547 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f913c1069d0 0x7f913c108e20 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.141+0000 7f9143078640 1 --2- 172.21.15.99:0/1391173547 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f913c1040a0 0x7f913c106490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.141+0000 7f9143078640 1 --2- 172.21.15.99:0/1391173547 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f913c101770 0x7f913c103b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.141+0000 7f9143078640 1 -- 172.21.15.99:0/1391173547 >> 172.21.15.99:0/1391173547 conn(0x7f913c0fb180 msgr2=0x7f913c0fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:32.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.141+0000 7f9143078640 1 -- 172.21.15.99:0/1391173547 shutdown_connections 2024-01-31T05:12:32.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.141+0000 7f9143078640 1 -- 172.21.15.99:0/1391173547 wait complete. 2024-01-31T05:12:32.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.141+0000 7f9143078640 1 Processor -- start 2024-01-31T05:12:32.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.142+0000 7f9143078640 1 -- start start 2024-01-31T05:12:32.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.142+0000 7f9143078640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f913c101770 0x7f913c196d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:32.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.142+0000 7f9143078640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f913c1040a0 0x7f913c197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:32.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.142+0000 7f9143078640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f913c1069d0 0x7f913c19e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:32.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.142+0000 7f9143078640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913c19e7e0 con 0x7f913c101770 2024-01-31T05:12:32.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.142+0000 7f9143078640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913c19e950 con 0x7f913c1069d0 2024-01-31T05:12:32.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.142+0000 7f9143078640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913c19eb10 con 0x7f913c1040a0 2024-01-31T05:12:32.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.142+0000 7f9140e14640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f913c101770 0x7f913c196d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:32.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.142+0000 7f9140e14640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f913c101770 0x7f913c196d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33836/0 (socket says 172.21.15.99:33836) 2024-01-31T05:12:32.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.142+0000 7f913bfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f913c1040a0 0x7f913c197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:32.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.142+0000 7f9140e14640 1 -- 172.21.15.99:0/1929478965 learned_addr learned my addr 172.21.15.99:0/1929478965 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:32.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.142+0000 7f9141615640 1 --2- 172.21.15.99:0/1929478965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f913c1069d0 0x7f913c19e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:32.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.142+0000 7f9141615640 1 -- 172.21.15.99:0/1929478965 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f913c1040a0 msgr2=0x7f913c197240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:32.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.142+0000 7f9141615640 1 --2- 172.21.15.99:0/1929478965 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f913c1040a0 0x7f913c197240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.142+0000 7f9141615640 1 -- 172.21.15.99:0/1929478965 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f913c101770 msgr2=0x7f913c196d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:32.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.142+0000 7f9141615640 1 --2- 172.21.15.99:0/1929478965 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f913c101770 0x7f913c196d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.142+0000 7f9141615640 1 -- 172.21.15.99:0/1929478965 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9134009900 con 0x7f913c1069d0 2024-01-31T05:12:32.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.142+0000 7f9140e14640 1 --2- 172.21.15.99:0/1929478965 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f913c101770 0x7f913c196d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:12:32.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.143+0000 7f9141615640 1 --2- 172.21.15.99:0/1929478965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f913c1069d0 0x7f913c19e270 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f913402c630 tx=0x7f9134032a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:32.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.143+0000 7f9139ffb640 1 -- 172.21.15.99:0/1929478965 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9134034e80 con 0x7f913c1069d0 2024-01-31T05:12:32.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.143+0000 7f9143078640 1 -- 172.21.15.99:0/1929478965 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f913c19ed90 con 0x7f913c1069d0 2024-01-31T05:12:32.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.143+0000 7f9139ffb640 1 -- 172.21.15.99:0/1929478965 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9134032e90 con 0x7f913c1069d0 2024-01-31T05:12:32.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.143+0000 7f9139ffb640 1 -- 172.21.15.99:0/1929478965 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913403d3f0 con 0x7f913c1069d0 2024-01-31T05:12:32.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.143+0000 7f9143078640 1 -- 172.21.15.99:0/1929478965 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f913c19f1a0 con 0x7f913c1069d0 2024-01-31T05:12:32.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.146+0000 7f9145e3f740 1 Processor -- start 2024-01-31T05:12:32.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.146+0000 7f9139ffb640 1 -- 172.21.15.99:0/1929478965 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 19) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f913403b040 con 0x7f913c1069d0 2024-01-31T05:12:32.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.146+0000 7f9145e3f740 1 -- start start 2024-01-31T05:12:32.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.147+0000 7f9145e3f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5608a0e9d9a0 0x5608a0e9ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:32.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.147+0000 7f9145e3f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608a0e9e390 0x5608a0ea0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:32.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.147+0000 7f9145e3f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5608a0ea14f0 0x5608a0eae360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:32.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.147+0000 7f9145e3f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608a0e0c380 con 0x5608a0e9e390 2024-01-31T05:12:32.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.147+0000 7f9145e3f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608a0e09a70 con 0x5608a0ea14f0 2024-01-31T05:12:32.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.147+0000 7f9145e3f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608a0e05360 con 0x5608a0e9d9a0 2024-01-31T05:12:32.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.147+0000 7f9140e14640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608a0e9e390 0x5608a0ea0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:32.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.147+0000 7f9140e14640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608a0e9e390 0x5608a0ea0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33840/0 (socket says 172.21.15.99:33840) 2024-01-31T05:12:32.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.147+0000 7f913bfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5608a0e9d9a0 0x5608a0e9ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:32.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.147+0000 7f9140e14640 1 -- 172.21.15.99:0/1672508713 learned_addr learned my addr 172.21.15.99:0/1672508713 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:32.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.147+0000 7f913bfff640 1 --2- 172.21.15.99:0/1672508713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5608a0ea14f0 0x5608a0eae360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:32.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.147+0000 7f9139ffb640 1 --2- 172.21.15.99:0/1929478965 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f912c0a13f0 0x7f912c0a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:32.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.147+0000 7f913bfff640 1 -- 172.21.15.99:0/1672508713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5608a0ea14f0 msgr2=0x5608a0eae360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:32.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.147+0000 7f913bfff640 1 --2- 172.21.15.99:0/1672508713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5608a0ea14f0 0x5608a0eae360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.147+0000 7f913bfff640 1 -- 172.21.15.99:0/1672508713 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608a0e9e390 msgr2=0x5608a0ea0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:32.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.147+0000 7f913bfff640 1 --2- 172.21.15.99:0/1672508713 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608a0e9e390 0x5608a0ea0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.147+0000 7f913bfff640 1 -- 172.21.15.99:0/1672508713 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5608a0dc77e0 con 0x5608a0e9d9a0 2024-01-31T05:12:32.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.147+0000 7f9140e14640 1 --2- 172.21.15.99:0/1672508713 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608a0e9e390 0x5608a0ea0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:12:32.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.147+0000 7f9139ffb640 1 -- 172.21.15.99:0/1929478965 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f91340eefb0 con 0x7f913c1069d0 2024-01-31T05:12:32.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.147+0000 7f9141615640 1 --2- 172.21.15.99:0/1929478965 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f912c0a13f0 0x7f912c0a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:32.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.148+0000 7f913bfff640 1 --2- 172.21.15.99:0/1672508713 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5608a0e9d9a0 0x5608a0e9ddc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9128005d00 tx=0x7f9128005c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd3920bb2e46dc1c server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:32.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.148+0000 7f9126ffd640 1 -- 172.21.15.99:0/1672508713 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9128012d20 con 0x5608a0e9d9a0 2024-01-31T05:12:32.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.148+0000 7f9126ffd640 1 -- 172.21.15.99:0/1672508713 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f91280044f0 con 0x5608a0e9d9a0 2024-01-31T05:12:32.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.148+0000 7f9126ffd640 1 -- 172.21.15.99:0/1672508713 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9128004a00 con 0x5608a0e9d9a0 2024-01-31T05:12:32.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.149+0000 7f9145e3f740 1 -- 172.21.15.99:0/1672508713 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5608a0e9d9a0 msgr2=0x5608a0e9ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:32.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.149+0000 7f9145e3f740 1 --2- 172.21.15.99:0/1672508713 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5608a0e9d9a0 0x5608a0e9ddc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9128005d00 tx=0x7f9128005c90 comp rx=0 tx=0).stop 2024-01-31T05:12:32.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.149+0000 7f9141615640 1 --2- 172.21.15.99:0/1929478965 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f912c0a13f0 0x7f912c0a38b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9134009ca0 tx=0x7f91340095c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:32.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.149+0000 7f9145e3f740 1 -- 172.21.15.99:0/1672508713 shutdown_connections 2024-01-31T05:12:32.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.149+0000 7f9145e3f740 1 --2- 172.21.15.99:0/1672508713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5608a0ea14f0 0x5608a0eae360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.149+0000 7f9145e3f740 1 --2- 172.21.15.99:0/1672508713 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608a0e9e390 0x5608a0ea0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.149+0000 7f9145e3f740 1 --2- 172.21.15.99:0/1672508713 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5608a0e9d9a0 0x5608a0e9ddc0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.149+0000 7f9145e3f740 1 -- 172.21.15.99:0/1672508713 >> 172.21.15.99:0/1672508713 conn(0x5608a0e98f90 msgr2=0x5608a0e99390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:32.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.149+0000 7f9145e3f740 1 -- 172.21.15.99:0/1672508713 shutdown_connections 2024-01-31T05:12:32.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.149+0000 7f9145e3f740 1 -- 172.21.15.99:0/1672508713 wait complete. 2024-01-31T05:12:32.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.149+0000 7f9145e3f740 1 -- start start 2024-01-31T05:12:32.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.149+0000 7f9145e3f740 1 Processor -- start 2024-01-31T05:12:32.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.150+0000 7f9145e3f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5608a0e9d9a0 0x5608a0eb0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:32.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.150+0000 7f9145e3f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5608a0e9e390 0x5608a0eb09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:32.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.150+0000 7f9145e3f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608a0ea14f0 0x5608a0eb7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:32.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.150+0000 7f9145e3f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608a0dbe750 con 0x5608a0ea14f0 2024-01-31T05:12:32.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.150+0000 7f9145e3f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608a0dbe3f0 con 0x5608a0e9d9a0 2024-01-31T05:12:32.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.150+0000 7f9145e3f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608a0d833f0 con 0x5608a0e9e390 2024-01-31T05:12:32.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.150+0000 7f913bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608a0ea14f0 0x5608a0eb7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:32.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.150+0000 7f913bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608a0ea14f0 0x5608a0eb7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33844/0 (socket says 172.21.15.99:33844) 2024-01-31T05:12:32.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.150+0000 7f913bfff640 1 -- 172.21.15.99:0/3063886708 learned_addr learned my addr 172.21.15.99:0/3063886708 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:32.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.150+0000 7f913bfff640 1 --2- 172.21.15.99:0/3063886708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5608a0e9d9a0 0x5608a0eb0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:32.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.150+0000 7f9140e14640 1 --2- 172.21.15.99:0/3063886708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5608a0e9e390 0x5608a0eb09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:32.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.150+0000 7f913bfff640 1 -- 172.21.15.99:0/3063886708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5608a0e9e390 msgr2=0x5608a0eb09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:32.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.150+0000 7f913bfff640 1 --2- 172.21.15.99:0/3063886708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5608a0e9e390 0x5608a0eb09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.150+0000 7f913bfff640 1 -- 172.21.15.99:0/3063886708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5608a0e9d9a0 msgr2=0x5608a0eb0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:32.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.150+0000 7f913bfff640 1 --2- 172.21.15.99:0/3063886708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5608a0e9d9a0 0x5608a0eb0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.150+0000 7f913bfff640 1 -- 172.21.15.99:0/3063886708 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f912801a040 con 0x5608a0ea14f0 2024-01-31T05:12:32.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.150+0000 7f9145e3f740 10 client.0 _ll_register_callbacks cb 0x5608a0dc0b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:12:32.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.151+0000 7f9145e3f740 1 -- 172.21.15.99:0/3063886708 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5608a0dda210 con 0x5608a0ea14f0 2024-01-31T05:12:32.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.151+0000 7f913bfff640 1 --2- 172.21.15.99:0/3063886708 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608a0ea14f0 0x5608a0eb7a10 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f912800b6b0 tx=0x7f912800bb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e35fefabd163423 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:32.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.151+0000 7f911bfff640 10 client.15837 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:12:32.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.151+0000 7f911bfff640 1 -- 172.21.15.99:0/3063886708 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9128022040 con 0x5608a0ea14f0 2024-01-31T05:12:32.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.151+0000 7f911bfff640 1 -- 172.21.15.99:0/3063886708 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f9128010740 con 0x5608a0ea14f0 2024-01-31T05:12:32.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.151+0000 7f911bfff640 1 -- 172.21.15.99:0/3063886708 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9128010940 con 0x5608a0ea14f0 2024-01-31T05:12:32.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.151+0000 7f9145e3f740 10 client.15837 fetch_fsmap learned FSMap version 27 2024-01-31T05:12:32.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.151+0000 7f9145e3f740 1 -- 172.21.15.99:0/3063886708 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({fsmap=27}) v3 -- 0x5608a0e039e0 con 0x5608a0ea14f0 2024-01-31T05:12:32.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.151+0000 7f911bfff640 1 -- 172.21.15.99:0/3063886708 <== mon.0 v2:172.21.15.99:3300/0 4 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9128010aa0 con 0x5608a0ea14f0 2024-01-31T05:12:32.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.152+0000 7f9145e3f740 10 client.15837 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:12:32.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.152+0000 7f9145e3f740 10 client.15837 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-01-31T05:12:32.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.152+0000 7f9145e3f740 20 client.15837 populate_metadata read hostname 'smithi099' 2024-01-31T05:12:32.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.152+0000 7f9145e3f740 1 --2- 172.21.15.99:0/3063886708 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5608a0ebc280 0x5608a0ebe720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:32.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.152+0000 7f9145e3f740 4 client.15837 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:12:32.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.152+0000 7f9145e3f740 1 -- 172.21.15.99:0/3063886708 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5608a0dd7b20 con 0x5608a0ebc280 2024-01-31T05:12:32.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.152+0000 7f9140e14640 1 --2- 172.21.15.99:0/3063886708 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5608a0ebc280 0x5608a0ebe720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:32.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.152+0000 7f9140e14640 1 --2- 172.21.15.99:0/3063886708 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5608a0ebc280 0x5608a0ebe720 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2210f17c84b1d61 server_cookie=b241a4db1e58ffb in_seq=0 out_seq=0 2024-01-31T05:12:32.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.152+0000 7f911bfff640 10 client.15837 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:12:32.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.153+0000 7f911bfff640 1 -- 172.21.15.99:0/3063886708 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5608a0dd7b20 con 0x5608a0ebc280 2024-01-31T05:12:32.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.153+0000 7f911bfff640 10 client.15837 handle_command_reply: tid=0 2024-01-31T05:12:32.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.153+0000 7f9145e3f740 1 client.15837 shutdown 2024-01-31T05:12:32.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.153+0000 7f9145e3f740 1 -- 172.21.15.99:0/3063886708 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608a0ea14f0 msgr2=0x5608a0eb7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:32.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.153+0000 7f9145e3f740 1 --2- 172.21.15.99:0/3063886708 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608a0ea14f0 0x5608a0eb7a10 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f912800b6b0 tx=0x7f912800bb50 comp rx=0 tx=0).stop 2024-01-31T05:12:32.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.153+0000 7f9145e3f740 1 -- 172.21.15.99:0/3063886708 shutdown_connections 2024-01-31T05:12:32.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.153+0000 7f9145e3f740 1 --2- 172.21.15.99:0/3063886708 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608a0ea14f0 0x5608a0eb7a10 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.153+0000 7f9145e3f740 1 --2- 172.21.15.99:0/3063886708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5608a0e9e390 0x5608a0eb09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.153+0000 7f9145e3f740 1 --2- 172.21.15.99:0/3063886708 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5608a0ebc280 0x5608a0ebe720 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.153+0000 7f911bfff640 0 client.15837 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:12:32.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.153+0000 7f9145e3f740 1 --2- 172.21.15.99:0/3063886708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5608a0e9d9a0 0x5608a0eb0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.153+0000 7f9145e3f740 1 -- 172.21.15.99:0/3063886708 >> 172.21.15.99:0/3063886708 conn(0x5608a0e98f90 msgr2=0x5608a0e98210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:32.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.154+0000 7f9145e3f740 1 -- 172.21.15.99:0/3063886708 shutdown_connections 2024-01-31T05:12:32.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.154+0000 7f9145e3f740 1 -- 172.21.15.99:0/3063886708 wait complete. 2024-01-31T05:12:32.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.154+0000 7f9145e3f740 20 client.15837 trim_cache size 0 max 16384 2024-01-31T05:12:32.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.183+0000 7f9145e3f740 1 Processor -- start 2024-01-31T05:12:32.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.183+0000 7f9145e3f740 1 -- start start 2024-01-31T05:12:32.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.183+0000 7f9145e3f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5608a0e9d9a0 0x5608a0eb0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:32.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.183+0000 7f9145e3f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5608a0e9e390 0x5608a0eb09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:32.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.183+0000 7f9145e3f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608a0ea14f0 0x5608a0eb79a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:32.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.184+0000 7f9145e3f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608a0e9d5e0 con 0x5608a0ea14f0 2024-01-31T05:12:32.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.184+0000 7f9145e3f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608a0e99d00 con 0x5608a0e9d9a0 2024-01-31T05:12:32.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.184+0000 7f9145e3f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608a0ec3950 con 0x5608a0e9e390 2024-01-31T05:12:32.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.184+0000 7f913bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608a0ea14f0 0x5608a0eb79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:32.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.184+0000 7f913bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608a0ea14f0 0x5608a0eb79a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33858/0 (socket says 172.21.15.99:33858) 2024-01-31T05:12:32.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.184+0000 7f913bfff640 1 -- 172.21.15.99:0/3460383139 learned_addr learned my addr 172.21.15.99:0/3460383139 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:32.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.184+0000 7f9140e14640 1 --2- 172.21.15.99:0/3460383139 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5608a0e9e390 0x5608a0eb09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:32.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.184+0000 7f913bfff640 1 --2- 172.21.15.99:0/3460383139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5608a0e9d9a0 0x5608a0eb0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:32.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.184+0000 7f913bfff640 1 -- 172.21.15.99:0/3460383139 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5608a0e9e390 msgr2=0x5608a0eb09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:32.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.184+0000 7f913bfff640 1 --2- 172.21.15.99:0/3460383139 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5608a0e9e390 0x5608a0eb09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.184+0000 7f913bfff640 1 -- 172.21.15.99:0/3460383139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5608a0e9d9a0 msgr2=0x5608a0eb0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:32.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.184+0000 7f913bfff640 1 --2- 172.21.15.99:0/3460383139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5608a0e9d9a0 0x5608a0eb0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.184+0000 7f913bfff640 1 -- 172.21.15.99:0/3460383139 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5608a0da04f0 con 0x5608a0ea14f0 2024-01-31T05:12:32.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.185+0000 7f913bfff640 1 --2- 172.21.15.99:0/3460383139 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608a0ea14f0 0x5608a0eb79a0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x5608a0dd7b40 tx=0x7f9128017030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71b6850d44da1b4a server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:32.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.185+0000 7f91267fc640 1 -- 172.21.15.99:0/3460383139 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912800bce0 con 0x5608a0ea14f0 2024-01-31T05:12:32.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.185+0000 7f91267fc640 1 -- 172.21.15.99:0/3460383139 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5608a0dda210 con 0x5608a0ea14f0 2024-01-31T05:12:32.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.185+0000 7f91267fc640 1 -- 172.21.15.99:0/3460383139 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9128004aa0 con 0x5608a0ea14f0 2024-01-31T05:12:32.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.186+0000 7f9145e3f740 1 -- 172.21.15.99:0/3460383139 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608a0ea14f0 msgr2=0x5608a0eb79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:32.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.186+0000 7f9145e3f740 1 --2- 172.21.15.99:0/3460383139 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608a0ea14f0 0x5608a0eb79a0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x5608a0dd7b40 tx=0x7f9128017030 comp rx=0 tx=0).stop 2024-01-31T05:12:32.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.186+0000 7f9145e3f740 1 -- 172.21.15.99:0/3460383139 shutdown_connections 2024-01-31T05:12:32.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.186+0000 7f9145e3f740 1 --2- 172.21.15.99:0/3460383139 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608a0ea14f0 0x5608a0eb79a0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.186+0000 7f9145e3f740 1 --2- 172.21.15.99:0/3460383139 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5608a0e9e390 0x5608a0eb09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.186+0000 7f9145e3f740 1 --2- 172.21.15.99:0/3460383139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5608a0e9d9a0 0x5608a0eb0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.186+0000 7f9145e3f740 1 -- 172.21.15.99:0/3460383139 >> 172.21.15.99:0/3460383139 conn(0x5608a0e98f90 msgr2=0x5608a0eaefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:32.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.186+0000 7f9145e3f740 1 -- 172.21.15.99:0/3460383139 shutdown_connections 2024-01-31T05:12:32.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.186+0000 7f9145e3f740 1 -- 172.21.15.99:0/3460383139 wait complete. 2024-01-31T05:12:32.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.186+0000 7f9145e3f740 1 -- start start 2024-01-31T05:12:32.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.187+0000 7f9145e3f740 1 Processor -- start 2024-01-31T05:12:32.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.187+0000 7f9145e3f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608a0e9d9a0 0x5608a0eb6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:32.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.187+0000 7f9145e3f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5608a0e9e390 0x5608a0eb6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:32.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.187+0000 7f913bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608a0e9d9a0 0x5608a0eb6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:32.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.187+0000 7f913bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608a0e9d9a0 0x5608a0eb6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33860/0 (socket says 172.21.15.99:33860) 2024-01-31T05:12:32.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.187+0000 7f913bfff640 1 -- 172.21.15.99:0/1620015822 learned_addr learned my addr 172.21.15.99:0/1620015822 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:32.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.187+0000 7f9145e3f740 1 --2- 172.21.15.99:0/1620015822 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5608a0ebc280 0x5608a0eb6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:32.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.187+0000 7f9145e3f740 1 -- 172.21.15.99:0/1620015822 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608a0f128b0 con 0x5608a0e9d9a0 2024-01-31T05:12:32.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.187+0000 7f9145e3f740 1 -- 172.21.15.99:0/1620015822 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608a0f12a20 con 0x5608a0e9e390 2024-01-31T05:12:32.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.187+0000 7f9145e3f740 1 -- 172.21.15.99:0/1620015822 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608a0f12be0 con 0x5608a0ebc280 2024-01-31T05:12:32.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.187+0000 7f9140e14640 1 --2- 172.21.15.99:0/1620015822 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5608a0e9e390 0x5608a0eb6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:32.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.188+0000 7f913bfff640 1 -- 172.21.15.99:0/1620015822 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5608a0ebc280 msgr2=0x5608a0eb6d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-31T05:12:32.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.188+0000 7f913bfff640 1 --2- 172.21.15.99:0/1620015822 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5608a0ebc280 0x5608a0eb6d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.188+0000 7f913bfff640 1 -- 172.21.15.99:0/1620015822 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5608a0e9e390 msgr2=0x5608a0eb6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:32.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.188+0000 7f913bfff640 1 --2- 172.21.15.99:0/1620015822 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5608a0e9e390 0x5608a0eb6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.188+0000 7f913bfff640 1 -- 172.21.15.99:0/1620015822 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5608a0e039e0 con 0x5608a0e9d9a0 2024-01-31T05:12:32.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.188+0000 7f9145e3f740 10 client.0 _ll_register_callbacks cb 0x7f913000bbc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:12:32.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.188+0000 7f9145e3f740 1 -- 172.21.15.99:0/1620015822 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5608a0e2cbd0 con 0x5608a0e9d9a0 2024-01-31T05:12:32.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.188+0000 7f913bfff640 1 --2- 172.21.15.99:0/1620015822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608a0e9d9a0 0x5608a0eb6310 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f912800b6b0 tx=0x7f9128010c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb2d987ef03ae57e server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:32.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.188+0000 7f911bfff640 10 client.15843 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:12:32.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.189+0000 7f911bfff640 1 -- 172.21.15.99:0/1620015822 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9128022040 con 0x5608a0e9d9a0 2024-01-31T05:12:32.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.189+0000 7f911bfff640 1 -- 172.21.15.99:0/1620015822 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f9128005280 con 0x5608a0e9d9a0 2024-01-31T05:12:32.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.189+0000 7f911bfff640 1 -- 172.21.15.99:0/1620015822 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9128010e20 con 0x5608a0e9d9a0 2024-01-31T05:12:32.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.189+0000 7f9145e3f740 10 client.15843 fetch_fsmap learned FSMap version 27 2024-01-31T05:12:32.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.189+0000 7f9145e3f740 1 -- 172.21.15.99:0/1620015822 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({fsmap=27}) v3 -- 0x5608a0dc6040 con 0x5608a0e9d9a0 2024-01-31T05:12:32.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.190+0000 7f911bfff640 1 -- 172.21.15.99:0/1620015822 <== mon.0 v2:172.21.15.99:3300/0 4 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9128004040 con 0x5608a0e9d9a0 2024-01-31T05:12:32.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.190+0000 7f9145e3f740 10 client.15843 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:12:32.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.190+0000 7f9145e3f740 10 client.15843 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-01-31T05:12:32.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.190+0000 7f9145e3f740 20 client.15843 populate_metadata read hostname 'smithi099' 2024-01-31T05:12:32.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.190+0000 7f9145e3f740 1 --2- 172.21.15.99:0/1620015822 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5608a0f14010 0x5608a0f16430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:32.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.190+0000 7f9145e3f740 4 client.15843 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-01-31T05:12:32.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.190+0000 7f9145e3f740 1 -- 172.21.15.99:0/1620015822 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5608a0dfe1f0 con 0x5608a0f14010 2024-01-31T05:12:32.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.190+0000 7f9140e14640 1 --2- 172.21.15.99:0/1620015822 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5608a0f14010 0x5608a0f16430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:32.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.190+0000 7f911bfff640 10 client.15843 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:12:32.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.190+0000 7f9140e14640 1 --2- 172.21.15.99:0/1620015822 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5608a0f14010 0x5608a0f16430 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0901bfb47fc8b80 server_cookie=973c480f9051ba3 in_seq=0 out_seq=0 2024-01-31T05:12:32.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.191+0000 7f911bfff640 1 -- 172.21.15.99:0/1620015822 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5608a0dfe1f0 con 0x5608a0f14010 2024-01-31T05:12:32.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.191+0000 7f911bfff640 10 client.15843 handle_command_reply: tid=0 2024-01-31T05:12:32.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.191+0000 7f9145e3f740 1 client.15843 shutdown 2024-01-31T05:12:32.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.194+0000 7f9145e3f740 1 -- 172.21.15.99:0/1620015822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608a0e9d9a0 msgr2=0x5608a0eb6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:32.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.194+0000 7f9145e3f740 1 --2- 172.21.15.99:0/1620015822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608a0e9d9a0 0x5608a0eb6310 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f912800b6b0 tx=0x7f9128010c90 comp rx=0 tx=0).stop 2024-01-31T05:12:32.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.194+0000 7f9145e3f740 1 -- 172.21.15.99:0/1620015822 shutdown_connections 2024-01-31T05:12:32.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.194+0000 7f9145e3f740 1 --2- 172.21.15.99:0/1620015822 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5608a0ebc280 0x5608a0eb6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.194+0000 7f9145e3f740 1 --2- 172.21.15.99:0/1620015822 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5608a0f14010 0x5608a0f16430 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.194+0000 7f9145e3f740 1 --2- 172.21.15.99:0/1620015822 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5608a0e9e390 0x5608a0eb6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.194+0000 7f911bfff640 0 client.15843 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:12:32.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.194+0000 7f9145e3f740 1 --2- 172.21.15.99:0/1620015822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608a0e9d9a0 0x5608a0eb6310 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.194+0000 7f9145e3f740 1 -- 172.21.15.99:0/1620015822 >> 172.21.15.99:0/1620015822 conn(0x5608a0e98f90 msgr2=0x5608a0eaefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:32.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.194+0000 7f9145e3f740 1 -- 172.21.15.99:0/1620015822 shutdown_connections 2024-01-31T05:12:32.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.194+0000 7f9145e3f740 1 -- 172.21.15.99:0/1620015822 wait complete. 2024-01-31T05:12:32.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.194+0000 7f9145e3f740 20 client.15843 trim_cache size 0 max 16384 2024-01-31T05:12:32.196 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-01-31T05:12:32.197 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "IDLE (waiting for more scrubs)", 2024-01-31T05:12:32.197 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": { 2024-01-31T05:12:32.197 INFO:teuthology.orchestra.run.smithi099.stdout: "f92cb97f-97d9-4e79-aa8e-d36a89adbcc9": { 2024-01-31T05:12:32.197 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-01-31T05:12:32.197 INFO:teuthology.orchestra.run.smithi099.stdout: "tag": "f92cb97f-97d9-4e79-aa8e-d36a89adbcc9", 2024-01-31T05:12:32.197 INFO:teuthology.orchestra.run.smithi099.stdout: "options": "recursive,force" 2024-01-31T05:12:32.197 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:12:32.197 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:12:32.197 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-01-31T05:12:32.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.195+0000 7f9143078640 1 -- 172.21.15.99:0/1929478965 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f912c0a13f0 msgr2=0x7f912c0a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:32.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.195+0000 7f9143078640 1 --2- 172.21.15.99:0/1929478965 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f912c0a13f0 0x7f912c0a38b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9134009ca0 tx=0x7f91340095c0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.195+0000 7f9143078640 1 -- 172.21.15.99:0/1929478965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f913c1069d0 msgr2=0x7f913c19e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:32.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.195+0000 7f9143078640 1 --2- 172.21.15.99:0/1929478965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f913c1069d0 0x7f913c19e270 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f913402c630 tx=0x7f9134032a40 comp rx=0 tx=0).stop 2024-01-31T05:12:32.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.196+0000 7f9143078640 1 -- 172.21.15.99:0/1929478965 shutdown_connections 2024-01-31T05:12:32.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.196+0000 7f9143078640 1 --2- 172.21.15.99:0/1929478965 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f912c0a13f0 0x7f912c0a38b0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.196+0000 7f9143078640 1 --2- 172.21.15.99:0/1929478965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f913c1069d0 0x7f913c19e270 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.196+0000 7f9143078640 1 --2- 172.21.15.99:0/1929478965 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f913c1040a0 0x7f913c197240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.196+0000 7f9143078640 1 --2- 172.21.15.99:0/1929478965 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f913c101770 0x7f913c196d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.196+0000 7f9143078640 1 -- 172.21.15.99:0/1929478965 >> 172.21.15.99:0/1929478965 conn(0x7f913c0fb180 msgr2=0x7f913c1020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:32.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.196+0000 7f9143078640 1 -- 172.21.15.99:0/1929478965 shutdown_connections 2024-01-31T05:12:32.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:12:32.196+0000 7f9143078640 1 -- 172.21.15.99:0/1929478965 wait complete. 2024-01-31T05:12:32.210 INFO:tasks.cephfs.filesystem:scrub status for tag:f92cb97f-97d9-4e79-aa8e-d36a89adbcc9 - {'path': '/', 'tag': 'f92cb97f-97d9-4e79-aa8e-d36a89adbcc9', 'options': 'recursive,force'} 2024-01-31T05:12:32.465 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.465+0000 7fb54d13b640 1 -- 172.21.15.99:0/2197572669 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5480ffc10 msgr2=0x7fb548100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:32.465 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.465+0000 7fb54d13b640 1 --2- 172.21.15.99:0/2197572669 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5480ffc10 0x7fb548100030 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fb538009900 tx=0x7fb53802bc30 comp rx=0 tx=0).stop 2024-01-31T05:12:32.465 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.466+0000 7fb54d13b640 1 -- 172.21.15.99:0/2197572669 shutdown_connections 2024-01-31T05:12:32.465 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.466+0000 7fb54d13b640 1 --2- 172.21.15.99:0/2197572669 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5481017c0 0x7fb548108050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.465 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.466+0000 7fb54d13b640 1 --2- 172.21.15.99:0/2197572669 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb548100e00 0x7fb548101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.465 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.466+0000 7fb54d13b640 1 --2- 172.21.15.99:0/2197572669 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5480ffc10 0x7fb548100030 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.465 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.466+0000 7fb54d13b640 1 -- 172.21.15.99:0/2197572669 >> 172.21.15.99:0/2197572669 conn(0x7fb5480fb180 msgr2=0x7fb5480fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:32.465 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.466+0000 7fb54d13b640 1 -- 172.21.15.99:0/2197572669 shutdown_connections 2024-01-31T05:12:32.465 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.466+0000 7fb54d13b640 1 -- 172.21.15.99:0/2197572669 wait complete. 2024-01-31T05:12:32.468 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.467+0000 7fb54d13b640 1 Processor -- start 2024-01-31T05:12:32.468 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.467+0000 7fb54d13b640 1 -- start start 2024-01-31T05:12:32.468 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.467+0000 7fb54d13b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5480ffc10 0x7fb548196c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:32.468 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.467+0000 7fb54d13b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb548100e00 0x7fb5481971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:32.468 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.467+0000 7fb54d13b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5481017c0 0x7fb54819e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:32.469 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.467+0000 7fb54d13b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54819e780 con 0x7fb5480ffc10 2024-01-31T05:12:32.469 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.467+0000 7fb54d13b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54819e8f0 con 0x7fb5481017c0 2024-01-31T05:12:32.469 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.467+0000 7fb54d13b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54819eab0 con 0x7fb548100e00 2024-01-31T05:12:32.469 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.467+0000 7fb546d9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5480ffc10 0x7fb548196c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:32.469 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.467+0000 7fb546d9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5480ffc10 0x7fb548196c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33874/0 (socket says 172.21.15.99:33874) 2024-01-31T05:12:32.469 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.467+0000 7fb546d9d640 1 -- 172.21.15.99:0/2733025733 learned_addr learned my addr 172.21.15.99:0/2733025733 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:32.469 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.467+0000 7fb53ffff640 1 --2- 172.21.15.99:0/2733025733 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb548100e00 0x7fb5481971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:32.469 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.468+0000 7fb54759e640 1 --2- 172.21.15.99:0/2733025733 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5481017c0 0x7fb54819e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:32.469 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.468+0000 7fb53ffff640 1 -- 172.21.15.99:0/2733025733 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5481017c0 msgr2=0x7fb54819e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:32.469 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.468+0000 7fb53ffff640 1 --2- 172.21.15.99:0/2733025733 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5481017c0 0x7fb54819e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.469 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.468+0000 7fb53ffff640 1 -- 172.21.15.99:0/2733025733 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5480ffc10 msgr2=0x7fb548196c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:32.469 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.468+0000 7fb53ffff640 1 --2- 172.21.15.99:0/2733025733 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5480ffc10 0x7fb548196c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.469 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.468+0000 7fb53ffff640 1 -- 172.21.15.99:0/2733025733 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb538009560 con 0x7fb548100e00 2024-01-31T05:12:32.469 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.468+0000 7fb54759e640 1 --2- 172.21.15.99:0/2733025733 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5481017c0 0x7fb54819e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:12:32.470 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.468+0000 7fb546d9d640 1 --2- 172.21.15.99:0/2733025733 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5480ffc10 0x7fb548196c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:12:32.470 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.468+0000 7fb53ffff640 1 --2- 172.21.15.99:0/2733025733 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb548100e00 0x7fb5481971b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb53000d6d0 tx=0x7fb53000db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:32.470 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.468+0000 7fb544d99640 1 -- 172.21.15.99:0/2733025733 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb530005220 con 0x7fb548100e00 2024-01-31T05:12:32.470 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.468+0000 7fb544d99640 1 -- 172.21.15.99:0/2733025733 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb530009ce0 con 0x7fb548100e00 2024-01-31T05:12:32.470 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.468+0000 7fb544d99640 1 -- 172.21.15.99:0/2733025733 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb530005220 con 0x7fb548100e00 2024-01-31T05:12:32.470 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.468+0000 7fb54d13b640 1 -- 172.21.15.99:0/2733025733 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb54819ed90 con 0x7fb548100e00 2024-01-31T05:12:32.470 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.468+0000 7fb54d13b640 1 -- 172.21.15.99:0/2733025733 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb54819f2c0 con 0x7fb548100e00 2024-01-31T05:12:32.471 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.471+0000 7fb544d99640 1 -- 172.21.15.99:0/2733025733 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 19) v1 ==== 135946+0+0 (secure 0 0 0) 0x7fb530005380 con 0x7fb548100e00 2024-01-31T05:12:32.471 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.472+0000 7fb54ffd8740 1 Processor -- start 2024-01-31T05:12:32.471 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.472+0000 7fb54ffd8740 1 -- start start 2024-01-31T05:12:32.473 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.472+0000 7fb54ffd8740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d286fbd270 0x55d286fbd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:32.473 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.472+0000 7fb54ffd8740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d286fbdc60 0x55d286fc2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:32.473 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.472+0000 7fb54ffd8740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d286fc2dd0 0x55d286fc5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:32.473 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.472+0000 7fb54ffd8740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d286f2d040 con 0x55d286fbdc60 2024-01-31T05:12:32.473 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.472+0000 7fb54ffd8740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d286f2a730 con 0x55d286fc2dd0 2024-01-31T05:12:32.473 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.472+0000 7fb54ffd8740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d286f26020 con 0x55d286fbd270 2024-01-31T05:12:32.473 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.472+0000 7fb544d99640 1 --2- 172.21.15.99:0/2733025733 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb5340a1470 0x7fb5340a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:32.473 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.472+0000 7fb546d9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d286fbdc60 0x55d286fc2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:32.473 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.472+0000 7fb546d9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d286fbdc60 0x55d286fc2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33884/0 (socket says 172.21.15.99:33884) 2024-01-31T05:12:32.473 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.473+0000 7fb546d9d640 1 -- 172.21.15.99:0/3358531965 learned_addr learned my addr 172.21.15.99:0/3358531965 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:32.473 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.473+0000 7fb544d99640 1 -- 172.21.15.99:0/2733025733 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fb5300cc4a0 con 0x7fb548100e00 2024-01-31T05:12:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.473+0000 7fb54759e640 1 --2- 172.21.15.99:0/2733025733 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb5340a1470 0x7fb5340a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.473+0000 7fb546d9d640 1 -- 172.21.15.99:0/3358531965 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d286fbd270 msgr2=0x55d286fbd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.473+0000 7fb546d9d640 1 --2- 172.21.15.99:0/3358531965 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d286fbd270 0x55d286fbd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.473+0000 7fb546d9d640 1 -- 172.21.15.99:0/3358531965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d286fc2dd0 msgr2=0x55d286fc5260 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-01-31T05:12:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.473+0000 7fb53ffff640 1 --2- 172.21.15.99:0/3358531965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d286fc2dd0 0x55d286fc5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.473+0000 7fb546d9d640 1 --2- 172.21.15.99:0/3358531965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d286fc2dd0 0x55d286fc5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.473+0000 7fb546d9d640 1 -- 172.21.15.99:0/3358531965 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d286f1de40 con 0x55d286fbdc60 2024-01-31T05:12:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.473+0000 7fb546d9d640 1 --2- 172.21.15.99:0/3358531965 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d286fbdc60 0x55d286fc2760 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fb538036040 tx=0x7fb538004dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58fa142b309d78f1 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.473+0000 7fb54759e640 1 --2- 172.21.15.99:0/2733025733 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb5340a1470 0x7fb5340a3930 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb540009fd0 tx=0x7fb5400094d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.474+0000 7fb53d7fa640 1 -- 172.21.15.99:0/3358531965 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb538043070 con 0x55d286fbdc60 2024-01-31T05:12:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.474+0000 7fb53d7fa640 1 -- 172.21.15.99:0/3358531965 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb538004040 con 0x55d286fbdc60 2024-01-31T05:12:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.474+0000 7fb53d7fa640 1 -- 172.21.15.99:0/3358531965 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb538005490 con 0x55d286fbdc60 2024-01-31T05:12:32.479 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.475+0000 7fb54ffd8740 1 -- 172.21.15.99:0/3358531965 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d286fbdc60 msgr2=0x55d286fc2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:32.479 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.475+0000 7fb54ffd8740 1 --2- 172.21.15.99:0/3358531965 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d286fbdc60 0x55d286fc2760 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fb538036040 tx=0x7fb538004dd0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.480 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.475+0000 7fb54ffd8740 1 -- 172.21.15.99:0/3358531965 shutdown_connections 2024-01-31T05:12:32.480 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.475+0000 7fb54ffd8740 1 --2- 172.21.15.99:0/3358531965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d286fc2dd0 0x55d286fc5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.480 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.475+0000 7fb54ffd8740 1 --2- 172.21.15.99:0/3358531965 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d286fbdc60 0x55d286fc2760 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.480 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.475+0000 7fb54ffd8740 1 --2- 172.21.15.99:0/3358531965 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d286fbd270 0x55d286fbd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.480 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.475+0000 7fb54ffd8740 1 -- 172.21.15.99:0/3358531965 >> 172.21.15.99:0/3358531965 conn(0x55d286fb87e0 msgr2=0x55d286fb8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:32.480 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.475+0000 7fb54ffd8740 1 -- 172.21.15.99:0/3358531965 shutdown_connections 2024-01-31T05:12:32.480 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.475+0000 7fb54ffd8740 1 -- 172.21.15.99:0/3358531965 wait complete. 2024-01-31T05:12:32.480 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.475+0000 7fb54ffd8740 1 -- start start 2024-01-31T05:12:32.480 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.475+0000 7fb54ffd8740 1 Processor -- start 2024-01-31T05:12:32.480 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.476+0000 7fb54ffd8740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d286fbd270 0x55d286fc7160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:32.480 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.476+0000 7fb54ffd8740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d286fbdc60 0x55d286fc76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:32.480 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.476+0000 7fb54ffd8740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d286fc2dd0 0x55d286fce6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:32.480 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.476+0000 7fb54ffd8740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d286edf1b0 con 0x55d286fc2dd0 2024-01-31T05:12:32.481 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.476+0000 7fb54ffd8740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d286edee50 con 0x55d286fbd270 2024-01-31T05:12:32.481 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.476+0000 7fb54ffd8740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d286ea4090 con 0x55d286fbdc60 2024-01-31T05:12:32.481 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.476+0000 7fb54ffd8740 10 client.0 _ll_register_callbacks cb 0x55d286ec9a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:12:32.481 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.476+0000 7fb54759e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d286fc2dd0 0x55d286fce6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:32.481 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.476+0000 7fb54759e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d286fc2dd0 0x55d286fce6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33894/0 (socket says 172.21.15.99:33894) 2024-01-31T05:12:32.481 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.476+0000 7fb54759e640 1 -- 172.21.15.99:0/2158075938 learned_addr learned my addr 172.21.15.99:0/2158075938 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:32.481 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.476+0000 7fb53ffff640 1 --2- 172.21.15.99:0/2158075938 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d286fbdc60 0x55d286fc76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:32.481 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.476+0000 7fb54759e640 1 -- 172.21.15.99:0/2158075938 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d286fbdc60 msgr2=0x55d286fc76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:32.481 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.476+0000 7fb546d9d640 1 --2- 172.21.15.99:0/2158075938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d286fbd270 0x55d286fc7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:32.481 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.476+0000 7fb54759e640 1 --2- 172.21.15.99:0/2158075938 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d286fbdc60 0x55d286fc76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.481 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.476+0000 7fb54759e640 1 -- 172.21.15.99:0/2158075938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d286fbd270 msgr2=0x55d286fc7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:32.481 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.476+0000 7fb54759e640 1 --2- 172.21.15.99:0/2158075938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d286fbd270 0x55d286fc7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.481 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.476+0000 7fb54759e640 1 -- 172.21.15.99:0/2158075938 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb548108950 con 0x55d286fc2dd0 2024-01-31T05:12:32.481 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.476+0000 7fb546d9d640 1 --2- 172.21.15.99:0/2158075938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d286fbd270 0x55d286fc7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:12:32.481 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.476+0000 7fb53ffff640 1 --2- 172.21.15.99:0/2158075938 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d286fbdc60 0x55d286fc76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:12:32.482 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.477+0000 7fb54759e640 1 --2- 172.21.15.99:0/2158075938 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d286fc2dd0 0x55d286fce6e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fb54000c960 tx=0x7fb540008220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=583ed719aa3fe9e server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:32.482 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.477+0000 7fb52e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:12:32.482 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.477+0000 7fb52e7fc640 1 -- 172.21.15.99:0/2158075938 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb540018c80 con 0x55d286fc2dd0 2024-01-31T05:12:32.482 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.477+0000 7fb52e7fc640 1 -- 172.21.15.99:0/2158075938 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fb540018de0 con 0x55d286fc2dd0 2024-01-31T05:12:32.482 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.477+0000 7fb54ffd8740 1 -- 172.21.15.99:0/2158075938 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d286f1f010 con 0x55d286fc2dd0 2024-01-31T05:12:32.482 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.477+0000 7fb52e7fc640 1 -- 172.21.15.99:0/2158075938 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb54001a450 con 0x55d286fc2dd0 2024-01-31T05:12:32.482 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.477+0000 7fb54ffd8740 10 client.15855 fetch_fsmap learned FSMap version 27 2024-01-31T05:12:32.482 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.477+0000 7fb54ffd8740 1 -- 172.21.15.99:0/2158075938 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55d286f246a0 con 0x55d286fc2dd0 2024-01-31T05:12:32.482 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.478+0000 7fb52e7fc640 1 -- 172.21.15.99:0/2158075938 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb54001aa70 con 0x55d286fc2dd0 2024-01-31T05:12:32.482 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.478+0000 7fb52e7fc640 1 -- 172.21.15.99:0/2158075938 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb54002f7f0 con 0x55d286fc2dd0 2024-01-31T05:12:32.482 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.478+0000 7fb54ffd8740 10 client.15855 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:12:32.482 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.478+0000 7fb54ffd8740 10 client.15855 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-01-31T05:12:32.482 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.478+0000 7fb54ffd8740 20 client.15855 populate_metadata read hostname 'smithi099' 2024-01-31T05:12:32.482 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.478+0000 7fb54ffd8740 1 --2- 172.21.15.99:0/2158075938 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55d286fd30c0 0x55d286fd5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:32.483 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.478+0000 7fb54ffd8740 4 client.15855 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:12:32.483 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.478+0000 7fb54ffd8740 1 -- 172.21.15.99:0/2158075938 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d286f1f010 con 0x55d286fd30c0 2024-01-31T05:12:32.483 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.478+0000 7fb546d9d640 1 --2- 172.21.15.99:0/2158075938 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55d286fd30c0 0x55d286fd5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:32.483 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.478+0000 7fb546d9d640 1 --2- 172.21.15.99:0/2158075938 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55d286fd30c0 0x55d286fd5580 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f14b695c56ba93e2 server_cookie=16150885a5711f64 in_seq=0 out_seq=0 2024-01-31T05:12:32.483 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.478+0000 7fb52e7fc640 10 client.15855 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:12:32.483 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.479+0000 7fb52e7fc640 1 -- 172.21.15.99:0/2158075938 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d286f1f010 con 0x55d286fd30c0 2024-01-31T05:12:32.483 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.479+0000 7fb52e7fc640 10 client.15855 handle_command_reply: tid=0 2024-01-31T05:12:32.483 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.479+0000 7fb54ffd8740 1 client.15855 shutdown 2024-01-31T05:12:32.483 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.479+0000 7fb54ffd8740 1 -- 172.21.15.99:0/2158075938 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d286fc2dd0 msgr2=0x55d286fce6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:32.483 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.479+0000 7fb54ffd8740 1 --2- 172.21.15.99:0/2158075938 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d286fc2dd0 0x55d286fce6e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fb54000c960 tx=0x7fb540008220 comp rx=0 tx=0).stop 2024-01-31T05:12:32.483 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.480+0000 7fb54ffd8740 1 -- 172.21.15.99:0/2158075938 shutdown_connections 2024-01-31T05:12:32.483 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.480+0000 7fb54ffd8740 1 --2- 172.21.15.99:0/2158075938 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d286fc2dd0 0x55d286fce6e0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.483 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.480+0000 7fb54ffd8740 1 --2- 172.21.15.99:0/2158075938 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d286fbdc60 0x55d286fc76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.483 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.480+0000 7fb54ffd8740 1 --2- 172.21.15.99:0/2158075938 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55d286fd30c0 0x55d286fd5580 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.484 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.480+0000 7fb54ffd8740 1 --2- 172.21.15.99:0/2158075938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d286fbd270 0x55d286fc7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.484 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.480+0000 7fb54ffd8740 1 -- 172.21.15.99:0/2158075938 >> 172.21.15.99:0/2158075938 conn(0x55d286fb87e0 msgr2=0x55d286fb7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:32.484 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.480+0000 7fb52e7fc640 0 client.15855 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:12:32.484 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.480+0000 7fb54ffd8740 1 -- 172.21.15.99:0/2158075938 shutdown_connections 2024-01-31T05:12:32.484 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.480+0000 7fb54ffd8740 1 -- 172.21.15.99:0/2158075938 wait complete. 2024-01-31T05:12:32.484 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.480+0000 7fb54ffd8740 20 client.15855 trim_cache size 0 max 16384 2024-01-31T05:12:32.506 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.505+0000 7fb54ffd8740 1 Processor -- start 2024-01-31T05:12:32.506 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.505+0000 7fb54ffd8740 1 -- start start 2024-01-31T05:12:32.506 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.506+0000 7fb54ffd8740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d286fbd270 0x55d286fc7160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:32.506 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.506+0000 7fb54ffd8740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d286fbdc60 0x55d286fc76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:32.506 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.506+0000 7fb54ffd8740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d286fc2dd0 0x55d286fce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.506+0000 7fb54ffd8740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d286fbd650 con 0x55d286fbdc60 2024-01-31T05:12:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.506+0000 7fb54ffd8740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d286f1f010 con 0x55d286fc2dd0 2024-01-31T05:12:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.506+0000 7fb54ffd8740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d286fc62a0 con 0x55d286fbd270 2024-01-31T05:12:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.506+0000 7fb53ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d286fbdc60 0x55d286fc76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.506+0000 7fb53ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d286fbdc60 0x55d286fc76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33898/0 (socket says 172.21.15.99:33898) 2024-01-31T05:12:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.506+0000 7fb53ffff640 1 -- 172.21.15.99:0/4027313610 learned_addr learned my addr 172.21.15.99:0/4027313610 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.506+0000 7fb54759e640 1 --2- 172.21.15.99:0/4027313610 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d286fc2dd0 0x55d286fce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.506+0000 7fb546d9d640 1 --2- 172.21.15.99:0/4027313610 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d286fbd270 0x55d286fc7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.507+0000 7fb53ffff640 1 -- 172.21.15.99:0/4027313610 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d286fbd270 msgr2=0x55d286fc7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.507+0000 7fb53ffff640 1 --2- 172.21.15.99:0/4027313610 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d286fbd270 0x55d286fc7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.507+0000 7fb53ffff640 1 -- 172.21.15.99:0/4027313610 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d286fc2dd0 msgr2=0x55d286fce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.507+0000 7fb53ffff640 1 --2- 172.21.15.99:0/4027313610 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d286fc2dd0 0x55d286fce6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.507+0000 7fb53ffff640 1 -- 172.21.15.99:0/4027313610 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d286ec1030 con 0x55d286fbdc60 2024-01-31T05:12:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.507+0000 7fb546d9d640 1 --2- 172.21.15.99:0/4027313610 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d286fbd270 0x55d286fc7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:12:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.507+0000 7fb53ffff640 1 --2- 172.21.15.99:0/4027313610 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d286fbdc60 0x55d286fc76a0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fb5300992a0 tx=0x7fb530005730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7713e75a9b25f20c server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:32.508 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.507+0000 7fb53cff9640 1 -- 172.21.15.99:0/4027313610 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5300cc2c0 con 0x55d286fbdc60 2024-01-31T05:12:32.508 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.507+0000 7fb53cff9640 1 -- 172.21.15.99:0/4027313610 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb5300995a0 con 0x55d286fbdc60 2024-01-31T05:12:32.508 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.507+0000 7fb53cff9640 1 -- 172.21.15.99:0/4027313610 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb530098cf0 con 0x55d286fbdc60 2024-01-31T05:12:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.508+0000 7fb54ffd8740 1 -- 172.21.15.99:0/4027313610 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d286fbdc60 msgr2=0x55d286fc76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.508+0000 7fb54ffd8740 1 --2- 172.21.15.99:0/4027313610 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d286fbdc60 0x55d286fc76a0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fb5300992a0 tx=0x7fb530005730 comp rx=0 tx=0).stop 2024-01-31T05:12:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.508+0000 7fb54ffd8740 1 -- 172.21.15.99:0/4027313610 shutdown_connections 2024-01-31T05:12:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.508+0000 7fb54ffd8740 1 --2- 172.21.15.99:0/4027313610 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d286fc2dd0 0x55d286fce6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.508+0000 7fb54ffd8740 1 --2- 172.21.15.99:0/4027313610 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d286fbdc60 0x55d286fc76a0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.508+0000 7fb54ffd8740 1 --2- 172.21.15.99:0/4027313610 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d286fbd270 0x55d286fc7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.508+0000 7fb54ffd8740 1 -- 172.21.15.99:0/4027313610 >> 172.21.15.99:0/4027313610 conn(0x55d286fb87e0 msgr2=0x55d286fb8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.508+0000 7fb54ffd8740 1 -- 172.21.15.99:0/4027313610 shutdown_connections 2024-01-31T05:12:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.508+0000 7fb54ffd8740 1 -- 172.21.15.99:0/4027313610 wait complete. 2024-01-31T05:12:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.509+0000 7fb54ffd8740 1 -- start start 2024-01-31T05:12:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.509+0000 7fb54ffd8740 1 Processor -- start 2024-01-31T05:12:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.509+0000 7fb54ffd8740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d286fbd270 0x55d286fce290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.509+0000 7fb54ffd8740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d286fbdc60 0x55d286fcc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.509+0000 7fb54ffd8740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d286fc2dd0 0x55d286fccde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.509+0000 7fb54ffd8740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d286fcea80 con 0x55d286fc2dd0 2024-01-31T05:12:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.509+0000 7fb54ffd8740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d286fcd350 con 0x55d286fbdc60 2024-01-31T05:12:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.509+0000 7fb54ffd8740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d286fcd510 con 0x55d286fbd270 2024-01-31T05:12:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.509+0000 7fb54ffd8740 10 client.0 _ll_register_callbacks cb 0x7fb53802cc30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:12:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.509+0000 7fb54759e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d286fc2dd0 0x55d286fccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.509+0000 7fb54759e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d286fc2dd0 0x55d286fccde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33912/0 (socket says 172.21.15.99:33912) 2024-01-31T05:12:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.509+0000 7fb54759e640 1 -- 172.21.15.99:0/2906150421 learned_addr learned my addr 172.21.15.99:0/2906150421 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.509+0000 7fb53ffff640 1 --2- 172.21.15.99:0/2906150421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d286fbdc60 0x55d286fcc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.509+0000 7fb546d9d640 1 --2- 172.21.15.99:0/2906150421 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d286fbd270 0x55d286fce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.510+0000 7fb54759e640 1 -- 172.21.15.99:0/2906150421 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d286fbd270 msgr2=0x55d286fce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.510+0000 7fb54759e640 1 --2- 172.21.15.99:0/2906150421 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d286fbd270 0x55d286fce290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.510+0000 7fb54759e640 1 -- 172.21.15.99:0/2906150421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d286fbdc60 msgr2=0x55d286fcc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.510+0000 7fb54759e640 1 --2- 172.21.15.99:0/2906150421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d286fbdc60 0x55d286fcc8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.510+0000 7fb54759e640 1 -- 172.21.15.99:0/2906150421 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb54819f2c0 con 0x55d286fc2dd0 2024-01-31T05:12:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.510+0000 7fb53ffff640 1 --2- 172.21.15.99:0/2906150421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d286fbdc60 0x55d286fcc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:12:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.510+0000 7fb54759e640 1 --2- 172.21.15.99:0/2906150421 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d286fc2dd0 0x55d286fccde0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fb5400093e0 tx=0x7fb54000ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d1430d9bcd71317 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.510+0000 7fb52e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:12:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.510+0000 7fb52e7fc640 1 -- 172.21.15.99:0/2906150421 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54000c560 con 0x55d286fc2dd0 2024-01-31T05:12:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.510+0000 7fb52e7fc640 1 -- 172.21.15.99:0/2906150421 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fb54002f640 con 0x55d286fc2dd0 2024-01-31T05:12:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.510+0000 7fb54ffd8740 1 -- 172.21.15.99:0/2906150421 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb538004040 con 0x55d286fc2dd0 2024-01-31T05:12:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.511+0000 7fb52e7fc640 1 -- 172.21.15.99:0/2906150421 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb54002f800 con 0x55d286fc2dd0 2024-01-31T05:12:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.511+0000 7fb54ffd8740 10 client.15861 fetch_fsmap learned FSMap version 27 2024-01-31T05:12:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.511+0000 7fb54ffd8740 1 -- 172.21.15.99:0/2906150421 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55d286ee6a50 con 0x55d286fc2dd0 2024-01-31T05:12:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.511+0000 7fb52e7fc640 1 -- 172.21.15.99:0/2906150421 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb538004040 con 0x55d286fc2dd0 2024-01-31T05:12:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.511+0000 7fb52e7fc640 1 -- 172.21.15.99:0/2906150421 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb54001a450 con 0x55d286fc2dd0 2024-01-31T05:12:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.511+0000 7fb54ffd8740 10 client.15861 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:12:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.511+0000 7fb54ffd8740 10 client.15861 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-01-31T05:12:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.511+0000 7fb54ffd8740 20 client.15861 populate_metadata read hostname 'smithi099' 2024-01-31T05:12:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.511+0000 7fb54ffd8740 1 --2- 172.21.15.99:0/2906150421 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55d28702ad70 0x55d28702d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.511+0000 7fb54ffd8740 4 client.15861 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-01-31T05:12:32.515 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.511+0000 7fb54ffd8740 1 -- 172.21.15.99:0/2906150421 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d286f1ed30 con 0x55d28702ad70 2024-01-31T05:12:32.515 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.511+0000 7fb546d9d640 1 --2- 172.21.15.99:0/2906150421 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55d28702ad70 0x55d28702d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:32.515 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.512+0000 7fb52e7fc640 10 client.15861 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:12:32.515 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.512+0000 7fb546d9d640 1 --2- 172.21.15.99:0/2906150421 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55d28702ad70 0x55d28702d190 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fc9338f258dc56d server_cookie=4207b7dc095203ec in_seq=0 out_seq=0 2024-01-31T05:12:32.516 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.516+0000 7fb52e7fc640 1 -- 172.21.15.99:0/2906150421 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d286f1ed30 con 0x55d28702ad70 2024-01-31T05:12:32.517 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.516+0000 7fb52e7fc640 10 client.15861 handle_command_reply: tid=0 2024-01-31T05:12:32.517 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.516+0000 7fb54ffd8740 1 client.15861 shutdown 2024-01-31T05:12:32.517 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.516+0000 7fb54ffd8740 1 -- 172.21.15.99:0/2906150421 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d286fc2dd0 msgr2=0x55d286fccde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:32.517 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.516+0000 7fb54ffd8740 1 --2- 172.21.15.99:0/2906150421 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d286fc2dd0 0x55d286fccde0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fb5400093e0 tx=0x7fb54000ed50 comp rx=0 tx=0).stop 2024-01-31T05:12:32.517 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.516+0000 7fb54ffd8740 1 -- 172.21.15.99:0/2906150421 shutdown_connections 2024-01-31T05:12:32.517 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.516+0000 7fb54ffd8740 1 --2- 172.21.15.99:0/2906150421 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d286fc2dd0 0x55d286fccde0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.517 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.516+0000 7fb54ffd8740 1 --2- 172.21.15.99:0/2906150421 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55d28702ad70 0x55d28702d190 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.517 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.516+0000 7fb54ffd8740 1 --2- 172.21.15.99:0/2906150421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d286fbdc60 0x55d286fcc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.517 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.516+0000 7fb52e7fc640 0 client.15861 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:12:32.517 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.516+0000 7fb54ffd8740 1 --2- 172.21.15.99:0/2906150421 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d286fbd270 0x55d286fce290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.517 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.516+0000 7fb54ffd8740 1 -- 172.21.15.99:0/2906150421 >> 172.21.15.99:0/2906150421 conn(0x55d286fb87e0 msgr2=0x55d286fbeea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:32.517 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.517+0000 7fb54ffd8740 1 -- 172.21.15.99:0/2906150421 shutdown_connections 2024-01-31T05:12:32.517 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.517+0000 7fb54ffd8740 1 -- 172.21.15.99:0/2906150421 wait complete. 2024-01-31T05:12:32.518 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.517+0000 7fb54ffd8740 20 client.15861 trim_cache size 0 max 16384 2024-01-31T05:12:32.518 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout:{ 2024-01-31T05:12:32.518 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout: "message": "", 2024-01-31T05:12:32.518 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout: "return_code": 0 2024-01-31T05:12:32.518 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout:} 2024-01-31T05:12:32.519 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.517+0000 7fb54d13b640 1 -- 172.21.15.99:0/2733025733 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb5340a1470 msgr2=0x7fb5340a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:32.519 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.517+0000 7fb54d13b640 1 --2- 172.21.15.99:0/2733025733 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb5340a1470 0x7fb5340a3930 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb540009fd0 tx=0x7fb5400094d0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.519 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.517+0000 7fb54d13b640 1 -- 172.21.15.99:0/2733025733 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb548100e00 msgr2=0x7fb5481971b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:32.519 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.517+0000 7fb54d13b640 1 --2- 172.21.15.99:0/2733025733 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb548100e00 0x7fb5481971b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb53000d6d0 tx=0x7fb53000db90 comp rx=0 tx=0).stop 2024-01-31T05:12:32.519 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.518+0000 7fb54d13b640 1 -- 172.21.15.99:0/2733025733 shutdown_connections 2024-01-31T05:12:32.519 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.518+0000 7fb54d13b640 1 --2- 172.21.15.99:0/2733025733 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb5340a1470 0x7fb5340a3930 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.519 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.518+0000 7fb54d13b640 1 --2- 172.21.15.99:0/2733025733 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5481017c0 0x7fb54819e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.519 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.518+0000 7fb54d13b640 1 --2- 172.21.15.99:0/2733025733 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb548100e00 0x7fb5481971b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.519 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.518+0000 7fb54d13b640 1 --2- 172.21.15.99:0/2733025733 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5480ffc10 0x7fb548196c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:32.520 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.518+0000 7fb54d13b640 1 -- 172.21.15.99:0/2733025733 >> 172.21.15.99:0/2733025733 conn(0x7fb5480fb180 msgr2=0x7fb548104220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:32.520 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.518+0000 7fb54d13b640 1 -- 172.21.15.99:0/2733025733 shutdown_connections 2024-01-31T05:12:32.520 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:32.518+0000 7fb54d13b640 1 -- 172.21.15.99:0/2733025733 wait complete. 2024-01-31T05:12:33.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:33 smithi099 ceph-mon[31615]: scrub queued for path: / 2024-01-31T05:12:33.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:33 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:12:33.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:33 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:12:33.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:33 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:12:33.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:33 smithi099 ceph-mon[31615]: pgmap v384: 97 pgs: 97 active+clean; 670 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-01-31T05:12:33.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:33 smithi181 ceph-mon[36434]: scrub queued for path: / 2024-01-31T05:12:33.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:33 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:12:33.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:33 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:12:33.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:33 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:12:33.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:33 smithi181 ceph-mon[36434]: pgmap v384: 97 pgs: 97 active+clean; 670 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-01-31T05:12:33.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:33 smithi179 ceph-mon[35652]: scrub queued for path: / 2024-01-31T05:12:33.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:33 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:12:33.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:33 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:12:33.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:33 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:12:33.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:33 smithi179 ceph-mon[35652]: pgmap v384: 97 pgs: 97 active+clean; 670 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-01-31T05:12:36.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:35 smithi099 ceph-mon[31615]: pgmap v385: 97 pgs: 97 active+clean; 671 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 511 B/s wr, 11 op/s 2024-01-31T05:12:36.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:35 smithi181 ceph-mon[36434]: pgmap v385: 97 pgs: 97 active+clean; 671 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 511 B/s wr, 11 op/s 2024-01-31T05:12:36.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:35 smithi179 ceph-mon[35652]: pgmap v385: 97 pgs: 97 active+clean; 671 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 511 B/s wr, 11 op/s 2024-01-31T05:12:37.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:36 smithi099 ceph-mon[31615]: scrub summary: idle 2024-01-31T05:12:37.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:36 smithi181 ceph-mon[36434]: scrub summary: idle 2024-01-31T05:12:37.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:36 smithi179 ceph-mon[35652]: scrub summary: idle 2024-01-31T05:12:38.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:37 smithi099 ceph-mon[31615]: pgmap v386: 97 pgs: 97 active+clean; 671 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-01-31T05:12:38.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:37 smithi181 ceph-mon[36434]: pgmap v386: 97 pgs: 97 active+clean; 671 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-01-31T05:12:38.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:37 smithi179 ceph-mon[35652]: pgmap v386: 97 pgs: 97 active+clean; 671 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-01-31T05:12:40.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:39 smithi099 ceph-mon[31615]: pgmap v387: 97 pgs: 97 active+clean; 671 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 255 B/s wr, 13 op/s 2024-01-31T05:12:40.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:39 smithi181 ceph-mon[36434]: pgmap v387: 97 pgs: 97 active+clean; 671 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 255 B/s wr, 13 op/s 2024-01-31T05:12:40.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:39 smithi179 ceph-mon[35652]: pgmap v387: 97 pgs: 97 active+clean; 671 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 255 B/s wr, 13 op/s 2024-01-31T05:12:42.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:41 smithi099 ceph-mon[31615]: pgmap v388: 97 pgs: 97 active+clean; 671 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 255 B/s wr, 9 op/s 2024-01-31T05:12:42.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:41 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:12:42.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:41 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:12:42.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:41 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:12:42.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:41 smithi181 ceph-mon[36434]: pgmap v388: 97 pgs: 97 active+clean; 671 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 255 B/s wr, 9 op/s 2024-01-31T05:12:42.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:41 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:12:42.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:41 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:12:42.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:41 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:12:42.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:41 smithi179 ceph-mon[35652]: pgmap v388: 97 pgs: 97 active+clean; 671 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 255 B/s wr, 9 op/s 2024-01-31T05:12:42.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:41 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:12:42.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:41 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:12:42.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:41 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:12:43.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:43 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:12:43.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:43 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:12:43.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:43 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:12:43.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:43 smithi099 ceph-mon[31615]: pgmap v389: 97 pgs: 97 active+clean; 671 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 11 op/s 2024-01-31T05:12:43.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:43 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:12:43.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:43 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:12:43.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:43 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:12:43.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:43 smithi181 ceph-mon[36434]: pgmap v389: 97 pgs: 97 active+clean; 671 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 11 op/s 2024-01-31T05:12:43.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:43 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:12:43.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:43 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:12:43.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:43 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:12:43.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:43 smithi179 ceph-mon[35652]: pgmap v389: 97 pgs: 97 active+clean; 671 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 11 op/s 2024-01-31T05:12:43.874 INFO:tasks.workunit.client.0.smithi099.stderr:Note: switching to '661946e7044723130c03627323f6a879a9848cb5'. 2024-01-31T05:12:43.874 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-01-31T05:12:43.874 INFO:tasks.workunit.client.0.smithi099.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-01-31T05:12:43.874 INFO:tasks.workunit.client.0.smithi099.stderr:changes and commit them, and you can discard any commits you make in this 2024-01-31T05:12:43.874 INFO:tasks.workunit.client.0.smithi099.stderr:state without impacting any branches by switching back to a branch. 2024-01-31T05:12:43.874 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-01-31T05:12:43.874 INFO:tasks.workunit.client.0.smithi099.stderr:If you want to create a new branch to retain commits you create, you may 2024-01-31T05:12:43.874 INFO:tasks.workunit.client.0.smithi099.stderr:do so (now or later) by using -c with the switch command. Example: 2024-01-31T05:12:43.874 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-01-31T05:12:43.874 INFO:tasks.workunit.client.0.smithi099.stderr: git switch -c 2024-01-31T05:12:43.874 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-01-31T05:12:43.874 INFO:tasks.workunit.client.0.smithi099.stderr:Or undo this operation with: 2024-01-31T05:12:43.875 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-01-31T05:12:43.875 INFO:tasks.workunit.client.0.smithi099.stderr: git switch - 2024-01-31T05:12:43.875 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-01-31T05:12:43.875 INFO:tasks.workunit.client.0.smithi099.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-01-31T05:12:43.875 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-01-31T05:12:43.875 INFO:tasks.workunit.client.0.smithi099.stderr:HEAD is now at 661946e7044 Merge PR #53901 into wip-vshankar-testing-20240125.044502 2024-01-31T05:12:43.876 DEBUG:teuthology.orchestra.run.smithi099:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-01-31T05:12:43.936 INFO:tasks.workunit.client.0.smithi099.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-01-31T05:12:43.938 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-01-31T05:12:43.938 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-01-31T05:12:44.722 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-01-31T05:12:44.795 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-01-31T05:12:44.834 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-01-31T05:12:44.836 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-01-31T05:12:44.836 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-01-31T05:12:44.875 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-01-31T05:12:44.878 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-31T05:12:44.878 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-01-31T05:12:44.933 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-01-31T05:12:44.934 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-01-31T05:12:44.935 DEBUG:teuthology.orchestra.run.smithi099:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=661946e7044723130c03627323f6a879a9848cb5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-01-31T05:12:44.994 INFO:tasks.workunit.client.0.smithi099.stderr:+ mkdir -p fsstress 2024-01-31T05:12:44.996 INFO:tasks.workunit.client.0.smithi099.stderr:+ pushd fsstress 2024-01-31T05:12:44.997 INFO:tasks.workunit.client.0.smithi099.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-01-31T05:12:44.997 INFO:tasks.workunit.client.0.smithi099.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-01-31T05:12:45.610 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.607+0000 7f002a7fb640 1 -- 172.21.15.99:0/1732821215 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0024104120 msgr2=0x7f0024106510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:45.610 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.607+0000 7f002a7fb640 1 --2- 172.21.15.99:0/1732821215 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0024104120 0x7f0024106510 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f0018009900 tx=0x7f001802bc30 comp rx=0 tx=0).stop 2024-01-31T05:12:45.610 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.607+0000 7f002a7fb640 1 -- 172.21.15.99:0/1732821215 shutdown_connections 2024-01-31T05:12:45.610 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.607+0000 7f002a7fb640 1 --2- 172.21.15.99:0/1732821215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0024106a50 0x7f0024108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:45.610 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.607+0000 7f002a7fb640 1 --2- 172.21.15.99:0/1732821215 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0024104120 0x7f0024106510 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:45.610 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.607+0000 7f002a7fb640 1 --2- 172.21.15.99:0/1732821215 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00241017f0 0x7f0024103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:45.610 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.607+0000 7f002a7fb640 1 -- 172.21.15.99:0/1732821215 >> 172.21.15.99:0/1732821215 conn(0x7f00240fb180 msgr2=0x7f00240fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:45.610 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.607+0000 7f002a7fb640 1 -- 172.21.15.99:0/1732821215 shutdown_connections 2024-01-31T05:12:45.610 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.607+0000 7f002a7fb640 1 -- 172.21.15.99:0/1732821215 wait complete. 2024-01-31T05:12:45.610 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.608+0000 7f002a7fb640 1 Processor -- start 2024-01-31T05:12:45.610 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.608+0000 7f002a7fb640 1 -- start start 2024-01-31T05:12:45.611 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.608+0000 7f002a7fb640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00241017f0 0x7f0024196c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:45.611 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.608+0000 7f002a7fb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0024104120 0x7f00241971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:45.611 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.608+0000 7f002a7fb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0024106a50 0x7f002419e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:45.611 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.608+0000 7f002a7fb640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f002419e750 con 0x7f0024106a50 2024-01-31T05:12:45.611 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.608+0000 7f002a7fb640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f002419e8c0 con 0x7f00241017f0 2024-01-31T05:12:45.611 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.608+0000 7f002a7fb640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f002419ea80 con 0x7f0024104120 2024-01-31T05:12:45.611 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.608+0000 7f0028d98640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0024106a50 0x7f002419e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:45.611 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.608+0000 7f0028d98640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0024106a50 0x7f002419e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48138/0 (socket says 172.21.15.99:48138) 2024-01-31T05:12:45.611 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.608+0000 7f0028d98640 1 -- 172.21.15.99:0/2479925722 learned_addr learned my addr 172.21.15.99:0/2479925722 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:45.611 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.608+0000 7f0023fff640 1 --2- 172.21.15.99:0/2479925722 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00241017f0 0x7f0024196c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:45.611 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.608+0000 7f00237fe640 1 --2- 172.21.15.99:0/2479925722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0024104120 0x7f00241971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:45.611 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.608+0000 7f0028d98640 1 -- 172.21.15.99:0/2479925722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0024104120 msgr2=0x7f00241971b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:45.611 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.608+0000 7f0028d98640 1 --2- 172.21.15.99:0/2479925722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0024104120 0x7f00241971b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:45.611 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.608+0000 7f0028d98640 1 -- 172.21.15.99:0/2479925722 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00241017f0 msgr2=0x7f0024196c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:45.611 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.608+0000 7f0028d98640 1 --2- 172.21.15.99:0/2479925722 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00241017f0 0x7f0024196c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:45.612 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.608+0000 7f0028d98640 1 -- 172.21.15.99:0/2479925722 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0018009560 con 0x7f0024106a50 2024-01-31T05:12:45.612 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.608+0000 7f0028d98640 1 --2- 172.21.15.99:0/2479925722 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0024106a50 0x7f002419e1e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f001c00eaa0 tx=0x7f001c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:45.612 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.609+0000 7f00217fa640 1 -- 172.21.15.99:0/2479925722 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001c00cdb0 con 0x7f0024106a50 2024-01-31T05:12:45.612 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.609+0000 7f00217fa640 1 -- 172.21.15.99:0/2479925722 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f001c005020 con 0x7f0024106a50 2024-01-31T05:12:45.612 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.609+0000 7f00217fa640 1 -- 172.21.15.99:0/2479925722 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001c0116d0 con 0x7f0024106a50 2024-01-31T05:12:45.612 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.609+0000 7f002a7fb640 1 -- 172.21.15.99:0/2479925722 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f002419ed60 con 0x7f0024106a50 2024-01-31T05:12:45.612 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.609+0000 7f002a7fb640 1 -- 172.21.15.99:0/2479925722 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f002419f1c0 con 0x7f0024106a50 2024-01-31T05:12:45.618 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.611+0000 7f00217fa640 1 -- 172.21.15.99:0/2479925722 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f001c005190 con 0x7f0024106a50 2024-01-31T05:12:45.618 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.612+0000 7f002d5c4740 1 Processor -- start 2024-01-31T05:12:45.619 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.612+0000 7f002d5c4740 1 -- start start 2024-01-31T05:12:45.619 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.612+0000 7f002d5c4740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5610b1511270 0x5610b1511690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:45.619 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.612+0000 7f002d5c4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610b1511c60 0x5610b1516760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:45.619 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.612+0000 7f002d5c4740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5610b1516dd0 0x5610b1519260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:45.619 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.612+0000 7f002d5c4740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610b1481040 con 0x5610b1511270 2024-01-31T05:12:45.619 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.612+0000 7f002d5c4740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610b147e730 con 0x5610b1516dd0 2024-01-31T05:12:45.619 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.612+0000 7f002d5c4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610b147a020 con 0x5610b1511c60 2024-01-31T05:12:45.619 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.612+0000 7f00237fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5610b1511270 0x5610b1511690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:45.619 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.612+0000 7f00217fa640 1 --2- 172.21.15.99:0/2479925722 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f000c0a14a0 0x7f000c0a3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:45.619 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.612+0000 7f00237fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5610b1511270 0x5610b1511690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48142/0 (socket says 172.21.15.99:48142) 2024-01-31T05:12:45.619 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.612+0000 7f00237fe640 1 -- 172.21.15.99:0/1499318252 learned_addr learned my addr 172.21.15.99:0/1499318252 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:45.619 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.612+0000 7f0023fff640 1 --2- 172.21.15.99:0/1499318252 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610b1511c60 0x5610b1516760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:45.619 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.612+0000 7f00237fe640 1 --2- 172.21.15.99:0/1499318252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5610b1516dd0 0x5610b1519260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:45.620 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.612+0000 7f00217fa640 1 -- 172.21.15.99:0/2479925722 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f001c0cced0 con 0x7f0024106a50 2024-01-31T05:12:45.620 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.612+0000 7f0028d98640 1 --2- 172.21.15.99:0/2479925722 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f000c0a14a0 0x7f000c0a3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:45.620 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.612+0000 7f00237fe640 1 -- 172.21.15.99:0/1499318252 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610b1511c60 msgr2=0x5610b1516760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:45.620 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.612+0000 7f00237fe640 1 --2- 172.21.15.99:0/1499318252 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610b1511c60 0x5610b1516760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:45.620 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.612+0000 7f00237fe640 1 -- 172.21.15.99:0/1499318252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5610b1516dd0 msgr2=0x5610b1519260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:45.620 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.612+0000 7f00237fe640 1 --2- 172.21.15.99:0/1499318252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5610b1516dd0 0x5610b1519260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:45.620 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.612+0000 7f00237fe640 1 -- 172.21.15.99:0/1499318252 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610b1471e40 con 0x5610b1511270 2024-01-31T05:12:45.620 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.612+0000 7f00237fe640 1 --2- 172.21.15.99:0/1499318252 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5610b1511270 0x5610b1511690 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f001802c7e0 tx=0x7f00180058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1cdee1f2663651f server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:45.620 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.613+0000 7f000a7fc640 1 -- 172.21.15.99:0/1499318252 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00180048c0 con 0x5610b1511270 2024-01-31T05:12:45.620 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.613+0000 7f0028d98640 1 --2- 172.21.15.99:0/2479925722 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f000c0a14a0 0x7f000c0a3960 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f001c0ca9d0 tx=0x7f001c0057e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:45.620 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.613+0000 7f000a7fc640 1 -- 172.21.15.99:0/1499318252 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f001802cc30 con 0x5610b1511270 2024-01-31T05:12:45.620 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.613+0000 7f000a7fc640 1 -- 172.21.15.99:0/1499318252 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00180035f0 con 0x5610b1511270 2024-01-31T05:12:45.620 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.613+0000 7f002d5c4740 1 -- 172.21.15.99:0/1499318252 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5610b1511270 msgr2=0x5610b1511690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:45.620 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.613+0000 7f002d5c4740 1 --2- 172.21.15.99:0/1499318252 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5610b1511270 0x5610b1511690 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f001802c7e0 tx=0x7f00180058d0 comp rx=0 tx=0).stop 2024-01-31T05:12:45.621 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.613+0000 7f002d5c4740 1 -- 172.21.15.99:0/1499318252 shutdown_connections 2024-01-31T05:12:45.621 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.613+0000 7f002d5c4740 1 --2- 172.21.15.99:0/1499318252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5610b1516dd0 0x5610b1519260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:45.621 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.613+0000 7f002d5c4740 1 --2- 172.21.15.99:0/1499318252 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610b1511c60 0x5610b1516760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:45.621 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.613+0000 7f002d5c4740 1 --2- 172.21.15.99:0/1499318252 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5610b1511270 0x5610b1511690 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:45.621 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.613+0000 7f002d5c4740 1 -- 172.21.15.99:0/1499318252 >> 172.21.15.99:0/1499318252 conn(0x5610b150c7e0 msgr2=0x5610b150cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:45.621 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.613+0000 7f002d5c4740 1 -- 172.21.15.99:0/1499318252 shutdown_connections 2024-01-31T05:12:45.621 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.613+0000 7f002d5c4740 1 -- 172.21.15.99:0/1499318252 wait complete. 2024-01-31T05:12:45.621 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.614+0000 7f002d5c4740 1 -- start start 2024-01-31T05:12:45.621 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.614+0000 7f002d5c4740 1 Processor -- start 2024-01-31T05:12:45.621 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.614+0000 7f002d5c4740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5610b1511270 0x5610b151b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:45.621 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.614+0000 7f002d5c4740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5610b1511c60 0x5610b151b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:45.621 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.614+0000 7f002d5c4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610b1516dd0 0x5610b15227a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:45.621 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.614+0000 7f002d5c4740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610b14331b0 con 0x5610b1511270 2024-01-31T05:12:45.621 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.614+0000 7f002d5c4740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610b1432e50 con 0x5610b1511c60 2024-01-31T05:12:45.622 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.614+0000 7f002d5c4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610b13f8090 con 0x5610b1516dd0 2024-01-31T05:12:45.622 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.614+0000 7f002d5c4740 10 client.0 _ll_register_callbacks cb 0x5610b141da90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:12:45.622 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.614+0000 7f00237fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5610b1511270 0x5610b151b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:45.622 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.614+0000 7f00237fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5610b1511270 0x5610b151b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48156/0 (socket says 172.21.15.99:48156) 2024-01-31T05:12:45.622 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.614+0000 7f00237fe640 1 -- 172.21.15.99:0/685693259 learned_addr learned my addr 172.21.15.99:0/685693259 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:45.622 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.614+0000 7f0023fff640 1 --2- 172.21.15.99:0/685693259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5610b1511c60 0x5610b151b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:45.622 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.614+0000 7f00237fe640 1 -- 172.21.15.99:0/685693259 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610b1516dd0 msgr2=0x5610b15227a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:45.622 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.614+0000 7f00237fe640 1 --2- 172.21.15.99:0/685693259 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610b1516dd0 0x5610b15227a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:45.622 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.614+0000 7f00237fe640 1 -- 172.21.15.99:0/685693259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5610b1511c60 msgr2=0x5610b151b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:45.622 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.614+0000 7f00237fe640 1 --2- 172.21.15.99:0/685693259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5610b1511c60 0x5610b151b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:45.622 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.614+0000 7f00237fe640 1 -- 172.21.15.99:0/685693259 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0024109a20 con 0x5610b1511270 2024-01-31T05:12:45.622 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.615+0000 7f00237fe640 1 --2- 172.21.15.99:0/685693259 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5610b1511270 0x5610b151b220 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f001802c170 tx=0x7f0018005230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51eb8fa3b899cc09 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:45.622 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.615+0000 7f00037fe640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:12:45.622 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.615+0000 7f00037fe640 1 -- 172.21.15.99:0/685693259 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0018048070 con 0x5610b1511270 2024-01-31T05:12:45.623 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.615+0000 7f00037fe640 1 -- 172.21.15.99:0/685693259 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f001802ce40 con 0x5610b1511270 2024-01-31T05:12:45.623 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.615+0000 7f002d5c4740 1 -- 172.21.15.99:0/685693259 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5610b1473010 con 0x5610b1511270 2024-01-31T05:12:45.623 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.615+0000 7f00037fe640 1 -- 172.21.15.99:0/685693259 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0018004950 con 0x5610b1511270 2024-01-31T05:12:45.623 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.615+0000 7f002d5c4740 10 client.15873 fetch_fsmap learned FSMap version 27 2024-01-31T05:12:45.623 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.615+0000 7f002d5c4740 1 -- 172.21.15.99:0/685693259 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5610b14786a0 con 0x5610b1511270 2024-01-31T05:12:45.623 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.615+0000 7f00037fe640 1 -- 172.21.15.99:0/685693259 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5610b1473010 con 0x5610b1511270 2024-01-31T05:12:45.623 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.615+0000 7f00037fe640 1 -- 172.21.15.99:0/685693259 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0018034440 con 0x5610b1511270 2024-01-31T05:12:45.623 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.615+0000 7f002d5c4740 10 client.15873 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:12:45.623 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.615+0000 7f002d5c4740 10 client.15873 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-01-31T05:12:45.623 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.615+0000 7f002d5c4740 20 client.15873 populate_metadata read hostname 'smithi099' 2024-01-31T05:12:45.623 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.615+0000 7f002d5c4740 1 --2- 172.21.15.99:0/685693259 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5610b1526d80 0x5610b1529170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:45.623 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.615+0000 7f002d5c4740 4 client.15873 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:12:45.623 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.615+0000 7f002d5c4740 1 -- 172.21.15.99:0/685693259 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5610b1472d30 con 0x5610b1526d80 2024-01-31T05:12:45.623 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.616+0000 7f0023fff640 1 --2- 172.21.15.99:0/685693259 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5610b1526d80 0x5610b1529170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:45.623 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.616+0000 7f00037fe640 10 client.15873 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:12:45.624 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.616+0000 7f0023fff640 1 --2- 172.21.15.99:0/685693259 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5610b1526d80 0x5610b1529170 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1457f7cce569429 server_cookie=9aa8d479198b8bc in_seq=0 out_seq=0 2024-01-31T05:12:45.624 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.616+0000 7f00037fe640 1 -- 172.21.15.99:0/685693259 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5610b1472d30 con 0x5610b1526d80 2024-01-31T05:12:45.624 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.616+0000 7f00037fe640 10 client.15873 handle_command_reply: tid=0 2024-01-31T05:12:45.624 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.617+0000 7f002d5c4740 1 client.15873 shutdown 2024-01-31T05:12:45.624 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.617+0000 7f002d5c4740 1 -- 172.21.15.99:0/685693259 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5610b1511270 msgr2=0x5610b151b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:45.624 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.617+0000 7f002d5c4740 1 --2- 172.21.15.99:0/685693259 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5610b1511270 0x5610b151b220 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f001802c170 tx=0x7f0018005230 comp rx=0 tx=0).stop 2024-01-31T05:12:45.624 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.617+0000 7f002d5c4740 1 -- 172.21.15.99:0/685693259 shutdown_connections 2024-01-31T05:12:45.624 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.617+0000 7f002d5c4740 1 --2- 172.21.15.99:0/685693259 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610b1516dd0 0x5610b15227a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:45.624 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.617+0000 7f002d5c4740 1 --2- 172.21.15.99:0/685693259 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5610b1526d80 0x5610b1529170 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:45.624 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.617+0000 7f002d5c4740 1 --2- 172.21.15.99:0/685693259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5610b1511c60 0x5610b151b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:45.624 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.617+0000 7f002d5c4740 1 --2- 172.21.15.99:0/685693259 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5610b1511270 0x5610b151b220 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:45.624 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.617+0000 7f002d5c4740 1 -- 172.21.15.99:0/685693259 >> 172.21.15.99:0/685693259 conn(0x5610b150c7e0 msgr2=0x5610b150ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:45.624 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.617+0000 7f00037fe640 0 client.15873 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:12:45.624 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.617+0000 7f002d5c4740 1 -- 172.21.15.99:0/685693259 shutdown_connections 2024-01-31T05:12:45.625 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.617+0000 7f002d5c4740 1 -- 172.21.15.99:0/685693259 wait complete. 2024-01-31T05:12:45.625 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.617+0000 7f002d5c4740 20 client.15873 trim_cache size 0 max 16384 2024-01-31T05:12:45.635 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.630+0000 7f002d5c4740 1 Processor -- start 2024-01-31T05:12:45.636 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.630+0000 7f002d5c4740 1 -- start start 2024-01-31T05:12:45.636 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.630+0000 7f002d5c4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610b1511270 0x5610b151ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:45.636 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.630+0000 7f002d5c4740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5610b1511c60 0x5610b1522730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:45.636 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.630+0000 7f002d5c4740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5610b1516dd0 0x5610b151b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:45.636 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.630+0000 7f002d5c4740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610b1472d60 con 0x5610b1511c60 2024-01-31T05:12:45.636 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.630+0000 7f002d5c4740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610b1473040 con 0x5610b1516dd0 2024-01-31T05:12:45.636 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.630+0000 7f002d5c4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610b151c260 con 0x5610b1511270 2024-01-31T05:12:45.636 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.630+0000 7f0023fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5610b1511c60 0x5610b1522730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:45.636 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.630+0000 7f0023fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5610b1511c60 0x5610b1522730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48170/0 (socket says 172.21.15.99:48170) 2024-01-31T05:12:45.636 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.630+0000 7f0023fff640 1 -- 172.21.15.99:0/1827155788 learned_addr learned my addr 172.21.15.99:0/1827155788 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:45.636 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.630+0000 7f0023fff640 1 -- 172.21.15.99:0/1827155788 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610b1511270 msgr2=0x5610b151ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:45.636 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.630+0000 7f0023fff640 1 --2- 172.21.15.99:0/1827155788 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610b1511270 0x5610b151ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:45.636 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.630+0000 7f0023fff640 1 -- 172.21.15.99:0/1827155788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5610b1516dd0 msgr2=0x5610b151b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:45.637 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.630+0000 7f00237fe640 1 --2- 172.21.15.99:0/1827155788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5610b1516dd0 0x5610b151b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:45.637 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.630+0000 7f0023fff640 1 --2- 172.21.15.99:0/1827155788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5610b1516dd0 0x5610b151b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:45.637 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.630+0000 7f0023fff640 1 -- 172.21.15.99:0/1827155788 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610b1415030 con 0x5610b1511c60 2024-01-31T05:12:45.637 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.631+0000 7f0023fff640 1 --2- 172.21.15.99:0/1827155788 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5610b1511c60 0x5610b1522730 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f00140058c0 tx=0x7f001400e3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f12cf0cf363b525b server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:45.637 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.631+0000 7f0009ffb640 1 -- 172.21.15.99:0/1827155788 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0014017070 con 0x5610b1511c60 2024-01-31T05:12:45.637 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.631+0000 7f0009ffb640 1 -- 172.21.15.99:0/1827155788 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0014018040 con 0x5610b1511c60 2024-01-31T05:12:45.637 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.631+0000 7f0009ffb640 1 -- 172.21.15.99:0/1827155788 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0014004730 con 0x5610b1511c60 2024-01-31T05:12:45.637 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.631+0000 7f002d5c4740 1 -- 172.21.15.99:0/1827155788 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5610b1511c60 msgr2=0x5610b1522730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:45.637 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.631+0000 7f002d5c4740 1 --2- 172.21.15.99:0/1827155788 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5610b1511c60 0x5610b1522730 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f00140058c0 tx=0x7f001400e3b0 comp rx=0 tx=0).stop 2024-01-31T05:12:45.637 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.631+0000 7f002d5c4740 1 -- 172.21.15.99:0/1827155788 shutdown_connections 2024-01-31T05:12:45.637 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.631+0000 7f002d5c4740 1 --2- 172.21.15.99:0/1827155788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5610b1516dd0 0x5610b151b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:45.637 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.631+0000 7f002d5c4740 1 --2- 172.21.15.99:0/1827155788 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5610b1511c60 0x5610b1522730 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:45.637 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.631+0000 7f002d5c4740 1 --2- 172.21.15.99:0/1827155788 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610b1511270 0x5610b151ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:45.637 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.631+0000 7f002d5c4740 1 -- 172.21.15.99:0/1827155788 >> 172.21.15.99:0/1827155788 conn(0x5610b150c7e0 msgr2=0x5610b1512f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:45.638 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.631+0000 7f002d5c4740 1 -- 172.21.15.99:0/1827155788 shutdown_connections 2024-01-31T05:12:45.638 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.631+0000 7f002d5c4740 1 -- 172.21.15.99:0/1827155788 wait complete. 2024-01-31T05:12:45.638 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.632+0000 7f002d5c4740 1 -- start start 2024-01-31T05:12:45.638 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.632+0000 7f002d5c4740 1 Processor -- start 2024-01-31T05:12:45.638 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.632+0000 7f002d5c4740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5610b1511270 0x5610b1579690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:45.638 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.632+0000 7f002d5c4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610b1511c60 0x5610b1579bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:45.638 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.632+0000 7f002d5c4740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5610b1516dd0 0x5610b1580ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:45.638 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.632+0000 7f002d5c4740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610b15810e0 con 0x5610b1516dd0 2024-01-31T05:12:45.638 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.632+0000 7f002d5c4740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610b1581220 con 0x5610b1511270 2024-01-31T05:12:45.638 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.632+0000 7f002d5c4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610b1581390 con 0x5610b1511c60 2024-01-31T05:12:45.638 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.632+0000 7f002d5c4740 10 client.0 _ll_register_callbacks cb 0x7f0018009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:12:45.638 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.632+0000 7f00237fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5610b1516dd0 0x5610b1580ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:45.638 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.632+0000 7f00237fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5610b1516dd0 0x5610b1580ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48172/0 (socket says 172.21.15.99:48172) 2024-01-31T05:12:45.638 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.632+0000 7f00237fe640 1 -- 172.21.15.99:0/1343130463 learned_addr learned my addr 172.21.15.99:0/1343130463 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:45.638 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.632+0000 7f00237fe640 1 --2- 172.21.15.99:0/1343130463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5610b1511270 0x5610b1579690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.632+0000 7f0023fff640 1 --2- 172.21.15.99:0/1343130463 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610b1511c60 0x5610b1579bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.633+0000 7f00237fe640 1 -- 172.21.15.99:0/1343130463 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610b1511c60 msgr2=0x5610b1579bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.633+0000 7f00237fe640 1 --2- 172.21.15.99:0/1343130463 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610b1511c60 0x5610b1579bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.633+0000 7f00237fe640 1 -- 172.21.15.99:0/1343130463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5610b1511270 msgr2=0x5610b1579690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.633+0000 7f00237fe640 1 --2- 172.21.15.99:0/1343130463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5610b1511270 0x5610b1579690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.633+0000 7f00237fe640 1 -- 172.21.15.99:0/1343130463 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f001400e8d0 con 0x5610b1516dd0 2024-01-31T05:12:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.633+0000 7f00237fe640 1 --2- 172.21.15.99:0/1343130463 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5610b1516dd0 0x5610b1580ba0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f0018004fd0 tx=0x7f001802c5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f02c50b41a1e73a server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.633+0000 7f00037fe640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:12:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.633+0000 7f00037fe640 1 -- 172.21.15.99:0/1343130463 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0018048040 con 0x5610b1516dd0 2024-01-31T05:12:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.633+0000 7f002d5c4740 1 -- 172.21.15.99:0/1343130463 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f001802cc30 con 0x5610b1516dd0 2024-01-31T05:12:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.633+0000 7f00037fe640 1 -- 172.21.15.99:0/1343130463 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f0018000e40 con 0x5610b1516dd0 2024-01-31T05:12:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.633+0000 7f00037fe640 1 -- 172.21.15.99:0/1343130463 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00180054a0 con 0x5610b1516dd0 2024-01-31T05:12:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.633+0000 7f002d5c4740 10 client.15879 fetch_fsmap learned FSMap version 27 2024-01-31T05:12:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.633+0000 7f002d5c4740 1 -- 172.21.15.99:0/1343130463 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5610b143aa50 con 0x5610b1516dd0 2024-01-31T05:12:45.640 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.633+0000 7f00037fe640 1 -- 172.21.15.99:0/1343130463 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f001802cc30 con 0x5610b1516dd0 2024-01-31T05:12:45.640 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.633+0000 7f00037fe640 1 -- 172.21.15.99:0/1343130463 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f001805a440 con 0x5610b1516dd0 2024-01-31T05:12:45.640 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.633+0000 7f002d5c4740 10 client.15879 fetch_fsmap finished waiting for FSMap version 27 2024-01-31T05:12:45.640 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.633+0000 7f002d5c4740 10 client.15879 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-01-31T05:12:45.640 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.633+0000 7f002d5c4740 20 client.15879 populate_metadata read hostname 'smithi099' 2024-01-31T05:12:45.640 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.633+0000 7f002d5c4740 1 --2- 172.21.15.99:0/1343130463 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5610b1582a00 0x5610b1584e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:45.640 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.633+0000 7f002d5c4740 4 client.15879 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-01-31T05:12:45.640 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.633+0000 7f002d5c4740 1 -- 172.21.15.99:0/1343130463 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5610b1179600 con 0x5610b1582a00 2024-01-31T05:12:45.640 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.634+0000 7f0023fff640 1 --2- 172.21.15.99:0/1343130463 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5610b1582a00 0x5610b1584e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:45.640 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.634+0000 7f0023fff640 1 --2- 172.21.15.99:0/1343130463 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5610b1582a00 0x5610b1584e20 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24244050ff64b2c9 server_cookie=4e43eadee0d35857 in_seq=0 out_seq=0 2024-01-31T05:12:45.640 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.634+0000 7f00037fe640 10 client.15879 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:12:45.646 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.645+0000 7f00037fe640 1 -- 172.21.15.99:0/1343130463 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5610b1179600 con 0x5610b1582a00 2024-01-31T05:12:45.646 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.645+0000 7f00037fe640 10 client.15879 handle_command_reply: tid=0 2024-01-31T05:12:45.646 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.645+0000 7f002d5c4740 1 client.15879 shutdown 2024-01-31T05:12:45.646 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.645+0000 7f002d5c4740 1 -- 172.21.15.99:0/1343130463 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5610b1516dd0 msgr2=0x5610b1580ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:45.646 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.645+0000 7f002d5c4740 1 --2- 172.21.15.99:0/1343130463 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5610b1516dd0 0x5610b1580ba0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f0018004fd0 tx=0x7f001802c5d0 comp rx=0 tx=0).stop 2024-01-31T05:12:45.646 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.645+0000 7f002d5c4740 1 -- 172.21.15.99:0/1343130463 shutdown_connections 2024-01-31T05:12:45.646 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.645+0000 7f002d5c4740 1 --2- 172.21.15.99:0/1343130463 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5610b1516dd0 0x5610b1580ba0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:45.646 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.645+0000 7f002d5c4740 1 --2- 172.21.15.99:0/1343130463 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610b1511c60 0x5610b1579bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:45.646 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.645+0000 7f002d5c4740 1 --2- 172.21.15.99:0/1343130463 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5610b1582a00 0x5610b1584e20 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:45.646 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.645+0000 7f002d5c4740 1 --2- 172.21.15.99:0/1343130463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5610b1511270 0x5610b1579690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:45.646 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.645+0000 7f00037fe640 0 client.15879 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:12:45.646 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.645+0000 7f002d5c4740 1 -- 172.21.15.99:0/1343130463 >> 172.21.15.99:0/1343130463 conn(0x5610b150c7e0 msgr2=0x5610b1512f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:45.646 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.645+0000 7f002d5c4740 1 -- 172.21.15.99:0/1343130463 shutdown_connections 2024-01-31T05:12:45.647 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.645+0000 7f002d5c4740 1 -- 172.21.15.99:0/1343130463 wait complete. 2024-01-31T05:12:45.647 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.645+0000 7f002d5c4740 20 client.15879 trim_cache size 0 max 16384 2024-01-31T05:12:45.647 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout:{ 2024-01-31T05:12:45.647 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout: "message": "", 2024-01-31T05:12:45.647 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout: "return_code": 0 2024-01-31T05:12:45.647 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout:} 2024-01-31T05:12:45.648 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.646+0000 7f002a7fb640 1 -- 172.21.15.99:0/2479925722 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f000c0a14a0 msgr2=0x7f000c0a3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:45.648 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.646+0000 7f002a7fb640 1 --2- 172.21.15.99:0/2479925722 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f000c0a14a0 0x7f000c0a3960 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f001c0ca9d0 tx=0x7f001c0057e0 comp rx=0 tx=0).stop 2024-01-31T05:12:45.648 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.646+0000 7f002a7fb640 1 -- 172.21.15.99:0/2479925722 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0024106a50 msgr2=0x7f002419e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:45.648 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.646+0000 7f002a7fb640 1 --2- 172.21.15.99:0/2479925722 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0024106a50 0x7f002419e1e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f001c00eaa0 tx=0x7f001c00ef60 comp rx=0 tx=0).stop 2024-01-31T05:12:45.648 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.646+0000 7f002a7fb640 1 -- 172.21.15.99:0/2479925722 shutdown_connections 2024-01-31T05:12:45.648 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.646+0000 7f002a7fb640 1 --2- 172.21.15.99:0/2479925722 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f000c0a14a0 0x7f000c0a3960 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:45.648 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.646+0000 7f002a7fb640 1 --2- 172.21.15.99:0/2479925722 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0024106a50 0x7f002419e1e0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:45.648 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.646+0000 7f002a7fb640 1 --2- 172.21.15.99:0/2479925722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0024104120 0x7f00241971b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:45.649 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.646+0000 7f002a7fb640 1 --2- 172.21.15.99:0/2479925722 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00241017f0 0x7f0024196c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:45.649 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.646+0000 7f002a7fb640 1 -- 172.21.15.99:0/2479925722 >> 172.21.15.99:0/2479925722 conn(0x7f00240fb180 msgr2=0x7f00241023f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:45.649 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.646+0000 7f002a7fb640 1 -- 172.21.15.99:0/2479925722 shutdown_connections 2024-01-31T05:12:45.649 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:45.646+0000 7f002a7fb640 1 -- 172.21.15.99:0/2479925722 wait complete. 2024-01-31T05:12:45.695 INFO:tasks.workunit.client.0.smithi099.stderr:+ tar xzf ltp-full.tgz 2024-01-31T05:12:46.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:45 smithi099 ceph-mon[31615]: pgmap v390: 97 pgs: 97 active+clean; 671 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 255 B/s wr, 11 op/s 2024-01-31T05:12:46.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:45 smithi181 ceph-mon[36434]: pgmap v390: 97 pgs: 97 active+clean; 671 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 255 B/s wr, 11 op/s 2024-01-31T05:12:46.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:45 smithi179 ceph-mon[35652]: pgmap v390: 97 pgs: 97 active+clean; 671 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 255 B/s wr, 11 op/s 2024-01-31T05:12:48.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:47 smithi099 ceph-mon[31615]: pgmap v391: 97 pgs: 97 active+clean; 671 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 3.1 KiB/s wr, 11 op/s 2024-01-31T05:12:48.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:47 smithi181 ceph-mon[36434]: pgmap v391: 97 pgs: 97 active+clean; 671 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 3.1 KiB/s wr, 11 op/s 2024-01-31T05:12:48.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:47 smithi179 ceph-mon[35652]: pgmap v391: 97 pgs: 97 active+clean; 671 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 3.1 KiB/s wr, 11 op/s 2024-01-31T05:12:50.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:49 smithi099 ceph-mon[31615]: pgmap v392: 97 pgs: 97 active+clean; 4.6 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 338 KiB/s wr, 16 op/s 2024-01-31T05:12:50.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:49 smithi181 ceph-mon[36434]: pgmap v392: 97 pgs: 97 active+clean; 4.6 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 338 KiB/s wr, 16 op/s 2024-01-31T05:12:50.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:49 smithi179 ceph-mon[35652]: pgmap v392: 97 pgs: 97 active+clean; 4.6 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 338 KiB/s wr, 16 op/s 2024-01-31T05:12:52.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:51 smithi099 ceph-mon[31615]: pgmap v393: 97 pgs: 97 active+clean; 4.6 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 338 KiB/s wr, 12 op/s 2024-01-31T05:12:52.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:51 smithi181 ceph-mon[36434]: pgmap v393: 97 pgs: 97 active+clean; 4.6 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 338 KiB/s wr, 12 op/s 2024-01-31T05:12:52.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:51 smithi179 ceph-mon[35652]: pgmap v393: 97 pgs: 97 active+clean; 4.6 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 338 KiB/s wr, 12 op/s 2024-01-31T05:12:53.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:52 smithi099 ceph-mon[31615]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:12:53.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:52 smithi181 ceph-mon[36434]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:12:53.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:52 smithi179 ceph-mon[35652]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:12:54.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:53 smithi099 ceph-mon[31615]: pgmap v394: 97 pgs: 97 active+clean; 43 MiB data, 505 MiB used, 1.0 TiB / 1.0 TiB avail; 880 KiB/s rd, 3.8 MiB/s wr, 371 op/s 2024-01-31T05:12:54.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:53 smithi099 ceph-mon[31615]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-01-31T05:12:54.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:53 smithi181 ceph-mon[36434]: pgmap v394: 97 pgs: 97 active+clean; 43 MiB data, 505 MiB used, 1.0 TiB / 1.0 TiB avail; 880 KiB/s rd, 3.8 MiB/s wr, 371 op/s 2024-01-31T05:12:54.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:53 smithi181 ceph-mon[36434]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-01-31T05:12:54.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:53 smithi179 ceph-mon[35652]: pgmap v394: 97 pgs: 97 active+clean; 43 MiB data, 505 MiB used, 1.0 TiB / 1.0 TiB avail; 880 KiB/s rd, 3.8 MiB/s wr, 371 op/s 2024-01-31T05:12:54.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:53 smithi179 ceph-mon[35652]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-01-31T05:12:56.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:55 smithi099 ceph-mon[31615]: pgmap v395: 97 pgs: 97 active+clean; 51 MiB data, 549 MiB used, 1.0 TiB / 1.0 TiB avail; 880 KiB/s rd, 4.5 MiB/s wr, 462 op/s 2024-01-31T05:12:56.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:55 smithi181 ceph-mon[36434]: pgmap v395: 97 pgs: 97 active+clean; 51 MiB data, 549 MiB used, 1.0 TiB / 1.0 TiB avail; 880 KiB/s rd, 4.5 MiB/s wr, 462 op/s 2024-01-31T05:12:56.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:55 smithi179 ceph-mon[35652]: pgmap v395: 97 pgs: 97 active+clean; 51 MiB data, 549 MiB used, 1.0 TiB / 1.0 TiB avail; 880 KiB/s rd, 4.5 MiB/s wr, 462 op/s 2024-01-31T05:12:58.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:57 smithi099 ceph-mon[31615]: pgmap v396: 97 pgs: 97 active+clean; 59 MiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.2 MiB/s wr, 476 op/s 2024-01-31T05:12:58.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:57 smithi181 ceph-mon[36434]: pgmap v396: 97 pgs: 97 active+clean; 59 MiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.2 MiB/s wr, 476 op/s 2024-01-31T05:12:58.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:57 smithi179 ceph-mon[35652]: pgmap v396: 97 pgs: 97 active+clean; 59 MiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.2 MiB/s wr, 476 op/s 2024-01-31T05:12:58.734 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.732+0000 7f56d5a78640 1 -- 172.21.15.99:0/1208258101 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56d01005b0 msgr2=0x7f56d0100a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:58.734 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.732+0000 7f56d5a78640 1 --2- 172.21.15.99:0/1208258101 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56d01005b0 0x7f56d0100a30 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f56c4009900 tx=0x7f56c402bc30 comp rx=0 tx=0).stop 2024-01-31T05:12:58.735 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.733+0000 7f56d5a78640 1 -- 172.21.15.99:0/1208258101 shutdown_connections 2024-01-31T05:12:58.735 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.733+0000 7f56d5a78640 1 --2- 172.21.15.99:0/1208258101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56d0100f70 0x7f56d0107800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:58.735 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.733+0000 7f56d5a78640 1 --2- 172.21.15.99:0/1208258101 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56d01005b0 0x7f56d0100a30 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:58.735 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.733+0000 7f56d5a78640 1 --2- 172.21.15.99:0/1208258101 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56d00ff3c0 0x7f56d00ff7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:58.735 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.733+0000 7f56d5a78640 1 -- 172.21.15.99:0/1208258101 >> 172.21.15.99:0/1208258101 conn(0x7f56d00fa910 msgr2=0x7f56d00fcd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:58.735 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.733+0000 7f56d5a78640 1 -- 172.21.15.99:0/1208258101 shutdown_connections 2024-01-31T05:12:58.735 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.733+0000 7f56d5a78640 1 -- 172.21.15.99:0/1208258101 wait complete. 2024-01-31T05:12:58.735 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.733+0000 7f56d5a78640 1 Processor -- start 2024-01-31T05:12:58.735 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.733+0000 7f56d5a78640 1 -- start start 2024-01-31T05:12:58.735 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.733+0000 7f56d5a78640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56d00ff3c0 0x7f56d0102310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:58.735 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.733+0000 7f56d5a78640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56d01005b0 0x7f56d019ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:58.735 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.733+0000 7f56d5a78640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56d0100f70 0x7f56d019dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:58.735 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.733+0000 7f56d5a78640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d019e780 con 0x7f56d01005b0 2024-01-31T05:12:58.735 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.733+0000 7f56d5a78640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d019e8f0 con 0x7f56d0100f70 2024-01-31T05:12:58.736 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.733+0000 7f56d5a78640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d019eab0 con 0x7f56d00ff3c0 2024-01-31T05:12:58.736 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.734+0000 7f56ceffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56d01005b0 0x7f56d019ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:58.736 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.734+0000 7f56ceffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56d01005b0 0x7f56d019ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46928/0 (socket says 172.21.15.99:46928) 2024-01-31T05:12:58.736 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.734+0000 7f56ceffd640 1 -- 172.21.15.99:0/310978788 learned_addr learned my addr 172.21.15.99:0/310978788 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:58.736 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.734+0000 7f56cf7fe640 1 --2- 172.21.15.99:0/310978788 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56d00ff3c0 0x7f56d0102310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:58.736 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.734+0000 7f56cffff640 1 --2- 172.21.15.99:0/310978788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56d0100f70 0x7f56d019dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:58.736 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.734+0000 7f56ceffd640 1 -- 172.21.15.99:0/310978788 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56d00ff3c0 msgr2=0x7f56d0102310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:58.736 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.734+0000 7f56ceffd640 1 --2- 172.21.15.99:0/310978788 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56d00ff3c0 0x7f56d0102310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:58.736 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.734+0000 7f56ceffd640 1 -- 172.21.15.99:0/310978788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56d0100f70 msgr2=0x7f56d019dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:58.736 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.734+0000 7f56ceffd640 1 --2- 172.21.15.99:0/310978788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56d0100f70 0x7f56d019dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:58.736 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.734+0000 7f56ceffd640 1 -- 172.21.15.99:0/310978788 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c4009560 con 0x7f56d01005b0 2024-01-31T05:12:58.736 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.734+0000 7f56cffff640 1 --2- 172.21.15.99:0/310978788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56d0100f70 0x7f56d019dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:12:58.736 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.734+0000 7f56ceffd640 1 --2- 172.21.15.99:0/310978788 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56d01005b0 0x7f56d019ba00 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f56c4009230 tx=0x7f56c4004ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:58.736 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.734+0000 7f56ccff9640 1 -- 172.21.15.99:0/310978788 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c4004350 con 0x7f56d01005b0 2024-01-31T05:12:58.737 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.734+0000 7f56ccff9640 1 -- 172.21.15.99:0/310978788 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f56c40044b0 con 0x7f56d01005b0 2024-01-31T05:12:58.737 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.734+0000 7f56d5a78640 1 -- 172.21.15.99:0/310978788 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56d019ed30 con 0x7f56d01005b0 2024-01-31T05:12:58.737 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.734+0000 7f56ccff9640 1 -- 172.21.15.99:0/310978788 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c4003da0 con 0x7f56d01005b0 2024-01-31T05:12:58.737 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.734+0000 7f56d5a78640 1 -- 172.21.15.99:0/310978788 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56d019f260 con 0x7f56d01005b0 2024-01-31T05:12:58.743 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.736+0000 7f56ccff9640 1 -- 172.21.15.99:0/310978788 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 20) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f56c4005000 con 0x7f56d01005b0 2024-01-31T05:12:58.743 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.737+0000 7f56d8844740 1 Processor -- start 2024-01-31T05:12:58.743 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.737+0000 7f56d8844740 1 -- start start 2024-01-31T05:12:58.744 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.737+0000 7f56d8844740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c12e2b9270 0x55c12e2b9690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:58.744 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.737+0000 7f56d8844740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c12e2b9c60 0x55c12e2be760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:58.744 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.737+0000 7f56ccff9640 1 --2- 172.21.15.99:0/310978788 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f56b80a1380 0x7f56b80a3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:58.744 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.737+0000 7f56d8844740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c12e2bedd0 0x55c12e2c1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:58.744 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.737+0000 7f56d8844740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c12e229040 con 0x55c12e2b9c60 2024-01-31T05:12:58.744 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.737+0000 7f56d8844740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c12e226730 con 0x55c12e2bedd0 2024-01-31T05:12:58.744 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.737+0000 7f56d8844740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c12e222020 con 0x55c12e2b9270 2024-01-31T05:12:58.744 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.737+0000 7f56cf7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c12e2b9c60 0x55c12e2be760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:58.744 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.737+0000 7f56ceffd640 1 --2- 172.21.15.99:0/310978788 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f56b80a1380 0x7f56b80a3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:58.744 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.737+0000 7f56cf7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c12e2b9c60 0x55c12e2be760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46934/0 (socket says 172.21.15.99:46934) 2024-01-31T05:12:58.744 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.737+0000 7f56cf7fe640 1 -- 172.21.15.99:0/548825694 learned_addr learned my addr 172.21.15.99:0/548825694 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:58.744 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.737+0000 7f56cffff640 1 --2- 172.21.15.99:0/548825694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c12e2bedd0 0x55c12e2c1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:58.744 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.737+0000 7f56ccff9640 1 -- 172.21.15.99:0/310978788 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f56c40ef4b0 con 0x7f56d01005b0 2024-01-31T05:12:58.745 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.737+0000 7f56cffff640 1 --2- 172.21.15.99:0/548825694 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c12e2b9270 0x55c12e2b9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:58.745 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.737+0000 7f56cf7fe640 1 -- 172.21.15.99:0/548825694 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c12e2b9270 msgr2=0x55c12e2b9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:58.745 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.737+0000 7f56cf7fe640 1 --2- 172.21.15.99:0/548825694 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c12e2b9270 0x55c12e2b9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:58.745 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.737+0000 7f56cf7fe640 1 -- 172.21.15.99:0/548825694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c12e2bedd0 msgr2=0x55c12e2c1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:58.745 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.737+0000 7f56cf7fe640 1 --2- 172.21.15.99:0/548825694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c12e2bedd0 0x55c12e2c1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:58.745 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.738+0000 7f56cf7fe640 1 -- 172.21.15.99:0/548825694 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c12e219e40 con 0x55c12e2b9c60 2024-01-31T05:12:58.745 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.738+0000 7f56cffff640 1 --2- 172.21.15.99:0/548825694 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c12e2b9270 0x55c12e2b9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:12:58.745 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.738+0000 7f56ceffd640 1 --2- 172.21.15.99:0/310978788 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f56b80a1380 0x7f56b80a3840 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f56c40bc310 tx=0x7f56c4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:58.745 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.738+0000 7f56cf7fe640 1 --2- 172.21.15.99:0/548825694 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c12e2b9c60 0x55c12e2be760 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f56c0009a40 tx=0x7f56c0009f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47fe770a0679d756 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:58.745 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.738+0000 7f56b5ffb640 1 -- 172.21.15.99:0/548825694 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c0009510 con 0x55c12e2b9c60 2024-01-31T05:12:58.745 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.738+0000 7f56b5ffb640 1 -- 172.21.15.99:0/548825694 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f56c0013470 con 0x55c12e2b9c60 2024-01-31T05:12:58.745 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.738+0000 7f56b5ffb640 1 -- 172.21.15.99:0/548825694 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c0012630 con 0x55c12e2b9c60 2024-01-31T05:12:58.745 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.738+0000 7f56d8844740 1 -- 172.21.15.99:0/548825694 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c12e2b9c60 msgr2=0x55c12e2be760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:58.745 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.738+0000 7f56d8844740 1 --2- 172.21.15.99:0/548825694 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c12e2b9c60 0x55c12e2be760 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f56c0009a40 tx=0x7f56c0009f00 comp rx=0 tx=0).stop 2024-01-31T05:12:58.746 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.738+0000 7f56d8844740 1 -- 172.21.15.99:0/548825694 shutdown_connections 2024-01-31T05:12:58.746 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.738+0000 7f56d8844740 1 --2- 172.21.15.99:0/548825694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c12e2bedd0 0x55c12e2c1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:58.746 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.739+0000 7f56d8844740 1 --2- 172.21.15.99:0/548825694 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c12e2b9c60 0x55c12e2be760 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:58.746 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.739+0000 7f56d8844740 1 --2- 172.21.15.99:0/548825694 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c12e2b9270 0x55c12e2b9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:58.746 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.739+0000 7f56d8844740 1 -- 172.21.15.99:0/548825694 >> 172.21.15.99:0/548825694 conn(0x55c12e2b47e0 msgr2=0x55c12e2b4be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:58.746 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.739+0000 7f56d8844740 1 -- 172.21.15.99:0/548825694 shutdown_connections 2024-01-31T05:12:58.746 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.739+0000 7f56d8844740 1 -- 172.21.15.99:0/548825694 wait complete. 2024-01-31T05:12:58.746 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.739+0000 7f56d8844740 1 -- start start 2024-01-31T05:12:58.746 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.739+0000 7f56d8844740 1 Processor -- start 2024-01-31T05:12:58.746 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.739+0000 7f56d8844740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c12e2b9270 0x55c12e2c3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:58.746 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.739+0000 7f56d8844740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c12e2b9c60 0x55c12e2c3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:58.746 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.739+0000 7f56d8844740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c12e2bedd0 0x55c12e2ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:58.746 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.739+0000 7f56d8844740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c12e1db1b0 con 0x55c12e2b9270 2024-01-31T05:12:58.746 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.739+0000 7f56d8844740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c12e1dae50 con 0x55c12e2bedd0 2024-01-31T05:12:58.746 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.739+0000 7f56d8844740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c12e1a0090 con 0x55c12e2b9c60 2024-01-31T05:12:58.747 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.739+0000 7f56d8844740 10 client.0 _ll_register_callbacks cb 0x55c12e1c5a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:12:58.747 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.739+0000 7f56cffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c12e2b9270 0x55c12e2c3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:58.747 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.739+0000 7f56cffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c12e2b9270 0x55c12e2c3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46940/0 (socket says 172.21.15.99:46940) 2024-01-31T05:12:58.747 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.739+0000 7f56cffff640 1 -- 172.21.15.99:0/1214951989 learned_addr learned my addr 172.21.15.99:0/1214951989 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:58.747 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.740+0000 7f56cffff640 1 -- 172.21.15.99:0/1214951989 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c12e2b9c60 msgr2=0x55c12e2c3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:58.747 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.740+0000 7f56cffff640 1 --2- 172.21.15.99:0/1214951989 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c12e2b9c60 0x55c12e2c3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:58.747 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.740+0000 7f56cffff640 1 -- 172.21.15.99:0/1214951989 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c12e2bedd0 msgr2=0x55c12e2ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:58.747 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.740+0000 7f56cffff640 1 --2- 172.21.15.99:0/1214951989 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c12e2bedd0 0x55c12e2ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:58.747 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.740+0000 7f56cffff640 1 -- 172.21.15.99:0/1214951989 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56c0009670 con 0x55c12e2b9270 2024-01-31T05:12:58.747 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.740+0000 7f56cffff640 1 --2- 172.21.15.99:0/1214951989 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c12e2b9270 0x55c12e2c3130 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f56c8014a80 tx=0x7f56c8009df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27ffab0b6470cbc server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:58.747 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.740+0000 7f56aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:12:58.747 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.740+0000 7f56aeffd640 1 -- 172.21.15.99:0/1214951989 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c8012e60 con 0x55c12e2b9270 2024-01-31T05:12:58.747 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.740+0000 7f56aeffd640 1 -- 172.21.15.99:0/1214951989 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f56c8003970 con 0x55c12e2b9270 2024-01-31T05:12:58.747 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.740+0000 7f56d8844740 1 -- 172.21.15.99:0/1214951989 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c12e21b010 con 0x55c12e2b9270 2024-01-31T05:12:58.748 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.740+0000 7f56aeffd640 1 -- 172.21.15.99:0/1214951989 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f56c8003b30 con 0x55c12e2b9270 2024-01-31T05:12:58.748 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.740+0000 7f56d8844740 10 client.15891 fetch_fsmap learned FSMap version 28 2024-01-31T05:12:58.748 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.740+0000 7f56d8844740 1 -- 172.21.15.99:0/1214951989 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55c12e2206a0 con 0x55c12e2b9270 2024-01-31T05:12:58.748 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.740+0000 7f56aeffd640 1 -- 172.21.15.99:0/1214951989 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c12e21b010 con 0x55c12e2b9270 2024-01-31T05:12:58.748 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.740+0000 7f56aeffd640 1 -- 172.21.15.99:0/1214951989 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 28) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f56c801e450 con 0x55c12e2b9270 2024-01-31T05:12:58.748 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.740+0000 7f56d8844740 10 client.15891 fetch_fsmap finished waiting for FSMap version 28 2024-01-31T05:12:58.748 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.740+0000 7f56d8844740 10 client.15891 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-01-31T05:12:58.748 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.740+0000 7f56d8844740 20 client.15891 populate_metadata read hostname 'smithi099' 2024-01-31T05:12:58.748 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.740+0000 7f56d8844740 1 --2- 172.21.15.99:0/1214951989 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55c12e2cf180 0x55c12e2d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:58.748 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.740+0000 7f56d8844740 4 client.15891 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:12:58.748 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.740+0000 7f56d8844740 1 -- 172.21.15.99:0/1214951989 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c12e21ad30 con 0x55c12e2cf180 2024-01-31T05:12:58.748 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.741+0000 7f56cf7fe640 1 --2- 172.21.15.99:0/1214951989 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55c12e2cf180 0x55c12e2d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:58.748 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.741+0000 7f56aeffd640 10 client.15891 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:12:58.748 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.741+0000 7f56cf7fe640 1 --2- 172.21.15.99:0/1214951989 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55c12e2cf180 0x55c12e2d15a0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15f92df65c8cc4f2 server_cookie=d63700fb116a25c6 in_seq=0 out_seq=0 2024-01-31T05:12:58.748 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.742+0000 7f56aeffd640 1 -- 172.21.15.99:0/1214951989 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c12e21ad30 con 0x55c12e2cf180 2024-01-31T05:12:58.749 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.742+0000 7f56aeffd640 10 client.15891 handle_command_reply: tid=0 2024-01-31T05:12:58.749 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.742+0000 7f56d8844740 1 client.15891 shutdown 2024-01-31T05:12:58.749 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.742+0000 7f56d8844740 1 -- 172.21.15.99:0/1214951989 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c12e2b9270 msgr2=0x55c12e2c3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:58.749 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.742+0000 7f56d8844740 1 --2- 172.21.15.99:0/1214951989 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c12e2b9270 0x55c12e2c3130 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f56c8014a80 tx=0x7f56c8009df0 comp rx=0 tx=0).stop 2024-01-31T05:12:58.749 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.742+0000 7f56d8844740 1 -- 172.21.15.99:0/1214951989 shutdown_connections 2024-01-31T05:12:58.749 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.742+0000 7f56d8844740 1 --2- 172.21.15.99:0/1214951989 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55c12e2cf180 0x55c12e2d15a0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:58.749 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.742+0000 7f56d8844740 1 --2- 172.21.15.99:0/1214951989 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c12e2bedd0 0x55c12e2ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:58.749 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.742+0000 7f56d8844740 1 --2- 172.21.15.99:0/1214951989 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c12e2b9c60 0x55c12e2c3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:58.749 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.742+0000 7f56aeffd640 0 client.15891 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:12:58.749 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.742+0000 7f56d8844740 1 --2- 172.21.15.99:0/1214951989 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c12e2b9270 0x55c12e2c3130 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:58.749 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.742+0000 7f56d8844740 1 -- 172.21.15.99:0/1214951989 >> 172.21.15.99:0/1214951989 conn(0x55c12e2b47e0 msgr2=0x55c12e2b3a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:58.749 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.742+0000 7f56d8844740 1 -- 172.21.15.99:0/1214951989 shutdown_connections 2024-01-31T05:12:58.749 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.742+0000 7f56d8844740 1 -- 172.21.15.99:0/1214951989 wait complete. 2024-01-31T05:12:58.749 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.742+0000 7f56d8844740 20 client.15891 trim_cache size 0 max 16384 2024-01-31T05:12:58.758 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.755+0000 7f56d8844740 1 Processor -- start 2024-01-31T05:12:58.758 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.755+0000 7f56d8844740 1 -- start start 2024-01-31T05:12:58.758 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.755+0000 7f56d8844740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c12e2b9270 0x55c12e2c2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:58.758 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.755+0000 7f56d8844740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c12e2b9c60 0x55c12e2c3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:58.758 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.755+0000 7f56d8844740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c12e2bedd0 0x55c12e2b3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:58.759 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.755+0000 7f56d8844740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c12e2ced40 con 0x55c12e2bedd0 2024-01-31T05:12:58.759 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.755+0000 7f56d8844740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c12e2b57b0 con 0x55c12e2b9c60 2024-01-31T05:12:58.759 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.755+0000 7f56d8844740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c12e2d6810 con 0x55c12e2b9270 2024-01-31T05:12:58.759 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.755+0000 7f56cffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c12e2bedd0 0x55c12e2b3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:58.759 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.755+0000 7f56cffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c12e2bedd0 0x55c12e2b3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46944/0 (socket says 172.21.15.99:46944) 2024-01-31T05:12:58.759 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.755+0000 7f56cffff640 1 -- 172.21.15.99:0/2790426435 learned_addr learned my addr 172.21.15.99:0/2790426435 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:58.759 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.755+0000 7f56cf7fe640 1 --2- 172.21.15.99:0/2790426435 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c12e2b9c60 0x55c12e2c3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:58.759 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.755+0000 7f56cffff640 1 --2- 172.21.15.99:0/2790426435 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c12e2b9270 0x55c12e2c2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:58.759 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.755+0000 7f56cffff640 1 -- 172.21.15.99:0/2790426435 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c12e2b9270 msgr2=0x55c12e2c2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:58.759 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.755+0000 7f56cffff640 1 --2- 172.21.15.99:0/2790426435 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c12e2b9270 0x55c12e2c2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:58.759 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.755+0000 7f56cffff640 1 -- 172.21.15.99:0/2790426435 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c12e2b9c60 msgr2=0x55c12e2c3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:58.759 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.755+0000 7f56cffff640 1 --2- 172.21.15.99:0/2790426435 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c12e2b9c60 0x55c12e2c3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:58.759 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.755+0000 7f56cffff640 1 -- 172.21.15.99:0/2790426435 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c12e1bd030 con 0x55c12e2bedd0 2024-01-31T05:12:58.759 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.755+0000 7f56cffff640 1 --2- 172.21.15.99:0/2790426435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c12e2bedd0 0x55c12e2b3190 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f56c8009950 tx=0x7f56c80098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2d26a2fdd2c067e server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:58.759 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.755+0000 7f56b57fa640 1 -- 172.21.15.99:0/2790426435 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c8012c60 con 0x55c12e2bedd0 2024-01-31T05:12:58.760 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.755+0000 7f56b57fa640 1 -- 172.21.15.99:0/2790426435 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f56c8012dc0 con 0x55c12e2bedd0 2024-01-31T05:12:58.760 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.756+0000 7f56b57fa640 1 -- 172.21.15.99:0/2790426435 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c802a880 con 0x55c12e2bedd0 2024-01-31T05:12:58.760 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.756+0000 7f56d8844740 1 -- 172.21.15.99:0/2790426435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c12e2bedd0 msgr2=0x55c12e2b3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:12:58.760 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.756+0000 7f56d8844740 1 --2- 172.21.15.99:0/2790426435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c12e2bedd0 0x55c12e2b3190 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f56c8009950 tx=0x7f56c80098e0 comp rx=0 tx=0).stop 2024-01-31T05:12:58.760 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.756+0000 7f56d8844740 1 -- 172.21.15.99:0/2790426435 shutdown_connections 2024-01-31T05:12:58.760 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.756+0000 7f56d8844740 1 --2- 172.21.15.99:0/2790426435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c12e2bedd0 0x55c12e2b3190 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:58.760 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.756+0000 7f56d8844740 1 --2- 172.21.15.99:0/2790426435 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c12e2b9c60 0x55c12e2c3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:58.760 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.756+0000 7f56d8844740 1 --2- 172.21.15.99:0/2790426435 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c12e2b9270 0x55c12e2c2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:58.760 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.756+0000 7f56d8844740 1 -- 172.21.15.99:0/2790426435 >> 172.21.15.99:0/2790426435 conn(0x55c12e2b47e0 msgr2=0x55c12e2bae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:12:58.760 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.756+0000 7f56d8844740 1 -- 172.21.15.99:0/2790426435 shutdown_connections 2024-01-31T05:12:58.760 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.756+0000 7f56d8844740 1 -- 172.21.15.99:0/2790426435 wait complete. 2024-01-31T05:12:58.760 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.756+0000 7f56d8844740 1 -- start start 2024-01-31T05:12:58.760 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.757+0000 7f56d8844740 1 Processor -- start 2024-01-31T05:12:58.760 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.757+0000 7f56d8844740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c12e2b9270 0x55c12e321a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:58.761 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.757+0000 7f56d8844740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c12e2b9c60 0x55c12e321f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:58.761 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.757+0000 7f56d8844740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c12e2bedd0 0x55c12e328fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:58.761 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.757+0000 7f56d8844740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c12e329510 con 0x55c12e2b9270 2024-01-31T05:12:58.761 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.757+0000 7f56d8844740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c12e329650 con 0x55c12e2bedd0 2024-01-31T05:12:58.761 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.757+0000 7f56d8844740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c12e3297c0 con 0x55c12e2b9c60 2024-01-31T05:12:58.761 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.757+0000 7f56d8844740 10 client.0 _ll_register_callbacks cb 0x7f56c0009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:12:58.761 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.757+0000 7f56cffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c12e2b9270 0x55c12e321a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:58.761 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.757+0000 7f56cffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c12e2b9270 0x55c12e321a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46952/0 (socket says 172.21.15.99:46952) 2024-01-31T05:12:58.761 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.757+0000 7f56cffff640 1 -- 172.21.15.99:0/4227326507 learned_addr learned my addr 172.21.15.99:0/4227326507 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:12:58.761 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.757+0000 7f56cf7fe640 1 --2- 172.21.15.99:0/4227326507 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c12e2b9c60 0x55c12e321f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:58.761 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.757+0000 7f56cffff640 1 --2- 172.21.15.99:0/4227326507 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c12e2bedd0 0x55c12e328fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:58.761 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.757+0000 7f56cffff640 1 -- 172.21.15.99:0/4227326507 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c12e2b9c60 msgr2=0x55c12e321f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:58.761 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.757+0000 7f56cffff640 1 --2- 172.21.15.99:0/4227326507 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c12e2b9c60 0x55c12e321f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:58.761 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.757+0000 7f56cffff640 1 -- 172.21.15.99:0/4227326507 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c12e2bedd0 msgr2=0x55c12e328fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:12:58.762 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.757+0000 7f56cffff640 1 --2- 172.21.15.99:0/4227326507 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c12e2bedd0 0x55c12e328fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:12:58.762 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.757+0000 7f56cffff640 1 -- 172.21.15.99:0/4227326507 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c12e2206a0 con 0x55c12e2b9270 2024-01-31T05:12:58.762 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.757+0000 7f56cffff640 1 --2- 172.21.15.99:0/4227326507 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c12e2b9270 0x55c12e321a50 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f56c8005c40 tx=0x7f56c8014a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c46a8d554d22b388 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:12:58.762 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.757+0000 7f56aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:12:58.762 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.758+0000 7f56aeffd640 1 -- 172.21.15.99:0/4227326507 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c8003b70 con 0x55c12e2b9270 2024-01-31T05:12:58.762 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.758+0000 7f56aeffd640 1 -- 172.21.15.99:0/4227326507 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f56c8003cd0 con 0x55c12e2b9270 2024-01-31T05:12:58.762 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.758+0000 7f56d8844740 1 -- 172.21.15.99:0/4227326507 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f56c0013470 con 0x55c12e2b9270 2024-01-31T05:12:58.762 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.758+0000 7f56aeffd640 1 -- 172.21.15.99:0/4227326507 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f56c8003e90 con 0x55c12e2b9270 2024-01-31T05:12:58.762 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.758+0000 7f56d8844740 10 client.15897 fetch_fsmap learned FSMap version 28 2024-01-31T05:12:58.762 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.758+0000 7f56d8844740 1 -- 172.21.15.99:0/4227326507 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55c12e1e2a50 con 0x55c12e2b9270 2024-01-31T05:12:58.762 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.758+0000 7f56aeffd640 1 -- 172.21.15.99:0/4227326507 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f56c0013470 con 0x55c12e2b9270 2024-01-31T05:12:58.762 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.758+0000 7f56aeffd640 1 -- 172.21.15.99:0/4227326507 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 28) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f56c8005310 con 0x55c12e2b9270 2024-01-31T05:12:58.762 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.758+0000 7f56d8844740 10 client.15897 fetch_fsmap finished waiting for FSMap version 28 2024-01-31T05:12:58.762 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.758+0000 7f56d8844740 10 client.15897 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-01-31T05:12:58.762 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.758+0000 7f56d8844740 20 client.15897 populate_metadata read hostname 'smithi099' 2024-01-31T05:12:58.763 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.758+0000 7f56d8844740 1 --2- 172.21.15.99:0/4227326507 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55c12e32af00 0x55c12e32d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:12:58.763 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.758+0000 7f56d8844740 4 client.15897 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-01-31T05:12:58.763 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.758+0000 7f56d8844740 1 -- 172.21.15.99:0/4227326507 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c12df21600 con 0x55c12e32af00 2024-01-31T05:12:58.763 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.758+0000 7f56cf7fe640 1 --2- 172.21.15.99:0/4227326507 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55c12e32af00 0x55c12e32d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:12:58.763 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.759+0000 7f56aeffd640 10 client.15897 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:12:58.763 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:12:58.759+0000 7f56cf7fe640 1 --2- 172.21.15.99:0/4227326507 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55c12e32af00 0x55c12e32d320 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41e53744578b0fd8 server_cookie=62287da69802328f in_seq=0 out_seq=0 2024-01-31T05:13:00.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:12:59 smithi099 ceph-mon[31615]: pgmap v397: 97 pgs: 97 active+clean; 62 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.5 MiB/s wr, 486 op/s 2024-01-31T05:13:00.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:12:59 smithi181 ceph-mon[36434]: pgmap v397: 97 pgs: 97 active+clean; 62 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.5 MiB/s wr, 486 op/s 2024-01-31T05:13:00.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:12:59 smithi179 ceph-mon[35652]: pgmap v397: 97 pgs: 97 active+clean; 62 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.5 MiB/s wr, 486 op/s 2024-01-31T05:13:00.466 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:00.467+0000 7f56aeffd640 1 -- 172.21.15.99:0/4227326507 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c12df21600 con 0x55c12e32af00 2024-01-31T05:13:00.467 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:00.467+0000 7f56aeffd640 10 client.15897 handle_command_reply: tid=0 2024-01-31T05:13:00.467 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:00.467+0000 7f56d8844740 1 client.15897 shutdown 2024-01-31T05:13:00.467 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:00.467+0000 7f56d8844740 1 -- 172.21.15.99:0/4227326507 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c12e2b9270 msgr2=0x55c12e321a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:00.467 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:00.467+0000 7f56d8844740 1 --2- 172.21.15.99:0/4227326507 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c12e2b9270 0x55c12e321a50 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f56c8005c40 tx=0x7f56c8014a10 comp rx=0 tx=0).stop 2024-01-31T05:13:00.467 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:00.467+0000 7f56d8844740 1 -- 172.21.15.99:0/4227326507 shutdown_connections 2024-01-31T05:13:00.467 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:00.467+0000 7f56d8844740 1 --2- 172.21.15.99:0/4227326507 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x55c12e32af00 0x55c12e32d320 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:00.467 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:00.467+0000 7f56aeffd640 0 client.15897 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:13:00.467 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:00.467+0000 7f56d8844740 1 --2- 172.21.15.99:0/4227326507 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c12e2bedd0 0x55c12e328fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:00.467 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:00.467+0000 7f56d8844740 1 --2- 172.21.15.99:0/4227326507 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c12e2b9c60 0x55c12e321f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:00.467 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:00.467+0000 7f56d8844740 1 --2- 172.21.15.99:0/4227326507 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c12e2b9270 0x55c12e321a50 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:00.467 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:00.467+0000 7f56d8844740 1 -- 172.21.15.99:0/4227326507 >> 172.21.15.99:0/4227326507 conn(0x55c12e2b47e0 msgr2=0x55c12e2c2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:00.467 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:00.467+0000 7f56d8844740 1 -- 172.21.15.99:0/4227326507 shutdown_connections 2024-01-31T05:13:00.468 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:00.467+0000 7f56d8844740 1 -- 172.21.15.99:0/4227326507 wait complete. 2024-01-31T05:13:00.468 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:00.467+0000 7f56d8844740 20 client.15897 trim_cache size 0 max 16384 2024-01-31T05:13:00.468 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout:{ 2024-01-31T05:13:00.468 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout: "message": "", 2024-01-31T05:13:00.468 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout: "return_code": 0 2024-01-31T05:13:00.468 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout:} 2024-01-31T05:13:00.469 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:00.468+0000 7f56d5a78640 1 -- 172.21.15.99:0/310978788 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f56b80a1380 msgr2=0x7f56b80a3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:00.469 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:00.468+0000 7f56d5a78640 1 --2- 172.21.15.99:0/310978788 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f56b80a1380 0x7f56b80a3840 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f56c40bc310 tx=0x7f56c4009260 comp rx=0 tx=0).stop 2024-01-31T05:13:00.469 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:00.468+0000 7f56d5a78640 1 -- 172.21.15.99:0/310978788 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56d01005b0 msgr2=0x7f56d019ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:00.469 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:00.468+0000 7f56d5a78640 1 --2- 172.21.15.99:0/310978788 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56d01005b0 0x7f56d019ba00 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f56c4009230 tx=0x7f56c4004ec0 comp rx=0 tx=0).stop 2024-01-31T05:13:00.469 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:00.468+0000 7f56d5a78640 1 -- 172.21.15.99:0/310978788 shutdown_connections 2024-01-31T05:13:00.469 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:00.468+0000 7f56d5a78640 1 --2- 172.21.15.99:0/310978788 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f56b80a1380 0x7f56b80a3840 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:00.469 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:00.468+0000 7f56d5a78640 1 --2- 172.21.15.99:0/310978788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56d0100f70 0x7f56d019dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:00.470 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:00.468+0000 7f56d5a78640 1 --2- 172.21.15.99:0/310978788 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56d01005b0 0x7f56d019ba00 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:00.470 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:00.468+0000 7f56d5a78640 1 --2- 172.21.15.99:0/310978788 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56d00ff3c0 0x7f56d0102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:00.470 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:00.468+0000 7f56d5a78640 1 -- 172.21.15.99:0/310978788 >> 172.21.15.99:0/310978788 conn(0x7f56d00fa910 msgr2=0x7f56d00facf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:00.470 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:00.468+0000 7f56d5a78640 1 -- 172.21.15.99:0/310978788 shutdown_connections 2024-01-31T05:13:00.470 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:00.468+0000 7f56d5a78640 1 -- 172.21.15.99:0/310978788 wait complete. 2024-01-31T05:13:02.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:01 smithi099 ceph-mon[31615]: pgmap v398: 97 pgs: 97 active+clean; 62 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.1 MiB/s wr, 480 op/s 2024-01-31T05:13:02.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:01 smithi181 ceph-mon[36434]: pgmap v398: 97 pgs: 97 active+clean; 62 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.1 MiB/s wr, 480 op/s 2024-01-31T05:13:02.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:01 smithi179 ceph-mon[35652]: pgmap v398: 97 pgs: 97 active+clean; 62 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.1 MiB/s wr, 480 op/s 2024-01-31T05:13:02.211 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-01-31T05:13:02.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.325+0000 7f6e06e59640 1 -- 172.21.15.99:0/4169637599 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e00100de0 msgr2=0x7f6e00101260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:02.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.325+0000 7f6e06e59640 1 --2- 172.21.15.99:0/4169637599 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e00100de0 0x7f6e00101260 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f6df0009900 tx=0x7f6df002bc30 comp rx=0 tx=0).stop 2024-01-31T05:13:02.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.325+0000 7f6e06e59640 1 -- 172.21.15.99:0/4169637599 shutdown_connections 2024-01-31T05:13:02.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.325+0000 7f6e06e59640 1 --2- 172.21.15.99:0/4169637599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e001017a0 0x7f6e00108030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.325+0000 7f6e06e59640 1 --2- 172.21.15.99:0/4169637599 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e00100de0 0x7f6e00101260 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.325+0000 7f6e06e59640 1 --2- 172.21.15.99:0/4169637599 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e000ffbf0 0x7f6e00100010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.325+0000 7f6e06e59640 1 -- 172.21.15.99:0/4169637599 >> 172.21.15.99:0/4169637599 conn(0x7f6e000fb180 msgr2=0x7f6e000fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:02.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.325+0000 7f6e06e59640 1 -- 172.21.15.99:0/4169637599 shutdown_connections 2024-01-31T05:13:02.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.325+0000 7f6e06e59640 1 -- 172.21.15.99:0/4169637599 wait complete. 2024-01-31T05:13:02.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.326+0000 7f6e06e59640 1 Processor -- start 2024-01-31T05:13:02.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.326+0000 7f6e06e59640 1 -- start start 2024-01-31T05:13:02.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.326+0000 7f6e06e59640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e000ffbf0 0x7f6e00195b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:02.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.326+0000 7f6e06e59640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e00100de0 0x7f6e001960c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:02.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.326+0000 7f6e06e59640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e001017a0 0x7f6e0019d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:02.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.326+0000 7f6e06e59640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0019d670 con 0x7f6e000ffbf0 2024-01-31T05:13:02.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.326+0000 7f6e06e59640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0019d7e0 con 0x7f6e00100de0 2024-01-31T05:13:02.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.326+0000 7f6e06e59640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0019d9a0 con 0x7f6e001017a0 2024-01-31T05:13:02.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.326+0000 7f6e04bf5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e000ffbf0 0x7f6e00195b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:02.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.326+0000 7f6e04bf5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e000ffbf0 0x7f6e00195b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46960/0 (socket says 172.21.15.99:46960) 2024-01-31T05:13:02.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.326+0000 7f6e04bf5640 1 -- 172.21.15.99:0/2447449546 learned_addr learned my addr 172.21.15.99:0/2447449546 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:02.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.326+0000 7f6df7fff640 1 --2- 172.21.15.99:0/2447449546 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e00100de0 0x7f6e001960c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:02.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.326+0000 7f6e053f6640 1 --2- 172.21.15.99:0/2447449546 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e001017a0 0x7f6e0019d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:02.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.327+0000 7f6e04bf5640 1 -- 172.21.15.99:0/2447449546 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e001017a0 msgr2=0x7f6e0019d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:02.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.327+0000 7f6e04bf5640 1 --2- 172.21.15.99:0/2447449546 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e001017a0 0x7f6e0019d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.327+0000 7f6e04bf5640 1 -- 172.21.15.99:0/2447449546 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e00100de0 msgr2=0x7f6e001960c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:02.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.327+0000 7f6e04bf5640 1 --2- 172.21.15.99:0/2447449546 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e00100de0 0x7f6e001960c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.327+0000 7f6e04bf5640 1 -- 172.21.15.99:0/2447449546 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df0009560 con 0x7f6e000ffbf0 2024-01-31T05:13:02.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.327+0000 7f6e04bf5640 1 --2- 172.21.15.99:0/2447449546 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e000ffbf0 0x7f6e00195b80 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc00d770 tx=0x7f6dfc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:02.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.327+0000 7f6df5ffb640 1 -- 172.21.15.99:0/2447449546 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc009c30 con 0x7f6e000ffbf0 2024-01-31T05:13:02.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.327+0000 7f6e06e59640 1 -- 172.21.15.99:0/2447449546 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e0019dc80 con 0x7f6e000ffbf0 2024-01-31T05:13:02.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.327+0000 7f6df5ffb640 1 -- 172.21.15.99:0/2447449546 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6dfc00de80 con 0x7f6e000ffbf0 2024-01-31T05:13:02.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.327+0000 7f6df5ffb640 1 -- 172.21.15.99:0/2447449546 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc003e20 con 0x7f6e000ffbf0 2024-01-31T05:13:02.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.327+0000 7f6e06e59640 1 -- 172.21.15.99:0/2447449546 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e0019e1b0 con 0x7f6e000ffbf0 2024-01-31T05:13:02.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.329+0000 7f6df5ffb640 1 -- 172.21.15.99:0/2447449546 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 20) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f6dfc003f80 con 0x7f6e000ffbf0 2024-01-31T05:13:02.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.330+0000 7f6e09c11740 1 Processor -- start 2024-01-31T05:13:02.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.330+0000 7f6e09c11740 1 -- start start 2024-01-31T05:13:02.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.330+0000 7f6df5ffb640 1 --2- 172.21.15.99:0/2447449546 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f6de80a12e0 0x7f6de80a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:02.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.330+0000 7f6e09c11740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556b08438a20 0x556b08438e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:02.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.330+0000 7f6e09c11740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b08439410 0x556b0843df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:02.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.330+0000 7f6e09c11740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b0843e580 0x556b08440a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:02.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.330+0000 7f6e09c11740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b083a7380 con 0x556b08439410 2024-01-31T05:13:02.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.330+0000 7f6e09c11740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b083a4a70 con 0x556b08438a20 2024-01-31T05:13:02.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.330+0000 7f6e09c11740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b083a0360 con 0x556b0843e580 2024-01-31T05:13:02.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.330+0000 7f6df5ffb640 1 -- 172.21.15.99:0/2447449546 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f6dfc0cc410 con 0x7f6e000ffbf0 2024-01-31T05:13:02.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.330+0000 7f6e053f6640 1 --2- 172.21.15.99:0/2447449546 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f6de80a12e0 0x7f6de80a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:02.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.330+0000 7f6df7fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b08439410 0x556b0843df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:02.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.330+0000 7f6e04bf5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556b08438a20 0x556b08438e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:02.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.330+0000 7f6df7fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b08439410 0x556b0843df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46974/0 (socket says 172.21.15.99:46974) 2024-01-31T05:13:02.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.330+0000 7f6df7fff640 1 -- 172.21.15.99:0/153763712 learned_addr learned my addr 172.21.15.99:0/153763712 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:02.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.330+0000 7f6e04bf5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556b08438a20 0x556b08438e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.99:47770/0 (socket says 172.21.15.99:47770) 2024-01-31T05:13:02.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.330+0000 7f6e053f6640 1 --2- 172.21.15.99:0/153763712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b0843e580 0x556b08440a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:02.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.330+0000 7f6e04bf5640 1 -- 172.21.15.99:0/153763712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b0843e580 msgr2=0x556b08440a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:02.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.330+0000 7f6e04bf5640 1 --2- 172.21.15.99:0/153763712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b0843e580 0x556b08440a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.330+0000 7f6e04bf5640 1 -- 172.21.15.99:0/153763712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b08439410 msgr2=0x556b0843df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:02.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.330+0000 7f6e04bf5640 1 --2- 172.21.15.99:0/153763712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b08439410 0x556b0843df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.330+0000 7f6e04bf5640 1 -- 172.21.15.99:0/153763712 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556b083627e0 con 0x556b08438a20 2024-01-31T05:13:02.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.330+0000 7f6df7fff640 1 --2- 172.21.15.99:0/153763712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b08439410 0x556b0843df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:13:02.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.330+0000 7f6e053f6640 1 --2- 172.21.15.99:0/2447449546 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f6de80a12e0 0x7f6de80a37a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6df8009fd0 tx=0x7f6df8013b80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:02.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.331+0000 7f6e04bf5640 1 --2- 172.21.15.99:0/153763712 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556b08438a20 0x556b08438e40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc0ca020 tx=0x7f6dfc095ac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4a7ccca56503ca8 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:02.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.331+0000 7f6de6ffd640 1 -- 172.21.15.99:0/153763712 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc099020 con 0x556b08438a20 2024-01-31T05:13:02.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.331+0000 7f6de6ffd640 1 -- 172.21.15.99:0/153763712 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6dfc0996c0 con 0x556b08438a20 2024-01-31T05:13:02.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.331+0000 7f6de6ffd640 1 -- 172.21.15.99:0/153763712 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc097af0 con 0x556b08438a20 2024-01-31T05:13:02.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.331+0000 7f6e09c11740 1 -- 172.21.15.99:0/153763712 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556b08438a20 msgr2=0x556b08438e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:02.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.331+0000 7f6e09c11740 1 --2- 172.21.15.99:0/153763712 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556b08438a20 0x556b08438e40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc0ca020 tx=0x7f6dfc095ac0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.332+0000 7f6e09c11740 1 -- 172.21.15.99:0/153763712 shutdown_connections 2024-01-31T05:13:02.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.332+0000 7f6e09c11740 1 --2- 172.21.15.99:0/153763712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b0843e580 0x556b08440a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.332+0000 7f6e09c11740 1 --2- 172.21.15.99:0/153763712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b08439410 0x556b0843df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.332+0000 7f6e09c11740 1 --2- 172.21.15.99:0/153763712 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556b08438a20 0x556b08438e40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.332+0000 7f6e09c11740 1 -- 172.21.15.99:0/153763712 >> 172.21.15.99:0/153763712 conn(0x556b08433f90 msgr2=0x556b08434390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:02.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.332+0000 7f6e09c11740 1 -- 172.21.15.99:0/153763712 shutdown_connections 2024-01-31T05:13:02.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.332+0000 7f6e09c11740 1 -- 172.21.15.99:0/153763712 wait complete. 2024-01-31T05:13:02.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.332+0000 7f6e09c11740 1 -- start start 2024-01-31T05:13:02.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.332+0000 7f6e09c11740 1 Processor -- start 2024-01-31T05:13:02.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.332+0000 7f6e09c11740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556b08438a20 0x556b08442c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:02.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.332+0000 7f6e09c11740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b08439410 0x556b08443140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:02.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.332+0000 7f6e09c11740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b0843e580 0x556b0844a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:02.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.332+0000 7f6e09c11740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b08359750 con 0x556b08439410 2024-01-31T05:13:02.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.332+0000 7f6e09c11740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b083593f0 con 0x556b08438a20 2024-01-31T05:13:02.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.332+0000 7f6e09c11740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b0831e3f0 con 0x556b0843e580 2024-01-31T05:13:02.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.332+0000 7f6e09c11740 10 client.0 _ll_register_callbacks cb 0x556b0835bb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:13:02.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.332+0000 7f6df7fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b08439410 0x556b08443140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:02.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.333+0000 7f6df7fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b08439410 0x556b08443140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46990/0 (socket says 172.21.15.99:46990) 2024-01-31T05:13:02.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.333+0000 7f6df7fff640 1 -- 172.21.15.99:0/697492194 learned_addr learned my addr 172.21.15.99:0/697492194 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:02.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.333+0000 7f6e04bf5640 1 --2- 172.21.15.99:0/697492194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556b08438a20 0x556b08442c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:02.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.333+0000 7f6e053f6640 1 --2- 172.21.15.99:0/697492194 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b0843e580 0x556b0844a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:02.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.333+0000 7f6df7fff640 1 -- 172.21.15.99:0/697492194 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b0843e580 msgr2=0x556b0844a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:02.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.333+0000 7f6df7fff640 1 --2- 172.21.15.99:0/697492194 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b0843e580 0x556b0844a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.333+0000 7f6df7fff640 1 -- 172.21.15.99:0/697492194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556b08438a20 msgr2=0x556b08442c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:02.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.333+0000 7f6df7fff640 1 --2- 172.21.15.99:0/697492194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556b08438a20 0x556b08442c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.333+0000 7f6df7fff640 1 -- 172.21.15.99:0/697492194 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e0019e1b0 con 0x556b08439410 2024-01-31T05:13:02.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.333+0000 7f6e053f6640 1 --2- 172.21.15.99:0/697492194 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b0843e580 0x556b0844a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:13:02.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.333+0000 7f6e04bf5640 1 --2- 172.21.15.99:0/697492194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556b08438a20 0x556b08442c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:13:02.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.333+0000 7f6df7fff640 1 --2- 172.21.15.99:0/697492194 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b08439410 0x556b08443140 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f6df002c240 tx=0x7f6df0004a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbc8c277238e7ceb server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:02.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.333+0000 7f6ddffff640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:13:02.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.333+0000 7f6ddffff640 1 -- 172.21.15.99:0/697492194 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df0004310 con 0x556b08439410 2024-01-31T05:13:02.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.333+0000 7f6ddffff640 1 -- 172.21.15.99:0/697492194 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f6df0046070 con 0x556b08439410 2024-01-31T05:13:02.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.333+0000 7f6e09c11740 1 -- 172.21.15.99:0/697492194 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556b08375210 con 0x556b08439410 2024-01-31T05:13:02.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.333+0000 7f6ddffff640 1 -- 172.21.15.99:0/697492194 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6df0004470 con 0x556b08439410 2024-01-31T05:13:02.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.333+0000 7f6e09c11740 10 client.15909 fetch_fsmap learned FSMap version 28 2024-01-31T05:13:02.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.333+0000 7f6e09c11740 1 -- 172.21.15.99:0/697492194 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x556b0839e9e0 con 0x556b08439410 2024-01-31T05:13:02.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.334+0000 7f6ddffff640 1 -- 172.21.15.99:0/697492194 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556b08375210 con 0x556b08439410 2024-01-31T05:13:02.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.334+0000 7f6ddffff640 1 -- 172.21.15.99:0/697492194 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 28) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f6df003c040 con 0x556b08439410 2024-01-31T05:13:02.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.334+0000 7f6e09c11740 10 client.15909 fetch_fsmap finished waiting for FSMap version 28 2024-01-31T05:13:02.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.334+0000 7f6e09c11740 10 client.15909 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-01-31T05:13:02.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.334+0000 7f6e09c11740 20 client.15909 populate_metadata read hostname 'smithi099' 2024-01-31T05:13:02.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.334+0000 7f6e09c11740 1 --2- 172.21.15.99:0/697492194 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x556b0844ef20 0x556b08451340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:02.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.334+0000 7f6e09c11740 4 client.15909 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:13:02.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.334+0000 7f6e09c11740 1 -- 172.21.15.99:0/697492194 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556b08372b20 con 0x556b0844ef20 2024-01-31T05:13:02.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.334+0000 7f6e04bf5640 1 --2- 172.21.15.99:0/697492194 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x556b0844ef20 0x556b08451340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:02.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.334+0000 7f6e04bf5640 1 --2- 172.21.15.99:0/697492194 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x556b0844ef20 0x556b08451340 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11ae8f4aefc92078 server_cookie=700841ca9c0f5f32 in_seq=0 out_seq=0 2024-01-31T05:13:02.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.334+0000 7f6ddffff640 10 client.15909 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:13:02.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.335+0000 7f6ddffff640 1 -- 172.21.15.99:0/697492194 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556b08372b20 con 0x556b0844ef20 2024-01-31T05:13:02.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.335+0000 7f6ddffff640 10 client.15909 handle_command_reply: tid=0 2024-01-31T05:13:02.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.335+0000 7f6e09c11740 1 client.15909 shutdown 2024-01-31T05:13:02.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.336+0000 7f6e09c11740 1 -- 172.21.15.99:0/697492194 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b08439410 msgr2=0x556b08443140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:02.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.336+0000 7f6e09c11740 1 --2- 172.21.15.99:0/697492194 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b08439410 0x556b08443140 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f6df002c240 tx=0x7f6df0004a30 comp rx=0 tx=0).stop 2024-01-31T05:13:02.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.336+0000 7f6e09c11740 1 -- 172.21.15.99:0/697492194 shutdown_connections 2024-01-31T05:13:02.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.336+0000 7f6e09c11740 1 --2- 172.21.15.99:0/697492194 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b0843e580 0x556b0844a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.336+0000 7f6e09c11740 1 --2- 172.21.15.99:0/697492194 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b08439410 0x556b08443140 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.336+0000 7f6e09c11740 1 --2- 172.21.15.99:0/697492194 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x556b0844ef20 0x556b08451340 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.336+0000 7f6e09c11740 1 --2- 172.21.15.99:0/697492194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556b08438a20 0x556b08442c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.336+0000 7f6ddffff640 0 client.15909 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:13:02.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.336+0000 7f6e09c11740 1 -- 172.21.15.99:0/697492194 >> 172.21.15.99:0/697492194 conn(0x556b08433f90 msgr2=0x556b08433210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:02.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.336+0000 7f6e09c11740 1 -- 172.21.15.99:0/697492194 shutdown_connections 2024-01-31T05:13:02.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.336+0000 7f6e09c11740 1 -- 172.21.15.99:0/697492194 wait complete. 2024-01-31T05:13:02.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.336+0000 7f6e09c11740 20 client.15909 trim_cache size 0 max 16384 2024-01-31T05:13:02.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.351+0000 7f6e09c11740 1 Processor -- start 2024-01-31T05:13:02.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.351+0000 7f6e09c11740 1 -- start start 2024-01-31T05:13:02.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.351+0000 7f6e09c11740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b08438a20 0x556b08442c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:02.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.351+0000 7f6e09c11740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556b08439410 0x556b08443140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:02.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.351+0000 7f6e09c11740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b0843e580 0x556b0843a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:02.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.351+0000 7f6e09c11740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b08375210 con 0x556b08438a20 2024-01-31T05:13:02.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.351+0000 7f6e09c11740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b08439ca0 con 0x556b08439410 2024-01-31T05:13:02.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.351+0000 7f6e09c11740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b0844d3b0 con 0x556b0843e580 2024-01-31T05:13:02.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.351+0000 7f6e04bf5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b08438a20 0x556b08442c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:02.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.351+0000 7f6e04bf5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b08438a20 0x556b08442c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47000/0 (socket says 172.21.15.99:47000) 2024-01-31T05:13:02.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.351+0000 7f6e04bf5640 1 -- 172.21.15.99:0/3049077600 learned_addr learned my addr 172.21.15.99:0/3049077600 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:02.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.351+0000 7f6df7fff640 1 --2- 172.21.15.99:0/3049077600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556b08439410 0x556b08443140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:02.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.351+0000 7f6e04bf5640 1 -- 172.21.15.99:0/3049077600 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b0843e580 msgr2=0x556b0843a960 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-01-31T05:13:02.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.351+0000 7f6e04bf5640 1 --2- 172.21.15.99:0/3049077600 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b0843e580 0x556b0843a960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.351+0000 7f6e04bf5640 1 -- 172.21.15.99:0/3049077600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556b08439410 msgr2=0x556b08443140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:02.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.351+0000 7f6e04bf5640 1 --2- 172.21.15.99:0/3049077600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556b08439410 0x556b08443140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.351+0000 7f6e04bf5640 1 -- 172.21.15.99:0/3049077600 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556b0833b4f0 con 0x556b08438a20 2024-01-31T05:13:02.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.352+0000 7f6e04bf5640 1 --2- 172.21.15.99:0/3049077600 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b08438a20 0x556b08442c00 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc00d740 tx=0x7f6dfc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45c6405b1e3e7979 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:02.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.352+0000 7f6de67fc640 1 -- 172.21.15.99:0/3049077600 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc0b5070 con 0x556b08438a20 2024-01-31T05:13:02.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.352+0000 7f6de67fc640 1 -- 172.21.15.99:0/3049077600 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6dfc097870 con 0x556b08438a20 2024-01-31T05:13:02.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.352+0000 7f6de67fc640 1 -- 172.21.15.99:0/3049077600 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc095dd0 con 0x556b08438a20 2024-01-31T05:13:02.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.352+0000 7f6e09c11740 1 -- 172.21.15.99:0/3049077600 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b08438a20 msgr2=0x556b08442c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:02.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.352+0000 7f6e09c11740 1 --2- 172.21.15.99:0/3049077600 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b08438a20 0x556b08442c00 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc00d740 tx=0x7f6dfc000bc0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.352+0000 7f6e09c11740 1 -- 172.21.15.99:0/3049077600 shutdown_connections 2024-01-31T05:13:02.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.352+0000 7f6e09c11740 1 --2- 172.21.15.99:0/3049077600 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b0843e580 0x556b0843a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.352+0000 7f6e09c11740 1 --2- 172.21.15.99:0/3049077600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556b08439410 0x556b08443140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.352+0000 7f6e09c11740 1 --2- 172.21.15.99:0/3049077600 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b08438a20 0x556b08442c00 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.352+0000 7f6e09c11740 1 -- 172.21.15.99:0/3049077600 >> 172.21.15.99:0/3049077600 conn(0x556b08433f90 msgr2=0x556b08434370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:02.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.353+0000 7f6e09c11740 1 -- 172.21.15.99:0/3049077600 shutdown_connections 2024-01-31T05:13:02.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.353+0000 7f6e09c11740 1 -- 172.21.15.99:0/3049077600 wait complete. 2024-01-31T05:13:02.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.353+0000 7f6e09c11740 1 -- start start 2024-01-31T05:13:02.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.353+0000 7f6e09c11740 1 Processor -- start 2024-01-31T05:13:02.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.353+0000 7f6e09c11740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b08438a20 0x556b08448230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:02.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.353+0000 7f6e09c11740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b08439410 0x556b08448770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:02.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.353+0000 7f6e09c11740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556b0843e580 0x556b08449690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:02.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.353+0000 7f6e09c11740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b08449bd0 con 0x556b08438a20 2024-01-31T05:13:02.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.353+0000 7f6e09c11740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b08449d40 con 0x556b0843e580 2024-01-31T05:13:02.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.353+0000 7f6e09c11740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b08449f00 con 0x556b08439410 2024-01-31T05:13:02.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.353+0000 7f6e09c11740 10 client.0 _ll_register_callbacks cb 0x7f6df0005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:13:02.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.353+0000 7f6e04bf5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b08438a20 0x556b08448230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:02.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.353+0000 7f6e04bf5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b08438a20 0x556b08448230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47002/0 (socket says 172.21.15.99:47002) 2024-01-31T05:13:02.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.353+0000 7f6e04bf5640 1 -- 172.21.15.99:0/2316797010 learned_addr learned my addr 172.21.15.99:0/2316797010 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:02.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.353+0000 7f6e053f6640 1 --2- 172.21.15.99:0/2316797010 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556b0843e580 0x556b08449690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:02.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.354+0000 7f6e04bf5640 1 -- 172.21.15.99:0/2316797010 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b08439410 msgr2=0x556b08448770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:02.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.354+0000 7f6e04bf5640 1 --2- 172.21.15.99:0/2316797010 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b08439410 0x556b08448770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.354+0000 7f6e04bf5640 1 -- 172.21.15.99:0/2316797010 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556b0843e580 msgr2=0x556b08449690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:02.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.354+0000 7f6e04bf5640 1 --2- 172.21.15.99:0/2316797010 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556b0843e580 0x556b08449690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.354+0000 7f6e04bf5640 1 -- 172.21.15.99:0/2316797010 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556b083627e0 con 0x556b08438a20 2024-01-31T05:13:02.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.354+0000 7f6e04bf5640 1 --2- 172.21.15.99:0/2316797010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b08438a20 0x556b08448230 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc0a1470 tx=0x7f6dfc0037a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53269547478c190f server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:02.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.354+0000 7f6ddffff640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:13:02.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.354+0000 7f6ddffff640 1 -- 172.21.15.99:0/2316797010 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc0b5050 con 0x556b08438a20 2024-01-31T05:13:02.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.354+0000 7f6ddffff640 1 -- 172.21.15.99:0/2316797010 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f6dfc0a19a0 con 0x556b08438a20 2024-01-31T05:13:02.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.354+0000 7f6e09c11740 1 -- 172.21.15.99:0/2316797010 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556b083c7bd0 con 0x556b08438a20 2024-01-31T05:13:02.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.354+0000 7f6ddffff640 1 -- 172.21.15.99:0/2316797010 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6dfc09d760 con 0x556b08438a20 2024-01-31T05:13:02.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.354+0000 7f6e09c11740 10 client.15915 fetch_fsmap learned FSMap version 28 2024-01-31T05:13:02.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.354+0000 7f6e09c11740 1 -- 172.21.15.99:0/2316797010 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x556b08361040 con 0x556b08438a20 2024-01-31T05:13:02.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.354+0000 7f6ddffff640 1 -- 172.21.15.99:0/2316797010 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556b083c7bd0 con 0x556b08438a20 2024-01-31T05:13:02.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.354+0000 7f6ddffff640 1 -- 172.21.15.99:0/2316797010 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 28) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f6dfc098620 con 0x556b08438a20 2024-01-31T05:13:02.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.354+0000 7f6e09c11740 10 client.15915 fetch_fsmap finished waiting for FSMap version 28 2024-01-31T05:13:02.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.354+0000 7f6e09c11740 10 client.15915 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-01-31T05:13:02.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.354+0000 7f6e09c11740 20 client.15915 populate_metadata read hostname 'smithi099' 2024-01-31T05:13:02.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.354+0000 7f6e09c11740 1 --2- 172.21.15.99:0/2316797010 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x556b084aa6e0 0x556b084acb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:02.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.354+0000 7f6e09c11740 4 client.15915 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-01-31T05:13:02.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.354+0000 7f6e09c11740 1 -- 172.21.15.99:0/2316797010 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x556b083991f0 con 0x556b084aa6e0 2024-01-31T05:13:02.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.355+0000 7f6df7fff640 1 --2- 172.21.15.99:0/2316797010 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x556b084aa6e0 0x556b084acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:02.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.355+0000 7f6df7fff640 1 --2- 172.21.15.99:0/2316797010 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x556b084aa6e0 0x556b084acb00 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75fc5d213e9cd174 server_cookie=d327dbcf6f042190 in_seq=0 out_seq=0 2024-01-31T05:13:02.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.355+0000 7f6ddffff640 10 client.15915 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:13:02.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.356+0000 7f6ddffff640 1 -- 172.21.15.99:0/2316797010 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x556b083991f0 con 0x556b084aa6e0 2024-01-31T05:13:02.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.356+0000 7f6ddffff640 10 client.15915 handle_command_reply: tid=0 2024-01-31T05:13:02.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.356+0000 7f6e09c11740 1 client.15915 shutdown 2024-01-31T05:13:02.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.356+0000 7f6e09c11740 1 -- 172.21.15.99:0/2316797010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b08438a20 msgr2=0x556b08448230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:02.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.356+0000 7f6e09c11740 1 --2- 172.21.15.99:0/2316797010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b08438a20 0x556b08448230 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc0a1470 tx=0x7f6dfc0037a0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.356+0000 7f6e09c11740 1 -- 172.21.15.99:0/2316797010 shutdown_connections 2024-01-31T05:13:02.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.356+0000 7f6e09c11740 1 --2- 172.21.15.99:0/2316797010 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x556b084aa6e0 0x556b084acb00 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.356+0000 7f6e09c11740 1 --2- 172.21.15.99:0/2316797010 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556b0843e580 0x556b08449690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.356+0000 7f6e09c11740 1 --2- 172.21.15.99:0/2316797010 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b08439410 0x556b08448770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.356+0000 7f6e09c11740 1 --2- 172.21.15.99:0/2316797010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b08438a20 0x556b08448230 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.356+0000 7f6ddffff640 0 client.15915 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:13:02.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.356+0000 7f6e09c11740 1 -- 172.21.15.99:0/2316797010 >> 172.21.15.99:0/2316797010 conn(0x556b08433f90 msgr2=0x556b0843a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:02.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.356+0000 7f6e09c11740 1 -- 172.21.15.99:0/2316797010 shutdown_connections 2024-01-31T05:13:02.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.356+0000 7f6e09c11740 1 -- 172.21.15.99:0/2316797010 wait complete. 2024-01-31T05:13:02.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.356+0000 7f6e09c11740 20 client.15915 trim_cache size 0 max 16384 2024-01-31T05:13:02.367 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-01-31T05:13:02.367 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "no active scrubs running", 2024-01-31T05:13:02.367 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": {} 2024-01-31T05:13:02.367 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-01-31T05:13:02.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.357+0000 7f6e06e59640 1 -- 172.21.15.99:0/2447449546 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f6de80a12e0 msgr2=0x7f6de80a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:02.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.357+0000 7f6e06e59640 1 --2- 172.21.15.99:0/2447449546 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f6de80a12e0 0x7f6de80a37a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6df8009fd0 tx=0x7f6df8013b80 comp rx=0 tx=0).stop 2024-01-31T05:13:02.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.357+0000 7f6e06e59640 1 -- 172.21.15.99:0/2447449546 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e000ffbf0 msgr2=0x7f6e00195b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:02.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.357+0000 7f6e06e59640 1 --2- 172.21.15.99:0/2447449546 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e000ffbf0 0x7f6e00195b80 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc00d770 tx=0x7f6dfc00dc30 comp rx=0 tx=0).stop 2024-01-31T05:13:02.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.357+0000 7f6e06e59640 1 -- 172.21.15.99:0/2447449546 shutdown_connections 2024-01-31T05:13:02.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.357+0000 7f6e06e59640 1 --2- 172.21.15.99:0/2447449546 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f6de80a12e0 0x7f6de80a37a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.357+0000 7f6e06e59640 1 --2- 172.21.15.99:0/2447449546 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e001017a0 0x7f6e0019d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.357+0000 7f6e06e59640 1 --2- 172.21.15.99:0/2447449546 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e00100de0 0x7f6e001960c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.357+0000 7f6e06e59640 1 --2- 172.21.15.99:0/2447449546 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e000ffbf0 0x7f6e00195b80 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.357+0000 7f6e06e59640 1 -- 172.21.15.99:0/2447449546 >> 172.21.15.99:0/2447449546 conn(0x7f6e000fb180 msgr2=0x7f6e00104200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:02.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.357+0000 7f6e06e59640 1 -- 172.21.15.99:0/2447449546 shutdown_connections 2024-01-31T05:13:02.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.357+0000 7f6e06e59640 1 -- 172.21.15.99:0/2447449546 wait complete. 2024-01-31T05:13:02.369 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-01-31T05:13:02.370 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T05:13:02.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.481+0000 7f5d6a97c640 1 -- 172.21.15.99:0/2008131774 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d64101810 msgr2=0x7f5d641080a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:02.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.481+0000 7f5d6a97c640 1 --2- 172.21.15.99:0/2008131774 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d64101810 0x7f5d641080a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c009ca0 tx=0x7f5d5c02c0f0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.481+0000 7f5d6a97c640 1 -- 172.21.15.99:0/2008131774 shutdown_connections 2024-01-31T05:13:02.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.481+0000 7f5d6a97c640 1 --2- 172.21.15.99:0/2008131774 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d64101810 0x7f5d641080a0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.481+0000 7f5d6a97c640 1 --2- 172.21.15.99:0/2008131774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d64100e50 0x7f5d641012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.481+0000 7f5d6a97c640 1 --2- 172.21.15.99:0/2008131774 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d64100140 0x7f5d64100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.481+0000 7f5d6a97c640 1 -- 172.21.15.99:0/2008131774 >> 172.21.15.99:0/2008131774 conn(0x7f5d640fa8d0 msgr2=0x7f5d640fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:02.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.481+0000 7f5d6a97c640 1 -- 172.21.15.99:0/2008131774 shutdown_connections 2024-01-31T05:13:02.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.481+0000 7f5d6a97c640 1 -- 172.21.15.99:0/2008131774 wait complete. 2024-01-31T05:13:02.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.481+0000 7f5d6a97c640 1 Processor -- start 2024-01-31T05:13:02.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.481+0000 7f5d6a97c640 1 -- start start 2024-01-31T05:13:02.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.481+0000 7f5d6a97c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d64100140 0x7f5d64195bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:02.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.481+0000 7f5d6a97c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d64100e50 0x7f5d641960f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:02.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.481+0000 7f5d6a97c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d64101810 0x7f5d6419d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:02.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.482+0000 7f5d6a97c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6419d6a0 con 0x7f5d64101810 2024-01-31T05:13:02.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.482+0000 7f5d6a97c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6419d810 con 0x7f5d64100e50 2024-01-31T05:13:02.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.482+0000 7f5d6a97c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6419d9d0 con 0x7f5d64100140 2024-01-31T05:13:02.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.482+0000 7f5d68f19640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d64101810 0x7f5d6419d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:02.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.482+0000 7f5d5bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d64100e50 0x7f5d641960f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:02.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.482+0000 7f5d68f19640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d64101810 0x7f5d6419d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47020/0 (socket says 172.21.15.99:47020) 2024-01-31T05:13:02.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.482+0000 7f5d68f19640 1 -- 172.21.15.99:0/1292935449 learned_addr learned my addr 172.21.15.99:0/1292935449 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:02.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.482+0000 7f5d63fff640 1 --2- 172.21.15.99:0/1292935449 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d64100140 0x7f5d64195bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:02.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.482+0000 7f5d68f19640 1 -- 172.21.15.99:0/1292935449 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d64100140 msgr2=0x7f5d64195bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:02.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.482+0000 7f5d68f19640 1 --2- 172.21.15.99:0/1292935449 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d64100140 0x7f5d64195bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.482+0000 7f5d68f19640 1 -- 172.21.15.99:0/1292935449 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d64100e50 msgr2=0x7f5d641960f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:02.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.482+0000 7f5d68f19640 1 --2- 172.21.15.99:0/1292935449 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d64100e50 0x7f5d641960f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.482+0000 7f5d68f19640 1 -- 172.21.15.99:0/1292935449 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d5c009900 con 0x7f5d64101810 2024-01-31T05:13:02.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.482+0000 7f5d68f19640 1 --2- 172.21.15.99:0/1292935449 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d64101810 0x7f5d6419d160 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c037040 tx=0x7f5d5c0093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:02.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.482+0000 7f5d61ffb640 1 -- 172.21.15.99:0/1292935449 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c034c70 con 0x7f5d64101810 2024-01-31T05:13:02.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.482+0000 7f5d61ffb640 1 -- 172.21.15.99:0/1292935449 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5d5c003e30 con 0x7f5d64101810 2024-01-31T05:13:02.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.482+0000 7f5d6a97c640 1 -- 172.21.15.99:0/1292935449 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d6419dc50 con 0x7f5d64101810 2024-01-31T05:13:02.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.482+0000 7f5d61ffb640 1 -- 172.21.15.99:0/1292935449 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c004800 con 0x7f5d64101810 2024-01-31T05:13:02.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.482+0000 7f5d6a97c640 1 -- 172.21.15.99:0/1292935449 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d6419e150 con 0x7f5d64101810 2024-01-31T05:13:02.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.483+0000 7f5d6a97c640 1 -- 172.21.15.99:0/1292935449 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d64106f80 con 0x7f5d64101810 2024-01-31T05:13:02.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.484+0000 7f5d61ffb640 1 -- 172.21.15.99:0/1292935449 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 20) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f5d5c03b040 con 0x7f5d64101810 2024-01-31T05:13:02.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.485+0000 7f5d61ffb640 1 --2- 172.21.15.99:0/1292935449 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f5d500a1360 0x7f5d500a3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:02.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.485+0000 7f5d63fff640 1 --2- 172.21.15.99:0/1292935449 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f5d500a1360 0x7f5d500a3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:02.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.485+0000 7f5d61ffb640 1 -- 172.21.15.99:0/1292935449 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f5d5c0ef410 con 0x7f5d64101810 2024-01-31T05:13:02.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.485+0000 7f5d63fff640 1 --2- 172.21.15.99:0/1292935449 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f5d500a1360 0x7f5d500a3820 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5d64068e70 tx=0x7f5d54005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:02.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.489+0000 7f5d61ffb640 1 -- 172.21.15.99:0/1292935449 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f5d5c0b8950 con 0x7f5d64101810 2024-01-31T05:13:02.659 INFO:tasks.workunit.client.0.smithi099.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-01-31T05:13:02.660 INFO:tasks.workunit.client.0.smithi099.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-01-31T05:13:02.660 INFO:tasks.workunit.client.0.smithi099.stderr:+ make 2024-01-31T05:13:02.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.725+0000 7f5d6a97c640 1 -- 172.21.15.99:0/1292935449 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5d6410b730 con 0x7f5d64101810 2024-01-31T05:13:02.729 INFO:tasks.workunit.client.0.smithi099.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-01-31T05:13:02.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.726+0000 7f5d61ffb640 1 -- 172.21.15.99:0/1292935449 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+11392 (secure 0 0 0) 0x7f5d5c039090 con 0x7f5d64101810 2024-01-31T05:13:02.729 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:13:02.730 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/1488539026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1488539026},{"type":"v1","addr":"172.21.15.99:6835","nonce":1488539026}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/1649552652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1649552652},{"type":"v1","addr":"172.21.15.99:6837","nonce":1649552652}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-01-31T05:09:20.564215+0000","modified":"2024-01-31T05:12:51.020368+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24461,"mds_2":24457,"mds_3":24439,"mds_4":14619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6839/4070477446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4070477446},{"type":"v1","addr":"172.21.15.99:6839","nonce":4070477446}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.99:6841/3069939345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6840","nonce":3069939345},{"type":"v1","addr":"172.21.15.99:6841","nonce":3069939345}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24376":{"gid":24376,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6833/427201290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":427201290},{"type":"v1","addr":"172.21.15.181:6833","nonce":427201290}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24401":{"gid":24401,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/472161020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":472161020},{"type":"v1","addr":"172.21.15.179:6833","nonce":472161020}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24427":{"gid":24427,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/1038715471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1038715471},{"type":"v1","addr":"172.21.15.181:6835","nonce":1038715471}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24434":{"gid":24434,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/966976592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":966976592},{"type":"v1","addr":"172.21.15.179:6835","nonce":966976592}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24439":{"gid":24439,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.181:6837/3875964154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3875964154},{"type":"v1","addr":"172.21.15.181:6837","nonce":3875964154}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24457":{"gid":24457,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.181:6839/996120687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":996120687},{"type":"v1","addr":"172.21.15.181:6839","nonce":996120687}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6837/837402830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":837402830},{"type":"v1","addr":"172.21.15.179:6837","nonce":837402830}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6839/754762785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":754762785},{"type":"v1","addr":"172.21.15.179:6839","nonce":754762785}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-31T05:13:02.730 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 28 2024-01-31T05:13:02.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.728+0000 7f5d6a97c640 1 -- 172.21.15.99:0/1292935449 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f5d500a1360 msgr2=0x7f5d500a3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:02.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.728+0000 7f5d6a97c640 1 --2- 172.21.15.99:0/1292935449 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f5d500a1360 0x7f5d500a3820 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5d64068e70 tx=0x7f5d54005f90 comp rx=0 tx=0).stop 2024-01-31T05:13:02.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.728+0000 7f5d6a97c640 1 -- 172.21.15.99:0/1292935449 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d64101810 msgr2=0x7f5d6419d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:02.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.728+0000 7f5d6a97c640 1 --2- 172.21.15.99:0/1292935449 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d64101810 0x7f5d6419d160 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c037040 tx=0x7f5d5c0093d0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.728+0000 7f5d6a97c640 1 -- 172.21.15.99:0/1292935449 shutdown_connections 2024-01-31T05:13:02.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.728+0000 7f5d6a97c640 1 --2- 172.21.15.99:0/1292935449 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f5d500a1360 0x7f5d500a3820 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.728+0000 7f5d6a97c640 1 --2- 172.21.15.99:0/1292935449 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d64101810 0x7f5d6419d160 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.728+0000 7f5d6a97c640 1 --2- 172.21.15.99:0/1292935449 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d64100e50 0x7f5d641960f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.728+0000 7f5d6a97c640 1 --2- 172.21.15.99:0/1292935449 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d64100140 0x7f5d64195bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.728+0000 7f5d6a97c640 1 -- 172.21.15.99:0/1292935449 >> 172.21.15.99:0/1292935449 conn(0x7f5d640fa8d0 msgr2=0x7f5d64104150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:02.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.728+0000 7f5d6a97c640 1 -- 172.21.15.99:0/1292935449 shutdown_connections 2024-01-31T05:13:02.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.728+0000 7f5d6a97c640 1 -- 172.21.15.99:0/1292935449 wait complete. 2024-01-31T05:13:02.741 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-01-31T05:13:02.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.847+0000 7f15a5c21640 1 -- 172.21.15.99:0/783631749 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15a01017a0 msgr2=0x7f15a0108030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:02.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.847+0000 7f15a5c21640 1 --2- 172.21.15.99:0/783631749 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15a01017a0 0x7f15a0108030 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f1598009ca0 tx=0x7f159802c0f0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.847+0000 7f15a5c21640 1 -- 172.21.15.99:0/783631749 shutdown_connections 2024-01-31T05:13:02.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.847+0000 7f15a5c21640 1 --2- 172.21.15.99:0/783631749 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15a01017a0 0x7f15a0108030 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.847+0000 7f15a5c21640 1 --2- 172.21.15.99:0/783631749 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15a0100de0 0x7f15a0101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.847+0000 7f15a5c21640 1 --2- 172.21.15.99:0/783631749 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15a00ffbf0 0x7f15a0100010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.847+0000 7f15a5c21640 1 -- 172.21.15.99:0/783631749 >> 172.21.15.99:0/783631749 conn(0x7f15a00fb180 msgr2=0x7f15a00fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:02.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.847+0000 7f15a5c21640 1 -- 172.21.15.99:0/783631749 shutdown_connections 2024-01-31T05:13:02.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.847+0000 7f15a5c21640 1 -- 172.21.15.99:0/783631749 wait complete. 2024-01-31T05:13:02.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.847+0000 7f15a5c21640 1 Processor -- start 2024-01-31T05:13:02.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.848+0000 7f15a5c21640 1 -- start start 2024-01-31T05:13:02.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.848+0000 7f15a5c21640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15a00ffbf0 0x7f15a0195ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:02.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.848+0000 7f15a5c21640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15a0100de0 0x7f15a0196000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:02.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.848+0000 7f15a5c21640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15a01017a0 0x7f15a019d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:02.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.848+0000 7f15a5c21640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a019d5b0 con 0x7f15a00ffbf0 2024-01-31T05:13:02.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.848+0000 7f15a5c21640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a019d720 con 0x7f15a01017a0 2024-01-31T05:13:02.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.848+0000 7f15a5c21640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a019d8e0 con 0x7f15a0100de0 2024-01-31T05:13:02.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.848+0000 7f159f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15a00ffbf0 0x7f15a0195ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:02.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.848+0000 7f159f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15a00ffbf0 0x7f15a0195ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47046/0 (socket says 172.21.15.99:47046) 2024-01-31T05:13:02.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.848+0000 7f159f7fe640 1 -- 172.21.15.99:0/1447815791 learned_addr learned my addr 172.21.15.99:0/1447815791 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:02.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.848+0000 7f159ffff640 1 --2- 172.21.15.99:0/1447815791 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15a01017a0 0x7f15a019d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:02.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.848+0000 7f159f7fe640 1 -- 172.21.15.99:0/1447815791 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15a0100de0 msgr2=0x7f15a0196000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:02.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.848+0000 7f159f7fe640 1 --2- 172.21.15.99:0/1447815791 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15a0100de0 0x7f15a0196000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.848+0000 7f159f7fe640 1 -- 172.21.15.99:0/1447815791 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15a01017a0 msgr2=0x7f15a019d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:02.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.848+0000 7f159f7fe640 1 --2- 172.21.15.99:0/1447815791 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15a01017a0 0x7f15a019d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.848+0000 7f159f7fe640 1 -- 172.21.15.99:0/1447815791 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1598009900 con 0x7f15a00ffbf0 2024-01-31T05:13:02.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.848+0000 7f159f7fe640 1 --2- 172.21.15.99:0/1447815791 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15a00ffbf0 0x7f15a0195ac0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f1590007b50 tx=0x7f159000e420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:02.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.849+0000 7f159cff9640 1 -- 172.21.15.99:0/1447815791 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1590011070 con 0x7f15a00ffbf0 2024-01-31T05:13:02.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.849+0000 7f159cff9640 1 -- 172.21.15.99:0/1447815791 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f159000c2e0 con 0x7f15a00ffbf0 2024-01-31T05:13:02.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.849+0000 7f15a5c21640 1 -- 172.21.15.99:0/1447815791 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15a0067eb0 con 0x7f15a00ffbf0 2024-01-31T05:13:02.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.849+0000 7f159cff9640 1 -- 172.21.15.99:0/1447815791 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159000ab40 con 0x7f15a00ffbf0 2024-01-31T05:13:02.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.849+0000 7f15a5c21640 1 -- 172.21.15.99:0/1447815791 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15a00683c0 con 0x7f15a00ffbf0 2024-01-31T05:13:02.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.851+0000 7f159cff9640 1 -- 172.21.15.99:0/1447815791 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 20) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f159000aca0 con 0x7f15a00ffbf0 2024-01-31T05:13:02.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.851+0000 7f15a89df740 1 Processor -- start 2024-01-31T05:13:02.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.851+0000 7f159cff9640 1 --2- 172.21.15.99:0/1447815791 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f15880a12e0 0x7f15880a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:02.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.851+0000 7f15a89df740 1 -- start start 2024-01-31T05:13:02.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.851+0000 7f15a89df740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561bb94e1f10 0x561bb94e2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:02.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.851+0000 7f15a89df740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561bb94e2900 0x561bb94e7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:02.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.851+0000 7f159ffff640 1 --2- 172.21.15.99:0/1447815791 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f15880a12e0 0x7f15880a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:02.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.851+0000 7f15a89df740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561bb94e7a70 0x561bb94e9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:02.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.851+0000 7f15a89df740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bb9450240 con 0x561bb94e7a70 2024-01-31T05:13:02.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.851+0000 7f15a89df740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bb944d930 con 0x561bb94e1f10 2024-01-31T05:13:02.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.851+0000 7f15a89df740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bb9449220 con 0x561bb94e2900 2024-01-31T05:13:02.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.851+0000 7f159cff9640 1 -- 172.21.15.99:0/1447815791 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f15900ce010 con 0x7f15a00ffbf0 2024-01-31T05:13:02.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.852+0000 7f159ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561bb94e7a70 0x561bb94e9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:02.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.852+0000 7f159ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561bb94e7a70 0x561bb94e9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47050/0 (socket says 172.21.15.99:47050) 2024-01-31T05:13:02.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.852+0000 7f159ffff640 1 -- 172.21.15.99:0/2010058033 learned_addr learned my addr 172.21.15.99:0/2010058033 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:02.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.852+0000 7f159f7fe640 1 --2- 172.21.15.99:0/2010058033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561bb94e1f10 0x561bb94e2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:02.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.852+0000 7f159effd640 1 --2- 172.21.15.99:0/2010058033 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561bb94e2900 0x561bb94e7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:02.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.852+0000 7f159ffff640 1 -- 172.21.15.99:0/2010058033 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561bb94e2900 msgr2=0x561bb94e7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:02.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.852+0000 7f159ffff640 1 --2- 172.21.15.99:0/2010058033 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561bb94e2900 0x561bb94e7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.852+0000 7f159ffff640 1 -- 172.21.15.99:0/2010058033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561bb94e1f10 msgr2=0x561bb94e2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:02.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.852+0000 7f159ffff640 1 --2- 172.21.15.99:0/2010058033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561bb94e1f10 0x561bb94e2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.852+0000 7f159ffff640 1 -- 172.21.15.99:0/2010058033 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561bb940b7c0 con 0x561bb94e7a70 2024-01-31T05:13:02.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.852+0000 7f159effd640 1 --2- 172.21.15.99:0/2010058033 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561bb94e2900 0x561bb94e7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:13:02.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.852+0000 7f159f7fe640 1 --2- 172.21.15.99:0/2010058033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561bb94e1f10 0x561bb94e2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:13:02.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.852+0000 7f159ffff640 1 --2- 172.21.15.99:0/1447815791 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f15880a12e0 0x7f15880a37a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1598032520 tx=0x7f1598032470 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:02.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.852+0000 7f159ffff640 1 --2- 172.21.15.99:0/2010058033 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561bb94e7a70 0x561bb94e9f00 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f15980325c0 tx=0x7f1598048000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a5acd0d752e8145 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:02.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.852+0000 7f1585ffb640 1 -- 172.21.15.99:0/2010058033 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1598048070 con 0x561bb94e7a70 2024-01-31T05:13:02.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.852+0000 7f1585ffb640 1 -- 172.21.15.99:0/2010058033 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1598034e40 con 0x561bb94e7a70 2024-01-31T05:13:02.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.852+0000 7f1585ffb640 1 -- 172.21.15.99:0/2010058033 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1598004570 con 0x561bb94e7a70 2024-01-31T05:13:02.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.853+0000 7f15a89df740 1 -- 172.21.15.99:0/2010058033 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561bb94e7a70 msgr2=0x561bb94e9f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:02.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.853+0000 7f15a89df740 1 --2- 172.21.15.99:0/2010058033 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561bb94e7a70 0x561bb94e9f00 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f15980325c0 tx=0x7f1598048000 comp rx=0 tx=0).stop 2024-01-31T05:13:02.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.853+0000 7f15a89df740 1 -- 172.21.15.99:0/2010058033 shutdown_connections 2024-01-31T05:13:02.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.853+0000 7f15a89df740 1 --2- 172.21.15.99:0/2010058033 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561bb94e7a70 0x561bb94e9f00 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.853+0000 7f15a89df740 1 --2- 172.21.15.99:0/2010058033 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561bb94e2900 0x561bb94e7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.853+0000 7f15a89df740 1 --2- 172.21.15.99:0/2010058033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561bb94e1f10 0x561bb94e2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.853+0000 7f15a89df740 1 -- 172.21.15.99:0/2010058033 >> 172.21.15.99:0/2010058033 conn(0x561bb94dd480 msgr2=0x561bb94dd880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:02.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.853+0000 7f15a89df740 1 -- 172.21.15.99:0/2010058033 shutdown_connections 2024-01-31T05:13:02.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.853+0000 7f15a89df740 1 -- 172.21.15.99:0/2010058033 wait complete. 2024-01-31T05:13:02.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.853+0000 7f15a89df740 1 -- start start 2024-01-31T05:13:02.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.853+0000 7f15a89df740 1 Processor -- start 2024-01-31T05:13:02.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.854+0000 7f15a89df740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561bb94e1f10 0x561bb94ec110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:02.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.854+0000 7f15a89df740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561bb94e2900 0x561bb94ec650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:02.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.854+0000 7f15a89df740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561bb94e7a70 0x561bb94f3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:02.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.854+0000 7f15a89df740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bb94025e0 con 0x561bb94e2900 2024-01-31T05:13:02.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.854+0000 7f15a89df740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bb9402280 con 0x561bb94e7a70 2024-01-31T05:13:02.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.854+0000 7f15a89df740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bb93c73d0 con 0x561bb94e1f10 2024-01-31T05:13:02.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.854+0000 7f15a89df740 10 client.0 _ll_register_callbacks cb 0x561bb943feb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:13:02.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.854+0000 7f159effd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561bb94e2900 0x561bb94ec650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:02.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.854+0000 7f159effd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561bb94e2900 0x561bb94ec650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47062/0 (socket says 172.21.15.99:47062) 2024-01-31T05:13:02.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.854+0000 7f159effd640 1 -- 172.21.15.99:0/2886263535 learned_addr learned my addr 172.21.15.99:0/2886263535 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:02.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.854+0000 7f159ffff640 1 --2- 172.21.15.99:0/2886263535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561bb94e7a70 0x561bb94f3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:02.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.854+0000 7f159f7fe640 1 --2- 172.21.15.99:0/2886263535 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561bb94e1f10 0x561bb94ec110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:02.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.854+0000 7f159effd640 1 -- 172.21.15.99:0/2886263535 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561bb94e1f10 msgr2=0x561bb94ec110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:02.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.854+0000 7f159effd640 1 --2- 172.21.15.99:0/2886263535 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561bb94e1f10 0x561bb94ec110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.854+0000 7f159effd640 1 -- 172.21.15.99:0/2886263535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561bb94e7a70 msgr2=0x561bb94f3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:02.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.854+0000 7f159effd640 1 --2- 172.21.15.99:0/2886263535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561bb94e7a70 0x561bb94f3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.854+0000 7f159effd640 1 -- 172.21.15.99:0/2886263535 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15a0108930 con 0x561bb94e2900 2024-01-31T05:13:02.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.854+0000 7f159ffff640 1 --2- 172.21.15.99:0/2886263535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561bb94e7a70 0x561bb94f3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:13:02.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.854+0000 7f159f7fe640 1 --2- 172.21.15.99:0/2886263535 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561bb94e1f10 0x561bb94ec110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:13:02.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.854+0000 7f159effd640 1 --2- 172.21.15.99:0/2886263535 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561bb94e2900 0x561bb94ec650 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f159400be00 tx=0x7f159400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=102574ccd598fc79 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:02.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.854+0000 7f157effd640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:13:02.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.854+0000 7f157effd640 1 -- 172.21.15.99:0/2886263535 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1594005220 con 0x561bb94e2900 2024-01-31T05:13:02.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.854+0000 7f157effd640 1 -- 172.21.15.99:0/2886263535 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f1594005380 con 0x561bb94e2900 2024-01-31T05:13:02.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.854+0000 7f15a89df740 1 -- 172.21.15.99:0/2886263535 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561bb94420b0 con 0x561bb94e2900 2024-01-31T05:13:02.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.855+0000 7f157effd640 1 -- 172.21.15.99:0/2886263535 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1594005540 con 0x561bb94e2900 2024-01-31T05:13:02.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.855+0000 7f15a89df740 10 client.15933 fetch_fsmap learned FSMap version 28 2024-01-31T05:13:02.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.855+0000 7f15a89df740 1 -- 172.21.15.99:0/2886263535 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x561bb94478a0 con 0x561bb94e2900 2024-01-31T05:13:02.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.855+0000 7f157effd640 1 -- 172.21.15.99:0/2886263535 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561bb94420b0 con 0x561bb94e2900 2024-01-31T05:13:02.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.855+0000 7f157effd640 1 -- 172.21.15.99:0/2886263535 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 28) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f1594011860 con 0x561bb94e2900 2024-01-31T05:13:02.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.855+0000 7f15a89df740 10 client.15933 fetch_fsmap finished waiting for FSMap version 28 2024-01-31T05:13:02.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.855+0000 7f15a89df740 10 client.15933 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-01-31T05:13:02.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.855+0000 7f15a89df740 20 client.15933 populate_metadata read hostname 'smithi099' 2024-01-31T05:13:02.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.855+0000 7f15a89df740 1 --2- 172.21.15.99:0/2886263535 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x561bb94f80d0 0x561bb94fa4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:02.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.855+0000 7f15a89df740 4 client.15933 mds_command: new command op to 14619 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:13:02.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.855+0000 7f15a89df740 1 -- 172.21.15.99:0/2886263535 --> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561bb9441dd0 con 0x561bb94f80d0 2024-01-31T05:13:02.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.855+0000 7f159f7fe640 1 --2- 172.21.15.99:0/2886263535 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x561bb94f80d0 0x561bb94fa4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:02.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.855+0000 7f157effd640 10 client.15933 ms_handle_connect on v2:172.21.15.99:6840/3069939345 2024-01-31T05:13:02.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.856+0000 7f159f7fe640 1 --2- 172.21.15.99:0/2886263535 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x561bb94f80d0 0x561bb94fa4f0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f4a3cd91098e6bfd server_cookie=60abe121e5e4e396 in_seq=0 out_seq=0 2024-01-31T05:13:02.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.856+0000 7f157effd640 1 -- 172.21.15.99:0/2886263535 <== mds.4 v2:172.21.15.99:6840/3069939345 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561bb9441dd0 con 0x561bb94f80d0 2024-01-31T05:13:02.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.856+0000 7f157effd640 10 client.15933 handle_command_reply: tid=0 2024-01-31T05:13:02.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.856+0000 7f15a89df740 1 client.15933 shutdown 2024-01-31T05:13:02.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.856+0000 7f15a89df740 1 -- 172.21.15.99:0/2886263535 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561bb94e2900 msgr2=0x561bb94ec650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:02.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.856+0000 7f15a89df740 1 --2- 172.21.15.99:0/2886263535 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561bb94e2900 0x561bb94ec650 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f159400be00 tx=0x7f159400f730 comp rx=0 tx=0).stop 2024-01-31T05:13:02.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.856+0000 7f15a89df740 1 -- 172.21.15.99:0/2886263535 shutdown_connections 2024-01-31T05:13:02.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.856+0000 7f15a89df740 1 --2- 172.21.15.99:0/2886263535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561bb94e7a70 0x561bb94f3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.856+0000 7f15a89df740 1 --2- 172.21.15.99:0/2886263535 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x561bb94f80d0 0x561bb94fa4f0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.856+0000 7f157effd640 0 client.15933 ms_handle_reset on v2:172.21.15.99:6840/3069939345 2024-01-31T05:13:02.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.856+0000 7f15a89df740 1 --2- 172.21.15.99:0/2886263535 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561bb94e2900 0x561bb94ec650 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.856+0000 7f15a89df740 1 --2- 172.21.15.99:0/2886263535 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561bb94e1f10 0x561bb94ec110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.856+0000 7f15a89df740 1 -- 172.21.15.99:0/2886263535 >> 172.21.15.99:0/2886263535 conn(0x561bb94dd480 msgr2=0x561bb94dc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:02.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.856+0000 7f15a89df740 1 -- 172.21.15.99:0/2886263535 shutdown_connections 2024-01-31T05:13:02.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.856+0000 7f15a89df740 1 -- 172.21.15.99:0/2886263535 wait complete. 2024-01-31T05:13:02.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.857+0000 7f15a89df740 20 client.15933 trim_cache size 0 max 16384 2024-01-31T05:13:02.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.868+0000 7f15a89df740 1 Processor -- start 2024-01-31T05:13:02.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.868+0000 7f15a89df740 1 -- start start 2024-01-31T05:13:02.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.868+0000 7f15a89df740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561bb94e1f10 0x561bb94ec110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:02.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.868+0000 7f15a89df740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561bb94e2900 0x561bb94ec650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:02.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.868+0000 7f15a89df740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561bb94e7a70 0x561bb94f3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:02.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.868+0000 7f15a89df740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bb94420b0 con 0x561bb94e7a70 2024-01-31T05:13:02.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.868+0000 7f15a89df740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bb94ed290 con 0x561bb94e1f10 2024-01-31T05:13:02.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.868+0000 7f15a89df740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bb94f65b0 con 0x561bb94e2900 2024-01-31T05:13:02.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.868+0000 7f159ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561bb94e7a70 0x561bb94f3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:02.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.868+0000 7f159ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561bb94e7a70 0x561bb94f3650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47074/0 (socket says 172.21.15.99:47074) 2024-01-31T05:13:02.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.868+0000 7f159ffff640 1 -- 172.21.15.99:0/4281917524 learned_addr learned my addr 172.21.15.99:0/4281917524 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:02.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.868+0000 7f159f7fe640 1 --2- 172.21.15.99:0/4281917524 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561bb94e1f10 0x561bb94ec110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:02.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.869+0000 7f159ffff640 1 -- 172.21.15.99:0/4281917524 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561bb94e2900 msgr2=0x561bb94ec650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:02.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.869+0000 7f159effd640 1 --2- 172.21.15.99:0/4281917524 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561bb94e2900 0x561bb94ec650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:02.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.869+0000 7f159ffff640 1 --2- 172.21.15.99:0/4281917524 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561bb94e2900 0x561bb94ec650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.869+0000 7f159ffff640 1 -- 172.21.15.99:0/4281917524 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561bb94e1f10 msgr2=0x561bb94ec110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:02.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.869+0000 7f159ffff640 1 --2- 172.21.15.99:0/4281917524 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561bb94e1f10 0x561bb94ec110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.869+0000 7f159ffff640 1 -- 172.21.15.99:0/4281917524 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561bb93e44d0 con 0x561bb94e7a70 2024-01-31T05:13:02.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.869+0000 7f159effd640 1 --2- 172.21.15.99:0/4281917524 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561bb94e2900 0x561bb94ec650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:13:02.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.869+0000 7f159ffff640 1 --2- 172.21.15.99:0/4281917524 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561bb94e7a70 0x561bb94f3650 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f159802c700 tx=0x7f159802e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f37dfe02db6ac1c4 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:02.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.869+0000 7f15857fa640 1 -- 172.21.15.99:0/4281917524 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1598003b70 con 0x561bb94e7a70 2024-01-31T05:13:02.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.869+0000 7f15857fa640 1 -- 172.21.15.99:0/4281917524 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1598053070 con 0x561bb94e7a70 2024-01-31T05:13:02.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.869+0000 7f15857fa640 1 -- 172.21.15.99:0/4281917524 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1598043630 con 0x561bb94e7a70 2024-01-31T05:13:02.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.870+0000 7f15a89df740 1 -- 172.21.15.99:0/4281917524 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561bb94e7a70 msgr2=0x561bb94f3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:02.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.870+0000 7f15a89df740 1 --2- 172.21.15.99:0/4281917524 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561bb94e7a70 0x561bb94f3650 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f159802c700 tx=0x7f159802e040 comp rx=0 tx=0).stop 2024-01-31T05:13:02.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.870+0000 7f15a89df740 1 -- 172.21.15.99:0/4281917524 shutdown_connections 2024-01-31T05:13:02.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.870+0000 7f15a89df740 1 --2- 172.21.15.99:0/4281917524 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561bb94e7a70 0x561bb94f3650 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.870+0000 7f15a89df740 1 --2- 172.21.15.99:0/4281917524 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561bb94e2900 0x561bb94ec650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.870+0000 7f15a89df740 1 --2- 172.21.15.99:0/4281917524 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561bb94e1f10 0x561bb94ec110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.870+0000 7f15a89df740 1 -- 172.21.15.99:0/4281917524 >> 172.21.15.99:0/4281917524 conn(0x561bb94dd480 msgr2=0x561bb94eac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:02.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.870+0000 7f15a89df740 1 -- 172.21.15.99:0/4281917524 shutdown_connections 2024-01-31T05:13:02.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.870+0000 7f15a89df740 1 -- 172.21.15.99:0/4281917524 wait complete. 2024-01-31T05:13:02.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.870+0000 7f15a89df740 1 -- start start 2024-01-31T05:13:02.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.870+0000 7f15a89df740 1 Processor -- start 2024-01-31T05:13:02.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.871+0000 7f15a89df740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561bb94e1f10 0x561bb94f31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:02.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.871+0000 7f15a89df740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561bb94e2900 0x561bb94f1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:02.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.871+0000 7f15a89df740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561bb94e7a70 0x561bb94f1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:02.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.871+0000 7f15a89df740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bb94f39d0 con 0x561bb94e7a70 2024-01-31T05:13:02.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.871+0000 7f15a89df740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bb94f22c0 con 0x561bb94e1f10 2024-01-31T05:13:02.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.871+0000 7f15a89df740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bb94f2430 con 0x561bb94e2900 2024-01-31T05:13:02.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.871+0000 7f15a89df740 10 client.0 _ll_register_callbacks cb 0x7f1598009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:13:02.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.871+0000 7f159ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561bb94e7a70 0x561bb94f1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:02.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.871+0000 7f159ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561bb94e7a70 0x561bb94f1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47082/0 (socket says 172.21.15.99:47082) 2024-01-31T05:13:02.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.871+0000 7f159ffff640 1 -- 172.21.15.99:0/2817837064 learned_addr learned my addr 172.21.15.99:0/2817837064 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:02.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.871+0000 7f159effd640 1 --2- 172.21.15.99:0/2817837064 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561bb94e2900 0x561bb94f1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:02.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.871+0000 7f159f7fe640 1 --2- 172.21.15.99:0/2817837064 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561bb94e1f10 0x561bb94f31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:02.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.871+0000 7f159ffff640 1 -- 172.21.15.99:0/2817837064 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561bb94e2900 msgr2=0x561bb94f1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:02.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.871+0000 7f159ffff640 1 --2- 172.21.15.99:0/2817837064 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561bb94e2900 0x561bb94f1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.871+0000 7f159ffff640 1 -- 172.21.15.99:0/2817837064 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561bb94e1f10 msgr2=0x561bb94f31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:02.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.871+0000 7f159ffff640 1 --2- 172.21.15.99:0/2817837064 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561bb94e1f10 0x561bb94f31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.871+0000 7f159ffff640 1 -- 172.21.15.99:0/2817837064 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561bb940b7c0 con 0x561bb94e7a70 2024-01-31T05:13:02.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.871+0000 7f159effd640 1 --2- 172.21.15.99:0/2817837064 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561bb94e2900 0x561bb94f1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:13:02.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.871+0000 7f159ffff640 1 --2- 172.21.15.99:0/2817837064 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561bb94e7a70 0x561bb94f1d80 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f159802e010 tx=0x7f1598003dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c454d482296dc4c server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:02.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.871+0000 7f157effd640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:13:02.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.871+0000 7f157effd640 1 -- 172.21.15.99:0/2817837064 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1598048040 con 0x561bb94e7a70 2024-01-31T05:13:02.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.871+0000 7f15a89df740 1 -- 172.21.15.99:0/2817837064 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1598034e40 con 0x561bb94e7a70 2024-01-31T05:13:02.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.871+0000 7f157effd640 1 -- 172.21.15.99:0/2817837064 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f1598004450 con 0x561bb94e7a70 2024-01-31T05:13:02.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.871+0000 7f157effd640 1 -- 172.21.15.99:0/2817837064 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1598043430 con 0x561bb94e7a70 2024-01-31T05:13:02.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.871+0000 7f15a89df740 10 client.15939 fetch_fsmap learned FSMap version 28 2024-01-31T05:13:02.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.871+0000 7f15a89df740 1 -- 172.21.15.99:0/2817837064 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x561bb940a020 con 0x561bb94e7a70 2024-01-31T05:13:02.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.872+0000 7f157effd640 1 -- 172.21.15.99:0/2817837064 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1598034e40 con 0x561bb94e7a70 2024-01-31T05:13:02.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.872+0000 7f157effd640 1 -- 172.21.15.99:0/2817837064 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 28) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f1598057070 con 0x561bb94e7a70 2024-01-31T05:13:02.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.872+0000 7f15a89df740 10 client.15939 fetch_fsmap finished waiting for FSMap version 28 2024-01-31T05:13:02.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.872+0000 7f15a89df740 10 client.15939 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-01-31T05:13:02.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.872+0000 7f15a89df740 20 client.15939 populate_metadata read hostname 'smithi099' 2024-01-31T05:13:02.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.872+0000 7f15a89df740 1 --2- 172.21.15.99:0/2817837064 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x561bb954f740 0x561bb9551b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:02.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.872+0000 7f15a89df740 4 client.15939 mds_command: new command op to 14619 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-01-31T05:13:02.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.872+0000 7f15a89df740 1 -- 172.21.15.99:0/2817837064 --> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561bb91487e0 con 0x561bb954f740 2024-01-31T05:13:02.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.872+0000 7f159f7fe640 1 --2- 172.21.15.99:0/2817837064 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x561bb954f740 0x561bb9551b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:02.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.872+0000 7f159f7fe640 1 --2- 172.21.15.99:0/2817837064 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x561bb954f740 0x561bb9551b60 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=da22b55950d8a89d server_cookie=d09dec411d8ef444 in_seq=0 out_seq=0 2024-01-31T05:13:02.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.872+0000 7f157effd640 10 client.15939 ms_handle_connect on v2:172.21.15.99:6840/3069939345 2024-01-31T05:13:02.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.873+0000 7f157effd640 1 -- 172.21.15.99:0/2817837064 <== mds.4 v2:172.21.15.99:6840/3069939345 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x561bb91487e0 con 0x561bb954f740 2024-01-31T05:13:02.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.873+0000 7f157effd640 10 client.15939 handle_command_reply: tid=0 2024-01-31T05:13:02.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.873+0000 7f15a89df740 1 client.15939 shutdown 2024-01-31T05:13:02.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.873+0000 7f15a89df740 1 -- 172.21.15.99:0/2817837064 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561bb94e7a70 msgr2=0x561bb94f1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:02.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.873+0000 7f15a89df740 1 --2- 172.21.15.99:0/2817837064 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561bb94e7a70 0x561bb94f1d80 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f159802e010 tx=0x7f1598003dd0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.873+0000 7f15a89df740 1 -- 172.21.15.99:0/2817837064 shutdown_connections 2024-01-31T05:13:02.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.873+0000 7f15a89df740 1 --2- 172.21.15.99:0/2817837064 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x561bb954f740 0x561bb9551b60 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.873+0000 7f15a89df740 1 --2- 172.21.15.99:0/2817837064 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561bb94e7a70 0x561bb94f1d80 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.873+0000 7f15a89df740 1 --2- 172.21.15.99:0/2817837064 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561bb94e2900 0x561bb94f1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.873+0000 7f15a89df740 1 --2- 172.21.15.99:0/2817837064 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561bb94e1f10 0x561bb94f31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.873+0000 7f157effd640 0 client.15939 ms_handle_reset on v2:172.21.15.99:6840/3069939345 2024-01-31T05:13:02.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.873+0000 7f15a89df740 1 -- 172.21.15.99:0/2817837064 >> 172.21.15.99:0/2817837064 conn(0x561bb94dd480 msgr2=0x561bb94e3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:02.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.873+0000 7f15a89df740 1 -- 172.21.15.99:0/2817837064 shutdown_connections 2024-01-31T05:13:02.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.873+0000 7f15a89df740 1 -- 172.21.15.99:0/2817837064 wait complete. 2024-01-31T05:13:02.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.873+0000 7f15a89df740 20 client.15939 trim_cache size 0 max 16384 2024-01-31T05:13:02.966 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-01-31T05:13:02.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.873+0000 7f15a5c21640 1 -- 172.21.15.99:0/1447815791 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f15880a12e0 msgr2=0x7f15880a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:02.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.873+0000 7f15a5c21640 1 --2- 172.21.15.99:0/1447815791 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f15880a12e0 0x7f15880a37a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1598032520 tx=0x7f1598032470 comp rx=0 tx=0).stop 2024-01-31T05:13:02.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.874+0000 7f15a5c21640 1 -- 172.21.15.99:0/1447815791 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15a00ffbf0 msgr2=0x7f15a0195ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:02.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.874+0000 7f15a5c21640 1 --2- 172.21.15.99:0/1447815791 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15a00ffbf0 0x7f15a0195ac0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f1590007b50 tx=0x7f159000e420 comp rx=0 tx=0).stop 2024-01-31T05:13:02.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.874+0000 7f15a5c21640 1 -- 172.21.15.99:0/1447815791 shutdown_connections 2024-01-31T05:13:02.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.874+0000 7f15a5c21640 1 --2- 172.21.15.99:0/1447815791 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f15880a12e0 0x7f15880a37a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.874+0000 7f15a5c21640 1 --2- 172.21.15.99:0/1447815791 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15a01017a0 0x7f15a019d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.874+0000 7f15a5c21640 1 --2- 172.21.15.99:0/1447815791 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15a0100de0 0x7f15a0196000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.874+0000 7f15a5c21640 1 --2- 172.21.15.99:0/1447815791 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15a00ffbf0 0x7f15a0195ac0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:02.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.874+0000 7f15a5c21640 1 -- 172.21.15.99:0/1447815791 >> 172.21.15.99:0/1447815791 conn(0x7f15a00fb180 msgr2=0x7f15a01040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:02.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.874+0000 7f15a5c21640 1 -- 172.21.15.99:0/1447815791 shutdown_connections 2024-01-31T05:13:02.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:02.874+0000 7f15a5c21640 1 -- 172.21.15.99:0/1447815791 wait complete. 2024-01-31T05:13:02.969 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-01-31T05:13:02.982 INFO:tasks.workunit.client.0.smithi099.stderr:++ readlink -f fsstress 2024-01-31T05:13:02.982 INFO:tasks.workunit.client.0.smithi099.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-01-31T05:13:02.982 INFO:tasks.workunit.client.0.smithi099.stderr:+ popd 2024-01-31T05:13:02.982 INFO:tasks.workunit.client.0.smithi099.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-01-31T05:13:02.984 INFO:tasks.workunit.client.0.smithi099.stdout:~/cephtest/mnt.0/client.0/tmp 2024-01-31T05:13:02.984 INFO:tasks.workunit.client.0.smithi099.stderr:+ popd 2024-01-31T05:13:02.985 INFO:tasks.workunit.client.0.smithi099.stderr:++ mktemp -d -p . 2024-01-31T05:13:02.986 INFO:tasks.workunit.client.0.smithi099.stderr:+ T=./tmp.CwtY0f2R9N 2024-01-31T05:13:02.986 INFO:tasks.workunit.client.0.smithi099.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.CwtY0f2R9N -l 1 -n 1000 -p 10 -v 2024-01-31T05:13:02.987 INFO:tasks.workunit.client.0.smithi099.stdout:seed = 1706481846 2024-01-31T05:13:02.987 INFO:tasks.workunit.client.0.smithi099.stdout:1/0: write - no filename 2024-01-31T05:13:02.988 INFO:tasks.workunit.client.0.smithi099.stdout:1/1: truncate - no filename 2024-01-31T05:13:02.988 INFO:tasks.workunit.client.0.smithi099.stdout:1/2: chown . 387289442 1 2024-01-31T05:13:02.991 INFO:tasks.workunit.client.0.smithi099.stdout:0/0: creat f0 x:0 0 0 2024-01-31T05:13:02.991 INFO:tasks.workunit.client.0.smithi099.stdout:2/0: write - no filename 2024-01-31T05:13:02.991 INFO:tasks.workunit.client.0.smithi099.stdout:2/1: dwrite - no filename 2024-01-31T05:13:02.992 INFO:tasks.workunit.client.0.smithi099.stdout:1/3: mknod c0 0 2024-01-31T05:13:02.992 INFO:tasks.workunit.client.0.smithi099.stdout:1/4: fdatasync - no filename 2024-01-31T05:13:02.992 INFO:tasks.workunit.client.0.smithi099.stdout:1/5: write - no filename 2024-01-31T05:13:02.992 INFO:tasks.workunit.client.0.smithi099.stdout:0/1: mkdir d1 0 2024-01-31T05:13:02.992 INFO:tasks.workunit.client.0.smithi099.stdout:0/2: readlink - no filename 2024-01-31T05:13:02.993 INFO:tasks.workunit.client.0.smithi099.stdout:2/2: creat f0 x:0 0 0 2024-01-31T05:13:02.993 INFO:tasks.workunit.client.0.smithi099.stdout:2/3: dread - f0 zero size 2024-01-31T05:13:02.993 INFO:tasks.workunit.client.0.smithi099.stdout:1/6: creat f1 x:0 0 0 2024-01-31T05:13:02.994 INFO:tasks.workunit.client.0.smithi099.stdout:1/7: mkdir d2 0 2024-01-31T05:13:02.995 INFO:tasks.workunit.client.0.smithi099.stdout:4/0: mkdir d0 0 2024-01-31T05:13:02.995 INFO:tasks.workunit.client.0.smithi099.stdout:4/1: dread - no filename 2024-01-31T05:13:02.995 INFO:tasks.workunit.client.0.smithi099.stdout:4/2: dread - no filename 2024-01-31T05:13:02.995 INFO:tasks.workunit.client.0.smithi099.stdout:4/3: dwrite - no filename 2024-01-31T05:13:02.995 INFO:tasks.workunit.client.0.smithi099.stdout:4/4: chown d0 19 1 2024-01-31T05:13:02.995 INFO:tasks.workunit.client.0.smithi099.stdout:4/5: write - no filename 2024-01-31T05:13:02.996 INFO:tasks.workunit.client.0.smithi099.stdout:1/8: rmdir d2 0 2024-01-31T05:13:03.007 INFO:tasks.workunit.client.0.smithi099.stdout:5/0: symlink l0 0 2024-01-31T05:13:03.007 INFO:tasks.workunit.client.0.smithi099.stdout:5/1: fsync - no filename 2024-01-31T05:13:03.007 INFO:tasks.workunit.client.0.smithi099.stdout:5/2: fdatasync - no filename 2024-01-31T05:13:03.007 INFO:tasks.workunit.client.0.smithi099.stdout:5/3: write - no filename 2024-01-31T05:13:03.008 INFO:tasks.workunit.client.0.smithi099.stdout:7/0: dwrite - no filename 2024-01-31T05:13:03.008 INFO:tasks.workunit.client.0.smithi099.stdout:7/1: write - no filename 2024-01-31T05:13:03.010 INFO:tasks.workunit.client.0.smithi099.stdout:6/0: symlink l0 0 2024-01-31T05:13:03.019 INFO:tasks.workunit.client.0.smithi099.stdout:5/4: creat f1 x:0 0 0 2024-01-31T05:13:03.019 INFO:tasks.workunit.client.0.smithi099.stdout:5/5: chown f1 12557572 1 2024-01-31T05:13:03.019 INFO:tasks.workunit.client.0.smithi099.stdout:5/6: readlink l0 0 2024-01-31T05:13:03.019 INFO:tasks.workunit.client.0.smithi099.stdout:0/3: fsync f0 0 2024-01-31T05:13:03.021 INFO:tasks.workunit.client.0.smithi099.stdout:7/2: creat f0 x:0 0 0 2024-01-31T05:13:03.021 INFO:tasks.workunit.client.0.smithi099.stdout:7/3: fdatasync f0 0 2024-01-31T05:13:03.035 INFO:tasks.workunit.client.0.smithi099.stdout:6/1: creat f1 x:0 0 0 2024-01-31T05:13:03.035 INFO:tasks.workunit.client.0.smithi099.stdout:6/2: write f1 [675120,123337] 0 2024-01-31T05:13:03.035 INFO:tasks.workunit.client.0.smithi099.stdout:6/3: write f1 [1659801,67403] 0 2024-01-31T05:13:03.037 INFO:tasks.workunit.client.0.smithi099.stdout:8/0: dread - no filename 2024-01-31T05:13:03.037 INFO:tasks.workunit.client.0.smithi099.stdout:1/9: fsync f1 0 2024-01-31T05:13:03.039 INFO:tasks.workunit.client.0.smithi099.stdout:8/1: symlink l0 0 2024-01-31T05:13:03.039 INFO:tasks.workunit.client.0.smithi099.stdout:8/2: dread - no filename 2024-01-31T05:13:03.060 INFO:tasks.workunit.client.0.smithi099.stdout:8/3: mkdir d1 0 2024-01-31T05:13:03.060 INFO:tasks.workunit.client.0.smithi099.stdout:8/4: dread - no filename 2024-01-31T05:13:03.062 INFO:tasks.workunit.client.0.smithi099.stdout:6/4: read f1 [1643112,67177] 0 2024-01-31T05:13:03.062 INFO:tasks.workunit.client.0.smithi099.stdout:6/5: write f1 [1068692,119729] 0 2024-01-31T05:13:03.064 INFO:tasks.workunit.client.0.smithi099.stdout:9/0: dread - no filename 2024-01-31T05:13:03.064 INFO:tasks.workunit.client.0.smithi099.stdout:9/1: write - no filename 2024-01-31T05:13:03.064 INFO:tasks.workunit.client.0.smithi099.stdout:9/2: truncate - no filename 2024-01-31T05:13:03.064 INFO:tasks.workunit.client.0.smithi099.stdout:9/3: write - no filename 2024-01-31T05:13:03.064 INFO:tasks.workunit.client.0.smithi099.stdout:9/4: write - no filename 2024-01-31T05:13:03.074 INFO:tasks.workunit.client.0.smithi099.stdout:8/5: mknod d1/c2 0 2024-01-31T05:13:03.075 INFO:tasks.workunit.client.0.smithi099.stdout:8/6: chown d1 37 1 2024-01-31T05:13:03.075 INFO:tasks.workunit.client.0.smithi099.stdout:8/7: readlink l0 0 2024-01-31T05:13:03.083 INFO:tasks.workunit.client.0.smithi099.stdout:8/8: creat d1/f3 x:0 0 0 2024-01-31T05:13:03.083 INFO:tasks.workunit.client.0.smithi099.stdout:8/9: creat d1/f4 x:0 0 0 2024-01-31T05:13:03.083 INFO:tasks.workunit.client.0.smithi099.stdout:8/10: write d1/f3 [290821,74810] 0 2024-01-31T05:13:03.083 INFO:tasks.workunit.client.0.smithi099.stdout:8/11: creat d1/f5 x:0 0 0 2024-01-31T05:13:03.083 INFO:tasks.workunit.client.0.smithi099.stdout:8/12: write d1/f4 [113355,50484] 0 2024-01-31T05:13:03.083 INFO:tasks.workunit.client.0.smithi099.stdout:8/13: write d1/f4 [1088862,28516] 0 2024-01-31T05:13:03.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.177+0000 7fd3eb23e640 1 -- 172.21.15.99:0/1996544402 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3e4100680 msgr2=0x7fd3e4104f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:03.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.177+0000 7fd3eb23e640 1 --2- 172.21.15.99:0/1996544402 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3e4100680 0x7fd3e4104f40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4009860 tx=0x7fd3d402bb70 comp rx=0 tx=0).stop 2024-01-31T05:13:03.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.177+0000 7fd3eb23e640 1 -- 172.21.15.99:0/1996544402 shutdown_connections 2024-01-31T05:13:03.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.177+0000 7fd3eb23e640 1 --2- 172.21.15.99:0/1996544402 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3e4100680 0x7fd3e4104f40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.177+0000 7fd3eb23e640 1 --2- 172.21.15.99:0/1996544402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3e40ffce0 0x7fd3e4100140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.177+0000 7fd3eb23e640 1 --2- 172.21.15.99:0/1996544402 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3e40febb0 0x7fd3e40fefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.177+0000 7fd3eb23e640 1 -- 172.21.15.99:0/1996544402 >> 172.21.15.99:0/1996544402 conn(0x7fd3e40fa4b0 msgr2=0x7fd3e40fc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:03.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.179+0000 7fd3eb23e640 1 -- 172.21.15.99:0/1996544402 shutdown_connections 2024-01-31T05:13:03.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.181+0000 7fd3eb23e640 1 -- 172.21.15.99:0/1996544402 wait complete. 2024-01-31T05:13:03.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.182+0000 7fd3eb23e640 1 Processor -- start 2024-01-31T05:13:03.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.182+0000 7fd3eb23e640 1 -- start start 2024-01-31T05:13:03.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.182+0000 7fd3eb23e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3e40febb0 0x7fd3e40707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.182+0000 7fd3eb23e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3e40ffce0 0x7fd3e4070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.182+0000 7fd3eb23e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3e4100680 0x7fd3e4071d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.182+0000 7fd3eb23e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e4072270 con 0x7fd3e40ffce0 2024-01-31T05:13:03.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.182+0000 7fd3eb23e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e40723e0 con 0x7fd3e40febb0 2024-01-31T05:13:03.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.182+0000 7fd3eb23e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e40725a0 con 0x7fd3e4100680 2024-01-31T05:13:03.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.183+0000 7fd3e8fda640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3e40febb0 0x7fd3e40707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:03.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.183+0000 7fd3e8fda640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3e40febb0 0x7fd3e40707b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.99:47924/0 (socket says 172.21.15.99:47924) 2024-01-31T05:13:03.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.183+0000 7fd3e8fda640 1 -- 172.21.15.99:0/3519058477 learned_addr learned my addr 172.21.15.99:0/3519058477 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:03.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.185+0000 7fd3e97db640 1 --2- 172.21.15.99:0/3519058477 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3e4100680 0x7fd3e4071d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:03.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.185+0000 7fd3e3fff640 1 --2- 172.21.15.99:0/3519058477 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3e40ffce0 0x7fd3e4070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:03.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.186+0000 7fd3e3fff640 1 -- 172.21.15.99:0/3519058477 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3e4100680 msgr2=0x7fd3e4071d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:03.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.186+0000 7fd3e3fff640 1 --2- 172.21.15.99:0/3519058477 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3e4100680 0x7fd3e4071d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.186+0000 7fd3e3fff640 1 -- 172.21.15.99:0/3519058477 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3e40febb0 msgr2=0x7fd3e40707b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:03.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.186+0000 7fd3e3fff640 1 --2- 172.21.15.99:0/3519058477 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3e40febb0 0x7fd3e40707b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.186+0000 7fd3e3fff640 1 -- 172.21.15.99:0/3519058477 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d4009490 con 0x7fd3e40ffce0 2024-01-31T05:13:03.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.186+0000 7fd3e97db640 1 --2- 172.21.15.99:0/3519058477 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3e4100680 0x7fd3e4071d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:13:03.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.191+0000 7fd3e3fff640 1 --2- 172.21.15.99:0/3519058477 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3e40ffce0 0x7fd3e4070cf0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fd3d800e790 tx=0x7fd3d800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:03.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.192+0000 7fd3e1ffb640 1 -- 172.21.15.99:0/3519058477 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d800ccc0 con 0x7fd3e40ffce0 2024-01-31T05:13:03.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.192+0000 7fd3e1ffb640 1 -- 172.21.15.99:0/3519058477 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd3d800eea0 con 0x7fd3e40ffce0 2024-01-31T05:13:03.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.192+0000 7fd3e1ffb640 1 -- 172.21.15.99:0/3519058477 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d8018680 con 0x7fd3e40ffce0 2024-01-31T05:13:03.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.192+0000 7fd3eb23e640 1 -- 172.21.15.99:0/3519058477 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3e4072880 con 0x7fd3e40ffce0 2024-01-31T05:13:03.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.193+0000 7fd3eb23e640 1 -- 172.21.15.99:0/3519058477 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3e4072d40 con 0x7fd3e40ffce0 2024-01-31T05:13:03.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.196+0000 7fd3ee004740 1 Processor -- start 2024-01-31T05:13:03.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.200+0000 7fd3e1ffb640 1 -- 172.21.15.99:0/3519058477 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 20) v1 ==== 135895+0+0 (secure 0 0 0) 0x7fd3d80187e0 con 0x7fd3e40ffce0 2024-01-31T05:13:03.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.201+0000 7fd3e1ffb640 1 --2- 172.21.15.99:0/3519058477 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd3cc0a14b0 0x7fd3cc0a3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.202+0000 7fd3e1ffb640 1 -- 172.21.15.99:0/3519058477 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fd3d8014070 con 0x7fd3e40ffce0 2024-01-31T05:13:03.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.203+0000 7fd3e97db640 1 --2- 172.21.15.99:0/3519058477 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd3cc0a14b0 0x7fd3cc0a3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:03.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.203+0000 7fd3ee004740 1 -- start start 2024-01-31T05:13:03.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.203+0000 7fd3ee004740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0f3fc6f10 0x55a0f3fc7330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.203+0000 7fd3ee004740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a0f3fc7900 0x55a0f3fcc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.203+0000 7fd3ee004740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a0f3fcca70 0x55a0f3fcef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.203+0000 7fd3ee004740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0f3f35240 con 0x55a0f3fc6f10 2024-01-31T05:13:03.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.203+0000 7fd3ee004740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0f3f32930 con 0x55a0f3fcca70 2024-01-31T05:13:03.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.203+0000 7fd3ee004740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0f3f2e220 con 0x55a0f3fc7900 2024-01-31T05:13:03.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.205+0000 7fd3e8fda640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0f3fc6f10 0x55a0f3fc7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:03.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.205+0000 7fd3e8fda640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0f3fc6f10 0x55a0f3fc7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47118/0 (socket says 172.21.15.99:47118) 2024-01-31T05:13:03.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.205+0000 7fd3e8fda640 1 -- 172.21.15.99:0/3062824647 learned_addr learned my addr 172.21.15.99:0/3062824647 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:03.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.206+0000 7fd3e97db640 1 --2- 172.21.15.99:0/3062824647 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a0f3fcca70 0x55a0f3fcef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:03.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.207+0000 7fd3e8fda640 1 -- 172.21.15.99:0/3062824647 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a0f3fc7900 msgr2=0x55a0f3fcc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:03.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.207+0000 7fd3e8fda640 1 --2- 172.21.15.99:0/3062824647 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a0f3fc7900 0x55a0f3fcc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.207+0000 7fd3e8fda640 1 -- 172.21.15.99:0/3062824647 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a0f3fcca70 msgr2=0x55a0f3fcef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:03.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.207+0000 7fd3e8fda640 1 --2- 172.21.15.99:0/3062824647 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a0f3fcca70 0x55a0f3fcef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.207+0000 7fd3e8fda640 1 -- 172.21.15.99:0/3062824647 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0f3ef07c0 con 0x55a0f3fc6f10 2024-01-31T05:13:03.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.207+0000 7fd3e97db640 1 --2- 172.21.15.99:0/3062824647 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a0f3fcca70 0x55a0f3fcef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:13:03.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.208+0000 7fd3e8fda640 1 --2- 172.21.15.99:0/3062824647 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0f3fc6f10 0x55a0f3fc7330 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc011490 tx=0x7fd3dc011950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce2ec5eb88d01c8e server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:03.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.208+0000 7fd3caffd640 1 -- 172.21.15.99:0/3062824647 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc012770 con 0x55a0f3fc6f10 2024-01-31T05:13:03.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.208+0000 7fd3caffd640 1 -- 172.21.15.99:0/3062824647 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd3dc012d90 con 0x55a0f3fc6f10 2024-01-31T05:13:03.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.209+0000 7fd3ee004740 1 -- 172.21.15.99:0/3062824647 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0f3fc6f10 msgr2=0x55a0f3fc7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:03.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.209+0000 7fd3ee004740 1 --2- 172.21.15.99:0/3062824647 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0f3fc6f10 0x55a0f3fc7330 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc011490 tx=0x7fd3dc011950 comp rx=0 tx=0).stop 2024-01-31T05:13:03.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.210+0000 7fd3e97db640 1 --2- 172.21.15.99:0/3519058477 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd3cc0a14b0 0x7fd3cc0a3970 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd3d402c180 tx=0x7fd3d4032480 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:03.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.213+0000 7fd3ee004740 1 -- 172.21.15.99:0/3062824647 shutdown_connections 2024-01-31T05:13:03.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.213+0000 7fd3ee004740 1 --2- 172.21.15.99:0/3062824647 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a0f3fcca70 0x55a0f3fcef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.213+0000 7fd3ee004740 1 --2- 172.21.15.99:0/3062824647 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a0f3fc7900 0x55a0f3fcc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.213+0000 7fd3ee004740 1 --2- 172.21.15.99:0/3062824647 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0f3fc6f10 0x55a0f3fc7330 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.213+0000 7fd3ee004740 1 -- 172.21.15.99:0/3062824647 >> 172.21.15.99:0/3062824647 conn(0x55a0f3fc2480 msgr2=0x55a0f3fc2880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:03.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.215+0000 7fd3ee004740 1 -- 172.21.15.99:0/3062824647 shutdown_connections 2024-01-31T05:13:03.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.216+0000 7fd3ee004740 1 -- 172.21.15.99:0/3062824647 wait complete. 2024-01-31T05:13:03.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.216+0000 7fd3ee004740 1 -- start start 2024-01-31T05:13:03.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.216+0000 7fd3ee004740 1 Processor -- start 2024-01-31T05:13:03.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.217+0000 7fd3ee004740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0f3fc6f10 0x55a0f3fd1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.217+0000 7fd3ee004740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a0f3fc7900 0x55a0f3fd1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.217+0000 7fd3ee004740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a0f3fcca70 0x55a0f3fd86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.217+0000 7fd3ee004740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0f3ee75e0 con 0x55a0f3fc6f10 2024-01-31T05:13:03.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.217+0000 7fd3ee004740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0f3ee7280 con 0x55a0f3fc7900 2024-01-31T05:13:03.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.217+0000 7fd3ee004740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0f3eac3d0 con 0x55a0f3fcca70 2024-01-31T05:13:03.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.217+0000 7fd3ee004740 10 client.0 _ll_register_callbacks cb 0x55a0f3f24eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:13:03.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.218+0000 7fd3e8fda640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0f3fc6f10 0x55a0f3fd1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:03.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.218+0000 7fd3e8fda640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0f3fc6f10 0x55a0f3fd1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47132/0 (socket says 172.21.15.99:47132) 2024-01-31T05:13:03.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.218+0000 7fd3e8fda640 1 -- 172.21.15.99:0/2482620044 learned_addr learned my addr 172.21.15.99:0/2482620044 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:03.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.218+0000 7fd3e8fda640 1 -- 172.21.15.99:0/2482620044 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a0f3fcca70 msgr2=0x55a0f3fd86b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-01-31T05:13:03.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.218+0000 7fd3e8fda640 1 --2- 172.21.15.99:0/2482620044 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a0f3fcca70 0x55a0f3fd86b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.218+0000 7fd3e8fda640 1 -- 172.21.15.99:0/2482620044 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a0f3fc7900 msgr2=0x55a0f3fd1670 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-01-31T05:13:03.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.218+0000 7fd3e8fda640 1 --2- 172.21.15.99:0/2482620044 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a0f3fc7900 0x55a0f3fd1670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.218+0000 7fd3e8fda640 1 -- 172.21.15.99:0/2482620044 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3dc009cd0 con 0x55a0f3fc6f10 2024-01-31T05:13:03.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.218+0000 7fd3e8fda640 1 --2- 172.21.15.99:0/2482620044 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0f3fc6f10 0x55a0f3fd1130 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc01c040 tx=0x7fd3dc01a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47e1b6c9c7c94313 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:03.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.219+0000 7fd3c87f8640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:13:03.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.219+0000 7fd3c87f8640 1 -- 172.21.15.99:0/2482620044 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc003d80 con 0x55a0f3fc6f10 2024-01-31T05:13:03.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.219+0000 7fd3c87f8640 1 -- 172.21.15.99:0/2482620044 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fd3dc012570 con 0x55a0f3fc6f10 2024-01-31T05:13:03.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.219+0000 7fd3ee004740 1 -- 172.21.15.99:0/2482620044 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a0f3f270b0 con 0x55a0f3fc6f10 2024-01-31T05:13:03.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.220+0000 7fd3c87f8640 1 -- 172.21.15.99:0/2482620044 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd3dc012730 con 0x55a0f3fc6f10 2024-01-31T05:13:03.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.220+0000 7fd3ee004740 10 client.15951 fetch_fsmap learned FSMap version 28 2024-01-31T05:13:03.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.220+0000 7fd3ee004740 1 -- 172.21.15.99:0/2482620044 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55a0f3f2c8a0 con 0x55a0f3fc6f10 2024-01-31T05:13:03.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.230+0000 7fd3c87f8640 1 -- 172.21.15.99:0/2482620044 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a0f3f270b0 con 0x55a0f3fc6f10 2024-01-31T05:13:03.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.230+0000 7fd3c87f8640 1 -- 172.21.15.99:0/2482620044 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 28) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fd3dc022040 con 0x55a0f3fc6f10 2024-01-31T05:13:03.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.230+0000 7fd3ee004740 10 client.15951 fetch_fsmap finished waiting for FSMap version 28 2024-01-31T05:13:03.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.230+0000 7fd3ee004740 10 client.15951 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-01-31T05:13:03.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.230+0000 7fd3ee004740 20 client.15951 populate_metadata read hostname 'smithi099' 2024-01-31T05:13:03.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.230+0000 7fd3ee004740 1 --2- 172.21.15.99:0/2482620044 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x55a0f3fdcdc0 0x55a0f3fdf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.230+0000 7fd3ee004740 4 client.15951 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:13:03.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.230+0000 7fd3ee004740 1 -- 172.21.15.99:0/2482620044 --> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a0f3f26dd0 con 0x55a0f3fdcdc0 2024-01-31T05:13:03.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.231+0000 7fd3e3fff640 1 --2- 172.21.15.99:0/2482620044 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x55a0f3fdcdc0 0x55a0f3fdf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:03.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.239+0000 7fd3e3fff640 1 --2- 172.21.15.99:0/2482620044 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x55a0f3fdcdc0 0x55a0f3fdf280 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b1844241fe26b70 server_cookie=6eade570faaedf70 in_seq=0 out_seq=0 2024-01-31T05:13:03.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.239+0000 7fd3c87f8640 10 client.15951 ms_handle_connect on v2:172.21.15.181:6836/3875964154 2024-01-31T05:13:03.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.241+0000 7fd3c87f8640 1 -- 172.21.15.99:0/2482620044 <== mds.3 v2:172.21.15.181:6836/3875964154 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a0f3f26dd0 con 0x55a0f3fdcdc0 2024-01-31T05:13:03.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.241+0000 7fd3c87f8640 10 client.15951 handle_command_reply: tid=0 2024-01-31T05:13:03.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.242+0000 7fd3ee004740 1 client.15951 shutdown 2024-01-31T05:13:03.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.252+0000 7fd3ee004740 1 -- 172.21.15.99:0/2482620044 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0f3fc6f10 msgr2=0x55a0f3fd1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:03.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.252+0000 7fd3ee004740 1 --2- 172.21.15.99:0/2482620044 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0f3fc6f10 0x55a0f3fd1130 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc01c040 tx=0x7fd3dc01a620 comp rx=0 tx=0).stop 2024-01-31T05:13:03.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.255+0000 7fd3ee004740 1 -- 172.21.15.99:0/2482620044 shutdown_connections 2024-01-31T05:13:03.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.255+0000 7fd3ee004740 1 --2- 172.21.15.99:0/2482620044 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x55a0f3fdcdc0 0x55a0f3fdf280 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.255+0000 7fd3ee004740 1 --2- 172.21.15.99:0/2482620044 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a0f3fcca70 0x55a0f3fd86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.255+0000 7fd3ee004740 1 --2- 172.21.15.99:0/2482620044 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a0f3fc7900 0x55a0f3fd1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.255+0000 7fd3ee004740 1 --2- 172.21.15.99:0/2482620044 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0f3fc6f10 0x55a0f3fd1130 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.255+0000 7fd3ee004740 1 -- 172.21.15.99:0/2482620044 >> 172.21.15.99:0/2482620044 conn(0x55a0f3fc2480 msgr2=0x55a0f3fc17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:03.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.255+0000 7fd3c87f8640 0 client.15951 ms_handle_reset on v2:172.21.15.181:6836/3875964154 2024-01-31T05:13:03.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.257+0000 7fd3ee004740 1 -- 172.21.15.99:0/2482620044 shutdown_connections 2024-01-31T05:13:03.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.259+0000 7fd3ee004740 1 -- 172.21.15.99:0/2482620044 wait complete. 2024-01-31T05:13:03.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.261+0000 7fd3ee004740 20 client.15951 trim_cache size 0 max 16384 2024-01-31T05:13:03.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.293+0000 7fd3ee004740 1 Processor -- start 2024-01-31T05:13:03.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.293+0000 7fd3ee004740 1 -- start start 2024-01-31T05:13:03.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.296+0000 7fd3ee004740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a0f3fc6f10 0x55a0f3fc0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.296+0000 7fd3ee004740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0f3fc7900 0x55a0f3fd8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.296+0000 7fd3e8fda640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a0f3fc6f10 0x55a0f3fc0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:03.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.296+0000 7fd3e8fda640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a0f3fc6f10 0x55a0f3fc0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:48972/0 (socket says 172.21.15.99:48972) 2024-01-31T05:13:03.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.297+0000 7fd3e3fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0f3fc7900 0x55a0f3fd8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:03.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.297+0000 7fd3e3fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0f3fc7900 0x55a0f3fd8640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47140/0 (socket says 172.21.15.99:47140) 2024-01-31T05:13:03.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.297+0000 7fd3e8fda640 1 -- 172.21.15.99:0/2029866640 learned_addr learned my addr 172.21.15.99:0/2029866640 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:03.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.297+0000 7fd3ee004740 1 --2- 172.21.15.99:0/2029866640 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a0f3fcca70 0x55a0f3fc1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.297+0000 7fd3ee004740 1 -- 172.21.15.99:0/2029866640 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0f3fc8160 con 0x55a0f3fc7900 2024-01-31T05:13:03.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.297+0000 7fd3ee004740 1 -- 172.21.15.99:0/2029866640 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0f3fd21a0 con 0x55a0f3fcca70 2024-01-31T05:13:03.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.297+0000 7fd3ee004740 1 -- 172.21.15.99:0/2029866640 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0f3f26dd0 con 0x55a0f3fc6f10 2024-01-31T05:13:03.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.300+0000 7fd3e3fff640 1 -- 172.21.15.99:0/2029866640 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a0f3fc6f10 msgr2=0x55a0f3fc0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:03.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.300+0000 7fd3e3fff640 1 --2- 172.21.15.99:0/2029866640 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a0f3fc6f10 0x55a0f3fc0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.300+0000 7fd3e3fff640 1 -- 172.21.15.99:0/2029866640 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a0f3fcca70 msgr2=0x55a0f3fc1470 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-01-31T05:13:03.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.300+0000 7fd3e3fff640 1 --2- 172.21.15.99:0/2029866640 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a0f3fcca70 0x55a0f3fc1470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.300+0000 7fd3e3fff640 1 -- 172.21.15.99:0/2029866640 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0f3ec94d0 con 0x55a0f3fc7900 2024-01-31T05:13:03.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.300+0000 7fd3e3fff640 1 --2- 172.21.15.99:0/2029866640 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0f3fc7900 0x55a0f3fd8640 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x55a0f3fc8370 tx=0x7fd3d8099e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ba78cc63b78a2e6 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:03.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.301+0000 7fd3ca7fc640 1 -- 172.21.15.99:0/2029866640 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d8098050 con 0x55a0f3fc7900 2024-01-31T05:13:03.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.301+0000 7fd3ca7fc640 1 -- 172.21.15.99:0/2029866640 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd3d80ca6d0 con 0x55a0f3fc7900 2024-01-31T05:13:03.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.301+0000 7fd3ca7fc640 1 -- 172.21.15.99:0/2029866640 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d8095aa0 con 0x55a0f3fc7900 2024-01-31T05:13:03.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.302+0000 7fd3ee004740 1 -- 172.21.15.99:0/2029866640 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0f3fc7900 msgr2=0x55a0f3fd8640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:03.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.302+0000 7fd3ee004740 1 --2- 172.21.15.99:0/2029866640 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0f3fc7900 0x55a0f3fd8640 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x55a0f3fc8370 tx=0x7fd3d8099e30 comp rx=0 tx=0).stop 2024-01-31T05:13:03.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.305+0000 7fd3ee004740 1 -- 172.21.15.99:0/2029866640 shutdown_connections 2024-01-31T05:13:03.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.305+0000 7fd3ee004740 1 --2- 172.21.15.99:0/2029866640 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a0f3fcca70 0x55a0f3fc1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.305+0000 7fd3ee004740 1 --2- 172.21.15.99:0/2029866640 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0f3fc7900 0x55a0f3fd8640 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.305+0000 7fd3ee004740 1 --2- 172.21.15.99:0/2029866640 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a0f3fc6f10 0x55a0f3fc0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.305+0000 7fd3ee004740 1 -- 172.21.15.99:0/2029866640 >> 172.21.15.99:0/2029866640 conn(0x55a0f3fc2480 msgr2=0x55a0f3fc8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:03.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.308+0000 7fd3ee004740 1 -- 172.21.15.99:0/2029866640 shutdown_connections 2024-01-31T05:13:03.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.308+0000 7fd3ee004740 1 -- 172.21.15.99:0/2029866640 wait complete. 2024-01-31T05:13:03.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.309+0000 7fd3ee004740 1 -- start start 2024-01-31T05:13:03.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.309+0000 7fd3ee004740 1 Processor -- start 2024-01-31T05:13:03.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.309+0000 7fd3ee004740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a0f3fc6f10 0x55a0f3fd7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.310+0000 7fd3ee004740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a0f3fc7900 0x55a0f3fd7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.310+0000 7fd3ee004740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0f3fcca70 0x55a0f3fd7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.310+0000 7fd3ee004740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0f4033530 con 0x55a0f3fcca70 2024-01-31T05:13:03.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.310+0000 7fd3e97db640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0f3fcca70 0x55a0f3fd7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:03.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.310+0000 7fd3e97db640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0f3fcca70 0x55a0f3fd7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47148/0 (socket says 172.21.15.99:47148) 2024-01-31T05:13:03.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.310+0000 7fd3e97db640 1 -- 172.21.15.99:0/565504508 learned_addr learned my addr 172.21.15.99:0/565504508 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:03.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.310+0000 7fd3ee004740 1 -- 172.21.15.99:0/565504508 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0f40336a0 con 0x55a0f3fc6f10 2024-01-31T05:13:03.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.310+0000 7fd3ee004740 1 -- 172.21.15.99:0/565504508 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0f4033860 con 0x55a0f3fc7900 2024-01-31T05:13:03.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.310+0000 7fd3ee004740 10 client.0 _ll_register_callbacks cb 0x7fd3dc009b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:13:03.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.313+0000 7fd3e3fff640 1 --2- 172.21.15.99:0/565504508 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a0f3fc7900 0x55a0f3fd7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:03.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.313+0000 7fd3e8fda640 1 --2- 172.21.15.99:0/565504508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a0f3fc6f10 0x55a0f3fd7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:03.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.313+0000 7fd3e97db640 1 -- 172.21.15.99:0/565504508 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a0f3fc7900 msgr2=0x55a0f3fd7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:03.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.313+0000 7fd3e97db640 1 --2- 172.21.15.99:0/565504508 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a0f3fc7900 0x55a0f3fd7640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.313+0000 7fd3e97db640 1 -- 172.21.15.99:0/565504508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a0f3fc6f10 msgr2=0x55a0f3fd7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:03.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.313+0000 7fd3e97db640 1 --2- 172.21.15.99:0/565504508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a0f3fc6f10 0x55a0f3fd7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.313+0000 7fd3e97db640 1 -- 172.21.15.99:0/565504508 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3e4072d40 con 0x55a0f3fcca70 2024-01-31T05:13:03.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.313+0000 7fd3e97db640 1 --2- 172.21.15.99:0/565504508 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0f3fcca70 0x55a0f3fd7ba0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4034a00 tx=0x7fd3d402bb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75daa90d75b88789 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:03.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.315+0000 7fd3c87f8640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:13:03.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.315+0000 7fd3c87f8640 1 -- 172.21.15.99:0/565504508 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d402c920 con 0x55a0f3fcca70 2024-01-31T05:13:03.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.315+0000 7fd3c87f8640 1 -- 172.21.15.99:0/565504508 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fd3d402ca80 con 0x55a0f3fcca70 2024-01-31T05:13:03.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.316+0000 7fd3ee004740 1 -- 172.21.15.99:0/565504508 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd3dc012d90 con 0x55a0f3fcca70 2024-01-31T05:13:03.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.318+0000 7fd3c87f8640 1 -- 172.21.15.99:0/565504508 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd3d40035f0 con 0x55a0f3fcca70 2024-01-31T05:13:03.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.318+0000 7fd3ee004740 10 client.15957 fetch_fsmap learned FSMap version 28 2024-01-31T05:13:03.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.318+0000 7fd3ee004740 1 -- 172.21.15.99:0/565504508 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55a0f3eef020 con 0x55a0f3fcca70 2024-01-31T05:13:03.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:03 smithi099 ceph-mon[31615]: pgmap v399: 97 pgs: 97 active+clean; 51 MiB data, 602 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.6 MiB/s wr, 1.88k op/s 2024-01-31T05:13:03.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:03 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/1292935449' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:13:03.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.323+0000 7fd3c87f8640 1 -- 172.21.15.99:0/565504508 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd3d4003c10 con 0x55a0f3fcca70 2024-01-31T05:13:03.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.323+0000 7fd3c87f8640 1 -- 172.21.15.99:0/565504508 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 28) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fd3d4032b60 con 0x55a0f3fcca70 2024-01-31T05:13:03.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.323+0000 7fd3ee004740 10 client.15957 fetch_fsmap finished waiting for FSMap version 28 2024-01-31T05:13:03.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.323+0000 7fd3ee004740 10 client.15957 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-01-31T05:13:03.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.323+0000 7fd3ee004740 20 client.15957 populate_metadata read hostname 'smithi099' 2024-01-31T05:13:03.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.323+0000 7fd3ee004740 1 --2- 172.21.15.99:0/565504508 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x55a0f4035360 0x55a0f4037780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.323+0000 7fd3ee004740 4 client.15957 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-01-31T05:13:03.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.323+0000 7fd3ee004740 1 -- 172.21.15.99:0/565504508 --> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x7fd3dc012d90 con 0x55a0f4035360 2024-01-31T05:13:03.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.324+0000 7fd3e8fda640 1 --2- 172.21.15.99:0/565504508 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x55a0f4035360 0x55a0f4037780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:03.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.328+0000 7fd3e8fda640 1 --2- 172.21.15.99:0/565504508 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x55a0f4035360 0x55a0f4037780 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=38825368865b52f8 server_cookie=d0c2d70b8c607273 in_seq=0 out_seq=0 2024-01-31T05:13:03.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.328+0000 7fd3c87f8640 10 client.15957 ms_handle_connect on v2:172.21.15.181:6836/3875964154 2024-01-31T05:13:03.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.331+0000 7fd3c87f8640 1 -- 172.21.15.99:0/565504508 <== mds.3 v2:172.21.15.181:6836/3875964154 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x7fd3dc012d90 con 0x55a0f4035360 2024-01-31T05:13:03.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.331+0000 7fd3c87f8640 10 client.15957 handle_command_reply: tid=0 2024-01-31T05:13:03.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.331+0000 7fd3ee004740 1 client.15957 shutdown 2024-01-31T05:13:03.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.337+0000 7fd3ee004740 1 -- 172.21.15.99:0/565504508 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0f3fcca70 msgr2=0x55a0f3fd7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:03.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.337+0000 7fd3ee004740 1 --2- 172.21.15.99:0/565504508 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0f3fcca70 0x55a0f3fd7ba0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4034a00 tx=0x7fd3d402bb70 comp rx=0 tx=0).stop 2024-01-31T05:13:03.343 INFO:tasks.workunit.client.0.smithi099.stdout:2/4: dwrite f0 [0,4194304] 0 2024-01-31T05:13:03.343 INFO:tasks.workunit.client.0.smithi099.stdout:2/5: creat f1 x:0 0 0 2024-01-31T05:13:03.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.341+0000 7fd3ee004740 1 -- 172.21.15.99:0/565504508 shutdown_connections 2024-01-31T05:13:03.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.341+0000 7fd3ee004740 1 --2- 172.21.15.99:0/565504508 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x55a0f4035360 0x55a0f4037780 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.341+0000 7fd3ee004740 1 --2- 172.21.15.99:0/565504508 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0f3fcca70 0x55a0f3fd7ba0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.341+0000 7fd3ee004740 1 --2- 172.21.15.99:0/565504508 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a0f3fc7900 0x55a0f3fd7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.341+0000 7fd3c87f8640 0 client.15957 ms_handle_reset on v2:172.21.15.181:6836/3875964154 2024-01-31T05:13:03.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.341+0000 7fd3ee004740 1 --2- 172.21.15.99:0/565504508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a0f3fc6f10 0x55a0f3fd7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.341+0000 7fd3ee004740 1 -- 172.21.15.99:0/565504508 >> 172.21.15.99:0/565504508 conn(0x55a0f3fc2480 msgr2=0x55a0f3fc56e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:03.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.342+0000 7fd3ee004740 1 -- 172.21.15.99:0/565504508 shutdown_connections 2024-01-31T05:13:03.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.344+0000 7fd3ee004740 1 -- 172.21.15.99:0/565504508 wait complete. 2024-01-31T05:13:03.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.346+0000 7fd3ee004740 20 client.15957 trim_cache size 0 max 16384 2024-01-31T05:13:03.349 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-01-31T05:13:03.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.350+0000 7fd3eb23e640 1 -- 172.21.15.99:0/3519058477 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd3cc0a14b0 msgr2=0x7fd3cc0a3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:03.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.350+0000 7fd3eb23e640 1 --2- 172.21.15.99:0/3519058477 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd3cc0a14b0 0x7fd3cc0a3970 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd3d402c180 tx=0x7fd3d4032480 comp rx=0 tx=0).stop 2024-01-31T05:13:03.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.350+0000 7fd3eb23e640 1 -- 172.21.15.99:0/3519058477 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3e40ffce0 msgr2=0x7fd3e4070cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:03.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.350+0000 7fd3eb23e640 1 --2- 172.21.15.99:0/3519058477 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3e40ffce0 0x7fd3e4070cf0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fd3d800e790 tx=0x7fd3d800ec50 comp rx=0 tx=0).stop 2024-01-31T05:13:03.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.351+0000 7fd3eb23e640 1 -- 172.21.15.99:0/3519058477 shutdown_connections 2024-01-31T05:13:03.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.351+0000 7fd3eb23e640 1 --2- 172.21.15.99:0/3519058477 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd3cc0a14b0 0x7fd3cc0a3970 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.351+0000 7fd3eb23e640 1 --2- 172.21.15.99:0/3519058477 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd3e4100680 0x7fd3e4071d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.351+0000 7fd3eb23e640 1 --2- 172.21.15.99:0/3519058477 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3e40ffce0 0x7fd3e4070cf0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.351+0000 7fd3eb23e640 1 --2- 172.21.15.99:0/3519058477 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3e40febb0 0x7fd3e40707b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.351+0000 7fd3eb23e640 1 -- 172.21.15.99:0/3519058477 >> 172.21.15.99:0/3519058477 conn(0x7fd3e40fa4b0 msgr2=0x7fd3e4100f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:03.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.354+0000 7fd3eb23e640 1 -- 172.21.15.99:0/3519058477 shutdown_connections 2024-01-31T05:13:03.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.355+0000 7fd3eb23e640 1 -- 172.21.15.99:0/3519058477 wait complete. 2024-01-31T05:13:03.377 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-01-31T05:13:03.410 INFO:tasks.workunit.client.0.smithi099.stdout:1/10: getdents . 0 2024-01-31T05:13:03.421 INFO:tasks.workunit.client.0.smithi099.stdout:5/7: getdents . 0 2024-01-31T05:13:03.479 INFO:tasks.workunit.client.0.smithi099.stdout:6/6: truncate f1 247574 0 2024-01-31T05:13:03.544 INFO:tasks.workunit.client.0.smithi099.stdout:8/14: fdatasync d1/f4 0 2024-01-31T05:13:03.544 INFO:tasks.workunit.client.0.smithi099.stdout:8/15: truncate d1/f3 652857 0 2024-01-31T05:13:03.544 INFO:tasks.workunit.client.0.smithi099.stdout:8/16: truncate d1/f5 23714 0 2024-01-31T05:13:03.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.560+0000 7eff51f7c640 1 -- 172.21.15.99:0/3851724339 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff4c0ffbf0 msgr2=0x7eff4c100010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:03.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.560+0000 7eff51f7c640 1 --2- 172.21.15.99:0/3851724339 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff4c0ffbf0 0x7eff4c100010 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7eff3c009900 tx=0x7eff3c02bc30 comp rx=0 tx=0).stop 2024-01-31T05:13:03.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.560+0000 7eff51f7c640 1 -- 172.21.15.99:0/3851724339 shutdown_connections 2024-01-31T05:13:03.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.560+0000 7eff51f7c640 1 --2- 172.21.15.99:0/3851724339 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff4c1017a0 0x7eff4c108030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.560+0000 7eff51f7c640 1 --2- 172.21.15.99:0/3851724339 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff4c100de0 0x7eff4c101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.560+0000 7eff51f7c640 1 --2- 172.21.15.99:0/3851724339 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff4c0ffbf0 0x7eff4c100010 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.560+0000 7eff51f7c640 1 -- 172.21.15.99:0/3851724339 >> 172.21.15.99:0/3851724339 conn(0x7eff4c0fb180 msgr2=0x7eff4c0fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:03.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.560+0000 7eff51f7c640 1 -- 172.21.15.99:0/3851724339 shutdown_connections 2024-01-31T05:13:03.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.560+0000 7eff51f7c640 1 -- 172.21.15.99:0/3851724339 wait complete. 2024-01-31T05:13:03.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.560+0000 7eff51f7c640 1 Processor -- start 2024-01-31T05:13:03.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.561+0000 7eff51f7c640 1 -- start start 2024-01-31T05:13:03.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.561+0000 7eff51f7c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff4c0ffbf0 0x7eff4c196d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.561+0000 7eff51f7c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff4c100de0 0x7eff4c1972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.561+0000 7eff51f7c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff4c1017a0 0x7eff4c19e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.561+0000 7eff51f7c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c19e850 con 0x7eff4c100de0 2024-01-31T05:13:03.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.561+0000 7eff51f7c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c19e9c0 con 0x7eff4c0ffbf0 2024-01-31T05:13:03.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.561+0000 7eff51f7c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c19eb80 con 0x7eff4c1017a0 2024-01-31T05:13:03.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.561+0000 7eff4affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff4c100de0 0x7eff4c1972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:03.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.561+0000 7eff4affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff4c100de0 0x7eff4c1972a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47166/0 (socket says 172.21.15.99:47166) 2024-01-31T05:13:03.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.561+0000 7eff4affd640 1 -- 172.21.15.99:0/1809183148 learned_addr learned my addr 172.21.15.99:0/1809183148 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:03.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.561+0000 7eff4bfff640 1 --2- 172.21.15.99:0/1809183148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff4c1017a0 0x7eff4c19e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:03.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.561+0000 7eff4b7fe640 1 --2- 172.21.15.99:0/1809183148 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff4c0ffbf0 0x7eff4c196d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:03.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.561+0000 7eff4affd640 1 -- 172.21.15.99:0/1809183148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff4c1017a0 msgr2=0x7eff4c19e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:03.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.561+0000 7eff4affd640 1 --2- 172.21.15.99:0/1809183148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff4c1017a0 0x7eff4c19e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.561+0000 7eff4affd640 1 -- 172.21.15.99:0/1809183148 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff4c0ffbf0 msgr2=0x7eff4c196d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:03.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.561+0000 7eff4affd640 1 --2- 172.21.15.99:0/1809183148 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff4c0ffbf0 0x7eff4c196d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.561+0000 7eff4affd640 1 -- 172.21.15.99:0/1809183148 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff3c009560 con 0x7eff4c100de0 2024-01-31T05:13:03.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.561+0000 7eff4b7fe640 1 --2- 172.21.15.99:0/1809183148 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff4c0ffbf0 0x7eff4c196d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:13:03.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.561+0000 7eff4affd640 1 --2- 172.21.15.99:0/1809183148 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff4c100de0 0x7eff4c1972a0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7eff4000d770 tx=0x7eff4000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:03.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.562+0000 7eff48ff9640 1 -- 172.21.15.99:0/1809183148 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff40009c30 con 0x7eff4c100de0 2024-01-31T05:13:03.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.562+0000 7eff48ff9640 1 -- 172.21.15.99:0/1809183148 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7eff4000de80 con 0x7eff4c100de0 2024-01-31T05:13:03.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.562+0000 7eff51f7c640 1 -- 172.21.15.99:0/1809183148 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff4c19ee60 con 0x7eff4c100de0 2024-01-31T05:13:03.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.562+0000 7eff48ff9640 1 -- 172.21.15.99:0/1809183148 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff40004de0 con 0x7eff4c100de0 2024-01-31T05:13:03.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.562+0000 7eff51f7c640 1 -- 172.21.15.99:0/1809183148 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff4c19f290 con 0x7eff4c100de0 2024-01-31T05:13:03.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.564+0000 7eff48ff9640 1 -- 172.21.15.99:0/1809183148 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 20) v1 ==== 135895+0+0 (secure 0 0 0) 0x7eff40004f40 con 0x7eff4c100de0 2024-01-31T05:13:03.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.564+0000 7eff54e15740 1 Processor -- start 2024-01-31T05:13:03.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.564+0000 7eff54e15740 1 -- start start 2024-01-31T05:13:03.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.564+0000 7eff54e15740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5653f5339f10 0x5653f533a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.564+0000 7eff54e15740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5653f533a900 0x5653f533f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.564+0000 7eff54e15740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653f533fa70 0x5653f5341f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.574 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:03 smithi181 ceph-mon[36434]: pgmap v399: 97 pgs: 97 active+clean; 51 MiB data, 602 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.6 MiB/s wr, 1.88k op/s 2024-01-31T05:13:03.574 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:03 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/1292935449' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:13:03.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.564+0000 7eff54e15740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f52a8240 con 0x5653f533fa70 2024-01-31T05:13:03.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.564+0000 7eff54e15740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f52a5930 con 0x5653f533a900 2024-01-31T05:13:03.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.564+0000 7eff54e15740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f52a1220 con 0x5653f5339f10 2024-01-31T05:13:03.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.564+0000 7eff48ff9640 1 --2- 172.21.15.99:0/1809183148 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7eff340a12e0 0x7eff340a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.564+0000 7eff4affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653f533fa70 0x5653f5341f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:03.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.564+0000 7eff4affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653f533fa70 0x5653f5341f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47172/0 (socket says 172.21.15.99:47172) 2024-01-31T05:13:03.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.564+0000 7eff4affd640 1 -- 172.21.15.99:0/821153712 learned_addr learned my addr 172.21.15.99:0/821153712 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:03.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.564+0000 7eff4bfff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5653f5339f10 0x5653f533a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:03.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.564+0000 7eff4bfff640 1 --2- 172.21.15.99:0/1809183148 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7eff340a12e0 0x7eff340a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:03.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.564+0000 7eff48ff9640 1 -- 172.21.15.99:0/1809183148 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7eff400cc5d0 con 0x7eff4c100de0 2024-01-31T05:13:03.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.565+0000 7eff4affd640 1 -- 172.21.15.99:0/821153712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5653f5339f10 msgr2=0x5653f533a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:03.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.565+0000 7eff4affd640 1 --2- 172.21.15.99:0/821153712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5653f5339f10 0x5653f533a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.565+0000 7eff4affd640 1 -- 172.21.15.99:0/821153712 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5653f533a900 msgr2=0x5653f533f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:03.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.565+0000 7eff4affd640 1 --2- 172.21.15.99:0/821153712 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5653f533a900 0x5653f533f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.565+0000 7eff4affd640 1 -- 172.21.15.99:0/821153712 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653f52637c0 con 0x5653f533fa70 2024-01-31T05:13:03.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.565+0000 7eff4affd640 1 --2- 172.21.15.99:0/821153712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653f533fa70 0x5653f5341f00 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7eff400056d0 tx=0x7eff400c3cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aabdf0ea0d321df8 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:03.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.565+0000 7eff4bfff640 1 --2- 172.21.15.99:0/1809183148 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7eff340a12e0 0x7eff340a37a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7eff44005fd0 tx=0x7eff44009660 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:03.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.565+0000 7eff31ffb640 1 -- 172.21.15.99:0/821153712 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff40099ed0 con 0x5653f533fa70 2024-01-31T05:13:03.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.565+0000 7eff31ffb640 1 -- 172.21.15.99:0/821153712 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7eff40065230 con 0x5653f533fa70 2024-01-31T05:13:03.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.565+0000 7eff31ffb640 1 -- 172.21.15.99:0/821153712 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff40009d90 con 0x5653f533fa70 2024-01-31T05:13:03.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.566+0000 7eff54e15740 1 -- 172.21.15.99:0/821153712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653f533fa70 msgr2=0x5653f5341f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:03.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.566+0000 7eff54e15740 1 --2- 172.21.15.99:0/821153712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653f533fa70 0x5653f5341f00 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7eff400056d0 tx=0x7eff400c3cc0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.566+0000 7eff54e15740 1 -- 172.21.15.99:0/821153712 shutdown_connections 2024-01-31T05:13:03.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.566+0000 7eff54e15740 1 --2- 172.21.15.99:0/821153712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653f533fa70 0x5653f5341f00 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.566+0000 7eff54e15740 1 --2- 172.21.15.99:0/821153712 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5653f533a900 0x5653f533f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.566+0000 7eff54e15740 1 --2- 172.21.15.99:0/821153712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5653f5339f10 0x5653f533a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.566+0000 7eff54e15740 1 -- 172.21.15.99:0/821153712 >> 172.21.15.99:0/821153712 conn(0x5653f5335480 msgr2=0x5653f5335880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:03.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.566+0000 7eff54e15740 1 -- 172.21.15.99:0/821153712 shutdown_connections 2024-01-31T05:13:03.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.566+0000 7eff54e15740 1 -- 172.21.15.99:0/821153712 wait complete. 2024-01-31T05:13:03.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.566+0000 7eff54e15740 1 -- start start 2024-01-31T05:13:03.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.566+0000 7eff54e15740 1 Processor -- start 2024-01-31T05:13:03.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.566+0000 7eff54e15740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5653f5339f10 0x5653f53440c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.566+0000 7eff54e15740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653f533a900 0x5653f5344600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.566+0000 7eff54e15740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5653f533fa70 0x5653f534b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.566+0000 7eff54e15740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f525a5e0 con 0x5653f533a900 2024-01-31T05:13:03.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.566+0000 7eff54e15740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f525a280 con 0x5653f533fa70 2024-01-31T05:13:03.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.566+0000 7eff54e15740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f521f3d0 con 0x5653f5339f10 2024-01-31T05:13:03.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.567+0000 7eff4affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653f533a900 0x5653f5344600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:03.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.567+0000 7eff54e15740 10 client.0 _ll_register_callbacks cb 0x5653f5297eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:13:03.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.567+0000 7eff4affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653f533a900 0x5653f5344600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47176/0 (socket says 172.21.15.99:47176) 2024-01-31T05:13:03.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.567+0000 7eff4affd640 1 -- 172.21.15.99:0/3422607030 learned_addr learned my addr 172.21.15.99:0/3422607030 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:03.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.567+0000 7eff4b7fe640 1 --2- 172.21.15.99:0/3422607030 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5653f5339f10 0x5653f53440c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:03.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.567+0000 7eff4affd640 1 -- 172.21.15.99:0/3422607030 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5653f5339f10 msgr2=0x5653f53440c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:03.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.567+0000 7eff4affd640 1 --2- 172.21.15.99:0/3422607030 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5653f5339f10 0x5653f53440c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.567+0000 7eff4affd640 1 -- 172.21.15.99:0/3422607030 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5653f533fa70 msgr2=0x5653f534b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:03.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.567+0000 7eff4affd640 1 --2- 172.21.15.99:0/3422607030 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5653f533fa70 0x5653f534b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.567+0000 7eff4affd640 1 -- 172.21.15.99:0/3422607030 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff4c19f290 con 0x5653f533a900 2024-01-31T05:13:03.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.567+0000 7eff4affd640 1 --2- 172.21.15.99:0/3422607030 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653f533a900 0x5653f5344600 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7eff40009610 tx=0x7eff40004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f685975a9f14deaa server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:03.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.567+0000 7eff2affd640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:13:03.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.567+0000 7eff2affd640 1 -- 172.21.15.99:0/3422607030 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff400997d0 con 0x5653f533a900 2024-01-31T05:13:03.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.567+0000 7eff2affd640 1 -- 172.21.15.99:0/3422607030 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7eff4009d920 con 0x5653f533a900 2024-01-31T05:13:03.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.567+0000 7eff54e15740 1 -- 172.21.15.99:0/3422607030 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5653f529a0b0 con 0x5653f533a900 2024-01-31T05:13:03.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.567+0000 7eff2affd640 1 -- 172.21.15.99:0/3422607030 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff40097b70 con 0x5653f533a900 2024-01-31T05:13:03.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.567+0000 7eff54e15740 10 client.15969 fetch_fsmap learned FSMap version 28 2024-01-31T05:13:03.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.567+0000 7eff54e15740 1 -- 172.21.15.99:0/3422607030 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5653f529f8a0 con 0x5653f533a900 2024-01-31T05:13:03.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.567+0000 7eff2affd640 1 -- 172.21.15.99:0/3422607030 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7eff400b4030 con 0x5653f533a900 2024-01-31T05:13:03.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.568+0000 7eff2affd640 1 -- 172.21.15.99:0/3422607030 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 28) v1 ==== 7898+0+0 (secure 0 0 0) 0x7eff400ac2b0 con 0x5653f533a900 2024-01-31T05:13:03.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.568+0000 7eff54e15740 10 client.15969 fetch_fsmap finished waiting for FSMap version 28 2024-01-31T05:13:03.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.568+0000 7eff54e15740 10 client.15969 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-01-31T05:13:03.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.568+0000 7eff54e15740 20 client.15969 populate_metadata read hostname 'smithi099' 2024-01-31T05:13:03.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.568+0000 7eff54e15740 1 --2- 172.21.15.99:0/3422607030 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x5653f5353fe0 0x5653f53563d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.568+0000 7eff54e15740 4 client.15969 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:13:03.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.568+0000 7eff54e15740 1 -- 172.21.15.99:0/3422607030 --> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5653f5299dd0 con 0x5653f5353fe0 2024-01-31T05:13:03.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.568+0000 7eff4b7fe640 1 --2- 172.21.15.99:0/3422607030 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x5653f5353fe0 0x5653f53563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:03.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.569+0000 7eff4b7fe640 1 --2- 172.21.15.99:0/3422607030 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x5653f5353fe0 0x5653f53563d0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3f444d2c3d3cd88f server_cookie=e5f5b99437021ecc in_seq=0 out_seq=0 2024-01-31T05:13:03.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.569+0000 7eff2affd640 10 client.15969 ms_handle_connect on v2:172.21.15.181:6838/996120687 2024-01-31T05:13:03.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.570+0000 7eff2affd640 1 -- 172.21.15.99:0/3422607030 <== mds.2 v2:172.21.15.181:6838/996120687 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5653f5299dd0 con 0x5653f5353fe0 2024-01-31T05:13:03.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.570+0000 7eff2affd640 10 client.15969 handle_command_reply: tid=0 2024-01-31T05:13:03.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.570+0000 7eff54e15740 1 client.15969 shutdown 2024-01-31T05:13:03.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.570+0000 7eff54e15740 1 -- 172.21.15.99:0/3422607030 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653f533a900 msgr2=0x5653f5344600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:03.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.570+0000 7eff54e15740 1 --2- 172.21.15.99:0/3422607030 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653f533a900 0x5653f5344600 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7eff40009610 tx=0x7eff40004830 comp rx=0 tx=0).stop 2024-01-31T05:13:03.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.570+0000 7eff54e15740 1 -- 172.21.15.99:0/3422607030 shutdown_connections 2024-01-31T05:13:03.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.570+0000 7eff54e15740 1 --2- 172.21.15.99:0/3422607030 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5653f533fa70 0x5653f534b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.570+0000 7eff54e15740 1 --2- 172.21.15.99:0/3422607030 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653f533a900 0x5653f5344600 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.570+0000 7eff54e15740 1 --2- 172.21.15.99:0/3422607030 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x5653f5353fe0 0x5653f53563d0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.570+0000 7eff2affd640 0 client.15969 ms_handle_reset on v2:172.21.15.181:6838/996120687 2024-01-31T05:13:03.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.570+0000 7eff54e15740 1 --2- 172.21.15.99:0/3422607030 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5653f5339f10 0x5653f53440c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.570+0000 7eff54e15740 1 -- 172.21.15.99:0/3422607030 >> 172.21.15.99:0/3422607030 conn(0x5653f5335480 msgr2=0x5653f53347c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:03.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.570+0000 7eff54e15740 1 -- 172.21.15.99:0/3422607030 shutdown_connections 2024-01-31T05:13:03.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.571+0000 7eff54e15740 1 -- 172.21.15.99:0/3422607030 wait complete. 2024-01-31T05:13:03.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.571+0000 7eff54e15740 20 client.15969 trim_cache size 0 max 16384 2024-01-31T05:13:03.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.582+0000 7eff54e15740 1 Processor -- start 2024-01-31T05:13:03.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.582+0000 7eff54e15740 1 -- start start 2024-01-31T05:13:03.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.582+0000 7eff54e15740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5653f5339f10 0x5653f533be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.582+0000 7eff54e15740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653f533a900 0x5653f534b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.582+0000 7eff54e15740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5653f533fa70 0x5653f533c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.582+0000 7eff54e15740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f5350540 con 0x5653f533a900 2024-01-31T05:13:03.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.582+0000 7eff54e15740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f533ad30 con 0x5653f5339f10 2024-01-31T05:13:03.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.582+0000 7eff54e15740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f5353de0 con 0x5653f533fa70 2024-01-31T05:13:03.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.582+0000 7eff4affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653f533a900 0x5653f534b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:03.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.582+0000 7eff4affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653f533a900 0x5653f534b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47190/0 (socket says 172.21.15.99:47190) 2024-01-31T05:13:03.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.582+0000 7eff4affd640 1 -- 172.21.15.99:0/2826208586 learned_addr learned my addr 172.21.15.99:0/2826208586 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:03.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.583+0000 7eff4affd640 1 -- 172.21.15.99:0/2826208586 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5653f533fa70 msgr2=0x5653f533c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:03.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.583+0000 7eff4bfff640 1 --2- 172.21.15.99:0/2826208586 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5653f533fa70 0x5653f533c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:03.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.583+0000 7eff4affd640 1 --2- 172.21.15.99:0/2826208586 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5653f533fa70 0x5653f533c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.583+0000 7eff4affd640 1 -- 172.21.15.99:0/2826208586 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5653f5339f10 msgr2=0x5653f533be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:03.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.583+0000 7eff4affd640 1 --2- 172.21.15.99:0/2826208586 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5653f5339f10 0x5653f533be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.583+0000 7eff4affd640 1 -- 172.21.15.99:0/2826208586 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653f523c4d0 con 0x5653f533a900 2024-01-31T05:13:03.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.583+0000 7eff4bfff640 1 --2- 172.21.15.99:0/2826208586 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5653f533fa70 0x5653f533c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:13:03.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.583+0000 7eff4affd640 1 --2- 172.21.15.99:0/2826208586 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653f533a900 0x5653f534b600 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7eff4000d740 tx=0x7eff400ac6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd806fb6404e21f3 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:03.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.583+0000 7eff317fa640 1 -- 172.21.15.99:0/2826208586 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff400997d0 con 0x5653f533a900 2024-01-31T05:13:03.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.583+0000 7eff317fa640 1 -- 172.21.15.99:0/2826208586 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7eff400b4050 con 0x5653f533a900 2024-01-31T05:13:03.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.583+0000 7eff317fa640 1 -- 172.21.15.99:0/2826208586 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff400ac260 con 0x5653f533a900 2024-01-31T05:13:03.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.584+0000 7eff54e15740 1 -- 172.21.15.99:0/2826208586 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653f533a900 msgr2=0x5653f534b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:03.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.584+0000 7eff54e15740 1 --2- 172.21.15.99:0/2826208586 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653f533a900 0x5653f534b600 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7eff4000d740 tx=0x7eff400ac6c0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.584+0000 7eff54e15740 1 -- 172.21.15.99:0/2826208586 shutdown_connections 2024-01-31T05:13:03.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.584+0000 7eff54e15740 1 --2- 172.21.15.99:0/2826208586 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5653f533fa70 0x5653f533c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.584+0000 7eff54e15740 1 --2- 172.21.15.99:0/2826208586 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653f533a900 0x5653f534b600 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.584+0000 7eff54e15740 1 --2- 172.21.15.99:0/2826208586 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5653f5339f10 0x5653f533be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.584+0000 7eff54e15740 1 -- 172.21.15.99:0/2826208586 >> 172.21.15.99:0/2826208586 conn(0x5653f5335480 msgr2=0x5653f53440c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:03.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.584+0000 7eff54e15740 1 -- 172.21.15.99:0/2826208586 shutdown_connections 2024-01-31T05:13:03.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.584+0000 7eff54e15740 1 -- 172.21.15.99:0/2826208586 wait complete. 2024-01-31T05:13:03.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.584+0000 7eff54e15740 1 -- start start 2024-01-31T05:13:03.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.584+0000 7eff54e15740 1 Processor -- start 2024-01-31T05:13:03.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.584+0000 7eff54e15740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5653f5339f10 0x5653f5349510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.584+0000 7eff54e15740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653f533a900 0x5653f5349a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.584+0000 7eff54e15740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5653f533fa70 0x5653f534a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.584+0000 7eff54e15740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f534af30 con 0x5653f533a900 2024-01-31T05:13:03.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.584+0000 7eff54e15740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f534b0a0 con 0x5653f5339f10 2024-01-31T05:13:03.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.584+0000 7eff54e15740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f534b260 con 0x5653f533fa70 2024-01-31T05:13:03.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.584+0000 7eff54e15740 10 client.0 _ll_register_callbacks cb 0x7eff40095450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:13:03.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.584+0000 7eff4affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653f533a900 0x5653f5349a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:03.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.584+0000 7eff4affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653f533a900 0x5653f5349a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47204/0 (socket says 172.21.15.99:47204) 2024-01-31T05:13:03.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.584+0000 7eff4affd640 1 -- 172.21.15.99:0/268895273 learned_addr learned my addr 172.21.15.99:0/268895273 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:03.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.585+0000 7eff4bfff640 1 --2- 172.21.15.99:0/268895273 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5653f533fa70 0x5653f534a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:03.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.585+0000 7eff4affd640 1 -- 172.21.15.99:0/268895273 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5653f533fa70 msgr2=0x5653f534a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:03.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.585+0000 7eff4affd640 1 --2- 172.21.15.99:0/268895273 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5653f533fa70 0x5653f534a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.585+0000 7eff4affd640 1 -- 172.21.15.99:0/268895273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5653f5339f10 msgr2=0x5653f5349510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:03.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.585+0000 7eff4affd640 1 --2- 172.21.15.99:0/268895273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5653f5339f10 0x5653f5349510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.585+0000 7eff4affd640 1 -- 172.21.15.99:0/268895273 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5653f529f8a0 con 0x5653f533a900 2024-01-31T05:13:03.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.585+0000 7eff4affd640 1 --2- 172.21.15.99:0/268895273 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653f533a900 0x5653f5349a50 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7eff400994d0 tx=0x7eff400ac510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc61ea838f532b2d server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:03.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.585+0000 7eff2affd640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:13:03.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.585+0000 7eff2affd640 1 -- 172.21.15.99:0/268895273 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff40004780 con 0x5653f533a900 2024-01-31T05:13:03.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.585+0000 7eff2affd640 1 -- 172.21.15.99:0/268895273 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7eff4009d920 con 0x5653f533a900 2024-01-31T05:13:03.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.585+0000 7eff54e15740 1 -- 172.21.15.99:0/268895273 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7eff40065230 con 0x5653f533a900 2024-01-31T05:13:03.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.585+0000 7eff2affd640 1 -- 172.21.15.99:0/268895273 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff400a1b60 con 0x5653f533a900 2024-01-31T05:13:03.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.585+0000 7eff54e15740 10 client.15975 fetch_fsmap learned FSMap version 28 2024-01-31T05:13:03.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.585+0000 7eff54e15740 1 -- 172.21.15.99:0/268895273 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5653f5262020 con 0x5653f533a900 2024-01-31T05:13:03.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.585+0000 7eff2affd640 1 -- 172.21.15.99:0/268895273 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7eff4007c020 con 0x5653f533a900 2024-01-31T05:13:03.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.585+0000 7eff2affd640 1 -- 172.21.15.99:0/268895273 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 28) v1 ==== 7898+0+0 (secure 0 0 0) 0x7eff4009ab00 con 0x5653f533a900 2024-01-31T05:13:03.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.585+0000 7eff54e15740 10 client.15975 fetch_fsmap finished waiting for FSMap version 28 2024-01-31T05:13:03.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.585+0000 7eff54e15740 10 client.15975 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-01-31T05:13:03.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.585+0000 7eff54e15740 20 client.15975 populate_metadata read hostname 'smithi099' 2024-01-31T05:13:03.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.585+0000 7eff54e15740 1 --2- 172.21.15.99:0/268895273 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x5653f5353fe0 0x5653f53acfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.585+0000 7eff54e15740 4 client.15975 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-01-31T05:13:03.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.585+0000 7eff54e15740 1 -- 172.21.15.99:0/268895273 --> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5653f4fa07e0 con 0x5653f5353fe0 2024-01-31T05:13:03.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.586+0000 7eff4b7fe640 1 --2- 172.21.15.99:0/268895273 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x5653f5353fe0 0x5653f53acfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:03.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.586+0000 7eff4b7fe640 1 --2- 172.21.15.99:0/268895273 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x5653f5353fe0 0x5653f53acfd0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f0148081e3b373fa server_cookie=307a3c28101e9096 in_seq=0 out_seq=0 2024-01-31T05:13:03.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.586+0000 7eff2affd640 10 client.15975 ms_handle_connect on v2:172.21.15.181:6838/996120687 2024-01-31T05:13:03.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.586+0000 7eff2affd640 1 -- 172.21.15.99:0/268895273 <== mds.2 v2:172.21.15.181:6838/996120687 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5653f4fa07e0 con 0x5653f5353fe0 2024-01-31T05:13:03.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.586+0000 7eff2affd640 10 client.15975 handle_command_reply: tid=0 2024-01-31T05:13:03.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.586+0000 7eff54e15740 1 client.15975 shutdown 2024-01-31T05:13:03.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.587+0000 7eff54e15740 1 -- 172.21.15.99:0/268895273 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653f533a900 msgr2=0x5653f5349a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:03.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.587+0000 7eff54e15740 1 --2- 172.21.15.99:0/268895273 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653f533a900 0x5653f5349a50 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7eff400994d0 tx=0x7eff400ac510 comp rx=0 tx=0).stop 2024-01-31T05:13:03.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.587+0000 7eff54e15740 1 -- 172.21.15.99:0/268895273 shutdown_connections 2024-01-31T05:13:03.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.587+0000 7eff54e15740 1 --2- 172.21.15.99:0/268895273 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x5653f5353fe0 0x5653f53acfd0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.587+0000 7eff54e15740 1 --2- 172.21.15.99:0/268895273 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5653f533fa70 0x5653f534a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.587+0000 7eff2affd640 0 client.15975 ms_handle_reset on v2:172.21.15.181:6838/996120687 2024-01-31T05:13:03.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.587+0000 7eff54e15740 1 --2- 172.21.15.99:0/268895273 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653f533a900 0x5653f5349a50 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.587+0000 7eff54e15740 1 --2- 172.21.15.99:0/268895273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5653f5339f10 0x5653f5349510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.587+0000 7eff54e15740 1 -- 172.21.15.99:0/268895273 >> 172.21.15.99:0/268895273 conn(0x5653f5335480 msgr2=0x5653f53440a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:03.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.587+0000 7eff54e15740 1 -- 172.21.15.99:0/268895273 shutdown_connections 2024-01-31T05:13:03.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.587+0000 7eff54e15740 1 -- 172.21.15.99:0/268895273 wait complete. 2024-01-31T05:13:03.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.587+0000 7eff54e15740 20 client.15975 trim_cache size 0 max 16384 2024-01-31T05:13:03.595 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-01-31T05:13:03.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.587+0000 7eff51f7c640 1 -- 172.21.15.99:0/1809183148 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7eff340a12e0 msgr2=0x7eff340a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:03.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.587+0000 7eff51f7c640 1 --2- 172.21.15.99:0/1809183148 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7eff340a12e0 0x7eff340a37a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7eff44005fd0 tx=0x7eff44009660 comp rx=0 tx=0).stop 2024-01-31T05:13:03.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.587+0000 7eff51f7c640 1 -- 172.21.15.99:0/1809183148 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff4c100de0 msgr2=0x7eff4c1972a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:03.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.587+0000 7eff51f7c640 1 --2- 172.21.15.99:0/1809183148 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff4c100de0 0x7eff4c1972a0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7eff4000d770 tx=0x7eff4000dc30 comp rx=0 tx=0).stop 2024-01-31T05:13:03.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.587+0000 7eff51f7c640 1 -- 172.21.15.99:0/1809183148 shutdown_connections 2024-01-31T05:13:03.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.587+0000 7eff51f7c640 1 --2- 172.21.15.99:0/1809183148 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7eff340a12e0 0x7eff340a37a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.587+0000 7eff51f7c640 1 --2- 172.21.15.99:0/1809183148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff4c1017a0 0x7eff4c19e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.587+0000 7eff51f7c640 1 --2- 172.21.15.99:0/1809183148 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff4c100de0 0x7eff4c1972a0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.587+0000 7eff51f7c640 1 --2- 172.21.15.99:0/1809183148 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff4c0ffbf0 0x7eff4c196d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.587+0000 7eff51f7c640 1 -- 172.21.15.99:0/1809183148 >> 172.21.15.99:0/1809183148 conn(0x7eff4c0fb180 msgr2=0x7eff4c067e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:03.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.587+0000 7eff51f7c640 1 -- 172.21.15.99:0/1809183148 shutdown_connections 2024-01-31T05:13:03.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.587+0000 7eff51f7c640 1 -- 172.21.15.99:0/1809183148 wait complete. 2024-01-31T05:13:03.599 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-01-31T05:13:03.626 INFO:tasks.workunit.client.0.smithi099.stdout:1/11: dwrite f1 [0,4194304] 0 2024-01-31T05:13:03.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:03 smithi179 ceph-mon[35652]: pgmap v399: 97 pgs: 97 active+clean; 51 MiB data, 602 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.6 MiB/s wr, 1.88k op/s 2024-01-31T05:13:03.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:03 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/1292935449' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:13:03.639 INFO:tasks.workunit.client.0.smithi099.stdout:1/12: write f1 [1723461,51406] 0 2024-01-31T05:13:03.639 INFO:tasks.workunit.client.0.smithi099.stdout:1/13: getdents . 0 2024-01-31T05:13:03.640 INFO:tasks.workunit.client.0.smithi099.stdout:1/14: readlink - no filename 2024-01-31T05:13:03.643 INFO:tasks.workunit.client.0.smithi099.stdout:1/15: fdatasync f1 0 2024-01-31T05:13:03.661 INFO:tasks.workunit.client.0.smithi099.stdout:2/6: dwrite f1 [0,4194304] 0 2024-01-31T05:13:03.709 INFO:tasks.workunit.client.0.smithi099.stdout:0/4: dwrite f0 [0,4194304] 0 2024-01-31T05:13:03.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.796+0000 7faf7403e640 1 -- 172.21.15.99:0/1454558042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf6c0ffc10 msgr2=0x7faf6c100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:03.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.796+0000 7faf7403e640 1 --2- 172.21.15.99:0/1454558042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf6c0ffc10 0x7faf6c100030 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7faf64009be0 tx=0x7faf6402bef0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.798+0000 7faf7403e640 1 -- 172.21.15.99:0/1454558042 shutdown_connections 2024-01-31T05:13:03.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.798+0000 7faf7403e640 1 --2- 172.21.15.99:0/1454558042 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf6c1017c0 0x7faf6c108050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.798+0000 7faf7403e640 1 --2- 172.21.15.99:0/1454558042 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf6c100e00 0x7faf6c101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.798+0000 7faf7403e640 1 --2- 172.21.15.99:0/1454558042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf6c0ffc10 0x7faf6c100030 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.798+0000 7faf7403e640 1 -- 172.21.15.99:0/1454558042 >> 172.21.15.99:0/1454558042 conn(0x7faf6c0fb1a0 msgr2=0x7faf6c0fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:03.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.800+0000 7faf7403e640 1 -- 172.21.15.99:0/1454558042 shutdown_connections 2024-01-31T05:13:03.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.800+0000 7faf7403e640 1 -- 172.21.15.99:0/1454558042 wait complete. 2024-01-31T05:13:03.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.801+0000 7faf7403e640 1 Processor -- start 2024-01-31T05:13:03.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.801+0000 7faf7403e640 1 -- start start 2024-01-31T05:13:03.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.801+0000 7faf7403e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf6c0ffc10 0x7faf6c069e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.801+0000 7faf7403e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf6c100e00 0x7faf6c19b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.801+0000 7faf7403e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf6c1017c0 0x7faf6c19dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.801+0000 7faf7403e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6c195830 con 0x7faf6c0ffc10 2024-01-31T05:13:03.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.801+0000 7faf7403e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6c1959a0 con 0x7faf6c1017c0 2024-01-31T05:13:03.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.801+0000 7faf7403e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6c195b60 con 0x7faf6c100e00 2024-01-31T05:13:03.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.801+0000 7faf715d9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf6c100e00 0x7faf6c19b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:03.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.801+0000 7faf725db640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf6c1017c0 0x7faf6c19dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:03.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.801+0000 7faf725db640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf6c1017c0 0x7faf6c19dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.99:48032/0 (socket says 172.21.15.99:48032) 2024-01-31T05:13:03.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.801+0000 7faf725db640 1 -- 172.21.15.99:0/3623984790 learned_addr learned my addr 172.21.15.99:0/3623984790 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:03.802 INFO:tasks.workunit.client.0.smithi099.stdout:0/5: dread f0 [0,4194304] 0 2024-01-31T05:13:03.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.802+0000 7faf71dda640 1 --2- 172.21.15.99:0/3623984790 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf6c0ffc10 0x7faf6c069e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:03.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.802+0000 7faf725db640 1 -- 172.21.15.99:0/3623984790 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf6c100e00 msgr2=0x7faf6c19b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:03.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.802+0000 7faf725db640 1 --2- 172.21.15.99:0/3623984790 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf6c100e00 0x7faf6c19b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.802+0000 7faf725db640 1 -- 172.21.15.99:0/3623984790 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf6c0ffc10 msgr2=0x7faf6c069e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:03.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.802+0000 7faf725db640 1 --2- 172.21.15.99:0/3623984790 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf6c0ffc10 0x7faf6c069e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.802+0000 7faf725db640 1 -- 172.21.15.99:0/3623984790 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf64009840 con 0x7faf6c1017c0 2024-01-31T05:13:03.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.802+0000 7faf725db640 1 --2- 172.21.15.99:0/3623984790 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf6c1017c0 0x7faf6c19dfc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faf6800d750 tx=0x7faf6800dc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:03.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.803+0000 7faf62ffd640 1 -- 172.21.15.99:0/3623984790 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf68009bd0 con 0x7faf6c1017c0 2024-01-31T05:13:03.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.803+0000 7faf62ffd640 1 -- 172.21.15.99:0/3623984790 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faf6800de60 con 0x7faf6c1017c0 2024-01-31T05:13:03.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.804+0000 7faf62ffd640 1 -- 172.21.15.99:0/3623984790 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf68004e10 con 0x7faf6c1017c0 2024-01-31T05:13:03.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.804+0000 7faf7403e640 1 -- 172.21.15.99:0/3623984790 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf6c195e40 con 0x7faf6c1017c0 2024-01-31T05:13:03.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.804+0000 7faf7403e640 1 -- 172.21.15.99:0/3623984790 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf6c1962d0 con 0x7faf6c1017c0 2024-01-31T05:13:03.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.807+0000 7faf76dfe740 1 Processor -- start 2024-01-31T05:13:03.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.808+0000 7faf62ffd640 1 -- 172.21.15.99:0/3623984790 <== mon.2 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 20) v1 ==== 135895+0+0 (secure 0 0 0) 0x7faf68009d30 con 0x7faf6c1017c0 2024-01-31T05:13:03.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.808+0000 7faf76dfe740 1 -- start start 2024-01-31T05:13:03.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.808+0000 7faf76dfe740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556bf1b4af10 0x556bf1b4b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.809+0000 7faf62ffd640 1 --2- 172.21.15.99:0/3623984790 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7faf580a1270 0x7faf580a3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.809+0000 7faf62ffd640 1 -- 172.21.15.99:0/3623984790 <== mon.2 v2:172.21.15.179:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7faf680cc530 con 0x7faf6c1017c0 2024-01-31T05:13:03.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.809+0000 7faf76dfe740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556bf1b4b900 0x556bf1b50400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.809+0000 7faf76dfe740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556bf1b50a70 0x556bf1b52f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.810+0000 7faf71dda640 1 --2- 172.21.15.99:0/3623984790 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7faf580a1270 0x7faf580a3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:03.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.810+0000 7faf715d9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556bf1b4af10 0x556bf1b4b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:03.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.810+0000 7faf715d9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556bf1b4af10 0x556bf1b4b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.99:48034/0 (socket says 172.21.15.99:48034) 2024-01-31T05:13:03.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.810+0000 7faf715d9640 1 -- 172.21.15.99:0/2625610735 learned_addr learned my addr 172.21.15.99:0/2625610735 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:03.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.810+0000 7faf76dfe740 1 -- 172.21.15.99:0/2625610735 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bf1ab9240 con 0x556bf1b4b900 2024-01-31T05:13:03.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.810+0000 7faf76dfe740 1 -- 172.21.15.99:0/2625610735 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bf1ab6930 con 0x556bf1b4af10 2024-01-31T05:13:03.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.810+0000 7faf76dfe740 1 -- 172.21.15.99:0/2625610735 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bf1ab2220 con 0x556bf1b50a70 2024-01-31T05:13:03.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.810+0000 7faf725db640 1 --2- 172.21.15.99:0/2625610735 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556bf1b50a70 0x556bf1b52f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:03.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.810+0000 7faf715d9640 1 --2- 172.21.15.99:0/2625610735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556bf1b4b900 0x556bf1b50400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:03.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.810+0000 7faf715d9640 1 -- 172.21.15.99:0/2625610735 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556bf1b50a70 msgr2=0x556bf1b52f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:03.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.810+0000 7faf715d9640 1 --2- 172.21.15.99:0/2625610735 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556bf1b50a70 0x556bf1b52f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.810+0000 7faf715d9640 1 -- 172.21.15.99:0/2625610735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556bf1b4b900 msgr2=0x556bf1b50400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:03.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.810+0000 7faf715d9640 1 --2- 172.21.15.99:0/2625610735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556bf1b4b900 0x556bf1b50400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.810+0000 7faf715d9640 1 -- 172.21.15.99:0/2625610735 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556bf1a747c0 con 0x556bf1b4af10 2024-01-31T05:13:03.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.811+0000 7faf71dda640 1 --2- 172.21.15.99:0/3623984790 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7faf580a1270 0x7faf580a3730 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7faf6402c500 tx=0x7faf64000f40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:03.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.812+0000 7faf715d9640 1 --2- 172.21.15.99:0/2625610735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556bf1b4af10 0x556bf1b4b330 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7faf5c012790 tx=0x7faf5c00b7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d16dd53b3de07d03 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:03.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.813+0000 7faf57fff640 1 -- 172.21.15.99:0/2625610735 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c012dd0 con 0x556bf1b4af10 2024-01-31T05:13:03.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.813+0000 7faf57fff640 1 -- 172.21.15.99:0/2625610735 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faf5c010c30 con 0x556bf1b4af10 2024-01-31T05:13:03.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.814+0000 7faf57fff640 1 -- 172.21.15.99:0/2625610735 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c01eb20 con 0x556bf1b4af10 2024-01-31T05:13:03.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.814+0000 7faf76dfe740 1 -- 172.21.15.99:0/2625610735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556bf1b4af10 msgr2=0x556bf1b4b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:03.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.814+0000 7faf76dfe740 1 --2- 172.21.15.99:0/2625610735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556bf1b4af10 0x556bf1b4b330 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7faf5c012790 tx=0x7faf5c00b7c0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.815+0000 7faf76dfe740 1 -- 172.21.15.99:0/2625610735 shutdown_connections 2024-01-31T05:13:03.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.815+0000 7faf76dfe740 1 --2- 172.21.15.99:0/2625610735 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556bf1b50a70 0x556bf1b52f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.815+0000 7faf76dfe740 1 --2- 172.21.15.99:0/2625610735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556bf1b4b900 0x556bf1b50400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.815+0000 7faf76dfe740 1 --2- 172.21.15.99:0/2625610735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556bf1b4af10 0x556bf1b4b330 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.815+0000 7faf76dfe740 1 -- 172.21.15.99:0/2625610735 >> 172.21.15.99:0/2625610735 conn(0x556bf1b46480 msgr2=0x556bf1b46880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:03.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.816+0000 7faf76dfe740 1 -- 172.21.15.99:0/2625610735 shutdown_connections 2024-01-31T05:13:03.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.817+0000 7faf76dfe740 1 -- 172.21.15.99:0/2625610735 wait complete. 2024-01-31T05:13:03.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.818+0000 7faf76dfe740 1 -- start start 2024-01-31T05:13:03.817 INFO:tasks.workunit.client.0.smithi099.stdout:0/6: dread f0 [0,4194304] 0 2024-01-31T05:13:03.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.818+0000 7faf76dfe740 1 Processor -- start 2024-01-31T05:13:03.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.819+0000 7faf76dfe740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556bf1b4af10 0x556bf1b54f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.819+0000 7faf76dfe740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556bf1b4b900 0x556bf1b554d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.819+0000 7faf76dfe740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556bf1b50a70 0x556bf1b5c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.820+0000 7faf76dfe740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bf1a6b5e0 con 0x556bf1b4af10 2024-01-31T05:13:03.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.820+0000 7faf715d9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556bf1b4b900 0x556bf1b554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:03.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.820+0000 7faf715d9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556bf1b4b900 0x556bf1b554d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:49058/0 (socket says 172.21.15.99:49058) 2024-01-31T05:13:03.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.820+0000 7faf715d9640 1 -- 172.21.15.99:0/239652828 learned_addr learned my addr 172.21.15.99:0/239652828 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:03.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.820+0000 7faf725db640 1 --2- 172.21.15.99:0/239652828 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556bf1b50a70 0x556bf1b5c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:03.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.820+0000 7faf76dfe740 1 -- 172.21.15.99:0/239652828 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bf1a6b280 con 0x556bf1b50a70 2024-01-31T05:13:03.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.820+0000 7faf76dfe740 1 -- 172.21.15.99:0/239652828 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bf1a303d0 con 0x556bf1b4b900 2024-01-31T05:13:03.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.820+0000 7faf76dfe740 10 client.0 _ll_register_callbacks cb 0x556bf1aa8eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:13:03.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.821+0000 7faf71dda640 1 --2- 172.21.15.99:0/239652828 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556bf1b4af10 0x556bf1b54f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:03.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.821+0000 7faf71dda640 1 -- 172.21.15.99:0/239652828 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556bf1b4b900 msgr2=0x556bf1b554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:03.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.821+0000 7faf71dda640 1 --2- 172.21.15.99:0/239652828 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556bf1b4b900 0x556bf1b554d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.821+0000 7faf71dda640 1 -- 172.21.15.99:0/239652828 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556bf1b50a70 msgr2=0x556bf1b5c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:03.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.821+0000 7faf71dda640 1 --2- 172.21.15.99:0/239652828 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556bf1b50a70 0x556bf1b5c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.821+0000 7faf71dda640 1 -- 172.21.15.99:0/239652828 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf5c01a040 con 0x556bf1b4af10 2024-01-31T05:13:03.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.822+0000 7faf71dda640 1 --2- 172.21.15.99:0/239652828 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556bf1b4af10 0x556bf1b54f90 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7faf64036040 tx=0x7faf64009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efe6305323483934 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:03.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.822+0000 7faf557fa640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:13:03.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.822+0000 7faf557fa640 1 -- 172.21.15.99:0/239652828 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf64004250 con 0x556bf1b4af10 2024-01-31T05:13:03.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.823+0000 7faf76dfe740 1 -- 172.21.15.99:0/239652828 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556bf1aab0b0 con 0x556bf1b4af10 2024-01-31T05:13:03.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.823+0000 7faf557fa640 1 -- 172.21.15.99:0/239652828 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7faf64047050 con 0x556bf1b4af10 2024-01-31T05:13:03.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.825+0000 7faf557fa640 1 -- 172.21.15.99:0/239652828 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf640043b0 con 0x556bf1b4af10 2024-01-31T05:13:03.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.826+0000 7faf76dfe740 10 client.15987 fetch_fsmap learned FSMap version 28 2024-01-31T05:13:03.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.826+0000 7faf76dfe740 1 -- 172.21.15.99:0/239652828 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x556bf1ab08a0 con 0x556bf1b4af10 2024-01-31T05:13:03.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.828+0000 7faf557fa640 1 -- 172.21.15.99:0/239652828 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faf6405b020 con 0x556bf1b4af10 2024-01-31T05:13:03.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.828+0000 7faf557fa640 1 -- 172.21.15.99:0/239652828 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 28) v1 ==== 7898+0+0 (secure 0 0 0) 0x7faf6403f440 con 0x556bf1b4af10 2024-01-31T05:13:03.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.828+0000 7faf76dfe740 10 client.15987 fetch_fsmap finished waiting for FSMap version 28 2024-01-31T05:13:03.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.828+0000 7faf76dfe740 10 client.15987 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-01-31T05:13:03.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.828+0000 7faf76dfe740 20 client.15987 populate_metadata read hostname 'smithi099' 2024-01-31T05:13:03.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.828+0000 7faf76dfe740 1 --2- 172.21.15.99:0/239652828 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x556bf1b60e50 0x556bf1b63240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.828+0000 7faf76dfe740 4 client.15987 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:13:03.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.828+0000 7faf76dfe740 1 -- 172.21.15.99:0/239652828 --> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556bf1aaadd0 con 0x556bf1b60e50 2024-01-31T05:13:03.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.829+0000 7faf715d9640 1 --2- 172.21.15.99:0/239652828 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x556bf1b60e50 0x556bf1b63240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:03.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.833+0000 7faf715d9640 1 --2- 172.21.15.99:0/239652828 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x556bf1b60e50 0x556bf1b63240 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=20c5c525ad0dd241 server_cookie=3298709621ae048e in_seq=0 out_seq=0 2024-01-31T05:13:03.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.833+0000 7faf557fa640 10 client.15987 ms_handle_connect on v2:172.21.15.179:6836/837402830 2024-01-31T05:13:03.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.836+0000 7faf557fa640 1 -- 172.21.15.99:0/239652828 <== mds.1 v2:172.21.15.179:6836/837402830 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556bf1aaadd0 con 0x556bf1b60e50 2024-01-31T05:13:03.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.836+0000 7faf557fa640 10 client.15987 handle_command_reply: tid=0 2024-01-31T05:13:03.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.836+0000 7faf76dfe740 1 client.15987 shutdown 2024-01-31T05:13:03.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.837+0000 7faf76dfe740 1 -- 172.21.15.99:0/239652828 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556bf1b4af10 msgr2=0x556bf1b54f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:03.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.837+0000 7faf76dfe740 1 --2- 172.21.15.99:0/239652828 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556bf1b4af10 0x556bf1b54f90 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7faf64036040 tx=0x7faf64009500 comp rx=0 tx=0).stop 2024-01-31T05:13:03.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.838+0000 7faf76dfe740 1 -- 172.21.15.99:0/239652828 shutdown_connections 2024-01-31T05:13:03.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.838+0000 7faf76dfe740 1 --2- 172.21.15.99:0/239652828 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x556bf1b60e50 0x556bf1b63240 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.838+0000 7faf76dfe740 1 --2- 172.21.15.99:0/239652828 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556bf1b50a70 0x556bf1b5c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.838+0000 7faf76dfe740 1 --2- 172.21.15.99:0/239652828 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556bf1b4b900 0x556bf1b554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.838+0000 7faf76dfe740 1 --2- 172.21.15.99:0/239652828 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556bf1b4af10 0x556bf1b54f90 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.838+0000 7faf76dfe740 1 -- 172.21.15.99:0/239652828 >> 172.21.15.99:0/239652828 conn(0x556bf1b46480 msgr2=0x556bf1b457c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:03.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.838+0000 7faf557fa640 0 client.15987 ms_handle_reset on v2:172.21.15.179:6836/837402830 2024-01-31T05:13:03.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.839+0000 7faf76dfe740 1 -- 172.21.15.99:0/239652828 shutdown_connections 2024-01-31T05:13:03.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.839+0000 7faf76dfe740 1 -- 172.21.15.99:0/239652828 wait complete. 2024-01-31T05:13:03.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.840+0000 7faf76dfe740 20 client.15987 trim_cache size 0 max 16384 2024-01-31T05:13:03.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.866+0000 7faf76dfe740 1 Processor -- start 2024-01-31T05:13:03.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.866+0000 7faf76dfe740 1 -- start start 2024-01-31T05:13:03.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.866+0000 7faf76dfe740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556bf1b4af10 0x556bf1b46860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.867+0000 7faf76dfe740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556bf1b4b900 0x556bf1b5c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.867+0000 7faf76dfe740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556bf1b50a70 0x556bf1b54ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.867+0000 7faf71dda640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556bf1b4af10 0x556bf1b46860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:03.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.867+0000 7faf71dda640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556bf1b4af10 0x556bf1b46860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.99:48048/0 (socket says 172.21.15.99:48048) 2024-01-31T05:13:03.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.867+0000 7faf725db640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556bf1b50a70 0x556bf1b54ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:03.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.867+0000 7faf725db640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556bf1b50a70 0x556bf1b54ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47238/0 (socket says 172.21.15.99:47238) 2024-01-31T05:13:03.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.867+0000 7faf71dda640 1 -- 172.21.15.99:0/3206239679 learned_addr learned my addr 172.21.15.99:0/3206239679 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:03.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.867+0000 7faf76dfe740 1 -- 172.21.15.99:0/3206239679 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bf1b47420 con 0x556bf1b50a70 2024-01-31T05:13:03.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.867+0000 7faf76dfe740 1 -- 172.21.15.99:0/3206239679 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bf1b68470 con 0x556bf1b4af10 2024-01-31T05:13:03.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.867+0000 7faf76dfe740 1 -- 172.21.15.99:0/3206239679 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bf1b38620 con 0x556bf1b4b900 2024-01-31T05:13:03.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.867+0000 7faf715d9640 1 --2- 172.21.15.99:0/3206239679 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556bf1b4b900 0x556bf1b5c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:03.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.867+0000 7faf715d9640 1 -- 172.21.15.99:0/3206239679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556bf1b4af10 msgr2=0x556bf1b46860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:03.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.867+0000 7faf715d9640 1 --2- 172.21.15.99:0/3206239679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556bf1b4af10 0x556bf1b46860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.867+0000 7faf715d9640 1 -- 172.21.15.99:0/3206239679 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556bf1b50a70 msgr2=0x556bf1b54ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:03.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.867+0000 7faf715d9640 1 --2- 172.21.15.99:0/3206239679 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556bf1b50a70 0x556bf1b54ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.867+0000 7faf715d9640 1 -- 172.21.15.99:0/3206239679 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556bf1a4d4d0 con 0x556bf1b4b900 2024-01-31T05:13:03.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.868+0000 7faf715d9640 1 --2- 172.21.15.99:0/3206239679 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556bf1b4b900 0x556bf1b5c4d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x556bf1b63b10 tx=0x7faf5c012740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2078d37cb7267c18 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:03.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.868+0000 7faf71dda640 1 --2- 172.21.15.99:0/3206239679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556bf1b4af10 0x556bf1b46860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:13:03.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.868+0000 7faf577fe640 1 -- 172.21.15.99:0/3206239679 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c000c30 con 0x556bf1b4b900 2024-01-31T05:13:03.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.868+0000 7faf577fe640 1 -- 172.21.15.99:0/3206239679 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faf5c010da0 con 0x556bf1b4b900 2024-01-31T05:13:03.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.868+0000 7faf577fe640 1 -- 172.21.15.99:0/3206239679 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c0055b0 con 0x556bf1b4b900 2024-01-31T05:13:03.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.868+0000 7faf725db640 1 --2- 172.21.15.99:0/3206239679 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556bf1b50a70 0x556bf1b54ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:13:03.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.869+0000 7faf76dfe740 1 -- 172.21.15.99:0/3206239679 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556bf1b4b900 msgr2=0x556bf1b5c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:03.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.869+0000 7faf76dfe740 1 --2- 172.21.15.99:0/3206239679 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556bf1b4b900 0x556bf1b5c4d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x556bf1b63b10 tx=0x7faf5c012740 comp rx=0 tx=0).stop 2024-01-31T05:13:03.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.869+0000 7faf76dfe740 1 -- 172.21.15.99:0/3206239679 shutdown_connections 2024-01-31T05:13:03.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.869+0000 7faf76dfe740 1 --2- 172.21.15.99:0/3206239679 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556bf1b50a70 0x556bf1b54ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.869+0000 7faf76dfe740 1 --2- 172.21.15.99:0/3206239679 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556bf1b4b900 0x556bf1b5c4d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.869+0000 7faf76dfe740 1 --2- 172.21.15.99:0/3206239679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556bf1b4af10 0x556bf1b46860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.869+0000 7faf76dfe740 1 -- 172.21.15.99:0/3206239679 >> 172.21.15.99:0/3206239679 conn(0x556bf1b46480 msgr2=0x556bf1b41650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:03.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.869+0000 7faf76dfe740 1 -- 172.21.15.99:0/3206239679 shutdown_connections 2024-01-31T05:13:03.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.869+0000 7faf76dfe740 1 -- 172.21.15.99:0/3206239679 wait complete. 2024-01-31T05:13:03.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.870+0000 7faf76dfe740 1 -- start start 2024-01-31T05:13:03.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.870+0000 7faf76dfe740 1 Processor -- start 2024-01-31T05:13:03.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.870+0000 7faf76dfe740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556bf1b4af10 0x556bf1b5aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.870+0000 7faf76dfe740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556bf1b4b900 0x556bf1b5b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.870+0000 7faf76dfe740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556bf1b50a70 0x556bf1b5b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.870+0000 7faf76dfe740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bf1bb7450 con 0x556bf1b4af10 2024-01-31T05:13:03.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.870+0000 7faf76dfe740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bf1bb75c0 con 0x556bf1b50a70 2024-01-31T05:13:03.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.870+0000 7faf76dfe740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bf1bb7780 con 0x556bf1b4b900 2024-01-31T05:13:03.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.870+0000 7faf76dfe740 10 client.0 _ll_register_callbacks cb 0x7faf5c00bab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:13:03.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.870+0000 7faf725db640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556bf1b50a70 0x556bf1b5b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:03.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.871+0000 7faf725db640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556bf1b50a70 0x556bf1b5b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.99:48050/0 (socket says 172.21.15.99:48050) 2024-01-31T05:13:03.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.871+0000 7faf725db640 1 -- 172.21.15.99:0/802377994 learned_addr learned my addr 172.21.15.99:0/802377994 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:03.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.871+0000 7faf71dda640 1 --2- 172.21.15.99:0/802377994 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556bf1b4af10 0x556bf1b5aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:03.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.871+0000 7faf715d9640 1 --2- 172.21.15.99:0/802377994 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556bf1b4b900 0x556bf1b5b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:03.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.871+0000 7faf725db640 1 -- 172.21.15.99:0/802377994 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556bf1b4b900 msgr2=0x556bf1b5b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:03.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.871+0000 7faf725db640 1 --2- 172.21.15.99:0/802377994 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556bf1b4b900 0x556bf1b5b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.871+0000 7faf725db640 1 -- 172.21.15.99:0/802377994 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556bf1b4af10 msgr2=0x556bf1b5aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:03.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.871+0000 7faf725db640 1 --2- 172.21.15.99:0/802377994 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556bf1b4af10 0x556bf1b5aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.871+0000 7faf725db640 1 -- 172.21.15.99:0/802377994 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf6c1962d0 con 0x556bf1b50a70 2024-01-31T05:13:03.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.871+0000 7faf725db640 1 --2- 172.21.15.99:0/802377994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556bf1b50a70 0x556bf1b5b940 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7faf68095be0 tx=0x7faf68099ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87ff2c9c639951c8 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:03.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.871+0000 7faf557fa640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-01-31T05:13:03.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.871+0000 7faf557fa640 1 -- 172.21.15.99:0/802377994 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf680a1ac0 con 0x556bf1b50a70 2024-01-31T05:13:03.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.872+0000 7faf557fa640 1 -- 172.21.15.99:0/802377994 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7faf680a1630 con 0x556bf1b50a70 2024-01-31T05:13:03.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.872+0000 7faf76dfe740 1 -- 172.21.15.99:0/802377994 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faf5c010c30 con 0x556bf1b50a70 2024-01-31T05:13:03.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.872+0000 7faf557fa640 1 -- 172.21.15.99:0/802377994 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf680a17f0 con 0x556bf1b50a70 2024-01-31T05:13:03.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.872+0000 7faf76dfe740 10 client.25388 fetch_fsmap learned FSMap version 28 2024-01-31T05:13:03.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.872+0000 7faf76dfe740 1 -- 172.21.15.99:0/802377994 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7faf5c023040 con 0x556bf1b50a70 2024-01-31T05:13:03.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.873+0000 7faf557fa640 1 -- 172.21.15.99:0/802377994 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faf5c010c30 con 0x556bf1b50a70 2024-01-31T05:13:03.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.873+0000 7faf557fa640 1 -- 172.21.15.99:0/802377994 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 28) v1 ==== 7898+0+0 (secure 0 0 0) 0x7faf68098760 con 0x556bf1b50a70 2024-01-31T05:13:03.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.873+0000 7faf76dfe740 10 client.25388 fetch_fsmap finished waiting for FSMap version 28 2024-01-31T05:13:03.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.873+0000 7faf76dfe740 10 client.25388 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-01-31T05:13:03.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.873+0000 7faf76dfe740 20 client.25388 populate_metadata read hostname 'smithi099' 2024-01-31T05:13:03.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.873+0000 7faf76dfe740 1 --2- 172.21.15.99:0/802377994 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x556bf1bb9280 0x556bf1bbb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:03.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.873+0000 7faf76dfe740 4 client.25388 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-01-31T05:13:03.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.873+0000 7faf76dfe740 1 -- 172.21.15.99:0/802377994 --> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556bf17b17e0 con 0x556bf1bb9280 2024-01-31T05:13:03.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.874+0000 7faf71dda640 1 --2- 172.21.15.99:0/802377994 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x556bf1bb9280 0x556bf1bbb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:03.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.874+0000 7faf71dda640 1 --2- 172.21.15.99:0/802377994 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x556bf1bb9280 0x556bf1bbb6a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b59b55877badd724 server_cookie=adc0c05d5c2a32f2 in_seq=0 out_seq=0 2024-01-31T05:13:03.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.874+0000 7faf557fa640 10 client.25388 ms_handle_connect on v2:172.21.15.179:6836/837402830 2024-01-31T05:13:03.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.875+0000 7faf557fa640 1 -- 172.21.15.99:0/802377994 <== mds.1 v2:172.21.15.179:6836/837402830 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556bf17b17e0 con 0x556bf1bb9280 2024-01-31T05:13:03.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.875+0000 7faf557fa640 10 client.25388 handle_command_reply: tid=0 2024-01-31T05:13:03.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.875+0000 7faf76dfe740 1 client.25388 shutdown 2024-01-31T05:13:03.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.875+0000 7faf76dfe740 1 -- 172.21.15.99:0/802377994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556bf1b50a70 msgr2=0x556bf1b5b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:03.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.875+0000 7faf76dfe740 1 --2- 172.21.15.99:0/802377994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556bf1b50a70 0x556bf1b5b940 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7faf68095be0 tx=0x7faf68099ef0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.875+0000 7faf76dfe740 1 -- 172.21.15.99:0/802377994 shutdown_connections 2024-01-31T05:13:03.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.875+0000 7faf76dfe740 1 --2- 172.21.15.99:0/802377994 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x556bf1bb9280 0x556bf1bbb6a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.875+0000 7faf76dfe740 1 --2- 172.21.15.99:0/802377994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556bf1b50a70 0x556bf1b5b940 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.875+0000 7faf557fa640 0 client.25388 ms_handle_reset on v2:172.21.15.179:6836/837402830 2024-01-31T05:13:03.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.875+0000 7faf76dfe740 1 --2- 172.21.15.99:0/802377994 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556bf1b4b900 0x556bf1b5b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.875+0000 7faf76dfe740 1 --2- 172.21.15.99:0/802377994 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556bf1b4af10 0x556bf1b5aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.875+0000 7faf76dfe740 1 -- 172.21.15.99:0/802377994 >> 172.21.15.99:0/802377994 conn(0x556bf1b46480 msgr2=0x556bf1b46860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:03.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.875+0000 7faf76dfe740 1 -- 172.21.15.99:0/802377994 shutdown_connections 2024-01-31T05:13:03.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.875+0000 7faf76dfe740 1 -- 172.21.15.99:0/802377994 wait complete. 2024-01-31T05:13:03.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.876+0000 7faf76dfe740 20 client.25388 trim_cache size 0 max 16384 2024-01-31T05:13:03.877 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-01-31T05:13:03.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.878+0000 7faf7403e640 1 -- 172.21.15.99:0/3623984790 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7faf580a1270 msgr2=0x7faf580a3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:03.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.878+0000 7faf7403e640 1 --2- 172.21.15.99:0/3623984790 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7faf580a1270 0x7faf580a3730 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7faf6402c500 tx=0x7faf64000f40 comp rx=0 tx=0).stop 2024-01-31T05:13:03.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.878+0000 7faf7403e640 1 -- 172.21.15.99:0/3623984790 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf6c1017c0 msgr2=0x7faf6c19dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:03.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.878+0000 7faf7403e640 1 --2- 172.21.15.99:0/3623984790 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf6c1017c0 0x7faf6c19dfc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faf6800d750 tx=0x7faf6800dc10 comp rx=0 tx=0).stop 2024-01-31T05:13:03.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.878+0000 7faf7403e640 1 -- 172.21.15.99:0/3623984790 shutdown_connections 2024-01-31T05:13:03.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.878+0000 7faf7403e640 1 --2- 172.21.15.99:0/3623984790 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7faf580a1270 0x7faf580a3730 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.878+0000 7faf7403e640 1 --2- 172.21.15.99:0/3623984790 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf6c1017c0 0x7faf6c19dfc0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.878+0000 7faf7403e640 1 --2- 172.21.15.99:0/3623984790 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf6c100e00 0x7faf6c19b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.878+0000 7faf7403e640 1 --2- 172.21.15.99:0/3623984790 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf6c0ffc10 0x7faf6c069e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:03.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.878+0000 7faf7403e640 1 -- 172.21.15.99:0/3623984790 >> 172.21.15.99:0/3623984790 conn(0x7faf6c0fb1a0 msgr2=0x7faf6c104180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:03.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.878+0000 7faf7403e640 1 -- 172.21.15.99:0/3623984790 shutdown_connections 2024-01-31T05:13:03.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:03.878+0000 7faf7403e640 1 -- 172.21.15.99:0/3623984790 wait complete. 2024-01-31T05:13:03.898 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-01-31T05:13:04.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.044+0000 7fd180ca3640 1 -- 172.21.15.99:0/1369150583 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd17c1017a0 msgr2=0x7fd17c108030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:04.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.044+0000 7fd180ca3640 1 --2- 172.21.15.99:0/1369150583 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd17c1017a0 0x7fd17c108030 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fd174009ca0 tx=0x7fd17402c0f0 comp rx=0 tx=0).stop 2024-01-31T05:13:04.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.044+0000 7fd180ca3640 1 -- 172.21.15.99:0/1369150583 shutdown_connections 2024-01-31T05:13:04.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.044+0000 7fd180ca3640 1 --2- 172.21.15.99:0/1369150583 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd17c1017a0 0x7fd17c108030 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:04.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.044+0000 7fd180ca3640 1 --2- 172.21.15.99:0/1369150583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd17c100de0 0x7fd17c101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:04.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.044+0000 7fd180ca3640 1 --2- 172.21.15.99:0/1369150583 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd17c0ffbf0 0x7fd17c100010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:04.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.044+0000 7fd180ca3640 1 -- 172.21.15.99:0/1369150583 >> 172.21.15.99:0/1369150583 conn(0x7fd17c0fb180 msgr2=0x7fd17c0fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:04.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.044+0000 7fd180ca3640 1 -- 172.21.15.99:0/1369150583 shutdown_connections 2024-01-31T05:13:04.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.044+0000 7fd180ca3640 1 -- 172.21.15.99:0/1369150583 wait complete. 2024-01-31T05:13:04.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.044+0000 7fd180ca3640 1 Processor -- start 2024-01-31T05:13:04.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.044+0000 7fd180ca3640 1 -- start start 2024-01-31T05:13:04.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.045+0000 7fd180ca3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd17c0ffbf0 0x7fd17c195b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:04.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.045+0000 7fd180ca3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd17c100de0 0x7fd17c1960d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:04.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.045+0000 7fd180ca3640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd17c1017a0 0x7fd17c19d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:04.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.045+0000 7fd180ca3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd17c19d680 con 0x7fd17c0ffbf0 2024-01-31T05:13:04.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.045+0000 7fd180ca3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd17c19d7f0 con 0x7fd17c100de0 2024-01-31T05:13:04.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.045+0000 7fd180ca3640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd17c19d9b0 con 0x7fd17c1017a0 2024-01-31T05:13:04.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.045+0000 7fd17a59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd17c0ffbf0 0x7fd17c195b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:04.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.045+0000 7fd17a59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd17c0ffbf0 0x7fd17c195b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47258/0 (socket says 172.21.15.99:47258) 2024-01-31T05:13:04.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.045+0000 7fd17a59c640 1 -- 172.21.15.99:0/1863158213 learned_addr learned my addr 172.21.15.99:0/1863158213 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:04.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.045+0000 7fd173fff640 1 --2- 172.21.15.99:0/1863158213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd17c100de0 0x7fd17c1960d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:04.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.045+0000 7fd17ad9d640 1 --2- 172.21.15.99:0/1863158213 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd17c1017a0 0x7fd17c19d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:04.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.045+0000 7fd17a59c640 1 -- 172.21.15.99:0/1863158213 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd17c1017a0 msgr2=0x7fd17c19d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:04.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.045+0000 7fd17a59c640 1 --2- 172.21.15.99:0/1863158213 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd17c1017a0 0x7fd17c19d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:04.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.045+0000 7fd17a59c640 1 -- 172.21.15.99:0/1863158213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd17c100de0 msgr2=0x7fd17c1960d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:04.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.045+0000 7fd17a59c640 1 --2- 172.21.15.99:0/1863158213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd17c100de0 0x7fd17c1960d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:04.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.045+0000 7fd17a59c640 1 -- 172.21.15.99:0/1863158213 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd174009900 con 0x7fd17c0ffbf0 2024-01-31T05:13:04.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.045+0000 7fd17a59c640 1 --2- 172.21.15.99:0/1863158213 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd17c0ffbf0 0x7fd17c195b90 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fd16c00c970 tx=0x7fd16c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:04.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.045+0000 7fd1737fe640 1 -- 172.21.15.99:0/1863158213 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16c004220 con 0x7fd17c0ffbf0 2024-01-31T05:13:04.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.045+0000 7fd1737fe640 1 -- 172.21.15.99:0/1863158213 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd16c007e70 con 0x7fd17c0ffbf0 2024-01-31T05:13:04.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.045+0000 7fd1737fe640 1 -- 172.21.15.99:0/1863158213 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16c004a00 con 0x7fd17c0ffbf0 2024-01-31T05:13:04.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.045+0000 7fd180ca3640 1 -- 172.21.15.99:0/1863158213 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd17c19dc90 con 0x7fd17c0ffbf0 2024-01-31T05:13:04.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.046+0000 7fd180ca3640 1 -- 172.21.15.99:0/1863158213 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd17c19e150 con 0x7fd17c0ffbf0 2024-01-31T05:13:04.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.048+0000 7fd183a60740 1 Processor -- start 2024-01-31T05:13:04.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.048+0000 7fd1737fe640 1 -- 172.21.15.99:0/1863158213 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 20) v1 ==== 135895+0+0 (secure 0 0 0) 0x7fd16c0079b0 con 0x7fd17c0ffbf0 2024-01-31T05:13:04.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.048+0000 7fd183a60740 1 -- start start 2024-01-31T05:13:04.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.048+0000 7fd183a60740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555a70138f10 0x555a70139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:04.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.048+0000 7fd183a60740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555a70139900 0x555a7013e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:04.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.048+0000 7fd183a60740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555a7013ea70 0x555a70140f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:04.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.048+0000 7fd183a60740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a700a7240 con 0x555a70139900 2024-01-31T05:13:04.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.048+0000 7fd183a60740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a700a4930 con 0x555a7013ea70 2024-01-31T05:13:04.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.048+0000 7fd183a60740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a700a0220 con 0x555a70138f10 2024-01-31T05:13:04.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.048+0000 7fd17a59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555a70139900 0x555a7013e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:04.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.048+0000 7fd173fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555a7013ea70 0x555a70140f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:04.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.048+0000 7fd17a59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555a70139900 0x555a7013e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47270/0 (socket says 172.21.15.99:47270) 2024-01-31T05:13:04.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.048+0000 7fd173fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555a7013ea70 0x555a70140f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.99:48090/0 (socket says 172.21.15.99:48090) 2024-01-31T05:13:04.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.048+0000 7fd17a59c640 1 -- 172.21.15.99:0/3040402745 learned_addr learned my addr 172.21.15.99:0/3040402745 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:04.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.048+0000 7fd1737fe640 1 --2- 172.21.15.99:0/1863158213 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd1680a1360 0x7fd1680a3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:04.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.049+0000 7fd17ad9d640 1 --2- 172.21.15.99:0/3040402745 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555a70138f10 0x555a70139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:04.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.049+0000 7fd17ad9d640 1 --2- 172.21.15.99:0/1863158213 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd1680a1360 0x7fd1680a3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:04.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.049+0000 7fd17a59c640 1 -- 172.21.15.99:0/3040402745 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555a70138f10 msgr2=0x555a70139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:04.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.049+0000 7fd17a59c640 1 --2- 172.21.15.99:0/3040402745 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555a70138f10 0x555a70139330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:04.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.049+0000 7fd17a59c640 1 -- 172.21.15.99:0/3040402745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555a7013ea70 msgr2=0x555a70140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:04.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.049+0000 7fd17a59c640 1 --2- 172.21.15.99:0/3040402745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555a7013ea70 0x555a70140f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:04.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.049+0000 7fd1737fe640 1 -- 172.21.15.99:0/1863158213 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fd16c0cc6e0 con 0x7fd17c0ffbf0 2024-01-31T05:13:04.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.049+0000 7fd17a59c640 1 -- 172.21.15.99:0/3040402745 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555a700627c0 con 0x555a70139900 2024-01-31T05:13:04.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.049+0000 7fd173fff640 1 --2- 172.21.15.99:0/3040402745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555a7013ea70 0x555a70140f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:13:04.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.049+0000 7fd17a59c640 1 --2- 172.21.15.99:0/3040402745 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555a70139900 0x555a7013e400 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fd16c0995e0 tx=0x7fd16c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9625f489531d71ce server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:04.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.049+0000 7fd17ad9d640 1 --2- 172.21.15.99:0/1863158213 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd1680a1360 0x7fd1680a3820 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd174006010 tx=0x7fd1740095c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:04.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.049+0000 7fd170ff9640 1 -- 172.21.15.99:0/3040402745 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16c099240 con 0x555a70139900 2024-01-31T05:13:04.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.049+0000 7fd170ff9640 1 -- 172.21.15.99:0/3040402745 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd16c004380 con 0x555a70139900 2024-01-31T05:13:04.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.049+0000 7fd170ff9640 1 -- 172.21.15.99:0/3040402745 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16c0998e0 con 0x555a70139900 2024-01-31T05:13:04.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.050+0000 7fd183a60740 1 -- 172.21.15.99:0/3040402745 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555a70139900 msgr2=0x555a7013e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:04.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.050+0000 7fd183a60740 1 --2- 172.21.15.99:0/3040402745 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555a70139900 0x555a7013e400 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fd16c0995e0 tx=0x7fd16c01b000 comp rx=0 tx=0).stop 2024-01-31T05:13:04.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.050+0000 7fd183a60740 1 -- 172.21.15.99:0/3040402745 shutdown_connections 2024-01-31T05:13:04.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.050+0000 7fd183a60740 1 --2- 172.21.15.99:0/3040402745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555a7013ea70 0x555a70140f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:04.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.050+0000 7fd183a60740 1 --2- 172.21.15.99:0/3040402745 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555a70139900 0x555a7013e400 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:04.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.050+0000 7fd183a60740 1 --2- 172.21.15.99:0/3040402745 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555a70138f10 0x555a70139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:04.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.050+0000 7fd183a60740 1 -- 172.21.15.99:0/3040402745 >> 172.21.15.99:0/3040402745 conn(0x555a70134480 msgr2=0x555a70134880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:04.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.050+0000 7fd183a60740 1 -- 172.21.15.99:0/3040402745 shutdown_connections 2024-01-31T05:13:04.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.050+0000 7fd183a60740 1 -- 172.21.15.99:0/3040402745 wait complete. 2024-01-31T05:13:04.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.050+0000 7fd183a60740 1 -- start start 2024-01-31T05:13:04.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.050+0000 7fd183a60740 1 Processor -- start 2024-01-31T05:13:04.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.051+0000 7fd183a60740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555a70138f10 0x555a70145240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:04.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.051+0000 7fd183a60740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555a70139900 0x555a70145780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:04.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.051+0000 7fd183a60740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555a7013ea70 0x555a7014c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:04.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.051+0000 7fd183a60740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a700595e0 con 0x555a7013ea70 2024-01-31T05:13:04.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.051+0000 7fd183a60740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a70059280 con 0x555a70139900 2024-01-31T05:13:04.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.051+0000 7fd183a60740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a7001e3d0 con 0x555a70138f10 2024-01-31T05:13:04.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.051+0000 7fd183a60740 10 client.0 _ll_register_callbacks cb 0x555a70096eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:13:04.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.051+0000 7fd17ad9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555a7013ea70 0x555a7014c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:04.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.051+0000 7fd17ad9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555a7013ea70 0x555a7014c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47278/0 (socket says 172.21.15.99:47278) 2024-01-31T05:13:04.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.051+0000 7fd17ad9d640 1 -- 172.21.15.99:0/3063879154 learned_addr learned my addr 172.21.15.99:0/3063879154 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:04.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.051+0000 7fd173fff640 1 --2- 172.21.15.99:0/3063879154 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555a70139900 0x555a70145780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:04.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.051+0000 7fd17a59c640 1 --2- 172.21.15.99:0/3063879154 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555a70138f10 0x555a70145240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:04.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.051+0000 7fd17ad9d640 1 -- 172.21.15.99:0/3063879154 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555a70138f10 msgr2=0x555a70145240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:04.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.051+0000 7fd17ad9d640 1 --2- 172.21.15.99:0/3063879154 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555a70138f10 0x555a70145240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:04.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.051+0000 7fd17ad9d640 1 -- 172.21.15.99:0/3063879154 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555a70139900 msgr2=0x555a70145780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:04.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.051+0000 7fd17ad9d640 1 --2- 172.21.15.99:0/3063879154 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555a70139900 0x555a70145780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:04.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.051+0000 7fd17ad9d640 1 -- 172.21.15.99:0/3063879154 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd17c19e150 con 0x555a7013ea70 2024-01-31T05:13:04.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.051+0000 7fd173fff640 1 --2- 172.21.15.99:0/3063879154 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555a70139900 0x555a70145780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:13:04.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.051+0000 7fd17ad9d640 1 --2- 172.21.15.99:0/3063879154 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555a7013ea70 0x555a7014c7c0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fd174036000 tx=0x7fd17402c0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d4ac38359a98045 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:04.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.051+0000 7fd161ffb640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:13:04.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.051+0000 7fd161ffb640 1 -- 172.21.15.99:0/3063879154 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd174003d80 con 0x555a7013ea70 2024-01-31T05:13:04.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.051+0000 7fd161ffb640 1 -- 172.21.15.99:0/3063879154 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fd174004040 con 0x555a7013ea70 2024-01-31T05:13:04.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.051+0000 7fd183a60740 1 -- 172.21.15.99:0/3063879154 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555a700990b0 con 0x555a7013ea70 2024-01-31T05:13:04.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.051+0000 7fd161ffb640 1 -- 172.21.15.99:0/3063879154 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd174004200 con 0x555a7013ea70 2024-01-31T05:13:04.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.051+0000 7fd183a60740 10 client.16005 fetch_fsmap learned FSMap version 28 2024-01-31T05:13:04.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.051+0000 7fd183a60740 1 -- 172.21.15.99:0/3063879154 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x555a7009e8a0 con 0x555a7013ea70 2024-01-31T05:13:04.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.052+0000 7fd161ffb640 1 -- 172.21.15.99:0/3063879154 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x555a700990b0 con 0x555a7013ea70 2024-01-31T05:13:04.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.052+0000 7fd161ffb640 1 -- 172.21.15.99:0/3063879154 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 28) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fd17403e040 con 0x555a7013ea70 2024-01-31T05:13:04.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.052+0000 7fd183a60740 10 client.16005 fetch_fsmap finished waiting for FSMap version 28 2024-01-31T05:13:04.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.052+0000 7fd183a60740 10 client.16005 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-01-31T05:13:04.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.052+0000 7fd183a60740 20 client.16005 populate_metadata read hostname 'smithi099' 2024-01-31T05:13:04.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.052+0000 7fd183a60740 1 --2- 172.21.15.99:0/3063879154 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x555a70151200 0x555a70153620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:04.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.052+0000 7fd183a60740 4 client.16005 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:13:04.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.052+0000 7fd183a60740 1 -- 172.21.15.99:0/3063879154 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555a70098dd0 con 0x555a70151200 2024-01-31T05:13:04.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.052+0000 7fd17a59c640 1 --2- 172.21.15.99:0/3063879154 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x555a70151200 0x555a70153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:04.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.052+0000 7fd17a59c640 1 --2- 172.21.15.99:0/3063879154 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x555a70151200 0x555a70153620 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28b9f3f36d96cbf6 server_cookie=2bee3ae69b01aa7d in_seq=0 out_seq=0 2024-01-31T05:13:04.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.052+0000 7fd161ffb640 10 client.16005 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:13:04.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.054+0000 7fd161ffb640 1 -- 172.21.15.99:0/3063879154 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555a70098dd0 con 0x555a70151200 2024-01-31T05:13:04.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.054+0000 7fd161ffb640 10 client.16005 handle_command_reply: tid=0 2024-01-31T05:13:04.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.054+0000 7fd183a60740 1 client.16005 shutdown 2024-01-31T05:13:04.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.054+0000 7fd183a60740 1 -- 172.21.15.99:0/3063879154 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555a7013ea70 msgr2=0x555a7014c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:04.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.054+0000 7fd183a60740 1 --2- 172.21.15.99:0/3063879154 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555a7013ea70 0x555a7014c7c0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fd174036000 tx=0x7fd17402c0f0 comp rx=0 tx=0).stop 2024-01-31T05:13:04.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.055+0000 7fd183a60740 1 -- 172.21.15.99:0/3063879154 shutdown_connections 2024-01-31T05:13:04.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.055+0000 7fd183a60740 1 --2- 172.21.15.99:0/3063879154 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555a7013ea70 0x555a7014c7c0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:04.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.055+0000 7fd183a60740 1 --2- 172.21.15.99:0/3063879154 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x555a70151200 0x555a70153620 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:04.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.055+0000 7fd183a60740 1 --2- 172.21.15.99:0/3063879154 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555a70139900 0x555a70145780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:04.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.055+0000 7fd183a60740 1 --2- 172.21.15.99:0/3063879154 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555a70138f10 0x555a70145240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:04.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.055+0000 7fd161ffb640 0 client.16005 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:13:04.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.055+0000 7fd183a60740 1 -- 172.21.15.99:0/3063879154 >> 172.21.15.99:0/3063879154 conn(0x555a70134480 msgr2=0x555a701337c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:04.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.055+0000 7fd183a60740 1 -- 172.21.15.99:0/3063879154 shutdown_connections 2024-01-31T05:13:04.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.055+0000 7fd183a60740 1 -- 172.21.15.99:0/3063879154 wait complete. 2024-01-31T05:13:04.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.055+0000 7fd183a60740 20 client.16005 trim_cache size 0 max 16384 2024-01-31T05:13:04.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.066+0000 7fd183a60740 1 Processor -- start 2024-01-31T05:13:04.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.066+0000 7fd183a60740 1 -- start start 2024-01-31T05:13:04.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.067+0000 7fd183a60740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555a70138f10 0x555a7013adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:04.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.067+0000 7fd183a60740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555a70139900 0x555a7013b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:04.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.067+0000 7fd183a60740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555a7013ea70 0x555a7014c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:04.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.067+0000 7fd183a60740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a70098dd0 con 0x555a70138f10 2024-01-31T05:13:04.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.067+0000 7fd183a60740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a700990b0 con 0x555a7013ea70 2024-01-31T05:13:04.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.067+0000 7fd183a60740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a70139d30 con 0x555a70139900 2024-01-31T05:13:04.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.067+0000 7fd17a59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555a70138f10 0x555a7013adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:04.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.067+0000 7fd17a59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555a70138f10 0x555a7013adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47288/0 (socket says 172.21.15.99:47288) 2024-01-31T05:13:04.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.067+0000 7fd17a59c640 1 -- 172.21.15.99:0/392072238 learned_addr learned my addr 172.21.15.99:0/392072238 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:04.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.067+0000 7fd17ad9d640 1 --2- 172.21.15.99:0/392072238 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555a7013ea70 0x555a7014c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:04.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.067+0000 7fd173fff640 1 --2- 172.21.15.99:0/392072238 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555a70139900 0x555a7013b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:04.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.067+0000 7fd17a59c640 1 -- 172.21.15.99:0/392072238 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555a70139900 msgr2=0x555a7013b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:04.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.067+0000 7fd17a59c640 1 --2- 172.21.15.99:0/392072238 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555a70139900 0x555a7013b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:04.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.067+0000 7fd17a59c640 1 -- 172.21.15.99:0/392072238 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555a7013ea70 msgr2=0x555a7014c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:04.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.067+0000 7fd17a59c640 1 --2- 172.21.15.99:0/392072238 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555a7013ea70 0x555a7014c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:04.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.067+0000 7fd17a59c640 1 -- 172.21.15.99:0/392072238 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555a7003b4d0 con 0x555a70138f10 2024-01-31T05:13:04.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.067+0000 7fd17ad9d640 1 --2- 172.21.15.99:0/392072238 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555a7013ea70 0x555a7014c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:13:04.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.067+0000 7fd17a59c640 1 --2- 172.21.15.99:0/392072238 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555a70138f10 0x555a7013adc0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fd16c004510 tx=0x7fd16c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a6ff4da8ea9457d server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:04.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.067+0000 7fd163fff640 1 -- 172.21.15.99:0/392072238 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16c099420 con 0x555a70138f10 2024-01-31T05:13:04.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.067+0000 7fd163fff640 1 -- 172.21.15.99:0/392072238 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd16c099fe0 con 0x555a70138f10 2024-01-31T05:13:04.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.067+0000 7fd163fff640 1 -- 172.21.15.99:0/392072238 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16c095ff0 con 0x555a70138f10 2024-01-31T05:13:04.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.068+0000 7fd183a60740 1 -- 172.21.15.99:0/392072238 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555a70138f10 msgr2=0x555a7013adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:04.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.068+0000 7fd183a60740 1 --2- 172.21.15.99:0/392072238 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555a70138f10 0x555a7013adc0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fd16c004510 tx=0x7fd16c01b000 comp rx=0 tx=0).stop 2024-01-31T05:13:04.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.068+0000 7fd183a60740 1 -- 172.21.15.99:0/392072238 shutdown_connections 2024-01-31T05:13:04.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.068+0000 7fd183a60740 1 --2- 172.21.15.99:0/392072238 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555a7013ea70 0x555a7014c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:04.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.068+0000 7fd183a60740 1 --2- 172.21.15.99:0/392072238 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555a70139900 0x555a7013b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:04.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.068+0000 7fd183a60740 1 --2- 172.21.15.99:0/392072238 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555a70138f10 0x555a7013adc0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:04.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.068+0000 7fd183a60740 1 -- 172.21.15.99:0/392072238 >> 172.21.15.99:0/392072238 conn(0x555a70134480 msgr2=0x555a70134860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:04.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.068+0000 7fd183a60740 1 -- 172.21.15.99:0/392072238 shutdown_connections 2024-01-31T05:13:04.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.068+0000 7fd183a60740 1 -- 172.21.15.99:0/392072238 wait complete. 2024-01-31T05:13:04.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.068+0000 7fd183a60740 1 -- start start 2024-01-31T05:13:04.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.069+0000 7fd183a60740 1 Processor -- start 2024-01-31T05:13:04.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.069+0000 7fd183a60740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555a70138f10 0x555a7014c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:04.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.069+0000 7fd183a60740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555a70139900 0x555a7014ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:04.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.069+0000 7fd183a60740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555a7013ea70 0x555a7014b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:04.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.069+0000 7fd183a60740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a7014ba20 con 0x555a70139900 2024-01-31T05:13:04.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.069+0000 7fd183a60740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a7014bb90 con 0x555a7013ea70 2024-01-31T05:13:04.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.069+0000 7fd183a60740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a701a76b0 con 0x555a70138f10 2024-01-31T05:13:04.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.069+0000 7fd183a60740 10 client.0 _ll_register_callbacks cb 0x7fd16c095c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:13:04.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.069+0000 7fd173fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555a70139900 0x555a7014ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:04.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.069+0000 7fd173fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555a70139900 0x555a7014ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47294/0 (socket says 172.21.15.99:47294) 2024-01-31T05:13:04.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.069+0000 7fd173fff640 1 -- 172.21.15.99:0/4069156310 learned_addr learned my addr 172.21.15.99:0/4069156310 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:04.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.069+0000 7fd17a59c640 1 --2- 172.21.15.99:0/4069156310 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555a70138f10 0x555a7014c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:04.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.069+0000 7fd17ad9d640 1 --2- 172.21.15.99:0/4069156310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555a7013ea70 0x555a7014b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:04.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.069+0000 7fd173fff640 1 -- 172.21.15.99:0/4069156310 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555a70138f10 msgr2=0x555a7014c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:04.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.069+0000 7fd173fff640 1 --2- 172.21.15.99:0/4069156310 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555a70138f10 0x555a7014c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:04.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.069+0000 7fd173fff640 1 -- 172.21.15.99:0/4069156310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555a7013ea70 msgr2=0x555a7014b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:04.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.069+0000 7fd173fff640 1 --2- 172.21.15.99:0/4069156310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555a7013ea70 0x555a7014b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:04.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.069+0000 7fd173fff640 1 -- 172.21.15.99:0/4069156310 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555a7009e8a0 con 0x555a70139900 2024-01-31T05:13:04.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.069+0000 7fd173fff640 1 --2- 172.21.15.99:0/4069156310 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555a70139900 0x555a7014ad60 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x555a701353f0 tx=0x7fd16400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=742e962bec51ac23 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:04.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.069+0000 7fd161ffb640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:13:04.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.069+0000 7fd161ffb640 1 -- 172.21.15.99:0/4069156310 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd164017040 con 0x555a70139900 2024-01-31T05:13:04.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.069+0000 7fd161ffb640 1 -- 172.21.15.99:0/4069156310 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fd164004250 con 0x555a70139900 2024-01-31T05:13:04.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.069+0000 7fd183a60740 1 -- 172.21.15.99:0/4069156310 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd16c004380 con 0x555a70139900 2024-01-31T05:13:04.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.070+0000 7fd161ffb640 1 -- 172.21.15.99:0/4069156310 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd16400feb0 con 0x555a70139900 2024-01-31T05:13:04.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.070+0000 7fd183a60740 10 client.16011 fetch_fsmap learned FSMap version 28 2024-01-31T05:13:04.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.070+0000 7fd183a60740 1 -- 172.21.15.99:0/4069156310 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x555a700627c0 con 0x555a70139900 2024-01-31T05:13:04.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.070+0000 7fd161ffb640 1 -- 172.21.15.99:0/4069156310 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd16c004380 con 0x555a70139900 2024-01-31T05:13:04.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.070+0000 7fd161ffb640 1 -- 172.21.15.99:0/4069156310 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 28) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fd164010430 con 0x555a70139900 2024-01-31T05:13:04.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.070+0000 7fd183a60740 10 client.16011 fetch_fsmap finished waiting for FSMap version 28 2024-01-31T05:13:04.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.070+0000 7fd183a60740 10 client.16011 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-01-31T05:13:04.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.070+0000 7fd183a60740 20 client.16011 populate_metadata read hostname 'smithi099' 2024-01-31T05:13:04.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.070+0000 7fd183a60740 1 --2- 172.21.15.99:0/4069156310 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x555a701a9300 0x555a701ab720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:04.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.070+0000 7fd183a60740 4 client.16011 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-01-31T05:13:04.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.070+0000 7fd183a60740 1 -- 172.21.15.99:0/4069156310 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x555a6fd9f7e0 con 0x555a701a9300 2024-01-31T05:13:04.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.070+0000 7fd17a59c640 1 --2- 172.21.15.99:0/4069156310 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x555a701a9300 0x555a701ab720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:04.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.070+0000 7fd161ffb640 10 client.16011 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:13:04.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.070+0000 7fd17a59c640 1 --2- 172.21.15.99:0/4069156310 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x555a701a9300 0x555a701ab720 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cd95165ab7a2fbc server_cookie=5931ae5134917a26 in_seq=0 out_seq=0 2024-01-31T05:13:04.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.073+0000 7fd161ffb640 1 -- 172.21.15.99:0/4069156310 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x555a6fd9f7e0 con 0x555a701a9300 2024-01-31T05:13:04.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.073+0000 7fd161ffb640 10 client.16011 handle_command_reply: tid=0 2024-01-31T05:13:04.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.073+0000 7fd183a60740 1 client.16011 shutdown 2024-01-31T05:13:04.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.073+0000 7fd183a60740 1 -- 172.21.15.99:0/4069156310 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555a70139900 msgr2=0x555a7014ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:04.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.073+0000 7fd183a60740 1 --2- 172.21.15.99:0/4069156310 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555a70139900 0x555a7014ad60 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x555a701353f0 tx=0x7fd16400f790 comp rx=0 tx=0).stop 2024-01-31T05:13:04.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.073+0000 7fd183a60740 1 -- 172.21.15.99:0/4069156310 shutdown_connections 2024-01-31T05:13:04.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.073+0000 7fd183a60740 1 --2- 172.21.15.99:0/4069156310 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x555a701a9300 0x555a701ab720 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:04.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.073+0000 7fd183a60740 1 --2- 172.21.15.99:0/4069156310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555a7013ea70 0x555a7014b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:04.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.073+0000 7fd183a60740 1 --2- 172.21.15.99:0/4069156310 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555a70139900 0x555a7014ad60 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:04.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.073+0000 7fd183a60740 1 --2- 172.21.15.99:0/4069156310 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555a70138f10 0x555a7014c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:04.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.073+0000 7fd161ffb640 0 client.16011 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:13:04.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.073+0000 7fd183a60740 1 -- 172.21.15.99:0/4069156310 >> 172.21.15.99:0/4069156310 conn(0x555a70134480 msgr2=0x555a70145080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:04.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.073+0000 7fd183a60740 1 -- 172.21.15.99:0/4069156310 shutdown_connections 2024-01-31T05:13:04.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.073+0000 7fd183a60740 1 -- 172.21.15.99:0/4069156310 wait complete. 2024-01-31T05:13:04.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.073+0000 7fd183a60740 20 client.16011 trim_cache size 0 max 16384 2024-01-31T05:13:04.077 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-01-31T05:13:04.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.073+0000 7fd180ca3640 1 -- 172.21.15.99:0/1863158213 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd1680a1360 msgr2=0x7fd1680a3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:04.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.073+0000 7fd180ca3640 1 --2- 172.21.15.99:0/1863158213 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd1680a1360 0x7fd1680a3820 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd174006010 tx=0x7fd1740095c0 comp rx=0 tx=0).stop 2024-01-31T05:13:04.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.073+0000 7fd180ca3640 1 -- 172.21.15.99:0/1863158213 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd17c0ffbf0 msgr2=0x7fd17c195b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:04.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.073+0000 7fd180ca3640 1 --2- 172.21.15.99:0/1863158213 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd17c0ffbf0 0x7fd17c195b90 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fd16c00c970 tx=0x7fd16c00ce30 comp rx=0 tx=0).stop 2024-01-31T05:13:04.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.073+0000 7fd180ca3640 1 -- 172.21.15.99:0/1863158213 shutdown_connections 2024-01-31T05:13:04.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.073+0000 7fd180ca3640 1 --2- 172.21.15.99:0/1863158213 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fd1680a1360 0x7fd1680a3820 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:04.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.073+0000 7fd180ca3640 1 --2- 172.21.15.99:0/1863158213 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd17c1017a0 0x7fd17c19d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:04.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.073+0000 7fd180ca3640 1 --2- 172.21.15.99:0/1863158213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd17c100de0 0x7fd17c1960d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:04.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.073+0000 7fd180ca3640 1 --2- 172.21.15.99:0/1863158213 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd17c0ffbf0 0x7fd17c195b90 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:04.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.073+0000 7fd180ca3640 1 -- 172.21.15.99:0/1863158213 >> 172.21.15.99:0/1863158213 conn(0x7fd17c0fb180 msgr2=0x7fd17c104200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:04.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.074+0000 7fd180ca3640 1 -- 172.21.15.99:0/1863158213 shutdown_connections 2024-01-31T05:13:04.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:04.074+0000 7fd180ca3640 1 -- 172.21.15.99:0/1863158213 wait complete. 2024-01-31T05:13:04.079 INFO:tasks.workunit.client.0.smithi099.stdout:6/7: dread f1 [0,4194304] 0 2024-01-31T05:13:04.079 INFO:tasks.workunit.client.0.smithi099.stdout:6/8: chown f1 88531083 1 2024-01-31T05:13:04.741 INFO:tasks.workunit.client.0.smithi099.stdout:5/8: mknod c2 0 2024-01-31T05:13:04.742 INFO:tasks.workunit.client.0.smithi099.stdout:5/9: readlink l0 0 2024-01-31T05:13:05.084 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-01-31T05:13:05.085 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-01-31T05:13:05.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.197+0000 7f33b6419640 1 -- 172.21.15.99:0/2497906661 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f33b0100150 msgr2=0x7f33b0100570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:05.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.197+0000 7f33b6419640 1 --2- 172.21.15.99:0/2497906661 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f33b0100150 0x7f33b0100570 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f33a0009900 tx=0x7f33a002bc30 comp rx=0 tx=0).stop 2024-01-31T05:13:05.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.197+0000 7f33b6419640 1 -- 172.21.15.99:0/2497906661 shutdown_connections 2024-01-31T05:13:05.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.197+0000 7f33b6419640 1 --2- 172.21.15.99:0/2497906661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33b0101820 0x7f33b01080b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:05.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.197+0000 7f33b6419640 1 --2- 172.21.15.99:0/2497906661 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f33b0100e60 0x7f33b01012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:05.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.197+0000 7f33b6419640 1 --2- 172.21.15.99:0/2497906661 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f33b0100150 0x7f33b0100570 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:05.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.197+0000 7f33b6419640 1 -- 172.21.15.99:0/2497906661 >> 172.21.15.99:0/2497906661 conn(0x7f33b00fa920 msgr2=0x7f33b00fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:05.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.197+0000 7f33b6419640 1 -- 172.21.15.99:0/2497906661 shutdown_connections 2024-01-31T05:13:05.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.197+0000 7f33b6419640 1 -- 172.21.15.99:0/2497906661 wait complete. 2024-01-31T05:13:05.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.198+0000 7f33b6419640 1 Processor -- start 2024-01-31T05:13:05.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.198+0000 7f33b6419640 1 -- start start 2024-01-31T05:13:05.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.198+0000 7f33b6419640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f33b0100150 0x7f33b0196da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:05.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.198+0000 7f33b6419640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33b0100e60 0x7f33b01972e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:05.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.198+0000 7f33b6419640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f33b0101820 0x7f33b019e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:05.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.198+0000 7f33b6419640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b019e880 con 0x7f33b0100150 2024-01-31T05:13:05.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.198+0000 7f33b6419640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b019e9f0 con 0x7f33b0100e60 2024-01-31T05:13:05.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.198+0000 7f33b6419640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b019ebb0 con 0x7f33b0101820 2024-01-31T05:13:05.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.198+0000 7f33affff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f33b0100150 0x7f33b0196da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:05.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.198+0000 7f33affff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f33b0100150 0x7f33b0196da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47312/0 (socket says 172.21.15.99:47312) 2024-01-31T05:13:05.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.198+0000 7f33affff640 1 -- 172.21.15.99:0/806602066 learned_addr learned my addr 172.21.15.99:0/806602066 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:05.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.198+0000 7f33af7fe640 1 --2- 172.21.15.99:0/806602066 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33b0100e60 0x7f33b01972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:05.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.198+0000 7f33affff640 1 -- 172.21.15.99:0/806602066 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f33b0101820 msgr2=0x7f33b019e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:05.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.198+0000 7f33affff640 1 --2- 172.21.15.99:0/806602066 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f33b0101820 0x7f33b019e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:05.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.198+0000 7f33affff640 1 -- 172.21.15.99:0/806602066 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33b0100e60 msgr2=0x7f33b01972e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:05.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.198+0000 7f33affff640 1 --2- 172.21.15.99:0/806602066 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33b0100e60 0x7f33b01972e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:05.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.198+0000 7f33affff640 1 -- 172.21.15.99:0/806602066 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a0009560 con 0x7f33b0100150 2024-01-31T05:13:05.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.199+0000 7f33affff640 1 --2- 172.21.15.99:0/806602066 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f33b0100150 0x7f33b0196da0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f33a0000c00 tx=0x7f33a00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:05.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.199+0000 7f33ad7fa640 1 -- 172.21.15.99:0/806602066 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a0004ac0 con 0x7f33b0100150 2024-01-31T05:13:05.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.199+0000 7f33ad7fa640 1 -- 172.21.15.99:0/806602066 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f33a00044e0 con 0x7f33b0100150 2024-01-31T05:13:05.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.199+0000 7f33b6419640 1 -- 172.21.15.99:0/806602066 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33b019ee30 con 0x7f33b0100150 2024-01-31T05:13:05.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.199+0000 7f33ad7fa640 1 -- 172.21.15.99:0/806602066 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a0005630 con 0x7f33b0100150 2024-01-31T05:13:05.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.199+0000 7f33b6419640 1 -- 172.21.15.99:0/806602066 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33b019f2d0 con 0x7f33b0100150 2024-01-31T05:13:05.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.201+0000 7f33ad7fa640 1 -- 172.21.15.99:0/806602066 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 20) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f33a0004dd0 con 0x7f33b0100150 2024-01-31T05:13:05.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.201+0000 7f33b91dc740 1 Processor -- start 2024-01-31T05:13:05.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.201+0000 7f33b91dc740 1 -- start start 2024-01-31T05:13:05.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.201+0000 7f33ad7fa640 1 --2- 172.21.15.99:0/806602066 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f33980a12e0 0x7f33980a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:05.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.201+0000 7f33b91dc740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d5120a050 0x558d5120a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:05.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.201+0000 7f33b91dc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558d5120aa40 0x558d5120f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:05.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.201+0000 7f33b49b6640 1 --2- 172.21.15.99:0/806602066 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f33980a12e0 0x7f33980a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:05.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.201+0000 7f33b91dc740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558d5120fbb0 0x558d51212040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:05.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.201+0000 7f33b91dc740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d511e0bf0 con 0x558d5120a050 2024-01-31T05:13:05.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.201+0000 7f33b91dc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d51178f50 con 0x558d5120aa40 2024-01-31T05:13:05.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.201+0000 7f33b91dc740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d51176640 con 0x558d5120fbb0 2024-01-31T05:13:05.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.201+0000 7f33ad7fa640 1 -- 172.21.15.99:0/806602066 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f33a00ef430 con 0x7f33b0100150 2024-01-31T05:13:05.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.202+0000 7f33af7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558d5120aa40 0x558d5120f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:05.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.202+0000 7f33af7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558d5120aa40 0x558d5120f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.99:48160/0 (socket says 172.21.15.99:48160) 2024-01-31T05:13:05.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.202+0000 7f33affff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d5120a050 0x558d5120a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:05.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.202+0000 7f33af7fe640 1 -- 172.21.15.99:0/2875085761 learned_addr learned my addr 172.21.15.99:0/2875085761 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:05.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.202+0000 7f33b49b6640 1 --2- 172.21.15.99:0/2875085761 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558d5120fbb0 0x558d51212040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:05.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.202+0000 7f33af7fe640 1 -- 172.21.15.99:0/2875085761 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558d5120fbb0 msgr2=0x558d51212040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:05.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.202+0000 7f33af7fe640 1 --2- 172.21.15.99:0/2875085761 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558d5120fbb0 0x558d51212040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:05.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.202+0000 7f33af7fe640 1 -- 172.21.15.99:0/2875085761 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d5120a050 msgr2=0x558d5120a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:05.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.202+0000 7f33af7fe640 1 --2- 172.21.15.99:0/2875085761 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d5120a050 0x558d5120a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:05.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.202+0000 7f33af7fe640 1 -- 172.21.15.99:0/2875085761 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d51169d50 con 0x558d5120aa40 2024-01-31T05:13:05.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.202+0000 7f33b49b6640 1 --2- 172.21.15.99:0/2875085761 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558d5120fbb0 0x558d51212040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:13:05.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.202+0000 7f33affff640 1 --2- 172.21.15.99:0/2875085761 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d5120a050 0x558d5120a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:13:05.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.202+0000 7f33b49b6640 1 --2- 172.21.15.99:0/806602066 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f33980a12e0 0x7f33980a37a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f33a8009270 tx=0x7f33a8012a30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:05.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.202+0000 7f33af7fe640 1 --2- 172.21.15.99:0/2875085761 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558d5120aa40 0x558d5120f540 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f33a4009a70 tx=0x7f33a4009e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf11635940e0a79d server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:05.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.202+0000 7f33967fc640 1 -- 172.21.15.99:0/2875085761 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a4009570 con 0x558d5120aa40 2024-01-31T05:13:05.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.202+0000 7f33967fc640 1 -- 172.21.15.99:0/2875085761 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f33a4013470 con 0x558d5120aa40 2024-01-31T05:13:05.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.202+0000 7f33967fc640 1 -- 172.21.15.99:0/2875085761 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a400eee0 con 0x558d5120aa40 2024-01-31T05:13:05.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.203+0000 7f33b91dc740 1 -- 172.21.15.99:0/2875085761 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558d5120aa40 msgr2=0x558d5120f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:05.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.203+0000 7f33b91dc740 1 --2- 172.21.15.99:0/2875085761 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558d5120aa40 0x558d5120f540 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f33a4009a70 tx=0x7f33a4009e70 comp rx=0 tx=0).stop 2024-01-31T05:13:05.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.203+0000 7f33b91dc740 1 -- 172.21.15.99:0/2875085761 shutdown_connections 2024-01-31T05:13:05.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.203+0000 7f33b91dc740 1 --2- 172.21.15.99:0/2875085761 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558d5120fbb0 0x558d51212040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:05.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.203+0000 7f33b91dc740 1 --2- 172.21.15.99:0/2875085761 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558d5120aa40 0x558d5120f540 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:05.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.203+0000 7f33b91dc740 1 --2- 172.21.15.99:0/2875085761 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d5120a050 0x558d5120a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:05.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.203+0000 7f33b91dc740 1 -- 172.21.15.99:0/2875085761 >> 172.21.15.99:0/2875085761 conn(0x558d512055c0 msgr2=0x558d512059c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:05.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.203+0000 7f33b91dc740 1 -- 172.21.15.99:0/2875085761 shutdown_connections 2024-01-31T05:13:05.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.203+0000 7f33b91dc740 1 -- 172.21.15.99:0/2875085761 wait complete. 2024-01-31T05:13:05.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.203+0000 7f33b91dc740 1 -- start start 2024-01-31T05:13:05.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.204+0000 7f33b91dc740 1 Processor -- start 2024-01-31T05:13:05.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.204+0000 7f33b91dc740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558d5120a050 0x558d512140e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:05.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.204+0000 7f33b91dc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558d5120aa40 0x558d51214620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:05.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.204+0000 7f33b91dc740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d5120fbb0 0x558d5121b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:05.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.204+0000 7f33b91dc740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d51171f30 con 0x558d5120fbb0 2024-01-31T05:13:05.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.204+0000 7f33b91dc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d5112b0c0 con 0x558d5120aa40 2024-01-31T05:13:05.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.204+0000 7f33b91dc740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d5112ad60 con 0x558d5120a050 2024-01-31T05:13:05.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.204+0000 7f33b91dc740 10 client.0 _ll_register_callbacks cb 0x558d51110fc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:13:05.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.204+0000 7f33b49b6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d5120fbb0 0x558d5121b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:05.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.204+0000 7f33af7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558d5120aa40 0x558d51214620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:05.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.204+0000 7f33af7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558d5120aa40 0x558d51214620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.99:48164/0 (socket says 172.21.15.99:48164) 2024-01-31T05:13:05.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.204+0000 7f33af7fe640 1 -- 172.21.15.99:0/4185222978 learned_addr learned my addr 172.21.15.99:0/4185222978 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:05.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.204+0000 7f33affff640 1 --2- 172.21.15.99:0/4185222978 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558d5120a050 0x558d512140e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:05.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.204+0000 7f33af7fe640 1 -- 172.21.15.99:0/4185222978 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558d5120a050 msgr2=0x558d512140e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:05.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.204+0000 7f33af7fe640 1 --2- 172.21.15.99:0/4185222978 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558d5120a050 0x558d512140e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:05.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.204+0000 7f33af7fe640 1 -- 172.21.15.99:0/4185222978 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d5120fbb0 msgr2=0x558d5121b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:05.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.204+0000 7f33af7fe640 1 --2- 172.21.15.99:0/4185222978 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d5120fbb0 0x558d5121b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:05.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.204+0000 7f33af7fe640 1 -- 172.21.15.99:0/4185222978 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33a40096d0 con 0x558d5120aa40 2024-01-31T05:13:05.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.204+0000 7f33b49b6640 1 --2- 172.21.15.99:0/4185222978 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d5120fbb0 0x558d5121b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:13:05.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.204+0000 7f33affff640 1 --2- 172.21.15.99:0/4185222978 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558d5120a050 0x558d512140e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:13:05.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.204+0000 7f33af7fe640 1 --2- 172.21.15.99:0/4185222978 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558d5120aa40 0x558d51214620 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f33a4019000 tx=0x7f33a400ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1dbe91e99dc14bce server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:05.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.204+0000 7f338f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-01-31T05:13:05.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.205+0000 7f338f7fe640 1 -- 172.21.15.99:0/4185222978 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a4013bc0 con 0x558d5120aa40 2024-01-31T05:13:05.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.205+0000 7f338f7fe640 1 -- 172.21.15.99:0/4185222978 <== mon.2 v2:172.21.15.179:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f33a401c660 con 0x558d5120aa40 2024-01-31T05:13:05.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.205+0000 7f33b91dc740 1 -- 172.21.15.99:0/4185222978 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558d5116af20 con 0x558d5120aa40 2024-01-31T05:13:05.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.205+0000 7f338f7fe640 1 -- 172.21.15.99:0/4185222978 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f33a4009550 con 0x558d5120aa40 2024-01-31T05:13:05.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.205+0000 7f33b91dc740 10 client.25418 fetch_fsmap learned FSMap version 28 2024-01-31T05:13:05.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.205+0000 7f33b91dc740 1 -- 172.21.15.99:0/4185222978 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x558d511705b0 con 0x558d5120aa40 2024-01-31T05:13:05.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.205+0000 7f338f7fe640 1 -- 172.21.15.99:0/4185222978 <== mon.2 v2:172.21.15.179:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558d5116af20 con 0x558d5120aa40 2024-01-31T05:13:05.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.205+0000 7f338f7fe640 1 -- 172.21.15.99:0/4185222978 <== mon.2 v2:172.21.15.179:3300/0 5 ==== fsmap(e 28) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f33a4011070 con 0x558d5120aa40 2024-01-31T05:13:05.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.205+0000 7f33b91dc740 10 client.25418 fetch_fsmap finished waiting for FSMap version 28 2024-01-31T05:13:05.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.205+0000 7f33b91dc740 10 client.25418 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-01-31T05:13:05.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.205+0000 7f33b91dc740 20 client.25418 populate_metadata read hostname 'smithi099' 2024-01-31T05:13:05.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.205+0000 7f33b91dc740 1 --2- 172.21.15.99:0/4185222978 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x558d512202f0 0x558d51222710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:05.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.205+0000 7f33b91dc740 4 client.25418 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:13:05.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.205+0000 7f33b91dc740 1 -- 172.21.15.99:0/4185222978 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558d5116ac40 con 0x558d512202f0 2024-01-31T05:13:05.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.205+0000 7f33affff640 1 --2- 172.21.15.99:0/4185222978 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x558d512202f0 0x558d51222710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:05.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.206+0000 7f33affff640 1 --2- 172.21.15.99:0/4185222978 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x558d512202f0 0x558d51222710 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d52d314bbf5d756 server_cookie=a58c067681ce0af in_seq=0 out_seq=0 2024-01-31T05:13:05.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.206+0000 7f338f7fe640 10 client.25418 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:13:05.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.208+0000 7f338f7fe640 1 -- 172.21.15.99:0/4185222978 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558d5116ac40 con 0x558d512202f0 2024-01-31T05:13:05.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.208+0000 7f338f7fe640 10 client.25418 handle_command_reply: tid=0 2024-01-31T05:13:05.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.208+0000 7f33b91dc740 1 client.25418 shutdown 2024-01-31T05:13:05.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.208+0000 7f33b91dc740 1 -- 172.21.15.99:0/4185222978 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558d5120aa40 msgr2=0x558d51214620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:05.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.208+0000 7f33b91dc740 1 --2- 172.21.15.99:0/4185222978 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558d5120aa40 0x558d51214620 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f33a4019000 tx=0x7f33a400ecd0 comp rx=0 tx=0).stop 2024-01-31T05:13:05.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.208+0000 7f33b91dc740 1 -- 172.21.15.99:0/4185222978 shutdown_connections 2024-01-31T05:13:05.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.208+0000 7f33b91dc740 1 --2- 172.21.15.99:0/4185222978 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d5120fbb0 0x558d5121b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:05.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.208+0000 7f33b91dc740 1 --2- 172.21.15.99:0/4185222978 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x558d512202f0 0x558d51222710 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:05.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.208+0000 7f33b91dc740 1 --2- 172.21.15.99:0/4185222978 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558d5120aa40 0x558d51214620 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:05.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.208+0000 7f338f7fe640 0 client.25418 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:13:05.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.208+0000 7f33b91dc740 1 --2- 172.21.15.99:0/4185222978 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558d5120a050 0x558d512140e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:05.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.208+0000 7f33b91dc740 1 -- 172.21.15.99:0/4185222978 >> 172.21.15.99:0/4185222978 conn(0x558d512055c0 msgr2=0x558d51204960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:05.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.208+0000 7f33b91dc740 1 -- 172.21.15.99:0/4185222978 shutdown_connections 2024-01-31T05:13:05.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.208+0000 7f33b91dc740 1 -- 172.21.15.99:0/4185222978 wait complete. 2024-01-31T05:13:05.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.209+0000 7f33b91dc740 20 client.25418 trim_cache size 0 max 16384 2024-01-31T05:13:05.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.223+0000 7f33b91dc740 1 Processor -- start 2024-01-31T05:13:05.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.223+0000 7f33b91dc740 1 -- start start 2024-01-31T05:13:05.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.224+0000 7f33b91dc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558d5120a050 0x558d512140e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:05.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.224+0000 7f33b91dc740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d5120aa40 0x558d51214620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:05.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.224+0000 7f33b91dc740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558d5120fbb0 0x558d5121b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:05.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.224+0000 7f33b91dc740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d510efe30 con 0x558d5120aa40 2024-01-31T05:13:05.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.224+0000 7f33b91dc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d5116af20 con 0x558d5120a050 2024-01-31T05:13:05.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.224+0000 7f33b91dc740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d5121e890 con 0x558d5120fbb0 2024-01-31T05:13:05.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.224+0000 7f33af7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d5120aa40 0x558d51214620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:05.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.224+0000 7f33af7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d5120aa40 0x558d51214620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47322/0 (socket says 172.21.15.99:47322) 2024-01-31T05:13:05.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.224+0000 7f33af7fe640 1 -- 172.21.15.99:0/3613103871 learned_addr learned my addr 172.21.15.99:0/3613103871 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:05.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.224+0000 7f33affff640 1 --2- 172.21.15.99:0/3613103871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558d5120a050 0x558d512140e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:05.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.224+0000 7f33af7fe640 1 -- 172.21.15.99:0/3613103871 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558d5120fbb0 msgr2=0x558d5121b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:05.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.224+0000 7f33af7fe640 1 --2- 172.21.15.99:0/3613103871 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558d5120fbb0 0x558d5121b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:05.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.224+0000 7f33af7fe640 1 -- 172.21.15.99:0/3613103871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558d5120a050 msgr2=0x558d512140e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:05.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.224+0000 7f33af7fe640 1 --2- 172.21.15.99:0/3613103871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558d5120a050 0x558d512140e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:05.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.224+0000 7f33af7fe640 1 -- 172.21.15.99:0/3613103871 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d5110cd50 con 0x558d5120aa40 2024-01-31T05:13:05.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.224+0000 7f33af7fe640 1 --2- 172.21.15.99:0/3613103871 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d5120aa40 0x558d51214620 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f33a4006070 tx=0x7f33a4006ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d25f7e05ad3f522 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:05.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.224+0000 7f3395ffb640 1 -- 172.21.15.99:0/3613103871 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a4006710 con 0x558d5120aa40 2024-01-31T05:13:05.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.224+0000 7f3395ffb640 1 -- 172.21.15.99:0/3613103871 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f33a4006870 con 0x558d5120aa40 2024-01-31T05:13:05.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.224+0000 7f3395ffb640 1 -- 172.21.15.99:0/3613103871 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a401c8c0 con 0x558d5120aa40 2024-01-31T05:13:05.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.225+0000 7f33b91dc740 1 -- 172.21.15.99:0/3613103871 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d5120aa40 msgr2=0x558d51214620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:05.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.225+0000 7f33b91dc740 1 --2- 172.21.15.99:0/3613103871 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d5120aa40 0x558d51214620 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f33a4006070 tx=0x7f33a4006ea0 comp rx=0 tx=0).stop 2024-01-31T05:13:05.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.225+0000 7f33b91dc740 1 -- 172.21.15.99:0/3613103871 shutdown_connections 2024-01-31T05:13:05.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.225+0000 7f33b91dc740 1 --2- 172.21.15.99:0/3613103871 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558d5120fbb0 0x558d5121b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:05.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.225+0000 7f33b91dc740 1 --2- 172.21.15.99:0/3613103871 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d5120aa40 0x558d51214620 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:05.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.225+0000 7f33b91dc740 1 --2- 172.21.15.99:0/3613103871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558d5120a050 0x558d512140e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:05.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.225+0000 7f33b91dc740 1 -- 172.21.15.99:0/3613103871 >> 172.21.15.99:0/3613103871 conn(0x558d512055c0 msgr2=0x558d512059a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:05.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.225+0000 7f33b91dc740 1 -- 172.21.15.99:0/3613103871 shutdown_connections 2024-01-31T05:13:05.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.225+0000 7f33b91dc740 1 -- 172.21.15.99:0/3613103871 wait complete. 2024-01-31T05:13:05.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.225+0000 7f33b91dc740 1 -- start start 2024-01-31T05:13:05.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.225+0000 7f33b91dc740 1 Processor -- start 2024-01-31T05:13:05.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.226+0000 7f33b91dc740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d5120a050 0x558d5121b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:05.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.226+0000 7f33b91dc740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558d5120aa40 0x558d51219b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:05.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.226+0000 7f33b91dc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558d5120fbb0 0x558d5121a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:05.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.226+0000 7f33b91dc740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d5121a720 con 0x558d5120a050 2024-01-31T05:13:05.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.226+0000 7f33b91dc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d5121a890 con 0x558d5120fbb0 2024-01-31T05:13:05.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.226+0000 7f33b91dc740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d5121aa50 con 0x558d5120aa40 2024-01-31T05:13:05.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.226+0000 7f33b91dc740 10 client.0 _ll_register_callbacks cb 0x7f33a40094a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:13:05.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.226+0000 7f33affff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d5120a050 0x558d5121b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:05.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.226+0000 7f33affff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d5120a050 0x558d5121b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47326/0 (socket says 172.21.15.99:47326) 2024-01-31T05:13:05.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.226+0000 7f33affff640 1 -- 172.21.15.99:0/508947057 learned_addr learned my addr 172.21.15.99:0/508947057 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:05.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.226+0000 7f33b49b6640 1 --2- 172.21.15.99:0/508947057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558d5120fbb0 0x558d5121a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:05.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.226+0000 7f33af7fe640 1 --2- 172.21.15.99:0/508947057 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558d5120aa40 0x558d51219b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:05.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.226+0000 7f33affff640 1 -- 172.21.15.99:0/508947057 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558d5120aa40 msgr2=0x558d51219b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:05.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.226+0000 7f33affff640 1 --2- 172.21.15.99:0/508947057 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558d5120aa40 0x558d51219b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:05.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.226+0000 7f33affff640 1 -- 172.21.15.99:0/508947057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558d5120fbb0 msgr2=0x558d5121a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:05.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.226+0000 7f33affff640 1 --2- 172.21.15.99:0/508947057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558d5120fbb0 0x558d5121a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:05.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.226+0000 7f33affff640 1 -- 172.21.15.99:0/508947057 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558d511705b0 con 0x558d5120a050 2024-01-31T05:13:05.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.226+0000 7f33af7fe640 1 --2- 172.21.15.99:0/508947057 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558d5120aa40 0x558d51219b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:13:05.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.226+0000 7f33b49b6640 1 --2- 172.21.15.99:0/508947057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558d5120fbb0 0x558d5121a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:13:05.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.226+0000 7f33affff640 1 --2- 172.21.15.99:0/508947057 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d5120a050 0x558d5121b570 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f33a0006010 tx=0x7f33a0003f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7837bcd9c5c1e893 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:05.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.226+0000 7f338f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:13:05.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.226+0000 7f338f7fe640 1 -- 172.21.15.99:0/508947057 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a00c0780 con 0x558d5120a050 2024-01-31T05:13:05.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.226+0000 7f338f7fe640 1 -- 172.21.15.99:0/508947057 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f33a00c49c0 con 0x558d5120a050 2024-01-31T05:13:05.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.226+0000 7f33b91dc740 1 -- 172.21.15.99:0/508947057 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f33a4013470 con 0x558d5120a050 2024-01-31T05:13:05.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.226+0000 7f338f7fe640 1 -- 172.21.15.99:0/508947057 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f33a00ef0b0 con 0x558d5120a050 2024-01-31T05:13:05.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.226+0000 7f33b91dc740 10 client.16029 fetch_fsmap learned FSMap version 28 2024-01-31T05:13:05.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.226+0000 7f33b91dc740 1 -- 172.21.15.99:0/508947057 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x558d51132960 con 0x558d5120a050 2024-01-31T05:13:05.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.227+0000 7f338f7fe640 1 -- 172.21.15.99:0/508947057 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f33a0086020 con 0x558d5120a050 2024-01-31T05:13:05.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.227+0000 7f338f7fe640 1 -- 172.21.15.99:0/508947057 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 28) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f33a003c070 con 0x558d5120a050 2024-01-31T05:13:05.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.227+0000 7f33b91dc740 10 client.16029 fetch_fsmap finished waiting for FSMap version 28 2024-01-31T05:13:05.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.227+0000 7f33b91dc740 10 client.16029 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-01-31T05:13:05.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.227+0000 7f33b91dc740 20 client.16029 populate_metadata read hostname 'smithi099' 2024-01-31T05:13:05.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.227+0000 7f33b91dc740 1 --2- 172.21.15.99:0/508947057 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x558d51277fe0 0x558d5127a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:05.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.227+0000 7f33b91dc740 4 client.16029 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-01-31T05:13:05.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.227+0000 7f33b91dc740 1 -- 172.21.15.99:0/508947057 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x558d50e71860 con 0x558d51277fe0 2024-01-31T05:13:05.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.227+0000 7f33af7fe640 1 --2- 172.21.15.99:0/508947057 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x558d51277fe0 0x558d5127a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:05.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.227+0000 7f338f7fe640 10 client.16029 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:13:05.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.227+0000 7f33af7fe640 1 --2- 172.21.15.99:0/508947057 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x558d51277fe0 0x558d5127a400 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62764aaa7e688207 server_cookie=f8aa614a910d103d in_seq=0 out_seq=0 2024-01-31T05:13:05.243 INFO:tasks.workunit.client.0.smithi099.stdout:8/17: link l0 d1/l6 0 2024-01-31T05:13:05.523 INFO:tasks.workunit.client.0.smithi099.stdout:1/16: creat f3 x:0 0 0 2024-01-31T05:13:05.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.956+0000 7f338f7fe640 1 -- 172.21.15.99:0/508947057 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x558d50e71860 con 0x558d51277fe0 2024-01-31T05:13:05.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.956+0000 7f338f7fe640 10 client.16029 handle_command_reply: tid=0 2024-01-31T05:13:05.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.956+0000 7f33b91dc740 1 client.16029 shutdown 2024-01-31T05:13:05.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.956+0000 7f33b91dc740 1 -- 172.21.15.99:0/508947057 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d5120a050 msgr2=0x558d5121b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:05.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.956+0000 7f33b91dc740 1 --2- 172.21.15.99:0/508947057 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d5120a050 0x558d5121b570 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f33a0006010 tx=0x7f33a0003f50 comp rx=0 tx=0).stop 2024-01-31T05:13:05.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.956+0000 7f33b91dc740 1 -- 172.21.15.99:0/508947057 shutdown_connections 2024-01-31T05:13:05.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.956+0000 7f33b91dc740 1 --2- 172.21.15.99:0/508947057 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x558d51277fe0 0x558d5127a400 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:05.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.956+0000 7f33b91dc740 1 --2- 172.21.15.99:0/508947057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558d5120fbb0 0x558d5121a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:05.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.956+0000 7f33b91dc740 1 --2- 172.21.15.99:0/508947057 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558d5120aa40 0x558d51219b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:05.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.956+0000 7f33b91dc740 1 --2- 172.21.15.99:0/508947057 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d5120a050 0x558d5121b570 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:05.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.956+0000 7f338f7fe640 0 client.16029 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:13:05.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.956+0000 7f33b91dc740 1 -- 172.21.15.99:0/508947057 >> 172.21.15.99:0/508947057 conn(0x558d512055c0 msgr2=0x558d5120bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:05.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.957+0000 7f33b91dc740 1 -- 172.21.15.99:0/508947057 shutdown_connections 2024-01-31T05:13:05.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.957+0000 7f33b91dc740 1 -- 172.21.15.99:0/508947057 wait complete. 2024-01-31T05:13:05.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.957+0000 7f33b91dc740 20 client.16029 trim_cache size 0 max 16384 2024-01-31T05:13:05.958 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-01-31T05:13:05.958 INFO:teuthology.orchestra.run.smithi099.stdout: "return_code": 0, 2024-01-31T05:13:05.958 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_tag": "456e7ed5-b385-4c77-b5b8-e6b3680fe945", 2024-01-31T05:13:05.958 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": "asynchronous" 2024-01-31T05:13:05.958 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-01-31T05:13:05.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.957+0000 7f33b6419640 1 -- 172.21.15.99:0/806602066 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f33980a12e0 msgr2=0x7f33980a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:05.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.957+0000 7f33b6419640 1 --2- 172.21.15.99:0/806602066 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f33980a12e0 0x7f33980a37a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f33a8009270 tx=0x7f33a8012a30 comp rx=0 tx=0).stop 2024-01-31T05:13:05.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.957+0000 7f33b6419640 1 -- 172.21.15.99:0/806602066 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f33b0100150 msgr2=0x7f33b0196da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:05.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.957+0000 7f33b6419640 1 --2- 172.21.15.99:0/806602066 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f33b0100150 0x7f33b0196da0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f33a0000c00 tx=0x7f33a00042f0 comp rx=0 tx=0).stop 2024-01-31T05:13:05.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.957+0000 7f33b6419640 1 -- 172.21.15.99:0/806602066 shutdown_connections 2024-01-31T05:13:05.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.957+0000 7f33b6419640 1 --2- 172.21.15.99:0/806602066 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f33980a12e0 0x7f33980a37a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:05.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.957+0000 7f33b6419640 1 --2- 172.21.15.99:0/806602066 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f33b0101820 0x7f33b019e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:05.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.957+0000 7f33b6419640 1 --2- 172.21.15.99:0/806602066 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33b0100e60 0x7f33b01972e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:05.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.957+0000 7f33b6419640 1 --2- 172.21.15.99:0/806602066 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f33b0100150 0x7f33b0196da0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:05.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.957+0000 7f33b6419640 1 -- 172.21.15.99:0/806602066 >> 172.21.15.99:0/806602066 conn(0x7f33b00fa920 msgr2=0x7f33b01041e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:05.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.957+0000 7f33b6419640 1 -- 172.21.15.99:0/806602066 shutdown_connections 2024-01-31T05:13:05.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:05.957+0000 7f33b6419640 1 -- 172.21.15.99:0/806602066 wait complete. 2024-01-31T05:13:05.966 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:05 smithi099 ceph-mon[31615]: pgmap v400: 97 pgs: 97 active+clean; 46 MiB data, 595 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.5 MiB/s wr, 1.90k op/s 2024-01-31T05:13:05.967 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-01-31T05:13:06.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:05 smithi181 ceph-mon[36434]: pgmap v400: 97 pgs: 97 active+clean; 46 MiB data, 595 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.5 MiB/s wr, 1.90k op/s 2024-01-31T05:13:06.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.075+0000 7fc477598640 1 -- 172.21.15.99:0/662179974 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4700ffc00 msgr2=0x7fc470100020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:06.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.075+0000 7fc477598640 1 --2- 172.21.15.99:0/662179974 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4700ffc00 0x7fc470100020 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fc46c009900 tx=0x7fc46c02bc30 comp rx=0 tx=0).stop 2024-01-31T05:13:06.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.075+0000 7fc477598640 1 -- 172.21.15.99:0/662179974 shutdown_connections 2024-01-31T05:13:06.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.075+0000 7fc477598640 1 --2- 172.21.15.99:0/662179974 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc4701017b0 0x7fc470108040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:06.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.075+0000 7fc477598640 1 --2- 172.21.15.99:0/662179974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc470100df0 0x7fc470101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:06.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.075+0000 7fc477598640 1 --2- 172.21.15.99:0/662179974 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4700ffc00 0x7fc470100020 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:06.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.075+0000 7fc477598640 1 -- 172.21.15.99:0/662179974 >> 172.21.15.99:0/662179974 conn(0x7fc4700fb190 msgr2=0x7fc4700fd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:06.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.075+0000 7fc477598640 1 -- 172.21.15.99:0/662179974 shutdown_connections 2024-01-31T05:13:06.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.075+0000 7fc477598640 1 -- 172.21.15.99:0/662179974 wait complete. 2024-01-31T05:13:06.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.076+0000 7fc477598640 1 Processor -- start 2024-01-31T05:13:06.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.076+0000 7fc477598640 1 -- start start 2024-01-31T05:13:06.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.076+0000 7fc477598640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc4700ffc00 0x7fc470196d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:06.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.076+0000 7fc477598640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc470100df0 0x7fc470197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:06.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.076+0000 7fc477598640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4701017b0 0x7fc47019e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:06.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.076+0000 7fc477598640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47019e7e0 con 0x7fc4701017b0 2024-01-31T05:13:06.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.076+0000 7fc477598640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47019e950 con 0x7fc470100df0 2024-01-31T05:13:06.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.076+0000 7fc477598640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47019eb10 con 0x7fc4700ffc00 2024-01-31T05:13:06.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.076+0000 7fc475b35640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4701017b0 0x7fc47019e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:06.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.076+0000 7fc475b35640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4701017b0 0x7fc47019e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35904/0 (socket says 172.21.15.99:35904) 2024-01-31T05:13:06.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.076+0000 7fc475b35640 1 -- 172.21.15.99:0/1196583121 learned_addr learned my addr 172.21.15.99:0/1196583121 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:06.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.076+0000 7fc474b33640 1 --2- 172.21.15.99:0/1196583121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc470100df0 0x7fc470197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:06.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.076+0000 7fc475334640 1 --2- 172.21.15.99:0/1196583121 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc4700ffc00 0x7fc470196d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:06.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.076+0000 7fc475b35640 1 -- 172.21.15.99:0/1196583121 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc4700ffc00 msgr2=0x7fc470196d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:06.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.076+0000 7fc475b35640 1 --2- 172.21.15.99:0/1196583121 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc4700ffc00 0x7fc470196d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:06.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.076+0000 7fc475b35640 1 -- 172.21.15.99:0/1196583121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc470100df0 msgr2=0x7fc470197240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:06.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.076+0000 7fc475b35640 1 --2- 172.21.15.99:0/1196583121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc470100df0 0x7fc470197240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:06.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.076+0000 7fc475b35640 1 -- 172.21.15.99:0/1196583121 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc46c009560 con 0x7fc4701017b0 2024-01-31T05:13:06.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.076+0000 7fc475b35640 1 --2- 172.21.15.99:0/1196583121 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4701017b0 0x7fc47019e270 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fc46800eaa0 tx=0x7fc46800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:06.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.077+0000 7fc4667fc640 1 -- 172.21.15.99:0/1196583121 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46800cdb0 con 0x7fc4701017b0 2024-01-31T05:13:06.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.077+0000 7fc4667fc640 1 -- 172.21.15.99:0/1196583121 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc468005020 con 0x7fc4701017b0 2024-01-31T05:13:06.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.077+0000 7fc477598640 1 -- 172.21.15.99:0/1196583121 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc47019edf0 con 0x7fc4701017b0 2024-01-31T05:13:06.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.077+0000 7fc4667fc640 1 -- 172.21.15.99:0/1196583121 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4680116d0 con 0x7fc4701017b0 2024-01-31T05:13:06.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.077+0000 7fc477598640 1 -- 172.21.15.99:0/1196583121 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc47019f270 con 0x7fc4701017b0 2024-01-31T05:13:06.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.079+0000 7fc4667fc640 1 -- 172.21.15.99:0/1196583121 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 20) v1 ==== 135895+0+0 (secure 0 0 0) 0x7fc468005190 con 0x7fc4701017b0 2024-01-31T05:13:06.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.079+0000 7fc47a434740 1 Processor -- start 2024-01-31T05:13:06.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.079+0000 7fc47a434740 1 -- start start 2024-01-31T05:13:06.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.080+0000 7fc47a434740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559722aa5e30 0x559722aa6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:06.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.080+0000 7fc47a434740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559722aa6820 0x559722aab320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:06.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.080+0000 7fc47a434740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559722aab990 0x559722aade20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:06.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.080+0000 7fc47a434740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x559722a10380 con 0x559722aab990 2024-01-31T05:13:06.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.080+0000 7fc47a434740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x559722a0da70 con 0x559722aa5e30 2024-01-31T05:13:06.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.080+0000 7fc47a434740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x559722a09360 con 0x559722aa6820 2024-01-31T05:13:06.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.080+0000 7fc4667fc640 1 --2- 172.21.15.99:0/1196583121 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc45c0a1360 0x7fc45c0a3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:06.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.080+0000 7fc474b33640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559722aab990 0x559722aade20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:06.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.080+0000 7fc474b33640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559722aab990 0x559722aade20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35908/0 (socket says 172.21.15.99:35908) 2024-01-31T05:13:06.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.080+0000 7fc474b33640 1 -- 172.21.15.99:0/3618725391 learned_addr learned my addr 172.21.15.99:0/3618725391 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:06.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.080+0000 7fc474b33640 1 --2- 172.21.15.99:0/3618725391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559722aa5e30 0x559722aa6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:06.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.080+0000 7fc475b35640 1 --2- 172.21.15.99:0/1196583121 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc45c0a1360 0x7fc45c0a3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:06.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.080+0000 7fc475334640 1 --2- 172.21.15.99:0/3618725391 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559722aa6820 0x559722aab320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:06.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.080+0000 7fc4667fc640 1 -- 172.21.15.99:0/1196583121 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fc4680ccc10 con 0x7fc4701017b0 2024-01-31T05:13:06.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.080+0000 7fc474b33640 1 -- 172.21.15.99:0/3618725391 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559722aa6820 msgr2=0x559722aab320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:06.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.080+0000 7fc474b33640 1 --2- 172.21.15.99:0/3618725391 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559722aa6820 0x559722aab320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:06.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.080+0000 7fc474b33640 1 -- 172.21.15.99:0/3618725391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559722aa5e30 msgr2=0x559722aa6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:06.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.080+0000 7fc474b33640 1 --2- 172.21.15.99:0/3618725391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559722aa5e30 0x559722aa6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:06.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.080+0000 7fc474b33640 1 -- 172.21.15.99:0/3618725391 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5597229cb7e0 con 0x559722aab990 2024-01-31T05:13:06.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.080+0000 7fc475334640 1 --2- 172.21.15.99:0/3618725391 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559722aa6820 0x559722aab320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:13:06.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.080+0000 7fc474b33640 1 --2- 172.21.15.99:0/3618725391 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559722aab990 0x559722aade20 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fc460011820 tx=0x7fc4600097f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f4b1c0ffb12ae60 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:06.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.080+0000 7fc475b35640 1 --2- 172.21.15.99:0/1196583121 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc45c0a1360 0x7fc45c0a3820 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc46800efd0 tx=0x7fc46806cf90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:06.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.080+0000 7fc45b7fe640 1 -- 172.21.15.99:0/3618725391 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc460004030 con 0x559722aab990 2024-01-31T05:13:06.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.081+0000 7fc45b7fe640 1 -- 172.21.15.99:0/3618725391 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc46000f7c0 con 0x559722aab990 2024-01-31T05:13:06.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.081+0000 7fc45b7fe640 1 -- 172.21.15.99:0/3618725391 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc460003850 con 0x559722aab990 2024-01-31T05:13:06.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.081+0000 7fc47a434740 1 -- 172.21.15.99:0/3618725391 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559722aab990 msgr2=0x559722aade20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:06.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.081+0000 7fc47a434740 1 --2- 172.21.15.99:0/3618725391 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559722aab990 0x559722aade20 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fc460011820 tx=0x7fc4600097f0 comp rx=0 tx=0).stop 2024-01-31T05:13:06.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.081+0000 7fc47a434740 1 -- 172.21.15.99:0/3618725391 shutdown_connections 2024-01-31T05:13:06.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.081+0000 7fc47a434740 1 --2- 172.21.15.99:0/3618725391 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559722aab990 0x559722aade20 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:06.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.081+0000 7fc47a434740 1 --2- 172.21.15.99:0/3618725391 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559722aa6820 0x559722aab320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:06.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.081+0000 7fc47a434740 1 --2- 172.21.15.99:0/3618725391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559722aa5e30 0x559722aa6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:06.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.081+0000 7fc47a434740 1 -- 172.21.15.99:0/3618725391 >> 172.21.15.99:0/3618725391 conn(0x559722a9cf90 msgr2=0x559722a9d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:06.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.081+0000 7fc47a434740 1 -- 172.21.15.99:0/3618725391 shutdown_connections 2024-01-31T05:13:06.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.081+0000 7fc47a434740 1 -- 172.21.15.99:0/3618725391 wait complete. 2024-01-31T05:13:06.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.081+0000 7fc47a434740 1 -- start start 2024-01-31T05:13:06.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.082+0000 7fc47a434740 1 Processor -- start 2024-01-31T05:13:06.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.082+0000 7fc47a434740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559722aa5e30 0x559722aaffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:06.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.082+0000 7fc47a434740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559722aa6820 0x559722ab0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:06.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.082+0000 7fc47a434740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559722aab990 0x559722ab7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:06.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.082+0000 7fc47a434740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597229c2750 con 0x559722aa5e30 2024-01-31T05:13:06.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.082+0000 7fc47a434740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597229c23f0 con 0x559722aa6820 2024-01-31T05:13:06.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.082+0000 7fc47a434740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597229873f0 con 0x559722aab990 2024-01-31T05:13:06.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.082+0000 7fc47a434740 10 client.0 _ll_register_callbacks cb 0x5597229c4b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:13:06.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.082+0000 7fc474b33640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559722aa5e30 0x559722aaffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:06.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.082+0000 7fc474b33640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559722aa5e30 0x559722aaffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35912/0 (socket says 172.21.15.99:35912) 2024-01-31T05:13:06.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.082+0000 7fc474b33640 1 -- 172.21.15.99:0/1958972045 learned_addr learned my addr 172.21.15.99:0/1958972045 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:06.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.082+0000 7fc475334640 1 --2- 172.21.15.99:0/1958972045 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559722aa6820 0x559722ab0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:06.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.082+0000 7fc474b33640 1 --2- 172.21.15.99:0/1958972045 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559722aab990 0x559722ab7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:06.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.082+0000 7fc474b33640 1 -- 172.21.15.99:0/1958972045 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559722aab990 msgr2=0x559722ab7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:06.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.082+0000 7fc474b33640 1 --2- 172.21.15.99:0/1958972045 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559722aab990 0x559722ab7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:06.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.082+0000 7fc474b33640 1 -- 172.21.15.99:0/1958972045 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559722aa6820 msgr2=0x559722ab0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:06.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.082+0000 7fc474b33640 1 --2- 172.21.15.99:0/1958972045 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559722aa6820 0x559722ab0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:06.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.082+0000 7fc474b33640 1 -- 172.21.15.99:0/1958972045 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc460019040 con 0x559722aa5e30 2024-01-31T05:13:06.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.083+0000 7fc474b33640 1 --2- 172.21.15.99:0/1958972045 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559722aa5e30 0x559722aaffe0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fc460005970 tx=0x7fc460005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b83628acf680b77 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:06.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.083+0000 7fc458ff9640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:13:06.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.083+0000 7fc458ff9640 1 -- 172.21.15.99:0/1958972045 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc460005260 con 0x559722aa5e30 2024-01-31T05:13:06.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.083+0000 7fc458ff9640 1 -- 172.21.15.99:0/1958972045 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fc460000e40 con 0x559722aa5e30 2024-01-31T05:13:06.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.083+0000 7fc47a434740 1 -- 172.21.15.99:0/1958972045 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5597229de210 con 0x559722aa5e30 2024-01-31T05:13:06.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.083+0000 7fc458ff9640 1 -- 172.21.15.99:0/1958972045 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc4600053c0 con 0x559722aa5e30 2024-01-31T05:13:06.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.083+0000 7fc47a434740 10 client.16041 fetch_fsmap learned FSMap version 28 2024-01-31T05:13:06.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.083+0000 7fc47a434740 1 -- 172.21.15.99:0/1958972045 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x559722a079e0 con 0x559722aa5e30 2024-01-31T05:13:06.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.083+0000 7fc458ff9640 1 -- 172.21.15.99:0/1958972045 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5597229de210 con 0x559722aa5e30 2024-01-31T05:13:06.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.083+0000 7fc458ff9640 1 -- 172.21.15.99:0/1958972045 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 28) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fc46001f5b0 con 0x559722aa5e30 2024-01-31T05:13:06.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.083+0000 7fc47a434740 10 client.16041 fetch_fsmap finished waiting for FSMap version 28 2024-01-31T05:13:06.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.083+0000 7fc47a434740 10 client.16041 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-01-31T05:13:06.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.083+0000 7fc47a434740 20 client.16041 populate_metadata read hostname 'smithi099' 2024-01-31T05:13:06.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.083+0000 7fc47a434740 1 --2- 172.21.15.99:0/1958972045 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x559722abc180 0x559722abe5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:06.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.083+0000 7fc47a434740 4 client.16041 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:13:06.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.083+0000 7fc47a434740 1 -- 172.21.15.99:0/1958972045 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5597229dbb20 con 0x559722abc180 2024-01-31T05:13:06.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.083+0000 7fc475334640 1 --2- 172.21.15.99:0/1958972045 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x559722abc180 0x559722abe5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:06.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.084+0000 7fc475334640 1 --2- 172.21.15.99:0/1958972045 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x559722abc180 0x559722abe5a0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e8c2147e98bd493 server_cookie=cde2d92898b5e2e2 in_seq=0 out_seq=0 2024-01-31T05:13:06.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.084+0000 7fc458ff9640 10 client.16041 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:13:06.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.087+0000 7fc458ff9640 1 -- 172.21.15.99:0/1958972045 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5597229dbb20 con 0x559722abc180 2024-01-31T05:13:06.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.087+0000 7fc458ff9640 10 client.16041 handle_command_reply: tid=0 2024-01-31T05:13:06.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.087+0000 7fc47a434740 1 client.16041 shutdown 2024-01-31T05:13:06.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.087+0000 7fc47a434740 1 -- 172.21.15.99:0/1958972045 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559722aa5e30 msgr2=0x559722aaffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:06.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.087+0000 7fc47a434740 1 --2- 172.21.15.99:0/1958972045 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559722aa5e30 0x559722aaffe0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fc460005970 tx=0x7fc460005fb0 comp rx=0 tx=0).stop 2024-01-31T05:13:06.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.087+0000 7fc47a434740 1 -- 172.21.15.99:0/1958972045 shutdown_connections 2024-01-31T05:13:06.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.087+0000 7fc47a434740 1 --2- 172.21.15.99:0/1958972045 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559722aab990 0x559722ab7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:06.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.087+0000 7fc47a434740 1 --2- 172.21.15.99:0/1958972045 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x559722abc180 0x559722abe5a0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:06.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.087+0000 7fc47a434740 1 --2- 172.21.15.99:0/1958972045 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559722aa6820 0x559722ab0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:06.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.087+0000 7fc47a434740 1 --2- 172.21.15.99:0/1958972045 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559722aa5e30 0x559722aaffe0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:06.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.087+0000 7fc458ff9640 0 client.16041 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:13:06.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.087+0000 7fc47a434740 1 -- 172.21.15.99:0/1958972045 >> 172.21.15.99:0/1958972045 conn(0x559722a9cf90 msgr2=0x559722a9c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:06.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.087+0000 7fc47a434740 1 -- 172.21.15.99:0/1958972045 shutdown_connections 2024-01-31T05:13:06.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.087+0000 7fc47a434740 1 -- 172.21.15.99:0/1958972045 wait complete. 2024-01-31T05:13:06.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.087+0000 7fc47a434740 20 client.16041 trim_cache size 0 max 16384 2024-01-31T05:13:06.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.102+0000 7fc47a434740 1 Processor -- start 2024-01-31T05:13:06.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.102+0000 7fc47a434740 1 -- start start 2024-01-31T05:13:06.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.102+0000 7fc47a434740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559722aa5e30 0x559722aa7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:06.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.102+0000 7fc47a434740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559722aa6820 0x559722aa8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:06.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.102+0000 7fc47a434740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559722aab990 0x559722ab74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:06.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.102+0000 7fc47a434740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597229de210 con 0x559722aa6820 2024-01-31T05:13:06.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.102+0000 7fc47a434740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x559722aa5ad0 con 0x559722aa5e30 2024-01-31T05:13:06.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.102+0000 7fc47a434740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x559722a9ce50 con 0x559722aab990 2024-01-31T05:13:06.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.102+0000 7fc475334640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559722aa6820 0x559722aa8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:06.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.102+0000 7fc475334640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559722aa6820 0x559722aa8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35922/0 (socket says 172.21.15.99:35922) 2024-01-31T05:13:06.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.102+0000 7fc475334640 1 -- 172.21.15.99:0/1406201553 learned_addr learned my addr 172.21.15.99:0/1406201553 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:06.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.102+0000 7fc474b33640 1 --2- 172.21.15.99:0/1406201553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559722aa5e30 0x559722aa7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:06.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.102+0000 7fc474b33640 1 --2- 172.21.15.99:0/1406201553 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559722aab990 0x559722ab74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:06.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.102+0000 7fc475334640 1 -- 172.21.15.99:0/1406201553 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559722aab990 msgr2=0x559722ab74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:06.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.102+0000 7fc475334640 1 --2- 172.21.15.99:0/1406201553 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559722aab990 0x559722ab74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:06.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.102+0000 7fc475334640 1 -- 172.21.15.99:0/1406201553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559722aa5e30 msgr2=0x559722aa7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:06.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.102+0000 7fc475334640 1 --2- 172.21.15.99:0/1406201553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559722aa5e30 0x559722aa7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:06.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.102+0000 7fc475334640 1 -- 172.21.15.99:0/1406201553 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5597229a44f0 con 0x559722aa6820 2024-01-31T05:13:06.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.102+0000 7fc474b33640 1 --2- 172.21.15.99:0/1406201553 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559722aab990 0x559722ab74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:13:06.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.103+0000 7fc475334640 1 --2- 172.21.15.99:0/1406201553 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559722aa6820 0x559722aa8220 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fc46c005ab0 tx=0x7fc46c02c5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1acf977afa8617b5 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:06.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.103+0000 7fc45affd640 1 -- 172.21.15.99:0/1406201553 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46c044040 con 0x559722aa6820 2024-01-31T05:13:06.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.103+0000 7fc45affd640 1 -- 172.21.15.99:0/1406201553 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc46c046040 con 0x559722aa6820 2024-01-31T05:13:06.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.103+0000 7fc45affd640 1 -- 172.21.15.99:0/1406201553 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46c04b720 con 0x559722aa6820 2024-01-31T05:13:06.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.103+0000 7fc47a434740 1 -- 172.21.15.99:0/1406201553 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559722aa6820 msgr2=0x559722aa8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:06.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.103+0000 7fc47a434740 1 --2- 172.21.15.99:0/1406201553 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559722aa6820 0x559722aa8220 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fc46c005ab0 tx=0x7fc46c02c5d0 comp rx=0 tx=0).stop 2024-01-31T05:13:06.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.103+0000 7fc47a434740 1 -- 172.21.15.99:0/1406201553 shutdown_connections 2024-01-31T05:13:06.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.103+0000 7fc47a434740 1 --2- 172.21.15.99:0/1406201553 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559722aab990 0x559722ab74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:06.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.103+0000 7fc47a434740 1 --2- 172.21.15.99:0/1406201553 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559722aa6820 0x559722aa8220 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:06.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.103+0000 7fc47a434740 1 --2- 172.21.15.99:0/1406201553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559722aa5e30 0x559722aa7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:06.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.103+0000 7fc47a434740 1 -- 172.21.15.99:0/1406201553 >> 172.21.15.99:0/1406201553 conn(0x559722a9cf90 msgr2=0x559722ac2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:06.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.103+0000 7fc47a434740 1 -- 172.21.15.99:0/1406201553 shutdown_connections 2024-01-31T05:13:06.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.103+0000 7fc47a434740 1 -- 172.21.15.99:0/1406201553 wait complete. 2024-01-31T05:13:06.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.104+0000 7fc47a434740 1 -- start start 2024-01-31T05:13:06.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.104+0000 7fc47a434740 1 Processor -- start 2024-01-31T05:13:06.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.104+0000 7fc47a434740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559722aa5e30 0x559722ab6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:06.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.104+0000 7fc47a434740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559722aa6820 0x559722ab7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:06.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.104+0000 7fc47a434740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559722aab990 0x559722ab55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:06.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.104+0000 7fc47a434740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x559722ab5cb0 con 0x559722aa5e30 2024-01-31T05:13:06.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.104+0000 7fc47a434740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x559722ab5e20 con 0x559722aa6820 2024-01-31T05:13:06.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.104+0000 7fc47a434740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x559722ab5fe0 con 0x559722aab990 2024-01-31T05:13:06.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.104+0000 7fc47a434740 10 client.0 _ll_register_callbacks cb 0x7fc460009ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:13:06.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.104+0000 7fc474b33640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559722aa5e30 0x559722ab6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:06.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.104+0000 7fc474b33640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559722aa5e30 0x559722ab6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35930/0 (socket says 172.21.15.99:35930) 2024-01-31T05:13:06.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.104+0000 7fc474b33640 1 -- 172.21.15.99:0/2034196555 learned_addr learned my addr 172.21.15.99:0/2034196555 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:06.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.104+0000 7fc475334640 1 --2- 172.21.15.99:0/2034196555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559722aa6820 0x559722ab7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:06.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.104+0000 7fc474b33640 1 --2- 172.21.15.99:0/2034196555 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559722aab990 0x559722ab55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:06.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.104+0000 7fc474b33640 1 -- 172.21.15.99:0/2034196555 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559722aab990 msgr2=0x559722ab55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:06.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.104+0000 7fc474b33640 1 --2- 172.21.15.99:0/2034196555 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559722aab990 0x559722ab55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:06.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.104+0000 7fc474b33640 1 -- 172.21.15.99:0/2034196555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559722aa6820 msgr2=0x559722ab7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:06.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.104+0000 7fc474b33640 1 --2- 172.21.15.99:0/2034196555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559722aa6820 0x559722ab7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:06.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.104+0000 7fc474b33640 1 -- 172.21.15.99:0/2034196555 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4700692c0 con 0x559722aa5e30 2024-01-31T05:13:06.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.104+0000 7fc475334640 1 --2- 172.21.15.99:0/2034196555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559722aa6820 0x559722ab7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:13:06.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.105+0000 7fc474b33640 1 --2- 172.21.15.99:0/2034196555 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559722aa5e30 0x559722ab6fc0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fc4600059a0 tx=0x7fc46000fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c773d8afef620ff4 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:06.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.105+0000 7fc458ff9640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:13:06.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.105+0000 7fc458ff9640 1 -- 172.21.15.99:0/2034196555 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46000fbd0 con 0x559722aa5e30 2024-01-31T05:13:06.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.105+0000 7fc47a434740 1 -- 172.21.15.99:0/2034196555 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559722a30bd0 con 0x559722aa5e30 2024-01-31T05:13:06.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.105+0000 7fc458ff9640 1 -- 172.21.15.99:0/2034196555 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fc46000fd30 con 0x559722aa5e30 2024-01-31T05:13:06.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.105+0000 7fc458ff9640 1 -- 172.21.15.99:0/2034196555 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc46001fca0 con 0x559722aa5e30 2024-01-31T05:13:06.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.105+0000 7fc47a434740 10 client.16047 fetch_fsmap learned FSMap version 28 2024-01-31T05:13:06.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.105+0000 7fc47a434740 1 -- 172.21.15.99:0/2034196555 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5597229ca040 con 0x559722aa5e30 2024-01-31T05:13:06.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.105+0000 7fc458ff9640 1 -- 172.21.15.99:0/2034196555 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc460049020 con 0x559722aa5e30 2024-01-31T05:13:06.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.105+0000 7fc458ff9640 1 -- 172.21.15.99:0/2034196555 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 28) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fc460005420 con 0x559722aa5e30 2024-01-31T05:13:06.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.105+0000 7fc47a434740 10 client.16047 fetch_fsmap finished waiting for FSMap version 28 2024-01-31T05:13:06.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.105+0000 7fc47a434740 10 client.16047 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-01-31T05:13:06.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.105+0000 7fc47a434740 20 client.16047 populate_metadata read hostname 'smithi099' 2024-01-31T05:13:06.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.105+0000 7fc47a434740 1 --2- 172.21.15.99:0/2034196555 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x559722b13750 0x559722b15b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:06.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.105+0000 7fc47a434740 4 client.16047 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-01-31T05:13:06.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.105+0000 7fc47a434740 1 -- 172.21.15.99:0/2034196555 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559722a021f0 con 0x559722b13750 2024-01-31T05:13:06.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.105+0000 7fc475334640 1 --2- 172.21.15.99:0/2034196555 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x559722b13750 0x559722b15b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:06.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.106+0000 7fc458ff9640 10 client.16047 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:13:06.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.106+0000 7fc475334640 1 --2- 172.21.15.99:0/2034196555 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x559722b13750 0x559722b15b70 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8df15c2909effbfe server_cookie=8bd7caf9d940f541 in_seq=0 out_seq=0 2024-01-31T05:13:06.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.109+0000 7fc458ff9640 1 -- 172.21.15.99:0/2034196555 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x559722a021f0 con 0x559722b13750 2024-01-31T05:13:06.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.109+0000 7fc458ff9640 10 client.16047 handle_command_reply: tid=0 2024-01-31T05:13:06.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.109+0000 7fc47a434740 1 client.16047 shutdown 2024-01-31T05:13:06.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.109+0000 7fc47a434740 1 -- 172.21.15.99:0/2034196555 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559722aa5e30 msgr2=0x559722ab6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:06.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.109+0000 7fc47a434740 1 --2- 172.21.15.99:0/2034196555 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559722aa5e30 0x559722ab6fc0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fc4600059a0 tx=0x7fc46000fb60 comp rx=0 tx=0).stop 2024-01-31T05:13:06.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.109+0000 7fc47a434740 1 -- 172.21.15.99:0/2034196555 shutdown_connections 2024-01-31T05:13:06.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.109+0000 7fc47a434740 1 --2- 172.21.15.99:0/2034196555 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559722aab990 0x559722ab55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:06.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.109+0000 7fc47a434740 1 --2- 172.21.15.99:0/2034196555 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x559722b13750 0x559722b15b70 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:06.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.109+0000 7fc47a434740 1 --2- 172.21.15.99:0/2034196555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559722aa6820 0x559722ab7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:06.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.109+0000 7fc47a434740 1 --2- 172.21.15.99:0/2034196555 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559722aa5e30 0x559722ab6fc0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:06.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.109+0000 7fc458ff9640 0 client.16047 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:13:06.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.109+0000 7fc47a434740 1 -- 172.21.15.99:0/2034196555 >> 172.21.15.99:0/2034196555 conn(0x559722a9cf90 msgr2=0x559722aa7ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:06.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.109+0000 7fc47a434740 1 -- 172.21.15.99:0/2034196555 shutdown_connections 2024-01-31T05:13:06.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.109+0000 7fc47a434740 1 -- 172.21.15.99:0/2034196555 wait complete. 2024-01-31T05:13:06.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.109+0000 7fc47a434740 20 client.16047 trim_cache size 0 max 16384 2024-01-31T05:13:06.115 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-01-31T05:13:06.115 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "scrub active (1 inodes in the stack)", 2024-01-31T05:13:06.115 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": { 2024-01-31T05:13:06.115 INFO:teuthology.orchestra.run.smithi099.stdout: "456e7ed5-b385-4c77-b5b8-e6b3680fe945": { 2024-01-31T05:13:06.115 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-01-31T05:13:06.115 INFO:teuthology.orchestra.run.smithi099.stdout: "tag": "456e7ed5-b385-4c77-b5b8-e6b3680fe945", 2024-01-31T05:13:06.115 INFO:teuthology.orchestra.run.smithi099.stdout: "options": "recursive,force" 2024-01-31T05:13:06.115 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:13:06.116 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:13:06.116 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-01-31T05:13:06.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.109+0000 7fc477598640 1 -- 172.21.15.99:0/1196583121 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc45c0a1360 msgr2=0x7fc45c0a3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:06.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.109+0000 7fc477598640 1 --2- 172.21.15.99:0/1196583121 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc45c0a1360 0x7fc45c0a3820 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc46800efd0 tx=0x7fc46806cf90 comp rx=0 tx=0).stop 2024-01-31T05:13:06.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.109+0000 7fc477598640 1 -- 172.21.15.99:0/1196583121 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4701017b0 msgr2=0x7fc47019e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:06.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.109+0000 7fc477598640 1 --2- 172.21.15.99:0/1196583121 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4701017b0 0x7fc47019e270 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fc46800eaa0 tx=0x7fc46800ef60 comp rx=0 tx=0).stop 2024-01-31T05:13:06.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.110+0000 7fc477598640 1 -- 172.21.15.99:0/1196583121 shutdown_connections 2024-01-31T05:13:06.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.110+0000 7fc477598640 1 --2- 172.21.15.99:0/1196583121 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc45c0a1360 0x7fc45c0a3820 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:06.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.110+0000 7fc477598640 1 --2- 172.21.15.99:0/1196583121 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4701017b0 0x7fc47019e270 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:06.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.110+0000 7fc477598640 1 --2- 172.21.15.99:0/1196583121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc470100df0 0x7fc470197240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:06.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.110+0000 7fc477598640 1 --2- 172.21.15.99:0/1196583121 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc4700ffc00 0x7fc470196d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:06.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.110+0000 7fc477598640 1 -- 172.21.15.99:0/1196583121 >> 172.21.15.99:0/1196583121 conn(0x7fc4700fb190 msgr2=0x7fc470104260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:06.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.110+0000 7fc477598640 1 -- 172.21.15.99:0/1196583121 shutdown_connections 2024-01-31T05:13:06.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:06.110+0000 7fc477598640 1 -- 172.21.15.99:0/1196583121 wait complete. 2024-01-31T05:13:06.119 INFO:tasks.cephfs.filesystem:scrub status for tag:456e7ed5-b385-4c77-b5b8-e6b3680fe945 - {'path': '/', 'tag': '456e7ed5-b385-4c77-b5b8-e6b3680fe945', 'options': 'recursive,force'} 2024-01-31T05:13:06.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:05 smithi179 ceph-mon[35652]: pgmap v400: 97 pgs: 97 active+clean; 46 MiB data, 595 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.5 MiB/s wr, 1.90k op/s 2024-01-31T05:13:06.434 INFO:tasks.workunit.client.0.smithi099.stdout:6/9: mknod c2 0 2024-01-31T05:13:06.435 INFO:tasks.workunit.client.0.smithi099.stdout:6/10: dread f1 [0,4194304] 0 2024-01-31T05:13:06.464 INFO:tasks.workunit.client.0.smithi099.stdout:6/11: dwrite f1 [0,4194304] 0 2024-01-31T05:13:06.479 INFO:tasks.workunit.client.0.smithi099.stdout:6/12: dread f1 [0,4194304] 0 2024-01-31T05:13:06.955 INFO:tasks.workunit.client.0.smithi099.stdout:5/10: creat f3 x:0 0 0 2024-01-31T05:13:06.955 INFO:tasks.workunit.client.0.smithi099.stdout:5/11: dread - f1 zero size 2024-01-31T05:13:06.955 INFO:tasks.workunit.client.0.smithi099.stdout:5/12: rmdir - no directory 2024-01-31T05:13:06.955 INFO:tasks.workunit.client.0.smithi099.stdout:5/13: fdatasync f3 0 2024-01-31T05:13:06.955 INFO:tasks.workunit.client.0.smithi099.stdout:5/14: creat f4 x:0 0 0 2024-01-31T05:13:07.007 INFO:tasks.workunit.client.0.smithi099.stdout:6/13: mknod c3 0 2024-01-31T05:13:07.009 INFO:tasks.workunit.client.0.smithi099.stdout:5/15: symlink l5 0 2024-01-31T05:13:07.009 INFO:tasks.workunit.client.0.smithi099.stdout:5/16: truncate f4 759412 0 2024-01-31T05:13:07.010 INFO:tasks.workunit.client.0.smithi099.stdout:1/17: getdents . 0 2024-01-31T05:13:07.013 INFO:tasks.workunit.client.0.smithi099.stdout:1/18: mkdir d4 0 2024-01-31T05:13:07.015 INFO:tasks.workunit.client.0.smithi099.stdout:1/19: creat d4/f5 x:0 0 0 2024-01-31T05:13:07.015 INFO:tasks.workunit.client.0.smithi099.stdout:1/20: creat d4/f6 x:0 0 0 2024-01-31T05:13:07.015 INFO:tasks.workunit.client.0.smithi099.stdout:1/21: readlink - no filename 2024-01-31T05:13:07.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:06 smithi099 ceph-mon[31615]: scrub queued for path: / 2024-01-31T05:13:07.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:06 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:07.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:06 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:07.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:06 smithi181 ceph-mon[36434]: scrub queued for path: / 2024-01-31T05:13:07.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:06 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:07.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:06 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:07.093 INFO:tasks.workunit.client.0.smithi099.stdout:8/18: truncate d1/f4 609141 0 2024-01-31T05:13:07.093 INFO:tasks.workunit.client.0.smithi099.stdout:8/19: stat d1/c2 0 2024-01-31T05:13:07.115 INFO:tasks.workunit.client.0.smithi099.stdout:8/20: dwrite d1/f5 [0,4194304] 0 2024-01-31T05:13:07.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:06 smithi179 ceph-mon[35652]: scrub queued for path: / 2024-01-31T05:13:07.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:06 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:07.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:06 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:07.260 INFO:tasks.workunit.client.0.smithi099.stdout:7/4: sync 2024-01-31T05:13:07.261 INFO:tasks.workunit.client.0.smithi099.stdout:2/7: sync 2024-01-31T05:13:07.261 INFO:tasks.workunit.client.0.smithi099.stdout:9/5: sync 2024-01-31T05:13:07.261 INFO:tasks.workunit.client.0.smithi099.stdout:3/0: sync 2024-01-31T05:13:07.261 INFO:tasks.workunit.client.0.smithi099.stdout:9/6: dread - no filename 2024-01-31T05:13:07.261 INFO:tasks.workunit.client.0.smithi099.stdout:9/7: dwrite - no filename 2024-01-31T05:13:07.261 INFO:tasks.workunit.client.0.smithi099.stdout:9/8: fdatasync - no filename 2024-01-31T05:13:07.261 INFO:tasks.workunit.client.0.smithi099.stdout:0/7: sync 2024-01-31T05:13:07.261 INFO:tasks.workunit.client.0.smithi099.stdout:4/6: sync 2024-01-31T05:13:07.261 INFO:tasks.workunit.client.0.smithi099.stdout:9/9: stat - no entries 2024-01-31T05:13:07.261 INFO:tasks.workunit.client.0.smithi099.stdout:9/10: dwrite - no filename 2024-01-31T05:13:07.261 INFO:tasks.workunit.client.0.smithi099.stdout:9/11: dread - no filename 2024-01-31T05:13:07.262 INFO:tasks.workunit.client.0.smithi099.stdout:9/12: link - no file 2024-01-31T05:13:07.262 INFO:tasks.workunit.client.0.smithi099.stdout:9/13: dread - no filename 2024-01-31T05:13:07.262 INFO:tasks.workunit.client.0.smithi099.stdout:9/14: unlink - no file 2024-01-31T05:13:07.262 INFO:tasks.workunit.client.0.smithi099.stdout:9/15: write - no filename 2024-01-31T05:13:07.262 INFO:tasks.workunit.client.0.smithi099.stdout:9/16: fdatasync - no filename 2024-01-31T05:13:07.262 INFO:tasks.workunit.client.0.smithi099.stdout:2/8: fdatasync f0 0 2024-01-31T05:13:07.262 INFO:tasks.workunit.client.0.smithi099.stdout:4/7: rename d0 to d0/d1 22 2024-01-31T05:13:07.262 INFO:tasks.workunit.client.0.smithi099.stdout:9/17: chown . 3 1 2024-01-31T05:13:07.262 INFO:tasks.workunit.client.0.smithi099.stdout:2/9: chown f1 36 1 2024-01-31T05:13:07.262 INFO:tasks.workunit.client.0.smithi099.stdout:7/5: write f0 [702529,45073] 0 2024-01-31T05:13:07.263 INFO:tasks.workunit.client.0.smithi099.stdout:3/1: creat f0 x:0 0 0 2024-01-31T05:13:07.263 INFO:tasks.workunit.client.0.smithi099.stdout:3/2: creat f1 x:0 0 0 2024-01-31T05:13:07.267 INFO:tasks.workunit.client.0.smithi099.stdout:6/14: getdents . 0 2024-01-31T05:13:07.267 INFO:tasks.workunit.client.0.smithi099.stdout:0/8: dread f0 [0,4194304] 0 2024-01-31T05:13:07.268 INFO:tasks.workunit.client.0.smithi099.stdout:4/8: mkdir d0/d2 0 2024-01-31T05:13:07.268 INFO:tasks.workunit.client.0.smithi099.stdout:4/9: fsync - no filename 2024-01-31T05:13:07.268 INFO:tasks.workunit.client.0.smithi099.stdout:4/10: write - no filename 2024-01-31T05:13:07.269 INFO:tasks.workunit.client.0.smithi099.stdout:9/18: mkdir d0 0 2024-01-31T05:13:07.271 INFO:tasks.workunit.client.0.smithi099.stdout:2/10: mknod c2 0 2024-01-31T05:13:07.271 INFO:tasks.workunit.client.0.smithi099.stdout:2/11: creat f3 x:0 0 0 2024-01-31T05:13:07.271 INFO:tasks.workunit.client.0.smithi099.stdout:1/22: fsync d4/f5 0 2024-01-31T05:13:07.280 INFO:tasks.workunit.client.0.smithi099.stdout:6/15: dread f1 [0,4194304] 0 2024-01-31T05:13:07.281 INFO:tasks.workunit.client.0.smithi099.stdout:7/6: dwrite f0 [0,4194304] 0 2024-01-31T05:13:07.281 INFO:tasks.workunit.client.0.smithi099.stdout:7/7: creat f1 x:0 0 0 2024-01-31T05:13:07.283 INFO:tasks.workunit.client.0.smithi099.stdout:0/9: link f0 d1/f2 0 2024-01-31T05:13:07.288 INFO:tasks.workunit.client.0.smithi099.stdout:4/11: creat d0/f3 x:0 0 0 2024-01-31T05:13:07.289 INFO:tasks.workunit.client.0.smithi099.stdout:0/10: write d1/f2 [2963162,2359] 0 2024-01-31T05:13:07.289 INFO:tasks.workunit.client.0.smithi099.stdout:3/3: dwrite f0 [0,4194304] 0 2024-01-31T05:13:07.292 INFO:tasks.workunit.client.0.smithi099.stdout:9/19: mkdir d0/d1 0 2024-01-31T05:13:07.295 INFO:tasks.workunit.client.0.smithi099.stdout:2/12: truncate f0 2754246 0 2024-01-31T05:13:07.295 INFO:tasks.workunit.client.0.smithi099.stdout:2/13: fdatasync f1 0 2024-01-31T05:13:07.296 INFO:tasks.workunit.client.0.smithi099.stdout:1/23: stat c0 0 2024-01-31T05:13:07.296 INFO:tasks.workunit.client.0.smithi099.stdout:1/24: read - d4/f5 zero size 2024-01-31T05:13:07.298 INFO:tasks.workunit.client.0.smithi099.stdout:8/21: rename d1/f4 to d1/f7 0 2024-01-31T05:13:07.301 INFO:tasks.workunit.client.0.smithi099.stdout:6/16: rename c2 to c4 0 2024-01-31T05:13:07.309 INFO:tasks.workunit.client.0.smithi099.stdout:4/12: creat d0/d2/f4 x:0 0 0 2024-01-31T05:13:07.309 INFO:tasks.workunit.client.0.smithi099.stdout:4/13: truncate d0/f3 64587 0 2024-01-31T05:13:07.312 INFO:tasks.workunit.client.0.smithi099.stdout:6/17: write f1 [2322460,1047] 0 2024-01-31T05:13:07.313 INFO:tasks.workunit.client.0.smithi099.stdout:6/18: read f1 [2739572,29000] 0 2024-01-31T05:13:07.313 INFO:tasks.workunit.client.0.smithi099.stdout:6/19: write f1 [2062343,60660] 0 2024-01-31T05:13:07.313 INFO:tasks.workunit.client.0.smithi099.stdout:6/20: truncate f1 4266950 0 2024-01-31T05:13:07.314 INFO:tasks.workunit.client.0.smithi099.stdout:0/11: symlink d1/l3 0 2024-01-31T05:13:07.316 INFO:tasks.workunit.client.0.smithi099.stdout:3/4: dwrite f0 [0,4194304] 0 2024-01-31T05:13:07.321 INFO:tasks.workunit.client.0.smithi099.stdout:9/20: creat d0/f2 x:0 0 0 2024-01-31T05:13:07.322 INFO:tasks.workunit.client.0.smithi099.stdout:1/25: fdatasync f3 0 2024-01-31T05:13:07.324 INFO:tasks.workunit.client.0.smithi099.stdout:8/22: dwrite d1/f5 [4194304,4194304] 0 2024-01-31T05:13:07.324 INFO:tasks.workunit.client.0.smithi099.stdout:8/23: fsync d1/f3 0 2024-01-31T05:13:07.325 INFO:tasks.workunit.client.0.smithi099.stdout:8/24: readlink d1/l6 0 2024-01-31T05:13:07.325 INFO:tasks.workunit.client.0.smithi099.stdout:7/8: rename f1 to f2 0 2024-01-31T05:13:07.326 INFO:tasks.workunit.client.0.smithi099.stdout:4/14: symlink d0/d2/l5 0 2024-01-31T05:13:07.327 INFO:tasks.workunit.client.0.smithi099.stdout:4/15: dread d0/f3 [0,4194304] 0 2024-01-31T05:13:07.329 INFO:tasks.workunit.client.0.smithi099.stdout:6/21: symlink l5 0 2024-01-31T05:13:07.329 INFO:tasks.workunit.client.0.smithi099.stdout:6/22: chown c3 384 1 2024-01-31T05:13:07.331 INFO:tasks.workunit.client.0.smithi099.stdout:0/12: rename f0 to d1/f4 0 2024-01-31T05:13:07.338 INFO:tasks.workunit.client.0.smithi099.stdout:6/23: dread f1 [0,4194304] 0 2024-01-31T05:13:07.338 INFO:tasks.workunit.client.0.smithi099.stdout:8/25: symlink d1/l8 0 2024-01-31T05:13:07.343 INFO:tasks.workunit.client.0.smithi099.stdout:4/16: mknod d0/c6 0 2024-01-31T05:13:07.343 INFO:tasks.workunit.client.0.smithi099.stdout:4/17: creat d0/d2/f7 x:0 0 0 2024-01-31T05:13:07.345 INFO:tasks.workunit.client.0.smithi099.stdout:5/17: sync 2024-01-31T05:13:07.350 INFO:tasks.workunit.client.0.smithi099.stdout:3/5: rename f1 to f2 0 2024-01-31T05:13:07.350 INFO:tasks.workunit.client.0.smithi099.stdout:3/6: write f2 [1043893,91338] 0 2024-01-31T05:13:07.356 INFO:tasks.workunit.client.0.smithi099.stdout:8/26: rename d1/f3 to d1/f9 0 2024-01-31T05:13:07.357 INFO:tasks.workunit.client.0.smithi099.stdout:8/27: write d1/f9 [1445140,24444] 0 2024-01-31T05:13:07.357 INFO:tasks.workunit.client.0.smithi099.stdout:6/24: symlink l6 0 2024-01-31T05:13:07.360 INFO:tasks.workunit.client.0.smithi099.stdout:4/18: mkdir d0/d8 0 2024-01-31T05:13:07.362 INFO:tasks.workunit.client.0.smithi099.stdout:4/19: dread d0/f3 [0,4194304] 0 2024-01-31T05:13:07.363 INFO:tasks.workunit.client.0.smithi099.stdout:3/7: mknod c3 0 2024-01-31T05:13:07.364 INFO:tasks.workunit.client.0.smithi099.stdout:8/28: dread d1/f7 [0,4194304] 0 2024-01-31T05:13:07.366 INFO:tasks.workunit.client.0.smithi099.stdout:6/25: creat f7 x:0 0 0 2024-01-31T05:13:07.366 INFO:tasks.workunit.client.0.smithi099.stdout:6/26: fdatasync f7 0 2024-01-31T05:13:07.367 INFO:tasks.workunit.client.0.smithi099.stdout:4/20: symlink d0/l9 0 2024-01-31T05:13:07.367 INFO:tasks.workunit.client.0.smithi099.stdout:4/21: readlink d0/d2/l5 0 2024-01-31T05:13:07.368 INFO:tasks.workunit.client.0.smithi099.stdout:4/22: write d0/f3 [982603,98849] 0 2024-01-31T05:13:07.368 INFO:tasks.workunit.client.0.smithi099.stdout:4/23: getdents d0/d8 0 2024-01-31T05:13:07.370 INFO:tasks.workunit.client.0.smithi099.stdout:8/29: symlink d1/la 0 2024-01-31T05:13:07.370 INFO:tasks.workunit.client.0.smithi099.stdout:8/30: fsync d1/f7 0 2024-01-31T05:13:07.370 INFO:tasks.workunit.client.0.smithi099.stdout:8/31: chown d1/la 465183 1 2024-01-31T05:13:07.370 INFO:tasks.workunit.client.0.smithi099.stdout:8/32: chown d1/c2 460798 1 2024-01-31T05:13:07.372 INFO:tasks.workunit.client.0.smithi099.stdout:4/24: symlink d0/d8/la 0 2024-01-31T05:13:07.372 INFO:tasks.workunit.client.0.smithi099.stdout:8/33: write d1/f7 [323535,126029] 0 2024-01-31T05:13:07.372 INFO:tasks.workunit.client.0.smithi099.stdout:8/34: chown d1/f5 56237320 1 2024-01-31T05:13:07.372 INFO:tasks.workunit.client.0.smithi099.stdout:8/35: stat d1/la 0 2024-01-31T05:13:07.372 INFO:tasks.workunit.client.0.smithi099.stdout:0/13: truncate d1/f4 1824546 0 2024-01-31T05:13:07.374 INFO:tasks.workunit.client.0.smithi099.stdout:4/25: rename d0/d2/l5 to d0/d2/lb 0 2024-01-31T05:13:07.375 INFO:tasks.workunit.client.0.smithi099.stdout:4/26: readlink d0/d2/lb 0 2024-01-31T05:13:07.377 INFO:tasks.workunit.client.0.smithi099.stdout:5/18: dwrite f1 [0,4194304] 0 2024-01-31T05:13:07.377 INFO:tasks.workunit.client.0.smithi099.stdout:0/14: creat d1/f5 x:0 0 0 2024-01-31T05:13:07.377 INFO:tasks.workunit.client.0.smithi099.stdout:7/9: dwrite f0 [4194304,4194304] 0 2024-01-31T05:13:07.377 INFO:tasks.workunit.client.0.smithi099.stdout:2/14: dwrite f0 [0,4194304] 0 2024-01-31T05:13:07.378 INFO:tasks.workunit.client.0.smithi099.stdout:8/36: fdatasync d1/f7 0 2024-01-31T05:13:07.378 INFO:tasks.workunit.client.0.smithi099.stdout:4/27: symlink d0/d2/lc 0 2024-01-31T05:13:07.383 INFO:tasks.workunit.client.0.smithi099.stdout:5/19: mkdir d6 0 2024-01-31T05:13:07.385 INFO:tasks.workunit.client.0.smithi099.stdout:7/10: unlink f0 0 2024-01-31T05:13:07.385 INFO:tasks.workunit.client.0.smithi099.stdout:7/11: truncate f2 698574 0 2024-01-31T05:13:07.387 INFO:tasks.workunit.client.0.smithi099.stdout:8/37: dread d1/f7 [0,4194304] 0 2024-01-31T05:13:07.387 INFO:tasks.workunit.client.0.smithi099.stdout:8/38: fsync d1/f5 0 2024-01-31T05:13:07.388 INFO:tasks.workunit.client.0.smithi099.stdout:8/39: stat d1/f9 0 2024-01-31T05:13:07.393 INFO:tasks.workunit.client.0.smithi099.stdout:8/40: mknod d1/cb 0 2024-01-31T05:13:07.395 INFO:tasks.workunit.client.0.smithi099.stdout:2/15: getdents . 0 2024-01-31T05:13:07.398 INFO:tasks.workunit.client.0.smithi099.stdout:9/21: rmdir d0 39 2024-01-31T05:13:07.398 INFO:tasks.workunit.client.0.smithi099.stdout:9/22: write d0/f2 [920618,57531] 0 2024-01-31T05:13:07.398 INFO:tasks.workunit.client.0.smithi099.stdout:9/23: truncate d0/f2 1207949 0 2024-01-31T05:13:07.402 INFO:tasks.workunit.client.0.smithi099.stdout:9/24: mkdir d0/d1/d3 0 2024-01-31T05:13:07.406 INFO:tasks.workunit.client.0.smithi099.stdout:3/8: write f0 [1783289,89215] 0 2024-01-31T05:13:07.406 INFO:tasks.workunit.client.0.smithi099.stdout:3/9: rmdir - no directory 2024-01-31T05:13:07.406 INFO:tasks.workunit.client.0.smithi099.stdout:3/10: creat f4 x:0 0 0 2024-01-31T05:13:07.408 INFO:tasks.workunit.client.0.smithi099.stdout:7/12: fsync f2 0 2024-01-31T05:13:07.408 INFO:tasks.workunit.client.0.smithi099.stdout:7/13: creat f3 x:0 0 0 2024-01-31T05:13:07.412 INFO:tasks.workunit.client.0.smithi099.stdout:4/28: dwrite d0/f3 [0,4194304] 0 2024-01-31T05:13:07.412 INFO:tasks.workunit.client.0.smithi099.stdout:4/29: dread - d0/d2/f7 zero size 2024-01-31T05:13:07.412 INFO:tasks.workunit.client.0.smithi099.stdout:4/30: chown d0 0 1 2024-01-31T05:13:07.412 INFO:tasks.workunit.client.0.smithi099.stdout:4/31: readlink d0/d2/lb 0 2024-01-31T05:13:07.412 INFO:tasks.workunit.client.0.smithi099.stdout:4/32: write d0/d2/f4 [1004843,49966] 0 2024-01-31T05:13:07.413 INFO:tasks.workunit.client.0.smithi099.stdout:4/33: creat d0/fd x:0 0 0 2024-01-31T05:13:07.413 INFO:tasks.workunit.client.0.smithi099.stdout:4/34: dread - d0/d2/f7 zero size 2024-01-31T05:13:07.413 INFO:tasks.workunit.client.0.smithi099.stdout:6/27: dwrite f7 [0,4194304] 0 2024-01-31T05:13:07.414 INFO:tasks.workunit.client.0.smithi099.stdout:3/11: mknod c5 0 2024-01-31T05:13:07.415 INFO:tasks.workunit.client.0.smithi099.stdout:3/12: fdatasync f4 0 2024-01-31T05:13:07.415 INFO:tasks.workunit.client.0.smithi099.stdout:3/13: write f2 [2179815,46697] 0 2024-01-31T05:13:07.415 INFO:tasks.workunit.client.0.smithi099.stdout:5/20: dwrite f3 [0,4194304] 0 2024-01-31T05:13:07.415 INFO:tasks.workunit.client.0.smithi099.stdout:5/21: readlink l5 0 2024-01-31T05:13:07.416 INFO:tasks.workunit.client.0.smithi099.stdout:8/41: write d1/f5 [3330469,65848] 0 2024-01-31T05:13:07.419 INFO:tasks.workunit.client.0.smithi099.stdout:4/35: symlink d0/d2/le 0 2024-01-31T05:13:07.421 INFO:tasks.workunit.client.0.smithi099.stdout:2/16: dwrite f0 [0,4194304] 0 2024-01-31T05:13:07.422 INFO:tasks.workunit.client.0.smithi099.stdout:9/25: dread d0/f2 [0,4194304] 0 2024-01-31T05:13:07.423 INFO:tasks.workunit.client.0.smithi099.stdout:6/28: dread f1 [0,4194304] 0 2024-01-31T05:13:07.423 INFO:tasks.workunit.client.0.smithi099.stdout:6/29: rmdir - no directory 2024-01-31T05:13:07.424 INFO:tasks.workunit.client.0.smithi099.stdout:3/14: dread f2 [0,4194304] 0 2024-01-31T05:13:07.429 INFO:tasks.workunit.client.0.smithi099.stdout:5/22: creat d6/f7 x:0 0 0 2024-01-31T05:13:07.431 INFO:tasks.workunit.client.0.smithi099.stdout:9/26: mknod d0/c4 0 2024-01-31T05:13:07.431 INFO:tasks.workunit.client.0.smithi099.stdout:9/27: fsync d0/f2 0 2024-01-31T05:13:07.432 INFO:tasks.workunit.client.0.smithi099.stdout:6/30: symlink l8 0 2024-01-31T05:13:07.433 INFO:tasks.workunit.client.0.smithi099.stdout:3/15: symlink l6 0 2024-01-31T05:13:07.433 INFO:tasks.workunit.client.0.smithi099.stdout:3/16: dread - f4 zero size 2024-01-31T05:13:07.434 INFO:tasks.workunit.client.0.smithi099.stdout:5/23: symlink d6/l8 0 2024-01-31T05:13:07.434 INFO:tasks.workunit.client.0.smithi099.stdout:5/24: readlink l0 0 2024-01-31T05:13:07.434 INFO:tasks.workunit.client.0.smithi099.stdout:5/25: chown f4 3723947 1 2024-01-31T05:13:07.434 INFO:tasks.workunit.client.0.smithi099.stdout:9/28: dread d0/f2 [0,4194304] 0 2024-01-31T05:13:07.436 INFO:tasks.workunit.client.0.smithi099.stdout:7/14: dwrite f2 [0,4194304] 0 2024-01-31T05:13:07.437 INFO:tasks.workunit.client.0.smithi099.stdout:4/36: write d0/f3 [4098140,81278] 0 2024-01-31T05:13:07.438 INFO:tasks.workunit.client.0.smithi099.stdout:9/29: mkdir d0/d1/d3/d5 0 2024-01-31T05:13:07.440 INFO:tasks.workunit.client.0.smithi099.stdout:5/26: write f1 [4709555,81726] 0 2024-01-31T05:13:07.443 INFO:tasks.workunit.client.0.smithi099.stdout:7/15: symlink l4 0 2024-01-31T05:13:07.444 INFO:tasks.workunit.client.0.smithi099.stdout:4/37: getdents d0/d8 0 2024-01-31T05:13:07.445 INFO:tasks.workunit.client.0.smithi099.stdout:9/30: mknod d0/d1/d3/c6 0 2024-01-31T05:13:07.446 INFO:tasks.workunit.client.0.smithi099.stdout:4/38: link d0/c6 d0/d2/cf 0 2024-01-31T05:13:07.447 INFO:tasks.workunit.client.0.smithi099.stdout:9/31: unlink d0/c4 0 2024-01-31T05:13:07.453 INFO:tasks.workunit.client.0.smithi099.stdout:2/17: dwrite f3 [0,4194304] 0 2024-01-31T05:13:07.454 INFO:tasks.workunit.client.0.smithi099.stdout:5/27: read f3 [2803821,58296] 0 2024-01-31T05:13:07.454 INFO:tasks.workunit.client.0.smithi099.stdout:3/17: dread f0 [0,4194304] 0 2024-01-31T05:13:07.454 INFO:tasks.workunit.client.0.smithi099.stdout:8/42: getdents d1 0 2024-01-31T05:13:07.458 INFO:tasks.workunit.client.0.smithi099.stdout:2/18: creat f4 x:0 0 0 2024-01-31T05:13:07.460 INFO:tasks.workunit.client.0.smithi099.stdout:2/19: rename c2 to c5 0 2024-01-31T05:13:07.460 INFO:tasks.workunit.client.0.smithi099.stdout:2/20: truncate f1 4456246 0 2024-01-31T05:13:07.460 INFO:tasks.workunit.client.0.smithi099.stdout:2/21: symlink l6 0 2024-01-31T05:13:07.462 INFO:tasks.workunit.client.0.smithi099.stdout:2/22: unlink f3 0 2024-01-31T05:13:07.462 INFO:tasks.workunit.client.0.smithi099.stdout:2/23: creat f7 x:0 0 0 2024-01-31T05:13:07.462 INFO:tasks.workunit.client.0.smithi099.stdout:2/24: creat f8 x:0 0 0 2024-01-31T05:13:07.462 INFO:tasks.workunit.client.0.smithi099.stdout:2/25: truncate f0 4566001 0 2024-01-31T05:13:07.462 INFO:tasks.workunit.client.0.smithi099.stdout:2/26: chown f1 105815 1 2024-01-31T05:13:07.463 INFO:tasks.workunit.client.0.smithi099.stdout:7/16: dwrite f3 [0,4194304] 0 2024-01-31T05:13:07.467 INFO:tasks.workunit.client.0.smithi099.stdout:6/31: truncate f7 3406891 0 2024-01-31T05:13:07.469 INFO:tasks.workunit.client.0.smithi099.stdout:6/32: truncate f1 1405736 0 2024-01-31T05:13:07.472 INFO:tasks.workunit.client.0.smithi099.stdout:8/43: read d1/f5 [6134923,73447] 0 2024-01-31T05:13:07.475 INFO:tasks.workunit.client.0.smithi099.stdout:8/44: symlink d1/lc 0 2024-01-31T05:13:07.477 INFO:tasks.workunit.client.0.smithi099.stdout:8/45: mkdir d1/dd 0 2024-01-31T05:13:07.479 INFO:tasks.workunit.client.0.smithi099.stdout:8/46: fdatasync d1/f9 0 2024-01-31T05:13:07.480 INFO:tasks.workunit.client.0.smithi099.stdout:9/32: rename d0/d1/d3 to d0/d7 0 2024-01-31T05:13:07.483 INFO:tasks.workunit.client.0.smithi099.stdout:7/17: dread f3 [0,4194304] 0 2024-01-31T05:13:07.484 INFO:tasks.workunit.client.0.smithi099.stdout:8/47: creat d1/fe x:0 0 0 2024-01-31T05:13:07.484 INFO:tasks.workunit.client.0.smithi099.stdout:4/39: truncate d0/f3 111886 0 2024-01-31T05:13:07.485 INFO:tasks.workunit.client.0.smithi099.stdout:3/18: dwrite f4 [0,4194304] 0 2024-01-31T05:13:07.486 INFO:tasks.workunit.client.0.smithi099.stdout:8/48: rename d1/f9 to d1/dd/ff 0 2024-01-31T05:13:07.486 INFO:tasks.workunit.client.0.smithi099.stdout:8/49: readlink d1/lc 0 2024-01-31T05:13:07.486 INFO:tasks.workunit.client.0.smithi099.stdout:8/50: creat d1/f10 x:0 0 0 2024-01-31T05:13:07.486 INFO:tasks.workunit.client.0.smithi099.stdout:8/51: dread - d1/fe zero size 2024-01-31T05:13:07.486 INFO:tasks.workunit.client.0.smithi099.stdout:8/52: read d1/f7 [373102,117236] 0 2024-01-31T05:13:07.491 INFO:tasks.workunit.client.0.smithi099.stdout:5/28: dwrite d6/f7 [0,4194304] 0 2024-01-31T05:13:07.493 INFO:tasks.workunit.client.0.smithi099.stdout:0/15: truncate d1/f4 1761889 0 2024-01-31T05:13:07.493 INFO:tasks.workunit.client.0.smithi099.stdout:0/16: creat d1/f6 x:0 0 0 2024-01-31T05:13:07.495 INFO:tasks.workunit.client.0.smithi099.stdout:5/29: mknod d6/c9 0 2024-01-31T05:13:07.495 INFO:tasks.workunit.client.0.smithi099.stdout:5/30: fdatasync f3 0 2024-01-31T05:13:07.496 INFO:tasks.workunit.client.0.smithi099.stdout:7/18: write f2 [1996184,69213] 0 2024-01-31T05:13:07.496 INFO:tasks.workunit.client.0.smithi099.stdout:7/19: write f2 [5049866,82081] 0 2024-01-31T05:13:07.498 INFO:tasks.workunit.client.0.smithi099.stdout:0/17: mknod d1/c7 0 2024-01-31T05:13:07.499 INFO:tasks.workunit.client.0.smithi099.stdout:2/27: fsync f4 0 2024-01-31T05:13:07.500 INFO:tasks.workunit.client.0.smithi099.stdout:0/18: mkdir d1/d8 0 2024-01-31T05:13:07.506 INFO:tasks.workunit.client.0.smithi099.stdout:7/20: dread f2 [0,4194304] 0 2024-01-31T05:13:07.511 INFO:tasks.workunit.client.0.smithi099.stdout:9/33: dwrite d0/f2 [0,4194304] 0 2024-01-31T05:13:07.511 INFO:tasks.workunit.client.0.smithi099.stdout:3/19: dread f0 [0,4194304] 0 2024-01-31T05:13:07.511 INFO:tasks.workunit.client.0.smithi099.stdout:3/20: creat f7 x:0 0 0 2024-01-31T05:13:07.512 INFO:tasks.workunit.client.0.smithi099.stdout:7/21: dread f2 [0,4194304] 0 2024-01-31T05:13:07.513 INFO:tasks.workunit.client.0.smithi099.stdout:4/40: dread d0/f3 [0,4194304] 0 2024-01-31T05:13:07.514 INFO:tasks.workunit.client.0.smithi099.stdout:6/33: dread f7 [0,4194304] 0 2024-01-31T05:13:07.520 INFO:tasks.workunit.client.0.smithi099.stdout:8/53: fsync d1/dd/ff 0 2024-01-31T05:13:07.520 INFO:tasks.workunit.client.0.smithi099.stdout:8/54: write d1/f10 [529861,110294] 0 2024-01-31T05:13:07.520 INFO:tasks.workunit.client.0.smithi099.stdout:8/55: dread - d1/fe zero size 2024-01-31T05:13:07.520 INFO:tasks.workunit.client.0.smithi099.stdout:8/56: fsync d1/fe 0 2024-01-31T05:13:07.520 INFO:tasks.workunit.client.0.smithi099.stdout:8/57: write d1/f7 [1550727,55896] 0 2024-01-31T05:13:07.523 INFO:tasks.workunit.client.0.smithi099.stdout:9/34: write d0/f2 [1066246,40041] 0 2024-01-31T05:13:07.523 INFO:tasks.workunit.client.0.smithi099.stdout:9/35: chown d0/d7/d5 24489 1 2024-01-31T05:13:07.523 INFO:tasks.workunit.client.0.smithi099.stdout:9/36: write d0/f2 [27270,50587] 0 2024-01-31T05:13:07.523 INFO:tasks.workunit.client.0.smithi099.stdout:3/21: write f4 [2146786,112984] 0 2024-01-31T05:13:07.523 INFO:tasks.workunit.client.0.smithi099.stdout:3/22: chown f4 10064989 1 2024-01-31T05:13:07.524 INFO:tasks.workunit.client.0.smithi099.stdout:2/28: dwrite f1 [0,4194304] 0 2024-01-31T05:13:07.528 INFO:tasks.workunit.client.0.smithi099.stdout:8/58: dread d1/f10 [0,4194304] 0 2024-01-31T05:13:07.532 INFO:tasks.workunit.client.0.smithi099.stdout:4/41: symlink d0/d8/l10 0 2024-01-31T05:13:07.532 INFO:tasks.workunit.client.0.smithi099.stdout:6/34: symlink l9 0 2024-01-31T05:13:07.532 INFO:tasks.workunit.client.0.smithi099.stdout:4/42: write d0/fd [844890,27956] 0 2024-01-31T05:13:07.532 INFO:tasks.workunit.client.0.smithi099.stdout:6/35: creat fa x:0 0 0 2024-01-31T05:13:07.532 INFO:tasks.workunit.client.0.smithi099.stdout:6/36: rmdir - no directory 2024-01-31T05:13:07.532 INFO:tasks.workunit.client.0.smithi099.stdout:7/22: mknod c5 0 2024-01-31T05:13:07.536 INFO:tasks.workunit.client.0.smithi099.stdout:9/37: rename d0/d7/d5 to d0/d1/d8 0 2024-01-31T05:13:07.536 INFO:tasks.workunit.client.0.smithi099.stdout:3/23: symlink l8 0 2024-01-31T05:13:07.536 INFO:tasks.workunit.client.0.smithi099.stdout:3/24: write f4 [2163669,32749] 0 2024-01-31T05:13:07.536 INFO:tasks.workunit.client.0.smithi099.stdout:3/25: write f0 [3871346,46650] 0 2024-01-31T05:13:07.539 INFO:tasks.workunit.client.0.smithi099.stdout:7/23: unlink c5 0 2024-01-31T05:13:07.542 INFO:tasks.workunit.client.0.smithi099.stdout:9/38: unlink d0/d7/c6 0 2024-01-31T05:13:07.542 INFO:tasks.workunit.client.0.smithi099.stdout:5/31: dread f1 [0,4194304] 0 2024-01-31T05:13:07.544 INFO:tasks.workunit.client.0.smithi099.stdout:0/19: rename d1/f2 to d1/f9 0 2024-01-31T05:13:07.544 INFO:tasks.workunit.client.0.smithi099.stdout:7/24: truncate f3 3686506 0 2024-01-31T05:13:07.545 INFO:tasks.workunit.client.0.smithi099.stdout:9/39: mknod d0/d1/c9 0 2024-01-31T05:13:07.546 INFO:tasks.workunit.client.0.smithi099.stdout:9/40: readlink - no filename 2024-01-31T05:13:07.546 INFO:tasks.workunit.client.0.smithi099.stdout:9/41: write d0/f2 [2796397,108592] 0 2024-01-31T05:13:07.547 INFO:tasks.workunit.client.0.smithi099.stdout:5/32: mkdir d6/da 0 2024-01-31T05:13:07.567 INFO:tasks.workunit.client.0.smithi099.stdout:9/42: truncate d0/f2 1672197 0 2024-01-31T05:13:07.576 INFO:tasks.workunit.client.0.smithi099.stdout:8/59: dwrite d1/dd/ff [0,4194304] 0 2024-01-31T05:13:07.583 INFO:tasks.workunit.client.0.smithi099.stdout:1/26: sync 2024-01-31T05:13:07.584 INFO:tasks.workunit.client.0.smithi099.stdout:8/60: mkdir d1/dd/d11 0 2024-01-31T05:13:07.585 INFO:tasks.workunit.client.0.smithi099.stdout:1/27: link c0 d4/c7 0 2024-01-31T05:13:07.586 INFO:tasks.workunit.client.0.smithi099.stdout:7/25: dread f3 [0,4194304] 0 2024-01-31T05:13:07.587 INFO:tasks.workunit.client.0.smithi099.stdout:1/28: write f1 [1625250,16284] 0 2024-01-31T05:13:07.590 INFO:tasks.workunit.client.0.smithi099.stdout:1/29: mknod d4/c8 0 2024-01-31T05:13:07.601 INFO:tasks.workunit.client.0.smithi099.stdout:6/37: dwrite fa [0,4194304] 0 2024-01-31T05:13:07.601 INFO:tasks.workunit.client.0.smithi099.stdout:4/43: dwrite d0/d2/f4 [0,4194304] 0 2024-01-31T05:13:07.601 INFO:tasks.workunit.client.0.smithi099.stdout:3/26: dwrite f0 [0,4194304] 0 2024-01-31T05:13:07.601 INFO:tasks.workunit.client.0.smithi099.stdout:3/27: write f7 [842702,35526] 0 2024-01-31T05:13:07.601 INFO:tasks.workunit.client.0.smithi099.stdout:0/20: dwrite d1/f6 [0,4194304] 0 2024-01-31T05:13:07.601 INFO:tasks.workunit.client.0.smithi099.stdout:2/29: dwrite f1 [4194304,4194304] 0 2024-01-31T05:13:07.601 INFO:tasks.workunit.client.0.smithi099.stdout:5/33: dwrite f3 [0,4194304] 0 2024-01-31T05:13:07.605 INFO:tasks.workunit.client.0.smithi099.stdout:4/44: creat d0/d8/f11 x:0 0 0 2024-01-31T05:13:07.605 INFO:tasks.workunit.client.0.smithi099.stdout:4/45: truncate d0/d2/f4 5177796 0 2024-01-31T05:13:07.605 INFO:tasks.workunit.client.0.smithi099.stdout:9/43: read d0/f2 [1139782,22559] 0 2024-01-31T05:13:07.609 INFO:tasks.workunit.client.0.smithi099.stdout:2/30: symlink l9 0 2024-01-31T05:13:07.609 INFO:tasks.workunit.client.0.smithi099.stdout:2/31: fdatasync f1 0 2024-01-31T05:13:07.609 INFO:tasks.workunit.client.0.smithi099.stdout:8/61: dwrite d1/f5 [0,4194304] 0 2024-01-31T05:13:07.609 INFO:tasks.workunit.client.0.smithi099.stdout:8/62: write d1/dd/ff [5052844,129820] 0 2024-01-31T05:13:07.613 INFO:tasks.workunit.client.0.smithi099.stdout:5/34: dread f3 [0,4194304] 0 2024-01-31T05:13:07.617 INFO:tasks.workunit.client.0.smithi099.stdout:4/46: unlink d0/d2/f4 0 2024-01-31T05:13:07.618 INFO:tasks.workunit.client.0.smithi099.stdout:4/47: truncate d0/d8/f11 377872 0 2024-01-31T05:13:07.618 INFO:tasks.workunit.client.0.smithi099.stdout:4/48: chown d0/c6 121607176 1 2024-01-31T05:13:07.618 INFO:tasks.workunit.client.0.smithi099.stdout:1/30: rmdir d4 39 2024-01-31T05:13:07.620 INFO:tasks.workunit.client.0.smithi099.stdout:9/44: creat d0/d7/fa x:0 0 0 2024-01-31T05:13:07.620 INFO:tasks.workunit.client.0.smithi099.stdout:9/45: write d0/f2 [1949262,36602] 0 2024-01-31T05:13:07.620 INFO:tasks.workunit.client.0.smithi099.stdout:9/46: write d0/f2 [2303140,80596] 0 2024-01-31T05:13:07.621 INFO:tasks.workunit.client.0.smithi099.stdout:0/21: dwrite d1/f6 [0,4194304] 0 2024-01-31T05:13:07.621 INFO:tasks.workunit.client.0.smithi099.stdout:0/22: write d1/f4 [2442260,20851] 0 2024-01-31T05:13:07.622 INFO:tasks.workunit.client.0.smithi099.stdout:2/32: rename f7 to fa 0 2024-01-31T05:13:07.624 INFO:tasks.workunit.client.0.smithi099.stdout:8/63: mknod d1/dd/c12 0 2024-01-31T05:13:07.626 INFO:tasks.workunit.client.0.smithi099.stdout:1/31: creat d4/f9 x:0 0 0 2024-01-31T05:13:07.626 INFO:tasks.workunit.client.0.smithi099.stdout:1/32: dread - d4/f9 zero size 2024-01-31T05:13:07.627 INFO:tasks.workunit.client.0.smithi099.stdout:9/47: link d0/d1/c9 d0/d1/cb 0 2024-01-31T05:13:07.630 INFO:tasks.workunit.client.0.smithi099.stdout:2/33: symlink lb 0 2024-01-31T05:13:07.631 INFO:tasks.workunit.client.0.smithi099.stdout:8/64: symlink d1/dd/d11/l13 0 2024-01-31T05:13:07.633 INFO:tasks.workunit.client.0.smithi099.stdout:5/35: dwrite f4 [0,4194304] 0 2024-01-31T05:13:07.636 INFO:tasks.workunit.client.0.smithi099.stdout:1/33: rename d4/f5 to d4/fa 0 2024-01-31T05:13:07.636 INFO:tasks.workunit.client.0.smithi099.stdout:0/23: getdents d1 0 2024-01-31T05:13:07.636 INFO:tasks.workunit.client.0.smithi099.stdout:0/24: rename d1/d8 to d1/d8/da 22 2024-01-31T05:13:07.639 INFO:tasks.workunit.client.0.smithi099.stdout:0/25: symlink d1/d8/lb 0 2024-01-31T05:13:07.642 INFO:tasks.workunit.client.0.smithi099.stdout:0/26: mknod d1/cc 0 2024-01-31T05:13:07.643 INFO:tasks.workunit.client.0.smithi099.stdout:0/27: stat d1/cc 0 2024-01-31T05:13:07.644 INFO:tasks.workunit.client.0.smithi099.stdout:3/28: truncate f7 477332 0 2024-01-31T05:13:07.646 INFO:tasks.workunit.client.0.smithi099.stdout:3/29: mknod c9 0 2024-01-31T05:13:07.648 INFO:tasks.workunit.client.0.smithi099.stdout:4/49: getdents d0/d2 0 2024-01-31T05:13:07.649 INFO:tasks.workunit.client.0.smithi099.stdout:8/65: read d1/f5 [3401349,85786] 0 2024-01-31T05:13:07.650 INFO:tasks.workunit.client.0.smithi099.stdout:8/66: symlink d1/dd/d11/l14 0 2024-01-31T05:13:07.651 INFO:tasks.workunit.client.0.smithi099.stdout:8/67: read d1/f5 [7920235,111238] 0 2024-01-31T05:13:07.652 INFO:tasks.workunit.client.0.smithi099.stdout:8/68: mkdir d1/dd/d15 0 2024-01-31T05:13:07.654 INFO:tasks.workunit.client.0.smithi099.stdout:8/69: link d1/cb d1/dd/d15/c16 0 2024-01-31T05:13:07.655 INFO:tasks.workunit.client.0.smithi099.stdout:1/34: dread f1 [0,4194304] 0 2024-01-31T05:13:07.655 INFO:tasks.workunit.client.0.smithi099.stdout:1/35: write d4/f6 [164128,32518] 0 2024-01-31T05:13:07.656 INFO:tasks.workunit.client.0.smithi099.stdout:8/70: dread d1/f10 [0,4194304] 0 2024-01-31T05:13:07.656 INFO:tasks.workunit.client.0.smithi099.stdout:8/71: fdatasync d1/fe 0 2024-01-31T05:13:07.656 INFO:tasks.workunit.client.0.smithi099.stdout:8/72: chown d1/dd/d11/l13 443198825 1 2024-01-31T05:13:07.656 INFO:tasks.workunit.client.0.smithi099.stdout:8/73: stat d1/l6 0 2024-01-31T05:13:07.657 INFO:tasks.workunit.client.0.smithi099.stdout:8/74: creat d1/dd/d15/f17 x:0 0 0 2024-01-31T05:13:07.658 INFO:tasks.workunit.client.0.smithi099.stdout:8/75: symlink d1/dd/l18 0 2024-01-31T05:13:07.659 INFO:tasks.workunit.client.0.smithi099.stdout:5/36: dread f1 [0,4194304] 0 2024-01-31T05:13:07.660 INFO:tasks.workunit.client.0.smithi099.stdout:2/34: dwrite fa [0,4194304] 0 2024-01-31T05:13:07.660 INFO:tasks.workunit.client.0.smithi099.stdout:2/35: rmdir - no directory 2024-01-31T05:13:07.660 INFO:tasks.workunit.client.0.smithi099.stdout:8/76: dread d1/f10 [0,4194304] 0 2024-01-31T05:13:07.664 INFO:tasks.workunit.client.0.smithi099.stdout:2/36: rename fa to fc 0 2024-01-31T05:13:07.665 INFO:tasks.workunit.client.0.smithi099.stdout:2/37: chown f0 944758484 1 2024-01-31T05:13:07.665 INFO:tasks.workunit.client.0.smithi099.stdout:2/38: stat l9 0 2024-01-31T05:13:07.665 INFO:tasks.workunit.client.0.smithi099.stdout:2/39: dread - f8 zero size 2024-01-31T05:13:07.665 INFO:tasks.workunit.client.0.smithi099.stdout:2/40: fsync f0 0 2024-01-31T05:13:07.665 INFO:tasks.workunit.client.0.smithi099.stdout:2/41: readlink lb 0 2024-01-31T05:13:07.665 INFO:tasks.workunit.client.0.smithi099.stdout:3/30: getdents . 0 2024-01-31T05:13:07.665 INFO:tasks.workunit.client.0.smithi099.stdout:8/77: rmdir d1/dd/d11 39 2024-01-31T05:13:07.667 INFO:tasks.workunit.client.0.smithi099.stdout:3/31: creat fa x:0 0 0 2024-01-31T05:13:07.679 INFO:tasks.workunit.client.0.smithi099.stdout:3/32: dread f4 [0,4194304] 0 2024-01-31T05:13:07.679 INFO:tasks.workunit.client.0.smithi099.stdout:3/33: dread - fa zero size 2024-01-31T05:13:07.682 INFO:tasks.workunit.client.0.smithi099.stdout:8/78: dread d1/dd/ff [0,4194304] 0 2024-01-31T05:13:07.684 INFO:tasks.workunit.client.0.smithi099.stdout:8/79: mkdir d1/dd/d11/d19 0 2024-01-31T05:13:07.690 INFO:tasks.workunit.client.0.smithi099.stdout:8/80: write d1/dd/ff [2434232,65809] 0 2024-01-31T05:13:07.692 INFO:tasks.workunit.client.0.smithi099.stdout:8/81: mknod d1/dd/c1a 0 2024-01-31T05:13:07.692 INFO:tasks.workunit.client.0.smithi099.stdout:8/82: dread - d1/fe zero size 2024-01-31T05:13:07.693 INFO:tasks.workunit.client.0.smithi099.stdout:8/83: creat d1/dd/d11/f1b x:0 0 0 2024-01-31T05:13:07.694 INFO:tasks.workunit.client.0.smithi099.stdout:8/84: write d1/f7 [2164429,108179] 0 2024-01-31T05:13:07.694 INFO:tasks.workunit.client.0.smithi099.stdout:2/42: write f1 [1217920,40377] 0 2024-01-31T05:13:07.694 INFO:tasks.workunit.client.0.smithi099.stdout:0/28: write d1/f6 [1760348,2665] 0 2024-01-31T05:13:07.694 INFO:tasks.workunit.client.0.smithi099.stdout:8/85: creat d1/dd/d11/d19/f1c x:0 0 0 2024-01-31T05:13:07.697 INFO:tasks.workunit.client.0.smithi099.stdout:4/50: dwrite d0/fd [0,4194304] 0 2024-01-31T05:13:07.697 INFO:tasks.workunit.client.0.smithi099.stdout:4/51: write d0/d2/f7 [921535,121529] 0 2024-01-31T05:13:07.697 INFO:tasks.workunit.client.0.smithi099.stdout:8/86: fsync d1/f7 0 2024-01-31T05:13:07.697 INFO:tasks.workunit.client.0.smithi099.stdout:0/29: creat d1/d8/fd x:0 0 0 2024-01-31T05:13:07.701 INFO:tasks.workunit.client.0.smithi099.stdout:8/87: mkdir d1/dd/d1d 0 2024-01-31T05:13:07.701 INFO:tasks.workunit.client.0.smithi099.stdout:8/88: chown d1/dd 6071319 1 2024-01-31T05:13:07.701 INFO:tasks.workunit.client.0.smithi099.stdout:8/89: dread - d1/dd/d11/d19/f1c zero size 2024-01-31T05:13:07.701 INFO:tasks.workunit.client.0.smithi099.stdout:8/90: creat d1/dd/d11/f1e x:0 0 0 2024-01-31T05:13:07.705 INFO:tasks.workunit.client.0.smithi099.stdout:5/37: dwrite d6/f7 [0,4194304] 0 2024-01-31T05:13:07.706 INFO:tasks.workunit.client.0.smithi099.stdout:2/43: write fc [3597660,38002] 0 2024-01-31T05:13:07.708 INFO:tasks.workunit.client.0.smithi099.stdout:0/30: symlink d1/le 0 2024-01-31T05:13:07.713 INFO:tasks.workunit.client.0.smithi099.stdout:2/44: unlink lb 0 2024-01-31T05:13:07.714 INFO:tasks.workunit.client.0.smithi099.stdout:0/31: unlink d1/l3 0 2024-01-31T05:13:07.715 INFO:tasks.workunit.client.0.smithi099.stdout:2/45: mknod cd 0 2024-01-31T05:13:07.715 INFO:tasks.workunit.client.0.smithi099.stdout:2/46: write f8 [755636,1523] 0 2024-01-31T05:13:07.717 INFO:tasks.workunit.client.0.smithi099.stdout:0/32: getdents d1/d8 0 2024-01-31T05:13:07.726 INFO:tasks.workunit.client.0.smithi099.stdout:7/26: sync 2024-01-31T05:13:07.726 INFO:tasks.workunit.client.0.smithi099.stdout:7/27: fdatasync f2 0 2024-01-31T05:13:07.727 INFO:tasks.workunit.client.0.smithi099.stdout:0/33: getdents d1 0 2024-01-31T05:13:07.727 INFO:tasks.workunit.client.0.smithi099.stdout:0/34: chown d1/f4 5942 1 2024-01-31T05:13:07.728 INFO:tasks.workunit.client.0.smithi099.stdout:0/35: write d1/d8/fd [368235,59707] 0 2024-01-31T05:13:07.729 INFO:tasks.workunit.client.0.smithi099.stdout:7/28: truncate f3 1565913 0 2024-01-31T05:13:07.730 INFO:tasks.workunit.client.0.smithi099.stdout:0/36: mkdir d1/d8/df 0 2024-01-31T05:13:07.732 INFO:tasks.workunit.client.0.smithi099.stdout:7/29: mkdir d6 0 2024-01-31T05:13:07.733 INFO:tasks.workunit.client.0.smithi099.stdout:0/37: truncate d1/f6 1618654 0 2024-01-31T05:13:07.735 INFO:tasks.workunit.client.0.smithi099.stdout:0/38: write d1/f4 [2154740,59827] 0 2024-01-31T05:13:07.735 INFO:tasks.workunit.client.0.smithi099.stdout:8/91: dwrite d1/f5 [0,4194304] 0 2024-01-31T05:13:07.736 INFO:tasks.workunit.client.0.smithi099.stdout:5/38: dwrite f3 [0,4194304] 0 2024-01-31T05:13:07.736 INFO:tasks.workunit.client.0.smithi099.stdout:4/52: dwrite d0/d2/f7 [0,4194304] 0 2024-01-31T05:13:07.736 INFO:tasks.workunit.client.0.smithi099.stdout:4/53: chown d0/d2/lb 49 1 2024-01-31T05:13:07.740 INFO:tasks.workunit.client.0.smithi099.stdout:5/39: unlink c2 0 2024-01-31T05:13:07.742 INFO:tasks.workunit.client.0.smithi099.stdout:4/54: symlink d0/l12 0 2024-01-31T05:13:07.743 INFO:tasks.workunit.client.0.smithi099.stdout:8/92: dread d1/f7 [0,4194304] 0 2024-01-31T05:13:07.743 INFO:tasks.workunit.client.0.smithi099.stdout:5/40: rename d6/l8 to d6/da/lb 0 2024-01-31T05:13:07.745 INFO:tasks.workunit.client.0.smithi099.stdout:7/30: truncate f3 2130270 0 2024-01-31T05:13:07.745 INFO:tasks.workunit.client.0.smithi099.stdout:0/39: dread d1/f4 [0,4194304] 0 2024-01-31T05:13:07.745 INFO:tasks.workunit.client.0.smithi099.stdout:2/47: dwrite f1 [0,4194304] 0 2024-01-31T05:13:07.747 INFO:tasks.workunit.client.0.smithi099.stdout:8/93: unlink d1/dd/d15/f17 0 2024-01-31T05:13:07.747 INFO:tasks.workunit.client.0.smithi099.stdout:8/94: creat d1/dd/d11/d19/f1f x:0 0 0 2024-01-31T05:13:07.752 INFO:tasks.workunit.client.0.smithi099.stdout:5/41: unlink d6/f7 0 2024-01-31T05:13:07.752 INFO:tasks.workunit.client.0.smithi099.stdout:4/55: dread d0/d2/f7 [0,4194304] 0 2024-01-31T05:13:07.753 INFO:tasks.workunit.client.0.smithi099.stdout:5/42: rename l5 to d6/lc 0 2024-01-31T05:13:07.755 INFO:tasks.workunit.client.0.smithi099.stdout:4/56: mkdir d0/d8/d13 0 2024-01-31T05:13:07.755 INFO:tasks.workunit.client.0.smithi099.stdout:4/57: write d0/f3 [270933,100814] 0 2024-01-31T05:13:07.755 INFO:tasks.workunit.client.0.smithi099.stdout:0/40: write d1/f6 [1859375,99378] 0 2024-01-31T05:13:07.756 INFO:tasks.workunit.client.0.smithi099.stdout:4/58: symlink d0/d8/l14 0 2024-01-31T05:13:07.763 INFO:tasks.workunit.client.0.smithi099.stdout:4/59: getdents d0 0 2024-01-31T05:13:07.765 INFO:tasks.workunit.client.0.smithi099.stdout:0/41: dread d1/d8/fd [0,4194304] 0 2024-01-31T05:13:07.765 INFO:tasks.workunit.client.0.smithi099.stdout:0/42: readlink d1/d8/lb 0 2024-01-31T05:13:07.766 INFO:tasks.workunit.client.0.smithi099.stdout:4/60: creat d0/d2/f15 x:0 0 0 2024-01-31T05:13:07.766 INFO:tasks.workunit.client.0.smithi099.stdout:4/61: creat d0/d8/f16 x:0 0 0 2024-01-31T05:13:07.766 INFO:tasks.workunit.client.0.smithi099.stdout:0/43: getdents d1/d8 0 2024-01-31T05:13:07.767 INFO:tasks.workunit.client.0.smithi099.stdout:0/44: write d1/f4 [1478116,28860] 0 2024-01-31T05:13:07.770 INFO:tasks.workunit.client.0.smithi099.stdout:8/95: dwrite d1/f7 [0,4194304] 0 2024-01-31T05:13:07.770 INFO:tasks.workunit.client.0.smithi099.stdout:8/96: dread - d1/dd/d11/d19/f1c zero size 2024-01-31T05:13:07.770 INFO:tasks.workunit.client.0.smithi099.stdout:8/97: stat d1/f7 0 2024-01-31T05:13:07.770 INFO:tasks.workunit.client.0.smithi099.stdout:8/98: truncate d1/dd/d11/d19/f1f 164150 0 2024-01-31T05:13:07.770 INFO:tasks.workunit.client.0.smithi099.stdout:8/99: dread - d1/dd/d11/f1b zero size 2024-01-31T05:13:07.770 INFO:tasks.workunit.client.0.smithi099.stdout:4/62: mkdir d0/d8/d13/d17 0 2024-01-31T05:13:07.770 INFO:tasks.workunit.client.0.smithi099.stdout:4/63: fdatasync d0/d2/f15 0 2024-01-31T05:13:07.771 INFO:tasks.workunit.client.0.smithi099.stdout:0/45: link d1/f4 d1/d8/df/f10 0 2024-01-31T05:13:07.772 INFO:tasks.workunit.client.0.smithi099.stdout:8/100: rmdir d1/dd 39 2024-01-31T05:13:07.774 INFO:tasks.workunit.client.0.smithi099.stdout:4/64: unlink d0/d2/f7 0 2024-01-31T05:13:07.776 INFO:tasks.workunit.client.0.smithi099.stdout:8/101: unlink d1/lc 0 2024-01-31T05:13:07.776 INFO:tasks.workunit.client.0.smithi099.stdout:8/102: dread - d1/fe zero size 2024-01-31T05:13:07.776 INFO:tasks.workunit.client.0.smithi099.stdout:8/103: dread - d1/dd/d11/f1e zero size 2024-01-31T05:13:07.783 INFO:tasks.workunit.client.0.smithi099.stdout:5/43: dwrite f3 [0,4194304] 0 2024-01-31T05:13:07.783 INFO:tasks.workunit.client.0.smithi099.stdout:5/44: creat d6/fd x:0 0 0 2024-01-31T05:13:07.783 INFO:tasks.workunit.client.0.smithi099.stdout:5/45: chown d6/fd 244035214 1 2024-01-31T05:13:07.785 INFO:tasks.workunit.client.0.smithi099.stdout:7/31: dread f3 [0,4194304] 0 2024-01-31T05:13:07.787 INFO:tasks.workunit.client.0.smithi099.stdout:7/32: link f2 d6/f7 0 2024-01-31T05:13:07.787 INFO:tasks.workunit.client.0.smithi099.stdout:7/33: chown f2 315531 1 2024-01-31T05:13:07.791 INFO:tasks.workunit.client.0.smithi099.stdout:0/46: dread d1/f9 [0,4194304] 0 2024-01-31T05:13:07.791 INFO:tasks.workunit.client.0.smithi099.stdout:2/48: dwrite f4 [0,4194304] 0 2024-01-31T05:13:07.802 INFO:tasks.workunit.client.0.smithi099.stdout:4/65: dwrite d0/d2/f15 [0,4194304] 0 2024-01-31T05:13:07.811 INFO:tasks.workunit.client.0.smithi099.stdout:2/49: link cd ce 0 2024-01-31T05:13:07.815 INFO:tasks.workunit.client.0.smithi099.stdout:8/104: dwrite d1/f7 [4194304,4194304] 0 2024-01-31T05:13:07.816 INFO:tasks.workunit.client.0.smithi099.stdout:5/46: dwrite f3 [0,4194304] 0 2024-01-31T05:13:07.817 INFO:tasks.workunit.client.0.smithi099.stdout:4/66: mkdir d0/d8/d13/d18 0 2024-01-31T05:13:07.817 INFO:tasks.workunit.client.0.smithi099.stdout:8/105: dread d1/f10 [0,4194304] 0 2024-01-31T05:13:07.819 INFO:tasks.workunit.client.0.smithi099.stdout:5/47: fsync d6/fd 0 2024-01-31T05:13:07.820 INFO:tasks.workunit.client.0.smithi099.stdout:7/34: dwrite f3 [0,4194304] 0 2024-01-31T05:13:07.823 INFO:tasks.workunit.client.0.smithi099.stdout:2/50: dread f1 [4194304,4194304] 0 2024-01-31T05:13:07.823 INFO:tasks.workunit.client.0.smithi099.stdout:8/106: mkdir d1/dd/d11/d20 0 2024-01-31T05:13:07.824 INFO:tasks.workunit.client.0.smithi099.stdout:0/47: dwrite d1/f9 [0,4194304] 0 2024-01-31T05:13:07.825 INFO:tasks.workunit.client.0.smithi099.stdout:5/48: unlink d6/c9 0 2024-01-31T05:13:07.826 INFO:tasks.workunit.client.0.smithi099.stdout:8/107: dread d1/f10 [0,4194304] 0 2024-01-31T05:13:07.826 INFO:tasks.workunit.client.0.smithi099.stdout:8/108: fdatasync d1/f10 0 2024-01-31T05:13:07.827 INFO:tasks.workunit.client.0.smithi099.stdout:4/67: getdents d0/d8 0 2024-01-31T05:13:07.828 INFO:tasks.workunit.client.0.smithi099.stdout:2/51: symlink lf 0 2024-01-31T05:13:07.829 INFO:tasks.workunit.client.0.smithi099.stdout:6/38: sync 2024-01-31T05:13:07.829 INFO:tasks.workunit.client.0.smithi099.stdout:3/34: sync 2024-01-31T05:13:07.829 INFO:tasks.workunit.client.0.smithi099.stdout:9/48: sync 2024-01-31T05:13:07.829 INFO:tasks.workunit.client.0.smithi099.stdout:3/35: fsync f4 0 2024-01-31T05:13:07.829 INFO:tasks.workunit.client.0.smithi099.stdout:1/36: sync 2024-01-31T05:13:07.830 INFO:tasks.workunit.client.0.smithi099.stdout:0/48: getdents d1/d8/df 0 2024-01-31T05:13:07.831 INFO:tasks.workunit.client.0.smithi099.stdout:0/49: chown d1/f4 0 1 2024-01-31T05:13:07.831 INFO:tasks.workunit.client.0.smithi099.stdout:0/50: dread - d1/f5 zero size 2024-01-31T05:13:07.832 INFO:tasks.workunit.client.0.smithi099.stdout:8/109: mkdir d1/dd/d11/d19/d21 0 2024-01-31T05:13:07.832 INFO:tasks.workunit.client.0.smithi099.stdout:8/110: write d1/dd/d11/d19/f1c [666036,29929] 0 2024-01-31T05:13:07.832 INFO:tasks.workunit.client.0.smithi099.stdout:8/111: creat d1/dd/d15/f22 x:0 0 0 2024-01-31T05:13:07.839 INFO:tasks.workunit.client.0.smithi099.stdout:4/68: rmdir d0/d8/d13/d18 0 2024-01-31T05:13:07.840 INFO:tasks.workunit.client.0.smithi099.stdout:6/39: link l9 lb 0 2024-01-31T05:13:07.840 INFO:tasks.workunit.client.0.smithi099.stdout:6/40: write f1 [1254550,75315] 0 2024-01-31T05:13:07.840 INFO:tasks.workunit.client.0.smithi099.stdout:6/41: creat fc x:0 0 0 2024-01-31T05:13:07.840 INFO:tasks.workunit.client.0.smithi099.stdout:6/42: write fc [547467,230] 0 2024-01-31T05:13:07.842 INFO:tasks.workunit.client.0.smithi099.stdout:8/112: unlink d1/fe 0 2024-01-31T05:13:07.843 INFO:tasks.workunit.client.0.smithi099.stdout:7/35: dread f3 [0,4194304] 0 2024-01-31T05:13:07.844 INFO:tasks.workunit.client.0.smithi099.stdout:3/36: truncate f7 243613 0 2024-01-31T05:13:07.847 INFO:tasks.workunit.client.0.smithi099.stdout:8/113: creat d1/dd/d11/d20/f23 x:0 0 0 2024-01-31T05:13:07.847 INFO:tasks.workunit.client.0.smithi099.stdout:8/114: creat d1/dd/d15/f24 x:0 0 0 2024-01-31T05:13:07.852 INFO:tasks.workunit.client.0.smithi099.stdout:3/37: symlink lb 0 2024-01-31T05:13:07.859 INFO:tasks.workunit.client.0.smithi099.stdout:2/52: dread f4 [0,4194304] 0 2024-01-31T05:13:07.862 INFO:tasks.workunit.client.0.smithi099.stdout:5/49: dwrite d6/fd [0,4194304] 0 2024-01-31T05:13:07.863 INFO:tasks.workunit.client.0.smithi099.stdout:2/53: mkdir d10 0 2024-01-31T05:13:07.863 INFO:tasks.workunit.client.0.smithi099.stdout:2/54: fdatasync f8 0 2024-01-31T05:13:07.869 INFO:tasks.workunit.client.0.smithi099.stdout:0/51: dwrite d1/f9 [0,4194304] 0 2024-01-31T05:13:07.869 INFO:tasks.workunit.client.0.smithi099.stdout:0/52: getdents d1 0 2024-01-31T05:13:07.878 INFO:tasks.workunit.client.0.smithi099.stdout:2/55: creat d10/f11 x:0 0 0 2024-01-31T05:13:07.879 INFO:tasks.workunit.client.0.smithi099.stdout:4/69: dwrite d0/d8/f16 [0,4194304] 0 2024-01-31T05:13:07.880 INFO:tasks.workunit.client.0.smithi099.stdout:1/37: dwrite f1 [0,4194304] 0 2024-01-31T05:13:07.881 INFO:tasks.workunit.client.0.smithi099.stdout:8/115: dwrite d1/dd/d15/f22 [0,4194304] 0 2024-01-31T05:13:07.881 INFO:tasks.workunit.client.0.smithi099.stdout:8/116: fdatasync d1/dd/d11/f1b 0 2024-01-31T05:13:07.881 INFO:tasks.workunit.client.0.smithi099.stdout:8/117: write d1/dd/ff [6055487,31852] 0 2024-01-31T05:13:07.881 INFO:tasks.workunit.client.0.smithi099.stdout:8/118: truncate d1/dd/d15/f24 456446 0 2024-01-31T05:13:07.881 INFO:tasks.workunit.client.0.smithi099.stdout:2/56: mknod d10/c12 0 2024-01-31T05:13:07.881 INFO:tasks.workunit.client.0.smithi099.stdout:2/57: chown l6 4 1 2024-01-31T05:13:07.881 INFO:tasks.workunit.client.0.smithi099.stdout:6/43: truncate fc 215787 0 2024-01-31T05:13:07.887 INFO:tasks.workunit.client.0.smithi099.stdout:4/70: mkdir d0/d8/d19 0 2024-01-31T05:13:07.887 INFO:tasks.workunit.client.0.smithi099.stdout:1/38: mkdir d4/db 0 2024-01-31T05:13:07.887 INFO:tasks.workunit.client.0.smithi099.stdout:1/39: getdents d4/db 0 2024-01-31T05:13:07.888 INFO:tasks.workunit.client.0.smithi099.stdout:6/44: rename c4 to cd 0 2024-01-31T05:13:07.889 INFO:tasks.workunit.client.0.smithi099.stdout:4/71: symlink d0/l1a 0 2024-01-31T05:13:07.892 INFO:tasks.workunit.client.0.smithi099.stdout:8/119: rmdir d1/dd/d11 39 2024-01-31T05:13:07.892 INFO:tasks.workunit.client.0.smithi099.stdout:5/50: dwrite f3 [4194304,4194304] 0 2024-01-31T05:13:07.893 INFO:tasks.workunit.client.0.smithi099.stdout:3/38: write f0 [1820616,97696] 0 2024-01-31T05:13:07.893 INFO:tasks.workunit.client.0.smithi099.stdout:4/72: truncate d0/d2/f15 1608869 0 2024-01-31T05:13:07.894 INFO:tasks.workunit.client.0.smithi099.stdout:8/120: mknod d1/dd/d1d/c25 0 2024-01-31T05:13:07.896 INFO:tasks.workunit.client.0.smithi099.stdout:4/73: rename d0/d2/lc to d0/d8/d13/d17/l1b 0 2024-01-31T05:13:07.897 INFO:tasks.workunit.client.0.smithi099.stdout:8/121: symlink d1/dd/d11/d20/l26 0 2024-01-31T05:13:07.898 INFO:tasks.workunit.client.0.smithi099.stdout:8/122: write d1/dd/d11/f1e [695458,49897] 0 2024-01-31T05:13:07.899 INFO:tasks.workunit.client.0.smithi099.stdout:3/39: rename lb to lc 0 2024-01-31T05:13:07.899 INFO:tasks.workunit.client.0.smithi099.stdout:3/40: dread - fa zero size 2024-01-31T05:13:07.900 INFO:tasks.workunit.client.0.smithi099.stdout:0/53: dwrite d1/f6 [0,4194304] 0 2024-01-31T05:13:07.901 INFO:tasks.workunit.client.0.smithi099.stdout:8/123: link d1/dd/d11/f1e d1/dd/d15/f27 0 2024-01-31T05:13:07.904 INFO:tasks.workunit.client.0.smithi099.stdout:8/124: symlink d1/dd/d11/d20/l28 0 2024-01-31T05:13:07.908 INFO:tasks.workunit.client.0.smithi099.stdout:3/41: link l8 ld 0 2024-01-31T05:13:07.908 INFO:tasks.workunit.client.0.smithi099.stdout:2/58: dwrite f1 [8388608,4194304] 0 2024-01-31T05:13:07.911 INFO:tasks.workunit.client.0.smithi099.stdout:2/59: symlink d10/l13 0 2024-01-31T05:13:07.914 INFO:tasks.workunit.client.0.smithi099.stdout:2/60: link c5 d10/c14 0 2024-01-31T05:13:07.914 INFO:tasks.workunit.client.0.smithi099.stdout:2/61: dread - d10/f11 zero size 2024-01-31T05:13:07.915 INFO:tasks.workunit.client.0.smithi099.stdout:1/40: dwrite d4/fa [0,4194304] 0 2024-01-31T05:13:07.915 INFO:tasks.workunit.client.0.smithi099.stdout:1/41: chown d4/db 1987700 1 2024-01-31T05:13:07.917 INFO:tasks.workunit.client.0.smithi099.stdout:5/51: dread f4 [0,4194304] 0 2024-01-31T05:13:07.917 INFO:tasks.workunit.client.0.smithi099.stdout:5/52: chown f1 1059442 1 2024-01-31T05:13:07.921 INFO:tasks.workunit.client.0.smithi099.stdout:1/42: mkdir d4/dc 0 2024-01-31T05:13:07.927 INFO:tasks.workunit.client.0.smithi099.stdout:5/53: symlink d6/le 0 2024-01-31T05:13:07.927 INFO:tasks.workunit.client.0.smithi099.stdout:5/54: creat d6/ff x:0 0 0 2024-01-31T05:13:07.927 INFO:tasks.workunit.client.0.smithi099.stdout:5/55: creat d6/f10 x:0 0 0 2024-01-31T05:13:07.931 INFO:tasks.workunit.client.0.smithi099.stdout:8/125: dwrite d1/dd/d15/f22 [0,4194304] 0 2024-01-31T05:13:07.931 INFO:tasks.workunit.client.0.smithi099.stdout:4/74: write d0/fd [3244549,68953] 0 2024-01-31T05:13:07.931 INFO:tasks.workunit.client.0.smithi099.stdout:4/75: chown d0/l9 91916223 1 2024-01-31T05:13:07.931 INFO:tasks.workunit.client.0.smithi099.stdout:4/76: write d0/fd [2792567,37598] 0 2024-01-31T05:13:07.934 INFO:tasks.workunit.client.0.smithi099.stdout:3/42: rename lc to le 0 2024-01-31T05:13:07.935 INFO:tasks.workunit.client.0.smithi099.stdout:3/43: write f0 [2601583,123050] 0 2024-01-31T05:13:07.937 INFO:tasks.workunit.client.0.smithi099.stdout:0/54: truncate d1/f4 2048206 0 2024-01-31T05:13:07.938 INFO:tasks.workunit.client.0.smithi099.stdout:6/45: dwrite f7 [0,4194304] 0 2024-01-31T05:13:07.939 INFO:tasks.workunit.client.0.smithi099.stdout:2/62: getdents d10 0 2024-01-31T05:13:07.942 INFO:tasks.workunit.client.0.smithi099.stdout:5/56: truncate f1 3183265 0 2024-01-31T05:13:07.943 INFO:tasks.workunit.client.0.smithi099.stdout:5/57: creat d6/f11 x:0 0 0 2024-01-31T05:13:07.943 INFO:tasks.workunit.client.0.smithi099.stdout:5/58: write d6/f10 [560363,100277] 0 2024-01-31T05:13:07.953 INFO:tasks.workunit.client.0.smithi099.stdout:5/59: dread d6/f10 [0,4194304] 0 2024-01-31T05:13:07.954 INFO:tasks.workunit.client.0.smithi099.stdout:8/126: dwrite d1/dd/d15/f22 [0,4194304] 0 2024-01-31T05:13:07.954 INFO:tasks.workunit.client.0.smithi099.stdout:4/77: dread d0/fd [0,4194304] 0 2024-01-31T05:13:07.955 INFO:tasks.workunit.client.0.smithi099.stdout:8/127: stat d1/la 0 2024-01-31T05:13:07.955 INFO:tasks.workunit.client.0.smithi099.stdout:4/78: write d0/fd [264190,86461] 0 2024-01-31T05:13:07.955 INFO:tasks.workunit.client.0.smithi099.stdout:2/63: rename fc to d10/f15 0 2024-01-31T05:13:07.958 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-mon[36434]: pgmap v401: 97 pgs: 97 active+clean; 69 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.9 MiB/s wr, 1.96k op/s 2024-01-31T05:13:07.959 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.910+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000217a [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/ auth v303 ap=1 f(v0 m2024-01-31T05:12:56.688593+0000 34=34+0) n(v0 rc2024-01-31T05:12:56.688593+0000 b92554 35=34+1) (inest mix) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850fac580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000217a:[<0x1000000216e/netns v172>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x1000000217a:[<0x1000000216e/netns v303>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:56.688593+0000 34=34+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:56.688593+0000 b92554 35=34+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:56.688593+0000 34=34+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:56.688593+0000 b92554 35=34+1)","error_str":""},"return_code":0} 2024-01-31T05:13:07.959 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.911+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f8d [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/Makefile.inc auth v231 ap=1 s=1391 n(v0 rc2009-10-10T23:53:29.000000+0000 b1391 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851156b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f8d:[<0x1000000216e/Makefile.inc v174>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f8d:[<0x1000000216e/Makefile.inc v231>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.959 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.923+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021cb [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/test_controllers.sh auth v512 ap=1 s=6403 n(v0 rc2009-10-09T17:55:46.000000+0000 b6403 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e7bb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021cb:[<0x100000022c5/test_controllers.sh v154>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021cb:[<0x100000022c5/test_controllers.sh v512>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.959 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.923+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021fa [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/Makefile.inc auth v494 ap=1 s=1280 n(v0 rc2009-12-19T05:21:23.000000+0000 b1280 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e7bab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021fa:[<0x100000022c5/Makefile.inc v254>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021fa:[<0x100000022c5/Makefile.inc v494>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.959 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.911+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002172 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/ auth v283 ap=1 f(v0 m2024-01-31T05:12:56.653594+0000 9=9+0) n(v0 rc2024-01-31T05:12:56.653594+0000 b30349 10=9+1) (inest mix) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85100e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002172:[<0x1000000216e/sysvipc v40>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000002172:[<0x1000000216e/sysvipc v283>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:56.653594+0000 9=9+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:56.653594+0000 b30349 10=9+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:56.653594+0000 9=9+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:56.653594+0000 b30349 10=9+1)","error_str":""},"return_code":0} 2024-01-31T05:13:07.960 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.911+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002178 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/libclone/ auth v259 ap=1 f(v0 m2024-01-31T05:12:56.683593+0000 3=3+0) n(v0 rc2024-01-31T05:12:56.683593+0000 b7765 4=3+1) (inest mix) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85100eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002178:[<0x1000000216e/libclone v102>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000002178:[<0x1000000216e/libclone v259>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:56.683593+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:56.683593+0000 b7765 4=3+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:56.683593+0000 3=3+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:56.683593+0000 b7765 4=3+1)","error_str":""},"return_code":0} 2024-01-31T05:13:07.960 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.924+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000023e2 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/ auth v508 ap=1 f(v0 m2024-01-31T05:12:57.222581+0000 10=10+0) n(v0 rc2024-01-31T05:12:57.222581+0000 b51620 11=10+1) (inest mix) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e6e6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000023e2:[<0x100000022c5/cgroup_fj v152>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x100000023e2:[<0x100000022c5/cgroup_fj v508>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.222581+0000 10=10+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.222581+0000 b51620 11=10+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.222581+0000 10=10+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.222581+0000 b51620 11=10+1)","error_str":""},"return_code":0} 2024-01-31T05:13:07.960 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.924+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022c7 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memctl/ auth v510 ap=1 f(v0 m2024-01-31T05:12:57.157582+0000 6=6+0) n(v0 rc2024-01-31T05:12:57.157582+0000 b31367 7=6+1) (inest mix) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e6e6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000022c7:[<0x100000022c5/memctl v16>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x100000022c7:[<0x100000022c5/memctl v510>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.157582+0000 6=6+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.157582+0000 b31367 7=6+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.157582+0000 6=6+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.157582+0000 b31367 7=6+1)","error_str":""},"return_code":0} 2024-01-31T05:13:07.960 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.911+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002174 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns/ auth v297 ap=1 f(v0 m2024-01-31T05:12:56.660594+0000 7=7+0) n(v0 rc2024-01-31T05:12:56.660594+0000 b20218 8=7+1) (inest mix) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85100f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002174:[<0x1000000216e/mqns v58>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000002174:[<0x1000000216e/mqns v297>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:56.660594+0000 7=7+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:56.660594+0000 b20218 8=7+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:56.660594+0000 7=7+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:56.660594+0000 b20218 8=7+1)","error_str":""},"return_code":0} 2024-01-31T05:13:07.960 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.911+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f4a [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/container_test.sh auth v245 ap=1 s=1701 n(v0 rc2009-03-04T07:03:42.000000+0000 b1701 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851157080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f4a:[<0x1000000216e/container_test.sh v20>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f4a:[<0x1000000216e/container_test.sh v245>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.961 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.924+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022c9 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/ auth v460 ap=1 f(v0 m2024-01-31T05:12:57.193581+0000 16=5+11) n(v1 rc2024-01-31T05:12:57.196581+0000 b285164 56=44+12) (inest mix dirty) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | dirtyscattered=1 lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e6e7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000022c9:[<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x100000022c9:[<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.193581+0000 16=5+11)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.196581+0000 b285164 56=44+12)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.193581+0000 16=5+11)","memory_value.rstat":"n(v1 rc2024-01-31T05:12:57.196581+0000 b285164 56=44+12)","error_str":""},"return_code":0} 2024-01-31T05:13:07.961 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.925+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022e1 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl_fj/ auth{0=1} v488 ap=1 f(v0 m2024-01-31T05:12:57.199581+0000 5=5+0) n(v0 rc2024-01-31T05:12:57.199581+0000 b19390 6=5+1) (inest mix) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x56120e6e7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000022e1:[<0x100000022c5/cpuctl_fj v64>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x100000022e1:[<0x100000022c5/cpuctl_fj v488>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.199581+0000 5=5+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.199581+0000 b19390 6=5+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.199581+0000 5=5+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.199581+0000 b19390 6=5+1)","error_str":""},"return_code":0} 2024-01-31T05:13:07.961 INFO:tasks.workunit.client.0.smithi099.stdout:8/128: truncate d1/f5 2368513 0 2024-01-31T05:13:07.961 INFO:tasks.workunit.client.0.smithi099.stdout:8/129: write d1/dd/d11/d20/f23 [62028,122140] 0 2024-01-31T05:13:07.961 INFO:tasks.workunit.client.0.smithi099.stdout:8/130: dread d1/dd/d11/d19/f1f [0,4194304] 0 2024-01-31T05:13:07.962 INFO:tasks.workunit.client.0.smithi099.stdout:4/79: creat d0/d8/d19/f1c x:0 0 0 2024-01-31T05:13:07.962 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.912+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f49 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/Makefile auth v255 ap=1 s=1379 n(v0 rc2009-10-10T23:53:29.000000+0000 b1379 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851157600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f49:[<0x1000000216e/Makefile v18>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f49:[<0x1000000216e/Makefile v255>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.963 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.912+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f53 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/README auth v229 ap=1 s=3286 n(v0 rc2009-03-04T07:03:42.000000+0000 b3286 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851158100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f53:[<0x1000000216e/README v42>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f53:[<0x1000000216e/README v229>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.963 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.912+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f7e [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/crtchild_delchild.c auth v110 ap=1 s=1784 n(v0 rc2009-10-09T17:55:46.000000+0000 b1784 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851136100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f7e:[<0x1000000217a/crtchild_delchild.c v40>,<0x1000000216e/netns v172>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f7e:[<0x1000000217a/crtchild_delchild.c v110>,<0x1000000216e/netns v303>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.963 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.913+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002171 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/TEST_PLAN.txt auth v199 ap=1 s=1451 n(v0 rc2024-01-31T05:12:56.649594+0000 b1451 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851157b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002171:[<0x1000000216e/TEST_PLAN.txt v16>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002171:[<0x1000000216e/TEST_PLAN.txt v199>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.963 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.913+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f7f [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/runallnetworktests_parent.sh auth v86 ap=1 s=1778 n(v0 rc2008-12-30T06:18:30.000000+0000 b1778 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851136680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f7f:[<0x1000000217a/runallnetworktests_parent.sh v42>,<0x1000000216e/netns v172>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f7f:[<0x1000000217a/runallnetworktests_parent.sh v86>,<0x1000000216e/netns v303>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.963 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.913+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f7b [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/child_1.sh auth v118 ap=1 s=3166 n(v0 rc2009-07-08T17:53:47.000000+0000 b3166 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851136c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f7b:[<0x1000000217a/child_1.sh v34>,<0x1000000216e/netns v172>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f7b:[<0x1000000217a/child_1.sh v118>,<0x1000000216e/netns v303>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.963 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.913+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f83 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/sysfsview.c auth v130 ap=1 s=2657 n(v0 rc2009-10-09T17:55:46.000000+0000 b2657 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851137180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f83:[<0x1000000217a/sysfsview.c v50>,<0x1000000216e/netns v172>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f83:[<0x1000000217a/sysfsview.c v130>,<0x1000000216e/netns v303>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.963 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.914+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f86 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/rename_net.sh auth v112 ap=1 s=2585 n(v0 rc2009-07-08T17:53:47.000000+0000 b2585 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851137700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f86:[<0x1000000217a/rename_net.sh v56>,<0x1000000216e/netns v172>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f86:[<0x1000000217a/rename_net.sh v112>,<0x1000000216e/netns v303>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.963 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.914+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f6c [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/parent_view.sh auth v106 ap=1 s=2636 n(v0 rc2008-09-19T12:17:11.000000+0000 b2636 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85114e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f6c:[<0x1000000217a/parent_view.sh v4>,<0x1000000216e/netns v172>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f6c:[<0x1000000217a/parent_view.sh v106>,<0x1000000216e/netns v303>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.964 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.926+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000214a [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/Makefile auth v360 ap=1 s=1369 n(v0 rc2009-12-19T05:21:23.000000+0000 b1369 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e7bb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000214a:[<0x100000022c5/Makefile v52>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000214a:[<0x100000022c5/Makefile v360>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.964 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.926+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022c6 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/testplan.txt auth v396 ap=1 s=739 n(v0 rc2009-04-22T10:48:10.000000+0000 b739 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e7bbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022c6:[<0x100000022c5/testplan.txt v2>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022c6:[<0x100000022c5/testplan.txt v396>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.964 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.927+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000023e6 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/ auth{3=1} v500 ap=1 f(v0 m2024-01-31T05:12:57.238580+0000 5=2+3) n(v1 rc2024-01-31T05:12:57.242580+0000 b41319 19=15+4) (inest mix dirty) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15315 | dirtyscattered=1 lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x56120e6dd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000023e6:[<0x100000022c5/memcg v180>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x100000023e6:[<0x100000022c5/memcg v500>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.238580+0000 5=2+3)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.242580+0000 b41319 19=15+4)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.238580+0000 5=2+3)","memory_value.rstat":"n(v1 rc2024-01-31T05:12:57.242580+0000 b41319 19=15+4)","error_str":""},"return_code":0} 2024-01-31T05:13:07.964 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.927+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022e3 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/ auth{0=1} v518 ap=1 f(v0 m2024-01-31T05:12:57.204581+0000 13=13+0) n(v0 rc2024-01-31T05:12:57.204581+0000 b45000 14=13+1) (inest mix) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x56120e6e7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000022e3:[<0x100000022c5/cgroup v92>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x100000022e3:[<0x100000022c5/cgroup v518>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.204581+0000 13=13+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.204581+0000 b45000 14=13+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.204581+0000 13=13+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.204581+0000 b45000 14=13+1)","error_str":""},"return_code":0} 2024-01-31T05:13:07.964 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.928+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000023e0 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/ auth{0=1} v516 ap=1 f(v0 m2024-01-31T05:12:57.212581+0000 17=17+0) n(v0 rc2024-01-31T05:12:57.212581+0000 b139894 18=17+1) (inest mix) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x56120e6e8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000023e0:[<0x100000022c5/cpuctl v128>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x100000023e0:[<0x100000022c5/cpuctl v516>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.212581+0000 17=17+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.212581+0000 b139894 18=17+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.212581+0000 17=17+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.212581+0000 b139894 18=17+1)","error_str":""},"return_code":0} 2024-01-31T05:13:07.964 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.928+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021c1 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/README auth v356 ap=1 s=2282 n(v0 rc2009-08-26T06:19:46.000000+0000 b2282 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e7bc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021c1:[<0x100000022c5/README v130>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021c1:[<0x100000022c5/README v356>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.964 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.929+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000023e4 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuacct/ auth v462 ap=1 f(v0 m2024-01-31T05:12:57.228581+0000 6=6+0) n(v0 rc2024-01-31T05:12:57.228581+0000 b20838 7=6+1) (inest mix) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e6e9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000023e4:[<0x100000022c5/cpuacct v168>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x100000023e4:[<0x100000022c5/cpuacct v462>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.228581+0000 6=6+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.228581+0000 b20838 7=6+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.228581+0000 6=6+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.228581+0000 b20838 7=6+1)","error_str":""},"return_code":0} 2024-01-31T05:13:07.964 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.929+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000023f2 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/ auth v484 ap=1 f(v0 m2024-01-31T05:12:57.261580+0000 6=6+0) n(v0 rc2024-01-31T05:12:57.261580+0000 b15995 7=6+1) (inest lock) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e6e9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000023f2:[<0x100000022c5/io-throttle v252>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x100000023f2:[<0x100000022c5/io-throttle v484>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.261580+0000 6=6+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.261580+0000 b15995 7=6+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.261580+0000 6=6+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.261580+0000 b15995 7=6+1)","error_str":""},"return_code":0} 2024-01-31T05:13:07.965 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.915+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f8a [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/ch_ftp.sh auth v136 ap=1 s=2097 n(v0 rc2008-09-19T12:17:10.000000+0000 b2097 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85114eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f8a:[<0x1000000217a/ch_ftp.sh v64>,<0x1000000216e/netns v172>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f8a:[<0x1000000217a/ch_ftp.sh v136>,<0x1000000216e/netns v303>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.965 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.915+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f7d [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/childns.sh auth v128 ap=1 s=3459 n(v0 rc2009-10-13T17:33:38.000000+0000 b3459 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85114f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f7d:[<0x1000000217a/childns.sh v38>,<0x1000000216e/netns v172>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f7d:[<0x1000000217a/childns.sh v128>,<0x1000000216e/netns v303>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.965 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.915+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f76 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/parent_share.sh auth v126 ap=1 s=2323 n(v0 rc2008-11-25T13:44:58.000000+0000 b2323 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85114e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f76:[<0x1000000217a/parent_share.sh v24>,<0x1000000216e/netns v172>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f76:[<0x1000000217a/parent_share.sh v126>,<0x1000000216e/netns v303>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.965 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.916+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f6d [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/parentns.sh auth v70 ap=1 s=3692 n(v0 rc2009-07-08T17:53:47.000000+0000 b3692 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85114fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f6d:[<0x1000000217a/parentns.sh v6>,<0x1000000216e/netns v172>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f6d:[<0x1000000217a/parentns.sh v70>,<0x1000000216e/netns v303>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.965 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.916+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f78 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/Makefile auth v116 ap=1 s=1973 n(v0 rc2009-10-09T17:55:46.000000+0000 b1973 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851150100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f78:[<0x1000000217a/Makefile v28>,<0x1000000216e/netns v172>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f78:[<0x1000000217a/Makefile v116>,<0x1000000216e/netns v303>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.965 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.916+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f75 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/parent.sh auth v100 ap=1 s=2111 n(v0 rc2009-07-08T17:53:47.000000+0000 b2111 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851150680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f75:[<0x1000000217a/parent.sh v22>,<0x1000000216e/netns v172>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f75:[<0x1000000217a/parent.sh v100>,<0x1000000216e/netns v303>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.965 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.917+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f74 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/parent_2.sh auth v88 ap=1 s=2398 n(v0 rc2009-07-08T17:53:47.000000+0000 b2398 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85114f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f74:[<0x1000000217a/parent_2.sh v20>,<0x1000000216e/netns v172>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f74:[<0x1000000217a/parent_2.sh v88>,<0x1000000216e/netns v303>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.965 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.917+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f6f [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/paripv6.sh auth v92 ap=1 s=3633 n(v0 rc2009-07-08T17:53:47.000000+0000 b3633 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851150c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f6f:[<0x1000000217a/paripv6.sh v10>,<0x1000000216e/netns v172>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f6f:[<0x1000000217a/paripv6.sh v92>,<0x1000000216e/netns v303>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.965 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.918+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f87 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/create_container.c auth v114 ap=1 s=2002 n(v0 rc2009-10-09T17:55:46.000000+0000 b2002 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85115c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f87:[<0x1000000217a/create_container.c v58>,<0x1000000216e/netns v172>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f87:[<0x1000000217a/create_container.c v114>,<0x1000000216e/netns v303>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.966 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.930+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000023f0 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/libcontrollers/ auth v506 ap=1 f(v0 m2024-01-31T05:12:57.257580+0000 3=3+0) n(v0 rc2024-01-31T05:12:57.257580+0000 b11106 4=3+1) (inest mix) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e6fa000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000023f0:[<0x100000022c5/libcontrollers v238>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x100000023f0:[<0x100000022c5/libcontrollers v506>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.257580+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.257580+0000 b11106 4=3+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.257580+0000 3=3+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.257580+0000 b11106 4=3+1)","error_str":""},"return_code":0} 2024-01-31T05:13:07.966 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.930+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000023ee [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/ auth v520 ap=1 f(v0 m2024-01-31T05:12:57.245580+0000 24=24+0) n(v0 rc2024-01-31T05:12:57.245580+0000 b99299 25=24+1) (inest lock) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e6fc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000023ee:[<0x100000022c5/freezer v230>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x100000023ee:[<0x100000022c5/freezer v520>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.245580+0000 24=24+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.245580+0000 b99299 25=24+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.245580+0000 24=24+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.245580+0000 b99299 25=24+1)","error_str":""},"return_code":0} 2024-01-31T05:13:07.966 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.930+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021c9 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/cgroup_fj_proc.c auth v38 ap=1 s=2634 n(v0 rc2024-01-31T05:12:57.222581+0000 b2634 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e713700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021c9:[<0x100000023e2/cgroup_fj_proc.c v18>,<0x100000022c5/cgroup_fj v152>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021c9:[<0x100000023e2/cgroup_fj_proc.c v38>,<0x100000022c5/cgroup_fj v508>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.966 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.930+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021c4 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/cgroup_fj_utility.sh auth v30 ap=1 s=12722 n(v0 rc2009-10-26T14:49:23.000000+0000 b12722 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e71a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021c4:[<0x100000023e2/cgroup_fj_utility.sh v8>,<0x100000022c5/cgroup_fj v152>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021c4:[<0x100000023e2/cgroup_fj_utility.sh v30>,<0x100000022c5/cgroup_fj v508>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.966 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.931+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021c6 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/cgroup_fj_release_agent auth v28 ap=1 s=175 n(v0 rc2009-08-26T05:42:27.000000+0000 b175 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e71a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021c6:[<0x100000023e2/cgroup_fj_release_agent v12>,<0x100000022c5/cgroup_fj v152>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021c6:[<0x100000023e2/cgroup_fj_release_agent v28>,<0x100000022c5/cgroup_fj v508>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.966 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.931+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021c5 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/Makefile auth v24 ap=1 s=1070 n(v0 rc2009-11-06T20:07:29.000000+0000 b1070 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e71ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021c5:[<0x100000023e2/Makefile v10>,<0x100000022c5/cgroup_fj v152>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021c5:[<0x100000023e2/Makefile v24>,<0x100000022c5/cgroup_fj v508>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.966 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.931+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021c7 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/cgroup_fj_testcases auth v26 ap=1 s=4596 n(v0 rc2009-08-26T05:42:27.000000+0000 b4596 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e71b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021c7:[<0x100000023e2/cgroup_fj_testcases v14>,<0x100000022c5/cgroup_fj v152>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021c7:[<0x100000023e2/cgroup_fj_testcases v26>,<0x100000022c5/cgroup_fj v508>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.966 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.931+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021c8 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/README auth v36 ap=1 s=1222 n(v0 rc2009-08-26T05:42:27.000000+0000 b1222 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e71b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021c8:[<0x100000023e2/README v16>,<0x100000022c5/cgroup_fj v152>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021c8:[<0x100000023e2/README v36>,<0x100000022c5/cgroup_fj v508>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.966 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.931+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021ca [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/cgroup_fj_function2.sh auth v40 ap=1 s=7233 n(v0 rc2009-08-26T05:42:27.000000+0000 b7233 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e71bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021ca:[<0x100000023e2/cgroup_fj_function2.sh v20>,<0x100000022c5/cgroup_fj v152>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021ca:[<0x100000023e2/cgroup_fj_function2.sh v40>,<0x100000022c5/cgroup_fj v508>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.967 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.918+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f72 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/readme auth v120 ap=1 s=996 n(v0 rc2008-12-30T06:37:00.000000+0000 b996 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851151700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f72:[<0x1000000217a/readme v16>,<0x1000000216e/netns v172>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f72:[<0x1000000217a/readme v120>,<0x1000000216e/netns v303>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.967 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.919+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f71 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/par_chld_ipv6.c auth v122 ap=1 s=3363 n(v0 rc2009-10-09T17:55:46.000000+0000 b3363 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851151180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f71:[<0x1000000217a/par_chld_ipv6.c v14>,<0x1000000216e/netns v172>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f71:[<0x1000000217a/par_chld_ipv6.c v122>,<0x1000000216e/netns v303>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.967 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.919+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f7a [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/child_2.sh auth v108 ap=1 s=2992 n(v0 rc2008-11-25T13:44:58.000000+0000 b2992 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85115c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f7a:[<0x1000000217a/child_2.sh v32>,<0x1000000216e/netns v172>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f7a:[<0x1000000217a/child_2.sh v108>,<0x1000000216e/netns v303>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.967 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.919+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f70 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/common.c auth v134 ap=1 s=4018 n(v0 rc2009-11-05T10:18:06.000000+0000 b4018 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85115cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f70:[<0x1000000217a/common.c v12>,<0x1000000216e/netns v172>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f70:[<0x1000000217a/common.c v134>,<0x1000000216e/netns v303>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.967 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.919+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f6e [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/two_children_ns.c auth v74 ap=1 s=4163 n(v0 rc2009-10-09T17:55:46.000000+0000 b4163 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85115d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f6e:[<0x1000000217a/two_children_ns.c v8>,<0x1000000216e/netns v172>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f6e:[<0x1000000217a/two_children_ns.c v74>,<0x1000000216e/netns v303>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.967 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.920+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f84 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/par_chld_ftp.c auth v78 ap=1 s=1644 n(v0 rc2009-10-09T17:55:46.000000+0000 b1644 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85115d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f84:[<0x1000000217a/par_chld_ftp.c v52>,<0x1000000216e/netns v172>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f84:[<0x1000000217a/par_chld_ftp.c v78>,<0x1000000216e/netns v303>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.967 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.920+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f82 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/par_ftp.sh auth v94 ap=1 s=2186 n(v0 rc2009-07-08T17:53:47.000000+0000 b2186 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85115db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f82:[<0x1000000217a/par_ftp.sh v48>,<0x1000000216e/netns v172>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f82:[<0x1000000217a/par_ftp.sh v94>,<0x1000000216e/netns v303>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.967 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.920+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f81 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/nw_under_ns.sh auth v80 ap=1 s=2016 n(v0 rc2009-10-13T17:33:38.000000+0000 b2016 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85115e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f81:[<0x1000000217a/nw_under_ns.sh v46>,<0x1000000216e/netns v172>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f81:[<0x1000000217a/nw_under_ns.sh v80>,<0x1000000216e/netns v303>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.967 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.921+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000217b [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/delchild.sh auth v132 ap=1 s=2998 n(v0 rc2024-01-31T05:12:56.687593+0000 b2998 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85115e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000217b:[<0x1000000217a/delchild.sh v2>,<0x1000000216e/netns v172>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000217b:[<0x1000000217a/delchild.sh v132>,<0x1000000216e/netns v303>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.968 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.932+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021c3 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/cgroup_fj_function.sh auth v32 ap=1 s=8456 n(v0 rc2009-08-27T10:02:52.000000+0000 b8456 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e71c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021c3:[<0x100000023e2/cgroup_fj_function.sh v6>,<0x100000022c5/cgroup_fj v152>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021c3:[<0x100000023e2/cgroup_fj_function.sh v32>,<0x100000022c5/cgroup_fj v508>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.968 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.932+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000023e3 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/run_cgroup_test_fj.sh auth v34 ap=1 s=4660 n(v0 rc2024-01-31T05:12:57.221581+0000 b4660 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e71c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000023e3:[<0x100000023e2/run_cgroup_test_fj.sh v2>,<0x100000022c5/cgroup_fj v152>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000023e3:[<0x100000023e2/run_cgroup_test_fj.sh v34>,<0x100000022c5/cgroup_fj v508>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.968 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.932+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021c2 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/cgroup_fj_stress.sh auth v22 ap=1 s=8852 n(v0 rc2009-08-26T05:42:27.000000+0000 b8852 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e71cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021c2:[<0x100000023e2/cgroup_fj_stress.sh v4>,<0x100000022c5/cgroup_fj v152>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021c2:[<0x100000023e2/cgroup_fj_stress.sh v22>,<0x100000022c5/cgroup_fj v508>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.968 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.932+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002127 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memctl/memctl_testplan.txt auth v22 ap=1 s=2134 n(v0 rc2008-05-26T11:30:10.000000+0000 b2134 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e71d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002127:[<0x100000022c7/memctl_testplan.txt v8>,<0x100000022c5/memctl v16>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002127:[<0x100000022c7/memctl_testplan.txt v22>,<0x100000022c5/memctl v510>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.968 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.932+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022c8 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memctl/memctl_test01.c auth v20 ap=1 s=7284 n(v0 rc2008-10-20T06:30:33.000000+0000 b7284 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e71d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022c8:[<0x100000022c7/memctl_test01.c v2>,<0x100000022c5/memctl v16>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022c8:[<0x100000022c7/memctl_test01.c v20>,<0x100000022c5/memctl v510>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.968 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.933+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002129 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memctl/myfunctions.sh auth v14 ap=1 s=4982 n(v0 rc2008-04-30T07:19:29.000000+0000 b4982 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e726000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002129:[<0x100000022c7/myfunctions.sh v12>,<0x100000022c5/memctl v16>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002129:[<0x100000022c7/myfunctions.sh v14>,<0x100000022c5/memctl v510>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.968 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.933+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002125 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memctl/Makefile auth v18 ap=1 s=1098 n(v0 rc2009-11-09T15:38:34.000000+0000 b1098 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e726580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002125:[<0x100000022c7/Makefile v4>,<0x100000022c5/memctl v16>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002125:[<0x100000022c7/Makefile v18>,<0x100000022c5/memctl v510>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.968 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.933+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002126 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memctl/README auth v24 ap=1 s=1800 n(v0 rc2008-05-28T12:13:23.000000+0000 b1800 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e726b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002126:[<0x100000022c7/README v6>,<0x100000022c5/memctl v16>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002126:[<0x100000022c7/README v24>,<0x100000022c5/memctl v510>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.968 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.933+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002128 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memctl/run_memctl_test.sh auth v16 ap=1 s=14069 n(v0 rc2009-08-25T07:48:20.000000+0000 b14069 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e727080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002128:[<0x100000022c7/run_memctl_test.sh v10>,<0x100000022c5/memctl v16>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002128:[<0x100000022c7/run_memctl_test.sh v16>,<0x100000022c5/memctl v510>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.969 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.921+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f8b [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/container_ftp.pl auth v96 ap=1 s=2692 n(v0 rc2008-09-19T12:17:10.000000+0000 b2692 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85115ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f8b:[<0x1000000217a/container_ftp.pl v66>,<0x1000000216e/netns v172>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f8b:[<0x1000000217a/container_ftp.pl v96>,<0x1000000216e/netns v303>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.969 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.922+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f80 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/initialize.sh auth v82 ap=1 s=3874 n(v0 rc2009-10-13T17:55:44.000000+0000 b3874 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851168000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f80:[<0x1000000217a/initialize.sh v44>,<0x1000000216e/netns v172>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f80:[<0x1000000217a/initialize.sh v82>,<0x1000000216e/netns v303>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.969 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.922+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f79 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/runnetnstest.sh auth v90 ap=1 s=3773 n(v0 rc2009-08-26T06:26:40.000000+0000 b3773 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85115f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f79:[<0x1000000217a/runnetnstest.sh v30>,<0x1000000216e/netns v172>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f79:[<0x1000000217a/runnetnstest.sh v90>,<0x1000000216e/netns v303>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.969 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.922+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f77 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/parent_1.sh auth v124 ap=1 s=2541 n(v0 rc2024-01-31T05:12:56.688593+0000 b2541 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85115f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f77:[<0x1000000217a/parent_1.sh v26>,<0x1000000216e/netns v172>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f77:[<0x1000000217a/parent_1.sh v124>,<0x1000000216e/netns v303>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.969 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.923+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f88 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/childipv6.sh auth v98 ap=1 s=3515 n(v0 rc2009-07-08T17:53:47.000000+0000 b3515 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851168b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f88:[<0x1000000217a/childipv6.sh v60>,<0x1000000216e/netns v172>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f88:[<0x1000000217a/childipv6.sh v98>,<0x1000000216e/netns v303>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.969 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.923+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f7c [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/child.sh auth v76 ap=1 s=2126 n(v0 rc2009-07-08T17:53:47.000000+0000 b2126 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851169080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f7c:[<0x1000000217a/child.sh v36>,<0x1000000216e/netns v172>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f7c:[<0x1000000217a/child.sh v76>,<0x1000000216e/netns v303>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.969 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.923+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f73 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/check_netns_enabled.c auth v104 ap=1 s=1516 n(v0 rc2008-09-19T12:17:10.000000+0000 b1516 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851168580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f73:[<0x1000000217a/check_netns_enabled.c v18>,<0x1000000216e/netns v172>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f73:[<0x1000000217a/check_netns_enabled.c v104>,<0x1000000216e/netns v303>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.969 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.923+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f85 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/runallnetworktests_child.sh auth v84 ap=1 s=5256 n(v0 rc2008-12-30T06:34:25.000000+0000 b5256 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851169600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f85:[<0x1000000217a/runallnetworktests_child.sh v54>,<0x1000000216e/netns v172>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f85:[<0x1000000217a/runallnetworktests_child.sh v84>,<0x1000000216e/netns v303>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.969 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.924+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f89 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/crtchild.c auth v72 ap=1 s=1626 n(v0 rc2009-10-09T17:55:46.000000+0000 b1626 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85116a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f89:[<0x1000000217a/crtchild.c v62>,<0x1000000216e/netns v172>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f89:[<0x1000000217a/crtchild.c v72>,<0x1000000216e/netns v303>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.970 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.934+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022ce [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_hotplug_test/ auth v189 ap=1 f(v0 m2024-01-31T05:12:57.171582+0000 3=3+0) n(v0 rc2024-01-31T05:12:57.171582+0000 b10437 4=3+1) (inest lock) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15315 | lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e6da580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000022ce:[<0x100000022c9/cpuset_hotplug_test v40>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x100000022ce:[<0x100000022c9/cpuset_hotplug_test v189>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.171582+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.171582+0000 b10437 4=3+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.171582+0000 3=3+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.171582+0000 b10437 4=3+1)","error_str":""},"return_code":0} 2024-01-31T05:13:07.970 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.934+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022d5 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_spread_test/ auth v195 ap=1 f(v0 m2024-01-31T05:12:57.182582+0000 3=3+0) n(v0 rc2024-01-31T05:12:57.182582+0000 b12138 4=3+1) (inest lock) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15315 | lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e760580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000022d5:[<0x100000022c9/cpuset_memory_spread_test v70>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x100000022d5:[<0x100000022c9/cpuset_memory_spread_test v195>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.182582+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.182582+0000 b12138 4=3+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.182582+0000 3=3+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.182582+0000 b12138 4=3+1)","error_str":""},"return_code":0} 2024-01-31T05:13:07.970 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.934+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022db [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_inherit_test/ auth v211 ap=1 f(v0 m2024-01-31T05:12:57.190582+0000 2=2+0) n(v0 rc2024-01-31T05:12:57.190582+0000 b6235 3=2+1) (inest lock) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15315 | lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e760b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000022db:[<0x100000022c9/cpuset_inherit_test v92>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x100000022db:[<0x100000022c9/cpuset_inherit_test v211>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.190582+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.190582+0000 b6235 3=2+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.190582+0000 2=2+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.190582+0000 b6235 3=2+1)","error_str":""},"return_code":0} 2024-01-31T05:13:07.970 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.935+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002147 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/Makefile.inc auth v179 ap=1 s=1531 n(v0 rc2009-11-30T08:41:37.000000+0000 b1531 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e761080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002147:[<0x100000022c9/Makefile.inc v102>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002147:[<0x100000022c9/Makefile.inc v179>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.971 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.935+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022d7 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_hierarchy_test/ auth v155 ap=1 f(v0 m2024-01-31T05:12:57.184582+0000 2=2+0) n(v0 rc2024-01-31T05:12:57.185582+0000 b15401 3=2+1) (inest lock) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15315 | lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e761600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000022d7:[<0x100000022c9/cpuset_hierarchy_test v76>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x100000022d7:[<0x100000022c9/cpuset_hierarchy_test v155>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.184582+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.184582+0000 b15401 3=2+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.184582+0000 2=2+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.185582+0000 b15401 3=2+1)","error_str":""},"return_code":0} 2024-01-31T05:13:07.971 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.935+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022cc [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_syscall_test/ auth v209 ap=1 f(v0 m2024-01-31T05:12:57.168582+0000 3=3+0) n(v0 rc2024-01-31T05:12:57.168582+0000 b16811 4=3+1) (inest lock) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15315 | lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e761b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000022cc:[<0x100000022c9/cpuset_syscall_test v32>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x100000022cc:[<0x100000022c9/cpuset_syscall_test v209>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.168582+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.168582+0000 b16811 4=3+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.168582+0000 3=3+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.168582+0000 b16811 4=3+1)","error_str":""},"return_code":0} 2024-01-31T05:13:07.971 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.936+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022d0 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/Makefile auth v173 ap=1 s=1334 n(v0 rc2024-01-31T05:12:57.173582+0000 b1334 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e762100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022d0:[<0x100000022c9/Makefile v42>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022d0:[<0x100000022c9/Makefile v173>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.971 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.936+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002143 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_funcs.sh auth v199 ap=1 s=6034 n(v0 rc2009-10-09T17:55:46.000000+0000 b6034 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e762680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002143:[<0x100000022c9/cpuset_funcs.sh v86>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002143:[<0x100000022c9/cpuset_funcs.sh v199>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.971 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.936+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022d1 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_load_balance_test/ auth v221 ap=1 f(v0 m2024-01-31T05:12:57.175582+0000 5=5+0) n(v0 rc2024-01-31T05:12:57.175582+0000 b29446 6=5+1) (inest lock) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15315 | lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e762c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000022d1:[<0x100000022c9/cpuset_load_balance_test v54>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x100000022d1:[<0x100000022c9/cpuset_load_balance_test v221>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.175582+0000 5=5+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.175582+0000 b29446 6=5+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.175582+0000 5=5+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.175582+0000 b29446 6=5+1)","error_str":""},"return_code":0} 2024-01-31T05:13:07.971 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.937+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022ca [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/ auth v215 ap=1 f(v0 m2024-01-31T05:12:57.162582+0000 11=11+0) n(v0 rc2024-01-31T05:12:57.162582+0000 b157769 12=11+1) (inest lock) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15315 | lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e763180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000022ca:[<0x100000022c9/cpuset_lib v24>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x100000022ca:[<0x100000022c9/cpuset_lib v215>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.162582+0000 11=11+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.162582+0000 b157769 12=11+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.162582+0000 11=11+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.162582+0000 b157769 12=11+1)","error_str":""},"return_code":0} 2024-01-31T05:13:07.971 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.937+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002142 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/run_cpuset_test.sh auth v201 ap=1 s=6023 n(v0 rc2009-05-11T10:02:46.000000+0000 b6023 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e763700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002142:[<0x100000022c9/run_cpuset_test.sh v84>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002142:[<0x100000022c9/run_cpuset_test.sh v201>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.971 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.937+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022d9 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_base_ops_test/ auth v207 ap=1 f(v0 m2024-01-31T05:12:57.187582+0000 2=2+0) n(v0 rc2024-01-31T05:12:57.187582+0000 b7740 3=2+1) (inest lock) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15315 | lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e780000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000022d9:[<0x100000022c9/cpuset_base_ops_test v82>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x100000022d9:[<0x100000022c9/cpuset_base_ops_test v207>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.187582+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.187582+0000 b7740 3=2+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.187582+0000 2=2+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.187582+0000 b7740 3=2+1)","error_str":""},"return_code":0} 2024-01-31T05:13:07.971 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.937+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000213c [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/README auth v175 ap=1 s=2830 n(v0 rc2009-05-11T10:02:46.000000+0000 b2830 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e780580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000213c:[<0x100000022c9/README v56>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000213c:[<0x100000022c9/README v175>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.971 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.938+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022df [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_test/ auth v205 ap=1 f(v0 m2024-01-31T05:12:57.196581+0000 3=3+0) n(v0 rc2024-01-31T05:12:57.196581+0000 b30278 4=3+1) (inest lock) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15315 | lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e780b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000022df:[<0x100000022c9/cpuset_memory_test v110>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x100000022df:[<0x100000022c9/cpuset_memory_test v205>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.196581+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.196581+0000 b30278 4=3+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.196581+0000 3=3+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.196581+0000 b30278 4=3+1)","error_str":""},"return_code":0} 2024-01-31T05:13:07.971 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.938+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022d3 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_exclusive_test/ auth v219 ap=1 f(v0 m2024-01-31T05:12:57.179582+0000 2=2+0) n(v0 rc2024-01-31T05:12:57.179582+0000 b8792 3=2+1) (inest lock) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15315 | lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e781080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000022d3:[<0x100000022c9/cpuset_exclusive_test v62>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x100000022d3:[<0x100000022c9/cpuset_exclusive_test v219>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.179582+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.179582+0000 b8792 3=2+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.179582+0000 2=2+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.179582+0000 b8792 3=2+1)","error_str":""},"return_code":0} 2024-01-31T05:13:07.971 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.938+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022dd [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_pressure_test/ auth v213 ap=1 f(v0 m2024-01-31T05:12:57.193581+0000 3=3+0) n(v0 rc2024-01-31T05:12:57.193581+0000 b10909 4=3+1) (inest lock) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15315 | lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e781600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000022dd:[<0x100000022c9/cpuset_memory_pressure_test v100>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x100000022dd:[<0x100000022c9/cpuset_memory_pressure_test v213>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.193581+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.193581+0000 b10909 4=3+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.193581+0000 3=3+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.193581+0000 b10909 4=3+1)","error_str":""},"return_code":0} 2024-01-31T05:13:07.972 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.938+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000214d [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl_fj/run_cpuctl_test_fj.sh auth v12 ap=1 s=12264 n(v0 rc2009-11-16T07:40:40.000000+0000 b12264 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e727600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000214d:[<0x100000022e1/run_cpuctl_test_fj.sh v8>,<0x100000022c5/cpuctl_fj v64>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000214d:[<0x100000022e1/run_cpuctl_test_fj.sh v12>,<0x100000022c5/cpuctl_fj v488>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.972 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.938+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000214b [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl_fj/Makefile auth v16 ap=1 s=1087 n(v0 rc2009-11-06T20:07:29.000000+0000 b1087 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e727b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000214b:[<0x100000022e1/Makefile v4>,<0x100000022c5/cpuctl_fj v64>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000214b:[<0x100000022e1/Makefile v16>,<0x100000022c5/cpuctl_fj v488>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.972 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.938+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000214c [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl_fj/README auth v20 ap=1 s=912 n(v0 rc2009-07-30T17:27:58.000000+0000 b912 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e728680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000214c:[<0x100000022e1/README v6>,<0x100000022c5/cpuctl_fj v64>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000214c:[<0x100000022e1/README v20>,<0x100000022c5/cpuctl_fj v488>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.972 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.939+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000214e [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl_fj/cpuctl_fj_cpu-hog.c auth v18 ap=1 s=2512 n(v0 rc2009-07-30T17:27:58.000000+0000 b2512 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e728c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000214e:[<0x100000022e1/cpuctl_fj_cpu-hog.c v10>,<0x100000022c5/cpuctl_fj v64>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000214e:[<0x100000022e1/cpuctl_fj_cpu-hog.c v18>,<0x100000022c5/cpuctl_fj v488>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.972 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.924+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f52 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/semtest_2ns.c auth v26 ap=1 s=6105 n(v0 rc2009-01-27T14:23:30.000000+0000 b6105 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85117fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f52:[<0x10000002172/semtest_2ns.c v18>,<0x1000000216e/sysvipc v40>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f52:[<0x10000002172/semtest_2ns.c v26>,<0x1000000216e/sysvipc v283>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.972 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.924+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f8c [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/child_propagate.sh auth v102 ap=1 s=2965 n(v0 rc2008-09-19T12:17:10.000000+0000 b2965 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851169b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f8c:[<0x1000000217a/child_propagate.sh v68>,<0x1000000216e/netns v172>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f8c:[<0x1000000217a/child_propagate.sh v102>,<0x1000000216e/netns v303>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.972 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.924+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f51 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/runipcnstest.sh auth v22 ap=1 s=2422 n(v0 rc2009-01-27T14:26:21.000000+0000 b2422 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851180100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f51:[<0x10000002172/runipcnstest.sh v16>,<0x1000000216e/sysvipc v40>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f51:[<0x10000002172/runipcnstest.sh v22>,<0x1000000216e/sysvipc v283>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.972 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.925+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f4d [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/shmnstest.c auth v30 ap=1 s=3805 n(v0 rc2009-06-09T16:01:20.000000+0000 b3805 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851180680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f4d:[<0x10000002172/shmnstest.c v8>,<0x1000000216e/sysvipc v40>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f4d:[<0x10000002172/shmnstest.c v30>,<0x1000000216e/sysvipc v283>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.973 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.925+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002173 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/mesgq_nstest.c auth v32 ap=1 s=4279 n(v0 rc2024-01-31T05:12:56.652594+0000 b4279 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851180c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002173:[<0x10000002172/mesgq_nstest.c v2>,<0x1000000216e/sysvipc v40>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002173:[<0x10000002172/mesgq_nstest.c v32>,<0x1000000216e/sysvipc v283>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.973 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.925+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f4c [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/runtests_noltp.sh auth v34 ap=1 s=1762 n(v0 rc2007-12-28T09:48:30.000000+0000 b1762 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851181180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f4c:[<0x10000002172/runtests_noltp.sh v6>,<0x1000000216e/sysvipc v40>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f4c:[<0x10000002172/runtests_noltp.sh v34>,<0x1000000216e/sysvipc v283>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.973 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.926+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f4e [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/Makefile auth v28 ap=1 s=1736 n(v0 rc2024-01-31T05:12:56.653594+0000 b1736 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851181700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f4e:[<0x10000002172/Makefile v10>,<0x1000000216e/sysvipc v40>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f4e:[<0x10000002172/Makefile v28>,<0x1000000216e/sysvipc v283>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.973 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.926+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f50 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/sem_nstest.c auth v36 ap=1 s=4046 n(v0 rc2009-01-22T10:10:37.000000+0000 b4046 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851188000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f50:[<0x10000002172/sem_nstest.c v14>,<0x1000000216e/sysvipc v40>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f50:[<0x10000002172/sem_nstest.c v36>,<0x1000000216e/sysvipc v283>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.973 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.939+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022e2 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl_fj/cpuctl_fj_simple_echo.c auth v14 ap=1 s=2615 n(v0 rc2024-01-31T05:12:57.199581+0000 b2615 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e728100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022e2:[<0x100000022e1/cpuctl_fj_simple_echo.c v2>,<0x100000022c5/cpuctl_fj v64>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022e2:[<0x100000022e1/cpuctl_fj_simple_echo.c v14>,<0x100000022c5/cpuctl_fj v488>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.973 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.940+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000023e9 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/Makefile auth v57 ap=1 s=1033 n(v0 rc2024-01-31T05:12:57.236581+0000 b1033 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e7bc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000023e9:[<0x100000023e6/Makefile v16>,<0x100000022c5/memcg v180>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000023e9:[<0x100000023e6/Makefile v57>,<0x100000022c5/memcg v500>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.973 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.940+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000023e7 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/regression/ auth v63 ap=1 f(v0 m2024-01-31T05:12:57.233581+0000 6=6+0) n(v0 rc2024-01-31T05:12:57.233581+0000 b16945 7=6+1) (inest lock) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e6dd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000023e7:[<0x100000023e6/regression v14>,<0x100000022c5/memcg v180>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x100000023e7:[<0x100000023e6/regression v63>,<0x100000022c5/memcg v500>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.233581+0000 6=6+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.233581+0000 b16945 7=6+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.233581+0000 6=6+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.233581+0000 b16945 7=6+1)","error_str":""},"return_code":0} 2024-01-31T05:13:07.973 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.940+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021d9 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/README auth v67 ap=1 s=1367 n(v0 rc2009-09-14T07:14:25.000000+0000 b1367 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e7bcc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021d9:[<0x100000023e6/README v28>,<0x100000022c5/memcg v180>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021d9:[<0x100000023e6/README v67>,<0x100000022c5/memcg v500>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.973 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.941+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000023ea [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/functional/ auth v65 ap=1 f(v0 m2024-01-31T05:12:57.238580+0000 4=4+0) n(v0 rc2024-01-31T05:12:57.238580+0000 b21974 5=4+1) (inest lock) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e6e6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000023ea:[<0x100000023e6/functional v26>,<0x100000022c5/memcg v180>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x100000023ea:[<0x100000023e6/functional v65>,<0x100000022c5/memcg v500>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.238580+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.238580+0000 b21974 5=4+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.238580+0000 4=4+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.238580+0000 b21974 5=4+1)","error_str":""},"return_code":0} 2024-01-31T05:13:07.974 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.941+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002159 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/getdelays.c auth v40 ap=1 s=12667 n(v0 rc2009-10-17T06:53:58.000000+0000 b12667 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e729180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002159:[<0x100000022e3/getdelays.c v24>,<0x100000022c5/cgroup v92>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002159:[<0x100000022e3/getdelays.c v40>,<0x100000022c5/cgroup v518>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.974 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.942+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002157 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_10_2.sh auth v44 ap=1 s=1832 n(v0 rc2009-04-22T10:37:22.000000+0000 b1832 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e738000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002157:[<0x100000022e3/test_10_2.sh v20>,<0x100000022c5/cgroup v92>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002157:[<0x100000022e3/test_10_2.sh v44>,<0x100000022c5/cgroup v518>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.974 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.942+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002153 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_10_1.sh auth v52 ap=1 s=1898 n(v0 rc2009-04-22T10:37:22.000000+0000 b1898 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e729700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002153:[<0x100000022e3/test_10_1.sh v12>,<0x100000022c5/cgroup v92>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002153:[<0x100000022e3/test_10_1.sh v52>,<0x100000022c5/cgroup v518>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.974 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.942+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002154 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_6_2.c auth v34 ap=1 s=2041 n(v0 rc2009-11-03T20:07:35.000000+0000 b2041 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e738580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002154:[<0x100000022e3/test_6_2.c v14>,<0x100000022c5/cgroup v92>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002154:[<0x100000022e3/test_6_2.c v34>,<0x100000022c5/cgroup v518>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.974 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.926+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f4f [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/check_ipcns_enabled.c auth v24 ap=1 s=1236 n(v0 rc2009-11-03T20:07:35.000000+0000 b1236 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851188580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f4f:[<0x10000002172/check_ipcns_enabled.c v12>,<0x1000000216e/sysvipc v40>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f4f:[<0x10000002172/check_ipcns_enabled.c v24>,<0x1000000216e/sysvipc v283>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.974 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.926+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002179 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/libclone/Makefile auth v10 ap=1 s=1676 n(v0 rc2024-01-31T05:12:56.683593+0000 b1676 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851189080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002179:[<0x10000002178/Makefile v2>,<0x1000000216e/libclone v102>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002179:[<0x10000002178/Makefile v10>,<0x1000000216e/libclone v259>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.974 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.926+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f4b [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/shmem_2nstest.c auth v20 ap=1 s=4958 n(v0 rc2009-01-27T14:26:21.000000+0000 b4958 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851188b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f4b:[<0x10000002172/shmem_2nstest.c v4>,<0x1000000216e/sysvipc v40>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f4b:[<0x10000002172/shmem_2nstest.c v20>,<0x1000000216e/sysvipc v283>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.974 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.927+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f6a [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/libclone/libclone.c auth v8 ap=1 s=3382 n(v0 rc2009-12-06T20:55:16.000000+0000 b3382 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851189b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f6a:[<0x10000002178/libclone.c v4>,<0x1000000216e/libclone v102>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f6a:[<0x10000002178/libclone.c v8>,<0x1000000216e/libclone v259>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.974 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.927+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f6b [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/libclone/libclone.h auth v12 ap=1 s=2707 n(v0 rc2009-11-16T08:41:06.000000+0000 b2707 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851189600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f6b:[<0x10000002178/libclone.h v6>,<0x1000000216e/libclone v102>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f6b:[<0x10000002178/libclone.h v12>,<0x1000000216e/libclone v259>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.974 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.927+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f59 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns/mqns_01.c auth v24 ap=1 s=3554 n(v0 rc2009-11-14T23:58:26.000000+0000 b3554 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85118ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f59:[<0x10000002174/mqns_01.c v14>,<0x1000000216e/mqns v58>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f59:[<0x10000002174/mqns_01.c v24>,<0x1000000216e/mqns v297>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.975 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.928+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002175 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns/runmqnstest.sh auth v22 ap=1 s=1874 n(v0 rc2024-01-31T05:12:56.660594+0000 b1874 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85118a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002175:[<0x10000002174/runmqnstest.sh v2>,<0x1000000216e/mqns v58>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002175:[<0x10000002174/runmqnstest.sh v22>,<0x1000000216e/mqns v297>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.975 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.928+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f58 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns/mqns_04.c auth v28 ap=1 s=3937 n(v0 rc2009-11-14T23:58:26.000000+0000 b3937 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85118a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f58:[<0x10000002174/mqns_04.c v12>,<0x1000000216e/mqns v58>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f58:[<0x10000002174/mqns_04.c v28>,<0x1000000216e/mqns v297>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.975 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.928+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f56 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns/mqns_02.c auth v16 ap=1 s=4214 n(v0 rc2009-11-14T23:58:26.000000+0000 b4214 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85118b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f56:[<0x10000002174/mqns_02.c v8>,<0x1000000216e/mqns v58>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f56:[<0x10000002174/mqns_02.c v16>,<0x1000000216e/mqns v297>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.975 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.943+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002152 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/Makefile auth v36 ap=1 s=1067 n(v0 rc2009-10-10T23:53:29.000000+0000 b1067 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e739b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002152:[<0x100000022e3/Makefile v10>,<0x100000022c5/cgroup v92>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002152:[<0x100000022e3/Makefile v36>,<0x100000022c5/cgroup v518>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.975 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.944+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022e4 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_9_2.sh auth v50 ap=1 s=1888 n(v0 rc2024-01-31T05:12:57.204581+0000 b1888 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e738b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022e4:[<0x100000022e3/test_9_2.sh v2>,<0x100000022c5/cgroup v92>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022e4:[<0x100000022e3/test_9_2.sh v50>,<0x100000022c5/cgroup v518>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.975 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.944+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002156 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_6_1.sh auth v46 ap=1 s=1876 n(v0 rc2009-04-22T10:37:22.000000+0000 b1876 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e739080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002156:[<0x100000022e3/test_6_1.sh v18>,<0x100000022c5/cgroup v92>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002156:[<0x100000022e3/test_6_1.sh v46>,<0x100000022c5/cgroup v518>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.975 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.944+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000214f [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/fork_processes.c auth v48 ap=1 s=2046 n(v0 rc2009-04-22T10:37:22.000000+0000 b2046 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e739600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000214f:[<0x100000022e3/fork_processes.c v4>,<0x100000022c5/cgroup v92>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000214f:[<0x100000022e3/fork_processes.c v48>,<0x100000022c5/cgroup v518>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.975 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.944+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002151 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_3_1.sh auth v28 ap=1 s=1785 n(v0 rc2009-04-22T10:37:22.000000+0000 b1785 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e73a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002151:[<0x100000022e3/test_3_1.sh v8>,<0x100000022c5/cgroup v92>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002151:[<0x100000022e3/test_3_1.sh v28>,<0x100000022c5/cgroup v518>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.976 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.945+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000215a [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/cgroup_regression_test.sh auth v32 ap=1 s=13974 n(v0 rc2009-12-23T00:52:18.000000+0000 b13974 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e73b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000215a:[<0x100000022e3/cgroup_regression_test.sh v26>,<0x100000022c5/cgroup v92>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000215a:[<0x100000022e3/cgroup_regression_test.sh v32>,<0x100000022c5/cgroup v518>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.976 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.945+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002150 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_3_2.sh auth v38 ap=1 s=1788 n(v0 rc2009-04-22T10:37:22.000000+0000 b1788 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e73a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002150:[<0x100000022e3/test_3_2.sh v6>,<0x100000022c5/cgroup v92>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002150:[<0x100000022e3/test_3_2.sh v38>,<0x100000022c5/cgroup v518>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.976 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.945+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002155 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/README auth v42 ap=1 s=207 n(v0 rc2009-04-22T10:37:22.000000+0000 b207 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e73ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002155:[<0x100000022e3/README v16>,<0x100000022c5/cgroup v92>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002155:[<0x100000022e3/README v42>,<0x100000022c5/cgroup v518>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.976 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.945+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021c0 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_def_task01.c auth v54 ap=1 s=9409 n(v0 rc2009-09-09T17:42:56.000000+0000 b9409 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e33e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021c0:[<0x100000023e0/cpuctl_def_task01.c v34>,<0x100000022c5/cpuctl v128>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021c0:[<0x100000023e0/cpuctl_def_task01.c v54>,<0x100000022c5/cpuctl v516>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.976 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.928+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f57 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns/mqns.h auth v26 ap=1 s=295 n(v0 rc2009-11-14T23:58:26.000000+0000 b295 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85118b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f57:[<0x10000002174/mqns.h v10>,<0x1000000216e/mqns v58>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f57:[<0x10000002174/mqns.h v26>,<0x1000000216e/mqns v297>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.976 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.929+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f55 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns/Makefile auth v20 ap=1 s=1832 n(v0 rc2009-11-14T23:58:26.000000+0000 b1832 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85118e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f55:[<0x10000002174/Makefile v6>,<0x1000000216e/mqns v58>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f55:[<0x10000002174/Makefile v20>,<0x1000000216e/mqns v297>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.976 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.929+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f54 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns/mqns_03.c auth v18 ap=1 s=4512 n(v0 rc2009-11-14T23:58:26.000000+0000 b4512 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85118e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f54:[<0x10000002174/mqns_03.c v4>,<0x1000000216e/mqns v58>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f54:[<0x10000002174/mqns_03.c v18>,<0x1000000216e/mqns v297>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.976 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.929+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002416 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/ auth{0=1} v291 ap=1 f(v0 m2024-01-31T05:12:57.349578+0000 10=10+0) n(v0 rc2024-01-31T05:12:57.349578+0000 b28501 11=10+1) (inest mix) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55e850fa0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002416:[<0x10000002406/cap_bound v72>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000002416:[<0x10000002406/cap_bound v291>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.349578+0000 10=10+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.349578+0000 b28501 11=10+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.349578+0000 10=10+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.349578+0000 b28501 11=10+1)","error_str":""},"return_code":0} 2024-01-31T05:13:07.976 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.930+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002415 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/Makefile auth v193 ap=1 s=1375 n(v0 rc2024-01-31T05:12:57.347578+0000 b1375 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851190680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002415:[<0x10000002406/Makefile v50>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002415:[<0x10000002406/Makefile v193>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.977 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.930+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002407 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/ auth{0=1} v289 ap=1 f(v0 m2024-01-31T05:12:57.320579+0000 14=14+0) n(v0 rc2024-01-31T05:12:57.320579+0000 b16306 15=14+1) (inest mix) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55e850fa0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002407:[<0x10000002406/smack v30>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000002407:[<0x10000002406/smack v289>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.320579+0000 14=14+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.320579+0000 b16306 15=14+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.320579+0000 14=14+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.320579+0000 b16306 15=14+1)","error_str":""},"return_code":0} 2024-01-31T05:13:07.977 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.931+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000240b [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ auth{0=1} v191 ap=1 f(v0 m2024-01-31T05:12:57.342578+0000 2=1+1) n(v2 rc2024-01-31T05:12:57.346578+0000 b2072 21=16+5) (inest mix dirty) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | dirtyscattered=1 lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55e850fa1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000240b:[<0x10000002406/integrity v48>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x1000000240b:[<0x10000002406/integrity v191>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.342578+0000 2=1+1)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.346578+0000 b2072 21=16+5)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.342578+0000 2=1+1)","memory_value.rstat":"n(v2 rc2024-01-31T05:12:57.346578+0000 b2072 21=16+5)","error_str":""},"return_code":0} 2024-01-31T05:13:07.977 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.932+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000256c [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/tomoyo/ auth{0=1} v253 ap=1 f(v0 m2024-01-31T05:12:57.731569+0000 6=6+0) n(v0 rc2024-01-31T05:12:57.731569+0000 b40472 7=6+1) (inest mix) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55e850fa1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000256c:[<0x10000002406/tomoyo v100>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x1000000256c:[<0x10000002406/tomoyo v253>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.731569+0000 6=6+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.731569+0000 b40472 7=6+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.731569+0000 6=6+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.731569+0000 b40472 7=6+1)","error_str":""},"return_code":0} 2024-01-31T05:13:07.977 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.933+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002418 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/ auth{0=1,1=1,4=1} v297 ap=1 f(v0 m2024-01-31T05:12:57.727569+0000 6=3+3) n(v2 rc2024-01-31T05:12:57.727569+0000 b330571 307=262+45) (inest mix dirty) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15315 | dirtyscattered=1 lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55e850f48580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002418:[<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000002418:[<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.727569+0000 6=3+3)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.727569+0000 b330571 307=262+45)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.727569+0000 6=3+3)","memory_value.rstat":"n(v2 rc2024-01-31T05:12:57.727569+0000 b330571 307=262+45)","error_str":""},"return_code":0} 2024-01-31T05:13:07.977 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.946+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000215c [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/parameters.sh auth v60 ap=1 s=5946 n(v0 rc2009-11-02T13:53:21.000000+0000 b5946 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e33eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000215c:[<0x100000023e0/parameters.sh v6>,<0x100000022c5/cpuctl v128>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000215c:[<0x100000023e0/parameters.sh v60>,<0x100000022c5/cpuctl v516>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.978 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.946+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002158 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_9_1.sh auth v30 ap=1 s=1931 n(v0 rc2009-04-22T10:37:22.000000+0000 b1931 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e73b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002158:[<0x100000022e3/test_9_1.sh v22>,<0x100000022c5/cgroup v92>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002158:[<0x100000022e3/test_9_1.sh v30>,<0x100000022c5/cgroup v518>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.978 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.946+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021be [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_latency_check_task.c auth v46 ap=1 s=6245 n(v0 rc2009-03-09T10:58:45.000000+0000 b6245 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e33f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021be:[<0x100000023e0/cpuctl_latency_check_task.c v30>,<0x100000022c5/cpuctl v128>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021be:[<0x100000023e0/cpuctl_latency_check_task.c v46>,<0x100000022c5/cpuctl v516>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.978 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.947+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000023ec [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/stress/ auth{3=1} v69 ap=2 RANDEPHEMERALPIN f(v0 m2024-01-31T05:12:57.242580+0000 3=3+0) n(v1 rc2024-01-31T05:12:57.242580+0000 b7936 4=3+1) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15315=pAsLsXsFs/pAsLsXsFsxcral@2} | dirtyscattered=0 lock=3 importingcaps=0 dirfrag=1 caps=1 stickydirs=0 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 randepin 0x56120e7ba000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000023ec:[<0x100000023e6/stress v36>,<0x100000022c5/memcg v180>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x100000023ec:[<0x100000023e6/stress v39>,<0x100000022c5/memcg v500>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.242580+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.242580+0000 4=3+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.242580+0000 3=3+0)","memory_value.rstat":"n(v1 rc2024-01-31T05:12:57.242580+0000 b7936 4=3+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-01-31T05:13:07.978 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.947+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000215d [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_def_task04.c auth v64 ap=1 s=9643 n(v0 rc2009-09-09T17:42:56.000000+0000 b9643 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e33f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000215d:[<0x100000023e0/cpuctl_def_task04.c v8>,<0x100000022c5/cpuctl v128>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000215d:[<0x100000023e0/cpuctl_def_task04.c v64>,<0x100000022c5/cpuctl v516>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.978 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.948+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021ba [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/run_cpuctl_test.sh auth v66 ap=1 s=10895 n(v0 rc2008-11-25T15:34:07.000000+0000 b10895 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e33fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021ba:[<0x100000023e0/run_cpuctl_test.sh v22>,<0x100000022c5/cpuctl v128>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021ba:[<0x100000023e0/run_cpuctl_test.sh v66>,<0x100000022c5/cpuctl v516>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.978 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.948+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021bd [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/run_cpuctl_stress_test.sh auth v40 ap=1 s=13049 n(v0 rc2008-11-25T15:43:07.000000+0000 b13049 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e340100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021bd:[<0x100000023e0/run_cpuctl_stress_test.sh v28>,<0x100000022c5/cpuctl v128>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021bd:[<0x100000023e0/run_cpuctl_stress_test.sh v40>,<0x100000022c5/cpuctl v516>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.978 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.948+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021b5 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_test02.c auth v62 ap=1 s=10864 n(v0 rc2009-09-09T17:42:56.000000+0000 b10864 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e340680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021b5:[<0x100000023e0/cpuctl_test02.c v12>,<0x100000022c5/cpuctl v128>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021b5:[<0x100000023e0/cpuctl_test02.c v62>,<0x100000022c5/cpuctl v516>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.978 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.934+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002570 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/ auth{0=1} v283 ap=1 f(v0 m2024-01-31T05:12:57.743569+0000 9=9+0) n(v0 rc2024-01-31T05:12:57.743569+0000 b34787 10=9+1) (inest mix) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55e850fa1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002570:[<0x10000002406/mmc_security v140>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000002570:[<0x10000002406/mmc_security v283>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.743569+0000 9=9+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.743569+0000 b34787 10=9+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.743569+0000 9=9+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.743569+0000 b34787 10=9+1)","error_str":""},"return_code":0} 2024-01-31T05:13:07.979 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.935+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002409 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/p9auth/ auth{0=1} v293 ap=1 f(v0 m2024-01-31T05:12:57.328578+0000 5=5+0) n(v0 rc2024-01-31T05:12:57.328578+0000 b11383 6=5+1) (inest mix) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55e850fa2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002409:[<0x10000002406/p9auth v42>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000002409:[<0x10000002406/p9auth v293>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.328578+0000 5=5+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.328578+0000 b11383 6=5+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.328578+0000 5=5+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.328578+0000 b11383 6=5+1)","error_str":""},"return_code":0} 2024-01-31T05:13:07.979 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.935+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000256e [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/ auth{0=1} v295 ap=1 f(v0 m2024-01-31T05:12:57.736569+0000 9=9+0) n(v0 rc2024-01-31T05:12:57.736569+0000 b29257 10=9+1) (inest mix) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55e850fa2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000256e:[<0x10000002406/filecaps v120>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x1000000256e:[<0x10000002406/filecaps v295>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.736569+0000 9=9+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.736569+0000 b29257 10=9+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.736569+0000 9=9+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.736569+0000 b29257 10=9+1)","error_str":""},"return_code":0} 2024-01-31T05:13:07.979 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.936+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000216f [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/utsname/ auth{1=1} v305 ap=2 RANDEPHEMERALPIN f(v0 m2024-01-31T05:12:56.644594+0000 6=6+0) n(v1 rc2024-01-31T05:12:56.644594+0000 b17661 7=6+1) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15315=pAsLsXsFs/pAsLsXsFsxcral@2} | dirtyscattered=0 lock=3 importingcaps=0 dirfrag=1 caps=1 stickydirs=0 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 randepin 0x55e851156580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000216f:[<0x1000000216e/utsname v14>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x1000000216f:[<0x1000000216e/utsname v177>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:56.644594+0000 6=6+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:56.644594+0000 7=6+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:56.644594+0000 6=6+0)","memory_value.rstat":"n(v1 rc2024-01-31T05:12:56.644594+0000 b17661 7=6+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-01-31T05:13:07.979 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.936+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002176 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/ auth{4=1} v307 ap=2 RANDEPHEMERALPIN f(v0 m2024-01-31T05:12:56.668594+0000 17=17+0) n(v1 rc2024-01-31T05:12:56.668594+0000 b81826 18=17+1) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15315=pAsLsXsFs/pAsLsXsFsxcral@2} | dirtyscattered=0 lock=3 importingcaps=0 dirfrag=1 caps=1 stickydirs=0 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 randepin 0x55e851156000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002176:[<0x1000000216e/pidns v94>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000002176:[<0x1000000216e/pidns v179>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:56.668594+0000 17=17+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:56.668594+0000 18=17+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:56.668594+0000 17=17+0)","memory_value.rstat":"n(v1 rc2024-01-31T05:12:56.668594+0000 b81826 18=17+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-01-31T05:13:07.979 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.937+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002258 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/exec_with_inh.c auth v24 ap=1 s=3481 n(v0 rc2009-10-09T17:55:50.000000+0000 b3481 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510e5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002258:[<0x10000002416/exec_with_inh.c v8>,<0x10000002406/cap_bound v72>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002258:[<0x10000002416/exec_with_inh.c v24>,<0x10000002406/cap_bound v291>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.979 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.937+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000225b [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/cap_bset_inh_bounds.c auth v38 ap=1 s=4927 n(v0 rc2009-10-09T17:55:50.000000+0000 b4927 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510e6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000225b:[<0x10000002416/cap_bset_inh_bounds.c v14>,<0x10000002406/cap_bound v72>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000225b:[<0x10000002416/cap_bset_inh_bounds.c v38>,<0x10000002406/cap_bound v291>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.979 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.937+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002257 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/Makefile auth v28 ap=1 s=1734 n(v0 rc2009-10-09T17:55:50.000000+0000 b1734 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510e6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002257:[<0x10000002416/Makefile v6>,<0x10000002406/cap_bound v72>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002257:[<0x10000002416/Makefile v28>,<0x10000002406/cap_bound v291>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.980 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.948+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021bb [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_test04.c auth v44 ap=1 s=10112 n(v0 rc2009-09-09T17:42:56.000000+0000 b10112 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e340c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021bb:[<0x100000023e0/cpuctl_test04.c v24>,<0x100000022c5/cpuctl v128>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021bb:[<0x100000023e0/cpuctl_test04.c v44>,<0x100000022c5/cpuctl v516>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.980 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.948+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021b7 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_testplan.txt auth v68 ap=1 s=7976 n(v0 rc2009-03-09T10:58:45.000000+0000 b7976 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e341180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021b7:[<0x100000023e0/cpuctl_testplan.txt v16>,<0x100000022c5/cpuctl v128>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021b7:[<0x100000023e0/cpuctl_testplan.txt v68>,<0x100000022c5/cpuctl v516>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.980 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.949+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021b8 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_def_task03.c auth v42 ap=1 s=9546 n(v0 rc2009-09-09T17:42:56.000000+0000 b9546 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e341700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021b8:[<0x100000023e0/cpuctl_def_task03.c v18>,<0x100000022c5/cpuctl v128>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021b8:[<0x100000023e0/cpuctl_def_task03.c v42>,<0x100000022c5/cpuctl v516>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.981 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.949+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021b6 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/Makefile auth v36 ap=1 s=1179 n(v0 rc2009-10-10T23:53:29.000000+0000 b1179 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e5de000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021b6:[<0x100000023e0/Makefile v14>,<0x100000022c5/cpuctl v128>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021b6:[<0x100000023e0/Makefile v36>,<0x100000022c5/cpuctl v516>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.981 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.949+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000023e1 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_test03.c auth v58 ap=1 s=9726 n(v0 rc2024-01-31T05:12:57.211581+0000 b9726 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e5de580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000023e1:[<0x100000023e0/cpuctl_test03.c v2>,<0x100000022c5/cpuctl v128>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000023e1:[<0x100000023e0/cpuctl_test03.c v58>,<0x100000022c5/cpuctl v516>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.981 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.949+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000215b [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_latency_test.c auth v50 ap=1 s=4699 n(v0 rc2024-01-31T05:12:57.212581+0000 b4699 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e5deb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000215b:[<0x100000023e0/cpuctl_latency_test.c v4>,<0x100000022c5/cpuctl v128>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000215b:[<0x100000023e0/cpuctl_latency_test.c v50>,<0x100000022c5/cpuctl v516>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.981 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.949+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021bf [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_def_task02.c auth v38 ap=1 s=9578 n(v0 rc2009-09-09T17:42:56.000000+0000 b9578 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e5df080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021bf:[<0x100000023e0/cpuctl_def_task02.c v32>,<0x100000022c5/cpuctl v128>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021bf:[<0x100000023e0/cpuctl_def_task02.c v38>,<0x100000022c5/cpuctl v516>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.981 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.950+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021bc [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/README auth v52 ap=1 s=3163 n(v0 rc2008-02-28T15:47:56.000000+0000 b3163 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e5dfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021bc:[<0x100000023e0/README v26>,<0x100000022c5/cpuctl v128>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021bc:[<0x100000023e0/README v52>,<0x100000022c5/cpuctl v516>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.981 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.950+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000215e [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/run_cpuctl_latency_test.sh auth v56 ap=1 s=6838 n(v0 rc2009-03-09T10:58:45.000000+0000 b6838 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e5e0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000215e:[<0x100000023e0/run_cpuctl_latency_test.sh v10>,<0x100000022c5/cpuctl v128>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000215e:[<0x100000023e0/run_cpuctl_latency_test.sh v56>,<0x100000022c5/cpuctl v516>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.981 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.950+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021b9 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_test01.c auth v48 ap=1 s=11026 n(v0 rc2009-09-09T17:42:56.000000+0000 b11026 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e5df600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021b9:[<0x100000023e0/cpuctl_test01.c v20>,<0x100000022c5/cpuctl v128>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021b9:[<0x100000023e0/cpuctl_test01.c v48>,<0x100000022c5/cpuctl v516>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.981 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.950+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021cc [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuacct/run_cpuacct_test.sh auth v22 ap=1 s=11363 n(v0 rc2009-08-26T06:19:47.000000+0000 b11363 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e334000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021cc:[<0x100000023e4/run_cpuacct_test.sh v4>,<0x100000022c5/cpuacct v168>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021cc:[<0x100000023e4/run_cpuacct_test.sh v22>,<0x100000022c5/cpuacct v462>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.981 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.951+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021ce [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuacct/Makefile auth v16 ap=1 s=1068 n(v0 rc2009-11-06T20:07:29.000000+0000 b1068 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e334580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021ce:[<0x100000023e4/Makefile v8>,<0x100000022c5/cpuacct v168>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021ce:[<0x100000023e4/Makefile v16>,<0x100000022c5/cpuacct v462>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.981 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.951+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021cd [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuacct/cpuacct_task01.c auth v20 ap=1 s=121 n(v0 rc2009-08-26T06:19:47.000000+0000 b121 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e334b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021cd:[<0x100000023e4/cpuacct_task01.c v6>,<0x100000022c5/cpuacct v168>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021cd:[<0x100000023e4/cpuacct_task01.c v20>,<0x100000022c5/cpuacct v462>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.981 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.951+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000023e5 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuacct/cpuacct_setup.sh auth v14 ap=1 s=5000 n(v0 rc2024-01-31T05:12:57.228581+0000 b5000 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e335080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000023e5:[<0x100000023e4/cpuacct_setup.sh v2>,<0x100000022c5/cpuacct v168>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000023e5:[<0x100000023e4/cpuacct_setup.sh v14>,<0x100000022c5/cpuacct v462>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.981 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.951+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021cf [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuacct/README auth v24 ap=1 s=1621 n(v0 rc2009-08-26T06:19:46.000000+0000 b1621 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e335600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021cf:[<0x100000023e4/README v10>,<0x100000022c5/cpuacct v168>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021cf:[<0x100000023e4/README v24>,<0x100000022c5/cpuacct v462>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.981 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.951+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021d0 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuacct/cpuacct_testplan.txt auth v18 ap=1 s=1665 n(v0 rc2009-08-26T06:19:47.000000+0000 b1665 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e335b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021d0:[<0x100000023e4/cpuacct_testplan.txt v12>,<0x100000022c5/cpuacct v168>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021d0:[<0x100000023e4/cpuacct_testplan.txt v18>,<0x100000022c5/cpuacct v462>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.982 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.952+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021f5 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/Makefile auth v18 ap=1 s=1145 n(v0 rc2009-10-10T23:53:29.000000+0000 b1145 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e336c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021f5:[<0x100000023f2/Makefile v4>,<0x100000022c5/io-throttle v252>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021f5:[<0x100000023f2/Makefile v18>,<0x100000022c5/io-throttle v484>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.982 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.952+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000023f3 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/io_throttle_testplan.txt auth v22 ap=1 s=1531 n(v0 rc2024-01-31T05:12:57.260580+0000 b1531 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e337180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000023f3:[<0x100000023f2/io_throttle_testplan.txt v2>,<0x100000022c5/io-throttle v252>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000023f3:[<0x100000023f2/io_throttle_testplan.txt v22>,<0x100000022c5/io-throttle v484>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.982 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.952+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021f7 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/README auth v16 ap=1 s=1970 n(v0 rc2008-07-14T17:16:07.000000+0000 b1970 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e337700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021f7:[<0x100000023f2/README v8>,<0x100000022c5/io-throttle v252>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021f7:[<0x100000023f2/README v16>,<0x100000022c5/io-throttle v484>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.982 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.952+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021f9 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/iobw.c auth v14 ap=1 s=6137 n(v0 rc2008-09-24T12:55:33.000000+0000 b6137 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e33e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021f9:[<0x100000023f2/iobw.c v12>,<0x100000022c5/io-throttle v252>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021f9:[<0x100000023f2/iobw.c v14>,<0x100000022c5/io-throttle v484>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.982 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.937+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002417 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/exec_without_inh.c auth v34 ap=1 s=3351 n(v0 rc2024-01-31T05:12:57.349578+0000 b3351 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510e6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002417:[<0x10000002416/exec_without_inh.c v2>,<0x10000002406/cap_bound v72>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002417:[<0x10000002416/exec_without_inh.c v34>,<0x10000002406/cap_bound v291>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.982 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.938+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000225d [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/cap_bounds_r.c auth v30 ap=1 s=3363 n(v0 rc2009-10-09T17:55:50.000000+0000 b3363 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510e7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000225d:[<0x10000002416/cap_bounds_r.c v18>,<0x10000002406/cap_bound v72>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000225d:[<0x10000002416/cap_bounds_r.c v30>,<0x10000002406/cap_bound v291>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.983 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.953+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021f4 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/libcontrollers/Makefile auth v10 ap=1 s=1014 n(v0 rc2009-10-09T17:55:47.000000+0000 b1014 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e5e0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021f4:[<0x100000023f0/Makefile v6>,<0x100000022c5/libcontrollers v238>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021f4:[<0x100000023f0/Makefile v10>,<0x100000022c5/libcontrollers v506>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.983 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.953+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000023f1 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/libcontrollers/libcontrollers.c auth v12 ap=1 s=6576 n(v0 rc2024-01-31T05:12:57.257580+0000 b6576 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e5e1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000023f1:[<0x100000023f0/libcontrollers.c v2>,<0x100000022c5/libcontrollers v238>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000023f1:[<0x100000023f0/libcontrollers.c v12>,<0x100000022c5/libcontrollers v506>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.983 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.938+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000225c [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/check_pe.c auth v22 ap=1 s=2994 n(v0 rc2009-10-09T17:55:50.000000+0000 b2994 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510e7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000225c:[<0x10000002416/check_pe.c v16>,<0x10000002406/cap_bound v72>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000225c:[<0x10000002416/check_pe.c v22>,<0x10000002406/cap_bound v291>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.983 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.938+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002256 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/cap_bounds_rw.c auth v32 ap=1 s=4171 n(v0 rc2009-10-09T17:55:50.000000+0000 b4171 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510fa000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002256:[<0x10000002416/cap_bounds_rw.c v4>,<0x10000002406/cap_bound v72>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002256:[<0x10000002416/cap_bounds_rw.c v32>,<0x10000002406/cap_bound v291>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.984 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.953+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021f3 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/libcontrollers/libcontrollers.h auth v8 ap=1 s=3516 n(v0 rc2009-09-09T17:42:56.000000+0000 b3516 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e5e0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021f3:[<0x100000023f0/libcontrollers.h v4>,<0x100000022c5/libcontrollers v238>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021f3:[<0x100000023f0/libcontrollers.h v8>,<0x100000022c5/libcontrollers v506>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.984 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.953+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021e0 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/freeze_move_thaw.sh auth v64 ap=1 s=3749 n(v0 rc2009-02-26T07:19:31.000000+0000 b3749 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e74a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021e0:[<0x100000023ee/freeze_move_thaw.sh v12>,<0x100000022c5/freezer v230>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021e0:[<0x100000023ee/freeze_move_thaw.sh v64>,<0x100000022c5/freezer v520>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.984 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.954+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021e9 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/TODO auth v76 ap=1 s=5126 n(v0 rc2009-02-26T07:19:31.000000+0000 b5126 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e5e1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021e9:[<0x100000023ee/TODO v30>,<0x100000022c5/freezer v230>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021e9:[<0x100000023ee/TODO v76>,<0x100000022c5/freezer v520>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.985 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.938+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000225a [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/check_for_libcap.sh auth v40 ap=1 s=1836 n(v0 rc2009-04-28T07:04:41.000000+0000 b1836 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510fa580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000225a:[<0x10000002416/check_for_libcap.sh v12>,<0x10000002406/cap_bound v72>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000225a:[<0x10000002416/check_for_libcap.sh v40>,<0x10000002406/cap_bound v291>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.985 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.939+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002259 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/run_capbounds.sh auth v36 ap=1 s=2171 n(v0 rc2009-04-28T07:04:45.000000+0000 b2171 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510fab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002259:[<0x10000002416/run_capbounds.sh v10>,<0x10000002406/cap_bound v72>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002259:[<0x10000002416/run_capbounds.sh v36>,<0x10000002406/cap_bound v291>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.985 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.939+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000225e [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/dummy.c auth v26 ap=1 s=473 n(v0 rc2009-10-09T17:55:50.000000+0000 b473 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510fb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000225e:[<0x10000002416/dummy.c v20>,<0x10000002406/cap_bound v72>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000225e:[<0x10000002416/dummy.c v26>,<0x10000002406/cap_bound v291>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.986 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.954+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021e1 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/write_freezing.sh auth v70 ap=1 s=1839 n(v0 rc2009-02-26T07:19:32.000000+0000 b1839 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e74ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021e1:[<0x100000023ee/write_freezing.sh v14>,<0x100000022c5/freezer v230>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021e1:[<0x100000023ee/write_freezing.sh v70>,<0x100000022c5/freezer v520>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.986 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.954+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021dc [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/run_freezer.sh auth v60 ap=1 s=3309 n(v0 rc2024-01-31T05:12:57.245580+0000 b3309 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e74b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021dc:[<0x100000023ee/run_freezer.sh v4>,<0x100000022c5/freezer v230>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021dc:[<0x100000023ee/run_freezer.sh v60>,<0x100000022c5/freezer v520>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.986 INFO:tasks.workunit.client.0.smithi099.stdout:2/64: rmdir d10 39 2024-01-31T05:13:07.986 INFO:tasks.workunit.client.0.smithi099.stdout:3/44: dwrite f4 [0,4194304] 0 2024-01-31T05:13:07.986 INFO:tasks.workunit.client.0.smithi099.stdout:4/80: dread d0/f3 [0,4194304] 0 2024-01-31T05:13:07.986 INFO:tasks.workunit.client.0.smithi099.stdout:3/45: creat ff x:0 0 0 2024-01-31T05:13:07.986 INFO:tasks.workunit.client.0.smithi099.stdout:8/131: getdents d1/dd/d15 0 2024-01-31T05:13:07.986 INFO:tasks.workunit.client.0.smithi099.stdout:1/43: truncate f1 2647788 0 2024-01-31T05:13:07.986 INFO:tasks.workunit.client.0.smithi099.stdout:6/46: dwrite fc [0,4194304] 0 2024-01-31T05:13:07.986 INFO:tasks.workunit.client.0.smithi099.stdout:6/47: truncate fc 4967651 0 2024-01-31T05:13:07.986 INFO:tasks.workunit.client.0.smithi099.stdout:4/81: unlink d0/d8/d13/d17/l1b 0 2024-01-31T05:13:07.987 INFO:tasks.workunit.client.0.smithi099.stdout:2/65: symlink d10/l16 0 2024-01-31T05:13:07.987 INFO:tasks.workunit.client.0.smithi099.stdout:4/82: dread d0/f3 [0,4194304] 0 2024-01-31T05:13:07.987 INFO:tasks.workunit.client.0.smithi099.stdout:4/83: creat d0/d2/f1d x:0 0 0 2024-01-31T05:13:07.987 INFO:tasks.workunit.client.0.smithi099.stdout:3/46: unlink l8 0 2024-01-31T05:13:07.987 INFO:tasks.workunit.client.0.smithi099.stdout:3/47: truncate f0 4441319 0 2024-01-31T05:13:07.987 INFO:tasks.workunit.client.0.smithi099.stdout:8/132: mkdir d1/dd/d11/d29 0 2024-01-31T05:13:07.987 INFO:tasks.workunit.client.0.smithi099.stdout:5/60: rmdir d6 39 2024-01-31T05:13:07.987 INFO:tasks.workunit.client.0.smithi099.stdout:0/55: dread d1/f9 [0,4194304] 0 2024-01-31T05:13:07.987 INFO:tasks.workunit.client.0.smithi099.stdout:0/56: fsync d1/f4 0 2024-01-31T05:13:07.987 INFO:tasks.workunit.client.0.smithi099.stdout:1/44: read d4/fa [1221148,98649] 0 2024-01-31T05:13:07.987 INFO:tasks.workunit.client.0.smithi099.stdout:1/45: chown d4 26 1 2024-01-31T05:13:07.987 INFO:tasks.workunit.client.0.smithi099.stdout:8/133: dread d1/dd/d11/d19/f1c [0,4194304] 0 2024-01-31T05:13:07.987 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.939+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000223b [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_onlycap.sh auth v34 ap=1 s=882 n(v0 rc2009-10-09T17:55:52.000000+0000 b882 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510fb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000223b:[<0x10000002407/smack_set_onlycap.sh v6>,<0x10000002406/smack v30>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000223b:[<0x10000002407/smack_set_onlycap.sh v34>,<0x10000002406/smack v289>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.987 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.939+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002241 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/notroot.c auth v50 ap=1 s=571 n(v0 rc2009-03-19T07:27:05.000000+0000 b571 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510fbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002241:[<0x10000002407/notroot.c v18>,<0x10000002406/smack v30>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002241:[<0x10000002407/notroot.c v50>,<0x10000002406/smack v289>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.988 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.954+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021df [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/CHANGELOG auth v80 ap=1 s=57 n(v0 rc2009-02-26T07:19:31.000000+0000 b57 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e74a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021df:[<0x100000023ee/CHANGELOG v10>,<0x100000022c5/freezer v230>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021df:[<0x100000023ee/CHANGELOG v80>,<0x100000022c5/freezer v520>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.988 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.954+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021ee [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/libcgroup_freezer auth v52 ap=1 s=23381 n(v0 rc2009-02-26T07:19:31.000000+0000 b23381 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e74b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021ee:[<0x100000023ee/libcgroup_freezer v40>,<0x100000022c5/freezer v230>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021ee:[<0x100000023ee/libcgroup_freezer v52>,<0x100000022c5/freezer v520>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.988 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.940+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002243 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_load.sh auth v36 ap=1 s=1391 n(v0 rc2009-10-09T17:55:52.000000+0000 b1391 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510fc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002243:[<0x10000002407/smack_set_load.sh v22>,<0x10000002406/smack v30>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002243:[<0x10000002407/smack_set_load.sh v36>,<0x10000002406/smack v289>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.988 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.940+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000223e [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_doi.sh auth v56 ap=1 s=840 n(v0 rc2009-10-09T17:55:52.000000+0000 b840 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510fc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000223e:[<0x10000002407/smack_set_doi.sh v12>,<0x10000002406/smack v30>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000223e:[<0x10000002407/smack_set_doi.sh v56>,<0x10000002406/smack v289>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.989 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.955+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021e7 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/timed_forkbomb.c auth v54 ap=1 s=2240 n(v0 rc2009-02-26T07:19:31.000000+0000 b2240 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e74bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021e7:[<0x100000023ee/timed_forkbomb.c v26>,<0x100000022c5/freezer v230>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021e7:[<0x100000023ee/timed_forkbomb.c v54>,<0x100000022c5/freezer v520>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.989 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.955+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021eb [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/freeze_self_thaw.sh auth v50 ap=1 s=2696 n(v0 rc2009-02-26T07:19:31.000000+0000 b2696 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e74c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021eb:[<0x100000023ee/freeze_self_thaw.sh v34>,<0x100000022c5/freezer v230>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021eb:[<0x100000023ee/freeze_self_thaw.sh v50>,<0x100000022c5/freezer v520>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.989 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.940+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002246 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_cipso.sh auth v52 ap=1 s=1636 n(v0 rc2009-10-09T17:55:52.000000+0000 b1636 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510fd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002246:[<0x10000002407/smack_set_cipso.sh v28>,<0x10000002406/smack v30>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002246:[<0x10000002407/smack_set_cipso.sh v52>,<0x10000002406/smack v289>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.989 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.940+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000223d [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_file_access.sh auth v54 ap=1 s=2898 n(v0 rc2009-10-09T17:55:52.000000+0000 b2898 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510fcc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000223d:[<0x10000002407/smack_file_access.sh v10>,<0x10000002406/smack v30>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000223d:[<0x10000002407/smack_file_access.sh v54>,<0x10000002406/smack v289>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.990 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.955+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021e3 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/stop_freeze_thaw_cont.sh auth v58 ap=1 s=2278 n(v0 rc2009-02-26T07:19:31.000000+0000 b2278 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e74c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021e3:[<0x100000023ee/stop_freeze_thaw_cont.sh v18>,<0x100000022c5/freezer v230>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021e3:[<0x100000023ee/stop_freeze_thaw_cont.sh v58>,<0x100000022c5/freezer v520>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.990 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.955+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021ec [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/fork_exec_loop.c auth v92 ap=1 s=1244 n(v0 rc2009-02-26T07:19:31.000000+0000 b1244 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e74cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021ec:[<0x100000023ee/fork_exec_loop.c v36>,<0x100000022c5/freezer v230>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021ec:[<0x100000023ee/fork_exec_loop.c v92>,<0x100000022c5/freezer v520>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.990 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.940+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002245 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_netlabel.sh auth v46 ap=1 s=1108 n(v0 rc2009-10-09T17:55:52.000000+0000 b1108 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851106000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002245:[<0x10000002407/smack_set_netlabel.sh v26>,<0x10000002406/smack v30>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002245:[<0x10000002407/smack_set_netlabel.sh v46>,<0x10000002406/smack v289>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.990 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.941+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000223a [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_ambient.sh auth v40 ap=1 s=891 n(v0 rc2009-10-09T17:55:52.000000+0000 b891 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510fd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000223a:[<0x10000002407/smack_set_ambient.sh v4>,<0x10000002406/smack v30>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000223a:[<0x10000002407/smack_set_ambient.sh v40>,<0x10000002406/smack v289>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.990 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.941+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000223c [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_direct.sh auth v44 ap=1 s=873 n(v0 rc2009-10-09T17:55:52.000000+0000 b873 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851106580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000223c:[<0x10000002407/smack_set_direct.sh v8>,<0x10000002406/smack v30>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000223c:[<0x10000002407/smack_set_direct.sh v44>,<0x10000002406/smack v289>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.991 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.956+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021dd [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/vfork.c auth v68 ap=1 s=8565 n(v0 rc2009-12-20T01:28:37.000000+0000 b8565 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e74d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021dd:[<0x100000023ee/vfork.c v6>,<0x100000022c5/freezer v230>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021dd:[<0x100000023ee/vfork.c v68>,<0x100000022c5/freezer v520>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.991 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.956+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021e5 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/Makefile auth v78 ap=1 s=1052 n(v0 rc2009-10-09T17:55:47.000000+0000 b1052 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e74d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021e5:[<0x100000023ee/Makefile v22>,<0x100000022c5/freezer v230>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021e5:[<0x100000023ee/Makefile v78>,<0x100000022c5/freezer v520>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.991 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.956+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021ed [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/freeze_thaw.sh auth v84 ap=1 s=1906 n(v0 rc2009-02-26T07:19:31.000000+0000 b1906 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e750000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021ed:[<0x100000023ee/freeze_thaw.sh v38>,<0x100000022c5/freezer v230>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021ed:[<0x100000023ee/freeze_thaw.sh v84>,<0x100000022c5/freezer v520>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.991 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:07 smithi179 ceph-mon[35652]: pgmap v401: 97 pgs: 97 active+clean; 69 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.9 MiB/s wr, 1.96k op/s 2024-01-31T05:13:07.991 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.941+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000223f [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/Makefile auth v30 ap=1 s=385 n(v0 rc2009-10-09T17:55:52.000000+0000 b385 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851106b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000223f:[<0x10000002407/Makefile v14>,<0x10000002406/smack v30>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000223f:[<0x10000002407/Makefile v30>,<0x10000002406/smack v289>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.992 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.941+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002244 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_socket_labels.c auth v42 ap=1 s=1691 n(v0 rc2009-12-06T11:54:42.000000+0000 b1691 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851107600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002244:[<0x10000002407/smack_set_socket_labels.c v24>,<0x10000002406/smack v30>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002244:[<0x10000002407/smack_set_socket_labels.c v42>,<0x10000002406/smack v289>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.992 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:07 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:07.912+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f45 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/utsname/Makefile auth v14 ap=1 s=1751 n(v0 rc2009-11-14T23:58:26.000000+0000 b1751 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d3fa680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f45:[<0x1000000216f/Makefile v6>,<0x1000000216e/utsname v14>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f45:[<0x1000000216f/Makefile v14>,<0x1000000216e/utsname v14>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.992 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:07 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:07.912+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002170 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/utsname/runtests_noltp.sh auth v24 ap=1 s=1909 n(v0 rc2024-01-31T05:12:56.644594+0000 b1909 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d3a9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002170:[<0x1000000216f/runtests_noltp.sh v2>,<0x1000000216e/utsname v14>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002170:[<0x1000000216f/runtests_noltp.sh v24>,<0x1000000216e/utsname v14>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.993 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:07 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:07.912+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f46 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/utsname/README auth v18 ap=1 s=2803 n(v0 rc2007-12-28T09:48:30.000000+0000 b2803 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d3fac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f46:[<0x1000000216f/README v8>,<0x1000000216e/utsname v14>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f46:[<0x1000000216f/README v18>,<0x1000000216e/utsname v14>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.993 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:07 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:07.912+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f44 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/utsname/utstest.c auth v22 ap=1 s=7515 n(v0 rc2008-09-08T10:22:31.000000+0000 b7515 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d3fa100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f44:[<0x1000000216f/utstest.c v4>,<0x1000000216e/utsname v14>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f44:[<0x1000000216f/utstest.c v22>,<0x1000000216e/utsname v14>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.993 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:07 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:07.913+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f48 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/utsname/runutstest.sh auth v20 ap=1 s=1781 n(v0 rc2007-12-28T09:48:31.000000+0000 b1781 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d3fb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f48:[<0x1000000216f/runutstest.sh v12>,<0x1000000216e/utsname v14>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f48:[<0x1000000216f/runutstest.sh v20>,<0x1000000216e/utsname v14>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.993 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:07 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:07.913+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f47 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/utsname/check_utsns_enabled.c auth v16 ap=1 s=1902 n(v0 rc2009-11-03T20:07:35.000000+0000 b1902 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d3fb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f47:[<0x1000000216f/check_utsns_enabled.c v10>,<0x1000000216e/utsname v14>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f47:[<0x1000000216f/check_utsns_enabled.c v16>,<0x1000000216e/utsname v14>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.993 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:07 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:07.989+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000233d [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/stat/selinux_stat.sh auth v8 ap=1 s=1748 n(v0 rc2009-04-21T09:39:59.000000+0000 b1748 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d421b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000233d:[<0x1000000253c/selinux_stat.sh v4>,<0x1000000251c/stat v152>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000233d:[<0x1000000253c/selinux_stat.sh v8>,<0x1000000251c/stat v152>,<0x10000002418/tests v277>,<0x10000002406/selinux-testsuite v161>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.993 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:07 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:07.989+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000253d [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/stat/Makefile auth v6 ap=1 s=1068 n(v0 rc2024-01-31T05:12:57.478575+0000 b1068 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d422100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000253d:[<0x1000000253c/Makefile v2>,<0x1000000251c/stat v152>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000253d:[<0x1000000253c/Makefile v6>,<0x1000000251c/stat v152>,<0x10000002418/tests v277>,<0x10000002406/selinux-testsuite v161>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.993 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.956+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021f6 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/run_io_throttle_test.sh auth v24 ap=1 s=3533 n(v0 rc2008-10-05T14:50:06.000000+0000 b3533 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e336100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021f6:[<0x100000023f2/run_io_throttle_test.sh v6>,<0x100000022c5/io-throttle v252>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021f6:[<0x100000023f2/run_io_throttle_test.sh v24>,<0x100000022c5/io-throttle v484>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.993 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.956+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021f8 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/myfunctions-io.sh auth v20 ap=1 s=1679 n(v0 rc2008-10-05T14:50:06.000000+0000 b1679 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e336680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021f8:[<0x100000023f2/myfunctions-io.sh v10>,<0x100000022c5/io-throttle v252>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021f8:[<0x100000023f2/myfunctions-io.sh v20>,<0x100000022c5/io-throttle v484>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.993 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.957+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021e6 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/freeze_sleep_thaw.sh auth v86 ap=1 s=2623 n(v0 rc2009-02-26T07:19:31.000000+0000 b2623 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e750580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021e6:[<0x100000023ee/freeze_sleep_thaw.sh v24>,<0x100000022c5/freezer v230>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021e6:[<0x100000023ee/freeze_sleep_thaw.sh v86>,<0x100000022c5/freezer v520>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.993 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.957+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021de [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/00_description.txt auth v74 ap=1 s=3027 n(v0 rc2009-02-26T07:19:31.000000+0000 b3027 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e750b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021de:[<0x100000023ee/00_description.txt v8>,<0x100000022c5/freezer v230>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021de:[<0x100000023ee/00_description.txt v74>,<0x100000022c5/freezer v520>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.994 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.942+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002240 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_common.sh auth v32 ap=1 s=1459 n(v0 rc2009-10-09T17:55:52.000000+0000 b1459 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851107080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002240:[<0x10000002407/smack_common.sh v16>,<0x10000002406/smack v30>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002240:[<0x10000002407/smack_common.sh v32>,<0x10000002406/smack v289>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.994 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.942+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002242 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/README auth v38 ap=1 s=759 n(v0 rc2009-03-19T07:27:05.000000+0000 b759 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851107b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002242:[<0x10000002407/README v20>,<0x10000002406/smack v30>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002242:[<0x10000002407/README v38>,<0x10000002406/smack v289>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.994 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.957+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021f1 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/freeze_kill_thaw.sh auth v90 ap=1 s=2631 n(v0 rc2009-02-26T07:19:31.000000+0000 b2631 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e751080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021f1:[<0x100000023ee/freeze_kill_thaw.sh v46>,<0x100000022c5/freezer v230>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021f1:[<0x100000023ee/freeze_kill_thaw.sh v90>,<0x100000022c5/freezer v520>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.994 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.957+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021ef [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/vfork_freeze.sh auth v88 ap=1 s=3131 n(v0 rc2009-11-09T10:42:31.000000+0000 b3131 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e751600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021ef:[<0x100000023ee/vfork_freeze.sh v42>,<0x100000022c5/freezer v230>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021ef:[<0x100000023ee/vfork_freeze.sh v88>,<0x100000022c5/freezer v520>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.995 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.942+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002408 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_current.sh auth v48 ap=1 s=922 n(v0 rc2024-01-31T05:12:57.320579+0000 b922 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851108100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002408:[<0x10000002407/smack_set_current.sh v2>,<0x10000002406/smack v30>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002408:[<0x10000002407/smack_set_current.sh v48>,<0x10000002406/smack v289>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.995 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.943+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000240c [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/ auth v29 ap=1 f(v0 m2024-01-31T05:12:57.339578+0000 5=2+3) n(v1 rc2024-01-31T05:12:57.342578+0000 b43117 19=15+4) (inest lock dirty) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15315 | dirtyscattered=1 lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85116ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000240c:[<0x1000000240b/ima v12>,<0x10000002406/integrity v48>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x1000000240c:[<0x1000000240b/ima v29>,<0x10000002406/integrity v191>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.339578+0000 5=2+3)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.342578+0000 b43117 19=15+4)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.339578+0000 5=2+3)","memory_value.rstat":"n(v1 rc2024-01-31T05:12:57.342578+0000 b43117 19=15+4)","error_str":""},"return_code":0} 2024-01-31T05:13:07.995 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.943+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002414 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/Makefile auth v25 ap=1 s=913 n(v0 rc2024-01-31T05:12:57.346578+0000 b913 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85116a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002414:[<0x1000000240b/Makefile v14>,<0x10000002406/integrity v48>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002414:[<0x1000000240b/Makefile v25>,<0x10000002406/integrity v191>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.995 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.943+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000237c [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/tomoyo/newns.c auth v20 ap=1 s=2086 n(v0 rc2009-11-03T20:07:35.000000+0000 b2086 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851108680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000237c:[<0x1000000256c/newns.c v10>,<0x10000002406/tomoyo v100>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000237c:[<0x1000000256c/newns.c v20>,<0x10000002406/tomoyo v253>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.995 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.957+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021e4 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/libltp auth v82 ap=1 s=1937 n(v0 rc2009-02-26T07:19:31.000000+0000 b1937 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e751b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021e4:[<0x100000023ee/libltp v20>,<0x100000022c5/freezer v230>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021e4:[<0x100000023ee/libltp v82>,<0x100000022c5/freezer v520>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.995 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.958+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021f0 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/freeze_cancel.sh auth v96 ap=1 s=1952 n(v0 rc2009-02-26T07:19:31.000000+0000 b1952 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e752100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021f0:[<0x100000023ee/freeze_cancel.sh v44>,<0x100000022c5/freezer v230>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021f0:[<0x100000023ee/freeze_cancel.sh v96>,<0x100000022c5/freezer v520>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.995 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.958+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021e8 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/README auth v56 ap=1 s=2101 n(v0 rc2009-02-26T07:19:31.000000+0000 b2101 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e752c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021e8:[<0x100000023ee/README v28>,<0x100000022c5/freezer v230>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021e8:[<0x100000023ee/README v56>,<0x100000022c5/freezer v520>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.996 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.958+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021e2 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/fork_freeze.sh auth v66 ap=1 s=2061 n(v0 rc2009-02-26T07:19:31.000000+0000 b2061 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e752680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021e2:[<0x100000023ee/fork_freeze.sh v16>,<0x100000022c5/freezer v230>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021e2:[<0x100000023ee/fork_freeze.sh v66>,<0x100000022c5/freezer v520>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.996 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.958+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021ea [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/stop_freeze_sleep_thaw_cont.sh auth v72 ap=1 s=2486 n(v0 rc2009-02-26T07:19:31.000000+0000 b2486 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e753180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021ea:[<0x100000023ee/stop_freeze_sleep_thaw_cont.sh v32>,<0x100000022c5/freezer v230>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021ea:[<0x100000023ee/stop_freeze_sleep_thaw_cont.sh v72>,<0x100000022c5/freezer v520>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.996 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.943+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000237b [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/tomoyo/tomoyo_file_test.c auth v18 ap=1 s=28077 n(v0 rc2009-07-08T18:02:37.000000+0000 b28077 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851108c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000237b:[<0x1000000256c/tomoyo_file_test.c v8>,<0x10000002406/tomoyo v100>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000237b:[<0x1000000256c/tomoyo_file_test.c v18>,<0x10000002406/tomoyo v253>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.996 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.943+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000237a [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/tomoyo/testall.sh auth v24 ap=1 s=1747 n(v0 rc2009-07-08T18:02:37.000000+0000 b1747 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851109180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000237a:[<0x1000000256c/testall.sh v6>,<0x10000002406/tomoyo v100>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000237a:[<0x1000000256c/testall.sh v24>,<0x10000002406/tomoyo v253>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.996 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.944+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000256d [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/tomoyo/Makefile auth v22 ap=1 s=1028 n(v0 rc2024-01-31T05:12:57.731569+0000 b1028 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851109700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000256d:[<0x1000000256c/Makefile v2>,<0x10000002406/tomoyo v100>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000256d:[<0x1000000256c/Makefile v22>,<0x10000002406/tomoyo v253>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.996 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.945+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000237d [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/tomoyo/include.h auth v14 ap=1 s=5592 n(v0 rc2009-10-09T17:55:52.000000+0000 b5592 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851118000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000237d:[<0x1000000256c/include.h v12>,<0x10000002406/tomoyo v100>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000237d:[<0x1000000256c/include.h v14>,<0x10000002406/tomoyo v253>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.996 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.946+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002419 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/ auth{0=1} v525 ap=1 f(v0 m2024-01-31T05:12:57.358578+0000 39=39+0) n(v0 rc2024-01-31T05:12:57.358578+0000 b52549 40=39+1) (inest mix) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55e850fa0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002419:[<0x10000002418/policy v80>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000002419:[<0x10000002418/policy v525>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.358578+0000 39=39+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.358578+0000 b52549 40=39+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.358578+0000 39=39+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.358578+0000 b52549 40=39+1)","error_str":""},"return_code":0} 2024-01-31T05:13:07.997 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.959+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000023ef [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/COPYING auth v62 ap=1 s=18007 n(v0 rc2024-01-31T05:12:57.244580+0000 b18007 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e760000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000023ef:[<0x100000023ee/COPYING v2>,<0x100000022c5/freezer v230>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000023ef:[<0x100000023ee/COPYING v62>,<0x100000022c5/freezer v520>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.997 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.959+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021f2 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/freeze_write_freezing.sh auth v94 ap=1 s=1901 n(v0 rc2009-02-26T07:19:31.000000+0000 b1901 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e753700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021f2:[<0x100000023ee/freeze_write_freezing.sh v48>,<0x100000022c5/freezer v230>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021f2:[<0x100000023ee/freeze_write_freezing.sh v94>,<0x100000022c5/freezer v520>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.997 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.946+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002379 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/tomoyo/README auth v16 ap=1 s=1942 n(v0 rc2009-07-08T18:02:37.000000+0000 b1942 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851118580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002379:[<0x1000000256c/README v4>,<0x10000002406/tomoyo v100>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002379:[<0x1000000256c/README v16>,<0x10000002406/tomoyo v253>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.997 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.947+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002378 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/ChangeLog auth v409 ap=1 s=568 n(v0 rc2006-03-22T21:26:05.000000+0000 b568 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851190c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002378:[<0x10000002418/ChangeLog v258>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002378:[<0x10000002418/ChangeLog v409>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.998 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.959+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022cf [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_hotplug_test/Makefile auth v8 ap=1 s=1092 n(v0 rc2024-01-31T05:12:57.171582+0000 b1092 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e782100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022cf:[<0x100000022ce/Makefile v2>,<0x100000022c9/cpuset_hotplug_test v40>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022cf:[<0x100000022ce/Makefile v8>,<0x100000022c9/cpuset_hotplug_test v189>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.998 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.959+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002136 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_hotplug_test/cpuset_hotplug_test.sh auth v10 ap=1 s=7021 n(v0 rc2009-06-23T14:09:11.000000+0000 b7021 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e781b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002136:[<0x100000022ce/cpuset_hotplug_test.sh v4>,<0x100000022c9/cpuset_hotplug_test v40>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002136:[<0x100000022ce/cpuset_hotplug_test.sh v10>,<0x100000022c9/cpuset_hotplug_test v189>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.999 INFO:tasks.workunit.client.0.smithi099.stdout:6/48: symlink le 0 2024-01-31T05:13:07.999 INFO:tasks.workunit.client.0.smithi099.stdout:6/49: read f1 [433348,9540] 0 2024-01-31T05:13:07.999 INFO:tasks.workunit.client.0.smithi099.stdout:6/50: chown f7 3832427 1 2024-01-31T05:13:07.999 INFO:tasks.workunit.client.0.smithi099.stdout:6/51: fdatasync fc 0 2024-01-31T05:13:07.999 INFO:tasks.workunit.client.0.smithi099.stdout:2/66: read - d10/f11 zero size 2024-01-31T05:13:07.999 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.948+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000251c [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ auth{0=1,1=1} v509 ap=1 f(v0 m2024-01-31T05:12:57.727569+0000 42=3+39) n(v1 rc2024-01-31T05:12:57.727569+0000 b194099 181=141+40) (inest mix dirty) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15315 | dirtyscattered=1 lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=1 dirty=1 authpin=1 discoverbase=0 scrubqueue=0 0x55e850f48b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000251c:[<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x1000000251c:[<0x10000002418/tests v509>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.727569+0000 42=3+39)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.727569+0000 b194099 181=141+40)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.727569+0000 42=3+39)","memory_value.rstat":"n(v1 rc2024-01-31T05:12:57.727569+0000 b194099 181=141+40)","error_str":""},"return_code":0} 2024-01-31T05:13:07.999 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.949+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000241b [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/Makefile auth v391 ap=1 s=1009 n(v0 rc2024-01-31T05:12:57.377577+0000 b1009 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851191180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000241b:[<0x10000002418/Makefile v82>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000241b:[<0x10000002418/Makefile v391>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.999 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.959+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002137 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_hotplug_test/cpuset_list_compute.c auth v12 ap=1 s=2324 n(v0 rc2009-05-11T10:02:46.000000+0000 b2324 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e782680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002137:[<0x100000022ce/cpuset_list_compute.c v6>,<0x100000022c9/cpuset_hotplug_test v40>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002137:[<0x100000022ce/cpuset_list_compute.c v12>,<0x100000022c9/cpuset_hotplug_test v189>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:07.999 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.960+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000213f [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_spread_test/cpuset_memory_spread_testset.sh auth v8 ap=1 s=7694 n(v0 rc2009-06-23T14:09:11.000000+0000 b7694 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e782c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000213f:[<0x100000022d5/cpuset_memory_spread_testset.sh v6>,<0x100000022c9/cpuset_memory_spread_test v70>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000213f:[<0x100000022d5/cpuset_memory_spread_testset.sh v8>,<0x100000022c9/cpuset_memory_spread_test v195>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.000 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.949+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002312 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/README auth v395 ap=1 s=8357 n(v0 rc2009-05-12T06:03:40.000000+0000 b8357 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851191700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002312:[<0x10000002418/README v170>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002312:[<0x10000002418/README v395>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.000 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.949+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000241c [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/ auth{0=1,4=1} v531 ap=1 f(v0 m2024-01-31T05:12:57.395577+0000 42=41+1) n(v2 rc2024-01-31T05:12:57.395577+0000 b73989 82=79+3) (inest mix) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15315 | lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55e85118eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000241c:[<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x1000000241c:[<0x10000002418/refpolicy v531>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.395577+0000 42=41+1)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.395577+0000 b73989 82=79+3)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.395577+0000 42=41+1)","memory_value.rstat":"n(v2 rc2024-01-31T05:12:57.395577+0000 b73989 82=79+3)","error_str":""},"return_code":0} 2024-01-31T05:13:08.000 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.960+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022d6 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_spread_test/Makefile auth v10 ap=1 s=1079 n(v0 rc2009-10-09T17:55:47.000000+0000 b1079 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e783700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022d6:[<0x100000022d5/Makefile v2>,<0x100000022c9/cpuset_memory_spread_test v70>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022d6:[<0x100000022d5/Makefile v10>,<0x100000022c9/cpuset_memory_spread_test v195>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.000 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.960+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002144 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_inherit_test/cpuset_inherit_testset.sh auth v6 ap=1 s=5143 n(v0 rc2009-06-23T14:09:11.000000+0000 b5143 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e78c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002144:[<0x100000022db/cpuset_inherit_testset.sh v4>,<0x100000022c9/cpuset_inherit_test v92>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002144:[<0x100000022db/cpuset_inherit_testset.sh v6>,<0x100000022c9/cpuset_inherit_test v211>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.001 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.949+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002386 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/ask_password.sh auth v24 ap=1 s=2629 n(v0 rc2006-02-01T22:38:52.000000+0000 b2629 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851118b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002386:[<0x10000002570/ask_password.sh v4>,<0x10000002406/mmc_security v140>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002386:[<0x10000002570/ask_password.sh v24>,<0x10000002406/mmc_security v283>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.001 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.949+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000238c [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/remove_password.sh auth v34 ap=1 s=2566 n(v0 rc2006-02-01T22:38:52.000000+0000 b2566 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851119080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000238c:[<0x10000002570/remove_password.sh v16>,<0x10000002406/mmc_security v140>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000238c:[<0x10000002570/remove_password.sh v34>,<0x10000002406/mmc_security v283>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.001 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.961+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022d8 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_hierarchy_test/cpuset_hierarchy_test.sh auth v8 ap=1 s=14307 n(v0 rc2024-01-31T05:12:57.184582+0000 b14307 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e78cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022d8:[<0x100000022d7/cpuset_hierarchy_test.sh v2>,<0x100000022c9/cpuset_hierarchy_test v76>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022d8:[<0x100000022d7/cpuset_hierarchy_test.sh v8>,<0x100000022c9/cpuset_hierarchy_test v155>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.001 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.961+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022dc [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_inherit_test/Makefile auth v8 ap=1 s=1092 n(v0 rc2024-01-31T05:12:57.190582+0000 b1092 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e78c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022dc:[<0x100000022db/Makefile v2>,<0x100000022c9/cpuset_inherit_test v92>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022dc:[<0x100000022db/Makefile v8>,<0x100000022c9/cpuset_inherit_test v211>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.001 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.949+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002571 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/change_password.sh auth v20 ap=1 s=2910 n(v0 rc2006-02-01T22:38:52.000000+0000 b2910 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851119600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002571:[<0x10000002570/change_password.sh v2>,<0x10000002406/mmc_security v140>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002571:[<0x10000002570/change_password.sh v20>,<0x10000002406/mmc_security v283>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.002 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.950+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002387 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/LICENSE auth v22 ap=1 s=18011 n(v0 rc2006-02-01T22:38:52.000000+0000 b18011 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851119b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002387:[<0x10000002570/LICENSE v6>,<0x10000002406/mmc_security v140>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002387:[<0x10000002570/LICENSE v22>,<0x10000002406/mmc_security v283>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.002 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.961+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002140 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_hierarchy_test/Makefile auth v6 ap=1 s=1094 n(v0 rc2009-10-09T17:55:46.000000+0000 b1094 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e78d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002140:[<0x100000022d7/Makefile v4>,<0x100000022c9/cpuset_hierarchy_test v76>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002140:[<0x100000022d7/Makefile v6>,<0x100000022c9/cpuset_hierarchy_test v155>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.002 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.961+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002134 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_syscall_test/cpuset_syscall_test.c auth v10 ap=1 s=6671 n(v0 rc2009-12-19T05:21:23.000000+0000 b6671 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e78e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002134:[<0x100000022cc/cpuset_syscall_test.c v4>,<0x100000022c9/cpuset_syscall_test v32>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002134:[<0x100000022cc/cpuset_syscall_test.c v10>,<0x100000022c9/cpuset_syscall_test v209>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.002 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.950+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002388 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/Makefile auth v26 ap=1 s=1029 n(v0 rc2009-10-09T17:55:50.000000+0000 b1029 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85111a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002388:[<0x10000002570/Makefile v8>,<0x10000002406/mmc_security v140>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002388:[<0x10000002570/Makefile v26>,<0x10000002406/mmc_security v283>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.002 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.950+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000238b [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/force_erase.sh auth v28 ap=1 s=2973 n(v0 rc2006-02-01T22:38:52.000000+0000 b2973 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85111ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000238b:[<0x10000002570/force_erase.sh v14>,<0x10000002406/mmc_security v140>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000238b:[<0x10000002570/force_erase.sh v28>,<0x10000002406/mmc_security v283>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.002 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.951+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000238a [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/AUTHORS auth v30 ap=1 s=146 n(v0 rc2006-02-01T22:38:52.000000+0000 b146 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85111a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000238a:[<0x10000002570/AUTHORS v12>,<0x10000002406/mmc_security v140>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000238a:[<0x10000002570/AUTHORS v30>,<0x10000002406/mmc_security v283>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.003 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.961+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022cd [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_syscall_test/Makefile auth v12 ap=1 s=1073 n(v0 rc2024-01-31T05:12:57.168582+0000 b1073 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e78db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022cd:[<0x100000022cc/Makefile v2>,<0x100000022c9/cpuset_syscall_test v32>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022cd:[<0x100000022cc/Makefile v12>,<0x100000022c9/cpuset_syscall_test v209>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.003 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.962+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000213b [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_load_balance_test/cpuset_cpu_hog.c auth v12 ap=1 s=7010 n(v0 rc2009-11-30T08:41:37.000000+0000 b7010 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e78ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000213b:[<0x100000022d1/cpuset_cpu_hog.c v10>,<0x100000022c9/cpuset_load_balance_test v54>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000213b:[<0x100000022d1/cpuset_cpu_hog.c v12>,<0x100000022c9/cpuset_load_balance_test v221>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.004 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.951+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002248 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/p9auth/p9unpriv.sh auth v18 ap=1 s=2036 n(v0 rc2009-09-21T15:48:09.000000+0000 b2036 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851128000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002248:[<0x10000002409/p9unpriv.sh v6>,<0x10000002406/p9auth v42>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002248:[<0x10000002409/p9unpriv.sh v18>,<0x10000002406/p9auth v293>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.004 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.951+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000224a [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/p9auth/unhex.c auth v20 ap=1 s=2008 n(v0 rc2009-09-21T15:48:09.000000+0000 b2008 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851128580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000224a:[<0x10000002409/unhex.c v10>,<0x10000002406/p9auth v42>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000224a:[<0x10000002409/unhex.c v20>,<0x10000002406/p9auth v293>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.004 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.951+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002249 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/p9auth/Makefile auth v14 ap=1 s=1697 n(v0 rc2009-10-09T17:55:50.000000+0000 b1697 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851128b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002249:[<0x10000002409/Makefile v8>,<0x10000002406/p9auth v42>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002249:[<0x10000002409/Makefile v14>,<0x10000002406/p9auth v293>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.004 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.951+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000240a [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/p9auth/p9priv.sh auth v12 ap=1 s=3889 n(v0 rc2024-01-31T05:12:57.328578+0000 b3889 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851129080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000240a:[<0x10000002409/p9priv.sh v2>,<0x10000002406/p9auth v42>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000240a:[<0x10000002409/p9priv.sh v12>,<0x10000002406/p9auth v293>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.004 INFO:tasks.workunit.client.0.smithi099.stdout:1/46: unlink d4/f9 0 2024-01-31T05:13:08.004 INFO:tasks.workunit.client.0.smithi099.stdout:1/47: stat d4/fa 0 2024-01-31T05:13:08.004 INFO:tasks.workunit.client.0.smithi099.stdout:1/48: write f3 [435612,26463] 0 2024-01-31T05:13:08.004 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.962+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022d2 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_load_balance_test/cpuset_sched_domains_check.c auth v14 ap=1 s=4138 n(v0 rc2024-01-31T05:12:57.175582+0000 b4138 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e78f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022d2:[<0x100000022d1/cpuset_sched_domains_check.c v2>,<0x100000022c9/cpuset_load_balance_test v54>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022d2:[<0x100000022d1/cpuset_sched_domains_check.c v14>,<0x100000022c9/cpuset_load_balance_test v221>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.005 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.962+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000213a [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_load_balance_test/Makefile auth v16 ap=1 s=1096 n(v0 rc2009-10-09T17:55:46.000000+0000 b1096 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e78f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000213a:[<0x100000022d1/Makefile v8>,<0x100000022c9/cpuset_load_balance_test v54>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000213a:[<0x100000022d1/Makefile v16>,<0x100000022c9/cpuset_load_balance_test v221>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.005 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.963+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002139 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_load_balance_test/cpuset_load_balance_test.sh auth v20 ap=1 s=9281 n(v0 rc2009-06-23T14:09:11.000000+0000 b9281 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e794000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002139:[<0x100000022d1/cpuset_load_balance_test.sh v6>,<0x100000022c9/cpuset_load_balance_test v54>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002139:[<0x100000022d1/cpuset_load_balance_test.sh v20>,<0x100000022c9/cpuset_load_balance_test v221>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.005 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.952+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002247 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/p9auth/runp9auth.sh auth v16 ap=1 s=1753 n(v0 rc2009-09-21T15:48:09.000000+0000 b1753 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851129600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002247:[<0x10000002409/runp9auth.sh v4>,<0x10000002406/p9auth v42>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002247:[<0x10000002409/runp9auth.sh v16>,<0x10000002406/p9auth v293>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.005 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.952+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000237e [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/verify_caps_exec.c auth v26 ap=1 s=10764 n(v0 rc2009-10-09T17:55:50.000000+0000 b10764 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851129b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000237e:[<0x1000000256e/verify_caps_exec.c v4>,<0x10000002406/filecaps v120>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000237e:[<0x1000000256e/verify_caps_exec.c v26>,<0x10000002406/filecaps v295>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.005 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.964+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000212f [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/meminfo.h auth v42 ap=1 s=221 n(v0 rc2009-05-11T10:02:46.000000+0000 b221 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e794580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000212f:[<0x100000022ca/meminfo.h v14>,<0x100000022c9/cpuset_lib v24>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000212f:[<0x100000022ca/meminfo.h v42>,<0x100000022c9/cpuset_lib v215>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.005 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.964+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002130 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/libbitmask.c auth v40 ap=1 s=16364 n(v0 rc2009-04-25T18:10:58.000000+0000 b16364 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e794b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002130:[<0x100000022ca/libbitmask.c v16>,<0x100000022c9/cpuset_lib v24>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002130:[<0x100000022ca/libbitmask.c v40>,<0x100000022c9/cpuset_lib v215>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.006 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.952+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002382 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/check_simple_capset.c auth v22 ap=1 s=2236 n(v0 rc2009-10-09T17:55:50.000000+0000 b2236 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85112a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002382:[<0x1000000256e/check_simple_capset.c v12>,<0x10000002406/filecaps v120>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002382:[<0x1000000256e/check_simple_capset.c v22>,<0x10000002406/filecaps v295>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.006 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.952+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002385 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/inh_capped.c auth v28 ap=1 s=3955 n(v0 rc2009-10-09T17:55:50.000000+0000 b3955 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85112ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002385:[<0x1000000256e/inh_capped.c v18>,<0x10000002406/filecaps v120>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002385:[<0x1000000256e/inh_capped.c v28>,<0x10000002406/filecaps v295>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.006 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.953+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002384 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/checkforfilecaps.sh auth v20 ap=1 s=2003 n(v0 rc2009-10-09T17:55:50.000000+0000 b2003 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85112b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002384:[<0x1000000256e/checkforfilecaps.sh v16>,<0x10000002406/filecaps v120>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002384:[<0x1000000256e/checkforfilecaps.sh v20>,<0x10000002406/filecaps v295>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.006 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.964+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000213e [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_spread_test/cpuset_mem_hog.c auth v12 ap=1 s=3365 n(v0 rc2024-01-31T05:12:57.182582+0000 b3365 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e783180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000213e:[<0x100000022d5/cpuset_mem_hog.c v4>,<0x100000022c9/cpuset_memory_spread_test v70>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000213e:[<0x100000022d5/cpuset_mem_hog.c v12>,<0x100000022c9/cpuset_memory_spread_test v195>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.006 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.965+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000212a [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/Makefile auth v24 ap=1 s=1088 n(v0 rc2009-11-30T08:41:37.000000+0000 b1088 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e795080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000212a:[<0x100000022ca/Makefile v4>,<0x100000022c9/cpuset_lib v24>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000212a:[<0x100000022ca/Makefile v24>,<0x100000022c9/cpuset_lib v215>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1769>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.007 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.953+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002380 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/Makefile auth v30 ap=1 s=1789 n(v0 rc2009-10-09T17:55:50.000000+0000 b1789 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85112b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002380:[<0x1000000256e/Makefile v8>,<0x10000002406/filecaps v120>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002380:[<0x1000000256e/Makefile v30>,<0x10000002406/filecaps v295>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.007 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.954+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002383 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/README auth v34 ap=1 s=1471 n(v0 rc2008-11-03T10:09:30.000000+0000 b1471 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851134000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002383:[<0x1000000256e/README v14>,<0x10000002406/filecaps v120>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002383:[<0x1000000256e/README v34>,<0x10000002406/filecaps v295>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.007 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.954+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000256f [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/print_caps.c auth v24 ap=1 s=2468 n(v0 rc2024-01-31T05:12:57.736569+0000 b2468 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851134580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000256f:[<0x1000000256e/print_caps.c v2>,<0x10000002406/filecaps v120>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000256f:[<0x1000000256e/print_caps.c v24>,<0x10000002406/filecaps v295>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.007 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.954+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002381 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/filecapstest.sh auth v36 ap=1 s=2364 n(v0 rc2009-12-03T14:59:23.000000+0000 b2364 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851134b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002381:[<0x1000000256e/filecapstest.sh v10>,<0x10000002406/filecaps v120>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002381:[<0x1000000256e/filecapstest.sh v36>,<0x10000002406/filecaps v295>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.007 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.965+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000212c [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/libcpuset.c auth v32 ap=1 s=98189 n(v0 rc2009-10-17T06:53:58.000000+0000 b98189 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e795b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000212c:[<0x100000022ca/libcpuset.c v8>,<0x100000022c9/cpuset_lib v24>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000212c:[<0x100000022ca/libcpuset.c v32>,<0x100000022c9/cpuset_lib v215>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1769>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.007 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.968+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002138 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_load_balance_test/cpuset_sched_domains_test.sh auth v18 ap=1 s=7921 n(v0 rc2009-11-27T07:39:10.000000+0000 b7921 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e78e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002138:[<0x100000022d1/cpuset_sched_domains_test.sh v4>,<0x100000022c9/cpuset_load_balance_test v54>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002138:[<0x100000022d1/cpuset_sched_domains_test.sh v18>,<0x100000022c9/cpuset_load_balance_test v221>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1769>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.008 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.955+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021da [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/stress/Makefile auth v12 ap=1 s=1115 n(v0 rc2009-10-09T17:55:47.000000+0000 b1115 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850faec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021da:[<0x100000023ec/Makefile v4>,<0x100000023e6/stress v36>,<0x100000022c5/memcg v180>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021da:[<0x100000023ec/Makefile v12>,<0x100000023e6/stress v69>,<0x100000022c5/memcg v268>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.008 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.955+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000023ed [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/stress/memcg_stress_test.sh auth v10 ap=1 s=3544 n(v0 rc2024-01-31T05:12:57.242580+0000 b3544 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850faf180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000023ed:[<0x100000023ec/memcg_stress_test.sh v2>,<0x100000023e6/stress v36>,<0x100000022c5/memcg v180>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000023ed:[<0x100000023ec/memcg_stress_test.sh v10>,<0x100000023e6/stress v69>,<0x100000022c5/memcg v268>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.008 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.968+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000212d [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/cpuinfo.h auth v44 ap=1 s=558 n(v0 rc2009-05-11T10:02:46.000000+0000 b558 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e795600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000212d:[<0x100000022ca/cpuinfo.h v10>,<0x100000022c9/cpuset_lib v24>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000212d:[<0x100000022ca/cpuinfo.h v44>,<0x100000022c9/cpuset_lib v215>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1769>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.008 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.968+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000212e [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/cpuset_funcs.sh auth v34 ap=1 s=6034 n(v0 rc2009-06-23T14:09:11.000000+0000 b6034 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e796100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000212e:[<0x100000022ca/cpuset_funcs.sh v12>,<0x100000022c9/cpuset_lib v24>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000212e:[<0x100000022ca/cpuset_funcs.sh v34>,<0x100000022c9/cpuset_lib v215>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1769>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.009 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.955+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021db [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/stress/memcg_process_stress.c auth v8 ap=1 s=3277 n(v0 rc2009-09-14T07:14:25.000000+0000 b3277 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850faf700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021db:[<0x100000023ec/memcg_process_stress.c v6>,<0x100000023e6/stress v36>,<0x100000022c5/memcg v180>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021db:[<0x100000023ec/memcg_process_stress.c v8>,<0x100000023e6/stress v69>,<0x100000022c5/memcg v268>,<0x10000001eda/controllers v1206>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.009 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.956+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000240d [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/policy/ auth v67 ap=1 f(v0 m2024-01-31T05:12:57.334578+0000 3=3+0) n(v0 rc2024-01-31T05:12:57.334578+0000 b1870 4=3+1) (inest lock) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15315 | lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85116b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000240d:[<0x1000000240c/policy v8>,<0x1000000240b/ima v12>,<0x10000002406/integrity v48>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x1000000240d:[<0x1000000240c/policy v67>,<0x1000000240b/ima v29>,<0x10000002406/integrity v191>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.334578+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.334578+0000 b1870 4=3+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.334578+0000 3=3+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.334578+0000 b1870 4=3+1)","error_str":""},"return_code":0} 2024-01-31T05:13:08.009 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.956+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002389 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/README auth v32 ap=1 s=1869 n(v0 rc2006-02-01T22:38:52.000000+0000 b1869 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85111b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002389:[<0x10000002570/README v10>,<0x10000002406/mmc_security v140>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002389:[<0x10000002570/README v32>,<0x10000002406/mmc_security v283>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.009 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.957+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000238d [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/assign_password.sh auth v36 ap=1 s=2654 n(v0 rc2006-02-01T22:38:52.000000+0000 b2654 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85111b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000238d:[<0x10000002570/assign_password.sh v18>,<0x10000002406/mmc_security v140>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000238d:[<0x10000002570/assign_password.sh v36>,<0x10000002406/mmc_security v283>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.010 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.969+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002135 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_syscall_test/cpuset_syscall_testset.sh auth v8 ap=1 s=9067 n(v0 rc2009-06-23T14:09:11.000000+0000 b9067 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e78d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002135:[<0x100000022cc/cpuset_syscall_testset.sh v6>,<0x100000022c9/cpuset_syscall_test v32>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002135:[<0x100000022cc/cpuset_syscall_testset.sh v8>,<0x100000022c9/cpuset_syscall_test v209>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1769>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.010 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.969+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000212b [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/bitmask.h auth v38 ap=1 s=7918 n(v0 rc2009-04-25T18:10:58.000000+0000 b7918 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e796c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000212b:[<0x100000022ca/bitmask.h v6>,<0x100000022c9/cpuset_lib v24>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000212b:[<0x100000022ca/bitmask.h v38>,<0x100000022c9/cpuset_lib v215>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1769>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.010 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.969+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002133 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/cpuset.h auth v26 ap=1 s=13542 n(v0 rc2009-04-25T18:10:58.000000+0000 b13542 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e797180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002133:[<0x100000022ca/cpuset.h v22>,<0x100000022c9/cpuset_lib v24>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002133:[<0x100000022ca/cpuset.h v26>,<0x100000022c9/cpuset_lib v215>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1769>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.010 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.969+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022da [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_base_ops_test/cpuset_base_ops_testset.sh auth v6 ap=1 s=6647 n(v0 rc2024-01-31T05:12:57.187582+0000 b6647 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e7a0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022da:[<0x100000022d9/cpuset_base_ops_testset.sh v2>,<0x100000022c9/cpuset_base_ops_test v82>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022da:[<0x100000022d9/cpuset_base_ops_testset.sh v6>,<0x100000022c9/cpuset_base_ops_test v207>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1769>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.011 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.957+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000237f [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/checkforlibcap.sh auth v32 ap=1 s=2207 n(v0 rc2008-10-29T06:55:15.000000+0000 b2207 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85112a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000237f:[<0x1000000256e/checkforlibcap.sh v6>,<0x10000002406/filecaps v120>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000237f:[<0x1000000256e/checkforlibcap.sh v32>,<0x10000002406/filecaps v295>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.011 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.957+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002410 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/ auth v69 ap=1 f(v0 m2024-01-31T05:12:57.339578+0000 4=4+0) n(v0 rc2024-01-31T05:12:57.339578+0000 b10752 5=4+1) (inest lock) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15315 | lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85116b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002410:[<0x1000000240c/src v22>,<0x1000000240b/ima v12>,<0x10000002406/integrity v48>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000002410:[<0x1000000240c/src v69>,<0x1000000240b/ima v29>,<0x10000002406/integrity v191>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.339578+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.339578+0000 b10752 5=4+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.339578+0000 4=4+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.339578+0000 b10752 5=4+1)","error_str":""},"return_code":0} 2024-01-31T05:13:08.011 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.957+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002412 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/tests/ auth v71 ap=1 f(v0 m2024-01-31T05:12:57.342578+0000 6=6+0) n(v0 rc2024-01-31T05:12:57.342578+0000 b26416 7=6+1) (inest lock) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15315 | lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851170000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002412:[<0x1000000240c/tests v36>,<0x1000000240b/ima v12>,<0x10000002406/integrity v48>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000002412:[<0x1000000240c/tests v71>,<0x1000000240b/ima v29>,<0x10000002406/integrity v191>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.342578+0000 6=6+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.342578+0000 b26416 7=6+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.342578+0000 6=6+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.342578+0000 b26416 7=6+1)","error_str":""},"return_code":0} 2024-01-31T05:13:08.011 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.957+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000224d [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/README auth v73 ap=1 s=3041 n(v0 rc2009-10-13T11:27:43.000000+0000 b3041 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851170b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000224d:[<0x1000000240c/README v12>,<0x1000000240b/ima v12>,<0x10000002406/integrity v48>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000224d:[<0x1000000240c/README v73>,<0x1000000240b/ima v29>,<0x10000002406/integrity v191>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.011 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.971+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002131 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/common.h auth v28 ap=1 s=2119 n(v0 rc2009-04-25T18:10:58.000000+0000 b2119 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e796680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002131:[<0x100000022ca/common.h v18>,<0x100000022c9/cpuset_lib v24>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002131:[<0x100000022ca/common.h v28>,<0x100000022c9/cpuset_lib v215>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1769>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.011 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.971+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002141 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_base_ops_test/Makefile auth v8 ap=1 s=1093 n(v0 rc2009-10-09T17:55:46.000000+0000 b1093 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e7a0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002141:[<0x100000022d9/Makefile v4>,<0x100000022c9/cpuset_base_ops_test v82>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002141:[<0x100000022d9/Makefile v8>,<0x100000022c9/cpuset_base_ops_test v207>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1769>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.012 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.958+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000227f [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_task_getsched.te auth v130 ap=1 s=669 n(v0 rc2005-04-20T16:09:04.000000+0000 b669 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851083700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000227f:[<0x10000002419/test_task_getsched.te v68>,<0x10000002418/policy v80>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000227f:[<0x10000002419/test_task_getsched.te v130>,<0x10000002418/policy v525>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.012 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.958+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002267 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_mkdir.te auth v96 ap=1 s=1742 n(v0 rc2005-04-20T16:09:04.000000+0000 b1742 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510be000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002267:[<0x10000002419/test_mkdir.te v20>,<0x10000002418/policy v80>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002267:[<0x10000002419/test_mkdir.te v96>,<0x10000002418/policy v525>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.012 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.958+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002280 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_capable_net.te auth v94 ap=1 s=1022 n(v0 rc2005-11-17T16:10:31.000000+0000 b1022 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510be580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002280:[<0x10000002419/test_capable_net.te v70>,<0x10000002418/policy v80>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002280:[<0x10000002419/test_capable_net.te v94>,<0x10000002418/policy v525>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.013 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.972+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002149 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_test/cpuset_memory_test.c auth v12 ap=1 s=9072 n(v0 rc2009-11-30T08:41:37.000000+0000 b9072 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e7a1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002149:[<0x100000022df/cpuset_memory_test.c v6>,<0x100000022c9/cpuset_memory_test v110>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002149:[<0x100000022df/cpuset_memory_test.c v12>,<0x100000022c9/cpuset_memory_test v205>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1769>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.013 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.972+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002148 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_test/cpuset_memory_testset.sh auth v10 ap=1 s=20111 n(v0 rc2009-06-23T14:09:11.000000+0000 b20111 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e7a1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002148:[<0x100000022df/cpuset_memory_testset.sh v4>,<0x100000022c9/cpuset_memory_test v110>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002148:[<0x100000022df/cpuset_memory_testset.sh v10>,<0x100000022c9/cpuset_memory_test v205>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1769>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.013 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.973+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000213d [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_exclusive_test/Makefile auth v8 ap=1 s=1094 n(v0 rc2009-10-09T17:55:46.000000+0000 b1094 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e7a2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000213d:[<0x100000022d3/Makefile v4>,<0x100000022c9/cpuset_exclusive_test v62>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000213d:[<0x100000022d3/Makefile v8>,<0x100000022c9/cpuset_exclusive_test v219>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1769>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.013 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.974+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002132 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/meminfo.c auth v36 ap=1 s=2134 n(v0 rc2009-05-11T10:02:46.000000+0000 b2134 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e797700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002132:[<0x100000022ca/meminfo.c v20>,<0x100000022c9/cpuset_lib v24>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002132:[<0x100000022ca/meminfo.c v36>,<0x100000022c9/cpuset_lib v215>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1769>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.013 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.974+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002145 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_pressure_test/cpuset_memory_pressure_testset.sh auth v12 ap=1 s=7139 n(v0 rc2009-06-23T14:09:11.000000+0000 b7139 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e7a2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002145:[<0x100000022dd/cpuset_memory_pressure_testset.sh v4>,<0x100000022c9/cpuset_memory_pressure_test v100>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002145:[<0x100000022dd/cpuset_memory_pressure_testset.sh v12>,<0x100000022c9/cpuset_memory_pressure_test v213>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1769>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.013 INFO:tasks.workunit.client.0.smithi099.stdout:8/134: creat d1/dd/d11/d29/f2a x:0 0 0 2024-01-31T05:13:08.014 INFO:tasks.workunit.client.0.smithi099.stdout:8/135: write d1/dd/d11/f1e [1377040,68170] 0 2024-01-31T05:13:08.014 INFO:tasks.workunit.client.0.smithi099.stdout:6/52: symlink lf 0 2024-01-31T05:13:08.014 INFO:tasks.workunit.client.0.smithi099.stdout:3/48: chown c9 3828537 1 2024-01-31T05:13:08.014 INFO:tasks.workunit.client.0.smithi099.stdout:8/136: creat d1/dd/f2b x:0 0 0 2024-01-31T05:13:08.014 INFO:tasks.workunit.client.0.smithi099.stdout:8/137: chown d1/dd/d11/d19/f1f 47961 1 2024-01-31T05:13:08.014 INFO:tasks.workunit.client.0.smithi099.stdout:8/138: write d1/dd/d11/d19/f1f [1173963,70105] 0 2024-01-31T05:13:08.014 INFO:tasks.workunit.client.0.smithi099.stdout:8/139: stat d1/dd/ff 0 2024-01-31T05:13:08.014 INFO:tasks.workunit.client.0.smithi099.stdout:2/67: symlink d10/l17 0 2024-01-31T05:13:08.014 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.958+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002274 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_fdreceive.te auth v114 ap=1 s=2111 n(v0 rc2005-04-20T16:09:04.000000+0000 b2111 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510bf080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002274:[<0x10000002419/test_fdreceive.te v46>,<0x10000002418/policy v80>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002274:[<0x10000002419/test_fdreceive.te v114>,<0x10000002418/policy v525>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.014 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.958+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000227e [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_dyntrace.te auth v150 ap=1 s=1610 n(v0 rc2005-04-20T16:09:04.000000+0000 b1610 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510bf600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000227e:[<0x10000002419/test_dyntrace.te v66>,<0x10000002418/policy v80>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000227e:[<0x10000002419/test_dyntrace.te v150>,<0x10000002418/policy v525>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.015 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.974+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022cb [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/cpuinfo.c auth v30 ap=1 s=9602 n(v0 rc2024-01-31T05:12:57.162582+0000 b9602 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e7a0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022cb:[<0x100000022ca/cpuinfo.c v2>,<0x100000022c9/cpuset_lib v24>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022cb:[<0x100000022ca/cpuinfo.c v30>,<0x100000022c9/cpuset_lib v215>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1769>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.015 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.974+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022e0 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_test/Makefile auth v8 ap=1 s=1095 n(v0 rc2024-01-31T05:12:57.196581+0000 b1095 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e7a1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022e0:[<0x100000022df/Makefile v2>,<0x100000022c9/cpuset_memory_test v110>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022e0:[<0x100000022df/Makefile v8>,<0x100000022c9/cpuset_memory_test v205>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1769>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.015 INFO:tasks.workunit.client.0.smithi099.stdout:8/140: truncate d1/dd/d11/d19/f1c 228820 0 2024-01-31T05:13:08.018 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.958+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002278 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_sysctl.te auth v144 ap=1 s=689 n(v0 rc2005-04-20T16:09:04.000000+0000 b689 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510beb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002278:[<0x10000002419/test_sysctl.te v54>,<0x10000002418/policy v80>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002278:[<0x10000002419/test_sysctl.te v144>,<0x10000002418/policy v525>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.019 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.959+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002263 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_ioctl.te auth v86 ap=1 s=830 n(v0 rc2005-04-20T16:09:04.000000+0000 b830 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510bfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002263:[<0x10000002419/test_ioctl.te v12>,<0x10000002418/policy v80>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002263:[<0x10000002419/test_ioctl.te v86>,<0x10000002418/policy v525>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.019 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.959+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002279 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_dyntrans.te auth v154 ap=1 s=751 n(v0 rc2005-04-20T16:09:04.000000+0000 b751 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510c0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002279:[<0x10000002419/test_dyntrans.te v56>,<0x10000002418/policy v80>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002279:[<0x10000002419/test_dyntrans.te v154>,<0x10000002418/policy v525>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.019 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.959+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000226b [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_task_getpgid.te auth v112 ap=1 s=650 n(v0 rc2005-04-20T16:09:04.000000+0000 b650 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510c0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000226b:[<0x10000002419/test_task_getpgid.te v28>,<0x10000002418/policy v80>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000226b:[<0x10000002419/test_task_getpgid.te v112>,<0x10000002418/policy v525>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.019 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.960+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002264 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_task_setsched.te auth v146 ap=1 s=998 n(v0 rc2005-04-20T16:09:05.000000+0000 b998 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510c0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002264:[<0x10000002419/test_task_setsched.te v14>,<0x10000002418/policy v80>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002264:[<0x10000002419/test_task_setsched.te v146>,<0x10000002418/policy v525>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.019 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.960+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000226f [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_file.te auth v120 ap=1 s=2276 n(v0 rc2008-07-15T12:24:56.000000+0000 b2276 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510c1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000226f:[<0x10000002419/test_file.te v36>,<0x10000002418/policy v80>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000226f:[<0x10000002419/test_file.te v120>,<0x10000002418/policy v525>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.019 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.960+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000240f [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/Makefile auth v63 ap=1 s=1038 n(v0 rc2024-01-31T05:12:57.336578+0000 b1038 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851170580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000240f:[<0x1000000240c/Makefile v10>,<0x1000000240b/ima v12>,<0x10000002406/integrity v48>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000240f:[<0x1000000240c/Makefile v63>,<0x1000000240b/ima v29>,<0x10000002406/integrity v191>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.019 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.960+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002266 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_readlink.te auth v136 ap=1 s=898 n(v0 rc2005-04-20T16:09:04.000000+0000 b898 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510c1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002266:[<0x10000002419/test_readlink.te v18>,<0x10000002418/policy v80>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002266:[<0x10000002419/test_readlink.te v136>,<0x10000002418/policy v525>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.019 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.961+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000226a [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_execute_no_trans.te auth v102 ap=1 s=797 n(v0 rc2005-04-20T16:09:04.000000+0000 b797 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510ce000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000226a:[<0x10000002419/test_execute_no_trans.te v26>,<0x10000002418/policy v80>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000226a:[<0x10000002419/test_execute_no_trans.te v102>,<0x10000002418/policy v525>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.019 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.961+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002269 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_stat.te auth v84 ap=1 s=556 n(v0 rc2005-04-20T16:09:04.000000+0000 b556 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510cf080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002269:[<0x10000002419/test_stat.te v24>,<0x10000002418/policy v80>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002269:[<0x10000002419/test_stat.te v84>,<0x10000002418/policy v525>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.019 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.961+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002276 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_open.te auth v148 ap=1 s=848 n(v0 rc2005-04-20T16:09:04.000000+0000 b848 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510ce580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002276:[<0x10000002419/test_open.te v50>,<0x10000002418/policy v80>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002276:[<0x10000002419/test_open.te v148>,<0x10000002418/policy v525>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.019 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.961+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000226c [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_attrib.te auth v142 ap=1 s=948 n(v0 rc2005-04-20T16:09:04.000000+0000 b948 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510ceb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000226c:[<0x10000002419/test_attrib.te v30>,<0x10000002418/policy v80>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000226c:[<0x10000002419/test_attrib.te v142>,<0x10000002418/policy v525>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.020 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.962+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002262 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_ipc.te auth v108 ap=1 s=2595 n(v0 rc2005-04-20T16:09:04.000000+0000 b2595 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510cf600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002262:[<0x10000002419/test_ipc.te v10>,<0x10000002418/policy v80>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002262:[<0x10000002419/test_ipc.te v108>,<0x10000002418/policy v525>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.020 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.962+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000225f [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_task_setpgid.te auth v118 ap=1 s=1403 n(v0 rc2024-01-31T05:12:57.358578+0000 b1403 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510d0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000225f:[<0x10000002419/test_task_setpgid.te v4>,<0x10000002418/policy v80>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000225f:[<0x10000002419/test_task_setpgid.te v118>,<0x10000002418/policy v525>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.020 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.962+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000226d [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_capable_sys.te auth v98 ap=1 s=479 n(v0 rc2005-04-20T16:09:04.000000+0000 b479 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510cfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000226d:[<0x10000002419/test_capable_sys.te v32>,<0x10000002418/policy v80>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000226d:[<0x10000002419/test_capable_sys.te v98>,<0x10000002418/policy v525>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.020 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.962+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002270 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/Makefile auth v116 ap=1 s=1604 n(v0 rc2009-10-09T17:55:51.000000+0000 b1604 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510d1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002270:[<0x10000002419/Makefile v38>,<0x10000002418/policy v80>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002270:[<0x10000002419/Makefile v116>,<0x10000002418/policy v525>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.020 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.963+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002283 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_rxdir.te auth v152 ap=1 s=801 n(v0 rc2005-04-20T16:09:04.000000+0000 b801 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510d0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002283:[<0x10000002419/test_rxdir.te v76>,<0x10000002418/policy v80>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002283:[<0x10000002419/test_rxdir.te v152>,<0x10000002418/policy v525>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.020 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.963+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000227d [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_global.te auth v138 ap=1 s=2673 n(v0 rc2008-07-11T07:08:54.000000+0000 b2673 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510d0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000227d:[<0x10000002419/test_global.te v64>,<0x10000002418/policy v80>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000227d:[<0x10000002419/test_global.te v138>,<0x10000002418/policy v525>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.020 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.963+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002261 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_link.te auth v140 ap=1 s=2232 n(v0 rc2005-04-20T16:09:04.000000+0000 b2232 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510d1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002261:[<0x10000002419/test_link.te v8>,<0x10000002418/policy v80>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002261:[<0x10000002419/test_link.te v140>,<0x10000002418/policy v525>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.020 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.964+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002268 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_ptrace.te auth v128 ap=1 s=905 n(v0 rc2005-04-20T16:09:04.000000+0000 b905 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510d8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002268:[<0x10000002419/test_ptrace.te v22>,<0x10000002418/policy v80>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002268:[<0x10000002419/test_ptrace.te v128>,<0x10000002418/policy v525>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.020 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.964+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002265 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_capable_file.te auth v124 ap=1 s=1645 n(v0 rc2005-11-17T16:10:31.000000+0000 b1645 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510d8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002265:[<0x10000002419/test_capable_file.te v16>,<0x10000002418/policy v80>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002265:[<0x10000002419/test_capable_file.te v124>,<0x10000002418/policy v525>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.020 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.965+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000227c [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_exectrace.te auth v90 ap=1 s=1508 n(v0 rc2005-04-20T16:09:04.000000+0000 b1508 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510d8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000227c:[<0x10000002419/test_exectrace.te v62>,<0x10000002418/policy v80>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000227c:[<0x10000002419/test_exectrace.te v90>,<0x10000002418/policy v525>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.020 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.965+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000226e [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_execshare.te auth v106 ap=1 s=952 n(v0 rc2005-04-20T16:09:04.000000+0000 b952 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510d9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000226e:[<0x10000002419/test_execshare.te v34>,<0x10000002418/policy v80>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000226e:[<0x10000002419/test_execshare.te v106>,<0x10000002418/policy v525>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.020 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.965+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002260 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_setnice.te auth v104 ap=1 s=779 n(v0 rc2005-04-20T16:09:04.000000+0000 b779 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510da680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002260:[<0x10000002419/test_setnice.te v6>,<0x10000002418/policy v80>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002260:[<0x10000002419/test_setnice.te v104>,<0x10000002418/policy v525>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.021 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.966+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000227b [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_setattr.te auth v82 ap=1 s=754 n(v0 rc2005-04-20T16:09:04.000000+0000 b754 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510dac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000227b:[<0x10000002419/test_setattr.te v60>,<0x10000002418/policy v80>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000227b:[<0x10000002419/test_setattr.te v82>,<0x10000002418/policy v525>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.021 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.966+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002275 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_sigkill.te auth v110 ap=1 s=1096 n(v0 rc2005-04-20T16:09:04.000000+0000 b1096 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510d9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002275:[<0x10000002419/test_sigkill.te v48>,<0x10000002418/policy v80>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002275:[<0x10000002419/test_sigkill.te v110>,<0x10000002418/policy v525>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.021 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.966+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002271 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_wait.te auth v88 ap=1 s=926 n(v0 rc2005-04-20T16:09:05.000000+0000 b926 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510d9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002271:[<0x10000002419/test_wait.te v40>,<0x10000002418/policy v80>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002271:[<0x10000002419/test_wait.te v88>,<0x10000002418/policy v525>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.021 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.968+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000227a [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_transition.te auth v134 ap=1 s=758 n(v0 rc2005-11-17T16:10:31.000000+0000 b758 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510db180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000227a:[<0x10000002419/test_transition.te v58>,<0x10000002418/policy v80>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000227a:[<0x10000002419/test_transition.te v134>,<0x10000002418/policy v525>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.021 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.968+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002281 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_task_getsid.te auth v156 ap=1 s=631 n(v0 rc2005-04-20T16:09:04.000000+0000 b631 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510e4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002281:[<0x10000002419/test_task_getsid.te v72>,<0x10000002418/policy v80>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002281:[<0x10000002419/test_task_getsid.te v156>,<0x10000002418/policy v525>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.021 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.968+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002273 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_socket.te auth v132 ap=1 s=4548 n(v0 rc2005-04-20T16:09:04.000000+0000 b4548 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510e4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002273:[<0x10000002419/test_socket.te v44>,<0x10000002418/policy v80>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002273:[<0x10000002419/test_socket.te v132>,<0x10000002418/policy v525>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.021 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.968+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002277 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_relabel.te auth v122 ap=1 s=1215 n(v0 rc2005-04-20T16:09:04.000000+0000 b1215 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510db700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002277:[<0x10000002419/test_relabel.te v52>,<0x10000002418/policy v80>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002277:[<0x10000002419/test_relabel.te v122>,<0x10000002418/policy v525>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.021 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.969+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000241a [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_rename.te auth v80 ap=1 s=4042 n(v0 rc2024-01-31T05:12:57.357578+0000 b4042 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510e4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000241a:[<0x10000002419/test_rename.te v2>,<0x10000002418/policy v80>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000241a:[<0x10000002419/test_rename.te v80>,<0x10000002418/policy v525>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1180>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.021 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.970+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002284 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_inherit.te auth v92 ap=1 s=1711 n(v0 rc2005-04-20T16:09:04.000000+0000 b1711 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510e5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002284:[<0x10000002419/test_inherit.te v78>,<0x10000002418/policy v80>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002284:[<0x10000002419/test_inherit.te v92>,<0x10000002418/policy v525>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.021 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.971+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002566 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/bounds/ auth v643 ap=1 f(v0 m2024-01-31T05:12:57.721569+0000 3=3+0) n(v0 rc2024-01-31T05:12:57.721569+0000 b6212 4=3+1) (inest lock) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850f58580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002566:[<0x1000000251c/bounds v342>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000002566:[<0x1000000251c/bounds v643>,<0x10000002418/tests v509>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.721569+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.721569+0000 b6212 4=3+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.721569+0000 3=3+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.721569+0000 b6212 4=3+1)","error_str":""},"return_code":0} 2024-01-31T05:13:08.021 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.971+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002272 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_entrypoint.te auth v126 ap=1 s=489 n(v0 rc2005-04-20T16:09:04.000000+0000 b489 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510e5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002272:[<0x10000002419/test_entrypoint.te v42>,<0x10000002418/policy v80>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002272:[<0x10000002419/test_entrypoint.te v126>,<0x10000002418/policy v525>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.021 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.971+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002531 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/inherit/ auth v661 ap=1 f(v0 m2024-01-31T05:12:57.456575+0000 4=4+0) n(v0 rc2024-01-31T05:12:57.456575+0000 b6607 5=4+1) (inest lock) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850f58b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002531:[<0x1000000251c/inherit v96>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000002531:[<0x1000000251c/inherit v661>,<0x10000002418/tests v509>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.456575+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.456575+0000 b6607 5=4+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.456575+0000 4=4+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.456575+0000 b6607 5=4+1)","error_str":""},"return_code":0} 2024-01-31T05:13:08.022 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.972+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000254a [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/open/ auth{0=1} v681 ap=1 f(v0 m2024-01-31T05:12:57.674570+0000 4=4+0) n(v0 rc2024-01-31T05:12:57.674570+0000 b6842 5=4+1) (inest mix) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55e850f59080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000254a:[<0x1000000251c/open v222>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x1000000254a:[<0x1000000251c/open v681>,<0x10000002418/tests v509>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.674570+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.674570+0000 b6842 5=4+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.674570+0000 4=4+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.674570+0000 b6842 5=4+1)","error_str":""},"return_code":0} 2024-01-31T05:13:08.022 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.972+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002346 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/runtest.sh auth v515 ap=1 s=2040 n(v0 rc2008-04-06T10:27:36.000000+0000 b2040 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8511be000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002346:[<0x1000000251c/runtest.sh v182>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002346:[<0x1000000251c/runtest.sh v515>,<0x10000002418/tests v509>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.022 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.973+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000254e [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sysctl/ auth{0=1} v557 ap=1 f(v0 m2024-01-31T05:12:57.681570+0000 2=2+0) n(v0 rc2024-01-31T05:12:57.681570+0000 b2922 3=2+1) (inest mix) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55e850ee8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000254e:[<0x1000000251c/sysctl v236>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x1000000254e:[<0x1000000251c/sysctl v557>,<0x10000002418/tests v509>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.681570+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.681570+0000 b2922 3=2+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.681570+0000 2=2+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.681570+0000 b2922 3=2+1)","error_str":""},"return_code":0} 2024-01-31T05:13:08.022 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.974+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000255e [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execshare/ auth v675 ap=1 f(v0 m2024-01-31T05:12:57.707570+0000 4=4+0) n(v0 rc2024-01-31T05:12:57.707570+0000 b6004 5=4+1) (inest lock) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850f59600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000255e:[<0x1000000251c/execshare v306>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x1000000255e:[<0x1000000251c/execshare v675>,<0x10000002418/tests v509>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.707570+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.707570+0000 b6004 5=4+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.707570+0000 4=4+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.707570+0000 b6004 5=4+1)","error_str":""},"return_code":0} 2024-01-31T05:13:08.022 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.974+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002282 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_task_create.te auth v100 ap=1 s=1408 n(v0 rc2005-04-20T16:09:04.000000+0000 b1408 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8510da100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002282:[<0x10000002419/test_task_create.te v74>,<0x10000002418/policy v80>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002282:[<0x10000002419/test_task_create.te v100>,<0x10000002418/policy v525>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.022 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.975+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002521 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sem/ auth{0=1} v619 ap=1 f(v0 m2024-01-31T05:12:57.432576+0000 6=6+0) n(v0 rc2024-01-31T05:12:57.432576+0000 b12737 7=6+1) (inest mix) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55e850f5a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002521:[<0x1000000251c/sem v28>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000002521:[<0x1000000251c/sem v619>,<0x10000002418/tests v509>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.432576+0000 6=6+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.432576+0000 b12737 7=6+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.432576+0000 6=6+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.432576+0000 b12737 7=6+1)","error_str":""},"return_code":0} 2024-01-31T05:13:08.022 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.975+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002527 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/exectrace/ auth v663 ap=1 f(v0 m2024-01-31T05:12:57.442576+0000 4=4+0) n(v0 rc2024-01-31T05:12:57.442576+0000 b6108 5=4+1) (inest lock) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850f59b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002527:[<0x1000000251c/exectrace v56>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000002527:[<0x1000000251c/exectrace v663>,<0x10000002418/tests v509>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.442576+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.442576+0000 b6108 5=4+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.442576+0000 4=4+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.442576+0000 b6108 5=4+1)","error_str":""},"return_code":0} 2024-01-31T05:13:08.022 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.976+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002529 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setattr/ auth v473 ap=1 f(v0 m2024-01-31T05:12:57.445576+0000 2=2+0) n(v0 rc2024-01-31T05:12:57.445576+0000 b3659 3=2+1) (inest lock) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850f5ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002529:[<0x1000000251c/setattr v62>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000002529:[<0x1000000251c/setattr v473>,<0x10000002418/tests v509>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.445576+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.445576+0000 b3659 3=2+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.445576+0000 2=2+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.445576+0000 b3659 3=2+1)","error_str":""},"return_code":0} 2024-01-31T05:13:08.022 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.976+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002536 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setscheduler/ auth{0=1} v705 ap=1 f(v0 m2024-01-31T05:12:57.468575+0000 4=4+0) n(v0 rc2024-01-31T05:12:57.468575+0000 b4183 5=4+1) (inest mix) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55e850f5b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002536:[<0x1000000251c/task_setscheduler v130>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000002536:[<0x1000000251c/task_setscheduler v705>,<0x10000002418/tests v509>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.468575+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.468575+0000 b4183 5=4+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.468575+0000 4=4+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.468575+0000 b4183 5=4+1)","error_str":""},"return_code":0} 2024-01-31T05:13:08.022 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.978+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002540 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setpgid/ auth{0=1} v649 ap=1 f(v0 m2024-01-31T05:12:57.485575+0000 3=3+0) n(v0 rc2024-01-31T05:12:57.485575+0000 b3254 4=3+1) (inest mix) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55e850f5b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002540:[<0x1000000251c/task_setpgid v170>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000002540:[<0x1000000251c/task_setpgid v649>,<0x10000002418/tests v509>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.485575+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.485575+0000 b3254 4=3+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.485575+0000 3=3+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.485575+0000 b3254 4=3+1)","error_str":""},"return_code":0} 2024-01-31T05:13:08.022 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.978+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000255c [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/link/ auth v665 ap=1 f(v0 m2024-01-31T05:12:57.704570+0000 2=2+0) n(v0 rc2024-01-31T05:12:57.704570+0000 b4685 3=2+1) (inest lock) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850f5a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000255c:[<0x1000000251c/link v296>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x1000000255c:[<0x1000000251c/link v665>,<0x10000002418/tests v509>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.704570+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.704570+0000 b4685 3=2+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.704570+0000 2=2+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.704570+0000 b4685 3=2+1)","error_str":""},"return_code":0} 2024-01-31T05:13:08.022 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.978+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002377 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/Makefile.inc auth v555 ap=1 s=1204 n(v0 rc2009-10-09T17:55:51.000000+0000 b1204 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8511be580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002377:[<0x1000000251c/Makefile.inc v360>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002377:[<0x1000000251c/Makefile.inc v555>,<0x10000002418/tests v509>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.023 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.979+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002538 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/mkdir/ auth{0=1} v543 ap=1 f(v0 m2024-01-31T05:12:57.472575+0000 2=2+0) n(v0 rc2024-01-31T05:12:57.472575+0000 b4362 3=2+1) (inest mix) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55e850f6e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002538:[<0x1000000251c/mkdir v136>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000002538:[<0x1000000251c/mkdir v543>,<0x10000002418/tests v509>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.472575+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.472575+0000 b4362 3=2+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.472575+0000 2=2+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.472575+0000 b4362 3=2+1)","error_str":""},"return_code":0} 2024-01-31T05:13:08.023 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.979+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002558 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sigkill/ auth{0=1} v715 ap=1 f(v0 m2024-01-31T05:12:57.697570+0000 3=3+0) n(v0 rc2024-01-31T05:12:57.697570+0000 b8070 4=3+1) (inest mix) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55e850f6e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002558:[<0x1000000251c/sigkill v280>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000002558:[<0x1000000251c/sigkill v715>,<0x10000002418/tests v509>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.697570+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.697570+0000 b8070 4=3+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.697570+0000 3=3+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.697570+0000 b8070 4=3+1)","error_str":""},"return_code":0} 2024-01-31T05:13:08.023 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.980+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002562 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/fdreceive/ auth{0=1} v635 ap=1 f(v0 m2024-01-31T05:12:57.715569+0000 4=4+0) n(v0 rc2024-01-31T05:12:57.715569+0000 b8604 5=4+1) (inest mix) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55e850f6eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002562:[<0x1000000251c/fdreceive v326>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000002562:[<0x1000000251c/fdreceive v635>,<0x10000002418/tests v509>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.715569+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.715569+0000 b8604 5=4+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.715569+0000 4=4+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.715569+0000 b8604 5=4+1)","error_str":""},"return_code":0} 2024-01-31T05:13:08.023 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.980+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002554 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/readlink/ auth{0=1} v517 ap=1 f(v0 m2024-01-31T05:12:57.690570+0000 2=2+0) n(v0 rc2024-01-31T05:12:57.690570+0000 b3356 3=2+1) (inest mix) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55e850f6f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002554:[<0x1000000251c/readlink v258>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000002554:[<0x1000000251c/readlink v517>,<0x10000002418/tests v509>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.690570+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.690570+0000 b3356 3=2+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.690570+0000 2=2+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.690570+0000 b3356 3=2+1)","error_str":""},"return_code":0} 2024-01-31T05:13:08.024 INFO:tasks.workunit.client.0.smithi099.stdout:8/141: rmdir d1/dd/d11/d20 39 2024-01-31T05:13:08.024 INFO:tasks.workunit.client.0.smithi099.stdout:8/142: unlink d1/dd/d11/l13 0 2024-01-31T05:13:08.024 INFO:tasks.workunit.client.0.smithi099.stdout:4/84: dwrite d0/d8/f11 [0,4194304] 0 2024-01-31T05:13:08.024 INFO:tasks.workunit.client.0.smithi099.stdout:7/36: sync 2024-01-31T05:13:08.024 INFO:tasks.workunit.client.0.smithi099.stdout:9/49: sync 2024-01-31T05:13:08.024 INFO:tasks.workunit.client.0.smithi099.stdout:7/37: chown f2 22210082 1 2024-01-31T05:13:08.024 INFO:tasks.workunit.client.0.smithi099.stdout:9/50: dread - d0/d7/fa zero size 2024-01-31T05:13:08.025 INFO:tasks.workunit.client.0.smithi099.stdout:0/57: dwrite d1/d8/fd [0,4194304] 0 2024-01-31T05:13:08.025 INFO:tasks.workunit.client.0.smithi099.stdout:1/49: dread f1 [0,4194304] 0 2024-01-31T05:13:08.025 INFO:tasks.workunit.client.0.smithi099.stdout:5/61: dwrite f3 [4194304,4194304] 0 2024-01-31T05:13:08.025 INFO:tasks.workunit.client.0.smithi099.stdout:5/62: fdatasync f1 0 2024-01-31T05:13:08.025 INFO:tasks.workunit.client.0.smithi099.stdout:5/63: chown f3 69565670 1 2024-01-31T05:13:08.025 INFO:tasks.workunit.client.0.smithi099.stdout:7/38: creat d6/f8 x:0 0 0 2024-01-31T05:13:08.026 INFO:tasks.workunit.client.0.smithi099.stdout:9/51: rmdir d0/d1/d8 0 2024-01-31T05:13:08.029 INFO:tasks.workunit.client.0.smithi099.stdout:0/58: unlink d1/d8/fd 0 2024-01-31T05:13:08.031 INFO:tasks.workunit.client.0.smithi099.stdout:7/39: rename l4 to d6/l9 0 2024-01-31T05:13:08.032 INFO:tasks.workunit.client.0.smithi099.stdout:9/52: creat d0/d1/fc x:0 0 0 2024-01-31T05:13:08.036 INFO:tasks.workunit.client.0.smithi099.stdout:9/53: mknod d0/cd 0 2024-01-31T05:13:08.036 INFO:tasks.workunit.client.0.smithi099.stdout:9/54: creat d0/d1/fe x:0 0 0 2024-01-31T05:13:08.039 INFO:tasks.workunit.client.0.smithi099.stdout:9/55: mkdir d0/df 0 2024-01-31T05:13:08.043 INFO:tasks.workunit.client.0.smithi099.stdout:9/56: creat d0/f10 x:0 0 0 2024-01-31T05:13:08.043 INFO:tasks.workunit.client.0.smithi099.stdout:9/57: chown d0/df 9 1 2024-01-31T05:13:08.043 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:07 smithi099 ceph-mon[31615]: pgmap v401: 97 pgs: 97 active+clean; 69 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.9 MiB/s wr, 1.96k op/s 2024-01-31T05:13:08.045 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:07 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:07.914+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f5d [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns01.c auth v54 ap=1 s=3679 n(v0 rc2009-12-06T20:55:16.000000+0000 b3679 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d9895d7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f5d:[<0x10000002176/pidns01.c v10>,<0x1000000216e/pidns v94>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f5d:[<0x10000002176/pidns01.c v54>,<0x1000000216e/pidns v94>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.045 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:07 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:07.914+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f66 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns20.c auth v64 ap=1 s=6202 n(v0 rc2009-11-03T20:07:35.000000+0000 b6202 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d9895d6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f66:[<0x10000002176/pidns20.c v28>,<0x1000000216e/pidns v94>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f66:[<0x10000002176/pidns20.c v64>,<0x1000000216e/pidns v94>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.045 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:07 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:07.914+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f64 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns03.c auth v46 ap=1 s=4346 n(v0 rc2009-12-06T20:55:16.000000+0000 b4346 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d9895f3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f64:[<0x10000002176/pidns03.c v24>,<0x1000000216e/pidns v94>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f64:[<0x10000002176/pidns03.c v46>,<0x1000000216e/pidns v94>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.045 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:07 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:07.915+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f68 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns05.c auth v50 ap=1 s=6472 n(v0 rc2008-11-27T15:33:55.000000+0000 b6472 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d9895d7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f68:[<0x10000002176/pidns05.c v32>,<0x1000000216e/pidns v94>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f68:[<0x10000002176/pidns05.c v50>,<0x1000000216e/pidns v94>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.045 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:07 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:07.915+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f60 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns17.c auth v38 ap=1 s=3964 n(v0 rc2024-01-31T05:12:56.668594+0000 b3964 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d9895f2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f60:[<0x10000002176/pidns17.c v16>,<0x1000000216e/pidns v94>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f60:[<0x10000002176/pidns17.c v38>,<0x1000000216e/pidns v94>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.045 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:07 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:07.916+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f67 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns16.c auth v56 ap=1 s=4571 n(v0 rc2009-11-03T20:07:35.000000+0000 b4571 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d9895f2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f67:[<0x10000002176/pidns16.c v30>,<0x1000000216e/pidns v94>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f67:[<0x10000002176/pidns16.c v56>,<0x1000000216e/pidns v94>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.045 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:07 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:07.916+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f65 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns04.c auth v48 ap=1 s=4377 n(v0 rc2009-12-06T20:55:16.000000+0000 b4377 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d9895f2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f65:[<0x10000002176/pidns04.c v26>,<0x1000000216e/pidns v94>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f65:[<0x10000002176/pidns04.c v48>,<0x1000000216e/pidns v94>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.045 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:07 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:07.916+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f5a [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns06.c auth v62 ap=1 s=4868 n(v0 rc2008-11-07T09:06:01.000000+0000 b4868 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d9895f3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f5a:[<0x10000002176/pidns06.c v4>,<0x1000000216e/pidns v94>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f5a:[<0x10000002176/pidns06.c v62>,<0x1000000216e/pidns v94>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.045 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:07 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:07.917+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f62 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns31.c auth v66 ap=1 s=8451 n(v0 rc2009-11-14T23:58:26.000000+0000 b8451 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d9895f4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f62:[<0x10000002176/pidns31.c v20>,<0x1000000216e/pidns v94>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f62:[<0x10000002176/pidns31.c v66>,<0x1000000216e/pidns v94>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.045 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:07 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:07.917+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f5e [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/Makefile auth v58 ap=1 s=1751 n(v0 rc2009-11-14T23:58:26.000000+0000 b1751 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d9895f3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f5e:[<0x10000002176/Makefile v12>,<0x1000000216e/pidns v94>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f5e:[<0x10000002176/Makefile v58>,<0x1000000216e/pidns v94>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.046 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:07 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:07.917+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f5c [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns10.c auth v52 ap=1 s=3614 n(v0 rc2009-12-06T20:55:16.000000+0000 b3614 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d9895f5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f5c:[<0x10000002176/pidns10.c v8>,<0x1000000216e/pidns v94>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f5c:[<0x10000002176/pidns10.c v52>,<0x1000000216e/pidns v94>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.046 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:07 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:07.918+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f69 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns30.c auth v42 ap=1 s=8985 n(v0 rc2009-11-14T23:58:26.000000+0000 b8985 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d9895f4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f69:[<0x10000002176/pidns30.c v34>,<0x1000000216e/pidns v94>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f69:[<0x10000002176/pidns30.c v42>,<0x1000000216e/pidns v94>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.046 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:07 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:07.918+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f5f [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/runpidnstest.sh auth v36 ap=1 s=2686 n(v0 rc2009-11-11T15:45:05.000000+0000 b2686 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d9895f4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f5f:[<0x10000002176/runpidnstest.sh v14>,<0x1000000216e/pidns v94>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f5f:[<0x10000002176/runpidnstest.sh v36>,<0x1000000216e/pidns v94>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.046 INFO:tasks.workunit.client.0.smithi099.stdout:3/49: getdents . 0 2024-01-31T05:13:08.046 INFO:tasks.workunit.client.0.smithi099.stdout:3/50: write ff [853678,125494] 0 2024-01-31T05:13:08.046 INFO:tasks.workunit.client.0.smithi099.stdout:3/51: fsync f7 0 2024-01-31T05:13:08.047 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:07 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:07.918+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002177 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns02.c auth v40 ap=1 s=3662 n(v0 rc2024-01-31T05:12:56.667594+0000 b3662 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d9895fa580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002177:[<0x10000002176/pidns02.c v2>,<0x1000000216e/pidns v94>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002177:[<0x10000002176/pidns02.c v40>,<0x1000000216e/pidns v179>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.047 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:07 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:07.918+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f63 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/README auth v44 ap=1 s=2677 n(v0 rc2007-12-28T09:40:55.000000+0000 b2677 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d9895f5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f63:[<0x10000002176/README v22>,<0x1000000216e/pidns v94>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f63:[<0x10000002176/README v44>,<0x1000000216e/pidns v179>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.047 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:07 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:07.919+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f61 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns13.c auth v60 ap=1 s=6733 n(v0 rc2009-11-03T20:07:35.000000+0000 b6733 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d9895fa000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f61:[<0x10000002176/pidns13.c v18>,<0x1000000216e/pidns v94>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f61:[<0x10000002176/pidns13.c v60>,<0x1000000216e/pidns v179>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.048 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:07 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:07.919+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f5b [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns12.c auth v68 ap=1 s=4788 n(v0 rc2009-11-03T20:07:35.000000+0000 b4788 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d9895fab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f5b:[<0x10000002176/pidns12.c v6>,<0x1000000216e/pidns v94>,<0x10000001eda/containers v150>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f5b:[<0x10000002176/pidns12.c v68>,<0x1000000216e/pidns v179>,<0x10000001eda/containers v1188>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.048 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.044+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022ee [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_fdreceive.te auth v136 ap=1 s=2541 n(v0 rc2009-05-11T07:22:27.000000+0000 b2541 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d9895dac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022ee:[<0x1000000241f/test_fdreceive.te v44>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v48>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022ee:[<0x1000000241f/test_fdreceive.te v136>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v93>,<0x10000002418/refpolicy v279>,<0x10000002406/selinux-testsuite v161>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.048 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.045+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022a3 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_mkdir.te auth v102 ap=1 s=2302 n(v0 rc2009-05-11T07:22:28.000000+0000 b2302 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d9895d9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022a3:[<0x1000000241f/test_mkdir.te v22>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v48>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022a3:[<0x1000000241f/test_mkdir.te v102>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v93>,<0x10000002418/refpolicy v279>,<0x10000002406/selinux-testsuite v161>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.048 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.045+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022fa [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_capable_net.te auth v114 ap=1 s=2026 n(v0 rc2009-05-11T07:22:27.000000+0000 b2026 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d9895da100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022fa:[<0x1000000241f/test_capable_net.te v68>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v48>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022fa:[<0x1000000241f/test_capable_net.te v114>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v93>,<0x10000002418/refpolicy v279>,<0x10000002406/selinux-testsuite v161>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.048 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.045+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022f9 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_task_getsched.te auth v110 ap=1 s=1031 n(v0 rc2024-01-31T05:12:57.394577+0000 b1031 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d9895d9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022f9:[<0x1000000241f/test_task_getsched.te v66>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v48>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022f9:[<0x1000000241f/test_task_getsched.te v110>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v93>,<0x10000002418/refpolicy v279>,<0x10000002406/selinux-testsuite v161>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.048 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.045+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022f2 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_sysctl.te auth v108 ap=1 s=870 n(v0 rc2009-05-11T07:22:28.000000+0000 b870 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d9895da680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022f2:[<0x1000000241f/test_sysctl.te v52>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v48>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022f2:[<0x1000000241f/test_sysctl.te v108>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v93>,<0x10000002418/refpolicy v279>,<0x10000002406/selinux-testsuite v161>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.048 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.046+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022f8 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_dyntrace.te auth v94 ap=1 s=1965 n(v0 rc2009-05-11T07:22:27.000000+0000 b1965 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d9895db180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022f8:[<0x1000000241f/test_dyntrace.te v64>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v48>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022f8:[<0x1000000241f/test_dyntrace.te v94>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v93>,<0x10000002418/refpolicy v279>,<0x10000002406/selinux-testsuite v161>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.048 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.046+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000229e [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_ioctl.te auth v144 ap=1 s=1336 n(v0 rc2009-05-11T07:22:28.000000+0000 b1336 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d9895db700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000229e:[<0x1000000241f/test_ioctl.te v12>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v48>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000229e:[<0x1000000241f/test_ioctl.te v144>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v93>,<0x10000002418/refpolicy v279>,<0x10000002406/selinux-testsuite v161>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.048 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.046+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000229f [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_task_setsched.te auth v146 ap=1 s=1307 n(v0 rc2009-05-11T07:22:28.000000+0000 b1307 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d98952a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000229f:[<0x1000000241f/test_task_setsched.te v14>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v48>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000229f:[<0x1000000241f/test_task_setsched.te v146>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v93>,<0x10000002418/refpolicy v279>,<0x10000002406/selinux-testsuite v161>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.048 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.046+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022f3 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_dyntrans.te auth v96 ap=1 s=1178 n(v0 rc2009-05-11T07:22:27.000000+0000 b1178 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d98952a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022f3:[<0x1000000241f/test_dyntrans.te v54>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v48>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022f3:[<0x1000000241f/test_dyntrans.te v96>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v93>,<0x10000002418/refpolicy v279>,<0x10000002406/selinux-testsuite v161>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.048 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.046+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022ea [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_file.te auth v116 ap=1 s=2747 n(v0 rc2009-05-11T07:22:27.000000+0000 b2747 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d98952b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022ea:[<0x1000000241f/test_file.te v36>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v48>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022ea:[<0x1000000241f/test_file.te v116>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v93>,<0x10000002418/refpolicy v279>,<0x10000002406/selinux-testsuite v161>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.049 INFO:tasks.workunit.client.0.smithi099.stdout:9/58: rename d0/f2 to d0/f11 0 2024-01-31T05:13:08.049 INFO:tasks.workunit.client.0.smithi099.stdout:0/59: read d1/f6 [1931064,101834] 0 2024-01-31T05:13:08.049 INFO:tasks.workunit.client.0.smithi099.stdout:0/60: stat d1 0 2024-01-31T05:13:08.051 INFO:tasks.workunit.client.0.smithi099.stdout:6/53: truncate fc 1055278 0 2024-01-31T05:13:08.054 INFO:tasks.workunit.client.0.smithi099.stdout:7/40: fsync d6/f8 0 2024-01-31T05:13:08.055 INFO:tasks.workunit.client.0.smithi099.stdout:7/41: stat d6/l9 0 2024-01-31T05:13:08.055 INFO:tasks.workunit.client.0.smithi099.stdout:7/42: write d6/f7 [2233087,32558] 0 2024-01-31T05:13:08.056 INFO:tasks.workunit.client.0.smithi099.stdout:5/64: dwrite d6/ff [0,4194304] 0 2024-01-31T05:13:08.056 INFO:tasks.workunit.client.0.smithi099.stdout:5/65: readlink d6/le 0 2024-01-31T05:13:08.056 INFO:tasks.workunit.client.0.smithi099.stdout:2/68: dwrite f0 [4194304,4194304] 0 2024-01-31T05:13:08.058 INFO:tasks.workunit.client.0.smithi099.stdout:7/43: rename d6/f8 to d6/fa 0 2024-01-31T05:13:08.058 INFO:tasks.workunit.client.0.smithi099.stdout:7/44: chown d6/f7 10 1 2024-01-31T05:13:08.058 INFO:tasks.workunit.client.0.smithi099.stdout:8/143: dwrite d1/dd/d15/f22 [0,4194304] 0 2024-01-31T05:13:08.058 INFO:tasks.workunit.client.0.smithi099.stdout:3/52: dread f4 [0,4194304] 0 2024-01-31T05:13:08.058 INFO:tasks.workunit.client.0.smithi099.stdout:3/53: stat l6 0 2024-01-31T05:13:08.058 INFO:tasks.workunit.client.0.smithi099.stdout:8/144: fsync d1/dd/d11/f1e 0 2024-01-31T05:13:08.063 INFO:tasks.workunit.client.0.smithi099.stdout:5/66: mknod d6/da/c12 0 2024-01-31T05:13:08.063 INFO:tasks.workunit.client.0.smithi099.stdout:2/69: rmdir d10 39 2024-01-31T05:13:08.064 INFO:tasks.workunit.client.0.smithi099.stdout:7/45: symlink d6/lb 0 2024-01-31T05:13:08.064 INFO:tasks.workunit.client.0.smithi099.stdout:7/46: chown f2 26 1 2024-01-31T05:13:08.064 INFO:tasks.workunit.client.0.smithi099.stdout:7/47: creat d6/fc x:0 0 0 2024-01-31T05:13:08.064 INFO:tasks.workunit.client.0.smithi099.stdout:7/48: read - d6/fc zero size 2024-01-31T05:13:08.065 INFO:tasks.workunit.client.0.smithi099.stdout:3/54: read f4 [2306922,54538] 0 2024-01-31T05:13:08.065 INFO:tasks.workunit.client.0.smithi099.stdout:5/67: creat d6/f13 x:0 0 0 2024-01-31T05:13:08.067 INFO:tasks.workunit.client.0.smithi099.stdout:7/49: mknod d6/cd 0 2024-01-31T05:13:08.068 INFO:tasks.workunit.client.0.smithi099.stdout:3/55: mkdir d10 0 2024-01-31T05:13:08.069 INFO:tasks.workunit.client.0.smithi099.stdout:3/56: symlink d10/l11 0 2024-01-31T05:13:08.083 INFO:tasks.workunit.client.0.smithi099.stdout:7/50: dread f3 [0,4194304] 0 2024-01-31T05:13:08.083 INFO:tasks.workunit.client.0.smithi099.stdout:7/51: write d6/f7 [445115,41703] 0 2024-01-31T05:13:08.085 INFO:tasks.workunit.client.0.smithi099.stdout:7/52: mknod d6/ce 0 2024-01-31T05:13:08.091 INFO:tasks.workunit.client.0.smithi099.stdout:9/59: dwrite d0/f10 [0,4194304] 0 2024-01-31T05:13:08.091 INFO:tasks.workunit.client.0.smithi099.stdout:0/61: dwrite d1/d8/df/f10 [0,4194304] 0 2024-01-31T05:13:08.096 INFO:tasks.workunit.client.0.smithi099.stdout:9/60: symlink d0/l12 0 2024-01-31T05:13:08.101 INFO:tasks.workunit.client.0.smithi099.stdout:0/62: mknod d1/d8/c11 0 2024-01-31T05:13:08.101 INFO:tasks.workunit.client.0.smithi099.stdout:8/145: dwrite d1/dd/f2b [0,4194304] 0 2024-01-31T05:13:08.103 INFO:tasks.workunit.client.0.smithi099.stdout:3/57: dwrite f7 [0,4194304] 0 2024-01-31T05:13:08.103 INFO:tasks.workunit.client.0.smithi099.stdout:5/68: dwrite d6/f11 [0,4194304] 0 2024-01-31T05:13:08.103 INFO:tasks.workunit.client.0.smithi099.stdout:6/54: dwrite fc [0,4194304] 0 2024-01-31T05:13:08.103 INFO:tasks.workunit.client.0.smithi099.stdout:6/55: fsync f7 0 2024-01-31T05:13:08.103 INFO:tasks.workunit.client.0.smithi099.stdout:6/56: creat f10 x:0 0 0 2024-01-31T05:13:08.103 INFO:tasks.workunit.client.0.smithi099.stdout:6/57: creat f11 x:0 0 0 2024-01-31T05:13:08.103 INFO:tasks.workunit.client.0.smithi099.stdout:6/58: write f10 [651047,108627] 0 2024-01-31T05:13:08.104 INFO:tasks.workunit.client.0.smithi099.stdout:6/59: chown l9 49 1 2024-01-31T05:13:08.104 INFO:tasks.workunit.client.0.smithi099.stdout:0/63: creat d1/d8/df/f12 x:0 0 0 2024-01-31T05:13:08.113 INFO:tasks.workunit.client.0.smithi099.stdout:8/146: write d1/f7 [7814390,4825] 0 2024-01-31T05:13:08.113 INFO:tasks.workunit.client.0.smithi099.stdout:7/53: getdents d6 0 2024-01-31T05:13:08.113 INFO:tasks.workunit.client.0.smithi099.stdout:7/54: stat d6/fa 0 2024-01-31T05:13:08.114 INFO:tasks.workunit.client.0.smithi099.stdout:6/60: write fc [629513,51627] 0 2024-01-31T05:13:08.116 INFO:tasks.workunit.client.0.smithi099.stdout:3/58: rename le to d10/l12 0 2024-01-31T05:13:08.119 INFO:tasks.workunit.client.0.smithi099.stdout:8/147: creat d1/dd/d11/d19/d21/f2c x:0 0 0 2024-01-31T05:13:08.120 INFO:tasks.workunit.client.0.smithi099.stdout:8/148: write d1/dd/d11/d19/d21/f2c [1029555,117023] 0 2024-01-31T05:13:08.120 INFO:tasks.workunit.client.0.smithi099.stdout:8/149: readlink d1/la 0 2024-01-31T05:13:08.120 INFO:tasks.workunit.client.0.smithi099.stdout:5/69: dread f4 [0,4194304] 0 2024-01-31T05:13:08.120 INFO:tasks.workunit.client.0.smithi099.stdout:7/55: creat d6/ff x:0 0 0 2024-01-31T05:13:08.122 INFO:tasks.workunit.client.0.smithi099.stdout:6/61: link f1 f12 0 2024-01-31T05:13:08.122 INFO:tasks.workunit.client.0.smithi099.stdout:6/62: write f10 [778432,95122] 0 2024-01-31T05:13:08.122 INFO:tasks.workunit.client.0.smithi099.stdout:6/63: stat l0 0 2024-01-31T05:13:08.123 INFO:tasks.workunit.client.0.smithi099.stdout:3/59: mknod d10/c13 0 2024-01-31T05:13:08.124 INFO:tasks.workunit.client.0.smithi099.stdout:9/61: dwrite d0/f11 [0,4194304] 0 2024-01-31T05:13:08.124 INFO:tasks.workunit.client.0.smithi099.stdout:9/62: write d0/f11 [4508092,4750] 0 2024-01-31T05:13:08.124 INFO:tasks.workunit.client.0.smithi099.stdout:9/63: write d0/d1/fe [371642,55053] 0 2024-01-31T05:13:08.124 INFO:tasks.workunit.client.0.smithi099.stdout:9/64: creat d0/d7/f13 x:0 0 0 2024-01-31T05:13:08.124 INFO:tasks.workunit.client.0.smithi099.stdout:0/64: getdents d1/d8/df 0 2024-01-31T05:13:08.125 INFO:tasks.workunit.client.0.smithi099.stdout:5/70: mkdir d6/da/d14 0 2024-01-31T05:13:08.128 INFO:tasks.workunit.client.0.smithi099.stdout:6/64: rename cd to c13 0 2024-01-31T05:13:08.134 INFO:tasks.workunit.client.0.smithi099.stdout:9/65: rename d0/f11 to d0/d7/f14 0 2024-01-31T05:13:08.134 INFO:tasks.workunit.client.0.smithi099.stdout:9/66: chown d0/d1/fc 253750 1 2024-01-31T05:13:08.138 INFO:tasks.workunit.client.0.smithi099.stdout:0/65: symlink d1/d8/df/l13 0 2024-01-31T05:13:08.138 INFO:tasks.workunit.client.0.smithi099.stdout:0/66: read d1/f6 [319268,44236] 0 2024-01-31T05:13:08.141 INFO:tasks.workunit.client.0.smithi099.stdout:8/150: dwrite d1/dd/d15/f24 [0,4194304] 0 2024-01-31T05:13:08.143 INFO:tasks.workunit.client.0.smithi099.stdout:7/56: mkdir d6/d10 0 2024-01-31T05:13:08.145 INFO:tasks.workunit.client.0.smithi099.stdout:0/67: link d1/d8/df/l13 d1/l14 0 2024-01-31T05:13:08.146 INFO:tasks.workunit.client.0.smithi099.stdout:9/67: read d0/f10 [729235,130731] 0 2024-01-31T05:13:08.147 INFO:tasks.workunit.client.0.smithi099.stdout:9/68: readlink d0/l12 0 2024-01-31T05:13:08.147 INFO:tasks.workunit.client.0.smithi099.stdout:9/69: dread - d0/d7/f13 zero size 2024-01-31T05:13:08.147 INFO:tasks.workunit.client.0.smithi099.stdout:8/151: mknod d1/dd/d15/c2d 0 2024-01-31T05:13:08.147 INFO:tasks.workunit.client.0.smithi099.stdout:5/71: dwrite d6/ff [0,4194304] 0 2024-01-31T05:13:08.148 INFO:tasks.workunit.client.0.smithi099.stdout:7/57: rmdir d6/d10 0 2024-01-31T05:13:08.149 INFO:tasks.workunit.client.0.smithi099.stdout:0/68: creat d1/d8/df/f15 x:0 0 0 2024-01-31T05:13:08.150 INFO:tasks.workunit.client.0.smithi099.stdout:8/152: mkdir d1/dd/d15/d2e 0 2024-01-31T05:13:08.150 INFO:tasks.workunit.client.0.smithi099.stdout:8/153: fsync d1/dd/d11/d29/f2a 0 2024-01-31T05:13:08.151 INFO:tasks.workunit.client.0.smithi099.stdout:5/72: symlink d6/da/d14/l15 0 2024-01-31T05:13:08.152 INFO:tasks.workunit.client.0.smithi099.stdout:7/58: readlink d6/lb 0 2024-01-31T05:13:08.152 INFO:tasks.workunit.client.0.smithi099.stdout:7/59: chown f2 103610475 1 2024-01-31T05:13:08.154 INFO:tasks.workunit.client.0.smithi099.stdout:8/154: symlink d1/dd/d11/d19/d21/l2f 0 2024-01-31T05:13:08.155 INFO:tasks.workunit.client.0.smithi099.stdout:5/73: symlink d6/da/l16 0 2024-01-31T05:13:08.155 INFO:tasks.workunit.client.0.smithi099.stdout:8/155: fsync d1/dd/d11/d19/d21/f2c 0 2024-01-31T05:13:08.155 INFO:tasks.workunit.client.0.smithi099.stdout:7/60: read - d6/fc zero size 2024-01-31T05:13:08.158 INFO:tasks.workunit.client.0.smithi099.stdout:5/74: truncate d6/f10 254646 0 2024-01-31T05:13:08.159 INFO:tasks.workunit.client.0.smithi099.stdout:8/156: link d1/dd/d15/c2d d1/c30 0 2024-01-31T05:13:08.166 INFO:tasks.workunit.client.0.smithi099.stdout:0/69: rmdir d1/d8 39 2024-01-31T05:13:08.168 INFO:tasks.workunit.client.0.smithi099.stdout:0/70: unlink d1/d8/df/l13 0 2024-01-31T05:13:08.176 INFO:tasks.workunit.client.0.smithi099.stdout:5/75: dread d6/f11 [0,4194304] 0 2024-01-31T05:13:08.181 INFO:tasks.workunit.client.0.smithi099.stdout:0/71: dread d1/d8/df/f10 [0,4194304] 0 2024-01-31T05:13:08.183 INFO:tasks.workunit.client.0.smithi099.stdout:0/72: mkdir d1/d16 0 2024-01-31T05:13:08.183 INFO:tasks.workunit.client.0.smithi099.stdout:0/73: chown d1/c7 52507 1 2024-01-31T05:13:08.186 INFO:tasks.workunit.client.0.smithi099.stdout:8/157: read d1/f7 [2313234,98259] 0 2024-01-31T05:13:08.186 INFO:tasks.workunit.client.0.smithi099.stdout:8/158: write d1/dd/d11/d19/d21/f2c [1513076,99968] 0 2024-01-31T05:13:08.188 INFO:tasks.workunit.client.0.smithi099.stdout:0/74: dread d1/d8/df/f10 [0,4194304] 0 2024-01-31T05:13:08.190 INFO:tasks.workunit.client.0.smithi099.stdout:7/61: dwrite d6/fa [0,4194304] 0 2024-01-31T05:13:08.190 INFO:tasks.workunit.client.0.smithi099.stdout:0/75: truncate d1/f6 3885327 0 2024-01-31T05:13:08.193 INFO:tasks.workunit.client.0.smithi099.stdout:7/62: creat d6/f11 x:0 0 0 2024-01-31T05:13:08.197 INFO:tasks.workunit.client.0.smithi099.stdout:8/159: truncate d1/dd/d15/f22 1270938 0 2024-01-31T05:13:08.197 INFO:tasks.workunit.client.0.smithi099.stdout:8/160: readlink d1/l6 0 2024-01-31T05:13:08.197 INFO:tasks.workunit.client.0.smithi099.stdout:5/76: dwrite f4 [0,4194304] 0 2024-01-31T05:13:08.198 INFO:tasks.workunit.client.0.smithi099.stdout:8/161: read d1/dd/d15/f27 [1073872,74427] 0 2024-01-31T05:13:08.198 INFO:tasks.workunit.client.0.smithi099.stdout:8/162: fdatasync d1/dd/d11/d29/f2a 0 2024-01-31T05:13:08.199 INFO:tasks.workunit.client.0.smithi099.stdout:0/76: write d1/f9 [3344313,91481] 0 2024-01-31T05:13:08.200 INFO:tasks.workunit.client.0.smithi099.stdout:8/163: creat d1/dd/d11/f31 x:0 0 0 2024-01-31T05:13:08.203 INFO:tasks.workunit.client.0.smithi099.stdout:0/77: creat d1/d16/f17 x:0 0 0 2024-01-31T05:13:08.203 INFO:tasks.workunit.client.0.smithi099.stdout:0/78: creat d1/d16/f18 x:0 0 0 2024-01-31T05:13:08.203 INFO:tasks.workunit.client.0.smithi099.stdout:7/63: dread d6/fa [0,4194304] 0 2024-01-31T05:13:08.204 INFO:tasks.workunit.client.0.smithi099.stdout:7/64: chown d6/fa 1665765 1 2024-01-31T05:13:08.204 INFO:tasks.workunit.client.0.smithi099.stdout:7/65: dread - d6/fc zero size 2024-01-31T05:13:08.209 INFO:tasks.workunit.client.0.smithi099.stdout:0/79: mknod d1/d8/df/c19 0 2024-01-31T05:13:08.210 INFO:tasks.workunit.client.0.smithi099.stdout:7/66: mkdir d6/d12 0 2024-01-31T05:13:08.210 INFO:tasks.workunit.client.0.smithi099.stdout:7/67: fdatasync d6/f11 0 2024-01-31T05:13:08.210 INFO:tasks.workunit.client.0.smithi099.stdout:7/68: stat d6 0 2024-01-31T05:13:08.211 INFO:tasks.workunit.client.0.smithi099.stdout:7/69: chown d6/f7 81 1 2024-01-31T05:13:08.212 INFO:tasks.workunit.client.0.smithi099.stdout:7/70: truncate d6/f7 3217229 0 2024-01-31T05:13:08.216 INFO:tasks.workunit.client.0.smithi099.stdout:8/164: rmdir d1 39 2024-01-31T05:13:08.218 INFO:tasks.workunit.client.0.smithi099.stdout:5/77: dwrite f4 [0,4194304] 0 2024-01-31T05:13:08.218 INFO:tasks.workunit.client.0.smithi099.stdout:5/78: creat d6/f17 x:0 0 0 2024-01-31T05:13:08.218 INFO:tasks.workunit.client.0.smithi099.stdout:5/79: chown f3 199584173 1 2024-01-31T05:13:08.218 INFO:tasks.workunit.client.0.smithi099.stdout:7/71: mkdir d6/d13 0 2024-01-31T05:13:08.218 INFO:tasks.workunit.client.0.smithi099.stdout:7/72: truncate d6/fc 687162 0 2024-01-31T05:13:08.220 INFO:tasks.workunit.client.0.smithi099.stdout:5/80: truncate d6/ff 1159244 0 2024-01-31T05:13:08.220 INFO:tasks.workunit.client.0.smithi099.stdout:5/81: creat d6/f18 x:0 0 0 2024-01-31T05:13:08.221 INFO:tasks.workunit.client.0.smithi099.stdout:7/73: mknod d6/d12/c14 0 2024-01-31T05:13:08.223 INFO:tasks.workunit.client.0.smithi099.stdout:5/82: creat d6/da/f19 x:0 0 0 2024-01-31T05:13:08.224 INFO:tasks.workunit.client.0.smithi099.stdout:5/83: creat d6/da/d14/f1a x:0 0 0 2024-01-31T05:13:08.237 INFO:tasks.workunit.client.0.smithi099.stdout:8/165: read d1/dd/f2b [543931,118921] 0 2024-01-31T05:13:08.238 INFO:tasks.workunit.client.0.smithi099.stdout:8/166: write d1/dd/d11/d19/f1c [1257226,49020] 0 2024-01-31T05:13:08.240 INFO:tasks.workunit.client.0.smithi099.stdout:8/167: creat d1/dd/d11/f32 x:0 0 0 2024-01-31T05:13:08.240 INFO:tasks.workunit.client.0.smithi099.stdout:8/168: write d1/f10 [1244097,107915] 0 2024-01-31T05:13:08.251 INFO:tasks.workunit.client.0.smithi099.stdout:7/74: dwrite d6/f7 [0,4194304] 0 2024-01-31T05:13:08.264 INFO:tasks.workunit.client.0.smithi099.stdout:5/84: dwrite d6/f10 [0,4194304] 0 2024-01-31T05:13:08.264 INFO:tasks.workunit.client.0.smithi099.stdout:8/169: dwrite d1/dd/d15/f24 [0,4194304] 0 2024-01-31T05:13:08.269 INFO:tasks.workunit.client.0.smithi099.stdout:5/85: mknod d6/c1b 0 2024-01-31T05:13:08.269 INFO:tasks.workunit.client.0.smithi099.stdout:5/86: write f1 [3433527,69728] 0 2024-01-31T05:13:08.270 INFO:tasks.workunit.client.0.smithi099.stdout:8/170: creat d1/dd/d15/d2e/f33 x:0 0 0 2024-01-31T05:13:08.271 INFO:tasks.workunit.client.0.smithi099.stdout:5/87: symlink d6/da/l1c 0 2024-01-31T05:13:08.272 INFO:tasks.workunit.client.0.smithi099.stdout:5/88: truncate f3 6918231 0 2024-01-31T05:13:08.273 INFO:tasks.workunit.client.0.smithi099.stdout:8/171: dread d1/dd/d11/f1e [0,4194304] 0 2024-01-31T05:13:08.275 INFO:tasks.workunit.client.0.smithi099.stdout:8/172: truncate d1/dd/ff 1135568 0 2024-01-31T05:13:08.275 INFO:tasks.workunit.client.0.smithi099.stdout:8/173: stat d1/dd/d11/f32 0 2024-01-31T05:13:08.275 INFO:tasks.workunit.client.0.smithi099.stdout:8/174: dread - d1/dd/d11/f1b zero size 2024-01-31T05:13:08.283 INFO:tasks.workunit.client.0.smithi099.stdout:7/75: dwrite f3 [0,4194304] 0 2024-01-31T05:13:08.283 INFO:tasks.workunit.client.0.smithi099.stdout:7/76: dread - d6/ff zero size 2024-01-31T05:13:08.283 INFO:tasks.workunit.client.0.smithi099.stdout:7/77: fdatasync d6/fc 0 2024-01-31T05:13:08.283 INFO:tasks.workunit.client.0.smithi099.stdout:7/78: fsync d6/fa 0 2024-01-31T05:13:08.289 INFO:tasks.workunit.client.0.smithi099.stdout:5/89: dread d6/f10 [0,4194304] 0 2024-01-31T05:13:08.295 INFO:tasks.workunit.client.0.smithi099.stdout:7/79: dread f2 [0,4194304] 0 2024-01-31T05:13:08.298 INFO:tasks.workunit.client.0.smithi099.stdout:5/90: dread d6/f11 [0,4194304] 0 2024-01-31T05:13:08.302 INFO:tasks.workunit.client.0.smithi099.stdout:8/175: dwrite d1/dd/d11/d19/d21/f2c [0,4194304] 0 2024-01-31T05:13:08.302 INFO:tasks.workunit.client.0.smithi099.stdout:8/176: chown d1/dd/d11/d29/f2a 509 1 2024-01-31T05:13:08.305 INFO:tasks.workunit.client.0.smithi099.stdout:4/85: sync 2024-01-31T05:13:08.305 INFO:tasks.workunit.client.0.smithi099.stdout:1/50: sync 2024-01-31T05:13:08.311 INFO:tasks.workunit.client.0.smithi099.stdout:8/177: getdents d1/dd 0 2024-01-31T05:13:08.315 INFO:tasks.workunit.client.0.smithi099.stdout:1/51: unlink f1 0 2024-01-31T05:13:08.315 INFO:tasks.workunit.client.0.smithi099.stdout:1/52: write d4/f6 [206425,46347] 0 2024-01-31T05:13:08.318 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.047+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022a1 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_readlink.te auth v124 ap=1 s=1251 n(v0 rc2009-05-11T07:22:28.000000+0000 b1251 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d98952b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022a1:[<0x1000000241f/test_readlink.te v18>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v48>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022a1:[<0x1000000241f/test_readlink.te v124>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v93>,<0x10000002418/refpolicy v279>,<0x10000002406/selinux-testsuite v161>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.318 INFO:tasks.workunit.client.0.smithi099.stdout:1/53: mknod d4/cd 0 2024-01-31T05:13:08.321 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.047+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022e6 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_execute_no_trans.te auth v92 ap=1 s=955 n(v0 rc2009-05-11T07:22:27.000000+0000 b955 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d98952bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022e6:[<0x1000000241f/test_execute_no_trans.te v28>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v48>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022e6:[<0x1000000241f/test_execute_no_trans.te v92>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v93>,<0x10000002418/refpolicy v279>,<0x10000002406/selinux-testsuite v161>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.321 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.047+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022e7 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_task_getpgid.te auth v78 ap=1 s=1001 n(v0 rc2009-05-11T07:22:28.000000+0000 b1001 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d98952ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022e7:[<0x1000000241f/test_task_getpgid.te v30>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v48>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022e7:[<0x1000000241f/test_task_getpgid.te v78>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v93>,<0x10000002418/refpolicy v279>,<0x10000002406/selinux-testsuite v161>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.321 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.047+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022f0 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_open.te auth v150 ap=1 s=1154 n(v0 rc2009-05-11T07:22:28.000000+0000 b1154 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d98952c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022f0:[<0x1000000241f/test_open.te v48>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v48>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022f0:[<0x1000000241f/test_open.te v150>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v93>,<0x10000002418/refpolicy v279>,<0x10000002406/selinux-testsuite v161>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.321 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.047+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022e5 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_stat.te auth v130 ap=1 s=864 n(v0 rc2009-05-11T07:22:28.000000+0000 b864 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d98952c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022e5:[<0x1000000241f/test_stat.te v26>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v48>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022e5:[<0x1000000241f/test_stat.te v130>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v93>,<0x10000002418/refpolicy v279>,<0x10000002406/selinux-testsuite v161>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.321 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.048+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000229d [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_ipc.te auth v134 ap=1 s=3187 n(v0 rc2009-05-11T07:22:28.000000+0000 b3187 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d98952cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000229d:[<0x1000000241f/test_ipc.te v10>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v48>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000229d:[<0x1000000241f/test_ipc.te v134>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v93>,<0x10000002418/refpolicy v279>,<0x10000002406/selinux-testsuite v161>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.322 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.048+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022e8 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_capable_sys.te auth v148 ap=1 s=621 n(v0 rc2009-05-11T07:22:27.000000+0000 b621 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d98952d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022e8:[<0x1000000241f/test_capable_sys.te v32>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v48>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022e8:[<0x1000000241f/test_capable_sys.te v148>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v93>,<0x10000002418/refpolicy v279>,<0x10000002406/selinux-testsuite v161>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.322 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.048+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000229a [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_task_setpgid.te auth v82 ap=1 s=1682 n(v0 rc2009-05-11T07:22:28.000000+0000 b1682 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d98952d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000229a:[<0x1000000241f/test_task_setpgid.te v4>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v48>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000229a:[<0x1000000241f/test_task_setpgid.te v82>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v93>,<0x10000002418/refpolicy v279>,<0x10000002406/selinux-testsuite v161>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.322 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.048+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022f7 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_global.te auth v120 ap=1 s=2555 n(v0 rc2009-05-11T07:22:27.000000+0000 b2555 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d989536000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022f7:[<0x1000000241f/test_global.te v62>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v48>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022f7:[<0x1000000241f/test_global.te v120>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v93>,<0x10000002418/refpolicy v279>,<0x10000002406/selinux-testsuite v161>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.322 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.048+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022fd [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_rxdir.te auth v138 ap=1 s=1099 n(v0 rc2009-05-11T07:22:28.000000+0000 b1099 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d989536580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022fd:[<0x1000000241f/test_rxdir.te v74>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v48>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022fd:[<0x1000000241f/test_rxdir.te v138>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v93>,<0x10000002418/refpolicy v279>,<0x10000002406/selinux-testsuite v161>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.322 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.048+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022eb [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/Makefile auth v122 ap=1 s=1158 n(v0 rc2009-05-12T06:05:36.000000+0000 b1158 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d989536b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022eb:[<0x1000000241f/Makefile v38>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v48>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022eb:[<0x1000000241f/Makefile v122>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v93>,<0x10000002418/refpolicy v279>,<0x10000002406/selinux-testsuite v161>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.322 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.048+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000229c [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_link.te auth v80 ap=1 s=2781 n(v0 rc2009-05-11T07:22:28.000000+0000 b2781 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d989537080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000229c:[<0x1000000241f/test_link.te v8>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v48>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000229c:[<0x1000000241f/test_link.te v80>,<0x1000000241e/5 v81>,<0x1000000241c/redhat v93>,<0x10000002418/refpolicy v279>,<0x10000002406/selinux-testsuite v161>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.322 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.049+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022a0 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_capable_file.te auth v126 ap=1 s=2148 n(v0 rc2009-05-11T07:22:27.000000+0000 b2148 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d989537b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022a0:[<0x1000000241f/test_capable_file.te v16>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v48>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022a0:[<0x1000000241f/test_capable_file.te v126>,<0x1000000241e/5 v81>,<0x1000000241c/redhat v93>,<0x10000002418/refpolicy v279>,<0x10000002406/selinux-testsuite v161>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.322 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.049+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022ef [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_sigkill.te auth v142 ap=1 s=1666 n(v0 rc2009-05-11T07:22:28.000000+0000 b1666 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d989538680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022ef:[<0x1000000241f/test_sigkill.te v46>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v48>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022ef:[<0x1000000241f/test_sigkill.te v142>,<0x1000000241e/5 v81>,<0x1000000241c/redhat v93>,<0x10000002418/refpolicy v279>,<0x10000002406/selinux-testsuite v161>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.322 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.049+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022e9 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_execshare.te auth v86 ap=1 s=1915 n(v0 rc2009-05-11T07:22:27.000000+0000 b1915 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d989538c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022e9:[<0x1000000241f/test_execshare.te v34>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v48>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022e9:[<0x1000000241f/test_execshare.te v86>,<0x1000000241e/5 v81>,<0x1000000241c/redhat v93>,<0x10000002418/refpolicy v279>,<0x10000002406/selinux-testsuite v161>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.322 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.050+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022a4 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_ptrace.te auth v132 ap=1 s=1333 n(v0 rc2024-01-31T05:12:57.393577+0000 b1333 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d989537600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022a4:[<0x1000000241f/test_ptrace.te v24>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v48>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022a4:[<0x1000000241f/test_ptrace.te v132>,<0x1000000241e/5 v81>,<0x1000000241c/redhat v93>,<0x10000002418/refpolicy v279>,<0x10000002406/selinux-testsuite v161>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.322 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.050+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022ec [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_wait.te auth v118 ap=1 s=1497 n(v0 rc2009-05-11T07:22:28.000000+0000 b1497 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d989539180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022ec:[<0x1000000241f/test_wait.te v40>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v48>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022ec:[<0x1000000241f/test_wait.te v118>,<0x1000000241e/5 v81>,<0x1000000241c/redhat v93>,<0x10000002418/refpolicy v279>,<0x10000002406/selinux-testsuite v161>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.322 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.050+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022fc [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_task_create.te auth v100 ap=1 s=2000 n(v0 rc2009-05-11T07:22:28.000000+0000 b2000 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d989539700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022fc:[<0x1000000241f/test_task_create.te v72>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v48>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022fc:[<0x1000000241f/test_task_create.te v100>,<0x1000000241e/5 v81>,<0x1000000241c/redhat v93>,<0x10000002418/refpolicy v279>,<0x10000002406/selinux-testsuite v161>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.323 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.050+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000229b [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_setnice.te auth v152 ap=1 s=2022 n(v0 rc2009-05-11T07:22:28.000000+0000 b2022 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d989540000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000229b:[<0x1000000241f/test_setnice.te v6>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v48>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000229b:[<0x1000000241f/test_setnice.te v152>,<0x1000000241e/5 v81>,<0x1000000241c/redhat v93>,<0x10000002418/refpolicy v279>,<0x10000002406/selinux-testsuite v161>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.323 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.050+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022f5 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_setattr.te auth v98 ap=1 s=1006 n(v0 rc2009-05-11T07:22:28.000000+0000 b1006 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d989540580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022f5:[<0x1000000241f/test_setattr.te v58>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v48>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022f5:[<0x1000000241f/test_setattr.te v98>,<0x1000000241e/5 v81>,<0x1000000241c/redhat v93>,<0x10000002418/refpolicy v279>,<0x10000002406/selinux-testsuite v161>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.323 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.051+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022f1 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_relabel.te auth v106 ap=1 s=1701 n(v0 rc2009-05-11T07:22:28.000000+0000 b1701 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d989541080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022f1:[<0x1000000241f/test_relabel.te v50>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v48>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022f1:[<0x1000000241f/test_relabel.te v106>,<0x1000000241e/5 v81>,<0x1000000241c/redhat v93>,<0x10000002418/refpolicy v279>,<0x10000002406/selinux-testsuite v161>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.323 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.051+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022f4 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_transition.te auth v84 ap=1 s=1337 n(v0 rc2009-05-11T07:22:28.000000+0000 b1337 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d989540b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022f4:[<0x1000000241f/test_transition.te v56>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v48>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022f4:[<0x1000000241f/test_transition.te v84>,<0x1000000241e/5 v81>,<0x1000000241c/redhat v93>,<0x10000002418/refpolicy v279>,<0x10000002406/selinux-testsuite v161>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.323 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.051+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022fb [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_task_getsid.te auth v88 ap=1 s=971 n(v0 rc2009-05-11T07:22:28.000000+0000 b971 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d989541600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022fb:[<0x1000000241f/test_task_getsid.te v70>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v48>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022fb:[<0x1000000241f/test_task_getsid.te v88>,<0x1000000241e/5 v81>,<0x1000000241c/redhat v93>,<0x10000002418/refpolicy v279>,<0x10000002406/selinux-testsuite v161>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.323 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.051+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002420 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_rename.te auth v128 ap=1 s=4810 n(v0 rc2024-01-31T05:12:57.392577+0000 b4810 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d989541b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002420:[<0x1000000241f/test_rename.te v2>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v48>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002420:[<0x1000000241f/test_rename.te v128>,<0x1000000241e/5 v81>,<0x1000000241c/redhat v93>,<0x10000002418/refpolicy v279>,<0x10000002406/selinux-testsuite v161>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.323 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.051+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022a2 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_policy.if auth v90 ap=1 s=702 n(v0 rc2009-05-11T07:22:28.000000+0000 b702 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d989542680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022a2:[<0x1000000241f/test_policy.if v20>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v48>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022a2:[<0x1000000241f/test_policy.if v90>,<0x1000000241e/5 v81>,<0x1000000241c/redhat v93>,<0x10000002418/refpolicy v279>,<0x10000002406/selinux-testsuite v161>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.323 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.052+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022fe [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_inherit.te auth v104 ap=1 s=2704 n(v0 rc2009-05-11T07:22:28.000000+0000 b2704 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d989542c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022fe:[<0x1000000241f/test_inherit.te v76>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v48>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022fe:[<0x1000000241f/test_inherit.te v104>,<0x1000000241e/5 v81>,<0x1000000241c/redhat v93>,<0x10000002418/refpolicy v279>,<0x10000002406/selinux-testsuite v161>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.323 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.052+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022ed [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_entrypoint.te auth v112 ap=1 s=612 n(v0 rc2009-05-11T07:22:27.000000+0000 b612 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d989542100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022ed:[<0x1000000241f/test_entrypoint.te v42>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v48>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022ed:[<0x1000000241f/test_entrypoint.te v112>,<0x1000000241e/5 v81>,<0x1000000241c/redhat v93>,<0x10000002418/refpolicy v279>,<0x10000002406/selinux-testsuite v161>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.323 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.058+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022f6 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_exectrace.te auth v140 ap=1 s=2339 n(v0 rc2009-05-11T07:22:27.000000+0000 b2339 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d989538100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022f6:[<0x1000000241f/test_exectrace.te v60>,<0x1000000241e/5 v78>,<0x1000000241c/redhat v48>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022f6:[<0x1000000241f/test_exectrace.te v140>,<0x1000000241e/5 v83>,<0x1000000241c/redhat v93>,<0x10000002418/refpolicy v279>,<0x10000002406/selinux-testsuite v161>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.323 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.093+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001bd9 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/plan.txt auth v51 ap=1 s=4787 n(v0 rc2005-06-03T16:36:37.000000+0000 b4787 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d989555b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001bd9:[<0x10000001d9a/plan.txt v26>,<0x10000001d95/timers v54>,<0x100000012a8/functional v46>,<0x10000000204/open_posix_testsuite v502>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001bd9:[<0x10000001d9a/plan.txt v51>,<0x10000001d95/timers v87>,<0x100000012a8/functional v145>,<0x10000000204/open_posix_testsuite v879>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.323 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.093+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d9e [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers/ auth v53 ap=1 f(v0 m2024-01-31T05:12:55.908611+0000 3=3+0) n(v0 rc2024-01-31T05:12:55.908611+0000 b6246 4=3+1) (inest lock) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15315 | lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d989556680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001d9e:[<0x10000001d9a/timers v22>,<0x10000001d95/timers v54>,<0x100000012a8/functional v46>,<0x10000000204/open_posix_testsuite v502>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000001d9e:[<0x10000001d9a/timers v53>,<0x10000001d95/timers v87>,<0x100000012a8/functional v145>,<0x10000000204/open_posix_testsuite v879>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:55.908611+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:55.908611+0000 b6246 4=3+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:55.908611+0000 3=3+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:55.908611+0000 b6246 4=3+1)","error_str":""},"return_code":0} 2024-01-31T05:13:08.324 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.093+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001bd8 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/run.sh auth v49 ap=1 s=1209 n(v0 rc2007-07-26T12:02:16.000000+0000 b1209 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d989556100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001bd8:[<0x10000001d9a/run.sh v24>,<0x10000001d95/timers v54>,<0x100000012a8/functional v46>,<0x10000000204/open_posix_testsuite v502>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001bd8:[<0x10000001d9a/run.sh v49>,<0x10000001d95/timers v87>,<0x100000012a8/functional v145>,<0x10000000204/open_posix_testsuite v879>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.324 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.094+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d9b [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/coverage.txt auth v39 ap=1 s=172 n(v0 rc2024-01-31T05:12:55.903611+0000 b172 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d989556c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d9b:[<0x10000001d9a/coverage.txt v2>,<0x10000001d95/timers v54>,<0x100000012a8/functional v46>,<0x10000000204/open_posix_testsuite v502>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001d9b:[<0x10000001d9a/coverage.txt v39>,<0x10000001d95/timers v87>,<0x100000012a8/functional v145>,<0x10000000204/open_posix_testsuite v879>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.324 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.094+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001bd2 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/Makefile auth v35 ap=1 s=366 n(v0 rc2005-06-03T16:36:37.000000+0000 b366 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d989557180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001bd2:[<0x10000001d9a/Makefile v4>,<0x10000001d95/timers v54>,<0x100000012a8/functional v46>,<0x10000000204/open_posix_testsuite v502>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001bd2:[<0x10000001d9a/Makefile v35>,<0x10000001d95/timers v87>,<0x100000012a8/functional v145>,<0x10000000204/open_posix_testsuite v879>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.324 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.094+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001bd3 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/assertions.xml auth v43 ap=1 s=3672 n(v0 rc2005-06-03T16:36:37.000000+0000 b3672 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d989557700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001bd3:[<0x10000001d9a/assertions.xml v6>,<0x10000001d95/timers v54>,<0x100000012a8/functional v46>,<0x10000000204/open_posix_testsuite v502>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001bd3:[<0x10000001d9a/assertions.xml v43>,<0x10000001d95/timers v87>,<0x100000012a8/functional v145>,<0x10000000204/open_posix_testsuite v879>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.324 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.094+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d9c [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks/ auth v45 ap=1 f(v0 m2024-01-31T05:12:55.905611+0000 3=3+0) n(v0 rc2024-01-31T05:12:55.906611+0000 b5981 4=3+1) (inest lock) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15315 | lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d98957a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001d9c:[<0x10000001d9a/clocks v14>,<0x10000001d95/timers v54>,<0x100000012a8/functional v46>,<0x10000000204/open_posix_testsuite v502>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000001d9c:[<0x10000001d9a/clocks v45>,<0x10000001d95/timers v87>,<0x100000012a8/functional v145>,<0x10000000204/open_posix_testsuite v879>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:55.905611+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:55.906611+0000 b5981 4=3+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:55.905611+0000 3=3+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:55.906611+0000 b5981 4=3+1)","error_str":""},"return_code":0} 2024-01-31T05:13:08.324 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.094+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001bd7 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers/twoptimers.c auth v10 ap=1 s=3141 n(v0 rc2005-06-03T16:36:58.000000+0000 b3141 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d98957a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001bd7:[<0x10000001d9e/twoptimers.c v6>,<0x10000001d9a/timers v22>,<0x10000001d95/timers v54>,<0x100000012a8/functional v46>,<0x10000000204/open_posix_testsuite v502>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001bd7:[<0x10000001d9e/twoptimers.c v10>,<0x10000001d9a/timers v53>,<0x10000001d95/timers v87>,<0x100000012a8/functional v145>,<0x10000000204/open_posix_testsuite v879>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.324 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.094+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001bd6 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers/twoevtimers.c auth v12 ap=1 s=2620 n(v0 rc2005-06-03T16:36:58.000000+0000 b2620 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d98957b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001bd6:[<0x10000001d9e/twoevtimers.c v4>,<0x10000001d9a/timers v22>,<0x10000001d95/timers v54>,<0x100000012a8/functional v46>,<0x10000000204/open_posix_testsuite v502>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001bd6:[<0x10000001d9e/twoevtimers.c v12>,<0x10000001d9a/timers v53>,<0x10000001d95/timers v87>,<0x100000012a8/functional v145>,<0x10000000204/open_posix_testsuite v879>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.324 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.095+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001bd5 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks/invaliddates.c auth v10 ap=1 s=2879 n(v0 rc2024-01-31T05:12:55.906611+0000 b2879 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d98957b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001bd5:[<0x10000001d9c/invaliddates.c v6>,<0x10000001d9a/clocks v14>,<0x10000001d95/timers v54>,<0x100000012a8/functional v46>,<0x10000000204/open_posix_testsuite v502>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001bd5:[<0x10000001d9c/invaliddates.c v10>,<0x10000001d9a/clocks v45>,<0x10000001d95/timers v87>,<0x100000012a8/functional v145>,<0x10000000204/open_posix_testsuite v879>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.324 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.095+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d9d [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks/Makefile auth v12 ap=1 s=527 n(v0 rc2007-07-26T12:02:16.000000+0000 b527 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d98957bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d9d:[<0x10000001d9c/Makefile v2>,<0x10000001d9a/clocks v14>,<0x10000001d95/timers v54>,<0x100000012a8/functional v46>,<0x10000000204/open_posix_testsuite v502>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001d9d:[<0x10000001d9c/Makefile v12>,<0x10000001d9a/clocks v45>,<0x10000001d95/timers v87>,<0x100000012a8/functional v145>,<0x10000000204/open_posix_testsuite v879>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.324 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.095+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d9f [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers/Makefile auth v8 ap=1 s=485 n(v0 rc2024-01-31T05:12:55.908611+0000 b485 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d98957ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d9f:[<0x10000001d9e/Makefile v2>,<0x10000001d9a/timers v22>,<0x10000001d95/timers v54>,<0x100000012a8/functional v46>,<0x10000000204/open_posix_testsuite v502>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001d9f:[<0x10000001d9e/Makefile v8>,<0x10000001d9a/timers v53>,<0x10000001d95/timers v87>,<0x100000012a8/functional v145>,<0x10000000204/open_posix_testsuite v879>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.324 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.095+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001bd4 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks/twopsetclock.c auth v8 ap=1 s=2575 n(v0 rc2005-06-03T16:36:57.000000+0000 b2575 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d98957c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001bd4:[<0x10000001d9c/twopsetclock.c v4>,<0x10000001d9a/clocks v14>,<0x10000001d95/timers v54>,<0x100000012a8/functional v46>,<0x10000000204/open_posix_testsuite v502>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001bd4:[<0x10000001d9c/twopsetclock.c v8>,<0x10000001d9a/clocks v45>,<0x10000001d95/timers v87>,<0x100000012a8/functional v145>,<0x10000000204/open_posix_testsuite v879>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.325 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.980+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000253e [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrace/ auth{0=1} v713 ap=1 f(v0 m2024-01-31T05:12:57.481575+0000 4=4+0) n(v0 rc2024-01-31T05:12:57.481575+0000 b6108 5=4+1) (inest mix) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55e850f6f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000253e:[<0x1000000251c/dyntrace v162>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x1000000253e:[<0x1000000251c/dyntrace v713>,<0x10000002418/tests v509>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.481575+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.481575+0000 b6108 5=4+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.481575+0000 4=4+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.481575+0000 b6108 5=4+1)","error_str":""},"return_code":0} 2024-01-31T05:13:08.326 INFO:tasks.workunit.client.0.smithi099.stdout:1/54: symlink d4/dc/le 0 2024-01-31T05:13:08.326 INFO:tasks.workunit.client.0.smithi099.stdout:1/55: mkdir d4/df 0 2024-01-31T05:13:08.326 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.975+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022de [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_pressure_test/Makefile auth v10 ap=1 s=1081 n(v0 rc2009-10-09T17:55:47.000000+0000 b1081 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e7a3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022de:[<0x100000022dd/Makefile v2>,<0x100000022c9/cpuset_memory_pressure_test v100>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022de:[<0x100000022dd/Makefile v10>,<0x100000022c9/cpuset_memory_pressure_test v213>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1769>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.326 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.975+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002146 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_pressure_test/cpuset_memory_pressure.c auth v8 ap=1 s=2689 n(v0 rc2009-11-05T09:56:21.000000+0000 b2689 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e7a3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002146:[<0x100000022dd/cpuset_memory_pressure.c v6>,<0x100000022c9/cpuset_memory_pressure_test v100>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002146:[<0x100000022dd/cpuset_memory_pressure.c v8>,<0x100000022c9/cpuset_memory_pressure_test v213>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1769>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.326 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.975+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022d4 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_exclusive_test/cpuset_exclusive_test.sh auth v6 ap=1 s=7698 n(v0 rc2024-01-31T05:12:57.179582+0000 b7698 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e7a2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022d4:[<0x100000022d3/cpuset_exclusive_test.sh v2>,<0x100000022c9/cpuset_exclusive_test v62>,<0x100000022c5/cpuset v50>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022d4:[<0x100000022d3/cpuset_exclusive_test.sh v6>,<0x100000022c9/cpuset_exclusive_test v219>,<0x100000022c5/cpuset v460>,<0x10000001eda/controllers v1769>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.326 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.975+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021d3 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/regression/memcg_regression_test.sh auth v16 ap=1 s=6549 n(v0 rc2009-09-14T07:14:25.000000+0000 b6549 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e710000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021d3:[<0x100000023e7/memcg_regression_test.sh v8>,<0x100000023e6/regression v14>,<0x100000022c5/memcg v180>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021d3:[<0x100000023e7/memcg_regression_test.sh v16>,<0x100000023e6/regression v63>,<0x100000022c5/memcg v522>,<0x10000001eda/controllers v1769>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.326 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.981+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000251f [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_file/ auth{0=1} v659 ap=1 f(v0 m2024-01-31T05:12:57.428576+0000 3=3+0) n(v0 rc2024-01-31T05:12:57.428576+0000 b6704 4=3+1) (inest mix) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55e850f6fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000251f:[<0x1000000251c/capable_file v14>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x1000000251f:[<0x1000000251c/capable_file v659>,<0x10000002418/tests v509>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.428576+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.428576+0000 b6704 4=3+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.428576+0000 3=3+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.428576+0000 b6704 4=3+1)","error_str":""},"return_code":0} 2024-01-31T05:13:08.327 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.981+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000252f [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execute_no_trans/ auth v631 ap=1 f(v0 m2024-01-31T05:12:57.454575+0000 2=2+0) n(v0 rc2024-01-31T05:12:57.454575+0000 b3042 3=2+1) (inest lock) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850f70100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000252f:[<0x1000000251c/execute_no_trans v86>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x1000000252f:[<0x1000000251c/execute_no_trans v631>,<0x10000002418/tests v509>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.454575+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.454575+0000 b3042 3=2+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.454575+0000 2=2+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.454575+0000 b3042 3=2+1)","error_str":""},"return_code":0} 2024-01-31T05:13:08.327 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.976+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021d4 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/regression/memcg_test_2.c auth v18 ap=1 s=2267 n(v0 rc2009-09-14T07:14:25.000000+0000 b2267 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e710580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021d4:[<0x100000023e7/memcg_test_2.c v10>,<0x100000023e6/regression v14>,<0x100000022c5/memcg v180>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021d4:[<0x100000023e7/memcg_test_2.c v18>,<0x100000023e6/regression v63>,<0x100000022c5/memcg v522>,<0x10000001eda/controllers v1769>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.327 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.976+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000023e8 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/regression/memcg_test_4.c auth v14 ap=1 s=2436 n(v0 rc2024-01-31T05:12:57.233581+0000 b2436 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e710b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000023e8:[<0x100000023e7/memcg_test_4.c v2>,<0x100000023e6/regression v14>,<0x100000022c5/memcg v180>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000023e8:[<0x100000023e7/memcg_test_4.c v14>,<0x100000023e6/regression v63>,<0x100000022c5/memcg v522>,<0x10000001eda/controllers v1769>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.327 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.981+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002523 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/shm/ auth v647 ap=1 f(v0 m2024-01-31T05:12:57.436576+0000 5=5+0) n(v0 rc2024-01-31T05:12:57.436576+0000 b10284 6=5+1) (inest lock) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850f70680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002523:[<0x1000000251c/shm v40>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000002523:[<0x1000000251c/shm v647>,<0x10000002418/tests v509>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.436576+0000 5=5+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.436576+0000 b10284 6=5+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.436576+0000 5=5+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.436576+0000 b10284 6=5+1)","error_str":""},"return_code":0} 2024-01-31T05:13:08.327 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.982+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002544 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/ auth{0=1} v695 ap=1 f(v0 m2024-01-31T05:12:57.492575+0000 6=6+0) n(v0 rc2024-01-31T05:12:57.492575+0000 b8062 7=6+1) (inest mix) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55e850f70c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002544:[<0x1000000251c/capable_sys v196>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000002544:[<0x1000000251c/capable_sys v695>,<0x10000002418/tests v509>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.492575+0000 6=6+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.492575+0000 b8062 7=6+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.492575+0000 6=6+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.492575+0000 b8062 7=6+1)","error_str":""},"return_code":0} 2024-01-31T05:13:08.328 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.976+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021d5 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/regression/memcg_test_1.c auth v20 ap=1 s=2426 n(v0 rc2009-09-14T07:14:25.000000+0000 b2426 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e711600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021d5:[<0x100000023e7/memcg_test_1.c v12>,<0x100000023e6/regression v14>,<0x100000022c5/memcg v180>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021d5:[<0x100000023e7/memcg_test_1.c v20>,<0x100000023e6/regression v63>,<0x100000022c5/memcg v522>,<0x10000001eda/controllers v1769>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.328 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.977+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021d8 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/functional/memcg_function_test.sh auth v10 ap=1 s=11781 n(v0 rc2009-10-26T14:49:23.000000+0000 b11781 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e712100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021d8:[<0x100000023ea/memcg_function_test.sh v8>,<0x100000023e6/functional v26>,<0x100000022c5/memcg v180>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021d8:[<0x100000023ea/memcg_function_test.sh v10>,<0x100000023e6/functional v65>,<0x100000022c5/memcg v522>,<0x10000001eda/controllers v1769>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.328 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.982+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002533 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/ auth v711 ap=1 f(v0 m2024-01-31T05:12:57.460575+0000 10=10+0) n(v0 rc2024-01-31T05:12:57.460575+0000 b19135 11=10+1) (inest lock) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850f71180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002533:[<0x1000000251c/file v118>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000002533:[<0x1000000251c/file v711>,<0x10000002418/tests v509>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.460575+0000 10=10+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.460575+0000 b19135 11=10+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.460575+0000 10=10+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.460575+0000 b19135 11=10+1)","error_str":""},"return_code":0} 2024-01-31T05:13:08.328 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.982+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002546 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getpgid/ auth{0=1} v687 ap=1 f(v0 m2024-01-31T05:12:57.668571+0000 4=4+0) n(v0 rc2024-01-31T05:12:57.668571+0000 b3797 5=4+1) (inest mix) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55e850f71700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002546:[<0x1000000251c/task_getpgid v206>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000002546:[<0x1000000251c/task_getpgid v687>,<0x10000002418/tests v509>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.668571+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.668571+0000 b3797 5=4+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.668571+0000 4=4+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.668571+0000 b3797 5=4+1)","error_str":""},"return_code":0} 2024-01-31T05:13:08.329 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.977+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021d6 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/functional/Makefile auth v14 ap=1 s=1068 n(v0 rc2009-10-09T17:55:47.000000+0000 b1068 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e712c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021d6:[<0x100000023ea/Makefile v4>,<0x100000023e6/functional v26>,<0x100000022c5/memcg v180>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021d6:[<0x100000023ea/Makefile v14>,<0x100000023e6/functional v65>,<0x100000022c5/memcg v522>,<0x10000001eda/controllers v1769>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.329 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.977+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021d2 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/regression/Makefile auth v24 ap=1 s=1119 n(v0 rc2009-10-09T17:55:47.000000+0000 b1119 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e711080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021d2:[<0x100000023e7/Makefile v6>,<0x100000023e6/regression v14>,<0x100000022c5/memcg v180>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021d2:[<0x100000023e7/Makefile v24>,<0x100000023e6/regression v63>,<0x100000022c5/memcg v522>,<0x10000001eda/controllers v1769>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.329 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.977+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021d1 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/regression/memcg_test_4.sh auth v22 ap=1 s=2148 n(v0 rc2009-09-14T07:14:25.000000+0000 b2148 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e711b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021d1:[<0x100000023e7/memcg_test_4.sh v4>,<0x100000023e6/regression v14>,<0x100000022c5/memcg v180>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021d1:[<0x100000023e7/memcg_test_4.sh v22>,<0x100000023e6/regression v63>,<0x100000022c5/memcg v522>,<0x10000001eda/controllers v1769>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.329 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.977+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021d7 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/functional/memcg_getpagesize.c auth v12 ap=1 s=1805 n(v0 rc2009-09-14T07:14:25.000000+0000 b1805 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e713180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021d7:[<0x100000023ea/memcg_getpagesize.c v6>,<0x100000023e6/functional v26>,<0x100000022c5/memcg v180>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021d7:[<0x100000023ea/memcg_getpagesize.c v12>,<0x100000023e6/functional v65>,<0x100000022c5/memcg v522>,<0x10000001eda/controllers v1769>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.329 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:07.979+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000023eb [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/functional/memcg_process.c auth v16 ap=1 s=7320 n(v0 rc2024-01-31T05:12:57.238580+0000 b7320 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e712680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000023eb:[<0x100000023ea/memcg_process.c v2>,<0x100000023e6/functional v26>,<0x100000022c5/memcg v180>,<0x10000001eda/controllers v242>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000023eb:[<0x100000023ea/memcg_process.c v16>,<0x100000023e6/functional v65>,<0x100000022c5/memcg v522>,<0x10000001eda/controllers v1769>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.332 INFO:tasks.workunit.client.0.smithi099.stdout:5/91: dwrite d6/f11 [0,4194304] 0 2024-01-31T05:13:08.332 INFO:tasks.workunit.client.0.smithi099.stdout:5/92: fsync d6/fd 0 2024-01-31T05:13:08.332 INFO:tasks.workunit.client.0.smithi099.stdout:5/93: symlink d6/da/d14/l1d 0 2024-01-31T05:13:08.332 INFO:tasks.workunit.client.0.smithi099.stdout:5/94: mkdir d6/d1e 0 2024-01-31T05:13:08.332 INFO:tasks.workunit.client.0.smithi099.stdout:7/80: dwrite f2 [0,4194304] 0 2024-01-31T05:13:08.333 INFO:tasks.workunit.client.0.smithi099.stdout:1/56: fdatasync d4/f6 0 2024-01-31T05:13:08.333 INFO:tasks.workunit.client.0.smithi099.stdout:4/86: dwrite d0/d8/d19/f1c [0,4194304] 0 2024-01-31T05:13:08.333 INFO:tasks.workunit.client.0.smithi099.stdout:4/87: stat d0/d8/d13/d17 0 2024-01-31T05:13:08.333 INFO:tasks.workunit.client.0.smithi099.stdout:5/95: mkdir d6/d1e/d1f 0 2024-01-31T05:13:08.338 INFO:tasks.workunit.client.0.smithi099.stdout:4/88: truncate d0/d2/f15 876538 0 2024-01-31T05:13:08.338 INFO:tasks.workunit.client.0.smithi099.stdout:5/96: rename d6/f17 to d6/da/d14/f20 0 2024-01-31T05:13:08.345 INFO:tasks.workunit.client.0.smithi099.stdout:1/57: dread d4/fa [0,4194304] 0 2024-01-31T05:13:08.345 INFO:tasks.workunit.client.0.smithi099.stdout:1/58: write d4/fa [4975323,93199] 0 2024-01-31T05:13:08.345 INFO:tasks.workunit.client.0.smithi099.stdout:1/59: creat d4/db/f10 x:0 0 0 2024-01-31T05:13:08.345 INFO:tasks.workunit.client.0.smithi099.stdout:7/81: dread d6/f7 [0,4194304] 0 2024-01-31T05:13:08.346 INFO:tasks.workunit.client.0.smithi099.stdout:4/89: write d0/d8/f11 [2145291,21503] 0 2024-01-31T05:13:08.346 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.983+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002568 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/rxdir/ auth v653 ap=1 f(v0 m2024-01-31T05:12:57.724569+0000 2=2+0) n(v0 rc2024-01-31T05:12:57.724569+0000 b3696 3=2+1) (inest lock) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850f84000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002568:[<0x1000000251c/rxdir v348>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000002568:[<0x1000000251c/rxdir v653>,<0x10000002418/tests v509>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.724569+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.724569+0000 b3696 3=2+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.724569+0000 2=2+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.724569+0000 b3696 3=2+1)","error_str":""},"return_code":0} 2024-01-31T05:13:08.346 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.983+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002550 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/domain_trans/ auth{0=1} v553 ap=1 f(v0 m2024-01-31T05:12:57.684570+0000 2=2+0) n(v0 rc2024-01-31T05:12:57.684570+0000 b2574 3=2+1) (inest mix) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55e850f84580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002550:[<0x1000000251c/domain_trans v242>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000002550:[<0x1000000251c/domain_trans v553>,<0x10000002418/tests v509>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.684570+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.684570+0000 b2574 3=2+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.684570+0000 2=2+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.684570+0000 b2574 3=2+1)","error_str":""},"return_code":0} 2024-01-31T05:13:08.346 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.983+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002564 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setnice/ auth{0=1} v691 ap=1 f(v0 m2024-01-31T05:12:57.718569+0000 3=3+0) n(v0 rc2024-01-31T05:12:57.718569+0000 b3816 4=3+1) (inest mix) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55e850f84b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002564:[<0x1000000251c/task_setnice v334>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000002564:[<0x1000000251c/task_setnice v691>,<0x10000002418/tests v509>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.718569+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.718569+0000 b3816 4=3+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.718569+0000 3=3+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.718569+0000 b3816 4=3+1)","error_str":""},"return_code":0} 2024-01-31T05:13:08.346 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.984+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002535 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/Makefile auth v667 ap=1 s=1114 n(v0 rc2024-01-31T05:12:57.465575+0000 b1114 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8511beb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002535:[<0x1000000251c/Makefile v120>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002535:[<0x1000000251c/Makefile v667>,<0x10000002418/tests v509>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.347 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.984+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002552 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/wait/ auth{0=1} v617 ap=1 f(v0 m2024-01-31T05:12:57.686570+0000 4=4+0) n(v0 rc2024-01-31T05:12:57.686570+0000 b4865 5=4+1) (inest mix) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55e850f85080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002552:[<0x1000000251c/wait v252>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000002552:[<0x1000000251c/wait v617>,<0x10000002418/tests v509>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.686570+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.686570+0000 b4865 5=4+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.686570+0000 4=4+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.686570+0000 b4865 5=4+1)","error_str":""},"return_code":0} 2024-01-31T05:13:08.347 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.985+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002548 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/entrypoint/ auth{0=1} v709 ap=1 f(v0 m2024-01-31T05:12:57.671570+0000 2=2+0) n(v0 rc2024-01-31T05:12:57.671570+0000 b2821 3=2+1) (inest mix) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55e850f85600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002548:[<0x1000000251c/entrypoint v212>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000002548:[<0x1000000251c/entrypoint v709>,<0x10000002418/tests v509>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.671570+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.671570+0000 b2821 3=2+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.671570+0000 2=2+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.671570+0000 b2821 3=2+1)","error_str":""},"return_code":0} 2024-01-31T05:13:08.347 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.985+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002525 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/rename/ auth v513 ap=1 f(v0 m2024-01-31T05:12:57.440576+0000 2=2+0) n(v0 rc2024-01-31T05:12:57.440576+0000 b7113 3=2+1) (inest lock) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850f87180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002525:[<0x1000000251c/rename v46>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000002525:[<0x1000000251c/rename v513>,<0x10000002418/tests v509>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.440576+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.440576+0000 b7113 3=2+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.440576+0000 2=2+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.440576+0000 b7113 3=2+1)","error_str":""},"return_code":0} 2024-01-31T05:13:08.347 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.985+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002560 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getscheduler/ auth{0=1} v701 ap=1 f(v0 m2024-01-31T05:12:57.711570+0000 4=4+0) n(v0 rc2024-01-31T05:12:57.711570+0000 b3934 5=4+1) (inest mix) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55e850f93080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002560:[<0x1000000251c/task_getscheduler v316>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000002560:[<0x1000000251c/task_getscheduler v701>,<0x10000002418/tests v509>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.711570+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.711570+0000 b3934 5=4+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.711570+0000 4=4+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.711570+0000 b3934 5=4+1)","error_str":""},"return_code":0} 2024-01-31T05:13:08.347 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.986+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000256a [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getsid/ auth v677 ap=1 f(v0 m2024-01-31T05:12:57.727569+0000 4=4+0) n(v0 rc2024-01-31T05:12:57.727569+0000 b3751 5=4+1) (inest lock) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850f92b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000256a:[<0x1000000251c/task_getsid v358>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x1000000256a:[<0x1000000251c/task_getsid v677>,<0x10000002418/tests v509>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.727569+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.727569+0000 b3751 5=4+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.727569+0000 4=4+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.727569+0000 b3751 5=4+1)","error_str":""},"return_code":0} 2024-01-31T05:13:08.347 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.987+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002556 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/msg/ auth{0=1} v625 ap=1 f(v0 m2024-01-31T05:12:57.693570+0000 6=6+0) n(v0 rc2024-01-31T05:12:57.693570+0000 b12909 7=6+1) (inest mix) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55e850f93b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002556:[<0x1000000251c/msg v272>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000002556:[<0x1000000251c/msg v625>,<0x10000002418/tests v509>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.693570+0000 6=6+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.693570+0000 b12909 7=6+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.693570+0000 6=6+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.693570+0000 b12909 7=6+1)","error_str":""},"return_code":0} 2024-01-31T05:13:08.347 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.987+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000255a [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ioctl/ auth{0=1} v717 ap=1 f(v0 m2024-01-31T05:12:57.701570+0000 4=4+0) n(v0 rc2024-01-31T05:12:57.701570+0000 b6932 5=4+1) (inest mix) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55e850f93600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000255a:[<0x1000000251c/ioctl v290>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x1000000255a:[<0x1000000251c/ioctl v717>,<0x10000002418/tests v509>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.701570+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.701570+0000 b6932 5=4+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.701570+0000 4=4+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.701570+0000 b6932 5=4+1)","error_str":""},"return_code":0} 2024-01-31T05:13:08.347 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.988+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000251d [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/relabel/ auth{0=1} v679 ap=1 f(v0 m2024-01-31T05:12:57.424576+0000 2=2+0) n(v0 rc2024-01-31T05:12:57.424576+0000 b3594 3=2+1) (inest mix) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55e850f94100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000251d:[<0x1000000251c/relabel v6>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x1000000251d:[<0x1000000251c/relabel v679>,<0x10000002418/tests v509>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.424576+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.424576+0000 b3594 3=2+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.424576+0000 2=2+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.424576+0000 b3594 3=2+1)","error_str":""},"return_code":0} 2024-01-31T05:13:08.347 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.988+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000254c [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrans/ auth{0=1} v657 ap=1 f(v0 m2024-01-31T05:12:57.677570+0000 3=3+0) n(v0 rc2024-01-31T05:12:57.677570+0000 b4056 4=3+1) (inest mix) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55e850f94680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000254c:[<0x1000000251c/dyntrans v230>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x1000000254c:[<0x1000000251c/dyntrans v657>,<0x10000002418/tests v509>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.677570+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.677570+0000 b4056 4=3+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.677570+0000 3=3+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.677570+0000 b4056 4=3+1)","error_str":""},"return_code":0} 2024-01-31T05:13:08.348 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.988+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000252d [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_create/ auth v693 ap=1 f(v0 m2024-01-31T05:12:57.451576+0000 3=3+0) n(v0 rc2024-01-31T05:12:57.451576+0000 b2972 4=3+1) (inest lock) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850f94c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000252d:[<0x1000000251c/task_create v80>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x1000000252d:[<0x1000000251c/task_create v693>,<0x10000002418/tests v509>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.451576+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.451576+0000 b2972 4=3+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.451576+0000 3=3+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.451576+0000 b2972 4=3+1)","error_str":""},"return_code":0} 2024-01-31T05:13:08.348 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.989+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000252b [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ptrace/ auth v541 ap=1 f(v0 m2024-01-31T05:12:57.448576+0000 4=4+0) n(v0 rc2024-01-31T05:12:57.448576+0000 b4150 5=4+1) (inest lock) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850f95180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000252b:[<0x1000000251c/ptrace v72>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x1000000252b:[<0x1000000251c/ptrace v541>,<0x10000002418/tests v509>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.448576+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.448576+0000 b4150 5=4+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.448576+0000 4=4+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.448576+0000 b4150 5=4+1)","error_str":""},"return_code":0} 2024-01-31T05:13:08.348 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.989+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000253a [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setnice/ auth{0=1} v707 ap=1 f(v0 m2024-01-31T05:12:57.475575+0000 4=4+0) n(v0 rc2024-01-31T05:12:57.475575+0000 b5841 5=4+1) (inest mix) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@2},l=15315 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55e850f95700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000253a:[<0x1000000251c/setnice v146>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x1000000253a:[<0x1000000251c/setnice v707>,<0x10000002418/tests v509>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.475575+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.475575+0000 b5841 5=4+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.475575+0000 4=4+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.475575+0000 b5841 5=4+1)","error_str":""},"return_code":0} 2024-01-31T05:13:08.348 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.989+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000230c [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_task_getsched.te auth v141 ap=1 s=1159 n(v0 rc2009-05-11T07:22:26.000000+0000 b1159 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8511bf080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000230c:[<0x1000000241c/test_task_getsched.te v76>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000230c:[<0x1000000241c/test_task_getsched.te v141>,<0x10000002418/refpolicy v531>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.348 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.990+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000228e [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_mkdir.te auth v151 ap=1 s=2482 n(v0 rc2009-05-11T07:22:26.000000+0000 b2482 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8511bf600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000228e:[<0x1000000241c/test_mkdir.te v22>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000228e:[<0x1000000241c/test_mkdir.te v151>,<0x10000002418/refpolicy v531>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.348 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.990+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000230d [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_capable_net.te auth v175 ap=1 s=2091 n(v0 rc2009-05-11T07:22:26.000000+0000 b2091 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8511bfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000230d:[<0x1000000241c/test_capable_net.te v78>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000230d:[<0x1000000241c/test_capable_net.te v175>,<0x10000002418/refpolicy v531>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.348 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.990+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002305 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_sysctl.te auth v143 ap=1 s=934 n(v0 rc2009-05-11T07:22:26.000000+0000 b934 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8511c0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002305:[<0x1000000241c/test_sysctl.te v62>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002305:[<0x1000000241c/test_sysctl.te v143>,<0x10000002418/refpolicy v531>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.348 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.991+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002300 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_fdreceive.te auth v161 ap=1 s=2680 n(v0 rc2009-05-11T07:22:26.000000+0000 b2680 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8511c0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002300:[<0x1000000241c/test_fdreceive.te v52>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002300:[<0x1000000241c/test_fdreceive.te v161>,<0x10000002418/refpolicy v531>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.348 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.991+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002303 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/TODO auth v169 ap=1 s=984 n(v0 rc2006-03-22T21:30:29.000000+0000 b984 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8511c0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002303:[<0x1000000241c/TODO v58>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002303:[<0x1000000241c/TODO v169>,<0x10000002418/refpolicy v531>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.348 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.992+0000 7fb104b04700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002542 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/ auth{0=1} v669 ap=2 RANDEPHEMERALPIN f(v0 m2024-01-31T05:12:57.488575+0000 4=4+0) n(v0 rc2024-01-31T05:12:57.488575+0000 b5261 5=4+1) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15315=pAsLsXsFs/pAsLsXsFsxcral@3} | lock=3 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 randepin 0x55e850f49080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002542:[<0x1000000251c/capable_net v180>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000002542:[<0x1000000251c/capable_net v669>,<0x10000002418/tests v509>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.488575+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.488575+0000 b5261 5=4+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.488575+0000 4=4+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.488575+0000 b5261 5=4+1)","error_str":""},"return_code":0} 2024-01-31T05:13:08.348 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.992+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000230b [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_dyntrace.te auth v167 ap=1 s=2146 n(v0 rc2009-05-11T07:22:26.000000+0000 b2146 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8511c1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000230b:[<0x1000000241c/test_dyntrace.te v74>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000230b:[<0x1000000241c/test_dyntrace.te v167>,<0x10000002418/refpolicy v531>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.349 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.993+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002289 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_ioctl.te auth v97 ap=1 s=1369 n(v0 rc2009-05-11T07:22:26.000000+0000 b1369 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8511c1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002289:[<0x1000000241c/test_ioctl.te v12>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002289:[<0x1000000241c/test_ioctl.te v97>,<0x10000002418/refpolicy v531>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.349 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.993+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000228a [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_task_setsched.te auth v113 ap=1 s=1435 n(v0 rc2009-05-11T07:22:26.000000+0000 b1435 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8511c4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000228a:[<0x1000000241c/test_task_setsched.te v14>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000228a:[<0x1000000241c/test_task_setsched.te v113>,<0x10000002418/refpolicy v531>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.349 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.993+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002306 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_dyntrans.te auth v123 ap=1 s=1375 n(v0 rc2009-05-11T07:22:26.000000+0000 b1375 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8511c4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002306:[<0x1000000241c/test_dyntrans.te v64>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002306:[<0x1000000241c/test_dyntrans.te v123>,<0x10000002418/refpolicy v531>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.349 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.993+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002292 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_task_getpgid.te auth v147 ap=1 s=1126 n(v0 rc2009-05-11T07:22:26.000000+0000 b1126 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8511c4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002292:[<0x1000000241c/test_task_getpgid.te v30>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002292:[<0x1000000241c/test_task_getpgid.te v147>,<0x10000002418/refpolicy v531>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.349 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.994+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002291 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_execute_no_trans.te auth v115 ap=1 s=1002 n(v0 rc2009-05-11T07:22:26.000000+0000 b1002 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8511c5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002291:[<0x1000000241c/test_execute_no_trans.te v28>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002291:[<0x1000000241c/test_execute_no_trans.te v115>,<0x10000002418/refpolicy v531>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.349 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.994+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002295 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_file.te auth v157 ap=1 s=2732 n(v0 rc2009-05-11T07:22:26.000000+0000 b2732 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8511c5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002295:[<0x1000000241c/test_file.te v36>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002295:[<0x1000000241c/test_file.te v157>,<0x10000002418/refpolicy v531>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.349 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.994+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002290 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_stat.te auth v121 ap=1 s=934 n(v0 rc2009-05-11T07:22:26.000000+0000 b934 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8511c6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002290:[<0x1000000241c/test_stat.te v26>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002290:[<0x1000000241c/test_stat.te v121>,<0x10000002418/refpolicy v531>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.349 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.995+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000228c [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_readlink.te auth v117 ap=1 s=1329 n(v0 rc2009-05-11T07:22:26.000000+0000 b1329 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8511c5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000228c:[<0x1000000241c/test_readlink.te v18>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000228c:[<0x1000000241c/test_readlink.te v117>,<0x10000002418/refpolicy v531>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.349 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.996+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002288 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_ipc.te auth v107 ap=1 s=3336 n(v0 rc2009-05-11T07:22:26.000000+0000 b3336 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8511c6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002288:[<0x1000000241c/test_ipc.te v10>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002288:[<0x1000000241c/test_ipc.te v107>,<0x10000002418/refpolicy v531>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.349 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.996+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002302 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_open.te auth v135 ap=1 s=1370 n(v0 rc2009-05-11T07:22:26.000000+0000 b1370 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8511c6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002302:[<0x1000000241c/test_open.te v56>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002302:[<0x1000000241c/test_open.te v135>,<0x10000002418/refpolicy v531>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.349 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.997+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002285 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_task_setpgid.te auth v133 ap=1 s=1803 n(v0 rc2009-05-11T07:22:26.000000+0000 b1803 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8511c7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002285:[<0x1000000241c/test_task_setpgid.te v4>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002285:[<0x1000000241c/test_task_setpgid.te v133>,<0x10000002418/refpolicy v531>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.349 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.998+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002293 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_capable_sys.te auth v129 ap=1 s=691 n(v0 rc2009-05-11T07:22:26.000000+0000 b691 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8511c7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002293:[<0x1000000241c/test_capable_sys.te v32>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002293:[<0x1000000241c/test_capable_sys.te v129>,<0x10000002418/refpolicy v531>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.350 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.998+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000230a [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_global.te auth v163 ap=1 s=2583 n(v0 rc2009-05-11T07:22:26.000000+0000 b2583 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8511cc000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000230a:[<0x1000000241c/test_global.te v72>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000230a:[<0x1000000241c/test_global.te v163>,<0x10000002418/refpolicy v531>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.350 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.998+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000241e [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/ auth{0=1,4=1} v177 ap=1 f(v0 m2024-01-31T05:12:57.390577+0000 1=0+1) n(v1 rc2024-01-31T05:12:57.394577+0000 40=38+2) (inest mix) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15315 | ptrwaiter=0 lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55e85118f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000241e:[<0x1000000241c/redhat v48>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x1000000241e:[<0x1000000241c/redhat v177>,<0x10000002418/refpolicy v531>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.390577+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.394577+0000 40=38+2)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.390577+0000 1=0+1)","memory_value.rstat":"n(v1 rc2024-01-31T05:12:57.394577+0000 40=38+2)","error_str":""},"return_code":0} 2024-01-31T05:13:08.350 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.998+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002296 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/Makefile auth v173 ap=1 s=2341 n(v0 rc2009-10-10T23:53:29.000000+0000 b2341 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8511ccb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002296:[<0x1000000241c/Makefile v38>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002296:[<0x1000000241c/Makefile v173>,<0x10000002418/refpolicy v531>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.350 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.998+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002287 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_link.te auth v139 ap=1 s=2993 n(v0 rc2009-05-11T07:22:26.000000+0000 b2993 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8511cd080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002287:[<0x1000000241c/test_link.te v8>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002287:[<0x1000000241c/test_link.te v139>,<0x10000002418/refpolicy v531>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.350 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.999+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000228b [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_capable_file.te auth v101 ap=1 s=2252 n(v0 rc2009-05-11T07:22:26.000000+0000 b2252 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8511cdb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000228b:[<0x1000000241c/test_capable_file.te v16>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000228b:[<0x1000000241c/test_capable_file.te v101>,<0x10000002418/refpolicy v531>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.350 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:07.999+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002310 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_rxdir.te auth v109 ap=1 s=1170 n(v0 rc2009-05-11T07:22:26.000000+0000 b1170 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8511cc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002310:[<0x1000000241c/test_rxdir.te v84>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002310:[<0x1000000241c/test_rxdir.te v109>,<0x10000002418/refpolicy v531>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.350 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.000+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000228f [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_ptrace.te auth v165 ap=1 s=1465 n(v0 rc2009-05-11T07:22:26.000000+0000 b1465 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8511cd600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000228f:[<0x1000000241c/test_ptrace.te v24>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000228f:[<0x1000000241c/test_ptrace.te v165>,<0x10000002418/refpolicy v531>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.350 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.000+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002299 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_bounds.te auth v159 ap=1 s=1990 n(v0 rc2008-10-23T09:41:38.000000+0000 b1990 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8511ce100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002299:[<0x1000000241c/test_bounds.te v44>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002299:[<0x1000000241c/test_bounds.te v159>,<0x10000002418/refpolicy v531>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.350 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.000+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002309 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_exectrace.te auth v127 ap=1 s=2500 n(v0 rc2009-05-11T07:22:26.000000+0000 b2500 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8511ce680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002309:[<0x1000000241c/test_exectrace.te v70>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002309:[<0x1000000241c/test_exectrace.te v127>,<0x10000002418/refpolicy v531>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.350 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.001+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002301 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_sigkill.te auth v171 ap=1 s=1866 n(v0 rc2009-05-11T07:22:26.000000+0000 b1866 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8511cec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002301:[<0x1000000241c/test_sigkill.te v54>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002301:[<0x1000000241c/test_sigkill.te v171>,<0x10000002418/refpolicy v531>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.350 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.002+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002294 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_execshare.te auth v95 ap=1 s=2054 n(v0 rc2009-05-11T07:22:26.000000+0000 b2054 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8511cf180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002294:[<0x1000000241c/test_execshare.te v34>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002294:[<0x1000000241c/test_execshare.te v95>,<0x10000002418/refpolicy v531>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.350 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.002+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002297 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_wait.te auth v103 ap=1 s=1675 n(v0 rc2009-05-11T07:22:26.000000+0000 b1675 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8511cf700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002297:[<0x1000000241c/test_wait.te v40>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002297:[<0x1000000241c/test_wait.te v103>,<0x10000002418/refpolicy v531>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.351 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.003+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022ff [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_policy.fc auth v119 ap=1 s=8 n(v0 rc2006-03-24T17:35:23.000000+0000 b8 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8511d4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022ff:[<0x1000000241c/test_policy.fc v50>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022ff:[<0x1000000241c/test_policy.fc v119>,<0x10000002418/refpolicy v531>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.351 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.003+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000230f [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_task_create.te auth v145 ap=1 s=2118 n(v0 rc2009-05-11T07:22:26.000000+0000 b2118 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8511d4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000230f:[<0x1000000241c/test_task_create.te v82>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000230f:[<0x1000000241c/test_task_create.te v145>,<0x10000002418/refpolicy v531>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.351 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.003+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002286 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_setnice.te auth v153 ap=1 s=2117 n(v0 rc2009-05-11T07:22:26.000000+0000 b2117 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8511d4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002286:[<0x1000000241c/test_setnice.te v6>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002286:[<0x1000000241c/test_setnice.te v153>,<0x10000002418/refpolicy v531>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.351 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.004+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002308 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_setattr.te auth v149 ap=1 s=1074 n(v0 rc2009-05-11T07:22:26.000000+0000 b1074 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8511d5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002308:[<0x1000000241c/test_setattr.te v68>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002308:[<0x1000000241c/test_setattr.te v149>,<0x10000002418/refpolicy v531>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.351 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.004+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002307 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_transition.te auth v155 ap=1 s=1491 n(v0 rc2009-05-11T07:22:26.000000+0000 b1491 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8511d5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002307:[<0x1000000241c/test_transition.te v66>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002307:[<0x1000000241c/test_transition.te v155>,<0x10000002418/refpolicy v531>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.351 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.004+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002304 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_relabel.te auth v125 ap=1 s=1814 n(v0 rc2009-05-11T07:22:26.000000+0000 b1814 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8511d5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002304:[<0x1000000241c/test_relabel.te v60>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002304:[<0x1000000241c/test_relabel.te v125>,<0x10000002418/refpolicy v531>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.351 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.005+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000230e [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_task_getsid.te auth v111 ap=1 s=1093 n(v0 rc2009-05-11T07:22:26.000000+0000 b1093 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8511d6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000230e:[<0x1000000241c/test_task_getsid.te v80>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000230e:[<0x1000000241c/test_task_getsid.te v111>,<0x10000002418/refpolicy v531>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.351 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.005+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002298 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_entrypoint.te auth v131 ap=1 s=652 n(v0 rc2009-05-11T07:22:26.000000+0000 b652 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8511d6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002298:[<0x1000000241c/test_entrypoint.te v42>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002298:[<0x1000000241c/test_entrypoint.te v131>,<0x10000002418/refpolicy v531>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.351 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.005+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000241d [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_rename.te auth v105 ap=1 s=5108 n(v0 rc2024-01-31T05:12:57.379577+0000 b5108 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8511d6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000241d:[<0x1000000241c/test_rename.te v2>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000241d:[<0x1000000241c/test_rename.te v105>,<0x10000002418/refpolicy v531>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.351 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.005+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002311 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_inherit.te auth v137 ap=1 s=2882 n(v0 rc2009-05-11T07:22:26.000000+0000 b2882 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8511d7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002311:[<0x1000000241c/test_inherit.te v86>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002311:[<0x1000000241c/test_inherit.te v137>,<0x10000002418/refpolicy v531>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.351 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.006+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000224c [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/policy/Makefile auth v10 ap=1 s=1095 n(v0 rc2009-10-09T17:55:50.000000+0000 b1095 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851171080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000224c:[<0x1000000240d/Makefile v6>,<0x1000000240c/policy v8>,<0x1000000240b/ima v12>,<0x10000002406/integrity v48>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000224c:[<0x1000000240d/Makefile v10>,<0x1000000240c/policy v67>,<0x1000000240b/ima v29>,<0x10000002406/integrity v191>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.352 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.006+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000224b [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/policy/measure.policy auth v8 ap=1 s=388 n(v0 rc2009-03-31T13:58:14.000000+0000 b388 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851171600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000224b:[<0x1000000240d/measure.policy v4>,<0x1000000240c/policy v8>,<0x1000000240b/ima v12>,<0x10000002406/integrity v48>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000224b:[<0x1000000240d/measure.policy v8>,<0x1000000240c/policy v67>,<0x1000000240b/ima v29>,<0x10000002406/integrity v191>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.352 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.007+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000224e [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/ima_boot_aggregate.c auth v16 ap=1 s=2835 n(v0 rc2009-10-09T17:55:50.000000+0000 b2835 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851172100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000224e:[<0x10000002410/ima_boot_aggregate.c v4>,<0x1000000240c/src v22>,<0x1000000240b/ima v12>,<0x10000002406/integrity v48>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000224e:[<0x10000002410/ima_boot_aggregate.c v16>,<0x1000000240c/src v69>,<0x1000000240b/ima v29>,<0x10000002406/integrity v191>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.352 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.008+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002411 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/ima_measure.c auth v14 ap=1 s=5710 n(v0 rc2024-01-31T05:12:57.338578+0000 b5710 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851172c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002411:[<0x10000002410/ima_measure.c v2>,<0x1000000240c/src v22>,<0x1000000240b/ima v12>,<0x10000002406/integrity v48>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002411:[<0x10000002410/ima_measure.c v14>,<0x1000000240c/src v69>,<0x1000000240b/ima v29>,<0x10000002406/integrity v191>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.352 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.009+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000228d [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_policy.if auth v99 ap=1 s=1765 n(v0 rc2009-05-11T07:22:26.000000+0000 b1765 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e8511d7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000228d:[<0x1000000241c/test_policy.if v20>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000228d:[<0x1000000241c/test_policy.if v99>,<0x10000002418/refpolicy v531>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.352 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.009+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000240e [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/policy/measure.policy-invalid auth v12 ap=1 s=387 n(v0 rc2024-01-31T05:12:57.334578+0000 b387 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851171b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000240e:[<0x1000000240d/measure.policy-invalid v2>,<0x1000000240c/policy v8>,<0x1000000240b/ima v12>,<0x10000002406/integrity v48>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000240e:[<0x1000000240d/measure.policy-invalid v12>,<0x1000000240c/policy v67>,<0x1000000240b/ima v29>,<0x10000002406/integrity v191>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.352 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.009+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000224f [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/Makefile auth v12 ap=1 s=1048 n(v0 rc2024-01-31T05:12:57.339578+0000 b1048 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851172680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000224f:[<0x10000002410/Makefile v6>,<0x1000000240c/src v22>,<0x1000000240b/ima v12>,<0x10000002406/integrity v48>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000224f:[<0x10000002410/Makefile v12>,<0x1000000240c/src v69>,<0x1000000240b/ima v29>,<0x10000002406/integrity v191>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.352 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.009+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002250 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/ima_mmap.c auth v10 ap=1 s=1159 n(v0 rc2009-10-09T17:55:50.000000+0000 b1159 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851173180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002250:[<0x10000002410/ima_mmap.c v8>,<0x1000000240c/src v22>,<0x1000000240b/ima v12>,<0x10000002406/integrity v48>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002250:[<0x10000002410/ima_mmap.c v10>,<0x1000000240c/src v69>,<0x1000000240b/ima v29>,<0x10000002406/integrity v191>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.352 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.009+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002413 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/tests/ima_policy.sh auth v14 ap=1 s=4695 n(v0 rc2024-01-31T05:12:57.342578+0000 b4695 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851173700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002413:[<0x10000002412/ima_policy.sh v2>,<0x1000000240c/tests v36>,<0x1000000240b/ima v12>,<0x10000002406/integrity v48>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002413:[<0x10000002412/ima_policy.sh v14>,<0x1000000240c/tests v71>,<0x1000000240b/ima v29>,<0x10000002406/integrity v191>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.352 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.010+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000253c [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/stat/ auth{0=1,1=1} v719 ap=2 RANDEPHEMERALPIN f(v0 m2024-01-31T05:12:57.478575+0000 2=2+0) n(v1 rc2024-01-31T05:12:57.478575+0000 b2816 3=2+1) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15315=pAsLsXsFs/pAsLsXsFsxcral@2} | dirtyscattered=0 lock=3 importingcaps=0 dirfrag=1 caps=1 stickydirs=0 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 randepin 0x55e85118fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000253c:[<0x1000000251c/stat v152>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x1000000253c:[<0x1000000251c/stat v365>,<0x10000002418/tests v509>,<0x10000002406/selinux-testsuite v297>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.478575+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.478575+0000 3=2+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.478575+0000 2=2+0)","memory_value.rstat":"n(v1 rc2024-01-31T05:12:57.478575+0000 b2816 3=2+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-01-31T05:13:08.352 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.011+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002254 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/tests/ima_violations.sh auth v18 ap=1 s=5518 n(v0 rc2009-10-19T04:32:28.000000+0000 b5518 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85117e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002254:[<0x10000002412/ima_violations.sh v10>,<0x1000000240c/tests v36>,<0x1000000240b/ima v12>,<0x10000002406/integrity v48>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002254:[<0x10000002412/ima_violations.sh v18>,<0x1000000240c/tests v71>,<0x1000000240b/ima v29>,<0x10000002406/integrity v191>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.352 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.011+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002252 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/tests/Makefile auth v22 ap=1 s=1052 n(v0 rc2009-10-09T17:55:50.000000+0000 b1052 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85117e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002252:[<0x10000002412/Makefile v6>,<0x1000000240c/tests v36>,<0x1000000240b/ima v12>,<0x10000002406/integrity v48>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002252:[<0x10000002412/Makefile v22>,<0x1000000240c/tests v71>,<0x1000000240b/ima v29>,<0x10000002406/integrity v191>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.353 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.011+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002251 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/tests/ima_measurements.sh auth v24 ap=1 s=5618 n(v0 rc2009-10-19T04:32:28.000000+0000 b5618 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85117f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002251:[<0x10000002412/ima_measurements.sh v4>,<0x1000000240c/tests v36>,<0x1000000240b/ima v12>,<0x10000002406/integrity v48>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002251:[<0x10000002412/ima_measurements.sh v24>,<0x1000000240c/tests v71>,<0x1000000240b/ima v29>,<0x10000002406/integrity v191>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.353 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.012+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002253 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/tests/ima_tpm.sh auth v20 ap=1 s=5401 n(v0 rc2009-10-19T04:32:28.000000+0000 b5401 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85117eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002253:[<0x10000002412/ima_tpm.sh v8>,<0x1000000240c/tests v36>,<0x1000000240b/ima v12>,<0x10000002406/integrity v48>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002253:[<0x10000002412/ima_tpm.sh v20>,<0x1000000240c/tests v71>,<0x1000000240b/ima v29>,<0x10000002406/integrity v191>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.353 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.012+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002255 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/tests/ima_setup.sh auth v16 ap=1 s=4132 n(v0 rc2009-10-19T04:32:28.000000+0000 b4132 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85117f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002255:[<0x10000002412/ima_setup.sh v12>,<0x1000000240c/tests v36>,<0x1000000240b/ima v12>,<0x10000002406/integrity v48>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002255:[<0x10000002412/ima_setup.sh v16>,<0x1000000240c/tests v71>,<0x1000000240b/ima v29>,<0x10000002406/integrity v191>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.353 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.012+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002371 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/bounds/selinux_bounds.sh auth v8 ap=1 s=3248 n(v0 rc2009-04-21T09:39:58.000000+0000 b3248 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850fc4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002371:[<0x10000002566/selinux_bounds.sh v4>,<0x1000000251c/bounds v342>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002371:[<0x10000002566/selinux_bounds.sh v8>,<0x1000000251c/bounds v643>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.353 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.012+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002567 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/bounds/Makefile auth v10 ap=1 s=1104 n(v0 rc2024-01-31T05:12:57.721569+0000 b1104 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850fc4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002567:[<0x10000002566/Makefile v2>,<0x1000000251c/bounds v342>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002567:[<0x10000002566/Makefile v10>,<0x1000000251c/bounds v643>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.353 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.012+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002372 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/bounds/selinux_bounds_thread.c auth v12 ap=1 s=1860 n(v0 rc2008-10-23T09:41:38.000000+0000 b1860 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850fc5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002372:[<0x10000002566/selinux_bounds_thread.c v6>,<0x1000000251c/bounds v342>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002372:[<0x10000002566/selinux_bounds_thread.c v12>,<0x1000000251c/bounds v643>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.353 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.013+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002532 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/inherit/selinux_inherit_parent.c auth v16 ap=1 s=1967 n(v0 rc2024-01-31T05:12:57.456575+0000 b1967 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850fc5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002532:[<0x10000002531/selinux_inherit_parent.c v2>,<0x1000000251c/inherit v96>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002532:[<0x10000002531/selinux_inherit_parent.c v16>,<0x1000000251c/inherit v661>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.353 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.013+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000232c [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/inherit/selinux_inherit_child.c auth v14 ap=1 s=941 n(v0 rc2009-02-26T12:02:31.000000+0000 b941 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850fd8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000232c:[<0x10000002531/selinux_inherit_child.c v8>,<0x1000000251c/inherit v96>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000232c:[<0x10000002531/selinux_inherit_child.c v14>,<0x1000000251c/inherit v661>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.353 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.013+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000232b [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/inherit/Makefile auth v10 ap=1 s=1117 n(v0 rc2009-10-09T17:55:51.000000+0000 b1117 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850fd8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000232b:[<0x10000002531/Makefile v6>,<0x1000000251c/inherit v96>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000232b:[<0x10000002531/Makefile v10>,<0x1000000251c/inherit v661>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.353 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.014+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000232a [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/inherit/selinux_inherit.sh auth v12 ap=1 s=2582 n(v0 rc2009-04-21T09:39:58.000000+0000 b2582 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850fd8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000232a:[<0x10000002531/selinux_inherit.sh v4>,<0x1000000251c/inherit v96>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000232a:[<0x10000002531/selinux_inherit.sh v12>,<0x1000000251c/inherit v661>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.353 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.014+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002352 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/open/selinux_append2write.c auth v10 ap=1 s=769 n(v0 rc2009-02-26T12:02:31.000000+0000 b769 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850fd9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002352:[<0x1000000254a/selinux_append2write.c v8>,<0x1000000251c/open v222>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002352:[<0x1000000254a/selinux_append2write.c v10>,<0x1000000251c/open v681>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.354 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.014+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000254b [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/open/Makefile auth v12 ap=1 s=1068 n(v0 rc2024-01-31T05:12:57.674570+0000 b1068 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850fd9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000254b:[<0x1000000254a/Makefile v2>,<0x1000000251c/open v222>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000254b:[<0x1000000254a/Makefile v12>,<0x1000000251c/open v681>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.354 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.014+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002350 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/open/selinux_fopen.c auth v16 ap=1 s=678 n(v0 rc2009-02-26T12:02:31.000000+0000 b678 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850fd9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002350:[<0x1000000254a/selinux_fopen.c v4>,<0x1000000251c/open v222>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002350:[<0x1000000254a/selinux_fopen.c v16>,<0x1000000251c/open v681>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.354 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.015+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002351 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/open/selinux_open.sh auth v14 ap=1 s=4327 n(v0 rc2009-04-21T09:39:59.000000+0000 b4327 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850fda100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002351:[<0x1000000254a/selinux_open.sh v6>,<0x1000000251c/open v222>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002351:[<0x1000000254a/selinux_open.sh v14>,<0x1000000251c/open v681>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.354 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.015+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000254f [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sysctl/selinux_sysctl.sh auth v6 ap=1 s=1852 n(v0 rc2024-01-31T05:12:57.681570+0000 b1852 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850fda680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000254f:[<0x1000000254e/selinux_sysctl.sh v2>,<0x1000000251c/sysctl v236>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000254f:[<0x1000000254e/selinux_sysctl.sh v6>,<0x1000000251c/sysctl v557>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.354 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.015+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002355 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sysctl/Makefile auth v8 ap=1 s=1070 n(v0 rc2009-10-09T17:55:52.000000+0000 b1070 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850fdac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002355:[<0x1000000254e/Makefile v4>,<0x1000000251c/sysctl v236>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002355:[<0x1000000254e/Makefile v8>,<0x1000000251c/sysctl v557>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.354 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.015+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002367 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execshare/selinux_execshare_parent.c auth v10 ap=1 s=2576 n(v0 rc2009-11-03T20:07:35.000000+0000 b2576 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850fdb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002367:[<0x1000000255e/selinux_execshare_parent.c v6>,<0x1000000251c/execshare v306>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002367:[<0x1000000255e/selinux_execshare_parent.c v10>,<0x1000000251c/execshare v675>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.354 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.015+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002366 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execshare/Makefile auth v14 ap=1 s=1097 n(v0 rc2009-10-09T17:55:51.000000+0000 b1097 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850fe6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002366:[<0x1000000255e/Makefile v4>,<0x1000000251c/execshare v306>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002366:[<0x1000000255e/Makefile v14>,<0x1000000251c/execshare v675>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.354 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.016+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000255f [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execshare/selinux_execshare_child.c auth v16 ap=1 s=374 n(v0 rc2024-01-31T05:12:57.707570+0000 b374 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850fdb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000255f:[<0x1000000255e/selinux_execshare_child.c v2>,<0x1000000251c/execshare v306>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000255f:[<0x1000000255e/selinux_execshare_child.c v16>,<0x1000000251c/execshare v675>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.354 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.016+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002368 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execshare/selinux_execshare.sh auth v12 ap=1 s=1957 n(v0 rc2005-11-08T16:49:34.000000+0000 b1957 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850fe6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002368:[<0x1000000255e/selinux_execshare.sh v8>,<0x1000000251c/execshare v306>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002368:[<0x1000000255e/selinux_execshare.sh v12>,<0x1000000251c/execshare v675>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.354 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.016+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002320 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/exectrace/Makefile auth v12 ap=1 s=1097 n(v0 rc2009-10-09T17:55:51.000000+0000 b1097 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850fe6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002320:[<0x10000002527/Makefile v4>,<0x1000000251c/exectrace v56>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002320:[<0x10000002527/Makefile v12>,<0x1000000251c/exectrace v663>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.354 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.016+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002322 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/exectrace/selinux_exectrace_parent.c auth v16 ap=1 s=2631 n(v0 rc2009-02-26T12:14:54.000000+0000 b2631 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850fe7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002322:[<0x10000002527/selinux_exectrace_parent.c v8>,<0x1000000251c/exectrace v56>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002322:[<0x10000002527/selinux_exectrace_parent.c v16>,<0x1000000251c/exectrace v663>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.354 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.016+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002528 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/exectrace/selinux_exectrace.sh auth v10 ap=1 s=2005 n(v0 rc2024-01-31T05:12:57.442576+0000 b2005 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850fe7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002528:[<0x10000002527/selinux_exectrace.sh v2>,<0x1000000251c/exectrace v56>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002528:[<0x10000002527/selinux_exectrace.sh v10>,<0x1000000251c/exectrace v663>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.355 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.017+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002321 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/exectrace/selinux_exectrace_child.c auth v14 ap=1 s=375 n(v0 rc2009-02-26T12:02:31.000000+0000 b375 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850fe7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002321:[<0x10000002527/selinux_exectrace_child.c v6>,<0x1000000251c/exectrace v56>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002321:[<0x10000002527/selinux_exectrace_child.c v14>,<0x1000000251c/exectrace v663>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.355 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.017+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002522 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sem/selinux_semget.c auth v16 ap=1 s=826 n(v0 rc2024-01-31T05:12:57.432576+0000 b826 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850fe8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002522:[<0x10000002521/selinux_semget.c v2>,<0x1000000251c/sem v28>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002522:[<0x10000002521/selinux_semget.c v16>,<0x1000000251c/sem v619>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.355 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.017+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002317 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sem/selinux_getinfo.c auth v22 ap=1 s=1133 n(v0 rc2005-11-08T16:49:35.000000+0000 b1133 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850fe8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002317:[<0x10000002521/selinux_getinfo.c v6>,<0x1000000251c/sem v28>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002317:[<0x10000002521/selinux_getinfo.c v22>,<0x1000000251c/sem v619>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.355 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.017+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002318 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sem/Makefile auth v14 ap=1 s=1067 n(v0 rc2009-10-09T17:55:52.000000+0000 b1067 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850fe8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002318:[<0x10000002521/Makefile v8>,<0x1000000251c/sem v28>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002318:[<0x10000002521/Makefile v14>,<0x1000000251c/sem v619>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.355 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.017+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002316 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sem/selinux_sem.sh auth v24 ap=1 s=6635 n(v0 rc2005-11-08T16:49:35.000000+0000 b6635 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850fe9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002316:[<0x10000002521/selinux_sem.sh v4>,<0x1000000251c/sem v28>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002316:[<0x10000002521/selinux_sem.sh v24>,<0x1000000251c/sem v619>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.355 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.017+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000231a [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sem/selinux_semctl.c auth v20 ap=1 s=2142 n(v0 rc2009-02-26T12:14:54.000000+0000 b2142 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850fe9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000231a:[<0x10000002521/selinux_semctl.c v12>,<0x1000000251c/sem v28>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000231a:[<0x10000002521/selinux_semctl.c v20>,<0x1000000251c/sem v619>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.355 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.018+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002319 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sem/selinux_semop.c auth v18 ap=1 s=934 n(v0 rc2005-11-08T16:49:35.000000+0000 b934 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850ff6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002319:[<0x10000002521/selinux_semop.c v10>,<0x1000000251c/sem v28>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002319:[<0x10000002521/selinux_semop.c v18>,<0x1000000251c/sem v619>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.355 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.018+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000255d [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/link/Makefile auth v6 ap=1 s=1068 n(v0 rc2024-01-31T05:12:57.704570+0000 b1068 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850ff6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000255d:[<0x1000000255c/Makefile v2>,<0x1000000251c/link v296>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000255d:[<0x1000000255c/Makefile v6>,<0x1000000251c/link v665>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.355 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.018+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002365 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/link/selinux_link.sh auth v8 ap=1 s=3617 n(v0 rc2009-04-21T09:39:58.000000+0000 b3617 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850ff6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002365:[<0x1000000255c/selinux_link.sh v4>,<0x1000000251c/link v296>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002365:[<0x1000000255c/selinux_link.sh v8>,<0x1000000251c/link v665>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.355 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.018+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002323 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setattr/selinux_setattr.sh auth v6 ap=1 s=2588 n(v0 rc2009-04-21T09:39:59.000000+0000 b2588 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850ff7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002323:[<0x10000002529/selinux_setattr.sh v4>,<0x1000000251c/setattr v62>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002323:[<0x10000002529/selinux_setattr.sh v6>,<0x1000000251c/setattr v473>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.355 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.018+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000252a [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setattr/Makefile auth v8 ap=1 s=1071 n(v0 rc2024-01-31T05:12:57.445576+0000 b1071 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850ff7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000252a:[<0x10000002529/Makefile v2>,<0x1000000251c/setattr v62>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000252a:[<0x10000002529/Makefile v8>,<0x1000000251c/setattr v473>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.355 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.019+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002337 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setscheduler/selinux_task_setscheduler.sh auth v12 ap=1 s=1802 n(v0 rc2005-11-08T16:49:36.000000+0000 b1802 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850ff7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002337:[<0x10000002536/selinux_task_setscheduler.sh v6>,<0x1000000251c/task_setscheduler v130>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002337:[<0x10000002536/selinux_task_setscheduler.sh v12>,<0x1000000251c/task_setscheduler v705>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.356 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.019+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002537 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setscheduler/selinux_task_setscheduler_source.c auth v14 ap=1 s=929 n(v0 rc2024-01-31T05:12:57.468575+0000 b929 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850ff8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002537:[<0x10000002536/selinux_task_setscheduler_source.c v2>,<0x1000000251c/task_setscheduler v130>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002537:[<0x10000002536/selinux_task_setscheduler_source.c v14>,<0x1000000251c/task_setscheduler v705>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.356 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.019+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002336 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setscheduler/Makefile auth v10 ap=1 s=1081 n(v0 rc2009-10-09T17:55:52.000000+0000 b1081 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850ff8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002336:[<0x10000002536/Makefile v4>,<0x1000000251c/task_setscheduler v130>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002336:[<0x10000002536/Makefile v10>,<0x1000000251c/task_setscheduler v705>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.356 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.019+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002338 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setscheduler/selinux_task_setscheduler_target.c auth v16 ap=1 s=371 n(v0 rc2009-02-26T12:02:32.000000+0000 b371 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850ff8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002338:[<0x10000002536/selinux_task_setscheduler_target.c v8>,<0x1000000251c/task_setscheduler v130>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002338:[<0x10000002536/selinux_task_setscheduler_target.c v16>,<0x1000000251c/task_setscheduler v705>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.356 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.019+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002541 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setpgid/Makefile auth v10 ap=1 s=1076 n(v0 rc2024-01-31T05:12:57.485575+0000 b1076 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850ff9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002541:[<0x10000002540/Makefile v2>,<0x1000000251c/task_setpgid v170>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002541:[<0x10000002540/Makefile v10>,<0x1000000251c/task_setpgid v649>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.356 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.019+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002342 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setpgid/selinux_task_setpgid_source.c auth v12 ap=1 s=802 n(v0 rc2009-02-26T12:14:54.000000+0000 b802 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850ff9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002342:[<0x10000002540/selinux_task_setpgid_source.c v6>,<0x1000000251c/task_setpgid v170>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002342:[<0x10000002540/selinux_task_setpgid_source.c v12>,<0x1000000251c/task_setpgid v649>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.356 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.020+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002341 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setpgid/selinux_task_setpgid.sh auth v8 ap=1 s=1376 n(v0 rc2005-11-08T16:49:36.000000+0000 b1376 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85100e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002341:[<0x10000002540/selinux_task_setpgid.sh v4>,<0x1000000251c/task_setpgid v170>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002341:[<0x10000002540/selinux_task_setpgid.sh v8>,<0x1000000251c/task_setpgid v649>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.356 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.020+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002539 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/mkdir/Makefile auth v6 ap=1 s=1069 n(v0 rc2024-01-31T05:12:57.472575+0000 b1069 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85100f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002539:[<0x10000002538/Makefile v2>,<0x1000000251c/mkdir v136>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002539:[<0x10000002538/Makefile v6>,<0x1000000251c/mkdir v543>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.356 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.020+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002339 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/mkdir/selinux_mkdir.sh auth v8 ap=1 s=3293 n(v0 rc2009-05-11T06:39:46.000000+0000 b3293 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85100fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002339:[<0x10000002538/selinux_mkdir.sh v4>,<0x1000000251c/mkdir v136>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002339:[<0x10000002538/selinux_mkdir.sh v8>,<0x1000000251c/mkdir v543>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.356 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.020+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002559 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sigkill/Makefile auth v8 ap=1 s=1071 n(v0 rc2024-01-31T05:12:57.697570+0000 b1071 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851010680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002559:[<0x10000002558/Makefile v2>,<0x1000000251c/sigkill v280>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002559:[<0x10000002558/Makefile v8>,<0x1000000251c/sigkill v715>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.356 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.020+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002361 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sigkill/selinux_sigkill_server.c auth v10 ap=1 s=625 n(v0 rc2009-02-26T12:14:54.000000+0000 b625 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851010100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002361:[<0x10000002558/selinux_sigkill_server.c v6>,<0x1000000251c/sigkill v280>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002361:[<0x10000002558/selinux_sigkill_server.c v10>,<0x1000000251c/sigkill v715>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.357 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.021+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002360 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sigkill/selinux_sigkill.sh auth v12 ap=1 s=6374 n(v0 rc2005-11-08T16:49:35.000000+0000 b6374 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851010c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002360:[<0x10000002558/selinux_sigkill.sh v4>,<0x1000000251c/sigkill v280>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002360:[<0x10000002558/selinux_sigkill.sh v12>,<0x1000000251c/sigkill v715>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.357 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.021+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000236e [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/fdreceive/selinux_fdreceive_client.c auth v14 ap=1 s=2250 n(v0 rc2009-02-26T12:14:54.000000+0000 b2250 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851011180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000236e:[<0x10000002562/selinux_fdreceive_client.c v8>,<0x1000000251c/fdreceive v326>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000236e:[<0x10000002562/selinux_fdreceive_client.c v14>,<0x1000000251c/fdreceive v635>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.357 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.021+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002563 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/fdreceive/Makefile auth v12 ap=1 s=1073 n(v0 rc2024-01-31T05:12:57.715569+0000 b1073 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851011700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002563:[<0x10000002562/Makefile v2>,<0x1000000251c/fdreceive v326>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002563:[<0x10000002562/Makefile v12>,<0x1000000251c/fdreceive v635>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.357 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.021+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000236d [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/fdreceive/selinux_fdreceive.sh auth v10 ap=1 s=2637 n(v0 rc2009-04-21T09:39:58.000000+0000 b2637 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851020000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000236d:[<0x10000002562/selinux_fdreceive.sh v6>,<0x1000000251c/fdreceive v326>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000236d:[<0x10000002562/selinux_fdreceive.sh v10>,<0x1000000251c/fdreceive v635>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.357 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.021+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000236c [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/fdreceive/selinux_fdreceive_server.c auth v16 ap=1 s=2644 n(v0 rc2009-02-26T12:14:54.000000+0000 b2644 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851020580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000236c:[<0x10000002562/selinux_fdreceive_server.c v4>,<0x1000000251c/fdreceive v326>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000236c:[<0x10000002562/selinux_fdreceive_server.c v16>,<0x1000000251c/fdreceive v635>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.357 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.022+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000233e [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrace/selinux_dyntrace_parent.c auth v14 ap=1 s=2640 n(v0 rc2009-02-26T12:14:54.000000+0000 b2640 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851021b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000233e:[<0x1000000253e/selinux_dyntrace_parent.c v4>,<0x1000000251c/dyntrace v162>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000233e:[<0x1000000253e/selinux_dyntrace_parent.c v14>,<0x1000000251c/dyntrace v713>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.357 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.022+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000235a [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/readlink/selinux_readlink.sh auth v8 ap=1 s=2284 n(v0 rc2009-04-21T09:39:59.000000+0000 b2284 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851020b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000235a:[<0x10000002554/selinux_readlink.sh v4>,<0x1000000251c/readlink v258>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000235a:[<0x10000002554/selinux_readlink.sh v8>,<0x1000000251c/readlink v517>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.357 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.022+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002555 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/readlink/Makefile auth v6 ap=1 s=1072 n(v0 rc2024-01-31T05:12:57.690570+0000 b1072 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851021080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002555:[<0x10000002554/Makefile v2>,<0x1000000251c/readlink v258>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002555:[<0x10000002554/Makefile v6>,<0x1000000251c/readlink v517>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.357 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.023+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002314 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_file/Makefile auth v8 ap=1 s=1110 n(v0 rc2009-10-09T17:55:51.000000+0000 b1110 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851022c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002314:[<0x1000000251f/Makefile v4>,<0x1000000251c/capable_file v14>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002314:[<0x1000000251f/Makefile v8>,<0x1000000251c/capable_file v659>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.357 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.023+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002520 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_file/selinux_lease.c auth v12 ap=1 s=955 n(v0 rc2024-01-31T05:12:57.428576+0000 b955 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851023180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002520:[<0x1000000251f/selinux_lease.c v2>,<0x1000000251c/capable_file v14>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002520:[<0x1000000251f/selinux_lease.c v12>,<0x1000000251c/capable_file v659>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.357 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.024+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002530 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execute_no_trans/Makefile auth v8 ap=1 s=1080 n(v0 rc2024-01-31T05:12:57.454575+0000 b1080 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851032000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002530:[<0x1000000252f/Makefile v2>,<0x1000000251c/execute_no_trans v86>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002530:[<0x1000000252f/Makefile v8>,<0x1000000251c/execute_no_trans v631>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.358 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.024+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002329 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execute_no_trans/selinux_execute_no_trans.sh auth v6 ap=1 s=1962 n(v0 rc2009-04-21T09:39:58.000000+0000 b1962 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851032580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002329:[<0x1000000252f/selinux_execute_no_trans.sh v4>,<0x1000000251c/execute_no_trans v86>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002329:[<0x1000000252f/selinux_execute_no_trans.sh v6>,<0x1000000251c/execute_no_trans v631>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.358 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.024+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000233f [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrace/selinux_dyntrace.sh auth v12 ap=1 s=1869 n(v0 rc2005-11-08T16:49:33.000000+0000 b1869 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851021600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000233f:[<0x1000000253e/selinux_dyntrace.sh v6>,<0x1000000251c/dyntrace v162>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000233f:[<0x1000000253e/selinux_dyntrace.sh v12>,<0x1000000251c/dyntrace v713>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.358 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.025+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002340 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrace/selinux_dyntrace_child.c auth v10 ap=1 s=503 n(v0 rc2009-02-26T12:02:29.000000+0000 b503 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851022680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002340:[<0x1000000253e/selinux_dyntrace_child.c v8>,<0x1000000251c/dyntrace v162>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002340:[<0x1000000253e/selinux_dyntrace_child.c v10>,<0x1000000251c/dyntrace v713>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.358 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.025+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000253f [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrace/Makefile auth v16 ap=1 s=1096 n(v0 rc2024-01-31T05:12:57.481575+0000 b1096 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851022100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000253f:[<0x1000000253e/Makefile v2>,<0x1000000251c/dyntrace v162>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000253f:[<0x1000000253e/Makefile v16>,<0x1000000251c/dyntrace v713>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.358 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.025+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002315 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_file/selinux_capable_file.sh auth v10 ap=1 s=4639 n(v0 rc2009-05-11T09:06:02.000000+0000 b4639 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851023700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002315:[<0x1000000251f/selinux_capable_file.sh v6>,<0x1000000251c/capable_file v14>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002315:[<0x1000000251f/selinux_capable_file.sh v10>,<0x1000000251c/capable_file v659>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.358 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.025+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000231c [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/shm/selinux_shmget.c auth v16 ap=1 s=848 n(v0 rc2005-11-08T16:49:35.000000+0000 b848 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851032b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000231c:[<0x10000002523/selinux_shmget.c v6>,<0x1000000251c/shm v40>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000231c:[<0x10000002523/selinux_shmget.c v16>,<0x1000000251c/shm v647>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.358 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.025+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000231b [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/shm/Makefile auth v12 ap=1 s=1067 n(v0 rc2009-10-09T17:55:52.000000+0000 b1067 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851033600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000231b:[<0x10000002523/Makefile v4>,<0x1000000251c/shm v40>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000231b:[<0x10000002523/Makefile v12>,<0x1000000251c/shm v647>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.358 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.026+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002524 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/shm/selinux_shmctl.c auth v14 ap=1 s=1372 n(v0 rc2024-01-31T05:12:57.436576+0000 b1372 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851033080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002524:[<0x10000002523/selinux_shmctl.c v2>,<0x1000000251c/shm v40>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002524:[<0x10000002523/selinux_shmctl.c v14>,<0x1000000251c/shm v647>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.358 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.026+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002545 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_chroot.c auth v16 ap=1 s=752 n(v0 rc2024-01-31T05:12:57.492575+0000 b752 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851034c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002545:[<0x10000002544/selinux_chroot.c v2>,<0x1000000251c/capable_sys v196>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002545:[<0x10000002544/selinux_chroot.c v16>,<0x1000000251c/capable_sys v695>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.358 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.027+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002348 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/Makefile auth v18 ap=1 s=1075 n(v0 rc2009-10-09T17:55:51.000000+0000 b1075 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851035700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002348:[<0x10000002544/Makefile v6>,<0x1000000251c/capable_sys v196>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002348:[<0x10000002544/Makefile v18>,<0x1000000251c/capable_sys v695>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.358 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.027+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002349 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_rawio.c auth v24 ap=1 s=976 n(v0 rc2009-02-26T12:02:29.000000+0000 b976 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851035180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002349:[<0x10000002544/selinux_rawio.c v8>,<0x1000000251c/capable_sys v196>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002349:[<0x10000002544/selinux_rawio.c v24>,<0x1000000251c/capable_sys v695>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.358 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.028+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000234a [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_nice.c auth v22 ap=1 s=624 n(v0 rc2005-07-14T18:21:33.000000+0000 b624 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85103e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000234a:[<0x10000002544/selinux_nice.c v10>,<0x1000000251c/capable_sys v196>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000234a:[<0x10000002544/selinux_nice.c v22>,<0x1000000251c/capable_sys v695>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.358 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.028+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000234b [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_hostname.c auth v20 ap=1 s=795 n(v0 rc2005-07-14T18:21:33.000000+0000 b795 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851034680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000234b:[<0x10000002544/selinux_hostname.c v12>,<0x1000000251c/capable_sys v196>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000234b:[<0x10000002544/selinux_hostname.c v20>,<0x1000000251c/capable_sys v695>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.359 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.028+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000231d [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/shm/selinux_shm.sh auth v20 ap=1 s=6078 n(v0 rc2005-11-08T16:49:35.000000+0000 b6078 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851034100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000231d:[<0x10000002523/selinux_shm.sh v8>,<0x1000000251c/shm v40>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000231d:[<0x10000002523/selinux_shm.sh v20>,<0x1000000251c/shm v647>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.359 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.028+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002347 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_capable_sys.sh auth v14 ap=1 s=3840 n(v0 rc2009-04-21T09:39:58.000000+0000 b3840 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85103e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002347:[<0x10000002544/selinux_capable_sys.sh v4>,<0x1000000251c/capable_sys v196>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002347:[<0x10000002544/selinux_capable_sys.sh v14>,<0x1000000251c/capable_sys v695>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.359 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.028+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000232e [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_mmap.c auth v34 ap=1 s=1282 n(v0 rc2009-02-26T12:02:31.000000+0000 b1282 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85103eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000232e:[<0x10000002533/selinux_mmap.c v6>,<0x1000000251c/file v118>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000232e:[<0x10000002533/selinux_mmap.c v34>,<0x1000000251c/file v711>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.359 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.029+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002334 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_file.sh auth v28 ap=1 s=7390 n(v0 rc2009-05-11T06:39:46.000000+0000 b7390 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85103f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002334:[<0x10000002533/selinux_file.sh v18>,<0x1000000251c/file v118>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002334:[<0x10000002533/selinux_file.sh v28>,<0x1000000251c/file v711>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.359 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.029+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002534 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_fcntl.c auth v32 ap=1 s=1246 n(v0 rc2024-01-31T05:12:57.460575+0000 b1246 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85103f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002534:[<0x10000002533/selinux_fcntl.c v2>,<0x1000000251c/file v118>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002534:[<0x10000002533/selinux_fcntl.c v32>,<0x1000000251c/file v711>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.359 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.029+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002333 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_mprotect.c auth v30 ap=1 s=1414 n(v0 rc2009-02-26T12:02:31.000000+0000 b1414 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851040c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002333:[<0x10000002533/selinux_mprotect.c v16>,<0x1000000251c/file v118>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002333:[<0x10000002533/selinux_mprotect.c v30>,<0x1000000251c/file v711>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.359 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.030+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000232d [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_wait_io.c auth v40 ap=1 s=864 n(v0 rc2005-04-20T16:09:09.000000+0000 b864 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85103fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000232d:[<0x10000002533/selinux_wait_io.c v4>,<0x1000000251c/file v118>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000232d:[<0x10000002533/selinux_wait_io.c v40>,<0x1000000251c/file v711>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.359 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.030+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000232f [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/Makefile auth v24 ap=1 s=1092 n(v0 rc2009-10-09T17:55:51.000000+0000 b1092 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851040100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000232f:[<0x10000002533/Makefile v8>,<0x1000000251c/file v118>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000232f:[<0x10000002533/Makefile v24>,<0x1000000251c/file v711>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.359 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.030+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002332 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_sigiotask.c auth v22 ap=1 s=2314 n(v0 rc2009-02-26T12:02:31.000000+0000 b2314 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851041180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002332:[<0x10000002533/selinux_sigiotask.c v14>,<0x1000000251c/file v118>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002332:[<0x10000002533/selinux_sigiotask.c v22>,<0x1000000251c/file v711>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.359 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.030+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002330 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_seek.c auth v26 ap=1 s=951 n(v0 rc2009-02-26T12:02:31.000000+0000 b951 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851040680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002330:[<0x10000002533/selinux_seek.c v10>,<0x1000000251c/file v118>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002330:[<0x10000002533/selinux_seek.c v26>,<0x1000000251c/file v711>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.359 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.030+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002331 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_lock.c auth v36 ap=1 s=1214 n(v0 rc2009-02-26T12:02:31.000000+0000 b1214 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851041700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002331:[<0x10000002533/selinux_lock.c v12>,<0x1000000251c/file v118>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002331:[<0x10000002533/selinux_lock.c v36>,<0x1000000251c/file v711>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.359 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.031+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002335 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_nofcntl.c auth v38 ap=1 s=1368 n(v0 rc2009-02-26T12:02:31.000000+0000 b1368 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851048000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002335:[<0x10000002533/selinux_nofcntl.c v20>,<0x1000000251c/file v118>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002335:[<0x10000002533/selinux_nofcntl.c v38>,<0x1000000251c/file v711>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.359 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.031+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000234d [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getpgid/selinux_task_getpgid_target.c auth v12 ap=1 s=371 n(v0 rc2009-02-26T12:02:32.000000+0000 b371 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851048580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000234d:[<0x10000002546/selinux_task_getpgid_target.c v6>,<0x1000000251c/task_getpgid v206>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000234d:[<0x10000002546/selinux_task_getpgid_target.c v12>,<0x1000000251c/task_getpgid v687>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.360 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.031+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000234c [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getpgid/Makefile auth v14 ap=1 s=1076 n(v0 rc2009-10-09T17:55:52.000000+0000 b1076 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851049600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000234c:[<0x10000002546/Makefile v4>,<0x1000000251c/task_getpgid v206>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000234c:[<0x10000002546/Makefile v14>,<0x1000000251c/task_getpgid v687>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.360 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.031+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000231e [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/shm/selinux_shmat.c auth v18 ap=1 s=919 n(v0 rc2005-11-08T16:49:35.000000+0000 b919 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851033b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000231e:[<0x10000002523/selinux_shmat.c v10>,<0x1000000251c/shm v40>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000231e:[<0x10000002523/selinux_shmat.c v18>,<0x1000000251c/shm v647>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.360 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.031+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000234e [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getpgid/selinux_task_getpgid_source.c auth v10 ap=1 s=700 n(v0 rc2009-02-26T12:02:32.000000+0000 b700 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851049080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000234e:[<0x10000002546/selinux_task_getpgid_source.c v8>,<0x1000000251c/task_getpgid v206>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000234e:[<0x10000002546/selinux_task_getpgid_source.c v10>,<0x1000000251c/task_getpgid v687>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.360 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.031+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027c9 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getpgid/selinux_task_getpgid.sh auth v16 ap=1 s=1650 n(v0 rc2024-01-31T05:12:57.668571+0000 b1650 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851048b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000027c9:[<0x10000002546/selinux_task_getpgid.sh v2>,<0x1000000251c/task_getpgid v206>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000027c9:[<0x10000002546/selinux_task_getpgid.sh v16>,<0x1000000251c/task_getpgid v687>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.360 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.032+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002551 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/domain_trans/Makefile auth v8 ap=1 s=1076 n(v0 rc2024-01-31T05:12:57.684570+0000 b1076 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85104a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002551:[<0x10000002550/Makefile v2>,<0x1000000251c/domain_trans v242>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002551:[<0x10000002550/Makefile v8>,<0x1000000251c/domain_trans v553>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.360 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.032+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002569 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/rxdir/selinux_rxdir.sh auth v6 ap=1 s=2627 n(v0 rc2024-01-31T05:12:57.724569+0000 b2627 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851049b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002569:[<0x10000002568/selinux_rxdir.sh v2>,<0x1000000251c/rxdir v348>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002569:[<0x10000002568/selinux_rxdir.sh v6>,<0x1000000251c/rxdir v653>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.360 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.032+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002373 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/rxdir/Makefile auth v8 ap=1 s=1069 n(v0 rc2009-10-09T17:55:52.000000+0000 b1069 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85104a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002373:[<0x10000002568/Makefile v4>,<0x1000000251c/rxdir v348>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002373:[<0x10000002568/Makefile v8>,<0x1000000251c/rxdir v653>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.360 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.032+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002356 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/domain_trans/selinux_domain_trans.sh auth v6 ap=1 s=1498 n(v0 rc2005-11-08T16:49:33.000000+0000 b1498 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85104ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002356:[<0x10000002550/selinux_domain_trans.sh v4>,<0x1000000251c/domain_trans v242>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002356:[<0x10000002550/selinux_domain_trans.sh v6>,<0x1000000251c/domain_trans v553>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.360 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.032+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002370 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setnice/selinux_task_setnice.sh auth v12 ap=1 s=2369 n(v0 rc2005-11-08T16:49:36.000000+0000 b2369 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85104b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002370:[<0x10000002564/selinux_task_setnice.sh v6>,<0x1000000251c/task_setnice v334>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002370:[<0x10000002564/selinux_task_setnice.sh v12>,<0x1000000251c/task_setnice v691>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.360 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.033+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002565 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setnice/Makefile auth v10 ap=1 s=1076 n(v0 rc2024-01-31T05:12:57.718569+0000 b1076 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85104b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002565:[<0x10000002564/Makefile v2>,<0x1000000251c/task_setnice v334>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002565:[<0x10000002564/Makefile v10>,<0x1000000251c/task_setnice v691>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.361 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.033+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000236f [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setnice/selinux_task_setnice_target.c auth v8 ap=1 s=371 n(v0 rc2009-02-26T12:02:32.000000+0000 b371 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85105a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000236f:[<0x10000002564/selinux_task_setnice_target.c v4>,<0x1000000251c/task_setnice v334>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000236f:[<0x10000002564/selinux_task_setnice_target.c v8>,<0x1000000251c/task_setnice v691>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.361 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.033+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002358 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/wait/selinux_wait_child.c auth v14 ap=1 s=375 n(v0 rc2009-02-26T12:02:32.000000+0000 b375 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85105a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002358:[<0x10000002552/selinux_wait_child.c v6>,<0x1000000251c/wait v252>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002358:[<0x10000002552/selinux_wait_child.c v14>,<0x1000000251c/wait v617>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.361 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.033+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002553 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/wait/selinux_wait_parent.c auth v10 ap=1 s=1699 n(v0 rc2024-01-31T05:12:57.686570+0000 b1699 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85105ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002553:[<0x10000002552/selinux_wait_parent.c v2>,<0x1000000251c/wait v252>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002553:[<0x10000002552/selinux_wait_parent.c v10>,<0x1000000251c/wait v617>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.361 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.033+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002357 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/wait/Makefile auth v12 ap=1 s=1092 n(v0 rc2009-10-09T17:55:52.000000+0000 b1092 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85105b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002357:[<0x10000002552/Makefile v4>,<0x1000000251c/wait v252>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002357:[<0x10000002552/Makefile v12>,<0x1000000251c/wait v617>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.361 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.033+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002359 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/wait/selinux_wait.sh auth v16 ap=1 s=1699 n(v0 rc2005-11-08T16:49:37.000000+0000 b1699 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85105b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002359:[<0x10000002552/selinux_wait.sh v8>,<0x1000000251c/wait v252>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002359:[<0x10000002552/selinux_wait.sh v16>,<0x1000000251c/wait v617>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.361 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.034+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000234f [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/entrypoint/Makefile auth v6 ap=1 s=1074 n(v0 rc2009-10-09T17:55:51.000000+0000 b1074 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85105bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000234f:[<0x10000002548/Makefile v4>,<0x1000000251c/entrypoint v212>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000234f:[<0x10000002548/Makefile v6>,<0x1000000251c/entrypoint v709>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.361 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.034+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002549 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/entrypoint/selinux_entrypoint.sh auth v8 ap=1 s=1747 n(v0 rc2024-01-31T05:12:57.671570+0000 b1747 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85105c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002549:[<0x10000002548/selinux_entrypoint.sh v2>,<0x1000000251c/entrypoint v212>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002549:[<0x10000002548/selinux_entrypoint.sh v8>,<0x1000000251c/entrypoint v709>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.361 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.034+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002375 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getsid/selinux_task_getsid.sh auth v14 ap=1 s=1599 n(v0 rc2005-11-08T16:49:36.000000+0000 b1599 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851073600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002375:[<0x1000000256a/selinux_task_getsid.sh v6>,<0x1000000251c/task_getsid v358>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002375:[<0x1000000256a/selinux_task_getsid.sh v14>,<0x1000000251c/task_getsid v677>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.361 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.034+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002374 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getsid/selinux_task_getsid_source.c auth v10 ap=1 s=706 n(v0 rc2009-02-26T12:02:32.000000+0000 b706 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851073b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002374:[<0x1000000256a/selinux_task_getsid_source.c v4>,<0x1000000251c/task_getsid v358>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002374:[<0x1000000256a/selinux_task_getsid_source.c v10>,<0x1000000251c/task_getsid v677>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.361 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.035+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000231f [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/rename/selinux_rename.sh auth v8 ap=1 s=6043 n(v0 rc2009-05-11T06:39:46.000000+0000 b6043 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85105c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000231f:[<0x10000002525/selinux_rename.sh v4>,<0x1000000251c/rename v46>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000231f:[<0x10000002525/selinux_rename.sh v8>,<0x1000000251c/rename v513>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.361 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.035+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002376 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getsid/selinux_task_getsid_target.c auth v12 ap=1 s=371 n(v0 rc2009-02-26T12:02:32.000000+0000 b371 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851074100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002376:[<0x1000000256a/selinux_task_getsid_target.c v8>,<0x1000000251c/task_getsid v358>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002376:[<0x1000000256a/selinux_task_getsid_target.c v12>,<0x1000000251c/task_getsid v677>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.361 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.035+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000236a [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getscheduler/selinux_task_getscheduler.sh auth v16 ap=1 s=1744 n(v0 rc2005-11-08T16:49:36.000000+0000 b1744 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85105d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000236a:[<0x10000002560/selinux_task_getscheduler.sh v6>,<0x1000000251c/task_getscheduler v316>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000236a:[<0x10000002560/selinux_task_getscheduler.sh v16>,<0x1000000251c/task_getscheduler v701>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.362 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.035+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002561 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getscheduler/selinux_task_getscheduler_target.c auth v10 ap=1 s=371 n(v0 rc2024-01-31T05:12:57.711570+0000 b371 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85106a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002561:[<0x10000002560/selinux_task_getscheduler_target.c v2>,<0x1000000251c/task_getscheduler v316>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002561:[<0x10000002560/selinux_task_getscheduler_target.c v10>,<0x1000000251c/task_getscheduler v701>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.362 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.035+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000256b [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getsid/Makefile auth v16 ap=1 s=1075 n(v0 rc2024-01-31T05:12:57.726569+0000 b1075 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851073080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000256b:[<0x1000000256a/Makefile v2>,<0x1000000251c/task_getsid v358>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000256b:[<0x1000000256a/Makefile v16>,<0x1000000251c/task_getsid v677>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.362 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.036+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002369 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getscheduler/Makefile auth v14 ap=1 s=1081 n(v0 rc2009-10-09T17:55:52.000000+0000 b1081 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85106a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002369:[<0x10000002560/Makefile v4>,<0x1000000251c/task_getscheduler v316>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002369:[<0x10000002560/Makefile v14>,<0x1000000251c/task_getscheduler v701>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.362 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.036+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000236b [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getscheduler/selinux_task_getscheduler_source.c auth v12 ap=1 s=738 n(v0 rc2009-02-26T12:02:32.000000+0000 b738 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85105d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000236b:[<0x10000002560/selinux_task_getscheduler_source.c v8>,<0x1000000251c/task_getscheduler v316>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000236b:[<0x10000002560/selinux_task_getscheduler_source.c v12>,<0x1000000251c/task_getscheduler v701>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.362 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.036+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002363 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ioctl/selinux_noioctl.c auth v10 ap=1 s=2297 n(v0 rc2009-05-11T09:00:25.000000+0000 b2297 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85106b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002363:[<0x1000000255a/selinux_noioctl.c v6>,<0x1000000251c/ioctl v290>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002363:[<0x1000000255a/selinux_noioctl.c v10>,<0x1000000251c/ioctl v717>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.362 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.037+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002557 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/msg/selinux_msg.sh auth v24 ap=1 s=7811 n(v0 rc2024-01-31T05:12:57.692570+0000 b7811 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85106c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002557:[<0x10000002556/selinux_msg.sh v2>,<0x1000000251c/msg v272>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002557:[<0x10000002556/selinux_msg.sh v24>,<0x1000000251c/msg v625>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.362 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.037+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002526 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/rename/Makefile auth v6 ap=1 s=1070 n(v0 rc2024-01-31T05:12:57.440576+0000 b1070 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85105cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002526:[<0x10000002525/Makefile v2>,<0x1000000251c/rename v46>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002526:[<0x10000002525/Makefile v6>,<0x1000000251c/rename v513>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.362 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.037+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000235e [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/msg/selinux_msgsnd.c auth v14 ap=1 s=1053 n(v0 rc2005-11-08T16:49:34.000000+0000 b1053 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85106c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000235e:[<0x10000002556/selinux_msgsnd.c v10>,<0x1000000251c/msg v272>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000235e:[<0x10000002556/selinux_msgsnd.c v14>,<0x1000000251c/msg v625>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.362 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.037+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000235c [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/msg/selinux_msgctl.c auth v22 ap=1 s=1149 n(v0 rc2009-02-26T12:14:54.000000+0000 b1149 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85106cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000235c:[<0x10000002556/selinux_msgctl.c v6>,<0x1000000251c/msg v272>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000235c:[<0x10000002556/selinux_msgctl.c v22>,<0x1000000251c/msg v625>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.362 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.038+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002362 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ioctl/Makefile auth v16 ap=1 s=1069 n(v0 rc2009-10-09T17:55:51.000000+0000 b1069 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85106ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002362:[<0x1000000255a/Makefile v4>,<0x1000000251c/ioctl v290>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002362:[<0x1000000255a/Makefile v16>,<0x1000000251c/ioctl v717>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.362 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.038+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000255b [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ioctl/selinux_ioctl.sh auth v12 ap=1 s=1876 n(v0 rc2024-01-31T05:12:57.701570+0000 b1876 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85106bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000255b:[<0x1000000255a/selinux_ioctl.sh v2>,<0x1000000251c/ioctl v290>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000255b:[<0x1000000255a/selinux_ioctl.sh v12>,<0x1000000251c/ioctl v717>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.362 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.038+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000235f [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/msg/selinux_msgget.c auth v16 ap=1 s=830 n(v0 rc2005-11-08T16:49:34.000000+0000 b830 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85106d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000235f:[<0x10000002556/selinux_msgget.c v12>,<0x1000000251c/msg v272>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000235f:[<0x10000002556/selinux_msgget.c v16>,<0x1000000251c/msg v625>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.362 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.038+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000235d [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/msg/selinux_msgrcv.c auth v18 ap=1 s=999 n(v0 rc2005-11-08T16:49:34.000000+0000 b999 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85106d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000235d:[<0x10000002556/selinux_msgrcv.c v8>,<0x1000000251c/msg v272>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000235d:[<0x10000002556/selinux_msgrcv.c v18>,<0x1000000251c/msg v625>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.363 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.038+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000235b [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/msg/Makefile auth v20 ap=1 s=1067 n(v0 rc2009-10-09T17:55:51.000000+0000 b1067 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851072000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000235b:[<0x10000002556/Makefile v4>,<0x1000000251c/msg v272>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000235b:[<0x10000002556/Makefile v20>,<0x1000000251c/msg v625>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.363 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.039+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002543 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/selinux_capable_net.sh auth v12 ap=1 s=2896 n(v0 rc2024-01-31T05:12:57.488575+0000 b2896 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850facb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002543:[<0x10000002542/selinux_capable_net.sh v2>,<0x1000000251c/capable_net v180>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002543:[<0x10000002542/selinux_capable_net.sh v12>,<0x1000000251c/capable_net v669>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.363 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.039+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002343 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/Makefile auth v14 ap=1 s=1075 n(v0 rc2009-10-09T17:55:51.000000+0000 b1075 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850fad600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002343:[<0x10000002542/Makefile v4>,<0x1000000251c/capable_net v180>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002343:[<0x10000002542/Makefile v14>,<0x1000000251c/capable_net v669>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.363 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.039+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000251e [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/relabel/Makefile auth v8 ap=1 s=1071 n(v0 rc2024-01-31T05:12:57.424576+0000 b1071 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851072580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000251e:[<0x1000000251d/Makefile v2>,<0x1000000251c/relabel v6>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000251e:[<0x1000000251d/Makefile v8>,<0x1000000251c/relabel v679>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.363 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.039+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002344 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/selinux_bind.c auth v10 ap=1 s=670 n(v0 rc2005-04-20T16:09:06.000000+0000 b670 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850fad080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002344:[<0x10000002542/selinux_bind.c v6>,<0x1000000251c/capable_net v180>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002344:[<0x10000002542/selinux_bind.c v10>,<0x1000000251c/capable_net v669>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.363 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.040+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002364 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ioctl/selinux_ioctl.c auth v14 ap=1 s=1690 n(v0 rc2009-05-11T08:58:22.000000+0000 b1690 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e85106b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002364:[<0x1000000255a/selinux_ioctl.c v8>,<0x1000000251c/ioctl v290>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002364:[<0x1000000255a/selinux_ioctl.c v14>,<0x1000000251c/ioctl v717>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.363 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.040+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002354 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrans/selinux_dyntrans.sh auth v10 ap=1 s=1561 n(v0 rc2005-11-08T16:49:33.000000+0000 b1561 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851074680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002354:[<0x1000000254c/selinux_dyntrans.sh v6>,<0x1000000251c/dyntrans v230>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002354:[<0x1000000254c/selinux_dyntrans.sh v10>,<0x1000000251c/dyntrans v657>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.363 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.040+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002345 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/selinux_raw.c auth v16 ap=1 s=620 n(v0 rc2005-04-20T16:09:07.000000+0000 b620 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850fadb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002345:[<0x10000002542/selinux_raw.c v8>,<0x1000000251c/capable_net v180>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002345:[<0x10000002542/selinux_raw.c v16>,<0x1000000251c/capable_net v669>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.363 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.040+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002353 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrans/selinux_dyntrans_parent.c auth v8 ap=1 s=1399 n(v0 rc2009-02-26T12:14:54.000000+0000 b1399 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851075180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002353:[<0x1000000254c/selinux_dyntrans_parent.c v4>,<0x1000000251c/dyntrans v230>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002353:[<0x1000000254c/selinux_dyntrans_parent.c v8>,<0x1000000251c/dyntrans v657>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.363 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.041+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002313 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/relabel/selinux_relabel.sh auth v6 ap=1 s=2523 n(v0 rc2009-05-11T09:00:25.000000+0000 b2523 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851072b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002313:[<0x1000000251d/selinux_relabel.sh v4>,<0x1000000251c/relabel v6>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002313:[<0x1000000251d/selinux_relabel.sh v6>,<0x1000000251c/relabel v679>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.363 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.041+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000254d [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrans/Makefile auth v12 ap=1 s=1096 n(v0 rc2024-01-31T05:12:57.677570+0000 b1096 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851074c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000254d:[<0x1000000254c/Makefile v2>,<0x1000000251c/dyntrans v230>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000254d:[<0x1000000254c/Makefile v12>,<0x1000000251c/dyntrans v657>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.363 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.041+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002327 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_create/Makefile auth v8 ap=1 s=1075 n(v0 rc2009-10-09T17:55:52.000000+0000 b1075 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851080580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002327:[<0x1000000252d/Makefile v4>,<0x1000000251c/task_create v80>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002327:[<0x1000000252d/Makefile v8>,<0x1000000251c/task_create v693>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.363 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.041+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002328 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_create/selinux_task_create_parent.c auth v12 ap=1 s=535 n(v0 rc2009-02-26T12:02:32.000000+0000 b535 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851075700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002328:[<0x1000000252d/selinux_task_create_parent.c v6>,<0x1000000251c/task_create v80>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002328:[<0x1000000252d/selinux_task_create_parent.c v12>,<0x1000000251c/task_create v693>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.364 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.041+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000252e [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_create/selinux_task_create.sh auth v10 ap=1 s=1362 n(v0 rc2024-01-31T05:12:57.451576+0000 b1362 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851080000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000252e:[<0x1000000252d/selinux_task_create.sh v2>,<0x1000000251c/task_create v80>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000252e:[<0x1000000252d/selinux_task_create.sh v10>,<0x1000000251c/task_create v693>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.364 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.042+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000252c [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ptrace/selinux_ptrace.c auth v10 ap=1 s=709 n(v0 rc2024-01-31T05:12:57.447576+0000 b709 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851080b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000252c:[<0x1000000252b/selinux_ptrace.c v2>,<0x1000000251c/ptrace v72>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000252c:[<0x1000000252b/selinux_ptrace.c v10>,<0x1000000251c/ptrace v541>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.364 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.042+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002325 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ptrace/Makefile auth v14 ap=1 s=1070 n(v0 rc2009-10-09T17:55:51.000000+0000 b1070 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851081080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002325:[<0x1000000252b/Makefile v6>,<0x1000000251c/ptrace v72>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002325:[<0x1000000252b/Makefile v14>,<0x1000000251c/ptrace v541>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.364 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.042+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002324 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ptrace/selinux_ptrace.sh auth v12 ap=1 s=1955 n(v0 rc2024-01-31T05:12:57.448576+0000 b1955 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851081600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002324:[<0x1000000252b/selinux_ptrace.sh v4>,<0x1000000251c/ptrace v72>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002324:[<0x1000000252b/selinux_ptrace.sh v12>,<0x1000000251c/ptrace v541>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.364 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.042+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002326 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ptrace/selinux_ptrace_wait.sh auth v16 ap=1 s=416 n(v0 rc2005-04-20T16:09:12.000000+0000 b416 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851081b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002326:[<0x1000000252b/selinux_ptrace_wait.sh v8>,<0x1000000251c/ptrace v72>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002326:[<0x1000000252b/selinux_ptrace_wait.sh v16>,<0x1000000251c/ptrace v541>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.364 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.042+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000233c [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setnice/selinux_setnice.sh auth v16 ap=1 s=1844 n(v0 rc2005-11-08T16:49:35.000000+0000 b1844 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851082c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000233c:[<0x1000000253a/selinux_setnice.sh v8>,<0x1000000251c/setnice v146>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000233c:[<0x1000000253a/selinux_setnice.sh v16>,<0x1000000251c/setnice v707>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.364 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.043+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000233a [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setnice/selinux_setnice_parent.c auth v12 ap=1 s=2289 n(v0 rc2009-02-26T12:02:32.000000+0000 b2289 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851083180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000233a:[<0x1000000253a/selinux_setnice_parent.c v4>,<0x1000000251c/setnice v146>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000233a:[<0x1000000253a/selinux_setnice_parent.c v12>,<0x1000000251c/setnice v707>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.364 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.043+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000233b [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setnice/selinux_setnice_child.c auth v14 ap=1 s=613 n(v0 rc2009-02-26T12:02:32.000000+0000 b613 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851082100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000233b:[<0x1000000253a/selinux_setnice_child.c v6>,<0x1000000251c/setnice v146>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000233b:[<0x1000000253a/selinux_setnice_child.c v14>,<0x1000000251c/setnice v707>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.364 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.043+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000253b [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setnice/Makefile auth v10 ap=1 s=1095 n(v0 rc2024-01-31T05:12:57.475575+0000 b1095 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851082680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000253b:[<0x1000000253a/Makefile v2>,<0x1000000251c/setnice v146>,<0x10000002418/tests v256>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000253b:[<0x1000000253a/Makefile v10>,<0x1000000251c/setnice v707>,<0x10000002418/tests v533>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.364 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.054+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000241f [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/ auth{0=1,4=1} v83 ap=2 RANDEPHEMERALPIN f(v0 m2024-01-31T05:12:57.394577+0000 38=38+0) n(v1 rc2024-01-31T05:12:57.394577+0000 b64374 39=38+1) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15315=pAsLsXsFs/pAsLsXsFsxcral@2} | dirtyscattered=0 lock=3 importingcaps=0 dirfrag=1 caps=1 stickydirs=0 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 randepin 0x55e85118f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000241f:[<0x1000000241e/5 v78>,<0x1000000241c/redhat v48>,<0x10000002418/refpolicy v168>,<0x10000002406/selinux-testsuite v86>,<0x10000001eda/security v270>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x1000000241f:[<0x1000000241e/5 v81>,<0x1000000241c/redhat v177>,<0x10000002418/refpolicy v531>,<0x10000002406/selinux-testsuite v300>,<0x10000001eda/security v1771>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.394577+0000 38=38+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.394577+0000 39=38+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.394577+0000 38=38+0)","memory_value.rstat":"n(v1 rc2024-01-31T05:12:57.394577+0000 b64374 39=38+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-01-31T05:13:08.366 INFO:tasks.workunit.client.0.smithi099.stdout:1/60: symlink d4/db/l11 0 2024-01-31T05:13:08.366 INFO:tasks.workunit.client.0.smithi099.stdout:4/90: mkdir d0/d1e 0 2024-01-31T05:13:08.366 INFO:tasks.workunit.client.0.smithi099.stdout:5/97: dread d6/f11 [0,4194304] 0 2024-01-31T05:13:08.366 INFO:tasks.workunit.client.0.smithi099.stdout:4/91: chown d0/d8/d13 727 1 2024-01-31T05:13:08.366 INFO:tasks.workunit.client.0.smithi099.stdout:4/92: stat d0 0 2024-01-31T05:13:08.366 INFO:tasks.workunit.client.0.smithi099.stdout:4/93: chown d0/d8/d19 1 1 2024-01-31T05:13:08.366 INFO:tasks.workunit.client.0.smithi099.stdout:4/94: chown d0/c6 1 1 2024-01-31T05:13:08.366 INFO:tasks.workunit.client.0.smithi099.stdout:5/98: mkdir d6/d1e/d1f/d21 0 2024-01-31T05:13:08.366 INFO:tasks.workunit.client.0.smithi099.stdout:4/95: symlink d0/d2/l1f 0 2024-01-31T05:13:08.366 INFO:tasks.workunit.client.0.smithi099.stdout:4/96: chown d0/c6 4116 1 2024-01-31T05:13:08.366 INFO:tasks.workunit.client.0.smithi099.stdout:4/97: mkdir d0/d2/d20 0 2024-01-31T05:13:08.366 INFO:tasks.workunit.client.0.smithi099.stdout:4/98: chown d0/d2/le 355909 1 2024-01-31T05:13:08.367 INFO:tasks.workunit.client.0.smithi099.stdout:4/99: rename d0/d8/d13 to d0/d2/d20/d21 0 2024-01-31T05:13:08.367 INFO:tasks.workunit.client.0.smithi099.stdout:4/100: symlink d0/d2/d20/l22 0 2024-01-31T05:13:08.367 INFO:tasks.workunit.client.0.smithi099.stdout:4/101: creat d0/d8/d19/f23 x:0 0 0 2024-01-31T05:13:08.367 INFO:tasks.workunit.client.0.smithi099.stdout:4/102: mkdir d0/d2/d20/d21/d17/d24 0 2024-01-31T05:13:08.367 INFO:tasks.workunit.client.0.smithi099.stdout:4/103: unlink d0/l12 0 2024-01-31T05:13:08.367 INFO:tasks.workunit.client.0.smithi099.stdout:4/104: creat d0/d2/d20/d21/d17/f25 x:0 0 0 2024-01-31T05:13:08.368 INFO:tasks.workunit.client.0.smithi099.stdout:4/105: rename d0/d8/l10 to d0/d2/d20/d21/d17/d24/l26 0 2024-01-31T05:13:08.368 INFO:tasks.workunit.client.0.smithi099.stdout:2/70: sync 2024-01-31T05:13:08.369 INFO:tasks.workunit.client.0.smithi099.stdout:2/71: write f1 [12747854,14596] 0 2024-01-31T05:13:08.369 INFO:tasks.workunit.client.0.smithi099.stdout:2/72: write d10/f15 [4750425,66517] 0 2024-01-31T05:13:08.369 INFO:tasks.workunit.client.0.smithi099.stdout:2/73: chown f1 59003 1 2024-01-31T05:13:08.369 INFO:tasks.workunit.client.0.smithi099.stdout:4/106: rmdir d0/d2/d20/d21/d17/d24 39 2024-01-31T05:13:08.373 INFO:tasks.workunit.client.0.smithi099.stdout:1/61: dwrite d4/fa [0,4194304] 0 2024-01-31T05:13:08.373 INFO:tasks.workunit.client.0.smithi099.stdout:4/107: link d0/d8/d19/f23 d0/d8/f27 0 2024-01-31T05:13:08.373 INFO:tasks.workunit.client.0.smithi099.stdout:1/62: readlink d4/dc/le 0 2024-01-31T05:13:08.373 INFO:tasks.workunit.client.0.smithi099.stdout:5/99: dwrite d6/ff [0,4194304] 0 2024-01-31T05:13:08.373 INFO:tasks.workunit.client.0.smithi099.stdout:5/100: dread - d6/da/d14/f1a zero size 2024-01-31T05:13:08.373 INFO:tasks.workunit.client.0.smithi099.stdout:5/101: write d6/f18 [251905,101099] 0 2024-01-31T05:13:08.374 INFO:tasks.workunit.client.0.smithi099.stdout:2/74: link l9 d10/l18 0 2024-01-31T05:13:08.376 INFO:tasks.workunit.client.0.smithi099.stdout:4/108: truncate d0/fd 728562 0 2024-01-31T05:13:08.378 INFO:tasks.workunit.client.0.smithi099.stdout:5/102: creat d6/d1e/d1f/f22 x:0 0 0 2024-01-31T05:13:08.378 INFO:tasks.workunit.client.0.smithi099.stdout:2/75: chown d10/l13 858852521 1 2024-01-31T05:13:08.381 INFO:tasks.workunit.client.0.smithi099.stdout:4/109: link d0/d8/l14 d0/d2/l28 0 2024-01-31T05:13:08.381 INFO:tasks.workunit.client.0.smithi099.stdout:2/76: dread f8 [0,4194304] 0 2024-01-31T05:13:08.381 INFO:tasks.workunit.client.0.smithi099.stdout:2/77: dread - d10/f11 zero size 2024-01-31T05:13:08.382 INFO:tasks.workunit.client.0.smithi099.stdout:4/110: mknod d0/d2/d20/d21/d17/c29 0 2024-01-31T05:13:08.383 INFO:tasks.workunit.client.0.smithi099.stdout:2/78: creat d10/f19 x:0 0 0 2024-01-31T05:13:08.384 INFO:tasks.workunit.client.0.smithi099.stdout:1/63: dread d4/fa [0,4194304] 0 2024-01-31T05:13:08.384 INFO:tasks.workunit.client.0.smithi099.stdout:4/111: mknod d0/d8/c2a 0 2024-01-31T05:13:08.384 INFO:tasks.workunit.client.0.smithi099.stdout:4/112: read - d0/d2/f1d zero size 2024-01-31T05:13:08.385 INFO:tasks.workunit.client.0.smithi099.stdout:2/79: creat d10/f1a x:0 0 0 2024-01-31T05:13:08.386 INFO:tasks.workunit.client.0.smithi099.stdout:1/64: mkdir d4/db/d12 0 2024-01-31T05:13:08.388 INFO:tasks.workunit.client.0.smithi099.stdout:4/113: symlink d0/d1e/l2b 0 2024-01-31T05:13:08.391 INFO:tasks.workunit.client.0.smithi099.stdout:4/114: mknod d0/c2c 0 2024-01-31T05:13:08.391 INFO:tasks.workunit.client.0.smithi099.stdout:4/115: creat d0/d8/d19/f2d x:0 0 0 2024-01-31T05:13:08.395 INFO:tasks.workunit.client.0.smithi099.stdout:2/80: mkdir d10/d1b 0 2024-01-31T05:13:08.395 INFO:tasks.workunit.client.0.smithi099.stdout:2/81: write d10/f11 [872796,109469] 0 2024-01-31T05:13:08.398 INFO:tasks.workunit.client.0.smithi099.stdout:4/116: mknod d0/d2/d20/c2e 0 2024-01-31T05:13:08.404 INFO:tasks.workunit.client.0.smithi099.stdout:2/82: mkdir d10/d1c 0 2024-01-31T05:13:08.404 INFO:tasks.workunit.client.0.smithi099.stdout:2/83: chown f0 939 1 2024-01-31T05:13:08.406 INFO:tasks.workunit.client.0.smithi099.stdout:2/84: write f8 [475026,65554] 0 2024-01-31T05:13:08.408 INFO:tasks.workunit.client.0.smithi099.stdout:2/85: mknod d10/c1d 0 2024-01-31T05:13:08.409 INFO:tasks.workunit.client.0.smithi099.stdout:5/103: dwrite d6/fd [0,4194304] 0 2024-01-31T05:13:08.410 INFO:tasks.workunit.client.0.smithi099.stdout:5/104: readlink d6/lc 0 2024-01-31T05:13:08.410 INFO:tasks.workunit.client.0.smithi099.stdout:4/117: getdents d0/d2 0 2024-01-31T05:13:08.410 INFO:tasks.workunit.client.0.smithi099.stdout:4/118: chown d0/d2/d20/d21/d17/d24 3495 1 2024-01-31T05:13:08.411 INFO:tasks.workunit.client.0.smithi099.stdout:4/119: getdents d0/d2/d20/d21/d17/d24 0 2024-01-31T05:13:08.413 INFO:tasks.workunit.client.0.smithi099.stdout:4/120: truncate d0/d8/f11 4048286 0 2024-01-31T05:13:08.440 INFO:tasks.workunit.client.0.smithi099.stdout:5/105: dwrite d6/f18 [0,4194304] 0 2024-01-31T05:13:08.442 INFO:tasks.workunit.client.0.smithi099.stdout:2/86: dwrite f8 [0,4194304] 0 2024-01-31T05:13:08.443 INFO:tasks.workunit.client.0.smithi099.stdout:4/121: dwrite d0/d8/d19/f2d [0,4194304] 0 2024-01-31T05:13:08.443 INFO:tasks.workunit.client.0.smithi099.stdout:4/122: fdatasync d0/fd 0 2024-01-31T05:13:08.443 INFO:tasks.workunit.client.0.smithi099.stdout:4/123: chown d0/d2/d20/d21/d17/c29 12 1 2024-01-31T05:13:08.446 INFO:tasks.workunit.client.0.smithi099.stdout:2/87: rename f8 to d10/d1b/f1e 0 2024-01-31T05:13:08.451 INFO:tasks.workunit.client.0.smithi099.stdout:2/88: getdents d10 0 2024-01-31T05:13:08.453 INFO:tasks.workunit.client.0.smithi099.stdout:2/89: creat d10/d1b/f1f x:0 0 0 2024-01-31T05:13:08.453 INFO:tasks.workunit.client.0.smithi099.stdout:2/90: readlink l9 0 2024-01-31T05:13:08.455 INFO:tasks.workunit.client.0.smithi099.stdout:2/91: mkdir d10/d20 0 2024-01-31T05:13:08.471 INFO:tasks.workunit.client.0.smithi099.stdout:5/106: dwrite f3 [4194304,4194304] 0 2024-01-31T05:13:08.472 INFO:tasks.workunit.client.0.smithi099.stdout:5/107: chown d6/f10 156917 1 2024-01-31T05:13:08.472 INFO:tasks.workunit.client.0.smithi099.stdout:5/108: truncate d6/da/f19 414081 0 2024-01-31T05:13:08.472 INFO:tasks.workunit.client.0.smithi099.stdout:5/109: fdatasync f1 0 2024-01-31T05:13:08.472 INFO:tasks.workunit.client.0.smithi099.stdout:5/110: chown d6/da/l16 85 1 2024-01-31T05:13:08.472 INFO:tasks.workunit.client.0.smithi099.stdout:5/111: fdatasync d6/da/f19 0 2024-01-31T05:13:08.479 INFO:tasks.workunit.client.0.smithi099.stdout:5/112: dread f1 [0,4194304] 0 2024-01-31T05:13:08.480 INFO:tasks.workunit.client.0.smithi099.stdout:5/113: truncate d6/f11 663949 0 2024-01-31T05:13:08.483 INFO:tasks.workunit.client.0.smithi099.stdout:2/92: dwrite d10/f15 [0,4194304] 0 2024-01-31T05:13:08.483 INFO:tasks.workunit.client.0.smithi099.stdout:4/124: dwrite d0/fd [0,4194304] 0 2024-01-31T05:13:08.485 INFO:tasks.workunit.client.0.smithi099.stdout:2/93: truncate d10/d1b/f1e 2434502 0 2024-01-31T05:13:08.492 INFO:tasks.workunit.client.0.smithi099.stdout:5/114: rmdir d6 39 2024-01-31T05:13:08.493 INFO:tasks.workunit.client.0.smithi099.stdout:2/94: mknod d10/d1b/c21 0 2024-01-31T05:13:08.499 INFO:tasks.workunit.client.0.smithi099.stdout:5/115: symlink d6/d1e/d1f/d21/l23 0 2024-01-31T05:13:08.509 INFO:tasks.workunit.client.0.smithi099.stdout:4/125: write d0/fd [3349670,76746] 0 2024-01-31T05:13:08.510 INFO:tasks.workunit.client.0.smithi099.stdout:4/126: mknod d0/c2f 0 2024-01-31T05:13:08.510 INFO:tasks.workunit.client.0.smithi099.stdout:4/127: write d0/d8/f27 [521491,34849] 0 2024-01-31T05:13:08.511 INFO:tasks.workunit.client.0.smithi099.stdout:4/128: stat d0/d1e/l2b 0 2024-01-31T05:13:08.512 INFO:tasks.workunit.client.0.smithi099.stdout:2/95: dwrite d10/f19 [0,4194304] 0 2024-01-31T05:13:08.512 INFO:tasks.workunit.client.0.smithi099.stdout:2/96: dread - d10/d1b/f1f zero size 2024-01-31T05:13:08.512 INFO:tasks.workunit.client.0.smithi099.stdout:4/129: unlink d0/d8/d19/f23 0 2024-01-31T05:13:08.512 INFO:tasks.workunit.client.0.smithi099.stdout:4/130: chown d0/d8 1330712 1 2024-01-31T05:13:08.512 INFO:tasks.workunit.client.0.smithi099.stdout:4/131: chown d0/d2/l28 61 1 2024-01-31T05:13:08.513 INFO:tasks.workunit.client.0.smithi099.stdout:5/116: dread f4 [0,4194304] 0 2024-01-31T05:13:08.516 INFO:tasks.workunit.client.0.smithi099.stdout:4/132: rename d0/d2/l28 to d0/d2/l30 0 2024-01-31T05:13:08.516 INFO:tasks.workunit.client.0.smithi099.stdout:4/133: write d0/d8/f11 [2647856,32186] 0 2024-01-31T05:13:08.517 INFO:tasks.workunit.client.0.smithi099.stdout:2/97: rmdir d10/d1b 39 2024-01-31T05:13:08.518 INFO:tasks.workunit.client.0.smithi099.stdout:4/134: creat d0/d2/d20/f31 x:0 0 0 2024-01-31T05:13:08.519 INFO:tasks.workunit.client.0.smithi099.stdout:2/98: truncate f1 5585078 0 2024-01-31T05:13:08.520 INFO:tasks.workunit.client.0.smithi099.stdout:2/99: symlink d10/l22 0 2024-01-31T05:13:08.522 INFO:tasks.workunit.client.0.smithi099.stdout:0/80: sync 2024-01-31T05:13:08.522 INFO:tasks.workunit.client.0.smithi099.stdout:3/60: sync 2024-01-31T05:13:08.522 INFO:tasks.workunit.client.0.smithi099.stdout:9/70: sync 2024-01-31T05:13:08.522 INFO:tasks.workunit.client.0.smithi099.stdout:6/65: sync 2024-01-31T05:13:08.522 INFO:tasks.workunit.client.0.smithi099.stdout:3/61: chown d10/l12 772477 1 2024-01-31T05:13:08.522 INFO:tasks.workunit.client.0.smithi099.stdout:9/71: fsync d0/d7/f13 0 2024-01-31T05:13:08.522 INFO:tasks.workunit.client.0.smithi099.stdout:0/81: creat d1/d16/f1a x:0 0 0 2024-01-31T05:13:08.522 INFO:tasks.workunit.client.0.smithi099.stdout:2/100: creat d10/d1b/f23 x:0 0 0 2024-01-31T05:13:08.525 INFO:tasks.workunit.client.0.smithi099.stdout:3/62: mknod d10/c14 0 2024-01-31T05:13:08.527 INFO:tasks.workunit.client.0.smithi099.stdout:9/72: mkdir d0/d1/d15 0 2024-01-31T05:13:08.528 INFO:tasks.workunit.client.0.smithi099.stdout:0/82: dread - d1/f5 zero size 2024-01-31T05:13:08.531 INFO:tasks.workunit.client.0.smithi099.stdout:2/101: unlink c5 0 2024-01-31T05:13:08.533 INFO:tasks.workunit.client.0.smithi099.stdout:5/117: dwrite d6/f13 [0,4194304] 0 2024-01-31T05:13:08.534 INFO:tasks.workunit.client.0.smithi099.stdout:5/118: write d6/da/f19 [992566,83484] 0 2024-01-31T05:13:08.534 INFO:tasks.workunit.client.0.smithi099.stdout:5/119: chown d6/lc 41745 1 2024-01-31T05:13:08.539 INFO:tasks.workunit.client.0.smithi099.stdout:3/63: mknod d10/c15 0 2024-01-31T05:13:08.539 INFO:tasks.workunit.client.0.smithi099.stdout:3/64: fdatasync f0 0 2024-01-31T05:13:08.539 INFO:tasks.workunit.client.0.smithi099.stdout:9/73: symlink d0/d1/d15/l16 0 2024-01-31T05:13:08.539 INFO:tasks.workunit.client.0.smithi099.stdout:0/83: rename d1/d16/f1a to d1/d8/df/f1b 0 2024-01-31T05:13:08.539 INFO:tasks.workunit.client.0.smithi099.stdout:0/84: chown d1/d8/df/f10 3983 1 2024-01-31T05:13:08.543 INFO:tasks.workunit.client.0.smithi099.stdout:9/74: rename d0/f10 to d0/d1/d15/f17 0 2024-01-31T05:13:08.546 INFO:tasks.workunit.client.0.smithi099.stdout:4/135: dwrite d0/d2/f15 [0,4194304] 0 2024-01-31T05:13:08.546 INFO:tasks.workunit.client.0.smithi099.stdout:6/66: dwrite f10 [0,4194304] 0 2024-01-31T05:13:08.547 INFO:tasks.workunit.client.0.smithi099.stdout:9/75: rmdir d0/df 0 2024-01-31T05:13:08.548 INFO:tasks.workunit.client.0.smithi099.stdout:0/85: link d1/f4 d1/d16/f1c 0 2024-01-31T05:13:08.550 INFO:tasks.workunit.client.0.smithi099.stdout:4/136: creat d0/d2/d20/d21/d17/d24/f32 x:0 0 0 2024-01-31T05:13:08.555 INFO:tasks.workunit.client.0.smithi099.stdout:9/76: symlink d0/l18 0 2024-01-31T05:13:08.560 INFO:tasks.workunit.client.0.smithi099.stdout:4/137: symlink d0/d1e/l33 0 2024-01-31T05:13:08.564 INFO:tasks.workunit.client.0.smithi099.stdout:3/65: dwrite f7 [0,4194304] 0 2024-01-31T05:13:08.572 INFO:tasks.workunit.client.0.smithi099.stdout:2/102: dwrite d10/f1a [0,4194304] 0 2024-01-31T05:13:08.578 INFO:tasks.workunit.client.0.smithi099.stdout:6/67: dread f7 [0,4194304] 0 2024-01-31T05:13:08.588 INFO:tasks.workunit.client.0.smithi099.stdout:0/86: dwrite d1/f9 [0,4194304] 0 2024-01-31T05:13:08.589 INFO:tasks.workunit.client.0.smithi099.stdout:6/68: read f7 [3111258,18176] 0 2024-01-31T05:13:08.589 INFO:tasks.workunit.client.0.smithi099.stdout:5/120: dwrite d6/d1e/d1f/f22 [0,4194304] 0 2024-01-31T05:13:08.589 INFO:tasks.workunit.client.0.smithi099.stdout:9/77: dwrite d0/d7/fa [0,4194304] 0 2024-01-31T05:13:08.591 INFO:tasks.workunit.client.0.smithi099.stdout:0/87: rename d1/f6 to d1/d8/df/f1d 0 2024-01-31T05:13:08.597 INFO:tasks.workunit.client.0.smithi099.stdout:4/138: dwrite d0/d8/d19/f2d [0,4194304] 0 2024-01-31T05:13:08.597 INFO:tasks.workunit.client.0.smithi099.stdout:3/66: dwrite f7 [4194304,4194304] 0 2024-01-31T05:13:08.606 INFO:tasks.workunit.client.0.smithi099.stdout:6/69: mkdir d14 0 2024-01-31T05:13:08.609 INFO:tasks.workunit.client.0.smithi099.stdout:9/78: symlink d0/d1/l19 0 2024-01-31T05:13:08.609 INFO:tasks.workunit.client.0.smithi099.stdout:5/121: dwrite d6/da/d14/f20 [0,4194304] 0 2024-01-31T05:13:08.610 INFO:tasks.workunit.client.0.smithi099.stdout:0/88: creat d1/f1e x:0 0 0 2024-01-31T05:13:08.613 INFO:tasks.workunit.client.0.smithi099.stdout:4/139: mknod d0/d2/c34 0 2024-01-31T05:13:08.614 INFO:tasks.workunit.client.0.smithi099.stdout:2/103: rmdir d10/d1b 39 2024-01-31T05:13:08.616 INFO:tasks.workunit.client.0.smithi099.stdout:9/79: symlink d0/l1a 0 2024-01-31T05:13:08.619 INFO:tasks.workunit.client.0.smithi099.stdout:3/67: dwrite f4 [0,4194304] 0 2024-01-31T05:13:08.620 INFO:tasks.workunit.client.0.smithi099.stdout:0/89: symlink d1/d8/l1f 0 2024-01-31T05:13:08.620 INFO:tasks.workunit.client.0.smithi099.stdout:0/90: chown d1/f9 0 1 2024-01-31T05:13:08.620 INFO:tasks.workunit.client.0.smithi099.stdout:0/91: chown d1/d16 1 1 2024-01-31T05:13:08.622 INFO:tasks.workunit.client.0.smithi099.stdout:4/140: creat d0/d1e/f35 x:0 0 0 2024-01-31T05:13:08.622 INFO:tasks.workunit.client.0.smithi099.stdout:4/141: write d0/d2/d20/f31 [859774,33043] 0 2024-01-31T05:13:08.625 INFO:tasks.workunit.client.0.smithi099.stdout:3/68: creat d10/f16 x:0 0 0 2024-01-31T05:13:08.627 INFO:tasks.workunit.client.0.smithi099.stdout:9/80: getdents d0/d7 0 2024-01-31T05:13:08.627 INFO:tasks.workunit.client.0.smithi099.stdout:9/81: write d0/d7/f13 [450138,40773] 0 2024-01-31T05:13:08.629 INFO:tasks.workunit.client.0.smithi099.stdout:3/69: rename c5 to d10/c17 0 2024-01-31T05:13:08.631 INFO:tasks.workunit.client.0.smithi099.stdout:9/82: creat d0/d1/d15/f1b x:0 0 0 2024-01-31T05:13:08.632 INFO:tasks.workunit.client.0.smithi099.stdout:9/83: write d0/d1/fc [682176,84230] 0 2024-01-31T05:13:08.632 INFO:tasks.workunit.client.0.smithi099.stdout:9/84: dread - d0/d1/d15/f1b zero size 2024-01-31T05:13:08.632 INFO:tasks.workunit.client.0.smithi099.stdout:3/70: mkdir d10/d18 0 2024-01-31T05:13:08.632 INFO:tasks.workunit.client.0.smithi099.stdout:3/71: creat d10/f19 x:0 0 0 2024-01-31T05:13:08.632 INFO:tasks.workunit.client.0.smithi099.stdout:3/72: write f7 [9400404,77603] 0 2024-01-31T05:13:08.633 INFO:tasks.workunit.client.0.smithi099.stdout:3/73: chown d10/c15 100 1 2024-01-31T05:13:08.635 INFO:tasks.workunit.client.0.smithi099.stdout:9/85: rename d0/l12 to d0/d7/l1c 0 2024-01-31T05:13:08.639 INFO:tasks.workunit.client.0.smithi099.stdout:5/122: write d6/da/d14/f20 [4454022,31377] 0 2024-01-31T05:13:08.642 INFO:tasks.workunit.client.0.smithi099.stdout:9/86: rename d0/d1/fc to d0/d1/f1d 0 2024-01-31T05:13:08.646 INFO:tasks.workunit.client.0.smithi099.stdout:9/87: mknod d0/c1e 0 2024-01-31T05:13:08.656 INFO:tasks.workunit.client.0.smithi099.stdout:2/104: dwrite d10/f15 [4194304,4194304] 0 2024-01-31T05:13:08.657 INFO:tasks.workunit.client.0.smithi099.stdout:5/123: dread d6/fd [0,4194304] 0 2024-01-31T05:13:08.657 INFO:tasks.workunit.client.0.smithi099.stdout:6/70: dwrite f12 [0,4194304] 0 2024-01-31T05:13:08.658 INFO:tasks.workunit.client.0.smithi099.stdout:6/71: fdatasync fa 0 2024-01-31T05:13:08.658 INFO:tasks.workunit.client.0.smithi099.stdout:6/72: getdents d14 0 2024-01-31T05:13:08.661 INFO:tasks.workunit.client.0.smithi099.stdout:5/124: creat d6/da/d14/f24 x:0 0 0 2024-01-31T05:13:08.663 INFO:tasks.workunit.client.0.smithi099.stdout:0/92: dwrite d1/d8/df/f15 [0,4194304] 0 2024-01-31T05:13:08.663 INFO:tasks.workunit.client.0.smithi099.stdout:4/142: dwrite d0/d2/d20/d21/d17/d24/f32 [0,4194304] 0 2024-01-31T05:13:08.664 INFO:tasks.workunit.client.0.smithi099.stdout:4/143: creat d0/d1e/f36 x:0 0 0 2024-01-31T05:13:08.664 INFO:tasks.workunit.client.0.smithi099.stdout:4/144: write d0/fd [2253501,35168] 0 2024-01-31T05:13:08.664 INFO:tasks.workunit.client.0.smithi099.stdout:4/145: fsync d0/d1e/f35 0 2024-01-31T05:13:08.664 INFO:tasks.workunit.client.0.smithi099.stdout:3/74: dwrite d10/f19 [0,4194304] 0 2024-01-31T05:13:08.667 INFO:tasks.workunit.client.0.smithi099.stdout:5/125: dread d6/da/f19 [0,4194304] 0 2024-01-31T05:13:08.667 INFO:tasks.workunit.client.0.smithi099.stdout:5/126: chown d6/d1e/d1f 4047122 1 2024-01-31T05:13:08.674 INFO:tasks.workunit.client.0.smithi099.stdout:9/88: getdents d0 0 2024-01-31T05:13:08.674 INFO:tasks.workunit.client.0.smithi099.stdout:4/146: rmdir d0/d2/d20/d21 39 2024-01-31T05:13:08.675 INFO:tasks.workunit.client.0.smithi099.stdout:6/73: write f12 [1655997,40511] 0 2024-01-31T05:13:08.678 INFO:tasks.workunit.client.0.smithi099.stdout:3/75: mknod d10/d18/c1a 0 2024-01-31T05:13:08.679 INFO:tasks.workunit.client.0.smithi099.stdout:5/127: mknod d6/da/d14/c25 0 2024-01-31T05:13:08.680 INFO:tasks.workunit.client.0.smithi099.stdout:1/65: sync 2024-01-31T05:13:08.680 INFO:tasks.workunit.client.0.smithi099.stdout:7/82: sync 2024-01-31T05:13:08.681 INFO:tasks.workunit.client.0.smithi099.stdout:8/178: sync 2024-01-31T05:13:08.681 INFO:tasks.workunit.client.0.smithi099.stdout:6/74: dread fc [0,4194304] 0 2024-01-31T05:13:08.681 INFO:tasks.workunit.client.0.smithi099.stdout:6/75: fdatasync fa 0 2024-01-31T05:13:08.681 INFO:tasks.workunit.client.0.smithi099.stdout:9/89: creat d0/d7/f1f x:0 0 0 2024-01-31T05:13:08.682 INFO:tasks.workunit.client.0.smithi099.stdout:2/105: dwrite d10/d1b/f1e [0,4194304] 0 2024-01-31T05:13:08.682 INFO:tasks.workunit.client.0.smithi099.stdout:2/106: fsync d10/d1b/f1e 0 2024-01-31T05:13:08.684 INFO:tasks.workunit.client.0.smithi099.stdout:5/128: symlink d6/da/l26 0 2024-01-31T05:13:08.685 INFO:tasks.workunit.client.0.smithi099.stdout:5/129: truncate f4 4764340 0 2024-01-31T05:13:08.685 INFO:tasks.workunit.client.0.smithi099.stdout:7/83: creat d6/f15 x:0 0 0 2024-01-31T05:13:08.686 INFO:tasks.workunit.client.0.smithi099.stdout:1/66: read d4/fa [2087871,10169] 0 2024-01-31T05:13:08.687 INFO:tasks.workunit.client.0.smithi099.stdout:8/179: symlink d1/dd/d11/d19/d21/l34 0 2024-01-31T05:13:08.687 INFO:tasks.workunit.client.0.smithi099.stdout:8/180: truncate d1/dd/d11/f31 57859 0 2024-01-31T05:13:08.687 INFO:tasks.workunit.client.0.smithi099.stdout:8/181: readlink d1/dd/d11/l14 0 2024-01-31T05:13:08.690 INFO:tasks.workunit.client.0.smithi099.stdout:3/76: write d10/f19 [1382050,6483] 0 2024-01-31T05:13:08.690 INFO:tasks.workunit.client.0.smithi099.stdout:6/76: link f10 d14/f15 0 2024-01-31T05:13:08.690 INFO:tasks.workunit.client.0.smithi099.stdout:3/77: truncate d10/f16 174739 0 2024-01-31T05:13:08.690 INFO:tasks.workunit.client.0.smithi099.stdout:6/77: chown le 136 1 2024-01-31T05:13:08.690 INFO:tasks.workunit.client.0.smithi099.stdout:3/78: creat d10/f1b x:0 0 0 2024-01-31T05:13:08.690 INFO:tasks.workunit.client.0.smithi099.stdout:9/90: truncate d0/d1/d15/f17 3547557 0 2024-01-31T05:13:08.693 INFO:tasks.workunit.client.0.smithi099.stdout:0/93: dwrite d1/d16/f17 [0,4194304] 0 2024-01-31T05:13:08.696 INFO:tasks.workunit.client.0.smithi099.stdout:7/84: rename d6/f7 to d6/d12/f16 0 2024-01-31T05:13:08.697 INFO:tasks.workunit.client.0.smithi099.stdout:1/67: symlink d4/db/l13 0 2024-01-31T05:13:08.699 INFO:tasks.workunit.client.0.smithi099.stdout:8/182: unlink d1/dd/d11/d20/f23 0 2024-01-31T05:13:08.699 INFO:tasks.workunit.client.0.smithi099.stdout:8/183: fdatasync d1/f10 0 2024-01-31T05:13:08.701 INFO:tasks.workunit.client.0.smithi099.stdout:6/78: creat d14/f16 x:0 0 0 2024-01-31T05:13:08.701 INFO:tasks.workunit.client.0.smithi099.stdout:6/79: write fa [4697098,50650] 0 2024-01-31T05:13:08.701 INFO:tasks.workunit.client.0.smithi099.stdout:6/80: creat d14/f17 x:0 0 0 2024-01-31T05:13:08.702 INFO:tasks.workunit.client.0.smithi099.stdout:3/79: symlink d10/l1c 0 2024-01-31T05:13:08.703 INFO:tasks.workunit.client.0.smithi099.stdout:2/107: truncate d10/f11 189400 0 2024-01-31T05:13:08.708 INFO:tasks.workunit.client.0.smithi099.stdout:8/184: dread d1/f10 [0,4194304] 0 2024-01-31T05:13:08.708 INFO:tasks.workunit.client.0.smithi099.stdout:8/185: chown l0 11 1 2024-01-31T05:13:08.708 INFO:tasks.workunit.client.0.smithi099.stdout:5/130: dwrite d6/da/d14/f1a [0,4194304] 0 2024-01-31T05:13:08.709 INFO:tasks.workunit.client.0.smithi099.stdout:1/68: rename d4/cd to d4/c14 0 2024-01-31T05:13:08.712 INFO:tasks.workunit.client.0.smithi099.stdout:3/80: creat d10/d18/f1d x:0 0 0 2024-01-31T05:13:08.713 INFO:tasks.workunit.client.0.smithi099.stdout:7/85: dread f2 [0,4194304] 0 2024-01-31T05:13:08.713 INFO:tasks.workunit.client.0.smithi099.stdout:3/81: write d10/d18/f1d [676723,129317] 0 2024-01-31T05:13:08.715 INFO:tasks.workunit.client.0.smithi099.stdout:5/131: creat d6/d1e/d1f/d21/f27 x:0 0 0 2024-01-31T05:13:08.717 INFO:tasks.workunit.client.0.smithi099.stdout:1/69: mkdir d4/dc/d15 0 2024-01-31T05:13:08.717 INFO:tasks.workunit.client.0.smithi099.stdout:9/91: write d0/d7/fa [2833238,58164] 0 2024-01-31T05:13:08.717 INFO:tasks.workunit.client.0.smithi099.stdout:9/92: fdatasync d0/d7/f14 0 2024-01-31T05:13:08.717 INFO:tasks.workunit.client.0.smithi099.stdout:9/93: fsync d0/d7/f1f 0 2024-01-31T05:13:08.717 INFO:tasks.workunit.client.0.smithi099.stdout:9/94: readlink d0/l1a 0 2024-01-31T05:13:08.717 INFO:tasks.workunit.client.0.smithi099.stdout:9/95: readlink d0/d1/d15/l16 0 2024-01-31T05:13:08.718 INFO:tasks.workunit.client.0.smithi099.stdout:7/86: creat d6/d12/f17 x:0 0 0 2024-01-31T05:13:08.719 INFO:tasks.workunit.client.0.smithi099.stdout:6/81: read fa [3877793,117084] 0 2024-01-31T05:13:08.719 INFO:tasks.workunit.client.0.smithi099.stdout:6/82: chown f11 1992601 1 2024-01-31T05:13:08.719 INFO:tasks.workunit.client.0.smithi099.stdout:6/83: fdatasync d14/f16 0 2024-01-31T05:13:08.720 INFO:tasks.workunit.client.0.smithi099.stdout:1/70: write f3 [294555,95352] 0 2024-01-31T05:13:08.720 INFO:tasks.workunit.client.0.smithi099.stdout:1/71: chown d4/c7 21 1 2024-01-31T05:13:08.720 INFO:tasks.workunit.client.0.smithi099.stdout:1/72: dread - d4/db/f10 zero size 2024-01-31T05:13:08.721 INFO:tasks.workunit.client.0.smithi099.stdout:7/87: symlink d6/l18 0 2024-01-31T05:13:08.726 INFO:tasks.workunit.client.0.smithi099.stdout:6/84: dread fc [0,4194304] 0 2024-01-31T05:13:08.730 INFO:tasks.workunit.client.0.smithi099.stdout:5/132: write f3 [7112213,43186] 0 2024-01-31T05:13:08.731 INFO:tasks.workunit.client.0.smithi099.stdout:5/133: symlink d6/da/d14/l28 0 2024-01-31T05:13:08.732 INFO:tasks.workunit.client.0.smithi099.stdout:5/134: symlink d6/d1e/d1f/d21/l29 0 2024-01-31T05:13:08.733 INFO:tasks.workunit.client.0.smithi099.stdout:5/135: symlink d6/da/d14/l2a 0 2024-01-31T05:13:08.734 INFO:tasks.workunit.client.0.smithi099.stdout:5/136: mkdir d6/da/d14/d2b 0 2024-01-31T05:13:08.740 INFO:tasks.workunit.client.0.smithi099.stdout:6/85: write d14/f15 [1328934,93680] 0 2024-01-31T05:13:08.748 INFO:tasks.workunit.client.0.smithi099.stdout:0/94: dwrite d1/f9 [0,4194304] 0 2024-01-31T05:13:08.753 INFO:tasks.workunit.client.0.smithi099.stdout:7/88: dwrite f2 [4194304,4194304] 0 2024-01-31T05:13:08.755 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.479+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001eb7 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/pthreads/Makefile auth v20 ap=1 s=1021 n(v0 rc2009-10-09T17:55:50.000000+0000 b1021 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d9895d5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001eb7:[<0x1000000205e/Makefile v4>,<0x1000000205b/pthreads v40>,<0x10000001eda/sched v126>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001eb7:[<0x1000000205e/Makefile v20>,<0x1000000205b/pthreads v40>,<0x10000001eda/sched v1140>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.755 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.479+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001eb9 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/pthreads/pth_str03.c auth v14 ap=1 s=18106 n(v0 rc2009-02-26T12:02:28.000000+0000 b18106 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d9895d5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001eb9:[<0x1000000205e/pth_str03.c v8>,<0x1000000205b/pthreads v40>,<0x10000001eda/sched v126>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001eb9:[<0x1000000205e/pth_str03.c v14>,<0x1000000205b/pthreads v40>,<0x10000001eda/sched v1140>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.757 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.479+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001eba [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/pthreads/pth_str02.c auth v16 ap=1 s=7334 n(v0 rc2009-02-26T12:02:28.000000+0000 b7334 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d9895d6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001eba:[<0x1000000205e/pth_str02.c v10>,<0x1000000205b/pthreads v40>,<0x10000001eda/sched v126>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001eba:[<0x1000000205e/pth_str02.c v16>,<0x1000000205b/pthreads v40>,<0x10000001eda/sched v1140>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.757 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.479+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001eb8 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/pthreads/pth_str01.c auth v12 ap=1 s=16267 n(v0 rc2007-06-22T06:28:12.000000+0000 b16267 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d9895d5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001eb8:[<0x1000000205e/pth_str01.c v6>,<0x1000000205b/pthreads v40>,<0x10000001eda/sched v126>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001eb8:[<0x1000000205e/pth_str01.c v12>,<0x1000000205b/pthreads v40>,<0x10000001eda/sched v1140>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.757 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.479+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000205f [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/pthreads/pth_str01.h auth v18 ap=1 s=1525 n(v0 rc2024-01-31T05:12:56.600595+0000 b1525 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d9895d6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000205f:[<0x1000000205e/pth_str01.h v2>,<0x1000000205b/pthreads v40>,<0x10000001eda/sched v126>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000205f:[<0x1000000205e/pth_str01.h v18>,<0x1000000205b/pthreads v40>,<0x10000001eda/sched v1140>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.757 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.510+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001cd8 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/vmtests/data_space.c auth v10 ap=1 s=10332 n(v0 rc2009-10-13T14:00:46.000000+0000 b10332 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d98956fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001cd8:[<0x10000001ee3/data_space.c v6>,<0x10000001edb/vmtests v38>,<0x10000001eda/mem v28>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001cd8:[<0x10000001ee3/data_space.c v10>,<0x10000001edb/vmtests v38>,<0x10000001eda/mem v1136>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.757 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.510+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001cd7 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/vmtests/stack_space.c auth v8 ap=1 s=9182 n(v0 rc2009-10-13T14:00:46.000000+0000 b9182 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d98956f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001cd7:[<0x10000001ee3/stack_space.c v4>,<0x10000001edb/vmtests v38>,<0x10000001eda/mem v28>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001cd7:[<0x10000001ee3/stack_space.c v8>,<0x10000001edb/vmtests v38>,<0x10000001eda/mem v1136>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.757 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.510+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ee4 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/vmtests/Makefile auth v12 ap=1 s=961 n(v0 rc2024-01-31T05:12:56.198604+0000 b961 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d98956f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ee4:[<0x10000001ee3/Makefile v2>,<0x10000001edb/vmtests v38>,<0x10000001eda/mem v28>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001ee4:[<0x10000001ee3/Makefile v12>,<0x10000001edb/vmtests v38>,<0x10000001eda/mem v1136>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.757 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.528+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000218e [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/writetest/Makefile auth v12 ap=1 s=1011 n(v0 rc2024-01-31T05:12:56.755592+0000 b1011 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d9894a7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000218e:[<0x1000000218d/Makefile v2>,<0x1000000217c/writetest v108>,<0x10000001eda/io v168>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000218e:[<0x1000000218d/Makefile v12>,<0x1000000217c/writetest v108>,<0x10000001eda/io v1158>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.757 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.528+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fbd [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/writetest/writetest.c auth v8 ap=1 s=6700 n(v0 rc2009-10-18T18:09:26.000000+0000 b6700 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d9894a7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fbd:[<0x1000000218d/writetest.c v4>,<0x1000000217c/writetest v108>,<0x10000001eda/io v168>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001fbd:[<0x1000000218d/writetest.c v8>,<0x1000000217c/writetest v108>,<0x10000001eda/io v1158>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.758 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.528+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fbe [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/writetest/gpl.txt auth v10 ap=1 s=18009 n(v0 rc2004-05-24T15:07:08.000000+0000 b18009 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d9895d8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fbe:[<0x1000000218d/gpl.txt v6>,<0x1000000217c/writetest v108>,<0x10000001eda/io v168>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001fbe:[<0x1000000218d/gpl.txt v10>,<0x1000000217c/writetest v108>,<0x10000001eda/io v1158>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.758 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.572+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000244d [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/wait4/wait401.c auth v8 ap=1 s=4527 n(v0 rc2009-11-02T13:57:19.000000+0000 b4527 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d9895d8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000244d:[<0x100000026bc/wait401.c v6>,<0x10000002572/wait4 v1530>,<0x10000001eda/syscalls v874>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000244d:[<0x100000026bc/wait401.c v8>,<0x10000002572/wait4 v1530>,<0x10000001eda/syscalls v1573>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.758 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.572+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000244c [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/wait4/wait402.c auth v12 ap=1 s=4897 n(v0 rc2009-03-23T13:36:15.000000+0000 b4897 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d9895d8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000244c:[<0x100000026bc/wait402.c v4>,<0x10000002572/wait4 v1530>,<0x10000001eda/syscalls v874>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000244c:[<0x100000026bc/wait402.c v12>,<0x10000002572/wait4 v1530>,<0x10000001eda/syscalls v1573>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.758 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.573+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000026bd [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/wait4/Makefile auth v10 ap=1 s=915 n(v0 rc2024-01-31T05:12:57.891565+0000 b915 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d9895d9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000026bd:[<0x100000026bc/Makefile v2>,<0x10000002572/wait4 v1530>,<0x10000001eda/syscalls v874>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000026bd:[<0x100000026bc/Makefile v10>,<0x10000002572/wait4 v1530>,<0x10000001eda/syscalls v1573>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.758 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.584+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000026a3 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setegid/Makefile auth v8 ap=1 s=915 n(v0 rc2024-01-31T05:12:57.844566+0000 b915 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d9895d4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000026a3:[<0x100000026a2/Makefile v2>,<0x10000002572/setegid v1504>,<0x10000001eda/syscalls v874>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000026a3:[<0x100000026a2/Makefile v8>,<0x10000002572/setegid v1504>,<0x10000001eda/syscalls v1573>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.758 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.585+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000242a [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setegid/setegid01.c auth v6 ap=1 s=3360 n(v0 rc2009-03-23T13:36:02.000000+0000 b3360 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d9895d4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000242a:[<0x100000026a2/setegid01.c v4>,<0x10000002572/setegid v1504>,<0x10000001eda/syscalls v874>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000242a:[<0x100000026a2/setegid01.c v6>,<0x10000002572/setegid v1504>,<0x10000001eda/syscalls v1573>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.759 INFO:tasks.workunit.client.0.smithi099.stdout:5/137: dread d6/f13 [0,4194304] 0 2024-01-31T05:13:08.759 INFO:tasks.workunit.client.0.smithi099.stdout:5/138: stat d6/f10 0 2024-01-31T05:13:08.759 INFO:tasks.workunit.client.0.smithi099.stdout:2/108: dwrite d10/d1b/f1e [4194304,4194304] 0 2024-01-31T05:13:08.759 INFO:tasks.workunit.client.0.smithi099.stdout:9/96: write d0/d7/f14 [1822520,99991] 0 2024-01-31T05:13:08.759 INFO:tasks.workunit.client.0.smithi099.stdout:1/73: dwrite d4/db/f10 [0,4194304] 0 2024-01-31T05:13:08.759 INFO:tasks.workunit.client.0.smithi099.stdout:9/97: write d0/d7/fa [3581575,107746] 0 2024-01-31T05:13:08.759 INFO:tasks.workunit.client.0.smithi099.stdout:7/89: symlink d6/l19 0 2024-01-31T05:13:08.759 INFO:tasks.workunit.client.0.smithi099.stdout:7/90: dread - d6/ff zero size 2024-01-31T05:13:08.760 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.461+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022a7 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/user_space/ auth v29 ap=1 f(v0 m2024-01-31T05:12:57.106584+0000 2=2+0) n(v0 rc2024-01-31T05:12:57.106584+0000 b11777 3=2+1) (inest lock) (ifile excl) (iversion lock) caps={15315=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15315 | lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851135080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000022a7:[<0x100000022a6/user_space v6>,<0x10000002195/drm v52>,<0x10000001eda/device-drivers v200>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x100000022a7:[<0x100000022a6/user_space v29>,<0x10000002195/drm v108>,<0x10000001eda/device-drivers v1162>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.106584+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.106584+0000 b11777 3=2+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.106584+0000 2=2+0)","memory_value.rstat":"n(v0 rc2024-01-31T05:12:57.106584+0000 b11777 3=2+1)","error_str":""},"return_code":0} 2024-01-31T05:13:08.760 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.462+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022a8 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/user_space/user_tdrm.c auth v6 ap=1 s=11641 n(v0 rc2009-02-26T12:14:52.000000+0000 b11641 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851135600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022a8:[<0x100000022a7/user_tdrm.c v2>,<0x100000022a6/user_space v6>,<0x10000002195/drm v52>,<0x10000001eda/device-drivers v200>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022a8:[<0x100000022a7/user_tdrm.c v6>,<0x100000022a6/user_space v29>,<0x10000002195/drm v108>,<0x10000001eda/device-drivers v1162>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.760 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:08.461+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002112 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/acpi/LtpAcpiMain.c auth v24 ap=1 s=4546 n(v0 rc2009-03-04T08:53:40.000000+0000 b4546 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e703b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002112:[<0x100000022b5/LtpAcpiMain.c v4>,<0x10000002195/acpi v78>,<0x10000001eda/device-drivers v200>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002112:[<0x100000022b5/LtpAcpiMain.c v24>,<0x10000002195/acpi v78>,<0x10000001eda/device-drivers v1162>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.760 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:08.461+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002116 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/acpi/ltpacpi.sh auth v14 ap=1 s=1369 n(v0 rc2006-08-21T07:28:29.000000+0000 b1369 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e704100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002116:[<0x100000022b5/ltpacpi.sh v12>,<0x10000002195/acpi v78>,<0x10000001eda/device-drivers v200>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002116:[<0x100000022b5/ltpacpi.sh v14>,<0x10000002195/acpi v78>,<0x10000001eda/device-drivers v1162>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.761 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.462+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000020fe [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/user_space/Makefile auth v8 ap=1 s=136 n(v0 rc2009-02-26T06:29:47.000000+0000 b136 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e851135b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000020fe:[<0x100000022a7/Makefile v4>,<0x100000022a6/user_space v6>,<0x10000002195/drm v52>,<0x10000001eda/device-drivers v200>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000020fe:[<0x100000022a7/Makefile v8>,<0x100000022a6/user_space v29>,<0x10000002195/drm v108>,<0x10000001eda/device-drivers v1162>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.761 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.469+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022a9 [...2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space/ auth{0=1} v31 ap=2 RANDEPHEMERALPIN f(v0 m2024-01-31T05:12:57.108583+0000 6=6+0) n(v1 rc2024-01-31T05:12:57.108583+0000 b11312 7=6+1) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15315=pAsLsXsFs/pAsLsXsFsxcral@2} | dirtyscattered=0 lock=3 importingcaps=0 dirfrag=1 caps=1 stickydirs=0 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 randepin 0x55e850fc2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000022a9:[<0x100000022a6/kernel_space v20>,<0x10000002195/drm v52>,<0x10000001eda/device-drivers v200>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x100000022a9:[<0x100000022a6/kernel_space v25>,<0x10000002195/drm v108>,<0x10000001eda/device-drivers v1162>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-31T05:12:57.108583+0000 6=6+0)","ondisk_value.rstat":"n(v0 rc2024-01-31T05:12:57.108583+0000 7=6+1)","memory_value.dirstat":"f(v0 m2024-01-31T05:12:57.108583+0000 6=6+0)","memory_value.rstat":"n(v1 rc2024-01-31T05:12:57.108583+0000 b11312 7=6+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-01-31T05:13:08.761 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.623+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000247a [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresgid/Makefile auth v10 ap=1 s=915 n(v0 rc2009-10-09T17:55:55.000000+0000 b915 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850f85b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000247a:[<0x100000026de/Makefile v4>,<0x10000002572/getresgid v1564>,<0x10000001eda/syscalls v874>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000247a:[<0x100000026de/Makefile v10>,<0x10000002572/getresgid v1564>,<0x10000001eda/syscalls v1573>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.761 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.623+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000247b [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresgid/getresgid03.c auth v12 ap=1 s=6530 n(v0 rc2009-03-23T13:35:45.000000+0000 b6530 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850f86680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000247b:[<0x100000026de/getresgid03.c v6>,<0x10000002572/getresgid v1564>,<0x10000001eda/syscalls v874>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000247b:[<0x100000026de/getresgid03.c v12>,<0x10000002572/getresgid v1564>,<0x10000001eda/syscalls v1573>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.761 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.623+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000247c [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresgid/getresgid02.c auth v14 ap=1 s=6274 n(v0 rc2009-03-23T13:35:45.000000+0000 b6274 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850f86100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000247c:[<0x100000026de/getresgid02.c v8>,<0x10000002572/getresgid v1564>,<0x10000001eda/syscalls v874>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000247c:[<0x100000026de/getresgid02.c v14>,<0x10000002572/getresgid v1564>,<0x10000001eda/syscalls v1573>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.761 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.624+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000026df [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresgid/getresgid01.c auth v16 ap=1 s=4833 n(v0 rc2024-01-31T05:12:57.944564+0000 b4833 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850f86c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000026df:[<0x100000026de/getresgid01.c v2>,<0x10000002572/getresgid v1564>,<0x10000001eda/syscalls v874>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000026df:[<0x100000026de/getresgid01.c v16>,<0x10000002572/getresgid v1564>,<0x10000001eda/syscalls v1573>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.762 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:08.461+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022b6 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/acpi/LtpAcpi.h auth v22 ap=1 s=3940 n(v0 rc2024-01-31T05:12:57.131583+0000 b3940 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e704680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022b6:[<0x100000022b5/LtpAcpi.h v2>,<0x10000002195/acpi v78>,<0x10000001eda/device-drivers v200>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022b6:[<0x100000022b5/LtpAcpi.h v22>,<0x10000002195/acpi v78>,<0x10000001eda/device-drivers v1162>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.762 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:08.461+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002113 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/acpi/Makefile auth v16 ap=1 s=680 n(v0 rc2009-11-06T20:07:29.000000+0000 b680 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e704c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002113:[<0x100000022b5/Makefile v6>,<0x10000002195/acpi v78>,<0x10000001eda/device-drivers v200>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002113:[<0x100000022b5/Makefile v16>,<0x10000002195/acpi v78>,<0x10000001eda/device-drivers v1162>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.762 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:08.462+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002115 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/acpi/README auth v20 ap=1 s=2345 n(v0 rc2006-01-09T17:06:12.000000+0000 b2345 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e705180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002115:[<0x100000022b5/README v10>,<0x10000002195/acpi v78>,<0x10000001eda/device-drivers v200>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002115:[<0x100000022b5/README v20>,<0x10000002195/acpi v78>,<0x10000001eda/device-drivers v1162>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.762 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:08.462+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002114 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/acpi/LtpAcpiCmds.c auth v18 ap=1 s=18609 n(v0 rc2009-03-04T08:53:40.000000+0000 b18609 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e705700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002114:[<0x100000022b5/LtpAcpiCmds.c v8>,<0x10000002195/acpi v78>,<0x10000001eda/device-drivers v200>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002114:[<0x100000022b5/LtpAcpiCmds.c v18>,<0x10000002195/acpi v78>,<0x10000001eda/device-drivers v1162>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.762 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:08.500+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001dfb [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/quota_remount/Makefile auth v8 ap=1 s=957 n(v0 rc2009-10-09T17:55:48.000000+0000 b957 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e6b5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001dfb:[<0x1000000203e/Makefile v4>,<0x10000001f09/quota_remount v242>,<0x10000001eda/fs v106>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001dfb:[<0x1000000203e/Makefile v8>,<0x10000001f09/quota_remount v242>,<0x10000001eda/fs v1142>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.762 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:08.500+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000203f [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/quota_remount/quota_remount_test01.sh auth v6 ap=1 s=5386 n(v0 rc2024-01-31T05:12:56.425599+0000 b5386 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e6b5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000203f:[<0x1000000203e/quota_remount_test01.sh v2>,<0x10000001f09/quota_remount v242>,<0x10000001eda/fs v106>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000203f:[<0x1000000203e/quota_remount_test01.sh v6>,<0x10000001f09/quota_remount v242>,<0x10000001eda/fs v1142>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.762 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:08.617+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000024eb [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigsuspend/sigsuspend01.c auth v6 ap=1 s=7050 n(v0 rc2009-11-02T13:57:19.000000+0000 b7050 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e6fbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000024eb:[<0x1000000273f/sigsuspend01.c v4>,<0x10000002572/sigsuspend v1660>,<0x10000001eda/syscalls v874>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000024eb:[<0x1000000273f/sigsuspend01.c v6>,<0x10000002572/sigsuspend v1660>,<0x10000001eda/syscalls v1573>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.762 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:08.617+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002740 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigsuspend/Makefile auth v8 ap=1 s=915 n(v0 rc2024-01-31T05:12:58.098561+0000 b915 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e6fb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002740:[<0x1000000273f/Makefile v2>,<0x10000002572/sigsuspend v1660>,<0x10000001eda/syscalls v874>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002740:[<0x1000000273f/Makefile v8>,<0x10000002572/sigsuspend v1660>,<0x10000001eda/syscalls v1573>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.762 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:08.658+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000238f [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/waitid/waitid02.c auth v12 ap=1 s=10002 n(v0 rc2024-01-31T05:12:57.750569+0000 b10002 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e6fa580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000238f:[<0x10000002573/waitid02.c v6>,<0x10000002572/waitid v1452>,<0x10000001eda/syscalls v874>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000238f:[<0x10000002573/waitid02.c v12>,<0x10000002572/waitid v1452>,<0x10000001eda/syscalls v1573>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.762 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:08.658+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000238e [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/waitid/Makefile auth v8 ap=1 s=915 n(v0 rc2009-10-09T17:56:03.000000+0000 b915 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e6fb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000238e:[<0x10000002573/Makefile v4>,<0x10000002572/waitid v1452>,<0x10000001eda/syscalls v874>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000238e:[<0x10000002573/Makefile v8>,<0x10000002572/waitid v1452>,<0x10000001eda/syscalls v1573>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.763 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:08.658+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002574 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/waitid/waitid01.c auth v10 ap=1 s=9176 n(v0 rc2024-01-31T05:12:57.749569+0000 b9176 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e6fab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002574:[<0x10000002573/waitid01.c v2>,<0x10000002572/waitid v1452>,<0x10000001eda/syscalls v874>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002574:[<0x10000002573/waitid01.c v10>,<0x10000002572/waitid v1452>,<0x10000001eda/syscalls v1573>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.763 INFO:tasks.workunit.client.0.smithi099.stdout:5/139: rmdir d6/da 39 2024-01-31T05:13:08.763 INFO:tasks.workunit.client.0.smithi099.stdout:5/140: stat d6/da/f19 0 2024-01-31T05:13:08.767 INFO:tasks.workunit.client.0.smithi099.stdout:2/109: getdents d10/d1c 0 2024-01-31T05:13:08.769 INFO:tasks.workunit.client.0.smithi099.stdout:8/186: dwrite d1/dd/d11/f32 [0,4194304] 0 2024-01-31T05:13:08.770 INFO:tasks.workunit.client.0.smithi099.stdout:1/74: unlink f3 0 2024-01-31T05:13:08.770 INFO:tasks.workunit.client.0.smithi099.stdout:7/91: write f2 [609810,14110] 0 2024-01-31T05:13:08.770 INFO:tasks.workunit.client.0.smithi099.stdout:7/92: readlink d6/lb 0 2024-01-31T05:13:08.770 INFO:tasks.workunit.client.0.smithi099.stdout:7/93: creat d6/d12/f1a x:0 0 0 2024-01-31T05:13:08.770 INFO:tasks.workunit.client.0.smithi099.stdout:7/94: write d6/f11 [57751,34185] 0 2024-01-31T05:13:08.771 INFO:tasks.workunit.client.0.smithi099.stdout:9/98: mknod d0/d1/d15/c20 0 2024-01-31T05:13:08.771 INFO:tasks.workunit.client.0.smithi099.stdout:9/99: fdatasync d0/d1/d15/f17 0 2024-01-31T05:13:08.771 INFO:tasks.workunit.client.0.smithi099.stdout:9/100: fdatasync d0/d7/f13 0 2024-01-31T05:13:08.771 INFO:tasks.workunit.client.0.smithi099.stdout:9/101: write d0/d1/d15/f1b [340868,39619] 0 2024-01-31T05:13:08.772 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:08.521+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022c4 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/connectors/pec/event_generator.c auth v12 ap=1 s=5538 n(v0 rc2009-09-09T06:28:39.000000+0000 b5538 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d412c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022c4:[<0x100000022c3/event_generator.c v2>,<0x100000022c1/pec v14>,<0x10000001eda/connectors v208>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000022c4:[<0x100000022c3/event_generator.c v12>,<0x100000022c1/pec v14>,<0x10000001eda/connectors v1146>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.772 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:08.521+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002122 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/connectors/pec/run_pec_test auth v14 ap=1 s=3319 n(v0 rc2008-10-23T07:02:59.000000+0000 b3319 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d412680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002122:[<0x100000022c3/run_pec_test v8>,<0x100000022c1/pec v14>,<0x10000001eda/connectors v208>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002122:[<0x100000022c3/run_pec_test v14>,<0x100000022c1/pec v14>,<0x10000001eda/connectors v1146>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.772 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:08.521+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002123 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/connectors/pec/pec_listener.c auth v20 ap=1 s=8232 n(v0 rc2024-01-31T05:12:57.151582+0000 b8232 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d413180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002123:[<0x100000022c3/pec_listener.c v10>,<0x100000022c1/pec v14>,<0x10000001eda/connectors v208>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002123:[<0x100000022c3/pec_listener.c v20>,<0x100000022c1/pec v14>,<0x10000001eda/connectors v1146>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.772 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:08.521+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002120 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/connectors/pec/Makefile auth v18 ap=1 s=1033 n(v0 rc2009-10-09T17:55:46.000000+0000 b1033 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d413700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002120:[<0x100000022c3/Makefile v4>,<0x100000022c1/pec v14>,<0x10000001eda/connectors v208>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002120:[<0x100000022c3/Makefile v18>,<0x100000022c1/pec v14>,<0x10000001eda/connectors v1146>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.772 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:08.521+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002121 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/connectors/pec/README auth v16 ap=1 s=1098 n(v0 rc2008-06-26T09:35:45.000000+0000 b1098 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d420000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002121:[<0x100000022c3/README v6>,<0x100000022c1/pec v14>,<0x10000001eda/connectors v208>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002121:[<0x100000022c3/README v16>,<0x100000022c1/pec v14>,<0x10000001eda/connectors v1146>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.772 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:08.553+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000024ba [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/personality/Makefile auth v10 ap=1 s=915 n(v0 rc2009-10-09T17:55:58.000000+0000 b915 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d44f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000024ba:[<0x10000002720/Makefile v4>,<0x10000002572/personality v1630>,<0x10000001eda/syscalls v874>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000024ba:[<0x10000002720/Makefile v10>,<0x10000002572/personality v1630>,<0x10000001eda/syscalls v1573>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.772 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:08.553+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000024bb [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/personality/personality01.c auth v8 ap=1 s=4535 n(v0 rc2009-06-30T06:48:23.000000+0000 b4535 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d450100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000024bb:[<0x10000002720/personality01.c v6>,<0x10000002572/personality v1630>,<0x10000001eda/syscalls v874>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000024bb:[<0x10000002720/personality01.c v8>,<0x10000002572/personality v1630>,<0x10000001eda/syscalls v1573>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.772 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:08.553+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002721 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/personality/personality02.c auth v12 ap=1 s=4143 n(v0 rc2024-01-31T05:12:58.045562+0000 b4143 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d44fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002721:[<0x10000002720/personality02.c v2>,<0x10000002572/personality v1630>,<0x10000001eda/syscalls v874>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002721:[<0x10000002720/personality02.c v12>,<0x10000002572/personality v1630>,<0x10000001eda/syscalls v1573>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.772 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:08.625+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000272f [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/recvmsg/Makefile auth v6 ap=1 s=915 n(v0 rc2024-01-31T05:12:58.068561+0000 b915 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d421080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000272f:[<0x1000000272e/Makefile v2>,<0x10000002572/recvmsg v1644>,<0x10000001eda/syscalls v874>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000272f:[<0x1000000272e/Makefile v6>,<0x10000002572/recvmsg v1644>,<0x10000001eda/syscalls v1573>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.773 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:08.626+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000024cf [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/recvmsg/recvmsg01.c auth v8 ap=1 s=13309 n(v0 rc2009-08-28T14:31:03.000000+0000 b13309 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d421600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000024cf:[<0x1000000272e/recvmsg01.c v4>,<0x10000002572/recvmsg v1644>,<0x10000001eda/syscalls v874>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000024cf:[<0x1000000272e/recvmsg01.c v8>,<0x10000002572/recvmsg v1644>,<0x10000001eda/syscalls v1573>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.773 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:08.657+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000027f0 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/renameat/Makefile auth v6 ap=1 s=915 n(v0 rc2024-01-31T05:12:58.440553+0000 b915 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={15315=0-4194304@1} caps={15315=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15315 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d420b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000027f0:[<0x100000027ef/Makefile v2>,<0x10000002572/renameat v1738>,<0x10000001eda/syscalls v874>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000027f0:[<0x100000027ef/Makefile v6>,<0x10000002572/renameat v1738>,<0x10000001eda/syscalls v1573>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.773 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:08.657+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000025e3 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/renameat/renameat01.c auth v8 ap=1 s=7692 n(v0 rc2009-03-23T13:36:01.000000+0000 b7692 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d420580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000025e3:[<0x100000027ef/renameat01.c v4>,<0x10000002572/renameat v1738>,<0x10000001eda/syscalls v874>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000025e3:[<0x100000027ef/renameat01.c v8>,<0x10000002572/renameat v1738>,<0x10000001eda/syscalls v1573>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:08.773 INFO:tasks.workunit.client.0.smithi099.stdout:6/86: dwrite fc [0,4194304] 0 2024-01-31T05:13:08.774 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:08.774 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:08.774 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:08.774 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:08.774 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:08.774 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:08.775 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:08.775 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:08.775 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:08.775 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:08.775 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:08.775 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:08.775 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:08.775 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:08.775 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:08.775 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:08.775 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:08.775 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:08.775 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:08.775 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:08.776 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:08.776 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:08.776 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:08.776 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:08.776 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:08.776 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:08.776 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:08.776 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:08.776 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:08.776 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:08.776 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:08.776 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000217a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.776 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f8d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/Makefile.inc) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.776 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002172 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.776 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002178 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/libclone) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.777 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002174 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.777 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f4a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/container_test.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.777 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f49 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.777 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f53 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/README) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.777 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f7e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/crtchild_delchild.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.777 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:08.777 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002171 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/TEST_PLAN.txt) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.777 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f7f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/runallnetworktests_parent.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.777 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f7b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/child_1.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.777 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f83 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/sysfsview.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.777 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f5d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns01.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.777 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f66 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns20.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.777 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f86 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/rename_net.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.777 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f6c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/parent_view.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.778 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f64 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns03.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.778 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f68 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns05.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.778 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f8a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/ch_ftp.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.778 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f7d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/childns.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.778 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f60 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns17.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.778 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f76 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/parent_share.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.778 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f67 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns16.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.778 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f6d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/parentns.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.778 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f78 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.778 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f65 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns04.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.778 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f5a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns06.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.778 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f75 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/parent.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.778 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f62 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns31.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.778 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f74 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/parent_2.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.778 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f5e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/Makefile) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.779 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f6f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/paripv6.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.779 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f5c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns10.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.779 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f69 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns30.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.779 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f87 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/create_container.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.779 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f5f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/runpidnstest.sh) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.779 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f72 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/readme) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.779 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002177 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns02.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.779 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f63 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/README) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.779 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f71 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/par_chld_ipv6.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.779 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f61 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns13.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.779 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f7a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/child_2.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.779 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f5b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns12.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.779 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:08.779 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f70 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/common.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.779 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f6e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/two_children_ns.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.780 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f84 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/par_chld_ftp.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.780 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f82 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/par_ftp.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.780 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f81 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/nw_under_ns.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.780 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000217b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/delchild.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.780 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:08.780 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f8b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/container_ftp.pl) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.780 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f80 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/initialize.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.780 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f79 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/runnetnstest.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.780 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f77 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/parent_1.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.780 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f88 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/childipv6.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.780 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021cb (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/test_controllers.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.780 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f7c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/child.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.781 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f73 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/check_netns_enabled.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.781 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f85 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/runallnetworktests_child.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.781 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021fa (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/Makefile.inc) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.781 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f89 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/crtchild.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.781 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000023e2 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.781 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f52 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/semtest_2ns.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.781 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022c7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memctl) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.781 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f8c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/child_propagate.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.781 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022c9 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.781 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f51 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/runipcnstest.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.781 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f4d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/shmnstest.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.781 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002173 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/mesgq_nstest.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.781 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022e1 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl_fj) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.781 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f4c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/runtests_noltp.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.781 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f4e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.782 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000214a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.782 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f50 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/sem_nstest.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.782 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f4f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/check_ipcns_enabled.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.782 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022c6 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/testplan.txt) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.782 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002179 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/libclone/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.782 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f4b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/shmem_2nstest.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.782 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000023e6 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.782 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f6a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/libclone/libclone.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.782 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f6b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/libclone/libclone.h) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.787 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022e3 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.787 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f59 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns/mqns_01.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.787 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002175 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns/runmqnstest.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.787 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f58 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns/mqns_04.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.787 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000023e0 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.787 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f56 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns/mqns_02.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.787 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f57 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns/mqns.h) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.787 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021c1 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/README) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.787 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f55 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.787 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f54 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns/mqns_03.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.787 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000023e4 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuacct) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.788 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002416 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.788 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000023f2 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.788 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000023f0 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/libcontrollers) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.788 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002415 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.788 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000023ee (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.788 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021c9 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/cgroup_fj_proc.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.788 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002407 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.788 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021c4 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/cgroup_fj_utility.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.788 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021c6 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/cgroup_fj_release_agent) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.788 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021c5 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.788 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021c7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/cgroup_fj_testcases) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.788 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000240b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.788 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021c8 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/README) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.788 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021ca (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/cgroup_fj_function2.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.789 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021c3 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/cgroup_fj_function.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.789 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000256c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/tomoyo) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.789 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000023e3 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/run_cgroup_test_fj.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.789 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021c2 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/cgroup_fj_stress.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.789 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002127 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memctl/memctl_testplan.txt) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.789 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022c8 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memctl/memctl_test01.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.789 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002129 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memctl/myfunctions.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.789 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002125 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memctl/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.789 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002126 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memctl/README) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.789 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002418 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.789 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002128 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memctl/run_memctl_test.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.789 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022ce (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_hotplug_test) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.789 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002570 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.789 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022d5 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_spread_test) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.790 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022db (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_inherit_test) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.790 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002409 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/p9auth) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.790 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002147 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/Makefile.inc) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.790 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000256e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.790 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022d7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_hierarchy_test) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.790 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022cc (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_syscall_test) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.790 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000216f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/utsname) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.790 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022d0 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.790 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002143 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_funcs.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.790 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002176 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.790 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022d1 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_load_balance_test) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.790 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022ca (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.790 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002258 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/exec_with_inh.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.790 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002142 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/run_cpuset_test.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.790 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000225b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/cap_bset_inh_bounds.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.791 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022d9 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_base_ops_test) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.791 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002257 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.791 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000213c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/README) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.791 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002417 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/exec_without_inh.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.791 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022df (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_test) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.791 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000225d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/cap_bounds_r.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.791 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022d3 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_exclusive_test) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.791 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000225c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/check_pe.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.791 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022dd (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_pressure_test) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.791 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002256 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/cap_bounds_rw.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.791 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000214d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl_fj/run_cpuctl_test_fj.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.791 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000225a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/check_for_libcap.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.791 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000214b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl_fj/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.791 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000214c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl_fj/README) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.791 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000214e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl_fj/cpuctl_fj_cpu-hog.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.792 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002259 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/run_capbounds.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.792 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000225e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/dummy.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.792 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022e2 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl_fj/cpuctl_fj_simple_echo.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.792 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000223b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_onlycap.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.792 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002241 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/notroot.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.792 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000023e9 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.792 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002243 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_load.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.792 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000223e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_doi.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.792 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002246 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_cipso.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.792 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000023e7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/regression) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.792 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000223d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_file_access.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.792 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021d9 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/README) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.792 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002245 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_netlabel.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.792 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000223a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_ambient.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.792 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000223c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_direct.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.793 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000223f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.793 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000023ea (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/functional) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.793 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002244 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_socket_labels.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.793 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002159 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/getdelays.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.793 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002157 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_10_2.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.793 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002240 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_common.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.793 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002242 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/README) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.793 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002153 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_10_1.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.793 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002408 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_current.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.793 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002154 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_6_2.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.793 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000240c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.793 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002414 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.793 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000237c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/tomoyo/newns.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.793 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000237b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/tomoyo/tomoyo_file_test.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.794 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000237a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/tomoyo/testall.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.794 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002152 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.794 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022e4 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_9_2.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.794 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002156 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_6_1.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.794 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000214f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/fork_processes.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.794 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002151 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_3_1.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.794 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000256d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/tomoyo/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.794 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000237d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/tomoyo/include.h) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.794 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000215a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/cgroup_regression_test.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.794 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002150 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_3_2.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.794 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002155 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/README) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.794 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021c0 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_def_task01.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.794 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000215c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/parameters.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.794 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002158 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_9_1.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.794 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021be (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_latency_check_task.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.795 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002419 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.795 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002379 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/tomoyo/README) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.795 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002378 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/ChangeLog) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.795 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000023ec (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/stress) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.795 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000215d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_def_task04.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.795 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021ba (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/run_cpuctl_test.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.795 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021bd (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/run_cpuctl_stress_test.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.795 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000251c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.795 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021b5 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_test02.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.795 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021bb (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_test04.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.795 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021b7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_testplan.txt) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.795 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000241b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.795 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021b8 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_def_task03.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.795 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021b6 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.795 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002312 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/README) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000023e1 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_test03.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000241c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000215b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_latency_test.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002386 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/ask_password.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000238c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/remove_password.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021bf (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_def_task02.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002571 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/change_password.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002387 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/LICENSE) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021bc (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/README) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002388 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000215e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/run_cpuctl_latency_test.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021b9 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_test01.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000238b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/force_erase.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.796 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021cc (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuacct/run_cpuacct_test.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021ce (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuacct/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000238a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/AUTHORS) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002248 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/p9auth/p9unpriv.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021cd (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuacct/cpuacct_task01.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000224a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/p9auth/unhex.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000023e5 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuacct/cpuacct_setup.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021cf (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuacct/README) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002249 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/p9auth/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021d0 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuacct/cpuacct_testplan.txt) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000240a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/p9auth/p9priv.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021f5 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002247 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/p9auth/runp9auth.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000023f3 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/io_throttle_testplan.txt) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000237e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/verify_caps_exec.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.797 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021f7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/README) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021f9 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/iobw.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002382 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/check_simple_capset.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002385 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/inh_capped.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021f4 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/libcontrollers/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000023f1 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/libcontrollers/libcontrollers.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002384 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/checkforfilecaps.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021f3 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/libcontrollers/libcontrollers.h) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002380 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021e0 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/freeze_move_thaw.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021e9 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/TODO) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002383 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/README) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021e1 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/write_freezing.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000256f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/print_caps.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021dc (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/run_freezer.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.798 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021df (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/CHANGELOG) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002381 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/filecapstest.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021ee (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/libcgroup_freezer) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021da (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/stress/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021e7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/timed_forkbomb.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000023ed (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/stress/memcg_stress_test.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021eb (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/freeze_self_thaw.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021e3 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/stop_freeze_thaw_cont.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021db (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/stress/memcg_process_stress.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021ec (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/fork_exec_loop.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021dd (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/vfork.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021e5 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000240d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/policy) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021ed (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/freeze_thaw.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.799 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021f6 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/run_io_throttle_test.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.800 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002389 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/README) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.800 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021f8 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/myfunctions-io.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.800 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021e6 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/freeze_sleep_thaw.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.800 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000238d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/assign_password.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.800 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000237f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/checkforlibcap.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.800 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021de (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/00_description.txt) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.800 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002410 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.800 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021f1 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/freeze_kill_thaw.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.800 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002412 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/tests) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.800 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021ef (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/vfork_freeze.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.800 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000224d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/README) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.800 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021e4 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/libltp) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.800 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000227f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_task_getsched.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.800 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021f0 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/freeze_cancel.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.800 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002267 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_mkdir.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.801 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002280 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_capable_net.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.801 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021e8 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/README) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.801 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002274 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_fdreceive.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.801 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021e2 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/fork_freeze.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.801 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000227e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_dyntrace.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.801 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021ea (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/stop_freeze_sleep_thaw_cont.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.801 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002278 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_sysctl.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.801 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000023ef (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/COPYING) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.801 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002263 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_ioctl.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.801 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021f2 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/freeze_write_freezing.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.801 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022cf (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_hotplug_test/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.801 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002136 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_hotplug_test/cpuset_hotplug_test.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.801 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002279 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_dyntrans.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.801 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002137 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_hotplug_test/cpuset_list_compute.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.801 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000226b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_task_getpgid.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.802 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000213f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_spread_test/cpuset_memory_spread_testset.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.802 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002264 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_task_setsched.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.802 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022d6 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_spread_test/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.802 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000226f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_file.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.802 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002144 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_inherit_test/cpuset_inherit_testset.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.802 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000240f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.802 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002266 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_readlink.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.802 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022d8 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_hierarchy_test/cpuset_hierarchy_test.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.802 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022dc (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_inherit_test/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.802 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000226a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_execute_no_trans.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.802 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002140 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_hierarchy_test/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.802 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002269 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_stat.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.802 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002134 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_syscall_test/cpuset_syscall_test.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.802 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002276 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_open.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.803 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022cd (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_syscall_test/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.803 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000226c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_attrib.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.803 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002262 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_ipc.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.803 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000225f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_task_setpgid.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.803 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000213b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_load_balance_test/cpuset_cpu_hog.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.803 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000226d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_capable_sys.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.803 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022d2 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_load_balance_test/cpuset_sched_domains_check.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.803 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002270 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.803 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000213a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_load_balance_test/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.803 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002139 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_load_balance_test/cpuset_load_balance_test.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.803 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002283 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_rxdir.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.803 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000227d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_global.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.803 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002261 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_link.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.803 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000212f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/meminfo.h) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.803 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002130 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/libbitmask.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.804 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002268 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_ptrace.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.804 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000213e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_spread_test/cpuset_mem_hog.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.804 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002265 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_capable_file.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.804 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000227c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_exectrace.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.804 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000212a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.804 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000226e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_execshare.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.804 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000212c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/libcpuset.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.804 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002260 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_setnice.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.804 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000227b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_setattr.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.804 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002275 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_sigkill.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.804 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002271 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_wait.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.804 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000227a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_transition.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.804 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002138 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_load_balance_test/cpuset_sched_domains_test.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.804 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002281 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_task_getsid.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.805 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000212d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/cpuinfo.h) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.805 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002273 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_socket.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.805 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000212e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/cpuset_funcs.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.805 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002277 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_relabel.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.805 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000241a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_rename.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.805 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002135 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_syscall_test/cpuset_syscall_testset.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.805 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000212b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/bitmask.h) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.805 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002133 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/cpuset.h) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.805 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022da (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_base_ops_test/cpuset_base_ops_testset.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.805 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002284 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_inherit.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.805 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002131 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/common.h) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.805 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002566 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/bounds) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.805 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002272 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_entrypoint.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.805 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002141 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_base_ops_test/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.806 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002531 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/inherit) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.806 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002149 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_test/cpuset_memory_test.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.806 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000254a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/open) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.806 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002148 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_test/cpuset_memory_testset.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.806 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002346 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/runtest.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.806 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000254e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sysctl) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.806 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000213d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_exclusive_test/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.806 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002132 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/meminfo.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.806 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002145 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_pressure_test/cpuset_memory_pressure_testset.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.806 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000255e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execshare) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.806 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022cb (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/cpuinfo.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.806 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022e0 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_test/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.806 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002282 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_task_create.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.806 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022de (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_pressure_test/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.807 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002521 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sem) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.807 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002146 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_pressure_test/cpuset_memory_pressure.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.807 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022d4 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_exclusive_test/cpuset_exclusive_test.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.807 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002527 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/exectrace) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.807 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021d3 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/regression/memcg_regression_test.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.807 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021d4 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/regression/memcg_test_2.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.807 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000023e8 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/regression/memcg_test_4.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.807 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021d5 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/regression/memcg_test_1.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.807 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002529 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setattr) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.807 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002536 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setscheduler) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.807 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021d8 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/functional/memcg_function_test.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.807 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021d6 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/functional/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.807 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021d2 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/regression/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.807 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021d1 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/regression/memcg_test_4.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.807 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021d7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/functional/memcg_getpagesize.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.808 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002540 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setpgid) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.808 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000255c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/link) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.808 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002377 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/Makefile.inc) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.808 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002538 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/mkdir) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.808 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002558 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sigkill) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.808 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000023eb (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/functional/memcg_process.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.808 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:08.808 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002562 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/fdreceive) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.808 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002554 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/readlink) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.808 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000253e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrace) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.808 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000251f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_file) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.808 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000252f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execute_no_trans) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.808 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002523 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/shm) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.808 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002544 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.809 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002533 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.809 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002546 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getpgid) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.809 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002568 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/rxdir) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.809 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002550 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/domain_trans) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.809 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002564 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setnice) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.809 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002535 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.809 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002552 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/wait) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.809 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002548 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/entrypoint) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.809 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002525 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/rename) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.809 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002560 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getscheduler) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.809 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000256a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getsid) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.809 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002556 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/msg) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.809 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000255a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ioctl) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.809 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000251d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/relabel) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.810 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000254c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrans) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.810 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000252d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_create) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.810 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000252b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ptrace) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.810 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000253a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setnice) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.810 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000230c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_task_getsched.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.810 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000228e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_mkdir.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.810 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000230d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_capable_net.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.810 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002305 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_sysctl.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.810 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002300 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_fdreceive.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.810 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002303 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/TODO) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.810 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002542 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.810 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000230b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_dyntrace.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.810 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002289 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_ioctl.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.810 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000228a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_task_setsched.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.810 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002306 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_dyntrans.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.811 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002292 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_task_getpgid.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.811 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002291 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_execute_no_trans.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.811 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002295 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_file.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.811 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002290 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_stat.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.811 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000228c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_readlink.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.811 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002288 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_ipc.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.811 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002302 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_open.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.811 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002285 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_task_setpgid.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.811 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002293 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_capable_sys.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.811 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000230a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_global.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.811 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000241e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.811 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002296 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.811 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002287 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_link.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.811 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000228b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_capable_file.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.812 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002310 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_rxdir.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.812 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000228f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_ptrace.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.812 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002299 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_bounds.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.812 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002309 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_exectrace.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.812 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002301 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_sigkill.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.812 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002294 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_execshare.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.812 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002297 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_wait.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.812 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022ff (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_policy.fc) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.812 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000230f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_task_create.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.812 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002286 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_setnice.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.812 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002308 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_setattr.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.812 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002307 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_transition.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.812 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002304 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_relabel.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.812 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000230e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_task_getsid.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.812 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002298 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_entrypoint.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.813 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000241d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_rename.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.813 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002311 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_inherit.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.813 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000224c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/policy/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.813 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000224b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/policy/measure.policy) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.813 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000224e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/ima_boot_aggregate.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.813 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002411 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/ima_measure.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.813 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000228d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_policy.if) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.813 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000240e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/policy/measure.policy-invalid) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.813 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000224f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.813 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002250 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/ima_mmap.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.813 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002413 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/tests/ima_policy.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.813 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000253c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/stat) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.813 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002254 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/tests/ima_violations.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.813 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002252 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/tests/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.814 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002251 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/tests/ima_measurements.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.814 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002253 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/tests/ima_tpm.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.814 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002255 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/tests/ima_setup.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.814 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002371 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/bounds/selinux_bounds.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.814 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002567 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/bounds/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.814 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002372 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/bounds/selinux_bounds_thread.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.814 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002532 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/inherit/selinux_inherit_parent.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.814 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000232c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/inherit/selinux_inherit_child.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.814 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000232b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/inherit/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.814 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000232a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/inherit/selinux_inherit.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.814 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002352 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/open/selinux_append2write.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.814 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000254b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/open/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.814 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002350 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/open/selinux_fopen.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.814 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002351 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/open/selinux_open.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.814 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000254f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sysctl/selinux_sysctl.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.815 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002355 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sysctl/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.815 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002367 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execshare/selinux_execshare_parent.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.815 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002366 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execshare/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.815 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000255f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execshare/selinux_execshare_child.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.815 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002368 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execshare/selinux_execshare.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.815 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002320 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/exectrace/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.815 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002322 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/exectrace/selinux_exectrace_parent.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.815 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002528 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/exectrace/selinux_exectrace.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.815 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002321 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/exectrace/selinux_exectrace_child.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.815 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002522 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sem/selinux_semget.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.815 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002317 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sem/selinux_getinfo.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.815 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002318 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sem/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.815 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002316 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sem/selinux_sem.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.815 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000231a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sem/selinux_semctl.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.815 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002319 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sem/selinux_semop.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.816 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000255d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/link/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.816 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002365 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/link/selinux_link.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.816 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002323 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setattr/selinux_setattr.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.816 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000252a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setattr/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.816 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002337 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setscheduler/selinux_task_setscheduler.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.816 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002537 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setscheduler/selinux_task_setscheduler_source.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.816 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002336 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setscheduler/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.816 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002338 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setscheduler/selinux_task_setscheduler_target.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.816 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002541 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setpgid/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.816 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002342 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setpgid/selinux_task_setpgid_source.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.816 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002341 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setpgid/selinux_task_setpgid.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.816 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002539 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/mkdir/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.816 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002339 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/mkdir/selinux_mkdir.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.816 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002559 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sigkill/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.817 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002361 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sigkill/selinux_sigkill_server.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.817 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002360 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sigkill/selinux_sigkill.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.817 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000236e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/fdreceive/selinux_fdreceive_client.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.817 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002563 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/fdreceive/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.817 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000236d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/fdreceive/selinux_fdreceive.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.817 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000236c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/fdreceive/selinux_fdreceive_server.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.817 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000233e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrace/selinux_dyntrace_parent.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.817 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000235a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/readlink/selinux_readlink.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.817 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002555 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/readlink/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.817 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002314 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_file/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.817 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002520 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_file/selinux_lease.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.817 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002530 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execute_no_trans/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.817 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002329 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execute_no_trans/selinux_execute_no_trans.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.817 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000233f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrace/selinux_dyntrace.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.818 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002340 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrace/selinux_dyntrace_child.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.818 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000253f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrace/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.818 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002315 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_file/selinux_capable_file.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.818 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000231c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/shm/selinux_shmget.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.818 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000231b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/shm/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.818 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002524 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/shm/selinux_shmctl.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.818 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002545 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_chroot.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.818 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002348 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.818 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002349 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_rawio.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.818 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000234a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_nice.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.818 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000234b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_hostname.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.818 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000231d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/shm/selinux_shm.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.818 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002347 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_capable_sys.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.818 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000232e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_mmap.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.818 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002334 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_file.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.818 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002534 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_fcntl.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.819 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002333 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_mprotect.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.819 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000232d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_wait_io.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.819 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000232f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.819 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002332 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_sigiotask.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.819 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002330 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_seek.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.819 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002331 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_lock.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.819 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002335 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_nofcntl.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.819 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000234d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getpgid/selinux_task_getpgid_target.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.819 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000234c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getpgid/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.819 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000231e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/shm/selinux_shmat.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.819 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000234e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getpgid/selinux_task_getpgid_source.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.819 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000027c9 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getpgid/selinux_task_getpgid.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.819 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002551 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/domain_trans/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.819 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002569 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/rxdir/selinux_rxdir.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.820 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002373 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/rxdir/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.820 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002356 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/domain_trans/selinux_domain_trans.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.820 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002370 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setnice/selinux_task_setnice.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.820 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002565 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setnice/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.820 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000236f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setnice/selinux_task_setnice_target.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.820 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002358 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/wait/selinux_wait_child.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.820 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002553 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/wait/selinux_wait_parent.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.820 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002357 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/wait/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.820 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002359 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/wait/selinux_wait.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.820 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000234f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/entrypoint/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.820 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002549 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/entrypoint/selinux_entrypoint.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.820 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002375 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getsid/selinux_task_getsid.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.820 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002374 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getsid/selinux_task_getsid_source.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.820 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000231f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/rename/selinux_rename.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.823 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002376 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getsid/selinux_task_getsid_target.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.823 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000236a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getscheduler/selinux_task_getscheduler.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.823 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002561 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getscheduler/selinux_task_getscheduler_target.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.823 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000256b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getsid/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.823 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002369 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getscheduler/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.823 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000236b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getscheduler/selinux_task_getscheduler_source.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.823 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002363 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ioctl/selinux_noioctl.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.823 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002557 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/msg/selinux_msg.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.823 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002526 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/rename/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.824 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000235e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/msg/selinux_msgsnd.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.824 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000235c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/msg/selinux_msgctl.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.824 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002362 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ioctl/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.824 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000255b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ioctl/selinux_ioctl.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.824 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000235f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/msg/selinux_msgget.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.824 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000235d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/msg/selinux_msgrcv.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.824 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000235b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/msg/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.824 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002543 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/selinux_capable_net.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.824 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002343 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.824 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000251e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/relabel/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.824 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002344 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/selinux_bind.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.824 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002364 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ioctl/selinux_ioctl.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.824 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002354 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrans/selinux_dyntrans.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.824 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002345 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/selinux_raw.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.825 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002353 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrans/selinux_dyntrans_parent.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.825 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002313 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/relabel/selinux_relabel.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.825 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000254d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrans/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.825 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002327 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_create/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.825 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002328 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_create/selinux_task_create_parent.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.825 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000252e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_create/selinux_task_create.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.825 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000252c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ptrace/selinux_ptrace.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.825 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002325 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ptrace/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.825 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002324 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ptrace/selinux_ptrace.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.825 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002326 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ptrace/selinux_ptrace_wait.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.825 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000233c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setnice/selinux_setnice.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.825 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000233a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setnice/selinux_setnice_parent.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.825 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000233b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setnice/selinux_setnice_child.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.825 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000253b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setnice/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.826 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:08.826 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022ee (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_fdreceive.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.826 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022a3 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_mkdir.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.826 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022fa (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_capable_net.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.826 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022f9 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_task_getsched.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.826 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022f2 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_sysctl.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.826 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022f8 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_dyntrace.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.826 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000229e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_ioctl.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.826 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000229f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_task_setsched.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.826 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022f3 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_dyntrans.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.826 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022ea (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_file.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.826 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022a1 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_readlink.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.826 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022e6 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_execute_no_trans.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.826 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022e7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_task_getpgid.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.826 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022f0 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_open.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.827 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022e5 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_stat.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.827 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000229d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_ipc.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.827 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022e8 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_capable_sys.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.827 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000229a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_task_setpgid.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.827 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022f7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_global.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.827 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022fd (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_rxdir.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.827 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022eb (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/Makefile) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.827 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000229c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_link.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.827 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022a0 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_capable_file.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.827 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022ef (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_sigkill.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.827 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022e9 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_execshare.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.827 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022a4 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_ptrace.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.827 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022ec (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_wait.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.827 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022fc (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_task_create.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.828 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000229b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_setnice.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.828 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022f5 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_setattr.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.828 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022f1 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_relabel.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.828 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022f4 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_transition.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.828 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022fb (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_task_getsid.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.828 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002420 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_rename.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.828 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022a2 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_policy.if) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.828 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022fe (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_inherit.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.828 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022ed (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_entrypoint.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.828 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000241f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5) see mds.c log and `damage ls` output for details 2024-01-31T05:13:08.828 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:08.828 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022f6 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_exectrace.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.828 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:08.828 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:08.828 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:08.829 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:08.829 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:08.829 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:08.829 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001bd9 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/plan.txt) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.829 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001d9e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.829 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001bd8 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/run.sh) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.829 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001d9b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/coverage.txt) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.829 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001bd2 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/Makefile) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.829 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001bd3 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/assertions.xml) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.829 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001d9c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.829 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001bd7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers/twoptimers.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.829 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001bd6 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers/twoevtimers.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.829 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001bd5 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks/invaliddates.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.829 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001d9d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks/Makefile) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.830 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001d9f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers/Makefile) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.830 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001bd4 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks/twopsetclock.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:08.830 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:08.830 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:08.830 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002112 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/acpi/LtpAcpiMain.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.830 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002116 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/acpi/ltpacpi.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.830 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022b6 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/acpi/LtpAcpi.h) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.830 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002113 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/acpi/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.830 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002115 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/acpi/README) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.830 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002114 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/acpi/LtpAcpiCmds.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.830 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:08.830 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:08.830 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001dfb (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/quota_remount/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.830 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000203f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/quota_remount/quota_remount_test01.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:08.830 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:08.833 INFO:tasks.workunit.client.0.smithi099.stdout:8/187: getdents d1/dd/d11/d19/d21 0 2024-01-31T05:13:08.833 INFO:tasks.workunit.client.0.smithi099.stdout:1/75: mknod d4/dc/c16 0 2024-01-31T05:13:08.833 INFO:tasks.workunit.client.0.smithi099.stdout:1/76: chown d4/db/l13 1336 1 2024-01-31T05:13:08.834 INFO:tasks.workunit.client.0.smithi099.stdout:2/110: write f4 [3201392,76229] 0 2024-01-31T05:13:08.834 INFO:tasks.workunit.client.0.smithi099.stdout:7/95: creat d6/d13/f1b x:0 0 0 2024-01-31T05:13:08.834 INFO:tasks.workunit.client.0.smithi099.stdout:5/141: dwrite d6/da/d14/f1a [0,4194304] 0 2024-01-31T05:13:08.834 INFO:tasks.workunit.client.0.smithi099.stdout:9/102: rename d0/l18 to d0/d1/d15/l21 0 2024-01-31T05:13:08.834 INFO:tasks.workunit.client.0.smithi099.stdout:9/103: write d0/d7/f1f [178487,34788] 0 2024-01-31T05:13:08.834 INFO:tasks.workunit.client.0.smithi099.stdout:6/87: mkdir d14/d18 0 2024-01-31T05:13:08.834 INFO:tasks.workunit.client.0.smithi099.stdout:0/95: dwrite d1/f5 [0,4194304] 0 2024-01-31T05:13:08.834 INFO:tasks.workunit.client.0.smithi099.stdout:0/96: dread - d1/d8/df/f12 zero size 2024-01-31T05:13:08.834 INFO:tasks.workunit.client.0.smithi099.stdout:0/97: fdatasync d1/d16/f1c 0 2024-01-31T05:13:08.834 INFO:tasks.workunit.client.0.smithi099.stdout:1/77: symlink d4/l17 0 2024-01-31T05:13:08.834 INFO:tasks.workunit.client.0.smithi099.stdout:2/111: mkdir d10/d1b/d24 0 2024-01-31T05:13:08.834 INFO:tasks.workunit.client.0.smithi099.stdout:2/112: write d10/d1b/f1f [501838,65653] 0 2024-01-31T05:13:08.834 INFO:tasks.workunit.client.0.smithi099.stdout:7/96: mknod d6/d12/c1c 0 2024-01-31T05:13:08.834 INFO:tasks.workunit.client.0.smithi099.stdout:7/97: creat d6/d12/f1d x:0 0 0 2024-01-31T05:13:08.835 INFO:tasks.workunit.client.0.smithi099.stdout:5/142: creat d6/d1e/f2c x:0 0 0 2024-01-31T05:13:08.835 INFO:tasks.workunit.client.0.smithi099.stdout:5/143: creat d6/d1e/f2d x:0 0 0 2024-01-31T05:13:08.835 INFO:tasks.workunit.client.0.smithi099.stdout:6/88: mknod d14/c19 0 2024-01-31T05:13:08.835 INFO:tasks.workunit.client.0.smithi099.stdout:6/89: write d14/f17 [677458,35779] 0 2024-01-31T05:13:08.835 INFO:tasks.workunit.client.0.smithi099.stdout:6/90: read f10 [1767705,83957] 0 2024-01-31T05:13:08.835 INFO:tasks.workunit.client.0.smithi099.stdout:6/91: chown lb 220218 1 2024-01-31T05:13:08.835 INFO:tasks.workunit.client.0.smithi099.stdout:6/92: read fa [1752974,101780] 0 2024-01-31T05:13:08.835 INFO:tasks.workunit.client.0.smithi099.stdout:6/93: dread fa [0,4194304] 0 2024-01-31T05:13:08.835 INFO:tasks.workunit.client.0.smithi099.stdout:2/113: rmdir d10/d1b/d24 0 2024-01-31T05:13:08.835 INFO:tasks.workunit.client.0.smithi099.stdout:5/144: truncate d6/da/d14/f20 4298792 0 2024-01-31T05:13:08.835 INFO:tasks.workunit.client.0.smithi099.stdout:9/104: dwrite d0/d1/f1d [0,4194304] 0 2024-01-31T05:13:08.835 INFO:tasks.workunit.client.0.smithi099.stdout:0/98: link d1/d8/df/f15 d1/f20 0 2024-01-31T05:13:08.835 INFO:tasks.workunit.client.0.smithi099.stdout:0/99: dread - d1/d8/df/f1b zero size 2024-01-31T05:13:08.835 INFO:tasks.workunit.client.0.smithi099.stdout:0/100: write d1/d8/df/f1d [2179511,55167] 0 2024-01-31T05:13:08.835 INFO:tasks.workunit.client.0.smithi099.stdout:1/78: dwrite d4/db/f10 [0,4194304] 0 2024-01-31T05:13:08.836 INFO:tasks.workunit.client.0.smithi099.stdout:6/94: mkdir d14/d18/d1a 0 2024-01-31T05:13:08.836 INFO:tasks.workunit.client.0.smithi099.stdout:6/95: chown f11 4 1 2024-01-31T05:13:08.836 INFO:tasks.workunit.client.0.smithi099.stdout:2/114: stat d10/l17 0 2024-01-31T05:13:08.836 INFO:tasks.workunit.client.0.smithi099.stdout:2/115: truncate d10/d1b/f23 89163 0 2024-01-31T05:13:08.836 INFO:tasks.workunit.client.0.smithi099.stdout:7/98: mkdir d6/d1e 0 2024-01-31T05:13:08.836 INFO:tasks.workunit.client.0.smithi099.stdout:0/101: write d1/d16/f1c [1183267,44105] 0 2024-01-31T05:13:08.836 INFO:tasks.workunit.client.0.smithi099.stdout:9/105: mknod d0/c22 0 2024-01-31T05:13:08.836 INFO:tasks.workunit.client.0.smithi099.stdout:9/106: write d0/d1/d15/f17 [3292861,59407] 0 2024-01-31T05:13:08.836 INFO:tasks.workunit.client.0.smithi099.stdout:9/107: creat d0/d7/f23 x:0 0 0 2024-01-31T05:13:08.837 INFO:tasks.workunit.client.0.smithi099.stdout:2/116: symlink d10/d1c/l25 0 2024-01-31T05:13:08.837 INFO:tasks.workunit.client.0.smithi099.stdout:1/79: dread d4/db/f10 [0,4194304] 0 2024-01-31T05:13:08.837 INFO:tasks.workunit.client.0.smithi099.stdout:1/80: chown c0 27970464 1 2024-01-31T05:13:08.837 INFO:tasks.workunit.client.0.smithi099.stdout:4/147: sync 2024-01-31T05:13:08.838 INFO:tasks.workunit.client.0.smithi099.stdout:7/99: rename d6/d12/f16 to d6/f1f 0 2024-01-31T05:13:08.838 INFO:tasks.workunit.client.0.smithi099.stdout:7/100: write d6/ff [827205,77152] 0 2024-01-31T05:13:08.846 INFO:tasks.workunit.client.0.smithi099.stdout:7/101: rmdir d6/d13 39 2024-01-31T05:13:08.848 INFO:tasks.workunit.client.0.smithi099.stdout:6/96: getdents d14/d18 0 2024-01-31T05:13:08.850 INFO:tasks.workunit.client.0.smithi099.stdout:6/97: mkdir d14/d18/d1a/d1b 0 2024-01-31T05:13:08.850 INFO:tasks.workunit.client.0.smithi099.stdout:1/81: write d4/db/f10 [1665726,92998] 0 2024-01-31T05:13:08.852 INFO:tasks.workunit.client.0.smithi099.stdout:6/98: mkdir d14/d18/d1a/d1c 0 2024-01-31T05:13:08.854 INFO:tasks.workunit.client.0.smithi099.stdout:1/82: mknod d4/c18 0 2024-01-31T05:13:08.854 INFO:tasks.workunit.client.0.smithi099.stdout:1/83: read d4/f6 [24416,97593] 0 2024-01-31T05:13:08.855 INFO:tasks.workunit.client.0.smithi099.stdout:6/99: symlink d14/d18/d1a/d1b/l1d 0 2024-01-31T05:13:08.855 INFO:tasks.workunit.client.0.smithi099.stdout:6/100: fdatasync f11 0 2024-01-31T05:13:08.855 INFO:tasks.workunit.client.0.smithi099.stdout:6/101: fdatasync d14/f17 0 2024-01-31T05:13:08.863 INFO:tasks.workunit.client.0.smithi099.stdout:5/145: dread d6/da/d14/f20 [0,4194304] 0 2024-01-31T05:13:08.863 INFO:tasks.workunit.client.0.smithi099.stdout:5/146: dread - d6/d1e/d1f/d21/f27 zero size 2024-01-31T05:13:08.865 INFO:tasks.workunit.client.0.smithi099.stdout:0/102: dread d1/f20 [0,4194304] 0 2024-01-31T05:13:08.865 INFO:tasks.workunit.client.0.smithi099.stdout:0/103: dread - d1/f1e zero size 2024-01-31T05:13:08.866 INFO:tasks.workunit.client.0.smithi099.stdout:6/102: dread fc [0,4194304] 0 2024-01-31T05:13:08.866 INFO:tasks.workunit.client.0.smithi099.stdout:5/147: getdents d6/da/d14 0 2024-01-31T05:13:08.868 INFO:tasks.workunit.client.0.smithi099.stdout:6/103: rename l8 to d14/d18/d1a/d1b/l1e 0 2024-01-31T05:13:08.868 INFO:tasks.workunit.client.0.smithi099.stdout:6/104: truncate d14/f16 789184 0 2024-01-31T05:13:08.868 INFO:tasks.workunit.client.0.smithi099.stdout:6/105: creat d14/f1f x:0 0 0 2024-01-31T05:13:08.868 INFO:tasks.workunit.client.0.smithi099.stdout:6/106: chown l6 53 1 2024-01-31T05:13:08.869 INFO:tasks.workunit.client.0.smithi099.stdout:6/107: chown d14/f17 0 1 2024-01-31T05:13:08.869 INFO:tasks.workunit.client.0.smithi099.stdout:4/148: dread d0/d8/d19/f1c [0,4194304] 0 2024-01-31T05:13:08.874 INFO:tasks.workunit.client.0.smithi099.stdout:4/149: creat d0/d2/d20/d21/d17/f37 x:0 0 0 2024-01-31T05:13:08.879 INFO:tasks.workunit.client.0.smithi099.stdout:6/108: dread f1 [0,4194304] 0 2024-01-31T05:13:08.880 INFO:tasks.workunit.client.0.smithi099.stdout:9/108: dwrite d0/d7/f23 [0,4194304] 0 2024-01-31T05:13:08.880 INFO:tasks.workunit.client.0.smithi099.stdout:6/109: chown d14 5 1 2024-01-31T05:13:08.881 INFO:tasks.workunit.client.0.smithi099.stdout:4/150: fsync d0/d2/d20/d21/d17/f37 0 2024-01-31T05:13:08.881 INFO:tasks.workunit.client.0.smithi099.stdout:4/151: read - d0/d1e/f35 zero size 2024-01-31T05:13:08.881 INFO:tasks.workunit.client.0.smithi099.stdout:4/152: creat d0/d2/d20/f38 x:0 0 0 2024-01-31T05:13:08.886 INFO:tasks.workunit.client.0.smithi099.stdout:5/148: dread d6/da/d14/f20 [0,4194304] 0 2024-01-31T05:13:08.889 INFO:tasks.workunit.client.0.smithi099.stdout:9/109: mkdir d0/d1/d24 0 2024-01-31T05:13:08.889 INFO:tasks.workunit.client.0.smithi099.stdout:9/110: readlink d0/d1/d15/l21 0 2024-01-31T05:13:08.889 INFO:tasks.workunit.client.0.smithi099.stdout:9/111: write d0/d7/f1f [1053017,88944] 0 2024-01-31T05:13:08.889 INFO:tasks.workunit.client.0.smithi099.stdout:9/112: fsync d0/d7/fa 0 2024-01-31T05:13:08.891 INFO:tasks.workunit.client.0.smithi099.stdout:4/153: mkdir d0/d2/d20/d21/d39 0 2024-01-31T05:13:08.892 INFO:tasks.workunit.client.0.smithi099.stdout:5/149: creat d6/da/d14/d2b/f2e x:0 0 0 2024-01-31T05:13:08.893 INFO:tasks.workunit.client.0.smithi099.stdout:6/110: unlink d14/f1f 0 2024-01-31T05:13:08.893 INFO:tasks.workunit.client.0.smithi099.stdout:6/111: write f1 [2831776,66292] 0 2024-01-31T05:13:08.895 INFO:tasks.workunit.client.0.smithi099.stdout:1/84: dwrite d4/db/f10 [0,4194304] 0 2024-01-31T05:13:08.895 INFO:tasks.workunit.client.0.smithi099.stdout:9/113: mknod d0/d1/d15/c25 0 2024-01-31T05:13:08.895 INFO:tasks.workunit.client.0.smithi099.stdout:4/154: write d0/d8/f27 [1210654,105684] 0 2024-01-31T05:13:08.896 INFO:tasks.workunit.client.0.smithi099.stdout:5/150: mkdir d6/da/d2f 0 2024-01-31T05:13:08.898 INFO:tasks.workunit.client.0.smithi099.stdout:6/112: rename d14/d18/d1a/d1b/l1e to d14/d18/d1a/d1b/l20 0 2024-01-31T05:13:08.898 INFO:tasks.workunit.client.0.smithi099.stdout:6/113: read d14/f15 [1046847,76169] 0 2024-01-31T05:13:08.898 INFO:tasks.workunit.client.0.smithi099.stdout:6/114: read f1 [383184,63939] 0 2024-01-31T05:13:08.898 INFO:tasks.workunit.client.0.smithi099.stdout:9/114: symlink d0/d1/l26 0 2024-01-31T05:13:08.899 INFO:tasks.workunit.client.0.smithi099.stdout:4/155: symlink d0/d2/d20/l3a 0 2024-01-31T05:13:08.899 INFO:tasks.workunit.client.0.smithi099.stdout:4/156: truncate d0/f3 809230 0 2024-01-31T05:13:08.899 INFO:tasks.workunit.client.0.smithi099.stdout:4/157: creat d0/d2/d20/d21/d17/f3b x:0 0 0 2024-01-31T05:13:08.900 INFO:tasks.workunit.client.0.smithi099.stdout:5/151: symlink d6/d1e/d1f/d21/l30 0 2024-01-31T05:13:08.900 INFO:tasks.workunit.client.0.smithi099.stdout:5/152: stat d6/d1e/f2d 0 2024-01-31T05:13:08.900 INFO:tasks.workunit.client.0.smithi099.stdout:5/153: chown d6/le 3848110 1 2024-01-31T05:13:08.900 INFO:tasks.workunit.client.0.smithi099.stdout:6/115: symlink d14/d18/l21 0 2024-01-31T05:13:08.901 INFO:tasks.workunit.client.0.smithi099.stdout:9/115: mkdir d0/d1/d24/d27 0 2024-01-31T05:13:08.901 INFO:tasks.workunit.client.0.smithi099.stdout:9/116: creat d0/d7/f28 x:0 0 0 2024-01-31T05:13:08.903 INFO:tasks.workunit.client.0.smithi099.stdout:4/158: truncate d0/d8/d19/f2d 1637378 0 2024-01-31T05:13:08.904 INFO:tasks.workunit.client.0.smithi099.stdout:4/159: truncate d0/d2/f15 1194381 0 2024-01-31T05:13:08.912 INFO:tasks.workunit.client.0.smithi099.stdout:1/85: read d4/db/f10 [1784599,64933] 0 2024-01-31T05:13:08.913 INFO:tasks.workunit.client.0.smithi099.stdout:0/104: dwrite d1/d8/df/f12 [0,4194304] 0 2024-01-31T05:13:08.916 INFO:tasks.workunit.client.0.smithi099.stdout:1/86: unlink d4/l17 0 2024-01-31T05:13:08.916 INFO:tasks.workunit.client.0.smithi099.stdout:1/87: chown d4/db/f10 8069050 1 2024-01-31T05:13:08.926 INFO:tasks.workunit.client.0.smithi099.stdout:0/105: rename d1/f1e to d1/d8/f21 0 2024-01-31T05:13:08.926 INFO:tasks.workunit.client.0.smithi099.stdout:0/106: readlink d1/d8/lb 0 2024-01-31T05:13:08.927 INFO:tasks.workunit.client.0.smithi099.stdout:5/154: dwrite d6/f11 [0,4194304] 0 2024-01-31T05:13:08.929 INFO:tasks.workunit.client.0.smithi099.stdout:1/88: rename d4/db/l11 to d4/dc/l19 0 2024-01-31T05:13:08.929 INFO:tasks.workunit.client.0.smithi099.stdout:1/89: fdatasync d4/f6 0 2024-01-31T05:13:08.930 INFO:tasks.workunit.client.0.smithi099.stdout:1/90: write d4/f6 [597379,8598] 0 2024-01-31T05:13:08.931 INFO:tasks.workunit.client.0.smithi099.stdout:5/155: mknod d6/d1e/c31 0 2024-01-31T05:13:08.934 INFO:tasks.workunit.client.0.smithi099.stdout:5/156: mknod d6/d1e/d1f/d21/c32 0 2024-01-31T05:13:08.934 INFO:tasks.workunit.client.0.smithi099.stdout:1/91: read d4/fa [4867361,101818] 0 2024-01-31T05:13:08.934 INFO:tasks.workunit.client.0.smithi099.stdout:1/92: chown d4/c18 931561816 1 2024-01-31T05:13:08.934 INFO:tasks.workunit.client.0.smithi099.stdout:1/93: chown d4/db/l13 6680 1 2024-01-31T05:13:08.934 INFO:tasks.workunit.client.0.smithi099.stdout:1/94: fsync d4/fa 0 2024-01-31T05:13:08.934 INFO:tasks.workunit.client.0.smithi099.stdout:1/95: read d4/db/f10 [2259286,38048] 0 2024-01-31T05:13:08.935 INFO:tasks.workunit.client.0.smithi099.stdout:0/107: dread d1/d8/df/f10 [0,4194304] 0 2024-01-31T05:13:08.935 INFO:tasks.workunit.client.0.smithi099.stdout:0/108: fsync d1/d8/df/f10 0 2024-01-31T05:13:08.935 INFO:tasks.workunit.client.0.smithi099.stdout:0/109: write d1/d8/df/f1d [2944802,50511] 0 2024-01-31T05:13:08.935 INFO:tasks.workunit.client.0.smithi099.stdout:4/160: rmdir d0/d2/d20/d21/d17 39 2024-01-31T05:13:08.936 INFO:tasks.workunit.client.0.smithi099.stdout:1/96: creat d4/dc/d15/f1a x:0 0 0 2024-01-31T05:13:08.936 INFO:tasks.workunit.client.0.smithi099.stdout:1/97: write d4/fa [2963418,117262] 0 2024-01-31T05:13:08.937 INFO:tasks.workunit.client.0.smithi099.stdout:9/117: dwrite d0/d7/f13 [0,4194304] 0 2024-01-31T05:13:08.939 INFO:tasks.workunit.client.0.smithi099.stdout:4/161: mknod d0/d1e/c3c 0 2024-01-31T05:13:08.939 INFO:tasks.workunit.client.0.smithi099.stdout:4/162: chown d0/d2/d20/d21/d17/d24/f32 5008913 1 2024-01-31T05:13:08.941 INFO:tasks.workunit.client.0.smithi099.stdout:0/110: mkdir d1/d22 0 2024-01-31T05:13:08.949 INFO:tasks.workunit.client.0.smithi099.stdout:4/163: mkdir d0/d2/d20/d21/d17/d3d 0 2024-01-31T05:13:08.949 INFO:tasks.workunit.client.0.smithi099.stdout:0/111: symlink d1/d8/df/l23 0 2024-01-31T05:13:08.949 INFO:tasks.workunit.client.0.smithi099.stdout:6/116: dwrite f12 [0,4194304] 0 2024-01-31T05:13:08.950 INFO:tasks.workunit.client.0.smithi099.stdout:6/117: write fc [4933046,66014] 0 2024-01-31T05:13:08.953 INFO:tasks.workunit.client.0.smithi099.stdout:6/118: mkdir d14/d18/d1a/d1b/d22 0 2024-01-31T05:13:08.955 INFO:tasks.workunit.client.0.smithi099.stdout:6/119: mknod d14/c23 0 2024-01-31T05:13:08.957 INFO:tasks.workunit.client.0.smithi099.stdout:0/112: rename d1/d8/f21 to d1/d16/f24 0 2024-01-31T05:13:08.960 INFO:tasks.workunit.client.0.smithi099.stdout:3/82: sync 2024-01-31T05:13:08.960 INFO:tasks.workunit.client.0.smithi099.stdout:3/83: readlink ld 0 2024-01-31T05:13:08.960 INFO:tasks.workunit.client.0.smithi099.stdout:3/84: fdatasync d10/f19 0 2024-01-31T05:13:08.965 INFO:tasks.workunit.client.0.smithi099.stdout:9/118: dwrite d0/d1/f1d [4194304,4194304] 0 2024-01-31T05:13:08.965 INFO:tasks.workunit.client.0.smithi099.stdout:9/119: chown d0/d7/f13 18050314 1 2024-01-31T05:13:08.968 INFO:tasks.workunit.client.0.smithi099.stdout:5/157: dwrite d6/d1e/d1f/d21/f27 [0,4194304] 0 2024-01-31T05:13:08.968 INFO:tasks.workunit.client.0.smithi099.stdout:5/158: getdents d6/da/d14 0 2024-01-31T05:13:08.968 INFO:tasks.workunit.client.0.smithi099.stdout:5/159: chown d6/da/d14/l15 3400 1 2024-01-31T05:13:08.968 INFO:tasks.workunit.client.0.smithi099.stdout:5/160: getdents d6/da/d2f 0 2024-01-31T05:13:08.968 INFO:tasks.workunit.client.0.smithi099.stdout:1/98: dwrite d4/f6 [0,4194304] 0 2024-01-31T05:13:08.968 INFO:tasks.workunit.client.0.smithi099.stdout:5/161: dread - d6/da/d14/d2b/f2e zero size 2024-01-31T05:13:08.968 INFO:tasks.workunit.client.0.smithi099.stdout:5/162: readlink d6/da/d14/l15 0 2024-01-31T05:13:08.974 INFO:tasks.workunit.client.0.smithi099.stdout:4/164: dread d0/fd [0,4194304] 0 2024-01-31T05:13:08.980 INFO:tasks.workunit.client.0.smithi099.stdout:1/99: mknod d4/df/c1b 0 2024-01-31T05:13:08.982 INFO:tasks.workunit.client.0.smithi099.stdout:5/163: symlink d6/d1e/d1f/d21/l33 0 2024-01-31T05:13:08.982 INFO:tasks.workunit.client.0.smithi099.stdout:5/164: read - d6/d1e/f2d zero size 2024-01-31T05:13:08.982 INFO:tasks.workunit.client.0.smithi099.stdout:4/165: readlink d0/d8/l14 0 2024-01-31T05:13:08.983 INFO:tasks.workunit.client.0.smithi099.stdout:5/165: mkdir d6/da/d34 0 2024-01-31T05:13:08.984 INFO:tasks.workunit.client.0.smithi099.stdout:9/120: dread d0/d7/f1f [0,4194304] 0 2024-01-31T05:13:08.986 INFO:tasks.workunit.client.0.smithi099.stdout:4/166: mknod d0/d8/c3e 0 2024-01-31T05:13:08.987 INFO:tasks.workunit.client.0.smithi099.stdout:9/121: dread d0/d1/fe [0,4194304] 0 2024-01-31T05:13:08.987 INFO:tasks.workunit.client.0.smithi099.stdout:9/122: write d0/d7/f14 [1238857,116974] 0 2024-01-31T05:13:08.989 INFO:tasks.workunit.client.0.smithi099.stdout:9/123: mkdir d0/d29 0 2024-01-31T05:13:08.989 INFO:tasks.workunit.client.0.smithi099.stdout:9/124: rename d0/d1/d15 to d0/d1/d15/d2a 22 2024-01-31T05:13:08.991 INFO:tasks.workunit.client.0.smithi099.stdout:3/85: dwrite f4 [0,4194304] 0 2024-01-31T05:13:08.993 INFO:tasks.workunit.client.0.smithi099.stdout:5/166: dread d6/fd [0,4194304] 0 2024-01-31T05:13:08.993 INFO:tasks.workunit.client.0.smithi099.stdout:3/86: mkdir d10/d1e 0 2024-01-31T05:13:08.993 INFO:tasks.workunit.client.0.smithi099.stdout:5/167: chown d6/d1e/d1f/d21/l33 2 1 2024-01-31T05:13:08.993 INFO:tasks.workunit.client.0.smithi099.stdout:3/87: creat d10/f1f x:0 0 0 2024-01-31T05:13:08.993 INFO:tasks.workunit.client.0.smithi099.stdout:3/88: dread - fa zero size 2024-01-31T05:13:08.994 INFO:tasks.workunit.client.0.smithi099.stdout:9/125: rename d0/d1/d15 to d0/d1/d24/d2b 0 2024-01-31T05:13:08.994 INFO:tasks.workunit.client.0.smithi099.stdout:9/126: chown d0/d1 438328391 1 2024-01-31T05:13:08.996 INFO:tasks.workunit.client.0.smithi099.stdout:9/127: dread d0/d1/d24/d2b/f1b [0,4194304] 0 2024-01-31T05:13:08.997 INFO:tasks.workunit.client.0.smithi099.stdout:9/128: symlink d0/d1/d24/d27/l2c 0 2024-01-31T05:13:08.997 INFO:tasks.workunit.client.0.smithi099.stdout:9/129: chown d0/d1/d24/d2b/l16 40843 1 2024-01-31T05:13:09.003 INFO:tasks.workunit.client.0.smithi099.stdout:2/117: sync 2024-01-31T05:13:09.003 INFO:tasks.workunit.client.0.smithi099.stdout:8/188: sync 2024-01-31T05:13:09.004 INFO:tasks.workunit.client.0.smithi099.stdout:2/118: creat d10/d1c/f26 x:0 0 0 2024-01-31T05:13:09.005 INFO:tasks.workunit.client.0.smithi099.stdout:8/189: symlink d1/l35 0 2024-01-31T05:13:09.006 INFO:tasks.workunit.client.0.smithi099.stdout:6/120: dwrite f12 [0,4194304] 0 2024-01-31T05:13:09.006 INFO:tasks.workunit.client.0.smithi099.stdout:6/121: chown d14/d18 3004 1 2024-01-31T05:13:09.006 INFO:tasks.workunit.client.0.smithi099.stdout:6/122: chown f11 28 1 2024-01-31T05:13:09.007 INFO:tasks.workunit.client.0.smithi099.stdout:0/113: dwrite d1/d8/df/f12 [0,4194304] 0 2024-01-31T05:13:09.008 INFO:tasks.workunit.client.0.smithi099.stdout:1/100: dwrite d4/dc/d15/f1a [0,4194304] 0 2024-01-31T05:13:09.008 INFO:tasks.workunit.client.0.smithi099.stdout:1/101: write d4/db/f10 [3203147,37007] 0 2024-01-31T05:13:09.009 INFO:tasks.workunit.client.0.smithi099.stdout:5/168: dread d6/d1e/d1f/d21/f27 [0,4194304] 0 2024-01-31T05:13:09.011 INFO:tasks.workunit.client.0.smithi099.stdout:2/119: symlink d10/d1b/l27 0 2024-01-31T05:13:09.011 INFO:tasks.workunit.client.0.smithi099.stdout:2/120: chown d10/f11 20 1 2024-01-31T05:13:09.011 INFO:tasks.workunit.client.0.smithi099.stdout:6/123: symlink d14/d18/d1a/l24 0 2024-01-31T05:13:09.014 INFO:tasks.workunit.client.0.smithi099.stdout:5/169: truncate d6/da/d14/f20 3687673 0 2024-01-31T05:13:09.015 INFO:tasks.workunit.client.0.smithi099.stdout:2/121: creat d10/f28 x:0 0 0 2024-01-31T05:13:09.016 INFO:tasks.workunit.client.0.smithi099.stdout:6/124: symlink d14/d18/d1a/d1b/d22/l25 0 2024-01-31T05:13:09.017 INFO:tasks.workunit.client.0.smithi099.stdout:3/89: dread f0 [0,4194304] 0 2024-01-31T05:13:09.018 INFO:tasks.workunit.client.0.smithi099.stdout:5/170: mkdir d6/d1e/d35 0 2024-01-31T05:13:09.020 INFO:tasks.workunit.client.0.smithi099.stdout:3/90: symlink d10/l20 0 2024-01-31T05:13:09.020 INFO:tasks.workunit.client.0.smithi099.stdout:3/91: fdatasync d10/f16 0 2024-01-31T05:13:09.020 INFO:tasks.workunit.client.0.smithi099.stdout:1/102: write d4/f6 [360967,100577] 0 2024-01-31T05:13:09.023 INFO:tasks.workunit.client.0.smithi099.stdout:0/114: dread d1/d8/df/f12 [0,4194304] 0 2024-01-31T05:13:09.023 INFO:tasks.workunit.client.0.smithi099.stdout:6/125: write fc [559167,113800] 0 2024-01-31T05:13:09.023 INFO:tasks.workunit.client.0.smithi099.stdout:6/126: truncate d14/f17 1580544 0 2024-01-31T05:13:09.024 INFO:tasks.workunit.client.0.smithi099.stdout:5/171: unlink d6/da/d14/f1a 0 2024-01-31T05:13:09.025 INFO:tasks.workunit.client.0.smithi099.stdout:2/122: mknod d10/c29 0 2024-01-31T05:13:09.027 INFO:tasks.workunit.client.0.smithi099.stdout:3/92: mknod d10/d18/c21 0 2024-01-31T05:13:09.028 INFO:tasks.workunit.client.0.smithi099.stdout:3/93: creat d10/d18/f22 x:0 0 0 2024-01-31T05:13:09.031 INFO:tasks.workunit.client.0.smithi099.stdout:1/103: mknod d4/db/c1c 0 2024-01-31T05:13:09.032 INFO:tasks.workunit.client.0.smithi099.stdout:0/115: creat d1/d8/df/f25 x:0 0 0 2024-01-31T05:13:09.034 INFO:tasks.workunit.client.0.smithi099.stdout:6/127: creat d14/d18/d1a/f26 x:0 0 0 2024-01-31T05:13:09.035 INFO:tasks.workunit.client.0.smithi099.stdout:6/128: write d14/f16 [1573038,89101] 0 2024-01-31T05:13:09.036 INFO:tasks.workunit.client.0.smithi099.stdout:8/190: dwrite d1/dd/d11/d19/f1c [0,4194304] 0 2024-01-31T05:13:09.036 INFO:tasks.workunit.client.0.smithi099.stdout:5/172: write d6/f10 [3030142,63000] 0 2024-01-31T05:13:09.036 INFO:tasks.workunit.client.0.smithi099.stdout:8/191: stat d1/dd/d1d/c25 0 2024-01-31T05:13:09.038 INFO:tasks.workunit.client.0.smithi099.stdout:3/94: rename f2 to d10/f23 0 2024-01-31T05:13:09.039 INFO:tasks.workunit.client.0.smithi099.stdout:1/104: symlink d4/df/l1d 0 2024-01-31T05:13:09.042 INFO:tasks.workunit.client.0.smithi099.stdout:2/123: link d10/d1b/f1f d10/f2a 0 2024-01-31T05:13:09.048 INFO:tasks.workunit.client.0.smithi099.stdout:5/173: rename d6/da/l1c to d6/l36 0 2024-01-31T05:13:09.049 INFO:tasks.workunit.client.0.smithi099.stdout:3/95: mkdir d10/d24 0 2024-01-31T05:13:09.049 INFO:tasks.workunit.client.0.smithi099.stdout:3/96: fdatasync d10/d18/f22 0 2024-01-31T05:13:09.049 INFO:tasks.workunit.client.0.smithi099.stdout:1/105: dread d4/dc/d15/f1a [0,4194304] 0 2024-01-31T05:13:09.052 INFO:tasks.workunit.client.0.smithi099.stdout:0/116: mknod d1/c26 0 2024-01-31T05:13:09.052 INFO:tasks.workunit.client.0.smithi099.stdout:0/117: readlink d1/d8/lb 0 2024-01-31T05:13:09.052 INFO:tasks.workunit.client.0.smithi099.stdout:0/118: stat d1/f5 0 2024-01-31T05:13:09.052 INFO:tasks.workunit.client.0.smithi099.stdout:0/119: readlink d1/d8/df/l23 0 2024-01-31T05:13:09.052 INFO:tasks.workunit.client.0.smithi099.stdout:3/97: rename d10/f1f to d10/d1e/f25 0 2024-01-31T05:13:09.054 INFO:tasks.workunit.client.0.smithi099.stdout:3/98: rename f7 to d10/d18/f26 0 2024-01-31T05:13:09.056 INFO:tasks.workunit.client.0.smithi099.stdout:3/99: mkdir d10/d27 0 2024-01-31T05:13:09.057 INFO:tasks.workunit.client.0.smithi099.stdout:3/100: link ld d10/d27/l28 0 2024-01-31T05:13:09.058 INFO:tasks.workunit.client.0.smithi099.stdout:3/101: rmdir d10/d1e 39 2024-01-31T05:13:09.059 INFO:tasks.workunit.client.0.smithi099.stdout:8/192: dread d1/dd/d11/d19/d21/f2c [0,4194304] 0 2024-01-31T05:13:09.060 INFO:tasks.workunit.client.0.smithi099.stdout:5/174: write d6/da/d14/f20 [282380,33390] 0 2024-01-31T05:13:09.062 INFO:tasks.workunit.client.0.smithi099.stdout:8/193: rename d1/f5 to d1/dd/d11/d19/f36 0 2024-01-31T05:13:09.063 INFO:tasks.workunit.client.0.smithi099.stdout:5/175: rename d6/d1e/d1f/d21/l23 to d6/d1e/d1f/d21/l37 0 2024-01-31T05:13:09.065 INFO:tasks.workunit.client.0.smithi099.stdout:8/194: rename d1/dd/d11/d19/d21/l34 to d1/dd/d11/d29/l37 0 2024-01-31T05:13:09.066 INFO:tasks.workunit.client.0.smithi099.stdout:8/195: mknod d1/dd/c38 0 2024-01-31T05:13:09.069 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.877+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002592 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll_create1/Makefile auth v6 ap=1 s=915 n(v0 rc2024-01-31T05:12:57.799568+0000 b915 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d9895fc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002592:[<0x10000002591/Makefile v2>,<0x10000002572/epoll_create1 v1482>,<0x10000001eda/syscalls v874>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002592:[<0x10000002591/Makefile v6>,<0x10000002572/epoll_create1 v1482>,<0x10000001eda/syscalls v1573>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:09.069 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.877+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000026f1 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sgetmask/sgetmask01.c auth v8 ap=1 s=8406 n(v0 rc2024-01-31T05:12:57.968564+0000 b8406 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d98956eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000026f1:[<0x100000026f0/sgetmask01.c v2>,<0x10000002572/sgetmask v1582>,<0x10000001eda/syscalls v874>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000026f1:[<0x100000026f0/sgetmask01.c v8>,<0x10000002572/sgetmask v1582>,<0x10000001eda/syscalls v1573>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:09.069 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.877+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000023bb [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll_create1/epoll_create1_01.c auth v8 ap=1 s=9840 n(v0 rc2024-01-31T05:12:57.800567+0000 b9840 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d9895fbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000023bb:[<0x10000002591/epoll_create1_01.c v4>,<0x10000002572/epoll_create1 v1482>,<0x10000001eda/syscalls v874>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000023bb:[<0x10000002591/epoll_create1_01.c v8>,<0x10000002572/epoll_create1 v1482>,<0x10000001eda/syscalls v1573>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:09.069 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.877+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002489 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sgetmask/Makefile auth v6 ap=1 s=915 n(v0 rc2009-10-09T17:56:01.000000+0000 b915 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d9894a6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002489:[<0x100000026f0/Makefile v4>,<0x10000002572/sgetmask v1582>,<0x10000001eda/syscalls v874>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002489:[<0x100000026f0/Makefile v6>,<0x10000002572/sgetmask v1582>,<0x10000001eda/syscalls v1573>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:09.069 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.950+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002491 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sched_yield/Makefile auth v8 ap=1 s=915 n(v0 rc2009-10-09T17:56:00.000000+0000 b915 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d9895fc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002491:[<0x100000026f8/Makefile v4>,<0x10000002572/sched_yield v1590>,<0x10000001eda/syscalls v874>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002491:[<0x100000026f8/Makefile v8>,<0x10000002572/sched_yield v1590>,<0x10000001eda/syscalls v1573>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:09.069 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:08.950+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000026f9 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sched_yield/sched_yield01.c auth v6 ap=1 s=2906 n(v0 rc2024-01-31T05:12:57.980563+0000 b2906 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d9895fcc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000026f9:[<0x100000026f8/sched_yield01.c v2>,<0x10000002572/sched_yield v1590>,<0x10000001eda/syscalls v874>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000026f9:[<0x100000026f8/sched_yield01.c v6>,<0x10000002572/sched_yield v1590>,<0x10000001eda/syscalls v1573>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:09.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:09.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:09.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:09.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:09.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:09.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:09.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:09.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:09.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:09.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:09.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:09.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:09.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:09.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:09.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:09.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:09.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000217a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f8d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/Makefile.inc) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002172 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002178 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/libclone) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002174 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f4a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/container_test.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.072 INFO:tasks.workunit.client.0.smithi099.stdout:8/196: truncate d1/dd/d11/d19/f36 1780200 0 2024-01-31T05:13:09.072 INFO:tasks.workunit.client.0.smithi099.stdout:3/102: dread f4 [0,4194304] 0 2024-01-31T05:13:09.072 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:09.005+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001c7b [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/testfrmw.h auth v24 ap=1 s=2420 n(v0 rc2024-01-31T05:12:55.977610+0000 b2420 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d989570680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001c7b:[<0x10000001dc0/testfrmw.h v8>,<0x10000001db9/sem_getvalue v60>,<0x10000001db0/threads v80>,<0x100000012a8/stress v108>,<0x10000000204/open_posix_testsuite v502>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001c7b:[<0x10000001dc0/testfrmw.h v24>,<0x10000001db9/sem_getvalue v60>,<0x10000001db0/threads v91>,<0x100000012a8/stress v143>,<0x10000000204/open_posix_testsuite v879>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:09.073 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:09.005+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001c26 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/Makefile auth v14 ap=1 s=372 n(v0 rc2005-06-03T16:37:17.000000+0000 b372 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d989570c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001c26:[<0x10000001dc0/Makefile v4>,<0x10000001db9/sem_getvalue v60>,<0x10000001db0/threads v80>,<0x100000012a8/stress v108>,<0x10000000204/open_posix_testsuite v502>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001c26:[<0x10000001dc0/Makefile v14>,<0x10000001db9/sem_getvalue v60>,<0x10000001db0/threads v91>,<0x100000012a8/stress v143>,<0x10000000204/open_posix_testsuite v879>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:09.073 INFO:tasks.workunit.client.0.smithi099.stdout:8/197: chown d1/dd/d15/f22 77 1 2024-01-31T05:13:09.073 INFO:tasks.workunit.client.0.smithi099.stdout:3/103: write d10/f1b [738618,13417] 0 2024-01-31T05:13:09.073 INFO:tasks.workunit.client.0.smithi099.stdout:2/124: dwrite d10/d1b/f23 [0,4194304] 0 2024-01-31T05:13:09.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f49 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f53 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/README) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f7e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/crtchild_delchild.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:09.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002171 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/TEST_PLAN.txt) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f7f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/runallnetworktests_parent.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f7b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/child_1.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f83 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/sysfsview.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f5d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns01.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f66 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns20.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f86 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/rename_net.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f6c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/parent_view.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f64 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns03.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f68 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns05.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.075 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f8a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/ch_ftp.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.075 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f7d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/childns.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.075 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:09.005+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001dc1 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/stress.c auth v22 ap=1 s=6622 n(v0 rc2005-06-03T16:37:17.000000+0000 b6622 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d989570100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001dc1:[<0x10000001dc0/stress.c v2>,<0x10000001db9/sem_getvalue v60>,<0x10000001db0/threads v80>,<0x100000012a8/stress v108>,<0x10000000204/open_posix_testsuite v502>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001dc1:[<0x10000001dc0/stress.c v22>,<0x10000001db9/sem_getvalue v60>,<0x10000001db0/threads v91>,<0x100000012a8/stress v143>,<0x10000000204/open_posix_testsuite v879>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:09.075 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:09.005+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001c7c [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/NOTES auth v16 ap=1 s=1813 n(v0 rc2005-06-03T16:37:17.000000+0000 b1813 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d989571180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001c7c:[<0x10000001dc0/NOTES v10>,<0x10000001db9/sem_getvalue v60>,<0x10000001db0/threads v80>,<0x100000012a8/stress v108>,<0x10000000204/open_posix_testsuite v502>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001c7c:[<0x10000001dc0/NOTES v16>,<0x10000001db9/sem_getvalue v60>,<0x10000001db0/threads v91>,<0x100000012a8/stress v143>,<0x10000000204/open_posix_testsuite v879>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:09.075 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f60 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns17.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.075 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f76 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/parent_share.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.075 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f67 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns16.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.076 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f6d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/parentns.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.076 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f78 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.076 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f65 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns04.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.076 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f5a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns06.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.076 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f75 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/parent.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.076 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f62 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns31.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.076 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f74 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/parent_2.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.076 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f5e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/Makefile) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.076 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f6f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/paripv6.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.076 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f5c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns10.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.076 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f69 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns30.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.076 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f87 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/create_container.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.077 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:09.005+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001c7d [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/LICENCE auth v20 ap=1 s=17992 n(v0 rc2005-06-03T16:37:17.000000+0000 b17992 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d989571700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001c7d:[<0x10000001dc0/LICENCE v12>,<0x10000001db9/sem_getvalue v60>,<0x10000001db0/threads v80>,<0x100000012a8/stress v108>,<0x10000000204/open_posix_testsuite v502>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001c7d:[<0x10000001dc0/LICENCE v20>,<0x10000001db9/sem_getvalue v60>,<0x10000001db0/threads v91>,<0x100000012a8/stress v143>,<0x10000000204/open_posix_testsuite v879>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:09.077 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:09.006+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001c27 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/testfrmw.c auth v18 ap=1 s=2106 n(v0 rc2005-06-03T16:37:17.000000+0000 b2106 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d9895d4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001c27:[<0x10000001dc0/testfrmw.c v6>,<0x10000001db9/sem_getvalue v60>,<0x10000001db0/threads v80>,<0x100000012a8/stress v108>,<0x10000000204/open_posix_testsuite v502>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001c27:[<0x10000001dc0/testfrmw.c v18>,<0x10000001db9/sem_getvalue v60>,<0x10000001db0/threads v91>,<0x100000012a8/stress v143>,<0x10000000204/open_posix_testsuite v879>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:09.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f5f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/runpidnstest.sh) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f72 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/readme) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002177 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns02.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f63 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/README) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f71 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/par_chld_ipv6.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f61 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns13.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f7a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/child_2.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f5b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns12.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f70 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/common.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f6e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/two_children_ns.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f84 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/par_chld_ftp.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f82 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/par_ftp.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f81 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/nw_under_ns.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000217b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/delchild.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:09.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f8b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/container_ftp.pl) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.078 INFO:tasks.workunit.client.0.smithi099.stdout:6/129: truncate d14/f16 1633216 0 2024-01-31T05:13:09.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f80 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/initialize.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f79 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/runnetnstest.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f77 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/parent_1.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f88 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/childipv6.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021cb (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/test_controllers.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f7c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/child.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f73 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/check_netns_enabled.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f85 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/runallnetworktests_child.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021fa (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/Makefile.inc) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f89 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/crtchild.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000023e2 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f52 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/semtest_2ns.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022c7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memctl) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f8c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/child_propagate.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022c9 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f51 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/runipcnstest.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f4d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/shmnstest.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002173 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/mesgq_nstest.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022e1 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl_fj) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f4c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/runtests_noltp.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f4e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000214a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f50 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/sem_nstest.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f4f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/check_ipcns_enabled.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022c6 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/testplan.txt) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002179 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/libclone/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f4b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/shmem_2nstest.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000023e6 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f6a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/libclone/libclone.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f6b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/libclone/libclone.h) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022e3 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f59 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns/mqns_01.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002175 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns/runmqnstest.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f58 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns/mqns_04.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000023e0 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f56 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns/mqns_02.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f57 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns/mqns.h) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021c1 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/README) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f55 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f54 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns/mqns_03.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000023e4 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuacct) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002416 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000023f2 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000023f0 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/libcontrollers) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002415 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000023ee (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021c9 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/cgroup_fj_proc.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002407 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021c4 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/cgroup_fj_utility.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021c6 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/cgroup_fj_release_agent) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021c5 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021c7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/cgroup_fj_testcases) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000240b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021c8 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/README) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021ca (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/cgroup_fj_function2.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021c3 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/cgroup_fj_function.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000256c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/tomoyo) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000023e3 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/run_cgroup_test_fj.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021c2 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/cgroup_fj_stress.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002127 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memctl/memctl_testplan.txt) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022c8 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memctl/memctl_test01.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.084 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.905+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002492 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pathconf/pathconf01.c auth v8 ap=1 s=7181 n(v0 rc2009-11-02T13:57:17.000000+0000 b7181 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850fae680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002492:[<0x100000026fa/pathconf01.c v4>,<0x10000002572/pathconf v1592>,<0x10000001eda/syscalls v874>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002492:[<0x100000026fa/pathconf01.c v8>,<0x10000002572/pathconf v1592>,<0x10000001eda/syscalls v1573>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:09.084 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:08.905+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000026fb [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pathconf/Makefile auth v6 ap=1 s=915 n(v0 rc2024-01-31T05:12:57.982563+0000 b915 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850fae100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000026fb:[<0x100000026fa/Makefile v2>,<0x10000002572/pathconf v1592>,<0x10000001eda/syscalls v874>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000026fb:[<0x100000026fa/Makefile v6>,<0x10000002572/pathconf v1592>,<0x10000001eda/syscalls v1573>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:09.084 INFO:tasks.workunit.client.0.smithi099.stdout:8/198: symlink d1/dd/d15/l39 0 2024-01-31T05:13:09.085 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:08.891+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000271d [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/exit_group/exit_group01.c auth v8 ap=1 s=8412 n(v0 rc2024-01-31T05:12:58.039562+0000 b8412 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e703080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000271d:[<0x1000000271c/exit_group01.c v2>,<0x10000002572/exit_group v1626>,<0x10000001eda/syscalls v874>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000271d:[<0x1000000271c/exit_group01.c v8>,<0x10000002572/exit_group v1626>,<0x10000001eda/syscalls v1573>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:09.085 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:13:08.891+0000 7f60023b0700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000024b7 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/exit_group/Makefile auth v6 ap=1 s=915 n(v0 rc2009-10-09T17:55:54.000000+0000 b915 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56120e703600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000024b7:[<0x1000000271c/Makefile v4>,<0x10000002572/exit_group v1626>,<0x10000001eda/syscalls v874>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000024b7:[<0x1000000271c/Makefile v6>,<0x10000002572/exit_group v1626>,<0x10000001eda/syscalls v1573>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:09.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002129 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memctl/myfunctions.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002125 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memctl/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002126 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memctl/README) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002418 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002128 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memctl/run_memctl_test.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022ce (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_hotplug_test) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002570 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022d5 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_spread_test) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022db (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_inherit_test) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002409 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/p9auth) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002147 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/Makefile.inc) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000256e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022d7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_hierarchy_test) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022cc (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_syscall_test) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000216f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/utsname) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022d0 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002143 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_funcs.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002176 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022d1 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_load_balance_test) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022ca (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002258 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/exec_with_inh.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002142 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/run_cpuset_test.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000225b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/cap_bset_inh_bounds.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022d9 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_base_ops_test) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002257 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000213c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/README) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002417 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/exec_without_inh.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022df (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_test) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000225d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/cap_bounds_r.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022d3 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_exclusive_test) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000225c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/check_pe.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022dd (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_pressure_test) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002256 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/cap_bounds_rw.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000214d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl_fj/run_cpuctl_test_fj.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000225a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/check_for_libcap.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000214b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl_fj/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000214c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl_fj/README) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000214e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl_fj/cpuctl_fj_cpu-hog.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002259 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/run_capbounds.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000225e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/dummy.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022e2 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl_fj/cpuctl_fj_simple_echo.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000223b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_onlycap.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002241 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/notroot.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000023e9 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002243 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_load.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000223e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_doi.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002246 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_cipso.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000023e7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/regression) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.093 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000223d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_file_access.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.093 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021d9 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/README) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.093 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002245 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_netlabel.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.093 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000223a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_ambient.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.093 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000223c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_direct.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.093 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000223f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.093 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000023ea (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/functional) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.093 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002244 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_socket_labels.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.093 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002159 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/getdelays.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.093 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002157 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_10_2.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.093 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002240 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_common.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.093 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002242 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/README) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.093 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002153 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_10_1.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.093 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002408 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_current.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.094 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002154 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_6_2.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.094 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000240c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.094 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002414 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.094 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000237c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/tomoyo/newns.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.094 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000237b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/tomoyo/tomoyo_file_test.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.094 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000237a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/tomoyo/testall.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.094 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002152 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.094 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022e4 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_9_2.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.094 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002156 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_6_1.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.094 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000214f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/fork_processes.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.094 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002151 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_3_1.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.094 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000256d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/tomoyo/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.094 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000237d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/tomoyo/include.h) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.094 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000215a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/cgroup_regression_test.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.095 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002150 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_3_2.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.095 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002155 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/README) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.095 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021c0 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_def_task01.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.095 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000215c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/parameters.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.095 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002158 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_9_1.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.095 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021be (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_latency_check_task.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.095 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002419 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.095 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002379 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/tomoyo/README) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.095 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002378 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/ChangeLog) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.095 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000023ec (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/stress) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.095 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000215d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_def_task04.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.095 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021ba (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/run_cpuctl_test.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.095 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021bd (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/run_cpuctl_stress_test.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.095 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000251c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.095 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021b5 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_test02.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.096 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021bb (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_test04.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.096 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021b7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_testplan.txt) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.096 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000241b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.096 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021b8 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_def_task03.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.096 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021b6 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.096 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002312 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/README) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.096 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000023e1 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_test03.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.096 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000241c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.096 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000215b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_latency_test.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.096 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002386 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/ask_password.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.096 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000238c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/remove_password.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.096 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021bf (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_def_task02.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.096 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002571 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/change_password.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.096 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002387 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/LICENSE) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.097 INFO:tasks.workunit.client.0.smithi099.stdout:3/104: link f0 d10/d27/f29 0 2024-01-31T05:13:09.097 INFO:tasks.workunit.client.0.smithi099.stdout:3/105: write fa [670582,49681] 0 2024-01-31T05:13:09.097 INFO:tasks.workunit.client.0.smithi099.stdout:3/106: chown c3 199 1 2024-01-31T05:13:09.100 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021bc (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/README) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.100 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002388 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.101 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000215e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/run_cpuctl_latency_test.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.101 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021b9 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_test01.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.101 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000238b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/force_erase.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.101 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021cc (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuacct/run_cpuacct_test.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.101 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021ce (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuacct/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.101 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000238a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/AUTHORS) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.101 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002248 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/p9auth/p9unpriv.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.101 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021cd (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuacct/cpuacct_task01.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.101 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000224a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/p9auth/unhex.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.101 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000023e5 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuacct/cpuacct_setup.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.101 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021cf (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuacct/README) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.101 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002249 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/p9auth/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.101 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021d0 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuacct/cpuacct_testplan.txt) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.101 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000240a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/p9auth/p9priv.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.102 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021f5 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.102 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002247 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/p9auth/runp9auth.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.102 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000023f3 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/io_throttle_testplan.txt) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.102 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000237e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/verify_caps_exec.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.102 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021f7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/README) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.102 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021f9 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/iobw.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.102 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002382 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/check_simple_capset.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.102 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002385 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/inh_capped.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.102 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021f4 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/libcontrollers/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.102 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000023f1 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/libcontrollers/libcontrollers.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.102 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002384 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/checkforfilecaps.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.102 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021f3 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/libcontrollers/libcontrollers.h) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.102 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002380 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.102 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021e0 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/freeze_move_thaw.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.103 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021e9 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/TODO) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.103 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002383 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/README) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.103 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021e1 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/write_freezing.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.103 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000256f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/print_caps.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.103 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021dc (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/run_freezer.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.103 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021df (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/CHANGELOG) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.103 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002381 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/filecapstest.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.103 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021ee (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/libcgroup_freezer) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.103 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021da (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/stress/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.103 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021e7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/timed_forkbomb.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.103 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000023ed (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/stress/memcg_stress_test.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.103 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021eb (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/freeze_self_thaw.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.103 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021e3 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/stop_freeze_thaw_cont.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.104 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021db (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/stress/memcg_process_stress.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.104 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021ec (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/fork_exec_loop.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.104 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021dd (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/vfork.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.104 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021e5 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.104 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000240d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/policy) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.104 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021ed (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/freeze_thaw.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.104 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021f6 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/run_io_throttle_test.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.104 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002389 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/README) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.104 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021f8 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/myfunctions-io.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.104 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021e6 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/freeze_sleep_thaw.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.104 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000238d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/assign_password.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.104 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000237f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/checkforlibcap.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.104 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021de (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/00_description.txt) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.104 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002410 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.105 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021f1 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/freeze_kill_thaw.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.105 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002412 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/tests) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.105 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021ef (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/vfork_freeze.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.105 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000224d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/README) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.105 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021e4 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/libltp) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.105 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000227f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_task_getsched.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.105 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021f0 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/freeze_cancel.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.105 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002267 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_mkdir.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.105 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002280 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_capable_net.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.105 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021e8 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/README) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.105 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002274 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_fdreceive.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.105 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021e2 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/fork_freeze.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.105 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000227e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_dyntrace.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.105 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021ea (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/stop_freeze_sleep_thaw_cont.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.106 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002278 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_sysctl.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.106 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000023ef (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/COPYING) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.106 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002263 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_ioctl.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.106 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021f2 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/freeze_write_freezing.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.106 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022cf (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_hotplug_test/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.106 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002136 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_hotplug_test/cpuset_hotplug_test.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.106 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002279 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_dyntrans.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.106 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002137 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_hotplug_test/cpuset_list_compute.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.106 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000226b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_task_getpgid.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.106 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000213f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_spread_test/cpuset_memory_spread_testset.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.106 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002264 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_task_setsched.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.106 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022d6 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_spread_test/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.106 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000226f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_file.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.106 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002144 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_inherit_test/cpuset_inherit_testset.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.106 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000240f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.107 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002266 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_readlink.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.107 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022d8 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_hierarchy_test/cpuset_hierarchy_test.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.107 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022dc (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_inherit_test/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.107 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000226a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_execute_no_trans.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.107 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002140 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_hierarchy_test/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.107 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002269 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_stat.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.107 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002134 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_syscall_test/cpuset_syscall_test.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.107 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002276 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_open.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.107 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022cd (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_syscall_test/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.107 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000226c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_attrib.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.107 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002262 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_ipc.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.107 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000225f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_task_setpgid.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.107 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000213b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_load_balance_test/cpuset_cpu_hog.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.107 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000226d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_capable_sys.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.107 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022d2 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_load_balance_test/cpuset_sched_domains_check.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.108 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002270 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.108 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000213a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_load_balance_test/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.108 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002139 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_load_balance_test/cpuset_load_balance_test.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.108 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002283 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_rxdir.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.108 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000227d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_global.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.108 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002261 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_link.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.108 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000212f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/meminfo.h) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.108 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002130 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/libbitmask.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.108 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002268 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_ptrace.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.108 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000213e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_spread_test/cpuset_mem_hog.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.108 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002265 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_capable_file.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.108 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000227c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_exectrace.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.108 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000212a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.108 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000226e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_execshare.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.109 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000212c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/libcpuset.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.109 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002260 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_setnice.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.109 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000227b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_setattr.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.109 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002275 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_sigkill.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.109 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002271 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_wait.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.109 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000227a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_transition.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.109 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002138 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_load_balance_test/cpuset_sched_domains_test.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.109 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002281 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_task_getsid.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.109 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000212d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/cpuinfo.h) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.109 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002273 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_socket.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.109 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000212e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/cpuset_funcs.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.109 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002277 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_relabel.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.109 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000241a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_rename.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.109 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002135 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_syscall_test/cpuset_syscall_testset.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.110 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000212b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/bitmask.h) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.110 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002133 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/cpuset.h) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.110 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022da (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_base_ops_test/cpuset_base_ops_testset.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.110 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002284 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_inherit.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.110 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002131 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/common.h) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.110 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002566 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/bounds) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.110 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002272 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_entrypoint.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.110 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002141 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_base_ops_test/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.110 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002531 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/inherit) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.110 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002149 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_test/cpuset_memory_test.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.110 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000254a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/open) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.110 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002148 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_test/cpuset_memory_testset.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.110 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002346 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/runtest.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.110 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000254e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sysctl) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.111 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000213d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_exclusive_test/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.111 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002132 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/meminfo.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.111 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002145 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_pressure_test/cpuset_memory_pressure_testset.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.111 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000255e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execshare) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.111 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022cb (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/cpuinfo.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.111 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022e0 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_test/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.111 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002282 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_task_create.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.111 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022de (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_pressure_test/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.111 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002521 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sem) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.111 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002146 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_pressure_test/cpuset_memory_pressure.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.111 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022d4 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_exclusive_test/cpuset_exclusive_test.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.111 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002527 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/exectrace) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.111 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021d3 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/regression/memcg_regression_test.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.111 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021d4 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/regression/memcg_test_2.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.111 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000023e8 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/regression/memcg_test_4.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.112 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021d5 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/regression/memcg_test_1.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.112 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002529 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setattr) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.112 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002536 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setscheduler) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.112 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021d8 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/functional/memcg_function_test.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.112 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021d6 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/functional/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.112 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021d2 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/regression/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.112 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021d1 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/regression/memcg_test_4.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.112 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021d7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/functional/memcg_getpagesize.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.112 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002540 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setpgid) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.112 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000255c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/link) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.112 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002377 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/Makefile.inc) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.112 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002538 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/mkdir) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.112 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002558 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sigkill) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.113 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000023eb (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/functional/memcg_process.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.113 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.113 INFO:tasks.workunit.client.0.smithi099.stdout:6/130: symlink d14/d18/d1a/d1b/d22/l27 0 2024-01-31T05:13:09.113 INFO:tasks.workunit.client.0.smithi099.stdout:6/131: stat f12 0 2024-01-31T05:13:09.116 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002562 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/fdreceive) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.116 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002554 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/readlink) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.116 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000253e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrace) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.117 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000251f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_file) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.117 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000252f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execute_no_trans) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.117 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002523 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/shm) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.117 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002544 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.117 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002533 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.117 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002546 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getpgid) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.117 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002568 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/rxdir) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.117 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002550 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/domain_trans) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.117 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002564 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setnice) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.117 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002535 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.117 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002552 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/wait) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.117 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002548 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/entrypoint) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.117 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002525 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/rename) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.117 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002560 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getscheduler) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.118 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000256a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getsid) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.118 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002556 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/msg) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.118 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000255a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ioctl) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.118 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000251d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/relabel) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.118 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000254c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrans) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.118 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000252d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_create) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.118 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000252b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ptrace) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.118 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000253a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setnice) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.118 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000230c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_task_getsched.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.118 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000228e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_mkdir.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.118 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000230d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_capable_net.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.118 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002305 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_sysctl.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.118 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002300 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_fdreceive.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.118 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002303 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/TODO) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.118 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002542 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.118 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000230b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_dyntrace.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.119 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002289 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_ioctl.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.119 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000228a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_task_setsched.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.119 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002306 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_dyntrans.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.119 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002292 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_task_getpgid.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.119 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002291 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_execute_no_trans.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.119 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002295 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_file.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.119 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002290 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_stat.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.119 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000228c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_readlink.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.119 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002288 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_ipc.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.119 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002302 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_open.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.119 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002285 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_task_setpgid.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.119 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002293 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_capable_sys.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.119 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000230a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_global.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.119 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000241e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.119 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002296 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.120 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002287 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_link.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.120 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000228b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_capable_file.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.120 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002310 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_rxdir.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.120 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000228f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_ptrace.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.120 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002299 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_bounds.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.120 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002309 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_exectrace.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.120 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002301 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_sigkill.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.120 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002294 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_execshare.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.120 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002297 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_wait.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.120 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022ff (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_policy.fc) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.120 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000230f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_task_create.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.120 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002286 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_setnice.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.121 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002308 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_setattr.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.121 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002307 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_transition.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.121 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002304 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_relabel.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.121 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000230e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_task_getsid.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.121 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002298 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_entrypoint.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.121 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000241d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_rename.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.121 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002311 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_inherit.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.121 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000224c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/policy/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.121 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000224b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/policy/measure.policy) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.121 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000224e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/ima_boot_aggregate.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.121 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002411 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/ima_measure.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.121 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000228d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_policy.if) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.121 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000240e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/policy/measure.policy-invalid) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.121 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000224f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.121 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002250 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/ima_mmap.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.122 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002413 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/tests/ima_policy.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.122 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000253c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/stat) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.122 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002254 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/tests/ima_violations.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.122 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002252 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/tests/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.122 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002251 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/tests/ima_measurements.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.122 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002253 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/tests/ima_tpm.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.122 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002255 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/tests/ima_setup.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.122 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002371 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/bounds/selinux_bounds.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.122 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002567 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/bounds/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.122 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002372 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/bounds/selinux_bounds_thread.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.122 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002532 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/inherit/selinux_inherit_parent.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.122 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000232c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/inherit/selinux_inherit_child.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.122 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000232b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/inherit/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.122 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000232a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/inherit/selinux_inherit.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.123 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002352 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/open/selinux_append2write.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.123 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000254b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/open/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.123 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002350 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/open/selinux_fopen.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.123 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002351 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/open/selinux_open.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.123 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000254f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sysctl/selinux_sysctl.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.123 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002355 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sysctl/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.123 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002367 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execshare/selinux_execshare_parent.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.123 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002366 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execshare/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.123 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000255f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execshare/selinux_execshare_child.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.123 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002368 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execshare/selinux_execshare.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.123 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002320 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/exectrace/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.123 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002322 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/exectrace/selinux_exectrace_parent.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.123 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002528 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/exectrace/selinux_exectrace.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.123 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002321 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/exectrace/selinux_exectrace_child.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.124 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002522 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sem/selinux_semget.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.124 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002317 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sem/selinux_getinfo.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.124 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002318 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sem/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.124 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002316 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sem/selinux_sem.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.124 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000231a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sem/selinux_semctl.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.124 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002319 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sem/selinux_semop.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.124 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000255d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/link/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.124 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002365 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/link/selinux_link.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.124 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002323 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setattr/selinux_setattr.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.124 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000252a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setattr/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.124 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002337 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setscheduler/selinux_task_setscheduler.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.124 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002537 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setscheduler/selinux_task_setscheduler_source.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.124 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002336 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setscheduler/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.125 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002338 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setscheduler/selinux_task_setscheduler_target.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.125 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002541 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setpgid/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.125 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002342 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setpgid/selinux_task_setpgid_source.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.125 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002341 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setpgid/selinux_task_setpgid.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.125 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002539 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/mkdir/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.125 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002339 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/mkdir/selinux_mkdir.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.125 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002559 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sigkill/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.125 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002361 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sigkill/selinux_sigkill_server.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.125 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002360 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sigkill/selinux_sigkill.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.125 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000236e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/fdreceive/selinux_fdreceive_client.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.125 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002563 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/fdreceive/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.125 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000236d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/fdreceive/selinux_fdreceive.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.125 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000236c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/fdreceive/selinux_fdreceive_server.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.125 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000233e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrace/selinux_dyntrace_parent.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.125 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000235a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/readlink/selinux_readlink.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.126 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002555 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/readlink/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.126 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002314 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_file/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.126 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002520 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_file/selinux_lease.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.126 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002530 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execute_no_trans/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.126 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002329 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execute_no_trans/selinux_execute_no_trans.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.126 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000233f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrace/selinux_dyntrace.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.126 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002340 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrace/selinux_dyntrace_child.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.126 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000253f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrace/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.126 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002315 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_file/selinux_capable_file.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.126 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000231c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/shm/selinux_shmget.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.126 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000231b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/shm/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.126 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002524 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/shm/selinux_shmctl.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.126 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002545 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_chroot.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.126 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002348 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.126 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002349 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_rawio.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.127 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000234a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_nice.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.127 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000234b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_hostname.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.127 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000231d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/shm/selinux_shm.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.127 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002347 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_capable_sys.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.127 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000232e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_mmap.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.127 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002334 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_file.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.127 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002534 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_fcntl.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.127 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002333 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_mprotect.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.128 INFO:tasks.workunit.client.0.smithi099.stdout:3/107: mknod d10/c2a 0 2024-01-31T05:13:09.128 INFO:tasks.workunit.client.0.smithi099.stdout:3/108: write f0 [2225814,116305] 0 2024-01-31T05:13:09.130 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:09.130 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:09.130 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.130 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:09.130 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.131 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.131 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:09.131 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.131 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:09.131 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.131 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:09.131 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.131 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:09.131 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:09.131 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.131 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.131 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:09.131 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.131 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:09.131 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:09.132 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.132 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:09.132 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.132 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:09.132 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.132 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:09.132 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:09.132 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.132 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.132 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.132 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:09.132 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000217a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.132 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f8d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/Makefile.inc) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.132 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002172 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.132 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002178 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/libclone) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.133 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002174 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.133 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f4a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/container_test.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.133 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f49 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.133 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f53 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/README) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.133 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f7e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/crtchild_delchild.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.133 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:09.133 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002171 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/TEST_PLAN.txt) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.133 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f7f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/runallnetworktests_parent.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.133 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f7b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/child_1.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.133 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f83 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/sysfsview.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.133 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f5d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns01.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.133 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f66 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns20.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.133 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f86 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/rename_net.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.133 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f6c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/parent_view.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.134 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f64 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns03.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.134 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f68 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns05.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.134 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f8a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/ch_ftp.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.134 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f7d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/childns.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.134 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f60 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns17.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.134 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f76 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/parent_share.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.134 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f67 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns16.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.134 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f6d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/parentns.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.134 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f78 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.134 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f65 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns04.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.134 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f5a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns06.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.134 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f75 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/parent.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.134 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f62 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns31.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.134 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f74 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/parent_2.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.134 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f5e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/Makefile) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.135 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f6f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/paripv6.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.135 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f5c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns10.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.135 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f69 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns30.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.135 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f87 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/create_container.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.135 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f5f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/runpidnstest.sh) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.135 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f72 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/readme) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.135 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002177 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns02.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.135 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f63 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/README) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.135 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f71 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/par_chld_ipv6.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.135 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f61 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns13.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.135 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f7a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/child_2.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.135 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f5b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns12.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.135 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.135 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f70 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/common.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.135 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f6e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/two_children_ns.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.136 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f84 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/par_chld_ftp.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.136 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f82 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/par_ftp.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.136 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f81 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/nw_under_ns.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.136 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000217b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/delchild.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.136 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:09.136 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f8b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/container_ftp.pl) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.136 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f80 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/initialize.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.136 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f79 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/runnetnstest.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.136 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f77 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/parent_1.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.136 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f88 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/childipv6.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.136 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021cb (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/test_controllers.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.136 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f7c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/child.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.136 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f73 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/check_netns_enabled.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.137 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f85 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/runallnetworktests_child.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.137 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021fa (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/Makefile.inc) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.137 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f89 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/crtchild.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.137 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000023e2 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.137 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f52 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/semtest_2ns.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.137 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022c7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memctl) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.137 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f8c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/child_propagate.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.137 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022c9 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.137 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f51 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/runipcnstest.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.137 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f4d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/shmnstest.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.137 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002173 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/mesgq_nstest.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.137 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022e1 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl_fj) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.137 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f4c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/runtests_noltp.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.137 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f4e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.137 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000214a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.138 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f50 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/sem_nstest.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.138 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f4f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/check_ipcns_enabled.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.138 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022c6 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/testplan.txt) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.138 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002179 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/libclone/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.138 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f4b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/shmem_2nstest.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.138 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000023e6 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.138 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f6a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/libclone/libclone.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.138 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f6b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/libclone/libclone.h) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.138 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022e3 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.138 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f59 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns/mqns_01.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.138 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002175 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns/runmqnstest.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.138 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f58 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns/mqns_04.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.138 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000023e0 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.138 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f56 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns/mqns_02.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.139 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f57 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns/mqns.h) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.139 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021c1 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/README) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.139 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f55 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.139 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f54 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns/mqns_03.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.139 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000023e4 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuacct) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.139 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002416 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.139 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000023f2 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.139 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000023f0 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/libcontrollers) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.139 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002415 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.139 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000023ee (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.139 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021c9 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/cgroup_fj_proc.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.139 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002407 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.139 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021c4 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/cgroup_fj_utility.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.139 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021c6 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/cgroup_fj_release_agent) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.140 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021c5 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.140 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021c7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/cgroup_fj_testcases) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.140 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000240b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.140 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021c8 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/README) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.140 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021ca (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/cgroup_fj_function2.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.140 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021c3 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/cgroup_fj_function.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.140 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000256c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/tomoyo) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.140 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000023e3 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/run_cgroup_test_fj.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.140 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021c2 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/cgroup_fj_stress.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.140 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002127 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memctl/memctl_testplan.txt) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.140 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022c8 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memctl/memctl_test01.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.140 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002129 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memctl/myfunctions.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.140 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002125 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memctl/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.140 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002126 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memctl/README) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.141 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002418 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.141 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002128 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memctl/run_memctl_test.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.141 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022ce (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_hotplug_test) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.141 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002570 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.141 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022d5 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_spread_test) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.141 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022db (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_inherit_test) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.141 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002409 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/p9auth) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.141 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002147 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/Makefile.inc) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.141 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000256e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.141 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022d7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_hierarchy_test) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.141 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022cc (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_syscall_test) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.141 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000216f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/utsname) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.141 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022d0 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.141 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002143 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_funcs.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.142 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002176 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.142 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022d1 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_load_balance_test) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.142 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022ca (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.142 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002258 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/exec_with_inh.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.142 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002142 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/run_cpuset_test.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.142 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000225b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/cap_bset_inh_bounds.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.142 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022d9 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_base_ops_test) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.142 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002257 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.142 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000213c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/README) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.142 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002417 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/exec_without_inh.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.142 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022df (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_test) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.142 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000225d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/cap_bounds_r.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.142 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022d3 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_exclusive_test) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.142 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000225c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/check_pe.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.143 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022dd (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_pressure_test) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.143 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002256 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/cap_bounds_rw.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.143 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000214d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl_fj/run_cpuctl_test_fj.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.143 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000225a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/check_for_libcap.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.143 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000214b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl_fj/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.143 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000214c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl_fj/README) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.143 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000214e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl_fj/cpuctl_fj_cpu-hog.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.143 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002259 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/run_capbounds.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.143 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000225e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/dummy.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.143 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022e2 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl_fj/cpuctl_fj_simple_echo.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.143 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000223b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_onlycap.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.143 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002241 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/notroot.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.143 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000023e9 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.143 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002243 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_load.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.143 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000223e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_doi.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.144 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002246 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_cipso.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.144 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000023e7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/regression) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.144 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000223d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_file_access.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.144 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021d9 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/README) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.144 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002245 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_netlabel.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.144 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000223a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_ambient.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.144 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000223c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_direct.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.144 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000223f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.144 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000023ea (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/functional) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.144 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002244 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_socket_labels.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.144 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002159 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/getdelays.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.144 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002157 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_10_2.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.144 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002240 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_common.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.144 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002242 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/README) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.145 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002153 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_10_1.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.145 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002408 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_current.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.145 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002154 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_6_2.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.145 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000240c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.145 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002414 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.145 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000237c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/tomoyo/newns.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.145 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000237b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/tomoyo/tomoyo_file_test.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.145 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000237a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/tomoyo/testall.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.145 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002152 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.145 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022e4 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_9_2.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.145 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002156 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_6_1.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.145 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000214f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/fork_processes.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.145 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002151 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_3_1.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.145 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000256d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/tomoyo/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.145 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000237d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/tomoyo/include.h) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.146 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000215a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/cgroup_regression_test.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.146 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002150 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_3_2.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.146 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002155 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/README) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.146 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021c0 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_def_task01.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.146 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000215c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/parameters.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.146 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002158 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_9_1.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.146 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021be (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_latency_check_task.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.146 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002419 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.146 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002379 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/tomoyo/README) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.146 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002378 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/ChangeLog) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.146 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000023ec (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/stress) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.146 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000215d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_def_task04.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.146 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021ba (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/run_cpuctl_test.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.146 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021bd (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/run_cpuctl_stress_test.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.147 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000251c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.147 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021b5 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_test02.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.147 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021bb (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_test04.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.147 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021b7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_testplan.txt) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.147 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000241b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.147 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021b8 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_def_task03.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.147 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021b6 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.147 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002312 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/README) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.147 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000023e1 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_test03.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.147 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000241c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.147 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000215b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_latency_test.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.147 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002386 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/ask_password.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.147 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000238c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/remove_password.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.147 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021bf (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_def_task02.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.148 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002571 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/change_password.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.148 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002387 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/LICENSE) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.148 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021bc (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/README) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.148 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002388 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.148 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000215e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/run_cpuctl_latency_test.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.148 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021b9 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_test01.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.148 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000238b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/force_erase.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.148 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021cc (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuacct/run_cpuacct_test.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.148 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021ce (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuacct/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.148 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000238a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/AUTHORS) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.148 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002248 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/p9auth/p9unpriv.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.148 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021cd (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuacct/cpuacct_task01.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.148 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000224a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/p9auth/unhex.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.148 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000023e5 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuacct/cpuacct_setup.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.149 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021cf (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuacct/README) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.149 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002249 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/p9auth/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.149 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021d0 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuacct/cpuacct_testplan.txt) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.149 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000240a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/p9auth/p9priv.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.149 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021f5 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.149 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002247 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/p9auth/runp9auth.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.149 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000023f3 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/io_throttle_testplan.txt) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.149 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000237e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/verify_caps_exec.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.149 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021f7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/README) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.149 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021f9 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/iobw.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.149 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002382 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/check_simple_capset.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.149 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002385 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/inh_capped.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.149 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021f4 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/libcontrollers/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.149 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000023f1 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/libcontrollers/libcontrollers.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.150 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002384 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/checkforfilecaps.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.150 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021f3 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/libcontrollers/libcontrollers.h) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.150 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002380 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.150 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021e0 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/freeze_move_thaw.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.150 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021e9 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/TODO) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.150 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002383 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/README) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.150 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021e1 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/write_freezing.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.150 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000256f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/print_caps.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.150 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021dc (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/run_freezer.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.150 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021df (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/CHANGELOG) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.150 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002381 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/filecapstest.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.150 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021ee (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/libcgroup_freezer) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.150 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021da (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/stress/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.150 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021e7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/timed_forkbomb.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.150 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000023ed (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/stress/memcg_stress_test.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.151 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021eb (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/freeze_self_thaw.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.151 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021e3 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/stop_freeze_thaw_cont.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.151 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021db (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/stress/memcg_process_stress.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.151 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021ec (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/fork_exec_loop.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.151 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021dd (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/vfork.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.151 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021e5 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.151 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000240d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/policy) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.151 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021ed (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/freeze_thaw.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.151 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021f6 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/run_io_throttle_test.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.151 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002389 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/README) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.151 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021f8 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/myfunctions-io.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.151 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021e6 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/freeze_sleep_thaw.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.151 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000238d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/assign_password.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.151 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000237f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/checkforlibcap.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.152 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021de (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/00_description.txt) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.152 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002410 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.152 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021f1 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/freeze_kill_thaw.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.152 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002412 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/tests) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.152 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021ef (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/vfork_freeze.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.152 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000224d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/README) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.152 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021e4 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/libltp) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.152 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000227f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_task_getsched.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.152 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021f0 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/freeze_cancel.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.152 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002267 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_mkdir.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.152 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002280 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_capable_net.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.152 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021e8 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/README) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.152 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002274 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_fdreceive.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.152 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021e2 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/fork_freeze.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.153 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000227e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_dyntrace.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.153 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021ea (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/stop_freeze_sleep_thaw_cont.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.153 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002278 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_sysctl.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.153 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000023ef (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/COPYING) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.153 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002263 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_ioctl.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.153 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021f2 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/freeze_write_freezing.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.153 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022cf (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_hotplug_test/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.153 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002136 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_hotplug_test/cpuset_hotplug_test.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.153 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002279 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_dyntrans.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.153 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002137 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_hotplug_test/cpuset_list_compute.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.153 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000226b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_task_getpgid.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.153 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000213f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_spread_test/cpuset_memory_spread_testset.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.153 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002264 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_task_setsched.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.153 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022d6 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_spread_test/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.154 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000226f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_file.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.154 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002144 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_inherit_test/cpuset_inherit_testset.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.154 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000240f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.154 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002266 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_readlink.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.154 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022d8 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_hierarchy_test/cpuset_hierarchy_test.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.154 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022dc (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_inherit_test/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.154 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000226a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_execute_no_trans.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.154 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002140 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_hierarchy_test/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.154 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002269 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_stat.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.154 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002134 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_syscall_test/cpuset_syscall_test.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.154 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002276 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_open.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.154 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022cd (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_syscall_test/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.154 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000226c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_attrib.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.154 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002262 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_ipc.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.154 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000225f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_task_setpgid.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.155 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000213b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_load_balance_test/cpuset_cpu_hog.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.155 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000226d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_capable_sys.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.155 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022d2 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_load_balance_test/cpuset_sched_domains_check.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.155 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002270 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.155 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000213a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_load_balance_test/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.155 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002139 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_load_balance_test/cpuset_load_balance_test.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.155 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002283 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_rxdir.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.155 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000227d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_global.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.155 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002261 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_link.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.155 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000212f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/meminfo.h) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.155 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002130 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/libbitmask.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.155 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002268 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_ptrace.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.155 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000213e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_spread_test/cpuset_mem_hog.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.155 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002265 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_capable_file.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.156 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000227c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_exectrace.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.156 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000212a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.156 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000226e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_execshare.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.156 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000212c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/libcpuset.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.156 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002260 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_setnice.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.156 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000227b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_setattr.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.156 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002275 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_sigkill.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.156 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002271 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_wait.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.156 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000227a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_transition.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.156 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002138 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_load_balance_test/cpuset_sched_domains_test.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.156 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002281 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_task_getsid.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.156 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000212d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/cpuinfo.h) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.156 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002273 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_socket.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.156 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000212e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/cpuset_funcs.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.157 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002277 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_relabel.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.157 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000241a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_rename.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.157 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002135 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_syscall_test/cpuset_syscall_testset.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.157 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000212b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/bitmask.h) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.157 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002133 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/cpuset.h) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.157 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022da (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_base_ops_test/cpuset_base_ops_testset.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.157 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002284 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_inherit.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.157 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002131 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/common.h) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.157 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002566 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/bounds) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.157 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002272 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_entrypoint.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.157 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002141 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_base_ops_test/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.157 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002531 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/inherit) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.157 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002149 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_test/cpuset_memory_test.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.157 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000254a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/open) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.158 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002148 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_test/cpuset_memory_testset.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.158 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002346 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/runtest.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.158 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000254e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sysctl) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.158 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000213d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_exclusive_test/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.158 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002132 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/meminfo.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.158 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002145 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_pressure_test/cpuset_memory_pressure_testset.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.158 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000255e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execshare) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.158 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022cb (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/cpuinfo.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.158 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022e0 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_test/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.158 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002282 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_task_create.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.158 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022de (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_pressure_test/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.158 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002521 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sem) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.158 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002146 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_pressure_test/cpuset_memory_pressure.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.158 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022d4 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_exclusive_test/cpuset_exclusive_test.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.158 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002527 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/exectrace) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.159 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021d3 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/regression/memcg_regression_test.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.159 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021d4 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/regression/memcg_test_2.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.159 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000023e8 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/regression/memcg_test_4.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.159 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021d5 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/regression/memcg_test_1.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.159 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002529 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setattr) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.159 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002536 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setscheduler) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.159 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021d8 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/functional/memcg_function_test.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.159 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021d6 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/functional/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.159 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021d2 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/regression/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.159 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021d1 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/regression/memcg_test_4.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.159 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021d7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/functional/memcg_getpagesize.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.159 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002540 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setpgid) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.159 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000255c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/link) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.159 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002377 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/Makefile.inc) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.160 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002538 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/mkdir) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.160 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002558 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sigkill) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.160 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000023eb (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/functional/memcg_process.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.160 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.160 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002562 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/fdreceive) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.160 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002554 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/readlink) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.160 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000253e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrace) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.160 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000251f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_file) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.160 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000252f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execute_no_trans) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.160 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002523 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/shm) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.160 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002544 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.160 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002533 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.160 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002546 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getpgid) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.160 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002568 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/rxdir) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.161 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002550 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/domain_trans) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.161 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002564 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setnice) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.161 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002535 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.161 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002552 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/wait) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.161 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002548 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/entrypoint) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.161 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002525 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/rename) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.161 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002560 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getscheduler) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.161 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000256a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getsid) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.161 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002556 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/msg) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.161 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000255a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ioctl) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.161 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000251d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/relabel) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.161 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000254c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrans) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.161 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000252d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_create) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.161 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000252b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ptrace) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.161 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000253a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setnice) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.162 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000230c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_task_getsched.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.162 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000228e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_mkdir.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.162 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000230d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_capable_net.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.162 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002305 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_sysctl.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.162 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002300 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_fdreceive.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.162 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002303 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/TODO) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.162 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002542 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.162 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000230b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_dyntrace.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.162 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002289 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_ioctl.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.162 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000228a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_task_setsched.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.162 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002306 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_dyntrans.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.162 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002292 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_task_getpgid.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.162 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002291 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_execute_no_trans.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.162 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002295 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_file.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.162 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002290 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_stat.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.162 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000228c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_readlink.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.163 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002288 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_ipc.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.163 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002302 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_open.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.163 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002285 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_task_setpgid.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.163 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002293 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_capable_sys.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.163 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000230a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_global.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.163 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000241e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.163 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002296 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.163 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002287 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_link.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.163 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000228b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_capable_file.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.163 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002310 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_rxdir.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.163 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000228f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_ptrace.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.163 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002299 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_bounds.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.163 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002309 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_exectrace.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.163 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002301 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_sigkill.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.164 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002294 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_execshare.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.164 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002297 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_wait.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.164 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022ff (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_policy.fc) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.164 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000230f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_task_create.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.164 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002286 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_setnice.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.164 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002308 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_setattr.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.164 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002307 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_transition.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.164 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002304 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_relabel.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.164 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000230e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_task_getsid.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.164 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002298 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_entrypoint.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.164 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000241d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_rename.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.164 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002311 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_inherit.te) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.164 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000224c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/policy/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.164 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000224b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/policy/measure.policy) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.164 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000224e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/ima_boot_aggregate.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.165 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002411 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/ima_measure.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.165 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000228d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_policy.if) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.165 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000240e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/policy/measure.policy-invalid) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.165 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000224f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.165 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002250 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/ima_mmap.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.165 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002413 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/tests/ima_policy.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.165 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000253c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/stat) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.165 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002254 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/tests/ima_violations.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.165 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002252 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/tests/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.165 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002251 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/tests/ima_measurements.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.165 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002253 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/tests/ima_tpm.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.165 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002255 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/tests/ima_setup.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.165 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002371 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/bounds/selinux_bounds.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.165 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002567 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/bounds/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.165 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002372 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/bounds/selinux_bounds_thread.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.165 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002532 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/inherit/selinux_inherit_parent.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.166 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000232c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/inherit/selinux_inherit_child.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.166 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000232b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/inherit/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.166 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000232a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/inherit/selinux_inherit.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.166 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002352 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/open/selinux_append2write.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.166 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000254b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/open/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.166 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002350 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/open/selinux_fopen.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.166 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002351 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/open/selinux_open.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.166 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000254f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sysctl/selinux_sysctl.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.166 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002355 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sysctl/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.166 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002367 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execshare/selinux_execshare_parent.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.166 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002366 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execshare/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.166 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000255f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execshare/selinux_execshare_child.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.166 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002368 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execshare/selinux_execshare.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.167 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002320 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/exectrace/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.167 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002322 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/exectrace/selinux_exectrace_parent.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.167 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002528 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/exectrace/selinux_exectrace.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.167 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002321 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/exectrace/selinux_exectrace_child.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.167 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002522 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sem/selinux_semget.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.167 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002317 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sem/selinux_getinfo.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.167 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002318 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sem/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.167 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002316 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sem/selinux_sem.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.167 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000231a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sem/selinux_semctl.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.167 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002319 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sem/selinux_semop.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.167 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000255d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/link/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.167 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002365 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/link/selinux_link.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.167 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002323 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setattr/selinux_setattr.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.167 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000252a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setattr/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.167 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002337 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setscheduler/selinux_task_setscheduler.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.168 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002537 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setscheduler/selinux_task_setscheduler_source.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.168 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002336 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setscheduler/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.168 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002338 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setscheduler/selinux_task_setscheduler_target.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.168 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002541 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setpgid/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.168 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002342 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setpgid/selinux_task_setpgid_source.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.168 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002341 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setpgid/selinux_task_setpgid.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.168 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002539 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/mkdir/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.168 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002339 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/mkdir/selinux_mkdir.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.168 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002559 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sigkill/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.168 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002361 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sigkill/selinux_sigkill_server.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.168 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002360 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sigkill/selinux_sigkill.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.168 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000236e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/fdreceive/selinux_fdreceive_client.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.168 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002563 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/fdreceive/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.169 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000236d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/fdreceive/selinux_fdreceive.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.169 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000236c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/fdreceive/selinux_fdreceive_server.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.169 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000233e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrace/selinux_dyntrace_parent.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.169 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000235a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/readlink/selinux_readlink.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.169 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002555 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/readlink/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.169 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002314 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_file/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.169 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002520 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_file/selinux_lease.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.169 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002530 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execute_no_trans/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.169 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002329 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execute_no_trans/selinux_execute_no_trans.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.169 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000233f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrace/selinux_dyntrace.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.169 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002340 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrace/selinux_dyntrace_child.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.169 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000253f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrace/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.169 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002315 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_file/selinux_capable_file.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.169 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000231c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/shm/selinux_shmget.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.169 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000231b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/shm/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.170 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002524 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/shm/selinux_shmctl.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.170 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002545 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_chroot.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.170 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002348 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.170 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002349 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_rawio.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.170 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000234a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_nice.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.170 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000234b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_hostname.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.170 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000231d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/shm/selinux_shm.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.170 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002347 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_capable_sys.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.170 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000232e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_mmap.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.170 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002334 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_file.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.170 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002534 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_fcntl.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.170 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002333 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_mprotect.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.170 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000232d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_wait_io.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.171 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000232f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.171 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002332 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_sigiotask.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.171 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002330 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_seek.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.171 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002331 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_lock.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.171 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002335 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_nofcntl.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.171 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000234d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getpgid/selinux_task_getpgid_target.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.171 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000234c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getpgid/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.171 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000231e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/shm/selinux_shmat.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.171 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000234e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getpgid/selinux_task_getpgid_source.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.171 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000027c9 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getpgid/selinux_task_getpgid.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.171 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002551 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/domain_trans/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.171 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002569 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/rxdir/selinux_rxdir.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.171 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002373 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/rxdir/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.171 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002356 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/domain_trans/selinux_domain_trans.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.171 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002370 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setnice/selinux_task_setnice.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.172 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002565 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setnice/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.172 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000236f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setnice/selinux_task_setnice_target.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.172 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002358 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/wait/selinux_wait_child.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.172 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002553 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/wait/selinux_wait_parent.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.172 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002357 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/wait/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.172 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002359 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/wait/selinux_wait.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.172 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000234f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/entrypoint/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.172 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002549 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/entrypoint/selinux_entrypoint.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.172 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002375 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getsid/selinux_task_getsid.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.172 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002374 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getsid/selinux_task_getsid_source.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.172 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000231f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/rename/selinux_rename.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.172 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002376 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getsid/selinux_task_getsid_target.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.172 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000236a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getscheduler/selinux_task_getscheduler.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.172 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002561 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getscheduler/selinux_task_getscheduler_target.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.173 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000256b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getsid/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.173 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002369 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getscheduler/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.173 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000236b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getscheduler/selinux_task_getscheduler_source.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.173 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002363 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ioctl/selinux_noioctl.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.173 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002557 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/msg/selinux_msg.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.173 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002526 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/rename/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.173 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000235e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/msg/selinux_msgsnd.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.173 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000235c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/msg/selinux_msgctl.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.173 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002362 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ioctl/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.173 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000255b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ioctl/selinux_ioctl.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.173 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000235f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/msg/selinux_msgget.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.173 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000235d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/msg/selinux_msgrcv.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.173 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000235b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/msg/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.173 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002543 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/selinux_capable_net.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.174 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002343 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.174 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000251e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/relabel/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.174 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002344 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/selinux_bind.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.174 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002364 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ioctl/selinux_ioctl.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.174 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002354 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrans/selinux_dyntrans.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.174 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002345 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/selinux_raw.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.174 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002353 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrans/selinux_dyntrans_parent.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.174 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002313 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/relabel/selinux_relabel.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.174 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000254d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrans/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.174 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002327 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_create/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.174 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002328 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_create/selinux_task_create_parent.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.174 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000252e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_create/selinux_task_create.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.174 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000252c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ptrace/selinux_ptrace.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.174 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002325 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ptrace/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.174 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002324 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ptrace/selinux_ptrace.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.175 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002326 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ptrace/selinux_ptrace_wait.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.175 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000233c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setnice/selinux_setnice.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.175 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000233a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setnice/selinux_setnice_parent.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.175 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000233b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setnice/selinux_setnice_child.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.175 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000253b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setnice/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.175 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:09.175 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022ee (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_fdreceive.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.175 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022a3 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_mkdir.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.175 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022fa (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_capable_net.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.175 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022f9 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_task_getsched.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.175 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022f2 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_sysctl.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.175 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022f8 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_dyntrace.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.175 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000229e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_ioctl.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.176 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000229f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_task_setsched.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.176 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022f3 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_dyntrans.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.176 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022ea (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_file.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.176 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022a1 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_readlink.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.176 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022e6 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_execute_no_trans.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.176 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022e7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_task_getpgid.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.176 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022f0 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_open.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.176 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022e5 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_stat.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.176 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000229d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_ipc.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.176 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022e8 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_capable_sys.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.176 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000229a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_task_setpgid.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.176 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022f7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_global.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.176 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022fd (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_rxdir.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.176 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022eb (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/Makefile) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.176 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000229c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_link.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.177 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022a0 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_capable_file.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.177 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022ef (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_sigkill.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.177 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022e9 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_execshare.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.177 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022a4 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_ptrace.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.177 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022ec (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_wait.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.177 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022fc (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_task_create.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.177 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000229b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_setnice.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.177 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022f5 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_setattr.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.177 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022f1 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_relabel.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.177 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022f4 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_transition.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.177 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022fb (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_task_getsid.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.177 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002420 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_rename.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.177 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022a2 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_policy.if) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.177 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022fe (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_inherit.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.178 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022ed (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_entrypoint.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.178 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000241f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.178 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.178 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022f6 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_exectrace.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.178 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.178 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:09.178 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.178 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:09.178 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.178 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:09.178 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001bd9 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/plan.txt) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.178 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001d9e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.178 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001bd8 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/run.sh) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.178 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001d9b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/coverage.txt) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.179 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001bd2 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/Makefile) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.179 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001bd3 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/assertions.xml) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.179 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001d9c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.179 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001bd7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers/twoptimers.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.179 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001bd6 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers/twoevtimers.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.179 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001bd5 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks/invaliddates.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.179 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001d9d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks/Makefile) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.179 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001d9f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers/Makefile) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.179 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001bd4 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks/twopsetclock.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.179 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.179 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:09.179 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002112 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/acpi/LtpAcpiMain.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.179 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002116 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/acpi/ltpacpi.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.179 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022b6 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/acpi/LtpAcpi.h) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.179 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002113 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/acpi/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.180 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002115 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/acpi/README) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.180 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002114 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/acpi/LtpAcpiCmds.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.180 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.180 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:09.180 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001dfb (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/quota_remount/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.180 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000203f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/quota_remount/quota_remount_test01.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.180 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:08 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.180 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000232d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_wait_io.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.180 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000232f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.180 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002332 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_sigiotask.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.181 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002330 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_seek.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.181 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002331 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_lock.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.181 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002335 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_nofcntl.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.181 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000234d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getpgid/selinux_task_getpgid_target.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.181 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000234c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getpgid/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.181 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000231e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/shm/selinux_shmat.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.181 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000234e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getpgid/selinux_task_getpgid_source.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.181 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000027c9 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getpgid/selinux_task_getpgid.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.181 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002551 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/domain_trans/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.181 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002569 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/rxdir/selinux_rxdir.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.181 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002373 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/rxdir/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.181 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002356 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/domain_trans/selinux_domain_trans.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.181 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002370 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setnice/selinux_task_setnice.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.182 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002565 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setnice/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.182 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000236f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setnice/selinux_task_setnice_target.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.182 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002358 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/wait/selinux_wait_child.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.182 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002553 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/wait/selinux_wait_parent.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.182 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002357 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/wait/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.182 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002359 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/wait/selinux_wait.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.182 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000234f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/entrypoint/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.182 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002549 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/entrypoint/selinux_entrypoint.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.182 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002375 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getsid/selinux_task_getsid.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.182 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002374 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getsid/selinux_task_getsid_source.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.182 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000231f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/rename/selinux_rename.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.182 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002376 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getsid/selinux_task_getsid_target.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.182 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000236a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getscheduler/selinux_task_getscheduler.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.182 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002561 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getscheduler/selinux_task_getscheduler_target.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.183 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000256b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getsid/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.183 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002369 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getscheduler/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.183 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000236b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getscheduler/selinux_task_getscheduler_source.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.183 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002363 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ioctl/selinux_noioctl.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.183 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002557 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/msg/selinux_msg.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.183 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002526 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/rename/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.183 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000235e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/msg/selinux_msgsnd.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.183 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000235c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/msg/selinux_msgctl.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.183 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002362 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ioctl/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.183 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000255b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ioctl/selinux_ioctl.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.183 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000235f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/msg/selinux_msgget.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.183 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000235d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/msg/selinux_msgrcv.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.183 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000235b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/msg/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.183 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002543 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/selinux_capable_net.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.184 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002343 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.184 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000251e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/relabel/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.184 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002344 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/selinux_bind.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.184 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002364 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ioctl/selinux_ioctl.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.184 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002354 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrans/selinux_dyntrans.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.184 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002345 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/selinux_raw.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.184 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002353 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrans/selinux_dyntrans_parent.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.184 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002313 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/relabel/selinux_relabel.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.184 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000254d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrans/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.184 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002327 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_create/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.184 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002328 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_create/selinux_task_create_parent.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.184 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000252e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_create/selinux_task_create.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.184 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000252c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ptrace/selinux_ptrace.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.184 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002325 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ptrace/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.184 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002324 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ptrace/selinux_ptrace.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.185 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002326 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ptrace/selinux_ptrace_wait.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.185 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000233c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setnice/selinux_setnice.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.185 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000233a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setnice/selinux_setnice_parent.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.185 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000233b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setnice/selinux_setnice_child.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.185 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000253b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setnice/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.185 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:09.185 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022ee (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_fdreceive.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.185 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022a3 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_mkdir.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.185 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022fa (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_capable_net.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.185 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022f9 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_task_getsched.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.185 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022f2 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_sysctl.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.185 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022f8 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_dyntrace.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.185 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000229e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_ioctl.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.185 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000229f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_task_setsched.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.185 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022f3 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_dyntrans.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.186 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022ea (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_file.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.186 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022a1 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_readlink.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.186 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022e6 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_execute_no_trans.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.186 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022e7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_task_getpgid.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.186 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022f0 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_open.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.186 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022e5 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_stat.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.186 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000229d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_ipc.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.186 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022e8 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_capable_sys.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.186 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000229a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_task_setpgid.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.186 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022f7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_global.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.186 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022fd (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_rxdir.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.186 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022eb (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/Makefile) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.186 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000229c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_link.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.186 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022a0 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_capable_file.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.186 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022ef (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_sigkill.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.187 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022e9 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_execshare.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.187 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022a4 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_ptrace.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.187 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022ec (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_wait.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.187 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022fc (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_task_create.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.187 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000229b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_setnice.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.187 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022f5 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_setattr.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.187 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022f1 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_relabel.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.187 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022f4 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_transition.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.187 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022fb (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_task_getsid.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.187 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002420 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_rename.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.187 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022a2 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_policy.if) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.187 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022fe (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_inherit.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.187 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022ed (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_entrypoint.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.187 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000241f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5) see mds.c log and `damage ls` output for details 2024-01-31T05:13:09.187 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.188 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022f6 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_exectrace.te) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.188 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.188 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:09.188 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.188 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:09.188 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.188 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:09.188 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001bd9 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/plan.txt) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.188 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001d9e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.188 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001bd8 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/run.sh) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.188 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001d9b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/coverage.txt) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.188 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001bd2 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/Makefile) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.188 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001bd3 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/assertions.xml) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.189 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001d9c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.189 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001bd7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers/twoptimers.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.189 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001bd6 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers/twoevtimers.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.189 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001bd5 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks/invaliddates.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.189 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001d9d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks/Makefile) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.189 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001d9f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers/Makefile) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.189 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001bd4 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks/twopsetclock.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:09.189 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.189 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:09.189 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002112 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/acpi/LtpAcpiMain.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.189 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002116 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/acpi/ltpacpi.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.189 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022b6 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/acpi/LtpAcpi.h) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.189 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002113 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/acpi/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.189 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002115 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/acpi/README) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.190 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002114 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/acpi/LtpAcpiCmds.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.190 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.190 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:09.190 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001dfb (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/quota_remount/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.190 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000203f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/quota_remount/quota_remount_test01.sh) see mds.i log and `damage ls` output for details 2024-01-31T05:13:09.190 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:08 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:09.193 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:08.877+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000246d [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/access/access03.c auth v16 ap=1 s=13453 n(v0 rc2009-03-23T13:35:39.000000+0000 b13453 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d451180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000246d:[<0x100000026d4/access03.c v4>,<0x10000002572/access v1554>,<0x10000001eda/syscalls v874>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000246d:[<0x100000026d4/access03.c v16>,<0x10000002572/access v1554>,<0x10000001eda/syscalls v1573>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:09.194 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:08.878+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000246f [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/access/Makefile auth v22 ap=1 s=915 n(v0 rc2009-10-09T17:55:52.000000+0000 b915 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d450680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000246f:[<0x100000026d4/Makefile v8>,<0x10000002572/access v1554>,<0x10000001eda/syscalls v874>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000246f:[<0x100000026d4/Makefile v22>,<0x10000002572/access v1554>,<0x10000001eda/syscalls v1573>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:09.194 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:08.878+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000026d5 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/access/access02.c auth v20 ap=1 s=12054 n(v0 rc2024-01-31T05:12:57.928565+0000 b12054 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d450c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000026d5:[<0x100000026d4/access02.c v2>,<0x10000002572/access v1554>,<0x10000001eda/syscalls v874>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000026d5:[<0x100000026d4/access02.c v20>,<0x10000002572/access v1554>,<0x10000001eda/syscalls v1573>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:09.194 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:08.878+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002470 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/access/access01.c auth v18 ap=1 s=8440 n(v0 rc2009-11-09T05:56:58.000000+0000 b8440 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d451700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002470:[<0x100000026d4/access01.c v10>,<0x10000002572/access v1554>,<0x10000001eda/syscalls v874>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002470:[<0x100000026d4/access01.c v18>,<0x10000002572/access v1554>,<0x10000001eda/syscalls v1573>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:09.194 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:08.878+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002471 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/access/access05.c auth v14 ap=1 s=10697 n(v0 rc2009-08-28T10:46:41.000000+0000 b10697 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d460000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002471:[<0x100000026d4/access05.c v12>,<0x10000002572/access v1554>,<0x10000001eda/syscalls v874>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002471:[<0x100000026d4/access05.c v14>,<0x10000002572/access v1554>,<0x10000001eda/syscalls v1573>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:09.194 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:08 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:08.878+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000246e [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/access/access04.c auth v24 ap=1 s=6532 n(v0 rc2009-08-28T10:46:41.000000+0000 b6532 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d460580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000246e:[<0x100000026d4/access04.c v6>,<0x10000002572/access v1554>,<0x10000001eda/syscalls v874>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000246e:[<0x100000026d4/access04.c v24>,<0x10000002572/access v1554>,<0x10000001eda/syscalls v1573>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:09.194 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:09.011+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ebe [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/stress.c auth v16 ap=1 s=7809 n(v0 rc2024-01-31T05:12:55.981609+0000 b7809 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d410580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ebe:[<0x10000001ebd/stress.c v2>,<0x10000001db9/pthread_exit v76>,<0x10000001db0/threads v80>,<0x100000012a8/stress v108>,<0x10000000204/open_posix_testsuite v502>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001ebe:[<0x10000001ebd/stress.c v16>,<0x10000001db9/pthread_exit v76>,<0x10000001db0/threads v91>,<0x100000012a8/stress v143>,<0x10000000204/open_posix_testsuite v879>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:09.194 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:09.011+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001c83 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/threads_scenarii.c auth v28 ap=1 s=14832 n(v0 rc2005-06-03T16:37:09.000000+0000 b14832 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d410000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001c83:[<0x10000001ebd/threads_scenarii.c v14>,<0x10000001db9/pthread_exit v76>,<0x10000001db0/threads v80>,<0x100000012a8/stress v108>,<0x10000000204/open_posix_testsuite v502>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001c83:[<0x10000001ebd/threads_scenarii.c v28>,<0x10000001db9/pthread_exit v76>,<0x10000001db0/threads v91>,<0x100000012a8/stress v143>,<0x10000000204/open_posix_testsuite v879>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:09.194 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:09.012+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001c80 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/testfrmw.h auth v18 ap=1 s=2420 n(v0 rc2005-06-03T16:37:09.000000+0000 b2420 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d410b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001c80:[<0x10000001ebd/testfrmw.h v8>,<0x10000001db9/pthread_exit v76>,<0x10000001db0/threads v80>,<0x100000012a8/stress v108>,<0x10000000204/open_posix_testsuite v502>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001c80:[<0x10000001ebd/testfrmw.h v18>,<0x10000001db9/pthread_exit v76>,<0x10000001db0/threads v91>,<0x100000012a8/stress v143>,<0x10000000204/open_posix_testsuite v879>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:09.194 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:09.012+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001c7e [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/Makefile auth v26 ap=1 s=372 n(v0 rc2005-06-03T16:37:09.000000+0000 b372 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d411080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001c7e:[<0x10000001ebd/Makefile v4>,<0x10000001db9/pthread_exit v76>,<0x10000001db0/threads v80>,<0x100000012a8/stress v108>,<0x10000000204/open_posix_testsuite v502>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001c7e:[<0x10000001ebd/Makefile v26>,<0x10000001db9/pthread_exit v76>,<0x10000001db0/threads v91>,<0x100000012a8/stress v143>,<0x10000000204/open_posix_testsuite v879>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:09.194 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:09.012+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001c82 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/LICENCE auth v24 ap=1 s=17992 n(v0 rc2005-06-03T16:37:09.000000+0000 b17992 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d411b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001c82:[<0x10000001ebd/LICENCE v12>,<0x10000001db9/pthread_exit v76>,<0x10000001db0/threads v80>,<0x100000012a8/stress v108>,<0x10000000204/open_posix_testsuite v502>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001c82:[<0x10000001ebd/LICENCE v24>,<0x10000001db9/pthread_exit v76>,<0x10000001db0/threads v91>,<0x100000012a8/stress v143>,<0x10000000204/open_posix_testsuite v879>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:09.194 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:09.012+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001c81 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/NOTES auth v20 ap=1 s=1813 n(v0 rc2005-06-03T16:37:09.000000+0000 b1813 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d411600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001c81:[<0x10000001ebd/NOTES v10>,<0x10000001db9/pthread_exit v76>,<0x10000001db0/threads v80>,<0x100000012a8/stress v108>,<0x10000000204/open_posix_testsuite v502>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001c81:[<0x10000001ebd/NOTES v20>,<0x10000001db9/pthread_exit v76>,<0x10000001db0/threads v91>,<0x100000012a8/stress v143>,<0x10000000204/open_posix_testsuite v879>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:09.194 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:09.012+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001c7f [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/testfrmw.c auth v22 ap=1 s=2106 n(v0 rc2005-06-03T16:37:09.000000+0000 b2106 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d412100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001c7f:[<0x10000001ebd/testfrmw.c v6>,<0x10000001db9/pthread_exit v76>,<0x10000001db0/threads v80>,<0x100000012a8/stress v108>,<0x10000000204/open_posix_testsuite v502>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001c7f:[<0x10000001ebd/testfrmw.c v22>,<0x10000001db9/pthread_exit v76>,<0x10000001db0/threads v91>,<0x100000012a8/stress v143>,<0x10000000204/open_posix_testsuite v879>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:09.197 INFO:tasks.workunit.client.0.smithi099.stdout:6/132: symlink d14/d18/l28 0 2024-01-31T05:13:09.198 INFO:tasks.workunit.client.0.smithi099.stdout:0/120: write d1/d16/f17 [879642,23913] 0 2024-01-31T05:13:09.198 INFO:tasks.workunit.client.0.smithi099.stdout:0/121: write d1/f4 [2100367,49923] 0 2024-01-31T05:13:09.198 INFO:tasks.workunit.client.0.smithi099.stdout:0/122: chown d1/d8/df/f1b 119026763 1 2024-01-31T05:13:09.198 INFO:tasks.workunit.client.0.smithi099.stdout:3/109: creat d10/d1e/f2b x:0 0 0 2024-01-31T05:13:09.198 INFO:tasks.workunit.client.0.smithi099.stdout:3/110: truncate d10/d1e/f2b 341784 0 2024-01-31T05:13:09.198 INFO:tasks.workunit.client.0.smithi099.stdout:6/133: mkdir d14/d18/d1a/d1c/d29 0 2024-01-31T05:13:09.198 INFO:tasks.workunit.client.0.smithi099.stdout:0/123: truncate d1/d8/df/f12 1396024 0 2024-01-31T05:13:09.198 INFO:tasks.workunit.client.0.smithi099.stdout:0/124: chown d1/d16 14586 1 2024-01-31T05:13:09.198 INFO:tasks.workunit.client.0.smithi099.stdout:2/125: write f1 [3891284,125860] 0 2024-01-31T05:13:09.198 INFO:tasks.workunit.client.0.smithi099.stdout:1/106: dwrite d4/f6 [4194304,4194304] 0 2024-01-31T05:13:09.198 INFO:tasks.workunit.client.0.smithi099.stdout:1/107: fdatasync d4/dc/d15/f1a 0 2024-01-31T05:13:09.198 INFO:tasks.workunit.client.0.smithi099.stdout:5/176: write f4 [742796,9677] 0 2024-01-31T05:13:09.198 INFO:tasks.workunit.client.0.smithi099.stdout:6/134: mknod d14/d18/d1a/d1c/d29/c2a 0 2024-01-31T05:13:09.198 INFO:tasks.workunit.client.0.smithi099.stdout:2/126: fdatasync d10/f19 0 2024-01-31T05:13:09.199 INFO:tasks.workunit.client.0.smithi099.stdout:2/127: dread - d10/d1c/f26 zero size 2024-01-31T05:13:09.199 INFO:tasks.workunit.client.0.smithi099.stdout:1/108: mknod d4/db/c1e 0 2024-01-31T05:13:09.199 INFO:tasks.workunit.client.0.smithi099.stdout:7/102: sync 2024-01-31T05:13:09.199 INFO:tasks.workunit.client.0.smithi099.stdout:7/103: chown d6/d12/f17 14 1 2024-01-31T05:13:09.199 INFO:tasks.workunit.client.0.smithi099.stdout:2/128: mkdir d10/d2b 0 2024-01-31T05:13:09.199 INFO:tasks.workunit.client.0.smithi099.stdout:7/104: creat d6/f20 x:0 0 0 2024-01-31T05:13:09.199 INFO:tasks.workunit.client.0.smithi099.stdout:7/105: mknod d6/d1e/c21 0 2024-01-31T05:13:09.199 INFO:tasks.workunit.client.0.smithi099.stdout:7/106: truncate d6/f1f 827012 0 2024-01-31T05:13:09.199 INFO:tasks.workunit.client.0.smithi099.stdout:6/135: getdents d14/d18/d1a/d1c 0 2024-01-31T05:13:09.199 INFO:tasks.workunit.client.0.smithi099.stdout:3/111: dwrite d10/d18/f1d [0,4194304] 0 2024-01-31T05:13:09.199 INFO:tasks.workunit.client.0.smithi099.stdout:3/112: creat d10/d18/f2c x:0 0 0 2024-01-31T05:13:09.199 INFO:tasks.workunit.client.0.smithi099.stdout:0/125: write d1/d8/df/f12 [2052708,57443] 0 2024-01-31T05:13:09.199 INFO:tasks.workunit.client.0.smithi099.stdout:0/126: write d1/f9 [3191851,29925] 0 2024-01-31T05:13:09.199 INFO:tasks.workunit.client.0.smithi099.stdout:0/127: fsync d1/d16/f18 0 2024-01-31T05:13:09.199 INFO:tasks.workunit.client.0.smithi099.stdout:1/109: dread d4/f6 [4194304,4194304] 0 2024-01-31T05:13:09.200 INFO:tasks.workunit.client.0.smithi099.stdout:0/128: fdatasync d1/d16/f1c 0 2024-01-31T05:13:09.200 INFO:tasks.workunit.client.0.smithi099.stdout:3/113: write fa [126262,35239] 0 2024-01-31T05:13:09.200 INFO:tasks.workunit.client.0.smithi099.stdout:5/177: dwrite d6/d1e/d1f/f22 [4194304,4194304] 0 2024-01-31T05:13:09.200 INFO:tasks.workunit.client.0.smithi099.stdout:3/114: mkdir d10/d24/d2d 0 2024-01-31T05:13:09.200 INFO:tasks.workunit.client.0.smithi099.stdout:3/115: stat d10/d24 0 2024-01-31T05:13:09.200 INFO:tasks.workunit.client.0.smithi099.stdout:0/129: dread d1/d16/f17 [0,4194304] 0 2024-01-31T05:13:09.200 INFO:tasks.workunit.client.0.smithi099.stdout:7/107: dwrite d6/d12/f1a [0,4194304] 0 2024-01-31T05:13:09.200 INFO:tasks.workunit.client.0.smithi099.stdout:7/108: dread d6/f1f [0,4194304] 0 2024-01-31T05:13:09.200 INFO:tasks.workunit.client.0.smithi099.stdout:7/109: fdatasync d6/f11 0 2024-01-31T05:13:09.200 INFO:tasks.workunit.client.0.smithi099.stdout:7/110: fsync f3 0 2024-01-31T05:13:09.200 INFO:tasks.workunit.client.0.smithi099.stdout:7/111: write d6/ff [1267606,111492] 0 2024-01-31T05:13:09.200 INFO:tasks.workunit.client.0.smithi099.stdout:3/116: dread d10/d18/f1d [0,4194304] 0 2024-01-31T05:13:09.200 INFO:tasks.workunit.client.0.smithi099.stdout:5/178: dwrite f4 [0,4194304] 0 2024-01-31T05:13:09.200 INFO:tasks.workunit.client.0.smithi099.stdout:7/112: rename d6/f15 to d6/d12/f22 0 2024-01-31T05:13:09.200 INFO:tasks.workunit.client.0.smithi099.stdout:5/179: mknod d6/d1e/d35/c38 0 2024-01-31T05:13:09.200 INFO:tasks.workunit.client.0.smithi099.stdout:3/117: creat d10/d27/f2e x:0 0 0 2024-01-31T05:13:09.201 INFO:tasks.workunit.client.0.smithi099.stdout:5/180: write d6/da/f19 [750701,7929] 0 2024-01-31T05:13:09.201 INFO:tasks.workunit.client.0.smithi099.stdout:5/181: rmdir d6/da/d14/d2b 39 2024-01-31T05:13:09.201 INFO:tasks.workunit.client.0.smithi099.stdout:5/182: fdatasync d6/f11 0 2024-01-31T05:13:09.201 INFO:tasks.workunit.client.0.smithi099.stdout:5/183: mknod d6/da/c39 0 2024-01-31T05:13:09.201 INFO:tasks.workunit.client.0.smithi099.stdout:5/184: truncate f1 2941513 0 2024-01-31T05:13:09.201 INFO:tasks.workunit.client.0.smithi099.stdout:5/185: fdatasync d6/f18 0 2024-01-31T05:13:09.201 INFO:tasks.workunit.client.0.smithi099.stdout:5/186: truncate d6/ff 1602706 0 2024-01-31T05:13:09.201 INFO:tasks.workunit.client.0.smithi099.stdout:0/130: dwrite d1/f4 [0,4194304] 0 2024-01-31T05:13:09.201 INFO:tasks.workunit.client.0.smithi099.stdout:0/131: chown d1/d8/df/f10 84 1 2024-01-31T05:13:09.201 INFO:tasks.workunit.client.0.smithi099.stdout:0/132: mknod d1/c27 0 2024-01-31T05:13:09.201 INFO:tasks.workunit.client.0.smithi099.stdout:0/133: rename d1/d8/df/l23 to d1/l28 0 2024-01-31T05:13:09.201 INFO:tasks.workunit.client.0.smithi099.stdout:0/134: unlink d1/d8/df/f12 0 2024-01-31T05:13:09.201 INFO:tasks.workunit.client.0.smithi099.stdout:0/135: creat d1/d8/df/f29 x:0 0 0 2024-01-31T05:13:09.201 INFO:tasks.workunit.client.0.smithi099.stdout:0/136: unlink d1/d8/df/f10 0 2024-01-31T05:13:09.201 INFO:tasks.workunit.client.0.smithi099.stdout:0/137: dread - d1/d8/df/f1b zero size 2024-01-31T05:13:09.202 INFO:tasks.workunit.client.0.smithi099.stdout:0/138: creat d1/f2a x:0 0 0 2024-01-31T05:13:09.202 INFO:tasks.workunit.client.0.smithi099.stdout:5/187: dread f4 [0,4194304] 0 2024-01-31T05:13:09.202 INFO:tasks.workunit.client.0.smithi099.stdout:3/118: dread f0 [0,4194304] 0 2024-01-31T05:13:09.202 INFO:tasks.workunit.client.0.smithi099.stdout:3/119: truncate d10/f1b 416695 0 2024-01-31T05:13:09.202 INFO:tasks.workunit.client.0.smithi099.stdout:3/120: write d10/f16 [926039,128847] 0 2024-01-31T05:13:09.202 INFO:tasks.workunit.client.0.smithi099.stdout:3/121: fsync d10/d18/f26 0 2024-01-31T05:13:09.202 INFO:tasks.workunit.client.0.smithi099.stdout:3/122: rename d10/d24 to d10/d24/d2d/d2f 22 2024-01-31T05:13:09.202 INFO:tasks.workunit.client.0.smithi099.stdout:0/139: rmdir d1/d8/df 39 2024-01-31T05:13:09.202 INFO:tasks.workunit.client.0.smithi099.stdout:7/113: dwrite f3 [0,4194304] 0 2024-01-31T05:13:09.202 INFO:tasks.workunit.client.0.smithi099.stdout:7/114: dread - d6/d12/f17 zero size 2024-01-31T05:13:09.205 INFO:tasks.workunit.client.0.smithi099.stdout:7/115: write d6/d12/f1a [2476622,68654] 0 2024-01-31T05:13:09.207 INFO:tasks.workunit.client.0.smithi099.stdout:0/140: dwrite d1/d8/df/f1b [0,4194304] 0 2024-01-31T05:13:09.207 INFO:tasks.workunit.client.0.smithi099.stdout:0/141: dread - d1/d8/df/f29 zero size 2024-01-31T05:13:09.207 INFO:tasks.workunit.client.0.smithi099.stdout:7/116: creat d6/d13/f23 x:0 0 0 2024-01-31T05:13:09.210 INFO:tasks.workunit.client.0.smithi099.stdout:0/142: symlink d1/d22/l2b 0 2024-01-31T05:13:09.215 INFO:tasks.workunit.client.0.smithi099.stdout:5/188: dwrite f4 [4194304,4194304] 0 2024-01-31T05:13:09.215 INFO:tasks.workunit.client.0.smithi099.stdout:3/123: dwrite d10/f1b [0,4194304] 0 2024-01-31T05:13:09.222 INFO:tasks.workunit.client.0.smithi099.stdout:5/189: rename d6/da/d14/d2b/f2e to d6/d1e/d1f/f3a 0 2024-01-31T05:13:09.225 INFO:tasks.workunit.client.0.smithi099.stdout:0/143: link d1/f4 d1/f2c 0 2024-01-31T05:13:09.228 INFO:tasks.workunit.client.0.smithi099.stdout:7/117: dwrite d6/f20 [0,4194304] 0 2024-01-31T05:13:09.228 INFO:tasks.workunit.client.0.smithi099.stdout:7/118: dread - d6/d12/f22 zero size 2024-01-31T05:13:09.228 INFO:tasks.workunit.client.0.smithi099.stdout:7/119: chown d6/d1e/c21 26 1 2024-01-31T05:13:09.230 INFO:tasks.workunit.client.0.smithi099.stdout:5/190: rmdir d6/da/d2f 0 2024-01-31T05:13:09.232 INFO:tasks.workunit.client.0.smithi099.stdout:7/120: mknod d6/d13/c24 0 2024-01-31T05:13:09.232 INFO:tasks.workunit.client.0.smithi099.stdout:7/121: write d6/f1f [1217861,53801] 0 2024-01-31T05:13:09.233 INFO:tasks.workunit.client.0.smithi099.stdout:7/122: mkdir d6/d1e/d25 0 2024-01-31T05:13:09.238 INFO:tasks.workunit.client.0.smithi099.stdout:5/191: read d6/f13 [1445835,55489] 0 2024-01-31T05:13:09.238 INFO:tasks.workunit.client.0.smithi099.stdout:0/144: dread d1/d16/f1c [0,4194304] 0 2024-01-31T05:13:09.239 INFO:tasks.workunit.client.0.smithi099.stdout:5/192: creat d6/da/d14/f3b x:0 0 0 2024-01-31T05:13:09.239 INFO:tasks.workunit.client.0.smithi099.stdout:5/193: read - d6/d1e/d1f/f3a zero size 2024-01-31T05:13:09.239 INFO:tasks.workunit.client.0.smithi099.stdout:5/194: truncate d6/da/d14/f20 4020910 0 2024-01-31T05:13:09.240 INFO:tasks.workunit.client.0.smithi099.stdout:5/195: unlink d6/da/d14/l28 0 2024-01-31T05:13:09.241 INFO:tasks.workunit.client.0.smithi099.stdout:3/124: dwrite d10/d1e/f25 [0,4194304] 0 2024-01-31T05:13:09.241 INFO:tasks.workunit.client.0.smithi099.stdout:3/125: getdents d10/d24/d2d 0 2024-01-31T05:13:09.241 INFO:tasks.workunit.client.0.smithi099.stdout:3/126: creat d10/d27/f30 x:0 0 0 2024-01-31T05:13:09.243 INFO:tasks.workunit.client.0.smithi099.stdout:5/196: unlink d6/da/c12 0 2024-01-31T05:13:09.243 INFO:tasks.workunit.client.0.smithi099.stdout:5/197: readlink d6/d1e/d1f/d21/l30 0 2024-01-31T05:13:09.243 INFO:tasks.workunit.client.0.smithi099.stdout:5/198: creat d6/d1e/f3c x:0 0 0 2024-01-31T05:13:09.243 INFO:tasks.workunit.client.0.smithi099.stdout:5/199: getdents d6/da/d34 0 2024-01-31T05:13:09.251 INFO:tasks.workunit.client.0.smithi099.stdout:0/145: write d1/d8/df/f15 [3458595,95830] 0 2024-01-31T05:13:09.251 INFO:tasks.workunit.client.0.smithi099.stdout:3/127: rename d10/d27/f2e to d10/d27/f31 0 2024-01-31T05:13:09.251 INFO:tasks.workunit.client.0.smithi099.stdout:5/200: dread f1 [0,4194304] 0 2024-01-31T05:13:09.252 INFO:tasks.workunit.client.0.smithi099.stdout:7/123: dread f3 [0,4194304] 0 2024-01-31T05:13:09.254 INFO:tasks.workunit.client.0.smithi099.stdout:0/146: mknod d1/d16/c2d 0 2024-01-31T05:13:09.255 INFO:tasks.workunit.client.0.smithi099.stdout:3/128: mkdir d10/d32 0 2024-01-31T05:13:09.255 INFO:tasks.workunit.client.0.smithi099.stdout:3/129: fsync d10/d18/f26 0 2024-01-31T05:13:09.255 INFO:tasks.workunit.client.0.smithi099.stdout:3/130: chown d10/d1e/f25 7361 1 2024-01-31T05:13:09.256 INFO:tasks.workunit.client.0.smithi099.stdout:3/131: dread d10/d1e/f2b [0,4194304] 0 2024-01-31T05:13:09.256 INFO:tasks.workunit.client.0.smithi099.stdout:3/132: chown d10/d18/f2c 25439932 1 2024-01-31T05:13:09.256 INFO:tasks.workunit.client.0.smithi099.stdout:5/201: mkdir d6/da/d14/d3d 0 2024-01-31T05:13:09.257 INFO:tasks.workunit.client.0.smithi099.stdout:7/124: mknod d6/d13/c26 0 2024-01-31T05:13:09.259 INFO:tasks.workunit.client.0.smithi099.stdout:3/133: rename d10/d24/d2d to d10/d32/d33 0 2024-01-31T05:13:09.259 INFO:tasks.workunit.client.0.smithi099.stdout:3/134: chown d10/d18/c1a 25239 1 2024-01-31T05:13:09.260 INFO:tasks.workunit.client.0.smithi099.stdout:3/135: mkdir d10/d27/d34 0 2024-01-31T05:13:09.261 INFO:tasks.workunit.client.0.smithi099.stdout:3/136: rmdir d10/d32 39 2024-01-31T05:13:09.266 INFO:tasks.workunit.client.0.smithi099.stdout:0/147: dread d1/d8/df/f1d [0,4194304] 0 2024-01-31T05:13:09.268 INFO:tasks.workunit.client.0.smithi099.stdout:0/148: mkdir d1/d8/df/d2e 0 2024-01-31T05:13:09.269 INFO:tasks.workunit.client.0.smithi099.stdout:4/167: sync 2024-01-31T05:13:09.269 INFO:tasks.workunit.client.0.smithi099.stdout:8/199: sync 2024-01-31T05:13:09.269 INFO:tasks.workunit.client.0.smithi099.stdout:9/130: sync 2024-01-31T05:13:09.269 INFO:tasks.workunit.client.0.smithi099.stdout:9/131: dread - d0/d7/f28 zero size 2024-01-31T05:13:09.269 INFO:tasks.workunit.client.0.smithi099.stdout:9/132: stat d0/c22 0 2024-01-31T05:13:09.271 INFO:tasks.workunit.client.0.smithi099.stdout:4/168: truncate d0/d8/d19/f1c 1939226 0 2024-01-31T05:13:09.272 INFO:tasks.workunit.client.0.smithi099.stdout:8/200: mkdir d1/dd/d11/d29/d3a 0 2024-01-31T05:13:09.273 INFO:tasks.workunit.client.0.smithi099.stdout:8/201: chown d1/dd/d11/d19/f36 15 1 2024-01-31T05:13:09.273 INFO:tasks.workunit.client.0.smithi099.stdout:8/202: chown d1/dd/d1d 66096656 1 2024-01-31T05:13:09.274 INFO:tasks.workunit.client.0.smithi099.stdout:9/133: rename d0/d1/c9 to d0/d7/c2d 0 2024-01-31T05:13:09.275 INFO:tasks.workunit.client.0.smithi099.stdout:3/137: write d10/d18/f26 [7499770,5945] 0 2024-01-31T05:13:09.275 INFO:tasks.workunit.client.0.smithi099.stdout:3/138: stat d10/d27/f30 0 2024-01-31T05:13:09.275 INFO:tasks.workunit.client.0.smithi099.stdout:4/169: mkdir d0/d2/d20/d21/d17/d24/d3f 0 2024-01-31T05:13:09.276 INFO:tasks.workunit.client.0.smithi099.stdout:4/170: dread - d0/d2/d20/d21/d17/f37 zero size 2024-01-31T05:13:09.277 INFO:tasks.workunit.client.0.smithi099.stdout:3/139: creat d10/d24/f35 x:0 0 0 2024-01-31T05:13:09.277 INFO:tasks.workunit.client.0.smithi099.stdout:7/125: dwrite d6/fc [0,4194304] 0 2024-01-31T05:13:09.279 INFO:tasks.workunit.client.0.smithi099.stdout:4/171: mknod d0/d2/c40 0 2024-01-31T05:13:09.279 INFO:tasks.workunit.client.0.smithi099.stdout:4/172: write d0/d2/d20/d21/d17/f37 [345454,114765] 0 2024-01-31T05:13:09.280 INFO:tasks.workunit.client.0.smithi099.stdout:4/173: read d0/fd [3743016,116941] 0 2024-01-31T05:13:09.280 INFO:tasks.workunit.client.0.smithi099.stdout:4/174: readlink d0/l9 0 2024-01-31T05:13:09.280 INFO:tasks.workunit.client.0.smithi099.stdout:4/175: readlink d0/d1e/l33 0 2024-01-31T05:13:09.287 INFO:tasks.workunit.client.0.smithi099.stdout:4/176: creat d0/d2/d20/d21/d17/d3d/f41 x:0 0 0 2024-01-31T05:13:09.291 INFO:tasks.workunit.client.0.smithi099.stdout:4/177: link d0/d2/lb d0/d1e/l42 0 2024-01-31T05:13:09.291 INFO:tasks.workunit.client.0.smithi099.stdout:4/178: chown d0/l9 2613 1 2024-01-31T05:13:09.292 INFO:tasks.workunit.client.0.smithi099.stdout:0/149: dwrite d1/d8/df/f1d [0,4194304] 0 2024-01-31T05:13:09.292 INFO:tasks.workunit.client.0.smithi099.stdout:0/150: creat d1/d16/f2f x:0 0 0 2024-01-31T05:13:09.293 INFO:tasks.workunit.client.0.smithi099.stdout:4/179: truncate d0/d8/d19/f2d 140760 0 2024-01-31T05:13:09.293 INFO:tasks.workunit.client.0.smithi099.stdout:4/180: fsync d0/d2/f15 0 2024-01-31T05:13:09.294 INFO:tasks.workunit.client.0.smithi099.stdout:8/203: write d1/dd/d11/d19/d21/f2c [573006,18415] 0 2024-01-31T05:13:09.294 INFO:tasks.workunit.client.0.smithi099.stdout:8/204: truncate d1/dd/d15/f27 1923192 0 2024-01-31T05:13:09.298 INFO:tasks.workunit.client.0.smithi099.stdout:3/140: dwrite d10/d18/f2c [0,4194304] 0 2024-01-31T05:13:09.298 INFO:tasks.workunit.client.0.smithi099.stdout:3/141: truncate d10/d24/f35 220049 0 2024-01-31T05:13:09.298 INFO:tasks.workunit.client.0.smithi099.stdout:3/142: dread - d10/d27/f31 zero size 2024-01-31T05:13:09.302 INFO:tasks.workunit.client.0.smithi099.stdout:8/205: creat d1/dd/d15/f3b x:0 0 0 2024-01-31T05:13:09.302 INFO:tasks.workunit.client.0.smithi099.stdout:2/129: sync 2024-01-31T05:13:09.304 INFO:tasks.workunit.client.0.smithi099.stdout:3/143: creat d10/d32/f36 x:0 0 0 2024-01-31T05:13:09.306 INFO:tasks.workunit.client.0.smithi099.stdout:0/151: mkdir d1/d30 0 2024-01-31T05:13:09.306 INFO:tasks.workunit.client.0.smithi099.stdout:0/152: creat d1/d16/f31 x:0 0 0 2024-01-31T05:13:09.306 INFO:tasks.workunit.client.0.smithi099.stdout:4/181: dread d0/d8/d19/f1c [0,4194304] 0 2024-01-31T05:13:09.307 INFO:tasks.workunit.client.0.smithi099.stdout:9/134: dwrite d0/d1/fe [0,4194304] 0 2024-01-31T05:13:09.308 INFO:tasks.workunit.client.0.smithi099.stdout:3/144: dread d10/f23 [0,4194304] 0 2024-01-31T05:13:09.315 INFO:tasks.workunit.client.0.smithi099.stdout:8/206: write d1/dd/d11/d19/f1c [4041331,1072] 0 2024-01-31T05:13:09.315 INFO:tasks.workunit.client.0.smithi099.stdout:7/126: dwrite d6/d13/f1b [0,4194304] 0 2024-01-31T05:13:09.317 INFO:tasks.workunit.client.0.smithi099.stdout:0/153: creat d1/d8/df/f32 x:0 0 0 2024-01-31T05:13:09.317 INFO:tasks.workunit.client.0.smithi099.stdout:8/207: dread d1/dd/ff [0,4194304] 0 2024-01-31T05:13:09.317 INFO:tasks.workunit.client.0.smithi099.stdout:8/208: fsync d1/dd/d11/f32 0 2024-01-31T05:13:09.317 INFO:tasks.workunit.client.0.smithi099.stdout:8/209: stat d1/dd/d11/d19 0 2024-01-31T05:13:09.318 INFO:tasks.workunit.client.0.smithi099.stdout:8/210: read d1/f10 [725231,113532] 0 2024-01-31T05:13:09.319 INFO:tasks.workunit.client.0.smithi099.stdout:2/130: symlink d10/d20/l2c 0 2024-01-31T05:13:09.319 INFO:tasks.workunit.client.0.smithi099.stdout:2/131: truncate d10/d1c/f26 55028 0 2024-01-31T05:13:09.319 INFO:tasks.workunit.client.0.smithi099.stdout:2/132: creat d10/d1c/f2d x:0 0 0 2024-01-31T05:13:09.320 INFO:tasks.workunit.client.0.smithi099.stdout:4/182: mkdir d0/d2/d20/d21/d17/d24/d3f/d43 0 2024-01-31T05:13:09.326 INFO:tasks.workunit.client.0.smithi099.stdout:9/135: rename d0/d1/d24/d27 to d0/d7/d2e 0 2024-01-31T05:13:09.327 INFO:tasks.workunit.client.0.smithi099.stdout:3/145: mknod d10/d32/c37 0 2024-01-31T05:13:09.333 INFO:tasks.workunit.client.0.smithi099.stdout:8/211: mkdir d1/dd/d11/d19/d21/d3c 0 2024-01-31T05:13:09.333 INFO:tasks.workunit.client.0.smithi099.stdout:8/212: read d1/dd/d11/d19/f1c [2033092,59479] 0 2024-01-31T05:13:09.333 INFO:tasks.workunit.client.0.smithi099.stdout:8/213: creat d1/dd/d15/f3d x:0 0 0 2024-01-31T05:13:09.335 INFO:tasks.workunit.client.0.smithi099.stdout:8/214: dread d1/dd/ff [0,4194304] 0 2024-01-31T05:13:09.336 INFO:tasks.workunit.client.0.smithi099.stdout:2/133: truncate f4 1630205 0 2024-01-31T05:13:09.337 INFO:tasks.workunit.client.0.smithi099.stdout:4/183: write d0/d8/f11 [601837,95842] 0 2024-01-31T05:13:09.337 INFO:tasks.workunit.client.0.smithi099.stdout:4/184: creat d0/d8/d19/f44 x:0 0 0 2024-01-31T05:13:09.337 INFO:tasks.workunit.client.0.smithi099.stdout:9/136: dread d0/d7/f23 [0,4194304] 0 2024-01-31T05:13:09.344 INFO:tasks.workunit.client.0.smithi099.stdout:7/127: rmdir d6/d12 39 2024-01-31T05:13:09.347 INFO:tasks.workunit.client.0.smithi099.stdout:8/215: creat d1/dd/d11/d20/f3e x:0 0 0 2024-01-31T05:13:09.347 INFO:tasks.workunit.client.0.smithi099.stdout:8/216: chown d1/cb 5642449 1 2024-01-31T05:13:09.350 INFO:tasks.workunit.client.0.smithi099.stdout:4/185: symlink d0/d8/d19/l45 0 2024-01-31T05:13:09.350 INFO:tasks.workunit.client.0.smithi099.stdout:4/186: stat d0/d2/d20/l3a 0 2024-01-31T05:13:09.352 INFO:tasks.workunit.client.0.smithi099.stdout:9/137: symlink d0/d7/d2e/l2f 0 2024-01-31T05:13:09.352 INFO:tasks.workunit.client.0.smithi099.stdout:9/138: write d0/d1/d24/d2b/f17 [1172174,128087] 0 2024-01-31T05:13:09.353 INFO:tasks.workunit.client.0.smithi099.stdout:3/146: getdents d10/d27 0 2024-01-31T05:13:09.355 INFO:tasks.workunit.client.0.smithi099.stdout:7/128: rmdir d6/d12 39 2024-01-31T05:13:09.356 INFO:tasks.workunit.client.0.smithi099.stdout:7/129: truncate d6/d12/f22 433538 0 2024-01-31T05:13:09.356 INFO:tasks.workunit.client.0.smithi099.stdout:7/130: write d6/d13/f23 [535366,10085] 0 2024-01-31T05:13:09.358 INFO:tasks.workunit.client.0.smithi099.stdout:7/131: rename d6/l18 to d6/d13/l27 0 2024-01-31T05:13:09.361 INFO:tasks.workunit.client.0.smithi099.stdout:2/134: dwrite d10/d1c/f26 [0,4194304] 0 2024-01-31T05:13:09.364 INFO:tasks.workunit.client.0.smithi099.stdout:2/135: rename d10/f28 to d10/d2b/f2e 0 2024-01-31T05:13:09.373 INFO:tasks.workunit.client.0.smithi099.stdout:2/136: link d10/l13 d10/d2b/l2f 0 2024-01-31T05:13:09.376 INFO:tasks.workunit.client.0.smithi099.stdout:2/137: readlink d10/l22 0 2024-01-31T05:13:09.376 INFO:tasks.workunit.client.0.smithi099.stdout:2/138: chown d10/d2b 197971471 1 2024-01-31T05:13:09.379 INFO:tasks.workunit.client.0.smithi099.stdout:2/139: truncate f1 625339 0 2024-01-31T05:13:09.400 INFO:tasks.workunit.client.0.smithi099.stdout:4/187: dwrite d0/d1e/f36 [0,4194304] 0 2024-01-31T05:13:09.400 INFO:tasks.workunit.client.0.smithi099.stdout:4/188: dread - d0/d2/d20/f38 zero size 2024-01-31T05:13:09.407 INFO:tasks.workunit.client.0.smithi099.stdout:8/217: dwrite d1/dd/d11/f31 [0,4194304] 0 2024-01-31T05:13:09.407 INFO:tasks.workunit.client.0.smithi099.stdout:8/218: fsync d1/dd/ff 0 2024-01-31T05:13:09.407 INFO:tasks.workunit.client.0.smithi099.stdout:9/139: dwrite d0/d7/f1f [0,4194304] 0 2024-01-31T05:13:09.407 INFO:tasks.workunit.client.0.smithi099.stdout:3/147: dwrite d10/d18/f26 [4194304,4194304] 0 2024-01-31T05:13:09.407 INFO:tasks.workunit.client.0.smithi099.stdout:7/132: dwrite d6/f20 [4194304,4194304] 0 2024-01-31T05:13:09.407 INFO:tasks.workunit.client.0.smithi099.stdout:7/133: fdatasync f2 0 2024-01-31T05:13:09.408 INFO:tasks.workunit.client.0.smithi099.stdout:2/140: dwrite d10/d1b/f1f [0,4194304] 0 2024-01-31T05:13:09.408 INFO:tasks.workunit.client.0.smithi099.stdout:4/189: dread d0/d8/d19/f1c [0,4194304] 0 2024-01-31T05:13:09.409 INFO:tasks.workunit.client.0.smithi099.stdout:8/219: mkdir d1/dd/d11/d29/d3f 0 2024-01-31T05:13:09.414 INFO:tasks.workunit.client.0.smithi099.stdout:8/220: dread d1/dd/d15/f22 [0,4194304] 0 2024-01-31T05:13:09.414 INFO:tasks.workunit.client.0.smithi099.stdout:8/221: stat d1/dd 0 2024-01-31T05:13:09.414 INFO:tasks.workunit.client.0.smithi099.stdout:3/148: link d10/f16 d10/d24/f38 0 2024-01-31T05:13:09.419 INFO:tasks.workunit.client.0.smithi099.stdout:7/134: dread d6/fc [0,4194304] 0 2024-01-31T05:13:09.422 INFO:tasks.workunit.client.0.smithi099.stdout:4/190: symlink d0/d2/l46 0 2024-01-31T05:13:09.423 INFO:tasks.workunit.client.0.smithi099.stdout:3/149: mknod d10/d32/c39 0 2024-01-31T05:13:09.425 INFO:tasks.workunit.client.0.smithi099.stdout:7/135: mknod d6/d12/c28 0 2024-01-31T05:13:09.425 INFO:tasks.workunit.client.0.smithi099.stdout:7/136: stat d6/d13/f23 0 2024-01-31T05:13:09.425 INFO:tasks.workunit.client.0.smithi099.stdout:9/140: write d0/d7/f1f [1681728,54682] 0 2024-01-31T05:13:09.426 INFO:tasks.workunit.client.0.smithi099.stdout:4/191: creat d0/d2/f47 x:0 0 0 2024-01-31T05:13:09.426 INFO:tasks.workunit.client.0.smithi099.stdout:3/150: symlink d10/l3a 0 2024-01-31T05:13:09.431 INFO:tasks.workunit.client.0.smithi099.stdout:7/137: getdents d6 0 2024-01-31T05:13:09.433 INFO:tasks.workunit.client.0.smithi099.stdout:7/138: creat d6/d1e/d25/f29 x:0 0 0 2024-01-31T05:13:09.436 INFO:tasks.workunit.client.0.smithi099.stdout:1/110: sync 2024-01-31T05:13:09.436 INFO:tasks.workunit.client.0.smithi099.stdout:6/136: sync 2024-01-31T05:13:09.436 INFO:tasks.workunit.client.0.smithi099.stdout:1/111: chown d4/dc 995 1 2024-01-31T05:13:09.436 INFO:tasks.workunit.client.0.smithi099.stdout:6/137: fdatasync f7 0 2024-01-31T05:13:09.438 INFO:tasks.workunit.client.0.smithi099.stdout:1/112: rmdir d4/db 39 2024-01-31T05:13:09.443 INFO:tasks.workunit.client.0.smithi099.stdout:9/141: dread d0/d1/fe [0,4194304] 0 2024-01-31T05:13:09.444 INFO:tasks.workunit.client.0.smithi099.stdout:2/141: dwrite d10/d1c/f26 [0,4194304] 0 2024-01-31T05:13:09.444 INFO:tasks.workunit.client.0.smithi099.stdout:2/142: chown d10/l13 57 1 2024-01-31T05:13:09.444 INFO:tasks.workunit.client.0.smithi099.stdout:2/143: write f1 [1446366,24367] 0 2024-01-31T05:13:09.444 INFO:tasks.workunit.client.0.smithi099.stdout:2/144: chown d10/d1b/c21 8 1 2024-01-31T05:13:09.445 INFO:tasks.workunit.client.0.smithi099.stdout:6/138: dread d14/f15 [0,4194304] 0 2024-01-31T05:13:09.445 INFO:tasks.workunit.client.0.smithi099.stdout:9/142: mknod d0/c30 0 2024-01-31T05:13:09.445 INFO:tasks.workunit.client.0.smithi099.stdout:2/145: mknod d10/d1c/c30 0 2024-01-31T05:13:09.446 INFO:tasks.workunit.client.0.smithi099.stdout:2/146: truncate d10/f2a 796584 0 2024-01-31T05:13:09.447 INFO:tasks.workunit.client.0.smithi099.stdout:1/113: dread d4/dc/d15/f1a [0,4194304] 0 2024-01-31T05:13:09.449 INFO:tasks.workunit.client.0.smithi099.stdout:2/147: rename d10/f19 to d10/f31 0 2024-01-31T05:13:09.449 INFO:tasks.workunit.client.0.smithi099.stdout:2/148: creat d10/d1c/f32 x:0 0 0 2024-01-31T05:13:09.458 INFO:tasks.workunit.client.0.smithi099.stdout:3/151: dwrite f0 [0,4194304] 0 2024-01-31T05:13:09.458 INFO:tasks.workunit.client.0.smithi099.stdout:3/152: stat d10/d1e/f25 0 2024-01-31T05:13:09.458 INFO:tasks.workunit.client.0.smithi099.stdout:3/153: stat d10/d18/f22 0 2024-01-31T05:13:09.459 INFO:tasks.workunit.client.0.smithi099.stdout:6/139: dread f7 [0,4194304] 0 2024-01-31T05:13:09.459 INFO:tasks.workunit.client.0.smithi099.stdout:8/222: dwrite d1/dd/d11/f32 [0,4194304] 0 2024-01-31T05:13:09.459 INFO:tasks.workunit.client.0.smithi099.stdout:6/140: write d14/d18/d1a/f26 [379451,20184] 0 2024-01-31T05:13:09.460 INFO:tasks.workunit.client.0.smithi099.stdout:8/223: creat d1/dd/d1d/f40 x:0 0 0 2024-01-31T05:13:09.464 INFO:tasks.workunit.client.0.smithi099.stdout:8/224: mknod d1/dd/d11/d29/d3f/c41 0 2024-01-31T05:13:09.464 INFO:tasks.workunit.client.0.smithi099.stdout:8/225: dread - d1/dd/d15/f3d zero size 2024-01-31T05:13:09.464 INFO:tasks.workunit.client.0.smithi099.stdout:8/226: chown d1/dd/d1d/f40 1924020 1 2024-01-31T05:13:09.466 INFO:tasks.workunit.client.0.smithi099.stdout:8/227: mknod d1/dd/d11/d19/d21/d3c/c42 0 2024-01-31T05:13:09.466 INFO:tasks.workunit.client.0.smithi099.stdout:7/139: dwrite d6/d13/f1b [0,4194304] 0 2024-01-31T05:13:09.466 INFO:tasks.workunit.client.0.smithi099.stdout:7/140: dread - d6/d12/f1d zero size 2024-01-31T05:13:09.467 INFO:tasks.workunit.client.0.smithi099.stdout:8/228: symlink d1/dd/d11/d29/d3a/l43 0 2024-01-31T05:13:09.470 INFO:tasks.workunit.client.0.smithi099.stdout:3/154: dread d10/d18/f1d [0,4194304] 0 2024-01-31T05:13:09.470 INFO:tasks.workunit.client.0.smithi099.stdout:7/141: mknod d6/d13/c2a 0 2024-01-31T05:13:09.470 INFO:tasks.workunit.client.0.smithi099.stdout:3/155: creat d10/d32/f3b x:0 0 0 2024-01-31T05:13:09.474 INFO:tasks.workunit.client.0.smithi099.stdout:7/142: getdents d6/d12 0 2024-01-31T05:13:09.474 INFO:tasks.workunit.client.0.smithi099.stdout:7/143: readlink d6/d13/l27 0 2024-01-31T05:13:09.479 INFO:tasks.workunit.client.0.smithi099.stdout:5/202: sync 2024-01-31T05:13:09.479 INFO:tasks.workunit.client.0.smithi099.stdout:0/154: sync 2024-01-31T05:13:09.479 INFO:tasks.workunit.client.0.smithi099.stdout:0/155: write d1/f20 [3697282,123123] 0 2024-01-31T05:13:09.482 INFO:tasks.workunit.client.0.smithi099.stdout:8/229: dread d1/dd/d15/f24 [0,4194304] 0 2024-01-31T05:13:09.483 INFO:tasks.workunit.client.0.smithi099.stdout:0/156: rename d1/d16/f17 to d1/d8/df/f33 0 2024-01-31T05:13:09.485 INFO:tasks.workunit.client.0.smithi099.stdout:0/157: link d1/d16/c2d d1/d22/c34 0 2024-01-31T05:13:09.487 INFO:tasks.workunit.client.0.smithi099.stdout:1/114: dwrite d4/db/f10 [0,4194304] 0 2024-01-31T05:13:09.488 INFO:tasks.workunit.client.0.smithi099.stdout:1/115: chown d4/fa 563983 1 2024-01-31T05:13:09.489 INFO:tasks.workunit.client.0.smithi099.stdout:1/116: truncate d4/fa 3476382 0 2024-01-31T05:13:09.489 INFO:tasks.workunit.client.0.smithi099.stdout:1/117: write d4/f6 [3040671,114354] 0 2024-01-31T05:13:09.489 INFO:tasks.workunit.client.0.smithi099.stdout:1/118: fdatasync d4/dc/d15/f1a 0 2024-01-31T05:13:09.491 INFO:tasks.workunit.client.0.smithi099.stdout:1/119: symlink d4/dc/l1f 0 2024-01-31T05:13:09.491 INFO:tasks.workunit.client.0.smithi099.stdout:1/120: chown d4/dc/l1f 494239 1 2024-01-31T05:13:09.491 INFO:tasks.workunit.client.0.smithi099.stdout:1/121: creat d4/dc/d15/f20 x:0 0 0 2024-01-31T05:13:09.491 INFO:tasks.workunit.client.0.smithi099.stdout:1/122: readlink d4/dc/l1f 0 2024-01-31T05:13:09.491 INFO:tasks.workunit.client.0.smithi099.stdout:1/123: write d4/db/f10 [5055549,33284] 0 2024-01-31T05:13:09.491 INFO:tasks.workunit.client.0.smithi099.stdout:1/124: fsync d4/dc/d15/f1a 0 2024-01-31T05:13:09.492 INFO:tasks.workunit.client.0.smithi099.stdout:1/125: write d4/db/f10 [4703602,128948] 0 2024-01-31T05:13:09.492 INFO:tasks.workunit.client.0.smithi099.stdout:1/126: readlink d4/db/l13 0 2024-01-31T05:13:09.492 INFO:tasks.workunit.client.0.smithi099.stdout:6/141: dwrite fa [4194304,4194304] 0 2024-01-31T05:13:09.492 INFO:tasks.workunit.client.0.smithi099.stdout:2/149: dwrite d10/d1b/f1f [0,4194304] 0 2024-01-31T05:13:09.495 INFO:tasks.workunit.client.0.smithi099.stdout:3/156: dread f0 [0,4194304] 0 2024-01-31T05:13:09.495 INFO:tasks.workunit.client.0.smithi099.stdout:3/157: dread - d10/d27/f30 zero size 2024-01-31T05:13:09.495 INFO:tasks.workunit.client.0.smithi099.stdout:3/158: stat d10/d27/l28 0 2024-01-31T05:13:09.496 INFO:tasks.workunit.client.0.smithi099.stdout:1/127: symlink d4/df/l21 0 2024-01-31T05:13:09.496 INFO:tasks.workunit.client.0.smithi099.stdout:6/142: creat d14/d18/d1a/d1c/d29/f2b x:0 0 0 2024-01-31T05:13:09.497 INFO:tasks.workunit.client.0.smithi099.stdout:7/144: dwrite d6/d12/f17 [0,4194304] 0 2024-01-31T05:13:09.498 INFO:tasks.workunit.client.0.smithi099.stdout:7/145: readlink d6/lb 0 2024-01-31T05:13:09.498 INFO:tasks.workunit.client.0.smithi099.stdout:7/146: creat d6/d1e/d25/f2b x:0 0 0 2024-01-31T05:13:09.498 INFO:tasks.workunit.client.0.smithi099.stdout:7/147: truncate d6/d12/f1d 565061 0 2024-01-31T05:13:09.498 INFO:tasks.workunit.client.0.smithi099.stdout:2/150: getdents d10/d20 0 2024-01-31T05:13:09.499 INFO:tasks.workunit.client.0.smithi099.stdout:3/159: mknod d10/d32/d33/c3c 0 2024-01-31T05:13:09.499 INFO:tasks.workunit.client.0.smithi099.stdout:3/160: fsync d10/d1e/f2b 0 2024-01-31T05:13:09.501 INFO:tasks.workunit.client.0.smithi099.stdout:1/128: link d4/dc/d15/f1a d4/df/f22 0 2024-01-31T05:13:09.502 INFO:tasks.workunit.client.0.smithi099.stdout:6/143: mknod d14/d18/d1a/d1c/c2c 0 2024-01-31T05:13:09.506 INFO:tasks.workunit.client.0.smithi099.stdout:6/144: mknod d14/d18/d1a/c2d 0 2024-01-31T05:13:09.507 INFO:tasks.workunit.client.0.smithi099.stdout:8/230: dwrite d1/f10 [0,4194304] 0 2024-01-31T05:13:09.507 INFO:tasks.workunit.client.0.smithi099.stdout:8/231: chown d1/dd/d1d 6228 1 2024-01-31T05:13:09.507 INFO:tasks.workunit.client.0.smithi099.stdout:8/232: readlink d1/dd/d11/d19/d21/l2f 0 2024-01-31T05:13:09.507 INFO:tasks.workunit.client.0.smithi099.stdout:8/233: creat d1/dd/d15/f44 x:0 0 0 2024-01-31T05:13:09.508 INFO:tasks.workunit.client.0.smithi099.stdout:2/151: rename d10/d1c/f32 to d10/f33 0 2024-01-31T05:13:09.511 INFO:tasks.workunit.client.0.smithi099.stdout:7/148: read d6/fa [1109069,33458] 0 2024-01-31T05:13:09.511 INFO:tasks.workunit.client.0.smithi099.stdout:7/149: chown d6/d13 18 1 2024-01-31T05:13:09.511 INFO:tasks.workunit.client.0.smithi099.stdout:0/158: truncate d1/f20 1691146 0 2024-01-31T05:13:09.515 INFO:tasks.workunit.client.0.smithi099.stdout:8/234: truncate d1/dd/f2b 2196941 0 2024-01-31T05:13:09.515 INFO:tasks.workunit.client.0.smithi099.stdout:5/203: write d6/d1e/d1f/d21/f27 [2187695,97179] 0 2024-01-31T05:13:09.515 INFO:tasks.workunit.client.0.smithi099.stdout:5/204: read d6/f13 [905209,25848] 0 2024-01-31T05:13:09.515 INFO:tasks.workunit.client.0.smithi099.stdout:5/205: chown d6/da/l26 1020 1 2024-01-31T05:13:09.516 INFO:tasks.workunit.client.0.smithi099.stdout:1/129: dread d4/dc/d15/f1a [0,4194304] 0 2024-01-31T05:13:09.516 INFO:tasks.workunit.client.0.smithi099.stdout:1/130: readlink d4/dc/l1f 0 2024-01-31T05:13:09.516 INFO:tasks.workunit.client.0.smithi099.stdout:1/131: chown d4/dc/d15 394102501 1 2024-01-31T05:13:09.518 INFO:tasks.workunit.client.0.smithi099.stdout:2/152: unlink d10/d2b/f2e 0 2024-01-31T05:13:09.518 INFO:tasks.workunit.client.0.smithi099.stdout:6/145: write d14/f16 [1015321,63382] 0 2024-01-31T05:13:09.519 INFO:tasks.workunit.client.0.smithi099.stdout:0/159: dread d1/f2c [0,4194304] 0 2024-01-31T05:13:09.519 INFO:tasks.workunit.client.0.smithi099.stdout:0/160: dread - d1/f2a zero size 2024-01-31T05:13:09.519 INFO:tasks.workunit.client.0.smithi099.stdout:7/150: link d6/f1f d6/d1e/f2c 0 2024-01-31T05:13:09.523 INFO:tasks.workunit.client.0.smithi099.stdout:5/206: creat d6/f3e x:0 0 0 2024-01-31T05:13:09.523 INFO:tasks.workunit.client.0.smithi099.stdout:5/207: chown d6/d1e/d1f/d21 635801 1 2024-01-31T05:13:09.525 INFO:tasks.workunit.client.0.smithi099.stdout:3/161: dwrite d10/d18/f26 [4194304,4194304] 0 2024-01-31T05:13:09.525 INFO:tasks.workunit.client.0.smithi099.stdout:3/162: truncate d10/f16 1839473 0 2024-01-31T05:13:09.525 INFO:tasks.workunit.client.0.smithi099.stdout:3/163: stat d10/d27/f31 0 2024-01-31T05:13:09.525 INFO:tasks.workunit.client.0.smithi099.stdout:1/132: link d4/dc/l1f d4/dc/l23 0 2024-01-31T05:13:09.525 INFO:tasks.workunit.client.0.smithi099.stdout:1/133: dread - d4/dc/d15/f20 zero size 2024-01-31T05:13:09.525 INFO:tasks.workunit.client.0.smithi099.stdout:1/134: fdatasync d4/fa 0 2024-01-31T05:13:09.525 INFO:tasks.workunit.client.0.smithi099.stdout:1/135: chown d4/db/c1c 7609747 1 2024-01-31T05:13:09.526 INFO:tasks.workunit.client.0.smithi099.stdout:7/151: symlink d6/d1e/l2d 0 2024-01-31T05:13:09.526 INFO:tasks.workunit.client.0.smithi099.stdout:7/152: chown d6/d1e 379 1 2024-01-31T05:13:09.526 INFO:tasks.workunit.client.0.smithi099.stdout:7/153: write d6/fa [1909373,10501] 0 2024-01-31T05:13:09.529 INFO:tasks.workunit.client.0.smithi099.stdout:5/208: rename d6/d1e/d35 to d6/da/d3f 0 2024-01-31T05:13:09.529 INFO:tasks.workunit.client.0.smithi099.stdout:2/153: write d10/d1b/f1e [4829499,93159] 0 2024-01-31T05:13:09.529 INFO:tasks.workunit.client.0.smithi099.stdout:5/209: stat d6/d1e/d1f 0 2024-01-31T05:13:09.529 INFO:tasks.workunit.client.0.smithi099.stdout:5/210: stat d6/da 0 2024-01-31T05:13:09.529 INFO:tasks.workunit.client.0.smithi099.stdout:5/211: truncate d6/d1e/d1f/f3a 1022950 0 2024-01-31T05:13:09.529 INFO:tasks.workunit.client.0.smithi099.stdout:5/212: readlink d6/da/lb 0 2024-01-31T05:13:09.531 INFO:tasks.workunit.client.0.smithi099.stdout:3/164: symlink d10/d27/l3d 0 2024-01-31T05:13:09.533 INFO:tasks.workunit.client.0.smithi099.stdout:6/146: getdents d14 0 2024-01-31T05:13:09.537 INFO:tasks.workunit.client.0.smithi099.stdout:7/154: rmdir d6 39 2024-01-31T05:13:09.537 INFO:tasks.workunit.client.0.smithi099.stdout:7/155: chown d6/cd 82002 1 2024-01-31T05:13:09.537 INFO:tasks.workunit.client.0.smithi099.stdout:7/156: truncate d6/d1e/d25/f2b 626750 0 2024-01-31T05:13:09.539 INFO:tasks.workunit.client.0.smithi099.stdout:6/147: dread fc [0,4194304] 0 2024-01-31T05:13:09.539 INFO:tasks.workunit.client.0.smithi099.stdout:1/136: write d4/db/f10 [961890,91324] 0 2024-01-31T05:13:09.541 INFO:tasks.workunit.client.0.smithi099.stdout:6/148: symlink d14/d18/d1a/l2e 0 2024-01-31T05:13:09.541 INFO:tasks.workunit.client.0.smithi099.stdout:6/149: fdatasync d14/d18/d1a/f26 0 2024-01-31T05:13:09.541 INFO:tasks.workunit.client.0.smithi099.stdout:6/150: chown lf 6994413 1 2024-01-31T05:13:09.542 INFO:tasks.workunit.client.0.smithi099.stdout:5/213: dread d6/fd [0,4194304] 0 2024-01-31T05:13:09.543 INFO:tasks.workunit.client.0.smithi099.stdout:1/137: mkdir d4/db/d24 0 2024-01-31T05:13:09.543 INFO:tasks.workunit.client.0.smithi099.stdout:1/138: dread - d4/dc/d15/f20 zero size 2024-01-31T05:13:09.544 INFO:tasks.workunit.client.0.smithi099.stdout:2/154: mknod d10/c34 0 2024-01-31T05:13:09.544 INFO:tasks.workunit.client.0.smithi099.stdout:0/161: read d1/f20 [1384649,62513] 0 2024-01-31T05:13:09.546 INFO:tasks.workunit.client.0.smithi099.stdout:6/151: unlink d14/d18/d1a/f26 0 2024-01-31T05:13:09.548 INFO:tasks.workunit.client.0.smithi099.stdout:1/139: creat d4/db/f25 x:0 0 0 2024-01-31T05:13:09.550 INFO:tasks.workunit.client.0.smithi099.stdout:1/140: unlink d4/dc/l23 0 2024-01-31T05:13:09.550 INFO:tasks.workunit.client.0.smithi099.stdout:1/141: fdatasync d4/f6 0 2024-01-31T05:13:09.552 INFO:tasks.workunit.client.0.smithi099.stdout:1/142: mknod d4/db/d12/c26 0 2024-01-31T05:13:09.554 INFO:tasks.workunit.client.0.smithi099.stdout:7/157: write d6/f20 [4793865,93833] 0 2024-01-31T05:13:09.555 INFO:tasks.workunit.client.0.smithi099.stdout:1/143: link d4/db/l13 d4/df/l27 0 2024-01-31T05:13:09.555 INFO:tasks.workunit.client.0.smithi099.stdout:1/144: write d4/dc/d15/f20 [282679,108413] 0 2024-01-31T05:13:09.558 INFO:tasks.workunit.client.0.smithi099.stdout:1/145: mkdir d4/db/d24/d28 0 2024-01-31T05:13:09.561 INFO:tasks.workunit.client.0.smithi099.stdout:1/146: mkdir d4/dc/d29 0 2024-01-31T05:13:09.564 INFO:tasks.workunit.client.0.smithi099.stdout:1/147: creat d4/df/f2a x:0 0 0 2024-01-31T05:13:09.566 INFO:tasks.workunit.client.0.smithi099.stdout:1/148: creat d4/db/d24/f2b x:0 0 0 2024-01-31T05:13:09.567 INFO:tasks.workunit.client.0.smithi099.stdout:1/149: chown d4/db/c1c 1907 1 2024-01-31T05:13:09.569 INFO:tasks.workunit.client.0.smithi099.stdout:1/150: getdents d4/dc/d15 0 2024-01-31T05:13:09.569 INFO:tasks.workunit.client.0.smithi099.stdout:1/151: write d4/df/f2a [203971,14223] 0 2024-01-31T05:13:09.569 INFO:tasks.workunit.client.0.smithi099.stdout:1/152: readlink d4/df/l1d 0 2024-01-31T05:13:09.571 INFO:tasks.workunit.client.0.smithi099.stdout:5/214: dwrite d6/f18 [0,4194304] 0 2024-01-31T05:13:09.573 INFO:tasks.workunit.client.0.smithi099.stdout:5/215: symlink d6/da/d14/l40 0 2024-01-31T05:13:09.578 INFO:tasks.workunit.client.0.smithi099.stdout:2/155: dwrite d10/d1b/f23 [0,4194304] 0 2024-01-31T05:13:09.578 INFO:tasks.workunit.client.0.smithi099.stdout:2/156: stat f1 0 2024-01-31T05:13:09.579 INFO:tasks.workunit.client.0.smithi099.stdout:2/157: chown d10/c14 128953144 1 2024-01-31T05:13:09.580 INFO:tasks.workunit.client.0.smithi099.stdout:2/158: rmdir d10/d1b 39 2024-01-31T05:13:09.582 INFO:tasks.workunit.client.0.smithi099.stdout:2/159: creat d10/d20/f35 x:0 0 0 2024-01-31T05:13:09.582 INFO:tasks.workunit.client.0.smithi099.stdout:2/160: chown f0 878128153 1 2024-01-31T05:13:09.582 INFO:tasks.workunit.client.0.smithi099.stdout:2/161: fdatasync d10/f31 0 2024-01-31T05:13:09.583 INFO:tasks.workunit.client.0.smithi099.stdout:2/162: symlink d10/d2b/l36 0 2024-01-31T05:13:09.585 INFO:tasks.workunit.client.0.smithi099.stdout:6/152: dwrite f10 [0,4194304] 0 2024-01-31T05:13:09.585 INFO:tasks.workunit.client.0.smithi099.stdout:6/153: chown l5 1 1 2024-01-31T05:13:09.585 INFO:tasks.workunit.client.0.smithi099.stdout:6/154: read d14/f16 [1097369,59732] 0 2024-01-31T05:13:09.585 INFO:tasks.workunit.client.0.smithi099.stdout:6/155: chown d14/f15 415861438 1 2024-01-31T05:13:09.585 INFO:tasks.workunit.client.0.smithi099.stdout:2/163: rename d10/d1b/f1f to d10/d20/f37 0 2024-01-31T05:13:09.587 INFO:tasks.workunit.client.0.smithi099.stdout:7/158: dwrite d6/d12/f1d [0,4194304] 0 2024-01-31T05:13:09.587 INFO:tasks.workunit.client.0.smithi099.stdout:7/159: fdatasync d6/d1e/d25/f2b 0 2024-01-31T05:13:09.595 INFO:tasks.workunit.client.0.smithi099.stdout:8/235: truncate d1/dd/f2b 1391742 0 2024-01-31T05:13:09.597 INFO:tasks.workunit.client.0.smithi099.stdout:8/236: symlink d1/dd/d11/d29/l45 0 2024-01-31T05:13:09.598 INFO:tasks.workunit.client.0.smithi099.stdout:8/237: creat d1/dd/d11/d19/d21/d3c/f46 x:0 0 0 2024-01-31T05:13:09.598 INFO:tasks.workunit.client.0.smithi099.stdout:8/238: write d1/dd/d11/d19/f1c [3834980,19793] 0 2024-01-31T05:13:09.598 INFO:tasks.workunit.client.0.smithi099.stdout:8/239: dread - d1/dd/d15/d2e/f33 zero size 2024-01-31T05:13:09.601 INFO:tasks.workunit.client.0.smithi099.stdout:8/240: dread d1/dd/d15/f22 [0,4194304] 0 2024-01-31T05:13:09.603 INFO:tasks.workunit.client.0.smithi099.stdout:8/241: symlink d1/dd/d11/d19/d21/d3c/l47 0 2024-01-31T05:13:09.603 INFO:tasks.workunit.client.0.smithi099.stdout:8/242: chown d1/dd/d11 4974072 1 2024-01-31T05:13:09.607 INFO:tasks.workunit.client.0.smithi099.stdout:5/216: dwrite d6/fd [0,4194304] 0 2024-01-31T05:13:09.610 INFO:tasks.workunit.client.0.smithi099.stdout:4/192: sync 2024-01-31T05:13:09.610 INFO:tasks.workunit.client.0.smithi099.stdout:4/193: write d0/d8/d19/f44 [278979,42036] 0 2024-01-31T05:13:09.611 INFO:tasks.workunit.client.0.smithi099.stdout:2/164: dread f0 [0,4194304] 0 2024-01-31T05:13:09.619 INFO:tasks.workunit.client.0.smithi099.stdout:4/194: read d0/d8/d19/f1c [64116,83771] 0 2024-01-31T05:13:09.619 INFO:tasks.workunit.client.0.smithi099.stdout:1/153: dwrite d4/dc/d15/f20 [0,4194304] 0 2024-01-31T05:13:09.620 INFO:tasks.workunit.client.0.smithi099.stdout:5/217: write f1 [717383,53280] 0 2024-01-31T05:13:09.622 INFO:tasks.workunit.client.0.smithi099.stdout:1/154: creat d4/dc/f2c x:0 0 0 2024-01-31T05:13:09.624 INFO:tasks.workunit.client.0.smithi099.stdout:2/165: dread d10/f31 [0,4194304] 0 2024-01-31T05:13:09.625 INFO:tasks.workunit.client.0.smithi099.stdout:2/166: fdatasync d10/f33 0 2024-01-31T05:13:09.633 INFO:tasks.workunit.client.0.smithi099.stdout:6/156: dwrite fc [4194304,4194304] 0 2024-01-31T05:13:09.633 INFO:tasks.workunit.client.0.smithi099.stdout:7/160: dwrite d6/d13/f1b [0,4194304] 0 2024-01-31T05:13:09.633 INFO:tasks.workunit.client.0.smithi099.stdout:1/155: dread d4/db/f10 [0,4194304] 0 2024-01-31T05:13:09.633 INFO:tasks.workunit.client.0.smithi099.stdout:8/243: dread d1/dd/d11/f31 [0,4194304] 0 2024-01-31T05:13:09.635 INFO:tasks.workunit.client.0.smithi099.stdout:6/157: unlink d14/d18/d1a/l24 0 2024-01-31T05:13:09.635 INFO:tasks.workunit.client.0.smithi099.stdout:6/158: chown lf 187218 1 2024-01-31T05:13:09.635 INFO:tasks.workunit.client.0.smithi099.stdout:6/159: dread - d14/d18/d1a/d1c/d29/f2b zero size 2024-01-31T05:13:09.636 INFO:tasks.workunit.client.0.smithi099.stdout:7/161: mkdir d6/d1e/d25/d2e 0 2024-01-31T05:13:09.637 INFO:tasks.workunit.client.0.smithi099.stdout:8/244: truncate d1/dd/d11/d19/d21/f2c 4047207 0 2024-01-31T05:13:09.641 INFO:tasks.workunit.client.0.smithi099.stdout:5/218: write d6/f18 [2350336,18389] 0 2024-01-31T05:13:09.641 INFO:tasks.workunit.client.0.smithi099.stdout:2/167: dread d10/d1b/f1e [0,4194304] 0 2024-01-31T05:13:09.641 INFO:tasks.workunit.client.0.smithi099.stdout:6/160: link d14/f16 d14/d18/d1a/d1b/f2f 0 2024-01-31T05:13:09.643 INFO:tasks.workunit.client.0.smithi099.stdout:8/245: truncate d1/dd/d11/f32 1909999 0 2024-01-31T05:13:09.644 INFO:tasks.workunit.client.0.smithi099.stdout:6/161: truncate d14/f17 1118095 0 2024-01-31T05:13:09.646 INFO:tasks.workunit.client.0.smithi099.stdout:8/246: creat d1/dd/d11/d29/d3f/f48 x:0 0 0 2024-01-31T05:13:09.646 INFO:tasks.workunit.client.0.smithi099.stdout:8/247: write d1/dd/d15/f27 [2670064,121180] 0 2024-01-31T05:13:09.647 INFO:tasks.workunit.client.0.smithi099.stdout:6/162: creat d14/f30 x:0 0 0 2024-01-31T05:13:09.647 INFO:tasks.workunit.client.0.smithi099.stdout:6/163: fdatasync d14/f17 0 2024-01-31T05:13:09.650 INFO:tasks.workunit.client.0.smithi099.stdout:8/248: rmdir d1/dd/d11/d19/d21/d3c 39 2024-01-31T05:13:09.654 INFO:tasks.workunit.client.0.smithi099.stdout:8/249: rename d1/dd/d11/f1b to d1/dd/f49 0 2024-01-31T05:13:09.656 INFO:tasks.workunit.client.0.smithi099.stdout:8/250: rmdir d1/dd/d11/d19 39 2024-01-31T05:13:09.658 INFO:tasks.workunit.client.0.smithi099.stdout:8/251: symlink d1/dd/d11/d19/d21/l4a 0 2024-01-31T05:13:09.658 INFO:tasks.workunit.client.0.smithi099.stdout:8/252: creat d1/dd/d11/d20/f4b x:0 0 0 2024-01-31T05:13:09.658 INFO:tasks.workunit.client.0.smithi099.stdout:8/253: fsync d1/dd/f2b 0 2024-01-31T05:13:09.658 INFO:tasks.workunit.client.0.smithi099.stdout:8/254: fdatasync d1/dd/d15/f3b 0 2024-01-31T05:13:09.663 INFO:tasks.workunit.client.0.smithi099.stdout:1/156: write d4/dc/d15/f20 [1735464,8380] 0 2024-01-31T05:13:09.663 INFO:tasks.workunit.client.0.smithi099.stdout:4/195: dwrite d0/d2/f15 [0,4194304] 0 2024-01-31T05:13:09.665 INFO:tasks.workunit.client.0.smithi099.stdout:4/196: mknod d0/d2/d20/c48 0 2024-01-31T05:13:09.665 INFO:tasks.workunit.client.0.smithi099.stdout:7/162: dread f3 [0,4194304] 0 2024-01-31T05:13:09.665 INFO:tasks.workunit.client.0.smithi099.stdout:7/163: creat d6/d13/f2f x:0 0 0 2024-01-31T05:13:09.666 INFO:tasks.workunit.client.0.smithi099.stdout:7/164: stat d6/f20 0 2024-01-31T05:13:09.670 INFO:tasks.workunit.client.0.smithi099.stdout:7/165: creat d6/f30 x:0 0 0 2024-01-31T05:13:09.670 INFO:tasks.workunit.client.0.smithi099.stdout:4/197: mknod d0/d8/c49 0 2024-01-31T05:13:09.672 INFO:tasks.workunit.client.0.smithi099.stdout:5/219: write d6/fd [4174749,113399] 0 2024-01-31T05:13:09.673 INFO:tasks.workunit.client.0.smithi099.stdout:5/220: creat d6/d1e/f41 x:0 0 0 2024-01-31T05:13:09.673 INFO:tasks.workunit.client.0.smithi099.stdout:5/221: readlink d6/lc 0 2024-01-31T05:13:09.673 INFO:tasks.workunit.client.0.smithi099.stdout:5/222: write d6/d1e/f2c [97738,72383] 0 2024-01-31T05:13:09.674 INFO:tasks.workunit.client.0.smithi099.stdout:4/198: dread d0/d2/d20/f31 [0,4194304] 0 2024-01-31T05:13:09.674 INFO:tasks.workunit.client.0.smithi099.stdout:2/168: dwrite d10/d1c/f26 [0,4194304] 0 2024-01-31T05:13:09.674 INFO:tasks.workunit.client.0.smithi099.stdout:2/169: fdatasync d10/d1c/f26 0 2024-01-31T05:13:09.675 INFO:tasks.workunit.client.0.smithi099.stdout:2/170: chown d10/d20/l2c 376749211 1 2024-01-31T05:13:09.675 INFO:tasks.workunit.client.0.smithi099.stdout:2/171: truncate d10/f15 8697804 0 2024-01-31T05:13:09.675 INFO:tasks.workunit.client.0.smithi099.stdout:2/172: fdatasync d10/d20/f37 0 2024-01-31T05:13:09.675 INFO:tasks.workunit.client.0.smithi099.stdout:2/173: dread - d10/d1c/f2d zero size 2024-01-31T05:13:09.676 INFO:tasks.workunit.client.0.smithi099.stdout:1/157: write d4/dc/d15/f1a [2678182,130548] 0 2024-01-31T05:13:09.676 INFO:tasks.workunit.client.0.smithi099.stdout:1/158: read d4/fa [2452378,90195] 0 2024-01-31T05:13:09.681 INFO:tasks.workunit.client.0.smithi099.stdout:4/199: rename d0/l9 to d0/d8/d19/l4a 0 2024-01-31T05:13:09.683 INFO:tasks.workunit.client.0.smithi099.stdout:2/174: mknod d10/d20/c38 0 2024-01-31T05:13:09.683 INFO:tasks.workunit.client.0.smithi099.stdout:2/175: creat d10/d1c/f39 x:0 0 0 2024-01-31T05:13:09.683 INFO:tasks.workunit.client.0.smithi099.stdout:2/176: stat d10/f31 0 2024-01-31T05:13:09.683 INFO:tasks.workunit.client.0.smithi099.stdout:6/164: dwrite d14/d18/d1a/d1b/f2f [0,4194304] 0 2024-01-31T05:13:09.683 INFO:tasks.workunit.client.0.smithi099.stdout:6/165: creat d14/d18/d1a/d1c/d29/f31 x:0 0 0 2024-01-31T05:13:09.683 INFO:tasks.workunit.client.0.smithi099.stdout:6/166: creat d14/d18/d1a/d1c/d29/f32 x:0 0 0 2024-01-31T05:13:09.683 INFO:tasks.workunit.client.0.smithi099.stdout:6/167: write fa [1722219,110667] 0 2024-01-31T05:13:09.684 INFO:tasks.workunit.client.0.smithi099.stdout:4/200: mkdir d0/d2/d4b 0 2024-01-31T05:13:09.684 INFO:tasks.workunit.client.0.smithi099.stdout:4/201: chown d0/d2/d20/d21/d17/d24/d3f 25 1 2024-01-31T05:13:09.684 INFO:tasks.workunit.client.0.smithi099.stdout:4/202: dread - d0/d2/d20/d21/d17/f25 zero size 2024-01-31T05:13:09.686 INFO:tasks.workunit.client.0.smithi099.stdout:8/255: dwrite d1/dd/d15/d2e/f33 [0,4194304] 0 2024-01-31T05:13:09.686 INFO:tasks.workunit.client.0.smithi099.stdout:8/256: readlink d1/l6 0 2024-01-31T05:13:09.687 INFO:tasks.workunit.client.0.smithi099.stdout:7/166: write d6/d13/f1b [3152030,16340] 0 2024-01-31T05:13:09.695 INFO:tasks.workunit.client.0.smithi099.stdout:6/168: symlink d14/d18/d1a/d1c/l33 0 2024-01-31T05:13:09.696 INFO:tasks.workunit.client.0.smithi099.stdout:5/223: dwrite d6/f3e [0,4194304] 0 2024-01-31T05:13:09.699 INFO:tasks.workunit.client.0.smithi099.stdout:4/203: unlink d0/d2/d20/d21/d17/f3b 0 2024-01-31T05:13:09.699 INFO:tasks.workunit.client.0.smithi099.stdout:4/204: write d0/d8/d19/f2d [450531,27574] 0 2024-01-31T05:13:09.700 INFO:tasks.workunit.client.0.smithi099.stdout:2/177: mkdir d10/d3a 0 2024-01-31T05:13:09.700 INFO:tasks.workunit.client.0.smithi099.stdout:2/178: fsync d10/d1c/f2d 0 2024-01-31T05:13:09.703 INFO:tasks.workunit.client.0.smithi099.stdout:8/257: truncate d1/dd/d11/d19/d21/f2c 3045529 0 2024-01-31T05:13:09.704 INFO:tasks.workunit.client.0.smithi099.stdout:7/167: symlink d6/d1e/l31 0 2024-01-31T05:13:09.706 INFO:tasks.workunit.client.0.smithi099.stdout:6/169: write d14/f15 [1628566,23427] 0 2024-01-31T05:13:09.707 INFO:tasks.workunit.client.0.smithi099.stdout:4/205: mknod d0/d2/d20/d21/c4c 0 2024-01-31T05:13:09.707 INFO:tasks.workunit.client.0.smithi099.stdout:4/206: readlink d0/d8/d19/l45 0 2024-01-31T05:13:09.709 INFO:tasks.workunit.client.0.smithi099.stdout:4/207: read d0/d2/d20/f31 [852510,1697] 0 2024-01-31T05:13:09.711 INFO:tasks.workunit.client.0.smithi099.stdout:2/179: rename d10/d1b/f1e to d10/f3b 0 2024-01-31T05:13:09.712 INFO:tasks.workunit.client.0.smithi099.stdout:2/180: write d10/f3b [7164480,59928] 0 2024-01-31T05:13:09.712 INFO:tasks.workunit.client.0.smithi099.stdout:4/208: getdents d0/d8 0 2024-01-31T05:13:09.712 INFO:tasks.workunit.client.0.smithi099.stdout:4/209: chown d0/d2/le 34240616 1 2024-01-31T05:13:09.713 INFO:tasks.workunit.client.0.smithi099.stdout:1/159: dwrite d4/dc/d15/f20 [4194304,4194304] 0 2024-01-31T05:13:09.713 INFO:tasks.workunit.client.0.smithi099.stdout:1/160: write d4/db/f10 [5582223,44176] 0 2024-01-31T05:13:09.713 INFO:tasks.workunit.client.0.smithi099.stdout:8/258: rmdir d1/dd/d1d 39 2024-01-31T05:13:09.713 INFO:tasks.workunit.client.0.smithi099.stdout:8/259: creat d1/dd/d11/d20/f4c x:0 0 0 2024-01-31T05:13:09.714 INFO:tasks.workunit.client.0.smithi099.stdout:9/143: sync 2024-01-31T05:13:09.716 INFO:tasks.workunit.client.0.smithi099.stdout:2/181: rmdir d10/d1b 39 2024-01-31T05:13:09.718 INFO:tasks.workunit.client.0.smithi099.stdout:4/210: mknod d0/d2/d20/d21/c4d 0 2024-01-31T05:13:09.718 INFO:tasks.workunit.client.0.smithi099.stdout:4/211: chown d0/d2/lb 4787378 1 2024-01-31T05:13:09.718 INFO:tasks.workunit.client.0.smithi099.stdout:4/212: dread - d0/d2/f47 zero size 2024-01-31T05:13:09.719 INFO:tasks.workunit.client.0.smithi099.stdout:1/161: mknod d4/df/c2d 0 2024-01-31T05:13:09.720 INFO:tasks.workunit.client.0.smithi099.stdout:1/162: write d4/df/f2a [964050,96501] 0 2024-01-31T05:13:09.720 INFO:tasks.workunit.client.0.smithi099.stdout:8/260: dread d1/dd/d11/d19/f36 [0,4194304] 0 2024-01-31T05:13:09.720 INFO:tasks.workunit.client.0.smithi099.stdout:8/261: dread - d1/dd/d11/d20/f4c zero size 2024-01-31T05:13:09.724 INFO:tasks.workunit.client.0.smithi099.stdout:7/168: rename d6/d1e/d25/d2e to d6/d32 0 2024-01-31T05:13:09.724 INFO:tasks.workunit.client.0.smithi099.stdout:7/169: chown d6/d12 1657530 1 2024-01-31T05:13:09.725 INFO:tasks.workunit.client.0.smithi099.stdout:2/182: symlink d10/d1c/l3c 0 2024-01-31T05:13:09.726 INFO:tasks.workunit.client.0.smithi099.stdout:4/213: unlink d0/d2/d20/d21/c4d 0 2024-01-31T05:13:09.728 INFO:tasks.workunit.client.0.smithi099.stdout:1/163: link d4/df/l1d d4/dc/d29/l2e 0 2024-01-31T05:13:09.729 INFO:tasks.workunit.client.0.smithi099.stdout:6/170: dwrite d14/d18/d1a/d1b/f2f [0,4194304] 0 2024-01-31T05:13:09.731 INFO:tasks.workunit.client.0.smithi099.stdout:8/262: rename d1/dd/d11/d29/d3f/c41 to d1/dd/d11/d19/c4d 0 2024-01-31T05:13:09.731 INFO:tasks.workunit.client.0.smithi099.stdout:3/165: sync 2024-01-31T05:13:09.731 INFO:tasks.workunit.client.0.smithi099.stdout:0/162: sync 2024-01-31T05:13:09.732 INFO:tasks.workunit.client.0.smithi099.stdout:7/170: mkdir d6/d13/d33 0 2024-01-31T05:13:09.732 INFO:tasks.workunit.client.0.smithi099.stdout:7/171: fdatasync f2 0 2024-01-31T05:13:09.735 INFO:tasks.workunit.client.0.smithi099.stdout:3/166: dread d10/f23 [0,4194304] 0 2024-01-31T05:13:09.735 INFO:tasks.workunit.client.0.smithi099.stdout:4/214: link d0/c6 d0/d2/d20/d21/d17/d3d/c4e 0 2024-01-31T05:13:09.735 INFO:tasks.workunit.client.0.smithi099.stdout:4/215: stat d0/fd 0 2024-01-31T05:13:09.735 INFO:tasks.workunit.client.0.smithi099.stdout:4/216: dread - d0/d2/f1d zero size 2024-01-31T05:13:09.738 INFO:tasks.workunit.client.0.smithi099.stdout:8/263: symlink d1/dd/d11/d29/d3f/l4e 0 2024-01-31T05:13:09.739 INFO:tasks.workunit.client.0.smithi099.stdout:0/163: creat d1/d8/f35 x:0 0 0 2024-01-31T05:13:09.742 INFO:tasks.workunit.client.0.smithi099.stdout:7/172: creat d6/d32/f34 x:0 0 0 2024-01-31T05:13:09.743 INFO:tasks.workunit.client.0.smithi099.stdout:3/167: mknod d10/d1e/c3e 0 2024-01-31T05:13:09.743 INFO:tasks.workunit.client.0.smithi099.stdout:4/217: mknod d0/d2/d20/c4f 0 2024-01-31T05:13:09.743 INFO:tasks.workunit.client.0.smithi099.stdout:4/218: write d0/d1e/f35 [718123,51779] 0 2024-01-31T05:13:09.744 INFO:tasks.workunit.client.0.smithi099.stdout:8/264: mkdir d1/dd/d4f 0 2024-01-31T05:13:09.745 INFO:tasks.workunit.client.0.smithi099.stdout:8/265: truncate d1/dd/d15/f3d 659658 0 2024-01-31T05:13:09.745 INFO:tasks.workunit.client.0.smithi099.stdout:0/164: getdents d1/d22 0 2024-01-31T05:13:09.748 INFO:tasks.workunit.client.0.smithi099.stdout:3/168: unlink d10/d27/f31 0 2024-01-31T05:13:09.748 INFO:tasks.workunit.client.0.smithi099.stdout:3/169: write d10/d27/f30 [100107,68968] 0 2024-01-31T05:13:09.749 INFO:tasks.workunit.client.0.smithi099.stdout:4/219: rename d0/d2/d20/c2e to d0/d2/d20/d21/d17/d3d/c50 0 2024-01-31T05:13:09.750 INFO:tasks.workunit.client.0.smithi099.stdout:8/266: mknod d1/dd/d11/d19/d21/c50 0 2024-01-31T05:13:09.750 INFO:tasks.workunit.client.0.smithi099.stdout:8/267: fsync d1/dd/d11/d29/d3f/f48 0 2024-01-31T05:13:09.751 INFO:tasks.workunit.client.0.smithi099.stdout:0/165: mkdir d1/d16/d36 0 2024-01-31T05:13:09.753 INFO:tasks.workunit.client.0.smithi099.stdout:3/170: mknod d10/d18/c3f 0 2024-01-31T05:13:09.753 INFO:tasks.workunit.client.0.smithi099.stdout:3/171: chown d10/c15 92 1 2024-01-31T05:13:09.755 INFO:tasks.workunit.client.0.smithi099.stdout:1/164: dwrite d4/fa [0,4194304] 0 2024-01-31T05:13:09.756 INFO:tasks.workunit.client.0.smithi099.stdout:4/220: rename d0/c2f to d0/d2/d20/d21/d17/d24/c51 0 2024-01-31T05:13:09.756 INFO:tasks.workunit.client.0.smithi099.stdout:2/183: dwrite f4 [0,4194304] 0 2024-01-31T05:13:09.756 INFO:tasks.workunit.client.0.smithi099.stdout:2/184: creat d10/d20/f3d x:0 0 0 2024-01-31T05:13:09.757 INFO:tasks.workunit.client.0.smithi099.stdout:8/268: truncate d1/dd/d11/d19/f1f 171769 0 2024-01-31T05:13:09.760 INFO:tasks.workunit.client.0.smithi099.stdout:3/172: mkdir d10/d24/d40 0 2024-01-31T05:13:09.761 INFO:tasks.workunit.client.0.smithi099.stdout:1/165: creat d4/db/d24/d28/f2f x:0 0 0 2024-01-31T05:13:09.763 INFO:tasks.workunit.client.0.smithi099.stdout:4/221: rename d0/d2/d20/l22 to d0/d2/d4b/l52 0 2024-01-31T05:13:09.763 INFO:tasks.workunit.client.0.smithi099.stdout:4/222: fdatasync d0/d8/d19/f2d 0 2024-01-31T05:13:09.763 INFO:tasks.workunit.client.0.smithi099.stdout:4/223: chown d0/d2/l46 1786256713 1 2024-01-31T05:13:09.763 INFO:tasks.workunit.client.0.smithi099.stdout:4/224: fsync d0/d8/f27 0 2024-01-31T05:13:09.767 INFO:tasks.workunit.client.0.smithi099.stdout:0/166: mkdir d1/d37 0 2024-01-31T05:13:09.768 INFO:tasks.workunit.client.0.smithi099.stdout:3/173: mknod d10/d24/c41 0 2024-01-31T05:13:09.770 INFO:tasks.workunit.client.0.smithi099.stdout:1/166: mknod d4/dc/d29/c30 0 2024-01-31T05:13:09.772 INFO:tasks.workunit.client.0.smithi099.stdout:4/225: creat d0/d2/d20/d21/f53 x:0 0 0 2024-01-31T05:13:09.772 INFO:tasks.workunit.client.0.smithi099.stdout:4/226: fdatasync d0/d8/d19/f2d 0 2024-01-31T05:13:09.776 INFO:tasks.workunit.client.0.smithi099.stdout:4/227: mkdir d0/d8/d19/d54 0 2024-01-31T05:13:09.776 INFO:tasks.workunit.client.0.smithi099.stdout:4/228: write d0/d8/d19/f44 [1343523,113970] 0 2024-01-31T05:13:09.776 INFO:tasks.workunit.client.0.smithi099.stdout:4/229: chown d0/l1a 1907 1 2024-01-31T05:13:09.778 INFO:tasks.workunit.client.0.smithi099.stdout:0/167: rename d1/d22/c34 to d1/c38 0 2024-01-31T05:13:09.780 INFO:tasks.workunit.client.0.smithi099.stdout:4/230: mknod d0/d8/d19/c55 0 2024-01-31T05:13:09.781 INFO:tasks.workunit.client.0.smithi099.stdout:3/174: read d10/d18/f26 [322163,117379] 0 2024-01-31T05:13:09.781 INFO:tasks.workunit.client.0.smithi099.stdout:1/167: rmdir d4/df 39 2024-01-31T05:13:09.783 INFO:tasks.workunit.client.0.smithi099.stdout:3/175: rename d10/c2a to d10/d27/c42 0 2024-01-31T05:13:09.783 INFO:tasks.workunit.client.0.smithi099.stdout:3/176: truncate d10/d18/f2c 4588844 0 2024-01-31T05:13:09.783 INFO:tasks.workunit.client.0.smithi099.stdout:2/185: dwrite d10/d20/f3d [0,4194304] 0 2024-01-31T05:13:09.784 INFO:tasks.workunit.client.0.smithi099.stdout:8/269: dwrite d1/dd/d1d/f40 [0,4194304] 0 2024-01-31T05:13:09.784 INFO:tasks.workunit.client.0.smithi099.stdout:2/186: write d10/d20/f35 [418928,130979] 0 2024-01-31T05:13:09.784 INFO:tasks.workunit.client.0.smithi099.stdout:0/168: write d1/f2c [4107936,24386] 0 2024-01-31T05:13:09.789 INFO:tasks.workunit.client.0.smithi099.stdout:3/177: rename c3 to d10/d1e/c43 0 2024-01-31T05:13:09.789 INFO:tasks.workunit.client.0.smithi099.stdout:7/173: rmdir d6/d13 39 2024-01-31T05:13:09.789 INFO:tasks.workunit.client.0.smithi099.stdout:7/174: chown d6/d12 22208 1 2024-01-31T05:13:09.789 INFO:tasks.workunit.client.0.smithi099.stdout:7/175: chown d6/d1e/d25 519962694 1 2024-01-31T05:13:09.791 INFO:tasks.workunit.client.0.smithi099.stdout:2/187: link d10/d1c/l3c d10/d3a/l3e 0 2024-01-31T05:13:09.792 INFO:tasks.workunit.client.0.smithi099.stdout:2/188: mknod d10/d20/c3f 0 2024-01-31T05:13:09.796 INFO:tasks.workunit.client.0.smithi099.stdout:2/189: unlink d10/d20/l2c 0 2024-01-31T05:13:09.796 INFO:tasks.workunit.client.0.smithi099.stdout:2/190: write f1 [2309745,107118] 0 2024-01-31T05:13:09.796 INFO:tasks.workunit.client.0.smithi099.stdout:1/168: dread d4/f6 [4194304,4194304] 0 2024-01-31T05:13:09.796 INFO:tasks.workunit.client.0.smithi099.stdout:2/191: creat d10/d20/f40 x:0 0 0 2024-01-31T05:13:09.796 INFO:tasks.workunit.client.0.smithi099.stdout:1/169: creat d4/db/d24/d28/f31 x:0 0 0 2024-01-31T05:13:09.796 INFO:tasks.workunit.client.0.smithi099.stdout:2/192: write d10/d1c/f2d [720609,40532] 0 2024-01-31T05:13:09.797 INFO:tasks.workunit.client.0.smithi099.stdout:0/169: dread d1/f4 [0,4194304] 0 2024-01-31T05:13:09.797 INFO:tasks.workunit.client.0.smithi099.stdout:0/170: truncate d1/d8/df/f25 355456 0 2024-01-31T05:13:09.801 INFO:tasks.workunit.client.0.smithi099.stdout:3/178: write d10/f1b [2957377,80420] 0 2024-01-31T05:13:09.802 INFO:tasks.workunit.client.0.smithi099.stdout:1/170: link d4/dc/d15/f1a d4/dc/d15/f32 0 2024-01-31T05:13:09.802 INFO:tasks.workunit.client.0.smithi099.stdout:1/171: chown d4/dc/c16 3103284 1 2024-01-31T05:13:09.803 INFO:tasks.workunit.client.0.smithi099.stdout:0/171: readlink d1/le 0 2024-01-31T05:13:09.803 INFO:tasks.workunit.client.0.smithi099.stdout:7/176: write d6/fc [3334813,88548] 0 2024-01-31T05:13:09.804 INFO:tasks.workunit.client.0.smithi099.stdout:2/193: rmdir d10/d2b 39 2024-01-31T05:13:09.807 INFO:tasks.workunit.client.0.smithi099.stdout:1/172: creat d4/dc/d15/f33 x:0 0 0 2024-01-31T05:13:09.809 INFO:tasks.workunit.client.0.smithi099.stdout:4/231: dwrite d0/d2/d20/d21/f53 [0,4194304] 0 2024-01-31T05:13:09.810 INFO:tasks.workunit.client.0.smithi099.stdout:8/270: dwrite d1/dd/d11/f31 [0,4194304] 0 2024-01-31T05:13:09.810 INFO:tasks.workunit.client.0.smithi099.stdout:8/271: read - d1/dd/d11/d29/d3f/f48 zero size 2024-01-31T05:13:09.811 INFO:tasks.workunit.client.0.smithi099.stdout:7/177: mknod d6/d32/c35 0 2024-01-31T05:13:09.813 INFO:tasks.workunit.client.0.smithi099.stdout:1/173: unlink d4/c8 0 2024-01-31T05:13:09.813 INFO:tasks.workunit.client.0.smithi099.stdout:1/174: write d4/db/f10 [1688575,88877] 0 2024-01-31T05:13:09.815 INFO:tasks.workunit.client.0.smithi099.stdout:0/172: unlink d1/l14 0 2024-01-31T05:13:09.818 INFO:tasks.workunit.client.0.smithi099.stdout:4/232: unlink d0/d2/d20/d21/d17/f37 0 2024-01-31T05:13:09.819 INFO:tasks.workunit.client.0.smithi099.stdout:8/272: mkdir d1/dd/d4f/d51 0 2024-01-31T05:13:09.819 INFO:tasks.workunit.client.0.smithi099.stdout:8/273: write d1/dd/d15/f3d [1503244,1930] 0 2024-01-31T05:13:09.820 INFO:tasks.workunit.client.0.smithi099.stdout:7/178: truncate d6/d1e/d25/f2b 463376 0 2024-01-31T05:13:09.821 INFO:tasks.workunit.client.0.smithi099.stdout:7/179: stat d6/lb 0 2024-01-31T05:13:09.825 INFO:tasks.workunit.client.0.smithi099.stdout:3/179: dwrite fa [0,4194304] 0 2024-01-31T05:13:09.826 INFO:tasks.workunit.client.0.smithi099.stdout:3/180: chown f4 142044581 1 2024-01-31T05:13:09.826 INFO:tasks.workunit.client.0.smithi099.stdout:3/181: truncate d10/d32/f36 508955 0 2024-01-31T05:13:09.826 INFO:tasks.workunit.client.0.smithi099.stdout:1/175: creat d4/df/f34 x:0 0 0 2024-01-31T05:13:09.826 INFO:tasks.workunit.client.0.smithi099.stdout:1/176: write d4/dc/d15/f33 [672000,31003] 0 2024-01-31T05:13:09.828 INFO:tasks.workunit.client.0.smithi099.stdout:4/233: mknod d0/d2/d20/d21/d17/d24/d3f/c56 0 2024-01-31T05:13:09.830 INFO:tasks.workunit.client.0.smithi099.stdout:8/274: link d1/dd/d11/d20/l28 d1/dd/d11/d19/d21/d3c/l52 0 2024-01-31T05:13:09.830 INFO:tasks.workunit.client.0.smithi099.stdout:8/275: dread - d1/dd/f49 zero size 2024-01-31T05:13:09.832 INFO:tasks.workunit.client.0.smithi099.stdout:7/180: creat d6/d13/d33/f36 x:0 0 0 2024-01-31T05:13:09.842 INFO:tasks.workunit.client.0.smithi099.stdout:1/177: unlink d4/db/f10 0 2024-01-31T05:13:09.843 INFO:tasks.workunit.client.0.smithi099.stdout:1/178: stat d4/dc/d15/f1a 0 2024-01-31T05:13:09.844 INFO:tasks.workunit.client.0.smithi099.stdout:0/173: symlink d1/l39 0 2024-01-31T05:13:09.844 INFO:tasks.workunit.client.0.smithi099.stdout:0/174: getdents d1/d8/df/d2e 0 2024-01-31T05:13:09.844 INFO:tasks.workunit.client.0.smithi099.stdout:0/175: write d1/d16/f31 [700558,34780] 0 2024-01-31T05:13:09.845 INFO:tasks.workunit.client.0.smithi099.stdout:8/276: creat d1/dd/d11/d19/f53 x:0 0 0 2024-01-31T05:13:09.845 INFO:tasks.workunit.client.0.smithi099.stdout:8/277: fsync d1/dd/d11/d19/f1f 0 2024-01-31T05:13:09.845 INFO:tasks.workunit.client.0.smithi099.stdout:8/278: dread - d1/dd/d15/f3b zero size 2024-01-31T05:13:09.846 INFO:tasks.workunit.client.0.smithi099.stdout:7/181: truncate d6/f1f 974008 0 2024-01-31T05:13:09.849 INFO:tasks.workunit.client.0.smithi099.stdout:3/182: dread fa [0,4194304] 0 2024-01-31T05:13:09.849 INFO:tasks.workunit.client.0.smithi099.stdout:2/194: dwrite d10/f1a [4194304,4194304] 0 2024-01-31T05:13:09.851 INFO:tasks.workunit.client.0.smithi099.stdout:8/279: write d1/dd/d15/f24 [3965174,101714] 0 2024-01-31T05:13:09.851 INFO:tasks.workunit.client.0.smithi099.stdout:8/280: truncate d1/dd/d11/d19/f1c 4325421 0 2024-01-31T05:13:09.852 INFO:tasks.workunit.client.0.smithi099.stdout:4/234: dwrite d0/d8/d19/f2d [0,4194304] 0 2024-01-31T05:13:09.853 INFO:tasks.workunit.client.0.smithi099.stdout:0/176: symlink d1/d16/l3a 0 2024-01-31T05:13:09.853 INFO:tasks.workunit.client.0.smithi099.stdout:0/177: fsync d1/d8/df/f32 0 2024-01-31T05:13:09.857 INFO:tasks.workunit.client.0.smithi099.stdout:7/182: dread d6/fc [0,4194304] 0 2024-01-31T05:13:09.857 INFO:tasks.workunit.client.0.smithi099.stdout:2/195: link d10/d20/c38 d10/d1b/c41 0 2024-01-31T05:13:09.858 INFO:tasks.workunit.client.0.smithi099.stdout:3/183: mkdir d10/d27/d34/d44 0 2024-01-31T05:13:09.859 INFO:tasks.workunit.client.0.smithi099.stdout:4/235: link d0/d8/d19/c55 d0/d8/c57 0 2024-01-31T05:13:09.861 INFO:tasks.workunit.client.0.smithi099.stdout:0/178: rename d1/d8/c11 to d1/d37/c3b 0 2024-01-31T05:13:09.862 INFO:tasks.workunit.client.0.smithi099.stdout:2/196: creat d10/f42 x:0 0 0 2024-01-31T05:13:09.865 INFO:tasks.workunit.client.0.smithi099.stdout:2/197: mkdir d10/d1c/d43 0 2024-01-31T05:13:09.867 INFO:tasks.workunit.client.0.smithi099.stdout:0/179: unlink d1/c7 0 2024-01-31T05:13:09.867 INFO:tasks.workunit.client.0.smithi099.stdout:0/180: fsync d1/d8/f35 0 2024-01-31T05:13:09.867 INFO:tasks.workunit.client.0.smithi099.stdout:0/181: stat d1/d8/df/f15 0 2024-01-31T05:13:09.869 INFO:tasks.workunit.client.0.smithi099.stdout:2/198: truncate f4 651017 0 2024-01-31T05:13:09.869 INFO:tasks.workunit.client.0.smithi099.stdout:2/199: truncate d10/d20/f40 20368 0 2024-01-31T05:13:09.869 INFO:tasks.workunit.client.0.smithi099.stdout:2/200: readlink d10/d1b/l27 0 2024-01-31T05:13:09.877 INFO:tasks.workunit.client.0.smithi099.stdout:1/179: dwrite d4/dc/d15/f20 [4194304,4194304] 0 2024-01-31T05:13:09.877 INFO:tasks.workunit.client.0.smithi099.stdout:1/180: rename d4 to d4/db/d35 22 2024-01-31T05:13:09.877 INFO:tasks.workunit.client.0.smithi099.stdout:1/181: chown d4/df/l1d 15211084 1 2024-01-31T05:13:09.877 INFO:tasks.workunit.client.0.smithi099.stdout:1/182: stat d4/db/f25 0 2024-01-31T05:13:09.880 INFO:tasks.workunit.client.0.smithi099.stdout:2/201: write d10/d1c/f26 [3679631,62638] 0 2024-01-31T05:13:09.889 INFO:tasks.workunit.client.0.smithi099.stdout:8/281: dwrite d1/dd/d15/f3d [0,4194304] 0 2024-01-31T05:13:09.889 INFO:tasks.workunit.client.0.smithi099.stdout:8/282: write d1/dd/d11/d19/f53 [744598,129618] 0 2024-01-31T05:13:09.889 INFO:tasks.workunit.client.0.smithi099.stdout:8/283: fsync d1/dd/f2b 0 2024-01-31T05:13:09.889 INFO:tasks.workunit.client.0.smithi099.stdout:7/183: dwrite d6/d12/f1a [0,4194304] 0 2024-01-31T05:13:09.889 INFO:tasks.workunit.client.0.smithi099.stdout:7/184: truncate d6/d12/f22 915974 0 2024-01-31T05:13:09.889 INFO:tasks.workunit.client.0.smithi099.stdout:1/183: creat d4/dc/d29/f36 x:0 0 0 2024-01-31T05:13:09.889 INFO:tasks.workunit.client.0.smithi099.stdout:1/184: truncate d4/db/f25 938607 0 2024-01-31T05:13:09.889 INFO:tasks.workunit.client.0.smithi099.stdout:1/185: readlink d4/db/l13 0 2024-01-31T05:13:09.890 INFO:tasks.workunit.client.0.smithi099.stdout:1/186: write d4/dc/d15/f20 [9232178,62217] 0 2024-01-31T05:13:09.890 INFO:tasks.workunit.client.0.smithi099.stdout:2/202: symlink d10/d1c/d43/l44 0 2024-01-31T05:13:09.892 INFO:tasks.workunit.client.0.smithi099.stdout:4/236: dwrite d0/d2/d20/d21/d17/f25 [0,4194304] 0 2024-01-31T05:13:09.893 INFO:tasks.workunit.client.0.smithi099.stdout:0/182: dwrite d1/f20 [0,4194304] 0 2024-01-31T05:13:09.894 INFO:tasks.workunit.client.0.smithi099.stdout:3/184: write fa [4918755,109573] 0 2024-01-31T05:13:09.900 INFO:tasks.workunit.client.0.smithi099.stdout:1/187: mkdir d4/df/d37 0 2024-01-31T05:13:09.900 INFO:tasks.workunit.client.0.smithi099.stdout:1/188: stat d4/dc/c16 0 2024-01-31T05:13:09.901 INFO:tasks.workunit.client.0.smithi099.stdout:1/189: chown d4/db/f25 614 1 2024-01-31T05:13:09.902 INFO:tasks.workunit.client.0.smithi099.stdout:8/284: rmdir d1/dd/d15/d2e 39 2024-01-31T05:13:09.907 INFO:tasks.workunit.client.0.smithi099.stdout:4/237: link d0/d2/c40 d0/d2/d20/d21/d17/d3d/c58 0 2024-01-31T05:13:09.909 INFO:tasks.workunit.client.0.smithi099.stdout:0/183: symlink d1/d16/d36/l3c 0 2024-01-31T05:13:09.910 INFO:tasks.workunit.client.0.smithi099.stdout:3/185: symlink d10/d24/d40/l45 0 2024-01-31T05:13:09.910 INFO:tasks.workunit.client.0.smithi099.stdout:7/185: rmdir d6/d13/d33 39 2024-01-31T05:13:09.913 INFO:tasks.workunit.client.0.smithi099.stdout:1/190: rename d4/db/c1e to d4/dc/c38 0 2024-01-31T05:13:09.913 INFO:tasks.workunit.client.0.smithi099.stdout:1/191: creat d4/dc/d15/f39 x:0 0 0 2024-01-31T05:13:09.913 INFO:tasks.workunit.client.0.smithi099.stdout:1/192: chown d4/dc/d29/c30 1 1 2024-01-31T05:13:09.914 INFO:tasks.workunit.client.0.smithi099.stdout:2/203: symlink d10/l45 0 2024-01-31T05:13:09.914 INFO:tasks.workunit.client.0.smithi099.stdout:2/204: dread - d10/f42 zero size 2024-01-31T05:13:09.914 INFO:tasks.workunit.client.0.smithi099.stdout:3/186: dread d10/f23 [0,4194304] 0 2024-01-31T05:13:09.915 INFO:tasks.workunit.client.0.smithi099.stdout:4/238: mkdir d0/d2/d20/d21/d59 0 2024-01-31T05:13:09.916 INFO:tasks.workunit.client.0.smithi099.stdout:2/205: dread d10/d1c/f2d [0,4194304] 0 2024-01-31T05:13:09.917 INFO:tasks.workunit.client.0.smithi099.stdout:0/184: creat d1/d16/d36/f3d x:0 0 0 2024-01-31T05:13:09.917 INFO:tasks.workunit.client.0.smithi099.stdout:7/186: rmdir d6/d13 39 2024-01-31T05:13:09.917 INFO:tasks.workunit.client.0.smithi099.stdout:4/239: dread d0/d1e/f35 [0,4194304] 0 2024-01-31T05:13:09.918 INFO:tasks.workunit.client.0.smithi099.stdout:4/240: read d0/f3 [711248,45812] 0 2024-01-31T05:13:09.919 INFO:tasks.workunit.client.0.smithi099.stdout:4/241: dread d0/f3 [0,4194304] 0 2024-01-31T05:13:09.920 INFO:tasks.workunit.client.0.smithi099.stdout:4/242: write d0/f3 [216850,59970] 0 2024-01-31T05:13:09.920 INFO:tasks.workunit.client.0.smithi099.stdout:4/243: chown d0/d2/l1f 1624 1 2024-01-31T05:13:09.920 INFO:tasks.workunit.client.0.smithi099.stdout:8/285: rename d1/dd/d11/d19/f36 to d1/dd/d11/d29/d3a/f54 0 2024-01-31T05:13:09.922 INFO:tasks.workunit.client.0.smithi099.stdout:1/193: truncate d4/f6 1972176 0 2024-01-31T05:13:09.922 INFO:tasks.workunit.client.0.smithi099.stdout:1/194: chown d4/df 10815 1 2024-01-31T05:13:09.922 INFO:tasks.workunit.client.0.smithi099.stdout:5/224: sync 2024-01-31T05:13:09.923 INFO:tasks.workunit.client.0.smithi099.stdout:5/225: write d6/d1e/d1f/f3a [619346,33052] 0 2024-01-31T05:13:09.923 INFO:tasks.workunit.client.0.smithi099.stdout:3/187: mknod d10/d27/c46 0 2024-01-31T05:13:09.925 INFO:tasks.workunit.client.0.smithi099.stdout:2/206: symlink d10/d1c/d43/l46 0 2024-01-31T05:13:09.925 INFO:tasks.workunit.client.0.smithi099.stdout:2/207: readlink d10/d3a/l3e 0 2024-01-31T05:13:09.925 INFO:tasks.workunit.client.0.smithi099.stdout:2/208: chown d10/d1b 1027454 1 2024-01-31T05:13:09.927 INFO:tasks.workunit.client.0.smithi099.stdout:0/185: link d1/f2c d1/d16/d36/f3e 0 2024-01-31T05:13:09.927 INFO:tasks.workunit.client.0.smithi099.stdout:0/186: truncate d1/d16/f1c 4753458 0 2024-01-31T05:13:09.927 INFO:tasks.workunit.client.0.smithi099.stdout:0/187: dread - d1/d16/f2f zero size 2024-01-31T05:13:09.927 INFO:tasks.workunit.client.0.smithi099.stdout:0/188: creat d1/d8/f3f x:0 0 0 2024-01-31T05:13:09.927 INFO:tasks.workunit.client.0.smithi099.stdout:0/189: stat d1/f2c 0 2024-01-31T05:13:09.927 INFO:tasks.workunit.client.0.smithi099.stdout:7/187: mkdir d6/d13/d33/d37 0 2024-01-31T05:13:09.932 INFO:tasks.workunit.client.0.smithi099.stdout:1/195: mkdir d4/db/d3a 0 2024-01-31T05:13:09.933 INFO:tasks.workunit.client.0.smithi099.stdout:5/226: creat d6/d1e/d1f/f42 x:0 0 0 2024-01-31T05:13:09.933 INFO:tasks.workunit.client.0.smithi099.stdout:5/227: truncate d6/d1e/f3c 980343 0 2024-01-31T05:13:09.933 INFO:tasks.workunit.client.0.smithi099.stdout:5/228: chown d6/le 21 1 2024-01-31T05:13:09.935 INFO:tasks.workunit.client.0.smithi099.stdout:7/188: write f2 [942918,114468] 0 2024-01-31T05:13:09.935 INFO:tasks.workunit.client.0.smithi099.stdout:7/189: chown d6/d13/c26 53582100 1 2024-01-31T05:13:09.936 INFO:tasks.workunit.client.0.smithi099.stdout:3/188: rename fa to d10/d24/d40/f47 0 2024-01-31T05:13:09.946 INFO:tasks.workunit.client.0.smithi099.stdout:8/286: dwrite d1/dd/d11/d29/d3f/f48 [0,4194304] 0 2024-01-31T05:13:09.947 INFO:tasks.workunit.client.0.smithi099.stdout:2/209: rename d10/d2b/l2f to d10/l47 0 2024-01-31T05:13:09.947 INFO:tasks.workunit.client.0.smithi099.stdout:2/210: write d10/d1b/f23 [4382367,90205] 0 2024-01-31T05:13:09.947 INFO:tasks.workunit.client.0.smithi099.stdout:2/211: stat d10/d3a 0 2024-01-31T05:13:09.948 INFO:tasks.workunit.client.0.smithi099.stdout:9/144: sync 2024-01-31T05:13:09.948 INFO:tasks.workunit.client.0.smithi099.stdout:6/171: sync 2024-01-31T05:13:09.949 INFO:tasks.workunit.client.0.smithi099.stdout:8/287: mknod d1/dd/d11/d19/d21/c55 0 2024-01-31T05:13:09.949 INFO:tasks.workunit.client.0.smithi099.stdout:8/288: chown d1/dd/d15/f44 23201 1 2024-01-31T05:13:09.951 INFO:tasks.workunit.client.0.smithi099.stdout:9/145: mknod d0/d1/d24/d2b/c31 0 2024-01-31T05:13:09.952 INFO:tasks.workunit.client.0.smithi099.stdout:5/229: write d6/d1e/d1f/f22 [132266,33066] 0 2024-01-31T05:13:09.952 INFO:tasks.workunit.client.0.smithi099.stdout:5/230: chown l0 244 1 2024-01-31T05:13:09.953 INFO:tasks.workunit.client.0.smithi099.stdout:6/172: creat d14/d18/d1a/d1c/f34 x:0 0 0 2024-01-31T05:13:09.954 INFO:tasks.workunit.client.0.smithi099.stdout:8/289: mkdir d1/dd/d11/d29/d3f/d56 0 2024-01-31T05:13:09.954 INFO:tasks.workunit.client.0.smithi099.stdout:8/290: fdatasync d1/dd/d11/d20/f3e 0 2024-01-31T05:13:09.955 INFO:tasks.workunit.client.0.smithi099.stdout:7/190: rename d6/ce to d6/d32/c38 0 2024-01-31T05:13:09.955 INFO:tasks.workunit.client.0.smithi099.stdout:7/191: chown d6/d13/f23 0 1 2024-01-31T05:13:09.956 INFO:tasks.workunit.client.0.smithi099.stdout:2/212: symlink d10/l48 0 2024-01-31T05:13:09.956 INFO:tasks.workunit.client.0.smithi099.stdout:2/213: chown d10/f11 11 1 2024-01-31T05:13:09.957 INFO:tasks.workunit.client.0.smithi099.stdout:8/291: dread d1/dd/d15/f22 [0,4194304] 0 2024-01-31T05:13:09.958 INFO:tasks.workunit.client.0.smithi099.stdout:9/146: symlink d0/d7/l32 0 2024-01-31T05:13:09.959 INFO:tasks.workunit.client.0.smithi099.stdout:9/147: fsync d0/d1/d24/d2b/f17 0 2024-01-31T05:13:09.959 INFO:tasks.workunit.client.0.smithi099.stdout:7/192: mknod d6/d1e/d25/c39 0 2024-01-31T05:13:09.960 INFO:tasks.workunit.client.0.smithi099.stdout:8/292: unlink d1/l6 0 2024-01-31T05:13:09.960 INFO:tasks.workunit.client.0.smithi099.stdout:8/293: fdatasync d1/dd/d11/f32 0 2024-01-31T05:13:09.961 INFO:tasks.workunit.client.0.smithi099.stdout:7/193: symlink d6/d12/l3a 0 2024-01-31T05:13:09.963 INFO:tasks.workunit.client.0.smithi099.stdout:8/294: truncate d1/dd/d11/d29/d3a/f54 172956 0 2024-01-31T05:13:09.963 INFO:tasks.workunit.client.0.smithi099.stdout:4/244: rmdir d0/d2 39 2024-01-31T05:13:09.965 INFO:tasks.workunit.client.0.smithi099.stdout:7/194: mknod d6/d32/c3b 0 2024-01-31T05:13:09.967 INFO:tasks.workunit.client.0.smithi099.stdout:8/295: mkdir d1/dd/d11/d29/d3f/d56/d57 0 2024-01-31T05:13:09.969 INFO:tasks.workunit.client.0.smithi099.stdout:4/245: unlink d0/d8/f27 0 2024-01-31T05:13:09.973 INFO:tasks.workunit.client.0.smithi099.stdout:4/246: mkdir d0/d2/d20/d21/d17/d24/d5a 0 2024-01-31T05:13:09.976 INFO:tasks.workunit.client.0.smithi099.stdout:4/247: unlink d0/d1e/f36 0 2024-01-31T05:13:09.977 INFO:tasks.workunit.client.0.smithi099.stdout:1/196: dwrite d4/dc/d15/f32 [0,4194304] 0 2024-01-31T05:13:09.977 INFO:tasks.workunit.client.0.smithi099.stdout:1/197: creat d4/dc/d29/f3b x:0 0 0 2024-01-31T05:13:09.977 INFO:tasks.workunit.client.0.smithi099.stdout:1/198: write d4/df/f2a [1734292,117557] 0 2024-01-31T05:13:09.978 INFO:tasks.workunit.client.0.smithi099.stdout:3/189: dwrite d10/d27/f30 [0,4194304] 0 2024-01-31T05:13:09.981 INFO:tasks.workunit.client.0.smithi099.stdout:1/199: mknod d4/db/c3c 0 2024-01-31T05:13:09.981 INFO:tasks.workunit.client.0.smithi099.stdout:1/200: creat d4/db/d24/d28/f3d x:0 0 0 2024-01-31T05:13:09.981 INFO:tasks.workunit.client.0.smithi099.stdout:0/190: dwrite d1/d16/d36/f3e [0,4194304] 0 2024-01-31T05:13:09.982 INFO:tasks.workunit.client.0.smithi099.stdout:0/191: readlink d1/le 0 2024-01-31T05:13:09.988 INFO:tasks.workunit.client.0.smithi099.stdout:3/190: mknod d10/d27/d34/d44/c48 0 2024-01-31T05:13:09.990 INFO:tasks.workunit.client.0.smithi099.stdout:1/201: link d4/db/d24/d28/f31 d4/df/f3e 0 2024-01-31T05:13:09.990 INFO:tasks.workunit.client.0.smithi099.stdout:1/202: write d4/dc/d15/f33 [1264749,56046] 0 2024-01-31T05:13:09.990 INFO:tasks.workunit.client.0.smithi099.stdout:1/203: write d4/f6 [2758455,8171] 0 2024-01-31T05:13:09.991 INFO:tasks.workunit.client.0.smithi099.stdout:3/191: creat d10/d27/f49 x:0 0 0 2024-01-31T05:13:09.995 INFO:tasks.workunit.client.0.smithi099.stdout:6/173: dwrite d14/f15 [0,4194304] 0 2024-01-31T05:13:09.996 INFO:tasks.workunit.client.0.smithi099.stdout:8/296: truncate d1/dd/d11/d29/d3f/f48 2271876 0 2024-01-31T05:13:09.996 INFO:tasks.workunit.client.0.smithi099.stdout:8/297: truncate d1/dd/d11/f32 2072690 0 2024-01-31T05:13:09.996 INFO:tasks.workunit.client.0.smithi099.stdout:8/298: write d1/dd/d11/d19/d21/d3c/f46 [479704,32262] 0 2024-01-31T05:13:09.997 INFO:tasks.workunit.client.0.smithi099.stdout:2/214: dwrite d10/f1a [0,4194304] 0 2024-01-31T05:13:09.999 INFO:tasks.workunit.client.0.smithi099.stdout:8/299: getdents d1/dd/d15/d2e 0 2024-01-31T05:13:10.002 INFO:tasks.workunit.client.0.smithi099.stdout:2/215: symlink d10/d2b/l49 0 2024-01-31T05:13:10.002 INFO:tasks.workunit.client.0.smithi099.stdout:2/216: fdatasync d10/f33 0 2024-01-31T05:13:10.004 INFO:tasks.workunit.client.0.smithi099.stdout:8/300: creat d1/dd/d11/d29/f58 x:0 0 0 2024-01-31T05:13:10.006 INFO:tasks.workunit.client.0.smithi099.stdout:2/217: unlink d10/d1c/l3c 0 2024-01-31T05:13:10.009 INFO:tasks.workunit.client.0.smithi099.stdout:8/301: creat d1/dd/d11/d29/d3f/d56/d57/f59 x:0 0 0 2024-01-31T05:13:10.009 INFO:tasks.workunit.client.0.smithi099.stdout:8/302: readlink l0 0 2024-01-31T05:13:10.011 INFO:tasks.workunit.client.0.smithi099.stdout:2/218: symlink d10/d1c/l4a 0 2024-01-31T05:13:10.013 INFO:tasks.workunit.client.0.smithi099.stdout:8/303: symlink d1/dd/d11/l5a 0 2024-01-31T05:13:10.013 INFO:tasks.workunit.client.0.smithi099.stdout:8/304: readlink d1/dd/d15/l39 0 2024-01-31T05:13:10.013 INFO:tasks.workunit.client.0.smithi099.stdout:5/231: dwrite f4 [4194304,4194304] 0 2024-01-31T05:13:10.013 INFO:tasks.workunit.client.0.smithi099.stdout:5/232: chown d6/f18 676610 1 2024-01-31T05:13:10.015 INFO:tasks.workunit.client.0.smithi099.stdout:2/219: rename d10/d1c/d43/l46 to d10/d1c/l4b 0 2024-01-31T05:13:10.015 INFO:tasks.workunit.client.0.smithi099.stdout:4/248: dwrite d0/d2/f47 [0,4194304] 0 2024-01-31T05:13:10.015 INFO:tasks.workunit.client.0.smithi099.stdout:2/220: creat d10/d20/f4c x:0 0 0 2024-01-31T05:13:10.016 INFO:tasks.workunit.client.0.smithi099.stdout:5/233: link d6/d1e/d1f/d21/f27 d6/d1e/f43 0 2024-01-31T05:13:10.019 INFO:tasks.workunit.client.0.smithi099.stdout:4/249: unlink d0/d2/f1d 0 2024-01-31T05:13:10.021 INFO:tasks.workunit.client.0.smithi099.stdout:2/221: mkdir d10/d1b/d4d 0 2024-01-31T05:13:10.021 INFO:tasks.workunit.client.0.smithi099.stdout:2/222: dread - d10/f33 zero size 2024-01-31T05:13:10.023 INFO:tasks.workunit.client.0.smithi099.stdout:4/250: creat d0/f5b x:0 0 0 2024-01-31T05:13:10.025 INFO:tasks.workunit.client.0.smithi099.stdout:2/223: rename d10/d1b/c41 to d10/d2b/c4e 0 2024-01-31T05:13:10.027 INFO:tasks.workunit.client.0.smithi099.stdout:8/305: dread d1/dd/d11/f32 [0,4194304] 0 2024-01-31T05:13:10.027 INFO:tasks.workunit.client.0.smithi099.stdout:8/306: chown d1/dd 226946138 1 2024-01-31T05:13:10.027 INFO:tasks.workunit.client.0.smithi099.stdout:4/251: rename d0/d8/d19/c55 to d0/d2/d20/d21/c5c 0 2024-01-31T05:13:10.029 INFO:tasks.workunit.client.0.smithi099.stdout:9/148: dwrite d0/d1/f1d [0,4194304] 0 2024-01-31T05:13:10.030 INFO:tasks.workunit.client.0.smithi099.stdout:9/149: readlink d0/d1/l19 0 2024-01-31T05:13:10.030 INFO:tasks.workunit.client.0.smithi099.stdout:7/195: dwrite d6/d12/f1a [0,4194304] 0 2024-01-31T05:13:10.030 INFO:tasks.workunit.client.0.smithi099.stdout:7/196: chown d6/d1e/l2d 12 1 2024-01-31T05:13:10.030 INFO:tasks.workunit.client.0.smithi099.stdout:7/197: readlink d6/lb 0 2024-01-31T05:13:10.030 INFO:tasks.workunit.client.0.smithi099.stdout:7/198: dread - d6/f30 zero size 2024-01-31T05:13:10.030 INFO:tasks.workunit.client.0.smithi099.stdout:8/307: mknod d1/c5b 0 2024-01-31T05:13:10.032 INFO:tasks.workunit.client.0.smithi099.stdout:1/204: dwrite d4/db/d24/d28/f31 [0,4194304] 0 2024-01-31T05:13:10.032 INFO:tasks.workunit.client.0.smithi099.stdout:3/192: dwrite d10/d27/f29 [0,4194304] 0 2024-01-31T05:13:10.035 INFO:tasks.workunit.client.0.smithi099.stdout:8/308: dread d1/dd/d11/d19/f53 [0,4194304] 0 2024-01-31T05:13:10.037 INFO:tasks.workunit.client.0.smithi099.stdout:5/234: dwrite d6/da/d14/f20 [0,4194304] 0 2024-01-31T05:13:10.044 INFO:tasks.workunit.client.0.smithi099.stdout:7/199: creat d6/d12/f3c x:0 0 0 2024-01-31T05:13:10.044 INFO:tasks.workunit.client.0.smithi099.stdout:3/193: mkdir d10/d32/d33/d4a 0 2024-01-31T05:13:10.044 INFO:tasks.workunit.client.0.smithi099.stdout:7/200: chown d6/d13/c2a 21308 1 2024-01-31T05:13:10.045 INFO:tasks.workunit.client.0.smithi099.stdout:4/252: write d0/d8/d19/f2d [771126,44986] 0 2024-01-31T05:13:10.045 INFO:tasks.workunit.client.0.smithi099.stdout:1/205: write d4/dc/d15/f1a [2109384,85209] 0 2024-01-31T05:13:10.045 INFO:tasks.workunit.client.0.smithi099.stdout:8/309: creat d1/dd/d11/d19/d21/f5c x:0 0 0 2024-01-31T05:13:10.048 INFO:tasks.workunit.client.0.smithi099.stdout:7/201: mkdir d6/d32/d3d 0 2024-01-31T05:13:10.048 INFO:tasks.workunit.client.0.smithi099.stdout:7/202: dread - d6/d13/f2f zero size 2024-01-31T05:13:10.050 INFO:tasks.workunit.client.0.smithi099.stdout:9/150: write d0/d7/f13 [2862519,53007] 0 2024-01-31T05:13:10.050 INFO:tasks.workunit.client.0.smithi099.stdout:3/194: symlink d10/d24/d40/l4b 0 2024-01-31T05:13:10.050 INFO:tasks.workunit.client.0.smithi099.stdout:3/195: chown d10/d24/f38 3135543 1 2024-01-31T05:13:10.051 INFO:tasks.workunit.client.0.smithi099.stdout:2/224: dwrite d10/d1c/f2d [0,4194304] 0 2024-01-31T05:13:10.051 INFO:tasks.workunit.client.0.smithi099.stdout:2/225: stat d10/d20/f4c 0 2024-01-31T05:13:10.052 INFO:tasks.workunit.client.0.smithi099.stdout:4/253: link d0/d8/c2a d0/d2/d4b/c5d 0 2024-01-31T05:13:10.052 INFO:tasks.workunit.client.0.smithi099.stdout:4/254: write d0/fd [3578335,62465] 0 2024-01-31T05:13:10.054 INFO:tasks.workunit.client.0.smithi099.stdout:1/206: symlink d4/df/d37/l3f 0 2024-01-31T05:13:10.055 INFO:tasks.workunit.client.0.smithi099.stdout:8/310: creat d1/dd/d4f/d51/f5d x:0 0 0 2024-01-31T05:13:10.055 INFO:tasks.workunit.client.0.smithi099.stdout:7/203: creat d6/d1e/f3e x:0 0 0 2024-01-31T05:13:10.057 INFO:tasks.workunit.client.0.smithi099.stdout:5/235: dwrite d6/ff [0,4194304] 0 2024-01-31T05:13:10.058 INFO:tasks.workunit.client.0.smithi099.stdout:5/236: write d6/d1e/d1f/f3a [1769750,80592] 0 2024-01-31T05:13:10.058 INFO:tasks.workunit.client.0.smithi099.stdout:5/237: stat d6/d1e/d1f/d21/f27 0 2024-01-31T05:13:10.059 INFO:tasks.workunit.client.0.smithi099.stdout:9/151: mkdir d0/d29/d33 0 2024-01-31T05:13:10.059 INFO:tasks.workunit.client.0.smithi099.stdout:9/152: write d0/d7/f28 [1042461,124959] 0 2024-01-31T05:13:10.059 INFO:tasks.workunit.client.0.smithi099.stdout:9/153: stat d0/d1/d24/d2b/f1b 0 2024-01-31T05:13:10.061 INFO:tasks.workunit.client.0.smithi099.stdout:3/196: symlink d10/d24/l4c 0 2024-01-31T05:13:10.061 INFO:tasks.workunit.client.0.smithi099.stdout:3/197: chown d10/d24/c41 533007416 1 2024-01-31T05:13:10.065 INFO:tasks.workunit.client.0.smithi099.stdout:2/226: creat d10/d3a/f4f x:0 0 0 2024-01-31T05:13:10.066 INFO:tasks.workunit.client.0.smithi099.stdout:4/255: symlink d0/d2/d20/d21/d39/l5e 0 2024-01-31T05:13:10.067 INFO:tasks.workunit.client.0.smithi099.stdout:8/311: creat d1/f5e x:0 0 0 2024-01-31T05:13:10.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:10.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f45 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/utsname/Makefile) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002170 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/utsname/runtests_noltp.sh) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f46 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/utsname/README) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f44 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/utsname/utstest.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f48 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/utsname/runutstest.sh) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f47 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/utsname/check_utsns_enabled.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:10.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000233d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/stat/selinux_stat.sh) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000253d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/stat/Makefile) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:10.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:10.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:10.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:10.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:10.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:10.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022a7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/user_space) see mds.c log and `damage ls` output for details 2024-01-31T05:13:10.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022a8 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/user_space/user_tdrm.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:10.070 INFO:tasks.workunit.client.0.smithi099.stdout:7/204: creat d6/f3f x:0 0 0 2024-01-31T05:13:10.071 INFO:tasks.workunit.client.0.smithi099.stdout:7/205: dread - d6/f3f zero size 2024-01-31T05:13:10.071 INFO:tasks.workunit.client.0.smithi099.stdout:7/206: truncate d6/d13/f2f 399573 0 2024-01-31T05:13:10.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000020fe (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/user_space/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:10.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022a9 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space) see mds.c log and `damage ls` output for details 2024-01-31T05:13:10.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:10.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:10.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001eb7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/pthreads/Makefile) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001eb9 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/pthreads/pth_str03.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001eba (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/pthreads/pth_str02.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001eb8 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/pthreads/pth_str01.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000205f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/pthreads/pth_str01.h) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:10.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001cd8 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/vmtests/data_space.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001cd7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/vmtests/stack_space.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001ee4 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/vmtests/Makefile) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:10.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000022c4 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/connectors/pec/event_generator.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002122 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/connectors/pec/run_pec_test) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002123 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/connectors/pec/pec_listener.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002120 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/connectors/pec/Makefile) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002121 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/connectors/pec/README) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:10.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000218e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/writetest/Makefile) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001fbd (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/writetest/writetest.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001fbe (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/writetest/gpl.txt) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:10.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000024ba (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/personality/Makefile) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000024bb (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/personality/personality01.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002721 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/personality/personality02.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:10.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:10.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:10.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000244d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/wait4/wait401.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000244c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/wait4/wait402.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000026bd (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/wait4/Makefile) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:10.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000026a3 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setegid/Makefile) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000242a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setegid/setegid01.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.075 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:10.075 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000024eb (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigsuspend/sigsuspend01.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:10.075 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002740 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigsuspend/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:10.075 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.075 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:10.075 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000247a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresgid/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:10.075 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000247b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresgid/getresgid03.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:10.075 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000247c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresgid/getresgid02.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:10.075 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000026df (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresgid/getresgid01.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:10.075 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.075 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:10.075 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000272f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/recvmsg/Makefile) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.075 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000024cf (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/recvmsg/recvmsg01.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.075 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.075 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: pgmap v402: 97 pgs: 97 active+clean; 120 MiB data, 805 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 8.6 MiB/s wr, 2.20k op/s 2024-01-31T05:13:10.076 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:10.076 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000027f0 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/renameat/Makefile) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.076 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000025e3 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/renameat/renameat01.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.076 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:10.076 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.076 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000238f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/waitid/waitid02.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:10.076 INFO:tasks.workunit.client.0.smithi099.stdout:5/238: link d6/d1e/d1f/f42 d6/da/d14/d2b/f44 0 2024-01-31T05:13:10.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000238e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/waitid/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:10.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002574 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/waitid/waitid01.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:10.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:10.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:10.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:10.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:10.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:10.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:10.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002592 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll_create1/Makefile) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:10.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000026f1 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sgetmask/sgetmask01.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000023bb (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll_create1/epoll_create1_01.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002489 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sgetmask/Makefile) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000246d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/access/access03.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000246f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/access/Makefile) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000026d5 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/access/access02.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002470 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/access/access01.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002471 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/access/access05.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000246e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/access/access04.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:10.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:10.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000271d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/exit_group/exit_group01.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:10.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000024b7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/exit_group/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:10.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:10.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002492 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pathconf/pathconf01.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:10.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000026fb (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pathconf/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:10.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:10.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002491 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sched_yield/Makefile) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000026f9 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sched_yield/sched_yield01.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:10.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:10.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001c7b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/testfrmw.h) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001c26 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/Makefile) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001dc1 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/stress.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001c7c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/NOTES) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001c7d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/LICENCE) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001c27 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/testfrmw.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:10.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:10.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:10.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:10.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:10.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:09 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.082 INFO:tasks.workunit.client.0.smithi099.stdout:4/256: dread d0/d8/d19/f44 [0,4194304] 0 2024-01-31T05:13:10.082 INFO:tasks.workunit.client.0.smithi099.stdout:2/227: read d10/f31 [2726476,115192] 0 2024-01-31T05:13:10.082 INFO:tasks.workunit.client.0.smithi099.stdout:2/228: creat d10/d20/f50 x:0 0 0 2024-01-31T05:13:10.082 INFO:tasks.workunit.client.0.smithi099.stdout:3/198: mknod d10/d27/d34/d44/c4d 0 2024-01-31T05:13:10.083 INFO:tasks.workunit.client.0.smithi099.stdout:8/312: rename d1/dd/d11/d29/l37 to d1/dd/d11/d19/d21/l5f 0 2024-01-31T05:13:10.084 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:10.084 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f45 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/utsname/Makefile) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.084 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002170 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/utsname/runtests_noltp.sh) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.084 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f46 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/utsname/README) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.084 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f44 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/utsname/utstest.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.084 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f48 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/utsname/runutstest.sh) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.084 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f47 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/utsname/check_utsns_enabled.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.084 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.084 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:10.084 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000233d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/stat/selinux_stat.sh) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.084 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000253d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/stat/Makefile) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.085 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.085 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:10.085 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.085 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:10.085 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.085 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:10.085 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:10.085 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.085 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.085 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:10.085 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.085 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:10.085 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022a7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/user_space) see mds.c log and `damage ls` output for details 2024-01-31T05:13:10.085 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022a8 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/user_space/user_tdrm.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:10.086 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000020fe (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/user_space/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:10.086 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022a9 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space) see mds.c log and `damage ls` output for details 2024-01-31T05:13:10.086 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.086 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:10.086 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.086 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:10.086 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001eb7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/pthreads/Makefile) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.086 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001eb9 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/pthreads/pth_str03.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.086 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001eba (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/pthreads/pth_str02.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.086 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001eb8 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/pthreads/pth_str01.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.086 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000205f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/pthreads/pth_str01.h) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.086 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.086 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:10.086 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001cd8 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/vmtests/data_space.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.086 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001cd7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/vmtests/stack_space.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.087 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001ee4 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/vmtests/Makefile) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.087 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.087 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:10.087 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000022c4 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/connectors/pec/event_generator.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.087 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002122 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/connectors/pec/run_pec_test) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.087 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002123 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/connectors/pec/pec_listener.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.087 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002120 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/connectors/pec/Makefile) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.087 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002121 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/connectors/pec/README) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.087 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.087 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:10.087 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000218e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/writetest/Makefile) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.088 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001fbd (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/writetest/writetest.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.088 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001fbe (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/writetest/gpl.txt) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.088 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.088 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:10.088 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000024ba (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/personality/Makefile) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.088 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000024bb (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/personality/personality01.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.088 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002721 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/personality/personality02.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.088 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.088 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:10.088 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.088 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:10.088 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:10.088 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.089 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000244d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/wait4/wait401.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.089 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000244c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/wait4/wait402.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.089 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000026bd (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/wait4/Makefile) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.089 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.089 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:10.089 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000026a3 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setegid/Makefile) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.089 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000242a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setegid/setegid01.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.089 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.089 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:10.089 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000024eb (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigsuspend/sigsuspend01.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:10.089 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002740 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigsuspend/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:10.089 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.089 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:10.089 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000247a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresgid/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:10.090 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000247b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresgid/getresgid03.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:10.090 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000247c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresgid/getresgid02.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:10.090 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000026df (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresgid/getresgid01.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:10.090 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.090 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:10.090 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000272f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/recvmsg/Makefile) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.090 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000024cf (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/recvmsg/recvmsg01.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.090 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.090 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: pgmap v402: 97 pgs: 97 active+clean; 120 MiB data, 805 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 8.6 MiB/s wr, 2.20k op/s 2024-01-31T05:13:10.090 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:10.090 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000027f0 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/renameat/Makefile) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.090 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000025e3 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/renameat/renameat01.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.090 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:10.090 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.090 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000238f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/waitid/waitid02.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:10.091 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000238e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/waitid/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:10.091 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002574 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/waitid/waitid01.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:10.091 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.091 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:10.091 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.091 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:10.091 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.091 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:10.091 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.091 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:10.091 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.091 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:10.091 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.092 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:10.092 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002592 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll_create1/Makefile) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.092 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:10.092 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000026f1 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sgetmask/sgetmask01.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.092 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000023bb (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll_create1/epoll_create1_01.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.092 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002489 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sgetmask/Makefile) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.092 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.092 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000246d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/access/access03.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.092 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000246f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/access/Makefile) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.092 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000026d5 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/access/access02.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.092 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002470 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/access/access01.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.092 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002471 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/access/access05.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.092 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000246e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/access/access04.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.093 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.093 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:10.093 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.093 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:10.093 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000271d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/exit_group/exit_group01.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:10.093 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000024b7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/exit_group/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:10.093 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.093 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:10.093 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002492 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pathconf/pathconf01.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:10.093 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000026fb (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pathconf/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:10.093 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.093 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:10.093 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002491 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sched_yield/Makefile) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.093 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000026f9 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sched_yield/sched_yield01.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.093 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.094 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:10.094 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.094 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:10.094 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001c7b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/testfrmw.h) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.094 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001c26 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/Makefile) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.094 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001dc1 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/stress.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.094 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001c7c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/NOTES) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.094 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001c7d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/LICENCE) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.094 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001c27 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/testfrmw.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.094 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.094 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:10.094 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:10.094 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.094 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.094 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:10.095 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.095 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:10.095 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.095 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:10.095 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:09 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.096 INFO:tasks.workunit.client.0.smithi099.stdout:1/207: dwrite d4/db/d24/d28/f31 [0,4194304] 0 2024-01-31T05:13:10.097 INFO:tasks.workunit.client.0.smithi099.stdout:8/313: rename d1/dd/f49 to d1/dd/d15/d2e/f60 0 2024-01-31T05:13:10.097 INFO:tasks.workunit.client.0.smithi099.stdout:8/314: creat d1/dd/d11/d29/d3f/d56/d57/f61 x:0 0 0 2024-01-31T05:13:10.097 INFO:tasks.workunit.client.0.smithi099.stdout:8/315: write d1/dd/ff [1177758,62359] 0 2024-01-31T05:13:10.097 INFO:tasks.workunit.client.0.smithi099.stdout:5/239: dread d6/fd [0,4194304] 0 2024-01-31T05:13:10.097 INFO:tasks.workunit.client.0.smithi099.stdout:1/208: link d4/dc/c38 d4/dc/c40 0 2024-01-31T05:13:10.097 INFO:tasks.workunit.client.0.smithi099.stdout:1/209: creat d4/db/d24/f41 x:0 0 0 2024-01-31T05:13:10.097 INFO:tasks.workunit.client.0.smithi099.stdout:1/210: write d4/dc/d15/f33 [805791,107374] 0 2024-01-31T05:13:10.097 INFO:tasks.workunit.client.0.smithi099.stdout:8/316: unlink d1/dd/d11/d19/f1c 0 2024-01-31T05:13:10.097 INFO:tasks.workunit.client.0.smithi099.stdout:8/317: creat d1/dd/d11/d19/d21/f62 x:0 0 0 2024-01-31T05:13:10.097 INFO:tasks.workunit.client.0.smithi099.stdout:8/318: chown d1/dd/d11/d29/l45 8093 1 2024-01-31T05:13:10.097 INFO:tasks.workunit.client.0.smithi099.stdout:8/319: chown d1/dd/d11/l14 147 1 2024-01-31T05:13:10.097 INFO:tasks.workunit.client.0.smithi099.stdout:8/320: truncate d1/dd/d11/d20/f4b 773450 0 2024-01-31T05:13:10.097 INFO:tasks.workunit.client.0.smithi099.stdout:5/240: unlink d6/d1e/d1f/d21/l33 0 2024-01-31T05:13:10.098 INFO:tasks.workunit.client.0.smithi099.stdout:2/229: dwrite d10/d20/f37 [0,4194304] 0 2024-01-31T05:13:10.098 INFO:tasks.workunit.client.0.smithi099.stdout:2/230: write f1 [2861083,10471] 0 2024-01-31T05:13:10.098 INFO:tasks.workunit.client.0.smithi099.stdout:7/207: dwrite d6/d12/f1a [0,4194304] 0 2024-01-31T05:13:10.100 INFO:tasks.workunit.client.0.smithi099.stdout:5/241: creat d6/da/d3f/f45 x:0 0 0 2024-01-31T05:13:10.100 INFO:tasks.workunit.client.0.smithi099.stdout:5/242: getdents d6/da/d34 0 2024-01-31T05:13:10.101 INFO:tasks.workunit.client.0.smithi099.stdout:1/211: getdents d4/dc/d15 0 2024-01-31T05:13:10.101 INFO:tasks.workunit.client.0.smithi099.stdout:1/212: write d4/dc/d29/f3b [260159,14168] 0 2024-01-31T05:13:10.105 INFO:tasks.workunit.client.0.smithi099.stdout:3/199: rmdir d10/d32 39 2024-01-31T05:13:10.105 INFO:tasks.workunit.client.0.smithi099.stdout:7/208: truncate f3 350697 0 2024-01-31T05:13:10.105 INFO:tasks.workunit.client.0.smithi099.stdout:8/321: getdents d1/dd/d11/d29/d3f 0 2024-01-31T05:13:10.106 INFO:tasks.workunit.client.0.smithi099.stdout:1/213: rename d4/c18 to d4/db/d24/d28/c42 0 2024-01-31T05:13:10.107 INFO:tasks.workunit.client.0.smithi099.stdout:2/231: mkdir d10/d51 0 2024-01-31T05:13:10.109 INFO:tasks.workunit.client.0.smithi099.stdout:3/200: rename d10/d24/f35 to d10/d32/f4e 0 2024-01-31T05:13:10.109 INFO:tasks.workunit.client.0.smithi099.stdout:3/201: chown d10/d1e 523439069 1 2024-01-31T05:13:10.110 INFO:tasks.workunit.client.0.smithi099.stdout:2/232: creat d10/d3a/f52 x:0 0 0 2024-01-31T05:13:10.110 INFO:tasks.workunit.client.0.smithi099.stdout:2/233: stat d10/d1c/d43/l44 0 2024-01-31T05:13:10.111 INFO:tasks.workunit.client.0.smithi099.stdout:7/209: rename f2 to d6/d13/d33/d37/f40 0 2024-01-31T05:13:10.112 INFO:tasks.workunit.client.0.smithi099.stdout:3/202: symlink d10/d32/l4f 0 2024-01-31T05:13:10.114 INFO:tasks.workunit.client.0.smithi099.stdout:2/234: link d10/l17 d10/d51/l53 0 2024-01-31T05:13:10.115 INFO:tasks.workunit.client.0.smithi099.stdout:2/235: write d10/d3a/f4f [637008,106462] 0 2024-01-31T05:13:10.116 INFO:tasks.workunit.client.0.smithi099.stdout:3/203: unlink d10/d27/d34/d44/c4d 0 2024-01-31T05:13:10.117 INFO:tasks.workunit.client.0.smithi099.stdout:1/214: dread d4/dc/d15/f20 [0,4194304] 0 2024-01-31T05:13:10.118 INFO:tasks.workunit.client.0.smithi099.stdout:1/215: chown d4/df/d37 2016220 1 2024-01-31T05:13:10.118 INFO:tasks.workunit.client.0.smithi099.stdout:1/216: creat d4/dc/f43 x:0 0 0 2024-01-31T05:13:10.118 INFO:tasks.workunit.client.0.smithi099.stdout:1/217: dread - d4/dc/d15/f39 zero size 2024-01-31T05:13:10.118 INFO:tasks.workunit.client.0.smithi099.stdout:1/218: fsync d4/df/f2a 0 2024-01-31T05:13:10.119 INFO:tasks.workunit.client.0.smithi099.stdout:2/236: creat d10/d51/f54 x:0 0 0 2024-01-31T05:13:10.119 INFO:tasks.workunit.client.0.smithi099.stdout:2/237: creat d10/d1c/f55 x:0 0 0 2024-01-31T05:13:10.123 INFO:tasks.workunit.client.0.smithi099.stdout:1/219: mkdir d4/dc/d44 0 2024-01-31T05:13:10.123 INFO:tasks.workunit.client.0.smithi099.stdout:1/220: stat d4/dc/d15/f39 0 2024-01-31T05:13:10.123 INFO:tasks.workunit.client.0.smithi099.stdout:1/221: write d4/dc/d15/f32 [4666798,32036] 0 2024-01-31T05:13:10.126 INFO:tasks.workunit.client.0.smithi099.stdout:2/238: dread d10/d1c/f26 [0,4194304] 0 2024-01-31T05:13:10.127 INFO:tasks.workunit.client.0.smithi099.stdout:5/243: dwrite d6/d1e/d1f/f42 [0,4194304] 0 2024-01-31T05:13:10.130 INFO:tasks.workunit.client.0.smithi099.stdout:8/322: dwrite d1/dd/d11/f1e [0,4194304] 0 2024-01-31T05:13:10.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:10.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f45 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/utsname/Makefile) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002170 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/utsname/runtests_noltp.sh) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f46 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/utsname/README) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f44 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/utsname/utstest.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f48 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/utsname/runutstest.sh) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f47 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/utsname/check_utsns_enabled.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:10.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000233d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/stat/selinux_stat.sh) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000253d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/stat/Makefile) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:10.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:10.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:10.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:10.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:10.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:10.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022a7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/user_space) see mds.c log and `damage ls` output for details 2024-01-31T05:13:10.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022a8 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/user_space/user_tdrm.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:10.135 INFO:tasks.workunit.client.0.smithi099.stdout:1/222: mkdir d4/dc/d15/d45 0 2024-01-31T05:13:10.135 INFO:tasks.workunit.client.0.smithi099.stdout:1/223: fdatasync d4/df/f3e 0 2024-01-31T05:13:10.136 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000020fe (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/user_space/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:10.136 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022a9 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space) see mds.c log and `damage ls` output for details 2024-01-31T05:13:10.136 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.136 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:10.136 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.136 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:10.136 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001eb7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/pthreads/Makefile) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.136 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001eb9 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/pthreads/pth_str03.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.136 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001eba (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/pthreads/pth_str02.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.136 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001eb8 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/pthreads/pth_str01.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.137 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000205f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/pthreads/pth_str01.h) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.137 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.137 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:10.137 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001cd8 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/vmtests/data_space.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.137 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001cd7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/vmtests/stack_space.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.137 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001ee4 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/vmtests/Makefile) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.137 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.137 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:10.137 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000022c4 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/connectors/pec/event_generator.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.137 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002122 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/connectors/pec/run_pec_test) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.137 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002123 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/connectors/pec/pec_listener.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.137 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002120 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/connectors/pec/Makefile) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.137 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002121 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/connectors/pec/README) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.137 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.138 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:10.138 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000218e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/writetest/Makefile) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.138 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001fbd (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/writetest/writetest.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.138 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001fbe (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/writetest/gpl.txt) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.138 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.138 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:10.138 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000024ba (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/personality/Makefile) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.138 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000024bb (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/personality/personality01.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.138 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002721 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/personality/personality02.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.138 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.138 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:10.138 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.138 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:10.138 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:10.139 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.139 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000244d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/wait4/wait401.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.139 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000244c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/wait4/wait402.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.139 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000026bd (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/wait4/Makefile) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.139 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.139 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:10.139 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000026a3 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setegid/Makefile) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.139 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000242a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setegid/setegid01.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.139 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.139 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:10.139 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000024eb (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigsuspend/sigsuspend01.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:10.139 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002740 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigsuspend/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:10.139 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.139 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:10.140 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000247a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresgid/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:10.140 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000247b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresgid/getresgid03.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:10.140 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000247c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresgid/getresgid02.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:10.140 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000026df (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresgid/getresgid01.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:10.140 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.140 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:10.140 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000272f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/recvmsg/Makefile) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.140 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000024cf (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/recvmsg/recvmsg01.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.140 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.140 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: pgmap v402: 97 pgs: 97 active+clean; 120 MiB data, 805 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 8.6 MiB/s wr, 2.20k op/s 2024-01-31T05:13:10.140 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:10.140 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000027f0 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/renameat/Makefile) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.141 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000025e3 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/renameat/renameat01.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.141 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:10.141 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.141 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000238f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/waitid/waitid02.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:10.141 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000238e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/waitid/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:10.141 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002574 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/waitid/waitid01.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:10.141 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.141 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:10.141 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.141 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:10.141 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.141 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:10.141 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.141 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:10.141 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.142 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:10.142 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.142 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:10.142 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002592 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll_create1/Makefile) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.142 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:10.142 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000026f1 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sgetmask/sgetmask01.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.142 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000023bb (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll_create1/epoll_create1_01.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.142 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002489 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sgetmask/Makefile) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.142 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.142 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000246d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/access/access03.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.142 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000246f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/access/Makefile) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.142 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000026d5 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/access/access02.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.142 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002470 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/access/access01.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.142 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002471 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/access/access05.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.142 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000246e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/access/access04.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:10.143 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.143 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:10.143 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.143 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:10.143 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000271d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/exit_group/exit_group01.c) see mds.i log and `damage ls` output for details 2024-01-31T05:13:10.143 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000024b7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/exit_group/Makefile) see mds.i log and `damage ls` output for details 2024-01-31T05:13:10.143 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.143 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:10.143 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002492 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pathconf/pathconf01.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:10.143 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000026fb (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pathconf/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:10.143 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.143 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:10.143 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002491 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sched_yield/Makefile) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.144 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000026f9 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sched_yield/sched_yield01.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.144 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.144 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:10.144 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.144 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:10.144 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001c7b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/testfrmw.h) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.144 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001c26 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/Makefile) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.144 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001dc1 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/stress.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.144 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001c7c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/NOTES) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.144 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001c7d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/LICENCE) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.144 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001c27 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/testfrmw.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:10.144 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.144 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:10.144 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:10.145 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.145 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.145 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:10.145 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.145 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:10.145 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.145 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:10.145 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:09 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:10.146 INFO:tasks.workunit.client.0.smithi099.stdout:2/239: mknod d10/d1b/d4d/c56 0 2024-01-31T05:13:10.146 INFO:tasks.workunit.client.0.smithi099.stdout:3/204: write d10/d27/f30 [2893109,26650] 0 2024-01-31T05:13:10.146 INFO:tasks.workunit.client.0.smithi099.stdout:5/244: symlink d6/da/l46 0 2024-01-31T05:13:10.146 INFO:tasks.workunit.client.0.smithi099.stdout:2/240: unlink d10/f1a 0 2024-01-31T05:13:10.146 INFO:tasks.workunit.client.0.smithi099.stdout:2/241: truncate d10/d1c/f39 281282 0 2024-01-31T05:13:10.146 INFO:tasks.workunit.client.0.smithi099.stdout:5/245: unlink f4 0 2024-01-31T05:13:10.146 INFO:tasks.workunit.client.0.smithi099.stdout:5/246: symlink d6/d1e/l47 0 2024-01-31T05:13:10.149 INFO:tasks.workunit.client.0.smithi099.stdout:0/192: sync 2024-01-31T05:13:10.149 INFO:tasks.workunit.client.0.smithi099.stdout:6/174: sync 2024-01-31T05:13:10.150 INFO:tasks.workunit.client.0.smithi099.stdout:6/175: chown l6 3838 1 2024-01-31T05:13:10.152 INFO:tasks.workunit.client.0.smithi099.stdout:0/193: rename d1/d8/lb to d1/d37/l40 0 2024-01-31T05:13:10.152 INFO:tasks.workunit.client.0.smithi099.stdout:0/194: write d1/d8/df/f25 [565752,103700] 0 2024-01-31T05:13:10.152 INFO:tasks.workunit.client.0.smithi099.stdout:0/195: fdatasync d1/d16/f31 0 2024-01-31T05:13:10.153 INFO:tasks.workunit.client.0.smithi099.stdout:6/176: dread d14/f17 [0,4194304] 0 2024-01-31T05:13:10.153 INFO:tasks.workunit.client.0.smithi099.stdout:6/177: creat d14/d18/d1a/d1c/f35 x:0 0 0 2024-01-31T05:13:10.155 INFO:tasks.workunit.client.0.smithi099.stdout:6/178: truncate f12 932592 0 2024-01-31T05:13:10.157 INFO:tasks.workunit.client.0.smithi099.stdout:6/179: symlink d14/d18/d1a/d1c/l36 0 2024-01-31T05:13:10.158 INFO:tasks.workunit.client.0.smithi099.stdout:6/180: unlink d14/d18/d1a/d1b/f2f 0 2024-01-31T05:13:10.158 INFO:tasks.workunit.client.0.smithi099.stdout:6/181: creat d14/d18/d1a/f37 x:0 0 0 2024-01-31T05:13:10.159 INFO:tasks.workunit.client.0.smithi099.stdout:7/210: write f3 [929843,24497] 0 2024-01-31T05:13:10.173 INFO:tasks.workunit.client.0.smithi099.stdout:3/205: dwrite d10/d18/f2c [4194304,4194304] 0 2024-01-31T05:13:10.175 INFO:tasks.workunit.client.0.smithi099.stdout:3/206: rmdir d10/d24 39 2024-01-31T05:13:10.175 INFO:tasks.workunit.client.0.smithi099.stdout:3/207: read d10/d18/f26 [3901012,39037] 0 2024-01-31T05:13:10.176 INFO:tasks.workunit.client.0.smithi099.stdout:3/208: mkdir d10/d27/d34/d50 0 2024-01-31T05:13:10.177 INFO:tasks.workunit.client.0.smithi099.stdout:3/209: chown d10/d27/f30 74130 1 2024-01-31T05:13:10.180 INFO:tasks.workunit.client.0.smithi099.stdout:7/211: dwrite d6/f11 [0,4194304] 0 2024-01-31T05:13:10.180 INFO:tasks.workunit.client.0.smithi099.stdout:7/212: creat d6/d12/f41 x:0 0 0 2024-01-31T05:13:10.183 INFO:tasks.workunit.client.0.smithi099.stdout:7/213: mknod d6/d13/d33/d37/c42 0 2024-01-31T05:13:10.183 INFO:tasks.workunit.client.0.smithi099.stdout:7/214: chown d6/d32/c38 21 1 2024-01-31T05:13:10.184 INFO:tasks.workunit.client.0.smithi099.stdout:7/215: read d6/ff [984066,36014] 0 2024-01-31T05:13:10.184 INFO:tasks.workunit.client.0.smithi099.stdout:7/216: chown d6/d13/d33/f36 3859926 1 2024-01-31T05:13:10.184 INFO:tasks.workunit.client.0.smithi099.stdout:7/217: readlink d6/d12/l3a 0 2024-01-31T05:13:10.184 INFO:tasks.workunit.client.0.smithi099.stdout:7/218: dread - d6/d32/f34 zero size 2024-01-31T05:13:10.191 INFO:tasks.workunit.client.0.smithi099.stdout:1/224: dwrite d4/dc/d29/f3b [0,4194304] 0 2024-01-31T05:13:10.194 INFO:tasks.workunit.client.0.smithi099.stdout:1/225: rename d4/df/f2a to d4/dc/d29/f46 0 2024-01-31T05:13:10.198 INFO:tasks.workunit.client.0.smithi099.stdout:2/242: dwrite f0 [4194304,4194304] 0 2024-01-31T05:13:10.198 INFO:tasks.workunit.client.0.smithi099.stdout:2/243: read - d10/d3a/f52 zero size 2024-01-31T05:13:10.201 INFO:tasks.workunit.client.0.smithi099.stdout:2/244: mknod d10/d51/c57 0 2024-01-31T05:13:10.203 INFO:tasks.workunit.client.0.smithi099.stdout:2/245: dread d10/d20/f35 [0,4194304] 0 2024-01-31T05:13:10.204 INFO:tasks.workunit.client.0.smithi099.stdout:2/246: mkdir d10/d2b/d58 0 2024-01-31T05:13:10.205 INFO:tasks.workunit.client.0.smithi099.stdout:2/247: truncate d10/d20/f40 569654 0 2024-01-31T05:13:10.205 INFO:tasks.workunit.client.0.smithi099.stdout:0/196: dwrite d1/d8/f3f [0,4194304] 0 2024-01-31T05:13:10.207 INFO:tasks.workunit.client.0.smithi099.stdout:6/182: dwrite fc [4194304,4194304] 0 2024-01-31T05:13:10.207 INFO:tasks.workunit.client.0.smithi099.stdout:6/183: readlink le 0 2024-01-31T05:13:10.207 INFO:tasks.workunit.client.0.smithi099.stdout:6/184: fsync d14/d18/d1a/d1c/f34 0 2024-01-31T05:13:10.207 INFO:tasks.workunit.client.0.smithi099.stdout:7/219: dwrite d6/d13/f23 [0,4194304] 0 2024-01-31T05:13:10.214 INFO:tasks.workunit.client.0.smithi099.stdout:6/185: mknod d14/d18/d1a/c38 0 2024-01-31T05:13:10.214 INFO:tasks.workunit.client.0.smithi099.stdout:6/186: write f7 [2896789,38707] 0 2024-01-31T05:13:10.216 INFO:tasks.workunit.client.0.smithi099.stdout:7/220: mkdir d6/d1e/d25/d43 0 2024-01-31T05:13:10.216 INFO:tasks.workunit.client.0.smithi099.stdout:2/248: dread d10/f15 [4194304,4194304] 0 2024-01-31T05:13:10.217 INFO:tasks.workunit.client.0.smithi099.stdout:2/249: write d10/d1c/f55 [721383,94900] 0 2024-01-31T05:13:10.218 INFO:tasks.workunit.client.0.smithi099.stdout:6/187: link d14/d18/l28 d14/d18/d1a/l39 0 2024-01-31T05:13:10.218 INFO:tasks.workunit.client.0.smithi099.stdout:6/188: chown d14/d18/l28 393078789 1 2024-01-31T05:13:10.218 INFO:tasks.workunit.client.0.smithi099.stdout:6/189: truncate f11 800534 0 2024-01-31T05:13:10.219 INFO:tasks.workunit.client.0.smithi099.stdout:2/250: creat d10/d1b/f59 x:0 0 0 2024-01-31T05:13:10.220 INFO:tasks.workunit.client.0.smithi099.stdout:3/210: dwrite d10/d32/f3b [0,4194304] 0 2024-01-31T05:13:10.220 INFO:tasks.workunit.client.0.smithi099.stdout:0/197: dread d1/d8/f3f [0,4194304] 0 2024-01-31T05:13:10.221 INFO:tasks.workunit.client.0.smithi099.stdout:6/190: rename c13 to d14/d18/d1a/d1c/d29/c3a 0 2024-01-31T05:13:10.225 INFO:tasks.workunit.client.0.smithi099.stdout:7/221: mknod d6/c44 0 2024-01-31T05:13:10.225 INFO:tasks.workunit.client.0.smithi099.stdout:7/222: read - d6/d13/d33/f36 zero size 2024-01-31T05:13:10.225 INFO:tasks.workunit.client.0.smithi099.stdout:7/223: creat d6/d1e/f45 x:0 0 0 2024-01-31T05:13:10.226 INFO:tasks.workunit.client.0.smithi099.stdout:2/251: mkdir d10/d1b/d4d/d5a 0 2024-01-31T05:13:10.226 INFO:tasks.workunit.client.0.smithi099.stdout:2/252: getdents d10/d2b/d58 0 2024-01-31T05:13:10.228 INFO:tasks.workunit.client.0.smithi099.stdout:3/211: unlink d10/c15 0 2024-01-31T05:13:10.229 INFO:tasks.workunit.client.0.smithi099.stdout:0/198: creat d1/d37/f41 x:0 0 0 2024-01-31T05:13:10.230 INFO:tasks.workunit.client.0.smithi099.stdout:6/191: mkdir d14/d18/d3b 0 2024-01-31T05:13:10.230 INFO:tasks.workunit.client.0.smithi099.stdout:6/192: write f10 [4326127,17113] 0 2024-01-31T05:13:10.230 INFO:tasks.workunit.client.0.smithi099.stdout:6/193: dread - d14/d18/d1a/d1c/d29/f32 zero size 2024-01-31T05:13:10.231 INFO:tasks.workunit.client.0.smithi099.stdout:1/226: rmdir d4 39 2024-01-31T05:13:10.232 INFO:tasks.workunit.client.0.smithi099.stdout:7/224: mkdir d6/d32/d3d/d46 0 2024-01-31T05:13:10.232 INFO:tasks.workunit.client.0.smithi099.stdout:7/225: stat d6 0 2024-01-31T05:13:10.233 INFO:tasks.workunit.client.0.smithi099.stdout:2/253: mkdir d10/d20/d5b 0 2024-01-31T05:13:10.235 INFO:tasks.workunit.client.0.smithi099.stdout:0/199: link d1/c26 d1/d8/c42 0 2024-01-31T05:13:10.236 INFO:tasks.workunit.client.0.smithi099.stdout:6/194: mknod d14/d18/d1a/d1c/c3c 0 2024-01-31T05:13:10.239 INFO:tasks.workunit.client.0.smithi099.stdout:0/200: rename d1/d16/l3a to d1/d8/df/d2e/l43 0 2024-01-31T05:13:10.241 INFO:tasks.workunit.client.0.smithi099.stdout:7/226: rmdir d6/d12 39 2024-01-31T05:13:10.242 INFO:tasks.workunit.client.0.smithi099.stdout:9/154: sync 2024-01-31T05:13:10.242 INFO:tasks.workunit.client.0.smithi099.stdout:9/155: write d0/d1/d24/d2b/f1b [450507,40073] 0 2024-01-31T05:13:10.242 INFO:tasks.workunit.client.0.smithi099.stdout:9/156: read d0/d7/f13 [1109571,114775] 0 2024-01-31T05:13:10.245 INFO:tasks.workunit.client.0.smithi099.stdout:7/227: getdents d6/d12 0 2024-01-31T05:13:10.246 INFO:tasks.workunit.client.0.smithi099.stdout:9/157: rename d0/d1/l19 to d0/d7/l34 0 2024-01-31T05:13:10.248 INFO:tasks.workunit.client.0.smithi099.stdout:7/228: unlink d6/d1e/c21 0 2024-01-31T05:13:10.248 INFO:tasks.workunit.client.0.smithi099.stdout:7/229: write d6/d13/d33/d37/f40 [1311159,70047] 0 2024-01-31T05:13:10.251 INFO:tasks.workunit.client.0.smithi099.stdout:7/230: mkdir d6/d1e/d25/d47 0 2024-01-31T05:13:10.252 INFO:tasks.workunit.client.0.smithi099.stdout:7/231: symlink d6/d1e/l48 0 2024-01-31T05:13:10.260 INFO:tasks.workunit.client.0.smithi099.stdout:6/195: rmdir d14/d18/d1a 39 2024-01-31T05:13:10.260 INFO:tasks.workunit.client.0.smithi099.stdout:6/196: truncate d14/d18/d1a/d1c/d29/f2b 145313 0 2024-01-31T05:13:10.262 INFO:tasks.workunit.client.0.smithi099.stdout:6/197: rmdir d14 39 2024-01-31T05:13:10.263 INFO:tasks.workunit.client.0.smithi099.stdout:9/158: dread d0/d1/f1d [0,4194304] 0 2024-01-31T05:13:10.263 INFO:tasks.workunit.client.0.smithi099.stdout:9/159: chown d0/d7/l32 10 1 2024-01-31T05:13:10.263 INFO:tasks.workunit.client.0.smithi099.stdout:9/160: fdatasync d0/d7/f28 0 2024-01-31T05:13:10.263 INFO:tasks.workunit.client.0.smithi099.stdout:9/161: creat d0/d7/f35 x:0 0 0 2024-01-31T05:13:10.263 INFO:tasks.workunit.client.0.smithi099.stdout:9/162: rename d0 to d0/d1/d36 22 2024-01-31T05:13:10.264 INFO:tasks.workunit.client.0.smithi099.stdout:6/198: truncate f11 33021 0 2024-01-31T05:13:10.264 INFO:tasks.workunit.client.0.smithi099.stdout:1/227: dwrite d4/dc/d15/f1a [0,4194304] 0 2024-01-31T05:13:10.265 INFO:tasks.workunit.client.0.smithi099.stdout:0/201: dwrite d1/d8/df/f1d [0,4194304] 0 2024-01-31T05:13:10.266 INFO:tasks.workunit.client.0.smithi099.stdout:9/163: link d0/d7/f28 d0/d1/d24/f37 0 2024-01-31T05:13:10.267 INFO:tasks.workunit.client.0.smithi099.stdout:1/228: symlink d4/db/d12/l47 0 2024-01-31T05:13:10.271 INFO:tasks.workunit.client.0.smithi099.stdout:9/164: mknod d0/d1/d24/d2b/c38 0 2024-01-31T05:13:10.271 INFO:tasks.workunit.client.0.smithi099.stdout:9/165: write d0/d7/f14 [879442,22993] 0 2024-01-31T05:13:10.271 INFO:tasks.workunit.client.0.smithi099.stdout:9/166: fdatasync d0/d1/f1d 0 2024-01-31T05:13:10.278 INFO:tasks.workunit.client.0.smithi099.stdout:7/232: dwrite d6/d12/f17 [0,4194304] 0 2024-01-31T05:13:10.279 INFO:tasks.workunit.client.0.smithi099.stdout:7/233: symlink d6/d13/d33/l49 0 2024-01-31T05:13:10.281 INFO:tasks.workunit.client.0.smithi099.stdout:1/229: dread d4/dc/d15/f20 [4194304,4194304] 0 2024-01-31T05:13:10.281 INFO:tasks.workunit.client.0.smithi099.stdout:7/234: creat d6/d32/d3d/f4a x:0 0 0 2024-01-31T05:13:10.281 INFO:tasks.workunit.client.0.smithi099.stdout:0/202: dread d1/f5 [0,4194304] 0 2024-01-31T05:13:10.283 INFO:tasks.workunit.client.0.smithi099.stdout:1/230: rename d4/db/d24/d28 to d4/dc/d48 0 2024-01-31T05:13:10.284 INFO:tasks.workunit.client.0.smithi099.stdout:6/199: write d14/f16 [2771279,111011] 0 2024-01-31T05:13:10.285 INFO:tasks.workunit.client.0.smithi099.stdout:6/200: read - d14/d18/d1a/d1c/d29/f31 zero size 2024-01-31T05:13:10.285 INFO:tasks.workunit.client.0.smithi099.stdout:0/203: unlink d1/d16/c2d 0 2024-01-31T05:13:10.285 INFO:tasks.workunit.client.0.smithi099.stdout:0/204: stat d1/d16/f2f 0 2024-01-31T05:13:10.287 INFO:tasks.workunit.client.0.smithi099.stdout:1/231: symlink d4/dc/l49 0 2024-01-31T05:13:10.289 INFO:tasks.workunit.client.0.smithi099.stdout:6/201: dread f1 [0,4194304] 0 2024-01-31T05:13:10.289 INFO:tasks.workunit.client.0.smithi099.stdout:0/205: chown d1/cc 0 1 2024-01-31T05:13:10.290 INFO:tasks.workunit.client.0.smithi099.stdout:1/232: truncate d4/df/f3e 1270857 0 2024-01-31T05:13:10.290 INFO:tasks.workunit.client.0.smithi099.stdout:1/233: truncate d4/dc/d29/f36 911871 0 2024-01-31T05:13:10.294 INFO:tasks.workunit.client.0.smithi099.stdout:7/235: rename d6/d13 to d6/d32/d3d/d4b 0 2024-01-31T05:13:10.294 INFO:tasks.workunit.client.0.smithi099.stdout:7/236: fdatasync d6/d12/f3c 0 2024-01-31T05:13:10.295 INFO:tasks.workunit.client.0.smithi099.stdout:7/237: read d6/f1f [804127,15128] 0 2024-01-31T05:13:10.295 INFO:tasks.workunit.client.0.smithi099.stdout:1/234: dread d4/dc/d15/f33 [0,4194304] 0 2024-01-31T05:13:10.295 INFO:tasks.workunit.client.0.smithi099.stdout:6/202: dread fc [0,4194304] 0 2024-01-31T05:13:10.296 INFO:tasks.workunit.client.0.smithi099.stdout:7/238: truncate d6/d32/d3d/d4b/f23 2179992 0 2024-01-31T05:13:10.296 INFO:tasks.workunit.client.0.smithi099.stdout:7/239: write d6/fc [4728379,92081] 0 2024-01-31T05:13:10.296 INFO:tasks.workunit.client.0.smithi099.stdout:9/167: dwrite d0/d1/d24/d2b/f1b [0,4194304] 0 2024-01-31T05:13:10.297 INFO:tasks.workunit.client.0.smithi099.stdout:1/235: creat d4/db/d12/f4a x:0 0 0 2024-01-31T05:13:10.297 INFO:tasks.workunit.client.0.smithi099.stdout:1/236: stat d4/db/d12/l47 0 2024-01-31T05:13:10.298 INFO:tasks.workunit.client.0.smithi099.stdout:6/203: getdents d14/d18/d1a/d1c/d29 0 2024-01-31T05:13:10.299 INFO:tasks.workunit.client.0.smithi099.stdout:6/204: truncate d14/d18/d1a/d1c/f34 316324 0 2024-01-31T05:13:10.303 INFO:tasks.workunit.client.0.smithi099.stdout:7/240: rename d6/f30 to d6/d1e/d25/f4c 0 2024-01-31T05:13:10.307 INFO:tasks.workunit.client.0.smithi099.stdout:1/237: mkdir d4/db/d24/d4b 0 2024-01-31T05:13:10.307 INFO:tasks.workunit.client.0.smithi099.stdout:1/238: fdatasync d4/dc/d29/f36 0 2024-01-31T05:13:10.308 INFO:tasks.workunit.client.0.smithi099.stdout:6/205: symlink d14/d18/d1a/d1c/d29/l3d 0 2024-01-31T05:13:10.311 INFO:tasks.workunit.client.0.smithi099.stdout:0/206: dwrite d1/d8/df/f1d [0,4194304] 0 2024-01-31T05:13:10.312 INFO:tasks.workunit.client.0.smithi099.stdout:9/168: rename d0/d7/l1c to d0/d29/d33/l39 0 2024-01-31T05:13:10.312 INFO:tasks.workunit.client.0.smithi099.stdout:9/169: rename d0/d1 to d0/d1/d3a 22 2024-01-31T05:13:10.312 INFO:tasks.workunit.client.0.smithi099.stdout:9/170: creat d0/d7/f3b x:0 0 0 2024-01-31T05:13:10.313 INFO:tasks.workunit.client.0.smithi099.stdout:7/241: unlink d6/d12/f17 0 2024-01-31T05:13:10.314 INFO:tasks.workunit.client.0.smithi099.stdout:0/207: unlink d1/d8/f35 0 2024-01-31T05:13:10.316 INFO:tasks.workunit.client.0.smithi099.stdout:7/242: write f3 [927847,93305] 0 2024-01-31T05:13:10.318 INFO:tasks.workunit.client.0.smithi099.stdout:4/257: sync 2024-01-31T05:13:10.320 INFO:tasks.workunit.client.0.smithi099.stdout:9/171: rmdir d0/d29 39 2024-01-31T05:13:10.326 INFO:tasks.workunit.client.0.smithi099.stdout:7/243: mkdir d6/d1e/d4d 0 2024-01-31T05:13:10.326 INFO:tasks.workunit.client.0.smithi099.stdout:4/258: creat d0/d2/d4b/f5f x:0 0 0 2024-01-31T05:13:10.326 INFO:tasks.workunit.client.0.smithi099.stdout:4/259: chown d0/d2/l46 12424 1 2024-01-31T05:13:10.326 INFO:tasks.workunit.client.0.smithi099.stdout:7/244: truncate d6/d32/d3d/d4b/d33/f36 710282 0 2024-01-31T05:13:10.335 INFO:tasks.workunit.client.0.smithi099.stdout:7/245: mkdir d6/d32/d3d/d4b/d33/d37/d4e 0 2024-01-31T05:13:10.337 INFO:tasks.workunit.client.0.smithi099.stdout:7/246: creat d6/d32/d3d/d4b/d33/d37/d4e/f4f x:0 0 0 2024-01-31T05:13:10.337 INFO:tasks.workunit.client.0.smithi099.stdout:7/247: chown d6/fc 0 1 2024-01-31T05:13:10.337 INFO:tasks.workunit.client.0.smithi099.stdout:7/248: dread - d6/d1e/d25/f29 zero size 2024-01-31T05:13:10.339 INFO:tasks.workunit.client.0.smithi099.stdout:6/206: dwrite f1 [0,4194304] 0 2024-01-31T05:13:10.339 INFO:tasks.workunit.client.0.smithi099.stdout:4/260: dread d0/d2/f47 [0,4194304] 0 2024-01-31T05:13:10.343 INFO:tasks.workunit.client.0.smithi099.stdout:6/207: rename f1 to d14/d18/d1a/f3e 0 2024-01-31T05:13:10.344 INFO:tasks.workunit.client.0.smithi099.stdout:0/208: dwrite d1/d8/df/f29 [0,4194304] 0 2024-01-31T05:13:10.345 INFO:tasks.workunit.client.0.smithi099.stdout:1/239: dwrite d4/dc/f43 [0,4194304] 0 2024-01-31T05:13:10.347 INFO:tasks.workunit.client.0.smithi099.stdout:9/172: dwrite d0/d7/fa [0,4194304] 0 2024-01-31T05:13:10.347 INFO:tasks.workunit.client.0.smithi099.stdout:9/173: fsync d0/d7/fa 0 2024-01-31T05:13:10.351 INFO:tasks.workunit.client.0.smithi099.stdout:9/174: creat d0/d1/d24/d2b/f3c x:0 0 0 2024-01-31T05:13:10.364 INFO:tasks.workunit.client.0.smithi099.stdout:1/240: write d4/dc/d29/f3b [2693681,36508] 0 2024-01-31T05:13:10.364 INFO:tasks.workunit.client.0.smithi099.stdout:1/241: chown d4/db/d24/f41 1385664653 1 2024-01-31T05:13:10.366 INFO:tasks.workunit.client.0.smithi099.stdout:4/261: dwrite d0/d1e/f35 [0,4194304] 0 2024-01-31T05:13:10.366 INFO:tasks.workunit.client.0.smithi099.stdout:4/262: chown d0/d2/f15 8234043 1 2024-01-31T05:13:10.366 INFO:tasks.workunit.client.0.smithi099.stdout:4/263: chown d0/d2/d20/d21/d39/l5e 3 1 2024-01-31T05:13:10.367 INFO:tasks.workunit.client.0.smithi099.stdout:1/242: symlink d4/df/d37/l4c 0 2024-01-31T05:13:10.367 INFO:tasks.workunit.client.0.smithi099.stdout:1/243: write d4/f6 [1162953,33765] 0 2024-01-31T05:13:10.370 INFO:tasks.workunit.client.0.smithi099.stdout:1/244: mkdir d4/dc/d4d 0 2024-01-31T05:13:10.370 INFO:tasks.workunit.client.0.smithi099.stdout:1/245: stat d4/df/f22 0 2024-01-31T05:13:10.370 INFO:tasks.workunit.client.0.smithi099.stdout:1/246: readlink d4/db/d12/l47 0 2024-01-31T05:13:10.373 INFO:tasks.workunit.client.0.smithi099.stdout:4/264: rmdir d0 39 2024-01-31T05:13:10.375 INFO:tasks.workunit.client.0.smithi099.stdout:1/247: creat d4/dc/d15/f4e x:0 0 0 2024-01-31T05:13:10.376 INFO:tasks.workunit.client.0.smithi099.stdout:4/265: creat d0/f60 x:0 0 0 2024-01-31T05:13:10.376 INFO:tasks.workunit.client.0.smithi099.stdout:4/266: read - d0/d2/d20/f38 zero size 2024-01-31T05:13:10.376 INFO:tasks.workunit.client.0.smithi099.stdout:4/267: write d0/d8/d19/f2d [3634375,113322] 0 2024-01-31T05:13:10.376 INFO:tasks.workunit.client.0.smithi099.stdout:7/249: dwrite d6/d32/d3d/d4b/d33/d37/f40 [0,4194304] 0 2024-01-31T05:13:10.376 INFO:tasks.workunit.client.0.smithi099.stdout:7/250: fsync d6/d1e/d25/f4c 0 2024-01-31T05:13:10.379 INFO:tasks.workunit.client.0.smithi099.stdout:1/248: link d4/f6 d4/dc/d4d/f4f 0 2024-01-31T05:13:10.379 INFO:tasks.workunit.client.0.smithi099.stdout:6/208: dwrite f11 [0,4194304] 0 2024-01-31T05:13:10.380 INFO:tasks.workunit.client.0.smithi099.stdout:6/209: chown d14/c23 369584 1 2024-01-31T05:13:10.380 INFO:tasks.workunit.client.0.smithi099.stdout:6/210: chown d14/f15 798042 1 2024-01-31T05:13:10.380 INFO:tasks.workunit.client.0.smithi099.stdout:6/211: truncate d14/f30 927551 0 2024-01-31T05:13:10.383 INFO:tasks.workunit.client.0.smithi099.stdout:9/175: dwrite d0/d1/d24/d2b/f1b [0,4194304] 0 2024-01-31T05:13:10.384 INFO:tasks.workunit.client.0.smithi099.stdout:1/249: mkdir d4/db/d24/d4b/d50 0 2024-01-31T05:13:10.387 INFO:tasks.workunit.client.0.smithi099.stdout:9/176: mknod d0/d1/d24/c3d 0 2024-01-31T05:13:10.388 INFO:tasks.workunit.client.0.smithi099.stdout:9/177: write d0/d1/d24/f37 [1706674,83289] 0 2024-01-31T05:13:10.388 INFO:tasks.workunit.client.0.smithi099.stdout:1/250: creat d4/dc/d4d/f51 x:0 0 0 2024-01-31T05:13:10.390 INFO:tasks.workunit.client.0.smithi099.stdout:7/251: rename d6/d1e to d6/d32/d3d/d4b/d33/d37/d50 0 2024-01-31T05:13:10.393 INFO:tasks.workunit.client.0.smithi099.stdout:9/178: rmdir d0/d7 39 2024-01-31T05:13:10.396 INFO:tasks.workunit.client.0.smithi099.stdout:9/179: rename d0/d29 to d0/d3e 0 2024-01-31T05:13:10.396 INFO:tasks.workunit.client.0.smithi099.stdout:8/323: sync 2024-01-31T05:13:10.397 INFO:tasks.workunit.client.0.smithi099.stdout:9/180: symlink d0/d7/l3f 0 2024-01-31T05:13:10.398 INFO:tasks.workunit.client.0.smithi099.stdout:1/251: write d4/dc/d15/f1a [1552603,99423] 0 2024-01-31T05:13:10.399 INFO:tasks.workunit.client.0.smithi099.stdout:8/324: rename d1/dd/d11/d29/d3a/l43 to d1/dd/d11/d29/d3a/l63 0 2024-01-31T05:13:10.399 INFO:tasks.workunit.client.0.smithi099.stdout:8/325: fdatasync d1/dd/d11/d19/d21/f5c 0 2024-01-31T05:13:10.399 INFO:tasks.workunit.client.0.smithi099.stdout:8/326: write d1/dd/d11/d20/f3e [120430,126223] 0 2024-01-31T05:13:10.400 INFO:tasks.workunit.client.0.smithi099.stdout:8/327: write d1/dd/d11/d19/f1f [977335,30574] 0 2024-01-31T05:13:10.400 INFO:tasks.workunit.client.0.smithi099.stdout:9/181: link d0/d1/f1d d0/d3e/f40 0 2024-01-31T05:13:10.402 INFO:tasks.workunit.client.0.smithi099.stdout:1/252: link d4/dc/d15/f20 d4/db/d24/d4b/f52 0 2024-01-31T05:13:10.402 INFO:tasks.workunit.client.0.smithi099.stdout:1/253: dread - d4/dc/d15/f4e zero size 2024-01-31T05:13:10.402 INFO:tasks.workunit.client.0.smithi099.stdout:1/254: fdatasync d4/dc/f2c 0 2024-01-31T05:13:10.403 INFO:tasks.workunit.client.0.smithi099.stdout:1/255: read d4/db/f25 [903098,61357] 0 2024-01-31T05:13:10.403 INFO:tasks.workunit.client.0.smithi099.stdout:1/256: write d4/dc/d4d/f51 [697054,120519] 0 2024-01-31T05:13:10.403 INFO:tasks.workunit.client.0.smithi099.stdout:4/268: dwrite d0/d2/d20/d21/f53 [0,4194304] 0 2024-01-31T05:13:10.403 INFO:tasks.workunit.client.0.smithi099.stdout:8/328: link d1/dd/d11/d19/d21/c50 d1/c64 0 2024-01-31T05:13:10.404 INFO:tasks.workunit.client.0.smithi099.stdout:9/182: mknod d0/d7/c41 0 2024-01-31T05:13:10.404 INFO:tasks.workunit.client.0.smithi099.stdout:9/183: dread - d0/d7/f3b zero size 2024-01-31T05:13:10.405 INFO:tasks.workunit.client.0.smithi099.stdout:1/257: truncate d4/dc/d29/f36 61095 0 2024-01-31T05:13:10.406 INFO:tasks.workunit.client.0.smithi099.stdout:7/252: read d6/f20 [3178732,58675] 0 2024-01-31T05:13:10.406 INFO:tasks.workunit.client.0.smithi099.stdout:7/253: write d6/f20 [5596152,80068] 0 2024-01-31T05:13:10.407 INFO:tasks.workunit.client.0.smithi099.stdout:4/269: truncate d0/f3 717585 0 2024-01-31T05:13:10.407 INFO:tasks.workunit.client.0.smithi099.stdout:4/270: chown d0/d2/cf 28 1 2024-01-31T05:13:10.408 INFO:tasks.workunit.client.0.smithi099.stdout:1/258: mkdir d4/df/d53 0 2024-01-31T05:13:10.410 INFO:tasks.workunit.client.0.smithi099.stdout:7/254: truncate d6/f11 1111463 0 2024-01-31T05:13:10.415 INFO:tasks.workunit.client.0.smithi099.stdout:6/212: dwrite f12 [0,4194304] 0 2024-01-31T05:13:10.415 INFO:tasks.workunit.client.0.smithi099.stdout:6/213: readlink d14/d18/d1a/d1c/l36 0 2024-01-31T05:13:10.419 INFO:tasks.workunit.client.0.smithi099.stdout:5/247: sync 2024-01-31T05:13:10.419 INFO:tasks.workunit.client.0.smithi099.stdout:5/248: chown d6/da/d3f 6 1 2024-01-31T05:13:10.419 INFO:tasks.workunit.client.0.smithi099.stdout:5/249: dread - d6/d1e/f2d zero size 2024-01-31T05:13:10.419 INFO:tasks.workunit.client.0.smithi099.stdout:5/250: chown l0 23 1 2024-01-31T05:13:10.419 INFO:tasks.workunit.client.0.smithi099.stdout:5/251: fdatasync f1 0 2024-01-31T05:13:10.419 INFO:tasks.workunit.client.0.smithi099.stdout:5/252: fdatasync d6/da/d14/f3b 0 2024-01-31T05:13:10.421 INFO:tasks.workunit.client.0.smithi099.stdout:1/259: write d4/dc/d48/f31 [78264,84502] 0 2024-01-31T05:13:10.422 INFO:tasks.workunit.client.0.smithi099.stdout:1/260: chown d4/db/d12 3 1 2024-01-31T05:13:10.423 INFO:tasks.workunit.client.0.smithi099.stdout:6/214: creat d14/d18/d1a/d1c/d29/f3f x:0 0 0 2024-01-31T05:13:10.423 INFO:tasks.workunit.client.0.smithi099.stdout:6/215: dread - d14/d18/d1a/f37 zero size 2024-01-31T05:13:10.425 INFO:tasks.workunit.client.0.smithi099.stdout:5/253: symlink d6/da/d14/d2b/l48 0 2024-01-31T05:13:10.425 INFO:tasks.workunit.client.0.smithi099.stdout:5/254: write d6/da/d3f/f45 [728289,40245] 0 2024-01-31T05:13:10.426 INFO:tasks.workunit.client.0.smithi099.stdout:9/184: write d0/d1/fe [1247903,55926] 0 2024-01-31T05:13:10.426 INFO:tasks.workunit.client.0.smithi099.stdout:9/185: fsync d0/d1/d24/d2b/f1b 0 2024-01-31T05:13:10.427 INFO:tasks.workunit.client.0.smithi099.stdout:1/261: creat d4/df/d37/f54 x:0 0 0 2024-01-31T05:13:10.429 INFO:tasks.workunit.client.0.smithi099.stdout:6/216: rmdir d14 39 2024-01-31T05:13:10.431 INFO:tasks.workunit.client.0.smithi099.stdout:9/186: creat d0/d3e/f42 x:0 0 0 2024-01-31T05:13:10.431 INFO:tasks.workunit.client.0.smithi099.stdout:9/187: chown d0/d1/f1d 17283 1 2024-01-31T05:13:10.432 INFO:tasks.workunit.client.0.smithi099.stdout:1/262: mkdir d4/dc/d55 0 2024-01-31T05:13:10.432 INFO:tasks.workunit.client.0.smithi099.stdout:6/217: rmdir d14/d18/d1a/d1b/d22 39 2024-01-31T05:13:10.433 INFO:tasks.workunit.client.0.smithi099.stdout:6/218: chown d14/d18/d1a/d1b 34 1 2024-01-31T05:13:10.434 INFO:tasks.workunit.client.0.smithi099.stdout:1/263: write d4/dc/d15/f32 [4416583,27670] 0 2024-01-31T05:13:10.434 INFO:tasks.workunit.client.0.smithi099.stdout:4/271: dwrite d0/d2/d20/d21/d17/d24/f32 [0,4194304] 0 2024-01-31T05:13:10.434 INFO:tasks.workunit.client.0.smithi099.stdout:1/264: write d4/dc/d48/f31 [469102,85306] 0 2024-01-31T05:13:10.434 INFO:tasks.workunit.client.0.smithi099.stdout:6/219: rename f7 to d14/f40 0 2024-01-31T05:13:10.435 INFO:tasks.workunit.client.0.smithi099.stdout:6/220: dread d14/f30 [0,4194304] 0 2024-01-31T05:13:10.436 INFO:tasks.workunit.client.0.smithi099.stdout:8/329: dwrite d1/dd/d11/f32 [0,4194304] 0 2024-01-31T05:13:10.436 INFO:tasks.workunit.client.0.smithi099.stdout:8/330: getdents d1/dd/d11/d29/d3f 0 2024-01-31T05:13:10.437 INFO:tasks.workunit.client.0.smithi099.stdout:6/221: creat d14/d18/d1a/d1c/d29/f41 x:0 0 0 2024-01-31T05:13:10.445 INFO:tasks.workunit.client.0.smithi099.stdout:5/255: write d6/da/d14/d2b/f44 [1466456,74739] 0 2024-01-31T05:13:10.449 INFO:tasks.workunit.client.0.smithi099.stdout:7/255: dwrite d6/d32/d3d/f4a [0,4194304] 0 2024-01-31T05:13:10.449 INFO:tasks.workunit.client.0.smithi099.stdout:7/256: chown d6/d32/d3d/d46 0 1 2024-01-31T05:13:10.449 INFO:tasks.workunit.client.0.smithi099.stdout:1/265: write d4/dc/f43 [572949,37133] 0 2024-01-31T05:13:10.453 INFO:tasks.workunit.client.0.smithi099.stdout:8/331: read d1/dd/d11/f31 [3986967,9185] 0 2024-01-31T05:13:10.457 INFO:tasks.workunit.client.0.smithi099.stdout:7/257: write d6/ff [641578,7103] 0 2024-01-31T05:13:10.457 INFO:tasks.workunit.client.0.smithi099.stdout:5/256: write d6/f3e [1247064,111553] 0 2024-01-31T05:13:10.465 INFO:tasks.workunit.client.0.smithi099.stdout:1/266: getdents d4/dc/d48 0 2024-01-31T05:13:10.467 INFO:tasks.workunit.client.0.smithi099.stdout:1/267: unlink d4/fa 0 2024-01-31T05:13:10.468 INFO:tasks.workunit.client.0.smithi099.stdout:6/222: dwrite d14/f30 [0,4194304] 0 2024-01-31T05:13:10.469 INFO:tasks.workunit.client.0.smithi099.stdout:1/268: mkdir d4/df/d37/d56 0 2024-01-31T05:13:10.469 INFO:tasks.workunit.client.0.smithi099.stdout:1/269: write d4/dc/d15/f1a [4292300,5198] 0 2024-01-31T05:13:10.470 INFO:tasks.workunit.client.0.smithi099.stdout:1/270: chown d4/dc/d29/c30 2885501 1 2024-01-31T05:13:10.470 INFO:tasks.workunit.client.0.smithi099.stdout:1/271: stat d4/dc/d15/f1a 0 2024-01-31T05:13:10.470 INFO:tasks.workunit.client.0.smithi099.stdout:1/272: chown d4/dc/l1f 7257 1 2024-01-31T05:13:10.470 INFO:tasks.workunit.client.0.smithi099.stdout:1/273: getdents d4/dc/d44 0 2024-01-31T05:13:10.470 INFO:tasks.workunit.client.0.smithi099.stdout:9/188: dwrite d0/d7/f28 [0,4194304] 0 2024-01-31T05:13:10.471 INFO:tasks.workunit.client.0.smithi099.stdout:4/272: dwrite d0/d2/d20/d21/d17/d3d/f41 [0,4194304] 0 2024-01-31T05:13:10.471 INFO:tasks.workunit.client.0.smithi099.stdout:4/273: fsync d0/fd 0 2024-01-31T05:13:10.471 INFO:tasks.workunit.client.0.smithi099.stdout:4/274: chown d0/d2/d20/d21/d17/d3d/c58 862 1 2024-01-31T05:13:10.471 INFO:tasks.workunit.client.0.smithi099.stdout:6/223: getdents d14/d18/d1a/d1b/d22 0 2024-01-31T05:13:10.475 INFO:tasks.workunit.client.0.smithi099.stdout:9/189: rmdir d0/d7/d2e 39 2024-01-31T05:13:10.477 INFO:tasks.workunit.client.0.smithi099.stdout:4/275: mkdir d0/d1e/d61 0 2024-01-31T05:13:10.479 INFO:tasks.workunit.client.0.smithi099.stdout:9/190: creat d0/d7/d2e/f43 x:0 0 0 2024-01-31T05:13:10.481 INFO:tasks.workunit.client.0.smithi099.stdout:2/254: sync 2024-01-31T05:13:10.481 INFO:tasks.workunit.client.0.smithi099.stdout:3/212: sync 2024-01-31T05:13:10.484 INFO:tasks.workunit.client.0.smithi099.stdout:5/257: dwrite d6/d1e/d1f/d21/f27 [4194304,4194304] 0 2024-01-31T05:13:10.484 INFO:tasks.workunit.client.0.smithi099.stdout:5/258: fsync d6/da/d14/f24 0 2024-01-31T05:13:10.484 INFO:tasks.workunit.client.0.smithi099.stdout:2/255: rename d10/d20/f35 to d10/d2b/f5c 0 2024-01-31T05:13:10.484 INFO:tasks.workunit.client.0.smithi099.stdout:2/256: stat d10/f2a 0 2024-01-31T05:13:10.486 INFO:tasks.workunit.client.0.smithi099.stdout:5/259: symlink d6/d1e/d1f/d21/l49 0 2024-01-31T05:13:10.487 INFO:tasks.workunit.client.0.smithi099.stdout:5/260: chown d6/f13 45 1 2024-01-31T05:13:10.487 INFO:tasks.workunit.client.0.smithi099.stdout:8/332: dwrite d1/dd/d11/d29/d3f/f48 [0,4194304] 0 2024-01-31T05:13:10.490 INFO:tasks.workunit.client.0.smithi099.stdout:6/224: write d14/f15 [2749052,126076] 0 2024-01-31T05:13:10.490 INFO:tasks.workunit.client.0.smithi099.stdout:1/274: dwrite d4/df/d37/f54 [0,4194304] 0 2024-01-31T05:13:10.490 INFO:tasks.workunit.client.0.smithi099.stdout:6/225: chown d14/d18/d1a 99 1 2024-01-31T05:13:10.490 INFO:tasks.workunit.client.0.smithi099.stdout:6/226: fdatasync f11 0 2024-01-31T05:13:10.490 INFO:tasks.workunit.client.0.smithi099.stdout:6/227: chown c3 30 1 2024-01-31T05:13:10.490 INFO:tasks.workunit.client.0.smithi099.stdout:6/228: chown d14/d18/d1a/d1c/c2c 13 1 2024-01-31T05:13:10.490 INFO:tasks.workunit.client.0.smithi099.stdout:6/229: write d14/d18/d1a/d1c/d29/f41 [226285,35540] 0 2024-01-31T05:13:10.491 INFO:tasks.workunit.client.0.smithi099.stdout:5/261: dread d6/d1e/f2c [0,4194304] 0 2024-01-31T05:13:10.492 INFO:tasks.workunit.client.0.smithi099.stdout:8/333: mkdir d1/dd/d65 0 2024-01-31T05:13:10.500 INFO:tasks.workunit.client.0.smithi099.stdout:6/230: rename d14/f30 to d14/d18/d3b/f42 0 2024-01-31T05:13:10.500 INFO:tasks.workunit.client.0.smithi099.stdout:2/257: dread d10/d20/f3d [0,4194304] 0 2024-01-31T05:13:10.500 INFO:tasks.workunit.client.0.smithi099.stdout:1/275: symlink d4/dc/l57 0 2024-01-31T05:13:10.500 INFO:tasks.workunit.client.0.smithi099.stdout:2/258: write d10/d20/f37 [4340006,16443] 0 2024-01-31T05:13:10.500 INFO:tasks.workunit.client.0.smithi099.stdout:2/259: truncate d10/d2b/f5c 709364 0 2024-01-31T05:13:10.501 INFO:tasks.workunit.client.0.smithi099.stdout:6/231: dread d14/d18/d1a/d1c/f34 [0,4194304] 0 2024-01-31T05:13:10.502 INFO:tasks.workunit.client.0.smithi099.stdout:6/232: write d14/d18/d1a/d1c/d29/f3f [944048,75487] 0 2024-01-31T05:13:10.502 INFO:tasks.workunit.client.0.smithi099.stdout:6/233: write d14/d18/d1a/f37 [974128,11498] 0 2024-01-31T05:13:10.502 INFO:tasks.workunit.client.0.smithi099.stdout:2/260: write f1 [1578915,72157] 0 2024-01-31T05:13:10.502 INFO:tasks.workunit.client.0.smithi099.stdout:5/262: unlink d6/da/d14/f20 0 2024-01-31T05:13:10.502 INFO:tasks.workunit.client.0.smithi099.stdout:5/263: dread - d6/d1e/f2d zero size 2024-01-31T05:13:10.502 INFO:tasks.workunit.client.0.smithi099.stdout:5/264: fdatasync d6/d1e/f41 0 2024-01-31T05:13:10.502 INFO:tasks.workunit.client.0.smithi099.stdout:5/265: creat d6/d1e/d1f/f4a x:0 0 0 2024-01-31T05:13:10.502 INFO:tasks.workunit.client.0.smithi099.stdout:5/266: readlink d6/d1e/d1f/d21/l30 0 2024-01-31T05:13:10.503 INFO:tasks.workunit.client.0.smithi099.stdout:4/276: dwrite d0/f60 [0,4194304] 0 2024-01-31T05:13:10.503 INFO:tasks.workunit.client.0.smithi099.stdout:4/277: fdatasync d0/d2/f47 0 2024-01-31T05:13:10.504 INFO:tasks.workunit.client.0.smithi099.stdout:6/234: truncate fa 5595873 0 2024-01-31T05:13:10.506 INFO:tasks.workunit.client.0.smithi099.stdout:5/267: rename d6/d1e/c31 to d6/da/c4b 0 2024-01-31T05:13:10.507 INFO:tasks.workunit.client.0.smithi099.stdout:1/276: dread d4/dc/d15/f32 [0,4194304] 0 2024-01-31T05:13:10.509 INFO:tasks.workunit.client.0.smithi099.stdout:3/213: dwrite d10/d1e/f2b [0,4194304] 0 2024-01-31T05:13:10.511 INFO:tasks.workunit.client.0.smithi099.stdout:1/277: dread d4/db/d24/d4b/f52 [8388608,4194304] 0 2024-01-31T05:13:10.511 INFO:tasks.workunit.client.0.smithi099.stdout:8/334: dread d1/f7 [0,4194304] 0 2024-01-31T05:13:10.511 INFO:tasks.workunit.client.0.smithi099.stdout:8/335: fdatasync d1/dd/ff 0 2024-01-31T05:13:10.511 INFO:tasks.workunit.client.0.smithi099.stdout:8/336: write d1/dd/d11/d29/d3f/d56/d57/f59 [280329,128822] 0 2024-01-31T05:13:10.512 INFO:tasks.workunit.client.0.smithi099.stdout:6/235: write d14/d18/d1a/d1c/d29/f2b [365965,124969] 0 2024-01-31T05:13:10.514 INFO:tasks.workunit.client.0.smithi099.stdout:5/268: symlink d6/d1e/d1f/l4c 0 2024-01-31T05:13:10.514 INFO:tasks.workunit.client.0.smithi099.stdout:5/269: creat d6/da/d3f/f4d x:0 0 0 2024-01-31T05:13:10.514 INFO:tasks.workunit.client.0.smithi099.stdout:5/270: dread - d6/da/d14/f24 zero size 2024-01-31T05:13:10.514 INFO:tasks.workunit.client.0.smithi099.stdout:5/271: creat d6/d1e/f4e x:0 0 0 2024-01-31T05:13:10.514 INFO:tasks.workunit.client.0.smithi099.stdout:5/272: read d6/d1e/d1f/f42 [1683065,18233] 0 2024-01-31T05:13:10.514 INFO:tasks.workunit.client.0.smithi099.stdout:5/273: readlink d6/da/d14/l1d 0 2024-01-31T05:13:10.514 INFO:tasks.workunit.client.0.smithi099.stdout:5/274: chown d6/da/d14/l1d 80952776 1 2024-01-31T05:13:10.516 INFO:tasks.workunit.client.0.smithi099.stdout:0/209: sync 2024-01-31T05:13:10.517 INFO:tasks.workunit.client.0.smithi099.stdout:3/214: mkdir d10/d32/d33/d51 0 2024-01-31T05:13:10.519 INFO:tasks.workunit.client.0.smithi099.stdout:8/337: mknod d1/dd/c66 0 2024-01-31T05:13:10.523 INFO:tasks.workunit.client.0.smithi099.stdout:5/275: creat d6/da/f4f x:0 0 0 2024-01-31T05:13:10.523 INFO:tasks.workunit.client.0.smithi099.stdout:2/261: dwrite d10/f42 [0,4194304] 0 2024-01-31T05:13:10.524 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:10.523+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ff4 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/dev_sim_framework/kernel_space/Makefile auth v22 ap=1 s=381 n(v0 rc2003-08-14T18:45:35.000000+0000 b381 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850fc3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ff4:[<0x100000021aa/Makefile v4>,<0x100000021a7/kernel_space v24>,<0x10000002195/dev_sim_framework v38>,<0x10000001eda/device-drivers v200>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001ff4:[<0x100000021aa/Makefile v22>,<0x100000021a7/kernel_space v24>,<0x10000002195/dev_sim_framework v131>,<0x10000001eda/device-drivers v1162>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:10.525 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:10.523+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ff8 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/dev_sim_framework/kernel_space/tmod.mod.c auth v16 ap=1 s=1087 n(v0 rc2006-01-09T19:17:16.000000+0000 b1087 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850fc2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ff8:[<0x100000021aa/tmod.mod.c v12>,<0x100000021a7/kernel_space v24>,<0x10000002195/dev_sim_framework v38>,<0x10000001eda/device-drivers v200>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001ff8:[<0x100000021aa/tmod.mod.c v16>,<0x100000021a7/kernel_space v24>,<0x10000002195/dev_sim_framework v131>,<0x10000001eda/device-drivers v1162>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:10.525 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:10.523+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ff5 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/dev_sim_framework/kernel_space/tmod.h auth v14 ap=1 s=2310 n(v0 rc2006-01-09T19:17:16.000000+0000 b2310 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850fc3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ff5:[<0x100000021aa/tmod.h v6>,<0x100000021a7/kernel_space v24>,<0x10000002195/dev_sim_framework v38>,<0x10000001eda/device-drivers v200>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001ff5:[<0x100000021aa/tmod.h v14>,<0x100000021a7/kernel_space v24>,<0x10000002195/dev_sim_framework v131>,<0x10000001eda/device-drivers v1162>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:10.525 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:10.523+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ff6 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/dev_sim_framework/kernel_space/str_mod.h auth v20 ap=1 s=1341 n(v0 rc2006-01-09T19:17:16.000000+0000 b1341 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850fc3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ff6:[<0x100000021aa/str_mod.h v8>,<0x100000021a7/kernel_space v24>,<0x10000002195/dev_sim_framework v38>,<0x10000001eda/device-drivers v200>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001ff6:[<0x100000021aa/str_mod.h v20>,<0x100000021a7/kernel_space v24>,<0x10000002195/dev_sim_framework v131>,<0x10000001eda/device-drivers v1162>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:10.525 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:10.524+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000021ab [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/dev_sim_framework/kernel_space/load_tmod.sh auth v24 ap=1 s=151 n(v0 rc2024-01-31T05:12:56.805590+0000 b151 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850fc2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000021ab:[<0x100000021aa/load_tmod.sh v2>,<0x100000021a7/kernel_space v24>,<0x10000002195/dev_sim_framework v38>,<0x10000001eda/device-drivers v200>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x100000021ab:[<0x100000021aa/load_tmod.sh v24>,<0x100000021a7/kernel_space v24>,<0x10000002195/dev_sim_framework v131>,<0x10000001eda/device-drivers v1162>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:10.525 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:10.524+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ff7 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/dev_sim_framework/kernel_space/tmod.c auth v18 ap=1 s=7286 n(v0 rc2009-02-26T12:14:51.000000+0000 b7286 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850fc4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ff7:[<0x100000021aa/tmod.c v10>,<0x100000021a7/kernel_space v24>,<0x10000002195/dev_sim_framework v38>,<0x10000001eda/device-drivers v200>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001ff7:[<0x100000021aa/tmod.c v18>,<0x100000021a7/kernel_space v24>,<0x10000002195/dev_sim_framework v131>,<0x10000001eda/device-drivers v1162>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:10.527 INFO:tasks.workunit.client.0.smithi099.stdout:3/215: mkdir d10/d27/d34/d52 0 2024-01-31T05:13:10.527 INFO:tasks.workunit.client.0.smithi099.stdout:3/216: readlink d10/l11 0 2024-01-31T05:13:10.527 INFO:tasks.workunit.client.0.smithi099.stdout:3/217: creat d10/d27/f53 x:0 0 0 2024-01-31T05:13:10.527 INFO:tasks.workunit.client.0.smithi099.stdout:3/218: truncate d10/d27/f30 4234503 0 2024-01-31T05:13:10.528 INFO:tasks.workunit.client.0.smithi099.stdout:8/338: creat d1/dd/d11/d19/d21/d3c/f67 x:0 0 0 2024-01-31T05:13:10.528 INFO:tasks.workunit.client.0.smithi099.stdout:8/339: dread - d1/dd/d11/d19/d21/d3c/f67 zero size 2024-01-31T05:13:10.528 INFO:tasks.workunit.client.0.smithi099.stdout:8/340: creat d1/dd/d11/f68 x:0 0 0 2024-01-31T05:13:10.535 INFO:tasks.workunit.client.0.smithi099.stdout:0/210: dread d1/d8/df/f29 [0,4194304] 0 2024-01-31T05:13:10.535 INFO:tasks.workunit.client.0.smithi099.stdout:0/211: chown d1/d8/df/f15 8275822 1 2024-01-31T05:13:10.536 INFO:tasks.workunit.client.0.smithi099.stdout:5/276: dread d6/d1e/d1f/f42 [0,4194304] 0 2024-01-31T05:13:10.537 INFO:tasks.workunit.client.0.smithi099.stdout:8/341: getdents d1/dd/d11/d29 0 2024-01-31T05:13:10.537 INFO:tasks.workunit.client.0.smithi099.stdout:3/219: dread d10/f1b [0,4194304] 0 2024-01-31T05:13:10.538 INFO:tasks.workunit.client.0.smithi099.stdout:6/236: dwrite fc [0,4194304] 0 2024-01-31T05:13:10.539 INFO:tasks.workunit.client.0.smithi099.stdout:1/278: dwrite d4/dc/d48/f3d [0,4194304] 0 2024-01-31T05:13:10.539 INFO:tasks.workunit.client.0.smithi099.stdout:1/279: getdents d4/dc/d44 0 2024-01-31T05:13:10.540 INFO:tasks.workunit.client.0.smithi099.stdout:5/277: symlink d6/d1e/d1f/l50 0 2024-01-31T05:13:10.542 INFO:tasks.workunit.client.0.smithi099.stdout:8/342: stat d1/dd/d11/d29/d3a/l63 0 2024-01-31T05:13:10.544 INFO:tasks.workunit.client.0.smithi099.stdout:0/212: mknod d1/d30/c44 0 2024-01-31T05:13:10.549 INFO:tasks.workunit.client.0.smithi099.stdout:1/280: symlink d4/db/d24/d4b/d50/l58 0 2024-01-31T05:13:10.549 INFO:tasks.workunit.client.0.smithi099.stdout:1/281: dread - d4/dc/d15/f39 zero size 2024-01-31T05:13:10.549 INFO:tasks.workunit.client.0.smithi099.stdout:1/282: read - d4/dc/d15/f4e zero size 2024-01-31T05:13:10.549 INFO:tasks.workunit.client.0.smithi099.stdout:1/283: dread - d4/dc/d48/f2f zero size 2024-01-31T05:13:10.550 INFO:tasks.workunit.client.0.smithi099.stdout:5/278: mkdir d6/da/d14/d3d/d51 0 2024-01-31T05:13:10.551 INFO:tasks.workunit.client.0.smithi099.stdout:0/213: chown d1/d22 98031 1 2024-01-31T05:13:10.553 INFO:tasks.workunit.client.0.smithi099.stdout:0/214: unlink d1/f9 0 2024-01-31T05:13:10.555 INFO:tasks.workunit.client.0.smithi099.stdout:0/215: mkdir d1/d30/d45 0 2024-01-31T05:13:10.562 INFO:tasks.workunit.client.0.smithi099.stdout:3/220: dwrite d10/f16 [0,4194304] 0 2024-01-31T05:13:10.567 INFO:tasks.workunit.client.0.smithi099.stdout:0/216: write d1/f5 [2883303,66157] 0 2024-01-31T05:13:10.567 INFO:tasks.workunit.client.0.smithi099.stdout:0/217: chown d1/d8/c42 2558 1 2024-01-31T05:13:10.567 INFO:tasks.workunit.client.0.smithi099.stdout:0/218: chown d1/d16 6 1 2024-01-31T05:13:10.569 INFO:tasks.workunit.client.0.smithi099.stdout:0/219: link d1/d16/d36/f3e d1/d8/df/d2e/f46 0 2024-01-31T05:13:10.569 INFO:tasks.workunit.client.0.smithi099.stdout:0/220: chown d1/d16/f2f 10805240 1 2024-01-31T05:13:10.571 INFO:tasks.workunit.client.0.smithi099.stdout:0/221: truncate d1/f2c 3297776 0 2024-01-31T05:13:10.571 INFO:tasks.workunit.client.0.smithi099.stdout:0/222: truncate d1/d8/df/f1d 4344055 0 2024-01-31T05:13:10.572 INFO:tasks.workunit.client.0.smithi099.stdout:6/237: dwrite d14/d18/d1a/f3e [0,4194304] 0 2024-01-31T05:13:10.573 INFO:tasks.workunit.client.0.smithi099.stdout:0/223: rename d1/c38 to d1/d16/c47 0 2024-01-31T05:13:10.574 INFO:tasks.workunit.client.0.smithi099.stdout:5/279: dwrite d6/f13 [0,4194304] 0 2024-01-31T05:13:10.574 INFO:tasks.workunit.client.0.smithi099.stdout:5/280: chown d6/d1e/d1f 6204 1 2024-01-31T05:13:10.574 INFO:tasks.workunit.client.0.smithi099.stdout:5/281: chown d6/d1e/d1f/d21 103 1 2024-01-31T05:13:10.574 INFO:tasks.workunit.client.0.smithi099.stdout:5/282: chown d6/d1e/d1f/f22 27052999 1 2024-01-31T05:13:10.575 INFO:tasks.workunit.client.0.smithi099.stdout:3/221: dread d10/d18/f26 [4194304,4194304] 0 2024-01-31T05:13:10.575 INFO:tasks.workunit.client.0.smithi099.stdout:3/222: read - d10/d27/f53 zero size 2024-01-31T05:13:10.576 INFO:tasks.workunit.client.0.smithi099.stdout:5/283: mkdir d6/d52 0 2024-01-31T05:13:10.577 INFO:tasks.workunit.client.0.smithi099.stdout:6/238: mkdir d14/d18/d1a/d1c/d29/d43 0 2024-01-31T05:13:10.579 INFO:tasks.workunit.client.0.smithi099.stdout:0/224: rename d1/d8/df/f29 to d1/f48 0 2024-01-31T05:13:10.580 INFO:tasks.workunit.client.0.smithi099.stdout:5/284: creat d6/da/d14/d3d/f53 x:0 0 0 2024-01-31T05:13:10.581 INFO:tasks.workunit.client.0.smithi099.stdout:1/284: dwrite d4/db/f25 [0,4194304] 0 2024-01-31T05:13:10.582 INFO:tasks.workunit.client.0.smithi099.stdout:1/285: write d4/dc/d15/f1a [5121682,120042] 0 2024-01-31T05:13:10.582 INFO:tasks.workunit.client.0.smithi099.stdout:1/286: write d4/db/d24/d4b/f52 [9598880,121599] 0 2024-01-31T05:13:10.582 INFO:tasks.workunit.client.0.smithi099.stdout:0/225: write d1/d16/d36/f3e [3708871,51321] 0 2024-01-31T05:13:10.582 INFO:tasks.workunit.client.0.smithi099.stdout:6/239: dread d14/d18/d1a/d1c/d29/f2b [0,4194304] 0 2024-01-31T05:13:10.591 INFO:tasks.workunit.client.0.smithi099.stdout:1/287: mknod d4/db/d3a/c59 0 2024-01-31T05:13:10.591 INFO:tasks.workunit.client.0.smithi099.stdout:1/288: creat d4/dc/d15/f5a x:0 0 0 2024-01-31T05:13:10.591 INFO:tasks.workunit.client.0.smithi099.stdout:1/289: write d4/df/f34 [689851,81412] 0 2024-01-31T05:13:10.591 INFO:tasks.workunit.client.0.smithi099.stdout:1/290: read d4/df/f3e [291578,23504] 0 2024-01-31T05:13:10.592 INFO:tasks.workunit.client.0.smithi099.stdout:0/226: mknod d1/d16/d36/c49 0 2024-01-31T05:13:10.592 INFO:tasks.workunit.client.0.smithi099.stdout:3/223: dread d10/d18/f2c [4194304,4194304] 0 2024-01-31T05:13:10.593 INFO:tasks.workunit.client.0.smithi099.stdout:6/240: creat d14/d18/d1a/d1c/f44 x:0 0 0 2024-01-31T05:13:10.595 INFO:tasks.workunit.client.0.smithi099.stdout:1/291: creat d4/db/d24/d4b/d50/f5b x:0 0 0 2024-01-31T05:13:10.597 INFO:tasks.workunit.client.0.smithi099.stdout:6/241: rmdir d14/d18/d1a 39 2024-01-31T05:13:10.597 INFO:tasks.workunit.client.0.smithi099.stdout:6/242: fdatasync f10 0 2024-01-31T05:13:10.598 INFO:tasks.workunit.client.0.smithi099.stdout:0/227: mkdir d1/d37/d4a 0 2024-01-31T05:13:10.598 INFO:tasks.workunit.client.0.smithi099.stdout:0/228: fsync d1/d16/f31 0 2024-01-31T05:13:10.598 INFO:tasks.workunit.client.0.smithi099.stdout:0/229: write d1/d8/df/f33 [455362,40137] 0 2024-01-31T05:13:10.599 INFO:tasks.workunit.client.0.smithi099.stdout:6/243: creat d14/d18/d1a/f45 x:0 0 0 2024-01-31T05:13:10.601 INFO:tasks.workunit.client.0.smithi099.stdout:5/285: dwrite d6/d1e/f3c [0,4194304] 0 2024-01-31T05:13:10.602 INFO:tasks.workunit.client.0.smithi099.stdout:5/286: stat d6/da/d3f/f45 0 2024-01-31T05:13:10.602 INFO:tasks.workunit.client.0.smithi099.stdout:1/292: dread d4/dc/d48/f31 [0,4194304] 0 2024-01-31T05:13:10.602 INFO:tasks.workunit.client.0.smithi099.stdout:0/230: unlink d1/d16/f24 0 2024-01-31T05:13:10.606 INFO:tasks.workunit.client.0.smithi099.stdout:5/287: symlink d6/d1e/d1f/l54 0 2024-01-31T05:13:10.607 INFO:tasks.workunit.client.0.smithi099.stdout:3/224: dread d10/d1e/f2b [0,4194304] 0 2024-01-31T05:13:10.609 INFO:tasks.workunit.client.0.smithi099.stdout:1/293: link d4/df/l27 d4/df/d53/l5c 0 2024-01-31T05:13:10.609 INFO:tasks.workunit.client.0.smithi099.stdout:1/294: fsync d4/dc/f43 0 2024-01-31T05:13:10.610 INFO:tasks.workunit.client.0.smithi099.stdout:0/231: link d1/d16/f2f d1/d8/df/d2e/f4b 0 2024-01-31T05:13:10.611 INFO:tasks.workunit.client.0.smithi099.stdout:5/288: creat d6/da/d14/d3d/d51/f55 x:0 0 0 2024-01-31T05:13:10.611 INFO:tasks.workunit.client.0.smithi099.stdout:5/289: creat d6/da/f56 x:0 0 0 2024-01-31T05:13:10.611 INFO:tasks.workunit.client.0.smithi099.stdout:5/290: dread - d6/da/d14/d3d/d51/f55 zero size 2024-01-31T05:13:10.612 INFO:tasks.workunit.client.0.smithi099.stdout:3/225: symlink d10/d32/d33/d51/l54 0 2024-01-31T05:13:10.615 INFO:tasks.workunit.client.0.smithi099.stdout:5/291: mkdir d6/da/d14/d3d/d57 0 2024-01-31T05:13:10.615 INFO:tasks.workunit.client.0.smithi099.stdout:5/292: creat d6/da/d3f/f58 x:0 0 0 2024-01-31T05:13:10.615 INFO:tasks.workunit.client.0.smithi099.stdout:5/293: truncate d6/da/d3f/f45 1169038 0 2024-01-31T05:13:10.615 INFO:tasks.workunit.client.0.smithi099.stdout:3/226: mknod d10/d27/d34/d50/c55 0 2024-01-31T05:13:10.619 INFO:tasks.workunit.client.0.smithi099.stdout:5/294: unlink f3 0 2024-01-31T05:13:10.621 INFO:tasks.workunit.client.0.smithi099.stdout:5/295: mknod d6/d1e/d1f/c59 0 2024-01-31T05:13:10.621 INFO:tasks.workunit.client.0.smithi099.stdout:5/296: stat d6/d1e/f4e 0 2024-01-31T05:13:10.621 INFO:tasks.workunit.client.0.smithi099.stdout:5/297: write d6/da/d3f/f45 [2152260,81629] 0 2024-01-31T05:13:10.622 INFO:tasks.workunit.client.0.smithi099.stdout:5/298: write d6/d1e/f2c [599027,56396] 0 2024-01-31T05:13:10.622 INFO:tasks.workunit.client.0.smithi099.stdout:3/227: rmdir d10/d27/d34/d44 39 2024-01-31T05:13:10.626 INFO:tasks.workunit.client.0.smithi099.stdout:5/299: mkdir d6/da/d3f/d5a 0 2024-01-31T05:13:10.626 INFO:tasks.workunit.client.0.smithi099.stdout:5/300: write d6/d1e/f2d [13072,65777] 0 2024-01-31T05:13:10.630 INFO:tasks.workunit.client.0.smithi099.stdout:3/228: write d10/d18/f1d [2125766,42327] 0 2024-01-31T05:13:10.630 INFO:tasks.workunit.client.0.smithi099.stdout:5/301: rename d6/d1e/d1f/l54 to d6/d1e/l5b 0 2024-01-31T05:13:10.630 INFO:tasks.workunit.client.0.smithi099.stdout:3/229: chown l6 0 1 2024-01-31T05:13:10.630 INFO:tasks.workunit.client.0.smithi099.stdout:3/230: write d10/d18/f26 [808764,40583] 0 2024-01-31T05:13:10.631 INFO:tasks.workunit.client.0.smithi099.stdout:0/232: dwrite d1/f20 [0,4194304] 0 2024-01-31T05:13:10.631 INFO:tasks.workunit.client.0.smithi099.stdout:0/233: fdatasync d1/d8/df/f33 0 2024-01-31T05:13:10.633 INFO:tasks.workunit.client.0.smithi099.stdout:5/302: unlink d6/da/d14/d2b/f44 0 2024-01-31T05:13:10.637 INFO:tasks.workunit.client.0.smithi099.stdout:5/303: link d6/da/d14/l15 d6/da/l5c 0 2024-01-31T05:13:10.637 INFO:tasks.workunit.client.0.smithi099.stdout:5/304: chown d6/d52 3 1 2024-01-31T05:13:10.643 INFO:tasks.workunit.client.0.smithi099.stdout:5/305: dread d6/f3e [0,4194304] 0 2024-01-31T05:13:10.650 INFO:tasks.workunit.client.0.smithi099.stdout:7/258: sync 2024-01-31T05:13:10.654 INFO:tasks.workunit.client.0.smithi099.stdout:7/259: rename d6/l19 to d6/d32/d3d/d4b/d33/d37/d50/l51 0 2024-01-31T05:13:10.654 INFO:tasks.workunit.client.0.smithi099.stdout:7/260: chown d6/cd 925473316 1 2024-01-31T05:13:10.656 INFO:tasks.workunit.client.0.smithi099.stdout:3/231: dwrite d10/d32/f3b [0,4194304] 0 2024-01-31T05:13:10.657 INFO:tasks.workunit.client.0.smithi099.stdout:0/234: dwrite d1/f48 [0,4194304] 0 2024-01-31T05:13:10.659 INFO:tasks.workunit.client.0.smithi099.stdout:7/261: creat d6/f52 x:0 0 0 2024-01-31T05:13:10.663 INFO:tasks.workunit.client.0.smithi099.stdout:3/232: link d10/d1e/c3e d10/d32/d33/d51/c56 0 2024-01-31T05:13:10.666 INFO:tasks.workunit.client.0.smithi099.stdout:5/306: dwrite f1 [0,4194304] 0 2024-01-31T05:13:10.666 INFO:tasks.workunit.client.0.smithi099.stdout:5/307: stat d6/d1e/d1f 0 2024-01-31T05:13:10.667 INFO:tasks.workunit.client.0.smithi099.stdout:7/262: symlink d6/d32/l53 0 2024-01-31T05:13:10.669 INFO:tasks.workunit.client.0.smithi099.stdout:3/233: truncate d10/d27/f29 816583 0 2024-01-31T05:13:10.670 INFO:tasks.workunit.client.0.smithi099.stdout:5/308: symlink d6/da/l5d 0 2024-01-31T05:13:10.672 INFO:tasks.workunit.client.0.smithi099.stdout:7/263: symlink d6/d12/l54 0 2024-01-31T05:13:10.674 INFO:tasks.workunit.client.0.smithi099.stdout:5/309: symlink d6/d1e/d1f/l5e 0 2024-01-31T05:13:10.675 INFO:tasks.workunit.client.0.smithi099.stdout:0/235: dwrite d1/d8/df/f25 [0,4194304] 0 2024-01-31T05:13:10.675 INFO:tasks.workunit.client.0.smithi099.stdout:0/236: truncate d1/d16/f31 1067442 0 2024-01-31T05:13:10.678 INFO:tasks.workunit.client.0.smithi099.stdout:3/234: read d10/d1e/f25 [485910,123087] 0 2024-01-31T05:13:10.678 INFO:tasks.workunit.client.0.smithi099.stdout:7/264: truncate d6/d32/d3d/d4b/d33/d37/d50/f2c 3775918 0 2024-01-31T05:13:10.678 INFO:tasks.workunit.client.0.smithi099.stdout:7/265: creat d6/d32/d3d/d4b/d33/d37/d4e/f55 x:0 0 0 2024-01-31T05:13:10.678 INFO:tasks.workunit.client.0.smithi099.stdout:7/266: fdatasync d6/d32/d3d/d4b/d33/d37/d4e/f4f 0 2024-01-31T05:13:10.678 INFO:tasks.workunit.client.0.smithi099.stdout:7/267: getdents d6/d32/d3d/d4b/d33/d37/d50/d25/d43 0 2024-01-31T05:13:10.678 INFO:tasks.workunit.client.0.smithi099.stdout:5/310: mknod d6/da/c5f 0 2024-01-31T05:13:10.678 INFO:tasks.workunit.client.0.smithi099.stdout:5/311: write d6/da/d14/d3d/f53 [638335,5648] 0 2024-01-31T05:13:10.679 INFO:tasks.workunit.client.0.smithi099.stdout:5/312: chown d6/d1e/d1f/d21/l29 743 1 2024-01-31T05:13:10.681 INFO:tasks.workunit.client.0.smithi099.stdout:0/237: symlink d1/d16/l4c 0 2024-01-31T05:13:10.681 INFO:tasks.workunit.client.0.smithi099.stdout:0/238: write d1/d8/df/d2e/f46 [4405567,103725] 0 2024-01-31T05:13:10.682 INFO:tasks.workunit.client.0.smithi099.stdout:7/268: write d6/d32/d3d/d4b/f23 [1063820,52224] 0 2024-01-31T05:13:10.683 INFO:tasks.workunit.client.0.smithi099.stdout:0/239: fdatasync d1/d16/d36/f3e 0 2024-01-31T05:13:10.683 INFO:tasks.workunit.client.0.smithi099.stdout:5/313: mknod d6/d52/c60 0 2024-01-31T05:13:10.689 INFO:tasks.workunit.client.0.smithi099.stdout:5/314: rmdir d6/da/d14 39 2024-01-31T05:13:10.695 INFO:tasks.workunit.client.0.smithi099.stdout:3/235: write d10/d32/f3b [3256014,50253] 0 2024-01-31T05:13:10.695 INFO:tasks.workunit.client.0.smithi099.stdout:3/236: stat d10/c13 0 2024-01-31T05:13:10.695 INFO:tasks.workunit.client.0.smithi099.stdout:3/237: creat d10/d27/f57 x:0 0 0 2024-01-31T05:13:10.698 INFO:tasks.workunit.client.0.smithi099.stdout:3/238: symlink d10/d27/d34/d44/l58 0 2024-01-31T05:13:10.698 INFO:tasks.workunit.client.0.smithi099.stdout:3/239: chown d10 100 1 2024-01-31T05:13:10.698 INFO:tasks.workunit.client.0.smithi099.stdout:3/240: chown d10/d24/d40/l4b 227290674 1 2024-01-31T05:13:10.702 INFO:tasks.workunit.client.0.smithi099.stdout:3/241: creat d10/d24/d40/f59 x:0 0 0 2024-01-31T05:13:10.704 INFO:tasks.workunit.client.0.smithi099.stdout:3/242: creat d10/d32/f5a x:0 0 0 2024-01-31T05:13:10.717 INFO:tasks.workunit.client.0.smithi099.stdout:5/315: dwrite d6/d1e/f2d [0,4194304] 0 2024-01-31T05:13:10.718 INFO:tasks.workunit.client.0.smithi099.stdout:0/240: dwrite d1/d16/f1c [4194304,4194304] 0 2024-01-31T05:13:10.718 INFO:tasks.workunit.client.0.smithi099.stdout:0/241: fdatasync d1/d16/f31 0 2024-01-31T05:13:10.718 INFO:tasks.workunit.client.0.smithi099.stdout:7/269: dwrite f3 [0,4194304] 0 2024-01-31T05:13:10.718 INFO:tasks.workunit.client.0.smithi099.stdout:3/243: dread d10/f16 [0,4194304] 0 2024-01-31T05:13:10.720 INFO:tasks.workunit.client.0.smithi099.stdout:5/316: truncate d6/d1e/d1f/f3a 58352 0 2024-01-31T05:13:10.730 INFO:tasks.workunit.client.0.smithi099.stdout:3/244: write d10/f16 [2081766,69894] 0 2024-01-31T05:13:10.730 INFO:tasks.workunit.client.0.smithi099.stdout:3/245: chown d10/d32/d33/d4a 32 1 2024-01-31T05:13:10.730 INFO:tasks.workunit.client.0.smithi099.stdout:3/246: fdatasync d10/d1e/f2b 0 2024-01-31T05:13:10.730 INFO:tasks.workunit.client.0.smithi099.stdout:3/247: creat d10/d27/f5b x:0 0 0 2024-01-31T05:13:10.730 INFO:tasks.workunit.client.0.smithi099.stdout:7/270: rename d6/l9 to d6/d32/d3d/d4b/d33/d37/d50/d25/d47/l56 0 2024-01-31T05:13:10.734 INFO:tasks.workunit.client.0.smithi099.stdout:3/248: truncate d10/d24/d40/f47 3760057 0 2024-01-31T05:13:10.734 INFO:tasks.workunit.client.0.smithi099.stdout:3/249: stat d10/d24/d40 0 2024-01-31T05:13:10.734 INFO:tasks.workunit.client.0.smithi099.stdout:3/250: chown d10/c14 111 1 2024-01-31T05:13:10.737 INFO:tasks.workunit.client.0.smithi099.stdout:3/251: creat d10/d27/d34/f5c x:0 0 0 2024-01-31T05:13:10.738 INFO:tasks.workunit.client.0.smithi099.stdout:3/252: chown d10/l12 184327929 1 2024-01-31T05:13:10.738 INFO:tasks.workunit.client.0.smithi099.stdout:3/253: write d10/d18/f1d [4892626,76729] 0 2024-01-31T05:13:10.738 INFO:tasks.workunit.client.0.smithi099.stdout:0/242: dwrite d1/f2c [4194304,4194304] 0 2024-01-31T05:13:10.741 INFO:tasks.workunit.client.0.smithi099.stdout:4/278: sync 2024-01-31T05:13:10.741 INFO:tasks.workunit.client.0.smithi099.stdout:9/191: sync 2024-01-31T05:13:10.741 INFO:tasks.workunit.client.0.smithi099.stdout:4/279: fsync d0/d2/d20/d21/f53 0 2024-01-31T05:13:10.741 INFO:tasks.workunit.client.0.smithi099.stdout:4/280: fsync d0/d2/d20/d21/d17/d24/f32 0 2024-01-31T05:13:10.743 INFO:tasks.workunit.client.0.smithi099.stdout:4/281: truncate d0/d2/f15 3315954 0 2024-01-31T05:13:10.747 INFO:tasks.workunit.client.0.smithi099.stdout:8/343: sync 2024-01-31T05:13:10.747 INFO:tasks.workunit.client.0.smithi099.stdout:6/244: sync 2024-01-31T05:13:10.748 INFO:tasks.workunit.client.0.smithi099.stdout:1/295: sync 2024-01-31T05:13:10.748 INFO:tasks.workunit.client.0.smithi099.stdout:2/262: sync 2024-01-31T05:13:10.748 INFO:tasks.workunit.client.0.smithi099.stdout:1/296: fsync d4/db/f25 0 2024-01-31T05:13:10.750 INFO:tasks.workunit.client.0.smithi099.stdout:1/297: mkdir d4/dc/d4d/d5d 0 2024-01-31T05:13:10.750 INFO:tasks.workunit.client.0.smithi099.stdout:2/263: mknod d10/c5d 0 2024-01-31T05:13:10.752 INFO:tasks.workunit.client.0.smithi099.stdout:1/298: symlink d4/dc/d15/l5e 0 2024-01-31T05:13:10.754 INFO:tasks.workunit.client.0.smithi099.stdout:1/299: getdents d4/db/d24/d4b/d50 0 2024-01-31T05:13:10.756 INFO:tasks.workunit.client.0.smithi099.stdout:1/300: write d4/dc/d15/f33 [11676,45773] 0 2024-01-31T05:13:10.757 INFO:tasks.workunit.client.0.smithi099.stdout:1/301: chown d4/dc/d29/l2e 27 1 2024-01-31T05:13:10.759 INFO:tasks.workunit.client.0.smithi099.stdout:0/243: write d1/f20 [769916,107837] 0 2024-01-31T05:13:10.759 INFO:tasks.workunit.client.0.smithi099.stdout:0/244: chown d1/d16/f1c 74518140 1 2024-01-31T05:13:10.761 INFO:tasks.workunit.client.0.smithi099.stdout:9/192: write d0/d3e/f40 [5865083,88249] 0 2024-01-31T05:13:10.762 INFO:tasks.workunit.client.0.smithi099.stdout:3/254: dwrite d10/d27/f53 [0,4194304] 0 2024-01-31T05:13:10.762 INFO:tasks.workunit.client.0.smithi099.stdout:1/302: dread d4/dc/d4d/f51 [0,4194304] 0 2024-01-31T05:13:10.762 INFO:tasks.workunit.client.0.smithi099.stdout:0/245: symlink d1/d37/d4a/l4d 0 2024-01-31T05:13:10.765 INFO:tasks.workunit.client.0.smithi099.stdout:9/193: mkdir d0/d44 0 2024-01-31T05:13:10.769 INFO:tasks.workunit.client.0.smithi099.stdout:3/255: rmdir d10/d27/d34/d50 39 2024-01-31T05:13:10.769 INFO:tasks.workunit.client.0.smithi099.stdout:3/256: creat d10/d27/f5d x:0 0 0 2024-01-31T05:13:10.769 INFO:tasks.workunit.client.0.smithi099.stdout:3/257: write d10/d32/f5a [361868,61827] 0 2024-01-31T05:13:10.769 INFO:tasks.workunit.client.0.smithi099.stdout:3/258: chown d10/d32/d33/d4a 7306348 1 2024-01-31T05:13:10.770 INFO:tasks.workunit.client.0.smithi099.stdout:1/303: creat d4/dc/d48/f5f x:0 0 0 2024-01-31T05:13:10.771 INFO:tasks.workunit.client.0.smithi099.stdout:0/246: link d1/d30/c44 d1/d16/c4e 0 2024-01-31T05:13:10.773 INFO:tasks.workunit.client.0.smithi099.stdout:9/194: rename d0/c30 to d0/d1/c45 0 2024-01-31T05:13:10.773 INFO:tasks.workunit.client.0.smithi099.stdout:9/195: write d0/d7/f1f [876,87733] 0 2024-01-31T05:13:10.774 INFO:tasks.workunit.client.0.smithi099.stdout:3/259: mknod d10/d27/c5e 0 2024-01-31T05:13:10.775 INFO:tasks.workunit.client.0.smithi099.stdout:3/260: write d10/d32/f3b [4980883,87602] 0 2024-01-31T05:13:10.775 INFO:tasks.workunit.client.0.smithi099.stdout:3/261: dread - d10/d27/d34/f5c zero size 2024-01-31T05:13:10.777 INFO:tasks.workunit.client.0.smithi099.stdout:6/245: dwrite d14/d18/d1a/d1c/d29/f3f [0,4194304] 0 2024-01-31T05:13:10.777 INFO:tasks.workunit.client.0.smithi099.stdout:1/304: rename d4/f6 to d4/db/d3a/f60 0 2024-01-31T05:13:10.777 INFO:tasks.workunit.client.0.smithi099.stdout:1/305: truncate d4/dc/d48/f2f 84685 0 2024-01-31T05:13:10.778 INFO:tasks.workunit.client.0.smithi099.stdout:1/306: chown d4/df/d37 14910147 1 2024-01-31T05:13:10.779 INFO:tasks.workunit.client.0.smithi099.stdout:4/282: dwrite d0/d2/d20/f31 [0,4194304] 0 2024-01-31T05:13:10.779 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:10.709+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f19 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-nsec-timestamps/Makefile auth v8 ap=1 s=969 n(v0 rc2024-01-31T05:12:56.346601+0000 b969 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850f87700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f19:[<0x10000001f18/Makefile v2>,<0x10000001f0c/ext4-nsec-timestamps v152>,<0x10000001f09/ext4-new-features v42>,<0x10000001eda/fs v106>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f19:[<0x10000001f18/Makefile v8>,<0x10000001f0c/ext4-nsec-timestamps v152>,<0x10000001f09/ext4-new-features v378>,<0x10000001eda/fs v1142>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:10.780 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:10.709+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d5b [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-nsec-timestamps/ext4_file_time.c auth v10 ap=1 s=2598 n(v0 rc2009-10-26T11:25:55.000000+0000 b2598 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850f92000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d5b:[<0x10000001f18/ext4_file_time.c v4>,<0x10000001f0c/ext4-nsec-timestamps v152>,<0x10000001f09/ext4-new-features v42>,<0x10000001eda/fs v106>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001d5b:[<0x10000001f18/ext4_file_time.c v10>,<0x10000001f0c/ext4-nsec-timestamps v152>,<0x10000001f09/ext4-new-features v378>,<0x10000001eda/fs v1142>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:10.780 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:10.709+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d5c [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-nsec-timestamps/ext4_nsec_timestamps_test.sh auth v12 ap=1 s=5938 n(v0 rc2009-12-09T12:02:24.000000+0000 b5938 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850f92580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d5c:[<0x10000001f18/ext4_nsec_timestamps_test.sh v6>,<0x10000001f0c/ext4-nsec-timestamps v152>,<0x10000001f09/ext4-new-features v42>,<0x10000001eda/fs v106>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001d5c:[<0x10000001f18/ext4_nsec_timestamps_test.sh v12>,<0x10000001f0c/ext4-nsec-timestamps v152>,<0x10000001f09/ext4-new-features v378>,<0x10000001eda/fs v1142>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:10.780 INFO:tasks.workunit.client.0.smithi099.stdout:3/262: link d10/d32/l4f d10/d27/l5f 0 2024-01-31T05:13:10.780 INFO:tasks.workunit.client.0.smithi099.stdout:2/264: dwrite d10/f3b [4194304,4194304] 0 2024-01-31T05:13:10.781 INFO:tasks.workunit.client.0.smithi099.stdout:0/247: getdents d1/d8 0 2024-01-31T05:13:10.786 INFO:tasks.workunit.client.0.smithi099.stdout:4/283: rename d0/d2/le to d0/d8/d19/l62 0 2024-01-31T05:13:10.787 INFO:tasks.workunit.client.0.smithi099.stdout:3/263: truncate d10/d27/f30 2994917 0 2024-01-31T05:13:10.790 INFO:tasks.workunit.client.0.smithi099.stdout:2/265: symlink d10/d1b/d4d/d5a/l5e 0 2024-01-31T05:13:10.793 INFO:tasks.workunit.client.0.smithi099.stdout:4/284: rename d0/d8/d19/f44 to d0/d8/f63 0 2024-01-31T05:13:10.793 INFO:tasks.workunit.client.0.smithi099.stdout:4/285: stat d0/d8/f11 0 2024-01-31T05:13:10.794 INFO:tasks.workunit.client.0.smithi099.stdout:3/264: mkdir d10/d27/d34/d44/d60 0 2024-01-31T05:13:10.794 INFO:tasks.workunit.client.0.smithi099.stdout:3/265: readlink d10/d27/d34/d44/l58 0 2024-01-31T05:13:10.797 INFO:tasks.workunit.client.0.smithi099.stdout:0/248: dread d1/d8/df/f15 [0,4194304] 0 2024-01-31T05:13:10.797 INFO:tasks.workunit.client.0.smithi099.stdout:4/286: rename d0/d2/d20/d21/f53 to d0/d8/f64 0 2024-01-31T05:13:10.799 INFO:tasks.workunit.client.0.smithi099.stdout:2/266: getdents d10/d1c 0 2024-01-31T05:13:10.799 INFO:tasks.workunit.client.0.smithi099.stdout:2/267: readlink l9 0 2024-01-31T05:13:10.800 INFO:tasks.workunit.client.0.smithi099.stdout:0/249: symlink d1/d30/d45/l4f 0 2024-01-31T05:13:10.800 INFO:tasks.workunit.client.0.smithi099.stdout:0/250: fdatasync d1/d8/df/f25 0 2024-01-31T05:13:10.800 INFO:tasks.workunit.client.0.smithi099.stdout:0/251: fdatasync d1/f5 0 2024-01-31T05:13:10.800 INFO:tasks.workunit.client.0.smithi099.stdout:0/252: creat d1/d16/f50 x:0 0 0 2024-01-31T05:13:10.801 INFO:tasks.workunit.client.0.smithi099.stdout:2/268: creat d10/d2b/d58/f5f x:0 0 0 2024-01-31T05:13:10.801 INFO:tasks.workunit.client.0.smithi099.stdout:9/196: dwrite d0/d7/f23 [0,4194304] 0 2024-01-31T05:13:10.801 INFO:tasks.workunit.client.0.smithi099.stdout:9/197: read - d0/d7/f35 zero size 2024-01-31T05:13:10.801 INFO:tasks.workunit.client.0.smithi099.stdout:9/198: stat d0/d1/d24/d2b/f3c 0 2024-01-31T05:13:10.803 INFO:tasks.workunit.client.0.smithi099.stdout:1/307: dwrite d4/df/f22 [0,4194304] 0 2024-01-31T05:13:10.806 INFO:tasks.workunit.client.0.smithi099.stdout:9/199: creat d0/d7/f46 x:0 0 0 2024-01-31T05:13:10.806 INFO:tasks.workunit.client.0.smithi099.stdout:9/200: write d0/d7/f23 [5072558,11639] 0 2024-01-31T05:13:10.809 INFO:tasks.workunit.client.0.smithi099.stdout:1/308: symlink d4/dc/d29/l61 0 2024-01-31T05:13:10.810 INFO:tasks.workunit.client.0.smithi099.stdout:9/201: mknod d0/c47 0 2024-01-31T05:13:10.812 INFO:tasks.workunit.client.0.smithi099.stdout:0/253: write d1/f4 [501751,68438] 0 2024-01-31T05:13:10.814 INFO:tasks.workunit.client.0.smithi099.stdout:0/254: mknod d1/d37/d4a/c51 0 2024-01-31T05:13:10.825 INFO:tasks.workunit.client.0.smithi099.stdout:2/269: dwrite d10/d20/f4c [0,4194304] 0 2024-01-31T05:13:10.825 INFO:tasks.workunit.client.0.smithi099.stdout:4/287: dread d0/d8/f16 [0,4194304] 0 2024-01-31T05:13:10.825 INFO:tasks.workunit.client.0.smithi099.stdout:4/288: write d0/d8/d19/f1c [2185999,32750] 0 2024-01-31T05:13:10.831 INFO:tasks.workunit.client.0.smithi099.stdout:2/270: rename d10/d1c/l4a to d10/d51/l60 0 2024-01-31T05:13:10.831 INFO:tasks.workunit.client.0.smithi099.stdout:2/271: stat d10/d1c/c30 0 2024-01-31T05:13:10.833 INFO:tasks.workunit.client.0.smithi099.stdout:4/289: mkdir d0/d8/d19/d65 0 2024-01-31T05:13:10.833 INFO:tasks.workunit.client.0.smithi099.stdout:4/290: stat d0/f5b 0 2024-01-31T05:13:10.833 INFO:tasks.workunit.client.0.smithi099.stdout:4/291: write d0/d8/d19/f2d [2197,26295] 0 2024-01-31T05:13:10.834 INFO:tasks.workunit.client.0.smithi099.stdout:2/272: truncate d10/d2b/f5c 389323 0 2024-01-31T05:13:10.834 INFO:tasks.workunit.client.0.smithi099.stdout:2/273: fdatasync d10/d1b/f59 0 2024-01-31T05:13:10.835 INFO:tasks.workunit.client.0.smithi099.stdout:4/292: getdents d0/d2/d20/d21/d39 0 2024-01-31T05:13:10.835 INFO:tasks.workunit.client.0.smithi099.stdout:4/293: chown d0/d2/d20/l3a 110 1 2024-01-31T05:13:10.836 INFO:tasks.workunit.client.0.smithi099.stdout:2/274: symlink d10/d20/l61 0 2024-01-31T05:13:10.836 INFO:tasks.workunit.client.0.smithi099.stdout:2/275: fdatasync d10/d1c/f55 0 2024-01-31T05:13:10.836 INFO:tasks.workunit.client.0.smithi099.stdout:2/276: fdatasync d10/d1b/f59 0 2024-01-31T05:13:10.836 INFO:tasks.workunit.client.0.smithi099.stdout:2/277: chown d10/d2b/f5c 3802554 1 2024-01-31T05:13:10.837 INFO:tasks.workunit.client.0.smithi099.stdout:2/278: symlink d10/d1c/l62 0 2024-01-31T05:13:10.846 INFO:tasks.workunit.client.0.smithi099.stdout:0/255: dwrite d1/f4 [4194304,4194304] 0 2024-01-31T05:13:10.846 INFO:tasks.workunit.client.0.smithi099.stdout:0/256: fsync d1/d8/df/d2e/f46 0 2024-01-31T05:13:10.847 INFO:tasks.workunit.client.0.smithi099.stdout:1/309: dwrite d4/db/d12/f4a [0,4194304] 0 2024-01-31T05:13:10.851 INFO:tasks.workunit.client.0.smithi099.stdout:0/257: symlink d1/d16/l52 0 2024-01-31T05:13:10.851 INFO:tasks.workunit.client.0.smithi099.stdout:0/258: stat d1/d8/c42 0 2024-01-31T05:13:10.853 INFO:tasks.workunit.client.0.smithi099.stdout:2/279: write d10/f42 [2202888,8203] 0 2024-01-31T05:13:10.854 INFO:tasks.workunit.client.0.smithi099.stdout:1/310: symlink d4/dc/d29/l62 0 2024-01-31T05:13:10.857 INFO:tasks.workunit.client.0.smithi099.stdout:2/280: mknod d10/d1b/d4d/d5a/c63 0 2024-01-31T05:13:10.857 INFO:tasks.workunit.client.0.smithi099.stdout:2/281: chown d10/d1c/f26 46 1 2024-01-31T05:13:10.857 INFO:tasks.workunit.client.0.smithi099.stdout:2/282: dread - d10/d1b/f59 zero size 2024-01-31T05:13:10.857 INFO:tasks.workunit.client.0.smithi099.stdout:2/283: chown d10/f33 280 1 2024-01-31T05:13:10.857 INFO:tasks.workunit.client.0.smithi099.stdout:4/294: dwrite d0/d2/f15 [0,4194304] 0 2024-01-31T05:13:10.858 INFO:tasks.workunit.client.0.smithi099.stdout:1/311: mknod d4/dc/d15/d45/c63 0 2024-01-31T05:13:10.861 INFO:tasks.workunit.client.0.smithi099.stdout:1/312: unlink d4/dc/d15/l5e 0 2024-01-31T05:13:10.861 INFO:tasks.workunit.client.0.smithi099.stdout:1/313: readlink d4/df/d37/l3f 0 2024-01-31T05:13:10.862 INFO:tasks.workunit.client.0.smithi099.stdout:1/314: rename d4/db/l13 to d4/dc/d44/l64 0 2024-01-31T05:13:10.867 INFO:tasks.workunit.client.0.smithi099.stdout:1/315: unlink d4/dc/d4d/f4f 0 2024-01-31T05:13:10.867 INFO:tasks.workunit.client.0.smithi099.stdout:1/316: chown d4/df/l27 848646984 1 2024-01-31T05:13:10.867 INFO:tasks.workunit.client.0.smithi099.stdout:0/259: truncate d1/f4 6294438 0 2024-01-31T05:13:10.867 INFO:tasks.workunit.client.0.smithi099.stdout:5/317: sync 2024-01-31T05:13:10.868 INFO:tasks.workunit.client.0.smithi099.stdout:5/318: chown d6 89420 1 2024-01-31T05:13:10.869 INFO:tasks.workunit.client.0.smithi099.stdout:5/319: write d6/da/d14/d3d/f53 [587104,4980] 0 2024-01-31T05:13:10.873 INFO:tasks.workunit.client.0.smithi099.stdout:0/260: link d1/c27 d1/d22/c53 0 2024-01-31T05:13:10.876 INFO:tasks.workunit.client.0.smithi099.stdout:0/261: dread d1/d16/f31 [0,4194304] 0 2024-01-31T05:13:10.876 INFO:tasks.workunit.client.0.smithi099.stdout:1/317: rmdir d4/dc/d15 39 2024-01-31T05:13:10.876 INFO:tasks.workunit.client.0.smithi099.stdout:1/318: creat d4/db/d12/f65 x:0 0 0 2024-01-31T05:13:10.879 INFO:tasks.workunit.client.0.smithi099.stdout:0/262: rename d1/d16/c47 to d1/d8/df/d2e/c54 0 2024-01-31T05:13:10.880 INFO:tasks.workunit.client.0.smithi099.stdout:0/263: truncate d1/d16/f18 380017 0 2024-01-31T05:13:10.883 INFO:tasks.workunit.client.0.smithi099.stdout:1/319: link d4/dc/l1f d4/dc/d15/l66 0 2024-01-31T05:13:10.884 INFO:tasks.workunit.client.0.smithi099.stdout:1/320: mknod d4/c67 0 2024-01-31T05:13:10.885 INFO:tasks.workunit.client.0.smithi099.stdout:1/321: chown d4/dc/d4d 264099 1 2024-01-31T05:13:10.885 INFO:tasks.workunit.client.0.smithi099.stdout:1/322: symlink d4/db/d24/d4b/d50/l68 0 2024-01-31T05:13:10.885 INFO:tasks.workunit.client.0.smithi099.stdout:1/323: chown d4/dc/d29/f36 6 1 2024-01-31T05:13:10.892 INFO:tasks.workunit.client.0.smithi099.stdout:4/295: dwrite d0/d2/f47 [0,4194304] 0 2024-01-31T05:13:10.892 INFO:tasks.workunit.client.0.smithi099.stdout:2/284: dwrite d10/f42 [0,4194304] 0 2024-01-31T05:13:10.901 INFO:tasks.workunit.client.0.smithi099.stdout:0/264: dwrite d1/d37/f41 [0,4194304] 0 2024-01-31T05:13:10.903 INFO:tasks.workunit.client.0.smithi099.stdout:0/265: creat d1/d22/f55 x:0 0 0 2024-01-31T05:13:10.904 INFO:tasks.workunit.client.0.smithi099.stdout:2/285: dread d10/d20/f37 [0,4194304] 0 2024-01-31T05:13:10.906 INFO:tasks.workunit.client.0.smithi099.stdout:2/286: getdents d10/d3a 0 2024-01-31T05:13:10.928 INFO:tasks.workunit.client.0.smithi099.stdout:0/266: dwrite d1/d16/f31 [0,4194304] 0 2024-01-31T05:13:10.946 INFO:tasks.workunit.client.0.smithi099.stdout:0/267: dwrite d1/d16/f18 [0,4194304] 0 2024-01-31T05:13:10.948 INFO:tasks.workunit.client.0.smithi099.stdout:0/268: rmdir d1/d8/df/d2e 39 2024-01-31T05:13:10.950 INFO:tasks.workunit.client.0.smithi099.stdout:0/269: mkdir d1/d56 0 2024-01-31T05:13:10.950 INFO:tasks.workunit.client.0.smithi099.stdout:0/270: creat d1/d16/d36/f57 x:0 0 0 2024-01-31T05:13:10.952 INFO:tasks.workunit.client.0.smithi099.stdout:0/271: rmdir d1/d30 39 2024-01-31T05:13:10.953 INFO:tasks.workunit.client.0.smithi099.stdout:0/272: creat d1/d8/f58 x:0 0 0 2024-01-31T05:13:10.958 INFO:tasks.workunit.client.0.smithi099.stdout:7/271: sync 2024-01-31T05:13:10.958 INFO:tasks.workunit.client.0.smithi099.stdout:7/272: readlink d6/d32/d3d/d4b/l27 0 2024-01-31T05:13:10.959 INFO:tasks.workunit.client.0.smithi099.stdout:7/273: creat d6/d32/d3d/d4b/d33/d37/d50/d25/d47/f57 x:0 0 0 2024-01-31T05:13:10.971 INFO:tasks.workunit.client.0.smithi099.stdout:7/274: dread d6/d12/f1a [0,4194304] 0 2024-01-31T05:13:10.972 INFO:tasks.workunit.client.0.smithi099.stdout:7/275: mkdir d6/d32/d3d/d4b/d33/d37/d50/d4d/d58 0 2024-01-31T05:13:10.972 INFO:tasks.workunit.client.0.smithi099.stdout:7/276: write d6/d32/d3d/d4b/d33/d37/d4e/f4f [743520,77494] 0 2024-01-31T05:13:10.973 INFO:tasks.workunit.client.0.smithi099.stdout:7/277: mknod d6/d32/d3d/d4b/c59 0 2024-01-31T05:13:10.973 INFO:tasks.workunit.client.0.smithi099.stdout:7/278: write d6/f11 [1696250,72791] 0 2024-01-31T05:13:10.977 INFO:tasks.workunit.client.0.smithi099.stdout:0/273: dwrite d1/d8/f3f [0,4194304] 0 2024-01-31T05:13:10.979 INFO:tasks.workunit.client.0.smithi099.stdout:0/274: rename d1/d16/c4e to d1/d8/c59 0 2024-01-31T05:13:10.984 INFO:tasks.workunit.client.0.smithi099.stdout:7/279: write d6/d12/f1d [2633107,126032] 0 2024-01-31T05:13:10.987 INFO:tasks.workunit.client.0.smithi099.stdout:7/280: link d6/d32/d3d/d4b/d33/d37/d4e/f4f d6/d32/d3d/d4b/d33/f5a 0 2024-01-31T05:13:10.987 INFO:tasks.workunit.client.0.smithi099.stdout:0/275: dread d1/d16/f1c [0,4194304] 0 2024-01-31T05:13:10.987 INFO:tasks.workunit.client.0.smithi099.stdout:0/276: creat d1/d16/f5a x:0 0 0 2024-01-31T05:13:10.987 INFO:tasks.workunit.client.0.smithi099.stdout:0/277: creat d1/d8/df/f5b x:0 0 0 2024-01-31T05:13:10.990 INFO:tasks.workunit.client.0.smithi099.stdout:0/278: mknod d1/d8/df/d2e/c5c 0 2024-01-31T05:13:10.992 INFO:tasks.workunit.client.0.smithi099.stdout:0/279: creat d1/d56/f5d x:0 0 0 2024-01-31T05:13:10.994 INFO:tasks.workunit.client.0.smithi099.stdout:0/280: creat d1/d37/d4a/f5e x:0 0 0 2024-01-31T05:13:10.994 INFO:tasks.workunit.client.0.smithi099.stdout:0/281: chown d1/d22/c53 1379 1 2024-01-31T05:13:11.000 INFO:tasks.workunit.client.0.smithi099.stdout:0/282: dread d1/d16/d36/f3e [4194304,4194304] 0 2024-01-31T05:13:11.013 INFO:tasks.workunit.client.0.smithi099.stdout:0/283: write d1/f48 [1983687,43727] 0 2024-01-31T05:13:11.040 INFO:tasks.workunit.client.0.smithi099.stdout:0/284: dwrite d1/d8/df/f5b [0,4194304] 0 2024-01-31T05:13:11.040 INFO:tasks.workunit.client.0.smithi099.stdout:0/285: creat d1/d8/f5f x:0 0 0 2024-01-31T05:13:11.046 INFO:tasks.workunit.client.0.smithi099.stdout:6/246: sync 2024-01-31T05:13:11.047 INFO:tasks.workunit.client.0.smithi099.stdout:8/344: sync 2024-01-31T05:13:11.068 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:10 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:10.844+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000218c [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/aio/aio01/Makefile auth v8 ap=1 s=1202 n(v0 rc2024-01-31T05:12:56.753592+0000 b1202 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d9895fd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000218c:[<0x1000000218b/Makefile v2>,<0x10000002185/aio01 v24>,<0x1000000217c/aio v100>,<0x10000001eda/io v168>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x1000000218c:[<0x1000000218b/Makefile v8>,<0x10000002185/aio01 v24>,<0x1000000217c/aio v183>,<0x10000001eda/io v1158>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:11.068 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:13:10 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:13:10.846+0000 7f421daa0700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fbc [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/aio/aio01/aio01.c auth v6 ap=1 s=10883 n(v0 rc2009-08-30T17:04:40.000000+0000 b10883 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55d9895fd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fbc:[<0x1000000218b/aio01.c v4>,<0x10000002185/aio01 v24>,<0x1000000217c/aio v100>,<0x10000001eda/io v168>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001fbc:[<0x1000000218b/aio01.c v6>,<0x10000002185/aio01 v24>,<0x1000000217c/aio v183>,<0x10000001eda/io v1158>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:11.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:10 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:11.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:10 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001ebe (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/stress.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:11.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:10 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001c83 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/threads_scenarii.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:11.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:10 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001c80 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/testfrmw.h) see mds.h log and `damage ls` output for details 2024-01-31T05:13:11.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:10 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001c7e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/Makefile) see mds.h log and `damage ls` output for details 2024-01-31T05:13:11.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:10 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001c82 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/LICENCE) see mds.h log and `damage ls` output for details 2024-01-31T05:13:11.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:10 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001c81 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/NOTES) see mds.h log and `damage ls` output for details 2024-01-31T05:13:11.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:10 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001c7f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/testfrmw.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:11.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:10 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:10 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:11.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:10 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:10 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:11.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:10 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:10 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:11.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:10 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:10 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:11.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:10 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:10 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:11.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:10 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:10 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:11.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:10 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:10 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:11.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:10 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:10 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:11.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:10 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:10 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:11.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:10 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:10 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:11.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:10 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:11.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:10 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:10 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:10 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:11.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:10 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:10 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:11.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:10 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:10 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:11.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:10 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:10 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:11.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:10 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.072 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:10.837+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f94 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/disktest/man1/disktest.1 auth v8 ap=1 s=25566 n(v0 rc2008-02-14T08:22:25.000000+0000 b25566 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850fa2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f94:[<0x10000002183/disktest.1 v6>,<0x10000002181/man1 v10>,<0x1000000217c/disktest v92>,<0x10000001eda/io v168>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f94:[<0x10000002183/disktest.1 v8>,<0x10000002181/man1 v10>,<0x1000000217c/disktest v181>,<0x10000001eda/io v1158>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:11.072 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:10.837+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002184 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/disktest/man1/disktest.1.gz auth v12 ap=1 s=7512 n(v0 rc2024-01-31T05:12:56.728592+0000 b7512 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850fa3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002184:[<0x10000002183/disktest.1.gz v2>,<0x10000002181/man1 v10>,<0x1000000217c/disktest v92>,<0x10000001eda/io v168>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002184:[<0x10000002183/disktest.1.gz v12>,<0x10000002181/man1 v10>,<0x1000000217c/disktest v181>,<0x10000001eda/io v1158>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:11.072 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:13:10.837+0000 7fb0feaf8700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f93 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/disktest/man1/disktest_manual.html auth v10 ap=1 s=27741 n(v0 rc2008-02-14T08:22:25.000000+0000 b27741 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e850fa3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f93:[<0x10000002183/disktest_manual.html v4>,<0x10000002181/man1 v10>,<0x1000000217c/disktest v92>,<0x10000001eda/io v168>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001f93:[<0x10000002183/disktest_manual.html v10>,<0x10000002181/man1 v10>,<0x1000000217c/disktest v181>,<0x10000001eda/io v1158>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:11.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:11.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001ebe (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/stress.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:11.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001c83 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/threads_scenarii.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:11.073 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001c80 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/testfrmw.h) see mds.h log and `damage ls` output for details 2024-01-31T05:13:11.073 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001c7e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/Makefile) see mds.h log and `damage ls` output for details 2024-01-31T05:13:11.073 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001c82 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/LICENCE) see mds.h log and `damage ls` output for details 2024-01-31T05:13:11.073 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001c81 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/NOTES) see mds.h log and `damage ls` output for details 2024-01-31T05:13:11.073 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001c7f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/testfrmw.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:11.073 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.073 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:11.073 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.073 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:11.073 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.073 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:11.073 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.073 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:11.074 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.074 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:11.074 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.074 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:11.074 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.074 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:11.074 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.074 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:11.074 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.074 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:11.074 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.074 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:11.074 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:11.074 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.074 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.074 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:11.075 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.075 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:11.075 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.075 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:11.075 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.075 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:11.075 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:10 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.087 INFO:tasks.workunit.client.0.smithi099.stdout:0/286: mknod d1/d16/c60 0 2024-01-31T05:13:11.087 INFO:tasks.workunit.client.0.smithi099.stdout:0/287: write d1/d37/d4a/f5e [400397,89218] 0 2024-01-31T05:13:11.087 INFO:tasks.workunit.client.0.smithi099.stdout:0/288: write d1/d16/f50 [795017,75387] 0 2024-01-31T05:13:11.099 INFO:tasks.workunit.client.0.smithi099.stdout:8/345: mkdir d1/dd/d15/d2e/d69 0 2024-01-31T05:13:11.101 INFO:tasks.workunit.client.0.smithi099.stdout:0/289: getdents d1/d37 0 2024-01-31T05:13:11.105 INFO:tasks.workunit.client.0.smithi099.stdout:8/346: getdents d1/dd/d11/d29/d3f/d56/d57 0 2024-01-31T05:13:11.105 INFO:tasks.workunit.client.0.smithi099.stdout:8/347: fsync d1/dd/d1d/f40 0 2024-01-31T05:13:11.105 INFO:tasks.workunit.client.0.smithi099.stdout:8/348: chown d1/dd/d11/d19/d21/l4a 4578 1 2024-01-31T05:13:11.105 INFO:tasks.workunit.client.0.smithi099.stdout:8/349: fsync d1/f5e 0 2024-01-31T05:13:11.105 INFO:tasks.workunit.client.0.smithi099.stdout:8/350: chown d1/dd/c12 1 1 2024-01-31T05:13:11.106 INFO:tasks.workunit.client.0.smithi099.stdout:8/351: truncate d1/dd/d11/f32 2542324 0 2024-01-31T05:13:11.106 INFO:tasks.workunit.client.0.smithi099.stdout:8/352: fdatasync d1/dd/d1d/f40 0 2024-01-31T05:13:11.106 INFO:tasks.workunit.client.0.smithi099.stdout:8/353: read d1/dd/d15/f24 [4168319,97136] 0 2024-01-31T05:13:11.117 INFO:tasks.workunit.client.0.smithi099.stdout:9/202: sync 2024-01-31T05:13:11.117 INFO:tasks.workunit.client.0.smithi099.stdout:3/266: sync 2024-01-31T05:13:11.119 INFO:tasks.workunit.client.0.smithi099.stdout:3/267: creat d10/d32/d33/f61 x:0 0 0 2024-01-31T05:13:11.122 INFO:tasks.workunit.client.0.smithi099.stdout:3/268: link d10/d27/d34/f5c d10/d27/d34/d52/f62 0 2024-01-31T05:13:11.122 INFO:tasks.workunit.client.0.smithi099.stdout:3/269: dread - d10/d27/d34/d52/f62 zero size 2024-01-31T05:13:11.125 INFO:tasks.workunit.client.0.smithi099.stdout:0/290: dwrite d1/d8/df/f25 [0,4194304] 0 2024-01-31T05:13:11.132 INFO:tasks.workunit.client.0.smithi099.stdout:0/291: truncate d1/d16/f31 3870532 0 2024-01-31T05:13:11.132 INFO:tasks.workunit.client.0.smithi099.stdout:0/292: creat d1/d8/f61 x:0 0 0 2024-01-31T05:13:11.132 INFO:tasks.workunit.client.0.smithi099.stdout:0/293: creat d1/d22/f62 x:0 0 0 2024-01-31T05:13:11.132 INFO:tasks.workunit.client.0.smithi099.stdout:0/294: rmdir d1/d30 39 2024-01-31T05:13:11.132 INFO:tasks.workunit.client.0.smithi099.stdout:0/295: fsync d1/f4 0 2024-01-31T05:13:11.132 INFO:tasks.workunit.client.0.smithi099.stdout:0/296: write d1/d8/df/f33 [61702,34726] 0 2024-01-31T05:13:11.132 INFO:tasks.workunit.client.0.smithi099.stdout:0/297: creat d1/d16/d36/f63 x:0 0 0 2024-01-31T05:13:11.132 INFO:tasks.workunit.client.0.smithi099.stdout:9/203: dread d0/d7/f23 [0,4194304] 0 2024-01-31T05:13:11.133 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:10.654+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e42 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test10 auth v110 ap=1 s=2972 n(v0 rc2008-05-13T10:44:09.000000+0000 b2972 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d422680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e42:[<0x10000002050/test10 v8>,<0x10000002048/rbind v164>,<0x10000001f09/fs_bind v352>,<0x10000001eda/fs v106>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001e42:[<0x10000002050/test10 v110>,<0x10000002048/rbind v461>,<0x10000001f09/fs_bind v382>,<0x10000001eda/fs v1142>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:11.133 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:10.654+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002051 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test20 auth v102 ap=1 s=2766 n(v0 rc2024-01-31T05:12:56.492598+0000 b2766 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d423180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002051:[<0x10000002050/test20 v2>,<0x10000002048/rbind v164>,<0x10000001f09/fs_bind v352>,<0x10000001eda/fs v106>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000002051:[<0x10000002050/test20 v102>,<0x10000002048/rbind v461>,<0x10000001f09/fs_bind v382>,<0x10000001eda/fs v1142>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:11.133 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:10.654+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e62 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test38 auth v106 ap=1 s=2910 n(v0 rc2008-05-13T10:44:10.000000+0000 b2910 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d423700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e62:[<0x10000002050/test38 v72>,<0x10000002048/rbind v164>,<0x10000001f09/fs_bind v352>,<0x10000001eda/fs v106>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001e62:[<0x10000002050/test38 v106>,<0x10000002048/rbind v461>,<0x10000001f09/fs_bind v382>,<0x10000001eda/fs v1142>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:11.133 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:10.655+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e67 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test24 auth v108 ap=1 s=2858 n(v0 rc2008-05-13T10:44:10.000000+0000 b2858 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d42e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e67:[<0x10000002050/test24 v82>,<0x10000002048/rbind v164>,<0x10000001f09/fs_bind v352>,<0x10000001eda/fs v106>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001e67:[<0x10000002050/test24 v108>,<0x10000002048/rbind v461>,<0x10000001f09/fs_bind v382>,<0x10000001eda/fs v1142>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:11.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:11.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001ebe (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/stress.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:11.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001c83 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/threads_scenarii.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:11.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001c80 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/testfrmw.h) see mds.h log and `damage ls` output for details 2024-01-31T05:13:11.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001c7e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/Makefile) see mds.h log and `damage ls` output for details 2024-01-31T05:13:11.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001c82 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/LICENCE) see mds.h log and `damage ls` output for details 2024-01-31T05:13:11.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001c81 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/NOTES) see mds.h log and `damage ls` output for details 2024-01-31T05:13:11.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001c7f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/testfrmw.c) see mds.h log and `damage ls` output for details 2024-01-31T05:13:11.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:11.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:11.135 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.135 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:11.135 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.135 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:11.135 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.135 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:11.135 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.135 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:11.135 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.135 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:11.135 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.135 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:11.135 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.136 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:11.136 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.136 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:11.136 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:11.136 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.136 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.136 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:11.136 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.136 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:10.655+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e4c [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test06 auth v120 ap=1 s=2806 n(v0 rc2008-05-13T10:44:09.000000+0000 b2806 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d42e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e4c:[<0x10000002050/test06 v28>,<0x10000002048/rbind v164>,<0x10000001f09/fs_bind v352>,<0x10000001eda/fs v106>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001e4c:[<0x10000002050/test06 v120>,<0x10000002048/rbind v461>,<0x10000001f09/fs_bind v382>,<0x10000001eda/fs v1142>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:11.136 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:10.655+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e48 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test17 auth v86 ap=1 s=2755 n(v0 rc2008-05-13T10:44:09.000000+0000 b2755 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d42eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e48:[<0x10000002050/test17 v20>,<0x10000002048/rbind v164>,<0x10000001f09/fs_bind v352>,<0x10000001eda/fs v106>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001e48:[<0x10000002050/test17 v86>,<0x10000002048/rbind v461>,<0x10000001f09/fs_bind v382>,<0x10000001eda/fs v1142>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:11.137 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:11.137 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.137 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:11.137 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.137 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:11.137 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:11.139 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:10.656+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e65 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test39 auth v104 ap=1 s=2273 n(v0 rc2008-05-13T10:44:10.000000+0000 b2273 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d42fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e65:[<0x10000002050/test39 v78>,<0x10000002048/rbind v164>,<0x10000001f09/fs_bind v352>,<0x10000001eda/fs v106>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001e65:[<0x10000002050/test39 v104>,<0x10000002048/rbind v461>,<0x10000001f09/fs_bind v382>,<0x10000001eda/fs v1142>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:11.139 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:10.657+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e44 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test13 auth v154 ap=1 s=2668 n(v0 rc2008-05-13T10:44:09.000000+0000 b2668 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d430100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e44:[<0x10000002050/test13 v12>,<0x10000002048/rbind v164>,<0x10000001f09/fs_bind v352>,<0x10000001eda/fs v106>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001e44:[<0x10000002050/test13 v154>,<0x10000002048/rbind v461>,<0x10000001f09/fs_bind v382>,<0x10000001eda/fs v1142>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:11.139 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:10.657+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e5d [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test16 auth v150 ap=1 s=2528 n(v0 rc2008-05-13T10:44:09.000000+0000 b2528 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d42f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e5d:[<0x10000002050/test16 v62>,<0x10000002048/rbind v164>,<0x10000001f09/fs_bind v352>,<0x10000001eda/fs v106>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001e5d:[<0x10000002050/test16 v150>,<0x10000002048/rbind v461>,<0x10000001f09/fs_bind v382>,<0x10000001eda/fs v1142>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:11.139 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:10.658+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e56 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test29 auth v96 ap=1 s=2657 n(v0 rc2008-05-13T10:44:10.000000+0000 b2657 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d42f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e56:[<0x10000002050/test29 v48>,<0x10000002048/rbind v164>,<0x10000001f09/fs_bind v352>,<0x10000001eda/fs v106>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001e56:[<0x10000002050/test29 v96>,<0x10000002048/rbind v461>,<0x10000001f09/fs_bind v382>,<0x10000001eda/fs v1142>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:11.140 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:10.658+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e57 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test07 auth v162 ap=1 s=3093 n(v0 rc2008-05-13T10:44:09.000000+0000 b3093 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d430680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e57:[<0x10000002050/test07 v50>,<0x10000002048/rbind v164>,<0x10000001f09/fs_bind v352>,<0x10000001eda/fs v106>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001e57:[<0x10000002050/test07 v162>,<0x10000002048/rbind v461>,<0x10000001f09/fs_bind v382>,<0x10000001eda/fs v1142>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:11.140 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:10.659+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e4a [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test19 auth v94 ap=1 s=2999 n(v0 rc2008-05-13T10:44:09.000000+0000 b2999 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d430c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e4a:[<0x10000002050/test19 v24>,<0x10000002048/rbind v164>,<0x10000001f09/fs_bind v352>,<0x10000001eda/fs v106>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001e4a:[<0x10000002050/test19 v94>,<0x10000002048/rbind v461>,<0x10000001f09/fs_bind v382>,<0x10000001eda/fs v1142>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:11.140 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:10.659+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e63 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test31 auth v124 ap=1 s=2692 n(v0 rc2008-05-13T10:44:10.000000+0000 b2692 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d431700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e63:[<0x10000002050/test31 v74>,<0x10000002048/rbind v164>,<0x10000001f09/fs_bind v352>,<0x10000001eda/fs v106>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001e63:[<0x10000002050/test31 v124>,<0x10000002048/rbind v461>,<0x10000001f09/fs_bind v382>,<0x10000001eda/fs v1142>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:11.140 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:10.659+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e41 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test33 auth v122 ap=1 s=2875 n(v0 rc2008-05-13T10:44:10.000000+0000 b2875 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d431180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e41:[<0x10000002050/test33 v6>,<0x10000002048/rbind v164>,<0x10000001f09/fs_bind v352>,<0x10000001eda/fs v106>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001e41:[<0x10000002050/test33 v122>,<0x10000002048/rbind v461>,<0x10000001f09/fs_bind v382>,<0x10000001eda/fs v1142>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:11.140 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:10.659+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e5b [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test02 auth v140 ap=1 s=2779 n(v0 rc2008-05-13T10:44:09.000000+0000 b2779 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d438000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e5b:[<0x10000002050/test02 v58>,<0x10000002048/rbind v164>,<0x10000001f09/fs_bind v352>,<0x10000001eda/fs v106>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001e5b:[<0x10000002050/test02 v140>,<0x10000002048/rbind v461>,<0x10000001f09/fs_bind v382>,<0x10000001eda/fs v1142>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:11.140 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:10.659+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e61 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test35 auth v90 ap=1 s=2745 n(v0 rc2008-05-13T10:44:10.000000+0000 b2745 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d438580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e61:[<0x10000002050/test35 v70>,<0x10000002048/rbind v164>,<0x10000001f09/fs_bind v352>,<0x10000001eda/fs v106>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001e61:[<0x10000002050/test35 v90>,<0x10000002048/rbind v461>,<0x10000001f09/fs_bind v382>,<0x10000001eda/fs v1142>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:11.140 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:10.660+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e52 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/00_Descriptions.txt auth v112 ap=1 s=6286 n(v0 rc2009-02-26T13:07:50.000000+0000 b6286 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d439080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e52:[<0x10000002050/00_Descriptions.txt v40>,<0x10000002048/rbind v164>,<0x10000001f09/fs_bind v352>,<0x10000001eda/fs v106>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001e52:[<0x10000002050/00_Descriptions.txt v112>,<0x10000002048/rbind v461>,<0x10000001f09/fs_bind v382>,<0x10000001eda/fs v1142>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:11.140 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:10.660+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e58 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test08 auth v160 ap=1 s=2818 n(v0 rc2008-05-13T10:44:09.000000+0000 b2818 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d438b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e58:[<0x10000002050/test08 v52>,<0x10000002048/rbind v164>,<0x10000001f09/fs_bind v352>,<0x10000001eda/fs v106>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001e58:[<0x10000002050/test08 v160>,<0x10000002048/rbind v461>,<0x10000001f09/fs_bind v382>,<0x10000001eda/fs v1142>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:11.140 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:10.660+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e50 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test21 auth v100 ap=1 s=3018 n(v0 rc2008-05-13T10:44:09.000000+0000 b3018 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d439b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e50:[<0x10000002050/test21 v36>,<0x10000002048/rbind v164>,<0x10000001f09/fs_bind v352>,<0x10000001eda/fs v106>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001e50:[<0x10000002050/test21 v100>,<0x10000002048/rbind v461>,<0x10000001f09/fs_bind v382>,<0x10000001eda/fs v1142>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:11.140 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:10.661+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e4e [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test12 auth v126 ap=1 s=2984 n(v0 rc2008-05-13T10:44:09.000000+0000 b2984 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d439600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e4e:[<0x10000002050/test12 v32>,<0x10000002048/rbind v164>,<0x10000001f09/fs_bind v352>,<0x10000001eda/fs v106>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001e4e:[<0x10000002050/test12 v126>,<0x10000002048/rbind v461>,<0x10000001f09/fs_bind v382>,<0x10000001eda/fs v1142>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:11.140 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:10.661+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e55 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test09 auth v92 ap=1 s=3115 n(v0 rc2008-05-13T10:44:09.000000+0000 b3115 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d43a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e55:[<0x10000002050/test09 v46>,<0x10000002048/rbind v164>,<0x10000001f09/fs_bind v352>,<0x10000001eda/fs v106>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001e55:[<0x10000002050/test09 v92>,<0x10000002048/rbind v461>,<0x10000001f09/fs_bind v382>,<0x10000001eda/fs v1142>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:11.141 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:10.661+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e59 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test27 auth v146 ap=1 s=2994 n(v0 rc2008-05-13T10:44:10.000000+0000 b2994 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d422c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e59:[<0x10000002050/test27 v54>,<0x10000002048/rbind v164>,<0x10000001f09/fs_bind v352>,<0x10000001eda/fs v106>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001e59:[<0x10000002050/test27 v146>,<0x10000002048/rbind v461>,<0x10000001f09/fs_bind v382>,<0x10000001eda/fs v1142>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:11.141 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:10.661+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e60 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test36 auth v116 ap=1 s=2665 n(v0 rc2008-05-13T10:44:10.000000+0000 b2665 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d43a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e60:[<0x10000002050/test36 v68>,<0x10000002048/rbind v164>,<0x10000001f09/fs_bind v352>,<0x10000001eda/fs v106>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001e60:[<0x10000002050/test36 v116>,<0x10000002048/rbind v461>,<0x10000001f09/fs_bind v382>,<0x10000001eda/fs v1142>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:11.141 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:10.661+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e47 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test34 auth v144 ap=1 s=2691 n(v0 rc2008-05-13T10:44:10.000000+0000 b2691 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d43ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e47:[<0x10000002050/test34 v18>,<0x10000002048/rbind v164>,<0x10000001f09/fs_bind v352>,<0x10000001eda/fs v106>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001e47:[<0x10000002050/test34 v144>,<0x10000002048/rbind v461>,<0x10000001f09/fs_bind v382>,<0x10000001eda/fs v1142>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:11.141 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:10.661+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e53 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test11 auth v136 ap=1 s=3228 n(v0 rc2008-05-13T10:44:09.000000+0000 b3228 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d43b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e53:[<0x10000002050/test11 v42>,<0x10000002048/rbind v164>,<0x10000001f09/fs_bind v352>,<0x10000001eda/fs v106>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001e53:[<0x10000002050/test11 v136>,<0x10000002048/rbind v461>,<0x10000001f09/fs_bind v382>,<0x10000001eda/fs v1142>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:11.141 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:10.662+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e5f [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test18 auth v98 ap=1 s=2755 n(v0 rc2008-05-13T10:44:09.000000+0000 b2755 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d43b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e5f:[<0x10000002050/test18 v66>,<0x10000002048/rbind v164>,<0x10000001f09/fs_bind v352>,<0x10000001eda/fs v106>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001e5f:[<0x10000002050/test18 v98>,<0x10000002048/rbind v461>,<0x10000001f09/fs_bind v382>,<0x10000001eda/fs v1142>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:11.141 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:10.662+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e49 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test28 auth v84 ap=1 s=2821 n(v0 rc2008-05-13T10:44:10.000000+0000 b2821 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d444000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e49:[<0x10000002050/test28 v22>,<0x10000002048/rbind v164>,<0x10000001f09/fs_bind v352>,<0x10000001eda/fs v106>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001e49:[<0x10000002050/test28 v84>,<0x10000002048/rbind v461>,<0x10000001f09/fs_bind v382>,<0x10000001eda/fs v1142>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:11.141 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:10.662+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e54 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test14 auth v128 ap=1 s=2514 n(v0 rc2008-05-13T10:44:09.000000+0000 b2514 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d444580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e54:[<0x10000002050/test14 v44>,<0x10000002048/rbind v164>,<0x10000001f09/fs_bind v352>,<0x10000001eda/fs v106>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001e54:[<0x10000002050/test14 v128>,<0x10000002048/rbind v461>,<0x10000001f09/fs_bind v382>,<0x10000001eda/fs v1142>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:11.141 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:10.663+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e43 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test22 auth v152 ap=1 s=2829 n(v0 rc2008-05-13T10:44:09.000000+0000 b2829 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d445080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e43:[<0x10000002050/test22 v10>,<0x10000002048/rbind v164>,<0x10000001f09/fs_bind v352>,<0x10000001eda/fs v106>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001e43:[<0x10000002050/test22 v152>,<0x10000002048/rbind v461>,<0x10000001f09/fs_bind v382>,<0x10000001eda/fs v1142>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:11.141 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:10.663+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e5e [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test32 auth v132 ap=1 s=2530 n(v0 rc2008-05-13T10:44:10.000000+0000 b2530 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d444b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e5e:[<0x10000002050/test32 v64>,<0x10000002048/rbind v164>,<0x10000001f09/fs_bind v352>,<0x10000001eda/fs v106>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001e5e:[<0x10000002050/test32 v132>,<0x10000002048/rbind v461>,<0x10000001f09/fs_bind v382>,<0x10000001eda/fs v1142>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:11.141 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:10.663+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e5c [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test07-2 auth v164 ap=1 s=1606 n(v0 rc2008-05-13T10:44:09.000000+0000 b1606 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d445600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e5c:[<0x10000002050/test07-2 v60>,<0x10000002048/rbind v164>,<0x10000001f09/fs_bind v352>,<0x10000001eda/fs v106>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001e5c:[<0x10000002050/test07-2 v164>,<0x10000002048/rbind v461>,<0x10000001f09/fs_bind v382>,<0x10000001eda/fs v1142>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:11.141 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:10.663+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e45 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test03 auth v148 ap=1 s=3267 n(v0 rc2008-05-13T10:44:09.000000+0000 b3267 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d445b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e45:[<0x10000002050/test03 v14>,<0x10000002048/rbind v164>,<0x10000001f09/fs_bind v352>,<0x10000001eda/fs v106>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001e45:[<0x10000002050/test03 v148>,<0x10000002048/rbind v461>,<0x10000001f09/fs_bind v382>,<0x10000001eda/fs v1142>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:11.141 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:10.663+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e51 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test30 auth v88 ap=1 s=2519 n(v0 rc2008-05-13T10:44:10.000000+0000 b2519 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d446100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e51:[<0x10000002050/test30 v38>,<0x10000002048/rbind v164>,<0x10000001f09/fs_bind v352>,<0x10000001eda/fs v106>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001e51:[<0x10000002050/test30 v88>,<0x10000002048/rbind v461>,<0x10000001f09/fs_bind v382>,<0x10000001eda/fs v1142>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:11.142 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:10.664+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e4f [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test15 auth v130 ap=1 s=2748 n(v0 rc2008-05-13T10:44:09.000000+0000 b2748 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d446680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e4f:[<0x10000002050/test15 v34>,<0x10000002048/rbind v164>,<0x10000001f09/fs_bind v352>,<0x10000001eda/fs v106>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001e4f:[<0x10000002050/test15 v130>,<0x10000002048/rbind v461>,<0x10000001f09/fs_bind v382>,<0x10000001eda/fs v1142>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:11.142 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:10.664+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e5a [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test37 auth v156 ap=1 s=2918 n(v0 rc2008-05-13T10:44:10.000000+0000 b2918 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d446c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e5a:[<0x10000002050/test37 v56>,<0x10000002048/rbind v164>,<0x10000001f09/fs_bind v352>,<0x10000001eda/fs v106>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001e5a:[<0x10000002050/test37 v156>,<0x10000002048/rbind v461>,<0x10000001f09/fs_bind v382>,<0x10000001eda/fs v1142>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:11.142 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:10.664+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e64 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test05 auth v158 ap=1 s=3075 n(v0 rc2008-05-13T10:44:09.000000+0000 b3075 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d447180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e64:[<0x10000002050/test05 v76>,<0x10000002048/rbind v164>,<0x10000001f09/fs_bind v352>,<0x10000001eda/fs v106>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001e64:[<0x10000002050/test05 v158>,<0x10000002048/rbind v461>,<0x10000001f09/fs_bind v382>,<0x10000001eda/fs v1142>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:11.142 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:10.664+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e4d [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test04 auth v118 ap=1 s=2829 n(v0 rc2008-05-13T10:44:09.000000+0000 b2829 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d447700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e4d:[<0x10000002050/test04 v30>,<0x10000002048/rbind v164>,<0x10000001f09/fs_bind v352>,<0x10000001eda/fs v106>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001e4d:[<0x10000002050/test04 v118>,<0x10000002048/rbind v461>,<0x10000001f09/fs_bind v382>,<0x10000001eda/fs v1142>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:11.142 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:10.665+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e66 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test01 auth v142 ap=1 s=2739 n(v0 rc2008-05-13T10:44:09.000000+0000 b2739 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d44e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e66:[<0x10000002050/test01 v80>,<0x10000002048/rbind v164>,<0x10000001f09/fs_bind v352>,<0x10000001eda/fs v106>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001e66:[<0x10000002050/test01 v142>,<0x10000002048/rbind v461>,<0x10000001f09/fs_bind v382>,<0x10000001eda/fs v1142>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:11.142 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:10.665+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e46 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test23 auth v138 ap=1 s=2851 n(v0 rc2008-05-13T10:44:10.000000+0000 b2851 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d44e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e46:[<0x10000002050/test23 v16>,<0x10000002048/rbind v164>,<0x10000001f09/fs_bind v352>,<0x10000001eda/fs v106>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001e46:[<0x10000002050/test23 v138>,<0x10000002048/rbind v461>,<0x10000001f09/fs_bind v382>,<0x10000001eda/fs v1142>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:11.142 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:10.665+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e40 [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test26 auth v114 ap=1 s=2824 n(v0 rc2008-05-13T10:44:10.000000+0000 b2824 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d44eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e40:[<0x10000002050/test26 v4>,<0x10000002048/rbind v164>,<0x10000001f09/fs_bind v352>,<0x10000001eda/fs v106>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001e40:[<0x10000002050/test26 v114>,<0x10000002048/rbind v461>,<0x10000001f09/fs_bind v382>,<0x10000001eda/fs v1142>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:11.142 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:13:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:13:10.665+0000 7f1cb1f72700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e4b [2,head] /volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test25 auth v134 ap=1 s=2928 n(v0 rc2008-05-13T10:44:10.000000+0000 b2928 1=1+0) (iversion lock) caps={15315=pAsLsXsFsc/-@1},l=15315(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55dd9d44f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e4b:[<0x10000002050/test25 v26>,<0x10000002048/rbind v164>,<0x10000001f09/fs_bind v352>,<0x10000001eda/fs v106>,<0x10000000204/kernel v542>,<0x10000000202/testcases v63>,<0x10000000007/ltp-full-20091231 v38>,<0x10000000006/fsstress v30>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v24>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v39>,<0x10000000001/sv_1 v59>,<0x10000000000/qa v49>,<0x1/volumes v42>]//[]","memoryvalue":"(3)0x10000001e4b:[<0x10000002050/test25 v134>,<0x10000002048/rbind v461>,<0x10000001f09/fs_bind v382>,<0x10000001eda/fs v1142>,<0x10000000204/kernel v881>,<0x10000000202/testcases v81>,<0x10000000007/ltp-full-20091231 v148>,<0x10000000006/fsstress v74>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v38>,<0x100000001fa/afb5b294-2883-459a-b856-3d1b5cb21c6f v51>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v60>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-31T05:13:11.143 INFO:tasks.workunit.client.0.smithi099.stdout:8/354: dwrite d1/dd/d4f/d51/f5d [0,4194304] 0 2024-01-31T05:13:11.143 INFO:tasks.workunit.client.0.smithi099.stdout:6/247: readlink d14/d18/d1a/d1b/l1d 0 2024-01-31T05:13:11.145 INFO:tasks.workunit.client.0.smithi099.stdout:8/355: mknod d1/dd/d15/d2e/d69/c6a 0 2024-01-31T05:13:11.153 INFO:tasks.workunit.client.0.smithi099.stdout:9/204: write d0/d7/f28 [3048660,24847] 0 2024-01-31T05:13:11.153 INFO:tasks.workunit.client.0.smithi099.stdout:3/270: dwrite d10/f23 [0,4194304] 0 2024-01-31T05:13:11.153 INFO:tasks.workunit.client.0.smithi099.stdout:9/205: stat d0/d3e 0 2024-01-31T05:13:11.153 INFO:tasks.workunit.client.0.smithi099.stdout:3/271: creat d10/d32/d33/f63 x:0 0 0 2024-01-31T05:13:11.153 INFO:tasks.workunit.client.0.smithi099.stdout:3/272: creat d10/d18/f64 x:0 0 0 2024-01-31T05:13:11.154 INFO:tasks.workunit.client.0.smithi099.stdout:6/248: write fc [2757995,84541] 0 2024-01-31T05:13:11.155 INFO:tasks.workunit.client.0.smithi099.stdout:8/356: mknod d1/dd/d65/c6b 0 2024-01-31T05:13:11.155 INFO:tasks.workunit.client.0.smithi099.stdout:0/298: dwrite d1/d22/f62 [0,4194304] 0 2024-01-31T05:13:11.156 INFO:tasks.workunit.client.0.smithi099.stdout:8/357: dread d1/dd/d11/d19/f53 [0,4194304] 0 2024-01-31T05:13:11.157 INFO:tasks.workunit.client.0.smithi099.stdout:6/249: mkdir d14/d18/d1a/d1b/d46 0 2024-01-31T05:13:11.157 INFO:tasks.workunit.client.0.smithi099.stdout:6/250: write d14/f15 [4536921,18582] 0 2024-01-31T05:13:11.158 INFO:tasks.workunit.client.0.smithi099.stdout:3/273: symlink d10/d32/l65 0 2024-01-31T05:13:11.162 INFO:tasks.workunit.client.0.smithi099.stdout:8/358: mknod d1/dd/d11/d20/c6c 0 2024-01-31T05:13:11.163 INFO:tasks.workunit.client.0.smithi099.stdout:8/359: readlink d1/dd/d11/d20/l26 0 2024-01-31T05:13:11.164 INFO:tasks.workunit.client.0.smithi099.stdout:3/274: getdents d10/d27/d34/d52 0 2024-01-31T05:13:11.164 INFO:tasks.workunit.client.0.smithi099.stdout:3/275: creat d10/f66 x:0 0 0 2024-01-31T05:13:11.165 INFO:tasks.workunit.client.0.smithi099.stdout:3/276: chown d10/d27/l5f 958902336 1 2024-01-31T05:13:11.165 INFO:tasks.workunit.client.0.smithi099.stdout:3/277: fsync d10/d24/d40/f47 0 2024-01-31T05:13:11.165 INFO:tasks.workunit.client.0.smithi099.stdout:3/278: write d10/d27/f5d [511350,27842] 0 2024-01-31T05:13:11.166 INFO:tasks.workunit.client.0.smithi099.stdout:0/299: mkdir d1/d64 0 2024-01-31T05:13:11.166 INFO:tasks.workunit.client.0.smithi099.stdout:0/300: creat d1/d8/f65 x:0 0 0 2024-01-31T05:13:11.169 INFO:tasks.workunit.client.0.smithi099.stdout:0/301: chown d1/f2a 928065 1 2024-01-31T05:13:11.170 INFO:tasks.workunit.client.0.smithi099.stdout:8/360: rename d1/dd/d15/d2e/f60 to d1/dd/d11/d19/f6d 0 2024-01-31T05:13:11.172 INFO:tasks.workunit.client.0.smithi099.stdout:3/279: write d10/d24/d40/f47 [199499,62006] 0 2024-01-31T05:13:11.173 INFO:tasks.workunit.client.0.smithi099.stdout:8/361: mkdir d1/dd/d4f/d6e 0 2024-01-31T05:13:11.176 INFO:tasks.workunit.client.0.smithi099.stdout:3/280: creat d10/d32/d33/d51/f67 x:0 0 0 2024-01-31T05:13:11.177 INFO:tasks.workunit.client.0.smithi099.stdout:0/302: rename d1/d8/df to d1/d30/d45/d66 0 2024-01-31T05:13:11.177 INFO:tasks.workunit.client.0.smithi099.stdout:0/303: stat d1/d16 0 2024-01-31T05:13:11.180 INFO:tasks.workunit.client.0.smithi099.stdout:3/281: rename d10/d27/f57 to d10/d27/d34/f68 0 2024-01-31T05:13:11.181 INFO:tasks.workunit.client.0.smithi099.stdout:0/304: creat d1/d64/f67 x:0 0 0 2024-01-31T05:13:11.182 INFO:tasks.workunit.client.0.smithi099.stdout:7/281: sync 2024-01-31T05:13:11.182 INFO:tasks.workunit.client.0.smithi099.stdout:1/324: sync 2024-01-31T05:13:11.182 INFO:tasks.workunit.client.0.smithi099.stdout:4/296: sync 2024-01-31T05:13:11.182 INFO:tasks.workunit.client.0.smithi099.stdout:5/320: sync 2024-01-31T05:13:11.183 INFO:tasks.workunit.client.0.smithi099.stdout:2/287: sync 2024-01-31T05:13:11.183 INFO:tasks.workunit.client.0.smithi099.stdout:2/288: truncate d10/d51/f54 779443 0 2024-01-31T05:13:11.183 INFO:tasks.workunit.client.0.smithi099.stdout:5/321: read d6/d1e/d1f/f22 [3921002,47623] 0 2024-01-31T05:13:11.183 INFO:tasks.workunit.client.0.smithi099.stdout:1/325: write d4/df/f22 [5245472,125269] 0 2024-01-31T05:13:11.184 INFO:tasks.workunit.client.0.smithi099.stdout:0/305: rename d1/d30/d45/d66/f1b to d1/d16/d36/f68 0 2024-01-31T05:13:11.185 INFO:tasks.workunit.client.0.smithi099.stdout:4/297: mkdir d0/d2/d20/d21/d39/d66 0 2024-01-31T05:13:11.186 INFO:tasks.workunit.client.0.smithi099.stdout:5/322: mkdir d6/da/d14/d61 0 2024-01-31T05:13:11.189 INFO:tasks.workunit.client.0.smithi099.stdout:7/282: rename d6/d12/f1a to d6/d32/f5b 0 2024-01-31T05:13:11.189 INFO:tasks.workunit.client.0.smithi099.stdout:7/283: dread - d6/d32/d3d/d4b/d33/d37/d50/d25/f4c zero size 2024-01-31T05:13:11.190 INFO:tasks.workunit.client.0.smithi099.stdout:0/306: link d1/d8/c42 d1/d37/c69 0 2024-01-31T05:13:11.192 INFO:tasks.workunit.client.0.smithi099.stdout:4/298: symlink d0/d8/l67 0 2024-01-31T05:13:11.192 INFO:tasks.workunit.client.0.smithi099.stdout:5/323: symlink d6/da/d34/l62 0 2024-01-31T05:13:11.193 INFO:tasks.workunit.client.0.smithi099.stdout:5/324: fdatasync d6/da/d3f/f58 0 2024-01-31T05:13:11.194 INFO:tasks.workunit.client.0.smithi099.stdout:4/299: link d0/d2/d20/d21/d17/d3d/c4e d0/d2/d20/d21/d17/c68 0 2024-01-31T05:13:11.195 INFO:tasks.workunit.client.0.smithi099.stdout:1/326: dread d4/dc/d15/f1a [0,4194304] 0 2024-01-31T05:13:11.197 INFO:tasks.workunit.client.0.smithi099.stdout:5/325: rename d6/d1e/d1f/d21/f27 to d6/da/d3f/f63 0 2024-01-31T05:13:11.199 INFO:tasks.workunit.client.0.smithi099.stdout:1/327: truncate d4/dc/f43 927980 0 2024-01-31T05:13:11.201 INFO:tasks.workunit.client.0.smithi099.stdout:3/282: dread d10/d27/f53 [0,4194304] 0 2024-01-31T05:13:11.201 INFO:tasks.workunit.client.0.smithi099.stdout:5/326: creat d6/da/d14/d61/f64 x:0 0 0 2024-01-31T05:13:11.201 INFO:tasks.workunit.client.0.smithi099.stdout:3/283: stat d10/c13 0 2024-01-31T05:13:11.201 INFO:tasks.workunit.client.0.smithi099.stdout:3/284: creat d10/d18/f69 x:0 0 0 2024-01-31T05:13:11.204 INFO:tasks.workunit.client.0.smithi099.stdout:4/300: creat d0/d2/d4b/f69 x:0 0 0 2024-01-31T05:13:11.206 INFO:tasks.workunit.client.0.smithi099.stdout:1/328: mkdir d4/db/d24/d69 0 2024-01-31T05:13:11.206 INFO:tasks.workunit.client.0.smithi099.stdout:3/285: symlink d10/d32/d33/l6a 0 2024-01-31T05:13:11.206 INFO:tasks.workunit.client.0.smithi099.stdout:3/286: creat d10/d27/f6b x:0 0 0 2024-01-31T05:13:11.206 INFO:tasks.workunit.client.0.smithi099.stdout:3/287: creat d10/d1e/f6c x:0 0 0 2024-01-31T05:13:11.208 INFO:tasks.workunit.client.0.smithi099.stdout:0/307: write d1/d16/f18 [1487503,100565] 0 2024-01-31T05:13:11.208 INFO:tasks.workunit.client.0.smithi099.stdout:4/301: creat d0/d2/d20/d21/d17/d3d/f6a x:0 0 0 2024-01-31T05:13:11.208 INFO:tasks.workunit.client.0.smithi099.stdout:4/302: read - d0/d2/d4b/f69 zero size 2024-01-31T05:13:11.209 INFO:tasks.workunit.client.0.smithi099.stdout:1/329: mknod d4/db/d24/d4b/c6a 0 2024-01-31T05:13:11.210 INFO:tasks.workunit.client.0.smithi099.stdout:3/288: unlink d10/f1b 0 2024-01-31T05:13:11.210 INFO:tasks.workunit.client.0.smithi099.stdout:3/289: truncate d10/d24/d40/f59 307681 0 2024-01-31T05:13:11.212 INFO:tasks.workunit.client.0.smithi099.stdout:0/308: rename d1/f2c to d1/d16/d36/f6a 0 2024-01-31T05:13:11.213 INFO:tasks.workunit.client.0.smithi099.stdout:2/289: dwrite d10/d1b/f59 [0,4194304] 0 2024-01-31T05:13:11.213 INFO:tasks.workunit.client.0.smithi099.stdout:2/290: dread - d10/f33 zero size 2024-01-31T05:13:11.215 INFO:tasks.workunit.client.0.smithi099.stdout:1/330: creat d4/f6b x:0 0 0 2024-01-31T05:13:11.216 INFO:tasks.workunit.client.0.smithi099.stdout:3/290: mknod d10/c6d 0 2024-01-31T05:13:11.216 INFO:tasks.workunit.client.0.smithi099.stdout:3/291: chown d10/d27/f29 3 1 2024-01-31T05:13:11.217 INFO:tasks.workunit.client.0.smithi099.stdout:0/309: symlink d1/d56/l6b 0 2024-01-31T05:13:11.218 INFO:tasks.workunit.client.0.smithi099.stdout:4/303: creat d0/d2/d20/d21/d17/d24/d5a/f6b x:0 0 0 2024-01-31T05:13:11.221 INFO:tasks.workunit.client.0.smithi099.stdout:7/284: dwrite d6/f1f [0,4194304] 0 2024-01-31T05:13:11.221 INFO:tasks.workunit.client.0.smithi099.stdout:7/285: stat d6/d32/d3d/d4b/d33/d37/d50/f45 0 2024-01-31T05:13:11.225 INFO:tasks.workunit.client.0.smithi099.stdout:1/331: dread d4/df/d37/f54 [0,4194304] 0 2024-01-31T05:13:11.226 INFO:tasks.workunit.client.0.smithi099.stdout:3/292: creat d10/d32/d33/d4a/f6e x:0 0 0 2024-01-31T05:13:11.226 INFO:tasks.workunit.client.0.smithi099.stdout:9/206: truncate d0/d1/d24/f37 318546 0 2024-01-31T05:13:11.226 INFO:tasks.workunit.client.0.smithi099.stdout:9/207: write d0/d7/d2e/f43 [982659,71571] 0 2024-01-31T05:13:11.226 INFO:tasks.workunit.client.0.smithi099.stdout:9/208: fsync d0/d7/f14 0 2024-01-31T05:13:11.227 INFO:tasks.workunit.client.0.smithi099.stdout:3/293: dread d10/d32/f4e [0,4194304] 0 2024-01-31T05:13:11.229 INFO:tasks.workunit.client.0.smithi099.stdout:7/286: link d6/cd d6/d32/d3d/d4b/d33/d37/d50/d25/d47/c5c 0 2024-01-31T05:13:11.231 INFO:tasks.workunit.client.0.smithi099.stdout:1/332: unlink d4/dc/d15/f39 0 2024-01-31T05:13:11.233 INFO:tasks.workunit.client.0.smithi099.stdout:9/209: mkdir d0/d1/d24/d48 0 2024-01-31T05:13:11.233 INFO:tasks.workunit.client.0.smithi099.stdout:5/327: dwrite d6/d1e/f4e [0,4194304] 0 2024-01-31T05:13:11.234 INFO:tasks.workunit.client.0.smithi099.stdout:7/287: creat d6/f5d x:0 0 0 2024-01-31T05:13:11.234 INFO:tasks.workunit.client.0.smithi099.stdout:7/288: truncate d6/d12/f3c 660161 0 2024-01-31T05:13:11.235 INFO:tasks.workunit.client.0.smithi099.stdout:9/210: mknod d0/d1/d24/c49 0 2024-01-31T05:13:11.235 INFO:tasks.workunit.client.0.smithi099.stdout:9/211: read - d0/d7/f46 zero size 2024-01-31T05:13:11.237 INFO:tasks.workunit.client.0.smithi099.stdout:2/291: dread d10/d20/f4c [0,4194304] 0 2024-01-31T05:13:11.238 INFO:tasks.workunit.client.0.smithi099.stdout:5/328: mknod d6/d1e/d1f/c65 0 2024-01-31T05:13:11.240 INFO:tasks.workunit.client.0.smithi099.stdout:7/289: mkdir d6/d32/d3d/d4b/d33/d37/d50/d5e 0 2024-01-31T05:13:11.240 INFO:tasks.workunit.client.0.smithi099.stdout:7/290: creat d6/d32/d3d/f5f x:0 0 0 2024-01-31T05:13:11.240 INFO:tasks.workunit.client.0.smithi099.stdout:7/291: fsync d6/d32/d3d/d4b/d33/d37/d50/f45 0 2024-01-31T05:13:11.240 INFO:tasks.workunit.client.0.smithi099.stdout:7/292: write d6/d32/d3d/d4b/f1b [1551551,27446] 0 2024-01-31T05:13:11.240 INFO:tasks.workunit.client.0.smithi099.stdout:4/304: dwrite d0/d2/d20/d21/d17/f25 [0,4194304] 0 2024-01-31T05:13:11.241 INFO:tasks.workunit.client.0.smithi099.stdout:4/305: write d0/d2/d20/f38 [358595,91469] 0 2024-01-31T05:13:11.242 INFO:tasks.workunit.client.0.smithi099.stdout:9/212: truncate d0/d7/f14 1698945 0 2024-01-31T05:13:11.242 INFO:tasks.workunit.client.0.smithi099.stdout:0/310: write d1/d30/d45/d66/f25 [3070584,70248] 0 2024-01-31T05:13:11.244 INFO:tasks.workunit.client.0.smithi099.stdout:2/292: creat d10/d1c/f64 x:0 0 0 2024-01-31T05:13:11.245 INFO:tasks.workunit.client.0.smithi099.stdout:5/329: symlink d6/l66 0 2024-01-31T05:13:11.249 INFO:tasks.workunit.client.0.smithi099.stdout:4/306: creat d0/d2/d20/d21/d39/d66/f6c x:0 0 0 2024-01-31T05:13:11.250 INFO:tasks.workunit.client.0.smithi099.stdout:9/213: truncate d0/d7/fa 2318011 0 2024-01-31T05:13:11.253 INFO:tasks.workunit.client.0.smithi099.stdout:0/311: rmdir d1/d30/d45/d66 39 2024-01-31T05:13:11.254 INFO:tasks.workunit.client.0.smithi099.stdout:3/294: dwrite d10/f19 [0,4194304] 0 2024-01-31T05:13:11.254 INFO:tasks.workunit.client.0.smithi099.stdout:3/295: write d10/d32/d33/f63 [958886,95937] 0 2024-01-31T05:13:11.254 INFO:tasks.workunit.client.0.smithi099.stdout:3/296: creat d10/d1e/f6f x:0 0 0 2024-01-31T05:13:11.254 INFO:tasks.workunit.client.0.smithi099.stdout:4/307: fsync d0/d2/d20/f38 0 2024-01-31T05:13:11.254 INFO:tasks.workunit.client.0.smithi099.stdout:4/308: chown d0/d2/d20/d21/d17/d24/d3f/c56 42 1 2024-01-31T05:13:11.255 INFO:tasks.workunit.client.0.smithi099.stdout:4/309: readlink d0/d2/d4b/l52 0 2024-01-31T05:13:11.255 INFO:tasks.workunit.client.0.smithi099.stdout:4/310: stat d0/d2/d20/f38 0 2024-01-31T05:13:11.255 INFO:tasks.workunit.client.0.smithi099.stdout:4/311: chown d0/d2/d20/d21/d17/d3d/f41 11 1 2024-01-31T05:13:11.256 INFO:tasks.workunit.client.0.smithi099.stdout:9/214: symlink d0/d3e/l4a 0 2024-01-31T05:13:11.262 INFO:tasks.workunit.client.0.smithi099.stdout:3/297: mknod d10/d27/d34/d52/c70 0 2024-01-31T05:13:11.262 INFO:tasks.workunit.client.0.smithi099.stdout:3/298: creat d10/d32/d33/d51/f71 x:0 0 0 2024-01-31T05:13:11.265 INFO:tasks.workunit.client.0.smithi099.stdout:4/312: creat d0/d8/d19/d65/f6d x:0 0 0 2024-01-31T05:13:11.265 INFO:tasks.workunit.client.0.smithi099.stdout:4/313: fsync d0/d2/f15 0 2024-01-31T05:13:11.270 INFO:tasks.workunit.client.0.smithi099.stdout:3/299: mkdir d10/d72 0 2024-01-31T05:13:11.270 INFO:tasks.workunit.client.0.smithi099.stdout:3/300: truncate d10/d32/d33/d51/f71 246571 0 2024-01-31T05:13:11.270 INFO:tasks.workunit.client.0.smithi099.stdout:4/314: symlink d0/d2/d20/l6e 0 2024-01-31T05:13:11.272 INFO:tasks.workunit.client.0.smithi099.stdout:9/215: getdents d0/d1 0 2024-01-31T05:13:11.273 INFO:tasks.workunit.client.0.smithi099.stdout:3/301: mknod d10/d1e/c73 0 2024-01-31T05:13:11.274 INFO:tasks.workunit.client.0.smithi099.stdout:4/315: dread d0/d8/f63 [0,4194304] 0 2024-01-31T05:13:11.275 INFO:tasks.workunit.client.0.smithi099.stdout:9/216: creat d0/d1/d24/d48/f4b x:0 0 0 2024-01-31T05:13:11.277 INFO:tasks.workunit.client.0.smithi099.stdout:3/302: mkdir d10/d32/d33/d51/d74 0 2024-01-31T05:13:11.279 INFO:tasks.workunit.client.0.smithi099.stdout:9/217: rmdir d0/d3e/d33 39 2024-01-31T05:13:11.279 INFO:tasks.workunit.client.0.smithi099.stdout:3/303: mkdir d10/d27/d34/d44/d60/d75 0 2024-01-31T05:13:11.281 INFO:tasks.workunit.client.0.smithi099.stdout:2/293: dwrite d10/f15 [0,4194304] 0 2024-01-31T05:13:11.281 INFO:tasks.workunit.client.0.smithi099.stdout:7/293: dwrite d6/d32/d3d/d4b/d33/d37/d4e/f4f [0,4194304] 0 2024-01-31T05:13:11.282 INFO:tasks.workunit.client.0.smithi099.stdout:2/294: write d10/d1c/f26 [2255142,3880] 0 2024-01-31T05:13:11.282 INFO:tasks.workunit.client.0.smithi099.stdout:2/295: write d10/f11 [922885,110181] 0 2024-01-31T05:13:11.300 INFO:tasks.workunit.client.0.smithi099.stdout:3/304: dwrite d10/d27/d34/f68 [0,4194304] 0 2024-01-31T05:13:11.300 INFO:tasks.workunit.client.0.smithi099.stdout:3/305: creat d10/d32/d33/d4a/f76 x:0 0 0 2024-01-31T05:13:11.303 INFO:tasks.workunit.client.0.smithi099.stdout:2/296: getdents d10/d2b/d58 0 2024-01-31T05:13:11.307 INFO:tasks.workunit.client.0.smithi099.stdout:3/306: mkdir d10/d18/d77 0 2024-01-31T05:13:11.309 INFO:tasks.workunit.client.0.smithi099.stdout:3/307: mknod d10/d27/d34/d50/c78 0 2024-01-31T05:13:11.311 INFO:tasks.workunit.client.0.smithi099.stdout:3/308: mknod d10/d18/c79 0 2024-01-31T05:13:11.311 INFO:tasks.workunit.client.0.smithi099.stdout:3/309: readlink d10/d27/l5f 0 2024-01-31T05:13:11.313 INFO:tasks.workunit.client.0.smithi099.stdout:3/310: mknod d10/d24/c7a 0 2024-01-31T05:13:11.315 INFO:tasks.workunit.client.0.smithi099.stdout:3/311: rmdir d10/d32/d33/d51/d74 0 2024-01-31T05:13:11.315 INFO:tasks.workunit.client.0.smithi099.stdout:2/297: write d10/f42 [1655783,89385] 0 2024-01-31T05:13:11.319 INFO:tasks.workunit.client.0.smithi099.stdout:9/218: dread d0/d7/f14 [0,4194304] 0 2024-01-31T05:13:11.327 INFO:tasks.workunit.client.0.smithi099.stdout:3/312: dread d10/d32/f3b [0,4194304] 0 2024-01-31T05:13:11.327 INFO:tasks.workunit.client.0.smithi099.stdout:3/313: chown d10/d24/d40/f59 167436906 1 2024-01-31T05:13:11.328 INFO:tasks.workunit.client.0.smithi099.stdout:1/333: rename d4/db/d24/d4b/d50/f5b to d4/dc/d15/f6c 0 2024-01-31T05:13:11.329 INFO:tasks.workunit.client.0.smithi099.stdout:3/314: mknod d10/d32/d33/d51/c7b 0 2024-01-31T05:13:11.329 INFO:tasks.workunit.client.0.smithi099.stdout:3/315: dread - d10/f66 zero size 2024-01-31T05:13:11.330 INFO:tasks.workunit.client.0.smithi099.stdout:3/316: fdatasync d10/d32/f4e 0 2024-01-31T05:13:11.330 INFO:tasks.workunit.client.0.smithi099.stdout:3/317: dread - d10/f66 zero size 2024-01-31T05:13:11.330 INFO:tasks.workunit.client.0.smithi099.stdout:3/318: write d10/d32/d33/d51/f67 [640506,124814] 0 2024-01-31T05:13:11.330 INFO:tasks.workunit.client.0.smithi099.stdout:2/298: dread d10/d1b/f23 [0,4194304] 0 2024-01-31T05:13:11.330 INFO:tasks.workunit.client.0.smithi099.stdout:2/299: creat d10/d1b/f65 x:0 0 0 2024-01-31T05:13:11.330 INFO:tasks.workunit.client.0.smithi099.stdout:5/330: rename d6/d1e/d1f/l50 to d6/da/d14/d2b/l67 0 2024-01-31T05:13:11.331 INFO:tasks.workunit.client.0.smithi099.stdout:1/334: truncate d4/db/d3a/f60 3527688 0 2024-01-31T05:13:11.331 INFO:tasks.workunit.client.0.smithi099.stdout:1/335: fsync d4/dc/d48/f3d 0 2024-01-31T05:13:11.331 INFO:tasks.workunit.client.0.smithi099.stdout:1/336: dread - d4/db/d24/f41 zero size 2024-01-31T05:13:11.331 INFO:tasks.workunit.client.0.smithi099.stdout:1/337: chown d4/dc/d29 5248349 1 2024-01-31T05:13:11.332 INFO:tasks.workunit.client.0.smithi099.stdout:2/300: unlink d10/d1b/f65 0 2024-01-31T05:13:11.335 INFO:tasks.workunit.client.0.smithi099.stdout:3/319: symlink d10/d27/d34/d44/d60/l7c 0 2024-01-31T05:13:11.335 INFO:tasks.workunit.client.0.smithi099.stdout:0/312: rename d1/d56/l6b to d1/d30/d45/l6c 0 2024-01-31T05:13:11.336 INFO:tasks.workunit.client.0.smithi099.stdout:5/331: mknod d6/da/d3f/c68 0 2024-01-31T05:13:11.338 INFO:tasks.workunit.client.0.smithi099.stdout:1/338: creat d4/dc/d44/f6d x:0 0 0 2024-01-31T05:13:11.341 INFO:tasks.workunit.client.0.smithi099.stdout:7/294: rename d6/d32/d3d/d4b/d33/d37/d50/f2c to d6/d32/d3d/f60 0 2024-01-31T05:13:11.341 INFO:tasks.workunit.client.0.smithi099.stdout:7/295: stat d6/d12/c28 0 2024-01-31T05:13:11.341 INFO:tasks.workunit.client.0.smithi099.stdout:7/296: write d6/d12/f1d [222814,89375] 0 2024-01-31T05:13:11.342 INFO:tasks.workunit.client.0.smithi099.stdout:0/313: creat d1/d30/d45/d66/f6d x:0 0 0 2024-01-31T05:13:11.342 INFO:tasks.workunit.client.0.smithi099.stdout:0/314: chown d1/d16/d36/c49 186093 1 2024-01-31T05:13:11.343 INFO:tasks.workunit.client.0.smithi099.stdout:1/339: mknod d4/db/c6e 0 2024-01-31T05:13:11.343 INFO:tasks.workunit.client.0.smithi099.stdout:1/340: write d4/dc/f2c [267739,112753] 0 2024-01-31T05:13:11.345 INFO:tasks.workunit.client.0.smithi099.stdout:2/301: mknod d10/c66 0 2024-01-31T05:13:11.348 INFO:tasks.workunit.client.0.smithi099.stdout:9/219: rename d0/d7/f3b to d0/d3e/f4c 0 2024-01-31T05:13:11.348 INFO:tasks.workunit.client.0.smithi099.stdout:9/220: truncate d0/d3e/f4c 829696 0 2024-01-31T05:13:11.349 INFO:tasks.workunit.client.0.smithi099.stdout:7/297: symlink d6/d32/d3d/d4b/d33/d37/d50/d25/d43/l61 0 2024-01-31T05:13:11.349 INFO:tasks.workunit.client.0.smithi099.stdout:0/315: rmdir d1/d30 39 2024-01-31T05:13:11.351 INFO:tasks.workunit.client.0.smithi099.stdout:0/316: mkdir d1/d30/d45/d6e 0 2024-01-31T05:13:11.352 INFO:tasks.workunit.client.0.smithi099.stdout:0/317: mkdir d1/d37/d4a/d6f 0 2024-01-31T05:13:11.353 INFO:tasks.workunit.client.0.smithi099.stdout:0/318: truncate d1/d16/f18 3313255 0 2024-01-31T05:13:11.353 INFO:tasks.workunit.client.0.smithi099.stdout:0/319: dread - d1/d16/f5a zero size 2024-01-31T05:13:11.353 INFO:tasks.workunit.client.0.smithi099.stdout:0/320: stat d1/d16/f18 0 2024-01-31T05:13:11.353 INFO:tasks.workunit.client.0.smithi099.stdout:0/321: chown d1/d30/d45/d66/d2e/c54 82529 1 2024-01-31T05:13:11.357 INFO:tasks.workunit.client.0.smithi099.stdout:3/320: dwrite d10/d27/f49 [0,4194304] 0 2024-01-31T05:13:11.357 INFO:tasks.workunit.client.0.smithi099.stdout:3/321: readlink d10/d32/l65 0 2024-01-31T05:13:11.360 INFO:tasks.workunit.client.0.smithi099.stdout:3/322: truncate d10/d27/f53 2713649 0 2024-01-31T05:13:11.360 INFO:tasks.workunit.client.0.smithi099.stdout:3/323: stat d10/d27/f30 0 2024-01-31T05:13:11.363 INFO:tasks.workunit.client.0.smithi099.stdout:9/221: fsync d0/d3e/f4c 0 2024-01-31T05:13:11.364 INFO:tasks.workunit.client.0.smithi099.stdout:9/222: symlink d0/d1/d24/l4d 0 2024-01-31T05:13:11.364 INFO:tasks.workunit.client.0.smithi099.stdout:9/223: creat d0/d7/f4e x:0 0 0 2024-01-31T05:13:11.367 INFO:tasks.workunit.client.0.smithi099.stdout:7/298: dread d6/d32/d3d/f60 [0,4194304] 0 2024-01-31T05:13:11.367 INFO:tasks.workunit.client.0.smithi099.stdout:7/299: chown d6/d32/d3d/d4b/d33/d37/f40 6 1 2024-01-31T05:13:11.367 INFO:tasks.workunit.client.0.smithi099.stdout:7/300: write d6/d12/f1d [2702427,66350] 0 2024-01-31T05:13:11.367 INFO:tasks.workunit.client.0.smithi099.stdout:7/301: creat d6/d32/d3d/d4b/d33/d37/d4e/f62 x:0 0 0 2024-01-31T05:13:11.367 INFO:tasks.workunit.client.0.smithi099.stdout:9/224: creat d0/d44/f4f x:0 0 0 2024-01-31T05:13:11.367 INFO:tasks.workunit.client.0.smithi099.stdout:9/225: dread - d0/d7/f46 zero size 2024-01-31T05:13:11.367 INFO:tasks.workunit.client.0.smithi099.stdout:9/226: chown d0/d3e/f42 0 1 2024-01-31T05:13:11.368 INFO:tasks.workunit.client.0.smithi099.stdout:6/251: rename d14/d18/d1a/d1c/f35 to d14/d18/d1a/d1b/f47 0 2024-01-31T05:13:11.369 INFO:tasks.workunit.client.0.smithi099.stdout:7/302: creat d6/d32/f63 x:0 0 0 2024-01-31T05:13:11.369 INFO:tasks.workunit.client.0.smithi099.stdout:7/303: chown d6/d32/d3d/d4b/c26 4270 1 2024-01-31T05:13:11.369 INFO:tasks.workunit.client.0.smithi099.stdout:7/304: dread - d6/d32/d3d/d4b/d33/d37/d50/d25/d47/f57 zero size 2024-01-31T05:13:11.369 INFO:tasks.workunit.client.0.smithi099.stdout:7/305: write d6/d32/d3d/d4b/d33/d37/d50/f3e [768086,81835] 0 2024-01-31T05:13:11.370 INFO:tasks.workunit.client.0.smithi099.stdout:9/227: truncate d0/d7/f28 56769 0 2024-01-31T05:13:11.370 INFO:tasks.workunit.client.0.smithi099.stdout:9/228: write d0/d1/fe [4193048,59122] 0 2024-01-31T05:13:11.371 INFO:tasks.workunit.client.0.smithi099.stdout:5/332: rename d6/da/d3f/f58 to d6/d1e/f69 0 2024-01-31T05:13:11.371 INFO:tasks.workunit.client.0.smithi099.stdout:5/333: fsync f1 0 2024-01-31T05:13:11.372 INFO:tasks.workunit.client.0.smithi099.stdout:9/229: mkdir d0/d1/d24/d50 0 2024-01-31T05:13:11.374 INFO:tasks.workunit.client.0.smithi099.stdout:1/341: rename d4/dc/d29/l62 to d4/dc/d4d/l6f 0 2024-01-31T05:13:11.375 INFO:tasks.workunit.client.0.smithi099.stdout:5/334: creat d6/da/d14/d2b/f6a x:0 0 0 2024-01-31T05:13:11.375 INFO:tasks.workunit.client.0.smithi099.stdout:5/335: dread - d6/da/d14/d2b/f6a zero size 2024-01-31T05:13:11.375 INFO:tasks.workunit.client.0.smithi099.stdout:6/252: mknod d14/d18/d1a/d1b/c48 0 2024-01-31T05:13:11.375 INFO:tasks.workunit.client.0.smithi099.stdout:1/342: creat d4/db/d24/d69/f70 x:0 0 0 2024-01-31T05:13:11.375 INFO:tasks.workunit.client.0.smithi099.stdout:1/343: truncate d4/dc/d15/f6c 400982 0 2024-01-31T05:13:11.377 INFO:tasks.workunit.client.0.smithi099.stdout:1/344: unlink d4/dc/c16 0 2024-01-31T05:13:11.377 INFO:tasks.workunit.client.0.smithi099.stdout:1/345: write d4/db/d3a/f60 [4144828,74912] 0 2024-01-31T05:13:11.378 INFO:tasks.workunit.client.0.smithi099.stdout:1/346: mknod d4/df/d37/c71 0 2024-01-31T05:13:11.379 INFO:tasks.workunit.client.0.smithi099.stdout:1/347: truncate d4/dc/d48/f3d 462070 0 2024-01-31T05:13:11.384 INFO:tasks.workunit.client.0.smithi099.stdout:7/306: dread d6/d32/d3d/d4b/d33/d37/d4e/f4f [0,4194304] 0 2024-01-31T05:13:11.384 INFO:tasks.workunit.client.0.smithi099.stdout:7/307: readlink d6/lb 0 2024-01-31T05:13:11.387 INFO:tasks.workunit.client.0.smithi099.stdout:1/348: write d4/dc/d15/f20 [7479796,64421] 0 2024-01-31T05:13:11.388 INFO:tasks.workunit.client.0.smithi099.stdout:7/308: unlink d6/d32/d3d/d4b/c26 0 2024-01-31T05:13:11.389 INFO:tasks.workunit.client.0.smithi099.stdout:5/336: dread d6/d1e/f43 [4194304,4194304] 0 2024-01-31T05:13:11.396 INFO:tasks.workunit.client.0.smithi099.stdout:1/349: dread d4/dc/d29/f46 [0,4194304] 0 2024-01-31T05:13:11.396 INFO:tasks.workunit.client.0.smithi099.stdout:1/350: stat d4/db/d12/f65 0 2024-01-31T05:13:11.396 INFO:tasks.workunit.client.0.smithi099.stdout:1/351: chown d4/df/d53 376619 1 2024-01-31T05:13:11.398 INFO:tasks.workunit.client.0.smithi099.stdout:1/352: creat d4/dc/d55/f72 x:0 0 0 2024-01-31T05:13:11.399 INFO:tasks.workunit.client.0.smithi099.stdout:3/324: dwrite d10/d18/f2c [4194304,4194304] 0 2024-01-31T05:13:11.399 INFO:tasks.workunit.client.0.smithi099.stdout:0/322: dwrite d1/d30/d45/d66/d2e/f46 [0,4194304] 0 2024-01-31T05:13:11.399 INFO:tasks.workunit.client.0.smithi099.stdout:0/323: dread - d1/d16/d36/f3d zero size 2024-01-31T05:13:11.400 INFO:tasks.workunit.client.0.smithi099.stdout:9/230: dwrite d0/d1/d24/d2b/f3c [0,4194304] 0 2024-01-31T05:13:11.400 INFO:tasks.workunit.client.0.smithi099.stdout:9/231: creat d0/d1/d24/d48/f51 x:0 0 0 2024-01-31T05:13:11.400 INFO:tasks.workunit.client.0.smithi099.stdout:9/232: fsync d0/d7/d2e/f43 0 2024-01-31T05:13:11.400 INFO:tasks.workunit.client.0.smithi099.stdout:9/233: write d0/d7/f13 [3039761,62555] 0 2024-01-31T05:13:11.403 INFO:tasks.workunit.client.0.smithi099.stdout:1/353: creat d4/db/f73 x:0 0 0 2024-01-31T05:13:11.403 INFO:tasks.workunit.client.0.smithi099.stdout:1/354: chown d4/db/d12 8062862 1 2024-01-31T05:13:11.414 INFO:tasks.workunit.client.0.smithi099.stdout:5/337: dwrite d6/da/d14/d3d/f53 [0,4194304] 0 2024-01-31T05:13:11.414 INFO:tasks.workunit.client.0.smithi099.stdout:5/338: chown d6/da/d14/d2b/l67 393 1 2024-01-31T05:13:11.415 INFO:tasks.workunit.client.0.smithi099.stdout:5/339: dread - d6/da/d14/d2b/f6a zero size 2024-01-31T05:13:11.419 INFO:tasks.workunit.client.0.smithi099.stdout:5/340: symlink d6/da/d3f/l6b 0 2024-01-31T05:13:11.419 INFO:tasks.workunit.client.0.smithi099.stdout:5/341: truncate d6/da/d14/d2b/f6a 22891 0 2024-01-31T05:13:11.420 INFO:tasks.workunit.client.0.smithi099.stdout:5/342: symlink d6/d1e/d1f/l6c 0 2024-01-31T05:13:11.421 INFO:tasks.workunit.client.0.smithi099.stdout:5/343: truncate d6/f18 1474709 0 2024-01-31T05:13:11.421 INFO:tasks.workunit.client.0.smithi099.stdout:5/344: write d6/f11 [4515759,22019] 0 2024-01-31T05:13:11.431 INFO:tasks.workunit.client.0.smithi099.stdout:9/234: dwrite d0/d7/f4e [0,4194304] 0 2024-01-31T05:13:11.431 INFO:tasks.workunit.client.0.smithi099.stdout:3/325: dwrite f0 [0,4194304] 0 2024-01-31T05:13:11.431 INFO:tasks.workunit.client.0.smithi099.stdout:3/326: chown d10/f19 4901164 1 2024-01-31T05:13:11.431 INFO:tasks.workunit.client.0.smithi099.stdout:3/327: read d10/d32/f3b [806411,124310] 0 2024-01-31T05:13:11.431 INFO:tasks.workunit.client.0.smithi099.stdout:3/328: write d10/d27/f5b [893747,93440] 0 2024-01-31T05:13:11.431 INFO:tasks.workunit.client.0.smithi099.stdout:3/329: truncate d10/d32/f4e 773422 0 2024-01-31T05:13:11.432 INFO:tasks.workunit.client.0.smithi099.stdout:8/362: sync 2024-01-31T05:13:11.432 INFO:tasks.workunit.client.0.smithi099.stdout:6/253: link l5 d14/d18/d1a/d1c/d29/l49 0 2024-01-31T05:13:11.432 INFO:tasks.workunit.client.0.smithi099.stdout:8/363: readlink d1/dd/d11/d19/d21/d3c/l52 0 2024-01-31T05:13:11.432 INFO:tasks.workunit.client.0.smithi099.stdout:9/235: dread d0/d3e/f4c [0,4194304] 0 2024-01-31T05:13:11.433 INFO:tasks.workunit.client.0.smithi099.stdout:2/302: rename d10/d51/l53 to d10/d1b/d4d/d5a/l67 0 2024-01-31T05:13:11.437 INFO:tasks.workunit.client.0.smithi099.stdout:9/236: mknod d0/d1/d24/d48/c52 0 2024-01-31T05:13:11.437 INFO:tasks.workunit.client.0.smithi099.stdout:9/237: fsync d0/d1/d24/d48/f51 0 2024-01-31T05:13:11.438 INFO:tasks.workunit.client.0.smithi099.stdout:9/238: creat d0/d44/f53 x:0 0 0 2024-01-31T05:13:11.440 INFO:tasks.workunit.client.0.smithi099.stdout:6/254: dread d14/f15 [0,4194304] 0 2024-01-31T05:13:11.441 INFO:tasks.workunit.client.0.smithi099.stdout:1/355: rename d4/df/d53 to d4/db/d12/d74 0 2024-01-31T05:13:11.441 INFO:tasks.workunit.client.0.smithi099.stdout:5/345: write d6/d1e/f3c [2081474,61241] 0 2024-01-31T05:13:11.441 INFO:tasks.workunit.client.0.smithi099.stdout:8/364: symlink d1/dd/d15/d2e/l6f 0 2024-01-31T05:13:11.442 INFO:tasks.workunit.client.0.smithi099.stdout:5/346: creat d6/f6d x:0 0 0 2024-01-31T05:13:11.442 INFO:tasks.workunit.client.0.smithi099.stdout:8/365: write d1/dd/d11/d29/f2a [312978,69218] 0 2024-01-31T05:13:11.446 INFO:tasks.workunit.client.0.smithi099.stdout:9/239: symlink d0/d7/l54 0 2024-01-31T05:13:11.450 INFO:tasks.workunit.client.0.smithi099.stdout:9/240: link d0/d1/d24/c49 d0/c55 0 2024-01-31T05:13:11.451 INFO:tasks.workunit.client.0.smithi099.stdout:1/356: link d4/dc/d15/f6c d4/df/d37/d56/f75 0 2024-01-31T05:13:11.455 INFO:tasks.workunit.client.0.smithi099.stdout:1/357: mknod d4/db/d24/d69/c76 0 2024-01-31T05:13:11.457 INFO:tasks.workunit.client.0.smithi099.stdout:1/358: creat d4/db/d24/d4b/f77 x:0 0 0 2024-01-31T05:13:11.457 INFO:tasks.workunit.client.0.smithi099.stdout:1/359: chown d4/dc/f43 1344 1 2024-01-31T05:13:11.457 INFO:tasks.workunit.client.0.smithi099.stdout:3/330: dwrite ff [0,4194304] 0 2024-01-31T05:13:11.461 INFO:tasks.workunit.client.0.smithi099.stdout:3/331: write d10/d24/f38 [4787865,3277] 0 2024-01-31T05:13:11.464 INFO:tasks.workunit.client.0.smithi099.stdout:3/332: creat d10/d27/d34/d52/f7d x:0 0 0 2024-01-31T05:13:11.465 INFO:tasks.workunit.client.0.smithi099.stdout:3/333: write d10/d27/d34/d52/f7d [781944,38281] 0 2024-01-31T05:13:11.466 INFO:tasks.workunit.client.0.smithi099.stdout:3/334: link d10/d32/f3b d10/d32/d33/d4a/f7e 0 2024-01-31T05:13:11.468 INFO:tasks.workunit.client.0.smithi099.stdout:1/360: dread d4/df/f34 [0,4194304] 0 2024-01-31T05:13:11.471 INFO:tasks.workunit.client.0.smithi099.stdout:1/361: mknod d4/db/d24/d69/c78 0 2024-01-31T05:13:11.482 INFO:tasks.workunit.client.0.smithi099.stdout:6/255: dwrite d14/d18/d1a/d1c/d29/f2b [0,4194304] 0 2024-01-31T05:13:11.483 INFO:tasks.workunit.client.0.smithi099.stdout:9/241: dwrite d0/d1/f1d [8388608,4194304] 0 2024-01-31T05:13:11.483 INFO:tasks.workunit.client.0.smithi099.stdout:8/366: dwrite d1/dd/d11/f31 [0,4194304] 0 2024-01-31T05:13:11.483 INFO:tasks.workunit.client.0.smithi099.stdout:8/367: fsync d1/dd/d11/d20/f4c 0 2024-01-31T05:13:11.488 INFO:tasks.workunit.client.0.smithi099.stdout:3/335: dwrite ff [0,4194304] 0 2024-01-31T05:13:11.488 INFO:tasks.workunit.client.0.smithi099.stdout:9/242: mknod d0/d44/c56 0 2024-01-31T05:13:11.489 INFO:tasks.workunit.client.0.smithi099.stdout:6/256: mknod d14/d18/d1a/d1c/d29/d43/c4a 0 2024-01-31T05:13:11.490 INFO:tasks.workunit.client.0.smithi099.stdout:9/243: dread d0/d7/f28 [0,4194304] 0 2024-01-31T05:13:11.494 INFO:tasks.workunit.client.0.smithi099.stdout:2/303: rename d10/f3b to d10/d20/f68 0 2024-01-31T05:13:11.494 INFO:tasks.workunit.client.0.smithi099.stdout:2/304: fsync d10/d20/f4c 0 2024-01-31T05:13:11.496 INFO:tasks.workunit.client.0.smithi099.stdout:8/368: mknod d1/dd/d65/c70 0 2024-01-31T05:13:11.496 INFO:tasks.workunit.client.0.smithi099.stdout:8/369: stat d1/dd/d15/f22 0 2024-01-31T05:13:11.502 INFO:tasks.workunit.client.0.smithi099.stdout:3/336: mknod d10/d27/d34/d50/c7f 0 2024-01-31T05:13:11.502 INFO:tasks.workunit.client.0.smithi099.stdout:3/337: truncate d10/d27/f5d 1392785 0 2024-01-31T05:13:11.503 INFO:tasks.workunit.client.0.smithi099.stdout:9/244: mknod d0/d3e/d33/c57 0 2024-01-31T05:13:11.507 INFO:tasks.workunit.client.0.smithi099.stdout:2/305: mkdir d10/d3a/d69 0 2024-01-31T05:13:11.510 INFO:tasks.workunit.client.0.smithi099.stdout:5/347: rename d6/d1e/d1f to d6/da/d14/d3d/d6e 0 2024-01-31T05:13:11.510 INFO:tasks.workunit.client.0.smithi099.stdout:2/306: mkdir d10/d1b/d6a 0 2024-01-31T05:13:11.510 INFO:tasks.workunit.client.0.smithi099.stdout:5/348: write d6/d1e/f2c [883007,110760] 0 2024-01-31T05:13:11.511 INFO:tasks.workunit.client.0.smithi099.stdout:2/307: mkdir d10/d1b/d4d/d5a/d6b 0 2024-01-31T05:13:11.512 INFO:tasks.workunit.client.0.smithi099.stdout:3/338: rename d10/l3a to d10/d1e/l80 0 2024-01-31T05:13:11.516 INFO:tasks.workunit.client.0.smithi099.stdout:5/349: unlink d6/d52/c60 0 2024-01-31T05:13:11.516 INFO:tasks.workunit.client.0.smithi099.stdout:4/316: sync 2024-01-31T05:13:11.516 INFO:tasks.workunit.client.0.smithi099.stdout:5/350: readlink d6/da/d14/d2b/l67 0 2024-01-31T05:13:11.516 INFO:tasks.workunit.client.0.smithi099.stdout:4/317: chown d0/d8/d19 300056 1 2024-01-31T05:13:11.516 INFO:tasks.workunit.client.0.smithi099.stdout:5/351: chown d6/le 93359 1 2024-01-31T05:13:11.517 INFO:tasks.workunit.client.0.smithi099.stdout:5/352: symlink d6/da/d14/l6f 0 2024-01-31T05:13:11.518 INFO:tasks.workunit.client.0.smithi099.stdout:4/318: mknod d0/d2/d20/c6f 0 2024-01-31T05:13:11.518 INFO:tasks.workunit.client.0.smithi099.stdout:9/245: dread d0/d1/f1d [8388608,4194304] 0 2024-01-31T05:13:11.519 INFO:tasks.workunit.client.0.smithi099.stdout:5/353: rename d6/c1b to d6/da/d14/d3d/d51/c70 0 2024-01-31T05:13:11.519 INFO:tasks.workunit.client.0.smithi099.stdout:8/370: dwrite d1/dd/d11/d19/f1f [0,4194304] 0 2024-01-31T05:13:11.522 INFO:tasks.workunit.client.0.smithi099.stdout:4/319: truncate d0/d8/f11 3488769 0 2024-01-31T05:13:11.522 INFO:tasks.workunit.client.0.smithi099.stdout:4/320: truncate d0/d2/d20/f31 4720227 0 2024-01-31T05:13:11.525 INFO:tasks.workunit.client.0.smithi099.stdout:8/371: mkdir d1/d71 0 2024-01-31T05:13:11.525 INFO:tasks.workunit.client.0.smithi099.stdout:8/372: write d1/dd/d11/d20/f4c [646197,127853] 0 2024-01-31T05:13:11.525 INFO:tasks.workunit.client.0.smithi099.stdout:8/373: write d1/dd/d11/d29/d3a/f54 [932306,70184] 0 2024-01-31T05:13:11.526 INFO:tasks.workunit.client.0.smithi099.stdout:4/321: unlink d0/d2/d20/c6f 0 2024-01-31T05:13:11.526 INFO:tasks.workunit.client.0.smithi099.stdout:4/322: chown d0/d2/d20/d21/d39/d66 1624032 1 2024-01-31T05:13:11.527 INFO:tasks.workunit.client.0.smithi099.stdout:4/323: truncate d0/d2/d4b/f69 434805 0 2024-01-31T05:13:11.527 INFO:tasks.workunit.client.0.smithi099.stdout:8/374: symlink d1/dd/d65/l72 0 2024-01-31T05:13:11.527 INFO:tasks.workunit.client.0.smithi099.stdout:8/375: chown d1/l35 3 1 2024-01-31T05:13:11.528 INFO:tasks.workunit.client.0.smithi099.stdout:4/324: symlink d0/d2/d20/d21/d39/d66/l70 0 2024-01-31T05:13:11.531 INFO:tasks.workunit.client.0.smithi099.stdout:4/325: rename d0/d2/d20/d21/d39/d66/l70 to d0/d2/d20/d21/d17/d24/d5a/l71 0 2024-01-31T05:13:11.532 INFO:tasks.workunit.client.0.smithi099.stdout:6/257: dwrite d14/d18/d1a/d1c/d29/f41 [0,4194304] 0 2024-01-31T05:13:11.532 INFO:tasks.workunit.client.0.smithi099.stdout:3/339: write d10/d27/f29 [2655037,65415] 0 2024-01-31T05:13:11.533 INFO:tasks.workunit.client.0.smithi099.stdout:3/340: fsync d10/d27/d34/f68 0 2024-01-31T05:13:11.533 INFO:tasks.workunit.client.0.smithi099.stdout:3/341: write d10/d24/d40/f59 [1340320,26567] 0 2024-01-31T05:13:11.533 INFO:tasks.workunit.client.0.smithi099.stdout:3/342: readlink d10/d32/d33/d51/l54 0 2024-01-31T05:13:11.533 INFO:tasks.workunit.client.0.smithi099.stdout:3/343: chown d10/d32/d33/c3c 65 1 2024-01-31T05:13:11.533 INFO:tasks.workunit.client.0.smithi099.stdout:4/326: mkdir d0/d1e/d72 0 2024-01-31T05:13:11.536 INFO:tasks.workunit.client.0.smithi099.stdout:6/258: unlink d14/c23 0 2024-01-31T05:13:11.536 INFO:tasks.workunit.client.0.smithi099.stdout:6/259: fsync d14/d18/d1a/d1c/d29/f41 0 2024-01-31T05:13:11.537 INFO:tasks.workunit.client.0.smithi099.stdout:9/246: dread d0/d7/f4e [0,4194304] 0 2024-01-31T05:13:11.537 INFO:tasks.workunit.client.0.smithi099.stdout:6/260: mknod d14/d18/d1a/d1b/d46/c4b 0 2024-01-31T05:13:11.537 INFO:tasks.workunit.client.0.smithi099.stdout:3/344: mkdir d10/d24/d40/d81 0 2024-01-31T05:13:11.538 INFO:tasks.workunit.client.0.smithi099.stdout:4/327: mknod d0/d2/d20/d21/d17/c73 0 2024-01-31T05:13:11.539 INFO:tasks.workunit.client.0.smithi099.stdout:6/261: symlink d14/d18/d1a/d1b/d22/l4c 0 2024-01-31T05:13:11.539 INFO:tasks.workunit.client.0.smithi099.stdout:9/247: symlink d0/d3e/d33/l58 0 2024-01-31T05:13:11.541 INFO:tasks.workunit.client.0.smithi099.stdout:4/328: mkdir d0/d74 0 2024-01-31T05:13:11.541 INFO:tasks.workunit.client.0.smithi099.stdout:4/329: creat d0/d8/d19/d65/f75 x:0 0 0 2024-01-31T05:13:11.545 INFO:tasks.workunit.client.0.smithi099.stdout:9/248: getdents d0 0 2024-01-31T05:13:11.545 INFO:tasks.workunit.client.0.smithi099.stdout:9/249: dread - d0/d1/d24/d48/f4b zero size 2024-01-31T05:13:11.545 INFO:tasks.workunit.client.0.smithi099.stdout:9/250: readlink d0/d1/d24/l4d 0 2024-01-31T05:13:11.545 INFO:tasks.workunit.client.0.smithi099.stdout:3/345: getdents d10/d27 0 2024-01-31T05:13:11.545 INFO:tasks.workunit.client.0.smithi099.stdout:2/308: dwrite f4 [0,4194304] 0 2024-01-31T05:13:11.545 INFO:tasks.workunit.client.0.smithi099.stdout:2/309: dread - d10/d1c/f64 zero size 2024-01-31T05:13:11.545 INFO:tasks.workunit.client.0.smithi099.stdout:4/330: mkdir d0/d8/d19/d54/d76 0 2024-01-31T05:13:11.545 INFO:tasks.workunit.client.0.smithi099.stdout:4/331: dread - d0/d2/d4b/f5f zero size 2024-01-31T05:13:11.546 INFO:tasks.workunit.client.0.smithi099.stdout:9/251: unlink d0/d1/d24/d48/c52 0 2024-01-31T05:13:11.549 INFO:tasks.workunit.client.0.smithi099.stdout:8/376: dwrite d1/dd/d11/d19/f1f [0,4194304] 0 2024-01-31T05:13:11.555 INFO:tasks.workunit.client.0.smithi099.stdout:4/332: mknod d0/d2/d20/d21/d17/d24/d3f/d43/c77 0 2024-01-31T05:13:11.555 INFO:tasks.workunit.client.0.smithi099.stdout:3/346: write ff [1828552,128546] 0 2024-01-31T05:13:11.555 INFO:tasks.workunit.client.0.smithi099.stdout:4/333: write d0/d8/f64 [4546874,95336] 0 2024-01-31T05:13:11.555 INFO:tasks.workunit.client.0.smithi099.stdout:3/347: creat d10/d24/d40/f82 x:0 0 0 2024-01-31T05:13:11.557 INFO:tasks.workunit.client.0.smithi099.stdout:9/252: mkdir d0/d1/d24/d2b/d59 0 2024-01-31T05:13:11.563 INFO:tasks.workunit.client.0.smithi099.stdout:4/334: symlink d0/d2/d20/d21/d17/d3d/l78 0 2024-01-31T05:13:11.564 INFO:tasks.workunit.client.0.smithi099.stdout:3/348: creat d10/d27/d34/d44/d60/f83 x:0 0 0 2024-01-31T05:13:11.565 INFO:tasks.workunit.client.0.smithi099.stdout:6/262: dwrite fa [0,4194304] 0 2024-01-31T05:13:11.566 INFO:tasks.workunit.client.0.smithi099.stdout:3/349: unlink f0 0 2024-01-31T05:13:11.569 INFO:tasks.workunit.client.0.smithi099.stdout:3/350: mknod d10/d32/d33/d51/c84 0 2024-01-31T05:13:11.570 INFO:tasks.workunit.client.0.smithi099.stdout:3/351: readlink d10/d27/l5f 0 2024-01-31T05:13:11.570 INFO:tasks.workunit.client.0.smithi099.stdout:3/352: dread - d10/d32/d33/d4a/f76 zero size 2024-01-31T05:13:11.570 INFO:tasks.workunit.client.0.smithi099.stdout:8/377: write d1/dd/d15/f3d [1792490,34265] 0 2024-01-31T05:13:11.570 INFO:tasks.workunit.client.0.smithi099.stdout:8/378: write d1/f5e [432827,121859] 0 2024-01-31T05:13:11.570 INFO:tasks.workunit.client.0.smithi099.stdout:6/263: symlink d14/d18/d1a/d1c/d29/l4d 0 2024-01-31T05:13:11.572 INFO:tasks.workunit.client.0.smithi099.stdout:8/379: symlink d1/dd/d11/d29/d3a/l73 0 2024-01-31T05:13:11.574 INFO:tasks.workunit.client.0.smithi099.stdout:8/380: truncate d1/f7 1457433 0 2024-01-31T05:13:11.576 INFO:tasks.workunit.client.0.smithi099.stdout:8/381: mknod d1/dd/d4f/d6e/c74 0 2024-01-31T05:13:11.580 INFO:tasks.workunit.client.0.smithi099.stdout:2/310: rmdir d10/d20 39 2024-01-31T05:13:11.582 INFO:tasks.workunit.client.0.smithi099.stdout:6/264: link d14/d18/d1a/d1c/d29/l49 d14/d18/l4e 0 2024-01-31T05:13:11.588 INFO:tasks.workunit.client.0.smithi099.stdout:4/335: dwrite d0/d2/d20/d21/d17/f25 [0,4194304] 0 2024-01-31T05:13:11.597 INFO:tasks.workunit.client.0.smithi099.stdout:2/311: dread f4 [0,4194304] 0 2024-01-31T05:13:11.597 INFO:tasks.workunit.client.0.smithi099.stdout:9/253: dwrite d0/d1/f1d [0,4194304] 0 2024-01-31T05:13:11.599 INFO:tasks.workunit.client.0.smithi099.stdout:2/312: rmdir d10/d1b/d4d/d5a/d6b 0 2024-01-31T05:13:11.600 INFO:tasks.workunit.client.0.smithi099.stdout:3/353: dwrite d10/d27/d34/d52/f7d [0,4194304] 0 2024-01-31T05:13:11.608 INFO:tasks.workunit.client.0.smithi099.stdout:2/313: dread d10/d1c/f26 [0,4194304] 0 2024-01-31T05:13:11.610 INFO:tasks.workunit.client.0.smithi099.stdout:3/354: write d10/d27/f5b [404482,88647] 0 2024-01-31T05:13:11.611 INFO:tasks.workunit.client.0.smithi099.stdout:3/355: unlink d10/d24/d40/l4b 0 2024-01-31T05:13:11.613 INFO:tasks.workunit.client.0.smithi099.stdout:8/382: dwrite d1/dd/d1d/f40 [0,4194304] 0 2024-01-31T05:13:11.614 INFO:tasks.workunit.client.0.smithi099.stdout:9/254: dread d0/d3e/f40 [0,4194304] 0 2024-01-31T05:13:11.614 INFO:tasks.workunit.client.0.smithi099.stdout:6/265: dwrite d14/d18/d3b/f42 [4194304,4194304] 0 2024-01-31T05:13:11.616 INFO:tasks.workunit.client.0.smithi099.stdout:7/309: sync 2024-01-31T05:13:11.616 INFO:tasks.workunit.client.0.smithi099.stdout:0/324: sync 2024-01-31T05:13:11.616 INFO:tasks.workunit.client.0.smithi099.stdout:7/310: readlink d6/lb 0 2024-01-31T05:13:11.616 INFO:tasks.workunit.client.0.smithi099.stdout:1/362: sync 2024-01-31T05:13:11.616 INFO:tasks.workunit.client.0.smithi099.stdout:1/363: fdatasync d4/dc/d48/f3d 0 2024-01-31T05:13:11.617 INFO:tasks.workunit.client.0.smithi099.stdout:1/364: truncate d4/dc/d15/f6c 513286 0 2024-01-31T05:13:11.617 INFO:tasks.workunit.client.0.smithi099.stdout:3/356: unlink d10/d18/f69 0 2024-01-31T05:13:11.619 INFO:tasks.workunit.client.0.smithi099.stdout:4/336: unlink d0/d1e/l42 0 2024-01-31T05:13:11.619 INFO:tasks.workunit.client.0.smithi099.stdout:4/337: chown d0/l1a 1565767 1 2024-01-31T05:13:11.619 INFO:tasks.workunit.client.0.smithi099.stdout:6/266: write d14/d18/d1a/d1c/f44 [281734,89288] 0 2024-01-31T05:13:11.620 INFO:tasks.workunit.client.0.smithi099.stdout:0/325: rename d1/d8/l1f to d1/d22/l70 0 2024-01-31T05:13:11.620 INFO:tasks.workunit.client.0.smithi099.stdout:6/267: write d14/d18/d1a/d1c/d29/f31 [994362,83124] 0 2024-01-31T05:13:11.621 INFO:tasks.workunit.client.0.smithi099.stdout:7/311: symlink d6/d32/d3d/d4b/d33/d37/d50/d5e/l64 0 2024-01-31T05:13:11.621 INFO:tasks.workunit.client.0.smithi099.stdout:3/357: dread d10/d32/f5a [0,4194304] 0 2024-01-31T05:13:11.623 INFO:tasks.workunit.client.0.smithi099.stdout:5/354: sync 2024-01-31T05:13:11.625 INFO:tasks.workunit.client.0.smithi099.stdout:4/338: mkdir d0/d79 0 2024-01-31T05:13:11.628 INFO:tasks.workunit.client.0.smithi099.stdout:0/326: truncate d1/d16/d36/f68 2374824 0 2024-01-31T05:13:11.630 INFO:tasks.workunit.client.0.smithi099.stdout:7/312: rename d6/d32/d3d/d4b/d33/d37/d4e/f4f to d6/d32/d3d/d4b/d33/d37/d4e/f65 0 2024-01-31T05:13:11.630 INFO:tasks.workunit.client.0.smithi099.stdout:6/268: mkdir d14/d18/d1a/d1c/d29/d4f 0 2024-01-31T05:13:11.630 INFO:tasks.workunit.client.0.smithi099.stdout:1/365: getdents d4/db 0 2024-01-31T05:13:11.632 INFO:tasks.workunit.client.0.smithi099.stdout:4/339: mknod d0/d2/d20/d21/d17/d24/c7a 0 2024-01-31T05:13:11.633 INFO:tasks.workunit.client.0.smithi099.stdout:7/313: symlink d6/d32/d3d/d4b/d33/d37/d50/d25/d47/l66 0 2024-01-31T05:13:11.637 INFO:tasks.workunit.client.0.smithi099.stdout:2/314: dwrite d10/d20/f37 [4194304,4194304] 0 2024-01-31T05:13:11.645 INFO:tasks.workunit.client.0.smithi099.stdout:6/269: dread d14/d18/d3b/f42 [4194304,4194304] 0 2024-01-31T05:13:11.647 INFO:tasks.workunit.client.0.smithi099.stdout:5/355: dread d6/d1e/f2d [0,4194304] 0 2024-01-31T05:13:11.648 INFO:tasks.workunit.client.0.smithi099.stdout:5/356: write d6/da/d14/d3d/d6e/f22 [9102232,30122] 0 2024-01-31T05:13:11.649 INFO:tasks.workunit.client.0.smithi099.stdout:9/255: dwrite d0/d1/fe [0,4194304] 0 2024-01-31T05:13:11.649 INFO:tasks.workunit.client.0.smithi099.stdout:4/340: rename d0/d2/lb to d0/d2/d20/l7b 0 2024-01-31T05:13:11.649 INFO:tasks.workunit.client.0.smithi099.stdout:4/341: truncate d0/d2/d20/d21/d17/d24/d5a/f6b 74704 0 2024-01-31T05:13:11.651 INFO:tasks.workunit.client.0.smithi099.stdout:9/256: creat d0/d1/d24/f5a x:0 0 0 2024-01-31T05:13:11.651 INFO:tasks.workunit.client.0.smithi099.stdout:3/358: dwrite d10/d1e/f6f [0,4194304] 0 2024-01-31T05:13:11.660 INFO:tasks.workunit.client.0.smithi099.stdout:3/359: rename d10/d18 to d10/d32/d85 0 2024-01-31T05:13:11.670 INFO:tasks.workunit.client.0.smithi099.stdout:6/270: dread d14/d18/d1a/d1c/d29/f41 [0,4194304] 0 2024-01-31T05:13:11.671 INFO:tasks.workunit.client.0.smithi099.stdout:1/366: dwrite d4/db/d24/f2b [0,4194304] 0 2024-01-31T05:13:11.672 INFO:tasks.workunit.client.0.smithi099.stdout:6/271: getdents d14/d18/d3b 0 2024-01-31T05:13:11.672 INFO:tasks.workunit.client.0.smithi099.stdout:0/327: dwrite d1/d30/d45/d66/f15 [0,4194304] 0 2024-01-31T05:13:11.672 INFO:tasks.workunit.client.0.smithi099.stdout:4/342: dread d0/d8/f64 [0,4194304] 0 2024-01-31T05:13:11.672 INFO:tasks.workunit.client.0.smithi099.stdout:1/367: read d4/dc/f2c [257212,92761] 0 2024-01-31T05:13:11.672 INFO:tasks.workunit.client.0.smithi099.stdout:1/368: write d4/dc/d29/f3b [1775665,25649] 0 2024-01-31T05:13:11.672 INFO:tasks.workunit.client.0.smithi099.stdout:9/257: dread d0/d1/fe [0,4194304] 0 2024-01-31T05:13:11.673 INFO:tasks.workunit.client.0.smithi099.stdout:7/314: dwrite d6/fa [4194304,4194304] 0 2024-01-31T05:13:11.673 INFO:tasks.workunit.client.0.smithi099.stdout:1/369: dread d4/dc/d15/f6c [0,4194304] 0 2024-01-31T05:13:11.673 INFO:tasks.workunit.client.0.smithi099.stdout:5/357: dwrite d6/f13 [0,4194304] 0 2024-01-31T05:13:11.676 INFO:tasks.workunit.client.0.smithi099.stdout:0/328: rename d1/d16/f2f to d1/d37/d4a/d6f/f71 0 2024-01-31T05:13:11.676 INFO:tasks.workunit.client.0.smithi099.stdout:0/329: dread - d1/d64/f67 zero size 2024-01-31T05:13:11.679 INFO:tasks.workunit.client.0.smithi099.stdout:4/343: unlink d0/d1e/l33 0 2024-01-31T05:13:11.679 INFO:tasks.workunit.client.0.smithi099.stdout:4/344: chown d0/d2/l46 179458 1 2024-01-31T05:13:11.680 INFO:tasks.workunit.client.0.smithi099.stdout:7/315: rename f3 to d6/d32/d3d/d4b/d33/d37/d50/d4d/d58/f67 0 2024-01-31T05:13:11.680 INFO:tasks.workunit.client.0.smithi099.stdout:7/316: creat d6/d32/d3d/d4b/d33/d37/d4e/f68 x:0 0 0 2024-01-31T05:13:11.683 INFO:tasks.workunit.client.0.smithi099.stdout:0/330: rmdir d1/d56 39 2024-01-31T05:13:11.686 INFO:tasks.workunit.client.0.smithi099.stdout:7/317: rename d6/f20 to d6/f69 0 2024-01-31T05:13:11.688 INFO:tasks.workunit.client.0.smithi099.stdout:6/272: dread d14/d18/d1a/d1c/d29/f41 [0,4194304] 0 2024-01-31T05:13:11.688 INFO:tasks.workunit.client.0.smithi099.stdout:3/360: dwrite d10/d32/d85/f22 [0,4194304] 0 2024-01-31T05:13:11.688 INFO:tasks.workunit.client.0.smithi099.stdout:6/273: readlink d14/d18/l4e 0 2024-01-31T05:13:11.688 INFO:tasks.workunit.client.0.smithi099.stdout:7/318: mkdir d6/d6a 0 2024-01-31T05:13:11.688 INFO:tasks.workunit.client.0.smithi099.stdout:7/319: fdatasync d6/f3f 0 2024-01-31T05:13:11.690 INFO:tasks.workunit.client.0.smithi099.stdout:5/358: fsync d6/da/d14/d3d/d6e/f22 0 2024-01-31T05:13:11.690 INFO:tasks.workunit.client.0.smithi099.stdout:1/370: dread d4/df/d37/f54 [0,4194304] 0 2024-01-31T05:13:11.691 INFO:tasks.workunit.client.0.smithi099.stdout:5/359: chown d6/da/d14/d3d/d6e/f22 0 1 2024-01-31T05:13:11.692 INFO:tasks.workunit.client.0.smithi099.stdout:3/361: truncate d10/d27/d34/f5c 436469 0 2024-01-31T05:13:11.695 INFO:tasks.workunit.client.0.smithi099.stdout:7/320: mknod d6/d32/d3d/d4b/d33/d37/d50/c6b 0 2024-01-31T05:13:11.695 INFO:tasks.workunit.client.0.smithi099.stdout:7/321: write d6/d32/d3d/d4b/f23 [2103660,67857] 0 2024-01-31T05:13:11.696 INFO:tasks.workunit.client.0.smithi099.stdout:1/371: dread d4/dc/d15/f32 [4194304,4194304] 0 2024-01-31T05:13:11.697 INFO:tasks.workunit.client.0.smithi099.stdout:9/258: dwrite d0/d7/f28 [0,4194304] 0 2024-01-31T05:13:11.698 INFO:tasks.workunit.client.0.smithi099.stdout:5/360: rename d6/da/l46 to d6/da/d3f/d5a/l71 0 2024-01-31T05:13:11.698 INFO:tasks.workunit.client.0.smithi099.stdout:3/362: link d10/d32/l4f d10/d27/d34/d52/l86 0 2024-01-31T05:13:11.698 INFO:tasks.workunit.client.0.smithi099.stdout:0/331: dread d1/d16/d36/f3e [0,4194304] 0 2024-01-31T05:13:11.704 INFO:tasks.workunit.client.0.smithi099.stdout:6/274: read fa [3764475,89516] 0 2024-01-31T05:13:11.706 INFO:tasks.workunit.client.0.smithi099.stdout:7/322: mknod d6/d32/d3d/d4b/c6c 0 2024-01-31T05:13:11.706 INFO:tasks.workunit.client.0.smithi099.stdout:7/323: write d6/f3f [708900,45754] 0 2024-01-31T05:13:11.710 INFO:tasks.workunit.client.0.smithi099.stdout:5/361: mknod d6/da/d14/c72 0 2024-01-31T05:13:11.710 INFO:tasks.workunit.client.0.smithi099.stdout:4/345: dwrite d0/d2/d20/d21/d17/d24/d5a/f6b [0,4194304] 0 2024-01-31T05:13:11.712 INFO:tasks.workunit.client.0.smithi099.stdout:6/275: stat d14/d18/d1a/d1c 0 2024-01-31T05:13:11.712 INFO:tasks.workunit.client.0.smithi099.stdout:3/363: rmdir d10/d24 39 2024-01-31T05:13:11.712 INFO:tasks.workunit.client.0.smithi099.stdout:3/364: write d10/d32/d33/d4a/f76 [498066,48804] 0 2024-01-31T05:13:11.712 INFO:tasks.workunit.client.0.smithi099.stdout:9/259: dread d0/d1/f1d [4194304,4194304] 0 2024-01-31T05:13:11.713 INFO:tasks.workunit.client.0.smithi099.stdout:0/332: symlink d1/d64/l72 0 2024-01-31T05:13:11.714 INFO:tasks.workunit.client.0.smithi099.stdout:7/324: mknod d6/d32/d3d/d46/c6d 0 2024-01-31T05:13:11.715 INFO:tasks.workunit.client.0.smithi099.stdout:6/276: dread d14/d18/d1a/f37 [0,4194304] 0 2024-01-31T05:13:11.716 INFO:tasks.workunit.client.0.smithi099.stdout:6/277: mkdir d14/d18/d1a/d50 0 2024-01-31T05:13:11.717 INFO:tasks.workunit.client.0.smithi099.stdout:6/278: truncate d14/d18/d1a/d1c/d29/f2b 4657843 0 2024-01-31T05:13:11.719 INFO:tasks.workunit.client.0.smithi099.stdout:5/362: mkdir d6/da/d3f/d73 0 2024-01-31T05:13:11.719 INFO:tasks.workunit.client.0.smithi099.stdout:5/363: fsync d6/d1e/f3c 0 2024-01-31T05:13:11.719 INFO:tasks.workunit.client.0.smithi099.stdout:5/364: truncate d6/da/d14/d61/f64 391045 0 2024-01-31T05:13:11.720 INFO:tasks.workunit.client.0.smithi099.stdout:3/365: truncate d10/d32/d33/d51/f71 228640 0 2024-01-31T05:13:11.720 INFO:tasks.workunit.client.0.smithi099.stdout:3/366: chown d10/d24/d40/f47 1 1 2024-01-31T05:13:11.720 INFO:tasks.workunit.client.0.smithi099.stdout:3/367: write d10/d32/f4e [113011,8597] 0 2024-01-31T05:13:11.721 INFO:tasks.workunit.client.0.smithi099.stdout:9/260: mknod d0/d1/d24/c5b 0 2024-01-31T05:13:11.727 INFO:tasks.workunit.client.0.smithi099.stdout:5/365: creat d6/da/d14/d3d/d51/f74 x:0 0 0 2024-01-31T05:13:11.731 INFO:tasks.workunit.client.0.smithi099.stdout:0/333: rmdir d1/d16 39 2024-01-31T05:13:11.742 INFO:tasks.workunit.client.0.smithi099.stdout:9/261: dread d0/d1/d24/d2b/f1b [0,4194304] 0 2024-01-31T05:13:11.742 INFO:tasks.workunit.client.0.smithi099.stdout:7/325: rmdir d6/d32/d3d 39 2024-01-31T05:13:11.742 INFO:tasks.workunit.client.0.smithi099.stdout:7/326: fdatasync d6/d12/f22 0 2024-01-31T05:13:11.743 INFO:tasks.workunit.client.0.smithi099.stdout:9/262: symlink d0/d3e/l5c 0 2024-01-31T05:13:11.758 INFO:tasks.workunit.client.0.smithi099.stdout:1/372: rename d4/dc/d44/f6d to d4/db/d24/d4b/f79 0 2024-01-31T05:13:11.759 INFO:tasks.workunit.client.0.smithi099.stdout:9/263: dread d0/d7/f28 [0,4194304] 0 2024-01-31T05:13:11.760 INFO:tasks.workunit.client.0.smithi099.stdout:6/279: dwrite f11 [0,4194304] 0 2024-01-31T05:13:11.760 INFO:tasks.workunit.client.0.smithi099.stdout:0/334: dwrite d1/d8/f58 [0,4194304] 0 2024-01-31T05:13:11.760 INFO:tasks.workunit.client.0.smithi099.stdout:3/368: rename d10/c17 to d10/d32/d85/d77/c87 0 2024-01-31T05:13:11.761 INFO:tasks.workunit.client.0.smithi099.stdout:3/369: creat d10/d27/d34/f88 x:0 0 0 2024-01-31T05:13:11.761 INFO:tasks.workunit.client.0.smithi099.stdout:6/280: chown d14/d18/d1a/f3e 5 1 2024-01-31T05:13:11.761 INFO:tasks.workunit.client.0.smithi099.stdout:9/264: rmdir d0/d3e/d33 39 2024-01-31T05:13:11.764 INFO:tasks.workunit.client.0.smithi099.stdout:0/335: mkdir d1/d37/d73 0 2024-01-31T05:13:11.765 INFO:tasks.workunit.client.0.smithi099.stdout:0/336: chown d1/d8/f65 16 1 2024-01-31T05:13:11.768 INFO:tasks.workunit.client.0.smithi099.stdout:5/366: dwrite d6/da/d14/d3d/d6e/f42 [0,4194304] 0 2024-01-31T05:13:11.768 INFO:tasks.workunit.client.0.smithi099.stdout:5/367: fdatasync d6/ff 0 2024-01-31T05:13:11.769 INFO:tasks.workunit.client.0.smithi099.stdout:3/370: mkdir d10/d27/d89 0 2024-01-31T05:13:11.770 INFO:tasks.workunit.client.0.smithi099.stdout:7/327: dwrite d6/d32/d3d/d4b/d33/d37/d50/d25/f29 [0,4194304] 0 2024-01-31T05:13:11.770 INFO:tasks.workunit.client.0.smithi099.stdout:3/371: creat d10/d24/f8a x:0 0 0 2024-01-31T05:13:11.775 INFO:tasks.workunit.client.0.smithi099.stdout:3/372: symlink d10/d32/d33/l8b 0 2024-01-31T05:13:11.775 INFO:tasks.workunit.client.0.smithi099.stdout:3/373: chown d10/d24 314 1 2024-01-31T05:13:11.778 INFO:tasks.workunit.client.0.smithi099.stdout:3/374: mkdir d10/d27/d34/d44/d60/d75/d8c 0 2024-01-31T05:13:11.778 INFO:tasks.workunit.client.0.smithi099.stdout:3/375: fdatasync d10/d32/d33/f61 0 2024-01-31T05:13:11.778 INFO:tasks.workunit.client.0.smithi099.stdout:3/376: chown d10/l11 197305972 1 2024-01-31T05:13:11.779 INFO:tasks.workunit.client.0.smithi099.stdout:8/383: sync 2024-01-31T05:13:11.781 INFO:tasks.workunit.client.0.smithi099.stdout:0/337: dread d1/d8/f58 [0,4194304] 0 2024-01-31T05:13:11.781 INFO:tasks.workunit.client.0.smithi099.stdout:8/384: mknod d1/dd/d15/d2e/c75 0 2024-01-31T05:13:11.783 INFO:tasks.workunit.client.0.smithi099.stdout:0/338: getdents d1/d37 0 2024-01-31T05:13:11.787 INFO:tasks.workunit.client.0.smithi099.stdout:8/385: rmdir d1/dd/d4f/d51 39 2024-01-31T05:13:11.791 INFO:tasks.workunit.client.0.smithi099.stdout:6/281: dwrite d14/d18/d1a/d1b/f47 [0,4194304] 0 2024-01-31T05:13:11.794 INFO:tasks.workunit.client.0.smithi099.stdout:8/386: getdents d1/dd/d15/d2e 0 2024-01-31T05:13:11.794 INFO:tasks.workunit.client.0.smithi099.stdout:1/373: dwrite d4/dc/d15/f32 [0,4194304] 0 2024-01-31T05:13:11.794 INFO:tasks.workunit.client.0.smithi099.stdout:8/387: stat d1/dd/d11/l14 0 2024-01-31T05:13:11.795 INFO:tasks.workunit.client.0.smithi099.stdout:1/374: rmdir d4/dc/d15/d45 39 2024-01-31T05:13:11.795 INFO:tasks.workunit.client.0.smithi099.stdout:1/375: write d4/db/d24/d69/f70 [757599,76556] 0 2024-01-31T05:13:11.795 INFO:tasks.workunit.client.0.smithi099.stdout:1/376: write d4/dc/d15/f20 [8228594,70279] 0 2024-01-31T05:13:11.795 INFO:tasks.workunit.client.0.smithi099.stdout:1/377: read - d4/dc/d15/f5a zero size 2024-01-31T05:13:11.796 INFO:tasks.workunit.client.0.smithi099.stdout:8/388: creat d1/d71/f76 x:0 0 0 2024-01-31T05:13:11.796 INFO:tasks.workunit.client.0.smithi099.stdout:8/389: readlink d1/dd/d11/d20/l28 0 2024-01-31T05:13:11.796 INFO:tasks.workunit.client.0.smithi099.stdout:8/390: stat d1/c5b 0 2024-01-31T05:13:11.796 INFO:tasks.workunit.client.0.smithi099.stdout:8/391: creat d1/dd/d15/f77 x:0 0 0 2024-01-31T05:13:11.798 INFO:tasks.workunit.client.0.smithi099.stdout:8/392: truncate d1/dd/d11/d19/d21/d3c/f46 508859 0 2024-01-31T05:13:11.798 INFO:tasks.workunit.client.0.smithi099.stdout:8/393: chown d1/dd/d11/d20/l28 326 1 2024-01-31T05:13:11.798 INFO:tasks.workunit.client.0.smithi099.stdout:8/394: readlink d1/l35 0 2024-01-31T05:13:11.798 INFO:tasks.workunit.client.0.smithi099.stdout:8/395: chown d1/dd/d11/d19/d21/l5f 9 1 2024-01-31T05:13:11.798 INFO:tasks.workunit.client.0.smithi099.stdout:8/396: truncate d1/dd/d11/d20/f3e 1039607 0 2024-01-31T05:13:11.798 INFO:tasks.workunit.client.0.smithi099.stdout:8/397: stat d1/dd/d11/l14 0 2024-01-31T05:13:11.799 INFO:tasks.workunit.client.0.smithi099.stdout:8/398: rename d1/dd/d11/l5a to d1/dd/d65/l78 0 2024-01-31T05:13:11.800 INFO:tasks.workunit.client.0.smithi099.stdout:3/377: dwrite d10/d27/f5d [0,4194304] 0 2024-01-31T05:13:11.801 INFO:tasks.workunit.client.0.smithi099.stdout:8/399: truncate d1/f10 1627958 0 2024-01-31T05:13:11.804 INFO:tasks.workunit.client.0.smithi099.stdout:3/378: dread d10/d32/d33/d4a/f76 [0,4194304] 0 2024-01-31T05:13:11.804 INFO:tasks.workunit.client.0.smithi099.stdout:3/379: chown d10/d1e/c3e 1 1 2024-01-31T05:13:11.804 INFO:tasks.workunit.client.0.smithi099.stdout:3/380: creat d10/d32/d33/d4a/f8d x:0 0 0 2024-01-31T05:13:11.804 INFO:tasks.workunit.client.0.smithi099.stdout:3/381: creat d10/d24/d40/f8e x:0 0 0 2024-01-31T05:13:11.804 INFO:tasks.workunit.client.0.smithi099.stdout:3/382: getdents d10/d27/d89 0 2024-01-31T05:13:11.804 INFO:tasks.workunit.client.0.smithi099.stdout:3/383: creat d10/f8f x:0 0 0 2024-01-31T05:13:11.804 INFO:tasks.workunit.client.0.smithi099.stdout:3/384: readlink d10/d32/d33/l8b 0 2024-01-31T05:13:11.805 INFO:tasks.workunit.client.0.smithi099.stdout:8/400: mknod d1/dd/d15/d2e/c79 0 2024-01-31T05:13:11.805 INFO:tasks.workunit.client.0.smithi099.stdout:8/401: creat d1/dd/d11/d19/d21/d3c/f7a x:0 0 0 2024-01-31T05:13:11.805 INFO:tasks.workunit.client.0.smithi099.stdout:8/402: fdatasync d1/dd/d11/d19/f6d 0 2024-01-31T05:13:11.808 INFO:tasks.workunit.client.0.smithi099.stdout:3/385: symlink d10/d1e/l90 0 2024-01-31T05:13:11.811 INFO:tasks.workunit.client.0.smithi099.stdout:8/403: mkdir d1/dd/d7b 0 2024-01-31T05:13:11.812 INFO:tasks.workunit.client.0.smithi099.stdout:3/386: link d10/c6d d10/d24/d40/c91 0 2024-01-31T05:13:11.813 INFO:tasks.workunit.client.0.smithi099.stdout:8/404: mknod d1/dd/d11/d19/d21/d3c/c7c 0 2024-01-31T05:13:11.817 INFO:tasks.workunit.client.0.smithi099.stdout:9/265: dwrite d0/d7/f23 [4194304,4194304] 0 2024-01-31T05:13:11.817 INFO:tasks.workunit.client.0.smithi099.stdout:9/266: fsync d0/d3e/f4c 0 2024-01-31T05:13:11.817 INFO:tasks.workunit.client.0.smithi099.stdout:9/267: chown d0/d7/f1f 101712192 1 2024-01-31T05:13:11.821 INFO:tasks.workunit.client.0.smithi099.stdout:9/268: truncate d0/d7/f4e 2738375 0 2024-01-31T05:13:11.825 INFO:tasks.workunit.client.0.smithi099.stdout:9/269: rmdir d0/d1/d24/d50 0 2024-01-31T05:13:11.825 INFO:tasks.workunit.client.0.smithi099.stdout:9/270: readlink d0/d7/l34 0 2024-01-31T05:13:11.825 INFO:tasks.workunit.client.0.smithi099.stdout:6/282: dwrite d14/d18/d1a/d1c/d29/f31 [0,4194304] 0 2024-01-31T05:13:11.827 INFO:tasks.workunit.client.0.smithi099.stdout:9/271: mkdir d0/d5d 0 2024-01-31T05:13:11.827 INFO:tasks.workunit.client.0.smithi099.stdout:9/272: stat d0/d7/f4e 0 2024-01-31T05:13:11.829 INFO:tasks.workunit.client.0.smithi099.stdout:6/283: unlink f10 0 2024-01-31T05:13:11.831 INFO:tasks.workunit.client.0.smithi099.stdout:9/273: mkdir d0/d1/d5e 0 2024-01-31T05:13:11.831 INFO:tasks.workunit.client.0.smithi099.stdout:9/274: creat d0/d3e/f5f x:0 0 0 2024-01-31T05:13:11.831 INFO:tasks.workunit.client.0.smithi099.stdout:9/275: stat d0/d1/d24/d2b/c20 0 2024-01-31T05:13:11.831 INFO:tasks.workunit.client.0.smithi099.stdout:9/276: write d0/d1/d24/d2b/f17 [1959704,84701] 0 2024-01-31T05:13:11.831 INFO:tasks.workunit.client.0.smithi099.stdout:9/277: truncate d0/d1/d24/f5a 405571 0 2024-01-31T05:13:11.831 INFO:tasks.workunit.client.0.smithi099.stdout:6/284: mknod d14/c51 0 2024-01-31T05:13:11.834 INFO:tasks.workunit.client.0.smithi099.stdout:9/278: creat d0/d1/d24/d2b/d59/f60 x:0 0 0 2024-01-31T05:13:11.836 INFO:tasks.workunit.client.0.smithi099.stdout:9/279: mknod d0/d1/d24/d2b/c61 0 2024-01-31T05:13:11.836 INFO:tasks.workunit.client.0.smithi099.stdout:9/280: creat d0/d1/d24/d2b/d59/f62 x:0 0 0 2024-01-31T05:13:11.836 INFO:tasks.workunit.client.0.smithi099.stdout:9/281: dread - d0/d1/d24/d48/f51 zero size 2024-01-31T05:13:11.842 INFO:tasks.workunit.client.0.smithi099.stdout:3/387: dwrite d10/d24/d40/f47 [0,4194304] 0 2024-01-31T05:13:11.842 INFO:tasks.workunit.client.0.smithi099.stdout:2/315: sync 2024-01-31T05:13:11.843 INFO:tasks.workunit.client.0.smithi099.stdout:8/405: dwrite d1/dd/d11/d20/f4c [0,4194304] 0 2024-01-31T05:13:11.844 INFO:tasks.workunit.client.0.smithi099.stdout:2/316: mknod d10/d1b/d4d/d5a/c6c 0 2024-01-31T05:13:11.845 INFO:tasks.workunit.client.0.smithi099.stdout:2/317: chown d10/d20/f50 432954400 1 2024-01-31T05:13:11.845 INFO:tasks.workunit.client.0.smithi099.stdout:2/318: write d10/f31 [2972955,59442] 0 2024-01-31T05:13:11.850 INFO:tasks.workunit.client.0.smithi099.stdout:8/406: unlink d1/dd/d11/d19/d21/d3c/f67 0 2024-01-31T05:13:11.851 INFO:tasks.workunit.client.0.smithi099.stdout:2/319: read d10/f2a [2164151,61945] 0 2024-01-31T05:13:11.851 INFO:tasks.workunit.client.0.smithi099.stdout:8/407: symlink d1/dd/d11/d19/d21/d3c/l7d 0 2024-01-31T05:13:11.853 INFO:tasks.workunit.client.0.smithi099.stdout:8/408: read d1/dd/d11/d19/f53 [578279,114258] 0 2024-01-31T05:13:11.854 INFO:tasks.workunit.client.0.smithi099.stdout:8/409: dread - d1/d71/f76 zero size 2024-01-31T05:13:11.854 INFO:tasks.workunit.client.0.smithi099.stdout:8/410: dread - d1/dd/d11/d19/f6d zero size 2024-01-31T05:13:11.854 INFO:tasks.workunit.client.0.smithi099.stdout:8/411: write d1/dd/d11/d19/d21/d3c/f7a [933266,8182] 0 2024-01-31T05:13:11.854 INFO:tasks.workunit.client.0.smithi099.stdout:8/412: chown d1/dd/d11/d29/f58 175 1 2024-01-31T05:13:11.855 INFO:tasks.workunit.client.0.smithi099.stdout:3/388: dread d10/d32/d85/f2c [4194304,4194304] 0 2024-01-31T05:13:11.856 INFO:tasks.workunit.client.0.smithi099.stdout:3/389: mkdir d10/d27/d34/d44/d60/d75/d8c/d92 0 2024-01-31T05:13:11.858 INFO:tasks.workunit.client.0.smithi099.stdout:9/282: dwrite d0/d44/f53 [0,4194304] 0 2024-01-31T05:13:11.859 INFO:tasks.workunit.client.0.smithi099.stdout:3/390: unlink d10/d32/c37 0 2024-01-31T05:13:11.865 INFO:tasks.workunit.client.0.smithi099.stdout:2/320: write d10/d1b/f59 [1804917,106836] 0 2024-01-31T05:13:11.865 INFO:tasks.workunit.client.0.smithi099.stdout:9/283: mkdir d0/d1/d24/d2b/d63 0 2024-01-31T05:13:11.867 INFO:tasks.workunit.client.0.smithi099.stdout:3/391: link d10/d27/d34/d52/c70 d10/d27/d34/d50/c93 0 2024-01-31T05:13:11.870 INFO:tasks.workunit.client.0.smithi099.stdout:9/284: link d0/d1/d24/d2b/d59/f60 d0/d1/d24/d48/f64 0 2024-01-31T05:13:11.871 INFO:tasks.workunit.client.0.smithi099.stdout:3/392: mknod d10/d32/d33/c94 0 2024-01-31T05:13:11.871 INFO:tasks.workunit.client.0.smithi099.stdout:3/393: fsync d10/d24/d40/f82 0 2024-01-31T05:13:11.874 INFO:tasks.workunit.client.0.smithi099.stdout:8/413: dwrite d1/dd/d11/d19/d21/f5c [0,4194304] 0 2024-01-31T05:13:11.877 INFO:tasks.workunit.client.0.smithi099.stdout:8/414: mknod d1/dd/d65/c7e 0 2024-01-31T05:13:11.877 INFO:tasks.workunit.client.0.smithi099.stdout:2/321: write d10/d20/f4c [3629977,11080] 0 2024-01-31T05:13:11.881 INFO:tasks.workunit.client.0.smithi099.stdout:2/322: unlink d10/d20/f3d 0 2024-01-31T05:13:11.882 INFO:tasks.workunit.client.0.smithi099.stdout:6/285: rename d14/d18/d1a/d1b to d14/d18/d52 0 2024-01-31T05:13:11.887 INFO:tasks.workunit.client.0.smithi099.stdout:6/286: rmdir d14/d18/d1a/d50 0 2024-01-31T05:13:11.898 INFO:tasks.workunit.client.0.smithi099.stdout:2/323: dread d10/d20/f68 [4194304,4194304] 0 2024-01-31T05:13:11.907 INFO:tasks.workunit.client.0.smithi099.stdout:9/285: dwrite d0/d3e/f5f [0,4194304] 0 2024-01-31T05:13:11.907 INFO:tasks.workunit.client.0.smithi099.stdout:9/286: write d0/d7/f1f [309283,125129] 0 2024-01-31T05:13:11.907 INFO:tasks.workunit.client.0.smithi099.stdout:8/415: dwrite d1/dd/d11/d20/f4b [0,4194304] 0 2024-01-31T05:13:11.909 INFO:tasks.workunit.client.0.smithi099.stdout:9/287: truncate d0/d3e/f4c 12138 0 2024-01-31T05:13:11.910 INFO:tasks.workunit.client.0.smithi099.stdout:2/324: link d10/d20/c3f d10/d1b/d6a/c6d 0 2024-01-31T05:13:11.910 INFO:tasks.workunit.client.0.smithi099.stdout:6/287: dwrite fc [0,4194304] 0 2024-01-31T05:13:11.912 INFO:tasks.workunit.client.0.smithi099.stdout:8/416: mkdir d1/dd/d65/d7f 0 2024-01-31T05:13:11.913 INFO:tasks.workunit.client.0.smithi099.stdout:9/288: mknod d0/d7/c65 0 2024-01-31T05:13:11.913 INFO:tasks.workunit.client.0.smithi099.stdout:9/289: creat d0/d7/f66 x:0 0 0 2024-01-31T05:13:11.914 INFO:tasks.workunit.client.0.smithi099.stdout:8/417: unlink d1/dd/d11/d19/d21/d3c/f7a 0 2024-01-31T05:13:11.915 INFO:tasks.workunit.client.0.smithi099.stdout:8/418: fsync d1/dd/d11/d20/f4b 0 2024-01-31T05:13:11.916 INFO:tasks.workunit.client.0.smithi099.stdout:8/419: symlink d1/dd/d11/d19/l80 0 2024-01-31T05:13:11.917 INFO:tasks.workunit.client.0.smithi099.stdout:6/288: creat d14/d18/d1a/d1c/d29/d4f/f53 x:0 0 0 2024-01-31T05:13:11.917 INFO:tasks.workunit.client.0.smithi099.stdout:8/420: mkdir d1/dd/d65/d7f/d81 0 2024-01-31T05:13:11.922 INFO:tasks.workunit.client.0.smithi099.stdout:6/289: rename d14/d18/d52/d46/c4b to d14/d18/d52/c54 0 2024-01-31T05:13:11.924 INFO:tasks.workunit.client.0.smithi099.stdout:8/421: rename d1/d71/f76 to d1/dd/d15/d2e/d69/f82 0 2024-01-31T05:13:11.925 INFO:tasks.workunit.client.0.smithi099.stdout:9/290: dread d0/d1/fe [0,4194304] 0 2024-01-31T05:13:11.926 INFO:tasks.workunit.client.0.smithi099.stdout:6/290: creat d14/d18/d1a/d1c/f55 x:0 0 0 2024-01-31T05:13:11.926 INFO:tasks.workunit.client.0.smithi099.stdout:9/291: mknod d0/d1/d24/d2b/d63/c67 0 2024-01-31T05:13:11.927 INFO:tasks.workunit.client.0.smithi099.stdout:6/291: write d14/d18/d1a/f45 [379600,22922] 0 2024-01-31T05:13:11.929 INFO:tasks.workunit.client.0.smithi099.stdout:6/292: mknod d14/c56 0 2024-01-31T05:13:11.931 INFO:tasks.workunit.client.0.smithi099.stdout:6/293: rename d14/d18/d1a/d1c/d29/d4f/f53 to d14/d18/d1a/d1c/d29/d4f/f57 0 2024-01-31T05:13:11.931 INFO:tasks.workunit.client.0.smithi099.stdout:6/294: mknod d14/d18/d1a/c58 0 2024-01-31T05:13:11.933 INFO:tasks.workunit.client.0.smithi099.stdout:6/295: creat d14/d18/d52/d22/f59 x:0 0 0 2024-01-31T05:13:11.934 INFO:tasks.workunit.client.0.smithi099.stdout:6/296: fsync d14/d18/d52/f47 0 2024-01-31T05:13:11.934 INFO:tasks.workunit.client.0.smithi099.stdout:6/297: chown d14/d18/d1a/f3e 499916770 1 2024-01-31T05:13:11.934 INFO:tasks.workunit.client.0.smithi099.stdout:6/298: write d14/d18/d1a/d1c/f55 [1029225,71959] 0 2024-01-31T05:13:11.934 INFO:tasks.workunit.client.0.smithi099.stdout:8/422: rename d1/d71 to d1/dd/d4f/d51/d83 0 2024-01-31T05:13:11.935 INFO:tasks.workunit.client.0.smithi099.stdout:2/325: dwrite d10/f2a [4194304,4194304] 0 2024-01-31T05:13:11.935 INFO:tasks.workunit.client.0.smithi099.stdout:2/326: write d10/d1c/f2d [4525891,81245] 0 2024-01-31T05:13:11.936 INFO:tasks.workunit.client.0.smithi099.stdout:8/423: getdents d1/dd/d11/d19 0 2024-01-31T05:13:11.937 INFO:tasks.workunit.client.0.smithi099.stdout:2/327: symlink d10/d1b/d4d/l6e 0 2024-01-31T05:13:11.938 INFO:tasks.workunit.client.0.smithi099.stdout:4/346: sync 2024-01-31T05:13:11.938 INFO:tasks.workunit.client.0.smithi099.stdout:4/347: chown d0/d2/d20/l7b 12072 1 2024-01-31T05:13:11.938 INFO:tasks.workunit.client.0.smithi099.stdout:2/328: creat d10/d1b/f6f x:0 0 0 2024-01-31T05:13:11.939 INFO:tasks.workunit.client.0.smithi099.stdout:6/299: truncate d14/d18/d1a/d1c/f55 977588 0 2024-01-31T05:13:11.941 INFO:tasks.workunit.client.0.smithi099.stdout:4/348: creat d0/d1e/d61/f7c x:0 0 0 2024-01-31T05:13:11.948 INFO:tasks.workunit.client.0.smithi099.stdout:2/329: dread d10/d1c/f26 [0,4194304] 0 2024-01-31T05:13:11.949 INFO:tasks.workunit.client.0.smithi099.stdout:2/330: creat d10/d3a/f70 x:0 0 0 2024-01-31T05:13:11.949 INFO:tasks.workunit.client.0.smithi099.stdout:2/331: fsync d10/d20/f68 0 2024-01-31T05:13:11.949 INFO:tasks.workunit.client.0.smithi099.stdout:2/332: chown lf 81 1 2024-01-31T05:13:11.950 INFO:tasks.workunit.client.0.smithi099.stdout:9/292: dwrite d0/d3e/f42 [0,4194304] 0 2024-01-31T05:13:11.950 INFO:tasks.workunit.client.0.smithi099.stdout:9/293: fdatasync d0/d3e/f42 0 2024-01-31T05:13:11.951 INFO:tasks.workunit.client.0.smithi099.stdout:9/294: creat d0/d7/f68 x:0 0 0 2024-01-31T05:13:11.951 INFO:tasks.workunit.client.0.smithi099.stdout:9/295: write d0/d3e/f4c [1014742,129540] 0 2024-01-31T05:13:11.951 INFO:tasks.workunit.client.0.smithi099.stdout:9/296: creat d0/d1/d24/f69 x:0 0 0 2024-01-31T05:13:11.953 INFO:tasks.workunit.client.0.smithi099.stdout:4/349: write d0/d8/f64 [905479,672] 0 2024-01-31T05:13:11.954 INFO:tasks.workunit.client.0.smithi099.stdout:9/297: rename d0/d7/f4e to d0/d1/d24/d48/f6a 0 2024-01-31T05:13:11.955 INFO:tasks.workunit.client.0.smithi099.stdout:9/298: dread - d0/d1/d24/d48/f64 zero size 2024-01-31T05:13:11.955 INFO:tasks.workunit.client.0.smithi099.stdout:9/299: read - d0/d7/f46 zero size 2024-01-31T05:13:11.956 INFO:tasks.workunit.client.0.smithi099.stdout:4/350: mkdir d0/d2/d20/d21/d17/d7d 0 2024-01-31T05:13:11.958 INFO:tasks.workunit.client.0.smithi099.stdout:4/351: creat d0/d2/d20/d21/d17/d24/d3f/d43/f7e x:0 0 0 2024-01-31T05:13:11.959 INFO:tasks.workunit.client.0.smithi099.stdout:4/352: rmdir d0/d2/d20/d21/d17/d3d 39 2024-01-31T05:13:11.961 INFO:tasks.workunit.client.0.smithi099.stdout:8/424: dwrite d1/dd/d11/d29/d3a/f54 [0,4194304] 0 2024-01-31T05:13:11.963 INFO:tasks.workunit.client.0.smithi099.stdout:8/425: mknod d1/dd/d15/c84 0 2024-01-31T05:13:11.963 INFO:tasks.workunit.client.0.smithi099.stdout:8/426: stat d1/dd/d11/d20/l26 0 2024-01-31T05:13:11.964 INFO:tasks.workunit.client.0.smithi099.stdout:8/427: unlink d1/dd/d11/d20/f3e 0 2024-01-31T05:13:11.965 INFO:tasks.workunit.client.0.smithi099.stdout:8/428: truncate d1/dd/f2b 661971 0 2024-01-31T05:13:11.965 INFO:tasks.workunit.client.0.smithi099.stdout:8/429: write d1/dd/d15/d2e/d69/f82 [163739,50474] 0 2024-01-31T05:13:11.966 INFO:tasks.workunit.client.0.smithi099.stdout:8/430: getdents d1/dd/d11 0 2024-01-31T05:13:11.966 INFO:tasks.workunit.client.0.smithi099.stdout:8/431: dread - d1/dd/d11/f68 zero size 2024-01-31T05:13:11.966 INFO:tasks.workunit.client.0.smithi099.stdout:8/432: stat d1 0 2024-01-31T05:13:11.967 INFO:tasks.workunit.client.0.smithi099.stdout:8/433: getdents d1/dd 0 2024-01-31T05:13:11.970 INFO:tasks.workunit.client.0.smithi099.stdout:6/300: link d14/d18/d52/l20 d14/d18/l5a 0 2024-01-31T05:13:11.970 INFO:tasks.workunit.client.0.smithi099.stdout:6/301: write f11 [4921067,86834] 0 2024-01-31T05:13:11.975 INFO:tasks.workunit.client.0.smithi099.stdout:4/353: dread d0/d2/d20/d21/d17/d24/f32 [0,4194304] 0 2024-01-31T05:13:11.976 INFO:tasks.workunit.client.0.smithi099.stdout:4/354: truncate d0/d2/d4b/f69 100408 0 2024-01-31T05:13:11.978 INFO:tasks.workunit.client.0.smithi099.stdout:4/355: mkdir d0/d2/d20/d21/d7f 0 2024-01-31T05:13:11.978 INFO:tasks.workunit.client.0.smithi099.stdout:4/356: chown d0/d74 1 1 2024-01-31T05:13:11.978 INFO:tasks.workunit.client.0.smithi099.stdout:4/357: read - d0/d2/d20/d21/d39/d66/f6c zero size 2024-01-31T05:13:11.981 INFO:tasks.workunit.client.0.smithi099.stdout:2/333: dwrite d10/f11 [0,4194304] 0 2024-01-31T05:13:11.984 INFO:tasks.workunit.client.0.smithi099.stdout:9/300: dwrite d0/d1/d24/d2b/d59/f60 [0,4194304] 0 2024-01-31T05:13:11.995 INFO:tasks.workunit.client.0.smithi099.stdout:6/302: rename d14/d18/d1a/d1c/d29/f41 to d14/d18/d3b/f5b 0 2024-01-31T05:13:11.995 INFO:tasks.workunit.client.0.smithi099.stdout:8/434: dwrite d1/dd/d11/d29/f58 [0,4194304] 0 2024-01-31T05:13:11.995 INFO:tasks.workunit.client.0.smithi099.stdout:8/435: readlink d1/l35 0 2024-01-31T05:13:11.999 INFO:tasks.workunit.client.0.smithi099.stdout:8/436: mkdir d1/dd/d7b/d85 0 2024-01-31T05:13:12.003 INFO:tasks.workunit.client.0.smithi099.stdout:8/437: creat d1/dd/d11/d29/d3f/f86 x:0 0 0 2024-01-31T05:13:12.004 INFO:tasks.workunit.client.0.smithi099.stdout:5/368: sync 2024-01-31T05:13:12.004 INFO:tasks.workunit.client.0.smithi099.stdout:5/369: truncate d6/da/d14/d3d/d6e/f4a 329286 0 2024-01-31T05:13:12.005 INFO:tasks.workunit.client.0.smithi099.stdout:8/438: truncate d1/dd/d11/d19/d21/d3c/f46 57878 0 2024-01-31T05:13:12.005 INFO:tasks.workunit.client.0.smithi099.stdout:8/439: chown d1/dd/d11/d19/f1f 1 1 2024-01-31T05:13:12.006 INFO:tasks.workunit.client.0.smithi099.stdout:5/370: getdents d6/da/d3f/d5a 0 2024-01-31T05:13:12.007 INFO:tasks.workunit.client.0.smithi099.stdout:8/440: dread d1/dd/d11/d29/d3f/d56/d57/f59 [0,4194304] 0 2024-01-31T05:13:12.007 INFO:tasks.workunit.client.0.smithi099.stdout:8/441: chown d1/dd/d15/d2e/c79 0 1 2024-01-31T05:13:12.009 INFO:tasks.workunit.client.0.smithi099.stdout:8/442: mknod d1/dd/d11/d29/c87 0 2024-01-31T05:13:12.010 INFO:tasks.workunit.client.0.smithi099.stdout:4/358: dwrite d0/d8/f64 [0,4194304] 0 2024-01-31T05:13:12.012 INFO:tasks.workunit.client.0.smithi099.stdout:6/303: dread fc [4194304,4194304] 0 2024-01-31T05:13:12.012 INFO:tasks.workunit.client.0.smithi099.stdout:4/359: mknod d0/d2/d20/d21/d59/c80 0 2024-01-31T05:13:12.012 INFO:tasks.workunit.client.0.smithi099.stdout:6/304: write d14/f16 [2446817,118797] 0 2024-01-31T05:13:12.017 INFO:tasks.workunit.client.0.smithi099.stdout:5/371: dread d6/ff [0,4194304] 0 2024-01-31T05:13:12.017 INFO:tasks.workunit.client.0.smithi099.stdout:5/372: chown d6/da/d14/d2b/f6a 1290 1 2024-01-31T05:13:12.017 INFO:tasks.workunit.client.0.smithi099.stdout:5/373: write d6/da/d3f/f4d [786685,13445] 0 2024-01-31T05:13:12.017 INFO:tasks.workunit.client.0.smithi099.stdout:5/374: write d6/d1e/f41 [448814,126163] 0 2024-01-31T05:13:12.018 INFO:tasks.workunit.client.0.smithi099.stdout:5/375: mknod d6/da/d14/d3d/d6e/c75 0 2024-01-31T05:13:12.020 INFO:tasks.workunit.client.0.smithi099.stdout:4/360: dread d0/d8/f11 [0,4194304] 0 2024-01-31T05:13:12.020 INFO:tasks.workunit.client.0.smithi099.stdout:4/361: readlink d0/d2/d20/l6e 0 2024-01-31T05:13:12.020 INFO:tasks.workunit.client.0.smithi099.stdout:4/362: symlink d0/d79/l81 0 2024-01-31T05:13:12.022 INFO:tasks.workunit.client.0.smithi099.stdout:4/363: mkdir d0/d2/d20/d21/d59/d82 0 2024-01-31T05:13:12.022 INFO:tasks.workunit.client.0.smithi099.stdout:4/364: chown d0/d2/d20/d21/d17/d24/d3f 152 1 2024-01-31T05:13:12.024 INFO:tasks.workunit.client.0.smithi099.stdout:9/301: dwrite d0/d1/d24/d2b/f17 [0,4194304] 0 2024-01-31T05:13:12.024 INFO:tasks.workunit.client.0.smithi099.stdout:9/302: readlink d0/d7/l32 0 2024-01-31T05:13:12.024 INFO:tasks.workunit.client.0.smithi099.stdout:9/303: truncate d0/d1/d24/d2b/d59/f62 798065 0 2024-01-31T05:13:12.024 INFO:tasks.workunit.client.0.smithi099.stdout:9/304: chown d0/d5d 0 1 2024-01-31T05:13:12.024 INFO:tasks.workunit.client.0.smithi099.stdout:2/334: dwrite d10/d1b/f59 [0,4194304] 0 2024-01-31T05:13:12.024 INFO:tasks.workunit.client.0.smithi099.stdout:2/335: stat d10/d1b/d4d/l6e 0 2024-01-31T05:13:12.024 INFO:tasks.workunit.client.0.smithi099.stdout:4/365: link d0/d8/d19/f2d d0/d8/d19/f83 0 2024-01-31T05:13:12.025 INFO:tasks.workunit.client.0.smithi099.stdout:9/305: truncate d0/d1/f1d 1990008 0 2024-01-31T05:13:12.031 INFO:tasks.workunit.client.0.smithi099.stdout:8/443: dread d1/dd/d11/d29/d3f/f48 [0,4194304] 0 2024-01-31T05:13:12.031 INFO:tasks.workunit.client.0.smithi099.stdout:8/444: getdents d1/dd 0 2024-01-31T05:13:12.031 INFO:tasks.workunit.client.0.smithi099.stdout:4/366: mkdir d0/d2/d20/d84 0 2024-01-31T05:13:12.031 INFO:tasks.workunit.client.0.smithi099.stdout:9/306: getdents d0/d3e/d33 0 2024-01-31T05:13:12.032 INFO:tasks.workunit.client.0.smithi099.stdout:8/445: creat d1/dd/d11/d29/d3f/d56/f88 x:0 0 0 2024-01-31T05:13:12.033 INFO:tasks.workunit.client.0.smithi099.stdout:8/446: readlink d1/dd/d11/d29/d3f/l4e 0 2024-01-31T05:13:12.033 INFO:tasks.workunit.client.0.smithi099.stdout:8/447: write d1/dd/d11/d29/d3f/d56/f88 [702304,8532] 0 2024-01-31T05:13:12.034 INFO:tasks.workunit.client.0.smithi099.stdout:9/307: link d0/d1/d24/c3d d0/d1/c6b 0 2024-01-31T05:13:12.034 INFO:tasks.workunit.client.0.smithi099.stdout:6/305: dread d14/d18/d3b/f42 [0,4194304] 0 2024-01-31T05:13:12.035 INFO:tasks.workunit.client.0.smithi099.stdout:6/306: chown d14/f15 28160 1 2024-01-31T05:13:12.036 INFO:tasks.workunit.client.0.smithi099.stdout:9/308: symlink d0/d1/d24/d2b/d63/l6c 0 2024-01-31T05:13:12.037 INFO:tasks.workunit.client.0.smithi099.stdout:6/307: symlink d14/d18/d52/l5c 0 2024-01-31T05:13:12.040 INFO:tasks.workunit.client.0.smithi099.stdout:2/336: read d10/d1b/f59 [2770210,12464] 0 2024-01-31T05:13:12.041 INFO:tasks.workunit.client.0.smithi099.stdout:2/337: mknod d10/d3a/c71 0 2024-01-31T05:13:12.045 INFO:tasks.workunit.client.0.smithi099.stdout:7/328: sync 2024-01-31T05:13:12.045 INFO:tasks.workunit.client.0.smithi099.stdout:0/339: sync 2024-01-31T05:13:12.045 INFO:tasks.workunit.client.0.smithi099.stdout:4/367: read d0/d2/f15 [1611758,54687] 0 2024-01-31T05:13:12.045 INFO:tasks.workunit.client.0.smithi099.stdout:4/368: readlink d0/d2/d20/l6e 0 2024-01-31T05:13:12.046 INFO:tasks.workunit.client.0.smithi099.stdout:5/376: dwrite d6/da/d14/d3d/d6e/f4a [0,4194304] 0 2024-01-31T05:13:12.046 INFO:tasks.workunit.client.0.smithi099.stdout:5/377: creat d6/d1e/f76 x:0 0 0 2024-01-31T05:13:12.046 INFO:tasks.workunit.client.0.smithi099.stdout:5/378: fdatasync d6/da/d14/d3d/d6e/f3a 0 2024-01-31T05:13:12.050 INFO:tasks.workunit.client.0.smithi099.stdout:0/340: unlink d1/d37/d4a/f5e 0 2024-01-31T05:13:12.050 INFO:tasks.workunit.client.0.smithi099.stdout:0/341: dread - d1/d64/f67 zero size 2024-01-31T05:13:12.050 INFO:tasks.workunit.client.0.smithi099.stdout:0/342: chown d1/d30/d45/d66/d2e/c54 12938726 1 2024-01-31T05:13:12.054 INFO:tasks.workunit.client.0.smithi099.stdout:7/329: dread d6/d32/d3d/d4b/f23 [0,4194304] 0 2024-01-31T05:13:12.057 INFO:tasks.workunit.client.0.smithi099.stdout:8/448: read d1/dd/d11/f31 [1469877,121496] 0 2024-01-31T05:13:12.057 INFO:tasks.workunit.client.0.smithi099.stdout:8/449: read - d1/dd/d15/f77 zero size 2024-01-31T05:13:12.060 INFO:tasks.workunit.client.0.smithi099.stdout:8/450: unlink d1/dd/d11/d19/d21/l5f 0 2024-01-31T05:13:12.062 INFO:tasks.workunit.client.0.smithi099.stdout:8/451: creat d1/dd/d11/d29/d3f/d56/d57/f89 x:0 0 0 2024-01-31T05:13:12.063 INFO:tasks.workunit.client.0.smithi099.stdout:8/452: creat d1/dd/d4f/d51/d83/f8a x:0 0 0 2024-01-31T05:13:12.064 INFO:tasks.workunit.client.0.smithi099.stdout:8/453: getdents d1/dd/d65/d7f 0 2024-01-31T05:13:12.064 INFO:tasks.workunit.client.0.smithi099.stdout:5/379: dread d6/f18 [0,4194304] 0 2024-01-31T05:13:12.065 INFO:tasks.workunit.client.0.smithi099.stdout:5/380: creat d6/da/d14/d2b/f77 x:0 0 0 2024-01-31T05:13:12.065 INFO:tasks.workunit.client.0.smithi099.stdout:8/454: symlink d1/dd/d65/l8b 0 2024-01-31T05:13:12.065 INFO:tasks.workunit.client.0.smithi099.stdout:5/381: read d6/d1e/f2c [981,64534] 0 2024-01-31T05:13:12.066 INFO:tasks.workunit.client.0.smithi099.stdout:6/308: dread d14/f16 [0,4194304] 0 2024-01-31T05:13:12.067 INFO:tasks.workunit.client.0.smithi099.stdout:8/455: mknod d1/dd/d11/d29/c8c 0 2024-01-31T05:13:12.067 INFO:tasks.workunit.client.0.smithi099.stdout:8/456: chown d1/dd/d4f/d51/f5d 411 1 2024-01-31T05:13:12.068 INFO:tasks.workunit.client.0.smithi099.stdout:4/369: dread d0/d8/d19/f83 [0,4194304] 0 2024-01-31T05:13:12.068 INFO:tasks.workunit.client.0.smithi099.stdout:0/343: dread d1/d37/f41 [0,4194304] 0 2024-01-31T05:13:12.068 INFO:tasks.workunit.client.0.smithi099.stdout:4/370: write d0/d2/d20/d21/d17/f25 [4760956,84091] 0 2024-01-31T05:13:12.068 INFO:tasks.workunit.client.0.smithi099.stdout:6/309: getdents d14/d18/d52/d22 0 2024-01-31T05:13:12.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mon-a[31611]: 2024-01-31T05:13:11.780+0000 7fcac313a700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-01-31T05:13:12.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:12.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:12.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:12.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001ff4 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/dev_sim_framework/kernel_space/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:12.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001ff8 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/dev_sim_framework/kernel_space/tmod.mod.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:12.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001ff5 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/dev_sim_framework/kernel_space/tmod.h) see mds.c log and `damage ls` output for details 2024-01-31T05:13:12.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001ff6 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/dev_sim_framework/kernel_space/str_mod.h) see mds.c log and `damage ls` output for details 2024-01-31T05:13:12.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x100000021ab (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/dev_sim_framework/kernel_space/load_tmod.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:12.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001ff7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/dev_sim_framework/kernel_space/tmod.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:12.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:12.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: pgmap v403: 97 pgs: 97 active+clean; 154 MiB data, 872 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 12 MiB/s wr, 2.21k op/s 2024-01-31T05:13:12.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:12.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001e42 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test10) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002051 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test20) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001e62 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test38) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001e67 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test24) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001e4c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test06) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001e48 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test17) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001e65 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test39) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001e44 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test13) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001e5d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test16) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001e56 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test29) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001e57 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test07) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001e4a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test19) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001e63 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test31) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001e41 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test33) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001e5b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test02) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001e61 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test35) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001e52 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/00_Descriptions.txt) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001e58 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test08) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001e50 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test21) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001e4e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test12) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001e55 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test09) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.071 INFO:tasks.workunit.client.0.smithi099.stdout:8/457: rename d1/dd/d11/d19/d21/d3c/l47 to d1/dd/d11/d19/d21/l8d 0 2024-01-31T05:13:12.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001e59 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test27) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001e60 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test36) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001e47 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test34) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001e53 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test11) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001e5f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test18) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001e49 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test28) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001e54 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test14) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001e43 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test22) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001e5e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test32) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001e5c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test07-2) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001e45 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test03) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001e51 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test30) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001e4f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test15) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001e5a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test37) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001e64 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test05) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001e4d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test04) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001e66 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test01) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001e46 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test23) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001e40 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test26) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001e4b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test25) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:12.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:12.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f19 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-nsec-timestamps/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:12.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001d5b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-nsec-timestamps/ext4_file_time.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:12.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001d5c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-nsec-timestamps/ext4_nsec_timestamps_test.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:12.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:12.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:12.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f94 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/disktest/man1/disktest.1) see mds.c log and `damage ls` output for details 2024-01-31T05:13:12.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000002184 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/disktest/man1/disktest.1.gz) see mds.c log and `damage ls` output for details 2024-01-31T05:13:12.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001f93 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/disktest/man1/disktest_manual.html) see mds.c log and `damage ls` output for details 2024-01-31T05:13:12.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:12.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:12.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x1000000218c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/aio/aio01/Makefile) see mds.a log and `damage ls` output for details 2024-01-31T05:13:12.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: Scrub error on inode 0x10000001fbc (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/aio/aio01/aio01.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:12.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:12.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:12.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:11 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:12.075 INFO:tasks.workunit.client.0.smithi099.stdout:0/344: creat d1/d30/d45/d6e/f74 x:0 0 0 2024-01-31T05:13:12.076 INFO:tasks.workunit.client.0.smithi099.stdout:4/371: symlink d0/d1e/d61/l85 0 2024-01-31T05:13:12.076 INFO:tasks.workunit.client.0.smithi099.stdout:4/372: write d0/d8/f64 [4758681,39819] 0 2024-01-31T05:13:12.076 INFO:tasks.workunit.client.0.smithi099.stdout:4/373: write d0/d8/f63 [2343980,28384] 0 2024-01-31T05:13:12.076 INFO:tasks.workunit.client.0.smithi099.stdout:2/338: dwrite d10/d1c/f26 [4194304,4194304] 0 2024-01-31T05:13:12.076 INFO:tasks.workunit.client.0.smithi099.stdout:2/339: write d10/d1c/f64 [448403,53895] 0 2024-01-31T05:13:12.076 INFO:tasks.workunit.client.0.smithi099.stdout:2/340: write d10/d20/f4c [1782169,77472] 0 2024-01-31T05:13:12.076 INFO:tasks.workunit.client.0.smithi099.stdout:2/341: chown d10/l22 153347 1 2024-01-31T05:13:12.076 INFO:tasks.workunit.client.0.smithi099.stdout:8/458: truncate d1/dd/d15/f3d 3977970 0 2024-01-31T05:13:12.076 INFO:tasks.workunit.client.0.smithi099.stdout:8/459: chown d1/dd/d11/d29/d3f/l4e 118 1 2024-01-31T05:13:12.076 INFO:tasks.workunit.client.0.smithi099.stdout:9/309: dwrite d0/d7/d2e/f43 [0,4194304] 0 2024-01-31T05:13:12.076 INFO:tasks.workunit.client.0.smithi099.stdout:0/345: chown d1/l39 232 1 2024-01-31T05:13:12.077 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:12.077 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:12.077 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:12.077 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001ff4 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/dev_sim_framework/kernel_space/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:12.077 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001ff8 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/dev_sim_framework/kernel_space/tmod.mod.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:12.077 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001ff5 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/dev_sim_framework/kernel_space/tmod.h) see mds.c log and `damage ls` output for details 2024-01-31T05:13:12.077 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001ff6 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/dev_sim_framework/kernel_space/str_mod.h) see mds.c log and `damage ls` output for details 2024-01-31T05:13:12.078 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x100000021ab (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/dev_sim_framework/kernel_space/load_tmod.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:12.078 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001ff7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/dev_sim_framework/kernel_space/tmod.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:12.078 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:12.078 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: pgmap v403: 97 pgs: 97 active+clean; 154 MiB data, 872 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 12 MiB/s wr, 2.21k op/s 2024-01-31T05:13:12.078 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:12.078 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001e42 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test10) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.078 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002051 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test20) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.078 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001e62 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test38) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.078 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001e67 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test24) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.078 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001e4c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test06) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.078 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001e48 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test17) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.078 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001e65 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test39) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.078 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001e44 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test13) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.078 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001e5d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test16) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.079 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001e56 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test29) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.079 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001e57 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test07) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.079 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001e4a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test19) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.079 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001e63 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test31) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.079 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001e41 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test33) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.079 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001e5b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test02) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.079 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001e61 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test35) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.079 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001e52 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/00_Descriptions.txt) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.079 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001e58 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test08) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.079 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001e50 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test21) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.079 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001e4e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test12) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.079 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001e55 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test09) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.079 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001e59 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test27) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.080 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001e60 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test36) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.080 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001e47 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test34) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.080 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001e53 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test11) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.080 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001e5f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test18) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.080 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001e49 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test28) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.080 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001e54 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test14) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.080 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001e43 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test22) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.080 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001e5e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test32) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.080 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001e5c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test07-2) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.080 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001e45 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test03) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.080 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001e51 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test30) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.080 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001e4f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test15) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.080 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001e5a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test37) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.080 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001e64 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test05) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.081 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001e4d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test04) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.081 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001e66 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test01) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.081 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001e46 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test23) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.081 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001e40 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test26) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.081 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001e4b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test25) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.081 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:12.081 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:12.081 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f19 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-nsec-timestamps/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:12.081 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001d5b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-nsec-timestamps/ext4_file_time.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:12.081 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001d5c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-nsec-timestamps/ext4_nsec_timestamps_test.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:12.081 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:12.081 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:12.081 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f94 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/disktest/man1/disktest.1) see mds.c log and `damage ls` output for details 2024-01-31T05:13:12.081 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000002184 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/disktest/man1/disktest.1.gz) see mds.c log and `damage ls` output for details 2024-01-31T05:13:12.082 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001f93 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/disktest/man1/disktest_manual.html) see mds.c log and `damage ls` output for details 2024-01-31T05:13:12.082 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:12.082 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:12.082 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x1000000218c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/aio/aio01/Makefile) see mds.a log and `damage ls` output for details 2024-01-31T05:13:12.082 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: Scrub error on inode 0x10000001fbc (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/aio/aio01/aio01.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:12.082 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:12.082 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:12.082 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:11 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:12.082 INFO:tasks.workunit.client.0.smithi099.stdout:5/382: dread d6/f3e [0,4194304] 0 2024-01-31T05:13:12.083 INFO:tasks.workunit.client.0.smithi099.stdout:8/460: symlink d1/l8e 0 2024-01-31T05:13:12.083 INFO:tasks.workunit.client.0.smithi099.stdout:7/330: dwrite d6/d12/f41 [0,4194304] 0 2024-01-31T05:13:12.085 INFO:tasks.workunit.client.0.smithi099.stdout:4/374: dread d0/d1e/f35 [0,4194304] 0 2024-01-31T05:13:12.085 INFO:tasks.workunit.client.0.smithi099.stdout:4/375: write d0/d2/d20/f38 [780131,38628] 0 2024-01-31T05:13:12.087 INFO:tasks.workunit.client.0.smithi099.stdout:9/310: mknod d0/d1/c6d 0 2024-01-31T05:13:12.088 INFO:tasks.workunit.client.0.smithi099.stdout:4/376: dread d0/f3 [0,4194304] 0 2024-01-31T05:13:12.088 INFO:tasks.workunit.client.0.smithi099.stdout:0/346: write d1/d16/f18 [2857263,98481] 0 2024-01-31T05:13:12.089 INFO:tasks.workunit.client.0.smithi099.stdout:5/383: mknod d6/da/d14/c78 0 2024-01-31T05:13:12.097 INFO:tasks.workunit.client.0.smithi099.stdout:9/311: mknod d0/d1/c6e 0 2024-01-31T05:13:12.100 INFO:tasks.workunit.client.0.smithi099.stdout:0/347: getdents d1/d16 0 2024-01-31T05:13:12.100 INFO:tasks.workunit.client.0.smithi099.stdout:0/348: readlink d1/d30/d45/d66/d2e/l43 0 2024-01-31T05:13:12.101 INFO:tasks.workunit.client.0.smithi099.stdout:5/384: mknod d6/da/d14/d3d/d51/c79 0 2024-01-31T05:13:12.103 INFO:tasks.workunit.client.0.smithi099.stdout:6/310: dwrite d14/d18/d1a/f3e [0,4194304] 0 2024-01-31T05:13:12.104 INFO:tasks.workunit.client.0.smithi099.stdout:7/331: symlink d6/l6e 0 2024-01-31T05:13:12.104 INFO:tasks.workunit.client.0.smithi099.stdout:7/332: fsync d6/d32/d3d/d4b/d33/d37/d50/d25/f4c 0 2024-01-31T05:13:12.104 INFO:tasks.workunit.client.0.smithi099.stdout:5/385: mknod d6/da/d14/d3d/c7a 0 2024-01-31T05:13:12.104 INFO:tasks.workunit.client.0.smithi099.stdout:5/386: truncate d6/da/d14/f3b 399443 0 2024-01-31T05:13:12.104 INFO:tasks.workunit.client.0.smithi099.stdout:6/311: write d14/f17 [2044238,421] 0 2024-01-31T05:13:12.105 INFO:tasks.workunit.client.0.smithi099.stdout:8/461: dwrite d1/dd/d11/d19/f53 [0,4194304] 0 2024-01-31T05:13:12.107 INFO:tasks.workunit.client.0.smithi099.stdout:5/387: mkdir d6/da/d14/d2b/d7b 0 2024-01-31T05:13:12.107 INFO:tasks.workunit.client.0.smithi099.stdout:5/388: chown d6/da/d14/d3d/d6e/d21 6 1 2024-01-31T05:13:12.108 INFO:tasks.workunit.client.0.smithi099.stdout:6/312: mknod d14/d18/d1a/d1c/d29/d43/c5d 0 2024-01-31T05:13:12.108 INFO:tasks.workunit.client.0.smithi099.stdout:6/313: mknod d14/d18/d52/d22/c5e 0 2024-01-31T05:13:12.108 INFO:tasks.workunit.client.0.smithi099.stdout:6/314: chown d14/d18/d1a/d1c/d29 1747950133 1 2024-01-31T05:13:12.110 INFO:tasks.workunit.client.0.smithi099.stdout:8/462: creat d1/dd/d4f/d6e/f8f x:0 0 0 2024-01-31T05:13:12.110 INFO:tasks.workunit.client.0.smithi099.stdout:8/463: creat d1/dd/d11/d29/d3f/d56/f90 x:0 0 0 2024-01-31T05:13:12.112 INFO:tasks.workunit.client.0.smithi099.stdout:5/389: symlink d6/d52/l7c 0 2024-01-31T05:13:12.116 INFO:tasks.workunit.client.0.smithi099.stdout:1/378: sync 2024-01-31T05:13:12.116 INFO:tasks.workunit.client.0.smithi099.stdout:3/394: sync 2024-01-31T05:13:12.116 INFO:tasks.workunit.client.0.smithi099.stdout:2/342: rmdir d10/d20 39 2024-01-31T05:13:12.116 INFO:tasks.workunit.client.0.smithi099.stdout:8/464: stat d1/dd/d15/d2e 0 2024-01-31T05:13:12.118 INFO:tasks.workunit.client.0.smithi099.stdout:7/333: dread d6/d32/f5b [0,4194304] 0 2024-01-31T05:13:12.118 INFO:tasks.workunit.client.0.smithi099.stdout:1/379: write d4/db/d3a/f60 [2701403,13146] 0 2024-01-31T05:13:12.118 INFO:tasks.workunit.client.0.smithi099.stdout:1/380: truncate d4/dc/d15/f32 5522835 0 2024-01-31T05:13:12.118 INFO:tasks.workunit.client.0.smithi099.stdout:5/390: mknod d6/da/d14/d3d/d57/c7d 0 2024-01-31T05:13:12.119 INFO:tasks.workunit.client.0.smithi099.stdout:2/343: link l9 d10/d2b/l72 0 2024-01-31T05:13:12.119 INFO:tasks.workunit.client.0.smithi099.stdout:2/344: chown d10/d1c/l62 3805 1 2024-01-31T05:13:12.122 INFO:tasks.workunit.client.0.smithi099.stdout:8/465: creat d1/dd/d65/d7f/f91 x:0 0 0 2024-01-31T05:13:12.124 INFO:tasks.workunit.client.0.smithi099.stdout:7/334: unlink d6/d12/f41 0 2024-01-31T05:13:12.124 INFO:tasks.workunit.client.0.smithi099.stdout:0/349: dwrite d1/d8/f5f [0,4194304] 0 2024-01-31T05:13:12.125 INFO:tasks.workunit.client.0.smithi099.stdout:9/312: dwrite d0/d1/d24/d2b/d59/f62 [0,4194304] 0 2024-01-31T05:13:12.125 INFO:tasks.workunit.client.0.smithi099.stdout:9/313: creat d0/d3e/f6f x:0 0 0 2024-01-31T05:13:12.125 INFO:tasks.workunit.client.0.smithi099.stdout:9/314: truncate d0/d1/d24/d48/f4b 18160 0 2024-01-31T05:13:12.125 INFO:tasks.workunit.client.0.smithi099.stdout:1/381: creat d4/dc/d15/f7a x:0 0 0 2024-01-31T05:13:12.128 INFO:tasks.workunit.client.0.smithi099.stdout:8/466: symlink d1/l92 0 2024-01-31T05:13:12.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:12.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:12.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:12.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001ff4 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/dev_sim_framework/kernel_space/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:12.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001ff8 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/dev_sim_framework/kernel_space/tmod.mod.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:12.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001ff5 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/dev_sim_framework/kernel_space/tmod.h) see mds.c log and `damage ls` output for details 2024-01-31T05:13:12.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001ff6 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/dev_sim_framework/kernel_space/str_mod.h) see mds.c log and `damage ls` output for details 2024-01-31T05:13:12.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x100000021ab (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/dev_sim_framework/kernel_space/load_tmod.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:12.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001ff7 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/dev_sim_framework/kernel_space/tmod.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:12.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:12.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: pgmap v403: 97 pgs: 97 active+clean; 154 MiB data, 872 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 12 MiB/s wr, 2.21k op/s 2024-01-31T05:13:12.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:12.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001e42 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test10) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002051 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test20) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001e62 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test38) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001e67 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test24) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001e4c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test06) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001e48 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test17) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.135 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001e65 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test39) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.135 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001e44 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test13) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.135 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001e5d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test16) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.135 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001e56 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test29) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.135 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001e57 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test07) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.135 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001e4a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test19) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.135 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001e63 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test31) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.135 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001e41 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test33) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.136 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001e5b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test02) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.136 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001e61 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test35) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.136 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001e52 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/00_Descriptions.txt) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.136 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001e58 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test08) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.136 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001e50 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test21) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.136 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001e4e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test12) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.136 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001e55 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test09) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.136 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001e59 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test27) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.136 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001e60 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test36) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.136 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001e47 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test34) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.136 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001e53 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test11) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.136 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001e5f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test18) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.136 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001e49 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test28) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.136 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001e54 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test14) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.137 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001e43 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test22) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.137 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001e5e (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test32) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.137 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001e5c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test07-2) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.137 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001e45 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test03) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.137 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001e51 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test30) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.137 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001e4f (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test15) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.137 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001e5a (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test37) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.137 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001e64 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test05) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.137 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001e4d (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test04) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.137 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001e66 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test01) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.137 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001e46 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test23) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.137 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001e40 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test26) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.137 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001e4b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test25) see mds.h log and `damage ls` output for details 2024-01-31T05:13:12.137 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:12.138 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:12.138 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f19 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-nsec-timestamps/Makefile) see mds.c log and `damage ls` output for details 2024-01-31T05:13:12.138 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001d5b (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-nsec-timestamps/ext4_file_time.c) see mds.c log and `damage ls` output for details 2024-01-31T05:13:12.138 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001d5c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-nsec-timestamps/ext4_nsec_timestamps_test.sh) see mds.c log and `damage ls` output for details 2024-01-31T05:13:12.138 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:12.138 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:12.138 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f94 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/disktest/man1/disktest.1) see mds.c log and `damage ls` output for details 2024-01-31T05:13:12.138 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000002184 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/disktest/man1/disktest.1.gz) see mds.c log and `damage ls` output for details 2024-01-31T05:13:12.138 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001f93 (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/disktest/man1/disktest_manual.html) see mds.c log and `damage ls` output for details 2024-01-31T05:13:12.138 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:12.138 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:12.138 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x1000000218c (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/aio/aio01/Makefile) see mds.a log and `damage ls` output for details 2024-01-31T05:13:12.138 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: Scrub error on inode 0x10000001fbc (/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/aio/aio01/aio01.c) see mds.a log and `damage ls` output for details 2024-01-31T05:13:12.138 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:12.138 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:12.139 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:11 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:12.140 INFO:tasks.workunit.client.0.smithi099.stdout:1/382: creat d4/df/f7b x:0 0 0 2024-01-31T05:13:12.141 INFO:tasks.workunit.client.0.smithi099.stdout:3/395: rename d10/d32/d33/d4a to d10/d27/d34/d44/d95 0 2024-01-31T05:13:12.142 INFO:tasks.workunit.client.0.smithi099.stdout:5/391: rmdir d6/d52 39 2024-01-31T05:13:12.143 INFO:tasks.workunit.client.0.smithi099.stdout:0/350: rmdir d1/d30/d45/d6e 39 2024-01-31T05:13:12.146 INFO:tasks.workunit.client.0.smithi099.stdout:9/315: getdents d0/d7 0 2024-01-31T05:13:12.146 INFO:tasks.workunit.client.0.smithi099.stdout:9/316: truncate d0/d1/d24/d48/f51 46542 0 2024-01-31T05:13:12.146 INFO:tasks.workunit.client.0.smithi099.stdout:3/396: creat d10/d72/f96 x:0 0 0 2024-01-31T05:13:12.146 INFO:tasks.workunit.client.0.smithi099.stdout:9/317: chown d0/d3e/d33/c57 1454 1 2024-01-31T05:13:12.146 INFO:tasks.workunit.client.0.smithi099.stdout:9/318: chown d0/d1/d24/d48/f6a 441724 1 2024-01-31T05:13:12.146 INFO:tasks.workunit.client.0.smithi099.stdout:3/397: read - d10/f66 zero size 2024-01-31T05:13:12.147 INFO:tasks.workunit.client.0.smithi099.stdout:3/398: mknod d10/d27/d34/d44/d95/c97 0 2024-01-31T05:13:12.148 INFO:tasks.workunit.client.0.smithi099.stdout:3/399: mknod d10/d32/d33/c98 0 2024-01-31T05:13:12.150 INFO:tasks.workunit.client.0.smithi099.stdout:3/400: getdents d10/d27/d34 0 2024-01-31T05:13:12.150 INFO:tasks.workunit.client.0.smithi099.stdout:3/401: chown d10/d32/d33/l8b 833 1 2024-01-31T05:13:12.151 INFO:tasks.workunit.client.0.smithi099.stdout:3/402: truncate d10/d32/d85/f1d 3959367 0 2024-01-31T05:13:12.156 INFO:tasks.workunit.client.0.smithi099.stdout:9/319: write d0/d1/d24/d2b/f1b [1130679,77376] 0 2024-01-31T05:13:12.157 INFO:tasks.workunit.client.0.smithi099.stdout:7/335: dwrite d6/d32/d3d/d4b/d33/d37/d4e/f68 [0,4194304] 0 2024-01-31T05:13:12.157 INFO:tasks.workunit.client.0.smithi099.stdout:6/315: link d14/f17 d14/d18/d1a/d1c/f5f 0 2024-01-31T05:13:12.158 INFO:tasks.workunit.client.0.smithi099.stdout:6/316: dread - d14/d18/d1a/d1c/d29/f32 zero size 2024-01-31T05:13:12.159 INFO:tasks.workunit.client.0.smithi099.stdout:9/320: dread d0/d3e/f4c [0,4194304] 0 2024-01-31T05:13:12.163 INFO:tasks.workunit.client.0.smithi099.stdout:7/336: link d6/f69 d6/f6f 0 2024-01-31T05:13:12.164 INFO:tasks.workunit.client.0.smithi099.stdout:7/337: symlink d6/d32/d3d/d4b/l70 0 2024-01-31T05:13:12.165 INFO:tasks.workunit.client.0.smithi099.stdout:3/403: dread d10/d27/f49 [0,4194304] 0 2024-01-31T05:13:12.165 INFO:tasks.workunit.client.0.smithi099.stdout:7/338: creat d6/d32/d3d/d4b/d33/f71 x:0 0 0 2024-01-31T05:13:12.166 INFO:tasks.workunit.client.0.smithi099.stdout:3/404: creat d10/d24/f99 x:0 0 0 2024-01-31T05:13:12.166 INFO:tasks.workunit.client.0.smithi099.stdout:1/383: dwrite d4/db/d24/d4b/f79 [0,4194304] 0 2024-01-31T05:13:12.167 INFO:tasks.workunit.client.0.smithi099.stdout:7/339: truncate d6/d32/d3d/d4b/f1b 3823057 0 2024-01-31T05:13:12.167 INFO:tasks.workunit.client.0.smithi099.stdout:7/340: fsync d6/d32/d3d/d4b/d33/d37/d4e/f55 0 2024-01-31T05:13:12.168 INFO:tasks.workunit.client.0.smithi099.stdout:1/384: creat d4/dc/d29/f7c x:0 0 0 2024-01-31T05:13:12.170 INFO:tasks.workunit.client.0.smithi099.stdout:7/341: mkdir d6/d32/d3d/d4b/d33/d37/d50/d25/d72 0 2024-01-31T05:13:12.170 INFO:tasks.workunit.client.0.smithi099.stdout:9/321: rmdir d0/d3e 39 2024-01-31T05:13:12.170 INFO:tasks.workunit.client.0.smithi099.stdout:9/322: chown d0/d3e/d33/l58 83950009 1 2024-01-31T05:13:12.170 INFO:tasks.workunit.client.0.smithi099.stdout:9/323: write d0/d7/d2e/f43 [5070601,27238] 0 2024-01-31T05:13:12.171 INFO:tasks.workunit.client.0.smithi099.stdout:1/385: truncate d4/df/f34 446959 0 2024-01-31T05:13:12.174 INFO:tasks.workunit.client.0.smithi099.stdout:9/324: write d0/d1/d24/f5a [69032,55943] 0 2024-01-31T05:13:12.179 INFO:tasks.workunit.client.0.smithi099.stdout:1/386: dread d4/df/d37/f54 [0,4194304] 0 2024-01-31T05:13:12.179 INFO:tasks.workunit.client.0.smithi099.stdout:1/387: creat d4/df/f7d x:0 0 0 2024-01-31T05:13:12.179 INFO:tasks.workunit.client.0.smithi099.stdout:1/388: readlink d4/dc/l49 0 2024-01-31T05:13:12.182 INFO:tasks.workunit.client.0.smithi099.stdout:1/389: mkdir d4/db/d3a/d7e 0 2024-01-31T05:13:12.188 INFO:tasks.workunit.client.0.smithi099.stdout:9/325: write d0/d1/d24/d2b/d59/f62 [279936,20814] 0 2024-01-31T05:13:12.188 INFO:tasks.workunit.client.0.smithi099.stdout:9/326: creat d0/d1/d24/d2b/d59/f70 x:0 0 0 2024-01-31T05:13:12.189 INFO:tasks.workunit.client.0.smithi099.stdout:1/390: link d4/dc/d15/f1a d4/dc/d4d/d5d/f7f 0 2024-01-31T05:13:12.190 INFO:tasks.workunit.client.0.smithi099.stdout:1/391: truncate d4/df/d37/d56/f75 1003703 0 2024-01-31T05:13:12.190 INFO:tasks.workunit.client.0.smithi099.stdout:1/392: stat d4/df/d37/c71 0 2024-01-31T05:13:12.190 INFO:tasks.workunit.client.0.smithi099.stdout:1/393: truncate d4/dc/d48/f31 1377818 0 2024-01-31T05:13:12.192 INFO:tasks.workunit.client.0.smithi099.stdout:2/345: rename d10/f2a to d10/d1b/f73 0 2024-01-31T05:13:12.192 INFO:tasks.workunit.client.0.smithi099.stdout:7/342: dwrite d6/f52 [0,4194304] 0 2024-01-31T05:13:12.193 INFO:tasks.workunit.client.0.smithi099.stdout:1/394: symlink d4/df/d37/l80 0 2024-01-31T05:13:12.194 INFO:tasks.workunit.client.0.smithi099.stdout:0/351: rename d1/d16/d36/l3c to d1/d22/l75 0 2024-01-31T05:13:12.196 INFO:tasks.workunit.client.0.smithi099.stdout:6/317: rename d14/d18/d52/d22/l25 to d14/d18/d52/d46/l60 0 2024-01-31T05:13:12.204 INFO:tasks.workunit.client.0.smithi099.stdout:3/405: rename d10/d24/d40/f59 to d10/d27/d89/f9a 0 2024-01-31T05:13:12.204 INFO:tasks.workunit.client.0.smithi099.stdout:3/406: chown d10/c6d 926 1 2024-01-31T05:13:12.206 INFO:tasks.workunit.client.0.smithi099.stdout:0/352: getdents d1/d8 0 2024-01-31T05:13:12.206 INFO:tasks.workunit.client.0.smithi099.stdout:0/353: fdatasync d1/d8/f61 0 2024-01-31T05:13:12.206 INFO:tasks.workunit.client.0.smithi099.stdout:0/354: read - d1/d22/f55 zero size 2024-01-31T05:13:12.207 INFO:tasks.workunit.client.0.smithi099.stdout:3/407: symlink d10/d27/d34/d44/d60/d75/d8c/l9b 0 2024-01-31T05:13:12.209 INFO:tasks.workunit.client.0.smithi099.stdout:7/343: dread d6/d32/f5b [0,4194304] 0 2024-01-31T05:13:12.209 INFO:tasks.workunit.client.0.smithi099.stdout:7/344: write d6/d32/d3d/d4b/d33/d37/f40 [5160648,14148] 0 2024-01-31T05:13:12.211 INFO:tasks.workunit.client.0.smithi099.stdout:7/345: rename d6/d32/f63 to d6/d12/f73 0 2024-01-31T05:13:12.213 INFO:tasks.workunit.client.0.smithi099.stdout:9/327: dwrite d0/d7/f68 [0,4194304] 0 2024-01-31T05:13:12.217 INFO:tasks.workunit.client.0.smithi099.stdout:4/377: sync 2024-01-31T05:13:12.217 INFO:tasks.workunit.client.0.smithi099.stdout:4/378: write d0/f3 [858551,90589] 0 2024-01-31T05:13:12.217 INFO:tasks.workunit.client.0.smithi099.stdout:4/379: write d0/d2/f15 [4142864,44938] 0 2024-01-31T05:13:12.218 INFO:tasks.workunit.client.0.smithi099.stdout:2/346: write d10/d1c/f2d [966702,31888] 0 2024-01-31T05:13:12.218 INFO:tasks.workunit.client.0.smithi099.stdout:2/347: stat d10/d3a/f70 0 2024-01-31T05:13:12.222 INFO:tasks.workunit.client.0.smithi099.stdout:7/346: getdents d6/d32 0 2024-01-31T05:13:12.224 INFO:tasks.workunit.client.0.smithi099.stdout:2/348: creat d10/d1c/f74 x:0 0 0 2024-01-31T05:13:12.226 INFO:tasks.workunit.client.0.smithi099.stdout:0/355: write d1/d8/f3f [1539059,120337] 0 2024-01-31T05:13:12.226 INFO:tasks.workunit.client.0.smithi099.stdout:7/347: creat d6/d32/d3d/d4b/d33/d37/d4e/f74 x:0 0 0 2024-01-31T05:13:12.226 INFO:tasks.workunit.client.0.smithi099.stdout:7/348: write d6/d32/d3d/d4b/d33/d37/d4e/f62 [800623,48299] 0 2024-01-31T05:13:12.226 INFO:tasks.workunit.client.0.smithi099.stdout:1/395: dwrite d4/dc/d29/f36 [0,4194304] 0 2024-01-31T05:13:12.228 INFO:tasks.workunit.client.0.smithi099.stdout:4/380: dread d0/d2/d20/d21/d17/d24/f32 [0,4194304] 0 2024-01-31T05:13:12.230 INFO:tasks.workunit.client.0.smithi099.stdout:6/318: dread d14/f40 [0,4194304] 0 2024-01-31T05:13:12.233 INFO:tasks.workunit.client.0.smithi099.stdout:0/356: truncate d1/d37/f41 970308 0 2024-01-31T05:13:12.233 INFO:tasks.workunit.client.0.smithi099.stdout:0/357: write d1/d64/f67 [857469,114223] 0 2024-01-31T05:13:12.233 INFO:tasks.workunit.client.0.smithi099.stdout:0/358: chown d1/d16/d36 6479074 1 2024-01-31T05:13:12.235 INFO:tasks.workunit.client.0.smithi099.stdout:0/359: mknod d1/d30/d45/d66/d2e/c76 0 2024-01-31T05:13:12.240 INFO:tasks.workunit.client.0.smithi099.stdout:7/349: dread d6/d32/d3d/d4b/d33/f5a [0,4194304] 0 2024-01-31T05:13:12.242 INFO:tasks.workunit.client.0.smithi099.stdout:1/396: dread d4/dc/d15/f20 [0,4194304] 0 2024-01-31T05:13:12.242 INFO:tasks.workunit.client.0.smithi099.stdout:1/397: fsync d4/dc/d48/f5f 0 2024-01-31T05:13:12.242 INFO:tasks.workunit.client.0.smithi099.stdout:1/398: readlink d4/db/d12/l47 0 2024-01-31T05:13:12.244 INFO:tasks.workunit.client.0.smithi099.stdout:2/349: dread f4 [0,4194304] 0 2024-01-31T05:13:12.244 INFO:tasks.workunit.client.0.smithi099.stdout:7/350: unlink d6/d32/d3d/d4b/d33/d37/d4e/f68 0 2024-01-31T05:13:12.245 INFO:tasks.workunit.client.0.smithi099.stdout:1/399: symlink d4/df/d37/l81 0 2024-01-31T05:13:12.246 INFO:tasks.workunit.client.0.smithi099.stdout:2/350: symlink d10/d1b/d4d/d5a/l75 0 2024-01-31T05:13:12.246 INFO:tasks.workunit.client.0.smithi099.stdout:0/360: dread d1/f4 [0,4194304] 0 2024-01-31T05:13:12.246 INFO:tasks.workunit.client.0.smithi099.stdout:0/361: dread - d1/d22/f55 zero size 2024-01-31T05:13:12.254 INFO:tasks.workunit.client.0.smithi099.stdout:9/328: dwrite d0/d7/f23 [4194304,4194304] 0 2024-01-31T05:13:12.254 INFO:tasks.workunit.client.0.smithi099.stdout:9/329: creat d0/d7/d2e/f71 x:0 0 0 2024-01-31T05:13:12.256 INFO:tasks.workunit.client.0.smithi099.stdout:4/381: dwrite d0/d8/f64 [4194304,4194304] 0 2024-01-31T05:13:12.256 INFO:tasks.workunit.client.0.smithi099.stdout:3/408: dwrite d10/d32/f4e [0,4194304] 0 2024-01-31T05:13:12.258 INFO:tasks.workunit.client.0.smithi099.stdout:9/330: unlink d0/d44/c56 0 2024-01-31T05:13:12.258 INFO:tasks.workunit.client.0.smithi099.stdout:9/331: write d0/d7/f13 [870735,14884] 0 2024-01-31T05:13:12.262 INFO:tasks.workunit.client.0.smithi099.stdout:2/351: dread d10/f31 [0,4194304] 0 2024-01-31T05:13:12.262 INFO:tasks.workunit.client.0.smithi099.stdout:3/409: link d10/f66 d10/d72/f9c 0 2024-01-31T05:13:12.262 INFO:tasks.workunit.client.0.smithi099.stdout:3/410: write d10/d32/d33/d51/f67 [1149331,127165] 0 2024-01-31T05:13:12.262 INFO:tasks.workunit.client.0.smithi099.stdout:3/411: creat d10/f9d x:0 0 0 2024-01-31T05:13:12.263 INFO:tasks.workunit.client.0.smithi099.stdout:9/332: mkdir d0/d1/d5e/d72 0 2024-01-31T05:13:12.263 INFO:tasks.workunit.client.0.smithi099.stdout:9/333: write d0/d7/fa [2382452,129640] 0 2024-01-31T05:13:12.263 INFO:tasks.workunit.client.0.smithi099.stdout:2/352: truncate d10/d1c/f39 107169 0 2024-01-31T05:13:12.266 INFO:tasks.workunit.client.0.smithi099.stdout:7/351: dwrite d6/f6f [0,4194304] 0 2024-01-31T05:13:12.267 INFO:tasks.workunit.client.0.smithi099.stdout:3/412: creat d10/d27/d34/d44/d60/d75/f9e x:0 0 0 2024-01-31T05:13:12.267 INFO:tasks.workunit.client.0.smithi099.stdout:3/413: fsync d10/d1e/f25 0 2024-01-31T05:13:12.270 INFO:tasks.workunit.client.0.smithi099.stdout:9/334: link d0/d7/c65 d0/d44/c73 0 2024-01-31T05:13:12.271 INFO:tasks.workunit.client.0.smithi099.stdout:2/353: symlink d10/d3a/d69/l76 0 2024-01-31T05:13:12.272 INFO:tasks.workunit.client.0.smithi099.stdout:5/392: sync 2024-01-31T05:13:12.272 INFO:tasks.workunit.client.0.smithi099.stdout:8/467: sync 2024-01-31T05:13:12.273 INFO:tasks.workunit.client.0.smithi099.stdout:2/354: symlink d10/d20/d5b/l77 0 2024-01-31T05:13:12.279 INFO:tasks.workunit.client.0.smithi099.stdout:3/414: creat d10/d27/d34/d44/d60/d75/d8c/f9f x:0 0 0 2024-01-31T05:13:12.279 INFO:tasks.workunit.client.0.smithi099.stdout:5/393: unlink d6/da/d14/f24 0 2024-01-31T05:13:12.279 INFO:tasks.workunit.client.0.smithi099.stdout:5/394: write d6/f3e [81954,61172] 0 2024-01-31T05:13:12.279 INFO:tasks.workunit.client.0.smithi099.stdout:8/468: rename d1/dd/d11/d19/d21/l4a to d1/dd/d15/l93 0 2024-01-31T05:13:12.281 INFO:tasks.workunit.client.0.smithi099.stdout:2/355: truncate f1 1835023 0 2024-01-31T05:13:12.281 INFO:tasks.workunit.client.0.smithi099.stdout:2/356: creat d10/d1c/f78 x:0 0 0 2024-01-31T05:13:12.289 INFO:tasks.workunit.client.0.smithi099.stdout:5/395: link d6/da/d14/d3d/d6e/l5e d6/da/d14/d3d/d6e/l7e 0 2024-01-31T05:13:12.289 INFO:tasks.workunit.client.0.smithi099.stdout:8/469: creat d1/dd/d11/d29/d3a/f94 x:0 0 0 2024-01-31T05:13:12.290 INFO:tasks.workunit.client.0.smithi099.stdout:8/470: write d1/dd/d11/f31 [4976519,80699] 0 2024-01-31T05:13:12.290 INFO:tasks.workunit.client.0.smithi099.stdout:8/471: write d1/dd/d11/d29/d3a/f54 [4499868,104565] 0 2024-01-31T05:13:12.291 INFO:tasks.workunit.client.0.smithi099.stdout:5/396: symlink d6/da/d3f/d73/l7f 0 2024-01-31T05:13:12.292 INFO:tasks.workunit.client.0.smithi099.stdout:8/472: mknod d1/dd/d4f/d51/d83/c95 0 2024-01-31T05:13:12.294 INFO:tasks.workunit.client.0.smithi099.stdout:7/352: dwrite d6/d32/d3d/d4b/d33/d37/d50/d4d/d58/f67 [0,4194304] 0 2024-01-31T05:13:12.297 INFO:tasks.workunit.client.0.smithi099.stdout:9/335: dwrite d0/d7/f13 [4194304,4194304] 0 2024-01-31T05:13:12.300 INFO:tasks.workunit.client.0.smithi099.stdout:7/353: mknod d6/d32/c75 0 2024-01-31T05:13:12.302 INFO:tasks.workunit.client.0.smithi099.stdout:9/336: creat d0/d1/d24/d2b/d63/f74 x:0 0 0 2024-01-31T05:13:12.302 INFO:tasks.workunit.client.0.smithi099.stdout:9/337: readlink d0/d7/l32 0 2024-01-31T05:13:12.303 INFO:tasks.workunit.client.0.smithi099.stdout:7/354: mknod d6/d32/c76 0 2024-01-31T05:13:12.303 INFO:tasks.workunit.client.0.smithi099.stdout:2/357: dwrite d10/d1b/f73 [8388608,4194304] 0 2024-01-31T05:13:12.303 INFO:tasks.workunit.client.0.smithi099.stdout:9/338: truncate d0/d3e/f40 978395 0 2024-01-31T05:13:12.304 INFO:tasks.workunit.client.0.smithi099.stdout:7/355: mknod d6/d32/d3d/d46/c77 0 2024-01-31T05:13:12.304 INFO:tasks.workunit.client.0.smithi099.stdout:2/358: mknod d10/d1b/d4d/d5a/c79 0 2024-01-31T05:13:12.305 INFO:tasks.workunit.client.0.smithi099.stdout:9/339: getdents d0/d1 0 2024-01-31T05:13:12.310 INFO:tasks.workunit.client.0.smithi099.stdout:7/356: write d6/d32/d3d/d4b/d33/d37/f40 [4262860,100158] 0 2024-01-31T05:13:12.312 INFO:tasks.workunit.client.0.smithi099.stdout:7/357: unlink d6/f11 0 2024-01-31T05:13:12.313 INFO:tasks.workunit.client.0.smithi099.stdout:5/397: write d6/da/d14/d3d/d6e/f4a [551265,60442] 0 2024-01-31T05:13:12.314 INFO:tasks.workunit.client.0.smithi099.stdout:7/358: mknod d6/d32/d3d/d4b/d33/d37/d50/d4d/c78 0 2024-01-31T05:13:12.315 INFO:tasks.workunit.client.0.smithi099.stdout:9/340: dread d0/d1/d24/d48/f6a [0,4194304] 0 2024-01-31T05:13:12.315 INFO:tasks.workunit.client.0.smithi099.stdout:9/341: readlink d0/d7/l32 0 2024-01-31T05:13:12.315 INFO:tasks.workunit.client.0.smithi099.stdout:9/342: chown d0/d1/d24/l4d 515079920 1 2024-01-31T05:13:12.316 INFO:tasks.workunit.client.0.smithi099.stdout:5/398: unlink d6/d1e/f3c 0 2024-01-31T05:13:12.318 INFO:tasks.workunit.client.0.smithi099.stdout:8/473: dwrite d1/dd/d11/d19/f1f [0,4194304] 0 2024-01-31T05:13:12.318 INFO:tasks.workunit.client.0.smithi099.stdout:8/474: write d1/f10 [2468327,85732] 0 2024-01-31T05:13:12.318 INFO:tasks.workunit.client.0.smithi099.stdout:8/475: creat d1/dd/d11/d29/d3f/d56/d57/f96 x:0 0 0 2024-01-31T05:13:12.318 INFO:tasks.workunit.client.0.smithi099.stdout:8/476: creat d1/dd/d11/d20/f97 x:0 0 0 2024-01-31T05:13:12.318 INFO:tasks.workunit.client.0.smithi099.stdout:5/399: unlink d6/da/d14/d3d/d6e/c75 0 2024-01-31T05:13:12.319 INFO:tasks.workunit.client.0.smithi099.stdout:9/343: dread d0/d1/f1d [0,4194304] 0 2024-01-31T05:13:12.320 INFO:tasks.workunit.client.0.smithi099.stdout:9/344: creat d0/d1/d24/f75 x:0 0 0 2024-01-31T05:13:12.324 INFO:tasks.workunit.client.0.smithi099.stdout:8/477: creat d1/dd/d15/d2e/f98 x:0 0 0 2024-01-31T05:13:12.326 INFO:tasks.workunit.client.0.smithi099.stdout:5/400: rename d6/da/d14/d3d/d6e/d21/l49 to d6/da/d14/l80 0 2024-01-31T05:13:12.326 INFO:tasks.workunit.client.0.smithi099.stdout:5/401: write d6/da/d14/d3d/d6e/f3a [687453,36162] 0 2024-01-31T05:13:12.327 INFO:tasks.workunit.client.0.smithi099.stdout:2/359: dwrite d10/d1b/f23 [0,4194304] 0 2024-01-31T05:13:12.330 INFO:tasks.workunit.client.0.smithi099.stdout:9/345: rename d0/d1/d24/d2b/c38 to d0/d7/c76 0 2024-01-31T05:13:12.336 INFO:tasks.workunit.client.0.smithi099.stdout:5/402: rename d6/d52 to d6/da/d3f/d5a/d81 0 2024-01-31T05:13:12.337 INFO:tasks.workunit.client.0.smithi099.stdout:9/346: symlink d0/d1/d5e/l77 0 2024-01-31T05:13:12.338 INFO:tasks.workunit.client.0.smithi099.stdout:2/360: dread d10/d20/f4c [0,4194304] 0 2024-01-31T05:13:12.338 INFO:tasks.workunit.client.0.smithi099.stdout:2/361: chown d10/d1c/c30 4287 1 2024-01-31T05:13:12.338 INFO:tasks.workunit.client.0.smithi099.stdout:2/362: dread - d10/d3a/f52 zero size 2024-01-31T05:13:12.341 INFO:tasks.workunit.client.0.smithi099.stdout:9/347: mknod d0/d1/d5e/c78 0 2024-01-31T05:13:12.343 INFO:tasks.workunit.client.0.smithi099.stdout:7/359: dwrite d6/f6f [0,4194304] 0 2024-01-31T05:13:12.343 INFO:tasks.workunit.client.0.smithi099.stdout:7/360: write d6/d32/d3d/d4b/d33/f36 [1174816,1198] 0 2024-01-31T05:13:12.343 INFO:tasks.workunit.client.0.smithi099.stdout:7/361: stat d6/d32/d3d/d4b/l70 0 2024-01-31T05:13:12.343 INFO:tasks.workunit.client.0.smithi099.stdout:7/362: chown d6/d32/d3d/d4b/d33/d37/d50/l48 3 1 2024-01-31T05:13:12.346 INFO:tasks.workunit.client.0.smithi099.stdout:9/348: creat d0/d5d/f79 x:0 0 0 2024-01-31T05:13:12.346 INFO:tasks.workunit.client.0.smithi099.stdout:9/349: dread - d0/d1/d24/f69 zero size 2024-01-31T05:13:12.348 INFO:tasks.workunit.client.0.smithi099.stdout:8/478: dwrite d1/dd/d11/d19/f53 [0,4194304] 0 2024-01-31T05:13:12.349 INFO:tasks.workunit.client.0.smithi099.stdout:7/363: mkdir d6/d32/d3d/d4b/d33/d37/d50/d25/d79 0 2024-01-31T05:13:12.351 INFO:tasks.workunit.client.0.smithi099.stdout:5/403: rename d6/d1e to d6/da/d14/d3d/d51/d82 0 2024-01-31T05:13:12.351 INFO:tasks.workunit.client.0.smithi099.stdout:5/404: write d6/da/d14/d3d/d51/d82/f41 [1216957,47523] 0 2024-01-31T05:13:12.351 INFO:tasks.workunit.client.0.smithi099.stdout:5/405: write d6/f6d [432608,28778] 0 2024-01-31T05:13:12.352 INFO:tasks.workunit.client.0.smithi099.stdout:8/479: symlink d1/dd/d11/l99 0 2024-01-31T05:13:12.353 INFO:tasks.workunit.client.0.smithi099.stdout:7/364: mkdir d6/d32/d3d/d4b/d33/d37/d50/d25/d7a 0 2024-01-31T05:13:12.356 INFO:tasks.workunit.client.0.smithi099.stdout:5/406: rename d6/da/l16 to d6/da/d14/d2b/l83 0 2024-01-31T05:13:12.356 INFO:tasks.workunit.client.0.smithi099.stdout:8/480: rmdir d1/dd/d65 39 2024-01-31T05:13:12.359 INFO:tasks.workunit.client.0.smithi099.stdout:7/365: mkdir d6/d32/d3d/d4b/d33/d37/d50/d7b 0 2024-01-31T05:13:12.361 INFO:tasks.workunit.client.0.smithi099.stdout:2/363: dwrite d10/d2b/f5c [0,4194304] 0 2024-01-31T05:13:12.374 INFO:tasks.workunit.client.0.smithi099.stdout:2/364: dread d10/f42 [0,4194304] 0 2024-01-31T05:13:12.376 INFO:tasks.workunit.client.0.smithi099.stdout:2/365: mkdir d10/d1b/d6a/d7a 0 2024-01-31T05:13:12.381 INFO:tasks.workunit.client.0.smithi099.stdout:8/481: dwrite d1/dd/d11/d29/d3f/f86 [0,4194304] 0 2024-01-31T05:13:12.381 INFO:tasks.workunit.client.0.smithi099.stdout:5/407: dwrite d6/f18 [0,4194304] 0 2024-01-31T05:13:12.381 INFO:tasks.workunit.client.0.smithi099.stdout:5/408: readlink d6/da/d34/l62 0 2024-01-31T05:13:12.381 INFO:tasks.workunit.client.0.smithi099.stdout:5/409: dread - d6/da/f4f zero size 2024-01-31T05:13:12.381 INFO:tasks.workunit.client.0.smithi099.stdout:5/410: fsync d6/da/f56 0 2024-01-31T05:13:12.381 INFO:tasks.workunit.client.0.smithi099.stdout:5/411: creat d6/da/d14/d61/f84 x:0 0 0 2024-01-31T05:13:12.383 INFO:tasks.workunit.client.0.smithi099.stdout:7/366: rmdir d6/d32/d3d/d4b/d33 39 2024-01-31T05:13:12.384 INFO:tasks.workunit.client.0.smithi099.stdout:8/482: creat d1/dd/d1d/f9a x:0 0 0 2024-01-31T05:13:12.397 INFO:tasks.workunit.client.0.smithi099.stdout:0/362: sync 2024-01-31T05:13:12.397 INFO:tasks.workunit.client.0.smithi099.stdout:6/319: sync 2024-01-31T05:13:12.397 INFO:tasks.workunit.client.0.smithi099.stdout:1/400: sync 2024-01-31T05:13:12.398 INFO:tasks.workunit.client.0.smithi099.stdout:0/363: fdatasync d1/d30/d45/d6e/f74 0 2024-01-31T05:13:12.399 INFO:tasks.workunit.client.0.smithi099.stdout:0/364: stat d1/d22/c53 0 2024-01-31T05:13:12.400 INFO:tasks.workunit.client.0.smithi099.stdout:1/401: mknod d4/db/d24/d69/c82 0 2024-01-31T05:13:12.401 INFO:tasks.workunit.client.0.smithi099.stdout:1/402: truncate d4/dc/d15/f5a 236033 0 2024-01-31T05:13:12.402 INFO:tasks.workunit.client.0.smithi099.stdout:0/365: mknod d1/d56/c77 0 2024-01-31T05:13:12.402 INFO:tasks.workunit.client.0.smithi099.stdout:0/366: getdents d1/d8 0 2024-01-31T05:13:12.403 INFO:tasks.workunit.client.0.smithi099.stdout:0/367: truncate d1/d30/d45/d6e/f74 32686 0 2024-01-31T05:13:12.403 INFO:tasks.workunit.client.0.smithi099.stdout:0/368: creat d1/d64/f78 x:0 0 0 2024-01-31T05:13:12.403 INFO:tasks.workunit.client.0.smithi099.stdout:0/369: dread - d1/d64/f78 zero size 2024-01-31T05:13:12.403 INFO:tasks.workunit.client.0.smithi099.stdout:0/370: fsync d1/d16/d36/f3e 0 2024-01-31T05:13:12.403 INFO:tasks.workunit.client.0.smithi099.stdout:0/371: chown d1/d16/d36/f3d 81 1 2024-01-31T05:13:12.403 INFO:tasks.workunit.client.0.smithi099.stdout:1/403: mkdir d4/df/d37/d56/d83 0 2024-01-31T05:13:12.404 INFO:tasks.workunit.client.0.smithi099.stdout:2/366: dwrite d10/d51/f54 [0,4194304] 0 2024-01-31T05:13:12.405 INFO:tasks.workunit.client.0.smithi099.stdout:0/372: mknod d1/d56/c79 0 2024-01-31T05:13:12.405 INFO:tasks.workunit.client.0.smithi099.stdout:2/367: symlink d10/d20/d5b/l7b 0 2024-01-31T05:13:12.410 INFO:tasks.workunit.client.0.smithi099.stdout:0/373: rename d1/d30/d45/d66/d2e to d1/d37/d4a/d7a 0 2024-01-31T05:13:12.410 INFO:tasks.workunit.client.0.smithi099.stdout:0/374: write d1/d8/f65 [409601,37633] 0 2024-01-31T05:13:12.411 INFO:tasks.workunit.client.0.smithi099.stdout:2/368: stat d10/d1b/d4d/d5a/l67 0 2024-01-31T05:13:12.411 INFO:tasks.workunit.client.0.smithi099.stdout:7/367: dwrite d6/f52 [0,4194304] 0 2024-01-31T05:13:12.412 INFO:tasks.workunit.client.0.smithi099.stdout:0/375: mkdir d1/d37/d4a/d7b 0 2024-01-31T05:13:12.413 INFO:tasks.workunit.client.0.smithi099.stdout:5/412: dwrite d6/da/d14/d3d/f53 [4194304,4194304] 0 2024-01-31T05:13:12.416 INFO:tasks.workunit.client.0.smithi099.stdout:0/376: creat d1/d16/d36/f7c x:0 0 0 2024-01-31T05:13:12.419 INFO:tasks.workunit.client.0.smithi099.stdout:5/413: creat d6/da/d14/d3d/d6e/f85 x:0 0 0 2024-01-31T05:13:12.421 INFO:tasks.workunit.client.0.smithi099.stdout:8/483: dwrite d1/dd/d11/f68 [0,4194304] 0 2024-01-31T05:13:12.422 INFO:tasks.workunit.client.0.smithi099.stdout:0/377: unlink d1/d16/c60 0 2024-01-31T05:13:12.429 INFO:tasks.workunit.client.0.smithi099.stdout:6/320: dwrite fa [0,4194304] 0 2024-01-31T05:13:12.434 INFO:tasks.workunit.client.0.smithi099.stdout:8/484: symlink d1/dd/l9b 0 2024-01-31T05:13:12.434 INFO:tasks.workunit.client.0.smithi099.stdout:8/485: truncate d1/dd/d11/d29/d3f/d56/f90 587150 0 2024-01-31T05:13:12.436 INFO:tasks.workunit.client.0.smithi099.stdout:0/378: mkdir d1/d37/d4a/d7a/d7d 0 2024-01-31T05:13:12.436 INFO:tasks.workunit.client.0.smithi099.stdout:0/379: fdatasync d1/d30/d45/d66/f6d 0 2024-01-31T05:13:12.436 INFO:tasks.workunit.client.0.smithi099.stdout:1/404: dwrite d4/f6b [0,4194304] 0 2024-01-31T05:13:12.439 INFO:tasks.workunit.client.0.smithi099.stdout:6/321: mknod d14/d18/d52/c61 0 2024-01-31T05:13:12.439 INFO:tasks.workunit.client.0.smithi099.stdout:6/322: readlink d14/d18/l21 0 2024-01-31T05:13:12.439 INFO:tasks.workunit.client.0.smithi099.stdout:6/323: write d14/d18/d1a/d1c/f44 [667078,16376] 0 2024-01-31T05:13:12.439 INFO:tasks.workunit.client.0.smithi099.stdout:8/486: link d1/dd/d11/d19/d21/d3c/c42 d1/dd/d4f/d51/c9c 0 2024-01-31T05:13:12.442 INFO:tasks.workunit.client.0.smithi099.stdout:8/487: rename d1/dd/d11/d29/d3a/f94 to d1/dd/d11/d19/f9d 0 2024-01-31T05:13:12.444 INFO:tasks.workunit.client.0.smithi099.stdout:0/380: read d1/d16/d36/f3e [710237,83284] 0 2024-01-31T05:13:12.444 INFO:tasks.workunit.client.0.smithi099.stdout:1/405: dread d4/df/f34 [0,4194304] 0 2024-01-31T05:13:12.444 INFO:tasks.workunit.client.0.smithi099.stdout:1/406: fdatasync d4/dc/f43 0 2024-01-31T05:13:12.445 INFO:tasks.workunit.client.0.smithi099.stdout:0/381: creat d1/d37/d73/f7e x:0 0 0 2024-01-31T05:13:12.448 INFO:tasks.workunit.client.0.smithi099.stdout:0/382: link d1/d30/d45/d66/f5b d1/d64/f7f 0 2024-01-31T05:13:12.451 INFO:tasks.workunit.client.0.smithi099.stdout:6/324: dread fa [0,4194304] 0 2024-01-31T05:13:12.451 INFO:tasks.workunit.client.0.smithi099.stdout:1/407: dread d4/dc/d48/f2f [0,4194304] 0 2024-01-31T05:13:12.452 INFO:tasks.workunit.client.0.smithi099.stdout:4/382: sync 2024-01-31T05:13:12.453 INFO:tasks.workunit.client.0.smithi099.stdout:6/325: stat d14/d18/d1a/d1c/l36 0 2024-01-31T05:13:12.453 INFO:tasks.workunit.client.0.smithi099.stdout:2/369: dwrite d10/d2b/f5c [0,4194304] 0 2024-01-31T05:13:12.453 INFO:tasks.workunit.client.0.smithi099.stdout:2/370: chown d10/d1c/l62 214 1 2024-01-31T05:13:12.453 INFO:tasks.workunit.client.0.smithi099.stdout:7/368: dwrite d6/d32/f34 [0,4194304] 0 2024-01-31T05:13:12.454 INFO:tasks.workunit.client.0.smithi099.stdout:1/408: symlink d4/db/d12/d74/l84 0 2024-01-31T05:13:12.456 INFO:tasks.workunit.client.0.smithi099.stdout:6/326: rename d14/d18/d1a/d1c/l33 to d14/d18/d1a/d1c/d29/d43/l62 0 2024-01-31T05:13:12.456 INFO:tasks.workunit.client.0.smithi099.stdout:4/383: rmdir d0/d2/d20/d21/d17/d24/d5a 39 2024-01-31T05:13:12.456 INFO:tasks.workunit.client.0.smithi099.stdout:4/384: truncate d0/d2/d20/d21/d17/d3d/f6a 505540 0 2024-01-31T05:13:12.456 INFO:tasks.workunit.client.0.smithi099.stdout:4/385: stat d0/d79 0 2024-01-31T05:13:12.456 INFO:tasks.workunit.client.0.smithi099.stdout:4/386: truncate d0/f5b 9403 0 2024-01-31T05:13:12.457 INFO:tasks.workunit.client.0.smithi099.stdout:6/327: mknod d14/d18/d1a/d1c/d29/d4f/c63 0 2024-01-31T05:13:12.458 INFO:tasks.workunit.client.0.smithi099.stdout:2/371: mkdir d10/d2b/d7c 0 2024-01-31T05:13:12.461 INFO:tasks.workunit.client.0.smithi099.stdout:2/372: rename d10/d1b/d6a to d10/d1b/d7d 0 2024-01-31T05:13:12.462 INFO:tasks.workunit.client.0.smithi099.stdout:1/409: mkdir d4/db/d3a/d7e/d85 0 2024-01-31T05:13:12.462 INFO:tasks.workunit.client.0.smithi099.stdout:4/387: mkdir d0/d2/d20/d21/d86 0 2024-01-31T05:13:12.464 INFO:tasks.workunit.client.0.smithi099.stdout:4/388: truncate d0/d8/d19/f2d 3929937 0 2024-01-31T05:13:12.464 INFO:tasks.workunit.client.0.smithi099.stdout:7/369: write d6/d32/f5b [3867913,4528] 0 2024-01-31T05:13:12.464 INFO:tasks.workunit.client.0.smithi099.stdout:5/414: dwrite d6/fd [0,4194304] 0 2024-01-31T05:13:12.466 INFO:tasks.workunit.client.0.smithi099.stdout:2/373: mknod d10/c7e 0 2024-01-31T05:13:12.466 INFO:tasks.workunit.client.0.smithi099.stdout:2/374: fsync d10/f42 0 2024-01-31T05:13:12.471 INFO:tasks.workunit.client.0.smithi099.stdout:6/328: dread fc [0,4194304] 0 2024-01-31T05:13:12.472 INFO:tasks.workunit.client.0.smithi099.stdout:6/329: truncate d14/d18/d1a/d1c/f44 387146 0 2024-01-31T05:13:12.472 INFO:tasks.workunit.client.0.smithi099.stdout:6/330: fdatasync d14/d18/d3b/f42 0 2024-01-31T05:13:12.472 INFO:tasks.workunit.client.0.smithi099.stdout:4/389: rename d0/d8/c2a to d0/c87 0 2024-01-31T05:13:12.476 INFO:tasks.workunit.client.0.smithi099.stdout:4/390: rename d0/d8/d19/l4a to d0/d2/d20/d21/d39/d66/l88 0 2024-01-31T05:13:12.476 INFO:tasks.workunit.client.0.smithi099.stdout:4/391: chown d0/f5b 10 1 2024-01-31T05:13:12.476 INFO:tasks.workunit.client.0.smithi099.stdout:6/331: mknod d14/d18/d1a/d1c/c64 0 2024-01-31T05:13:12.477 INFO:tasks.workunit.client.0.smithi099.stdout:0/383: dwrite d1/d8/f65 [0,4194304] 0 2024-01-31T05:13:12.477 INFO:tasks.workunit.client.0.smithi099.stdout:2/375: dread f4 [0,4194304] 0 2024-01-31T05:13:12.477 INFO:tasks.workunit.client.0.smithi099.stdout:2/376: stat d10/d2b/f5c 0 2024-01-31T05:13:12.481 INFO:tasks.workunit.client.0.smithi099.stdout:0/384: rmdir d1 39 2024-01-31T05:13:12.484 INFO:tasks.workunit.client.0.smithi099.stdout:0/385: creat d1/f80 x:0 0 0 2024-01-31T05:13:12.487 INFO:tasks.workunit.client.0.smithi099.stdout:2/377: mknod d10/d20/c7f 0 2024-01-31T05:13:12.487 INFO:tasks.workunit.client.0.smithi099.stdout:2/378: chown d10/f15 932 1 2024-01-31T05:13:12.487 INFO:tasks.workunit.client.0.smithi099.stdout:2/379: fdatasync d10/f33 0 2024-01-31T05:13:12.501 INFO:tasks.workunit.client.0.smithi099.stdout:7/370: dwrite d6/d32/d3d/d4b/d33/d37/d4e/f74 [0,4194304] 0 2024-01-31T05:13:12.501 INFO:tasks.workunit.client.0.smithi099.stdout:1/410: dwrite d4/dc/d4d/d5d/f7f [4194304,4194304] 0 2024-01-31T05:13:12.501 INFO:tasks.workunit.client.0.smithi099.stdout:1/411: write d4/dc/d55/f72 [809965,15014] 0 2024-01-31T05:13:12.501 INFO:tasks.workunit.client.0.smithi099.stdout:6/332: dwrite d14/d18/d3b/f5b [4194304,4194304] 0 2024-01-31T05:13:12.501 INFO:tasks.workunit.client.0.smithi099.stdout:1/412: chown d4/dc/l49 64 1 2024-01-31T05:13:12.501 INFO:tasks.workunit.client.0.smithi099.stdout:6/333: write d14/d18/d1a/d1c/f44 [773565,22652] 0 2024-01-31T05:13:12.502 INFO:tasks.workunit.client.0.smithi099.stdout:6/334: creat d14/d18/d52/d22/f65 x:0 0 0 2024-01-31T05:13:12.504 INFO:tasks.workunit.client.0.smithi099.stdout:3/415: sync 2024-01-31T05:13:12.504 INFO:tasks.workunit.client.0.smithi099.stdout:9/350: sync 2024-01-31T05:13:12.504 INFO:tasks.workunit.client.0.smithi099.stdout:3/416: fsync d10/d32/d85/f2c 0 2024-01-31T05:13:12.504 INFO:tasks.workunit.client.0.smithi099.stdout:9/351: creat d0/d1/d24/d48/f7a x:0 0 0 2024-01-31T05:13:12.504 INFO:tasks.workunit.client.0.smithi099.stdout:9/352: truncate d0/d1/d24/d48/f4b 772753 0 2024-01-31T05:13:12.505 INFO:tasks.workunit.client.0.smithi099.stdout:7/371: getdents d6/d32/d3d/d4b/d33/d37 0 2024-01-31T05:13:12.505 INFO:tasks.workunit.client.0.smithi099.stdout:5/415: dwrite d6/da/d14/d3d/d51/d82/f69 [0,4194304] 0 2024-01-31T05:13:12.508 INFO:tasks.workunit.client.0.smithi099.stdout:1/413: link d4/dc/d48/c42 d4/dc/d44/c86 0 2024-01-31T05:13:12.508 INFO:tasks.workunit.client.0.smithi099.stdout:1/414: chown d4/db/d3a/d7e 20 1 2024-01-31T05:13:12.508 INFO:tasks.workunit.client.0.smithi099.stdout:1/415: dread - d4/df/f7d zero size 2024-01-31T05:13:12.510 INFO:tasks.workunit.client.0.smithi099.stdout:6/335: mkdir d14/d18/d1a/d66 0 2024-01-31T05:13:12.510 INFO:tasks.workunit.client.0.smithi099.stdout:9/353: mkdir d0/d1/d24/d2b/d7b 0 2024-01-31T05:13:12.512 INFO:tasks.workunit.client.0.smithi099.stdout:7/372: dread d6/ff [0,4194304] 0 2024-01-31T05:13:12.517 INFO:tasks.workunit.client.0.smithi099.stdout:5/416: rename d6/da/c4b to d6/da/d14/d2b/d7b/c86 0 2024-01-31T05:13:12.517 INFO:tasks.workunit.client.0.smithi099.stdout:6/336: getdents d14/d18 0 2024-01-31T05:13:12.519 INFO:tasks.workunit.client.0.smithi099.stdout:6/337: creat d14/d18/d52/f67 x:0 0 0 2024-01-31T05:13:12.519 INFO:tasks.workunit.client.0.smithi099.stdout:6/338: write d14/d18/d1a/f3e [4758465,64971] 0 2024-01-31T05:13:12.519 INFO:tasks.workunit.client.0.smithi099.stdout:6/339: truncate d14/d18/d1a/d1c/d29/f32 138853 0 2024-01-31T05:13:12.521 INFO:tasks.workunit.client.0.smithi099.stdout:6/340: getdents d14/d18/d1a/d1c/d29/d4f 0 2024-01-31T05:13:12.521 INFO:tasks.workunit.client.0.smithi099.stdout:6/341: chown d14/d18/d1a/d1c/d29/d4f 549 1 2024-01-31T05:13:12.521 INFO:tasks.workunit.client.0.smithi099.stdout:6/342: truncate d14/d18/d1a/f37 1255456 0 2024-01-31T05:13:12.523 INFO:tasks.workunit.client.0.smithi099.stdout:4/392: dwrite d0/d8/d19/f2d [4194304,4194304] 0 2024-01-31T05:13:12.523 INFO:tasks.workunit.client.0.smithi099.stdout:4/393: write d0/d1e/d61/f7c [508489,61091] 0 2024-01-31T05:13:12.523 INFO:tasks.workunit.client.0.smithi099.stdout:4/394: fsync d0/d8/f11 0 2024-01-31T05:13:12.523 INFO:tasks.workunit.client.0.smithi099.stdout:0/386: dwrite d1/d16/d36/f68 [0,4194304] 0 2024-01-31T05:13:12.523 INFO:tasks.workunit.client.0.smithi099.stdout:0/387: write d1/d8/f3f [3230819,97426] 0 2024-01-31T05:13:12.523 INFO:tasks.workunit.client.0.smithi099.stdout:1/416: rename d4/df/d37 to d4/dc/d4d/d5d/d87 0 2024-01-31T05:13:12.525 INFO:tasks.workunit.client.0.smithi099.stdout:2/380: getdents d10/d1b 0 2024-01-31T05:13:12.526 INFO:tasks.workunit.client.0.smithi099.stdout:3/417: dread d10/d32/d85/f22 [0,4194304] 0 2024-01-31T05:13:12.526 INFO:tasks.workunit.client.0.smithi099.stdout:4/395: mknod d0/d2/d20/d21/d39/d66/c89 0 2024-01-31T05:13:12.527 INFO:tasks.workunit.client.0.smithi099.stdout:3/418: write d10/d27/d34/d44/d60/f83 [1036157,112603] 0 2024-01-31T05:13:12.527 INFO:tasks.workunit.client.0.smithi099.stdout:2/381: symlink d10/d1b/d4d/l80 0 2024-01-31T05:13:12.527 INFO:tasks.workunit.client.0.smithi099.stdout:2/382: write d10/d20/f50 [762983,18684] 0 2024-01-31T05:13:12.527 INFO:tasks.workunit.client.0.smithi099.stdout:2/383: chown d10/d1b/d4d/l6e 80 1 2024-01-31T05:13:12.528 INFO:tasks.workunit.client.0.smithi099.stdout:2/384: stat d10/d20/f40 0 2024-01-31T05:13:12.528 INFO:tasks.workunit.client.0.smithi099.stdout:2/385: chown d10/d2b/l36 436 1 2024-01-31T05:13:12.528 INFO:tasks.workunit.client.0.smithi099.stdout:2/386: chown d10/d2b/l72 152 1 2024-01-31T05:13:12.529 INFO:tasks.workunit.client.0.smithi099.stdout:0/388: symlink d1/d37/d4a/d7a/l81 0 2024-01-31T05:13:12.529 INFO:tasks.workunit.client.0.smithi099.stdout:0/389: chown d1/f48 13484 1 2024-01-31T05:13:12.529 INFO:tasks.workunit.client.0.smithi099.stdout:0/390: truncate d1/d64/f67 1915593 0 2024-01-31T05:13:12.532 INFO:tasks.workunit.client.0.smithi099.stdout:4/396: creat d0/d8/d19/d54/f8a x:0 0 0 2024-01-31T05:13:12.532 INFO:tasks.workunit.client.0.smithi099.stdout:4/397: stat d0/d2/d20/d21/d17/d7d 0 2024-01-31T05:13:12.534 INFO:tasks.workunit.client.0.smithi099.stdout:5/417: dread d6/f10 [0,4194304] 0 2024-01-31T05:13:12.535 INFO:tasks.workunit.client.0.smithi099.stdout:5/418: dread d6/da/d14/d61/f64 [0,4194304] 0 2024-01-31T05:13:12.535 INFO:tasks.workunit.client.0.smithi099.stdout:0/391: link d1/d16/f5a d1/d64/f82 0 2024-01-31T05:13:12.536 INFO:tasks.workunit.client.0.smithi099.stdout:1/417: getdents d4/dc/d55 0 2024-01-31T05:13:12.538 INFO:tasks.workunit.client.0.smithi099.stdout:9/354: dwrite d0/d1/d24/d48/f64 [0,4194304] 0 2024-01-31T05:13:12.538 INFO:tasks.workunit.client.0.smithi099.stdout:1/418: unlink d4/db/d24/d4b/c6a 0 2024-01-31T05:13:12.538 INFO:tasks.workunit.client.0.smithi099.stdout:1/419: readlink d4/dc/d29/l2e 0 2024-01-31T05:13:12.538 INFO:tasks.workunit.client.0.smithi099.stdout:4/398: unlink d0/fd 0 2024-01-31T05:13:12.540 INFO:tasks.workunit.client.0.smithi099.stdout:3/419: link d10/d27/f29 d10/d27/d34/d52/fa0 0 2024-01-31T05:13:12.540 INFO:tasks.workunit.client.0.smithi099.stdout:3/420: read d10/d27/d34/d44/d95/f7e [3652047,29755] 0 2024-01-31T05:13:12.541 INFO:tasks.workunit.client.0.smithi099.stdout:7/373: dwrite d6/d32/f5b [4194304,4194304] 0 2024-01-31T05:13:12.541 INFO:tasks.workunit.client.0.smithi099.stdout:5/419: truncate d6/da/d14/d3d/d6e/f42 3207182 0 2024-01-31T05:13:12.544 INFO:tasks.workunit.client.0.smithi099.stdout:2/387: creat d10/d1b/f81 x:0 0 0 2024-01-31T05:13:12.544 INFO:tasks.workunit.client.0.smithi099.stdout:2/388: stat d10/d2b/d7c 0 2024-01-31T05:13:12.545 INFO:tasks.workunit.client.0.smithi099.stdout:9/355: rename d0/c55 to d0/d1/d24/c7c 0 2024-01-31T05:13:12.545 INFO:tasks.workunit.client.0.smithi099.stdout:5/420: dread d6/f6d [0,4194304] 0 2024-01-31T05:13:12.546 INFO:tasks.workunit.client.0.smithi099.stdout:1/420: rmdir d4/db/d3a 39 2024-01-31T05:13:12.546 INFO:tasks.workunit.client.0.smithi099.stdout:1/421: chown d4/db/d24/f2b 540637 1 2024-01-31T05:13:12.547 INFO:tasks.workunit.client.0.smithi099.stdout:3/421: link d10/d24/d40/l45 d10/d27/d34/d44/la1 0 2024-01-31T05:13:12.549 INFO:tasks.workunit.client.0.smithi099.stdout:7/374: creat d6/d32/d3d/f7c x:0 0 0 2024-01-31T05:13:12.551 INFO:tasks.workunit.client.0.smithi099.stdout:0/392: rmdir d1/d37/d4a 39 2024-01-31T05:13:12.551 INFO:tasks.workunit.client.0.smithi099.stdout:0/393: creat d1/d22/f83 x:0 0 0 2024-01-31T05:13:12.551 INFO:tasks.workunit.client.0.smithi099.stdout:0/394: write d1/f48 [4675990,34151] 0 2024-01-31T05:13:12.551 INFO:tasks.workunit.client.0.smithi099.stdout:0/395: fsync d1/f20 0 2024-01-31T05:13:12.551 INFO:tasks.workunit.client.0.smithi099.stdout:0/396: readlink d1/d22/l70 0 2024-01-31T05:13:12.551 INFO:tasks.workunit.client.0.smithi099.stdout:0/397: fsync d1/d37/f41 0 2024-01-31T05:13:12.551 INFO:tasks.workunit.client.0.smithi099.stdout:2/389: truncate d10/f42 3600189 0 2024-01-31T05:13:12.554 INFO:tasks.workunit.client.0.smithi099.stdout:4/399: rename d0/d2/d20/d21/d17/d24/f32 to d0/d2/d20/d21/d59/f8b 0 2024-01-31T05:13:12.554 INFO:tasks.workunit.client.0.smithi099.stdout:9/356: symlink d0/d1/l7d 0 2024-01-31T05:13:12.555 INFO:tasks.workunit.client.0.smithi099.stdout:1/422: creat d4/dc/f88 x:0 0 0 2024-01-31T05:13:12.555 INFO:tasks.workunit.client.0.smithi099.stdout:6/343: dwrite d14/d18/d1a/f3e [0,4194304] 0 2024-01-31T05:13:12.556 INFO:tasks.workunit.client.0.smithi099.stdout:7/375: symlink d6/d32/d3d/d4b/d33/d37/l7d 0 2024-01-31T05:13:12.556 INFO:tasks.workunit.client.0.smithi099.stdout:7/376: stat d6/d32/d3d/d4b/c6c 0 2024-01-31T05:13:12.556 INFO:tasks.workunit.client.0.smithi099.stdout:7/377: readlink d6/d32/d3d/d4b/d33/d37/d50/d5e/l64 0 2024-01-31T05:13:12.558 INFO:tasks.workunit.client.0.smithi099.stdout:5/421: rename d6/da/d14/d3d/d51/d82/f2d to d6/da/d34/f87 0 2024-01-31T05:13:12.560 INFO:tasks.workunit.client.0.smithi099.stdout:6/344: symlink d14/d18/d52/d22/l68 0 2024-01-31T05:13:12.560 INFO:tasks.workunit.client.0.smithi099.stdout:9/357: truncate d0/d7/fa 1677103 0 2024-01-31T05:13:12.560 INFO:tasks.workunit.client.0.smithi099.stdout:9/358: dread - d0/d1/d24/d2b/d59/f70 zero size 2024-01-31T05:13:12.560 INFO:tasks.workunit.client.0.smithi099.stdout:1/423: mknod d4/db/d12/c89 0 2024-01-31T05:13:12.560 INFO:tasks.workunit.client.0.smithi099.stdout:1/424: fdatasync d4/dc/d4d/d5d/d87/f54 0 2024-01-31T05:13:12.567 INFO:tasks.workunit.client.0.smithi099.stdout:4/400: write d0/d2/d20/d21/d17/d3d/f41 [4115317,127927] 0 2024-01-31T05:13:12.567 INFO:tasks.workunit.client.0.smithi099.stdout:1/425: write d4/dc/d15/f33 [1231434,77220] 0 2024-01-31T05:13:12.568 INFO:tasks.workunit.client.0.smithi099.stdout:0/398: write d1/d30/d45/d66/f5b [3243280,109049] 0 2024-01-31T05:13:12.568 INFO:tasks.workunit.client.0.smithi099.stdout:4/401: dread d0/d2/d20/d21/d17/d3d/f6a [0,4194304] 0 2024-01-31T05:13:12.568 INFO:tasks.workunit.client.0.smithi099.stdout:4/402: fsync d0/d8/d19/f2d 0 2024-01-31T05:13:12.569 INFO:tasks.workunit.client.0.smithi099.stdout:6/345: write fc [3888331,51465] 0 2024-01-31T05:13:12.569 INFO:tasks.workunit.client.0.smithi099.stdout:6/346: fdatasync d14/f16 0 2024-01-31T05:13:12.575 INFO:tasks.workunit.client.0.smithi099.stdout:4/403: dread d0/d8/d19/f2d [0,4194304] 0 2024-01-31T05:13:12.576 INFO:tasks.workunit.client.0.smithi099.stdout:5/422: link d6/da/f56 d6/da/d3f/d73/f88 0 2024-01-31T05:13:12.576 INFO:tasks.workunit.client.0.smithi099.stdout:3/422: dwrite d10/d24/f38 [0,4194304] 0 2024-01-31T05:13:12.578 INFO:tasks.workunit.client.0.smithi099.stdout:1/426: mknod d4/dc/c8a 0 2024-01-31T05:13:12.578 INFO:tasks.workunit.client.0.smithi099.stdout:1/427: fsync d4/dc/d29/f7c 0 2024-01-31T05:13:12.579 INFO:tasks.workunit.client.0.smithi099.stdout:0/399: getdents d1/d30 0 2024-01-31T05:13:12.579 INFO:tasks.workunit.client.0.smithi099.stdout:0/400: chown d1/d8/f58 3439027 1 2024-01-31T05:13:12.580 INFO:tasks.workunit.client.0.smithi099.stdout:1/428: symlink d4/db/d24/d4b/l8b 0 2024-01-31T05:13:12.582 INFO:tasks.workunit.client.0.smithi099.stdout:3/423: write d10/d27/f6b [143272,129476] 0 2024-01-31T05:13:12.582 INFO:tasks.workunit.client.0.smithi099.stdout:3/424: dread - d10/f8f zero size 2024-01-31T05:13:12.582 INFO:tasks.workunit.client.0.smithi099.stdout:3/425: write d10/d27/d34/d44/d60/d75/f9e [38070,26826] 0 2024-01-31T05:13:12.583 INFO:tasks.workunit.client.0.smithi099.stdout:0/401: mknod d1/d37/d4a/d6f/c84 0 2024-01-31T05:13:12.583 INFO:tasks.workunit.client.0.smithi099.stdout:0/402: dread - d1/f2a zero size 2024-01-31T05:13:12.585 INFO:tasks.workunit.client.0.smithi099.stdout:5/423: getdents d6/da/d14/d3d/d6e 0 2024-01-31T05:13:12.586 INFO:tasks.workunit.client.0.smithi099.stdout:6/347: dread fc [0,4194304] 0 2024-01-31T05:13:12.589 INFO:tasks.workunit.client.0.smithi099.stdout:6/348: creat d14/d18/d1a/d1c/d29/f69 x:0 0 0 2024-01-31T05:13:12.592 INFO:tasks.workunit.client.0.smithi099.stdout:0/403: read d1/d8/f58 [1912904,99134] 0 2024-01-31T05:13:12.592 INFO:tasks.workunit.client.0.smithi099.stdout:0/404: stat d1 0 2024-01-31T05:13:12.592 INFO:tasks.workunit.client.0.smithi099.stdout:1/429: getdents d4/db/d12 0 2024-01-31T05:13:12.592 INFO:tasks.workunit.client.0.smithi099.stdout:9/359: dwrite d0/d44/f4f [0,4194304] 0 2024-01-31T05:13:12.592 INFO:tasks.workunit.client.0.smithi099.stdout:9/360: chown d0/d1/d24/d2b/d63 52280204 1 2024-01-31T05:13:12.593 INFO:tasks.workunit.client.0.smithi099.stdout:2/390: dwrite d10/d20/f37 [8388608,4194304] 0 2024-01-31T05:13:12.593 INFO:tasks.workunit.client.0.smithi099.stdout:2/391: fdatasync d10/d1c/f39 0 2024-01-31T05:13:12.594 INFO:tasks.workunit.client.0.smithi099.stdout:2/392: chown d10/c7e 2709 1 2024-01-31T05:13:12.596 INFO:tasks.workunit.client.0.smithi099.stdout:0/405: mknod d1/d22/c85 0 2024-01-31T05:13:12.596 INFO:tasks.workunit.client.0.smithi099.stdout:0/406: dread - d1/f2a zero size 2024-01-31T05:13:12.596 INFO:tasks.workunit.client.0.smithi099.stdout:6/349: symlink d14/d18/d52/l6a 0 2024-01-31T05:13:12.598 INFO:tasks.workunit.client.0.smithi099.stdout:7/378: dwrite d6/d32/d3d/d4b/f1b [4194304,4194304] 0 2024-01-31T05:13:12.599 INFO:tasks.workunit.client.0.smithi099.stdout:5/424: write d6/fd [2716015,20122] 0 2024-01-31T05:13:12.599 INFO:tasks.workunit.client.0.smithi099.stdout:2/393: mkdir d10/d3a/d69/d82 0 2024-01-31T05:13:12.608 INFO:tasks.workunit.client.0.smithi099.stdout:5/425: unlink d6/da/d14/d3d/d51/d82/f69 0 2024-01-31T05:13:12.608 INFO:tasks.workunit.client.0.smithi099.stdout:8/488: sync 2024-01-31T05:13:12.609 INFO:tasks.workunit.client.0.smithi099.stdout:4/404: dwrite d0/d2/f47 [0,4194304] 0 2024-01-31T05:13:12.609 INFO:tasks.workunit.client.0.smithi099.stdout:4/405: write d0/d8/d19/d65/f6d [563456,125817] 0 2024-01-31T05:13:12.610 INFO:tasks.workunit.client.0.smithi099.stdout:9/361: read d0/d44/f53 [48496,115137] 0 2024-01-31T05:13:12.610 INFO:tasks.workunit.client.0.smithi099.stdout:9/362: creat d0/d1/d24/d2b/d63/f7e x:0 0 0 2024-01-31T05:13:12.611 INFO:tasks.workunit.client.0.smithi099.stdout:9/363: stat d0/d7/d2e/l2c 0 2024-01-31T05:13:12.612 INFO:tasks.workunit.client.0.smithi099.stdout:8/489: rename d1/dd/d65/c7e to d1/dd/d11/d19/d21/c9e 0 2024-01-31T05:13:12.614 INFO:tasks.workunit.client.0.smithi099.stdout:4/406: mknod d0/d8/d19/d65/c8c 0 2024-01-31T05:13:12.617 INFO:tasks.workunit.client.0.smithi099.stdout:9/364: mknod d0/d5d/c7f 0 2024-01-31T05:13:12.617 INFO:tasks.workunit.client.0.smithi099.stdout:9/365: creat d0/d1/d24/f80 x:0 0 0 2024-01-31T05:13:12.618 INFO:tasks.workunit.client.0.smithi099.stdout:8/490: symlink d1/dd/d11/d19/d21/d3c/l9f 0 2024-01-31T05:13:12.623 INFO:tasks.workunit.client.0.smithi099.stdout:4/407: truncate d0/d8/d19/f1c 31698 0 2024-01-31T05:13:12.623 INFO:tasks.workunit.client.0.smithi099.stdout:4/408: stat d0/d2/d20/d21/d17/f25 0 2024-01-31T05:13:12.626 INFO:tasks.workunit.client.0.smithi099.stdout:9/366: unlink d0/d7/c41 0 2024-01-31T05:13:12.629 INFO:tasks.workunit.client.0.smithi099.stdout:4/409: mkdir d0/d2/d20/d21/d86/d8d 0 2024-01-31T05:13:12.630 INFO:tasks.workunit.client.0.smithi099.stdout:9/367: getdents d0/d1/d5e 0 2024-01-31T05:13:12.630 INFO:tasks.workunit.client.0.smithi099.stdout:9/368: dread - d0/d1/d24/f69 zero size 2024-01-31T05:13:12.631 INFO:tasks.workunit.client.0.smithi099.stdout:3/426: dwrite d10/d27/d34/d52/f62 [0,4194304] 0 2024-01-31T05:13:12.632 INFO:tasks.workunit.client.0.smithi099.stdout:0/407: dwrite d1/f48 [4194304,4194304] 0 2024-01-31T05:13:12.632 INFO:tasks.workunit.client.0.smithi099.stdout:7/379: dwrite d6/d12/f73 [0,4194304] 0 2024-01-31T05:13:12.632 INFO:tasks.workunit.client.0.smithi099.stdout:7/380: stat d6/f5d 0 2024-01-31T05:13:12.632 INFO:tasks.workunit.client.0.smithi099.stdout:6/350: dwrite d14/d18/d1a/d1c/f55 [0,4194304] 0 2024-01-31T05:13:12.633 INFO:tasks.workunit.client.0.smithi099.stdout:8/491: rename d1/dd/d15 to d1/dd/d11/d29/d3f/d56/da0 0 2024-01-31T05:13:12.638 INFO:tasks.workunit.client.0.smithi099.stdout:0/408: creat d1/d37/f86 x:0 0 0 2024-01-31T05:13:12.639 INFO:tasks.workunit.client.0.smithi099.stdout:6/351: rmdir d14/d18/d52/d46 39 2024-01-31T05:13:12.639 INFO:tasks.workunit.client.0.smithi099.stdout:7/381: creat d6/d32/d3d/d4b/d33/d37/f7e x:0 0 0 2024-01-31T05:13:12.639 INFO:tasks.workunit.client.0.smithi099.stdout:7/382: chown d6/d32/d3d/d4b/d33/d37/d50/d25/c39 6673116 1 2024-01-31T05:13:12.639 INFO:tasks.workunit.client.0.smithi099.stdout:7/383: truncate d6/d12/f3c 1526982 0 2024-01-31T05:13:12.640 INFO:tasks.workunit.client.0.smithi099.stdout:9/369: rmdir d0/d1/d24/d2b/d59 39 2024-01-31T05:13:12.640 INFO:tasks.workunit.client.0.smithi099.stdout:9/370: fsync d0/d7/f68 0 2024-01-31T05:13:12.640 INFO:tasks.workunit.client.0.smithi099.stdout:9/371: fsync d0/d7/f28 0 2024-01-31T05:13:12.640 INFO:tasks.workunit.client.0.smithi099.stdout:9/372: creat d0/d5d/f81 x:0 0 0 2024-01-31T05:13:12.640 INFO:tasks.workunit.client.0.smithi099.stdout:9/373: write d0/d7/f14 [2005795,43046] 0 2024-01-31T05:13:12.641 INFO:tasks.workunit.client.0.smithi099.stdout:6/352: truncate d14/d18/d1a/d1c/f34 956809 0 2024-01-31T05:13:12.641 INFO:tasks.workunit.client.0.smithi099.stdout:6/353: fdatasync d14/f15 0 2024-01-31T05:13:12.641 INFO:tasks.workunit.client.0.smithi099.stdout:6/354: readlink d14/d18/l28 0 2024-01-31T05:13:12.641 INFO:tasks.workunit.client.0.smithi099.stdout:8/492: truncate d1/dd/d11/d19/d21/f2c 2495250 0 2024-01-31T05:13:12.642 INFO:tasks.workunit.client.0.smithi099.stdout:0/409: getdents d1/d30/d45 0 2024-01-31T05:13:12.642 INFO:tasks.workunit.client.0.smithi099.stdout:0/410: write d1/d16/f5a [936649,55276] 0 2024-01-31T05:13:12.642 INFO:tasks.workunit.client.0.smithi099.stdout:0/411: creat d1/d37/f87 x:0 0 0 2024-01-31T05:13:12.643 INFO:tasks.workunit.client.0.smithi099.stdout:6/355: mknod d14/d18/d1a/d1c/c6b 0 2024-01-31T05:13:12.644 INFO:tasks.workunit.client.0.smithi099.stdout:7/384: unlink d6/f5d 0 2024-01-31T05:13:12.655 INFO:tasks.workunit.client.0.smithi099.stdout:9/374: write d0/d7/f23 [4019500,72750] 0 2024-01-31T05:13:12.655 INFO:tasks.workunit.client.0.smithi099.stdout:6/356: dread d14/d18/d1a/f45 [0,4194304] 0 2024-01-31T05:13:12.656 INFO:tasks.workunit.client.0.smithi099.stdout:7/385: dread d6/d32/d3d/d4b/d33/d37/d4e/f65 [0,4194304] 0 2024-01-31T05:13:12.657 INFO:tasks.workunit.client.0.smithi099.stdout:9/375: link d0/d1/d5e/c78 d0/d7/d2e/c82 0 2024-01-31T05:13:12.657 INFO:tasks.workunit.client.0.smithi099.stdout:9/376: chown d0/d1/d24/d2b/d63/f74 86 1 2024-01-31T05:13:12.660 INFO:tasks.workunit.client.0.smithi099.stdout:6/357: link fa d14/d18/f6c 0 2024-01-31T05:13:12.660 INFO:tasks.workunit.client.0.smithi099.stdout:6/358: write d14/d18/d52/f67 [898089,11289] 0 2024-01-31T05:13:12.660 INFO:tasks.workunit.client.0.smithi099.stdout:6/359: stat d14/d18/d1a/d1c/f44 0 2024-01-31T05:13:12.661 INFO:tasks.workunit.client.0.smithi099.stdout:9/377: symlink d0/d3e/l83 0 2024-01-31T05:13:12.662 INFO:tasks.workunit.client.0.smithi099.stdout:6/360: symlink d14/d18/d3b/l6d 0 2024-01-31T05:13:12.663 INFO:tasks.workunit.client.0.smithi099.stdout:6/361: unlink c3 0 2024-01-31T05:13:12.666 INFO:tasks.workunit.client.0.smithi099.stdout:7/386: write d6/d12/f73 [3013451,61186] 0 2024-01-31T05:13:12.666 INFO:tasks.workunit.client.0.smithi099.stdout:7/387: readlink d6/d32/d3d/d4b/d33/d37/d50/d25/d47/l56 0 2024-01-31T05:13:12.669 INFO:tasks.workunit.client.0.smithi099.stdout:3/427: dwrite d10/d27/d34/d44/d95/f8d [0,4194304] 0 2024-01-31T05:13:12.670 INFO:tasks.workunit.client.0.smithi099.stdout:8/493: dwrite d1/dd/d11/d20/f4b [0,4194304] 0 2024-01-31T05:13:12.671 INFO:tasks.workunit.client.0.smithi099.stdout:4/410: dwrite d0/d2/d4b/f69 [0,4194304] 0 2024-01-31T05:13:12.671 INFO:tasks.workunit.client.0.smithi099.stdout:9/378: dread d0/d3e/f42 [0,4194304] 0 2024-01-31T05:13:12.672 INFO:tasks.workunit.client.0.smithi099.stdout:3/428: mkdir d10/d1e/da2 0 2024-01-31T05:13:12.677 INFO:tasks.workunit.client.0.smithi099.stdout:9/379: rename d0/d1/d24/c5b to d0/d44/c84 0 2024-01-31T05:13:12.677 INFO:tasks.workunit.client.0.smithi099.stdout:9/380: readlink d0/d7/l34 0 2024-01-31T05:13:12.677 INFO:tasks.workunit.client.0.smithi099.stdout:9/381: stat d0/d1/d24/d2b/f3c 0 2024-01-31T05:13:12.677 INFO:tasks.workunit.client.0.smithi099.stdout:9/382: creat d0/d5d/f85 x:0 0 0 2024-01-31T05:13:12.680 INFO:tasks.workunit.client.0.smithi099.stdout:9/383: truncate d0/d7/d2e/f43 1393762 0 2024-01-31T05:13:12.680 INFO:tasks.workunit.client.0.smithi099.stdout:9/384: stat d0/d3e/f4c 0 2024-01-31T05:13:12.680 INFO:tasks.workunit.client.0.smithi099.stdout:9/385: chown d0/l1a 12509582 1 2024-01-31T05:13:12.680 INFO:tasks.workunit.client.0.smithi099.stdout:9/386: write d0/d7/f23 [3127265,125973] 0 2024-01-31T05:13:12.682 INFO:tasks.workunit.client.0.smithi099.stdout:9/387: unlink d0/d7/fa 0 2024-01-31T05:13:12.686 INFO:tasks.workunit.client.0.smithi099.stdout:8/494: dread d1/dd/d11/f68 [0,4194304] 0 2024-01-31T05:13:12.687 INFO:tasks.workunit.client.0.smithi099.stdout:8/495: unlink d1/dd/d11/d29/d3f/d56/da0/d2e/f98 0 2024-01-31T05:13:12.688 INFO:tasks.workunit.client.0.smithi099.stdout:8/496: write d1/dd/d11/f1e [4585890,33339] 0 2024-01-31T05:13:12.690 INFO:tasks.workunit.client.0.smithi099.stdout:8/497: mknod d1/dd/d7b/ca1 0 2024-01-31T05:13:12.690 INFO:tasks.workunit.client.0.smithi099.stdout:8/498: write d1/dd/ff [2077721,62006] 0 2024-01-31T05:13:12.692 INFO:tasks.workunit.client.0.smithi099.stdout:3/429: dread d10/d27/d34/d52/f7d [0,4194304] 0 2024-01-31T05:13:12.698 INFO:tasks.workunit.client.0.smithi099.stdout:4/411: dwrite d0/d2/d20/d21/d17/f25 [0,4194304] 0 2024-01-31T05:13:12.701 INFO:tasks.workunit.client.0.smithi099.stdout:4/412: rename d0/c2c to d0/d8/d19/d54/d76/c8e 0 2024-01-31T05:13:12.704 INFO:tasks.workunit.client.0.smithi099.stdout:4/413: mkdir d0/d2/d20/d21/d59/d8f 0 2024-01-31T05:13:12.704 INFO:tasks.workunit.client.0.smithi099.stdout:4/414: readlink d0/d2/d20/l6e 0 2024-01-31T05:13:12.704 INFO:tasks.workunit.client.0.smithi099.stdout:4/415: stat d0/d2/d20/d21/d59/f8b 0 2024-01-31T05:13:12.706 INFO:tasks.workunit.client.0.smithi099.stdout:4/416: creat d0/d2/d4b/f90 x:0 0 0 2024-01-31T05:13:12.707 INFO:tasks.workunit.client.0.smithi099.stdout:4/417: dread d0/f5b [0,4194304] 0 2024-01-31T05:13:12.714 INFO:tasks.workunit.client.0.smithi099.stdout:8/499: dwrite d1/dd/d11/d29/d3f/d56/f88 [0,4194304] 0 2024-01-31T05:13:12.716 INFO:tasks.workunit.client.0.smithi099.stdout:9/388: dwrite d0/d7/f13 [0,4194304] 0 2024-01-31T05:13:12.716 INFO:tasks.workunit.client.0.smithi099.stdout:9/389: write d0/d7/f35 [383529,39874] 0 2024-01-31T05:13:12.717 INFO:tasks.workunit.client.0.smithi099.stdout:3/430: dwrite d10/d32/d33/d51/f71 [0,4194304] 0 2024-01-31T05:13:12.720 INFO:tasks.workunit.client.0.smithi099.stdout:9/390: symlink d0/d7/l86 0 2024-01-31T05:13:12.727 INFO:tasks.workunit.client.0.smithi099.stdout:9/391: dread d0/d3e/f40 [0,4194304] 0 2024-01-31T05:13:12.727 INFO:tasks.workunit.client.0.smithi099.stdout:9/392: truncate d0/d1/d24/f37 5068099 0 2024-01-31T05:13:12.728 INFO:tasks.workunit.client.0.smithi099.stdout:3/431: mkdir d10/d32/d85/da3 0 2024-01-31T05:13:12.729 INFO:tasks.workunit.client.0.smithi099.stdout:9/393: mkdir d0/d3e/d87 0 2024-01-31T05:13:12.729 INFO:tasks.workunit.client.0.smithi099.stdout:9/394: fdatasync d0/d1/d24/f37 0 2024-01-31T05:13:12.730 INFO:tasks.workunit.client.0.smithi099.stdout:9/395: dread d0/d7/f28 [4194304,4194304] 0 2024-01-31T05:13:12.730 INFO:tasks.workunit.client.0.smithi099.stdout:9/396: chown d0/d1/d5e/l77 12 1 2024-01-31T05:13:12.730 INFO:tasks.workunit.client.0.smithi099.stdout:9/397: fsync d0/d1/d24/d2b/d63/f7e 0 2024-01-31T05:13:12.731 INFO:tasks.workunit.client.0.smithi099.stdout:3/432: unlink d10/d32/d33/d51/c7b 0 2024-01-31T05:13:12.734 INFO:tasks.workunit.client.0.smithi099.stdout:9/398: creat d0/d1/d24/d2b/d7b/f88 x:0 0 0 2024-01-31T05:13:12.735 INFO:tasks.workunit.client.0.smithi099.stdout:3/433: symlink d10/d27/d34/d44/d60/d75/d8c/la4 0 2024-01-31T05:13:12.737 INFO:tasks.workunit.client.0.smithi099.stdout:9/399: mkdir d0/d1/d5e/d72/d89 0 2024-01-31T05:13:12.737 INFO:tasks.workunit.client.0.smithi099.stdout:9/400: dread - d0/d1/d24/d2b/d59/f70 zero size 2024-01-31T05:13:12.739 INFO:tasks.workunit.client.0.smithi099.stdout:5/426: sync 2024-01-31T05:13:12.739 INFO:tasks.workunit.client.0.smithi099.stdout:2/394: sync 2024-01-31T05:13:12.739 INFO:tasks.workunit.client.0.smithi099.stdout:1/430: sync 2024-01-31T05:13:12.739 INFO:tasks.workunit.client.0.smithi099.stdout:5/427: readlink d6/da/d14/l6f 0 2024-01-31T05:13:12.739 INFO:tasks.workunit.client.0.smithi099.stdout:2/395: fsync d10/d1c/f2d 0 2024-01-31T05:13:12.739 INFO:tasks.workunit.client.0.smithi099.stdout:1/431: write d4/dc/f43 [169996,51816] 0 2024-01-31T05:13:12.740 INFO:tasks.workunit.client.0.smithi099.stdout:5/428: symlink d6/da/d14/d2b/l89 0 2024-01-31T05:13:12.740 INFO:tasks.workunit.client.0.smithi099.stdout:5/429: readlink d6/da/d14/l6f 0 2024-01-31T05:13:12.742 INFO:tasks.workunit.client.0.smithi099.stdout:5/430: mknod d6/da/d14/d3d/d57/c8a 0 2024-01-31T05:13:12.749 INFO:tasks.workunit.client.0.smithi099.stdout:8/500: dwrite d1/dd/d11/f31 [0,4194304] 0 2024-01-31T05:13:12.751 INFO:tasks.workunit.client.0.smithi099.stdout:4/418: dwrite d0/d2/d20/d21/d17/d3d/f41 [0,4194304] 0 2024-01-31T05:13:12.751 INFO:tasks.workunit.client.0.smithi099.stdout:9/401: dread d0/d3e/f5f [0,4194304] 0 2024-01-31T05:13:12.751 INFO:tasks.workunit.client.0.smithi099.stdout:8/501: unlink d1/dd/d11/d19/l80 0 2024-01-31T05:13:12.753 INFO:tasks.workunit.client.0.smithi099.stdout:1/432: write d4/f6b [3500917,102999] 0 2024-01-31T05:13:12.754 INFO:tasks.workunit.client.0.smithi099.stdout:4/419: mknod d0/d8/d19/d54/d76/c91 0 2024-01-31T05:13:12.754 INFO:tasks.workunit.client.0.smithi099.stdout:4/420: readlink d0/d2/d20/d21/d39/l5e 0 2024-01-31T05:13:12.754 INFO:tasks.workunit.client.0.smithi099.stdout:1/433: truncate d4/db/d24/d4b/f79 2786007 0 2024-01-31T05:13:12.757 INFO:tasks.workunit.client.0.smithi099.stdout:9/402: unlink d0/d1/f1d 0 2024-01-31T05:13:12.757 INFO:tasks.workunit.client.0.smithi099.stdout:9/403: stat d0/d1/d24/d2b 0 2024-01-31T05:13:12.759 INFO:tasks.workunit.client.0.smithi099.stdout:8/502: creat d1/dd/d11/d29/fa2 x:0 0 0 2024-01-31T05:13:12.759 INFO:tasks.workunit.client.0.smithi099.stdout:8/503: write d1/dd/d11/d29/d3f/d56/da0/f3d [4656442,107318] 0 2024-01-31T05:13:12.761 INFO:tasks.workunit.client.0.smithi099.stdout:4/421: creat d0/d79/f92 x:0 0 0 2024-01-31T05:13:12.764 INFO:tasks.workunit.client.0.smithi099.stdout:8/504: mknod d1/dd/d65/d7f/ca3 0 2024-01-31T05:13:12.766 INFO:tasks.workunit.client.0.smithi099.stdout:3/434: dwrite d10/d1e/f25 [0,4194304] 0 2024-01-31T05:13:12.767 INFO:tasks.workunit.client.0.smithi099.stdout:2/396: rmdir d10/d20 39 2024-01-31T05:13:12.767 INFO:tasks.workunit.client.0.smithi099.stdout:2/397: write d10/d1c/f26 [935830,18440] 0 2024-01-31T05:13:12.767 INFO:tasks.workunit.client.0.smithi099.stdout:2/398: truncate d10/d1c/f64 1168014 0 2024-01-31T05:13:12.768 INFO:tasks.workunit.client.0.smithi099.stdout:3/435: dread d10/d27/d34/d44/d60/d75/f9e [0,4194304] 0 2024-01-31T05:13:12.768 INFO:tasks.workunit.client.0.smithi099.stdout:3/436: dread - d10/d24/d40/f82 zero size 2024-01-31T05:13:12.769 INFO:tasks.workunit.client.0.smithi099.stdout:2/399: mkdir d10/d1b/d83 0 2024-01-31T05:13:12.769 INFO:tasks.workunit.client.0.smithi099.stdout:2/400: fsync d10/d1c/f39 0 2024-01-31T05:13:12.769 INFO:tasks.workunit.client.0.smithi099.stdout:5/431: dwrite d6/f6d [0,4194304] 0 2024-01-31T05:13:12.771 INFO:tasks.workunit.client.0.smithi099.stdout:3/437: mknod d10/d27/d34/d44/d95/ca5 0 2024-01-31T05:13:12.772 INFO:tasks.workunit.client.0.smithi099.stdout:3/438: fsync d10/d27/d34/f88 0 2024-01-31T05:13:12.772 INFO:tasks.workunit.client.0.smithi099.stdout:3/439: chown d10/d32/l4f 0 1 2024-01-31T05:13:12.772 INFO:tasks.workunit.client.0.smithi099.stdout:3/440: getdents d10/d32/d85/da3 0 2024-01-31T05:13:12.777 INFO:tasks.workunit.client.0.smithi099.stdout:9/404: dwrite d0/d7/f66 [0,4194304] 0 2024-01-31T05:13:12.777 INFO:tasks.workunit.client.0.smithi099.stdout:5/432: link d6/da/d14/d3d/d51/f74 d6/da/d14/d2b/d7b/f8b 0 2024-01-31T05:13:12.780 INFO:tasks.workunit.client.0.smithi099.stdout:2/401: write d10/d51/f54 [3021299,107236] 0 2024-01-31T05:13:12.780 INFO:tasks.workunit.client.0.smithi099.stdout:2/402: dread - d10/d2b/d58/f5f zero size 2024-01-31T05:13:12.781 INFO:tasks.workunit.client.0.smithi099.stdout:2/403: creat d10/d1b/d4d/f84 x:0 0 0 2024-01-31T05:13:12.781 INFO:tasks.workunit.client.0.smithi099.stdout:2/404: creat d10/d1c/f85 x:0 0 0 2024-01-31T05:13:12.782 INFO:tasks.workunit.client.0.smithi099.stdout:2/405: mkdir d10/d1b/d83/d86 0 2024-01-31T05:13:12.782 INFO:tasks.workunit.client.0.smithi099.stdout:2/406: write d10/d20/f50 [1673819,118580] 0 2024-01-31T05:13:12.785 INFO:tasks.workunit.client.0.smithi099.stdout:2/407: symlink d10/d1b/d7d/d7a/l87 0 2024-01-31T05:13:12.787 INFO:tasks.workunit.client.0.smithi099.stdout:5/433: write d6/da/d14/d3d/d6e/f42 [2267290,77907] 0 2024-01-31T05:13:12.787 INFO:tasks.workunit.client.0.smithi099.stdout:5/434: chown d6/da/c39 195428 1 2024-01-31T05:13:12.787 INFO:tasks.workunit.client.0.smithi099.stdout:5/435: dread - d6/da/d14/d3d/d51/f74 zero size 2024-01-31T05:13:12.789 INFO:tasks.workunit.client.0.smithi099.stdout:5/436: mkdir d6/da/d14/d3d/d8c 0 2024-01-31T05:13:12.793 INFO:tasks.workunit.client.0.smithi099.stdout:5/437: creat d6/da/d34/f8d x:0 0 0 2024-01-31T05:13:12.796 INFO:tasks.workunit.client.0.smithi099.stdout:5/438: unlink d6/lc 0 2024-01-31T05:13:12.797 INFO:tasks.workunit.client.0.smithi099.stdout:2/408: write d10/f15 [7288303,6273] 0 2024-01-31T05:13:12.799 INFO:tasks.workunit.client.0.smithi099.stdout:2/409: mknod d10/d1b/c88 0 2024-01-31T05:13:12.799 INFO:tasks.workunit.client.0.smithi099.stdout:2/410: chown d10/d2b 907358 1 2024-01-31T05:13:12.804 INFO:tasks.workunit.client.0.smithi099.stdout:1/434: dwrite d4/db/d24/d4b/f52 [0,4194304] 0 2024-01-31T05:13:12.809 INFO:tasks.workunit.client.0.smithi099.stdout:1/435: getdents d4 0 2024-01-31T05:13:12.809 INFO:tasks.workunit.client.0.smithi099.stdout:1/436: write d4/dc/f2c [801307,82511] 0 2024-01-31T05:13:12.811 INFO:tasks.workunit.client.0.smithi099.stdout:1/437: dread d4/dc/f43 [0,4194304] 0 2024-01-31T05:13:12.826 INFO:tasks.workunit.client.0.smithi099.stdout:5/439: dwrite d6/da/d14/d3d/d51/d82/f41 [0,4194304] 0 2024-01-31T05:13:12.826 INFO:tasks.workunit.client.0.smithi099.stdout:2/411: dwrite d10/f33 [0,4194304] 0 2024-01-31T05:13:12.827 INFO:tasks.workunit.client.0.smithi099.stdout:7/388: sync 2024-01-31T05:13:12.827 INFO:tasks.workunit.client.0.smithi099.stdout:0/412: sync 2024-01-31T05:13:12.827 INFO:tasks.workunit.client.0.smithi099.stdout:6/362: sync 2024-01-31T05:13:12.827 INFO:tasks.workunit.client.0.smithi099.stdout:4/422: rename d0/d2/d20/d21 to d0/d2/d4b/d93 0 2024-01-31T05:13:12.827 INFO:tasks.workunit.client.0.smithi099.stdout:6/363: write d14/d18/d1a/f45 [388163,123499] 0 2024-01-31T05:13:12.828 INFO:tasks.workunit.client.0.smithi099.stdout:6/364: creat d14/d18/d1a/d1c/d29/d4f/f6e x:0 0 0 2024-01-31T05:13:12.830 INFO:tasks.workunit.client.0.smithi099.stdout:6/365: unlink d14/d18/d1a/f45 0 2024-01-31T05:13:12.834 INFO:tasks.workunit.client.0.smithi099.stdout:0/413: rename d1/d8/f58 to d1/d37/d4a/d7a/d7d/f88 0 2024-01-31T05:13:12.836 INFO:tasks.workunit.client.0.smithi099.stdout:4/423: unlink d0/d2/c34 0 2024-01-31T05:13:12.836 INFO:tasks.workunit.client.0.smithi099.stdout:4/424: write d0/d8/d19/f1c [11344,45752] 0 2024-01-31T05:13:12.840 INFO:tasks.workunit.client.0.smithi099.stdout:3/441: rename d10/d27/d34/d52/l86 to d10/d27/d34/d44/d95/la6 0 2024-01-31T05:13:12.842 INFO:tasks.workunit.client.0.smithi099.stdout:7/389: dread d6/d32/d3d/d4b/d33/f5a [0,4194304] 0 2024-01-31T05:13:12.843 INFO:tasks.workunit.client.0.smithi099.stdout:0/414: mknod d1/d56/c89 0 2024-01-31T05:13:12.844 INFO:tasks.workunit.client.0.smithi099.stdout:1/438: dwrite d4/db/d3a/f60 [4194304,4194304] 0 2024-01-31T05:13:12.845 INFO:tasks.workunit.client.0.smithi099.stdout:3/442: creat d10/d27/fa7 x:0 0 0 2024-01-31T05:13:12.845 INFO:tasks.workunit.client.0.smithi099.stdout:3/443: creat d10/d27/d34/d44/d60/fa8 x:0 0 0 2024-01-31T05:13:12.850 INFO:tasks.workunit.client.0.smithi099.stdout:3/444: mknod d10/d27/d34/d50/ca9 0 2024-01-31T05:13:12.851 INFO:tasks.workunit.client.0.smithi099.stdout:5/440: dwrite d6/f18 [0,4194304] 0 2024-01-31T05:13:12.854 INFO:tasks.workunit.client.0.smithi099.stdout:5/441: link d6/da/d14/d2b/d7b/f8b d6/da/d14/d3d/d51/f8e 0 2024-01-31T05:13:12.855 INFO:tasks.workunit.client.0.smithi099.stdout:2/412: dwrite d10/d1c/f78 [0,4194304] 0 2024-01-31T05:13:12.856 INFO:tasks.workunit.client.0.smithi099.stdout:5/442: unlink d6/da/d14/d3d/d51/f55 0 2024-01-31T05:13:12.857 INFO:tasks.workunit.client.0.smithi099.stdout:2/413: chown d10/d20/d5b 53988 1 2024-01-31T05:13:12.860 INFO:tasks.workunit.client.0.smithi099.stdout:4/425: write d0/d2/d4b/d93/d17/d24/d5a/f6b [2950909,109481] 0 2024-01-31T05:13:12.866 INFO:tasks.workunit.client.0.smithi099.stdout:2/414: creat d10/d20/f89 x:0 0 0 2024-01-31T05:13:12.866 INFO:tasks.workunit.client.0.smithi099.stdout:3/445: write d10/d32/d85/f2c [7434318,96768] 0 2024-01-31T05:13:12.866 INFO:tasks.workunit.client.0.smithi099.stdout:3/446: chown d10/d27/d34/d50/c7f 811087099 1 2024-01-31T05:13:12.866 INFO:tasks.workunit.client.0.smithi099.stdout:3/447: write d10/d27/f5b [1728876,130551] 0 2024-01-31T05:13:12.868 INFO:tasks.workunit.client.0.smithi099.stdout:2/415: mknod d10/d1b/c8a 0 2024-01-31T05:13:12.871 INFO:tasks.workunit.client.0.smithi099.stdout:3/448: rename d10/d27/d34/d44/d95/f7e to d10/d27/d34/d44/d60/d75/d8c/faa 0 2024-01-31T05:13:12.872 INFO:tasks.workunit.client.0.smithi099.stdout:6/366: dwrite fa [0,4194304] 0 2024-01-31T05:13:12.873 INFO:tasks.workunit.client.0.smithi099.stdout:6/367: write d14/d18/d1a/f3e [5158678,93502] 0 2024-01-31T05:13:12.873 INFO:tasks.workunit.client.0.smithi099.stdout:2/416: creat d10/d3a/d69/f8b x:0 0 0 2024-01-31T05:13:12.873 INFO:tasks.workunit.client.0.smithi099.stdout:4/426: creat d0/d2/d4b/d93/f94 x:0 0 0 2024-01-31T05:13:12.874 INFO:tasks.workunit.client.0.smithi099.stdout:4/427: mknod d0/d2/d20/c95 0 2024-01-31T05:13:12.878 INFO:tasks.workunit.client.0.smithi099.stdout:2/417: dread d10/d20/f50 [0,4194304] 0 2024-01-31T05:13:12.878 INFO:tasks.workunit.client.0.smithi099.stdout:0/415: dwrite d1/f80 [0,4194304] 0 2024-01-31T05:13:12.878 INFO:tasks.workunit.client.0.smithi099.stdout:0/416: write d1/d30/d45/d66/f5b [1529472,82376] 0 2024-01-31T05:13:12.878 INFO:tasks.workunit.client.0.smithi099.stdout:0/417: write d1/d22/f83 [327155,98026] 0 2024-01-31T05:13:12.878 INFO:tasks.workunit.client.0.smithi099.stdout:0/418: stat d1/d37/f41 0 2024-01-31T05:13:12.882 INFO:tasks.workunit.client.0.smithi099.stdout:0/419: symlink d1/d22/l8a 0 2024-01-31T05:13:12.883 INFO:tasks.workunit.client.0.smithi099.stdout:8/505: sync 2024-01-31T05:13:12.883 INFO:tasks.workunit.client.0.smithi099.stdout:6/368: write fc [8184176,26079] 0 2024-01-31T05:13:12.884 INFO:tasks.workunit.client.0.smithi099.stdout:0/420: mkdir d1/d16/d36/d8b 0 2024-01-31T05:13:12.884 INFO:tasks.workunit.client.0.smithi099.stdout:0/421: getdents d1/d16/d36/d8b 0 2024-01-31T05:13:12.884 INFO:tasks.workunit.client.0.smithi099.stdout:0/422: chown d1/d30/d45/d66/f25 218 1 2024-01-31T05:13:12.885 INFO:tasks.workunit.client.0.smithi099.stdout:4/428: dread d0/d2/d20/f38 [0,4194304] 0 2024-01-31T05:13:12.885 INFO:tasks.workunit.client.0.smithi099.stdout:7/390: dwrite d6/f52 [0,4194304] 0 2024-01-31T05:13:12.885 INFO:tasks.workunit.client.0.smithi099.stdout:5/443: dread d6/da/d14/d3d/d6e/f22 [4194304,4194304] 0 2024-01-31T05:13:12.885 INFO:tasks.workunit.client.0.smithi099.stdout:5/444: truncate d6/da/d14/d2b/d7b/f8b 697212 0 2024-01-31T05:13:12.893 INFO:tasks.workunit.client.0.smithi099.stdout:7/391: link d6/d12/c1c d6/d32/d3d/d4b/d33/d37/d50/d25/d7a/c7f 0 2024-01-31T05:13:12.893 INFO:tasks.workunit.client.0.smithi099.stdout:3/449: dwrite d10/d27/d34/d44/d95/f6e [0,4194304] 0 2024-01-31T05:13:12.894 INFO:tasks.workunit.client.0.smithi099.stdout:5/445: symlink d6/da/d14/d2b/l8f 0 2024-01-31T05:13:12.896 INFO:tasks.workunit.client.0.smithi099.stdout:4/429: symlink d0/d2/d4b/d93/d39/l96 0 2024-01-31T05:13:12.896 INFO:tasks.workunit.client.0.smithi099.stdout:4/430: fdatasync d0/d8/d19/d65/f75 0 2024-01-31T05:13:12.896 INFO:tasks.workunit.client.0.smithi099.stdout:6/369: dread fc [4194304,4194304] 0 2024-01-31T05:13:12.900 INFO:tasks.workunit.client.0.smithi099.stdout:7/392: mknod d6/d32/d3d/d4b/d33/d37/d50/d25/d79/c80 0 2024-01-31T05:13:12.903 INFO:tasks.workunit.client.0.smithi099.stdout:8/506: dread d1/dd/d11/d29/f58 [0,4194304] 0 2024-01-31T05:13:12.903 INFO:tasks.workunit.client.0.smithi099.stdout:3/450: truncate d10/d32/d85/f26 4769321 0 2024-01-31T05:13:12.903 INFO:tasks.workunit.client.0.smithi099.stdout:3/451: fdatasync d10/d24/d40/f8e 0 2024-01-31T05:13:12.903 INFO:tasks.workunit.client.0.smithi099.stdout:3/452: readlink d10/d32/l65 0 2024-01-31T05:13:12.905 INFO:tasks.workunit.client.0.smithi099.stdout:5/446: mknod d6/da/d14/d3d/d6e/c90 0 2024-01-31T05:13:12.905 INFO:tasks.workunit.client.0.smithi099.stdout:5/447: readlink d6/da/d14/l2a 0 2024-01-31T05:13:12.905 INFO:tasks.workunit.client.0.smithi099.stdout:5/448: write d6/da/d14/d3d/d51/d82/f2c [1949280,96279] 0 2024-01-31T05:13:12.905 INFO:tasks.workunit.client.0.smithi099.stdout:5/449: creat d6/f91 x:0 0 0 2024-01-31T05:13:12.905 INFO:tasks.workunit.client.0.smithi099.stdout:5/450: read - d6/da/d34/f8d zero size 2024-01-31T05:13:12.907 INFO:tasks.workunit.client.0.smithi099.stdout:6/370: creat d14/d18/d3b/f6f x:0 0 0 2024-01-31T05:13:12.908 INFO:tasks.workunit.client.0.smithi099.stdout:7/393: mkdir d6/d32/d3d/d4b/d33/d37/d50/d25/d7a/d81 0 2024-01-31T05:13:12.909 INFO:tasks.workunit.client.0.smithi099.stdout:7/394: write d6/f69 [7859455,2789] 0 2024-01-31T05:13:12.910 INFO:tasks.workunit.client.0.smithi099.stdout:8/507: getdents d1/dd/d11 0 2024-01-31T05:13:12.910 INFO:tasks.workunit.client.0.smithi099.stdout:8/508: fsync d1/f5e 0 2024-01-31T05:13:12.910 INFO:tasks.workunit.client.0.smithi099.stdout:8/509: chown d1/dd/d11/d19/d21/d3c/c42 411190 1 2024-01-31T05:13:12.912 INFO:tasks.workunit.client.0.smithi099.stdout:5/451: mkdir d6/da/d14/d3d/d57/d92 0 2024-01-31T05:13:12.913 INFO:tasks.workunit.client.0.smithi099.stdout:0/423: dwrite d1/d64/f7f [0,4194304] 0 2024-01-31T05:13:12.914 INFO:tasks.workunit.client.0.smithi099.stdout:6/371: symlink d14/d18/d3b/l70 0 2024-01-31T05:13:12.915 INFO:tasks.workunit.client.0.smithi099.stdout:6/372: mkdir d14/d18/d52/d22/d71 0 2024-01-31T05:13:12.915 INFO:tasks.workunit.client.0.smithi099.stdout:3/453: write d10/d24/d40/f47 [272726,47762] 0 2024-01-31T05:13:12.916 INFO:tasks.workunit.client.0.smithi099.stdout:7/395: creat d6/f82 x:0 0 0 2024-01-31T05:13:12.917 INFO:tasks.workunit.client.0.smithi099.stdout:8/510: symlink d1/la4 0 2024-01-31T05:13:12.918 INFO:tasks.workunit.client.0.smithi099.stdout:5/452: mkdir d6/da/d14/d3d/d51/d82/d93 0 2024-01-31T05:13:12.921 INFO:tasks.workunit.client.0.smithi099.stdout:6/373: creat d14/d18/d52/d22/d71/f72 x:0 0 0 2024-01-31T05:13:12.921 INFO:tasks.workunit.client.0.smithi099.stdout:0/424: symlink d1/d30/d45/d6e/l8c 0 2024-01-31T05:13:12.921 INFO:tasks.workunit.client.0.smithi099.stdout:0/425: fdatasync d1/d30/d45/d6e/f74 0 2024-01-31T05:13:12.921 INFO:tasks.workunit.client.0.smithi099.stdout:0/426: dread - d1/d64/f78 zero size 2024-01-31T05:13:12.922 INFO:tasks.workunit.client.0.smithi099.stdout:7/396: creat d6/d32/d3d/d46/f83 x:0 0 0 2024-01-31T05:13:12.923 INFO:tasks.workunit.client.0.smithi099.stdout:4/431: dread d0/d2/d4b/d93/d17/f25 [0,4194304] 0 2024-01-31T05:13:12.923 INFO:tasks.workunit.client.0.smithi099.stdout:4/432: dread - d0/d79/f92 zero size 2024-01-31T05:13:12.928 INFO:tasks.workunit.client.0.smithi099.stdout:7/397: link d6/d32/f5b d6/d32/d3d/d4b/d33/d37/d50/d4d/f84 0 2024-01-31T05:13:12.928 INFO:tasks.workunit.client.0.smithi099.stdout:7/398: write d6/d32/d3d/d4b/d33/d37/d50/d4d/d58/f67 [4418043,23093] 0 2024-01-31T05:13:12.929 INFO:tasks.workunit.client.0.smithi099.stdout:7/399: write d6/d12/f3c [652320,78515] 0 2024-01-31T05:13:12.929 INFO:tasks.workunit.client.0.smithi099.stdout:7/400: write d6/d32/d3d/d46/f83 [986555,95752] 0 2024-01-31T05:13:12.930 INFO:tasks.workunit.client.0.smithi099.stdout:0/427: write d1/d16/d36/f3e [4536233,70162] 0 2024-01-31T05:13:12.932 INFO:tasks.workunit.client.0.smithi099.stdout:4/433: symlink d0/d2/d4b/d93/d59/d82/l97 0 2024-01-31T05:13:12.932 INFO:tasks.workunit.client.0.smithi099.stdout:4/434: chown d0/d2/d4b/d93/d17/d24/c51 0 1 2024-01-31T05:13:12.933 INFO:tasks.workunit.client.0.smithi099.stdout:4/435: dread - d0/d8/d19/d65/f75 zero size 2024-01-31T05:13:12.935 INFO:tasks.workunit.client.0.smithi099.stdout:0/428: creat d1/d37/d4a/d7a/d7d/f8d x:0 0 0 2024-01-31T05:13:12.935 INFO:tasks.workunit.client.0.smithi099.stdout:0/429: chown d1/f20 3 1 2024-01-31T05:13:12.936 INFO:tasks.workunit.client.0.smithi099.stdout:8/511: write d1/dd/d11/d20/f4b [3835228,74710] 0 2024-01-31T05:13:12.937 INFO:tasks.workunit.client.0.smithi099.stdout:4/436: mkdir d0/d8/d19/d98 0 2024-01-31T05:13:12.940 INFO:tasks.workunit.client.0.smithi099.stdout:0/430: creat d1/d30/d45/d6e/f8e x:0 0 0 2024-01-31T05:13:12.940 INFO:tasks.workunit.client.0.smithi099.stdout:0/431: stat d1/d37/f87 0 2024-01-31T05:13:12.941 INFO:tasks.workunit.client.0.smithi099.stdout:6/374: dread d14/d18/d3b/f5b [4194304,4194304] 0 2024-01-31T05:13:12.941 INFO:tasks.workunit.client.0.smithi099.stdout:8/512: symlink d1/dd/d11/d29/d3f/la5 0 2024-01-31T05:13:12.942 INFO:tasks.workunit.client.0.smithi099.stdout:6/375: truncate f12 3025396 0 2024-01-31T05:13:12.942 INFO:tasks.workunit.client.0.smithi099.stdout:4/437: mkdir d0/d8/d19/d99 0 2024-01-31T05:13:12.943 INFO:tasks.workunit.client.0.smithi099.stdout:3/454: dwrite d10/d32/f3b [4194304,4194304] 0 2024-01-31T05:13:12.950 INFO:tasks.workunit.client.0.smithi099.stdout:4/438: truncate d0/d2/d4b/d93/d17/d24/d5a/f6b 1225314 0 2024-01-31T05:13:12.953 INFO:tasks.workunit.client.0.smithi099.stdout:3/455: creat d10/d32/d85/fab x:0 0 0 2024-01-31T05:13:12.955 INFO:tasks.workunit.client.0.smithi099.stdout:0/432: link d1/d16/f1c d1/f8f 0 2024-01-31T05:13:12.956 INFO:tasks.workunit.client.0.smithi099.stdout:3/456: mknod d10/d27/d89/cac 0 2024-01-31T05:13:12.956 INFO:tasks.workunit.client.0.smithi099.stdout:3/457: creat d10/d32/fad x:0 0 0 2024-01-31T05:13:12.956 INFO:tasks.workunit.client.0.smithi099.stdout:3/458: stat d10/d32/d33/f61 0 2024-01-31T05:13:12.957 INFO:tasks.workunit.client.0.smithi099.stdout:3/459: dread - d10/d27/d34/d44/d60/d75/d8c/f9f zero size 2024-01-31T05:13:12.958 INFO:tasks.workunit.client.0.smithi099.stdout:0/433: unlink d1/d16/d36/f3d 0 2024-01-31T05:13:12.958 INFO:tasks.workunit.client.0.smithi099.stdout:0/434: fdatasync d1/d22/f55 0 2024-01-31T05:13:12.958 INFO:tasks.workunit.client.0.smithi099.stdout:0/435: chown d1/d64/f7f 174472 1 2024-01-31T05:13:12.965 INFO:tasks.workunit.client.0.smithi099.stdout:2/418: rename d10/d1c/l25 to d10/d1b/d83/l8c 0 2024-01-31T05:13:12.972 INFO:tasks.workunit.client.0.smithi099.stdout:5/453: rename d6/da/d34 to d6/da/d14/d94 0 2024-01-31T05:13:12.972 INFO:tasks.workunit.client.0.smithi099.stdout:0/436: dread d1/d30/d45/d66/f5b [0,4194304] 0 2024-01-31T05:13:12.974 INFO:tasks.workunit.client.0.smithi099.stdout:8/513: rename d1/dd/d4f/d6e to d1/da6 0 2024-01-31T05:13:12.975 INFO:tasks.workunit.client.0.smithi099.stdout:6/376: rename l0 to d14/d18/l73 0 2024-01-31T05:13:12.975 INFO:tasks.workunit.client.0.smithi099.stdout:9/405: sync 2024-01-31T05:13:12.977 INFO:tasks.workunit.client.0.smithi099.stdout:4/439: rename d0/d2/d4b/d93/d39/d66/c89 to d0/d74/c9a 0 2024-01-31T05:13:12.981 INFO:tasks.workunit.client.0.smithi099.stdout:1/439: sync 2024-01-31T05:13:12.981 INFO:tasks.workunit.client.0.smithi099.stdout:1/440: chown d4/dc/c8a 1811675 1 2024-01-31T05:13:12.984 INFO:tasks.workunit.client.0.smithi099.stdout:9/406: dread d0/d3e/f42 [0,4194304] 0 2024-01-31T05:13:12.985 INFO:tasks.workunit.client.0.smithi099.stdout:3/460: rename d10/d1e/c3e to d10/d27/d34/cae 0 2024-01-31T05:13:12.985 INFO:tasks.workunit.client.0.smithi099.stdout:8/514: dread d1/dd/d11/d29/d3f/d56/f88 [0,4194304] 0 2024-01-31T05:13:12.985 INFO:tasks.workunit.client.0.smithi099.stdout:4/440: truncate d0/d8/f16 1423349 0 2024-01-31T05:13:12.985 INFO:tasks.workunit.client.0.smithi099.stdout:8/515: stat d1/dd/d11/d20/f97 0 2024-01-31T05:13:12.985 INFO:tasks.workunit.client.0.smithi099.stdout:6/377: readlink d14/d18/d1a/l39 0 2024-01-31T05:13:12.986 INFO:tasks.workunit.client.0.smithi099.stdout:9/407: readlink d0/d3e/l5c 0 2024-01-31T05:13:12.986 INFO:tasks.workunit.client.0.smithi099.stdout:4/441: chown d0/d1e/l2b 3 1 2024-01-31T05:13:12.988 INFO:tasks.workunit.client.0.smithi099.stdout:3/461: mkdir d10/d27/d34/d44/d95/daf 0 2024-01-31T05:13:12.988 INFO:tasks.workunit.client.0.smithi099.stdout:3/462: stat d10/d32/f4e 0 2024-01-31T05:13:12.989 INFO:tasks.workunit.client.0.smithi099.stdout:8/516: creat d1/dd/fa7 x:0 0 0 2024-01-31T05:13:12.990 INFO:tasks.workunit.client.0.smithi099.stdout:1/441: dread d4/dc/d15/f32 [0,4194304] 0 2024-01-31T05:13:12.990 INFO:tasks.workunit.client.0.smithi099.stdout:4/442: mkdir d0/d8/d19/d98/d9b 0 2024-01-31T05:13:12.992 INFO:tasks.workunit.client.0.smithi099.stdout:4/443: mkdir d0/d2/d4b/d93/d59/d9c 0 2024-01-31T05:13:12.992 INFO:tasks.workunit.client.0.smithi099.stdout:4/444: truncate d0/f5b 925172 0 2024-01-31T05:13:12.992 INFO:tasks.workunit.client.0.smithi099.stdout:4/445: dread - d0/d2/d4b/d93/d17/d24/d3f/d43/f7e zero size 2024-01-31T05:13:12.993 INFO:tasks.workunit.client.0.smithi099.stdout:4/446: creat d0/d8/d19/d54/d76/f9d x:0 0 0 2024-01-31T05:13:12.993 INFO:tasks.workunit.client.0.smithi099.stdout:4/447: chown d0/d8/d19/d65/f75 23690 1 2024-01-31T05:13:12.995 INFO:tasks.workunit.client.0.smithi099.stdout:8/517: dread d1/dd/d11/d29/d3f/d56/f88 [0,4194304] 0 2024-01-31T05:13:12.996 INFO:tasks.workunit.client.0.smithi099.stdout:5/454: dwrite d6/da/d14/d2b/f77 [0,4194304] 0 2024-01-31T05:13:13.001 INFO:tasks.workunit.client.0.smithi099.stdout:5/455: rename d6/f10 to d6/da/d14/d3d/d6e/d21/f95 0 2024-01-31T05:13:13.001 INFO:tasks.workunit.client.0.smithi099.stdout:3/463: dread d10/d32/d85/f1d [0,4194304] 0 2024-01-31T05:13:13.002 INFO:tasks.workunit.client.0.smithi099.stdout:2/419: dwrite d10/d1c/f39 [0,4194304] 0 2024-01-31T05:13:13.002 INFO:tasks.workunit.client.0.smithi099.stdout:2/420: fdatasync d10/f33 0 2024-01-31T05:13:13.002 INFO:tasks.workunit.client.0.smithi099.stdout:9/408: read d0/d7/f23 [4998726,93383] 0 2024-01-31T05:13:13.002 INFO:tasks.workunit.client.0.smithi099.stdout:9/409: chown d0/d44/f53 403630926 1 2024-01-31T05:13:13.002 INFO:tasks.workunit.client.0.smithi099.stdout:8/518: mknod d1/dd/d11/d29/d3f/d56/da0/d2e/ca8 0 2024-01-31T05:13:13.003 INFO:tasks.workunit.client.0.smithi099.stdout:5/456: creat d6/da/d14/d2b/d7b/f96 x:0 0 0 2024-01-31T05:13:13.006 INFO:tasks.workunit.client.0.smithi099.stdout:3/464: mkdir d10/d27/d34/d44/d60/d75/d8c/db0 0 2024-01-31T05:13:13.008 INFO:tasks.workunit.client.0.smithi099.stdout:2/421: mkdir d10/d51/d8d 0 2024-01-31T05:13:13.008 INFO:tasks.workunit.client.0.smithi099.stdout:2/422: readlink d10/l17 0 2024-01-31T05:13:13.009 INFO:tasks.workunit.client.0.smithi099.stdout:8/519: mkdir d1/dd/d11/da9 0 2024-01-31T05:13:13.011 INFO:tasks.workunit.client.0.smithi099.stdout:1/442: dwrite d4/db/d24/d4b/f77 [0,4194304] 0 2024-01-31T05:13:13.011 INFO:tasks.workunit.client.0.smithi099.stdout:1/443: creat d4/dc/d48/f8c x:0 0 0 2024-01-31T05:13:13.012 INFO:tasks.workunit.client.0.smithi099.stdout:1/444: truncate d4/dc/d48/f3d 813217 0 2024-01-31T05:13:13.012 INFO:tasks.workunit.client.0.smithi099.stdout:1/445: dread - d4/dc/d29/f7c zero size 2024-01-31T05:13:13.012 INFO:tasks.workunit.client.0.smithi099.stdout:1/446: dread - d4/dc/d48/f8c zero size 2024-01-31T05:13:13.012 INFO:tasks.workunit.client.0.smithi099.stdout:5/457: creat d6/da/d14/d3d/d57/f97 x:0 0 0 2024-01-31T05:13:13.012 INFO:tasks.workunit.client.0.smithi099.stdout:5/458: stat d6/da/d14/d2b/f6a 0 2024-01-31T05:13:13.012 INFO:tasks.workunit.client.0.smithi099.stdout:5/459: read - d6/da/d14/d61/f84 zero size 2024-01-31T05:13:13.014 INFO:tasks.workunit.client.0.smithi099.stdout:3/465: mkdir d10/d27/d34/d44/d60/d75/d8c/db1 0 2024-01-31T05:13:13.016 INFO:tasks.workunit.client.0.smithi099.stdout:3/466: symlink d10/d27/d34/d44/d95/daf/lb2 0 2024-01-31T05:13:13.022 INFO:tasks.workunit.client.0.smithi099.stdout:6/378: getdents d14/d18/d1a 0 2024-01-31T05:13:13.022 INFO:tasks.workunit.client.0.smithi099.stdout:6/379: write d14/d18/d52/d22/d71/f72 [443429,130152] 0 2024-01-31T05:13:13.024 INFO:tasks.workunit.client.0.smithi099.stdout:9/410: dwrite d0/d7/f66 [0,4194304] 0 2024-01-31T05:13:13.024 INFO:tasks.workunit.client.0.smithi099.stdout:9/411: chown d0/d1/d24/d2b/d59 62 1 2024-01-31T05:13:13.024 INFO:tasks.workunit.client.0.smithi099.stdout:9/412: fsync d0/d7/d2e/f71 0 2024-01-31T05:13:13.028 INFO:tasks.workunit.client.0.smithi099.stdout:6/380: dread d14/d18/d1a/d1c/f44 [0,4194304] 0 2024-01-31T05:13:13.028 INFO:tasks.workunit.client.0.smithi099.stdout:6/381: readlink d14/d18/d1a/d1c/d29/l4d 0 2024-01-31T05:13:13.028 INFO:tasks.workunit.client.0.smithi099.stdout:9/413: rmdir d0/d1/d24/d2b 39 2024-01-31T05:13:13.030 INFO:tasks.workunit.client.0.smithi099.stdout:9/414: mkdir d0/d3e/d33/d8a 0 2024-01-31T05:13:13.031 INFO:tasks.workunit.client.0.smithi099.stdout:9/415: creat d0/d3e/f8b x:0 0 0 2024-01-31T05:13:13.031 INFO:tasks.workunit.client.0.smithi099.stdout:6/382: rename d14/d18/d1a/d1c/l36 to d14/d18/d1a/d1c/d29/d4f/l74 0 2024-01-31T05:13:13.031 INFO:tasks.workunit.client.0.smithi099.stdout:6/383: write d14/d18/d1a/d1c/d29/d4f/f57 [798825,114319] 0 2024-01-31T05:13:13.032 INFO:tasks.workunit.client.0.smithi099.stdout:9/416: link d0/d44/c84 d0/d1/d5e/c8c 0 2024-01-31T05:13:13.033 INFO:tasks.workunit.client.0.smithi099.stdout:6/384: truncate fa 4482872 0 2024-01-31T05:13:13.038 INFO:tasks.workunit.client.0.smithi099.stdout:6/385: dread d14/f17 [0,4194304] 0 2024-01-31T05:13:13.038 INFO:tasks.workunit.client.0.smithi099.stdout:6/386: write d14/f17 [2330574,79047] 0 2024-01-31T05:13:13.039 INFO:tasks.workunit.client.0.smithi099.stdout:6/387: truncate d14/d18/d52/f47 2672434 0 2024-01-31T05:13:13.040 INFO:tasks.workunit.client.0.smithi099.stdout:6/388: creat d14/d18/d1a/d1c/f75 x:0 0 0 2024-01-31T05:13:13.048 INFO:tasks.workunit.client.0.smithi099.stdout:2/423: dwrite f1 [0,4194304] 0 2024-01-31T05:13:13.048 INFO:tasks.workunit.client.0.smithi099.stdout:3/467: dwrite d10/d32/d33/f63 [0,4194304] 0 2024-01-31T05:13:13.048 INFO:tasks.workunit.client.0.smithi099.stdout:1/447: dwrite d4/dc/d48/f31 [0,4194304] 0 2024-01-31T05:13:13.050 INFO:tasks.workunit.client.0.smithi099.stdout:3/468: truncate d10/d1e/f2b 1957360 0 2024-01-31T05:13:13.054 INFO:tasks.workunit.client.0.smithi099.stdout:2/424: mknod d10/c8e 0 2024-01-31T05:13:13.055 INFO:tasks.workunit.client.0.smithi099.stdout:3/469: truncate d10/d27/f5b 1712632 0 2024-01-31T05:13:13.055 INFO:tasks.workunit.client.0.smithi099.stdout:3/470: write d10/d27/d34/d52/f62 [4856387,8893] 0 2024-01-31T05:13:13.055 INFO:tasks.workunit.client.0.smithi099.stdout:2/425: mknod d10/d1b/d7d/c8f 0 2024-01-31T05:13:13.055 INFO:tasks.workunit.client.0.smithi099.stdout:2/426: read - d10/d1b/f6f zero size 2024-01-31T05:13:13.055 INFO:tasks.workunit.client.0.smithi099.stdout:2/427: write d10/f31 [1707587,53612] 0 2024-01-31T05:13:13.058 INFO:tasks.workunit.client.0.smithi099.stdout:2/428: truncate f0 7840308 0 2024-01-31T05:13:13.058 INFO:tasks.workunit.client.0.smithi099.stdout:2/429: stat d10/d1b/d4d/d5a/l75 0 2024-01-31T05:13:13.063 INFO:tasks.workunit.client.0.smithi099.stdout:7/401: sync 2024-01-31T05:13:13.063 INFO:tasks.workunit.client.0.smithi099.stdout:7/402: write d6/d12/f3c [1308582,20140] 0 2024-01-31T05:13:13.064 INFO:tasks.workunit.client.0.smithi099.stdout:7/403: write d6/d12/f22 [339070,41244] 0 2024-01-31T05:13:13.064 INFO:tasks.workunit.client.0.smithi099.stdout:7/404: readlink d6/d32/d3d/d4b/d33/d37/d50/d25/d47/l66 0 2024-01-31T05:13:13.064 INFO:tasks.workunit.client.0.smithi099.stdout:7/405: write d6/d32/d3d/d4b/d33/d37/d4e/f55 [592407,20624] 0 2024-01-31T05:13:13.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:12 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:13.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:12 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:13.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:12 smithi099 ceph-mon[31615]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-01-31T05:13:13.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:12 smithi099 ceph-mon[31615]: mds.? [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] up:active 2024-01-31T05:13:13.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:12 smithi099 ceph-mon[31615]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:13:13.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:12 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:13.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:12 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:13.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:12 smithi181 ceph-mon[36434]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-01-31T05:13:13.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:12 smithi181 ceph-mon[36434]: mds.? [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] up:active 2024-01-31T05:13:13.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:12 smithi181 ceph-mon[36434]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:13:13.077 INFO:tasks.workunit.client.0.smithi099.stdout:3/471: dwrite d10/f23 [0,4194304] 0 2024-01-31T05:13:13.077 INFO:tasks.workunit.client.0.smithi099.stdout:3/472: creat d10/d27/d34/d52/fb3 x:0 0 0 2024-01-31T05:13:13.080 INFO:tasks.workunit.client.0.smithi099.stdout:3/473: getdents d10/d27/d89 0 2024-01-31T05:13:13.080 INFO:tasks.workunit.client.0.smithi099.stdout:3/474: write d10/d27/d34/d44/d60/d75/d8c/f9f [690120,28872] 0 2024-01-31T05:13:13.081 INFO:tasks.workunit.client.0.smithi099.stdout:3/475: creat d10/d1e/da2/fb4 x:0 0 0 2024-01-31T05:13:13.083 INFO:tasks.workunit.client.0.smithi099.stdout:3/476: symlink d10/d27/d34/d44/d60/d75/d8c/d92/lb5 0 2024-01-31T05:13:13.083 INFO:tasks.workunit.client.0.smithi099.stdout:3/477: fsync d10/d27/fa7 0 2024-01-31T05:13:13.084 INFO:tasks.workunit.client.0.smithi099.stdout:3/478: readlink d10/d32/l4f 0 2024-01-31T05:13:13.084 INFO:tasks.workunit.client.0.smithi099.stdout:3/479: rmdir d10/d27/d34 39 2024-01-31T05:13:13.085 INFO:tasks.workunit.client.0.smithi099.stdout:3/480: mkdir d10/d27/d34/d44/d60/d75/d8c/db6 0 2024-01-31T05:13:13.088 INFO:tasks.workunit.client.0.smithi099.stdout:2/430: dwrite d10/d1c/f2d [0,4194304] 0 2024-01-31T05:13:13.090 INFO:tasks.workunit.client.0.smithi099.stdout:7/406: dwrite d6/f6f [8388608,4194304] 0 2024-01-31T05:13:13.090 INFO:tasks.workunit.client.0.smithi099.stdout:7/407: fsync d6/d32/d3d/d4b/d33/d37/d50/f45 0 2024-01-31T05:13:13.091 INFO:tasks.workunit.client.0.smithi099.stdout:2/431: rename d10/d1c/f78 to d10/d2b/d7c/f90 0 2024-01-31T05:13:13.091 INFO:tasks.workunit.client.0.smithi099.stdout:2/432: stat d10/d3a/l3e 0 2024-01-31T05:13:13.097 INFO:tasks.workunit.client.0.smithi099.stdout:7/408: creat d6/d12/f85 x:0 0 0 2024-01-31T05:13:13.099 INFO:tasks.workunit.client.0.smithi099.stdout:2/433: mknod d10/d1b/c91 0 2024-01-31T05:13:13.099 INFO:tasks.workunit.client.0.smithi099.stdout:3/481: write d10/d32/f4e [1976553,118304] 0 2024-01-31T05:13:13.099 INFO:tasks.workunit.client.0.smithi099.stdout:7/409: symlink d6/d32/d3d/d4b/d33/d37/l86 0 2024-01-31T05:13:13.100 INFO:tasks.workunit.client.0.smithi099.stdout:2/434: symlink d10/d1b/d83/l92 0 2024-01-31T05:13:13.104 INFO:tasks.workunit.client.0.smithi099.stdout:2/435: truncate f4 783360 0 2024-01-31T05:13:13.104 INFO:tasks.workunit.client.0.smithi099.stdout:2/436: write d10/d1c/f55 [1041391,35282] 0 2024-01-31T05:13:13.104 INFO:tasks.workunit.client.0.smithi099.stdout:2/437: chown d10/d1b/f23 5 1 2024-01-31T05:13:13.107 INFO:tasks.workunit.client.0.smithi099.stdout:2/438: rmdir d10/d2b 39 2024-01-31T05:13:13.108 INFO:tasks.workunit.client.0.smithi099.stdout:2/439: creat d10/d2b/d7c/f93 x:0 0 0 2024-01-31T05:13:13.111 INFO:tasks.workunit.client.0.smithi099.stdout:7/410: dread d6/d32/d3d/d4b/d33/d37/d4e/f74 [0,4194304] 0 2024-01-31T05:13:13.112 INFO:tasks.workunit.client.0.smithi099.stdout:7/411: rmdir d6/d32/d3d/d4b/d33/d37/d50/d25 39 2024-01-31T05:13:13.127 INFO:tasks.workunit.client.0.smithi099.stdout:3/482: dwrite d10/d24/d40/f82 [0,4194304] 0 2024-01-31T05:13:13.127 INFO:tasks.workunit.client.0.smithi099.stdout:3/483: write d10/d32/d33/f61 [597763,52858] 0 2024-01-31T05:13:13.127 INFO:tasks.workunit.client.0.smithi099.stdout:3/484: stat d10/d32/d85/c3f 0 2024-01-31T05:13:13.129 INFO:tasks.workunit.client.0.smithi099.stdout:3/485: creat d10/d24/d40/d81/fb7 x:0 0 0 2024-01-31T05:13:13.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:12 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:13.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:12 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:13.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:12 smithi179 ceph-mon[35652]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-01-31T05:13:13.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:12 smithi179 ceph-mon[35652]: mds.? [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] up:active 2024-01-31T05:13:13.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:12 smithi179 ceph-mon[35652]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:13:13.135 INFO:tasks.workunit.client.0.smithi099.stdout:0/437: sync 2024-01-31T05:13:13.135 INFO:tasks.workunit.client.0.smithi099.stdout:0/438: fdatasync d1/d30/d45/d66/f32 0 2024-01-31T05:13:13.136 INFO:tasks.workunit.client.0.smithi099.stdout:0/439: chown d1/l39 5668478 1 2024-01-31T05:13:13.137 INFO:tasks.workunit.client.0.smithi099.stdout:0/440: creat d1/d37/d4a/d7a/f90 x:0 0 0 2024-01-31T05:13:13.137 INFO:tasks.workunit.client.0.smithi099.stdout:0/441: chown d1/d22 553171 1 2024-01-31T05:13:13.138 INFO:tasks.workunit.client.0.smithi099.stdout:0/442: mknod d1/d22/c91 0 2024-01-31T05:13:13.139 INFO:tasks.workunit.client.0.smithi099.stdout:0/443: rmdir d1/d8 39 2024-01-31T05:13:13.140 INFO:tasks.workunit.client.0.smithi099.stdout:2/440: dwrite d10/f31 [0,4194304] 0 2024-01-31T05:13:13.140 INFO:tasks.workunit.client.0.smithi099.stdout:2/441: write d10/d2b/d7c/f93 [508937,125971] 0 2024-01-31T05:13:13.140 INFO:tasks.workunit.client.0.smithi099.stdout:7/412: dwrite d6/d32/f5b [0,4194304] 0 2024-01-31T05:13:13.140 INFO:tasks.workunit.client.0.smithi099.stdout:7/413: truncate d6/d32/d3d/d4b/d33/d37/d50/d25/f4c 696267 0 2024-01-31T05:13:13.143 INFO:tasks.workunit.client.0.smithi099.stdout:2/442: rmdir d10 39 2024-01-31T05:13:13.144 INFO:tasks.workunit.client.0.smithi099.stdout:7/414: link d6/d32/d3d/d4b/l70 d6/d32/d3d/d4b/d33/d37/d50/d4d/l87 0 2024-01-31T05:13:13.146 INFO:tasks.workunit.client.0.smithi099.stdout:2/443: mkdir d10/d3a/d94 0 2024-01-31T05:13:13.147 INFO:tasks.workunit.client.0.smithi099.stdout:7/415: symlink d6/d32/d3d/d4b/d33/d37/d4e/l88 0 2024-01-31T05:13:13.148 INFO:tasks.workunit.client.0.smithi099.stdout:2/444: mkdir d10/d1b/d83/d86/d95 0 2024-01-31T05:13:13.149 INFO:tasks.workunit.client.0.smithi099.stdout:2/445: rmdir d10/d1b/d7d 39 2024-01-31T05:13:13.149 INFO:tasks.workunit.client.0.smithi099.stdout:7/416: link d6/d32/d3d/d4b/d33/d37/d50/d25/d47/c5c d6/d32/d3d/d4b/d33/d37/d50/c89 0 2024-01-31T05:13:13.150 INFO:tasks.workunit.client.0.smithi099.stdout:0/444: dread d1/f80 [0,4194304] 0 2024-01-31T05:13:13.150 INFO:tasks.workunit.client.0.smithi099.stdout:0/445: chown d1/d16/d36/f6a 122140650 1 2024-01-31T05:13:13.150 INFO:tasks.workunit.client.0.smithi099.stdout:7/417: rmdir d6/d6a 0 2024-01-31T05:13:13.150 INFO:tasks.workunit.client.0.smithi099.stdout:2/446: creat d10/d1b/d83/d86/d95/f96 x:0 0 0 2024-01-31T05:13:13.153 INFO:tasks.workunit.client.0.smithi099.stdout:3/486: dwrite d10/d32/d85/f2c [4194304,4194304] 0 2024-01-31T05:13:13.153 INFO:tasks.workunit.client.0.smithi099.stdout:3/487: stat d10/d27/d34/d44/d60/f83 0 2024-01-31T05:13:13.161 INFO:tasks.workunit.client.0.smithi099.stdout:2/447: dread d10/d20/f4c [0,4194304] 0 2024-01-31T05:13:13.163 INFO:tasks.workunit.client.0.smithi099.stdout:2/448: unlink d10/d2b/f5c 0 2024-01-31T05:13:13.164 INFO:tasks.workunit.client.0.smithi099.stdout:2/449: mkdir d10/d2b/d97 0 2024-01-31T05:13:13.168 INFO:tasks.workunit.client.0.smithi099.stdout:7/418: dread d6/d32/d3d/f60 [0,4194304] 0 2024-01-31T05:13:13.168 INFO:tasks.workunit.client.0.smithi099.stdout:7/419: chown d6/d32/d3d/d4b/d33/l49 160 1 2024-01-31T05:13:13.168 INFO:tasks.workunit.client.0.smithi099.stdout:7/420: getdents d6/d32/d3d/d4b/d33/d37/d50/d25/d79 0 2024-01-31T05:13:13.169 INFO:tasks.workunit.client.0.smithi099.stdout:7/421: symlink d6/d32/d3d/d4b/d33/d37/d50/d4d/d58/l8a 0 2024-01-31T05:13:13.169 INFO:tasks.workunit.client.0.smithi099.stdout:7/422: truncate d6/d32/d3d/d4b/d33/f71 878559 0 2024-01-31T05:13:13.178 INFO:tasks.workunit.client.0.smithi099.stdout:0/446: dwrite d1/f4 [0,4194304] 0 2024-01-31T05:13:13.178 INFO:tasks.workunit.client.0.smithi099.stdout:3/488: write d10/d27/d34/d52/f62 [2254784,84269] 0 2024-01-31T05:13:13.179 INFO:tasks.workunit.client.0.smithi099.stdout:0/447: rename d1/d30/d45/l4f to d1/d16/l92 0 2024-01-31T05:13:13.180 INFO:tasks.workunit.client.0.smithi099.stdout:3/489: truncate d10/f23 16851 0 2024-01-31T05:13:13.182 INFO:tasks.workunit.client.0.smithi099.stdout:3/490: symlink d10/d24/d40/d81/lb8 0 2024-01-31T05:13:13.182 INFO:tasks.workunit.client.0.smithi099.stdout:3/491: dread - d10/d24/f8a zero size 2024-01-31T05:13:13.184 INFO:tasks.workunit.client.0.smithi099.stdout:0/448: rmdir d1/d30/d45/d66 39 2024-01-31T05:13:13.184 INFO:tasks.workunit.client.0.smithi099.stdout:3/492: mkdir d10/d32/d85/da3/db9 0 2024-01-31T05:13:13.195 INFO:tasks.workunit.client.0.smithi099.stdout:2/450: dwrite d10/d1c/f2d [0,4194304] 0 2024-01-31T05:13:13.197 INFO:tasks.workunit.client.0.smithi099.stdout:7/423: dwrite d6/d32/d3d/d4b/f23 [0,4194304] 0 2024-01-31T05:13:13.197 INFO:tasks.workunit.client.0.smithi099.stdout:7/424: chown d6/d32/d3d/d4b/d33/d37/d50/d25/d47/l66 10 1 2024-01-31T05:13:13.197 INFO:tasks.workunit.client.0.smithi099.stdout:7/425: read - d6/d32/d3d/f5f zero size 2024-01-31T05:13:13.197 INFO:tasks.workunit.client.0.smithi099.stdout:7/426: write d6/d32/d3d/d4b/d33/d37/d50/d25/d47/f57 [469690,29916] 0 2024-01-31T05:13:13.197 INFO:tasks.workunit.client.0.smithi099.stdout:7/427: fdatasync d6/d32/d3d/d4b/d33/d37/d4e/f62 0 2024-01-31T05:13:13.198 INFO:tasks.workunit.client.0.smithi099.stdout:7/428: dread d6/d32/d3d/d4b/f2f [0,4194304] 0 2024-01-31T05:13:13.198 INFO:tasks.workunit.client.0.smithi099.stdout:7/429: fdatasync d6/d32/d3d/d4b/d33/d37/d50/d25/f4c 0 2024-01-31T05:13:13.198 INFO:tasks.workunit.client.0.smithi099.stdout:2/451: creat d10/d3a/d69/d82/f98 x:0 0 0 2024-01-31T05:13:13.204 INFO:tasks.workunit.client.0.smithi099.stdout:7/430: truncate d6/f52 3791469 0 2024-01-31T05:13:13.204 INFO:tasks.workunit.client.0.smithi099.stdout:7/431: chown d6/d32/d3d/d4b/d33/d37/d50/d25/d47/f57 112929929 1 2024-01-31T05:13:13.205 INFO:tasks.workunit.client.0.smithi099.stdout:7/432: getdents d6/d32/d3d/d4b/d33/d37/d50/d25/d43 0 2024-01-31T05:13:13.205 INFO:tasks.workunit.client.0.smithi099.stdout:7/433: write d6/f6f [4656827,33586] 0 2024-01-31T05:13:13.205 INFO:tasks.workunit.client.0.smithi099.stdout:7/434: chown d6/d32/d3d/d4b/c59 9 1 2024-01-31T05:13:13.209 INFO:tasks.workunit.client.0.smithi099.stdout:0/449: dwrite d1/d8/f5f [0,4194304] 0 2024-01-31T05:13:13.210 INFO:tasks.workunit.client.0.smithi099.stdout:7/435: rename d6/d32/c3b to d6/d32/d3d/d4b/d33/d37/d50/d25/d72/c8b 0 2024-01-31T05:13:13.210 INFO:tasks.workunit.client.0.smithi099.stdout:7/436: chown d6/d32/d3d/d46 602 1 2024-01-31T05:13:13.210 INFO:tasks.workunit.client.0.smithi099.stdout:7/437: read d6/d32/d3d/d4b/d33/d37/f40 [4724992,127040] 0 2024-01-31T05:13:13.214 INFO:tasks.workunit.client.0.smithi099.stdout:2/452: write d10/d1c/f39 [975434,127897] 0 2024-01-31T05:13:13.215 INFO:tasks.workunit.client.0.smithi099.stdout:2/453: fdatasync d10/d1c/f39 0 2024-01-31T05:13:13.218 INFO:tasks.workunit.client.0.smithi099.stdout:4/448: sync 2024-01-31T05:13:13.219 INFO:tasks.workunit.client.0.smithi099.stdout:8/520: sync 2024-01-31T05:13:13.219 INFO:tasks.workunit.client.0.smithi099.stdout:4/449: write d0/d2/d20/f38 [917538,96623] 0 2024-01-31T05:13:13.221 INFO:tasks.workunit.client.0.smithi099.stdout:4/450: mkdir d0/d8/d19/d99/d9e 0 2024-01-31T05:13:13.221 INFO:tasks.workunit.client.0.smithi099.stdout:4/451: write d0/d8/d19/d65/f6d [1184931,97328] 0 2024-01-31T05:13:13.221 INFO:tasks.workunit.client.0.smithi099.stdout:4/452: write d0/d2/d4b/d93/d17/d3d/f6a [978131,99564] 0 2024-01-31T05:13:13.223 INFO:tasks.workunit.client.0.smithi099.stdout:4/453: getdents d0/d2/d4b/d93/d39/d66 0 2024-01-31T05:13:13.223 INFO:tasks.workunit.client.0.smithi099.stdout:0/450: dread d1/d16/d36/f6a [0,4194304] 0 2024-01-31T05:13:13.224 INFO:tasks.workunit.client.0.smithi099.stdout:0/451: link d1/d16/f50 d1/d37/f93 0 2024-01-31T05:13:13.225 INFO:tasks.workunit.client.0.smithi099.stdout:0/452: creat d1/d22/f94 x:0 0 0 2024-01-31T05:13:13.226 INFO:tasks.workunit.client.0.smithi099.stdout:0/453: symlink d1/d30/l95 0 2024-01-31T05:13:13.226 INFO:tasks.workunit.client.0.smithi099.stdout:0/454: creat d1/d37/f96 x:0 0 0 2024-01-31T05:13:13.233 INFO:tasks.workunit.client.0.smithi099.stdout:8/521: write d1/dd/d11/d19/f53 [1363443,11735] 0 2024-01-31T05:13:13.233 INFO:tasks.workunit.client.0.smithi099.stdout:8/522: chown d1/dd/d65/d7f/d81 47277626 1 2024-01-31T05:13:13.240 INFO:tasks.workunit.client.0.smithi099.stdout:8/523: read d1/dd/d11/d29/d3f/d56/f88 [3675278,98468] 0 2024-01-31T05:13:13.242 INFO:tasks.workunit.client.0.smithi099.stdout:4/454: write d0/d8/f64 [1838546,36070] 0 2024-01-31T05:13:13.242 INFO:tasks.workunit.client.0.smithi099.stdout:4/455: dread - d0/d8/d19/d54/d76/f9d zero size 2024-01-31T05:13:13.242 INFO:tasks.workunit.client.0.smithi099.stdout:8/524: rename d1/dd/d11/d29/d3f/d56/da0/l93 to d1/dd/d11/d19/d21/laa 0 2024-01-31T05:13:13.244 INFO:tasks.workunit.client.0.smithi099.stdout:4/456: creat d0/d2/f9f x:0 0 0 2024-01-31T05:13:13.244 INFO:tasks.workunit.client.0.smithi099.stdout:4/457: write d0/d79/f92 [464194,8830] 0 2024-01-31T05:13:13.244 INFO:tasks.workunit.client.0.smithi099.stdout:4/458: truncate d0/d8/d19/d54/d76/f9d 366902 0 2024-01-31T05:13:13.244 INFO:tasks.workunit.client.0.smithi099.stdout:4/459: stat d0/d2/d4b/d93/d59 0 2024-01-31T05:13:13.244 INFO:tasks.workunit.client.0.smithi099.stdout:4/460: readlink d0/d2/d4b/d93/d39/d66/l88 0 2024-01-31T05:13:13.245 INFO:tasks.workunit.client.0.smithi099.stdout:8/525: symlink d1/dd/d7b/d85/lab 0 2024-01-31T05:13:13.245 INFO:tasks.workunit.client.0.smithi099.stdout:8/526: stat d1/dd/d1d/f9a 0 2024-01-31T05:13:13.246 INFO:tasks.workunit.client.0.smithi099.stdout:4/461: unlink d0/d8/d19/d54/f8a 0 2024-01-31T05:13:13.247 INFO:tasks.workunit.client.0.smithi099.stdout:8/527: creat d1/dd/d11/d29/d3f/d56/da0/fac x:0 0 0 2024-01-31T05:13:13.249 INFO:tasks.workunit.client.0.smithi099.stdout:4/462: creat d0/d8/d19/d99/fa0 x:0 0 0 2024-01-31T05:13:13.249 INFO:tasks.workunit.client.0.smithi099.stdout:4/463: chown d0/d2/d20/l6e 5939 1 2024-01-31T05:13:13.249 INFO:tasks.workunit.client.0.smithi099.stdout:4/464: fdatasync d0/d2/d20/f31 0 2024-01-31T05:13:13.249 INFO:tasks.workunit.client.0.smithi099.stdout:4/465: truncate d0/d2/f15 5228613 0 2024-01-31T05:13:13.249 INFO:tasks.workunit.client.0.smithi099.stdout:4/466: getdents d0/d2/d4b/d93/d59/d9c 0 2024-01-31T05:13:13.249 INFO:tasks.workunit.client.0.smithi099.stdout:4/467: write d0/d8/d19/d54/d76/f9d [871351,93422] 0 2024-01-31T05:13:13.252 INFO:tasks.workunit.client.0.smithi099.stdout:4/468: creat d0/d8/fa1 x:0 0 0 2024-01-31T05:13:13.252 INFO:tasks.workunit.client.0.smithi099.stdout:7/438: dwrite d6/d32/d3d/d4b/d33/d37/d50/d25/d47/f57 [0,4194304] 0 2024-01-31T05:13:13.252 INFO:tasks.workunit.client.0.smithi099.stdout:2/454: dwrite d10/f15 [0,4194304] 0 2024-01-31T05:13:13.253 INFO:tasks.workunit.client.0.smithi099.stdout:4/469: getdents d0/d2/d4b/d93/d59 0 2024-01-31T05:13:13.253 INFO:tasks.workunit.client.0.smithi099.stdout:4/470: stat d0/d2/d4b/d93/d59/d82/l97 0 2024-01-31T05:13:13.254 INFO:tasks.workunit.client.0.smithi099.stdout:0/455: dwrite d1/d30/d45/d66/f15 [0,4194304] 0 2024-01-31T05:13:13.254 INFO:tasks.workunit.client.0.smithi099.stdout:0/456: fdatasync d1/d16/f1c 0 2024-01-31T05:13:13.261 INFO:tasks.workunit.client.0.smithi099.stdout:4/471: dread d0/d8/f63 [0,4194304] 0 2024-01-31T05:13:13.278 INFO:tasks.workunit.client.0.smithi099.stdout:7/439: dwrite d6/ff [0,4194304] 0 2024-01-31T05:13:13.293 INFO:tasks.workunit.client.0.smithi099.stdout:2/455: dwrite d10/d51/f54 [0,4194304] 0 2024-01-31T05:13:13.293 INFO:tasks.workunit.client.0.smithi099.stdout:0/457: dwrite d1/d16/d36/f6a [4194304,4194304] 0 2024-01-31T05:13:13.295 INFO:tasks.workunit.client.0.smithi099.stdout:0/458: mkdir d1/d30/d45/d66/d97 0 2024-01-31T05:13:13.295 INFO:tasks.workunit.client.0.smithi099.stdout:0/459: fdatasync d1/d37/d73/f7e 0 2024-01-31T05:13:13.297 INFO:tasks.workunit.client.0.smithi099.stdout:2/456: dread d10/d20/f50 [0,4194304] 0 2024-01-31T05:13:13.297 INFO:tasks.workunit.client.0.smithi099.stdout:4/472: dwrite d0/d8/d19/d54/d76/f9d [0,4194304] 0 2024-01-31T05:13:13.297 INFO:tasks.workunit.client.0.smithi099.stdout:4/473: readlink d0/d2/d4b/d93/d17/d3d/l78 0 2024-01-31T05:13:13.297 INFO:tasks.workunit.client.0.smithi099.stdout:0/460: symlink d1/d37/d4a/d6f/l98 0 2024-01-31T05:13:13.297 INFO:tasks.workunit.client.0.smithi099.stdout:0/461: write d1/d37/d4a/d7a/f4b [168641,88077] 0 2024-01-31T05:13:13.297 INFO:tasks.workunit.client.0.smithi099.stdout:0/462: fdatasync d1/d30/d45/d6e/f74 0 2024-01-31T05:13:13.298 INFO:tasks.workunit.client.0.smithi099.stdout:4/474: read d0/d8/f63 [1456021,127306] 0 2024-01-31T05:13:13.298 INFO:tasks.workunit.client.0.smithi099.stdout:4/475: fsync d0/d79/f92 0 2024-01-31T05:13:13.298 INFO:tasks.workunit.client.0.smithi099.stdout:4/476: fsync d0/f5b 0 2024-01-31T05:13:13.299 INFO:tasks.workunit.client.0.smithi099.stdout:4/477: rename d0/d2/l46 to d0/d2/d20/d84/la2 0 2024-01-31T05:13:13.304 INFO:tasks.workunit.client.0.smithi099.stdout:7/440: dwrite d6/fc [4194304,4194304] 0 2024-01-31T05:13:13.305 INFO:tasks.workunit.client.0.smithi099.stdout:7/441: chown d6/d32/d3d/d4b/d33/d37/d4e/f62 413860 1 2024-01-31T05:13:13.305 INFO:tasks.workunit.client.0.smithi099.stdout:7/442: write d6/d32/d3d/d4b/d33/d37/d50/d25/d47/f57 [4417264,81258] 0 2024-01-31T05:13:13.307 INFO:tasks.workunit.client.0.smithi099.stdout:2/457: dread d10/d1c/f26 [4194304,4194304] 0 2024-01-31T05:13:13.307 INFO:tasks.workunit.client.0.smithi099.stdout:2/458: dread - d10/d3a/f52 zero size 2024-01-31T05:13:13.307 INFO:tasks.workunit.client.0.smithi099.stdout:2/459: chown d10/f33 4320 1 2024-01-31T05:13:13.307 INFO:tasks.workunit.client.0.smithi099.stdout:2/460: chown d10/d3a/f70 1901292261 1 2024-01-31T05:13:13.312 INFO:tasks.workunit.client.0.smithi099.stdout:2/461: link lf d10/d1c/d43/l99 0 2024-01-31T05:13:13.313 INFO:tasks.workunit.client.0.smithi099.stdout:7/443: getdents d6/d32/d3d/d4b/d33/d37 0 2024-01-31T05:13:13.316 INFO:tasks.workunit.client.0.smithi099.stdout:7/444: unlink d6/d12/l54 0 2024-01-31T05:13:13.318 INFO:tasks.workunit.client.0.smithi099.stdout:7/445: getdents d6/d32/d3d/d4b 0 2024-01-31T05:13:13.322 INFO:tasks.workunit.client.0.smithi099.stdout:0/463: dwrite d1/d37/d73/f7e [0,4194304] 0 2024-01-31T05:13:13.322 INFO:tasks.workunit.client.0.smithi099.stdout:0/464: fdatasync d1/d16/d36/f3e 0 2024-01-31T05:13:13.322 INFO:tasks.workunit.client.0.smithi099.stdout:0/465: readlink d1/d30/d45/l6c 0 2024-01-31T05:13:13.323 INFO:tasks.workunit.client.0.smithi099.stdout:5/460: sync 2024-01-31T05:13:13.323 INFO:tasks.workunit.client.0.smithi099.stdout:9/417: sync 2024-01-31T05:13:13.323 INFO:tasks.workunit.client.0.smithi099.stdout:9/418: read - d0/d1/d24/d48/f7a zero size 2024-01-31T05:13:13.323 INFO:tasks.workunit.client.0.smithi099.stdout:9/419: write d0/d7/f1f [4490446,27700] 0 2024-01-31T05:13:13.324 INFO:tasks.workunit.client.0.smithi099.stdout:0/466: symlink d1/d30/d45/d66/d97/l99 0 2024-01-31T05:13:13.324 INFO:tasks.workunit.client.0.smithi099.stdout:5/461: mkdir d6/da/d14/d61/d98 0 2024-01-31T05:13:13.325 INFO:tasks.workunit.client.0.smithi099.stdout:9/420: link d0/d1/l26 d0/d5d/l8d 0 2024-01-31T05:13:13.327 INFO:tasks.workunit.client.0.smithi099.stdout:0/467: creat d1/d37/d4a/f9a x:0 0 0 2024-01-31T05:13:13.327 INFO:tasks.workunit.client.0.smithi099.stdout:7/446: dread d6/d32/d3d/d4b/f1b [0,4194304] 0 2024-01-31T05:13:13.327 INFO:tasks.workunit.client.0.smithi099.stdout:5/462: dread d6/da/d14/d3d/d6e/f3a [0,4194304] 0 2024-01-31T05:13:13.328 INFO:tasks.workunit.client.0.smithi099.stdout:9/421: creat d0/f8e x:0 0 0 2024-01-31T05:13:13.328 INFO:tasks.workunit.client.0.smithi099.stdout:9/422: fsync d0/d1/d24/d2b/f1b 0 2024-01-31T05:13:13.328 INFO:tasks.workunit.client.0.smithi099.stdout:9/423: fdatasync d0/d7/f68 0 2024-01-31T05:13:13.328 INFO:tasks.workunit.client.0.smithi099.stdout:9/424: fsync d0/d1/d24/d2b/d63/f7e 0 2024-01-31T05:13:13.329 INFO:tasks.workunit.client.0.smithi099.stdout:0/468: creat d1/d30/d45/d66/f9b x:0 0 0 2024-01-31T05:13:13.330 INFO:tasks.workunit.client.0.smithi099.stdout:5/463: mkdir d6/da/d14/d3d/d8c/d99 0 2024-01-31T05:13:13.330 INFO:tasks.workunit.client.0.smithi099.stdout:5/464: chown d6/da/d14/d2b/d7b 1234671 1 2024-01-31T05:13:13.330 INFO:tasks.workunit.client.0.smithi099.stdout:9/425: symlink d0/d1/l8f 0 2024-01-31T05:13:13.332 INFO:tasks.workunit.client.0.smithi099.stdout:0/469: unlink d1/d37/d4a/c51 0 2024-01-31T05:13:13.332 INFO:tasks.workunit.client.0.smithi099.stdout:0/470: chown d1/d16/l92 6844840 1 2024-01-31T05:13:13.332 INFO:tasks.workunit.client.0.smithi099.stdout:4/478: dwrite d0/d8/d19/f83 [4194304,4194304] 0 2024-01-31T05:13:13.333 INFO:tasks.workunit.client.0.smithi099.stdout:5/465: mkdir d6/da/d14/d3d/d51/d82/d9a 0 2024-01-31T05:13:13.334 INFO:tasks.workunit.client.0.smithi099.stdout:9/426: rename d0/d1/d24/d2b/d63/f74 to d0/d1/d5e/d72/d89/f90 0 2024-01-31T05:13:13.335 INFO:tasks.workunit.client.0.smithi099.stdout:0/471: creat d1/d16/d36/d8b/f9c x:0 0 0 2024-01-31T05:13:13.341 INFO:tasks.workunit.client.0.smithi099.stdout:4/479: rename d0/d2/d4b/d93/d17/d24/c51 to d0/d2/d4b/d93/d59/d8f/ca3 0 2024-01-31T05:13:13.342 INFO:tasks.workunit.client.0.smithi099.stdout:9/427: getdents d0/d3e/d33 0 2024-01-31T05:13:13.342 INFO:tasks.workunit.client.0.smithi099.stdout:9/428: stat d0/d1/d24/d2b/d7b/f88 0 2024-01-31T05:13:13.343 INFO:tasks.workunit.client.0.smithi099.stdout:4/480: write d0/d8/f63 [8256,22182] 0 2024-01-31T05:13:13.343 INFO:tasks.workunit.client.0.smithi099.stdout:4/481: readlink d0/d1e/d61/l85 0 2024-01-31T05:13:13.343 INFO:tasks.workunit.client.0.smithi099.stdout:4/482: write d0/d8/d19/f1c [206822,85347] 0 2024-01-31T05:13:13.343 INFO:tasks.workunit.client.0.smithi099.stdout:4/483: chown d0/d2/c40 7 1 2024-01-31T05:13:13.343 INFO:tasks.workunit.client.0.smithi099.stdout:4/484: write d0/d8/f63 [3000318,117261] 0 2024-01-31T05:13:13.343 INFO:tasks.workunit.client.0.smithi099.stdout:4/485: fsync d0/d8/d19/d54/d76/f9d 0 2024-01-31T05:13:13.343 INFO:tasks.workunit.client.0.smithi099.stdout:4/486: read - d0/d2/d4b/d93/f94 zero size 2024-01-31T05:13:13.343 INFO:tasks.workunit.client.0.smithi099.stdout:0/472: mkdir d1/d37/d4a/d7a/d9d 0 2024-01-31T05:13:13.343 INFO:tasks.workunit.client.0.smithi099.stdout:4/487: rmdir d0/d1e/d72 0 2024-01-31T05:13:13.344 INFO:tasks.workunit.client.0.smithi099.stdout:5/466: rename d6/da/d14/d2b/f6a to d6/da/d3f/f9b 0 2024-01-31T05:13:13.344 INFO:tasks.workunit.client.0.smithi099.stdout:5/467: chown d6/da/d14/d3d/d6e/d21/c32 6321669 1 2024-01-31T05:13:13.345 INFO:tasks.workunit.client.0.smithi099.stdout:9/429: unlink d0/d1/d24/d48/f51 0 2024-01-31T05:13:13.345 INFO:tasks.workunit.client.0.smithi099.stdout:9/430: read - d0/d1/d5e/d72/d89/f90 zero size 2024-01-31T05:13:13.346 INFO:tasks.workunit.client.0.smithi099.stdout:9/431: read - d0/d5d/f81 zero size 2024-01-31T05:13:13.346 INFO:tasks.workunit.client.0.smithi099.stdout:9/432: creat d0/d5d/f91 x:0 0 0 2024-01-31T05:13:13.347 INFO:tasks.workunit.client.0.smithi099.stdout:4/488: creat d0/d2/d4b/d93/d59/d8f/fa4 x:0 0 0 2024-01-31T05:13:13.349 INFO:tasks.workunit.client.0.smithi099.stdout:0/473: rename d1/d8/f3f to d1/d37/d4a/d7b/f9e 0 2024-01-31T05:13:13.349 INFO:tasks.workunit.client.0.smithi099.stdout:0/474: chown d1/d16/d36/d8b/f9c 118 1 2024-01-31T05:13:13.350 INFO:tasks.workunit.client.0.smithi099.stdout:5/468: truncate d6/da/d14/d3d/d51/d82/f43 438086 0 2024-01-31T05:13:13.350 INFO:tasks.workunit.client.0.smithi099.stdout:5/469: creat d6/da/d3f/f9c x:0 0 0 2024-01-31T05:13:13.351 INFO:tasks.workunit.client.0.smithi099.stdout:7/447: dwrite d6/d32/d3d/f7c [0,4194304] 0 2024-01-31T05:13:13.351 INFO:tasks.workunit.client.0.smithi099.stdout:7/448: readlink d6/d32/d3d/d4b/d33/d37/d50/d25/d47/l56 0 2024-01-31T05:13:13.351 INFO:tasks.workunit.client.0.smithi099.stdout:7/449: chown d6/d32/d3d/d4b/d33/d37/d4e/f74 254 1 2024-01-31T05:13:13.352 INFO:tasks.workunit.client.0.smithi099.stdout:0/475: symlink d1/d16/l9f 0 2024-01-31T05:13:13.353 INFO:tasks.workunit.client.0.smithi099.stdout:9/433: dread d0/d1/fe [0,4194304] 0 2024-01-31T05:13:13.358 INFO:tasks.workunit.client.0.smithi099.stdout:2/462: link d10/d1b/c91 d10/d3a/d69/c9a 0 2024-01-31T05:13:13.358 INFO:tasks.workunit.client.0.smithi099.stdout:8/528: sync 2024-01-31T05:13:13.358 INFO:tasks.workunit.client.0.smithi099.stdout:3/493: sync 2024-01-31T05:13:13.358 INFO:tasks.workunit.client.0.smithi099.stdout:6/389: sync 2024-01-31T05:13:13.359 INFO:tasks.workunit.client.0.smithi099.stdout:1/448: sync 2024-01-31T05:13:13.359 INFO:tasks.workunit.client.0.smithi099.stdout:3/494: stat d10/d27/f29 0 2024-01-31T05:13:13.359 INFO:tasks.workunit.client.0.smithi099.stdout:8/529: write d1/dd/d11/d29/d3f/d56/da0/f3b [44402,121322] 0 2024-01-31T05:13:13.359 INFO:tasks.workunit.client.0.smithi099.stdout:2/463: mkdir d10/d1b/d9b 0 2024-01-31T05:13:13.359 INFO:tasks.workunit.client.0.smithi099.stdout:4/489: dread d0/f60 [0,4194304] 0 2024-01-31T05:13:13.360 INFO:tasks.workunit.client.0.smithi099.stdout:6/390: creat d14/d18/d1a/d1c/d29/f76 x:0 0 0 2024-01-31T05:13:13.361 INFO:tasks.workunit.client.0.smithi099.stdout:0/476: unlink d1/f48 0 2024-01-31T05:13:13.361 INFO:tasks.workunit.client.0.smithi099.stdout:5/470: write d6/ff [2929682,17347] 0 2024-01-31T05:13:13.361 INFO:tasks.workunit.client.0.smithi099.stdout:9/434: mknod d0/d7/c92 0 2024-01-31T05:13:13.361 INFO:tasks.workunit.client.0.smithi099.stdout:9/435: write d0/d1/d24/d48/f4b [801587,101268] 0 2024-01-31T05:13:13.362 INFO:tasks.workunit.client.0.smithi099.stdout:1/449: rename d4/f6b to d4/f8d 0 2024-01-31T05:13:13.363 INFO:tasks.workunit.client.0.smithi099.stdout:8/530: creat d1/dd/d11/d29/d3f/d56/da0/d2e/fad x:0 0 0 2024-01-31T05:13:13.363 INFO:tasks.workunit.client.0.smithi099.stdout:8/531: creat d1/dd/d1d/fae x:0 0 0 2024-01-31T05:13:13.364 INFO:tasks.workunit.client.0.smithi099.stdout:4/490: mknod d0/d2/d4b/d93/d17/d24/ca5 0 2024-01-31T05:13:13.365 INFO:tasks.workunit.client.0.smithi099.stdout:5/471: mknod d6/da/d14/d3d/d51/d82/d9a/c9d 0 2024-01-31T05:13:13.367 INFO:tasks.workunit.client.0.smithi099.stdout:9/436: write d0/d3e/f6f [246889,34930] 0 2024-01-31T05:13:13.367 INFO:tasks.workunit.client.0.smithi099.stdout:9/437: write d0/d5d/f79 [320918,36296] 0 2024-01-31T05:13:13.367 INFO:tasks.workunit.client.0.smithi099.stdout:9/438: chown d0/d7/f13 195752 1 2024-01-31T05:13:13.368 INFO:tasks.workunit.client.0.smithi099.stdout:8/532: mknod d1/dd/d11/d29/d3f/d56/da0/caf 0 2024-01-31T05:13:13.371 INFO:tasks.workunit.client.0.smithi099.stdout:3/495: write d10/d32/d85/f22 [3373940,31563] 0 2024-01-31T05:13:13.371 INFO:tasks.workunit.client.0.smithi099.stdout:3/496: readlink d10/l12 0 2024-01-31T05:13:13.371 INFO:tasks.workunit.client.0.smithi099.stdout:3/497: fdatasync d10/d32/d85/f2c 0 2024-01-31T05:13:13.371 INFO:tasks.workunit.client.0.smithi099.stdout:8/533: dread d1/dd/d11/d29/f2a [0,4194304] 0 2024-01-31T05:13:13.373 INFO:tasks.workunit.client.0.smithi099.stdout:5/472: mkdir d6/da/d14/d2b/d9e 0 2024-01-31T05:13:13.373 INFO:tasks.workunit.client.0.smithi099.stdout:5/473: truncate d6/da/d3f/d73/f88 76183 0 2024-01-31T05:13:13.373 INFO:tasks.workunit.client.0.smithi099.stdout:5/474: write d6/da/d14/d2b/d7b/f96 [989890,13101] 0 2024-01-31T05:13:13.373 INFO:tasks.workunit.client.0.smithi099.stdout:5/475: creat d6/da/d14/d3d/d51/f9f x:0 0 0 2024-01-31T05:13:13.373 INFO:tasks.workunit.client.0.smithi099.stdout:6/391: dread d14/d18/d1a/d1c/d29/f31 [0,4194304] 0 2024-01-31T05:13:13.374 INFO:tasks.workunit.client.0.smithi099.stdout:2/464: write d10/f31 [696597,123951] 0 2024-01-31T05:13:13.378 INFO:tasks.workunit.client.0.smithi099.stdout:9/439: creat d0/d1/d24/d2b/d63/f93 x:0 0 0 2024-01-31T05:13:13.378 INFO:tasks.workunit.client.0.smithi099.stdout:7/450: dwrite d6/f82 [0,4194304] 0 2024-01-31T05:13:13.378 INFO:tasks.workunit.client.0.smithi099.stdout:5/476: mkdir d6/da/d14/d61/d98/da0 0 2024-01-31T05:13:13.378 INFO:tasks.workunit.client.0.smithi099.stdout:5/477: write d6/da/f19 [878801,17863] 0 2024-01-31T05:13:13.379 INFO:tasks.workunit.client.0.smithi099.stdout:4/491: getdents d0/d2/d4b/d93/d59/d8f 0 2024-01-31T05:13:13.379 INFO:tasks.workunit.client.0.smithi099.stdout:4/492: truncate d0/d1e/f35 4243058 0 2024-01-31T05:13:13.379 INFO:tasks.workunit.client.0.smithi099.stdout:4/493: truncate d0/d8/d19/d99/fa0 1010674 0 2024-01-31T05:13:13.379 INFO:tasks.workunit.client.0.smithi099.stdout:9/440: read d0/d7/f28 [4876528,26893] 0 2024-01-31T05:13:13.384 INFO:tasks.workunit.client.0.smithi099.stdout:6/392: mknod d14/d18/d52/c77 0 2024-01-31T05:13:13.384 INFO:tasks.workunit.client.0.smithi099.stdout:1/450: dread d4/dc/d29/f36 [0,4194304] 0 2024-01-31T05:13:13.384 INFO:tasks.workunit.client.0.smithi099.stdout:1/451: chown d4/f8d 1873407 1 2024-01-31T05:13:13.384 INFO:tasks.workunit.client.0.smithi099.stdout:2/465: truncate d10/f15 5786474 0 2024-01-31T05:13:13.384 INFO:tasks.workunit.client.0.smithi099.stdout:2/466: truncate d10/d1c/f85 854449 0 2024-01-31T05:13:13.384 INFO:tasks.workunit.client.0.smithi099.stdout:2/467: creat d10/d1b/d83/d86/d95/f9c x:0 0 0 2024-01-31T05:13:13.389 INFO:tasks.workunit.client.0.smithi099.stdout:7/451: creat d6/d32/d3d/d4b/d33/d37/d50/d25/d79/f8c x:0 0 0 2024-01-31T05:13:13.391 INFO:tasks.workunit.client.0.smithi099.stdout:5/478: symlink d6/da/d3f/d73/la1 0 2024-01-31T05:13:13.391 INFO:tasks.workunit.client.0.smithi099.stdout:5/479: chown d6/f18 13 1 2024-01-31T05:13:13.392 INFO:tasks.workunit.client.0.smithi099.stdout:4/494: creat d0/d2/d4b/d93/d17/d24/d3f/fa6 x:0 0 0 2024-01-31T05:13:13.393 INFO:tasks.workunit.client.0.smithi099.stdout:9/441: rmdir d0/d1/d5e 39 2024-01-31T05:13:13.396 INFO:tasks.workunit.client.0.smithi099.stdout:1/452: creat d4/dc/d55/f8e x:0 0 0 2024-01-31T05:13:13.399 INFO:tasks.workunit.client.0.smithi099.stdout:4/495: link d0/d2/d4b/d93/f94 d0/d79/fa7 0 2024-01-31T05:13:13.400 INFO:tasks.workunit.client.0.smithi099.stdout:9/442: unlink d0/d7/d2e/c82 0 2024-01-31T05:13:13.400 INFO:tasks.workunit.client.0.smithi099.stdout:9/443: stat d0/d1/d24/d2b/d59 0 2024-01-31T05:13:13.402 INFO:tasks.workunit.client.0.smithi099.stdout:2/468: getdents d10/d3a/d69 0 2024-01-31T05:13:13.403 INFO:tasks.workunit.client.0.smithi099.stdout:5/480: write d6/da/d14/d94/f87 [898020,36211] 0 2024-01-31T05:13:13.403 INFO:tasks.workunit.client.0.smithi099.stdout:6/393: mknod d14/d18/d1a/c78 0 2024-01-31T05:13:13.403 INFO:tasks.workunit.client.0.smithi099.stdout:5/481: fdatasync d6/da/d14/f3b 0 2024-01-31T05:13:13.403 INFO:tasks.workunit.client.0.smithi099.stdout:6/394: chown d14/d18/d1a/d1c/d29/d43 291 1 2024-01-31T05:13:13.403 INFO:tasks.workunit.client.0.smithi099.stdout:5/482: creat d6/da/d14/d61/fa2 x:0 0 0 2024-01-31T05:13:13.404 INFO:tasks.workunit.client.0.smithi099.stdout:4/496: symlink d0/d2/d4b/d93/d17/d7d/la8 0 2024-01-31T05:13:13.404 INFO:tasks.workunit.client.0.smithi099.stdout:4/497: fdatasync d0/d2/d4b/d93/d17/d3d/f6a 0 2024-01-31T05:13:13.404 INFO:tasks.workunit.client.0.smithi099.stdout:9/444: truncate d0/d3e/f4c 1807385 0 2024-01-31T05:13:13.405 INFO:tasks.workunit.client.0.smithi099.stdout:9/445: creat d0/d1/d24/d2b/d63/f94 x:0 0 0 2024-01-31T05:13:13.406 INFO:tasks.workunit.client.0.smithi099.stdout:5/483: dread d6/da/d3f/f4d [0,4194304] 0 2024-01-31T05:13:13.407 INFO:tasks.workunit.client.0.smithi099.stdout:5/484: stat d6/da/d14/d94/l62 0 2024-01-31T05:13:13.407 INFO:tasks.workunit.client.0.smithi099.stdout:5/485: fsync d6/da/d14/d3d/d51/d82/f76 0 2024-01-31T05:13:13.407 INFO:tasks.workunit.client.0.smithi099.stdout:5/486: chown d6/fd 6410688 1 2024-01-31T05:13:13.407 INFO:tasks.workunit.client.0.smithi099.stdout:5/487: truncate d6/f91 536333 0 2024-01-31T05:13:13.407 INFO:tasks.workunit.client.0.smithi099.stdout:3/498: dwrite d10/d72/f96 [0,4194304] 0 2024-01-31T05:13:13.407 INFO:tasks.workunit.client.0.smithi099.stdout:3/499: fsync d10/d1e/da2/fb4 0 2024-01-31T05:13:13.408 INFO:tasks.workunit.client.0.smithi099.stdout:2/469: dread d10/d2b/d7c/f93 [0,4194304] 0 2024-01-31T05:13:13.409 INFO:tasks.workunit.client.0.smithi099.stdout:6/395: mkdir d14/d18/d1a/d1c/d29/d79 0 2024-01-31T05:13:13.410 INFO:tasks.workunit.client.0.smithi099.stdout:9/446: rename d0/d1/d24/d2b/d7b/f88 to d0/f95 0 2024-01-31T05:13:13.413 INFO:tasks.workunit.client.0.smithi099.stdout:8/534: dwrite d1/dd/d11/d29/d3f/d56/da0/f77 [0,4194304] 0 2024-01-31T05:13:13.413 INFO:tasks.workunit.client.0.smithi099.stdout:4/498: dread d0/d8/d19/f2d [0,4194304] 0 2024-01-31T05:13:13.413 INFO:tasks.workunit.client.0.smithi099.stdout:3/500: unlink d10/d24/d40/f8e 0 2024-01-31T05:13:13.415 INFO:tasks.workunit.client.0.smithi099.stdout:9/447: mknod d0/d1/d24/d48/c96 0 2024-01-31T05:13:13.415 INFO:tasks.workunit.client.0.smithi099.stdout:9/448: fsync d0/d5d/f81 0 2024-01-31T05:13:13.416 INFO:tasks.workunit.client.0.smithi099.stdout:3/501: read d10/f23 [8963,103524] 0 2024-01-31T05:13:13.416 INFO:tasks.workunit.client.0.smithi099.stdout:6/396: mknod d14/d18/d1a/d1c/d29/d43/c7a 0 2024-01-31T05:13:13.416 INFO:tasks.workunit.client.0.smithi099.stdout:7/452: dwrite d6/d32/d3d/d4b/d33/d37/d4e/f62 [0,4194304] 0 2024-01-31T05:13:13.416 INFO:tasks.workunit.client.0.smithi099.stdout:7/453: write d6/d12/f3c [931443,82986] 0 2024-01-31T05:13:13.417 INFO:tasks.workunit.client.0.smithi099.stdout:5/488: dread d6/da/d14/d3d/d51/d82/f2c [0,4194304] 0 2024-01-31T05:13:13.418 INFO:tasks.workunit.client.0.smithi099.stdout:8/535: symlink d1/dd/d11/d29/d3f/d56/da0/lb0 0 2024-01-31T05:13:13.420 INFO:tasks.workunit.client.0.smithi099.stdout:4/499: truncate d0/d2/d20/f38 96675 0 2024-01-31T05:13:13.421 INFO:tasks.workunit.client.0.smithi099.stdout:9/449: stat d0/d3e/f40 0 2024-01-31T05:13:13.422 INFO:tasks.workunit.client.0.smithi099.stdout:1/453: dwrite d4/dc/d55/f72 [0,4194304] 0 2024-01-31T05:13:13.423 INFO:tasks.workunit.client.0.smithi099.stdout:1/454: read d4/dc/d15/f6c [44943,44596] 0 2024-01-31T05:13:13.423 INFO:tasks.workunit.client.0.smithi099.stdout:1/455: readlink d4/db/d24/d4b/d50/l68 0 2024-01-31T05:13:13.423 INFO:tasks.workunit.client.0.smithi099.stdout:1/456: write d4/dc/d15/f7a [181053,55191] 0 2024-01-31T05:13:13.423 INFO:tasks.workunit.client.0.smithi099.stdout:1/457: fsync d4/db/f25 0 2024-01-31T05:13:13.424 INFO:tasks.workunit.client.0.smithi099.stdout:6/397: getdents d14 0 2024-01-31T05:13:13.429 INFO:tasks.workunit.client.0.smithi099.stdout:5/489: mknod d6/da/d3f/d5a/ca3 0 2024-01-31T05:13:13.429 INFO:tasks.workunit.client.0.smithi099.stdout:5/490: creat d6/da/d14/d3d/d57/fa4 x:0 0 0 2024-01-31T05:13:13.430 INFO:tasks.workunit.client.0.smithi099.stdout:7/454: dread d6/d32/d3d/d4b/f23 [0,4194304] 0 2024-01-31T05:13:13.430 INFO:tasks.workunit.client.0.smithi099.stdout:8/536: creat d1/dd/d11/d29/d3f/d56/da0/d2e/fb1 x:0 0 0 2024-01-31T05:13:13.436 INFO:tasks.workunit.client.0.smithi099.stdout:3/502: rename d10/d27/l28 to d10/d32/d85/d77/lba 0 2024-01-31T05:13:13.436 INFO:tasks.workunit.client.0.smithi099.stdout:2/470: dwrite d10/f42 [0,4194304] 0 2024-01-31T05:13:13.436 INFO:tasks.workunit.client.0.smithi099.stdout:1/458: mkdir d4/db/d24/d8f 0 2024-01-31T05:13:13.436 INFO:tasks.workunit.client.0.smithi099.stdout:6/398: mkdir d14/d18/d3b/d7b 0 2024-01-31T05:13:13.439 INFO:tasks.workunit.client.0.smithi099.stdout:1/459: unlink d4/dc/le 0 2024-01-31T05:13:13.439 INFO:tasks.workunit.client.0.smithi099.stdout:3/503: mknod d10/d27/d34/d44/d60/d75/d8c/db6/cbb 0 2024-01-31T05:13:13.439 INFO:tasks.workunit.client.0.smithi099.stdout:1/460: write d4/dc/f2c [1152957,123479] 0 2024-01-31T05:13:13.439 INFO:tasks.workunit.client.0.smithi099.stdout:6/399: symlink d14/d18/l7c 0 2024-01-31T05:13:13.441 INFO:tasks.workunit.client.0.smithi099.stdout:3/504: mknod d10/d27/d34/d44/d60/cbc 0 2024-01-31T05:13:13.445 INFO:tasks.workunit.client.0.smithi099.stdout:3/505: rmdir d10/d27/d34/d52 39 2024-01-31T05:13:13.447 INFO:tasks.workunit.client.0.smithi099.stdout:7/455: dread d6/d32/d3d/d4b/d33/d37/d50/d4d/f84 [0,4194304] 0 2024-01-31T05:13:13.448 INFO:tasks.workunit.client.0.smithi099.stdout:3/506: mknod d10/d27/d34/d44/d60/d75/d8c/d92/cbd 0 2024-01-31T05:13:13.448 INFO:tasks.workunit.client.0.smithi099.stdout:3/507: write d10/d1e/f6f [5051139,129810] 0 2024-01-31T05:13:13.449 INFO:tasks.workunit.client.0.smithi099.stdout:7/456: symlink d6/d32/d3d/d4b/d33/d37/d50/d4d/l8d 0 2024-01-31T05:13:13.452 INFO:tasks.workunit.client.0.smithi099.stdout:3/508: creat d10/d27/d89/fbe x:0 0 0 2024-01-31T05:13:13.452 INFO:tasks.workunit.client.0.smithi099.stdout:3/509: truncate d10/f8f 733462 0 2024-01-31T05:13:13.453 INFO:tasks.workunit.client.0.smithi099.stdout:7/457: truncate d6/d32/f5b 3353170 0 2024-01-31T05:13:13.453 INFO:tasks.workunit.client.0.smithi099.stdout:1/461: dread d4/dc/d4d/f51 [0,4194304] 0 2024-01-31T05:13:13.453 INFO:tasks.workunit.client.0.smithi099.stdout:1/462: fsync d4/dc/d15/f20 0 2024-01-31T05:13:13.458 INFO:tasks.workunit.client.0.smithi099.stdout:3/510: dread d10/d27/f5b [0,4194304] 0 2024-01-31T05:13:13.458 INFO:tasks.workunit.client.0.smithi099.stdout:3/511: fsync d10/d24/d40/f82 0 2024-01-31T05:13:13.460 INFO:tasks.workunit.client.0.smithi099.stdout:5/491: dwrite d6/da/d14/d3d/d6e/f42 [0,4194304] 0 2024-01-31T05:13:13.462 INFO:tasks.workunit.client.0.smithi099.stdout:5/492: creat d6/da/d14/d61/d98/fa5 x:0 0 0 2024-01-31T05:13:13.462 INFO:tasks.workunit.client.0.smithi099.stdout:5/493: fdatasync d6/da/d3f/f4d 0 2024-01-31T05:13:13.463 INFO:tasks.workunit.client.0.smithi099.stdout:5/494: creat d6/da/d14/d94/fa6 x:0 0 0 2024-01-31T05:13:13.463 INFO:tasks.workunit.client.0.smithi099.stdout:5/495: write d6/da/d14/d3d/d57/fa4 [1042476,53004] 0 2024-01-31T05:13:13.469 INFO:tasks.workunit.client.0.smithi099.stdout:8/537: dwrite d1/dd/d11/d19/d21/d3c/f46 [0,4194304] 0 2024-01-31T05:13:13.469 INFO:tasks.workunit.client.0.smithi099.stdout:8/538: chown d1/dd/d11/d19/f1f 14436581 1 2024-01-31T05:13:13.469 INFO:tasks.workunit.client.0.smithi099.stdout:8/539: stat d1/dd/d11/d29/d3f/f86 0 2024-01-31T05:13:13.472 INFO:tasks.workunit.client.0.smithi099.stdout:2/471: dwrite d10/d1c/f64 [0,4194304] 0 2024-01-31T05:13:13.473 INFO:tasks.workunit.client.0.smithi099.stdout:6/400: dwrite d14/f17 [0,4194304] 0 2024-01-31T05:13:13.482 INFO:tasks.workunit.client.0.smithi099.stdout:8/540: creat d1/dd/d7b/fb2 x:0 0 0 2024-01-31T05:13:13.482 INFO:tasks.workunit.client.0.smithi099.stdout:8/541: stat d1/dd/d1d 0 2024-01-31T05:13:13.485 INFO:tasks.workunit.client.0.smithi099.stdout:6/401: write f11 [3322645,117812] 0 2024-01-31T05:13:13.485 INFO:tasks.workunit.client.0.smithi099.stdout:6/402: fdatasync d14/d18/d1a/d1c/f75 0 2024-01-31T05:13:13.485 INFO:tasks.workunit.client.0.smithi099.stdout:6/403: write d14/f40 [1649297,96280] 0 2024-01-31T05:13:13.488 INFO:tasks.workunit.client.0.smithi099.stdout:3/512: dwrite d10/d32/f5a [0,4194304] 0 2024-01-31T05:13:13.490 INFO:tasks.workunit.client.0.smithi099.stdout:4/500: rename d0/d74/c9a to d0/d1e/d61/ca9 0 2024-01-31T05:13:13.490 INFO:tasks.workunit.client.0.smithi099.stdout:4/501: truncate d0/d8/d19/d99/fa0 1696392 0 2024-01-31T05:13:13.494 INFO:tasks.workunit.client.0.smithi099.stdout:2/472: unlink d10/l18 0 2024-01-31T05:13:13.494 INFO:tasks.workunit.client.0.smithi099.stdout:2/473: truncate d10/d1b/d4d/f84 240281 0 2024-01-31T05:13:13.495 INFO:tasks.workunit.client.0.smithi099.stdout:9/450: rename d0/d1/d24/d2b/d63/l6c to d0/d44/l97 0 2024-01-31T05:13:13.496 INFO:tasks.workunit.client.0.smithi099.stdout:2/474: symlink d10/d1b/d7d/l9d 0 2024-01-31T05:13:13.497 INFO:tasks.workunit.client.0.smithi099.stdout:7/458: dread d6/d32/f5b [0,4194304] 0 2024-01-31T05:13:13.497 INFO:tasks.workunit.client.0.smithi099.stdout:7/459: stat d6/d32/d3d/d4b/d33/d37/d50/f45 0 2024-01-31T05:13:13.498 INFO:tasks.workunit.client.0.smithi099.stdout:7/460: write d6/d32/d3d/d4b/d33/d37/f7e [608462,117339] 0 2024-01-31T05:13:13.498 INFO:tasks.workunit.client.0.smithi099.stdout:1/463: rename d4/db/d12/f4a to d4/f90 0 2024-01-31T05:13:13.499 INFO:tasks.workunit.client.0.smithi099.stdout:9/451: mkdir d0/d1/d5e/d72/d89/d98 0 2024-01-31T05:13:13.499 INFO:tasks.workunit.client.0.smithi099.stdout:9/452: truncate d0/d7/f28 5566743 0 2024-01-31T05:13:13.500 INFO:tasks.workunit.client.0.smithi099.stdout:7/461: rmdir d6/d32/d3d/d4b/d33/d37/d4e 39 2024-01-31T05:13:13.502 INFO:tasks.workunit.client.0.smithi099.stdout:9/453: mknod d0/d1/d5e/d72/d89/c99 0 2024-01-31T05:13:13.502 INFO:tasks.workunit.client.0.smithi099.stdout:7/462: mkdir d6/d32/d3d/d4b/d33/d37/d50/d25/d72/d8e 0 2024-01-31T05:13:13.504 INFO:tasks.workunit.client.0.smithi099.stdout:7/463: mknod d6/d32/d3d/d4b/d33/d37/d4e/c8f 0 2024-01-31T05:13:13.506 INFO:tasks.workunit.client.0.smithi099.stdout:4/502: dread d0/d2/d4b/d93/d17/f25 [0,4194304] 0 2024-01-31T05:13:13.506 INFO:tasks.workunit.client.0.smithi099.stdout:7/464: mknod d6/d32/d3d/d4b/d33/d37/d50/d25/d79/c90 0 2024-01-31T05:13:13.506 INFO:tasks.workunit.client.0.smithi099.stdout:7/465: write d6/d32/d3d/d4b/d33/d37/d4e/f65 [4518884,87592] 0 2024-01-31T05:13:13.507 INFO:tasks.workunit.client.0.smithi099.stdout:4/503: creat d0/d2/d4b/d93/d17/d3d/faa x:0 0 0 2024-01-31T05:13:13.508 INFO:tasks.workunit.client.0.smithi099.stdout:0/477: sync 2024-01-31T05:13:13.510 INFO:tasks.workunit.client.0.smithi099.stdout:7/466: creat d6/d32/d3d/d4b/d33/d37/d50/d25/d47/f91 x:0 0 0 2024-01-31T05:13:13.510 INFO:tasks.workunit.client.0.smithi099.stdout:8/542: dwrite d1/dd/d11/d29/d3f/d56/da0/f22 [0,4194304] 0 2024-01-31T05:13:13.510 INFO:tasks.workunit.client.0.smithi099.stdout:8/543: read - d1/dd/d1d/fae zero size 2024-01-31T05:13:13.512 INFO:tasks.workunit.client.0.smithi099.stdout:7/467: creat d6/d32/d3d/d4b/d33/d37/d50/d25/f92 x:0 0 0 2024-01-31T05:13:13.512 INFO:tasks.workunit.client.0.smithi099.stdout:7/468: fdatasync d6/d32/d3d/d4b/d33/d37/d4e/f55 0 2024-01-31T05:13:13.513 INFO:tasks.workunit.client.0.smithi099.stdout:3/513: dwrite d10/d27/d34/d44/d60/f83 [0,4194304] 0 2024-01-31T05:13:13.513 INFO:tasks.workunit.client.0.smithi099.stdout:3/514: creat d10/fbf x:0 0 0 2024-01-31T05:13:13.514 INFO:tasks.workunit.client.0.smithi099.stdout:7/469: creat d6/d32/d3d/d4b/d33/d37/d50/d4d/f93 x:0 0 0 2024-01-31T05:13:13.522 INFO:tasks.workunit.client.0.smithi099.stdout:0/478: write d1/d22/f62 [1124239,74800] 0 2024-01-31T05:13:13.522 INFO:tasks.workunit.client.0.smithi099.stdout:0/479: write d1/d56/f5d [779085,128903] 0 2024-01-31T05:13:13.522 INFO:tasks.workunit.client.0.smithi099.stdout:0/480: creat d1/d37/d4a/d7a/d7d/fa0 x:0 0 0 2024-01-31T05:13:13.525 INFO:tasks.workunit.client.0.smithi099.stdout:2/475: dwrite d10/d1c/f2d [0,4194304] 0 2024-01-31T05:13:13.526 INFO:tasks.workunit.client.0.smithi099.stdout:0/481: mkdir d1/d37/d73/da1 0 2024-01-31T05:13:13.526 INFO:tasks.workunit.client.0.smithi099.stdout:0/482: write d1/d16/f5a [1966855,99735] 0 2024-01-31T05:13:13.527 INFO:tasks.workunit.client.0.smithi099.stdout:0/483: read d1/d64/f67 [1416410,11212] 0 2024-01-31T05:13:13.527 INFO:tasks.workunit.client.0.smithi099.stdout:0/484: write d1/d37/d4a/f9a [735840,9491] 0 2024-01-31T05:13:13.530 INFO:tasks.workunit.client.0.smithi099.stdout:0/485: truncate d1/d37/d4a/d7a/f46 3879112 0 2024-01-31T05:13:13.532 INFO:tasks.workunit.client.0.smithi099.stdout:7/470: getdents d6/d32/d3d/d4b/d33/d37/d50/d25/d79 0 2024-01-31T05:13:13.534 INFO:tasks.workunit.client.0.smithi099.stdout:7/471: creat d6/d32/d3d/d4b/d33/d37/f94 x:0 0 0 2024-01-31T05:13:13.534 INFO:tasks.workunit.client.0.smithi099.stdout:7/472: fsync d6/d32/d3d/d4b/d33/d37/d50/d25/d47/f57 0 2024-01-31T05:13:13.534 INFO:tasks.workunit.client.0.smithi099.stdout:7/473: readlink d6/d32/d3d/d4b/d33/d37/d50/l2d 0 2024-01-31T05:13:13.540 INFO:tasks.workunit.client.0.smithi099.stdout:2/476: dread d10/d1c/f2d [0,4194304] 0 2024-01-31T05:13:13.543 INFO:tasks.workunit.client.0.smithi099.stdout:7/474: dread d6/d12/f1d [0,4194304] 0 2024-01-31T05:13:13.544 INFO:tasks.workunit.client.0.smithi099.stdout:7/475: chown d6/c44 3932276 1 2024-01-31T05:13:13.544 INFO:tasks.workunit.client.0.smithi099.stdout:1/464: rename d4/df to d4/db/d24/d4b/d50/d91 0 2024-01-31T05:13:13.544 INFO:tasks.workunit.client.0.smithi099.stdout:1/465: chown d4/db/c3c 14 1 2024-01-31T05:13:13.544 INFO:tasks.workunit.client.0.smithi099.stdout:1/466: truncate d4/dc/d4d/f51 1576503 0 2024-01-31T05:13:13.545 INFO:tasks.workunit.client.0.smithi099.stdout:7/476: symlink d6/d32/d3d/d4b/d33/d37/d50/d25/d7a/l95 0 2024-01-31T05:13:13.547 INFO:tasks.workunit.client.0.smithi099.stdout:1/467: mknod d4/dc/d4d/d5d/d87/c92 0 2024-01-31T05:13:13.553 INFO:tasks.workunit.client.0.smithi099.stdout:7/477: getdents d6/d32/d3d/d4b/d33/d37/d50/d25/d7a 0 2024-01-31T05:13:13.554 INFO:tasks.workunit.client.0.smithi099.stdout:0/486: dwrite d1/d8/f5f [0,4194304] 0 2024-01-31T05:13:13.554 INFO:tasks.workunit.client.0.smithi099.stdout:0/487: chown d1/d37/f87 619053420 1 2024-01-31T05:13:13.555 INFO:tasks.workunit.client.0.smithi099.stdout:7/478: link d6/d32/d3d/d4b/d33/d37/f7e d6/d32/d3d/d4b/d33/d37/d50/d25/d72/d8e/f96 0 2024-01-31T05:13:13.555 INFO:tasks.workunit.client.0.smithi099.stdout:7/479: readlink d6/d32/d3d/d4b/d33/d37/d50/d25/d47/l66 0 2024-01-31T05:13:13.555 INFO:tasks.workunit.client.0.smithi099.stdout:7/480: chown d6/d32/d3d/d4b/d33/d37/f94 19887990 1 2024-01-31T05:13:13.557 INFO:tasks.workunit.client.0.smithi099.stdout:2/477: write f1 [785332,44810] 0 2024-01-31T05:13:13.561 INFO:tasks.workunit.client.0.smithi099.stdout:0/488: creat d1/d8/fa2 x:0 0 0 2024-01-31T05:13:13.563 INFO:tasks.workunit.client.0.smithi099.stdout:7/481: creat d6/d32/d3d/d4b/d33/d37/d50/d4d/d58/f97 x:0 0 0 2024-01-31T05:13:13.565 INFO:tasks.workunit.client.0.smithi099.stdout:0/489: creat d1/d30/d45/fa3 x:0 0 0 2024-01-31T05:13:13.566 INFO:tasks.workunit.client.0.smithi099.stdout:7/482: dread d6/f1f [4194304,4194304] 0 2024-01-31T05:13:13.570 INFO:tasks.workunit.client.0.smithi099.stdout:1/468: dwrite d4/db/d24/d4b/d50/d91/f7d [0,4194304] 0 2024-01-31T05:13:13.570 INFO:tasks.workunit.client.0.smithi099.stdout:1/469: stat d4/db 0 2024-01-31T05:13:13.570 INFO:tasks.workunit.client.0.smithi099.stdout:0/490: dread d1/f8f [0,4194304] 0 2024-01-31T05:13:13.574 INFO:tasks.workunit.client.0.smithi099.stdout:1/470: unlink d4/dc/d4d/d5d/d87/l3f 0 2024-01-31T05:13:13.575 INFO:tasks.workunit.client.0.smithi099.stdout:7/483: dread d6/d32/d3d/d4b/d33/d37/d4e/f74 [0,4194304] 0 2024-01-31T05:13:13.575 INFO:tasks.workunit.client.0.smithi099.stdout:6/404: rename d14/d18/d1a/f3e to d14/d18/d3b/d7b/f7d 0 2024-01-31T05:13:13.575 INFO:tasks.workunit.client.0.smithi099.stdout:1/471: symlink d4/db/d3a/d7e/l93 0 2024-01-31T05:13:13.576 INFO:tasks.workunit.client.0.smithi099.stdout:6/405: unlink d14/d18/d1a/d1c/d29/d4f/f57 0 2024-01-31T05:13:13.576 INFO:tasks.workunit.client.0.smithi099.stdout:6/406: readlink l9 0 2024-01-31T05:13:13.577 INFO:tasks.workunit.client.0.smithi099.stdout:9/454: rename d0/d5d/f79 to d0/d44/f9a 0 2024-01-31T05:13:13.577 INFO:tasks.workunit.client.0.smithi099.stdout:7/484: mkdir d6/d98 0 2024-01-31T05:13:13.578 INFO:tasks.workunit.client.0.smithi099.stdout:1/472: getdents d4/dc/d15/d45 0 2024-01-31T05:13:13.580 INFO:tasks.workunit.client.0.smithi099.stdout:4/504: rename d0/d2/d4b/d93/d17/d24/d5a to d0/d8/d19/d98/d9b/dab 0 2024-01-31T05:13:13.580 INFO:tasks.workunit.client.0.smithi099.stdout:4/505: fsync d0/d2/d4b/f5f 0 2024-01-31T05:13:13.583 INFO:tasks.workunit.client.0.smithi099.stdout:9/455: creat d0/d1/d24/d2b/d59/f9b x:0 0 0 2024-01-31T05:13:13.584 INFO:tasks.workunit.client.0.smithi099.stdout:7/485: rmdir d6/d32/d3d/d4b/d33/d37/d50/d25/d7a/d81 0 2024-01-31T05:13:13.584 INFO:tasks.workunit.client.0.smithi099.stdout:7/486: fsync d6/d12/f73 0 2024-01-31T05:13:13.584 INFO:tasks.workunit.client.0.smithi099.stdout:7/487: write d6/d32/d3d/d4b/d33/d37/d50/d4d/d58/f97 [820966,74171] 0 2024-01-31T05:13:13.584 INFO:tasks.workunit.client.0.smithi099.stdout:1/473: unlink d4/dc/d44/c86 0 2024-01-31T05:13:13.584 INFO:tasks.workunit.client.0.smithi099.stdout:1/474: chown d4/dc/d4d/l6f 857 1 2024-01-31T05:13:13.585 INFO:tasks.workunit.client.0.smithi099.stdout:3/515: rename d10/d24/d40/c91 to d10/d27/d34/d50/cc0 0 2024-01-31T05:13:13.586 INFO:tasks.workunit.client.0.smithi099.stdout:4/506: mkdir d0/d8/d19/d98/dac 0 2024-01-31T05:13:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.587+0000 7eff2fe59640 1 -- 172.21.15.99:0/3684910386 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff28100d40 msgr2=0x7eff28101160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.587+0000 7eff2fe59640 1 --2- 172.21.15.99:0/3684910386 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff28100d40 0x7eff28101160 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7eff24009900 tx=0x7eff2402bc30 comp rx=0 tx=0).stop 2024-01-31T05:13:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.587+0000 7eff2fe59640 1 -- 172.21.15.99:0/3684910386 shutdown_connections 2024-01-31T05:13:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.587+0000 7eff2fe59640 1 --2- 172.21.15.99:0/3684910386 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff281028f0 0x7eff28109180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.587+0000 7eff2fe59640 1 --2- 172.21.15.99:0/3684910386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff28101f30 0x7eff281023b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:13.588 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.587+0000 7eff2fe59640 1 --2- 172.21.15.99:0/3684910386 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff28100d40 0x7eff28101160 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:13.588 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.587+0000 7eff2fe59640 1 -- 172.21.15.99:0/3684910386 >> 172.21.15.99:0/3684910386 conn(0x7eff280fc2b0 msgr2=0x7eff280fe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:13.588 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.587+0000 7eff2fe59640 1 -- 172.21.15.99:0/3684910386 shutdown_connections 2024-01-31T05:13:13.588 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.587+0000 7eff2fe59640 1 -- 172.21.15.99:0/3684910386 wait complete. 2024-01-31T05:13:13.588 INFO:tasks.workunit.client.0.smithi099.stdout:9/456: creat d0/d1/f9c x:0 0 0 2024-01-31T05:13:13.589 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.588+0000 7eff2fe59640 1 Processor -- start 2024-01-31T05:13:13.589 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.588+0000 7eff2fe59640 1 -- start start 2024-01-31T05:13:13.589 INFO:tasks.workunit.client.0.smithi099.stdout:7/488: mknod d6/d32/d3d/d4b/d33/d37/d50/c99 0 2024-01-31T05:13:13.592 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.588+0000 7eff2fe59640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff28100d40 0x7eff28198fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:13.592 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.588+0000 7eff2fe59640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff28101f30 0x7eff281994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:13.592 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.588+0000 7eff2fe59640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff281028f0 0x7eff281a0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:13.592 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.588+0000 7eff2fe59640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff281a0aa0 con 0x7eff28100d40 2024-01-31T05:13:13.592 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.588+0000 7eff2fe59640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff281a0c10 con 0x7eff281028f0 2024-01-31T05:13:13.592 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.588+0000 7eff2fe59640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff281a0dd0 con 0x7eff28101f30 2024-01-31T05:13:13.592 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.589+0000 7eff2dbf5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff28100d40 0x7eff28198fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:13.593 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.589+0000 7eff2dbf5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff28100d40 0x7eff28198fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35938/0 (socket says 172.21.15.99:35938) 2024-01-31T05:13:13.593 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.589+0000 7eff2dbf5640 1 -- 172.21.15.99:0/347238912 learned_addr learned my addr 172.21.15.99:0/347238912 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:13.593 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.589+0000 7eff2d3f4640 1 --2- 172.21.15.99:0/347238912 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff28101f30 0x7eff281994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:13.593 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.589+0000 7eff2e3f6640 1 --2- 172.21.15.99:0/347238912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff281028f0 0x7eff281a0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:13.593 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.589+0000 7eff2dbf5640 1 -- 172.21.15.99:0/347238912 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff28101f30 msgr2=0x7eff281994f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:13.593 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.589+0000 7eff2dbf5640 1 --2- 172.21.15.99:0/347238912 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff28101f30 0x7eff281994f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:13.593 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.589+0000 7eff2dbf5640 1 -- 172.21.15.99:0/347238912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff281028f0 msgr2=0x7eff281a0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:13.593 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.589+0000 7eff2dbf5640 1 --2- 172.21.15.99:0/347238912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff281028f0 0x7eff281a0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:13.593 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.589+0000 7eff2dbf5640 1 -- 172.21.15.99:0/347238912 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff24009560 con 0x7eff28100d40 2024-01-31T05:13:13.593 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.589+0000 7eff2dbf5640 1 --2- 172.21.15.99:0/347238912 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff28100d40 0x7eff28198fb0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7eff24009230 tx=0x7eff240040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:13.593 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.589+0000 7eff1effd640 1 -- 172.21.15.99:0/347238912 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff240044c0 con 0x7eff28100d40 2024-01-31T05:13:13.594 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.589+0000 7eff1effd640 1 -- 172.21.15.99:0/347238912 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7eff240054c0 con 0x7eff28100d40 2024-01-31T05:13:13.594 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.589+0000 7eff2fe59640 1 -- 172.21.15.99:0/347238912 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff281a1050 con 0x7eff28100d40 2024-01-31T05:13:13.594 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.590+0000 7eff1effd640 1 -- 172.21.15.99:0/347238912 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2403e450 con 0x7eff28100d40 2024-01-31T05:13:13.594 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.590+0000 7eff2fe59640 1 -- 172.21.15.99:0/347238912 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff281a15e0 con 0x7eff28100d40 2024-01-31T05:13:13.594 INFO:tasks.workunit.client.0.smithi099.stdout:3/516: link d10/d27/fa7 d10/d1e/fc1 0 2024-01-31T05:13:13.595 INFO:tasks.workunit.client.0.smithi099.stdout:9/457: creat d0/d1/d24/d2b/d7b/f9d x:0 0 0 2024-01-31T05:13:13.595 INFO:tasks.workunit.client.0.smithi099.stdout:9/458: dread - d0/d1/d24/d2b/d7b/f9d zero size 2024-01-31T05:13:13.595 INFO:tasks.workunit.client.0.smithi099.stdout:9/459: readlink d0/d1/d24/d2b/l16 0 2024-01-31T05:13:13.595 INFO:tasks.workunit.client.0.smithi099.stdout:9/460: chown d0/d1/c6d 19 1 2024-01-31T05:13:13.595 INFO:tasks.workunit.client.0.smithi099.stdout:9/461: write d0/d44/f9a [368427,34255] 0 2024-01-31T05:13:13.595 INFO:tasks.workunit.client.0.smithi099.stdout:9/462: mknod d0/d7/d2e/c9e 0 2024-01-31T05:13:13.595 INFO:tasks.workunit.client.0.smithi099.stdout:9/463: stat d0/d7/f46 0 2024-01-31T05:13:13.595 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.594+0000 7eff32c1a740 1 Processor -- start 2024-01-31T05:13:13.595 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.594+0000 7eff32c1a740 1 -- start start 2024-01-31T05:13:13.596 INFO:tasks.workunit.client.0.smithi099.stdout:5/496: sync 2024-01-31T05:13:13.597 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.595+0000 7eff1effd640 1 -- 172.21.15.99:0/347238912 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 20) v1 ==== 135895+0+0 (secure 0 0 0) 0x7eff24003680 con 0x7eff28100d40 2024-01-31T05:13:13.597 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.595+0000 7eff32c1a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574e6f3c270 0x5574e6f3c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:13.597 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.595+0000 7eff2e3f6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574e6f3c270 0x5574e6f3c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:13.597 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.596+0000 7eff1effd640 1 --2- 172.21.15.99:0/347238912 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7eff140a1380 0x7eff140a3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:13.597 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.596+0000 7eff32c1a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5574e6f3cc60 0x5574e6f41760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:13.597 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.596+0000 7eff32c1a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5574e6f41dd0 0x5574e6f44260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:13.597 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.596+0000 7eff32c1a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574e6eac040 con 0x5574e6f3c270 2024-01-31T05:13:13.597 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.596+0000 7eff32c1a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574e6ea9730 con 0x5574e6f41dd0 2024-01-31T05:13:13.597 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.596+0000 7eff32c1a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574e6ea5020 con 0x5574e6f3cc60 2024-01-31T05:13:13.597 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.596+0000 7eff2e3f6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574e6f3c270 0x5574e6f3c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35954/0 (socket says 172.21.15.99:35954) 2024-01-31T05:13:13.597 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.596+0000 7eff2e3f6640 1 -- 172.21.15.99:0/3748134583 learned_addr learned my addr 172.21.15.99:0/3748134583 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:13.597 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.596+0000 7eff2d3f4640 1 --2- 172.21.15.99:0/3748134583 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5574e6f3cc60 0x5574e6f41760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:13.598 INFO:tasks.workunit.client.0.smithi099.stdout:5/497: creat d6/da/d14/d3d/d57/d92/fa7 x:0 0 0 2024-01-31T05:13:13.599 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.596+0000 7eff2dbf5640 1 --2- 172.21.15.99:0/347238912 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7eff140a1380 0x7eff140a3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:13.599 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.596+0000 7eff1effd640 1 -- 172.21.15.99:0/347238912 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7eff240ef4a0 con 0x7eff28100d40 2024-01-31T05:13:13.599 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.597+0000 7eff2e3f6640 1 -- 172.21.15.99:0/3748134583 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5574e6f3cc60 msgr2=0x5574e6f41760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:13.599 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.597+0000 7eff2e3f6640 1 --2- 172.21.15.99:0/3748134583 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5574e6f3cc60 0x5574e6f41760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:13.599 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.597+0000 7eff2e3f6640 1 -- 172.21.15.99:0/3748134583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5574e6f41dd0 msgr2=0x5574e6f44260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-31T05:13:13.599 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.597+0000 7eff2e3f6640 1 --2- 172.21.15.99:0/3748134583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5574e6f41dd0 0x5574e6f44260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:13.599 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.597+0000 7eff2e3f6640 1 -- 172.21.15.99:0/3748134583 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5574e6e9ce40 con 0x5574e6f3c270 2024-01-31T05:13:13.599 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.597+0000 7eff2d3f4640 1 --2- 172.21.15.99:0/3748134583 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5574e6f3cc60 0x5574e6f41760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:13:13.599 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.597+0000 7eff2dbf5640 1 --2- 172.21.15.99:0/347238912 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7eff140a1380 0x7eff140a3840 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7eff240057c0 tx=0x7eff240e6b90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:13.600 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.597+0000 7eff2e3f6640 1 --2- 172.21.15.99:0/3748134583 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574e6f3c270 0x5574e6f3c690 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7eff2000a790 tx=0x7eff20009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29666c51e109f378 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:13.600 INFO:tasks.workunit.client.0.smithi099.stdout:4/507: dread d0/d2/d4b/d93/d17/d3d/f6a [0,4194304] 0 2024-01-31T05:13:13.600 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.597+0000 7eff13fff640 1 -- 172.21.15.99:0/3748134583 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff20010040 con 0x5574e6f3c270 2024-01-31T05:13:13.600 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.597+0000 7eff13fff640 1 -- 172.21.15.99:0/3748134583 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7eff2000eb60 con 0x5574e6f3c270 2024-01-31T05:13:13.600 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.597+0000 7eff13fff640 1 -- 172.21.15.99:0/3748134583 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff20014ad0 con 0x5574e6f3c270 2024-01-31T05:13:13.601 INFO:tasks.workunit.client.0.smithi099.stdout:0/491: dwrite d1/d8/f5f [0,4194304] 0 2024-01-31T05:13:13.601 INFO:tasks.workunit.client.0.smithi099.stdout:0/492: chown d1/d37/d4a/d6f/l98 448 1 2024-01-31T05:13:13.601 INFO:tasks.workunit.client.0.smithi099.stdout:0/493: creat d1/d22/fa4 x:0 0 0 2024-01-31T05:13:13.601 INFO:tasks.workunit.client.0.smithi099.stdout:0/494: dread - d1/f2a zero size 2024-01-31T05:13:13.602 INFO:tasks.workunit.client.0.smithi099.stdout:5/498: mkdir d6/da/d14/d3d/da8 0 2024-01-31T05:13:13.602 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.599+0000 7eff32c1a740 1 -- 172.21.15.99:0/3748134583 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574e6f3c270 msgr2=0x5574e6f3c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:13.602 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.599+0000 7eff32c1a740 1 --2- 172.21.15.99:0/3748134583 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574e6f3c270 0x5574e6f3c690 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7eff2000a790 tx=0x7eff20009650 comp rx=0 tx=0).stop 2024-01-31T05:13:13.602 INFO:tasks.workunit.client.0.smithi099.stdout:4/508: creat d0/d8/d19/d98/fad x:0 0 0 2024-01-31T05:13:13.603 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.600+0000 7eff32c1a740 1 -- 172.21.15.99:0/3748134583 shutdown_connections 2024-01-31T05:13:13.603 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.600+0000 7eff32c1a740 1 --2- 172.21.15.99:0/3748134583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5574e6f41dd0 0x5574e6f44260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:13.603 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.600+0000 7eff32c1a740 1 --2- 172.21.15.99:0/3748134583 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5574e6f3cc60 0x5574e6f41760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:13.603 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.600+0000 7eff32c1a740 1 --2- 172.21.15.99:0/3748134583 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574e6f3c270 0x5574e6f3c690 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:13.603 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.600+0000 7eff32c1a740 1 -- 172.21.15.99:0/3748134583 >> 172.21.15.99:0/3748134583 conn(0x5574e6f377e0 msgr2=0x5574e6f37be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:13.603 INFO:tasks.workunit.client.0.smithi099.stdout:4/509: write d0/d8/d19/d99/fa0 [1398568,120731] 0 2024-01-31T05:13:13.604 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.601+0000 7eff32c1a740 1 -- 172.21.15.99:0/3748134583 shutdown_connections 2024-01-31T05:13:13.604 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.601+0000 7eff32c1a740 1 -- 172.21.15.99:0/3748134583 wait complete. 2024-01-31T05:13:13.604 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.603+0000 7eff32c1a740 1 -- start start 2024-01-31T05:13:13.604 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.603+0000 7eff32c1a740 1 Processor -- start 2024-01-31T05:13:13.605 INFO:tasks.workunit.client.0.smithi099.stdout:5/499: symlink d6/da/d14/d2b/d7b/la9 0 2024-01-31T05:13:13.606 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.604+0000 7eff32c1a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5574e6f3c270 0x5574e6f46220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:13.606 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.604+0000 7eff32c1a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5574e6f3cc60 0x5574e6f46760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:13.606 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.604+0000 7eff32c1a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574e6f41dd0 0x5574e6f4d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:13.606 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.604+0000 7eff32c1a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574e6e5e1b0 con 0x5574e6f41dd0 2024-01-31T05:13:13.606 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.604+0000 7eff32c1a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574e6e5de50 con 0x5574e6f3cc60 2024-01-31T05:13:13.606 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.604+0000 7eff32c1a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574e6e23090 con 0x5574e6f3c270 2024-01-31T05:13:13.606 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.604+0000 7eff32c1a740 10 client.0 _ll_register_callbacks cb 0x5574e6e48a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:13:13.606 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.604+0000 7eff2e3f6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574e6f41dd0 0x5574e6f4d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:13.606 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.604+0000 7eff2e3f6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574e6f41dd0 0x5574e6f4d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35962/0 (socket says 172.21.15.99:35962) 2024-01-31T05:13:13.606 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.604+0000 7eff2e3f6640 1 -- 172.21.15.99:0/1898336196 learned_addr learned my addr 172.21.15.99:0/1898336196 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:13.606 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.604+0000 7eff2e3f6640 1 --2- 172.21.15.99:0/1898336196 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5574e6f3c270 0x5574e6f46220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:13.606 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.604+0000 7eff2d3f4640 1 --2- 172.21.15.99:0/1898336196 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5574e6f3cc60 0x5574e6f46760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:13.607 INFO:tasks.workunit.client.0.smithi099.stdout:4/510: truncate d0/d2/f15 914644 0 2024-01-31T05:13:13.608 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.605+0000 7eff2e3f6640 1 -- 172.21.15.99:0/1898336196 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5574e6f3c270 msgr2=0x5574e6f46220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:13.608 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.605+0000 7eff2e3f6640 1 --2- 172.21.15.99:0/1898336196 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5574e6f3c270 0x5574e6f46220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:13.608 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.605+0000 7eff2e3f6640 1 -- 172.21.15.99:0/1898336196 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5574e6f3cc60 msgr2=0x5574e6f46760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:13.609 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.605+0000 7eff2e3f6640 1 --2- 172.21.15.99:0/1898336196 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5574e6f3cc60 0x5574e6f46760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:13.609 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.605+0000 7eff2e3f6640 1 -- 172.21.15.99:0/1898336196 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff20009c60 con 0x5574e6f41dd0 2024-01-31T05:13:13.609 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.605+0000 7eff2d3f4640 1 --2- 172.21.15.99:0/1898336196 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5574e6f3cc60 0x5574e6f46760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:13:13.609 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.605+0000 7eff2e3f6640 1 --2- 172.21.15.99:0/1898336196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574e6f41dd0 0x5574e6f4d7a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7eff200094c0 tx=0x7eff20009bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=749a0f388a540fae server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:13.609 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.605+0000 7eff117fa640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:13:13.609 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.605+0000 7eff117fa640 1 -- 172.21.15.99:0/1898336196 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff20014400 con 0x5574e6f41dd0 2024-01-31T05:13:13.609 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.605+0000 7eff117fa640 1 -- 172.21.15.99:0/1898336196 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7eff2001d420 con 0x5574e6f41dd0 2024-01-31T05:13:13.609 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.606+0000 7eff32c1a740 1 -- 172.21.15.99:0/1898336196 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5574e6e9e010 con 0x5574e6f41dd0 2024-01-31T05:13:13.609 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.606+0000 7eff117fa640 1 -- 172.21.15.99:0/1898336196 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff2001d5e0 con 0x5574e6f41dd0 2024-01-31T05:13:13.609 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.606+0000 7eff32c1a740 10 client.16059 fetch_fsmap learned FSMap version 30 2024-01-31T05:13:13.609 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.606+0000 7eff32c1a740 1 -- 172.21.15.99:0/1898336196 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5574e6ea36a0 con 0x5574e6f41dd0 2024-01-31T05:13:13.609 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.606+0000 7eff117fa640 1 -- 172.21.15.99:0/1898336196 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5574e6e9e010 con 0x5574e6f41dd0 2024-01-31T05:13:13.609 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.606+0000 7eff117fa640 1 -- 172.21.15.99:0/1898336196 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 30) v1 ==== 7898+0+0 (secure 0 0 0) 0x7eff20008030 con 0x5574e6f41dd0 2024-01-31T05:13:13.610 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.606+0000 7eff32c1a740 10 client.16059 fetch_fsmap finished waiting for FSMap version 30 2024-01-31T05:13:13.610 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.606+0000 7eff32c1a740 10 client.16059 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-01-31T05:13:13.610 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.606+0000 7eff32c1a740 20 client.16059 populate_metadata read hostname 'smithi099' 2024-01-31T05:13:13.610 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.606+0000 7eff32c1a740 1 --2- 172.21.15.99:0/1898336196 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5574e6f52040 0x5574e6f54460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:13.610 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.606+0000 7eff32c1a740 4 client.16059 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:13:13.610 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.606+0000 7eff32c1a740 1 -- 172.21.15.99:0/1898336196 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5574e6e9dd30 con 0x5574e6f52040 2024-01-31T05:13:13.610 INFO:tasks.workunit.client.0.smithi099.stdout:5/500: creat d6/da/d14/faa x:0 0 0 2024-01-31T05:13:13.611 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.607+0000 7eff2d3f4640 1 --2- 172.21.15.99:0/1898336196 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5574e6f52040 0x5574e6f54460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:13.611 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.608+0000 7eff117fa640 10 client.16059 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:13:13.612 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.608+0000 7eff2d3f4640 1 --2- 172.21.15.99:0/1898336196 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5574e6f52040 0x5574e6f54460 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd3563d003861ffd server_cookie=9b2e667699daee1f in_seq=0 out_seq=0 2024-01-31T05:13:13.612 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.609+0000 7eff117fa640 1 -- 172.21.15.99:0/1898336196 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5574e6e9dd30 con 0x5574e6f52040 2024-01-31T05:13:13.612 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.609+0000 7eff117fa640 10 client.16059 handle_command_reply: tid=0 2024-01-31T05:13:13.612 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.609+0000 7eff32c1a740 1 client.16059 shutdown 2024-01-31T05:13:13.612 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.610+0000 7eff32c1a740 1 -- 172.21.15.99:0/1898336196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574e6f41dd0 msgr2=0x5574e6f4d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:13.612 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.610+0000 7eff32c1a740 1 --2- 172.21.15.99:0/1898336196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574e6f41dd0 0x5574e6f4d7a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7eff200094c0 tx=0x7eff20009bc0 comp rx=0 tx=0).stop 2024-01-31T05:13:13.612 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.610+0000 7eff32c1a740 1 -- 172.21.15.99:0/1898336196 shutdown_connections 2024-01-31T05:13:13.612 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.610+0000 7eff32c1a740 1 --2- 172.21.15.99:0/1898336196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574e6f41dd0 0x5574e6f4d7a0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:13.612 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.610+0000 7eff32c1a740 1 --2- 172.21.15.99:0/1898336196 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5574e6f52040 0x5574e6f54460 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:13.612 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.610+0000 7eff117fa640 0 client.16059 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:13:13.612 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.610+0000 7eff32c1a740 1 --2- 172.21.15.99:0/1898336196 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5574e6f3cc60 0x5574e6f46760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:13.612 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.610+0000 7eff32c1a740 1 --2- 172.21.15.99:0/1898336196 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5574e6f3c270 0x5574e6f46220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:13.612 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.610+0000 7eff32c1a740 1 -- 172.21.15.99:0/1898336196 >> 172.21.15.99:0/1898336196 conn(0x5574e6f377e0 msgr2=0x5574e6f36a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:13.612 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.610+0000 7eff32c1a740 1 -- 172.21.15.99:0/1898336196 shutdown_connections 2024-01-31T05:13:13.613 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.610+0000 7eff32c1a740 1 -- 172.21.15.99:0/1898336196 wait complete. 2024-01-31T05:13:13.613 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.610+0000 7eff32c1a740 20 client.16059 trim_cache size 0 max 16384 2024-01-31T05:13:13.619 INFO:tasks.workunit.client.0.smithi099.stdout:0/495: dread d1/f20 [0,4194304] 0 2024-01-31T05:13:13.619 INFO:tasks.workunit.client.0.smithi099.stdout:1/475: dwrite d4/db/d24/d4b/f79 [0,4194304] 0 2024-01-31T05:13:13.619 INFO:tasks.workunit.client.0.smithi099.stdout:1/476: write d4/dc/d29/f7c [706916,24012] 0 2024-01-31T05:13:13.619 INFO:tasks.workunit.client.0.smithi099.stdout:0/496: creat d1/d22/fa5 x:0 0 0 2024-01-31T05:13:13.620 INFO:tasks.workunit.client.0.smithi099.stdout:7/489: dwrite d6/d12/f1d [4194304,4194304] 0 2024-01-31T05:13:13.621 INFO:tasks.workunit.client.0.smithi099.stdout:9/464: dwrite d0/d5d/f91 [0,4194304] 0 2024-01-31T05:13:13.622 INFO:tasks.workunit.client.0.smithi099.stdout:3/517: dwrite d10/d27/d34/d52/f7d [4194304,4194304] 0 2024-01-31T05:13:13.622 INFO:tasks.workunit.client.0.smithi099.stdout:3/518: stat d10/d32/c39 0 2024-01-31T05:13:13.622 INFO:tasks.workunit.client.0.smithi099.stdout:3/519: write d10/d27/d34/f88 [914897,30113] 0 2024-01-31T05:13:13.622 INFO:tasks.workunit.client.0.smithi099.stdout:3/520: chown d10/f19 1 1 2024-01-31T05:13:13.622 INFO:tasks.workunit.client.0.smithi099.stdout:7/490: mkdir d6/d32/d3d/d4b/d33/d37/d50/d25/d72/d8e/d9a 0 2024-01-31T05:13:13.623 INFO:tasks.workunit.client.0.smithi099.stdout:1/477: getdents d4/dc/d55 0 2024-01-31T05:13:13.624 INFO:tasks.workunit.client.0.smithi099.stdout:0/497: dread d1/d16/f5a [0,4194304] 0 2024-01-31T05:13:13.627 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.627+0000 7eff32c1a740 1 Processor -- start 2024-01-31T05:13:13.627 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.627+0000 7eff32c1a740 1 -- start start 2024-01-31T05:13:13.628 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.627+0000 7eff32c1a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5574e6f3c270 0x5574e6f36190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:13.628 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.627+0000 7eff32c1a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5574e6f3cc60 0x5574e6f4d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:13.628 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.627+0000 7eff32c1a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574e6f41dd0 0x5574e6f366d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:13.628 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.627+0000 7eff32c1a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574e6e9dd30 con 0x5574e6f41dd0 2024-01-31T05:13:13.628 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.627+0000 7eff32c1a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574e6e9e010 con 0x5574e6f3c270 2024-01-31T05:13:13.628 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.627+0000 7eff32c1a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574e6f3d090 con 0x5574e6f3cc60 2024-01-31T05:13:13.628 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.628+0000 7eff2e3f6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574e6f41dd0 0x5574e6f366d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:13.628 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.628+0000 7eff2e3f6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574e6f41dd0 0x5574e6f366d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35964/0 (socket says 172.21.15.99:35964) 2024-01-31T05:13:13.628 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.628+0000 7eff2d3f4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5574e6f3cc60 0x5574e6f4d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:13.628 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.628+0000 7eff2e3f6640 1 -- 172.21.15.99:0/2769564502 learned_addr learned my addr 172.21.15.99:0/2769564502 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:13.629 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.628+0000 7eff2e3f6640 1 --2- 172.21.15.99:0/2769564502 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5574e6f3c270 0x5574e6f36190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:13.629 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.628+0000 7eff2e3f6640 1 -- 172.21.15.99:0/2769564502 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5574e6f3cc60 msgr2=0x5574e6f4d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:13.629 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.628+0000 7eff2e3f6640 1 --2- 172.21.15.99:0/2769564502 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5574e6f3cc60 0x5574e6f4d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:13.629 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.628+0000 7eff2e3f6640 1 -- 172.21.15.99:0/2769564502 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5574e6f3c270 msgr2=0x5574e6f36190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:13.629 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.628+0000 7eff2e3f6640 1 --2- 172.21.15.99:0/2769564502 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5574e6f3c270 0x5574e6f36190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:13.629 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.628+0000 7eff2e3f6640 1 -- 172.21.15.99:0/2769564502 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5574e6e40030 con 0x5574e6f41dd0 2024-01-31T05:13:13.629 INFO:tasks.workunit.client.0.smithi099.stdout:9/465: unlink d0/d3e/f4c 0 2024-01-31T05:13:13.634 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.628+0000 7eff2e3f6640 1 --2- 172.21.15.99:0/2769564502 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574e6f41dd0 0x5574e6f366d0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7eff2000e670 tx=0x7eff20004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f23e15eacb2d618c server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:13.634 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.628+0000 7eff137fe640 1 -- 172.21.15.99:0/2769564502 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2000adf0 con 0x5574e6f41dd0 2024-01-31T05:13:13.634 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.628+0000 7eff137fe640 1 -- 172.21.15.99:0/2769564502 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7eff20036470 con 0x5574e6f41dd0 2024-01-31T05:13:13.634 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.628+0000 7eff137fe640 1 -- 172.21.15.99:0/2769564502 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2002c8e0 con 0x5574e6f41dd0 2024-01-31T05:13:13.634 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.629+0000 7eff32c1a740 1 -- 172.21.15.99:0/2769564502 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574e6f41dd0 msgr2=0x5574e6f366d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:13.634 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.629+0000 7eff32c1a740 1 --2- 172.21.15.99:0/2769564502 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574e6f41dd0 0x5574e6f366d0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7eff2000e670 tx=0x7eff20004b50 comp rx=0 tx=0).stop 2024-01-31T05:13:13.634 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.629+0000 7eff32c1a740 1 -- 172.21.15.99:0/2769564502 shutdown_connections 2024-01-31T05:13:13.634 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.629+0000 7eff32c1a740 1 --2- 172.21.15.99:0/2769564502 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574e6f41dd0 0x5574e6f366d0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:13.634 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.629+0000 7eff32c1a740 1 --2- 172.21.15.99:0/2769564502 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5574e6f3cc60 0x5574e6f4d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:13.634 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.629+0000 7eff32c1a740 1 --2- 172.21.15.99:0/2769564502 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5574e6f3c270 0x5574e6f36190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:13.634 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.629+0000 7eff32c1a740 1 -- 172.21.15.99:0/2769564502 >> 172.21.15.99:0/2769564502 conn(0x5574e6f377e0 msgr2=0x5574e6f3df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:13.635 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.629+0000 7eff32c1a740 1 -- 172.21.15.99:0/2769564502 shutdown_connections 2024-01-31T05:13:13.635 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.629+0000 7eff32c1a740 1 -- 172.21.15.99:0/2769564502 wait complete. 2024-01-31T05:13:13.635 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.629+0000 7eff32c1a740 1 -- start start 2024-01-31T05:13:13.635 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.629+0000 7eff32c1a740 1 Processor -- start 2024-01-31T05:13:13.635 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.630+0000 7eff32c1a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5574e6f3c270 0x5574e6f4c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:13.635 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.630+0000 7eff32c1a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574e6f3cc60 0x5574e6f4c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:13.635 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.630+0000 7eff32c1a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5574e6f41dd0 0x5574e6f4cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:13.635 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.630+0000 7eff32c1a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574e6fa8600 con 0x5574e6f3cc60 2024-01-31T05:13:13.635 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.630+0000 7eff32c1a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574e6fa8770 con 0x5574e6f3c270 2024-01-31T05:13:13.635 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.630+0000 7eff32c1a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574e6fa8930 con 0x5574e6f41dd0 2024-01-31T05:13:13.635 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.630+0000 7eff32c1a740 10 client.0 _ll_register_callbacks cb 0x7eff20009a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:13:13.635 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.630+0000 7eff2e3f6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5574e6f41dd0 0x5574e6f4cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:13.635 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.630+0000 7eff2e3f6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5574e6f3c270 0x5574e6f4c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:13.635 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.630+0000 7eff2e3f6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5574e6f41dd0 0x5574e6f4cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:43428/0 (socket says 172.21.15.99:43428) 2024-01-31T05:13:13.636 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.630+0000 7eff2e3f6640 1 -- 172.21.15.99:0/3306173308 learned_addr learned my addr 172.21.15.99:0/3306173308 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:13.636 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.630+0000 7eff2d3f4640 1 --2- 172.21.15.99:0/3306173308 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574e6f3cc60 0x5574e6f4c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:13.636 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.631+0000 7eff2e3f6640 1 -- 172.21.15.99:0/3306173308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5574e6f3c270 msgr2=0x5574e6f4c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:13.636 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.631+0000 7eff2e3f6640 1 --2- 172.21.15.99:0/3306173308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5574e6f3c270 0x5574e6f4c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:13.636 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.631+0000 7eff2e3f6640 1 -- 172.21.15.99:0/3306173308 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574e6f3cc60 msgr2=0x5574e6f4c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:13.636 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.631+0000 7eff2e3f6640 1 --2- 172.21.15.99:0/3306173308 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574e6f3cc60 0x5574e6f4c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:13.636 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.631+0000 7eff2e3f6640 1 -- 172.21.15.99:0/3306173308 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5574e6ea36a0 con 0x5574e6f41dd0 2024-01-31T05:13:13.636 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.631+0000 7eff2d3f4640 1 --2- 172.21.15.99:0/3306173308 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574e6f3cc60 0x5574e6f4c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:13:13.636 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.631+0000 7eff2e3f6640 1 --2- 172.21.15.99:0/3306173308 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5574e6f41dd0 0x5574e6f4cad0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7eff20006d80 tx=0x7eff20036ae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7f4e5d33e6917a5 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:13.636 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.631+0000 7eff117fa640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-01-31T05:13:13.636 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.631+0000 7eff117fa640 1 -- 172.21.15.99:0/3306173308 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff20009390 con 0x5574e6f41dd0 2024-01-31T05:13:13.636 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.631+0000 7eff117fa640 1 -- 172.21.15.99:0/3306173308 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7eff200368c0 con 0x5574e6f41dd0 2024-01-31T05:13:13.637 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.631+0000 7eff32c1a740 1 -- 172.21.15.99:0/3306173308 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7eff2000eb60 con 0x5574e6f41dd0 2024-01-31T05:13:13.637 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.631+0000 7eff117fa640 1 -- 172.21.15.99:0/3306173308 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff2002c860 con 0x5574e6f41dd0 2024-01-31T05:13:13.637 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.631+0000 7eff32c1a740 10 client.25375 fetch_fsmap learned FSMap version 30 2024-01-31T05:13:13.637 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.631+0000 7eff32c1a740 1 -- 172.21.15.99:0/3306173308 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5574e6e65a50 con 0x5574e6f41dd0 2024-01-31T05:13:13.637 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.632+0000 7eff117fa640 1 -- 172.21.15.99:0/3306173308 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7eff2002ce80 con 0x5574e6f41dd0 2024-01-31T05:13:13.637 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.632+0000 7eff117fa640 1 -- 172.21.15.99:0/3306173308 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 30) v1 ==== 7898+0+0 (secure 0 0 0) 0x7eff20008040 con 0x5574e6f41dd0 2024-01-31T05:13:13.637 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.632+0000 7eff32c1a740 10 client.25375 fetch_fsmap finished waiting for FSMap version 30 2024-01-31T05:13:13.637 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.632+0000 7eff32c1a740 10 client.25375 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-01-31T05:13:13.637 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.632+0000 7eff32c1a740 20 client.25375 populate_metadata read hostname 'smithi099' 2024-01-31T05:13:13.637 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.632+0000 7eff32c1a740 1 --2- 172.21.15.99:0/3306173308 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5574e6fa9f80 0x5574e6fac3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:13.637 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.632+0000 7eff32c1a740 4 client.25375 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-01-31T05:13:13.637 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.632+0000 7eff32c1a740 1 -- 172.21.15.99:0/3306173308 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x7eff2000eb60 con 0x5574e6fa9f80 2024-01-31T05:13:13.637 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.632+0000 7eff2d3f4640 1 --2- 172.21.15.99:0/3306173308 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5574e6fa9f80 0x5574e6fac3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:13.637 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.632+0000 7eff117fa640 10 client.25375 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:13:13.637 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:13.632+0000 7eff2d3f4640 1 --2- 172.21.15.99:0/3306173308 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5574e6fa9f80 0x5574e6fac3a0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7af6c34b5145dcb3 server_cookie=1e022696465e8b70 in_seq=0 out_seq=0 2024-01-31T05:13:13.638 INFO:tasks.workunit.client.0.smithi099.stdout:3/521: dread d10/d32/f4e [0,4194304] 0 2024-01-31T05:13:13.638 INFO:tasks.workunit.client.0.smithi099.stdout:3/522: chown d10/d27/d34/d44/d60/d75/d8c/db0 31564932 1 2024-01-31T05:13:13.638 INFO:tasks.workunit.client.0.smithi099.stdout:7/491: mkdir d6/d32/d3d/d4b/d9b 0 2024-01-31T05:13:13.638 INFO:tasks.workunit.client.0.smithi099.stdout:7/492: chown d6/d32/d3d/d4b/d9b 3897419 1 2024-01-31T05:13:13.640 INFO:tasks.workunit.client.0.smithi099.stdout:0/498: symlink d1/d56/la6 0 2024-01-31T05:13:13.640 INFO:tasks.workunit.client.0.smithi099.stdout:0/499: chown d1/d37/d4a/d7a/l81 10 1 2024-01-31T05:13:13.643 INFO:tasks.workunit.client.0.smithi099.stdout:9/466: rmdir d0/d1/d5e 39 2024-01-31T05:13:13.645 INFO:tasks.workunit.client.0.smithi099.stdout:7/493: unlink d6/cd 0 2024-01-31T05:13:13.645 INFO:tasks.workunit.client.0.smithi099.stdout:7/494: chown d6/d12/f73 4080 1 2024-01-31T05:13:13.645 INFO:tasks.workunit.client.0.smithi099.stdout:1/478: rmdir d4/dc/d29 39 2024-01-31T05:13:13.645 INFO:tasks.workunit.client.0.smithi099.stdout:1/479: chown d4/db/d24/d4b/d50/d91/l1d 2 1 2024-01-31T05:13:13.647 INFO:tasks.workunit.client.0.smithi099.stdout:0/500: link d1/d22/f94 d1/d16/d36/fa7 0 2024-01-31T05:13:13.649 INFO:tasks.workunit.client.0.smithi099.stdout:9/467: rmdir d0/d1/d24/d2b/d7b 39 2024-01-31T05:13:13.649 INFO:tasks.workunit.client.0.smithi099.stdout:9/468: chown d0/d3e/d33/d8a 98 1 2024-01-31T05:13:13.649 INFO:tasks.workunit.client.0.smithi099.stdout:9/469: stat d0/d1/d24/d2b/d63/f93 0 2024-01-31T05:13:13.650 INFO:tasks.workunit.client.0.smithi099.stdout:9/470: truncate d0/d1/d24/d48/f4b 181702 0 2024-01-31T05:13:13.657 INFO:tasks.workunit.client.0.smithi099.stdout:1/480: dread d4/dc/d15/f32 [4194304,4194304] 0 2024-01-31T05:13:13.657 INFO:tasks.workunit.client.0.smithi099.stdout:3/523: dwrite d10/d27/d34/f5c [0,4194304] 0 2024-01-31T05:13:13.658 INFO:tasks.workunit.client.0.smithi099.stdout:1/481: getdents d4/dc 0 2024-01-31T05:13:13.658 INFO:tasks.workunit.client.0.smithi099.stdout:1/482: chown d4/db/d24/d4b/f79 103347684 1 2024-01-31T05:13:13.658 INFO:tasks.workunit.client.0.smithi099.stdout:1/483: fsync d4/dc/d15/f5a 0 2024-01-31T05:13:13.659 INFO:tasks.workunit.client.0.smithi099.stdout:1/484: rmdir d4/dc/d4d/d5d 39 2024-01-31T05:13:13.659 INFO:tasks.workunit.client.0.smithi099.stdout:6/407: rename d14/d18/d1a to d14/d18/d52/d7e 0 2024-01-31T05:13:13.659 INFO:tasks.workunit.client.0.smithi099.stdout:6/408: dread - d14/d18/d52/d7e/d1c/d29/f69 zero size 2024-01-31T05:13:13.659 INFO:tasks.workunit.client.0.smithi099.stdout:6/409: chown d14/d18/d52/d7e/d1c/d29/d4f/l74 162557896 1 2024-01-31T05:13:13.660 INFO:tasks.workunit.client.0.smithi099.stdout:8/544: sync 2024-01-31T05:13:13.661 INFO:tasks.workunit.client.0.smithi099.stdout:2/478: sync 2024-01-31T05:13:13.662 INFO:tasks.workunit.client.0.smithi099.stdout:5/501: rename d6/da/d14/d2b/d7b/f96 to d6/da/d14/d2b/fab 0 2024-01-31T05:13:13.662 INFO:tasks.workunit.client.0.smithi099.stdout:6/410: symlink d14/d18/d52/d46/l7f 0 2024-01-31T05:13:13.662 INFO:tasks.workunit.client.0.smithi099.stdout:6/411: fdatasync f12 0 2024-01-31T05:13:13.662 INFO:tasks.workunit.client.0.smithi099.stdout:6/412: write f11 [1867706,24401] 0 2024-01-31T05:13:13.663 INFO:tasks.workunit.client.0.smithi099.stdout:5/502: write d6/da/d14/d3d/d51/f8e [280344,113784] 0 2024-01-31T05:13:13.663 INFO:tasks.workunit.client.0.smithi099.stdout:5/503: creat d6/fac x:0 0 0 2024-01-31T05:13:13.665 INFO:tasks.workunit.client.0.smithi099.stdout:4/511: rename d0/d2/l1f to d0/d2/d4b/d93/d86/lae 0 2024-01-31T05:13:13.665 INFO:tasks.workunit.client.0.smithi099.stdout:4/512: readlink d0/d1e/d61/l85 0 2024-01-31T05:13:13.666 INFO:tasks.workunit.client.0.smithi099.stdout:4/513: chown d0/d8/d19/d65/f6d 191003929 1 2024-01-31T05:13:13.666 INFO:tasks.workunit.client.0.smithi099.stdout:4/514: creat d0/d8/faf x:0 0 0 2024-01-31T05:13:13.666 INFO:tasks.workunit.client.0.smithi099.stdout:4/515: truncate d0/d1e/f35 2140601 0 2024-01-31T05:13:13.667 INFO:tasks.workunit.client.0.smithi099.stdout:4/516: truncate d0/d79/fa7 633478 0 2024-01-31T05:13:13.669 INFO:tasks.workunit.client.0.smithi099.stdout:9/471: rename d0/d1/d24/f80 to d0/d1/d24/d48/f9f 0 2024-01-31T05:13:13.669 INFO:tasks.workunit.client.0.smithi099.stdout:9/472: chown d0/d1/d24/l4d 7447 1 2024-01-31T05:13:13.669 INFO:tasks.workunit.client.0.smithi099.stdout:9/473: write d0/d1/f9c [68750,92121] 0 2024-01-31T05:13:13.669 INFO:tasks.workunit.client.0.smithi099.stdout:9/474: write d0/d1/d24/f69 [545824,48980] 0 2024-01-31T05:13:13.670 INFO:tasks.workunit.client.0.smithi099.stdout:3/524: read d10/d24/d40/f82 [1101366,13720] 0 2024-01-31T05:13:13.670 INFO:tasks.workunit.client.0.smithi099.stdout:3/525: creat d10/fc2 x:0 0 0 2024-01-31T05:13:13.671 INFO:tasks.workunit.client.0.smithi099.stdout:2/479: rename d10/d1b/d4d/c56 to d10/d1b/d7d/c9e 0 2024-01-31T05:13:13.675 INFO:tasks.workunit.client.0.smithi099.stdout:4/517: symlink d0/d2/d4b/d93/d17/d24/d3f/lb0 0 2024-01-31T05:13:13.675 INFO:tasks.workunit.client.0.smithi099.stdout:6/413: dread fc [4194304,4194304] 0 2024-01-31T05:13:13.675 INFO:tasks.workunit.client.0.smithi099.stdout:6/414: chown d14/d18/d52/d22/c5e 667485 1 2024-01-31T05:13:13.675 INFO:tasks.workunit.client.0.smithi099.stdout:9/475: symlink d0/d1/d5e/la0 0 2024-01-31T05:13:13.677 INFO:tasks.workunit.client.0.smithi099.stdout:7/495: dwrite d6/d32/d3d/d4b/d33/d37/d50/d25/d72/d8e/f96 [0,4194304] 0 2024-01-31T05:13:13.677 INFO:tasks.workunit.client.0.smithi099.stdout:7/496: fdatasync d6/f1f 0 2024-01-31T05:13:13.677 INFO:tasks.workunit.client.0.smithi099.stdout:6/415: unlink d14/d18/d52/d7e/d1c/d29/f31 0 2024-01-31T05:13:13.678 INFO:tasks.workunit.client.0.smithi099.stdout:8/545: rename d1/dd/d11/d29/d3f/d56/d57/f59 to d1/dd/d11/d29/d3f/fb3 0 2024-01-31T05:13:13.685 INFO:tasks.workunit.client.0.smithi099.stdout:4/518: rename d0/d8/la to d0/d2/d20/d84/lb1 0 2024-01-31T05:13:13.685 INFO:tasks.workunit.client.0.smithi099.stdout:4/519: write d0/d2/d20/f38 [822681,90804] 0 2024-01-31T05:13:13.691 INFO:tasks.workunit.client.0.smithi099.stdout:1/485: dwrite d4/db/f25 [0,4194304] 0 2024-01-31T05:13:13.692 INFO:tasks.workunit.client.0.smithi099.stdout:5/504: dread d6/da/d14/d3d/d6e/f42 [0,4194304] 0 2024-01-31T05:13:13.692 INFO:tasks.workunit.client.0.smithi099.stdout:0/501: dwrite d1/d30/d45/d66/f9b [0,4194304] 0 2024-01-31T05:13:13.692 INFO:tasks.workunit.client.0.smithi099.stdout:0/502: stat d1/d37/d73 0 2024-01-31T05:13:13.692 INFO:tasks.workunit.client.0.smithi099.stdout:5/505: stat d6/da/d3f/c38 0 2024-01-31T05:13:13.693 INFO:tasks.workunit.client.0.smithi099.stdout:8/546: dread d1/dd/d11/d29/d3f/f86 [0,4194304] 0 2024-01-31T05:13:13.709 INFO:tasks.workunit.client.0.smithi099.stdout:3/526: dwrite d10/d32/f3b [4194304,4194304] 0 2024-01-31T05:13:13.711 INFO:tasks.workunit.client.0.smithi099.stdout:2/480: dwrite d10/d20/f37 [8388608,4194304] 0 2024-01-31T05:13:13.711 INFO:tasks.workunit.client.0.smithi099.stdout:9/476: dwrite d0/d1/d24/f69 [0,4194304] 0 2024-01-31T05:13:13.711 INFO:tasks.workunit.client.0.smithi099.stdout:9/477: creat d0/d1/d24/fa1 x:0 0 0 2024-01-31T05:13:13.720 INFO:tasks.workunit.client.0.smithi099.stdout:8/547: dwrite d1/dd/d11/d29/d3f/d56/f90 [0,4194304] 0 2024-01-31T05:13:13.721 INFO:tasks.workunit.client.0.smithi099.stdout:8/548: chown d1/dd/d11/d29/d3f/d56/da0/d2e/ca8 241398560 1 2024-01-31T05:13:13.736 INFO:tasks.workunit.client.0.smithi099.stdout:2/481: dwrite d10/f15 [0,4194304] 0 2024-01-31T05:13:13.754 INFO:tasks.workunit.client.0.smithi099.stdout:2/482: dwrite d10/d20/f50 [0,4194304] 0 2024-01-31T05:13:13.775 INFO:tasks.workunit.client.0.smithi099.stdout:2/483: dwrite f1 [0,4194304] 0 2024-01-31T05:13:14.003 INFO:tasks.workunit.client.0.smithi099.stdout:4/520: unlink d0/d2/d20/f38 0 2024-01-31T05:13:14.014 INFO:tasks.workunit.client.0.smithi099.stdout:0/503: mknod d1/d56/ca8 0 2024-01-31T05:13:14.014 INFO:tasks.workunit.client.0.smithi099.stdout:0/504: chown d1/d22/f55 883968 1 2024-01-31T05:13:14.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:13 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:14.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:13 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:14.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:13 smithi099 ceph-mon[31615]: pgmap v404: 97 pgs: 97 active+clean; 615 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 82 MiB/s rd, 102 MiB/s wr, 2.65k op/s 2024-01-31T05:13:14.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:13 smithi099 ceph-mon[31615]: mds.? [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] up:active 2024-01-31T05:13:14.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:13 smithi099 ceph-mon[31615]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:13:14.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:13 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:14.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:13 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:14.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:13 smithi181 ceph-mon[36434]: pgmap v404: 97 pgs: 97 active+clean; 615 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 82 MiB/s rd, 102 MiB/s wr, 2.65k op/s 2024-01-31T05:13:14.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:13 smithi181 ceph-mon[36434]: mds.? [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] up:active 2024-01-31T05:13:14.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:13 smithi181 ceph-mon[36434]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:13:14.109 INFO:tasks.workunit.client.0.smithi099.stdout:9/478: symlink d0/d7/d2e/la2 0 2024-01-31T05:13:14.123 INFO:tasks.workunit.client.0.smithi099.stdout:9/479: dread d0/d3e/f42 [0,4194304] 0 2024-01-31T05:13:14.129 INFO:tasks.workunit.client.0.smithi099.stdout:8/549: mkdir d1/da6/db4 0 2024-01-31T05:13:14.129 INFO:tasks.workunit.client.0.smithi099.stdout:8/550: write d1/f10 [3256381,88183] 0 2024-01-31T05:13:14.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:13 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:14.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:13 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:14.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:13 smithi179 ceph-mon[35652]: pgmap v404: 97 pgs: 97 active+clean; 615 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 82 MiB/s rd, 102 MiB/s wr, 2.65k op/s 2024-01-31T05:13:14.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:13 smithi179 ceph-mon[35652]: mds.? [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] up:active 2024-01-31T05:13:14.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:13 smithi179 ceph-mon[35652]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:13:14.141 INFO:tasks.workunit.client.0.smithi099.stdout:2/484: mknod d10/d2b/d7c/c9f 0 2024-01-31T05:13:14.141 INFO:tasks.workunit.client.0.smithi099.stdout:2/485: readlink d10/l17 0 2024-01-31T05:13:14.152 INFO:tasks.workunit.client.0.smithi099.stdout:8/551: dread d1/dd/d4f/d51/f5d [0,4194304] 0 2024-01-31T05:13:14.281 INFO:tasks.workunit.client.0.smithi099.stdout:4/521: mkdir d0/d2/d4b/d93/d17/d7d/db2 0 2024-01-31T05:13:14.291 INFO:tasks.workunit.client.0.smithi099.stdout:0/505: link d1/d16/d36/f7c d1/d16/d36/d8b/fa9 0 2024-01-31T05:13:14.291 INFO:tasks.workunit.client.0.smithi099.stdout:0/506: fdatasync d1/d8/f65 0 2024-01-31T05:13:14.295 INFO:tasks.workunit.client.0.smithi099.stdout:9/480: symlink d0/d1/d24/d2b/d59/la3 0 2024-01-31T05:13:14.314 INFO:tasks.workunit.client.0.smithi099.stdout:7/497: unlink d6/d32/d3d/d4b/d33/d37/d50/d25/d47/c5c 0 2024-01-31T05:13:14.320 INFO:tasks.workunit.client.0.smithi099.stdout:8/552: dwrite d1/dd/d11/d29/d3f/d56/f88 [0,4194304] 0 2024-01-31T05:13:14.413 INFO:tasks.workunit.client.0.smithi099.stdout:0/507: dwrite d1/f8f [0,4194304] 0 2024-01-31T05:13:14.683 INFO:tasks.workunit.client.0.smithi099.stdout:1/486: rename d4/db/f73 to d4/db/f94 0 2024-01-31T05:13:14.726 INFO:tasks.workunit.client.0.smithi099.stdout:4/522: symlink d0/d2/d4b/d93/d17/lb3 0 2024-01-31T05:13:14.726 INFO:tasks.workunit.client.0.smithi099.stdout:4/523: dread - d0/d8/d19/d65/f75 zero size 2024-01-31T05:13:14.726 INFO:tasks.workunit.client.0.smithi099.stdout:4/524: write d0/d2/f9f [174611,118394] 0 2024-01-31T05:13:14.732 INFO:tasks.workunit.client.0.smithi099.stdout:0/508: creat d1/d37/d4a/faa x:0 0 0 2024-01-31T05:13:14.732 INFO:tasks.workunit.client.0.smithi099.stdout:0/509: fdatasync d1/d16/d36/f68 0 2024-01-31T05:13:14.733 INFO:tasks.workunit.client.0.smithi099.stdout:0/510: dread - d1/d22/f94 zero size 2024-01-31T05:13:14.735 INFO:tasks.workunit.client.0.smithi099.stdout:7/498: rmdir d6/d32/d3d/d4b/d33/d37/d50/d25/d47 39 2024-01-31T05:13:14.739 INFO:tasks.workunit.client.0.smithi099.stdout:5/506: sync 2024-01-31T05:13:14.739 INFO:tasks.workunit.client.0.smithi099.stdout:6/416: rename d14/d18/d3b/f5b to d14/d18/d52/d22/f80 0 2024-01-31T05:13:14.739 INFO:tasks.workunit.client.0.smithi099.stdout:5/507: read d6/da/f56 [40600,503] 0 2024-01-31T05:13:14.740 INFO:tasks.workunit.client.0.smithi099.stdout:5/508: dread - d6/fac zero size 2024-01-31T05:13:14.741 INFO:tasks.workunit.client.0.smithi099.stdout:6/417: write f11 [4447330,104412] 0 2024-01-31T05:13:14.743 INFO:tasks.workunit.client.0.smithi099.stdout:3/527: rename d10/d32/d33/c94 to d10/d32/cc3 0 2024-01-31T05:13:14.745 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:14.745+0000 7eff117fa640 1 -- 172.21.15.99:0/3306173308 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x7eff2000eb60 con 0x5574e6fa9f80 2024-01-31T05:13:14.745 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:14.745+0000 7eff117fa640 10 client.25375 handle_command_reply: tid=0 2024-01-31T05:13:14.745 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:14.745+0000 7eff32c1a740 1 client.25375 shutdown 2024-01-31T05:13:14.745 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:14.745+0000 7eff32c1a740 1 -- 172.21.15.99:0/3306173308 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5574e6f41dd0 msgr2=0x5574e6f4cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:14.746 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:14.745+0000 7eff32c1a740 1 --2- 172.21.15.99:0/3306173308 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5574e6f41dd0 0x5574e6f4cad0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7eff20006d80 tx=0x7eff20036ae0 comp rx=0 tx=0).stop 2024-01-31T05:13:14.746 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:14.745+0000 7eff32c1a740 1 -- 172.21.15.99:0/3306173308 shutdown_connections 2024-01-31T05:13:14.746 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:14.745+0000 7eff32c1a740 1 --2- 172.21.15.99:0/3306173308 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5574e6f41dd0 0x5574e6f4cad0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:14.746 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:14.745+0000 7eff32c1a740 1 --2- 172.21.15.99:0/3306173308 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574e6f3cc60 0x5574e6f4c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:14.746 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:14.745+0000 7eff32c1a740 1 --2- 172.21.15.99:0/3306173308 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5574e6fa9f80 0x5574e6fac3a0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:14.746 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:14.745+0000 7eff32c1a740 1 --2- 172.21.15.99:0/3306173308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5574e6f3c270 0x5574e6f4c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:14.746 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:14.745+0000 7eff117fa640 0 client.25375 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:13:14.746 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:14.745+0000 7eff32c1a740 1 -- 172.21.15.99:0/3306173308 >> 172.21.15.99:0/3306173308 conn(0x5574e6f377e0 msgr2=0x5574e6f3df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:14.746 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:14.746+0000 7eff32c1a740 1 -- 172.21.15.99:0/3306173308 shutdown_connections 2024-01-31T05:13:14.746 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:14.746+0000 7eff32c1a740 1 -- 172.21.15.99:0/3306173308 wait complete. 2024-01-31T05:13:14.746 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:14.746+0000 7eff32c1a740 20 client.25375 trim_cache size 0 max 16384 2024-01-31T05:13:14.747 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout:{ 2024-01-31T05:13:14.747 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout: "message": "", 2024-01-31T05:13:14.747 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout: "return_code": 0 2024-01-31T05:13:14.747 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout:} 2024-01-31T05:13:14.747 INFO:tasks.workunit.client.0.smithi099.stdout:4/525: dwrite d0/d2/d4b/d93/d39/d66/f6c [0,4194304] 0 2024-01-31T05:13:14.748 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:14.747+0000 7eff2fe59640 1 -- 172.21.15.99:0/347238912 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7eff140a1380 msgr2=0x7eff140a3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:14.748 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:14.747+0000 7eff2fe59640 1 --2- 172.21.15.99:0/347238912 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7eff140a1380 0x7eff140a3840 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7eff240057c0 tx=0x7eff240e6b90 comp rx=0 tx=0).stop 2024-01-31T05:13:14.748 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:14.747+0000 7eff2fe59640 1 -- 172.21.15.99:0/347238912 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff28100d40 msgr2=0x7eff28198fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:14.748 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:14.747+0000 7eff2fe59640 1 --2- 172.21.15.99:0/347238912 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff28100d40 0x7eff28198fb0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7eff24009230 tx=0x7eff240040c0 comp rx=0 tx=0).stop 2024-01-31T05:13:14.748 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:14.747+0000 7eff2fe59640 1 -- 172.21.15.99:0/347238912 shutdown_connections 2024-01-31T05:13:14.748 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:14.747+0000 7eff2fe59640 1 --2- 172.21.15.99:0/347238912 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7eff140a1380 0x7eff140a3840 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:14.748 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:14.747+0000 7eff2fe59640 1 --2- 172.21.15.99:0/347238912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff281028f0 0x7eff281a0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:14.748 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:14.747+0000 7eff2fe59640 1 --2- 172.21.15.99:0/347238912 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff28101f30 0x7eff281994f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:14.749 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:14.747+0000 7eff2fe59640 1 --2- 172.21.15.99:0/347238912 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff28100d40 0x7eff28198fb0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:14.749 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:14.747+0000 7eff2fe59640 1 -- 172.21.15.99:0/347238912 >> 172.21.15.99:0/347238912 conn(0x7eff280fc2b0 msgr2=0x7eff28072f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:14.749 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:14.747+0000 7eff2fe59640 1 -- 172.21.15.99:0/347238912 shutdown_connections 2024-01-31T05:13:14.749 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:14.747+0000 7eff2fe59640 1 -- 172.21.15.99:0/347238912 wait complete. 2024-01-31T05:13:14.749 INFO:tasks.workunit.client.0.smithi099.stdout:9/481: rename d0/d1/d24/f5a to d0/d1/d24/d2b/d7b/fa4 0 2024-01-31T05:13:14.752 INFO:tasks.workunit.client.0.smithi099.stdout:8/553: rename d1/dd/d65/d7f/f91 to d1/dd/d65/d7f/d81/fb5 0 2024-01-31T05:13:14.752 INFO:tasks.workunit.client.0.smithi099.stdout:9/482: mknod d0/d1/d5e/ca5 0 2024-01-31T05:13:14.753 INFO:tasks.workunit.client.0.smithi099.stdout:9/483: write d0/d1/d24/d2b/d63/f7e [558758,9962] 0 2024-01-31T05:13:14.755 INFO:tasks.workunit.client.0.smithi099.stdout:5/509: rename d6/da/d14/faa to d6/da/d14/d3d/d57/fad 0 2024-01-31T05:13:14.757 INFO:tasks.workunit.client.0.smithi099.stdout:8/554: symlink d1/dd/d65/d7f/lb6 0 2024-01-31T05:13:14.757 INFO:tasks.workunit.client.0.smithi099.stdout:8/555: chown d1/dd/d11/d29/d3f/d56 127146686 1 2024-01-31T05:13:14.759 INFO:tasks.workunit.client.0.smithi099.stdout:9/484: mkdir d0/d7/da6 0 2024-01-31T05:13:14.759 INFO:tasks.workunit.client.0.smithi099.stdout:9/485: dread - d0/d1/d24/d2b/d7b/f9d zero size 2024-01-31T05:13:14.761 INFO:tasks.workunit.client.0.smithi099.stdout:4/526: rename d0/d2/d4b/d93/d39/d66 to d0/d2/d4b/d93/d86/db4 0 2024-01-31T05:13:14.761 INFO:tasks.workunit.client.0.smithi099.stdout:4/527: chown d0/d2/d4b/d93/d17/d3d/f6a 37 1 2024-01-31T05:13:14.761 INFO:tasks.workunit.client.0.smithi099.stdout:4/528: chown d0/d2/d4b/d93/d17/d24/d3f/fa6 8 1 2024-01-31T05:13:14.761 INFO:tasks.workunit.client.0.smithi099.stdout:2/486: sync 2024-01-31T05:13:14.762 INFO:tasks.workunit.client.0.smithi099.stdout:5/510: mkdir d6/da/d14/d3d/d51/dae 0 2024-01-31T05:13:14.762 INFO:tasks.workunit.client.0.smithi099.stdout:5/511: chown d6/da/d3f/d5a/ca3 417 1 2024-01-31T05:13:14.762 INFO:tasks.workunit.client.0.smithi099.stdout:5/512: creat d6/da/d14/d61/d98/faf x:0 0 0 2024-01-31T05:13:14.762 INFO:tasks.workunit.client.0.smithi099.stdout:5/513: dread - d6/da/d14/d3d/d51/d82/f76 zero size 2024-01-31T05:13:14.762 INFO:tasks.workunit.client.0.smithi099.stdout:5/514: stat d6/da/d14/d3d/d51/f74 0 2024-01-31T05:13:14.762 INFO:tasks.workunit.client.0.smithi099.stdout:5/515: readlink d6/da/d14/d2b/l89 0 2024-01-31T05:13:14.763 INFO:tasks.workunit.client.0.smithi099.stdout:4/529: symlink d0/d8/d19/d54/d76/lb5 0 2024-01-31T05:13:14.763 INFO:tasks.workunit.client.0.smithi099.stdout:4/530: write d0/d2/d4b/d93/d59/d8f/fa4 [745177,8030] 0 2024-01-31T05:13:14.763 INFO:tasks.workunit.client.0.smithi099.stdout:2/487: mknod d10/d2b/ca0 0 2024-01-31T05:13:14.765 INFO:tasks.workunit.client.0.smithi099.stdout:4/531: unlink d0/d2/d4b/d93/d17/d3d/c58 0 2024-01-31T05:13:14.765 INFO:tasks.workunit.client.0.smithi099.stdout:4/532: chown d0/d2/d4b/d93/d17/d24/d3f 2 1 2024-01-31T05:13:14.767 INFO:tasks.workunit.client.0.smithi099.stdout:2/488: unlink lf 0 2024-01-31T05:13:14.767 INFO:tasks.workunit.client.0.smithi099.stdout:2/489: getdents d10/d2b/d97 0 2024-01-31T05:13:14.767 INFO:tasks.workunit.client.0.smithi099.stdout:4/533: rmdir d0/d2/d4b/d93/d17/d24 39 2024-01-31T05:13:14.768 INFO:tasks.workunit.client.0.smithi099.stdout:6/418: link d14/d18/d52/c48 d14/d18/d52/d7e/d1c/c81 0 2024-01-31T05:13:14.768 INFO:tasks.workunit.client.0.smithi099.stdout:6/419: write fc [1428100,98695] 0 2024-01-31T05:13:14.768 INFO:tasks.workunit.client.0.smithi099.stdout:0/511: dwrite d1/d30/d45/d6e/f74 [0,4194304] 0 2024-01-31T05:13:14.768 INFO:tasks.workunit.client.0.smithi099.stdout:0/512: truncate d1/d22/fa5 707975 0 2024-01-31T05:13:14.768 INFO:tasks.workunit.client.0.smithi099.stdout:2/490: truncate d10/d2b/d7c/f90 2699159 0 2024-01-31T05:13:14.770 INFO:tasks.workunit.client.0.smithi099.stdout:4/534: creat d0/d2/d4b/d93/d59/d82/fb6 x:0 0 0 2024-01-31T05:13:14.771 INFO:tasks.workunit.client.0.smithi099.stdout:3/528: dwrite d10/f66 [0,4194304] 0 2024-01-31T05:13:14.772 INFO:tasks.workunit.client.0.smithi099.stdout:9/486: dread d0/d1/d24/d2b/f1b [0,4194304] 0 2024-01-31T05:13:14.773 INFO:tasks.workunit.client.0.smithi099.stdout:7/499: dwrite d6/d32/d3d/d4b/d33/d37/d50/d25/d79/f8c [0,4194304] 0 2024-01-31T05:13:14.773 INFO:tasks.workunit.client.0.smithi099.stdout:6/420: getdents d14/d18/d3b/d7b 0 2024-01-31T05:13:14.773 INFO:tasks.workunit.client.0.smithi099.stdout:6/421: write f11 [4349244,47017] 0 2024-01-31T05:13:14.774 INFO:tasks.workunit.client.0.smithi099.stdout:0/513: mknod d1/d37/d4a/d7a/cab 0 2024-01-31T05:13:14.774 INFO:tasks.workunit.client.0.smithi099.stdout:0/514: creat d1/d22/fac x:0 0 0 2024-01-31T05:13:14.775 INFO:tasks.workunit.client.0.smithi099.stdout:6/422: creat d14/d18/d52/d7e/d1c/f82 x:0 0 0 2024-01-31T05:13:14.775 INFO:tasks.workunit.client.0.smithi099.stdout:6/423: write d14/d18/d52/d7e/d1c/d29/f69 [145939,86369] 0 2024-01-31T05:13:14.776 INFO:tasks.workunit.client.0.smithi099.stdout:4/535: truncate d0/d8/d19/d98/d9b/dab/f6b 1150960 0 2024-01-31T05:13:14.777 INFO:tasks.workunit.client.0.smithi099.stdout:6/424: creat d14/d18/d52/d7e/f83 x:0 0 0 2024-01-31T05:13:14.777 INFO:tasks.workunit.client.0.smithi099.stdout:6/425: chown d14/d18/d52/d7e/d1c/d29/d43/c5d 79 1 2024-01-31T05:13:14.779 INFO:tasks.workunit.client.0.smithi099.stdout:3/529: rename d10/d27/f29 to d10/fc4 0 2024-01-31T05:13:14.779 INFO:tasks.workunit.client.0.smithi099.stdout:3/530: chown d10/d32/d85/da3/db9 553536 1 2024-01-31T05:13:14.779 INFO:tasks.workunit.client.0.smithi099.stdout:3/531: write d10/d27/d34/f5c [5026178,90473] 0 2024-01-31T05:13:14.779 INFO:tasks.workunit.client.0.smithi099.stdout:3/532: stat d10/d27/d34/d44/d60/d75/d8c/db6/cbb 0 2024-01-31T05:13:14.779 INFO:tasks.workunit.client.0.smithi099.stdout:3/533: chown d10/c13 79012 1 2024-01-31T05:13:14.780 INFO:tasks.workunit.client.0.smithi099.stdout:8/556: dread d1/dd/d11/d29/d3f/d56/da0/f77 [0,4194304] 0 2024-01-31T05:13:14.782 INFO:tasks.workunit.client.0.smithi099.stdout:4/536: dread d0/d2/f9f [0,4194304] 0 2024-01-31T05:13:14.782 INFO:tasks.workunit.client.0.smithi099.stdout:4/537: creat d0/d2/d4b/d93/d17/d3d/fb7 x:0 0 0 2024-01-31T05:13:14.782 INFO:tasks.workunit.client.0.smithi099.stdout:4/538: write d0/d8/d19/f2d [571332,52113] 0 2024-01-31T05:13:14.783 INFO:tasks.workunit.client.0.smithi099.stdout:7/500: unlink d6/f82 0 2024-01-31T05:13:14.783 INFO:tasks.workunit.client.0.smithi099.stdout:7/501: dread - d6/d32/d3d/f5f zero size 2024-01-31T05:13:14.785 INFO:tasks.workunit.client.0.smithi099.stdout:6/426: rename d14/d18/d52/f47 to d14/d18/d52/f84 0 2024-01-31T05:13:14.787 INFO:tasks.workunit.client.0.smithi099.stdout:5/516: dwrite d6/da/d14/d61/d98/faf [0,4194304] 0 2024-01-31T05:13:14.787 INFO:tasks.workunit.client.0.smithi099.stdout:5/517: stat d6/da/d14/d3d/d51/f9f 0 2024-01-31T05:13:14.789 INFO:tasks.workunit.client.0.smithi099.stdout:8/557: creat d1/dd/d11/da9/fb7 x:0 0 0 2024-01-31T05:13:14.793 INFO:tasks.workunit.client.0.smithi099.stdout:6/427: truncate d14/d18/d3b/d7b/f7d 2729335 0 2024-01-31T05:13:14.793 INFO:tasks.workunit.client.0.smithi099.stdout:6/428: write d14/d18/d52/d7e/d1c/d29/f32 [993903,91996] 0 2024-01-31T05:13:14.801 INFO:tasks.workunit.client.0.smithi099.stdout:8/558: unlink d1/dd/d1d/f9a 0 2024-01-31T05:13:14.801 INFO:tasks.workunit.client.0.smithi099.stdout:8/559: chown d1/dd/d11/d20/f4c 186948 1 2024-01-31T05:13:14.803 INFO:tasks.workunit.client.0.smithi099.stdout:5/518: dread d6/fd [0,4194304] 0 2024-01-31T05:13:14.804 INFO:tasks.workunit.client.0.smithi099.stdout:2/491: dwrite d10/d1c/f39 [0,4194304] 0 2024-01-31T05:13:14.804 INFO:tasks.workunit.client.0.smithi099.stdout:2/492: stat d10/c29 0 2024-01-31T05:13:14.807 INFO:tasks.workunit.client.0.smithi099.stdout:8/560: rmdir d1/dd/d11 39 2024-01-31T05:13:14.809 INFO:tasks.workunit.client.0.smithi099.stdout:5/519: mkdir d6/da/d14/d3d/d51/dae/db0 0 2024-01-31T05:13:14.810 INFO:tasks.workunit.client.0.smithi099.stdout:5/520: dread d6/da/d14/d61/f64 [0,4194304] 0 2024-01-31T05:13:14.811 INFO:tasks.workunit.client.0.smithi099.stdout:2/493: creat d10/d3a/d69/fa1 x:0 0 0 2024-01-31T05:13:14.811 INFO:tasks.workunit.client.0.smithi099.stdout:9/487: dwrite d0/d1/d24/d2b/f3c [0,4194304] 0 2024-01-31T05:13:14.811 INFO:tasks.workunit.client.0.smithi099.stdout:3/534: dwrite d10/d27/d34/d44/d60/d75/d8c/f9f [0,4194304] 0 2024-01-31T05:13:14.811 INFO:tasks.workunit.client.0.smithi099.stdout:3/535: write d10/fbf [150166,3870] 0 2024-01-31T05:13:14.812 INFO:tasks.workunit.client.0.smithi099.stdout:2/494: symlink d10/d1b/d9b/la2 0 2024-01-31T05:13:14.814 INFO:tasks.workunit.client.0.smithi099.stdout:8/561: link d1/dd/d11/d19/d21/d3c/c42 d1/dd/d11/d29/d3f/d56/cb8 0 2024-01-31T05:13:14.816 INFO:tasks.workunit.client.0.smithi099.stdout:9/488: mkdir d0/d1/d24/d2b/d63/da7 0 2024-01-31T05:13:14.821 INFO:tasks.workunit.client.0.smithi099.stdout:2/495: creat d10/d1c/fa3 x:0 0 0 2024-01-31T05:13:14.821 INFO:tasks.workunit.client.0.smithi099.stdout:8/562: write d1/dd/d4f/d51/f5d [2307951,101842] 0 2024-01-31T05:13:14.824 INFO:tasks.workunit.client.0.smithi099.stdout:9/489: creat d0/d3e/d33/fa8 x:0 0 0 2024-01-31T05:13:14.824 INFO:tasks.workunit.client.0.smithi099.stdout:9/490: stat d0/d7/d2e/l2f 0 2024-01-31T05:13:14.827 INFO:tasks.workunit.client.0.smithi099.stdout:9/491: unlink d0/d7/d2e/f71 0 2024-01-31T05:13:14.834 INFO:tasks.workunit.client.0.smithi099.stdout:8/563: dread d1/dd/d1d/f40 [0,4194304] 0 2024-01-31T05:13:14.834 INFO:tasks.workunit.client.0.smithi099.stdout:5/521: dwrite d6/da/d14/d3d/d51/d82/f76 [0,4194304] 0 2024-01-31T05:13:14.835 INFO:tasks.workunit.client.0.smithi099.stdout:5/522: dread - d6/da/f4f zero size 2024-01-31T05:13:14.837 INFO:tasks.workunit.client.0.smithi099.stdout:3/536: dwrite d10/f19 [0,4194304] 0 2024-01-31T05:13:14.837 INFO:tasks.workunit.client.0.smithi099.stdout:0/515: rename d1/d22 to d1/d30/d45/dad 0 2024-01-31T05:13:14.837 INFO:tasks.workunit.client.0.smithi099.stdout:0/516: truncate d1/d37/f86 26600 0 2024-01-31T05:13:14.837 INFO:tasks.workunit.client.0.smithi099.stdout:0/517: read d1/d30/d45/d66/f33 [3233159,7926] 0 2024-01-31T05:13:14.837 INFO:tasks.workunit.client.0.smithi099.stdout:0/518: chown d1/d30/d45/d66/f25 13476424 1 2024-01-31T05:13:14.840 INFO:tasks.workunit.client.0.smithi099.stdout:2/496: rename d10/d1c/l4b to d10/d51/la4 0 2024-01-31T05:13:14.842 INFO:tasks.workunit.client.0.smithi099.stdout:0/519: creat d1/d37/d4a/d7a/d9d/fae x:0 0 0 2024-01-31T05:13:14.842 INFO:tasks.workunit.client.0.smithi099.stdout:0/520: truncate d1/d8/f61 293095 0 2024-01-31T05:13:14.844 INFO:tasks.workunit.client.0.smithi099.stdout:0/521: link d1/d37/d4a/d7a/d7d/f88 d1/d56/faf 0 2024-01-31T05:13:14.846 INFO:tasks.workunit.client.0.smithi099.stdout:0/522: creat d1/d37/d4a/d6f/fb0 x:0 0 0 2024-01-31T05:13:14.846 INFO:tasks.workunit.client.0.smithi099.stdout:0/523: chown d1/d16/d36/c49 2787674 1 2024-01-31T05:13:14.848 INFO:tasks.workunit.client.0.smithi099.stdout:0/524: getdents d1/d16/d36 0 2024-01-31T05:13:14.848 INFO:tasks.workunit.client.0.smithi099.stdout:9/492: dread d0/d7/f1f [0,4194304] 0 2024-01-31T05:13:14.851 INFO:tasks.workunit.client.0.smithi099.stdout:0/525: mkdir d1/d30/d45/dad/db1 0 2024-01-31T05:13:14.851 INFO:tasks.workunit.client.0.smithi099.stdout:0/526: read - d1/d37/d4a/faa zero size 2024-01-31T05:13:14.851 INFO:tasks.workunit.client.0.smithi099.stdout:9/493: getdents d0/d1/d24/d2b/d7b 0 2024-01-31T05:13:14.854 INFO:tasks.workunit.client.0.smithi099.stdout:8/564: dread d1/dd/d11/d20/f4b [0,4194304] 0 2024-01-31T05:13:14.855 INFO:tasks.workunit.client.0.smithi099.stdout:9/494: creat d0/d1/d5e/d72/fa9 x:0 0 0 2024-01-31T05:13:14.857 INFO:tasks.workunit.client.0.smithi099.stdout:9/495: mkdir d0/d1/d24/d2b/d63/da7/daa 0 2024-01-31T05:13:14.857 INFO:tasks.workunit.client.0.smithi099.stdout:9/496: write d0/f8e [365363,21192] 0 2024-01-31T05:13:14.868 INFO:tasks.workunit.client.0.smithi099.stdout:4/539: dwrite d0/d8/d19/d98/d9b/dab/f6b [0,4194304] 0 2024-01-31T05:13:14.868 INFO:tasks.workunit.client.0.smithi099.stdout:3/537: dwrite d10/d27/d34/d44/d60/d75/f9e [0,4194304] 0 2024-01-31T05:13:14.871 INFO:tasks.workunit.client.0.smithi099.stdout:4/540: rename d0/d8/f16 to d0/d74/fb8 0 2024-01-31T05:13:14.872 INFO:tasks.workunit.client.0.smithi099.stdout:3/538: creat d10/d32/d85/da3/fc5 x:0 0 0 2024-01-31T05:13:14.872 INFO:tasks.workunit.client.0.smithi099.stdout:2/497: dwrite d10/d1c/f26 [0,4194304] 0 2024-01-31T05:13:14.873 INFO:tasks.workunit.client.0.smithi099.stdout:8/565: dread d1/dd/d11/d19/d21/d3c/f46 [0,4194304] 0 2024-01-31T05:13:14.878 INFO:tasks.workunit.client.0.smithi099.stdout:8/566: symlink d1/dd/d11/d29/d3a/lb9 0 2024-01-31T05:13:14.881 INFO:tasks.workunit.client.0.smithi099.stdout:2/498: read d10/d1c/f2d [1690233,28018] 0 2024-01-31T05:13:14.881 INFO:tasks.workunit.client.0.smithi099.stdout:2/499: rename d10/d2b/d58 to d10/d2b/d58/da5 22 2024-01-31T05:13:14.885 INFO:tasks.workunit.client.0.smithi099.stdout:2/500: creat d10/d3a/d94/fa6 x:0 0 0 2024-01-31T05:13:14.887 INFO:tasks.workunit.client.0.smithi099.stdout:9/497: write d0/d5d/f91 [2567228,84618] 0 2024-01-31T05:13:14.887 INFO:tasks.workunit.client.0.smithi099.stdout:0/527: dwrite d1/d16/f50 [0,4194304] 0 2024-01-31T05:13:14.887 INFO:tasks.workunit.client.0.smithi099.stdout:2/501: symlink d10/d2b/d97/la7 0 2024-01-31T05:13:14.890 INFO:tasks.workunit.client.0.smithi099.stdout:9/498: mkdir d0/d3e/d33/dab 0 2024-01-31T05:13:14.892 INFO:tasks.workunit.client.0.smithi099.stdout:0/528: rename d1/d30/d45/d66/f25 to d1/d30/fb2 0 2024-01-31T05:13:14.894 INFO:tasks.workunit.client.0.smithi099.stdout:9/499: mknod d0/d44/cac 0 2024-01-31T05:13:14.894 INFO:tasks.workunit.client.0.smithi099.stdout:9/500: fsync d0/d1/d24/d48/f6a 0 2024-01-31T05:13:14.894 INFO:tasks.workunit.client.0.smithi099.stdout:9/501: write d0/d1/d24/d2b/d7b/f9d [346149,36288] 0 2024-01-31T05:13:14.894 INFO:tasks.workunit.client.0.smithi099.stdout:9/502: chown d0/d44/c73 1799323611 1 2024-01-31T05:13:14.895 INFO:tasks.workunit.client.0.smithi099.stdout:9/503: truncate d0/d1/d5e/d72/d89/f90 629781 0 2024-01-31T05:13:14.896 INFO:tasks.workunit.client.0.smithi099.stdout:0/529: link d1/d30/d45/d66/f33 d1/d37/d4a/d7a/d7d/fb3 0 2024-01-31T05:13:14.897 INFO:tasks.workunit.client.0.smithi099.stdout:8/567: rename d1/dd/d11 to d1/dd/dba 0 2024-01-31T05:13:14.897 INFO:tasks.workunit.client.0.smithi099.stdout:9/504: rmdir d0/d3e 39 2024-01-31T05:13:14.898 INFO:tasks.workunit.client.0.smithi099.stdout:0/530: creat d1/fb4 x:0 0 0 2024-01-31T05:13:14.899 INFO:tasks.workunit.client.0.smithi099.stdout:8/568: creat d1/dd/d7b/d85/fbb x:0 0 0 2024-01-31T05:13:14.900 INFO:tasks.workunit.client.0.smithi099.stdout:9/505: mknod d0/d1/d24/d2b/d63/da7/daa/cad 0 2024-01-31T05:13:14.900 INFO:tasks.workunit.client.0.smithi099.stdout:4/541: dwrite d0/d2/d4b/d93/d86/db4/f6c [0,4194304] 0 2024-01-31T05:13:14.901 INFO:tasks.workunit.client.0.smithi099.stdout:0/531: symlink d1/d30/d45/d6e/lb5 0 2024-01-31T05:13:14.901 INFO:tasks.workunit.client.0.smithi099.stdout:3/539: dwrite d10/fbf [0,4194304] 0 2024-01-31T05:13:14.902 INFO:tasks.workunit.client.0.smithi099.stdout:8/569: truncate d1/f7 1106690 0 2024-01-31T05:13:14.902 INFO:tasks.workunit.client.0.smithi099.stdout:8/570: dread - d1/dd/d7b/d85/fbb zero size 2024-01-31T05:13:14.902 INFO:tasks.workunit.client.0.smithi099.stdout:0/532: dread d1/d30/d45/dad/fa5 [0,4194304] 0 2024-01-31T05:13:14.904 INFO:tasks.workunit.client.0.smithi099.stdout:9/506: unlink d0/d5d/f81 0 2024-01-31T05:13:14.904 INFO:tasks.workunit.client.0.smithi099.stdout:9/507: creat d0/d1/d24/fae x:0 0 0 2024-01-31T05:13:14.904 INFO:tasks.workunit.client.0.smithi099.stdout:4/542: mkdir d0/d2/d4b/d93/d17/d24/d3f/db9 0 2024-01-31T05:13:14.906 INFO:tasks.workunit.client.0.smithi099.stdout:2/502: dwrite d10/d3a/f4f [0,4194304] 0 2024-01-31T05:13:14.906 INFO:tasks.workunit.client.0.smithi099.stdout:2/503: write f4 [1721947,71448] 0 2024-01-31T05:13:14.908 INFO:tasks.workunit.client.0.smithi099.stdout:0/533: unlink d1/f20 0 2024-01-31T05:13:14.910 INFO:tasks.workunit.client.0.smithi099.stdout:9/508: symlink d0/d1/d5e/d72/laf 0 2024-01-31T05:13:14.910 INFO:tasks.workunit.client.0.smithi099.stdout:9/509: truncate d0/d1/d5e/d72/fa9 196117 0 2024-01-31T05:13:14.910 INFO:tasks.workunit.client.0.smithi099.stdout:9/510: truncate d0/d44/f9a 476948 0 2024-01-31T05:13:14.910 INFO:tasks.workunit.client.0.smithi099.stdout:4/543: mknod d0/d2/d4b/d93/d86/db4/cba 0 2024-01-31T05:13:14.912 INFO:tasks.workunit.client.0.smithi099.stdout:4/544: dread d0/d2/d4b/d93/f94 [0,4194304] 0 2024-01-31T05:13:14.912 INFO:tasks.workunit.client.0.smithi099.stdout:4/545: fsync d0/d2/f47 0 2024-01-31T05:13:14.914 INFO:tasks.workunit.client.0.smithi099.stdout:2/504: mknod d10/d2b/d97/ca8 0 2024-01-31T05:13:14.915 INFO:tasks.workunit.client.0.smithi099.stdout:2/505: dread d10/d20/f40 [0,4194304] 0 2024-01-31T05:13:14.915 INFO:tasks.workunit.client.0.smithi099.stdout:2/506: write d10/d1b/f6f [64485,29873] 0 2024-01-31T05:13:14.915 INFO:tasks.workunit.client.0.smithi099.stdout:2/507: readlink d10/l47 0 2024-01-31T05:13:14.915 INFO:tasks.workunit.client.0.smithi099.stdout:0/534: rename d1/f5 to d1/d30/d45/fb6 0 2024-01-31T05:13:14.917 INFO:tasks.workunit.client.0.smithi099.stdout:9/511: link d0/d1/d24/d2b/d59/la3 d0/d5d/lb0 0 2024-01-31T05:13:14.917 INFO:tasks.workunit.client.0.smithi099.stdout:9/512: getdents d0/d1/d24/d2b/d7b 0 2024-01-31T05:13:14.919 INFO:tasks.workunit.client.0.smithi099.stdout:0/535: rename d1/d37/d73/da1 to d1/d37/d73/db7 0 2024-01-31T05:13:14.925 INFO:tasks.workunit.client.0.smithi099.stdout:9/513: dread d0/d3e/f42 [0,4194304] 0 2024-01-31T05:13:14.926 INFO:tasks.workunit.client.0.smithi099.stdout:9/514: fsync d0/d1/d24/d48/f7a 0 2024-01-31T05:13:14.927 INFO:tasks.workunit.client.0.smithi099.stdout:8/571: dwrite d1/dd/dba/d20/f4c [0,4194304] 0 2024-01-31T05:13:14.927 INFO:tasks.workunit.client.0.smithi099.stdout:8/572: dread - d1/dd/d1d/fae zero size 2024-01-31T05:13:14.929 INFO:tasks.workunit.client.0.smithi099.stdout:8/573: mkdir d1/dd/d1d/dbc 0 2024-01-31T05:13:14.930 INFO:tasks.workunit.client.0.smithi099.stdout:8/574: mkdir d1/dd/dba/d19/dbd 0 2024-01-31T05:13:14.932 INFO:tasks.workunit.client.0.smithi099.stdout:2/508: dread d10/f33 [0,4194304] 0 2024-01-31T05:13:14.932 INFO:tasks.workunit.client.0.smithi099.stdout:2/509: write d10/d3a/f70 [225545,112111] 0 2024-01-31T05:13:14.932 INFO:tasks.workunit.client.0.smithi099.stdout:8/575: mkdir d1/dd/d7b/dbe 0 2024-01-31T05:13:14.933 INFO:tasks.workunit.client.0.smithi099.stdout:8/576: mknod d1/dd/d4f/d51/cbf 0 2024-01-31T05:13:14.933 INFO:tasks.workunit.client.0.smithi099.stdout:8/577: write d1/dd/dba/d19/f9d [18810,108822] 0 2024-01-31T05:13:14.935 INFO:tasks.workunit.client.0.smithi099.stdout:0/536: write d1/d30/d45/d66/f15 [444334,104898] 0 2024-01-31T05:13:14.936 INFO:tasks.workunit.client.0.smithi099.stdout:0/537: readlink d1/d30/d45/d6e/lb5 0 2024-01-31T05:13:14.943 INFO:tasks.workunit.client.0.smithi099.stdout:2/510: write d10/d1c/f26 [600825,127970] 0 2024-01-31T05:13:14.943 INFO:tasks.workunit.client.0.smithi099.stdout:2/511: fdatasync d10/d20/f89 0 2024-01-31T05:13:14.943 INFO:tasks.workunit.client.0.smithi099.stdout:4/546: dwrite d0/d2/f47 [0,4194304] 0 2024-01-31T05:13:14.946 INFO:tasks.workunit.client.0.smithi099.stdout:2/512: rmdir d10/d2b 39 2024-01-31T05:13:14.948 INFO:tasks.workunit.client.0.smithi099.stdout:2/513: chown d10/c1d 0 1 2024-01-31T05:13:14.951 INFO:tasks.workunit.client.0.smithi099.stdout:9/515: dwrite d0/d1/d24/d2b/d59/f70 [0,4194304] 0 2024-01-31T05:13:14.962 INFO:tasks.workunit.client.0.smithi099.stdout:0/538: dwrite d1/f80 [4194304,4194304] 0 2024-01-31T05:13:14.962 INFO:tasks.workunit.client.0.smithi099.stdout:8/578: dwrite d1/da6/f8f [0,4194304] 0 2024-01-31T05:13:14.972 INFO:tasks.workunit.client.0.smithi099.stdout:0/539: mknod d1/d37/d4a/d7a/cb8 0 2024-01-31T05:13:14.975 INFO:tasks.workunit.client.0.smithi099.stdout:4/547: dwrite d0/d2/d4b/d93/d59/f8b [4194304,4194304] 0 2024-01-31T05:13:14.976 INFO:tasks.workunit.client.0.smithi099.stdout:2/514: rename d10/d20/f40 to d10/d1b/d4d/fa9 0 2024-01-31T05:13:14.981 INFO:tasks.workunit.client.0.smithi099.stdout:0/540: dread d1/d16/f31 [0,4194304] 0 2024-01-31T05:13:14.983 INFO:tasks.workunit.client.0.smithi099.stdout:9/516: dwrite d0/d7/d2e/f43 [0,4194304] 0 2024-01-31T05:13:14.983 INFO:tasks.workunit.client.0.smithi099.stdout:4/548: mknod d0/d2/d4b/d93/cbb 0 2024-01-31T05:13:14.983 INFO:tasks.workunit.client.0.smithi099.stdout:9/517: dread - d0/d7/f46 zero size 2024-01-31T05:13:14.983 INFO:tasks.workunit.client.0.smithi099.stdout:9/518: chown d0/c22 101693133 1 2024-01-31T05:13:14.983 INFO:tasks.workunit.client.0.smithi099.stdout:9/519: chown d0/d1/d24/f75 1 1 2024-01-31T05:13:14.989 INFO:tasks.workunit.client.0.smithi099.stdout:4/549: unlink d0/d2/c40 0 2024-01-31T05:13:14.989 INFO:tasks.workunit.client.0.smithi099.stdout:9/520: mknod d0/d1/d24/d2b/d63/cb1 0 2024-01-31T05:13:14.989 INFO:tasks.workunit.client.0.smithi099.stdout:9/521: readlink d0/d1/d24/d2b/l16 0 2024-01-31T05:13:14.990 INFO:tasks.workunit.client.0.smithi099.stdout:9/522: creat d0/d1/d24/d2b/d63/da7/fb2 x:0 0 0 2024-01-31T05:13:14.990 INFO:tasks.workunit.client.0.smithi099.stdout:9/523: dread - d0/d3e/f8b zero size 2024-01-31T05:13:14.991 INFO:tasks.workunit.client.0.smithi099.stdout:9/524: mknod d0/d1/d24/d2b/d63/da7/daa/cb3 0 2024-01-31T05:13:14.991 INFO:tasks.workunit.client.0.smithi099.stdout:9/525: fsync d0/d44/f4f 0 2024-01-31T05:13:14.993 INFO:tasks.workunit.client.0.smithi099.stdout:9/526: unlink d0/d44/l97 0 2024-01-31T05:13:14.994 INFO:tasks.workunit.client.0.smithi099.stdout:9/527: fsync d0/d44/f53 0 2024-01-31T05:13:14.994 INFO:tasks.workunit.client.0.smithi099.stdout:9/528: creat d0/d5d/fb4 x:0 0 0 2024-01-31T05:13:15.005 INFO:tasks.workunit.client.0.smithi099.stdout:9/529: write d0/d1/d24/d48/f64 [785380,108103] 0 2024-01-31T05:13:15.006 INFO:tasks.workunit.client.0.smithi099.stdout:2/515: dwrite d10/d1c/f55 [0,4194304] 0 2024-01-31T05:13:15.009 INFO:tasks.workunit.client.0.smithi099.stdout:9/530: mkdir d0/d5d/db5 0 2024-01-31T05:13:15.009 INFO:tasks.workunit.client.0.smithi099.stdout:2/516: unlink d10/d1b/d83/d86/d95/f9c 0 2024-01-31T05:13:15.009 INFO:tasks.workunit.client.0.smithi099.stdout:2/517: read - d10/d1b/f81 zero size 2024-01-31T05:13:15.010 INFO:tasks.workunit.client.0.smithi099.stdout:0/541: dwrite d1/d30/d45/d66/f6d [0,4194304] 0 2024-01-31T05:13:15.011 INFO:tasks.workunit.client.0.smithi099.stdout:2/518: symlink d10/d20/laa 0 2024-01-31T05:13:15.011 INFO:tasks.workunit.client.0.smithi099.stdout:2/519: read d10/d3a/f70 [56655,2969] 0 2024-01-31T05:13:15.012 INFO:tasks.workunit.client.0.smithi099.stdout:0/542: read d1/d37/f41 [395691,2737] 0 2024-01-31T05:13:15.013 INFO:tasks.workunit.client.0.smithi099.stdout:9/531: mkdir d0/d5d/db6 0 2024-01-31T05:13:15.013 INFO:tasks.workunit.client.0.smithi099.stdout:9/532: creat d0/d1/d24/d2b/d63/fb7 x:0 0 0 2024-01-31T05:13:15.013 INFO:tasks.workunit.client.0.smithi099.stdout:9/533: stat d0/d1/d24/d2b/d63/f7e 0 2024-01-31T05:13:15.016 INFO:tasks.workunit.client.0.smithi099.stdout:0/543: link d1/d30/d45/dad/l2b d1/d37/d4a/d6f/lb9 0 2024-01-31T05:13:15.017 INFO:tasks.workunit.client.0.smithi099.stdout:0/544: dread - d1/d16/d36/fa7 zero size 2024-01-31T05:13:15.017 INFO:tasks.workunit.client.0.smithi099.stdout:0/545: creat d1/d37/d4a/d7a/d7d/fba x:0 0 0 2024-01-31T05:13:15.018 INFO:tasks.workunit.client.0.smithi099.stdout:4/550: dwrite d0/d8/d19/f83 [4194304,4194304] 0 2024-01-31T05:13:15.018 INFO:tasks.workunit.client.0.smithi099.stdout:4/551: chown d0/d8/d19/f83 12649 1 2024-01-31T05:13:15.019 INFO:tasks.workunit.client.0.smithi099.stdout:2/520: mknod d10/cab 0 2024-01-31T05:13:15.019 INFO:tasks.workunit.client.0.smithi099.stdout:2/521: dread - d10/d3a/d69/f8b zero size 2024-01-31T05:13:15.020 INFO:tasks.workunit.client.0.smithi099.stdout:0/546: creat d1/d56/fbb x:0 0 0 2024-01-31T05:13:15.021 INFO:tasks.workunit.client.0.smithi099.stdout:9/534: write d0/d1/d24/f37 [1027191,33174] 0 2024-01-31T05:13:15.022 INFO:tasks.workunit.client.0.smithi099.stdout:4/552: truncate d0/d2/f15 373250 0 2024-01-31T05:13:15.023 INFO:tasks.workunit.client.0.smithi099.stdout:0/547: unlink d1/d30/d45/dad/l75 0 2024-01-31T05:13:15.025 INFO:tasks.workunit.client.0.smithi099.stdout:0/548: mkdir d1/d37/d73/dbc 0 2024-01-31T05:13:15.025 INFO:tasks.workunit.client.0.smithi099.stdout:0/549: chown d1/d56/c79 917 1 2024-01-31T05:13:15.026 INFO:tasks.workunit.client.0.smithi099.stdout:0/550: creat d1/d30/d45/fbd x:0 0 0 2024-01-31T05:13:15.029 INFO:tasks.workunit.client.0.smithi099.stdout:0/551: mknod d1/d37/d73/dbc/cbe 0 2024-01-31T05:13:15.029 INFO:tasks.workunit.client.0.smithi099.stdout:0/552: dread - d1/d30/d45/dad/fa4 zero size 2024-01-31T05:13:15.029 INFO:tasks.workunit.client.0.smithi099.stdout:0/553: creat d1/d16/d36/d8b/fbf x:0 0 0 2024-01-31T05:13:15.029 INFO:tasks.workunit.client.0.smithi099.stdout:0/554: chown d1/d16/d36/d8b 15 1 2024-01-31T05:13:15.031 INFO:tasks.workunit.client.0.smithi099.stdout:0/555: getdents d1/d37/d4a/d7a 0 2024-01-31T05:13:15.034 INFO:tasks.workunit.client.0.smithi099.stdout:0/556: symlink d1/d16/d36/lc0 0 2024-01-31T05:13:15.042 INFO:tasks.workunit.client.0.smithi099.stdout:2/522: write f0 [466699,104199] 0 2024-01-31T05:13:15.043 INFO:tasks.workunit.client.0.smithi099.stdout:4/553: dread d0/d8/d19/d98/d9b/dab/f6b [0,4194304] 0 2024-01-31T05:13:15.043 INFO:tasks.workunit.client.0.smithi099.stdout:4/554: chown d0 195814714 1 2024-01-31T05:13:15.043 INFO:tasks.workunit.client.0.smithi099.stdout:4/555: write d0/d2/d4b/d93/d17/d3d/f41 [5248734,67] 0 2024-01-31T05:13:15.044 INFO:tasks.workunit.client.0.smithi099.stdout:2/523: mknod d10/d1b/d4d/cac 0 2024-01-31T05:13:15.044 INFO:tasks.workunit.client.0.smithi099.stdout:2/524: write d10/d1b/f59 [110619,72] 0 2024-01-31T05:13:15.046 INFO:tasks.workunit.client.0.smithi099.stdout:2/525: mkdir d10/d1b/d7d/d7a/dad 0 2024-01-31T05:13:15.046 INFO:tasks.workunit.client.0.smithi099.stdout:2/526: chown d10/d1b/d4d/d5a/c63 0 1 2024-01-31T05:13:15.046 INFO:tasks.workunit.client.0.smithi099.stdout:2/527: chown d10/c1d 12733339 1 2024-01-31T05:13:15.046 INFO:tasks.workunit.client.0.smithi099.stdout:2/528: fsync d10/d1c/f39 0 2024-01-31T05:13:15.046 INFO:tasks.workunit.client.0.smithi099.stdout:0/557: write d1/d30/d45/d66/f5b [168319,16271] 0 2024-01-31T05:13:15.047 INFO:tasks.workunit.client.0.smithi099.stdout:0/558: truncate d1/d30/d45/dad/fac 474281 0 2024-01-31T05:13:15.047 INFO:tasks.workunit.client.0.smithi099.stdout:2/529: creat d10/d1b/d9b/fae x:0 0 0 2024-01-31T05:13:15.048 INFO:tasks.workunit.client.0.smithi099.stdout:0/559: symlink d1/d37/d73/lc1 0 2024-01-31T05:13:15.050 INFO:tasks.workunit.client.0.smithi099.stdout:0/560: truncate d1/d37/d4a/d7b/f9e 2523080 0 2024-01-31T05:13:15.052 INFO:tasks.workunit.client.0.smithi099.stdout:4/556: unlink d0/d2/d20/l7b 0 2024-01-31T05:13:15.054 INFO:tasks.workunit.client.0.smithi099.stdout:0/561: creat d1/d37/d4a/d7b/fc2 x:0 0 0 2024-01-31T05:13:15.055 INFO:tasks.workunit.client.0.smithi099.stdout:4/557: truncate d0/d8/f11 741141 0 2024-01-31T05:13:15.057 INFO:tasks.workunit.client.0.smithi099.stdout:4/558: creat d0/d1e/fbc x:0 0 0 2024-01-31T05:13:15.057 INFO:tasks.workunit.client.0.smithi099.stdout:4/559: truncate d0/d2/d4b/d93/d17/d3d/f6a 1640591 0 2024-01-31T05:13:15.057 INFO:tasks.workunit.client.0.smithi099.stdout:0/562: write d1/d16/f5a [449889,99824] 0 2024-01-31T05:13:15.058 INFO:tasks.workunit.client.0.smithi099.stdout:9/535: dwrite d0/d1/d24/d48/f9f [0,4194304] 0 2024-01-31T05:13:15.058 INFO:tasks.workunit.client.0.smithi099.stdout:9/536: read d0/d5d/f91 [807645,127170] 0 2024-01-31T05:13:15.061 INFO:tasks.workunit.client.0.smithi099.stdout:4/560: creat d0/d8/d19/d98/fbd x:0 0 0 2024-01-31T05:13:15.061 INFO:tasks.workunit.client.0.smithi099.stdout:2/530: dread d10/d20/f50 [0,4194304] 0 2024-01-31T05:13:15.061 INFO:tasks.workunit.client.0.smithi099.stdout:0/563: creat d1/d37/fc3 x:0 0 0 2024-01-31T05:13:15.063 INFO:tasks.workunit.client.0.smithi099.stdout:9/537: creat d0/d3e/d33/dab/fb8 x:0 0 0 2024-01-31T05:13:15.063 INFO:tasks.workunit.client.0.smithi099.stdout:9/538: readlink d0/d7/l32 0 2024-01-31T05:13:15.063 INFO:tasks.workunit.client.0.smithi099.stdout:9/539: dread - d0/d3e/d33/fa8 zero size 2024-01-31T05:13:15.064 INFO:tasks.workunit.client.0.smithi099.stdout:9/540: write d0/d1/d24/d2b/d63/fb7 [864615,50616] 0 2024-01-31T05:13:15.064 INFO:tasks.workunit.client.0.smithi099.stdout:9/541: stat d0/d1/d24/d2b/d59 0 2024-01-31T05:13:15.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:14 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:15.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:14 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:15.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:14 smithi099 ceph-mon[31615]: mds.? [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] up:active 2024-01-31T05:13:15.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:14 smithi099 ceph-mon[31615]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:13:15.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:14 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:15.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:14 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:15.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:14 smithi181 ceph-mon[36434]: mds.? [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] up:active 2024-01-31T05:13:15.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:14 smithi181 ceph-mon[36434]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:13:15.075 INFO:tasks.workunit.client.0.smithi099.stdout:4/561: getdents d0/d2/d4b/d93/d17/d24 0 2024-01-31T05:13:15.077 INFO:tasks.workunit.client.0.smithi099.stdout:0/564: symlink d1/d37/d4a/d7a/lc4 0 2024-01-31T05:13:15.078 INFO:tasks.workunit.client.0.smithi099.stdout:9/542: creat d0/d1/d5e/d72/d89/d98/fb9 x:0 0 0 2024-01-31T05:13:15.079 INFO:tasks.workunit.client.0.smithi099.stdout:0/565: mkdir d1/d37/d73/db7/dc5 0 2024-01-31T05:13:15.080 INFO:tasks.workunit.client.0.smithi099.stdout:0/566: creat d1/d37/d4a/d7b/fc6 x:0 0 0 2024-01-31T05:13:15.082 INFO:tasks.workunit.client.0.smithi099.stdout:0/567: unlink d1/d30/d45/fbd 0 2024-01-31T05:13:15.100 INFO:tasks.workunit.client.0.smithi099.stdout:4/562: dwrite d0/d2/d4b/d93/d59/d8f/fa4 [0,4194304] 0 2024-01-31T05:13:15.100 INFO:tasks.workunit.client.0.smithi099.stdout:4/563: fdatasync d0/d2/d4b/d93/f94 0 2024-01-31T05:13:15.101 INFO:tasks.workunit.client.0.smithi099.stdout:2/531: link d10/d2b/d7c/c9f d10/d1b/d83/caf 0 2024-01-31T05:13:15.101 INFO:tasks.workunit.client.0.smithi099.stdout:9/543: dwrite d0/d1/d5e/d72/fa9 [0,4194304] 0 2024-01-31T05:13:15.102 INFO:tasks.workunit.client.0.smithi099.stdout:2/532: creat d10/d1b/d7d/d7a/fb0 x:0 0 0 2024-01-31T05:13:15.103 INFO:tasks.workunit.client.0.smithi099.stdout:4/564: symlink d0/d2/d4b/d93/d17/d24/d3f/d43/lbe 0 2024-01-31T05:13:15.106 INFO:tasks.workunit.client.0.smithi099.stdout:0/568: dwrite d1/d37/d4a/f9a [0,4194304] 0 2024-01-31T05:13:15.106 INFO:tasks.workunit.client.0.smithi099.stdout:9/544: write d0/d3e/f5f [5111792,25846] 0 2024-01-31T05:13:15.107 INFO:tasks.workunit.client.0.smithi099.stdout:0/569: chown d1/d37/d4a/d7a/d7d/f8d 7 1 2024-01-31T05:13:15.107 INFO:tasks.workunit.client.0.smithi099.stdout:9/545: truncate d0/d7/d2e/f43 5146124 0 2024-01-31T05:13:15.107 INFO:tasks.workunit.client.0.smithi099.stdout:2/533: creat d10/d2b/d58/fb1 x:0 0 0 2024-01-31T05:13:15.109 INFO:tasks.workunit.client.0.smithi099.stdout:4/565: symlink d0/d8/d19/d99/lbf 0 2024-01-31T05:13:15.109 INFO:tasks.workunit.client.0.smithi099.stdout:2/534: dread d10/d1b/f6f [0,4194304] 0 2024-01-31T05:13:15.109 INFO:tasks.workunit.client.0.smithi099.stdout:4/566: write d0/d8/d19/f1c [180922,93723] 0 2024-01-31T05:13:15.109 INFO:tasks.workunit.client.0.smithi099.stdout:4/567: write d0/d2/d4b/d93/d17/d24/d3f/fa6 [283429,14569] 0 2024-01-31T05:13:15.110 INFO:tasks.workunit.client.0.smithi099.stdout:0/570: symlink d1/d16/d36/lc7 0 2024-01-31T05:13:15.111 INFO:tasks.workunit.client.0.smithi099.stdout:9/546: rename d0/d1/d24/d2b/c31 to d0/d7/da6/cba 0 2024-01-31T05:13:15.111 INFO:tasks.workunit.client.0.smithi099.stdout:9/547: readlink d0/d7/d2e/l2c 0 2024-01-31T05:13:15.113 INFO:tasks.workunit.client.0.smithi099.stdout:4/568: dread d0/d1e/d61/f7c [0,4194304] 0 2024-01-31T05:13:15.116 INFO:tasks.workunit.client.0.smithi099.stdout:2/535: unlink d10/c14 0 2024-01-31T05:13:15.117 INFO:tasks.workunit.client.0.smithi099.stdout:9/548: rename d0/d7/f35 to d0/d5d/db6/fbb 0 2024-01-31T05:13:15.119 INFO:tasks.workunit.client.0.smithi099.stdout:1/487: sync 2024-01-31T05:13:15.119 INFO:tasks.workunit.client.0.smithi099.stdout:6/429: sync 2024-01-31T05:13:15.119 INFO:tasks.workunit.client.0.smithi099.stdout:3/540: sync 2024-01-31T05:13:15.119 INFO:tasks.workunit.client.0.smithi099.stdout:7/502: sync 2024-01-31T05:13:15.119 INFO:tasks.workunit.client.0.smithi099.stdout:5/523: sync 2024-01-31T05:13:15.120 INFO:tasks.workunit.client.0.smithi099.stdout:2/536: creat d10/d2b/fb2 x:0 0 0 2024-01-31T05:13:15.120 INFO:tasks.workunit.client.0.smithi099.stdout:2/537: creat d10/d1b/d4d/fb3 x:0 0 0 2024-01-31T05:13:15.121 INFO:tasks.workunit.client.0.smithi099.stdout:0/571: link d1/c26 d1/cc8 0 2024-01-31T05:13:15.122 INFO:tasks.workunit.client.0.smithi099.stdout:5/524: write d6/da/d14/d2b/fab [671897,66913] 0 2024-01-31T05:13:15.124 INFO:tasks.workunit.client.0.smithi099.stdout:3/541: symlink d10/d24/d40/lc6 0 2024-01-31T05:13:15.125 INFO:tasks.workunit.client.0.smithi099.stdout:5/525: link d6/da/d14/d3d/d51/d82/l5b d6/da/d14/d3d/d51/dae/db0/lb1 0 2024-01-31T05:13:15.127 INFO:tasks.workunit.client.0.smithi099.stdout:1/488: rename d4/db/d24/d4b/d50/d91/f7d to d4/dc/d55/f95 0 2024-01-31T05:13:15.127 INFO:tasks.workunit.client.0.smithi099.stdout:1/489: write d4/dc/d15/f4e [538999,93849] 0 2024-01-31T05:13:15.128 INFO:tasks.workunit.client.0.smithi099.stdout:1/490: readlink d4/db/d24/d4b/d50/l68 0 2024-01-31T05:13:15.128 INFO:tasks.workunit.client.0.smithi099.stdout:1/491: stat d4/dc/d15/d45 0 2024-01-31T05:13:15.128 INFO:tasks.workunit.client.0.smithi099.stdout:1/492: fdatasync d4/dc/d15/f1a 0 2024-01-31T05:13:15.128 INFO:tasks.workunit.client.0.smithi099.stdout:8/579: sync 2024-01-31T05:13:15.128 INFO:tasks.workunit.client.0.smithi099.stdout:8/580: truncate d1/dd/dba/d20/f4b 5186280 0 2024-01-31T05:13:15.129 INFO:tasks.workunit.client.0.smithi099.stdout:8/581: mknod d1/dd/dba/d29/cc0 0 2024-01-31T05:13:15.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:14 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:15.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:14 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:15.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:14 smithi179 ceph-mon[35652]: mds.? [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] up:active 2024-01-31T05:13:15.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:14 smithi179 ceph-mon[35652]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:13:15.137 INFO:tasks.workunit.client.0.smithi099.stdout:6/430: dread d14/d18/f6c [0,4194304] 0 2024-01-31T05:13:15.140 INFO:tasks.workunit.client.0.smithi099.stdout:5/526: dread d6/da/d14/d2b/fab [0,4194304] 0 2024-01-31T05:13:15.140 INFO:tasks.workunit.client.0.smithi099.stdout:5/527: getdents d6/da/d14/d2b/d9e 0 2024-01-31T05:13:15.140 INFO:tasks.workunit.client.0.smithi099.stdout:5/528: dread - d6/da/d14/d3d/d57/f97 zero size 2024-01-31T05:13:15.141 INFO:tasks.workunit.client.0.smithi099.stdout:3/542: dread d10/fbf [0,4194304] 0 2024-01-31T05:13:15.143 INFO:tasks.workunit.client.0.smithi099.stdout:6/431: mknod d14/d18/d52/c85 0 2024-01-31T05:13:15.147 INFO:tasks.workunit.client.0.smithi099.stdout:8/582: write d1/dd/dba/d20/f4c [961961,3022] 0 2024-01-31T05:13:15.148 INFO:tasks.workunit.client.0.smithi099.stdout:4/569: dwrite d0/d2/d4b/f5f [0,4194304] 0 2024-01-31T05:13:15.148 INFO:tasks.workunit.client.0.smithi099.stdout:4/570: creat d0/d2/fc0 x:0 0 0 2024-01-31T05:13:15.148 INFO:tasks.workunit.client.0.smithi099.stdout:4/571: stat d0/d8/d19/d99 0 2024-01-31T05:13:15.153 INFO:tasks.workunit.client.0.smithi099.stdout:4/572: rename d0/d2/d4b/d93/d17/lb3 to d0/d2/d4b/d93/d17/d3d/lc1 0 2024-01-31T05:13:15.155 INFO:tasks.workunit.client.0.smithi099.stdout:4/573: mknod d0/d74/cc2 0 2024-01-31T05:13:15.156 INFO:tasks.workunit.client.0.smithi099.stdout:4/574: creat d0/d1e/d61/fc3 x:0 0 0 2024-01-31T05:13:15.156 INFO:tasks.workunit.client.0.smithi099.stdout:4/575: write d0/d8/d19/d98/fbd [10385,115702] 0 2024-01-31T05:13:15.158 INFO:tasks.workunit.client.0.smithi099.stdout:6/432: write d14/d18/d52/f67 [207358,45261] 0 2024-01-31T05:13:15.158 INFO:tasks.workunit.client.0.smithi099.stdout:6/433: write d14/d18/d52/d22/f65 [613374,14049] 0 2024-01-31T05:13:15.159 INFO:tasks.workunit.client.0.smithi099.stdout:3/543: dread d10/f66 [0,4194304] 0 2024-01-31T05:13:15.159 INFO:tasks.workunit.client.0.smithi099.stdout:3/544: write d10/d32/d85/f26 [5450046,9735] 0 2024-01-31T05:13:15.161 INFO:tasks.workunit.client.0.smithi099.stdout:3/545: write d10/d27/d34/f88 [493802,35540] 0 2024-01-31T05:13:15.161 INFO:tasks.workunit.client.0.smithi099.stdout:3/546: chown d10/d24/d40/d81 447730 1 2024-01-31T05:13:15.161 INFO:tasks.workunit.client.0.smithi099.stdout:9/549: dwrite d0/d3e/f42 [4194304,4194304] 0 2024-01-31T05:13:15.162 INFO:tasks.workunit.client.0.smithi099.stdout:3/547: creat d10/d27/d34/d44/d95/daf/fc7 x:0 0 0 2024-01-31T05:13:15.165 INFO:tasks.workunit.client.0.smithi099.stdout:9/550: creat d0/d7/da6/fbc x:0 0 0 2024-01-31T05:13:15.165 INFO:tasks.workunit.client.0.smithi099.stdout:0/572: dwrite d1/d37/d4a/d7a/d7d/fb3 [0,4194304] 0 2024-01-31T05:13:15.165 INFO:tasks.workunit.client.0.smithi099.stdout:9/551: chown d0/d1/d24/d2b/d59/f9b 1383 1 2024-01-31T05:13:15.165 INFO:tasks.workunit.client.0.smithi099.stdout:0/573: fdatasync d1/d16/d36/d8b/f9c 0 2024-01-31T05:13:15.166 INFO:tasks.workunit.client.0.smithi099.stdout:0/574: stat d1/cc 0 2024-01-31T05:13:15.167 INFO:tasks.workunit.client.0.smithi099.stdout:9/552: link d0/d1/d24/d2b/d63/f94 d0/d1/d5e/d72/d89/d98/fbd 0 2024-01-31T05:13:15.167 INFO:tasks.workunit.client.0.smithi099.stdout:9/553: creat d0/d3e/d33/dab/fbe x:0 0 0 2024-01-31T05:13:15.174 INFO:tasks.workunit.client.0.smithi099.stdout:6/434: write d14/d18/d3b/f42 [8350216,35112] 0 2024-01-31T05:13:15.177 INFO:tasks.workunit.client.0.smithi099.stdout:4/576: dread d0/d8/d19/f83 [0,4194304] 0 2024-01-31T05:13:15.177 INFO:tasks.workunit.client.0.smithi099.stdout:2/538: dwrite d10/d3a/f4f [0,4194304] 0 2024-01-31T05:13:15.177 INFO:tasks.workunit.client.0.smithi099.stdout:1/493: dwrite d4/dc/d29/f36 [0,4194304] 0 2024-01-31T05:13:15.177 INFO:tasks.workunit.client.0.smithi099.stdout:8/583: dwrite d1/da6/f8f [4194304,4194304] 0 2024-01-31T05:13:15.180 INFO:tasks.workunit.client.0.smithi099.stdout:4/577: creat d0/d8/fc4 x:0 0 0 2024-01-31T05:13:15.181 INFO:tasks.workunit.client.0.smithi099.stdout:2/539: truncate d10/d51/f54 3541850 0 2024-01-31T05:13:15.182 INFO:tasks.workunit.client.0.smithi099.stdout:6/435: rmdir d14/d18/d3b 39 2024-01-31T05:13:15.183 INFO:tasks.workunit.client.0.smithi099.stdout:9/554: dread d0/d1/d24/f69 [0,4194304] 0 2024-01-31T05:13:15.184 INFO:tasks.workunit.client.0.smithi099.stdout:1/494: mkdir d4/db/d3a/d7e/d85/d96 0 2024-01-31T05:13:15.184 INFO:tasks.workunit.client.0.smithi099.stdout:1/495: chown d4/dc/d44/l64 20762 1 2024-01-31T05:13:15.185 INFO:tasks.workunit.client.0.smithi099.stdout:8/584: mknod d1/dd/d1d/cc1 0 2024-01-31T05:13:15.187 INFO:tasks.workunit.client.0.smithi099.stdout:4/578: symlink d0/d2/d4b/lc5 0 2024-01-31T05:13:15.187 INFO:tasks.workunit.client.0.smithi099.stdout:4/579: chown d0/d2/d4b/d93/d59/d8f/ca3 3286081 1 2024-01-31T05:13:15.188 INFO:tasks.workunit.client.0.smithi099.stdout:9/555: mkdir d0/d1/d5e/d72/dbf 0 2024-01-31T05:13:15.189 INFO:tasks.workunit.client.0.smithi099.stdout:3/548: dwrite d10/d27/f5d [0,4194304] 0 2024-01-31T05:13:15.190 INFO:tasks.workunit.client.0.smithi099.stdout:4/580: dread d0/d79/f92 [0,4194304] 0 2024-01-31T05:13:15.190 INFO:tasks.workunit.client.0.smithi099.stdout:4/581: read d0/d79/fa7 [539924,70446] 0 2024-01-31T05:13:15.190 INFO:tasks.workunit.client.0.smithi099.stdout:2/540: unlink d10/d2b/d97/la7 0 2024-01-31T05:13:15.190 INFO:tasks.workunit.client.0.smithi099.stdout:1/496: creat d4/db/d24/d4b/d50/d91/f97 x:0 0 0 2024-01-31T05:13:15.191 INFO:tasks.workunit.client.0.smithi099.stdout:2/541: dread d10/d1b/d4d/f84 [0,4194304] 0 2024-01-31T05:13:15.191 INFO:tasks.workunit.client.0.smithi099.stdout:2/542: truncate d10/d3a/d69/f8b 763736 0 2024-01-31T05:13:15.192 INFO:tasks.workunit.client.0.smithi099.stdout:6/436: stat d14/f17 0 2024-01-31T05:13:15.192 INFO:tasks.workunit.client.0.smithi099.stdout:6/437: getdents d14/d18/d52/d7e/d66 0 2024-01-31T05:13:15.192 INFO:tasks.workunit.client.0.smithi099.stdout:2/543: symlink d10/d1b/d83/d86/lb4 0 2024-01-31T05:13:15.194 INFO:tasks.workunit.client.0.smithi099.stdout:0/575: dwrite d1/d8/f61 [0,4194304] 0 2024-01-31T05:13:15.194 INFO:tasks.workunit.client.0.smithi099.stdout:4/582: unlink d0/d2/d4b/d93/d17/d3d/f6a 0 2024-01-31T05:13:15.194 INFO:tasks.workunit.client.0.smithi099.stdout:4/583: chown d0/d2/d4b/d93/d59/d9c 7112997 1 2024-01-31T05:13:15.194 INFO:tasks.workunit.client.0.smithi099.stdout:4/584: dread - d0/d2/d4b/f90 zero size 2024-01-31T05:13:15.195 INFO:tasks.workunit.client.0.smithi099.stdout:1/497: mknod d4/dc/d4d/d5d/c98 0 2024-01-31T05:13:15.198 INFO:tasks.workunit.client.0.smithi099.stdout:6/438: rmdir d14/d18 39 2024-01-31T05:13:15.200 INFO:tasks.workunit.client.0.smithi099.stdout:0/576: mkdir d1/d37/d4a/d6f/dc9 0 2024-01-31T05:13:15.200 INFO:tasks.workunit.client.0.smithi099.stdout:0/577: dread - d1/d16/d36/f7c zero size 2024-01-31T05:13:15.203 INFO:tasks.workunit.client.0.smithi099.stdout:4/585: link d0/d2/d4b/d93/d59/f8b d0/d74/fc6 0 2024-01-31T05:13:15.203 INFO:tasks.workunit.client.0.smithi099.stdout:9/556: write d0/d44/f4f [2590399,121269] 0 2024-01-31T05:13:15.203 INFO:tasks.workunit.client.0.smithi099.stdout:1/498: creat d4/db/d24/d4b/d50/d91/f99 x:0 0 0 2024-01-31T05:13:15.203 INFO:tasks.workunit.client.0.smithi099.stdout:8/585: dread d1/dd/dba/d29/d3f/d56/da0/d2e/f33 [0,4194304] 0 2024-01-31T05:13:15.203 INFO:tasks.workunit.client.0.smithi099.stdout:8/586: stat d1/f10 0 2024-01-31T05:13:15.204 INFO:tasks.workunit.client.0.smithi099.stdout:9/557: write d0/d7/f1f [4468087,79687] 0 2024-01-31T05:13:15.204 INFO:tasks.workunit.client.0.smithi099.stdout:9/558: dread - d0/d1/d24/d2b/d59/f9b zero size 2024-01-31T05:13:15.205 INFO:tasks.workunit.client.0.smithi099.stdout:0/578: truncate d1/d56/faf 238107 0 2024-01-31T05:13:15.207 INFO:tasks.workunit.client.0.smithi099.stdout:1/499: mkdir d4/db/d24/d4b/d9a 0 2024-01-31T05:13:15.208 INFO:tasks.workunit.client.0.smithi099.stdout:8/587: creat d1/dd/dba/d29/d3f/d56/fc2 x:0 0 0 2024-01-31T05:13:15.209 INFO:tasks.workunit.client.0.smithi099.stdout:9/559: truncate d0/d1/d24/d48/f9f 543170 0 2024-01-31T05:13:15.211 INFO:tasks.workunit.client.0.smithi099.stdout:0/579: mknod d1/d30/d45/dad/cca 0 2024-01-31T05:13:15.212 INFO:tasks.workunit.client.0.smithi099.stdout:3/549: dwrite d10/d24/d40/d81/fb7 [0,4194304] 0 2024-01-31T05:13:15.212 INFO:tasks.workunit.client.0.smithi099.stdout:3/550: write d10/d27/d34/f68 [5199103,97321] 0 2024-01-31T05:13:15.218 INFO:tasks.workunit.client.0.smithi099.stdout:0/580: read d1/d16/f31 [2055979,40823] 0 2024-01-31T05:13:15.219 INFO:tasks.workunit.client.0.smithi099.stdout:0/581: mknod d1/d16/d36/ccb 0 2024-01-31T05:13:15.219 INFO:tasks.workunit.client.0.smithi099.stdout:0/582: readlink d1/d37/l40 0 2024-01-31T05:13:15.219 INFO:tasks.workunit.client.0.smithi099.stdout:0/583: creat d1/d56/fcc x:0 0 0 2024-01-31T05:13:15.223 INFO:tasks.workunit.client.0.smithi099.stdout:3/551: dread d10/d27/d34/d52/f7d [0,4194304] 0 2024-01-31T05:13:15.224 INFO:tasks.workunit.client.0.smithi099.stdout:3/552: mknod d10/d27/d34/d44/d60/d75/d8c/d92/cc8 0 2024-01-31T05:13:15.224 INFO:tasks.workunit.client.0.smithi099.stdout:3/553: write d10/d32/d33/d51/f67 [1816041,123875] 0 2024-01-31T05:13:15.234 INFO:tasks.workunit.client.0.smithi099.stdout:0/584: dread d1/d64/f7f [0,4194304] 0 2024-01-31T05:13:15.235 INFO:tasks.workunit.client.0.smithi099.stdout:4/586: dwrite d0/d1e/d61/fc3 [0,4194304] 0 2024-01-31T05:13:15.235 INFO:tasks.workunit.client.0.smithi099.stdout:0/585: mknod d1/d37/d4a/d6f/dc9/ccd 0 2024-01-31T05:13:15.236 INFO:tasks.workunit.client.0.smithi099.stdout:4/587: stat d0/d8/d19/d98/d9b/dab/l71 0 2024-01-31T05:13:15.237 INFO:tasks.workunit.client.0.smithi099.stdout:3/554: write d10/f66 [797151,58543] 0 2024-01-31T05:13:15.237 INFO:tasks.workunit.client.0.smithi099.stdout:3/555: write d10/d32/fad [94668,124885] 0 2024-01-31T05:13:15.237 INFO:tasks.workunit.client.0.smithi099.stdout:3/556: dread - d10/d1e/da2/fb4 zero size 2024-01-31T05:13:15.237 INFO:tasks.workunit.client.0.smithi099.stdout:3/557: read d10/f66 [4167265,70243] 0 2024-01-31T05:13:15.237 INFO:tasks.workunit.client.0.smithi099.stdout:3/558: fsync d10/d27/fa7 0 2024-01-31T05:13:15.238 INFO:tasks.workunit.client.0.smithi099.stdout:0/586: mknod d1/d30/d45/dad/db1/cce 0 2024-01-31T05:13:15.238 INFO:tasks.workunit.client.0.smithi099.stdout:0/587: dread - d1/d8/fa2 zero size 2024-01-31T05:13:15.238 INFO:tasks.workunit.client.0.smithi099.stdout:0/588: chown d1/d30/d45/d66/f5b 3829 1 2024-01-31T05:13:15.238 INFO:tasks.workunit.client.0.smithi099.stdout:2/544: rename d10/c34 to d10/d1b/d9b/cb5 0 2024-01-31T05:13:15.239 INFO:tasks.workunit.client.0.smithi099.stdout:9/560: dwrite d0/d7/f68 [0,4194304] 0 2024-01-31T05:13:15.239 INFO:tasks.workunit.client.0.smithi099.stdout:9/561: dread - d0/d3e/d33/dab/fb8 zero size 2024-01-31T05:13:15.239 INFO:tasks.workunit.client.0.smithi099.stdout:9/562: truncate d0/d1/d24/d2b/d7b/fa4 1377472 0 2024-01-31T05:13:15.239 INFO:tasks.workunit.client.0.smithi099.stdout:9/563: dread - d0/d3e/d33/fa8 zero size 2024-01-31T05:13:15.239 INFO:tasks.workunit.client.0.smithi099.stdout:9/564: write d0/d1/d24/d2b/f1b [1210119,117619] 0 2024-01-31T05:13:15.239 INFO:tasks.workunit.client.0.smithi099.stdout:4/588: mkdir d0/d2/d4b/d93/d17/d7d/db2/dc7 0 2024-01-31T05:13:15.242 INFO:tasks.workunit.client.0.smithi099.stdout:0/589: rmdir d1/d37/d73/dbc 39 2024-01-31T05:13:15.246 INFO:tasks.workunit.client.0.smithi099.stdout:9/565: link d0/d1/d24/d2b/d63/f7e d0/d1/d24/d2b/d63/da7/daa/fc0 0 2024-01-31T05:13:15.247 INFO:tasks.workunit.client.0.smithi099.stdout:0/590: mkdir d1/d37/d4a/d6f/dc9/dcf 0 2024-01-31T05:13:15.247 INFO:tasks.workunit.client.0.smithi099.stdout:0/591: truncate d1/d56/f5d 1839463 0 2024-01-31T05:13:15.249 INFO:tasks.workunit.client.0.smithi099.stdout:0/592: symlink d1/d37/d4a/d6f/dc9/dcf/ld0 0 2024-01-31T05:13:15.251 INFO:tasks.workunit.client.0.smithi099.stdout:4/589: dread d0/d2/d4b/f69 [0,4194304] 0 2024-01-31T05:13:15.253 INFO:tasks.workunit.client.0.smithi099.stdout:4/590: mknod d0/d8/d19/d65/cc8 0 2024-01-31T05:13:15.254 INFO:tasks.workunit.client.0.smithi099.stdout:4/591: write d0/d2/d4b/d93/d17/f25 [4646631,18620] 0 2024-01-31T05:13:15.254 INFO:tasks.workunit.client.0.smithi099.stdout:4/592: fdatasync d0/d2/f9f 0 2024-01-31T05:13:15.255 INFO:tasks.workunit.client.0.smithi099.stdout:4/593: rmdir d0/d2/d4b/d93/d17 39 2024-01-31T05:13:15.256 INFO:tasks.workunit.client.0.smithi099.stdout:6/439: rename d14/d18/d52/d7e/d1c/c64 to d14/d18/d52/d22/c86 0 2024-01-31T05:13:15.257 INFO:tasks.workunit.client.0.smithi099.stdout:2/545: write f1 [1247250,85660] 0 2024-01-31T05:13:15.257 INFO:tasks.workunit.client.0.smithi099.stdout:2/546: write d10/d1c/f55 [4916295,97110] 0 2024-01-31T05:13:15.258 INFO:tasks.workunit.client.0.smithi099.stdout:3/559: dwrite d10/f9d [0,4194304] 0 2024-01-31T05:13:15.258 INFO:tasks.workunit.client.0.smithi099.stdout:6/440: creat d14/d18/d52/d7e/d1c/d29/d43/f87 x:0 0 0 2024-01-31T05:13:15.258 INFO:tasks.workunit.client.0.smithi099.stdout:3/560: readlink d10/d1e/l80 0 2024-01-31T05:13:15.259 INFO:tasks.workunit.client.0.smithi099.stdout:8/588: rename d1/dd/dba/d29/d3f/d56/da0/c2d to d1/dd/dba/d29/d3a/cc3 0 2024-01-31T05:13:15.262 INFO:tasks.workunit.client.0.smithi099.stdout:4/594: link d0/d2/d4b/d93/d17/c68 d0/d8/cc9 0 2024-01-31T05:13:15.262 INFO:tasks.workunit.client.0.smithi099.stdout:4/595: write d0/d8/f11 [1231758,38156] 0 2024-01-31T05:13:15.262 INFO:tasks.workunit.client.0.smithi099.stdout:4/596: creat d0/d2/fca x:0 0 0 2024-01-31T05:13:15.264 INFO:tasks.workunit.client.0.smithi099.stdout:3/561: mknod d10/d72/cc9 0 2024-01-31T05:13:15.267 INFO:tasks.workunit.client.0.smithi099.stdout:2/547: dread d10/d20/f50 [0,4194304] 0 2024-01-31T05:13:15.267 INFO:tasks.workunit.client.0.smithi099.stdout:2/548: readlink d10/d2b/l36 0 2024-01-31T05:13:15.267 INFO:tasks.workunit.client.0.smithi099.stdout:0/593: rename d1/cc to d1/d37/d4a/d7a/d7d/cd1 0 2024-01-31T05:13:15.268 INFO:tasks.workunit.client.0.smithi099.stdout:2/549: symlink d10/d2b/d7c/lb6 0 2024-01-31T05:13:15.269 INFO:tasks.workunit.client.0.smithi099.stdout:9/566: dwrite d0/d1/d5e/d72/d89/d98/fb9 [0,4194304] 0 2024-01-31T05:13:15.269 INFO:tasks.workunit.client.0.smithi099.stdout:9/567: dread - d0/d7/f46 zero size 2024-01-31T05:13:15.271 INFO:tasks.workunit.client.0.smithi099.stdout:8/589: rename d1/dd/d7b/dbe to d1/dd/d65/d7f/d81/dc4 0 2024-01-31T05:13:15.273 INFO:tasks.workunit.client.0.smithi099.stdout:0/594: symlink d1/d30/d45/d66/d97/ld2 0 2024-01-31T05:13:15.273 INFO:tasks.workunit.client.0.smithi099.stdout:0/595: chown d1/d64 1219 1 2024-01-31T05:13:15.276 INFO:tasks.workunit.client.0.smithi099.stdout:9/568: unlink d0/d1/d24/d48/f64 0 2024-01-31T05:13:15.282 INFO:tasks.workunit.client.0.smithi099.stdout:8/590: rename d1/dd/dba/d29/d3a to d1/dd/dba/d19/dc5 0 2024-01-31T05:13:15.282 INFO:tasks.workunit.client.0.smithi099.stdout:8/591: dread - d1/dd/dba/d29/d3f/d56/fc2 zero size 2024-01-31T05:13:15.289 INFO:tasks.workunit.client.0.smithi099.stdout:8/592: rename d1/dd/dba/d29/d3f/d56/da0/f24 to d1/dd/dba/d19/d21/d3c/fc6 0 2024-01-31T05:13:15.289 INFO:tasks.workunit.client.0.smithi099.stdout:4/597: dwrite d0/d2/d4b/d93/d59/d8f/fa4 [0,4194304] 0 2024-01-31T05:13:15.290 INFO:tasks.workunit.client.0.smithi099.stdout:4/598: chown d0/d1e/l2b 2163 1 2024-01-31T05:13:15.291 INFO:tasks.workunit.client.0.smithi099.stdout:8/593: getdents d1/da6 0 2024-01-31T05:13:15.291 INFO:tasks.workunit.client.0.smithi099.stdout:8/594: readlink d1/dd/dba/d19/d21/l8d 0 2024-01-31T05:13:15.293 INFO:tasks.workunit.client.0.smithi099.stdout:6/441: dwrite d14/f15 [4194304,4194304] 0 2024-01-31T05:13:15.293 INFO:tasks.workunit.client.0.smithi099.stdout:6/442: readlink d14/d18/l4e 0 2024-01-31T05:13:15.294 INFO:tasks.workunit.client.0.smithi099.stdout:6/443: readlink d14/d18/d52/d7e/l2e 0 2024-01-31T05:13:15.298 INFO:tasks.workunit.client.0.smithi099.stdout:3/562: dwrite d10/d27/f6b [0,4194304] 0 2024-01-31T05:13:15.299 INFO:tasks.workunit.client.0.smithi099.stdout:4/599: write d0/d74/fc6 [4083336,28145] 0 2024-01-31T05:13:15.299 INFO:tasks.workunit.client.0.smithi099.stdout:4/600: fdatasync d0/d8/d19/f2d 0 2024-01-31T05:13:15.301 INFO:tasks.workunit.client.0.smithi099.stdout:2/550: dwrite d10/f11 [0,4194304] 0 2024-01-31T05:13:15.301 INFO:tasks.workunit.client.0.smithi099.stdout:2/551: creat d10/d1b/d4d/fb7 x:0 0 0 2024-01-31T05:13:15.301 INFO:tasks.workunit.client.0.smithi099.stdout:6/444: write d14/f17 [5102163,85563] 0 2024-01-31T05:13:15.302 INFO:tasks.workunit.client.0.smithi099.stdout:4/601: creat d0/d2/d4b/d93/fcb x:0 0 0 2024-01-31T05:13:15.302 INFO:tasks.workunit.client.0.smithi099.stdout:6/445: truncate d14/d18/d52/d7e/d1c/d29/f69 43573 0 2024-01-31T05:13:15.306 INFO:tasks.workunit.client.0.smithi099.stdout:4/602: fdatasync d0/d2/d4b/d93/d59/f8b 0 2024-01-31T05:13:15.307 INFO:tasks.workunit.client.0.smithi099.stdout:4/603: read d0/d2/f15 [283114,77894] 0 2024-01-31T05:13:15.309 INFO:tasks.workunit.client.0.smithi099.stdout:4/604: unlink d0/d2/d4b/d93/d17/d7d/la8 0 2024-01-31T05:13:15.310 INFO:tasks.workunit.client.0.smithi099.stdout:4/605: mkdir d0/d2/d4b/d93/d17/d7d/db2/dc7/dcc 0 2024-01-31T05:13:15.310 INFO:tasks.workunit.client.0.smithi099.stdout:7/503: sync 2024-01-31T05:13:15.313 INFO:tasks.workunit.client.0.smithi099.stdout:4/606: creat d0/d2/d4b/d93/d39/fcd x:0 0 0 2024-01-31T05:13:15.314 INFO:tasks.workunit.client.0.smithi099.stdout:7/504: mknod d6/d32/d3d/d4b/d33/d37/d50/d25/d72/d8e/c9c 0 2024-01-31T05:13:15.314 INFO:tasks.workunit.client.0.smithi099.stdout:7/505: stat d6/d12/f85 0 2024-01-31T05:13:15.315 INFO:tasks.workunit.client.0.smithi099.stdout:3/563: dread d10/d27/d34/d52/f7d [4194304,4194304] 0 2024-01-31T05:13:15.316 INFO:tasks.workunit.client.0.smithi099.stdout:2/552: write d10/d3a/f4f [2118790,128864] 0 2024-01-31T05:13:15.316 INFO:tasks.workunit.client.0.smithi099.stdout:7/506: truncate d6/d32/d3d/d4b/f23 964515 0 2024-01-31T05:13:15.318 INFO:tasks.workunit.client.0.smithi099.stdout:3/564: link d10/d27/d34/d44/d95/f8d d10/d32/d85/da3/db9/fca 0 2024-01-31T05:13:15.320 INFO:tasks.workunit.client.0.smithi099.stdout:3/565: rename f4 to d10/d1e/da2/fcb 0 2024-01-31T05:13:15.323 INFO:tasks.workunit.client.0.smithi099.stdout:3/566: getdents d10/d27/d89 0 2024-01-31T05:13:15.329 INFO:tasks.workunit.client.0.smithi099.stdout:6/446: dwrite d14/d18/d52/d7e/f83 [0,4194304] 0 2024-01-31T05:13:15.329 INFO:tasks.workunit.client.0.smithi099.stdout:6/447: creat d14/d18/d52/d22/f88 x:0 0 0 2024-01-31T05:13:15.329 INFO:tasks.workunit.client.0.smithi099.stdout:6/448: chown d14/d18/d52/d7e/d1c/d29/l4d 321828 1 2024-01-31T05:13:15.331 INFO:tasks.workunit.client.0.smithi099.stdout:6/449: rename d14/d18/d52/d7e/d1c/d29/f69 to d14/d18/d52/d7e/d1c/d29/d4f/f89 0 2024-01-31T05:13:15.331 INFO:tasks.workunit.client.0.smithi099.stdout:6/450: fdatasync f12 0 2024-01-31T05:13:15.343 INFO:tasks.workunit.client.0.smithi099.stdout:6/451: dread d14/d18/d52/d7e/f83 [0,4194304] 0 2024-01-31T05:13:15.349 INFO:tasks.workunit.client.0.smithi099.stdout:6/452: dread fa [0,4194304] 0 2024-01-31T05:13:15.350 INFO:tasks.workunit.client.0.smithi099.stdout:6/453: chown d14/d18/d52/d22/l4c 2 1 2024-01-31T05:13:15.364 INFO:tasks.workunit.client.0.smithi099.stdout:2/553: dwrite d10/d20/f89 [0,4194304] 0 2024-01-31T05:13:15.366 INFO:tasks.workunit.client.0.smithi099.stdout:2/554: mkdir d10/d1c/d43/db8 0 2024-01-31T05:13:15.366 INFO:tasks.workunit.client.0.smithi099.stdout:4/607: dwrite d0/d8/fc4 [0,4194304] 0 2024-01-31T05:13:15.366 INFO:tasks.workunit.client.0.smithi099.stdout:4/608: fdatasync d0/d8/f64 0 2024-01-31T05:13:15.366 INFO:tasks.workunit.client.0.smithi099.stdout:3/567: dwrite d10/d27/d34/d44/d60/d75/d8c/f9f [4194304,4194304] 0 2024-01-31T05:13:15.366 INFO:tasks.workunit.client.0.smithi099.stdout:7/507: dwrite d6/d32/d3d/d4b/d33/f5a [0,4194304] 0 2024-01-31T05:13:15.366 INFO:tasks.workunit.client.0.smithi099.stdout:6/454: getdents d14/d18/d52/d7e/d1c/d29/d4f 0 2024-01-31T05:13:15.367 INFO:tasks.workunit.client.0.smithi099.stdout:2/555: truncate d10/d1b/d83/d86/d95/f96 480238 0 2024-01-31T05:13:15.368 INFO:tasks.workunit.client.0.smithi099.stdout:6/455: mknod d14/d18/d52/d7e/d1c/d29/d43/c8a 0 2024-01-31T05:13:15.368 INFO:tasks.workunit.client.0.smithi099.stdout:4/609: mknod d0/d2/d4b/d93/d17/d24/d3f/d43/cce 0 2024-01-31T05:13:15.370 INFO:tasks.workunit.client.0.smithi099.stdout:3/568: symlink d10/lcc 0 2024-01-31T05:13:15.371 INFO:tasks.workunit.client.0.smithi099.stdout:4/610: rmdir d0/d8/d19/d98/d9b/dab 39 2024-01-31T05:13:15.373 INFO:tasks.workunit.client.0.smithi099.stdout:6/456: creat d14/d18/d52/d7e/f8b x:0 0 0 2024-01-31T05:13:15.375 INFO:tasks.workunit.client.0.smithi099.stdout:6/457: rename d14/d18/d52/d7e/d1c/d29/d43/c4a to d14/d18/d52/d7e/d1c/d29/c8c 0 2024-01-31T05:13:15.376 INFO:tasks.workunit.client.0.smithi099.stdout:6/458: creat d14/d18/d52/d46/f8d x:0 0 0 2024-01-31T05:13:15.378 INFO:tasks.workunit.client.0.smithi099.stdout:2/556: write d10/d20/f37 [10522065,98994] 0 2024-01-31T05:13:15.383 INFO:tasks.workunit.client.0.smithi099.stdout:2/557: creat d10/d2b/d97/fb9 x:0 0 0 2024-01-31T05:13:15.383 INFO:tasks.workunit.client.0.smithi099.stdout:2/558: fdatasync d10/d1b/f59 0 2024-01-31T05:13:15.399 INFO:tasks.workunit.client.0.smithi099.stdout:3/569: dwrite d10/f23 [0,4194304] 0 2024-01-31T05:13:15.399 INFO:tasks.workunit.client.0.smithi099.stdout:7/508: dwrite d6/d32/d3d/d4b/d33/d37/d50/d25/d47/f91 [0,4194304] 0 2024-01-31T05:13:15.400 INFO:tasks.workunit.client.0.smithi099.stdout:4/611: dwrite d0/d74/fb8 [0,4194304] 0 2024-01-31T05:13:15.402 INFO:tasks.workunit.client.0.smithi099.stdout:6/459: rename d14/d18/d52/d7e/d1c/d29/d43/c7a to d14/d18/d52/d7e/d66/c8e 0 2024-01-31T05:13:15.403 INFO:tasks.workunit.client.0.smithi099.stdout:6/460: readlink d14/d18/l21 0 2024-01-31T05:13:15.403 INFO:tasks.workunit.client.0.smithi099.stdout:7/509: mknod d6/d12/c9d 0 2024-01-31T05:13:15.404 INFO:tasks.workunit.client.0.smithi099.stdout:4/612: mkdir d0/d2/d4b/d93/d39/dcf 0 2024-01-31T05:13:15.406 INFO:tasks.workunit.client.0.smithi099.stdout:3/570: rename d10/c13 to d10/d32/d33/d51/ccd 0 2024-01-31T05:13:15.408 INFO:tasks.workunit.client.0.smithi099.stdout:7/510: creat d6/d32/d3d/d4b/d9b/f9e x:0 0 0 2024-01-31T05:13:15.409 INFO:tasks.workunit.client.0.smithi099.stdout:4/613: creat d0/d2/d4b/d93/d17/d24/d3f/fd0 x:0 0 0 2024-01-31T05:13:15.411 INFO:tasks.workunit.client.0.smithi099.stdout:6/461: read d14/d18/d3b/d7b/f7d [920213,2015] 0 2024-01-31T05:13:15.411 INFO:tasks.workunit.client.0.smithi099.stdout:6/462: chown d14/d18/d52/c77 2 1 2024-01-31T05:13:15.411 INFO:tasks.workunit.client.0.smithi099.stdout:6/463: fdatasync d14/d18/d52/d22/f88 0 2024-01-31T05:13:15.412 INFO:tasks.workunit.client.0.smithi099.stdout:1/500: sync 2024-01-31T05:13:15.412 INFO:tasks.workunit.client.0.smithi099.stdout:9/569: sync 2024-01-31T05:13:15.412 INFO:tasks.workunit.client.0.smithi099.stdout:1/501: stat d4/dc/d29/f36 0 2024-01-31T05:13:15.412 INFO:tasks.workunit.client.0.smithi099.stdout:1/502: truncate d4/db/d24/f41 1449 0 2024-01-31T05:13:15.412 INFO:tasks.workunit.client.0.smithi099.stdout:4/614: creat d0/d2/d4b/d93/d59/d8f/fd1 x:0 0 0 2024-01-31T05:13:15.413 INFO:tasks.workunit.client.0.smithi099.stdout:3/571: rmdir d10/d1e/da2 39 2024-01-31T05:13:15.415 INFO:tasks.workunit.client.0.smithi099.stdout:4/615: dread d0/d1e/d61/f7c [0,4194304] 0 2024-01-31T05:13:15.415 INFO:tasks.workunit.client.0.smithi099.stdout:4/616: fdatasync d0/d2/d4b/d93/d59/d8f/fa4 0 2024-01-31T05:13:15.415 INFO:tasks.workunit.client.0.smithi099.stdout:4/617: fdatasync d0/d8/d19/d98/d9b/dab/f6b 0 2024-01-31T05:13:15.416 INFO:tasks.workunit.client.0.smithi099.stdout:7/511: symlink d6/d32/d3d/d4b/d33/d37/d50/d4d/d58/l9f 0 2024-01-31T05:13:15.416 INFO:tasks.workunit.client.0.smithi099.stdout:7/512: write d6/d12/f73 [4395475,69902] 0 2024-01-31T05:13:15.416 INFO:tasks.workunit.client.0.smithi099.stdout:7/513: readlink d6/d32/d3d/d4b/d33/d37/d4e/l88 0 2024-01-31T05:13:15.416 INFO:tasks.workunit.client.0.smithi099.stdout:1/503: rmdir d4/dc/d4d 39 2024-01-31T05:13:15.419 INFO:tasks.workunit.client.0.smithi099.stdout:4/618: creat d0/d2/d4b/d93/d17/d24/fd2 x:0 0 0 2024-01-31T05:13:15.422 INFO:tasks.workunit.client.0.smithi099.stdout:5/529: sync 2024-01-31T05:13:15.422 INFO:tasks.workunit.client.0.smithi099.stdout:0/596: sync 2024-01-31T05:13:15.422 INFO:tasks.workunit.client.0.smithi099.stdout:0/597: dread - d1/d37/d4a/d7a/d7d/fa0 zero size 2024-01-31T05:13:15.422 INFO:tasks.workunit.client.0.smithi099.stdout:0/598: write d1/d30/d45/d6e/f8e [887587,4073] 0 2024-01-31T05:13:15.425 INFO:tasks.workunit.client.0.smithi099.stdout:1/504: rename d4/db/c1c to d4/db/d3a/d7e/d85/c9b 0 2024-01-31T05:13:15.427 INFO:tasks.workunit.client.0.smithi099.stdout:5/530: symlink d6/da/d14/d3d/d51/d82/d93/lb2 0 2024-01-31T05:13:15.427 INFO:tasks.workunit.client.0.smithi099.stdout:5/531: creat d6/da/d14/fb3 x:0 0 0 2024-01-31T05:13:15.427 INFO:tasks.workunit.client.0.smithi099.stdout:5/532: read d6/da/d3f/f9b [2828,19790] 0 2024-01-31T05:13:15.427 INFO:tasks.workunit.client.0.smithi099.stdout:5/533: write d6/f13 [4222480,83335] 0 2024-01-31T05:13:15.431 INFO:tasks.workunit.client.0.smithi099.stdout:7/514: rename d6/d32/f34 to d6/d32/d3d/d4b/d33/d37/d50/d5e/fa0 0 2024-01-31T05:13:15.433 INFO:tasks.workunit.client.0.smithi099.stdout:0/599: unlink d1/d56/f5d 0 2024-01-31T05:13:15.435 INFO:tasks.workunit.client.0.smithi099.stdout:1/505: dread d4/dc/d48/f31 [0,4194304] 0 2024-01-31T05:13:15.435 INFO:tasks.workunit.client.0.smithi099.stdout:5/534: creat d6/da/d14/d3d/da8/fb4 x:0 0 0 2024-01-31T05:13:15.435 INFO:tasks.workunit.client.0.smithi099.stdout:5/535: fsync d6/da/d14/d3d/d51/d82/f43 0 2024-01-31T05:13:15.436 INFO:tasks.workunit.client.0.smithi099.stdout:0/600: mknod d1/d30/d45/d66/d97/cd3 0 2024-01-31T05:13:15.436 INFO:tasks.workunit.client.0.smithi099.stdout:0/601: fsync d1/d37/fc3 0 2024-01-31T05:13:15.436 INFO:tasks.workunit.client.0.smithi099.stdout:1/506: fsync d4/db/d24/d4b/d50/d91/f7b 0 2024-01-31T05:13:15.438 INFO:tasks.workunit.client.0.smithi099.stdout:5/536: creat d6/da/d14/d3d/d51/d82/d9a/fb5 x:0 0 0 2024-01-31T05:13:15.439 INFO:tasks.workunit.client.0.smithi099.stdout:7/515: dread d6/d32/d3d/d4b/d33/d37/d4e/f74 [0,4194304] 0 2024-01-31T05:13:15.439 INFO:tasks.workunit.client.0.smithi099.stdout:5/537: rename d6/da/d14/l6f to d6/da/d14/d3d/d51/dae/lb6 0 2024-01-31T05:13:15.440 INFO:tasks.workunit.client.0.smithi099.stdout:5/538: readlink d6/da/l26 0 2024-01-31T05:13:15.441 INFO:tasks.workunit.client.0.smithi099.stdout:7/516: rename d6/d32/d3d/d4b/d33/d37/d50/d25/d47/l66 to d6/d32/d3d/d4b/d33/d37/d50/d25/d7a/la1 0 2024-01-31T05:13:15.444 INFO:tasks.workunit.client.0.smithi099.stdout:6/464: dwrite d14/d18/d52/d7e/d1c/f5f [4194304,4194304] 0 2024-01-31T05:13:15.444 INFO:tasks.workunit.client.0.smithi099.stdout:4/619: dwrite d0/d2/d4b/d93/d39/fcd [0,4194304] 0 2024-01-31T05:13:15.445 INFO:tasks.workunit.client.0.smithi099.stdout:4/620: truncate d0/d79/f92 1297981 0 2024-01-31T05:13:15.446 INFO:tasks.workunit.client.0.smithi099.stdout:1/507: dread d4/db/d3a/f60 [0,4194304] 0 2024-01-31T05:13:15.446 INFO:tasks.workunit.client.0.smithi099.stdout:1/508: chown d4/dc/l19 2546 1 2024-01-31T05:13:15.448 INFO:tasks.workunit.client.0.smithi099.stdout:0/602: dread d1/d16/d36/f68 [0,4194304] 0 2024-01-31T05:13:15.448 INFO:tasks.workunit.client.0.smithi099.stdout:0/603: creat d1/d16/d36/d8b/fd4 x:0 0 0 2024-01-31T05:13:15.448 INFO:tasks.workunit.client.0.smithi099.stdout:4/621: symlink d0/d2/d4b/d93/d86/d8d/ld3 0 2024-01-31T05:13:15.449 INFO:tasks.workunit.client.0.smithi099.stdout:1/509: dread d4/db/d24/d69/f70 [0,4194304] 0 2024-01-31T05:13:15.450 INFO:tasks.workunit.client.0.smithi099.stdout:0/604: symlink d1/d37/d4a/d6f/dc9/dcf/ld5 0 2024-01-31T05:13:15.450 INFO:tasks.workunit.client.0.smithi099.stdout:0/605: chown d1/d16/l52 212 1 2024-01-31T05:13:15.451 INFO:tasks.workunit.client.0.smithi099.stdout:4/622: mkdir d0/d8/d19/d54/dd4 0 2024-01-31T05:13:15.451 INFO:tasks.workunit.client.0.smithi099.stdout:1/510: rmdir d4/db/d3a 39 2024-01-31T05:13:15.453 INFO:tasks.workunit.client.0.smithi099.stdout:0/606: mkdir d1/d8/dd6 0 2024-01-31T05:13:15.453 INFO:tasks.workunit.client.0.smithi099.stdout:0/607: creat d1/d37/d4a/fd7 x:0 0 0 2024-01-31T05:13:15.455 INFO:tasks.workunit.client.0.smithi099.stdout:7/517: write d6/d32/d3d/d4b/d33/d37/d50/d4d/d58/f67 [2885412,125827] 0 2024-01-31T05:13:15.455 INFO:tasks.workunit.client.0.smithi099.stdout:7/518: readlink d6/d32/d3d/d4b/d33/d37/l86 0 2024-01-31T05:13:15.455 INFO:tasks.workunit.client.0.smithi099.stdout:0/608: link d1/d30/d45/dad/c85 d1/d30/d45/dad/db1/cd8 0 2024-01-31T05:13:15.456 INFO:tasks.workunit.client.0.smithi099.stdout:0/609: stat d1/d30/d45/d6e 0 2024-01-31T05:13:15.456 INFO:tasks.workunit.client.0.smithi099.stdout:0/610: readlink d1/d37/l40 0 2024-01-31T05:13:15.456 INFO:tasks.workunit.client.0.smithi099.stdout:4/623: mknod d0/d8/d19/d98/d9b/dab/cd5 0 2024-01-31T05:13:15.457 INFO:tasks.workunit.client.0.smithi099.stdout:4/624: truncate d0/d2/d4b/d93/d17/d3d/f41 4491361 0 2024-01-31T05:13:15.457 INFO:tasks.workunit.client.0.smithi099.stdout:4/625: read d0/d2/d4b/d93/d59/f8b [706967,28860] 0 2024-01-31T05:13:15.459 INFO:tasks.workunit.client.0.smithi099.stdout:4/626: mkdir d0/d2/d4b/d93/d59/d8f/dd6 0 2024-01-31T05:13:15.459 INFO:tasks.workunit.client.0.smithi099.stdout:4/627: fdatasync d0/d2/d4b/d93/f94 0 2024-01-31T05:13:15.465 INFO:tasks.workunit.client.0.smithi099.stdout:0/611: write d1/f8f [888333,106358] 0 2024-01-31T05:13:15.465 INFO:tasks.workunit.client.0.smithi099.stdout:0/612: creat d1/d37/d4a/d7a/d9d/fd9 x:0 0 0 2024-01-31T05:13:15.467 INFO:tasks.workunit.client.0.smithi099.stdout:7/519: dread d6/d32/d3d/d4b/d33/d37/d50/d25/d72/d8e/f96 [0,4194304] 0 2024-01-31T05:13:15.467 INFO:tasks.workunit.client.0.smithi099.stdout:7/520: creat d6/d32/d3d/d4b/d33/d37/fa2 x:0 0 0 2024-01-31T05:13:15.475 INFO:tasks.workunit.client.0.smithi099.stdout:6/465: link d14/d18/d52/f67 d14/d18/d52/d7e/d1c/f8f 0 2024-01-31T05:13:15.476 INFO:tasks.workunit.client.0.smithi099.stdout:6/466: readlink l6 0 2024-01-31T05:13:15.476 INFO:tasks.workunit.client.0.smithi099.stdout:6/467: dread - d14/d18/d52/d22/f88 zero size 2024-01-31T05:13:15.476 INFO:tasks.workunit.client.0.smithi099.stdout:1/511: write d4/dc/d15/f7a [18301,108766] 0 2024-01-31T05:13:15.478 INFO:tasks.workunit.client.0.smithi099.stdout:1/512: mknod d4/dc/d4d/d5d/d87/c9c 0 2024-01-31T05:13:15.484 INFO:tasks.workunit.client.0.smithi099.stdout:7/521: read d6/d32/d3d/f7c [3125928,101063] 0 2024-01-31T05:13:15.486 INFO:tasks.workunit.client.0.smithi099.stdout:7/522: creat d6/d32/d3d/d4b/d33/d37/d50/d25/d7a/fa3 x:0 0 0 2024-01-31T05:13:15.487 INFO:tasks.workunit.client.0.smithi099.stdout:1/513: write d4/db/d24/d4b/d50/d91/f22 [3347848,110222] 0 2024-01-31T05:13:15.487 INFO:tasks.workunit.client.0.smithi099.stdout:1/514: fdatasync d4/dc/d48/f2f 0 2024-01-31T05:13:15.492 INFO:tasks.workunit.client.0.smithi099.stdout:7/523: mknod d6/d98/ca4 0 2024-01-31T05:13:15.494 INFO:tasks.workunit.client.0.smithi099.stdout:0/613: dwrite d1/d37/f86 [0,4194304] 0 2024-01-31T05:13:15.494 INFO:tasks.workunit.client.0.smithi099.stdout:4/628: dwrite d0/d8/d19/d65/f75 [0,4194304] 0 2024-01-31T05:13:15.495 INFO:tasks.workunit.client.0.smithi099.stdout:1/515: creat d4/dc/d4d/d5d/d87/f9d x:0 0 0 2024-01-31T05:13:15.499 INFO:tasks.workunit.client.0.smithi099.stdout:0/614: mknod d1/d30/d45/d66/d97/cda 0 2024-01-31T05:13:15.502 INFO:tasks.workunit.client.0.smithi099.stdout:4/629: unlink d0/d2/d4b/d93/d17/d24/d3f/d43/c77 0 2024-01-31T05:13:15.502 INFO:tasks.workunit.client.0.smithi099.stdout:4/630: fdatasync d0/f3 0 2024-01-31T05:13:15.502 INFO:tasks.workunit.client.0.smithi099.stdout:4/631: write d0/d8/faf [397235,86464] 0 2024-01-31T05:13:15.502 INFO:tasks.workunit.client.0.smithi099.stdout:4/632: write d0/d1e/fbc [220997,98232] 0 2024-01-31T05:13:15.502 INFO:tasks.workunit.client.0.smithi099.stdout:4/633: creat d0/d2/d4b/d93/d17/d7d/db2/dc7/dcc/fd7 x:0 0 0 2024-01-31T05:13:15.504 INFO:tasks.workunit.client.0.smithi099.stdout:4/634: creat d0/d2/d4b/d93/d86/db4/fd8 x:0 0 0 2024-01-31T05:13:15.507 INFO:tasks.workunit.client.0.smithi099.stdout:6/468: dwrite d14/d18/d52/f67 [0,4194304] 0 2024-01-31T05:13:15.509 INFO:tasks.workunit.client.0.smithi099.stdout:0/615: write d1/d37/d4a/f9a [1128417,1909] 0 2024-01-31T05:13:15.520 INFO:tasks.workunit.client.0.smithi099.stdout:4/635: rmdir d0 39 2024-01-31T05:13:15.521 INFO:tasks.workunit.client.0.smithi099.stdout:4/636: truncate d0/d2/d4b/f5f 2522712 0 2024-01-31T05:13:15.523 INFO:tasks.workunit.client.0.smithi099.stdout:4/637: creat d0/d8/d19/d98/d9b/dab/fd9 x:0 0 0 2024-01-31T05:13:15.524 INFO:tasks.workunit.client.0.smithi099.stdout:4/638: getdents d0/d8/d19/d99 0 2024-01-31T05:13:15.525 INFO:tasks.workunit.client.0.smithi099.stdout:4/639: getdents d0/d2/d4b/d93/d17/d7d 0 2024-01-31T05:13:15.527 INFO:tasks.workunit.client.0.smithi099.stdout:4/640: mknod d0/d8/d19/d98/cda 0 2024-01-31T05:13:15.529 INFO:tasks.workunit.client.0.smithi099.stdout:8/595: sync 2024-01-31T05:13:15.529 INFO:tasks.workunit.client.0.smithi099.stdout:8/596: stat d1/dd/dba/d29/d3f/d56/da0/c16 0 2024-01-31T05:13:15.530 INFO:tasks.workunit.client.0.smithi099.stdout:6/469: dwrite d14/d18/d52/d7e/d1c/f34 [0,4194304] 0 2024-01-31T05:13:15.531 INFO:tasks.workunit.client.0.smithi099.stdout:8/597: rmdir d1/dd 39 2024-01-31T05:13:15.532 INFO:tasks.workunit.client.0.smithi099.stdout:8/598: mkdir d1/dd/d65/d7f/d81/dc7 0 2024-01-31T05:13:15.532 INFO:tasks.workunit.client.0.smithi099.stdout:8/599: readlink d1/dd/dba/d29/d3f/d56/da0/l39 0 2024-01-31T05:13:15.533 INFO:tasks.workunit.client.0.smithi099.stdout:0/616: dwrite d1/d30/d45/d6e/f8e [0,4194304] 0 2024-01-31T05:13:15.534 INFO:tasks.workunit.client.0.smithi099.stdout:8/600: mknod d1/dd/dba/d29/d3f/d56/cc8 0 2024-01-31T05:13:15.534 INFO:tasks.workunit.client.0.smithi099.stdout:8/601: readlink d1/dd/dba/d29/d3f/d56/da0/d2e/l6f 0 2024-01-31T05:13:15.534 INFO:tasks.workunit.client.0.smithi099.stdout:8/602: readlink d1/dd/dba/d29/d3f/l4e 0 2024-01-31T05:13:15.535 INFO:tasks.workunit.client.0.smithi099.stdout:6/470: dread d14/d18/d52/d22/d71/f72 [0,4194304] 0 2024-01-31T05:13:15.536 INFO:tasks.workunit.client.0.smithi099.stdout:0/617: creat d1/fdb x:0 0 0 2024-01-31T05:13:15.538 INFO:tasks.workunit.client.0.smithi099.stdout:8/603: rename d1/dd/dba/d29/d3f/d56/cb8 to d1/da6/cc9 0 2024-01-31T05:13:15.538 INFO:tasks.workunit.client.0.smithi099.stdout:8/604: chown d1/dd/dba/da9 1 1 2024-01-31T05:13:15.538 INFO:tasks.workunit.client.0.smithi099.stdout:6/471: mkdir d14/d18/d52/d90 0 2024-01-31T05:13:15.540 INFO:tasks.workunit.client.0.smithi099.stdout:8/605: mknod d1/dd/dba/d20/cca 0 2024-01-31T05:13:15.540 INFO:tasks.workunit.client.0.smithi099.stdout:8/606: chown d1/dd/d1d/dbc 512076 1 2024-01-31T05:13:15.540 INFO:tasks.workunit.client.0.smithi099.stdout:8/607: readlink l0 0 2024-01-31T05:13:15.540 INFO:tasks.workunit.client.0.smithi099.stdout:8/608: read - d1/dd/dba/d29/d3f/d56/da0/d2e/fb1 zero size 2024-01-31T05:13:15.546 INFO:tasks.workunit.client.0.smithi099.stdout:0/618: symlink d1/ldc 0 2024-01-31T05:13:15.547 INFO:tasks.workunit.client.0.smithi099.stdout:0/619: creat d1/d37/d73/db7/dc5/fdd x:0 0 0 2024-01-31T05:13:15.550 INFO:tasks.workunit.client.0.smithi099.stdout:4/641: dwrite d0/d2/f15 [0,4194304] 0 2024-01-31T05:13:15.552 INFO:tasks.workunit.client.0.smithi099.stdout:4/642: mkdir d0/d2/d4b/d93/d59/d8f/dd6/ddb 0 2024-01-31T05:13:15.552 INFO:tasks.workunit.client.0.smithi099.stdout:4/643: write d0/d2/fc0 [95607,82715] 0 2024-01-31T05:13:15.567 INFO:tasks.workunit.client.0.smithi099.stdout:6/472: dwrite d14/d18/d3b/f42 [4194304,4194304] 0 2024-01-31T05:13:15.568 INFO:tasks.workunit.client.0.smithi099.stdout:6/473: creat d14/d18/d52/d7e/d1c/d29/d43/f91 x:0 0 0 2024-01-31T05:13:15.569 INFO:tasks.workunit.client.0.smithi099.stdout:6/474: dread - d14/d18/d52/d7e/d1c/d29/d4f/f6e zero size 2024-01-31T05:13:15.570 INFO:tasks.workunit.client.0.smithi099.stdout:6/475: creat d14/d18/d52/d7e/d1c/d29/d4f/f92 x:0 0 0 2024-01-31T05:13:15.572 INFO:tasks.workunit.client.0.smithi099.stdout:6/476: creat d14/d18/f93 x:0 0 0 2024-01-31T05:13:15.572 INFO:tasks.workunit.client.0.smithi099.stdout:0/620: dwrite d1/d37/fc3 [0,4194304] 0 2024-01-31T05:13:15.573 INFO:tasks.workunit.client.0.smithi099.stdout:8/609: dwrite d1/dd/f2b [0,4194304] 0 2024-01-31T05:13:15.577 INFO:tasks.workunit.client.0.smithi099.stdout:4/644: dwrite d0/d8/f64 [4194304,4194304] 0 2024-01-31T05:13:15.579 INFO:tasks.workunit.client.0.smithi099.stdout:0/621: creat d1/d37/d4a/d6f/dc9/dcf/fde x:0 0 0 2024-01-31T05:13:15.579 INFO:tasks.workunit.client.0.smithi099.stdout:0/622: chown d1/d30/d45/dad/l2b 616060244 1 2024-01-31T05:13:15.579 INFO:tasks.workunit.client.0.smithi099.stdout:8/610: creat d1/da6/fcb x:0 0 0 2024-01-31T05:13:15.579 INFO:tasks.workunit.client.0.smithi099.stdout:8/611: truncate d1/dd/dba/d19/f6d 983470 0 2024-01-31T05:13:15.580 INFO:tasks.workunit.client.0.smithi099.stdout:8/612: read d1/dd/dba/d19/dc5/f54 [4365473,96846] 0 2024-01-31T05:13:15.583 INFO:tasks.workunit.client.0.smithi099.stdout:0/623: unlink d1/d37/d4a/d7a/d7d/f88 0 2024-01-31T05:13:15.585 INFO:tasks.workunit.client.0.smithi099.stdout:8/613: truncate d1/dd/dba/d29/d3f/d56/da0/f27 2694062 0 2024-01-31T05:13:15.585 INFO:tasks.workunit.client.0.smithi099.stdout:8/614: write d1/dd/dba/d29/d3f/d56/da0/f44 [354217,103676] 0 2024-01-31T05:13:15.587 INFO:tasks.workunit.client.0.smithi099.stdout:8/615: mknod d1/dd/dba/d29/ccc 0 2024-01-31T05:13:15.587 INFO:tasks.workunit.client.0.smithi099.stdout:8/616: getdents d1/da6/db4 0 2024-01-31T05:13:15.587 INFO:tasks.workunit.client.0.smithi099.stdout:8/617: readlink d1/dd/d7b/d85/lab 0 2024-01-31T05:13:15.591 INFO:tasks.workunit.client.0.smithi099.stdout:4/645: dread d0/d1e/d61/fc3 [0,4194304] 0 2024-01-31T05:13:15.591 INFO:tasks.workunit.client.0.smithi099.stdout:3/572: sync 2024-01-31T05:13:15.591 INFO:tasks.workunit.client.0.smithi099.stdout:2/559: sync 2024-01-31T05:13:15.591 INFO:tasks.workunit.client.0.smithi099.stdout:9/570: sync 2024-01-31T05:13:15.591 INFO:tasks.workunit.client.0.smithi099.stdout:5/539: sync 2024-01-31T05:13:15.591 INFO:tasks.workunit.client.0.smithi099.stdout:3/573: stat d10/d32/d33/l8b 0 2024-01-31T05:13:15.591 INFO:tasks.workunit.client.0.smithi099.stdout:2/560: fdatasync d10/d2b/d58/fb1 0 2024-01-31T05:13:15.592 INFO:tasks.workunit.client.0.smithi099.stdout:9/571: fdatasync d0/d1/d24/d2b/d63/f93 0 2024-01-31T05:13:15.592 INFO:tasks.workunit.client.0.smithi099.stdout:2/561: creat d10/d2b/d7c/fba x:0 0 0 2024-01-31T05:13:15.592 INFO:tasks.workunit.client.0.smithi099.stdout:4/646: truncate d0/d2/d4b/d93/d59/f8b 157010 0 2024-01-31T05:13:15.593 INFO:tasks.workunit.client.0.smithi099.stdout:4/647: chown d0/d2/d20/c4f 2 1 2024-01-31T05:13:15.593 INFO:tasks.workunit.client.0.smithi099.stdout:4/648: readlink d0/d8/d19/l45 0 2024-01-31T05:13:15.593 INFO:tasks.workunit.client.0.smithi099.stdout:5/540: rmdir d6/da/d14/d3d/d6e 39 2024-01-31T05:13:15.595 INFO:tasks.workunit.client.0.smithi099.stdout:9/572: unlink d0/d5d/c7f 0 2024-01-31T05:13:15.596 INFO:tasks.workunit.client.0.smithi099.stdout:3/574: symlink d10/d1e/lce 0 2024-01-31T05:13:15.599 INFO:tasks.workunit.client.0.smithi099.stdout:4/649: symlink d0/d2/d4b/d93/d59/d8f/dd6/ddb/ldc 0 2024-01-31T05:13:15.600 INFO:tasks.workunit.client.0.smithi099.stdout:5/541: truncate d6/da/d14/d61/d98/faf 3562620 0 2024-01-31T05:13:15.602 INFO:tasks.workunit.client.0.smithi099.stdout:5/542: write d6/f91 [219908,7067] 0 2024-01-31T05:13:15.602 INFO:tasks.workunit.client.0.smithi099.stdout:5/543: stat d6/da/d14/d3d/d6e/d21/l29 0 2024-01-31T05:13:15.602 INFO:tasks.workunit.client.0.smithi099.stdout:5/544: fdatasync d6/da/f56 0 2024-01-31T05:13:15.602 INFO:tasks.workunit.client.0.smithi099.stdout:9/573: mkdir d0/d1/d5e/d72/d89/d98/dc1 0 2024-01-31T05:13:15.602 INFO:tasks.workunit.client.0.smithi099.stdout:0/624: dwrite d1/d37/d4a/d7b/fc2 [0,4194304] 0 2024-01-31T05:13:15.602 INFO:tasks.workunit.client.0.smithi099.stdout:0/625: readlink d1/d16/d36/lc0 0 2024-01-31T05:13:15.603 INFO:tasks.workunit.client.0.smithi099.stdout:4/650: mknod d0/d2/d4b/d93/d17/d3d/cdd 0 2024-01-31T05:13:15.603 INFO:tasks.workunit.client.0.smithi099.stdout:8/618: dread d1/dd/dba/d19/f1f [0,4194304] 0 2024-01-31T05:13:15.606 INFO:tasks.workunit.client.0.smithi099.stdout:5/545: truncate d6/f6d 2759880 0 2024-01-31T05:13:15.606 INFO:tasks.workunit.client.0.smithi099.stdout:5/546: truncate d6/da/d14/fb3 704761 0 2024-01-31T05:13:15.608 INFO:tasks.workunit.client.0.smithi099.stdout:9/574: link d0/d3e/d33/fa8 d0/fc2 0 2024-01-31T05:13:15.608 INFO:tasks.workunit.client.0.smithi099.stdout:3/575: dread d10/d27/d34/f68 [0,4194304] 0 2024-01-31T05:13:15.612 INFO:tasks.workunit.client.0.smithi099.stdout:8/619: mkdir d1/dd/d4f/dcd 0 2024-01-31T05:13:15.615 INFO:tasks.workunit.client.0.smithi099.stdout:5/547: mknod d6/da/d14/d3d/d51/dae/db0/cb7 0 2024-01-31T05:13:15.617 INFO:tasks.workunit.client.0.smithi099.stdout:2/562: dwrite d10/d3a/d69/f8b [0,4194304] 0 2024-01-31T05:13:15.617 INFO:tasks.workunit.client.0.smithi099.stdout:9/575: link d0/f95 d0/d1/d24/d48/fc3 0 2024-01-31T05:13:15.617 INFO:tasks.workunit.client.0.smithi099.stdout:9/576: fdatasync d0/d1/d24/d48/f6a 0 2024-01-31T05:13:15.617 INFO:tasks.workunit.client.0.smithi099.stdout:4/651: read d0/d2/d4b/d93/d17/d3d/f41 [109774,44003] 0 2024-01-31T05:13:15.618 INFO:tasks.workunit.client.0.smithi099.stdout:9/577: fsync d0/d3e/f6f 0 2024-01-31T05:13:15.623 INFO:tasks.workunit.client.0.smithi099.stdout:3/576: unlink d10/d27/d34/d44/d60/d75/d8c/d92/cc8 0 2024-01-31T05:13:15.624 INFO:tasks.workunit.client.0.smithi099.stdout:8/620: mkdir d1/dd/d65/d7f/d81/dc7/dce 0 2024-01-31T05:13:15.624 INFO:tasks.workunit.client.0.smithi099.stdout:5/548: symlink d6/da/d14/d3d/d51/lb8 0 2024-01-31T05:13:15.624 INFO:tasks.workunit.client.0.smithi099.stdout:9/578: symlink d0/d3e/d33/dab/lc4 0 2024-01-31T05:13:15.627 INFO:tasks.workunit.client.0.smithi099.stdout:3/577: mknod d10/d27/d34/d44/d60/d75/ccf 0 2024-01-31T05:13:15.629 INFO:tasks.workunit.client.0.smithi099.stdout:8/621: link d1/da6/f8f d1/dd/d4f/dcd/fcf 0 2024-01-31T05:13:15.631 INFO:tasks.workunit.client.0.smithi099.stdout:5/549: symlink d6/da/d3f/d73/lb9 0 2024-01-31T05:13:15.633 INFO:tasks.workunit.client.0.smithi099.stdout:3/578: rename d10/d27/d89/f9a to d10/d32/d85/d77/fd0 0 2024-01-31T05:13:15.634 INFO:tasks.workunit.client.0.smithi099.stdout:8/622: mknod d1/dd/d4f/dcd/cd0 0 2024-01-31T05:13:15.634 INFO:tasks.workunit.client.0.smithi099.stdout:8/623: truncate d1/dd/dba/d29/d3f/d56/fc2 464082 0 2024-01-31T05:13:15.635 INFO:tasks.workunit.client.0.smithi099.stdout:8/624: dread d1/dd/dba/d29/d3f/d56/fc2 [0,4194304] 0 2024-01-31T05:13:15.636 INFO:tasks.workunit.client.0.smithi099.stdout:3/579: creat d10/d27/d34/d52/fd1 x:0 0 0 2024-01-31T05:13:15.636 INFO:tasks.workunit.client.0.smithi099.stdout:3/580: chown d10/d32/d85/da3/db9/fca 2 1 2024-01-31T05:13:15.637 INFO:tasks.workunit.client.0.smithi099.stdout:8/625: creat d1/dd/d65/d7f/d81/dc7/fd1 x:0 0 0 2024-01-31T05:13:15.639 INFO:tasks.workunit.client.0.smithi099.stdout:5/550: dread d6/da/d14/d3d/d6e/f22 [0,4194304] 0 2024-01-31T05:13:15.648 INFO:tasks.workunit.client.0.smithi099.stdout:2/563: getdents d10/d1b 0 2024-01-31T05:13:15.648 INFO:tasks.workunit.client.0.smithi099.stdout:2/564: dread - d10/d2b/fb2 zero size 2024-01-31T05:13:15.650 INFO:tasks.workunit.client.0.smithi099.stdout:2/565: creat d10/d2b/fbb x:0 0 0 2024-01-31T05:13:15.652 INFO:tasks.workunit.client.0.smithi099.stdout:2/566: rename d10/d2b/fbb to d10/d3a/d69/fbc 0 2024-01-31T05:13:15.656 INFO:tasks.workunit.client.0.smithi099.stdout:4/652: dwrite d0/d8/f64 [4194304,4194304] 0 2024-01-31T05:13:15.657 INFO:tasks.workunit.client.0.smithi099.stdout:9/579: dwrite d0/d5d/f85 [0,4194304] 0 2024-01-31T05:13:15.658 INFO:tasks.workunit.client.0.smithi099.stdout:4/653: link d0/d8/fc4 d0/d2/d4b/d93/d59/d8f/dd6/ddb/fde 0 2024-01-31T05:13:15.662 INFO:tasks.workunit.client.0.smithi099.stdout:3/581: dread d10/d72/f96 [0,4194304] 0 2024-01-31T05:13:15.662 INFO:tasks.workunit.client.0.smithi099.stdout:9/580: creat d0/d5d/db6/fc5 x:0 0 0 2024-01-31T05:13:15.663 INFO:tasks.workunit.client.0.smithi099.stdout:9/581: mknod d0/d1/d24/d2b/d63/da7/cc6 0 2024-01-31T05:13:15.664 INFO:tasks.workunit.client.0.smithi099.stdout:9/582: read - d0/f95 zero size 2024-01-31T05:13:15.664 INFO:tasks.workunit.client.0.smithi099.stdout:4/654: dread d0/d8/d19/f2d [0,4194304] 0 2024-01-31T05:13:15.664 INFO:tasks.workunit.client.0.smithi099.stdout:4/655: fsync d0/d2/d4b/d93/d17/d3d/faa 0 2024-01-31T05:13:15.665 INFO:tasks.workunit.client.0.smithi099.stdout:3/582: creat d10/d27/d34/d44/d95/fd2 x:0 0 0 2024-01-31T05:13:15.666 INFO:tasks.workunit.client.0.smithi099.stdout:9/583: mkdir d0/d5d/db6/dc7 0 2024-01-31T05:13:15.667 INFO:tasks.workunit.client.0.smithi099.stdout:4/656: symlink d0/d8/d19/d54/ldf 0 2024-01-31T05:13:15.668 INFO:tasks.workunit.client.0.smithi099.stdout:9/584: link d0/d1/d5e/d72/d89/d98/fb9 d0/d1/d24/d2b/d63/da7/fc8 0 2024-01-31T05:13:15.670 INFO:tasks.workunit.client.0.smithi099.stdout:4/657: truncate d0/d2/d4b/d93/d39/fcd 273277 0 2024-01-31T05:13:15.670 INFO:tasks.workunit.client.0.smithi099.stdout:4/658: fsync d0/d2/d4b/d93/d17/d3d/fb7 0 2024-01-31T05:13:15.670 INFO:tasks.workunit.client.0.smithi099.stdout:4/659: truncate d0/d2/d4b/d93/d86/db4/fd8 590727 0 2024-01-31T05:13:15.675 INFO:tasks.workunit.client.0.smithi099.stdout:5/551: dwrite d6/da/d14/d3d/d6e/f22 [0,4194304] 0 2024-01-31T05:13:15.675 INFO:tasks.workunit.client.0.smithi099.stdout:5/552: dread - d6/da/d14/d3d/d57/fad zero size 2024-01-31T05:13:15.675 INFO:tasks.workunit.client.0.smithi099.stdout:5/553: readlink d6/da/d14/d3d/d51/d82/d93/lb2 0 2024-01-31T05:13:15.675 INFO:tasks.workunit.client.0.smithi099.stdout:4/660: link d0/d2/l30 d0/d8/d19/d54/d76/le0 0 2024-01-31T05:13:15.677 INFO:tasks.workunit.client.0.smithi099.stdout:8/626: dwrite d1/dd/dba/d29/d3f/d56/da0/d2e/f33 [4194304,4194304] 0 2024-01-31T05:13:15.680 INFO:tasks.workunit.client.0.smithi099.stdout:8/627: dread d1/f5e [0,4194304] 0 2024-01-31T05:13:15.680 INFO:tasks.workunit.client.0.smithi099.stdout:5/554: symlink d6/da/d14/lba 0 2024-01-31T05:13:15.684 INFO:tasks.workunit.client.0.smithi099.stdout:4/661: mkdir d0/d2/d4b/d93/d17/de1 0 2024-01-31T05:13:15.684 INFO:tasks.workunit.client.0.smithi099.stdout:4/662: chown d0/d2/d4b/d93/d17/f25 1043210842 1 2024-01-31T05:13:15.687 INFO:tasks.workunit.client.0.smithi099.stdout:4/663: dread d0/d79/f92 [0,4194304] 0 2024-01-31T05:13:15.687 INFO:tasks.workunit.client.0.smithi099.stdout:4/664: dread - d0/d2/d4b/d93/d59/d8f/fd1 zero size 2024-01-31T05:13:15.687 INFO:tasks.workunit.client.0.smithi099.stdout:4/665: chown d0/d2/d4b/d93/d17/f25 2 1 2024-01-31T05:13:15.687 INFO:tasks.workunit.client.0.smithi099.stdout:3/583: dwrite d10/d32/d33/f61 [0,4194304] 0 2024-01-31T05:13:15.688 INFO:tasks.workunit.client.0.smithi099.stdout:3/584: creat d10/d32/d85/da3/fd3 x:0 0 0 2024-01-31T05:13:15.688 INFO:tasks.workunit.client.0.smithi099.stdout:3/585: write d10/d32/d85/f26 [3783301,23597] 0 2024-01-31T05:13:15.693 INFO:tasks.workunit.client.0.smithi099.stdout:5/555: read d6/f13 [2033770,100814] 0 2024-01-31T05:13:15.693 INFO:tasks.workunit.client.0.smithi099.stdout:5/556: fsync d6/da/d3f/f4d 0 2024-01-31T05:13:15.697 INFO:tasks.workunit.client.0.smithi099.stdout:4/666: write d0/d2/d4b/d93/d17/f25 [2624503,104430] 0 2024-01-31T05:13:15.702 INFO:tasks.workunit.client.0.smithi099.stdout:8/628: rmdir d1/dd/dba/d29/d3f/d56/da0/d2e 39 2024-01-31T05:13:15.702 INFO:tasks.workunit.client.0.smithi099.stdout:8/629: chown d1/l35 175078 1 2024-01-31T05:13:15.702 INFO:tasks.workunit.client.0.smithi099.stdout:8/630: write d1/dd/dba/d29/d3f/d56/d57/f96 [316259,5523] 0 2024-01-31T05:13:15.707 INFO:tasks.workunit.client.0.smithi099.stdout:3/586: creat d10/d32/d33/fd4 x:0 0 0 2024-01-31T05:13:15.708 INFO:tasks.workunit.client.0.smithi099.stdout:5/557: creat d6/da/d14/d3d/d8c/fbb x:0 0 0 2024-01-31T05:13:15.708 INFO:tasks.workunit.client.0.smithi099.stdout:5/558: fdatasync d6/da/d14/d3d/d8c/fbb 0 2024-01-31T05:13:15.710 INFO:tasks.workunit.client.0.smithi099.stdout:9/585: rename d0/d1 to d0/d3e/d87/dc9 0 2024-01-31T05:13:15.713 INFO:tasks.workunit.client.0.smithi099.stdout:3/587: creat d10/d27/d34/fd5 x:0 0 0 2024-01-31T05:13:15.713 INFO:tasks.workunit.client.0.smithi099.stdout:3/588: fdatasync d10/d32/d33/f63 0 2024-01-31T05:13:15.714 INFO:tasks.workunit.client.0.smithi099.stdout:5/559: rename d6/da/d3f/d73/f88 to d6/da/d14/d61/d98/fbc 0 2024-01-31T05:13:15.715 INFO:tasks.workunit.client.0.smithi099.stdout:9/586: mkdir d0/d3e/d87/dc9/d5e/d72/d89/d98/dc1/dca 0 2024-01-31T05:13:15.716 INFO:tasks.workunit.client.0.smithi099.stdout:8/631: getdents d1/dd/d4f/d51/d83 0 2024-01-31T05:13:15.716 INFO:tasks.workunit.client.0.smithi099.stdout:8/632: fsync d1/dd/dba/d19/f9d 0 2024-01-31T05:13:15.721 INFO:tasks.workunit.client.0.smithi099.stdout:3/589: unlink d10/d32/f3b 0 2024-01-31T05:13:15.721 INFO:tasks.workunit.client.0.smithi099.stdout:3/590: readlink d10/d32/d33/l8b 0 2024-01-31T05:13:15.721 INFO:tasks.workunit.client.0.smithi099.stdout:3/591: read d10/d32/fad [130572,129425] 0 2024-01-31T05:13:15.723 INFO:tasks.workunit.client.0.smithi099.stdout:5/560: mknod d6/da/d14/d3d/d8c/d99/cbd 0 2024-01-31T05:13:15.723 INFO:tasks.workunit.client.0.smithi099.stdout:5/561: write d6/da/d14/d3d/da8/fb4 [581144,62739] 0 2024-01-31T05:13:15.723 INFO:tasks.workunit.client.0.smithi099.stdout:5/562: fsync d6/da/d14/d3d/d51/f8e 0 2024-01-31T05:13:15.724 INFO:tasks.workunit.client.0.smithi099.stdout:7/524: sync 2024-01-31T05:13:15.725 INFO:tasks.workunit.client.0.smithi099.stdout:9/587: rmdir d0/d5d/db6/dc7 0 2024-01-31T05:13:15.726 INFO:tasks.workunit.client.0.smithi099.stdout:9/588: write d0/d7/f1f [3647666,64818] 0 2024-01-31T05:13:15.726 INFO:tasks.workunit.client.0.smithi099.stdout:8/633: rmdir d1/dd/d7b 39 2024-01-31T05:13:15.727 INFO:tasks.workunit.client.0.smithi099.stdout:5/563: mknod d6/da/d3f/d5a/d81/cbe 0 2024-01-31T05:13:15.730 INFO:tasks.workunit.client.0.smithi099.stdout:9/589: rename d0/d7/l32 to d0/d3e/d33/lcb 0 2024-01-31T05:13:15.730 INFO:tasks.workunit.client.0.smithi099.stdout:3/592: dread d10/d72/f9c [0,4194304] 0 2024-01-31T05:13:15.731 INFO:tasks.workunit.client.0.smithi099.stdout:8/634: link d1/dd/dba/d19/d21/f62 d1/dd/fd2 0 2024-01-31T05:13:15.733 INFO:tasks.workunit.client.0.smithi099.stdout:7/525: rename d6/d32/d3d/f5f to d6/d32/d3d/d4b/d33/d37/d50/d7b/fa5 0 2024-01-31T05:13:15.733 INFO:tasks.workunit.client.0.smithi099.stdout:7/526: chown d6/d32/d3d/d4b/d33/d37/d50/d25/d7a/l95 1 1 2024-01-31T05:13:15.734 INFO:tasks.workunit.client.0.smithi099.stdout:3/593: symlink d10/d27/d34/d44/d60/ld6 0 2024-01-31T05:13:15.739 INFO:tasks.workunit.client.0.smithi099.stdout:9/590: rename d0/d3e/d87/dc9/d24/f37 to d0/d3e/d87/dc9/d24/d2b/d63/da7/daa/fcc 0 2024-01-31T05:13:15.739 INFO:tasks.workunit.client.0.smithi099.stdout:9/591: dread - d0/d3e/d87/dc9/d24/d2b/d63/da7/fb2 zero size 2024-01-31T05:13:15.740 INFO:tasks.workunit.client.0.smithi099.stdout:7/527: getdents d6/d32/d3d/d4b/d33/d37/d50/d5e 0 2024-01-31T05:13:15.740 INFO:tasks.workunit.client.0.smithi099.stdout:7/528: write d6/d32/d3d/d4b/d9b/f9e [985876,84066] 0 2024-01-31T05:13:15.743 INFO:tasks.workunit.client.0.smithi099.stdout:9/592: symlink d0/d3e/d87/dc9/d24/d2b/d63/da7/daa/lcd 0 2024-01-31T05:13:15.743 INFO:tasks.workunit.client.0.smithi099.stdout:9/593: fdatasync d0/d44/f4f 0 2024-01-31T05:13:15.744 INFO:tasks.workunit.client.0.smithi099.stdout:7/529: rename d6/d32/d3d/d4b/d33/d37/f7e to d6/d32/d3d/d4b/d33/d37/d4e/fa6 0 2024-01-31T05:13:15.745 INFO:tasks.workunit.client.0.smithi099.stdout:3/594: link d10/d27/c46 d10/d1e/cd7 0 2024-01-31T05:13:15.747 INFO:tasks.workunit.client.0.smithi099.stdout:9/594: mknod d0/d3e/d33/dab/cce 0 2024-01-31T05:13:15.749 INFO:tasks.workunit.client.0.smithi099.stdout:7/530: link d6/d32/d3d/d4b/d33/d37/l7d d6/d32/d3d/d46/la7 0 2024-01-31T05:13:15.750 INFO:tasks.workunit.client.0.smithi099.stdout:7/531: chown d6/d32/f5b 13601165 1 2024-01-31T05:13:15.751 INFO:tasks.workunit.client.0.smithi099.stdout:7/532: mkdir d6/d32/d3d/d4b/d33/d37/d50/d4d/d58/da8 0 2024-01-31T05:13:15.752 INFO:tasks.workunit.client.0.smithi099.stdout:8/635: dwrite d1/dd/dba/d19/d21/d3c/fc6 [0,4194304] 0 2024-01-31T05:13:15.752 INFO:tasks.workunit.client.0.smithi099.stdout:8/636: write d1/dd/dba/d19/f6d [1116626,87269] 0 2024-01-31T05:13:15.753 INFO:tasks.workunit.client.0.smithi099.stdout:9/595: dread d0/d3e/d87/dc9/d24/d48/f9f [0,4194304] 0 2024-01-31T05:13:15.753 INFO:tasks.workunit.client.0.smithi099.stdout:9/596: dread - d0/d3e/d87/dc9/d24/d48/f7a zero size 2024-01-31T05:13:15.753 INFO:tasks.workunit.client.0.smithi099.stdout:9/597: write d0/d5d/db6/fc5 [697683,6867] 0 2024-01-31T05:13:15.753 INFO:tasks.workunit.client.0.smithi099.stdout:9/598: fsync d0/d3e/d87/dc9/d24/fa1 0 2024-01-31T05:13:15.754 INFO:tasks.workunit.client.0.smithi099.stdout:3/595: getdents d10/d32/d85/da3 0 2024-01-31T05:13:15.754 INFO:tasks.workunit.client.0.smithi099.stdout:5/564: dwrite d6/da/d14/fb3 [0,4194304] 0 2024-01-31T05:13:15.755 INFO:tasks.workunit.client.0.smithi099.stdout:8/637: mknod d1/da6/cd3 0 2024-01-31T05:13:15.756 INFO:tasks.workunit.client.0.smithi099.stdout:9/599: rmdir d0/d3e/d87/dc9/d24/d2b/d7b 39 2024-01-31T05:13:15.760 INFO:tasks.workunit.client.0.smithi099.stdout:4/667: link d0/d2/d4b/d93/d17/d3d/fb7 d0/d1e/d61/fe2 0 2024-01-31T05:13:15.762 INFO:tasks.workunit.client.0.smithi099.stdout:1/516: sync 2024-01-31T05:13:15.765 INFO:tasks.workunit.client.0.smithi099.stdout:5/565: rename d6/da/d14/d3d/d51/d82/l47 to d6/da/d3f/d73/lbf 0 2024-01-31T05:13:15.765 INFO:tasks.workunit.client.0.smithi099.stdout:7/533: dread d6/ff [0,4194304] 0 2024-01-31T05:13:15.767 INFO:tasks.workunit.client.0.smithi099.stdout:8/638: mkdir d1/dd/d65/d7f/d81/dd4 0 2024-01-31T05:13:15.767 INFO:tasks.workunit.client.0.smithi099.stdout:8/639: readlink d1/l8e 0 2024-01-31T05:13:15.768 INFO:tasks.workunit.client.0.smithi099.stdout:9/600: mknod d0/d3e/d87/dc9/d5e/d72/dbf/ccf 0 2024-01-31T05:13:15.769 INFO:tasks.workunit.client.0.smithi099.stdout:3/596: mknod d10/d27/d34/d44/d60/d75/d8c/db6/cd8 0 2024-01-31T05:13:15.770 INFO:tasks.workunit.client.0.smithi099.stdout:9/601: dread d0/d3e/d87/dc9/d24/d48/f9f [0,4194304] 0 2024-01-31T05:13:15.772 INFO:tasks.workunit.client.0.smithi099.stdout:4/668: creat d0/d2/d4b/d93/d17/d24/d3f/d43/fe3 x:0 0 0 2024-01-31T05:13:15.774 INFO:tasks.workunit.client.0.smithi099.stdout:5/566: truncate d6/da/d14/d3d/f53 3252759 0 2024-01-31T05:13:15.775 INFO:tasks.workunit.client.0.smithi099.stdout:8/640: link d1/dd/dba/d19/d21/d3c/l52 d1/dd/d7b/ld5 0 2024-01-31T05:13:15.778 INFO:tasks.workunit.client.0.smithi099.stdout:8/641: dread d1/f5e [0,4194304] 0 2024-01-31T05:13:15.778 INFO:tasks.workunit.client.0.smithi099.stdout:8/642: write d1/dd/dba/da9/fb7 [418762,50419] 0 2024-01-31T05:13:15.778 INFO:tasks.workunit.client.0.smithi099.stdout:8/643: chown d1/dd/dba/d29/d3f/d56/da0/d2e/fb1 57221 1 2024-01-31T05:13:15.778 INFO:tasks.workunit.client.0.smithi099.stdout:4/669: unlink d0/d2/d4b/d93/d39/l96 0 2024-01-31T05:13:15.779 INFO:tasks.workunit.client.0.smithi099.stdout:5/567: mknod d6/da/d14/d3d/d57/d92/cc0 0 2024-01-31T05:13:15.779 INFO:tasks.workunit.client.0.smithi099.stdout:5/568: creat d6/da/d14/d3d/d8c/fc1 x:0 0 0 2024-01-31T05:13:15.780 INFO:tasks.workunit.client.0.smithi099.stdout:7/534: getdents d6/d32/d3d/d4b/d33/d37/d50/d25/d7a 0 2024-01-31T05:13:15.782 INFO:tasks.workunit.client.0.smithi099.stdout:3/597: link d10/fc2 d10/d27/d34/d44/d60/d75/d8c/db0/fd9 0 2024-01-31T05:13:15.783 INFO:tasks.workunit.client.0.smithi099.stdout:8/644: link d1/dd/dba/d19/dc5/l63 d1/dd/d1d/ld6 0 2024-01-31T05:13:15.786 INFO:tasks.workunit.client.0.smithi099.stdout:7/535: mknod d6/d32/ca9 0 2024-01-31T05:13:15.789 INFO:tasks.workunit.client.0.smithi099.stdout:8/645: creat d1/dd/dba/d29/d3f/fd7 x:0 0 0 2024-01-31T05:13:15.790 INFO:tasks.workunit.client.0.smithi099.stdout:4/670: dread d0/d8/d19/d98/d9b/dab/f6b [0,4194304] 0 2024-01-31T05:13:15.790 INFO:tasks.workunit.client.0.smithi099.stdout:4/671: write d0/d8/fa1 [70186,21301] 0 2024-01-31T05:13:15.791 INFO:tasks.workunit.client.0.smithi099.stdout:3/598: mknod d10/d27/cda 0 2024-01-31T05:13:15.792 INFO:tasks.workunit.client.0.smithi099.stdout:8/646: symlink d1/dd/d4f/d51/d83/ld8 0 2024-01-31T05:13:15.792 INFO:tasks.workunit.client.0.smithi099.stdout:8/647: chown d1/dd/d7b/ca1 1788 1 2024-01-31T05:13:15.793 INFO:tasks.workunit.client.0.smithi099.stdout:8/648: unlink d1/dd/dba/d19/dc5/lb9 0 2024-01-31T05:13:15.794 INFO:tasks.workunit.client.0.smithi099.stdout:6/477: sync 2024-01-31T05:13:15.794 INFO:tasks.workunit.client.0.smithi099.stdout:0/626: sync 2024-01-31T05:13:15.794 INFO:tasks.workunit.client.0.smithi099.stdout:2/567: sync 2024-01-31T05:13:15.794 INFO:tasks.workunit.client.0.smithi099.stdout:2/568: write d10/d1c/fa3 [624771,5355] 0 2024-01-31T05:13:15.794 INFO:tasks.workunit.client.0.smithi099.stdout:0/627: write d1/d16/f5a [923554,68036] 0 2024-01-31T05:13:15.795 INFO:tasks.workunit.client.0.smithi099.stdout:0/628: creat d1/d37/d4a/d7a/fdf x:0 0 0 2024-01-31T05:13:15.795 INFO:tasks.workunit.client.0.smithi099.stdout:0/629: dread - d1/d16/d36/d8b/fd4 zero size 2024-01-31T05:13:15.796 INFO:tasks.workunit.client.0.smithi099.stdout:2/569: rename d10/d1b/d4d/fb7 to d10/d1b/d7d/d7a/fbd 0 2024-01-31T05:13:15.797 INFO:tasks.workunit.client.0.smithi099.stdout:6/478: mkdir d14/d18/d52/d7e/d1c/d29/d94 0 2024-01-31T05:13:15.797 INFO:tasks.workunit.client.0.smithi099.stdout:0/630: truncate d1/d8/f65 3853822 0 2024-01-31T05:13:15.799 INFO:tasks.workunit.client.0.smithi099.stdout:2/570: truncate d10/d1c/f85 528351 0 2024-01-31T05:13:15.799 INFO:tasks.workunit.client.0.smithi099.stdout:2/571: dread - d10/d1b/d4d/fb3 zero size 2024-01-31T05:13:15.799 INFO:tasks.workunit.client.0.smithi099.stdout:2/572: readlink d10/d1b/l27 0 2024-01-31T05:13:15.800 INFO:tasks.workunit.client.0.smithi099.stdout:6/479: creat d14/d18/d3b/d7b/f95 x:0 0 0 2024-01-31T05:13:15.800 INFO:tasks.workunit.client.0.smithi099.stdout:6/480: creat d14/d18/f96 x:0 0 0 2024-01-31T05:13:15.801 INFO:tasks.workunit.client.0.smithi099.stdout:7/536: read d6/d32/f5b [601790,31276] 0 2024-01-31T05:13:15.803 INFO:tasks.workunit.client.0.smithi099.stdout:2/573: mknod d10/d3a/d69/d82/cbe 0 2024-01-31T05:13:15.803 INFO:tasks.workunit.client.0.smithi099.stdout:3/599: dread d10/d27/d34/d52/fa0 [0,4194304] 0 2024-01-31T05:13:15.804 INFO:tasks.workunit.client.0.smithi099.stdout:2/574: mkdir d10/d1b/d7d/d7a/dad/dbf 0 2024-01-31T05:13:15.805 INFO:tasks.workunit.client.0.smithi099.stdout:6/481: symlink d14/d18/d3b/l97 0 2024-01-31T05:13:15.805 INFO:tasks.workunit.client.0.smithi099.stdout:6/482: chown d14/f16 0 1 2024-01-31T05:13:15.805 INFO:tasks.workunit.client.0.smithi099.stdout:6/483: chown d14/d18/d52/d7e/d1c/f75 28 1 2024-01-31T05:13:15.805 INFO:tasks.workunit.client.0.smithi099.stdout:2/575: dread d10/d1b/d4d/fa9 [0,4194304] 0 2024-01-31T05:13:15.806 INFO:tasks.workunit.client.0.smithi099.stdout:7/537: symlink d6/d32/d3d/d4b/d33/d37/d50/d25/d43/laa 0 2024-01-31T05:13:15.806 INFO:tasks.workunit.client.0.smithi099.stdout:6/484: symlink d14/d18/d52/d22/l98 0 2024-01-31T05:13:15.808 INFO:tasks.workunit.client.0.smithi099.stdout:6/485: mkdir d14/d18/d52/d7e/d66/d99 0 2024-01-31T05:13:15.808 INFO:tasks.workunit.client.0.smithi099.stdout:5/569: dwrite d6/da/d14/d61/d98/fbc [0,4194304] 0 2024-01-31T05:13:15.809 INFO:tasks.workunit.client.0.smithi099.stdout:6/486: mkdir d14/d18/d52/d90/d9a 0 2024-01-31T05:13:15.810 INFO:tasks.workunit.client.0.smithi099.stdout:3/600: creat d10/d27/d34/d44/d60/d75/d8c/d92/fdb x:0 0 0 2024-01-31T05:13:15.810 INFO:tasks.workunit.client.0.smithi099.stdout:3/601: stat d10/d27/cda 0 2024-01-31T05:13:15.810 INFO:tasks.workunit.client.0.smithi099.stdout:3/602: fsync d10/d27/f6b 0 2024-01-31T05:13:15.811 INFO:tasks.workunit.client.0.smithi099.stdout:3/603: chown d10/d32/d33/l8b 118166 1 2024-01-31T05:13:15.812 INFO:tasks.workunit.client.0.smithi099.stdout:7/538: dread d6/d32/d3d/f60 [4194304,4194304] 0 2024-01-31T05:13:15.812 INFO:tasks.workunit.client.0.smithi099.stdout:7/539: creat d6/d32/d3d/d46/fab x:0 0 0 2024-01-31T05:13:15.816 INFO:tasks.workunit.client.0.smithi099.stdout:5/570: symlink d6/da/d14/d3d/d8c/d99/lc2 0 2024-01-31T05:13:15.820 INFO:tasks.workunit.client.0.smithi099.stdout:5/571: rename d6/l66 to d6/da/d14/d3d/d51/dae/db0/lc3 0 2024-01-31T05:13:15.820 INFO:tasks.workunit.client.0.smithi099.stdout:5/572: chown d6/da/l5d 574519 1 2024-01-31T05:13:15.820 INFO:tasks.workunit.client.0.smithi099.stdout:5/573: chown d6/da/d14/d3d/d51/dae 59595 1 2024-01-31T05:13:15.820 INFO:tasks.workunit.client.0.smithi099.stdout:5/574: stat d6/da/d14/d3d/d8c/d99/cbd 0 2024-01-31T05:13:15.821 INFO:tasks.workunit.client.0.smithi099.stdout:3/604: truncate d10/d27/d34/d44/d60/d75/d8c/f9f 1105734 0 2024-01-31T05:13:15.821 INFO:tasks.workunit.client.0.smithi099.stdout:2/576: write d10/d1b/f73 [2077598,4051] 0 2024-01-31T05:13:15.821 INFO:tasks.workunit.client.0.smithi099.stdout:2/577: dread - d10/d2b/fb2 zero size 2024-01-31T05:13:15.821 INFO:tasks.workunit.client.0.smithi099.stdout:2/578: chown d10/d1b/d9b 145107 1 2024-01-31T05:13:15.822 INFO:tasks.workunit.client.0.smithi099.stdout:2/579: write d10/f31 [3838244,121450] 0 2024-01-31T05:13:15.822 INFO:tasks.workunit.client.0.smithi099.stdout:4/672: dwrite d0/d2/d4b/d93/d17/d3d/faa [0,4194304] 0 2024-01-31T05:13:15.823 INFO:tasks.workunit.client.0.smithi099.stdout:2/580: dread d10/d1b/f6f [0,4194304] 0 2024-01-31T05:13:15.823 INFO:tasks.workunit.client.0.smithi099.stdout:3/605: unlink d10/f8f 0 2024-01-31T05:13:15.823 INFO:tasks.workunit.client.0.smithi099.stdout:2/581: chown d10/d1b/c8a 8 1 2024-01-31T05:13:15.823 INFO:tasks.workunit.client.0.smithi099.stdout:2/582: fsync d10/d20/f89 0 2024-01-31T05:13:15.823 INFO:tasks.workunit.client.0.smithi099.stdout:2/583: dread - d10/d2b/d97/fb9 zero size 2024-01-31T05:13:15.836 INFO:tasks.workunit.client.0.smithi099.stdout:5/575: dread d6/f13 [0,4194304] 0 2024-01-31T05:13:15.836 INFO:tasks.workunit.client.0.smithi099.stdout:5/576: fdatasync d6/da/d14/f3b 0 2024-01-31T05:13:15.836 INFO:tasks.workunit.client.0.smithi099.stdout:5/577: readlink d6/da/d14/d3d/d6e/d21/l30 0 2024-01-31T05:13:15.836 INFO:tasks.workunit.client.0.smithi099.stdout:5/578: fsync d6/da/d14/d3d/d6e/d21/f95 0 2024-01-31T05:13:15.839 INFO:tasks.workunit.client.0.smithi099.stdout:6/487: dwrite d14/d18/d52/d7e/d1c/d29/f32 [0,4194304] 0 2024-01-31T05:13:15.839 INFO:tasks.workunit.client.0.smithi099.stdout:6/488: chown d14/d18/d52/d7e/d1c/c6b 2288 1 2024-01-31T05:13:15.841 INFO:tasks.workunit.client.0.smithi099.stdout:7/540: dwrite d6/d32/d3d/d4b/d9b/f9e [0,4194304] 0 2024-01-31T05:13:15.848 INFO:tasks.workunit.client.0.smithi099.stdout:4/673: dwrite d0/d2/d4b/d93/d17/d24/d3f/d43/fe3 [0,4194304] 0 2024-01-31T05:13:15.851 INFO:tasks.workunit.client.0.smithi099.stdout:4/674: symlink d0/d2/d4b/d93/d17/de1/le4 0 2024-01-31T05:13:15.853 INFO:tasks.workunit.client.0.smithi099.stdout:4/675: dread - d0/d2/d4b/d93/d17/d3d/fb7 zero size 2024-01-31T05:13:15.853 INFO:tasks.workunit.client.0.smithi099.stdout:4/676: fdatasync d0/d2/d20/f31 0 2024-01-31T05:13:15.853 INFO:tasks.workunit.client.0.smithi099.stdout:4/677: fsync d0/d74/fb8 0 2024-01-31T05:13:15.853 INFO:tasks.workunit.client.0.smithi099.stdout:4/678: write d0/d2/f47 [4751550,74906] 0 2024-01-31T05:13:15.856 INFO:tasks.workunit.client.0.smithi099.stdout:4/679: mkdir d0/d2/d4b/d93/de5 0 2024-01-31T05:13:15.857 INFO:tasks.workunit.client.0.smithi099.stdout:7/541: dread d6/d32/d3d/d4b/d33/d37/d50/d25/d47/f57 [0,4194304] 0 2024-01-31T05:13:15.857 INFO:tasks.workunit.client.0.smithi099.stdout:4/680: chown d0/d2/d20/d84/la2 29085 1 2024-01-31T05:13:15.858 INFO:tasks.workunit.client.0.smithi099.stdout:4/681: link d0/d8/d19/f2d d0/d2/d4b/d93/d59/d8f/dd6/fe6 0 2024-01-31T05:13:15.860 INFO:tasks.workunit.client.0.smithi099.stdout:4/682: symlink d0/d2/d4b/d93/d17/d24/d3f/d43/le7 0 2024-01-31T05:13:15.860 INFO:tasks.workunit.client.0.smithi099.stdout:4/683: chown d0/d2/f9f 108071 1 2024-01-31T05:13:15.861 INFO:tasks.workunit.client.0.smithi099.stdout:2/584: dwrite d10/d1b/d83/d86/d95/f96 [0,4194304] 0 2024-01-31T05:13:15.862 INFO:tasks.workunit.client.0.smithi099.stdout:3/606: dwrite d10/d32/d33/f61 [0,4194304] 0 2024-01-31T05:13:15.862 INFO:tasks.workunit.client.0.smithi099.stdout:7/542: truncate d6/d32/d3d/d4b/d9b/f9e 1033988 0 2024-01-31T05:13:15.862 INFO:tasks.workunit.client.0.smithi099.stdout:7/543: chown d6/d32/d3d/d4b/d33/d37/d4e/f65 4624836 1 2024-01-31T05:13:15.864 INFO:tasks.workunit.client.0.smithi099.stdout:3/607: creat d10/d32/d85/d77/fdc x:0 0 0 2024-01-31T05:13:15.864 INFO:tasks.workunit.client.0.smithi099.stdout:3/608: chown d10/d27/d34/d44/d60/cbc 2956 1 2024-01-31T05:13:15.864 INFO:tasks.workunit.client.0.smithi099.stdout:7/544: truncate d6/d32/d3d/d4b/d33/d37/d50/d4d/f84 1796495 0 2024-01-31T05:13:15.872 INFO:tasks.workunit.client.0.smithi099.stdout:6/489: rename l9 to d14/d18/d52/d7e/d1c/d29/l9b 0 2024-01-31T05:13:15.872 INFO:tasks.workunit.client.0.smithi099.stdout:6/490: chown d14/d18/d52/c48 2 1 2024-01-31T05:13:15.877 INFO:tasks.workunit.client.0.smithi099.stdout:4/684: write d0/d2/f15 [2896939,83084] 0 2024-01-31T05:13:15.879 INFO:tasks.workunit.client.0.smithi099.stdout:4/685: creat d0/d2/d4b/d93/d59/d8f/dd6/fe8 x:0 0 0 2024-01-31T05:13:15.883 INFO:tasks.workunit.client.0.smithi099.stdout:6/491: rename d14/d18/d52/l20 to d14/d18/d52/d7e/d66/d99/l9c 0 2024-01-31T05:13:15.886 INFO:tasks.workunit.client.0.smithi099.stdout:6/492: getdents d14/d18/d3b/d7b 0 2024-01-31T05:13:15.888 INFO:tasks.workunit.client.0.smithi099.stdout:6/493: mkdir d14/d18/d9d 0 2024-01-31T05:13:15.888 INFO:tasks.workunit.client.0.smithi099.stdout:6/494: truncate d14/d18/d52/d7e/d1c/d29/f76 727974 0 2024-01-31T05:13:15.891 INFO:tasks.workunit.client.0.smithi099.stdout:6/495: symlink d14/d18/d52/d7e/d1c/d29/l9e 0 2024-01-31T05:13:15.896 INFO:tasks.workunit.client.0.smithi099.stdout:7/545: dwrite d6/ff [0,4194304] 0 2024-01-31T05:13:15.897 INFO:tasks.workunit.client.0.smithi099.stdout:7/546: chown d6/d32/d3d/d4b/d33/d37/d50/l51 0 1 2024-01-31T05:13:15.898 INFO:tasks.workunit.client.0.smithi099.stdout:6/496: dread d14/d18/d52/d7e/f37 [0,4194304] 0 2024-01-31T05:13:15.899 INFO:tasks.workunit.client.0.smithi099.stdout:7/547: creat d6/d32/d3d/d4b/d33/fac x:0 0 0 2024-01-31T05:13:15.899 INFO:tasks.workunit.client.0.smithi099.stdout:2/585: dwrite d10/d1c/f39 [0,4194304] 0 2024-01-31T05:13:15.900 INFO:tasks.workunit.client.0.smithi099.stdout:6/497: link d14/d18/d52/d7e/f37 d14/d18/d52/d7e/d66/f9f 0 2024-01-31T05:13:15.900 INFO:tasks.workunit.client.0.smithi099.stdout:6/498: dread - d14/d18/d52/d7e/d1c/d29/d43/f91 zero size 2024-01-31T05:13:15.900 INFO:tasks.workunit.client.0.smithi099.stdout:7/548: mkdir d6/d32/d3d/d4b/d33/d37/d50/d4d/dad 0 2024-01-31T05:13:15.900 INFO:tasks.workunit.client.0.smithi099.stdout:7/549: chown d6/d12/f85 436460 1 2024-01-31T05:13:15.901 INFO:tasks.workunit.client.0.smithi099.stdout:7/550: getdents d6/d32 0 2024-01-31T05:13:15.901 INFO:tasks.workunit.client.0.smithi099.stdout:3/609: dwrite d10/d24/f99 [0,4194304] 0 2024-01-31T05:13:15.901 INFO:tasks.workunit.client.0.smithi099.stdout:3/610: dread - d10/d27/d34/d44/d95/fd2 zero size 2024-01-31T05:13:15.901 INFO:tasks.workunit.client.0.smithi099.stdout:6/499: rmdir d14/d18/d52/d90 39 2024-01-31T05:13:15.901 INFO:tasks.workunit.client.0.smithi099.stdout:6/500: chown d14/d18/d52/c77 2 1 2024-01-31T05:13:15.904 INFO:tasks.workunit.client.0.smithi099.stdout:3/611: rename d10/d24/d40/l45 to d10/d27/d34/d44/d60/d75/d8c/d92/ldd 0 2024-01-31T05:13:15.904 INFO:tasks.workunit.client.0.smithi099.stdout:3/612: fsync d10/d1e/f6c 0 2024-01-31T05:13:15.905 INFO:tasks.workunit.client.0.smithi099.stdout:3/613: symlink d10/d32/lde 0 2024-01-31T05:13:15.905 INFO:tasks.workunit.client.0.smithi099.stdout:3/614: creat d10/d27/d34/fdf x:0 0 0 2024-01-31T05:13:15.905 INFO:tasks.workunit.client.0.smithi099.stdout:3/615: stat d10/d32/d33/l6a 0 2024-01-31T05:13:15.908 INFO:tasks.workunit.client.0.smithi099.stdout:6/501: rename d14/d18/d52/d22/l98 to d14/d18/d52/d7e/d66/la0 0 2024-01-31T05:13:15.913 INFO:tasks.workunit.client.0.smithi099.stdout:4/686: dwrite d0/d2/d4b/d93/f94 [0,4194304] 0 2024-01-31T05:13:15.922 INFO:tasks.workunit.client.0.smithi099.stdout:2/586: truncate d10/d20/f37 1430794 0 2024-01-31T05:13:15.924 INFO:tasks.workunit.client.0.smithi099.stdout:7/551: dwrite d6/f6f [4194304,4194304] 0 2024-01-31T05:13:15.927 INFO:tasks.workunit.client.0.smithi099.stdout:7/552: rename d6/d12/f1d to d6/d32/fae 0 2024-01-31T05:13:15.928 INFO:tasks.workunit.client.0.smithi099.stdout:7/553: mkdir d6/d32/d3d/d4b/d33/d37/d50/d4d/dad/daf 0 2024-01-31T05:13:15.928 INFO:tasks.workunit.client.0.smithi099.stdout:7/554: chown d6/d32/d3d/d4b/d33/d37/d4e/fa6 1 1 2024-01-31T05:13:15.931 INFO:tasks.workunit.client.0.smithi099.stdout:7/555: rename d6/d32/d3d/d4b/d33/d37/d50/f45 to d6/d32/d3d/d4b/d33/d37/d50/d5e/fb0 0 2024-01-31T05:13:15.932 INFO:tasks.workunit.client.0.smithi099.stdout:7/556: symlink d6/d32/d3d/d4b/d33/d37/lb1 0 2024-01-31T05:13:15.932 INFO:tasks.workunit.client.0.smithi099.stdout:7/557: dread - d6/d32/d3d/d46/fab zero size 2024-01-31T05:13:15.932 INFO:tasks.workunit.client.0.smithi099.stdout:7/558: truncate d6/d32/d3d/d4b/d33/d37/f94 655918 0 2024-01-31T05:13:15.938 INFO:tasks.workunit.client.0.smithi099.stdout:6/502: link d14/d18/f93 d14/d18/d52/d7e/d1c/d29/fa1 0 2024-01-31T05:13:15.938 INFO:tasks.workunit.client.0.smithi099.stdout:6/503: write d14/d18/d52/d7e/d1c/d29/d4f/f6e [602818,85166] 0 2024-01-31T05:13:15.938 INFO:tasks.workunit.client.0.smithi099.stdout:6/504: truncate d14/d18/f96 196409 0 2024-01-31T05:13:15.939 INFO:tasks.workunit.client.0.smithi099.stdout:6/505: readlink d14/d18/d52/d7e/d1c/d29/l4d 0 2024-01-31T05:13:15.939 INFO:tasks.workunit.client.0.smithi099.stdout:6/506: truncate d14/d18/d52/d22/f88 923052 0 2024-01-31T05:13:15.940 INFO:tasks.workunit.client.0.smithi099.stdout:2/587: dread d10/d20/f89 [0,4194304] 0 2024-01-31T05:13:15.940 INFO:tasks.workunit.client.0.smithi099.stdout:3/616: dwrite d10/f19 [0,4194304] 0 2024-01-31T05:13:15.940 INFO:tasks.workunit.client.0.smithi099.stdout:4/687: dwrite d0/d8/d19/d98/fbd [0,4194304] 0 2024-01-31T05:13:15.942 INFO:tasks.workunit.client.0.smithi099.stdout:3/617: rename d10/d27/d34/d44/l58 to d10/d27/d34/d44/le0 0 2024-01-31T05:13:15.942 INFO:tasks.workunit.client.0.smithi099.stdout:7/559: write d6/d32/d3d/d4b/d33/d37/d4e/fa6 [1689714,18265] 0 2024-01-31T05:13:15.942 INFO:tasks.workunit.client.0.smithi099.stdout:7/560: stat d6/d32/d3d/d4b/d33/d37 0 2024-01-31T05:13:15.950 INFO:tasks.workunit.client.0.smithi099.stdout:2/588: dread d10/d20/f89 [0,4194304] 0 2024-01-31T05:13:15.950 INFO:tasks.workunit.client.0.smithi099.stdout:2/589: fdatasync d10/f31 0 2024-01-31T05:13:15.950 INFO:tasks.workunit.client.0.smithi099.stdout:4/688: symlink d0/d8/d19/d98/d9b/dab/le9 0 2024-01-31T05:13:15.951 INFO:tasks.workunit.client.0.smithi099.stdout:3/618: getdents d10/d32/d33 0 2024-01-31T05:13:15.951 INFO:tasks.workunit.client.0.smithi099.stdout:2/590: creat d10/d1b/d4d/d5a/fc0 x:0 0 0 2024-01-31T05:13:15.951 INFO:tasks.workunit.client.0.smithi099.stdout:2/591: truncate d10/d1c/f85 554403 0 2024-01-31T05:13:15.952 INFO:tasks.workunit.client.0.smithi099.stdout:7/561: rmdir d6/d32/d3d/d4b/d9b 39 2024-01-31T05:13:15.952 INFO:tasks.workunit.client.0.smithi099.stdout:7/562: fdatasync d6/d32/d3d/d4b/d33/d37/d4e/f55 0 2024-01-31T05:13:15.954 INFO:tasks.workunit.client.0.smithi099.stdout:3/619: unlink d10/d27/d34/d52/c70 0 2024-01-31T05:13:15.954 INFO:tasks.workunit.client.0.smithi099.stdout:4/689: read d0/d1e/f35 [1021170,39415] 0 2024-01-31T05:13:15.955 INFO:tasks.workunit.client.0.smithi099.stdout:3/620: mknod d10/d27/d34/d50/ce1 0 2024-01-31T05:13:15.955 INFO:tasks.workunit.client.0.smithi099.stdout:7/563: fdatasync d6/d32/d3d/d4b/d33/d37/d50/d25/d72/d8e/f96 0 2024-01-31T05:13:15.956 INFO:tasks.workunit.client.0.smithi099.stdout:3/621: rmdir d10/d24/d40 39 2024-01-31T05:13:15.956 INFO:tasks.workunit.client.0.smithi099.stdout:7/564: mknod d6/d32/d3d/d4b/d33/d37/d50/d4d/dad/cb2 0 2024-01-31T05:13:15.957 INFO:tasks.workunit.client.0.smithi099.stdout:3/622: readlink d10/d27/d34/d44/d60/d75/d8c/la4 0 2024-01-31T05:13:15.958 INFO:tasks.workunit.client.0.smithi099.stdout:7/565: mknod d6/d32/d3d/d46/cb3 0 2024-01-31T05:13:15.958 INFO:tasks.workunit.client.0.smithi099.stdout:7/566: write d6/d32/d3d/d4b/d33/d37/d50/d4d/f93 [1036963,24541] 0 2024-01-31T05:13:15.959 INFO:tasks.workunit.client.0.smithi099.stdout:7/567: truncate d6/d32/d3d/d4b/d33/d37/d50/d25/d47/f57 1940070 0 2024-01-31T05:13:15.963 INFO:tasks.workunit.client.0.smithi099.stdout:6/507: dwrite d14/d18/d52/d7e/d1c/f5f [4194304,4194304] 0 2024-01-31T05:13:15.963 INFO:tasks.workunit.client.0.smithi099.stdout:6/508: chown d14/d18/f93 209 1 2024-01-31T05:13:15.963 INFO:tasks.workunit.client.0.smithi099.stdout:6/509: chown d14/d18/d52/d7e/f37 30609776 1 2024-01-31T05:13:15.963 INFO:tasks.workunit.client.0.smithi099.stdout:6/510: truncate d14/d18/d3b/d7b/f95 612691 0 2024-01-31T05:13:15.971 INFO:tasks.workunit.client.0.smithi099.stdout:1/517: sync 2024-01-31T05:13:15.987 INFO:tasks.workunit.client.0.smithi099.stdout:5/579: sync 2024-01-31T05:13:15.987 INFO:tasks.workunit.client.0.smithi099.stdout:9/602: sync 2024-01-31T05:13:15.987 INFO:tasks.workunit.client.0.smithi099.stdout:0/631: sync 2024-01-31T05:13:15.987 INFO:tasks.workunit.client.0.smithi099.stdout:8/649: sync 2024-01-31T05:13:15.987 INFO:tasks.workunit.client.0.smithi099.stdout:5/580: dread - d6/da/d14/d94/f8d zero size 2024-01-31T05:13:15.987 INFO:tasks.workunit.client.0.smithi099.stdout:2/592: dwrite d10/d1b/d7d/d7a/fb0 [0,4194304] 0 2024-01-31T05:13:15.987 INFO:tasks.workunit.client.0.smithi099.stdout:2/593: readlink d10/d1b/d4d/l80 0 2024-01-31T05:13:15.987 INFO:tasks.workunit.client.0.smithi099.stdout:2/594: fsync d10/f11 0 2024-01-31T05:13:15.988 INFO:tasks.workunit.client.0.smithi099.stdout:4/690: dwrite d0/d2/d4b/d93/d39/fcd [0,4194304] 0 2024-01-31T05:13:15.989 INFO:tasks.workunit.client.0.smithi099.stdout:9/603: creat d0/d3e/d33/d8a/fd0 x:0 0 0 2024-01-31T05:13:15.992 INFO:tasks.workunit.client.0.smithi099.stdout:9/604: mkdir d0/d3e/d87/dc9/d5e/d72/dbf/dd1 0 2024-01-31T05:13:15.993 INFO:tasks.workunit.client.0.smithi099.stdout:4/691: getdents d0/d2/d4b/d93/d39 0 2024-01-31T05:13:15.994 INFO:tasks.workunit.client.0.smithi099.stdout:9/605: mkdir d0/d7/dd2 0 2024-01-31T05:13:15.995 INFO:tasks.workunit.client.0.smithi099.stdout:4/692: stat d0/d2/d4b/d93/c4c 0 2024-01-31T05:13:15.996 INFO:tasks.workunit.client.0.smithi099.stdout:9/606: mknod d0/d3e/d87/cd3 0 2024-01-31T05:13:15.997 INFO:tasks.workunit.client.0.smithi099.stdout:9/607: write d0/d7/f14 [1631618,124786] 0 2024-01-31T05:13:15.999 INFO:tasks.workunit.client.0.smithi099.stdout:6/511: link d14/d18/f93 d14/d18/d52/d46/fa2 0 2024-01-31T05:13:16.003 INFO:tasks.workunit.client.0.smithi099.stdout:1/518: dwrite d4/dc/d55/f95 [4194304,4194304] 0 2024-01-31T05:13:16.004 INFO:tasks.workunit.client.0.smithi099.stdout:0/632: write d1/d37/f93 [3401229,27667] 0 2024-01-31T05:13:16.004 INFO:tasks.workunit.client.0.smithi099.stdout:3/623: dwrite d10/d32/d85/f1d [0,4194304] 0 2024-01-31T05:13:16.004 INFO:tasks.workunit.client.0.smithi099.stdout:3/624: write d10/d72/f9c [580171,72258] 0 2024-01-31T05:13:16.006 INFO:tasks.workunit.client.0.smithi099.stdout:7/568: dwrite d6/d32/d3d/d4b/d33/d37/d4e/f65 [0,4194304] 0 2024-01-31T05:13:16.006 INFO:tasks.workunit.client.0.smithi099.stdout:7/569: write d6/d32/d3d/d4b/d33/d37/f94 [1524046,47270] 0 2024-01-31T05:13:16.006 INFO:tasks.workunit.client.0.smithi099.stdout:7/570: getdents d6/d32/d3d/d4b/d33/d37/d50/d4d/dad/daf 0 2024-01-31T05:13:16.010 INFO:tasks.workunit.client.0.smithi099.stdout:6/512: dread d14/d18/f6c [0,4194304] 0 2024-01-31T05:13:16.010 INFO:tasks.workunit.client.0.smithi099.stdout:6/513: write d14/d18/f96 [539636,56569] 0 2024-01-31T05:13:16.014 INFO:tasks.workunit.client.0.smithi099.stdout:4/693: dread d0/d2/d4b/d93/f94 [0,4194304] 0 2024-01-31T05:13:16.014 INFO:tasks.workunit.client.0.smithi099.stdout:6/514: mkdir d14/d18/d52/d7e/d1c/d29/d94/da3 0 2024-01-31T05:13:16.015 INFO:tasks.workunit.client.0.smithi099.stdout:6/515: readlink d14/d18/d52/l5c 0 2024-01-31T05:13:16.015 INFO:tasks.workunit.client.0.smithi099.stdout:4/694: chown d0/d2/cf 9568 1 2024-01-31T05:13:16.015 INFO:tasks.workunit.client.0.smithi099.stdout:4/695: read - d0/d8/d19/d98/d9b/dab/fd9 zero size 2024-01-31T05:13:16.015 INFO:tasks.workunit.client.0.smithi099.stdout:3/625: read d10/d1e/da2/fcb [1552223,34988] 0 2024-01-31T05:13:16.015 INFO:tasks.workunit.client.0.smithi099.stdout:3/626: dread - d10/d27/d34/fd5 zero size 2024-01-31T05:13:16.018 INFO:tasks.workunit.client.0.smithi099.stdout:5/581: dwrite d6/da/d14/d3d/d6e/d21/f95 [0,4194304] 0 2024-01-31T05:13:16.025 INFO:tasks.workunit.client.0.smithi099.stdout:2/595: dread d10/d1b/f73 [0,4194304] 0 2024-01-31T05:13:16.037 INFO:tasks.workunit.client.0.smithi099.stdout:2/596: write d10/d1b/d7d/d7a/fb0 [1039278,4841] 0 2024-01-31T05:13:16.050 INFO:tasks.workunit.client.0.smithi099.stdout:1/519: rename d4/dc/d29/c30 to d4/dc/d4d/d5d/d87/d56/d83/c9e 0 2024-01-31T05:13:16.057 INFO:tasks.workunit.client.0.smithi099.stdout:0/633: creat d1/d37/d73/db7/fe0 x:0 0 0 2024-01-31T05:13:16.071 INFO:tasks.workunit.client.0.smithi099.stdout:6/516: creat d14/d18/d3b/d7b/fa4 x:0 0 0 2024-01-31T05:13:16.072 INFO:tasks.workunit.client.0.smithi099.stdout:4/696: mkdir d0/d2/d20/dea 0 2024-01-31T05:13:16.072 INFO:tasks.workunit.client.0.smithi099.stdout:4/697: truncate d0/d8/faf 1377066 0 2024-01-31T05:13:16.072 INFO:tasks.workunit.client.0.smithi099.stdout:6/517: creat d14/d18/d52/d7e/d1c/fa5 x:0 0 0 2024-01-31T05:13:16.072 INFO:tasks.workunit.client.0.smithi099.stdout:3/627: fsync d10/d27/f30 0 2024-01-31T05:13:16.073 INFO:tasks.workunit.client.0.smithi099.stdout:3/628: creat d10/d32/d85/d77/fe2 x:0 0 0 2024-01-31T05:13:16.073 INFO:tasks.workunit.client.0.smithi099.stdout:5/582: mknod d6/da/d3f/d5a/d81/cc4 0 2024-01-31T05:13:16.076 INFO:tasks.workunit.client.0.smithi099.stdout:7/571: rename d6/d32/fae to d6/d32/d3d/d4b/d33/d37/d50/d25/d72/fb4 0 2024-01-31T05:13:16.076 INFO:tasks.workunit.client.0.smithi099.stdout:7/572: stat d6/f6f 0 2024-01-31T05:13:16.078 INFO:tasks.workunit.client.0.smithi099.stdout:1/520: dwrite d4/dc/d29/f7c [0,4194304] 0 2024-01-31T05:13:16.079 INFO:tasks.workunit.client.0.smithi099.stdout:0/634: creat d1/d30/d45/d66/d97/fe1 x:0 0 0 2024-01-31T05:13:16.079 INFO:tasks.workunit.client.0.smithi099.stdout:0/635: fsync d1/d37/d4a/faa 0 2024-01-31T05:13:16.083 INFO:tasks.workunit.client.0.smithi099.stdout:4/698: read d0/f60 [1842972,57061] 0 2024-01-31T05:13:16.083 INFO:tasks.workunit.client.0.smithi099.stdout:4/699: chown d0/d8/d19/d54/ldf 63282188 1 2024-01-31T05:13:16.088 INFO:tasks.workunit.client.0.smithi099.stdout:6/518: dread - d14/d18/d52/d7e/d1c/d29/fa1 zero size 2024-01-31T05:13:16.095 INFO:tasks.workunit.client.0.smithi099.stdout:5/583: symlink d6/da/d14/d3d/d8c/d99/lc5 0 2024-01-31T05:13:16.096 INFO:tasks.workunit.client.0.smithi099.stdout:7/573: symlink d6/d32/d3d/d4b/d33/d37/lb5 0 2024-01-31T05:13:16.116 INFO:tasks.workunit.client.0.smithi099.stdout:0/636: truncate d1/f80 7645184 0 2024-01-31T05:13:16.118 INFO:tasks.workunit.client.0.smithi099.stdout:1/521: rmdir d4/dc 39 2024-01-31T05:13:16.121 INFO:tasks.workunit.client.0.smithi099.stdout:0/637: creat d1/d16/d36/fe2 x:0 0 0 2024-01-31T05:13:16.121 INFO:tasks.workunit.client.0.smithi099.stdout:0/638: chown d1/d8/c59 213049 1 2024-01-31T05:13:16.121 INFO:tasks.workunit.client.0.smithi099.stdout:0/639: fsync d1/d37/f87 0 2024-01-31T05:13:16.122 INFO:tasks.workunit.client.0.smithi099.stdout:0/640: fsync d1/d30/d45/dad/f94 0 2024-01-31T05:13:16.122 INFO:tasks.workunit.client.0.smithi099.stdout:0/641: creat d1/d37/d4a/fe3 x:0 0 0 2024-01-31T05:13:16.122 INFO:tasks.workunit.client.0.smithi099.stdout:0/642: chown d1/d37/d73/db7 3 1 2024-01-31T05:13:16.122 INFO:tasks.workunit.client.0.smithi099.stdout:6/519: mkdir d14/d18/d52/d7e/d1c/da6 0 2024-01-31T05:13:16.122 INFO:tasks.workunit.client.0.smithi099.stdout:2/597: fdatasync d10/d3a/d69/fbc 0 2024-01-31T05:13:16.122 INFO:tasks.workunit.client.0.smithi099.stdout:8/650: sync 2024-01-31T05:13:16.122 INFO:tasks.workunit.client.0.smithi099.stdout:8/651: write d1/dd/fa7 [915655,15529] 0 2024-01-31T05:13:16.123 INFO:tasks.workunit.client.0.smithi099.stdout:6/520: rename d14/d18/d52/d46/l7f to d14/d18/d52/d22/la7 0 2024-01-31T05:13:16.123 INFO:tasks.workunit.client.0.smithi099.stdout:6/521: chown d14/d18/d52/d7e/d1c/d29/d4f/f89 239 1 2024-01-31T05:13:16.125 INFO:tasks.workunit.client.0.smithi099.stdout:6/522: mknod d14/d18/d52/d7e/ca8 0 2024-01-31T05:13:16.125 INFO:tasks.workunit.client.0.smithi099.stdout:6/523: getdents d14/d18/d52/d7e/d1c/d29/d79 0 2024-01-31T05:13:16.125 INFO:tasks.workunit.client.0.smithi099.stdout:6/524: dread - d14/d18/d52/d46/f8d zero size 2024-01-31T05:13:16.125 INFO:tasks.workunit.client.0.smithi099.stdout:6/525: truncate d14/d18/d3b/f6f 804960 0 2024-01-31T05:13:16.125 INFO:tasks.workunit.client.0.smithi099.stdout:6/526: stat d14/c19 0 2024-01-31T05:13:16.125 INFO:tasks.workunit.client.0.smithi099.stdout:8/652: mknod d1/dd/d1d/cd9 0 2024-01-31T05:13:16.125 INFO:tasks.workunit.client.0.smithi099.stdout:9/608: sync 2024-01-31T05:13:16.125 INFO:tasks.workunit.client.0.smithi099.stdout:9/609: chown d0/cd 2080356 1 2024-01-31T05:13:16.125 INFO:tasks.workunit.client.0.smithi099.stdout:9/610: creat d0/d3e/d33/dab/fd4 x:0 0 0 2024-01-31T05:13:16.125 INFO:tasks.workunit.client.0.smithi099.stdout:9/611: chown d0/d3e/d87/dc9/d24/d2b/d7b/fa4 0 1 2024-01-31T05:13:16.125 INFO:tasks.workunit.client.0.smithi099.stdout:9/612: readlink d0/d3e/d87/dc9/l7d 0 2024-01-31T05:13:16.127 INFO:tasks.workunit.client.0.smithi099.stdout:3/629: dwrite d10/d27/d34/d44/d60/d75/d8c/faa [0,4194304] 0 2024-01-31T05:13:16.127 INFO:tasks.workunit.client.0.smithi099.stdout:7/574: dwrite d6/d32/d3d/d4b/f23 [0,4194304] 0 2024-01-31T05:13:16.127 INFO:tasks.workunit.client.0.smithi099.stdout:7/575: rename d6 to d6/d32/d3d/d4b/d33/d37/d50/d25/d72/d8e/db6 22 2024-01-31T05:13:16.127 INFO:tasks.workunit.client.0.smithi099.stdout:7/576: chown d6/d32/d3d/d4b/d33/d37/d50/d25/d7a/l95 110101 1 2024-01-31T05:13:16.128 INFO:tasks.workunit.client.0.smithi099.stdout:8/653: getdents d1/dd/dba/d29/d3f/d56/da0 0 2024-01-31T05:13:16.131 INFO:tasks.workunit.client.0.smithi099.stdout:9/613: truncate d0/d3e/d87/dc9/d24/f69 3287492 0 2024-01-31T05:13:16.131 INFO:tasks.workunit.client.0.smithi099.stdout:9/614: readlink d0/d3e/d87/dc9/d24/l4d 0 2024-01-31T05:13:16.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:15 smithi179 ceph-mon[35652]: pgmap v405: 97 pgs: 97 active+clean; 775 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 101 MiB/s rd, 128 MiB/s wr, 1.37k op/s 2024-01-31T05:13:16.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:15 smithi179 ceph-mon[35652]: mds.? [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] up:active 2024-01-31T05:13:16.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:15 smithi179 ceph-mon[35652]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:13:16.132 INFO:tasks.workunit.client.0.smithi099.stdout:3/630: mknod d10/d32/d85/da3/ce3 0 2024-01-31T05:13:16.135 INFO:tasks.workunit.client.0.smithi099.stdout:7/577: rename d6/d32/d3d/d46/la7 to d6/d32/d3d/d4b/d33/d37/d50/d25/d72/lb7 0 2024-01-31T05:13:16.140 INFO:tasks.workunit.client.0.smithi099.stdout:9/615: link d0/d3e/d87/dc9/d24/d2b/d7b/f9d d0/d7/dd2/fd5 0 2024-01-31T05:13:16.141 INFO:tasks.workunit.client.0.smithi099.stdout:8/654: creat d1/dd/dba/d19/fda x:0 0 0 2024-01-31T05:13:16.141 INFO:tasks.workunit.client.0.smithi099.stdout:9/616: read - d0/d3e/f8b zero size 2024-01-31T05:13:16.141 INFO:tasks.workunit.client.0.smithi099.stdout:8/655: chown d1/dd/dba/d19/d21/d3c/fc6 56852 1 2024-01-31T05:13:16.145 INFO:tasks.workunit.client.0.smithi099.stdout:9/617: creat d0/d3e/d87/dc9/d24/d2b/d7b/fd6 x:0 0 0 2024-01-31T05:13:16.148 INFO:tasks.workunit.client.0.smithi099.stdout:8/656: creat d1/dd/dba/d19/d21/d3c/fdb x:0 0 0 2024-01-31T05:13:16.149 INFO:tasks.workunit.client.0.smithi099.stdout:3/631: mkdir d10/d24/d40/d81/de4 0 2024-01-31T05:13:16.150 INFO:tasks.workunit.client.0.smithi099.stdout:9/618: mknod d0/d3e/d87/dc9/d24/d2b/cd7 0 2024-01-31T05:13:16.152 INFO:tasks.workunit.client.0.smithi099.stdout:8/657: symlink d1/dd/dba/d19/dbd/ldc 0 2024-01-31T05:13:16.154 INFO:tasks.workunit.client.0.smithi099.stdout:8/658: mknod d1/dd/dba/d19/d21/cdd 0 2024-01-31T05:13:16.154 INFO:tasks.workunit.client.0.smithi099.stdout:8/659: readlink d1/dd/dba/d19/d21/laa 0 2024-01-31T05:13:16.161 INFO:tasks.workunit.client.0.smithi099.stdout:4/700: readlink d0/d2/d4b/d93/d59/d82/l97 0 2024-01-31T05:13:16.164 INFO:tasks.workunit.client.0.smithi099.stdout:6/527: dwrite d14/d18/d52/d7e/d1c/f34 [0,4194304] 0 2024-01-31T05:13:16.165 INFO:tasks.workunit.client.0.smithi099.stdout:2/598: dwrite d10/d2b/d7c/f90 [0,4194304] 0 2024-01-31T05:13:16.166 INFO:tasks.workunit.client.0.smithi099.stdout:1/522: dwrite d4/dc/d15/f7a [0,4194304] 0 2024-01-31T05:13:16.166 INFO:tasks.workunit.client.0.smithi099.stdout:1/523: stat d4/dc/d15/f6c 0 2024-01-31T05:13:16.166 INFO:tasks.workunit.client.0.smithi099.stdout:0/643: dwrite d1/d16/d36/d8b/fbf [0,4194304] 0 2024-01-31T05:13:16.166 INFO:tasks.workunit.client.0.smithi099.stdout:0/644: write d1/d16/d36/f57 [601508,77956] 0 2024-01-31T05:13:16.166 INFO:tasks.workunit.client.0.smithi099.stdout:4/701: creat d0/d8/d19/d99/d9e/feb x:0 0 0 2024-01-31T05:13:16.166 INFO:tasks.workunit.client.0.smithi099.stdout:2/599: dread - d10/d3a/d69/fa1 zero size 2024-01-31T05:13:16.166 INFO:tasks.workunit.client.0.smithi099.stdout:2/600: fdatasync f1 0 2024-01-31T05:13:16.166 INFO:tasks.workunit.client.0.smithi099.stdout:6/528: read d14/d18/d52/d22/f65 [518882,99623] 0 2024-01-31T05:13:16.168 INFO:tasks.workunit.client.0.smithi099.stdout:4/702: dread - d0/d2/d4b/d93/d17/d24/d3f/fd0 zero size 2024-01-31T05:13:16.169 INFO:tasks.workunit.client.0.smithi099.stdout:4/703: chown d0/d2/d4b/d93/d59/d8f/dd6/ddb/ldc 657010 1 2024-01-31T05:13:16.179 INFO:tasks.workunit.client.0.smithi099.stdout:7/578: dwrite d6/fa [8388608,4194304] 0 2024-01-31T05:13:16.179 INFO:tasks.workunit.client.0.smithi099.stdout:9/619: dwrite d0/d3e/d87/dc9/f9c [0,4194304] 0 2024-01-31T05:13:16.180 INFO:tasks.workunit.client.0.smithi099.stdout:1/524: creat d4/dc/d4d/d5d/d87/d56/d83/f9f x:0 0 0 2024-01-31T05:13:16.180 INFO:tasks.workunit.client.0.smithi099.stdout:1/525: write d4/dc/d4d/d5d/d87/d56/f75 [1524481,121092] 0 2024-01-31T05:13:16.181 INFO:tasks.workunit.client.0.smithi099.stdout:2/601: write d10/d1c/f55 [1089696,125499] 0 2024-01-31T05:13:16.181 INFO:tasks.workunit.client.0.smithi099.stdout:2/602: fdatasync d10/d2b/d7c/fba 0 2024-01-31T05:13:16.182 INFO:tasks.workunit.client.0.smithi099.stdout:0/645: creat d1/d37/d4a/d7a/d9d/fe4 x:0 0 0 2024-01-31T05:13:16.182 INFO:tasks.workunit.client.0.smithi099.stdout:4/704: creat d0/d2/d4b/d93/d39/fec x:0 0 0 2024-01-31T05:13:16.182 INFO:tasks.workunit.client.0.smithi099.stdout:4/705: creat d0/d8/d19/d99/d9e/fed x:0 0 0 2024-01-31T05:13:16.183 INFO:tasks.workunit.client.0.smithi099.stdout:4/706: truncate d0/d2/d4b/d93/d59/d8f/fa4 1022921 0 2024-01-31T05:13:16.184 INFO:tasks.workunit.client.0.smithi099.stdout:7/579: truncate d6/d32/d3d/f4a 3502692 0 2024-01-31T05:13:16.184 INFO:tasks.workunit.client.0.smithi099.stdout:7/580: fdatasync d6/d32/d3d/d4b/d33/d37/d4e/fa6 0 2024-01-31T05:13:16.184 INFO:tasks.workunit.client.0.smithi099.stdout:4/707: mkdir d0/d2/d4b/d93/d17/d24/d3f/dee 0 2024-01-31T05:13:16.188 INFO:tasks.workunit.client.0.smithi099.stdout:7/581: dread d6/d12/f22 [0,4194304] 0 2024-01-31T05:13:16.188 INFO:tasks.workunit.client.0.smithi099.stdout:4/708: mkdir d0/d2/d4b/d93/d17/def 0 2024-01-31T05:13:16.188 INFO:tasks.workunit.client.0.smithi099.stdout:9/620: link d0/d3e/d87/dc9/d24/d2b/d63/c67 d0/d3e/d87/dc9/d5e/d72/cd8 0 2024-01-31T05:13:16.189 INFO:tasks.workunit.client.0.smithi099.stdout:2/603: creat d10/d1c/d43/db8/fc1 x:0 0 0 2024-01-31T05:13:16.191 INFO:tasks.workunit.client.0.smithi099.stdout:4/709: dread d0/d8/faf [0,4194304] 0 2024-01-31T05:13:16.192 INFO:tasks.workunit.client.0.smithi099.stdout:0/646: mknod d1/d30/d45/dad/ce5 0 2024-01-31T05:13:16.200 INFO:tasks.workunit.client.0.smithi099.stdout:7/582: symlink d6/d12/lb8 0 2024-01-31T05:13:16.201 INFO:tasks.workunit.client.0.smithi099.stdout:9/621: mknod d0/cd9 0 2024-01-31T05:13:16.202 INFO:tasks.workunit.client.0.smithi099.stdout:4/710: symlink d0/d8/d19/d65/lf0 0 2024-01-31T05:13:16.202 INFO:tasks.workunit.client.0.smithi099.stdout:4/711: fsync d0/d1e/d61/f7c 0 2024-01-31T05:13:16.203 INFO:tasks.workunit.client.0.smithi099.stdout:0/647: mkdir d1/d37/d4a/de6 0 2024-01-31T05:13:16.204 INFO:tasks.workunit.client.0.smithi099.stdout:4/712: dread d0/d1e/fbc [0,4194304] 0 2024-01-31T05:13:16.204 INFO:tasks.workunit.client.0.smithi099.stdout:4/713: readlink d0/d8/l67 0 2024-01-31T05:13:16.204 INFO:tasks.workunit.client.0.smithi099.stdout:4/714: readlink d0/d2/d4b/d93/d39/l5e 0 2024-01-31T05:13:16.205 INFO:tasks.workunit.client.0.smithi099.stdout:2/604: write d10/d3a/d69/f8b [3071418,56681] 0 2024-01-31T05:13:16.205 INFO:tasks.workunit.client.0.smithi099.stdout:1/526: dwrite d4/dc/f43 [0,4194304] 0 2024-01-31T05:13:16.205 INFO:tasks.workunit.client.0.smithi099.stdout:1/527: chown d4/dc/d4d/l6f 64139 1 2024-01-31T05:13:16.206 INFO:tasks.workunit.client.0.smithi099.stdout:9/622: mknod d0/d3e/d87/dc9/d24/d2b/d63/da7/cda 0 2024-01-31T05:13:16.208 INFO:tasks.workunit.client.0.smithi099.stdout:4/715: getdents d0/d8/d19/d54/d76 0 2024-01-31T05:13:16.208 INFO:tasks.workunit.client.0.smithi099.stdout:4/716: truncate d0/d8/d19/f1c 836564 0 2024-01-31T05:13:16.208 INFO:tasks.workunit.client.0.smithi099.stdout:4/717: write d0/d8/d19/d99/fa0 [822551,83836] 0 2024-01-31T05:13:16.209 INFO:tasks.workunit.client.0.smithi099.stdout:2/605: mknod d10/d2b/d97/cc2 0 2024-01-31T05:13:16.210 INFO:tasks.workunit.client.0.smithi099.stdout:9/623: mkdir d0/d3e/d87/dc9/d5e/ddb 0 2024-01-31T05:13:16.212 INFO:tasks.workunit.client.0.smithi099.stdout:9/624: mknod d0/d3e/d87/dc9/d5e/d72/dbf/dd1/cdc 0 2024-01-31T05:13:16.212 INFO:tasks.workunit.client.0.smithi099.stdout:1/528: dread d4/db/d24/d4b/d50/d91/f22 [0,4194304] 0 2024-01-31T05:13:16.213 INFO:tasks.workunit.client.0.smithi099.stdout:1/529: mknod d4/dc/d15/d45/ca0 0 2024-01-31T05:13:16.222 INFO:tasks.workunit.client.0.smithi099.stdout:8/660: rename d1/dd/dba/d29/ccc to d1/dd/d65/d7f/d81/dc4/cde 0 2024-01-31T05:13:16.224 INFO:tasks.workunit.client.0.smithi099.stdout:6/529: rename d14/d18/l21 to d14/d18/d3b/d7b/la9 0 2024-01-31T05:13:16.225 INFO:tasks.workunit.client.0.smithi099.stdout:8/661: creat d1/dd/dba/d19/dbd/fdf x:0 0 0 2024-01-31T05:13:16.226 INFO:tasks.workunit.client.0.smithi099.stdout:7/583: rename d6/d32/d3d/d4b/d33/d37/d4e/c8f to d6/d32/d3d/d4b/d33/cb9 0 2024-01-31T05:13:16.227 INFO:tasks.workunit.client.0.smithi099.stdout:8/662: truncate d1/dd/dba/d19/f6d 675159 0 2024-01-31T05:13:16.229 INFO:tasks.workunit.client.0.smithi099.stdout:1/530: read d4/db/d24/d4b/f79 [2379015,62995] 0 2024-01-31T05:13:16.231 INFO:tasks.workunit.client.0.smithi099.stdout:1/531: mknod d4/db/d24/d69/ca1 0 2024-01-31T05:13:16.233 INFO:tasks.workunit.client.0.smithi099.stdout:1/532: symlink d4/db/d3a/la2 0 2024-01-31T05:13:16.235 INFO:tasks.workunit.client.0.smithi099.stdout:0/648: dwrite d1/f8f [0,4194304] 0 2024-01-31T05:13:16.235 INFO:tasks.workunit.client.0.smithi099.stdout:0/649: creat d1/d37/d4a/d6f/fe7 x:0 0 0 2024-01-31T05:13:16.241 INFO:tasks.workunit.client.0.smithi099.stdout:0/650: unlink d1/d30/l95 0 2024-01-31T05:13:16.244 INFO:tasks.workunit.client.0.smithi099.stdout:9/625: dwrite d0/d7/d2e/f43 [0,4194304] 0 2024-01-31T05:13:16.246 INFO:tasks.workunit.client.0.smithi099.stdout:9/626: creat d0/d7/fdd x:0 0 0 2024-01-31T05:13:16.246 INFO:tasks.workunit.client.0.smithi099.stdout:9/627: fsync d0/d3e/d87/dc9/d24/d2b/d63/f93 0 2024-01-31T05:13:16.246 INFO:tasks.workunit.client.0.smithi099.stdout:9/628: fdatasync d0/d3e/d87/dc9/f9c 0 2024-01-31T05:13:16.246 INFO:tasks.workunit.client.0.smithi099.stdout:9/629: rmdir d0/d3e/d87/dc9/d5e 39 2024-01-31T05:13:16.246 INFO:tasks.workunit.client.0.smithi099.stdout:9/630: write d0/d7/da6/fbc [7622,119698] 0 2024-01-31T05:13:16.247 INFO:tasks.workunit.client.0.smithi099.stdout:9/631: truncate d0/d3e/d87/dc9/d24/d2b/d63/fb7 956505 0 2024-01-31T05:13:16.253 INFO:tasks.workunit.client.0.smithi099.stdout:2/606: dwrite d10/d2b/d58/fb1 [0,4194304] 0 2024-01-31T05:13:16.253 INFO:tasks.workunit.client.0.smithi099.stdout:6/530: dwrite d14/d18/d52/d22/f80 [4194304,4194304] 0 2024-01-31T05:13:16.257 INFO:tasks.workunit.client.0.smithi099.stdout:9/632: dread d0/d5d/f91 [0,4194304] 0 2024-01-31T05:13:16.260 INFO:tasks.workunit.client.0.smithi099.stdout:2/607: unlink d10/d1c/f55 0 2024-01-31T05:13:16.260 INFO:tasks.workunit.client.0.smithi099.stdout:4/718: rename d0/d2/d20/l6e to d0/d2/d4b/d93/d86/db4/lf1 0 2024-01-31T05:13:16.261 INFO:tasks.workunit.client.0.smithi099.stdout:5/584: sync 2024-01-31T05:13:16.265 INFO:tasks.workunit.client.0.smithi099.stdout:7/584: rename d6/d32/d3d/d4b/d33/d37/d50/d4d/l87 to d6/d32/d3d/d4b/d33/d37/d4e/lba 0 2024-01-31T05:13:16.267 INFO:tasks.workunit.client.0.smithi099.stdout:5/585: unlink d6/da/d14/d3d/d6e/f42 0 2024-01-31T05:13:16.267 INFO:tasks.workunit.client.0.smithi099.stdout:5/586: readlink d6/da/d14/d3d/d6e/d21/l30 0 2024-01-31T05:13:16.267 INFO:tasks.workunit.client.0.smithi099.stdout:5/587: readlink d6/da/d14/d2b/l48 0 2024-01-31T05:13:16.267 INFO:tasks.workunit.client.0.smithi099.stdout:9/633: dread d0/d44/f4f [0,4194304] 0 2024-01-31T05:13:16.268 INFO:tasks.workunit.client.0.smithi099.stdout:3/632: sync 2024-01-31T05:13:16.268 INFO:tasks.workunit.client.0.smithi099.stdout:3/633: truncate d10/d32/f4e 5028316 0 2024-01-31T05:13:16.268 INFO:tasks.workunit.client.0.smithi099.stdout:8/663: rename d1/dd/d1d/cc1 to d1/ce0 0 2024-01-31T05:13:16.269 INFO:tasks.workunit.client.0.smithi099.stdout:2/608: write d10/f33 [3030116,12882] 0 2024-01-31T05:13:16.271 INFO:tasks.workunit.client.0.smithi099.stdout:9/634: mknod d0/d3e/cde 0 2024-01-31T05:13:16.271 INFO:tasks.workunit.client.0.smithi099.stdout:9/635: write d0/d44/f4f [4749003,36811] 0 2024-01-31T05:13:16.271 INFO:tasks.workunit.client.0.smithi099.stdout:7/585: write d6/d32/d3d/d4b/d33/d37/d50/f3e [2025,120210] 0 2024-01-31T05:13:16.271 INFO:tasks.workunit.client.0.smithi099.stdout:1/533: rename d4/dc/d4d/d5d/d87/c9c to d4/dc/d4d/d5d/ca3 0 2024-01-31T05:13:16.272 INFO:tasks.workunit.client.0.smithi099.stdout:9/636: mkdir d0/d3e/d87/dc9/d24/d2b/ddf 0 2024-01-31T05:13:16.273 INFO:tasks.workunit.client.0.smithi099.stdout:2/609: write d10/d3a/d69/d82/f98 [668715,44328] 0 2024-01-31T05:13:16.273 INFO:tasks.workunit.client.0.smithi099.stdout:2/610: chown d10/d2b/d7c/f93 2 1 2024-01-31T05:13:16.273 INFO:tasks.workunit.client.0.smithi099.stdout:0/651: rename d1/d30/d45/d66/f9b to d1/d30/fe8 0 2024-01-31T05:13:16.275 INFO:tasks.workunit.client.0.smithi099.stdout:9/637: mkdir d0/d3e/d87/dc9/d5e/de0 0 2024-01-31T05:13:16.275 INFO:tasks.workunit.client.0.smithi099.stdout:9/638: dread - d0/fc2 zero size 2024-01-31T05:13:16.275 INFO:tasks.workunit.client.0.smithi099.stdout:9/639: creat d0/d3e/d33/dab/fe1 x:0 0 0 2024-01-31T05:13:16.276 INFO:tasks.workunit.client.0.smithi099.stdout:2/611: mkdir d10/d2b/d58/dc3 0 2024-01-31T05:13:16.276 INFO:tasks.workunit.client.0.smithi099.stdout:2/612: write d10/d1b/d7d/d7a/fb0 [2127071,120698] 0 2024-01-31T05:13:16.278 INFO:tasks.workunit.client.0.smithi099.stdout:8/664: write d1/dd/d1d/f40 [2983657,69928] 0 2024-01-31T05:13:16.279 INFO:tasks.workunit.client.0.smithi099.stdout:9/640: creat d0/d3e/d87/fe2 x:0 0 0 2024-01-31T05:13:16.280 INFO:tasks.workunit.client.0.smithi099.stdout:2/613: unlink d10/d1c/l62 0 2024-01-31T05:13:16.280 INFO:tasks.workunit.client.0.smithi099.stdout:2/614: write d10/d3a/d94/fa6 [1027025,44498] 0 2024-01-31T05:13:16.281 INFO:tasks.workunit.client.0.smithi099.stdout:2/615: creat d10/d1b/d7d/d7a/dad/fc4 x:0 0 0 2024-01-31T05:13:16.281 INFO:tasks.workunit.client.0.smithi099.stdout:2/616: creat d10/d2b/d97/fc5 x:0 0 0 2024-01-31T05:13:16.282 INFO:tasks.workunit.client.0.smithi099.stdout:9/641: symlink d0/d3e/d87/dc9/d5e/d72/le3 0 2024-01-31T05:13:16.284 INFO:tasks.workunit.client.0.smithi099.stdout:2/617: creat d10/d1c/d43/fc6 x:0 0 0 2024-01-31T05:13:16.284 INFO:tasks.workunit.client.0.smithi099.stdout:2/618: creat d10/d1b/d7d/d7a/fc7 x:0 0 0 2024-01-31T05:13:16.284 INFO:tasks.workunit.client.0.smithi099.stdout:2/619: creat d10/d1c/d43/db8/fc8 x:0 0 0 2024-01-31T05:13:16.284 INFO:tasks.workunit.client.0.smithi099.stdout:2/620: truncate d10/d1b/f81 580151 0 2024-01-31T05:13:16.285 INFO:tasks.workunit.client.0.smithi099.stdout:2/621: getdents d10/d1b/d7d 0 2024-01-31T05:13:16.287 INFO:tasks.workunit.client.0.smithi099.stdout:2/622: rmdir d10/d1b/d4d/d5a 39 2024-01-31T05:13:16.290 INFO:tasks.workunit.client.0.smithi099.stdout:3/634: dwrite d10/d1e/fc1 [0,4194304] 0 2024-01-31T05:13:16.290 INFO:tasks.workunit.client.0.smithi099.stdout:2/623: unlink d10/d1b/d83/d86/d95/f96 0 2024-01-31T05:13:16.290 INFO:tasks.workunit.client.0.smithi099.stdout:2/624: creat d10/d2b/d58/fc9 x:0 0 0 2024-01-31T05:13:16.291 INFO:tasks.workunit.client.0.smithi099.stdout:3/635: write d10/d32/d85/d77/fe2 [993389,57905] 0 2024-01-31T05:13:16.291 INFO:tasks.workunit.client.0.smithi099.stdout:3/636: creat d10/d27/d34/d52/fe5 x:0 0 0 2024-01-31T05:13:16.291 INFO:tasks.workunit.client.0.smithi099.stdout:3/637: fdatasync d10/d32/d85/f22 0 2024-01-31T05:13:16.291 INFO:tasks.workunit.client.0.smithi099.stdout:3/638: readlink d10/d27/d34/d44/le0 0 2024-01-31T05:13:16.293 INFO:tasks.workunit.client.0.smithi099.stdout:7/586: dwrite d6/d32/d3d/d4b/d33/d37/d50/d25/d7a/fa3 [0,4194304] 0 2024-01-31T05:13:16.301 INFO:tasks.workunit.client.0.smithi099.stdout:3/639: unlink d10/d27/d34/d50/c7f 0 2024-01-31T05:13:16.303 INFO:tasks.workunit.client.0.smithi099.stdout:7/587: symlink d6/d32/d3d/d4b/d33/d37/d50/lbb 0 2024-01-31T05:13:16.305 INFO:tasks.workunit.client.0.smithi099.stdout:7/588: link d6/d32/d3d/f60 d6/d32/d3d/d4b/d33/d37/d50/d4d/d58/da8/fbc 0 2024-01-31T05:13:16.305 INFO:tasks.workunit.client.0.smithi099.stdout:7/589: fsync d6/d32/d3d/d4b/d33/d37/d50/d25/d72/fb4 0 2024-01-31T05:13:16.305 INFO:tasks.workunit.client.0.smithi099.stdout:3/640: write d10/d32/d85/f26 [5390075,84214] 0 2024-01-31T05:13:16.307 INFO:tasks.workunit.client.0.smithi099.stdout:0/652: rmdir d1/d37/d4a/d7a/d9d 39 2024-01-31T05:13:16.309 INFO:tasks.workunit.client.0.smithi099.stdout:7/590: symlink d6/d32/d3d/d4b/d33/d37/d50/d25/d72/d8e/lbd 0 2024-01-31T05:13:16.309 INFO:tasks.workunit.client.0.smithi099.stdout:0/653: symlink d1/d8/le9 0 2024-01-31T05:13:16.311 INFO:tasks.workunit.client.0.smithi099.stdout:7/591: creat d6/d32/d3d/d4b/d33/d37/d4e/fbe x:0 0 0 2024-01-31T05:13:16.311 INFO:tasks.workunit.client.0.smithi099.stdout:7/592: write d6/d32/d3d/d4b/d33/d37/d50/d25/f29 [5101852,110957] 0 2024-01-31T05:13:16.311 INFO:tasks.workunit.client.0.smithi099.stdout:2/625: dread d10/d1c/f39 [0,4194304] 0 2024-01-31T05:13:16.313 INFO:tasks.workunit.client.0.smithi099.stdout:7/593: rename d6/d32/d3d/d4b/d33/d37/d50/d4d/f93 to d6/d32/d3d/d4b/d33/d37/d50/d4d/fbf 0 2024-01-31T05:13:16.313 INFO:tasks.workunit.client.0.smithi099.stdout:2/626: mknod d10/d1c/cca 0 2024-01-31T05:13:16.315 INFO:tasks.workunit.client.0.smithi099.stdout:4/719: rename d0/d2/fca to d0/d2/d4b/d93/d17/d24/d3f/d43/ff2 0 2024-01-31T05:13:16.315 INFO:tasks.workunit.client.0.smithi099.stdout:4/720: fsync d0/d8/d19/f2d 0 2024-01-31T05:13:16.315 INFO:tasks.workunit.client.0.smithi099.stdout:4/721: chown d0/d8/c49 28 1 2024-01-31T05:13:16.317 INFO:tasks.workunit.client.0.smithi099.stdout:4/722: creat d0/d2/d4b/d93/d17/d7d/ff3 x:0 0 0 2024-01-31T05:13:16.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:15 smithi099 ceph-mon[31615]: pgmap v405: 97 pgs: 97 active+clean; 775 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 101 MiB/s rd, 128 MiB/s wr, 1.37k op/s 2024-01-31T05:13:16.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:15 smithi099 ceph-mon[31615]: mds.? [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] up:active 2024-01-31T05:13:16.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:15 smithi099 ceph-mon[31615]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:13:16.318 INFO:tasks.workunit.client.0.smithi099.stdout:9/642: dwrite d0/d3e/d87/dc9/d24/f69 [0,4194304] 0 2024-01-31T05:13:16.318 INFO:tasks.workunit.client.0.smithi099.stdout:9/643: write d0/d3e/d87/dc9/d24/d2b/d63/da7/fb2 [73361,125186] 0 2024-01-31T05:13:16.319 INFO:tasks.workunit.client.0.smithi099.stdout:9/644: dread - d0/d3e/f8b zero size 2024-01-31T05:13:16.319 INFO:tasks.workunit.client.0.smithi099.stdout:2/627: mkdir d10/d3a/d69/d82/dcb 0 2024-01-31T05:13:16.319 INFO:tasks.workunit.client.0.smithi099.stdout:2/628: write d10/d20/f50 [4196091,37840] 0 2024-01-31T05:13:16.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:15 smithi181 ceph-mon[36434]: pgmap v405: 97 pgs: 97 active+clean; 775 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 101 MiB/s rd, 128 MiB/s wr, 1.37k op/s 2024-01-31T05:13:16.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:15 smithi181 ceph-mon[36434]: mds.? [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] up:active 2024-01-31T05:13:16.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:15 smithi181 ceph-mon[36434]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:13:16.322 INFO:tasks.workunit.client.0.smithi099.stdout:8/665: dwrite d1/dd/dba/d29/d3f/d56/f90 [0,4194304] 0 2024-01-31T05:13:16.322 INFO:tasks.workunit.client.0.smithi099.stdout:9/645: rmdir d0/d3e/d87/dc9/d24/d2b/d63/da7/daa 39 2024-01-31T05:13:16.330 INFO:tasks.workunit.client.0.smithi099.stdout:8/666: mkdir d1/dd/dba/d29/d3f/d56/da0/d2e/de1 0 2024-01-31T05:13:16.332 INFO:tasks.workunit.client.0.smithi099.stdout:8/667: symlink d1/dd/dba/d19/dc5/le2 0 2024-01-31T05:13:16.338 INFO:tasks.workunit.client.0.smithi099.stdout:5/588: rename d6/da/d14/d3d/d51/d82/d93 to d6/da/d14/d3d/d57/dc6 0 2024-01-31T05:13:16.338 INFO:tasks.workunit.client.0.smithi099.stdout:5/589: chown d6/da/d14/d3d/d6e/f22 1761 1 2024-01-31T05:13:16.340 INFO:tasks.workunit.client.0.smithi099.stdout:3/641: rename d10/d32/l65 to d10/d32/d85/d77/le6 0 2024-01-31T05:13:16.340 INFO:tasks.workunit.client.0.smithi099.stdout:3/642: write d10/d24/d40/f47 [3264376,107988] 0 2024-01-31T05:13:16.340 INFO:tasks.workunit.client.0.smithi099.stdout:5/590: write d6/da/d3f/f4d [600760,75894] 0 2024-01-31T05:13:16.342 INFO:tasks.workunit.client.0.smithi099.stdout:9/646: rename d0/d3e/d87/dc9/d24/d2b/c25 to d0/ce4 0 2024-01-31T05:13:16.343 INFO:tasks.workunit.client.0.smithi099.stdout:0/654: dwrite d1/d8/f5f [0,4194304] 0 2024-01-31T05:13:16.344 INFO:tasks.workunit.client.0.smithi099.stdout:9/647: symlink d0/d3e/d87/dc9/d5e/d72/d89/d98/dc1/dca/le5 0 2024-01-31T05:13:16.346 INFO:tasks.workunit.client.0.smithi099.stdout:3/643: unlink d10/d32/d85/d77/fe2 0 2024-01-31T05:13:16.347 INFO:tasks.workunit.client.0.smithi099.stdout:9/648: dread d0/d3e/d87/dc9/d24/d2b/d63/da7/fb2 [0,4194304] 0 2024-01-31T05:13:16.347 INFO:tasks.workunit.client.0.smithi099.stdout:0/655: dread d1/d30/d45/dad/f83 [0,4194304] 0 2024-01-31T05:13:16.349 INFO:tasks.workunit.client.0.smithi099.stdout:9/649: creat d0/d3e/d87/dc9/d24/d48/fe6 x:0 0 0 2024-01-31T05:13:16.349 INFO:tasks.workunit.client.0.smithi099.stdout:9/650: chown d0/d3e/d33/l58 96442 1 2024-01-31T05:13:16.349 INFO:tasks.workunit.client.0.smithi099.stdout:9/651: truncate d0/d5d/db6/fbb 592873 0 2024-01-31T05:13:16.349 INFO:tasks.workunit.client.0.smithi099.stdout:9/652: creat d0/d7/dd2/fe7 x:0 0 0 2024-01-31T05:13:16.350 INFO:tasks.workunit.client.0.smithi099.stdout:9/653: rmdir d0/d3e 39 2024-01-31T05:13:16.350 INFO:tasks.workunit.client.0.smithi099.stdout:9/654: write d0/d5d/f91 [209609,108642] 0 2024-01-31T05:13:16.350 INFO:tasks.workunit.client.0.smithi099.stdout:9/655: read - d0/d3e/d87/dc9/d24/d2b/d59/f9b zero size 2024-01-31T05:13:16.351 INFO:tasks.workunit.client.0.smithi099.stdout:9/656: creat d0/d3e/d87/dc9/d5e/ddb/fe8 x:0 0 0 2024-01-31T05:13:16.351 INFO:tasks.workunit.client.0.smithi099.stdout:9/657: chown d0/d3e/d87/dc9/d24/d48/fc3 15412 1 2024-01-31T05:13:16.352 INFO:tasks.workunit.client.0.smithi099.stdout:9/658: mkdir d0/d3e/d87/dc9/d24/d2b/de9 0 2024-01-31T05:13:16.357 INFO:tasks.workunit.client.0.smithi099.stdout:5/591: dread d6/da/f56 [0,4194304] 0 2024-01-31T05:13:16.359 INFO:tasks.workunit.client.0.smithi099.stdout:5/592: creat d6/da/fc7 x:0 0 0 2024-01-31T05:13:16.360 INFO:tasks.workunit.client.0.smithi099.stdout:5/593: link d6/da/d3f/f4d d6/da/d14/d3d/d51/d82/d9a/fc8 0 2024-01-31T05:13:16.361 INFO:tasks.workunit.client.0.smithi099.stdout:5/594: creat d6/da/d3f/fc9 x:0 0 0 2024-01-31T05:13:16.362 INFO:tasks.workunit.client.0.smithi099.stdout:5/595: symlink d6/da/d14/d3d/lca 0 2024-01-31T05:13:16.365 INFO:tasks.workunit.client.0.smithi099.stdout:2/629: dwrite d10/d2b/d58/f5f [0,4194304] 0 2024-01-31T05:13:16.365 INFO:tasks.workunit.client.0.smithi099.stdout:2/630: fdatasync d10/f42 0 2024-01-31T05:13:16.365 INFO:tasks.workunit.client.0.smithi099.stdout:7/594: dwrite d6/d32/d3d/d4b/d33/d37/d4e/fbe [0,4194304] 0 2024-01-31T05:13:16.365 INFO:tasks.workunit.client.0.smithi099.stdout:3/644: dwrite d10/d27/d34/d44/d60/fa8 [0,4194304] 0 2024-01-31T05:13:16.366 INFO:tasks.workunit.client.0.smithi099.stdout:3/645: chown d10/d32 0 1 2024-01-31T05:13:16.366 INFO:tasks.workunit.client.0.smithi099.stdout:2/631: mkdir d10/d3a/d69/d82/dcb/dcc 0 2024-01-31T05:13:16.366 INFO:tasks.workunit.client.0.smithi099.stdout:2/632: write d10/d1c/f2d [3948176,4677] 0 2024-01-31T05:13:16.366 INFO:tasks.workunit.client.0.smithi099.stdout:2/633: chown d10/d1b/d4d/d5a/l67 1 1 2024-01-31T05:13:16.368 INFO:tasks.workunit.client.0.smithi099.stdout:7/595: creat d6/d32/d3d/d4b/d33/d37/d50/d4d/dad/daf/fc0 x:0 0 0 2024-01-31T05:13:16.370 INFO:tasks.workunit.client.0.smithi099.stdout:8/668: dwrite d1/f5e [0,4194304] 0 2024-01-31T05:13:16.372 INFO:tasks.workunit.client.0.smithi099.stdout:0/656: dread d1/d30/fb2 [0,4194304] 0 2024-01-31T05:13:16.372 INFO:tasks.workunit.client.0.smithi099.stdout:0/657: creat d1/d37/d4a/d7a/d7d/fea x:0 0 0 2024-01-31T05:13:16.376 INFO:tasks.workunit.client.0.smithi099.stdout:2/634: unlink f0 0 2024-01-31T05:13:16.376 INFO:tasks.workunit.client.0.smithi099.stdout:2/635: write d10/d3a/d69/fbc [338784,333] 0 2024-01-31T05:13:16.377 INFO:tasks.workunit.client.0.smithi099.stdout:7/596: creat d6/d98/fc1 x:0 0 0 2024-01-31T05:13:16.378 INFO:tasks.workunit.client.0.smithi099.stdout:3/646: write d10/d27/f53 [2004716,36261] 0 2024-01-31T05:13:16.379 INFO:tasks.workunit.client.0.smithi099.stdout:9/659: truncate d0/d5d/f91 2870399 0 2024-01-31T05:13:16.379 INFO:tasks.workunit.client.0.smithi099.stdout:9/660: readlink d0/d3e/d33/dab/lc4 0 2024-01-31T05:13:16.384 INFO:tasks.workunit.client.0.smithi099.stdout:2/636: dread d10/d3a/d69/f8b [0,4194304] 0 2024-01-31T05:13:16.385 INFO:tasks.workunit.client.0.smithi099.stdout:7/597: creat d6/d32/d3d/d4b/d33/d37/d50/d25/d7a/fc2 x:0 0 0 2024-01-31T05:13:16.385 INFO:tasks.workunit.client.0.smithi099.stdout:9/661: dread d0/d7/f28 [4194304,4194304] 0 2024-01-31T05:13:16.387 INFO:tasks.workunit.client.0.smithi099.stdout:8/669: getdents d1/dd/d7b/d85 0 2024-01-31T05:13:16.387 INFO:tasks.workunit.client.0.smithi099.stdout:8/670: write d1/dd/dba/d29/d3f/d56/da0/f3b [972810,73422] 0 2024-01-31T05:13:16.388 INFO:tasks.workunit.client.0.smithi099.stdout:2/637: unlink l9 0 2024-01-31T05:13:16.389 INFO:tasks.workunit.client.0.smithi099.stdout:2/638: dread - d10/d1b/d7d/d7a/fc7 zero size 2024-01-31T05:13:16.389 INFO:tasks.workunit.client.0.smithi099.stdout:7/598: symlink d6/d32/d3d/d4b/d33/d37/d50/d4d/d58/lc3 0 2024-01-31T05:13:16.390 INFO:tasks.workunit.client.0.smithi099.stdout:9/662: symlink d0/d3e/d87/dc9/d5e/d72/d89/d98/dc1/dca/lea 0 2024-01-31T05:13:16.391 INFO:tasks.workunit.client.0.smithi099.stdout:2/639: mkdir d10/d2b/d58/dc3/dcd 0 2024-01-31T05:13:16.392 INFO:tasks.workunit.client.0.smithi099.stdout:5/596: dwrite d6/da/d14/d3d/d51/d82/f76 [0,4194304] 0 2024-01-31T05:13:16.393 INFO:tasks.workunit.client.0.smithi099.stdout:5/597: readlink d6/da/d14/l2a 0 2024-01-31T05:13:16.393 INFO:tasks.workunit.client.0.smithi099.stdout:5/598: write d6/da/d14/d3d/d51/d82/f76 [4929025,48401] 0 2024-01-31T05:13:16.393 INFO:tasks.workunit.client.0.smithi099.stdout:7/599: rmdir d6/d32/d3d/d4b 39 2024-01-31T05:13:16.393 INFO:tasks.workunit.client.0.smithi099.stdout:7/600: dread - d6/d32/d3d/d4b/d33/d37/d50/d25/f92 zero size 2024-01-31T05:13:16.394 INFO:tasks.workunit.client.0.smithi099.stdout:9/663: creat d0/d3e/d87/dc9/d5e/d72/d89/feb x:0 0 0 2024-01-31T05:13:16.394 INFO:tasks.workunit.client.0.smithi099.stdout:9/664: write d0/d7/f14 [1499426,41274] 0 2024-01-31T05:13:16.394 INFO:tasks.workunit.client.0.smithi099.stdout:9/665: dread - d0/d3e/d87/dc9/d5e/ddb/fe8 zero size 2024-01-31T05:13:16.395 INFO:tasks.workunit.client.0.smithi099.stdout:2/640: mkdir d10/d1c/d43/db8/dce 0 2024-01-31T05:13:16.396 INFO:tasks.workunit.client.0.smithi099.stdout:2/641: fdatasync d10/d3a/d69/fa1 0 2024-01-31T05:13:16.399 INFO:tasks.workunit.client.0.smithi099.stdout:2/642: rmdir d10/d3a/d69/d82/dcb/dcc 0 2024-01-31T05:13:16.400 INFO:tasks.workunit.client.0.smithi099.stdout:5/599: unlink d6/da/d3f/c38 0 2024-01-31T05:13:16.401 INFO:tasks.workunit.client.0.smithi099.stdout:5/600: fsync d6/da/d3f/f4d 0 2024-01-31T05:13:16.401 INFO:tasks.workunit.client.0.smithi099.stdout:5/601: write d6/da/d14/d3d/d6e/f3a [1144608,129972] 0 2024-01-31T05:13:16.401 INFO:tasks.workunit.client.0.smithi099.stdout:7/601: rmdir d6/d32/d3d 39 2024-01-31T05:13:16.404 INFO:tasks.workunit.client.0.smithi099.stdout:0/658: dwrite d1/d37/f41 [0,4194304] 0 2024-01-31T05:13:16.407 INFO:tasks.workunit.client.0.smithi099.stdout:0/659: mkdir d1/d37/d4a/d6f/dc9/deb 0 2024-01-31T05:13:16.407 INFO:tasks.workunit.client.0.smithi099.stdout:0/660: write d1/d37/d4a/faa [646949,112495] 0 2024-01-31T05:13:16.408 INFO:tasks.workunit.client.0.smithi099.stdout:8/671: dread d1/dd/f2b [0,4194304] 0 2024-01-31T05:13:16.409 INFO:tasks.workunit.client.0.smithi099.stdout:8/672: write d1/dd/dba/d29/d3f/d56/da0/fac [424080,41379] 0 2024-01-31T05:13:16.414 INFO:tasks.workunit.client.0.smithi099.stdout:2/643: read d10/d2b/d58/fb1 [4164195,130694] 0 2024-01-31T05:13:16.416 INFO:tasks.workunit.client.0.smithi099.stdout:0/661: mknod d1/cec 0 2024-01-31T05:13:16.417 INFO:tasks.workunit.client.0.smithi099.stdout:0/662: mkdir d1/d64/ded 0 2024-01-31T05:13:16.418 INFO:tasks.workunit.client.0.smithi099.stdout:0/663: mkdir d1/d64/ded/dee 0 2024-01-31T05:13:16.419 INFO:tasks.workunit.client.0.smithi099.stdout:6/531: sync 2024-01-31T05:13:16.419 INFO:tasks.workunit.client.0.smithi099.stdout:6/532: creat d14/d18/faa x:0 0 0 2024-01-31T05:13:16.423 INFO:tasks.workunit.client.0.smithi099.stdout:3/647: dwrite d10/d32/d33/d51/f67 [0,4194304] 0 2024-01-31T05:13:16.423 INFO:tasks.workunit.client.0.smithi099.stdout:3/648: dread - d10/d32/d85/f64 zero size 2024-01-31T05:13:16.424 INFO:tasks.workunit.client.0.smithi099.stdout:3/649: read - d10/d27/d34/d44/d60/d75/d8c/d92/fdb zero size 2024-01-31T05:13:16.424 INFO:tasks.workunit.client.0.smithi099.stdout:3/650: chown d10/d32/d85/c21 468756180 1 2024-01-31T05:13:16.424 INFO:tasks.workunit.client.0.smithi099.stdout:6/533: mknod d14/d18/d52/d7e/cab 0 2024-01-31T05:13:16.424 INFO:tasks.workunit.client.0.smithi099.stdout:6/534: dread - d14/d18/d52/d46/f8d zero size 2024-01-31T05:13:16.426 INFO:tasks.workunit.client.0.smithi099.stdout:3/651: mkdir d10/d32/d85/da3/de7 0 2024-01-31T05:13:16.428 INFO:tasks.workunit.client.0.smithi099.stdout:7/602: write d6/f69 [131046,108336] 0 2024-01-31T05:13:16.428 INFO:tasks.workunit.client.0.smithi099.stdout:9/666: dwrite d0/d3e/d87/dc9/d24/fa1 [0,4194304] 0 2024-01-31T05:13:16.429 INFO:tasks.workunit.client.0.smithi099.stdout:9/667: chown d0/d3e/d87/dc9/d5e/d72/d89/feb 219 1 2024-01-31T05:13:16.444 INFO:tasks.workunit.client.0.smithi099.stdout:3/652: dread d10/d72/f9c [0,4194304] 0 2024-01-31T05:13:16.446 INFO:tasks.workunit.client.0.smithi099.stdout:3/653: rename d10/d32/d85/c1a to d10/d27/d34/d44/ce8 0 2024-01-31T05:13:16.448 INFO:tasks.workunit.client.0.smithi099.stdout:3/654: truncate d10/d32/d85/f22 3116629 0 2024-01-31T05:13:16.453 INFO:tasks.workunit.client.0.smithi099.stdout:5/602: dwrite d6/da/d14/d3d/d57/d92/fa7 [0,4194304] 0 2024-01-31T05:13:16.453 INFO:tasks.workunit.client.0.smithi099.stdout:5/603: fdatasync d6/da/d14/d61/d98/fa5 0 2024-01-31T05:13:16.458 INFO:tasks.workunit.client.0.smithi099.stdout:8/673: dwrite d1/dd/dba/d29/d3f/d56/da0/d2e/fb1 [0,4194304] 0 2024-01-31T05:13:16.459 INFO:tasks.workunit.client.0.smithi099.stdout:8/674: truncate d1/dd/dba/d19/dbd/fdf 415274 0 2024-01-31T05:13:16.459 INFO:tasks.workunit.client.0.smithi099.stdout:2/644: dwrite d10/d1c/d43/db8/fc8 [0,4194304] 0 2024-01-31T05:13:16.460 INFO:tasks.workunit.client.0.smithi099.stdout:1/534: sync 2024-01-31T05:13:16.461 INFO:tasks.workunit.client.0.smithi099.stdout:9/668: dwrite d0/d3e/d87/dc9/d24/d2b/d7b/f9d [0,4194304] 0 2024-01-31T05:13:16.462 INFO:tasks.workunit.client.0.smithi099.stdout:9/669: write d0/d3e/d87/dc9/d24/d2b/f17 [5001148,15024] 0 2024-01-31T05:13:16.462 INFO:tasks.workunit.client.0.smithi099.stdout:8/675: unlink d1/cb 0 2024-01-31T05:13:16.463 INFO:tasks.workunit.client.0.smithi099.stdout:9/670: dread d0/d3e/d87/dc9/d24/d48/f4b [0,4194304] 0 2024-01-31T05:13:16.464 INFO:tasks.workunit.client.0.smithi099.stdout:0/664: dwrite d1/d16/d36/fa7 [0,4194304] 0 2024-01-31T05:13:16.464 INFO:tasks.workunit.client.0.smithi099.stdout:3/655: write d10/d27/d34/d44/d60/d75/d8c/faa [6835849,44196] 0 2024-01-31T05:13:16.464 INFO:tasks.workunit.client.0.smithi099.stdout:6/535: dwrite d14/d18/f93 [0,4194304] 0 2024-01-31T05:13:16.469 INFO:tasks.workunit.client.0.smithi099.stdout:2/645: read d10/d51/f54 [1136228,97207] 0 2024-01-31T05:13:16.470 INFO:tasks.workunit.client.0.smithi099.stdout:7/603: dwrite d6/f3f [0,4194304] 0 2024-01-31T05:13:16.470 INFO:tasks.workunit.client.0.smithi099.stdout:7/604: read d6/d12/f3c [1406446,86122] 0 2024-01-31T05:13:16.471 INFO:tasks.workunit.client.0.smithi099.stdout:8/676: rename d1/dd/dba/d29/d3f/f86 to d1/dd/dba/d29/d3f/d56/da0/d2e/de1/fe3 0 2024-01-31T05:13:16.471 INFO:tasks.workunit.client.0.smithi099.stdout:8/677: truncate d1/dd/dba/d29/d3f/d56/da0/f44 1062932 0 2024-01-31T05:13:16.471 INFO:tasks.workunit.client.0.smithi099.stdout:8/678: chown d1/l8 971219803 1 2024-01-31T05:13:16.471 INFO:tasks.workunit.client.0.smithi099.stdout:8/679: dread - d1/dd/d4f/d51/d83/f8a zero size 2024-01-31T05:13:16.472 INFO:tasks.workunit.client.0.smithi099.stdout:9/671: getdents d0/d3e/d87/dc9/d5e/d72/d89/d98/dc1 0 2024-01-31T05:13:16.472 INFO:tasks.workunit.client.0.smithi099.stdout:9/672: chown d0/d3e/d87/dc9/d5e/d72/d89/feb 65954377 1 2024-01-31T05:13:16.472 INFO:tasks.workunit.client.0.smithi099.stdout:9/673: chown d0/d3e/d87/dc9 1498 1 2024-01-31T05:13:16.472 INFO:tasks.workunit.client.0.smithi099.stdout:4/723: sync 2024-01-31T05:13:16.472 INFO:tasks.workunit.client.0.smithi099.stdout:9/674: write d0/d44/f53 [4219176,97674] 0 2024-01-31T05:13:16.472 INFO:tasks.workunit.client.0.smithi099.stdout:9/675: chown d0/d3e/d87/dc9/d24/d2b/d63/c67 1611671459 1 2024-01-31T05:13:16.473 INFO:tasks.workunit.client.0.smithi099.stdout:4/724: stat d0/d2/d4b/d93/d17/d3d/faa 0 2024-01-31T05:13:16.476 INFO:tasks.workunit.client.0.smithi099.stdout:0/665: mkdir d1/d37/d4a/d6f/def 0 2024-01-31T05:13:16.476 INFO:tasks.workunit.client.0.smithi099.stdout:0/666: fsync d1/d64/f7f 0 2024-01-31T05:13:16.476 INFO:tasks.workunit.client.0.smithi099.stdout:0/667: write d1/d30/d45/dad/fa4 [798478,20125] 0 2024-01-31T05:13:16.479 INFO:tasks.workunit.client.0.smithi099.stdout:6/536: mknod d14/d18/d3b/cac 0 2024-01-31T05:13:16.480 INFO:tasks.workunit.client.0.smithi099.stdout:2/646: getdents d10/d51 0 2024-01-31T05:13:16.480 INFO:tasks.workunit.client.0.smithi099.stdout:2/647: write d10/d1b/d4d/fb3 [837215,99549] 0 2024-01-31T05:13:16.480 INFO:tasks.workunit.client.0.smithi099.stdout:6/537: creat d14/d18/d52/d7e/d1c/fad x:0 0 0 2024-01-31T05:13:16.480 INFO:tasks.workunit.client.0.smithi099.stdout:6/538: dread - d14/d18/d52/d7e/d1c/f82 zero size 2024-01-31T05:13:16.482 INFO:tasks.workunit.client.0.smithi099.stdout:8/680: read d1/dd/dba/f31 [1015646,2359] 0 2024-01-31T05:13:16.484 INFO:tasks.workunit.client.0.smithi099.stdout:7/605: mknod d6/d32/d3d/d4b/d33/d37/d50/d25/d72/cc4 0 2024-01-31T05:13:16.485 INFO:tasks.workunit.client.0.smithi099.stdout:2/648: rmdir d10/d3a/d69/d82/dcb 0 2024-01-31T05:13:16.485 INFO:tasks.workunit.client.0.smithi099.stdout:2/649: chown d10/d1c/f2d 107615152 1 2024-01-31T05:13:16.487 INFO:tasks.workunit.client.0.smithi099.stdout:6/539: rmdir d14/d18/d52/d7e/d1c/d29 39 2024-01-31T05:13:16.489 INFO:tasks.workunit.client.0.smithi099.stdout:0/668: mknod d1/d30/d45/dad/cf0 0 2024-01-31T05:13:16.489 INFO:tasks.workunit.client.0.smithi099.stdout:0/669: write d1/d64/f67 [2093121,127743] 0 2024-01-31T05:13:16.489 INFO:tasks.workunit.client.0.smithi099.stdout:4/725: symlink d0/d2/d4b/d93/d39/lf4 0 2024-01-31T05:13:16.489 INFO:tasks.workunit.client.0.smithi099.stdout:4/726: fdatasync d0/d2/d4b/d93/d39/fec 0 2024-01-31T05:13:16.489 INFO:tasks.workunit.client.0.smithi099.stdout:3/656: symlink d10/d27/le9 0 2024-01-31T05:13:16.490 INFO:tasks.workunit.client.0.smithi099.stdout:8/681: chown d1/dd/dba/d29/d3f/d56/da0/d2e/d69/c6a 150823 1 2024-01-31T05:13:16.490 INFO:tasks.workunit.client.0.smithi099.stdout:7/606: mkdir d6/d32/d3d/d4b/d33/d37/d50/d4d/d58/da8/dc5 0 2024-01-31T05:13:16.492 INFO:tasks.workunit.client.0.smithi099.stdout:0/670: creat d1/d30/d45/dad/ff1 x:0 0 0 2024-01-31T05:13:16.494 INFO:tasks.workunit.client.0.smithi099.stdout:3/657: rename d10/d27/f5d to d10/d27/d34/d44/d60/d75/fea 0 2024-01-31T05:13:16.495 INFO:tasks.workunit.client.0.smithi099.stdout:2/650: truncate d10/d2b/d58/f5f 1211361 0 2024-01-31T05:13:16.495 INFO:tasks.workunit.client.0.smithi099.stdout:2/651: creat d10/fcf x:0 0 0 2024-01-31T05:13:16.496 INFO:tasks.workunit.client.0.smithi099.stdout:9/676: dwrite d0/d7/f1f [0,4194304] 0 2024-01-31T05:13:16.499 INFO:tasks.workunit.client.0.smithi099.stdout:7/607: dread d6/f1f [0,4194304] 0 2024-01-31T05:13:16.499 INFO:tasks.workunit.client.0.smithi099.stdout:9/677: rename d0/d3e/d87/dc9/d24/d2b/d63/f7e to d0/d3e/d87/dc9/d24/d2b/ddf/fec 0 2024-01-31T05:13:16.503 INFO:tasks.workunit.client.0.smithi099.stdout:9/678: symlink d0/d3e/d87/dc9/d5e/de0/led 0 2024-01-31T05:13:16.503 INFO:tasks.workunit.client.0.smithi099.stdout:9/679: truncate d0/d3e/d87/dc9/d24/d2b/d63/da7/fc8 4964404 0 2024-01-31T05:13:16.503 INFO:tasks.workunit.client.0.smithi099.stdout:9/680: dread - d0/d3e/d87/fe2 zero size 2024-01-31T05:13:16.505 INFO:tasks.workunit.client.0.smithi099.stdout:7/608: symlink d6/d32/d3d/d4b/d9b/lc6 0 2024-01-31T05:13:16.505 INFO:tasks.workunit.client.0.smithi099.stdout:7/609: write d6/d32/d3d/d4b/d33/d37/d50/f3e [996652,110443] 0 2024-01-31T05:13:16.505 INFO:tasks.workunit.client.0.smithi099.stdout:7/610: truncate d6/d32/d3d/d4b/d33/d37/d50/d25/d7a/fc2 271748 0 2024-01-31T05:13:16.507 INFO:tasks.workunit.client.0.smithi099.stdout:2/652: mkdir d10/d20/dd0 0 2024-01-31T05:13:16.507 INFO:tasks.workunit.client.0.smithi099.stdout:2/653: fdatasync d10/d1c/f26 0 2024-01-31T05:13:16.507 INFO:tasks.workunit.client.0.smithi099.stdout:9/681: creat d0/d3e/d87/dc9/d5e/d72/dbf/dd1/fee x:0 0 0 2024-01-31T05:13:16.507 INFO:tasks.workunit.client.0.smithi099.stdout:9/682: write d0/d7/fdd [1013830,65017] 0 2024-01-31T05:13:16.508 INFO:tasks.workunit.client.0.smithi099.stdout:0/671: dread d1/d8/f61 [0,4194304] 0 2024-01-31T05:13:16.508 INFO:tasks.workunit.client.0.smithi099.stdout:7/611: creat d6/d32/d3d/d4b/d9b/fc7 x:0 0 0 2024-01-31T05:13:16.508 INFO:tasks.workunit.client.0.smithi099.stdout:7/612: truncate d6/d32/d3d/d4b/d33/d37/f94 1774773 0 2024-01-31T05:13:16.508 INFO:tasks.workunit.client.0.smithi099.stdout:7/613: dread - d6/d32/d3d/d4b/d33/d37/d50/d4d/dad/daf/fc0 zero size 2024-01-31T05:13:16.508 INFO:tasks.workunit.client.0.smithi099.stdout:7/614: truncate d6/d32/d3d/d4b/d33/d37/d50/d4d/d58/f97 1814196 0 2024-01-31T05:13:16.508 INFO:tasks.workunit.client.0.smithi099.stdout:7/615: chown d6/d32/d3d/d4b/d33/d37/d50/d25/d7a/la1 466467 1 2024-01-31T05:13:16.508 INFO:tasks.workunit.client.0.smithi099.stdout:7/616: chown d6/d32/d3d/d4b/d33/d37/d50/d25/d7a 514214 1 2024-01-31T05:13:16.509 INFO:tasks.workunit.client.0.smithi099.stdout:9/683: mkdir d0/d5d/def 0 2024-01-31T05:13:16.511 INFO:tasks.workunit.client.0.smithi099.stdout:0/672: mkdir d1/d64/ded/dee/df2 0 2024-01-31T05:13:16.512 INFO:tasks.workunit.client.0.smithi099.stdout:8/682: write d1/dd/dba/d29/d3f/f48 [2763522,95298] 0 2024-01-31T05:13:16.513 INFO:tasks.workunit.client.0.smithi099.stdout:8/683: creat d1/dd/dba/d19/d21/d3c/fe4 x:0 0 0 2024-01-31T05:13:16.513 INFO:tasks.workunit.client.0.smithi099.stdout:6/540: write d14/d18/d52/d7e/d1c/d29/f32 [1303619,69169] 0 2024-01-31T05:13:16.513 INFO:tasks.workunit.client.0.smithi099.stdout:6/541: chown d14/d18/d52/d46 4 1 2024-01-31T05:13:16.513 INFO:tasks.workunit.client.0.smithi099.stdout:0/673: chown d1/d37/d4a/d7a/d9d/fd9 2967326 1 2024-01-31T05:13:16.513 INFO:tasks.workunit.client.0.smithi099.stdout:0/674: dread - d1/d37/d4a/fd7 zero size 2024-01-31T05:13:16.513 INFO:tasks.workunit.client.0.smithi099.stdout:0/675: stat d1/d30 0 2024-01-31T05:13:16.521 INFO:tasks.workunit.client.0.smithi099.stdout:3/658: dwrite d10/d27/d34/d52/fa0 [4194304,4194304] 0 2024-01-31T05:13:16.523 INFO:tasks.workunit.client.0.smithi099.stdout:7/617: write d6/d32/d3d/d4b/d33/d37/d50/d5e/fa0 [1413767,107535] 0 2024-01-31T05:13:16.525 INFO:tasks.workunit.client.0.smithi099.stdout:6/542: read d14/d18/d52/d7e/d66/f9f [96130,10676] 0 2024-01-31T05:13:16.526 INFO:tasks.workunit.client.0.smithi099.stdout:4/727: dwrite d0/d79/f92 [0,4194304] 0 2024-01-31T05:13:16.526 INFO:tasks.workunit.client.0.smithi099.stdout:3/659: unlink d10/f23 0 2024-01-31T05:13:16.526 INFO:tasks.workunit.client.0.smithi099.stdout:3/660: chown d10/d32/d85/da3/db9/fca 831791 1 2024-01-31T05:13:16.527 INFO:tasks.workunit.client.0.smithi099.stdout:7/618: symlink d6/d32/d3d/d4b/d33/d37/d50/d25/d72/lc8 0 2024-01-31T05:13:16.527 INFO:tasks.workunit.client.0.smithi099.stdout:4/728: write d0/d8/f63 [651685,99909] 0 2024-01-31T05:13:16.529 INFO:tasks.workunit.client.0.smithi099.stdout:0/676: dread d1/d30/d45/d6e/f8e [0,4194304] 0 2024-01-31T05:13:16.529 INFO:tasks.workunit.client.0.smithi099.stdout:4/729: rmdir d0/d2/d4b/d93/d59/d8f 39 2024-01-31T05:13:16.539 INFO:tasks.workunit.client.0.smithi099.stdout:2/654: dwrite d10/d1c/f26 [0,4194304] 0 2024-01-31T05:13:16.539 INFO:tasks.workunit.client.0.smithi099.stdout:2/655: chown d10/d1b/d7d/d7a/fbd 3132 1 2024-01-31T05:13:16.544 INFO:tasks.workunit.client.0.smithi099.stdout:6/543: read d14/d18/d52/f67 [38512,47498] 0 2024-01-31T05:13:16.544 INFO:tasks.workunit.client.0.smithi099.stdout:0/677: truncate d1/d37/d4a/d7a/d7d/fb3 1323124 0 2024-01-31T05:13:16.547 INFO:tasks.workunit.client.0.smithi099.stdout:7/619: mknod d6/d32/d3d/d4b/d33/d37/d50/cc9 0 2024-01-31T05:13:16.547 INFO:tasks.workunit.client.0.smithi099.stdout:7/620: write d6/d32/f5b [2390587,6609] 0 2024-01-31T05:13:16.548 INFO:tasks.workunit.client.0.smithi099.stdout:6/544: mknod d14/cae 0 2024-01-31T05:13:16.548 INFO:tasks.workunit.client.0.smithi099.stdout:0/678: getdents d1/d64/ded/dee 0 2024-01-31T05:13:16.548 INFO:tasks.workunit.client.0.smithi099.stdout:0/679: chown d1/d30/d45/dad/f94 57 1 2024-01-31T05:13:16.550 INFO:tasks.workunit.client.0.smithi099.stdout:6/545: link d14/d18/d52/d7e/d1c/d29/f76 d14/d18/d52/d7e/d1c/d29/d94/faf 0 2024-01-31T05:13:16.550 INFO:tasks.workunit.client.0.smithi099.stdout:6/546: chown d14/d18/d52/d46 3403674 1 2024-01-31T05:13:16.551 INFO:tasks.workunit.client.0.smithi099.stdout:6/547: stat d14/d18/d52/d7e/d1c/d29/c3a 0 2024-01-31T05:13:16.551 INFO:tasks.workunit.client.0.smithi099.stdout:7/621: link d6/f69 d6/d32/d3d/d4b/d33/fca 0 2024-01-31T05:13:16.551 INFO:tasks.workunit.client.0.smithi099.stdout:0/680: creat d1/ff3 x:0 0 0 2024-01-31T05:13:16.553 INFO:tasks.workunit.client.0.smithi099.stdout:0/681: creat d1/d30/ff4 x:0 0 0 2024-01-31T05:13:16.553 INFO:tasks.workunit.client.0.smithi099.stdout:0/682: fsync d1/d37/fc3 0 2024-01-31T05:13:16.553 INFO:tasks.workunit.client.0.smithi099.stdout:0/683: fdatasync d1/d30/d45/dad/f83 0 2024-01-31T05:13:16.553 INFO:tasks.workunit.client.0.smithi099.stdout:0/684: creat d1/d30/d45/dad/ff5 x:0 0 0 2024-01-31T05:13:16.553 INFO:tasks.workunit.client.0.smithi099.stdout:0/685: truncate d1/d37/d4a/d7a/d9d/fd9 204109 0 2024-01-31T05:13:16.555 INFO:tasks.workunit.client.0.smithi099.stdout:7/622: creat d6/d32/d3d/d4b/d33/d37/d50/d25/d72/d8e/d9a/fcb x:0 0 0 2024-01-31T05:13:16.556 INFO:tasks.workunit.client.0.smithi099.stdout:7/623: chown d6/d32/d3d/d4b/d33/d37/d50/d5e/fa0 5015564 1 2024-01-31T05:13:16.556 INFO:tasks.workunit.client.0.smithi099.stdout:7/624: chown d6/d32/d3d/d4b/d33/d37/d50/d25/d43 14 1 2024-01-31T05:13:16.556 INFO:tasks.workunit.client.0.smithi099.stdout:7/625: chown d6/d98 7641 1 2024-01-31T05:13:16.556 INFO:tasks.workunit.client.0.smithi099.stdout:7/626: truncate d6/d32/d3d/d4b/d33/d37/d50/d25/d72/d8e/d9a/fcb 192044 0 2024-01-31T05:13:16.557 INFO:tasks.workunit.client.0.smithi099.stdout:0/686: getdents d1/d37/d4a/d7a 0 2024-01-31T05:13:16.557 INFO:tasks.workunit.client.0.smithi099.stdout:0/687: write d1/d64/f78 [249469,119034] 0 2024-01-31T05:13:16.557 INFO:tasks.workunit.client.0.smithi099.stdout:0/688: creat d1/d37/d4a/d6f/dc9/dcf/ff6 x:0 0 0 2024-01-31T05:13:16.557 INFO:tasks.workunit.client.0.smithi099.stdout:7/627: stat d6/d32/d3d/d4b/d33/d37/d50/c99 0 2024-01-31T05:13:16.557 INFO:tasks.workunit.client.0.smithi099.stdout:7/628: read - d6/d98/fc1 zero size 2024-01-31T05:13:16.557 INFO:tasks.workunit.client.0.smithi099.stdout:7/629: write d6/d32/d3d/d4b/d33/f71 [1432245,73342] 0 2024-01-31T05:13:16.558 INFO:tasks.workunit.client.0.smithi099.stdout:7/630: mknod d6/d32/d3d/ccc 0 2024-01-31T05:13:16.558 INFO:tasks.workunit.client.0.smithi099.stdout:7/631: readlink d6/d32/d3d/d4b/d33/d37/d50/d25/d7a/l95 0 2024-01-31T05:13:16.559 INFO:tasks.workunit.client.0.smithi099.stdout:3/661: dwrite d10/d32/d85/f22 [0,4194304] 0 2024-01-31T05:13:16.559 INFO:tasks.workunit.client.0.smithi099.stdout:3/662: stat d10/fc2 0 2024-01-31T05:13:16.559 INFO:tasks.workunit.client.0.smithi099.stdout:3/663: rename d10/d24/d40/d81 to d10/d24/d40/d81/de4/deb 22 2024-01-31T05:13:16.559 INFO:tasks.workunit.client.0.smithi099.stdout:4/730: dwrite d0/d79/f92 [0,4194304] 0 2024-01-31T05:13:16.560 INFO:tasks.workunit.client.0.smithi099.stdout:7/632: getdents d6/d32/d3d/d4b 0 2024-01-31T05:13:16.560 INFO:tasks.workunit.client.0.smithi099.stdout:1/535: sync 2024-01-31T05:13:16.560 INFO:tasks.workunit.client.0.smithi099.stdout:5/604: sync 2024-01-31T05:13:16.565 INFO:tasks.workunit.client.0.smithi099.stdout:0/689: dread d1/d16/f31 [0,4194304] 0 2024-01-31T05:13:16.566 INFO:tasks.workunit.client.0.smithi099.stdout:3/664: creat d10/d27/d34/d44/d60/d75/d8c/db0/fec x:0 0 0 2024-01-31T05:13:16.568 INFO:tasks.workunit.client.0.smithi099.stdout:1/536: creat d4/db/fa4 x:0 0 0 2024-01-31T05:13:16.569 INFO:tasks.workunit.client.0.smithi099.stdout:5/605: rmdir d6/da/d14/d3d 39 2024-01-31T05:13:16.569 INFO:tasks.workunit.client.0.smithi099.stdout:5/606: dread - d6/da/d14/d61/d98/fa5 zero size 2024-01-31T05:13:16.569 INFO:tasks.workunit.client.0.smithi099.stdout:5/607: chown d6/da/d14/c78 17733 1 2024-01-31T05:13:16.571 INFO:tasks.workunit.client.0.smithi099.stdout:3/665: unlink d10/d27/d34/d44/d60/d75/ccf 0 2024-01-31T05:13:16.571 INFO:tasks.workunit.client.0.smithi099.stdout:3/666: fdatasync d10/d32/d33/fd4 0 2024-01-31T05:13:16.572 INFO:tasks.workunit.client.0.smithi099.stdout:7/633: mknod d6/d32/d3d/d4b/d33/d37/d50/ccd 0 2024-01-31T05:13:16.572 INFO:tasks.workunit.client.0.smithi099.stdout:7/634: write d6/d32/d3d/d46/f83 [1528596,67717] 0 2024-01-31T05:13:16.573 INFO:tasks.workunit.client.0.smithi099.stdout:0/690: mknod d1/cf7 0 2024-01-31T05:13:16.573 INFO:tasks.workunit.client.0.smithi099.stdout:0/691: chown d1/d30/d45/dad/fa5 1022 1 2024-01-31T05:13:16.574 INFO:tasks.workunit.client.0.smithi099.stdout:5/608: rename d6/da/d14/d3d/d6e/c59 to d6/da/d14/d61/d98/da0/ccb 0 2024-01-31T05:13:16.575 INFO:tasks.workunit.client.0.smithi099.stdout:5/609: read d6/da/d14/d3d/d51/d82/d9a/fc8 [344280,30173] 0 2024-01-31T05:13:16.575 INFO:tasks.workunit.client.0.smithi099.stdout:5/610: truncate d6/da/d14/d3d/d51/d82/d9a/fb5 409867 0 2024-01-31T05:13:16.575 INFO:tasks.workunit.client.0.smithi099.stdout:5/611: write d6/da/d14/f3b [567642,59106] 0 2024-01-31T05:13:16.576 INFO:tasks.workunit.client.0.smithi099.stdout:5/612: rmdir d6/da/d14/d3d/d51/dae/db0 39 2024-01-31T05:13:16.576 INFO:tasks.workunit.client.0.smithi099.stdout:5/613: stat d6/da/d14/d94/f8d 0 2024-01-31T05:13:16.576 INFO:tasks.workunit.client.0.smithi099.stdout:5/614: chown d6/da/d14/d3d/d8c/d99/cbd 1748895 1 2024-01-31T05:13:16.578 INFO:tasks.workunit.client.0.smithi099.stdout:5/615: rmdir d6/da/d3f 39 2024-01-31T05:13:16.584 INFO:tasks.workunit.client.0.smithi099.stdout:4/731: dwrite d0/d74/fc6 [0,4194304] 0 2024-01-31T05:13:16.586 INFO:tasks.workunit.client.0.smithi099.stdout:6/548: dwrite d14/f40 [0,4194304] 0 2024-01-31T05:13:16.586 INFO:tasks.workunit.client.0.smithi099.stdout:6/549: write d14/d18/d52/d22/d71/f72 [500822,121779] 0 2024-01-31T05:13:16.586 INFO:tasks.workunit.client.0.smithi099.stdout:6/550: chown d14/d18/d52/d7e/d1c/c81 3521908 1 2024-01-31T05:13:16.591 INFO:tasks.workunit.client.0.smithi099.stdout:0/692: dread d1/d30/fe8 [0,4194304] 0 2024-01-31T05:13:16.591 INFO:tasks.workunit.client.0.smithi099.stdout:0/693: readlink d1/d30/d45/dad/l70 0 2024-01-31T05:13:16.592 INFO:tasks.workunit.client.0.smithi099.stdout:0/694: write d1/d37/f87 [90035,54581] 0 2024-01-31T05:13:16.593 INFO:tasks.workunit.client.0.smithi099.stdout:0/695: mknod d1/d30/d45/d66/d97/cf8 0 2024-01-31T05:13:16.593 INFO:tasks.workunit.client.0.smithi099.stdout:6/551: symlink d14/d18/d52/d46/lb0 0 2024-01-31T05:13:16.595 INFO:tasks.workunit.client.0.smithi099.stdout:0/696: symlink d1/d37/d73/db7/dc5/lf9 0 2024-01-31T05:13:16.610 INFO:tasks.workunit.client.0.smithi099.stdout:1/537: dwrite d4/dc/d29/f3b [0,4194304] 0 2024-01-31T05:13:16.610 INFO:tasks.workunit.client.0.smithi099.stdout:1/538: dread - d4/dc/d4d/d5d/d87/d56/d83/f9f zero size 2024-01-31T05:13:16.610 INFO:tasks.workunit.client.0.smithi099.stdout:1/539: write d4/dc/d15/f6c [984381,57611] 0 2024-01-31T05:13:16.610 INFO:tasks.workunit.client.0.smithi099.stdout:1/540: write d4/db/f94 [355898,68762] 0 2024-01-31T05:13:16.611 INFO:tasks.workunit.client.0.smithi099.stdout:3/667: dwrite d10/d24/d40/f82 [0,4194304] 0 2024-01-31T05:13:16.612 INFO:tasks.workunit.client.0.smithi099.stdout:3/668: read - d10/d27/d34/d44/d60/d75/d8c/db0/fec zero size 2024-01-31T05:13:16.615 INFO:tasks.workunit.client.0.smithi099.stdout:7/635: dwrite d6/d32/d3d/d4b/d33/f5a [4194304,4194304] 0 2024-01-31T05:13:16.615 INFO:tasks.workunit.client.0.smithi099.stdout:7/636: stat d6/d32/d3d/d4b/d33/d37/d50/d25/d72/fb4 0 2024-01-31T05:13:16.615 INFO:tasks.workunit.client.0.smithi099.stdout:5/616: dwrite d6/f11 [0,4194304] 0 2024-01-31T05:13:16.615 INFO:tasks.workunit.client.0.smithi099.stdout:5/617: chown d6/da/d14/d3d/d51/dae 3627 1 2024-01-31T05:13:16.615 INFO:tasks.workunit.client.0.smithi099.stdout:4/732: dwrite d0/d2/d4b/d93/d17/d3d/f41 [4194304,4194304] 0 2024-01-31T05:13:16.615 INFO:tasks.workunit.client.0.smithi099.stdout:4/733: write d0/d2/d4b/d93/d17/d3d/fb7 [778860,3164] 0 2024-01-31T05:13:16.616 INFO:tasks.workunit.client.0.smithi099.stdout:7/637: mkdir d6/d32/d3d/d4b/d33/d37/d50/d25/d7a/dce 0 2024-01-31T05:13:16.617 INFO:tasks.workunit.client.0.smithi099.stdout:5/618: symlink d6/da/d14/d3d/d6e/d21/lcc 0 2024-01-31T05:13:16.620 INFO:tasks.workunit.client.0.smithi099.stdout:4/734: symlink d0/d2/d4b/d93/d59/d8f/dd6/ddb/lf5 0 2024-01-31T05:13:16.624 INFO:tasks.workunit.client.0.smithi099.stdout:7/638: symlink d6/d32/d3d/d4b/d33/d37/d50/d7b/lcf 0 2024-01-31T05:13:16.624 INFO:tasks.workunit.client.0.smithi099.stdout:7/639: stat d6/d32/d3d/d4b/l70 0 2024-01-31T05:13:16.625 INFO:tasks.workunit.client.0.smithi099.stdout:7/640: chown d6/d32/c38 41 1 2024-01-31T05:13:16.627 INFO:tasks.workunit.client.0.smithi099.stdout:7/641: rename d6/f1f to d6/d32/d3d/d4b/d33/d37/d50/d25/d72/fd0 0 2024-01-31T05:13:16.627 INFO:tasks.workunit.client.0.smithi099.stdout:7/642: creat d6/d98/fd1 x:0 0 0 2024-01-31T05:13:16.628 INFO:tasks.workunit.client.0.smithi099.stdout:6/552: dwrite d14/d18/d52/d7e/d1c/d29/f32 [0,4194304] 0 2024-01-31T05:13:16.629 INFO:tasks.workunit.client.0.smithi099.stdout:7/643: creat d6/d32/d3d/d4b/d33/d37/d50/d25/d79/fd2 x:0 0 0 2024-01-31T05:13:16.634 INFO:tasks.workunit.client.0.smithi099.stdout:7/644: rename d6/d32/d3d/d4b/c24 to d6/cd3 0 2024-01-31T05:13:16.634 INFO:tasks.workunit.client.0.smithi099.stdout:4/735: dread d0/d2/d4b/d93/d39/fcd [0,4194304] 0 2024-01-31T05:13:16.634 INFO:tasks.workunit.client.0.smithi099.stdout:4/736: chown d0/d79/l81 190 1 2024-01-31T05:13:16.634 INFO:tasks.workunit.client.0.smithi099.stdout:4/737: read - d0/d8/d19/d98/fad zero size 2024-01-31T05:13:16.641 INFO:tasks.workunit.client.0.smithi099.stdout:3/669: dwrite d10/d32/d33/f61 [0,4194304] 0 2024-01-31T05:13:16.643 INFO:tasks.workunit.client.0.smithi099.stdout:6/553: write d14/d18/d52/d7e/d1c/f55 [2979754,15032] 0 2024-01-31T05:13:16.644 INFO:tasks.workunit.client.0.smithi099.stdout:0/697: dwrite d1/d16/f50 [0,4194304] 0 2024-01-31T05:13:16.645 INFO:tasks.workunit.client.0.smithi099.stdout:7/645: dread d6/d32/d3d/d4b/d33/d37/d4e/fa6 [0,4194304] 0 2024-01-31T05:13:16.645 INFO:tasks.workunit.client.0.smithi099.stdout:4/738: dread d0/d2/d4b/d93/d17/d3d/f41 [0,4194304] 0 2024-01-31T05:13:16.645 INFO:tasks.workunit.client.0.smithi099.stdout:5/619: dwrite d6/da/f19 [0,4194304] 0 2024-01-31T05:13:16.646 INFO:tasks.workunit.client.0.smithi099.stdout:5/620: truncate d6/da/d14/d94/f8d 112816 0 2024-01-31T05:13:16.648 INFO:tasks.workunit.client.0.smithi099.stdout:1/541: unlink d4/dc/d4d/d5d/d87/d56/f75 0 2024-01-31T05:13:16.652 INFO:tasks.workunit.client.0.smithi099.stdout:0/698: mknod d1/d30/d45/dad/cfa 0 2024-01-31T05:13:16.652 INFO:tasks.workunit.client.0.smithi099.stdout:0/699: write d1/d30/d45/dad/f83 [858897,116227] 0 2024-01-31T05:13:16.652 INFO:tasks.workunit.client.0.smithi099.stdout:0/700: readlink d1/d37/d4a/d6f/l98 0 2024-01-31T05:13:16.655 INFO:tasks.workunit.client.0.smithi099.stdout:0/701: link d1/d30/d45/dad/fa4 d1/d37/d73/ffb 0 2024-01-31T05:13:16.656 INFO:tasks.workunit.client.0.smithi099.stdout:8/684: sync 2024-01-31T05:13:16.656 INFO:tasks.workunit.client.0.smithi099.stdout:9/684: sync 2024-01-31T05:13:16.656 INFO:tasks.workunit.client.0.smithi099.stdout:9/685: chown d0/d3e/d33/dab/fd4 1 1 2024-01-31T05:13:16.656 INFO:tasks.workunit.client.0.smithi099.stdout:0/702: truncate d1/d37/fc3 4074411 0 2024-01-31T05:13:16.657 INFO:tasks.workunit.client.0.smithi099.stdout:0/703: creat d1/d37/d73/ffc x:0 0 0 2024-01-31T05:13:16.658 INFO:tasks.workunit.client.0.smithi099.stdout:7/646: dread d6/d32/d3d/d4b/d33/f36 [0,4194304] 0 2024-01-31T05:13:16.658 INFO:tasks.workunit.client.0.smithi099.stdout:8/685: mknod d1/dd/dba/d29/d3f/d56/da0/d2e/d69/ce5 0 2024-01-31T05:13:16.658 INFO:tasks.workunit.client.0.smithi099.stdout:8/686: readlink d1/dd/dba/d20/l26 0 2024-01-31T05:13:16.663 INFO:tasks.workunit.client.0.smithi099.stdout:0/704: rmdir d1/d37/d4a/d6f/dc9/dcf 39 2024-01-31T05:13:16.666 INFO:tasks.workunit.client.0.smithi099.stdout:7/647: symlink d6/ld4 0 2024-01-31T05:13:16.666 INFO:tasks.workunit.client.0.smithi099.stdout:0/705: mkdir d1/d37/d73/dbc/dfd 0 2024-01-31T05:13:16.666 INFO:tasks.workunit.client.0.smithi099.stdout:0/706: chown d1 318356977 1 2024-01-31T05:13:16.673 INFO:tasks.workunit.client.0.smithi099.stdout:4/739: dread d0/d2/d4b/d93/d59/f8b [0,4194304] 0 2024-01-31T05:13:16.673 INFO:tasks.workunit.client.0.smithi099.stdout:8/687: dread d1/dd/dba/d19/f1f [0,4194304] 0 2024-01-31T05:13:16.676 INFO:tasks.workunit.client.0.smithi099.stdout:7/648: write d6/d32/d3d/d4b/d33/d37/f40 [3893785,92675] 0 2024-01-31T05:13:16.677 INFO:tasks.workunit.client.0.smithi099.stdout:7/649: chown d6/d32/d3d/d4b/d33/d37/d50/d5e/fa0 9 1 2024-01-31T05:13:16.677 INFO:tasks.workunit.client.0.smithi099.stdout:7/650: truncate d6/d32/d3d/d46/f83 2527504 0 2024-01-31T05:13:16.677 INFO:tasks.workunit.client.0.smithi099.stdout:3/670: dwrite d10/d32/d85/d77/fd0 [0,4194304] 0 2024-01-31T05:13:16.678 INFO:tasks.workunit.client.0.smithi099.stdout:3/671: chown d10/d32/d33/f61 3 1 2024-01-31T05:13:16.679 INFO:tasks.workunit.client.0.smithi099.stdout:6/554: dwrite d14/d18/d52/d7e/d1c/d29/f2b [0,4194304] 0 2024-01-31T05:13:16.680 INFO:tasks.workunit.client.0.smithi099.stdout:7/651: mknod d6/d32/d3d/d4b/d33/d37/d50/d25/d72/cd5 0 2024-01-31T05:13:16.683 INFO:tasks.workunit.client.0.smithi099.stdout:5/621: dwrite d6/ff [0,4194304] 0 2024-01-31T05:13:16.686 INFO:tasks.workunit.client.0.smithi099.stdout:7/652: symlink d6/d32/ld6 0 2024-01-31T05:13:16.688 INFO:tasks.workunit.client.0.smithi099.stdout:5/622: rename d6/da/d14/d3d/d6e/f4a to d6/fcd 0 2024-01-31T05:13:16.689 INFO:tasks.workunit.client.0.smithi099.stdout:6/555: stat d14/d18/d52/d46/fa2 0 2024-01-31T05:13:16.689 INFO:tasks.workunit.client.0.smithi099.stdout:6/556: read d14/f15 [1313924,94700] 0 2024-01-31T05:13:16.690 INFO:tasks.workunit.client.0.smithi099.stdout:6/557: dread - d14/d18/d52/d7e/d1c/f82 zero size 2024-01-31T05:13:16.691 INFO:tasks.workunit.client.0.smithi099.stdout:6/558: truncate d14/d18/d52/d7e/d1c/d29/f2b 1262785 0 2024-01-31T05:13:16.692 INFO:tasks.workunit.client.0.smithi099.stdout:7/653: rename d6/d32/d3d/d4b/d33/d37/d50/d4d/d58/da8 to d6/d32/d3d/dd7 0 2024-01-31T05:13:16.696 INFO:tasks.workunit.client.0.smithi099.stdout:7/654: truncate d6/d32/d3d/d4b/d33/d37/d50/d25/d47/f91 2974589 0 2024-01-31T05:13:16.697 INFO:tasks.workunit.client.0.smithi099.stdout:7/655: dread - d6/d32/d3d/d46/fab zero size 2024-01-31T05:13:16.697 INFO:tasks.workunit.client.0.smithi099.stdout:7/656: truncate d6/d32/d3d/d4b/d33/d37/d50/d5e/fb0 296933 0 2024-01-31T05:13:16.698 INFO:tasks.workunit.client.0.smithi099.stdout:2/656: sync 2024-01-31T05:13:16.698 INFO:tasks.workunit.client.0.smithi099.stdout:2/657: write d10/d1b/f81 [1331832,21677] 0 2024-01-31T05:13:16.698 INFO:tasks.workunit.client.0.smithi099.stdout:2/658: creat d10/d1b/d4d/fd1 x:0 0 0 2024-01-31T05:13:16.699 INFO:tasks.workunit.client.0.smithi099.stdout:2/659: creat d10/d1b/d7d/d7a/dad/fd2 x:0 0 0 2024-01-31T05:13:16.706 INFO:tasks.workunit.client.0.smithi099.stdout:4/740: dwrite d0/d8/d19/d98/fad [0,4194304] 0 2024-01-31T05:13:16.707 INFO:tasks.workunit.client.0.smithi099.stdout:9/686: dwrite d0/d3e/d87/dc9/d24/d2b/d63/da7/daa/fc0 [0,4194304] 0 2024-01-31T05:13:16.708 INFO:tasks.workunit.client.0.smithi099.stdout:4/741: getdents d0/d2/d4b/d93/d17/d7d/db2 0 2024-01-31T05:13:16.711 INFO:tasks.workunit.client.0.smithi099.stdout:9/687: symlink d0/d3e/d87/lf0 0 2024-01-31T05:13:16.711 INFO:tasks.workunit.client.0.smithi099.stdout:9/688: truncate d0/d3e/d87/dc9/d24/d2b/d63/fb7 1654440 0 2024-01-31T05:13:16.718 INFO:tasks.workunit.client.0.smithi099.stdout:0/707: dwrite d1/d30/d45/d66/f33 [0,4194304] 0 2024-01-31T05:13:16.718 INFO:tasks.workunit.client.0.smithi099.stdout:3/672: dwrite d10/d1e/f25 [0,4194304] 0 2024-01-31T05:13:16.718 INFO:tasks.workunit.client.0.smithi099.stdout:8/688: dwrite d1/dd/dba/d19/d21/d3c/fc6 [0,4194304] 0 2024-01-31T05:13:16.720 INFO:tasks.workunit.client.0.smithi099.stdout:0/708: mkdir d1/d37/d4a/d7b/dfe 0 2024-01-31T05:13:16.724 INFO:tasks.workunit.client.0.smithi099.stdout:5/623: dwrite d6/f11 [0,4194304] 0 2024-01-31T05:13:16.724 INFO:tasks.workunit.client.0.smithi099.stdout:5/624: readlink d6/da/d14/lba 0 2024-01-31T05:13:16.726 INFO:tasks.workunit.client.0.smithi099.stdout:2/660: link d10/d20/l61 d10/d51/ld3 0 2024-01-31T05:13:16.727 INFO:tasks.workunit.client.0.smithi099.stdout:2/661: symlink d10/d1b/d83/d86/ld4 0 2024-01-31T05:13:16.729 INFO:tasks.workunit.client.0.smithi099.stdout:2/662: symlink d10/d1b/d7d/ld5 0 2024-01-31T05:13:16.731 INFO:tasks.workunit.client.0.smithi099.stdout:2/663: unlink cd 0 2024-01-31T05:13:16.732 INFO:tasks.workunit.client.0.smithi099.stdout:5/625: rmdir d6/da/d14/d3d/d57/dc6 39 2024-01-31T05:13:16.732 INFO:tasks.workunit.client.0.smithi099.stdout:7/657: dwrite d6/d98/fc1 [0,4194304] 0 2024-01-31T05:13:16.732 INFO:tasks.workunit.client.0.smithi099.stdout:2/664: mkdir d10/d1b/d7d/d7a/dd6 0 2024-01-31T05:13:16.732 INFO:tasks.workunit.client.0.smithi099.stdout:2/665: write d10/d3a/d69/f8b [705631,70734] 0 2024-01-31T05:13:16.733 INFO:tasks.workunit.client.0.smithi099.stdout:6/559: dwrite d14/d18/d52/d7e/d1c/d29/f32 [0,4194304] 0 2024-01-31T05:13:16.733 INFO:tasks.workunit.client.0.smithi099.stdout:5/626: read d6/da/d14/d3d/d6e/f22 [8656392,27008] 0 2024-01-31T05:13:16.734 INFO:tasks.workunit.client.0.smithi099.stdout:2/666: mkdir d10/d1b/d7d/d7a/dd7 0 2024-01-31T05:13:16.736 INFO:tasks.workunit.client.0.smithi099.stdout:5/627: mkdir d6/da/d14/d3d/d8c/dce 0 2024-01-31T05:13:16.737 INFO:tasks.workunit.client.0.smithi099.stdout:5/628: symlink d6/da/d14/lcf 0 2024-01-31T05:13:16.739 INFO:tasks.workunit.client.0.smithi099.stdout:6/560: creat d14/d18/d52/d90/fb1 x:0 0 0 2024-01-31T05:13:16.739 INFO:tasks.workunit.client.0.smithi099.stdout:2/667: symlink d10/d3a/d69/ld8 0 2024-01-31T05:13:16.740 INFO:tasks.workunit.client.0.smithi099.stdout:9/689: dwrite d0/d7/d2e/f43 [4194304,4194304] 0 2024-01-31T05:13:16.740 INFO:tasks.workunit.client.0.smithi099.stdout:6/561: mknod d14/d18/d52/d90/cb2 0 2024-01-31T05:13:16.742 INFO:tasks.workunit.client.0.smithi099.stdout:2/668: unlink d10/d20/d5b/l7b 0 2024-01-31T05:13:16.752 INFO:tasks.workunit.client.0.smithi099.stdout:4/742: rename d0/d79/fa7 to d0/d8/d19/d99/ff6 0 2024-01-31T05:13:16.755 INFO:tasks.workunit.client.0.smithi099.stdout:3/673: dwrite d10/d32/d33/fd4 [0,4194304] 0 2024-01-31T05:13:16.755 INFO:tasks.workunit.client.0.smithi099.stdout:8/689: dwrite d1/dd/dba/d29/d3f/d56/da0/d2e/d69/f82 [0,4194304] 0 2024-01-31T05:13:16.757 INFO:tasks.workunit.client.0.smithi099.stdout:0/709: dwrite d1/d30/d45/dad/f55 [0,4194304] 0 2024-01-31T05:13:16.766 INFO:tasks.workunit.client.0.smithi099.stdout:3/674: rename d10/d1e/c73 to d10/d32/d85/d77/ced 0 2024-01-31T05:13:16.767 INFO:tasks.workunit.client.0.smithi099.stdout:0/710: rename d1/d16/l92 to d1/d37/d4a/d6f/dc9/lff 0 2024-01-31T05:13:16.768 INFO:tasks.workunit.client.0.smithi099.stdout:3/675: symlink d10/d24/lee 0 2024-01-31T05:13:16.769 INFO:tasks.workunit.client.0.smithi099.stdout:3/676: link d10/d32/d85/da3/fd3 d10/d24/d40/fef 0 2024-01-31T05:13:16.770 INFO:tasks.workunit.client.0.smithi099.stdout:3/677: symlink d10/d32/d85/da3/lf0 0 2024-01-31T05:13:16.771 INFO:tasks.workunit.client.0.smithi099.stdout:4/743: write d0/d2/d4b/d93/d17/d3d/fb7 [1624832,91020] 0 2024-01-31T05:13:16.771 INFO:tasks.workunit.client.0.smithi099.stdout:3/678: creat d10/ff1 x:0 0 0 2024-01-31T05:13:16.773 INFO:tasks.workunit.client.0.smithi099.stdout:8/690: write d1/dd/dba/d29/d3f/d56/da0/d2e/de1/fe3 [1854538,125078] 0 2024-01-31T05:13:16.773 INFO:tasks.workunit.client.0.smithi099.stdout:8/691: fsync d1/dd/f2b 0 2024-01-31T05:13:16.773 INFO:tasks.workunit.client.0.smithi099.stdout:8/692: fdatasync d1/dd/dba/d20/f4c 0 2024-01-31T05:13:16.773 INFO:tasks.workunit.client.0.smithi099.stdout:7/658: dwrite d6/ff [0,4194304] 0 2024-01-31T05:13:16.773 INFO:tasks.workunit.client.0.smithi099.stdout:7/659: write d6/fa [818844,96760] 0 2024-01-31T05:13:16.774 INFO:tasks.workunit.client.0.smithi099.stdout:6/562: dwrite d14/d18/d52/d7e/d1c/d29/d4f/f89 [0,4194304] 0 2024-01-31T05:13:16.774 INFO:tasks.workunit.client.0.smithi099.stdout:6/563: chown d14/d18/d52/d7e/d1c/d29/d4f/l74 20277933 1 2024-01-31T05:13:16.774 INFO:tasks.workunit.client.0.smithi099.stdout:5/629: dwrite d6/da/d14/d61/d98/fa5 [0,4194304] 0 2024-01-31T05:13:16.774 INFO:tasks.workunit.client.0.smithi099.stdout:9/690: dwrite d0/d3e/d87/dc9/f9c [0,4194304] 0 2024-01-31T05:13:16.775 INFO:tasks.workunit.client.0.smithi099.stdout:6/564: symlink d14/d18/d52/d22/d71/lb3 0 2024-01-31T05:13:16.775 INFO:tasks.workunit.client.0.smithi099.stdout:6/565: truncate d14/d18/d52/d90/fb1 195751 0 2024-01-31T05:13:16.776 INFO:tasks.workunit.client.0.smithi099.stdout:7/660: unlink d6/d32/d3d/d4b/d33/d37/d50/d25/d7a/l95 0 2024-01-31T05:13:16.778 INFO:tasks.workunit.client.0.smithi099.stdout:8/693: link d1/dd/dba/d29/d3f/d56/da0/lb0 d1/da6/le6 0 2024-01-31T05:13:16.780 INFO:tasks.workunit.client.0.smithi099.stdout:3/679: dread d10/d32/f4e [0,4194304] 0 2024-01-31T05:13:16.786 INFO:tasks.workunit.client.0.smithi099.stdout:5/630: write d6/f18 [948754,96756] 0 2024-01-31T05:13:16.787 INFO:tasks.workunit.client.0.smithi099.stdout:7/661: creat d6/d32/d3d/d4b/d33/d37/d50/d25/d47/fd8 x:0 0 0 2024-01-31T05:13:16.788 INFO:tasks.workunit.client.0.smithi099.stdout:7/662: fsync d6/d32/d3d/d4b/d33/d37/d50/d25/d7a/fc2 0 2024-01-31T05:13:16.788 INFO:tasks.workunit.client.0.smithi099.stdout:7/663: chown d6/d32/c75 16696 1 2024-01-31T05:13:16.788 INFO:tasks.workunit.client.0.smithi099.stdout:7/664: chown d6/d32/d3d/d4b/d33/d37/d50/d5e/fa0 26 1 2024-01-31T05:13:16.789 INFO:tasks.workunit.client.0.smithi099.stdout:8/694: symlink d1/da6/db4/le7 0 2024-01-31T05:13:16.792 INFO:tasks.workunit.client.0.smithi099.stdout:3/680: mkdir d10/d1e/df2 0 2024-01-31T05:13:16.793 INFO:tasks.workunit.client.0.smithi099.stdout:7/665: mkdir d6/d32/d3d/d46/dd9 0 2024-01-31T05:13:16.796 INFO:tasks.workunit.client.0.smithi099.stdout:7/666: symlink d6/d32/d3d/d4b/d33/d37/lda 0 2024-01-31T05:13:16.796 INFO:tasks.workunit.client.0.smithi099.stdout:6/566: dwrite d14/d18/d52/d7e/d1c/d29/d43/f91 [0,4194304] 0 2024-01-31T05:13:16.801 INFO:tasks.workunit.client.0.smithi099.stdout:7/667: truncate d6/d32/d3d/d46/f83 919426 0 2024-01-31T05:13:16.805 INFO:tasks.workunit.client.0.smithi099.stdout:8/695: dread d1/dd/dba/d19/d21/f5c [0,4194304] 0 2024-01-31T05:13:16.805 INFO:tasks.workunit.client.0.smithi099.stdout:8/696: stat d1/dd/dba/d20 0 2024-01-31T05:13:16.807 INFO:tasks.workunit.client.0.smithi099.stdout:4/744: link d0/d2/d20/f31 d0/d2/d4b/d93/d39/ff7 0 2024-01-31T05:13:16.808 INFO:tasks.workunit.client.0.smithi099.stdout:8/697: creat d1/dd/dba/d29/d3f/d56/fe8 x:0 0 0 2024-01-31T05:13:16.808 INFO:tasks.workunit.client.0.smithi099.stdout:4/745: mknod d0/d2/d4b/d93/d17/d7d/db2/cf8 0 2024-01-31T05:13:16.809 INFO:tasks.workunit.client.0.smithi099.stdout:1/542: sync 2024-01-31T05:13:16.809 INFO:tasks.workunit.client.0.smithi099.stdout:1/543: fdatasync d4/db/d12/f65 0 2024-01-31T05:13:16.809 INFO:tasks.workunit.client.0.smithi099.stdout:8/698: symlink d1/dd/le9 0 2024-01-31T05:13:16.815 INFO:tasks.workunit.client.0.smithi099.stdout:5/631: dwrite d6/da/d14/d3d/d51/f74 [0,4194304] 0 2024-01-31T05:13:16.815 INFO:tasks.workunit.client.0.smithi099.stdout:5/632: chown d6/da/d14/d3d 376007926 1 2024-01-31T05:13:16.815 INFO:tasks.workunit.client.0.smithi099.stdout:3/681: dwrite d10/f16 [4194304,4194304] 0 2024-01-31T05:13:16.819 INFO:tasks.workunit.client.0.smithi099.stdout:5/633: mkdir d6/da/d14/d61/d98/da0/dd0 0 2024-01-31T05:13:16.819 INFO:tasks.workunit.client.0.smithi099.stdout:5/634: chown d6/da/d3f/d5a/d81/cc4 1147335920 1 2024-01-31T05:13:16.819 INFO:tasks.workunit.client.0.smithi099.stdout:5/635: chown d6/da/d14/d3d/d8c/d99 91552 1 2024-01-31T05:13:16.823 INFO:tasks.workunit.client.0.smithi099.stdout:7/668: dread d6/d12/f73 [0,4194304] 0 2024-01-31T05:13:16.823 INFO:tasks.workunit.client.0.smithi099.stdout:7/669: stat d6/d32/d3d/d4b/d33/d37/d50/lbb 0 2024-01-31T05:13:16.823 INFO:tasks.workunit.client.0.smithi099.stdout:7/670: stat d6/d32 0 2024-01-31T05:13:16.823 INFO:tasks.workunit.client.0.smithi099.stdout:7/671: readlink d6/d32/d3d/d4b/d33/d37/l86 0 2024-01-31T05:13:16.823 INFO:tasks.workunit.client.0.smithi099.stdout:7/672: truncate d6/d32/d3d/d4b/d33/d37/d50/d25/f29 1838390 0 2024-01-31T05:13:16.825 INFO:tasks.workunit.client.0.smithi099.stdout:7/673: truncate d6/d32/d3d/d4b/d33/d37/d50/f3e 35475 0 2024-01-31T05:13:16.828 INFO:tasks.workunit.client.0.smithi099.stdout:7/674: write d6/d32/d3d/d4b/d33/d37/d50/d25/d72/d8e/f96 [4982770,70277] 0 2024-01-31T05:13:16.831 INFO:tasks.workunit.client.0.smithi099.stdout:6/567: dwrite d14/d18/d52/d7e/d1c/d29/d4f/f6e [0,4194304] 0 2024-01-31T05:13:16.831 INFO:tasks.workunit.client.0.smithi099.stdout:4/746: write d0/d2/f47 [3786156,72813] 0 2024-01-31T05:13:16.832 INFO:tasks.workunit.client.0.smithi099.stdout:4/747: chown d0/d1e/d61/f7c 7 1 2024-01-31T05:13:16.832 INFO:tasks.workunit.client.0.smithi099.stdout:7/675: creat d6/d32/d3d/dd7/dc5/fdb x:0 0 0 2024-01-31T05:13:16.832 INFO:tasks.workunit.client.0.smithi099.stdout:7/676: truncate d6/d32/d3d/dd7/dc5/fdb 985600 0 2024-01-31T05:13:16.833 INFO:tasks.workunit.client.0.smithi099.stdout:6/568: dread d14/d18/d52/d22/f88 [0,4194304] 0 2024-01-31T05:13:16.833 INFO:tasks.workunit.client.0.smithi099.stdout:4/748: mkdir d0/d2/d4b/d93/d17/d24/d3f/d43/df9 0 2024-01-31T05:13:16.833 INFO:tasks.workunit.client.0.smithi099.stdout:7/677: symlink d6/d32/d3d/d4b/d33/d37/d50/d4d/dad/daf/ldc 0 2024-01-31T05:13:16.852 INFO:tasks.workunit.client.0.smithi099.stdout:1/544: dwrite d4/dc/d55/f72 [0,4194304] 0 2024-01-31T05:13:16.852 INFO:tasks.workunit.client.0.smithi099.stdout:1/545: dread - d4/db/fa4 zero size 2024-01-31T05:13:16.853 INFO:tasks.workunit.client.0.smithi099.stdout:1/546: write d4/dc/d4d/d5d/d87/f9d [933246,62731] 0 2024-01-31T05:13:16.853 INFO:tasks.workunit.client.0.smithi099.stdout:1/547: dread - d4/dc/d48/f8c zero size 2024-01-31T05:13:16.855 INFO:tasks.workunit.client.0.smithi099.stdout:1/548: mkdir d4/dc/d4d/da5 0 2024-01-31T05:13:16.856 INFO:tasks.workunit.client.0.smithi099.stdout:1/549: mknod d4/db/d24/ca6 0 2024-01-31T05:13:16.857 INFO:tasks.workunit.client.0.smithi099.stdout:1/550: creat d4/db/d24/d4b/d50/fa7 x:0 0 0 2024-01-31T05:13:16.857 INFO:tasks.workunit.client.0.smithi099.stdout:1/551: dread - d4/db/fa4 zero size 2024-01-31T05:13:16.863 INFO:tasks.workunit.client.0.smithi099.stdout:3/682: dwrite d10/f16 [0,4194304] 0 2024-01-31T05:13:16.863 INFO:tasks.workunit.client.0.smithi099.stdout:3/683: dread - d10/d27/d34/d52/fe5 zero size 2024-01-31T05:13:16.864 INFO:tasks.workunit.client.0.smithi099.stdout:8/699: dwrite d1/dd/d7b/d85/fbb [0,4194304] 0 2024-01-31T05:13:16.864 INFO:tasks.workunit.client.0.smithi099.stdout:3/684: symlink d10/d32/lf3 0 2024-01-31T05:13:16.864 INFO:tasks.workunit.client.0.smithi099.stdout:3/685: read d10/d24/d40/f47 [968690,72311] 0 2024-01-31T05:13:16.865 INFO:tasks.workunit.client.0.smithi099.stdout:3/686: fsync d10/d24/f8a 0 2024-01-31T05:13:16.865 INFO:tasks.workunit.client.0.smithi099.stdout:8/700: stat d1/dd/d65/d7f/d81/fb5 0 2024-01-31T05:13:16.865 INFO:tasks.workunit.client.0.smithi099.stdout:6/569: dwrite d14/d18/d52/d46/f8d [0,4194304] 0 2024-01-31T05:13:16.866 INFO:tasks.workunit.client.0.smithi099.stdout:3/687: getdents d10/d27/d34/d52 0 2024-01-31T05:13:16.868 INFO:tasks.workunit.client.0.smithi099.stdout:6/570: mknod d14/d18/d52/d90/d9a/cb4 0 2024-01-31T05:13:16.869 INFO:tasks.workunit.client.0.smithi099.stdout:6/571: creat d14/d18/d9d/fb5 x:0 0 0 2024-01-31T05:13:16.870 INFO:tasks.workunit.client.0.smithi099.stdout:6/572: rmdir d14/d18/d52/d7e/d1c/d29/d94 39 2024-01-31T05:13:16.882 INFO:tasks.workunit.client.0.smithi099.stdout:8/701: dread d1/dd/dba/d29/d3f/d56/da0/d2e/f33 [4194304,4194304] 0 2024-01-31T05:13:16.888 INFO:tasks.workunit.client.0.smithi099.stdout:5/636: dwrite d6/da/d14/d3d/d6e/f22 [0,4194304] 0 2024-01-31T05:13:16.898 INFO:tasks.workunit.client.0.smithi099.stdout:7/678: dwrite d6/d32/d3d/d4b/d33/d37/d50/d25/d47/fd8 [0,4194304] 0 2024-01-31T05:13:16.901 INFO:tasks.workunit.client.0.smithi099.stdout:4/749: dwrite d0/d2/d4b/d93/fcb [0,4194304] 0 2024-01-31T05:13:16.901 INFO:tasks.workunit.client.0.smithi099.stdout:6/573: dwrite d14/d18/d52/d7e/d1c/d29/f2b [0,4194304] 0 2024-01-31T05:13:16.902 INFO:tasks.workunit.client.0.smithi099.stdout:1/552: dwrite d4/dc/d15/f7a [0,4194304] 0 2024-01-31T05:13:16.902 INFO:tasks.workunit.client.0.smithi099.stdout:3/688: dwrite d10/d24/d40/d81/fb7 [0,4194304] 0 2024-01-31T05:13:16.902 INFO:tasks.workunit.client.0.smithi099.stdout:3/689: chown d10/d32/d85/da3/lf0 44388232 1 2024-01-31T05:13:16.904 INFO:tasks.workunit.client.0.smithi099.stdout:7/679: symlink d6/d32/d3d/d4b/d9b/ldd 0 2024-01-31T05:13:16.906 INFO:tasks.workunit.client.0.smithi099.stdout:4/750: unlink d0/c6 0 2024-01-31T05:13:16.906 INFO:tasks.workunit.client.0.smithi099.stdout:4/751: fsync d0/d2/d4b/d93/d17/f25 0 2024-01-31T05:13:16.910 INFO:tasks.workunit.client.0.smithi099.stdout:3/690: mknod d10/d32/d85/d77/cf4 0 2024-01-31T05:13:16.911 INFO:tasks.workunit.client.0.smithi099.stdout:4/752: mkdir d0/d2/d4b/d93/d59/d82/dfa 0 2024-01-31T05:13:16.912 INFO:tasks.workunit.client.0.smithi099.stdout:5/637: dwrite d6/da/d3f/f63 [0,4194304] 0 2024-01-31T05:13:16.912 INFO:tasks.workunit.client.0.smithi099.stdout:3/691: mkdir d10/d27/df5 0 2024-01-31T05:13:16.913 INFO:tasks.workunit.client.0.smithi099.stdout:4/753: creat d0/d8/d19/d65/ffb x:0 0 0 2024-01-31T05:13:16.913 INFO:tasks.workunit.client.0.smithi099.stdout:4/754: fdatasync d0/d2/d4b/d93/d39/fec 0 2024-01-31T05:13:16.914 INFO:tasks.workunit.client.0.smithi099.stdout:4/755: fsync d0/d2/d4b/d93/d17/d3d/fb7 0 2024-01-31T05:13:16.914 INFO:tasks.workunit.client.0.smithi099.stdout:4/756: fdatasync d0/d2/d4b/d93/f94 0 2024-01-31T05:13:16.915 INFO:tasks.workunit.client.0.smithi099.stdout:1/553: dread d4/db/d24/f2b [0,4194304] 0 2024-01-31T05:13:16.915 INFO:tasks.workunit.client.0.smithi099.stdout:3/692: rename d10/fc4 to d10/d32/ff6 0 2024-01-31T05:13:16.917 INFO:tasks.workunit.client.0.smithi099.stdout:6/574: dread d14/d18/d52/d7e/d1c/d29/f3f [0,4194304] 0 2024-01-31T05:13:16.917 INFO:tasks.workunit.client.0.smithi099.stdout:1/554: rename d4/dc/d29/f3b to d4/dc/d29/fa8 0 2024-01-31T05:13:16.919 INFO:tasks.workunit.client.0.smithi099.stdout:6/575: truncate fa 1598534 0 2024-01-31T05:13:16.920 INFO:tasks.workunit.client.0.smithi099.stdout:1/555: creat d4/dc/d44/fa9 x:0 0 0 2024-01-31T05:13:16.922 INFO:tasks.workunit.client.0.smithi099.stdout:1/556: mkdir d4/dc/d29/daa 0 2024-01-31T05:13:16.922 INFO:tasks.workunit.client.0.smithi099.stdout:1/557: creat d4/dc/d48/fab x:0 0 0 2024-01-31T05:13:16.922 INFO:tasks.workunit.client.0.smithi099.stdout:1/558: chown d4/db/d24/d4b/d50/d91/f97 1498338 1 2024-01-31T05:13:16.924 INFO:tasks.workunit.client.0.smithi099.stdout:1/559: getdents d4 0 2024-01-31T05:13:16.929 INFO:tasks.workunit.client.0.smithi099.stdout:3/693: read d10/d27/d34/d44/d60/d75/fea [192295,69728] 0 2024-01-31T05:13:16.929 INFO:tasks.workunit.client.0.smithi099.stdout:3/694: creat d10/d27/d34/d44/d95/daf/ff7 x:0 0 0 2024-01-31T05:13:16.929 INFO:tasks.workunit.client.0.smithi099.stdout:3/695: write d10/d27/d34/d44/d60/d75/d8c/faa [4255885,101331] 0 2024-01-31T05:13:16.931 INFO:tasks.workunit.client.0.smithi099.stdout:7/680: dwrite d6/d32/d3d/d4b/d33/f71 [0,4194304] 0 2024-01-31T05:13:16.932 INFO:tasks.workunit.client.0.smithi099.stdout:3/696: fsync d10/d27/d34/d44/d60/d75/d8c/faa 0 2024-01-31T05:13:16.936 INFO:tasks.workunit.client.0.smithi099.stdout:7/681: rename d6/d32/d3d/d4b/d33/d37/l86 to d6/d32/d3d/lde 0 2024-01-31T05:13:16.938 INFO:tasks.workunit.client.0.smithi099.stdout:3/697: mknod d10/d32/cf8 0 2024-01-31T05:13:16.939 INFO:tasks.workunit.client.0.smithi099.stdout:7/682: mknod d6/d32/d3d/d4b/d33/d37/d50/d25/d72/cdf 0 2024-01-31T05:13:16.940 INFO:tasks.workunit.client.0.smithi099.stdout:3/698: creat d10/d32/d85/d77/ff9 x:0 0 0 2024-01-31T05:13:16.940 INFO:tasks.workunit.client.0.smithi099.stdout:1/560: dread d4/dc/d4d/d5d/f7f [0,4194304] 0 2024-01-31T05:13:16.946 INFO:tasks.workunit.client.0.smithi099.stdout:3/699: truncate d10/d32/d85/f2c 1570796 0 2024-01-31T05:13:16.946 INFO:tasks.workunit.client.0.smithi099.stdout:4/757: dwrite d0/d8/d19/d98/fbd [0,4194304] 0 2024-01-31T05:13:16.947 INFO:tasks.workunit.client.0.smithi099.stdout:1/561: creat d4/db/d3a/fac x:0 0 0 2024-01-31T05:13:16.947 INFO:tasks.workunit.client.0.smithi099.stdout:1/562: truncate d4/db/d24/d4b/d50/d91/f99 3048 0 2024-01-31T05:13:16.949 INFO:tasks.workunit.client.0.smithi099.stdout:3/700: rename d10/d32/d85/da3/db9 to d10/dfa 0 2024-01-31T05:13:16.950 INFO:tasks.workunit.client.0.smithi099.stdout:6/576: dwrite d14/d18/d52/d22/d71/f72 [0,4194304] 0 2024-01-31T05:13:16.950 INFO:tasks.workunit.client.0.smithi099.stdout:3/701: symlink d10/d24/d40/d81/lfb 0 2024-01-31T05:13:16.950 INFO:tasks.workunit.client.0.smithi099.stdout:4/758: dread d0/d2/f9f [0,4194304] 0 2024-01-31T05:13:16.950 INFO:tasks.workunit.client.0.smithi099.stdout:4/759: chown d0/d8/d19/d54/d76 11 1 2024-01-31T05:13:16.951 INFO:tasks.workunit.client.0.smithi099.stdout:3/702: creat d10/d27/d34/d44/d60/ffc x:0 0 0 2024-01-31T05:13:16.953 INFO:tasks.workunit.client.0.smithi099.stdout:3/703: unlink d10/d27/d34/d52/fa0 0 2024-01-31T05:13:16.953 INFO:tasks.workunit.client.0.smithi099.stdout:3/704: stat d10/d27/d34/d44/d60/fa8 0 2024-01-31T05:13:16.954 INFO:tasks.workunit.client.0.smithi099.stdout:3/705: mknod d10/d27/d34/d44/d95/daf/cfd 0 2024-01-31T05:13:16.954 INFO:tasks.workunit.client.0.smithi099.stdout:3/706: chown d10/d27/d34/d44/d95/daf/fc7 0 1 2024-01-31T05:13:16.954 INFO:tasks.workunit.client.0.smithi099.stdout:3/707: write d10/d27/d34/d44/d95/fd2 [977367,80911] 0 2024-01-31T05:13:16.957 INFO:tasks.workunit.client.0.smithi099.stdout:3/708: mknod d10/d27/d34/cfe 0 2024-01-31T05:13:16.959 INFO:tasks.workunit.client.0.smithi099.stdout:3/709: mkdir d10/d27/d34/d44/d60/d75/d8c/dff 0 2024-01-31T05:13:16.959 INFO:tasks.workunit.client.0.smithi099.stdout:3/710: fsync d10/d32/f5a 0 2024-01-31T05:13:16.961 INFO:tasks.workunit.client.0.smithi099.stdout:7/683: dwrite d6/d32/d3d/d46/f83 [0,4194304] 0 2024-01-31T05:13:16.963 INFO:tasks.workunit.client.0.smithi099.stdout:7/684: getdents d6/d32/d3d/d4b/d33/d37/d50/d25/d72/d8e 0 2024-01-31T05:13:16.966 INFO:tasks.workunit.client.0.smithi099.stdout:7/685: link d6/d32/d3d/d4b/d33/d37/d50/c89 d6/d32/d3d/d4b/d33/d37/d50/ce0 0 2024-01-31T05:13:16.968 INFO:tasks.workunit.client.0.smithi099.stdout:2/669: sync 2024-01-31T05:13:16.973 INFO:tasks.workunit.client.0.smithi099.stdout:1/563: rename d4/db/d24/d4b/d50/d91/l27 to d4/db/d3a/d7e/d85/lad 0 2024-01-31T05:13:16.974 INFO:tasks.workunit.client.0.smithi099.stdout:1/564: symlink d4/dc/d55/lae 0 2024-01-31T05:13:16.974 INFO:tasks.workunit.client.0.smithi099.stdout:4/760: dwrite d0/d2/d4b/f69 [0,4194304] 0 2024-01-31T05:13:16.977 INFO:tasks.workunit.client.0.smithi099.stdout:7/686: write d6/f3f [203656,20415] 0 2024-01-31T05:13:16.977 INFO:tasks.workunit.client.0.smithi099.stdout:7/687: readlink d6/ld4 0 2024-01-31T05:13:16.977 INFO:tasks.workunit.client.0.smithi099.stdout:2/670: getdents d10/d20 0 2024-01-31T05:13:16.978 INFO:tasks.workunit.client.0.smithi099.stdout:7/688: getdents d6/d32/d3d/d4b/d33/d37 0 2024-01-31T05:13:16.988 INFO:tasks.workunit.client.0.smithi099.stdout:2/671: dread d10/d1c/f26 [0,4194304] 0 2024-01-31T05:13:16.988 INFO:tasks.workunit.client.0.smithi099.stdout:4/761: link d0/d8/c49 d0/d2/d4b/d93/d39/cfc 0 2024-01-31T05:13:16.991 INFO:tasks.workunit.client.0.smithi099.stdout:4/762: mkdir d0/d2/d4b/d93/d17/d7d/db2/dc7/dfd 0 2024-01-31T05:13:16.992 INFO:tasks.workunit.client.0.smithi099.stdout:4/763: mknod d0/d8/d19/d54/d76/cfe 0 2024-01-31T05:13:16.993 INFO:tasks.workunit.client.0.smithi099.stdout:4/764: fsync d0/d8/fc4 0 2024-01-31T05:13:16.994 INFO:tasks.workunit.client.0.smithi099.stdout:1/565: dwrite d4/db/f94 [0,4194304] 0 2024-01-31T05:13:16.995 INFO:tasks.workunit.client.0.smithi099.stdout:6/577: rename f11 to d14/d18/d52/d22/d71/fb6 0 2024-01-31T05:13:16.995 INFO:tasks.workunit.client.0.smithi099.stdout:6/578: write d14/d18/d52/d7e/f8b [197546,117928] 0 2024-01-31T05:13:16.996 INFO:tasks.workunit.client.0.smithi099.stdout:6/579: creat d14/d18/d52/d7e/d1c/d29/d79/fb7 x:0 0 0 2024-01-31T05:13:16.996 INFO:tasks.workunit.client.0.smithi099.stdout:1/566: creat d4/dc/d15/d45/faf x:0 0 0 2024-01-31T05:13:16.998 INFO:tasks.workunit.client.0.smithi099.stdout:6/580: mknod d14/d18/d52/d7e/d1c/cb8 0 2024-01-31T05:13:16.998 INFO:tasks.workunit.client.0.smithi099.stdout:3/711: rename d10/d32/d85/d77/lba to d10/d27/d89/l100 0 2024-01-31T05:13:17.003 INFO:tasks.workunit.client.0.smithi099.stdout:7/689: dwrite d6/d32/d3d/d4b/d33/d37/fa2 [0,4194304] 0 2024-01-31T05:13:17.003 INFO:tasks.workunit.client.0.smithi099.stdout:7/690: write d6/f69 [13384666,34618] 0 2024-01-31T05:13:17.005 INFO:tasks.workunit.client.0.smithi099.stdout:4/765: rename d0/d2/d4b/d93/d17/d24/d3f to d0/d2/d4b/d93/d59/dff 0 2024-01-31T05:13:17.005 INFO:tasks.workunit.client.0.smithi099.stdout:4/766: chown d0/d2/d4b/d93/d17/d7d/db2/cf8 2790 1 2024-01-31T05:13:17.005 INFO:tasks.workunit.client.0.smithi099.stdout:4/767: fsync d0/d1e/f35 0 2024-01-31T05:13:17.008 INFO:tasks.workunit.client.0.smithi099.stdout:7/691: creat d6/d32/d3d/d4b/d33/d37/d50/d25/d72/fe1 x:0 0 0 2024-01-31T05:13:17.011 INFO:tasks.workunit.client.0.smithi099.stdout:1/567: write d4/db/f25 [3368411,104466] 0 2024-01-31T05:13:17.014 INFO:tasks.workunit.client.0.smithi099.stdout:1/568: dread d4/db/d24/d69/f70 [0,4194304] 0 2024-01-31T05:13:17.014 INFO:tasks.workunit.client.0.smithi099.stdout:2/672: dwrite d10/d1c/f39 [0,4194304] 0 2024-01-31T05:13:17.016 INFO:tasks.workunit.client.0.smithi099.stdout:1/569: symlink d4/db/d24/d8f/lb0 0 2024-01-31T05:13:17.016 INFO:tasks.workunit.client.0.smithi099.stdout:1/570: creat d4/dc/d15/fb1 x:0 0 0 2024-01-31T05:13:17.018 INFO:tasks.workunit.client.0.smithi099.stdout:4/768: link d0/d1e/l2b d0/d2/d4b/d93/d17/d3d/l100 0 2024-01-31T05:13:17.020 INFO:tasks.workunit.client.0.smithi099.stdout:4/769: mknod d0/d2/d4b/d93/d17/de1/c101 0 2024-01-31T05:13:17.021 INFO:tasks.workunit.client.0.smithi099.stdout:1/571: creat d4/db/d3a/d7e/d85/d96/fb2 x:0 0 0 2024-01-31T05:13:17.022 INFO:tasks.workunit.client.0.smithi099.stdout:2/673: getdents d10/d2b/d58 0 2024-01-31T05:13:17.022 INFO:tasks.workunit.client.0.smithi099.stdout:1/572: write d4/dc/f2c [1136314,11292] 0 2024-01-31T05:13:17.022 INFO:tasks.workunit.client.0.smithi099.stdout:1/573: creat d4/dc/d15/fb3 x:0 0 0 2024-01-31T05:13:17.023 INFO:tasks.workunit.client.0.smithi099.stdout:7/692: write d6/ff [1136904,15716] 0 2024-01-31T05:13:17.026 INFO:tasks.workunit.client.0.smithi099.stdout:4/770: mkdir d0/d2/d4b/d93/d59/d102 0 2024-01-31T05:13:17.026 INFO:tasks.workunit.client.0.smithi099.stdout:4/771: chown d0/d2/d4b/f5f 65363 1 2024-01-31T05:13:17.027 INFO:tasks.workunit.client.0.smithi099.stdout:7/693: dread d6/d32/d3d/d4b/d33/d37/d50/d25/d72/fd0 [4194304,4194304] 0 2024-01-31T05:13:17.027 INFO:tasks.workunit.client.0.smithi099.stdout:7/694: fsync d6/d32/d3d/d4b/d33/d37/d50/d4d/dad/daf/fc0 0 2024-01-31T05:13:17.027 INFO:tasks.workunit.client.0.smithi099.stdout:7/695: stat d6/d32/d3d/d4b/d33/d37/d50/d25/d72/cc4 0 2024-01-31T05:13:17.027 INFO:tasks.workunit.client.0.smithi099.stdout:7/696: fdatasync d6/d32/d3d/d4b/d33/d37/d50/d25/f2b 0 2024-01-31T05:13:17.028 INFO:tasks.workunit.client.0.smithi099.stdout:1/574: unlink d4/dc/l19 0 2024-01-31T05:13:17.028 INFO:tasks.workunit.client.0.smithi099.stdout:4/772: creat d0/d2/d4b/d93/d59/d82/f103 x:0 0 0 2024-01-31T05:13:17.029 INFO:tasks.workunit.client.0.smithi099.stdout:2/674: getdents d10/d1c/d43/db8 0 2024-01-31T05:13:17.029 INFO:tasks.workunit.client.0.smithi099.stdout:2/675: stat d10/d1c/d43/db8/dce 0 2024-01-31T05:13:17.032 INFO:tasks.workunit.client.0.smithi099.stdout:2/676: symlink d10/d1c/d43/db8/ld9 0 2024-01-31T05:13:17.037 INFO:tasks.workunit.client.0.smithi099.stdout:6/581: rename d14/d18/d3b/l70 to d14/d18/d52/d7e/lb9 0 2024-01-31T05:13:17.040 INFO:tasks.workunit.client.0.smithi099.stdout:2/677: symlink d10/d1b/d9b/lda 0 2024-01-31T05:13:17.044 INFO:tasks.workunit.client.0.smithi099.stdout:2/678: mknod d10/d1b/cdb 0 2024-01-31T05:13:17.044 INFO:tasks.workunit.client.0.smithi099.stdout:2/679: fsync d10/d1c/f85 0 2024-01-31T05:13:17.046 INFO:tasks.workunit.client.0.smithi099.stdout:2/680: rmdir d10/d2b/d58 39 2024-01-31T05:13:17.046 INFO:tasks.workunit.client.0.smithi099.stdout:6/582: dread d14/d18/d3b/d7b/f7d [0,4194304] 0 2024-01-31T05:13:17.046 INFO:tasks.workunit.client.0.smithi099.stdout:6/583: fdatasync d14/d18/d52/d7e/d1c/d29/d79/fb7 0 2024-01-31T05:13:17.048 INFO:tasks.workunit.client.0.smithi099.stdout:6/584: mkdir d14/d18/d52/d7e/d1c/da6/dba 0 2024-01-31T05:13:17.049 INFO:tasks.workunit.client.0.smithi099.stdout:2/681: dread d10/d1c/f85 [0,4194304] 0 2024-01-31T05:13:17.049 INFO:tasks.workunit.client.0.smithi099.stdout:1/575: dread d4/dc/d15/f1a [0,4194304] 0 2024-01-31T05:13:17.054 INFO:tasks.workunit.client.0.smithi099.stdout:9/691: sync 2024-01-31T05:13:17.054 INFO:tasks.workunit.client.0.smithi099.stdout:0/711: sync 2024-01-31T05:13:17.054 INFO:tasks.workunit.client.0.smithi099.stdout:8/702: sync 2024-01-31T05:13:17.054 INFO:tasks.workunit.client.0.smithi099.stdout:8/703: write d1/dd/ff [3153332,21815] 0 2024-01-31T05:13:17.055 INFO:tasks.workunit.client.0.smithi099.stdout:2/682: write d10/d1c/f26 [3402743,27701] 0 2024-01-31T05:13:17.055 INFO:tasks.workunit.client.0.smithi099.stdout:0/712: mknod d1/d37/d73/dbc/c100 0 2024-01-31T05:13:17.060 INFO:tasks.workunit.client.0.smithi099.stdout:2/683: dread d10/d1c/fa3 [0,4194304] 0 2024-01-31T05:13:17.060 INFO:tasks.workunit.client.0.smithi099.stdout:2/684: write d10/fcf [895377,122499] 0 2024-01-31T05:13:17.063 INFO:tasks.workunit.client.0.smithi099.stdout:2/685: truncate d10/d1b/d7d/d7a/fb0 2068338 0 2024-01-31T05:13:17.063 INFO:tasks.workunit.client.0.smithi099.stdout:2/686: getdents d10/d1b/d7d/d7a/dd7 0 2024-01-31T05:13:17.063 INFO:tasks.workunit.client.0.smithi099.stdout:4/773: dwrite d0/d2/f47 [0,4194304] 0 2024-01-31T05:13:17.063 INFO:tasks.workunit.client.0.smithi099.stdout:4/774: getdents d0/d2/d4b/d93/d59/d8f 0 2024-01-31T05:13:17.069 INFO:tasks.workunit.client.0.smithi099.stdout:7/697: dwrite d6/d32/d3d/d4b/d33/d37/d50/d25/f4c [0,4194304] 0 2024-01-31T05:13:17.069 INFO:tasks.workunit.client.0.smithi099.stdout:7/698: chown d6/d32/d3d/d4b/d33/d37/fa2 444050 1 2024-01-31T05:13:17.069 INFO:tasks.workunit.client.0.smithi099.stdout:1/576: dread d4/dc/d15/f1a [4194304,4194304] 0 2024-01-31T05:13:17.070 INFO:tasks.workunit.client.0.smithi099.stdout:6/585: rename d14/d18/l28 to d14/d18/d52/d7e/d66/d99/lbb 0 2024-01-31T05:13:17.073 INFO:tasks.workunit.client.0.smithi099.stdout:0/713: rename d1/d16/f5a to d1/d30/f101 0 2024-01-31T05:13:17.074 INFO:tasks.workunit.client.0.smithi099.stdout:7/699: mknod d6/d32/d3d/d4b/d9b/ce2 0 2024-01-31T05:13:17.078 INFO:tasks.workunit.client.0.smithi099.stdout:4/775: dread d0/d2/d4b/d93/f94 [0,4194304] 0 2024-01-31T05:13:17.078 INFO:tasks.workunit.client.0.smithi099.stdout:4/776: creat d0/d2/d4b/d93/d59/dff/d43/df9/f104 x:0 0 0 2024-01-31T05:13:17.079 INFO:tasks.workunit.client.0.smithi099.stdout:8/704: dwrite d1/dd/dba/d29/d3f/d56/da0/f3d [0,4194304] 0 2024-01-31T05:13:17.084 INFO:tasks.workunit.client.0.smithi099.stdout:1/577: link d4/db/d24/d4b/d50/d91/c2d d4/db/cb4 0 2024-01-31T05:13:17.084 INFO:tasks.workunit.client.0.smithi099.stdout:6/586: dread d14/d18/d52/d7e/d1c/f8f [0,4194304] 0 2024-01-31T05:13:17.094 INFO:tasks.workunit.client.0.smithi099.stdout:8/705: write d1/dd/dba/d29/d3f/d56/da0/f77 [141539,129977] 0 2024-01-31T05:13:17.094 INFO:tasks.workunit.client.0.smithi099.stdout:8/706: write d1/dd/dba/d19/d21/d3c/fdb [205809,16225] 0 2024-01-31T05:13:17.101 INFO:tasks.workunit.client.0.smithi099.stdout:2/687: dwrite d10/d3a/d69/f8b [0,4194304] 0 2024-01-31T05:13:17.103 INFO:tasks.workunit.client.0.smithi099.stdout:0/714: dwrite d1/d16/d36/d8b/f9c [0,4194304] 0 2024-01-31T05:13:17.103 INFO:tasks.workunit.client.0.smithi099.stdout:6/587: dread d14/d18/d52/d7e/d1c/d29/d43/f91 [0,4194304] 0 2024-01-31T05:13:17.105 INFO:tasks.workunit.client.0.smithi099.stdout:7/700: dwrite d6/d32/d3d/d4b/d33/d37/d50/d25/d72/d8e/f96 [0,4194304] 0 2024-01-31T05:13:17.105 INFO:tasks.workunit.client.0.smithi099.stdout:7/701: read d6/d32/d3d/d4b/d33/d37/d50/d25/d72/fd0 [598811,79647] 0 2024-01-31T05:13:17.105 INFO:tasks.workunit.client.0.smithi099.stdout:7/702: chown d6/d32/d3d/d4b/d33/f71 4 1 2024-01-31T05:13:17.105 INFO:tasks.workunit.client.0.smithi099.stdout:0/715: creat d1/d8/f102 x:0 0 0 2024-01-31T05:13:17.106 INFO:tasks.workunit.client.0.smithi099.stdout:7/703: mkdir d6/d98/de3 0 2024-01-31T05:13:17.110 INFO:tasks.workunit.client.0.smithi099.stdout:0/716: unlink d1/d30/d45/d66/f1d 0 2024-01-31T05:13:17.111 INFO:tasks.workunit.client.0.smithi099.stdout:0/717: write d1/d16/d36/f57 [1563288,52590] 0 2024-01-31T05:13:17.116 INFO:tasks.workunit.client.0.smithi099.stdout:7/704: rename d6/d32/d3d/d4b/d33/d37/d50/l48 to d6/d32/d3d/d4b/d33/d37/d50/d5e/le4 0 2024-01-31T05:13:17.116 INFO:tasks.workunit.client.0.smithi099.stdout:7/705: fsync d6/d32/d3d/d4b/d33/d37/f40 0 2024-01-31T05:13:17.116 INFO:tasks.workunit.client.0.smithi099.stdout:6/588: dread d14/f16 [0,4194304] 0 2024-01-31T05:13:17.117 INFO:tasks.workunit.client.0.smithi099.stdout:6/589: getdents d14/d18/d52/d7e/d66/d99 0 2024-01-31T05:13:17.121 INFO:tasks.workunit.client.0.smithi099.stdout:0/718: rmdir d1/d37 39 2024-01-31T05:13:17.121 INFO:tasks.workunit.client.0.smithi099.stdout:1/578: getdents d4/db/d24/d4b 0 2024-01-31T05:13:17.123 INFO:tasks.workunit.client.0.smithi099.stdout:1/579: mkdir d4/db/d24/d4b/d50/db5 0 2024-01-31T05:13:17.123 INFO:tasks.workunit.client.0.smithi099.stdout:8/707: dwrite d1/da6/fcb [0,4194304] 0 2024-01-31T05:13:17.125 INFO:tasks.workunit.client.0.smithi099.stdout:5/638: sync 2024-01-31T05:13:17.125 INFO:tasks.workunit.client.0.smithi099.stdout:5/639: creat d6/da/d14/d94/fd1 x:0 0 0 2024-01-31T05:13:17.129 INFO:tasks.workunit.client.0.smithi099.stdout:6/590: mkdir d14/d18/d52/dbc 0 2024-01-31T05:13:17.131 INFO:tasks.workunit.client.0.smithi099.stdout:1/580: rename d4/db/d3a/d7e/d85/lad to d4/lb6 0 2024-01-31T05:13:17.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:16 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:17.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:16 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:17.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:16 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:17.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:16 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:17.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:16 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:17.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:16 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:17.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:16 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:17.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:16 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:17.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:16 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:17.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:16 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:17.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:16 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:17.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:16 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:17.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:16 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:17.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:16 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:17.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:16 smithi179 ceph-mon[35652]: scrub summary: active paths [/] 2024-01-31T05:13:17.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:16 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:17.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:16 smithi179 ceph-mon[35652]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:17.139 INFO:tasks.workunit.client.0.smithi099.stdout:2/688: dwrite d10/d1b/d7d/d7a/fc7 [0,4194304] 0 2024-01-31T05:13:17.142 INFO:tasks.workunit.client.0.smithi099.stdout:6/591: write d14/d18/d52/d22/d71/f72 [1449048,105197] 0 2024-01-31T05:13:17.142 INFO:tasks.workunit.client.0.smithi099.stdout:6/592: readlink d14/d18/d52/d7e/l39 0 2024-01-31T05:13:17.142 INFO:tasks.workunit.client.0.smithi099.stdout:6/593: truncate d14/d18/d52/d7e/d1c/d29/d79/fb7 984758 0 2024-01-31T05:13:17.142 INFO:tasks.workunit.client.0.smithi099.stdout:6/594: chown d14/d18/d52/d7e/d1c/fad 616 1 2024-01-31T05:13:17.144 INFO:tasks.workunit.client.0.smithi099.stdout:6/595: mknod d14/d18/d52/d7e/d1c/d29/d94/cbd 0 2024-01-31T05:13:17.144 INFO:tasks.workunit.client.0.smithi099.stdout:6/596: readlink d14/d18/d3b/l97 0 2024-01-31T05:13:17.147 INFO:tasks.workunit.client.0.smithi099.stdout:6/597: creat d14/d18/d9d/fbe x:0 0 0 2024-01-31T05:13:17.147 INFO:tasks.workunit.client.0.smithi099.stdout:6/598: dread - d14/d18/d52/d7e/d1c/f82 zero size 2024-01-31T05:13:17.147 INFO:tasks.workunit.client.0.smithi099.stdout:6/599: readlink d14/d18/l4e 0 2024-01-31T05:13:17.156 INFO:tasks.workunit.client.0.smithi099.stdout:2/689: write d10/f42 [3998624,15361] 0 2024-01-31T05:13:17.156 INFO:tasks.workunit.client.0.smithi099.stdout:2/690: chown d10/l17 28835421 1 2024-01-31T05:13:17.160 INFO:tasks.workunit.client.0.smithi099.stdout:0/719: dwrite d1/d37/d73/f7e [0,4194304] 0 2024-01-31T05:13:17.160 INFO:tasks.workunit.client.0.smithi099.stdout:6/600: dread d14/f16 [0,4194304] 0 2024-01-31T05:13:17.161 INFO:tasks.workunit.client.0.smithi099.stdout:6/601: creat d14/d18/d52/d7e/fbf x:0 0 0 2024-01-31T05:13:17.161 INFO:tasks.workunit.client.0.smithi099.stdout:6/602: stat d14/d18/d52/d7e/d1c/d29/d43/f87 0 2024-01-31T05:13:17.162 INFO:tasks.workunit.client.0.smithi099.stdout:8/708: dwrite d1/dd/dba/d19/d21/d3c/fe4 [0,4194304] 0 2024-01-31T05:13:17.163 INFO:tasks.workunit.client.0.smithi099.stdout:8/709: read - d1/dd/d7b/fb2 zero size 2024-01-31T05:13:17.163 INFO:tasks.workunit.client.0.smithi099.stdout:5/640: dwrite d6/da/d14/d61/d98/faf [0,4194304] 0 2024-01-31T05:13:17.163 INFO:tasks.workunit.client.0.smithi099.stdout:8/710: read d1/dd/dba/d29/d3f/fb3 [65760,130741] 0 2024-01-31T05:13:17.167 INFO:tasks.workunit.client.0.smithi099.stdout:7/706: dwrite d6/d32/d3d/dd7/fbc [0,4194304] 0 2024-01-31T05:13:17.167 INFO:tasks.workunit.client.0.smithi099.stdout:5/641: creat d6/da/d14/d3d/d51/fd2 x:0 0 0 2024-01-31T05:13:17.167 INFO:tasks.workunit.client.0.smithi099.stdout:5/642: readlink d6/da/l26 0 2024-01-31T05:13:17.167 INFO:tasks.workunit.client.0.smithi099.stdout:5/643: write d6/da/d14/d3d/d51/d82/d9a/fb5 [1312949,5653] 0 2024-01-31T05:13:17.169 INFO:tasks.workunit.client.0.smithi099.stdout:8/711: rename d1/dd/dba/d29/d3f/d56/da0/d2e/d69 to d1/dd/d1d/dea 0 2024-01-31T05:13:17.169 INFO:tasks.workunit.client.0.smithi099.stdout:8/712: chown d1/dd/dba/d19/dc5/f54 84601 1 2024-01-31T05:13:17.169 INFO:tasks.workunit.client.0.smithi099.stdout:8/713: creat d1/da6/feb x:0 0 0 2024-01-31T05:13:17.172 INFO:tasks.workunit.client.0.smithi099.stdout:7/707: getdents d6/d32/d3d/d4b/d33/d37/d50/d25/d47 0 2024-01-31T05:13:17.173 INFO:tasks.workunit.client.0.smithi099.stdout:7/708: mknod d6/d32/ce5 0 2024-01-31T05:13:17.174 INFO:tasks.workunit.client.0.smithi099.stdout:7/709: mkdir d6/d32/d3d/de6 0 2024-01-31T05:13:17.176 INFO:tasks.workunit.client.0.smithi099.stdout:5/644: dread d6/f6d [0,4194304] 0 2024-01-31T05:13:17.176 INFO:tasks.workunit.client.0.smithi099.stdout:5/645: write d6/fac [83034,100293] 0 2024-01-31T05:13:17.181 INFO:tasks.workunit.client.0.smithi099.stdout:8/714: dread d1/dd/dba/d29/d3f/d56/da0/f27 [0,4194304] 0 2024-01-31T05:13:17.183 INFO:tasks.workunit.client.0.smithi099.stdout:6/603: link d14/d18/f96 d14/d18/d52/d7e/d1c/da6/fc0 0 2024-01-31T05:13:17.183 INFO:tasks.workunit.client.0.smithi099.stdout:6/604: stat d14/d18/d52/d7e/f37 0 2024-01-31T05:13:17.184 INFO:tasks.workunit.client.0.smithi099.stdout:6/605: dread d14/d18/d52/d7e/d1c/d29/d94/faf [0,4194304] 0 2024-01-31T05:13:17.185 INFO:tasks.workunit.client.0.smithi099.stdout:8/715: rename d1/dd/fa7 to d1/dd/dba/d29/d3f/d56/d57/fec 0 2024-01-31T05:13:17.185 INFO:tasks.workunit.client.0.smithi099.stdout:8/716: chown d1/dd/dba/d19/dc5/cc3 1649939 1 2024-01-31T05:13:17.185 INFO:tasks.workunit.client.0.smithi099.stdout:8/717: fdatasync d1/dd/dba/d19/f53 0 2024-01-31T05:13:17.185 INFO:tasks.workunit.client.0.smithi099.stdout:0/720: dwrite d1/d37/d4a/d6f/dc9/dcf/fde [0,4194304] 0 2024-01-31T05:13:17.185 INFO:tasks.workunit.client.0.smithi099.stdout:6/606: mknod d14/cc1 0 2024-01-31T05:13:17.187 INFO:tasks.workunit.client.0.smithi099.stdout:7/710: write d6/d32/d3d/d4b/d33/d37/d50/d25/d72/fb4 [5812234,24262] 0 2024-01-31T05:13:17.188 INFO:tasks.workunit.client.0.smithi099.stdout:8/718: dread d1/dd/dba/d29/d3f/d56/d57/fec [0,4194304] 0 2024-01-31T05:13:17.188 INFO:tasks.workunit.client.0.smithi099.stdout:8/719: fdatasync d1/dd/dba/d20/f97 0 2024-01-31T05:13:17.189 INFO:tasks.workunit.client.0.smithi099.stdout:8/720: dread d1/dd/dba/d19/f9d [0,4194304] 0 2024-01-31T05:13:17.192 INFO:tasks.workunit.client.0.smithi099.stdout:7/711: symlink d6/le7 0 2024-01-31T05:13:17.194 INFO:tasks.workunit.client.0.smithi099.stdout:8/721: mkdir d1/dd/dba/d29/d3f/d56/da0/d2e/de1/ded 0 2024-01-31T05:13:17.194 INFO:tasks.workunit.client.0.smithi099.stdout:8/722: truncate d1/dd/dba/d20/f97 37010 0 2024-01-31T05:13:17.195 INFO:tasks.workunit.client.0.smithi099.stdout:6/607: dread d14/d18/d52/d7e/d1c/da6/fc0 [0,4194304] 0 2024-01-31T05:13:17.195 INFO:tasks.workunit.client.0.smithi099.stdout:0/721: rename d1/d16/d36 to d1/d56/d103 0 2024-01-31T05:13:17.196 INFO:tasks.workunit.client.0.smithi099.stdout:6/608: creat d14/d18/d52/d7e/fc2 x:0 0 0 2024-01-31T05:13:17.201 INFO:tasks.workunit.client.0.smithi099.stdout:7/712: dread d6/d32/d3d/d4b/d33/f71 [0,4194304] 0 2024-01-31T05:13:17.202 INFO:tasks.workunit.client.0.smithi099.stdout:7/713: fsync d6/d32/d3d/d4b/d33/fac 0 2024-01-31T05:13:17.205 INFO:tasks.workunit.client.0.smithi099.stdout:8/723: dread d1/dd/dba/d29/d3f/d56/f90 [0,4194304] 0 2024-01-31T05:13:17.206 INFO:tasks.workunit.client.0.smithi099.stdout:6/609: link d14/d18/d52/d7e/d1c/f5f d14/d18/d52/d7e/d1c/fc3 0 2024-01-31T05:13:17.206 INFO:tasks.workunit.client.0.smithi099.stdout:8/724: rename d1/dd/d65/l8b to d1/dd/d1d/dbc/lee 0 2024-01-31T05:13:17.207 INFO:tasks.workunit.client.0.smithi099.stdout:6/610: getdents d14/d18/d52/d7e/d1c/d29/d79 0 2024-01-31T05:13:17.208 INFO:tasks.workunit.client.0.smithi099.stdout:8/725: creat d1/dd/d65/d7f/d81/dd4/fef x:0 0 0 2024-01-31T05:13:17.208 INFO:tasks.workunit.client.0.smithi099.stdout:8/726: chown d1/dd/dba/d29/d3f/fb3 15 1 2024-01-31T05:13:17.211 INFO:tasks.workunit.client.0.smithi099.stdout:7/714: write d6/d32/d3d/dd7/fbc [2753296,91472] 0 2024-01-31T05:13:17.215 INFO:tasks.workunit.client.0.smithi099.stdout:6/611: dread d14/d18/d52/d7e/d1c/d29/f3f [0,4194304] 0 2024-01-31T05:13:17.217 INFO:tasks.workunit.client.0.smithi099.stdout:6/612: unlink d14/d18/d52/d7e/d1c/d29/l9e 0 2024-01-31T05:13:17.220 INFO:tasks.workunit.client.0.smithi099.stdout:8/727: dread d1/dd/dba/d20/f4b [0,4194304] 0 2024-01-31T05:13:17.220 INFO:tasks.workunit.client.0.smithi099.stdout:8/728: readlink d1/dd/d65/d7f/lb6 0 2024-01-31T05:13:17.223 INFO:tasks.workunit.client.0.smithi099.stdout:7/715: dread d6/d32/d3d/d4b/d33/d37/d50/d25/d7a/fa3 [0,4194304] 0 2024-01-31T05:13:17.223 INFO:tasks.workunit.client.0.smithi099.stdout:7/716: truncate d6/d32/d3d/d4b/d33/d37/d50/d25/d72/d8e/d9a/fcb 1079328 0 2024-01-31T05:13:17.225 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:16 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:17.225 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:16 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:17.225 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:16 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:17.226 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:16 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:17.226 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:16 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:17.226 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:16 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:17.226 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:16 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:17.226 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:16 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:17.226 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:16 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:17.226 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:16 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:17.226 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:16 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:17.226 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:16 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:17.226 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:16 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:17.226 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:16 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:17.226 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:16 smithi099 ceph-mon[31615]: scrub summary: active paths [/] 2024-01-31T05:13:17.226 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:16 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:17.226 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:16 smithi099 ceph-mon[31615]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:17.227 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:17 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mon-a[31611]: 2024-01-31T05:13:17.226+0000 7fcac313a700 -1 log_channel(cluster) log [ERR] : Health check update: 4 MDSs report damaged metadata (MDS_DAMAGE) 2024-01-31T05:13:17.229 INFO:tasks.workunit.client.0.smithi099.stdout:8/729: write d1/dd/d7b/d85/fbb [3192038,1276] 0 2024-01-31T05:13:17.238 INFO:tasks.workunit.client.0.smithi099.stdout:7/717: dread d6/d32/d3d/d46/f83 [0,4194304] 0 2024-01-31T05:13:17.240 INFO:tasks.workunit.client.0.smithi099.stdout:7/718: readlink d6/d32/d3d/d4b/d33/d37/d50/l31 0 2024-01-31T05:13:17.243 INFO:tasks.workunit.client.0.smithi099.stdout:7/719: rmdir d6/d32/d3d/d4b/d33/d37/d50/d25/d7a/dce 0 2024-01-31T05:13:17.246 INFO:tasks.workunit.client.0.smithi099.stdout:7/720: rename d6/d32/d3d/d4b/d33/d37/d50/d25/d43 to d6/d32/d3d/d4b/d33/d37/d50/d5e/de8 0 2024-01-31T05:13:17.246 INFO:tasks.workunit.client.0.smithi099.stdout:6/613: dwrite d14/d18/d52/f84 [0,4194304] 0 2024-01-31T05:13:17.247 INFO:tasks.workunit.client.0.smithi099.stdout:6/614: creat d14/d18/d52/d7e/fc4 x:0 0 0 2024-01-31T05:13:17.252 INFO:tasks.workunit.client.0.smithi099.stdout:8/730: dwrite d1/dd/dba/d29/d3f/d56/d57/f89 [0,4194304] 0 2024-01-31T05:13:17.252 INFO:tasks.workunit.client.0.smithi099.stdout:8/731: chown d1/dd/dba/da9 2703 1 2024-01-31T05:13:17.254 INFO:tasks.workunit.client.0.smithi099.stdout:8/732: rmdir d1/dd/d4f 39 2024-01-31T05:13:17.259 INFO:tasks.workunit.client.0.smithi099.stdout:6/615: read d14/d18/f93 [2656838,104762] 0 2024-01-31T05:13:17.260 INFO:tasks.workunit.client.0.smithi099.stdout:6/616: symlink d14/d18/d52/d7e/d1c/d29/d79/lc5 0 2024-01-31T05:13:17.260 INFO:tasks.workunit.client.0.smithi099.stdout:6/617: dread - d14/d18/d52/d7e/fc4 zero size 2024-01-31T05:13:17.261 INFO:tasks.workunit.client.0.smithi099.stdout:6/618: mkdir d14/d18/d52/d7e/d1c/d29/d79/dc6 0 2024-01-31T05:13:17.263 INFO:tasks.workunit.client.0.smithi099.stdout:6/619: unlink d14/d18/d52/d7e/c2d 0 2024-01-31T05:13:17.264 INFO:tasks.workunit.client.0.smithi099.stdout:6/620: rmdir d14/d18 39 2024-01-31T05:13:17.264 INFO:tasks.workunit.client.0.smithi099.stdout:7/721: dread d6/d32/d3d/d4b/d33/d37/d50/d25/d72/d8e/f96 [0,4194304] 0 2024-01-31T05:13:17.265 INFO:tasks.workunit.client.0.smithi099.stdout:7/722: write d6/d32/d3d/d4b/d33/d37/d50/d25/f92 [833734,118879] 0 2024-01-31T05:13:17.284 INFO:tasks.workunit.client.0.smithi099.stdout:8/733: dwrite d1/dd/d4f/d51/f5d [0,4194304] 0 2024-01-31T05:13:17.288 INFO:tasks.workunit.client.0.smithi099.stdout:8/734: getdents d1 0 2024-01-31T05:13:17.289 INFO:tasks.workunit.client.0.smithi099.stdout:8/735: getdents d1/da6/db4 0 2024-01-31T05:13:17.289 INFO:tasks.workunit.client.0.smithi099.stdout:8/736: write d1/dd/dba/d19/fda [167900,52766] 0 2024-01-31T05:13:17.294 INFO:tasks.workunit.client.0.smithi099.stdout:8/737: unlink d1/dd/le9 0 2024-01-31T05:13:17.294 INFO:tasks.workunit.client.0.smithi099.stdout:8/738: dread - d1/dd/d65/d7f/d81/dd4/fef zero size 2024-01-31T05:13:17.294 INFO:tasks.workunit.client.0.smithi099.stdout:8/739: dread - d1/dd/dba/d19/d21/f62 zero size 2024-01-31T05:13:17.295 INFO:tasks.workunit.client.0.smithi099.stdout:8/740: mkdir d1/dd/dba/df0 0 2024-01-31T05:13:17.295 INFO:tasks.workunit.client.0.smithi099.stdout:8/741: fdatasync d1/dd/dba/d19/d21/d3c/fdb 0 2024-01-31T05:13:17.296 INFO:tasks.workunit.client.0.smithi099.stdout:8/742: symlink d1/dd/dba/d19/d21/lf1 0 2024-01-31T05:13:17.297 INFO:tasks.workunit.client.0.smithi099.stdout:8/743: creat d1/dd/dba/d29/d3f/d56/d57/ff2 x:0 0 0 2024-01-31T05:13:17.301 INFO:tasks.workunit.client.0.smithi099.stdout:7/723: dwrite d6/d32/d3d/d4b/d33/d37/d50/d25/d79/f8c [4194304,4194304] 0 2024-01-31T05:13:17.301 INFO:tasks.workunit.client.0.smithi099.stdout:7/724: creat d6/d32/d3d/dd7/dc5/fe9 x:0 0 0 2024-01-31T05:13:17.303 INFO:tasks.workunit.client.0.smithi099.stdout:8/744: dread d1/dd/ff [0,4194304] 0 2024-01-31T05:13:17.303 INFO:tasks.workunit.client.0.smithi099.stdout:6/621: dwrite d14/d18/d52/d7e/f83 [0,4194304] 0 2024-01-31T05:13:17.303 INFO:tasks.workunit.client.0.smithi099.stdout:7/725: symlink d6/d32/d3d/d4b/d33/d37/lea 0 2024-01-31T05:13:17.304 INFO:tasks.workunit.client.0.smithi099.stdout:8/745: symlink d1/dd/dba/d19/d21/lf3 0 2024-01-31T05:13:17.304 INFO:tasks.workunit.client.0.smithi099.stdout:8/746: rename d1/dd/dba/d29/d3f to d1/dd/dba/d29/d3f/df4 22 2024-01-31T05:13:17.309 INFO:tasks.workunit.client.0.smithi099.stdout:7/726: symlink d6/d32/d3d/d4b/leb 0 2024-01-31T05:13:17.310 INFO:tasks.workunit.client.0.smithi099.stdout:7/727: rmdir d6/d32/d3d/d46/dd9 0 2024-01-31T05:13:17.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:16 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:17.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:16 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:17.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:16 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:17.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:16 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:17.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:16 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:17.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:16 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:17.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:16 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:17.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:16 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:17.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:16 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:17.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:16 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:17.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:16 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:17.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:16 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:17.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:16 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:17.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:16 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:17.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:16 smithi181 ceph-mon[36434]: scrub summary: active paths [/] 2024-01-31T05:13:17.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:16 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:17.322 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:16 smithi181 ceph-mon[36434]: scrub summary: idle+waiting paths [/] 2024-01-31T05:13:17.343 INFO:tasks.workunit.client.0.smithi099.stdout:8/747: dwrite d1/dd/dba/d29/d3f/d56/da0/d2e/de1/fe3 [0,4194304] 0 2024-01-31T05:13:17.345 INFO:tasks.workunit.client.0.smithi099.stdout:8/748: mknod d1/cf5 0 2024-01-31T05:13:17.345 INFO:tasks.workunit.client.0.smithi099.stdout:8/749: write d1/da6/feb [752807,27539] 0 2024-01-31T05:13:17.346 INFO:tasks.workunit.client.0.smithi099.stdout:7/728: dwrite d6/d32/d3d/d4b/d33/d37/d4e/f62 [0,4194304] 0 2024-01-31T05:13:17.346 INFO:tasks.workunit.client.0.smithi099.stdout:6/622: dwrite d14/d18/d52/d7e/d1c/f8f [0,4194304] 0 2024-01-31T05:13:17.346 INFO:tasks.workunit.client.0.smithi099.stdout:6/623: truncate d14/d18/d52/d7e/d1c/d29/d43/f87 90679 0 2024-01-31T05:13:17.348 INFO:tasks.workunit.client.0.smithi099.stdout:7/729: symlink d6/d32/d3d/d46/lec 0 2024-01-31T05:13:17.348 INFO:tasks.workunit.client.0.smithi099.stdout:6/624: creat d14/d18/d52/d7e/d66/fc7 x:0 0 0 2024-01-31T05:13:17.348 INFO:tasks.workunit.client.0.smithi099.stdout:7/730: stat d6/d32/d3d/d4b/d33/d37/d50/d25/d47/f57 0 2024-01-31T05:13:17.348 INFO:tasks.workunit.client.0.smithi099.stdout:6/625: chown d14/c51 487 1 2024-01-31T05:13:17.348 INFO:tasks.workunit.client.0.smithi099.stdout:6/626: creat d14/d18/d9d/fc8 x:0 0 0 2024-01-31T05:13:17.357 INFO:tasks.workunit.client.0.smithi099.stdout:8/750: read d1/dd/dba/d29/d3f/d56/f90 [699290,24277] 0 2024-01-31T05:13:17.358 INFO:tasks.workunit.client.0.smithi099.stdout:8/751: read d1/dd/dba/d20/f97 [1613,114984] 0 2024-01-31T05:13:17.360 INFO:tasks.workunit.client.0.smithi099.stdout:8/752: unlink d1/dd/dba/d19/d21/d3c/c7c 0 2024-01-31T05:13:17.374 INFO:tasks.workunit.client.0.smithi099.stdout:7/731: dwrite d6/d32/d3d/d4b/d33/d37/d50/d25/d47/f91 [0,4194304] 0 2024-01-31T05:13:17.376 INFO:tasks.workunit.client.0.smithi099.stdout:7/732: rmdir d6/d32/d3d/d4b/d33/d37/d4e 39 2024-01-31T05:13:17.377 INFO:tasks.workunit.client.0.smithi099.stdout:7/733: fdatasync d6/d32/f5b 0 2024-01-31T05:13:17.377 INFO:tasks.workunit.client.0.smithi099.stdout:7/734: symlink d6/d32/d3d/dd7/led 0 2024-01-31T05:13:17.379 INFO:tasks.workunit.client.0.smithi099.stdout:8/753: dwrite d1/dd/dba/d19/dbd/fdf [0,4194304] 0 2024-01-31T05:13:17.379 INFO:tasks.workunit.client.0.smithi099.stdout:8/754: truncate d1/dd/dba/d29/d3f/fd7 948477 0 2024-01-31T05:13:17.390 INFO:tasks.workunit.client.0.smithi099.stdout:8/755: dread d1/dd/dba/d19/dbd/fdf [0,4194304] 0 2024-01-31T05:13:17.401 INFO:tasks.workunit.client.0.smithi099.stdout:8/756: read d1/dd/dba/d19/dc5/f54 [1462168,75301] 0 2024-01-31T05:13:17.427 INFO:tasks.workunit.client.0.smithi099.stdout:8/757: dwrite d1/da6/fcb [0,4194304] 0 2024-01-31T05:13:17.427 INFO:tasks.workunit.client.0.smithi099.stdout:8/758: chown d1/c64 16472454 1 2024-01-31T05:13:17.435 INFO:tasks.workunit.client.0.smithi099.stdout:8/759: link d1/dd/dba/l14 d1/dd/d65/d7f/d81/dc7/dce/lf6 0 2024-01-31T05:13:17.437 INFO:tasks.workunit.client.0.smithi099.stdout:8/760: symlink d1/dd/dba/d29/d3f/d56/lf7 0 2024-01-31T05:13:17.456 INFO:tasks.workunit.client.0.smithi099.stdout:8/761: dwrite d1/dd/d7b/fb2 [0,4194304] 0 2024-01-31T05:13:17.458 INFO:tasks.workunit.client.0.smithi099.stdout:8/762: mknod d1/dd/dba/cf8 0 2024-01-31T05:13:17.459 INFO:tasks.workunit.client.0.smithi099.stdout:8/763: creat d1/dd/d65/d7f/d81/dc7/dce/ff9 x:0 0 0 2024-01-31T05:13:17.468 INFO:tasks.workunit.client.0.smithi099.stdout:8/764: write d1/dd/dba/d19/f1f [1956542,13881] 0 2024-01-31T05:13:17.469 INFO:tasks.workunit.client.0.smithi099.stdout:8/765: creat d1/dd/ffa x:0 0 0 2024-01-31T05:13:17.470 INFO:tasks.workunit.client.0.smithi099.stdout:8/766: write d1/dd/d7b/d85/fbb [818171,58115] 0 2024-01-31T05:13:17.471 INFO:tasks.workunit.client.0.smithi099.stdout:8/767: rename d1/dd/dba/d29/c8c to d1/dd/d4f/d51/d83/cfb 0 2024-01-31T05:13:17.472 INFO:tasks.workunit.client.0.smithi099.stdout:8/768: mknod d1/dd/dba/d19/dc5/cfc 0 2024-01-31T05:13:17.497 INFO:tasks.workunit.client.0.smithi099.stdout:8/769: rename d1/dd/dba/f32 to d1/dd/d65/d7f/d81/dc7/dce/ffd 0 2024-01-31T05:13:17.498 INFO:tasks.workunit.client.0.smithi099.stdout:8/770: creat d1/dd/d4f/d51/d83/ffe x:0 0 0 2024-01-31T05:13:17.516 INFO:tasks.workunit.client.0.smithi099.stdout:8/771: dwrite d1/dd/dba/d19/dbd/fdf [4194304,4194304] 0 2024-01-31T05:13:17.518 INFO:tasks.workunit.client.0.smithi099.stdout:8/772: mknod d1/dd/dba/d19/dc5/cff 0 2024-01-31T05:13:17.529 INFO:tasks.workunit.client.0.smithi099.stdout:8/773: dread d1/da6/fcb [0,4194304] 0 2024-01-31T05:13:17.529 INFO:tasks.workunit.client.0.smithi099.stdout:8/774: write d1/dd/d1d/f40 [5054610,77886] 0 2024-01-31T05:13:17.529 INFO:tasks.workunit.client.0.smithi099.stdout:8/775: creat d1/dd/dba/d29/d3f/d56/f100 x:0 0 0 2024-01-31T05:13:18.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:17 smithi179 ceph-mon[35652]: pgmap v406: 97 pgs: 97 active+clean; 978 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 133 MiB/s rd, 164 MiB/s wr, 1.43k op/s 2024-01-31T05:13:18.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:17 smithi179 ceph-mon[35652]: Health check update: 4 MDSs report damaged metadata (MDS_DAMAGE) 2024-01-31T05:13:18.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:17 smithi099 ceph-mon[31615]: pgmap v406: 97 pgs: 97 active+clean; 978 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 133 MiB/s rd, 164 MiB/s wr, 1.43k op/s 2024-01-31T05:13:18.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:17 smithi099 ceph-mon[31615]: Health check update: 4 MDSs report damaged metadata (MDS_DAMAGE) 2024-01-31T05:13:18.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:17 smithi181 ceph-mon[36434]: pgmap v406: 97 pgs: 97 active+clean; 978 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 133 MiB/s rd, 164 MiB/s wr, 1.43k op/s 2024-01-31T05:13:18.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:17 smithi181 ceph-mon[36434]: Health check update: 4 MDSs report damaged metadata (MDS_DAMAGE) 2024-01-31T05:13:19.871 INFO:tasks.workunit.client.0.smithi099.stdout:5/646: sync 2024-01-31T05:13:19.871 INFO:tasks.workunit.client.0.smithi099.stdout:0/722: sync 2024-01-31T05:13:19.871 INFO:tasks.workunit.client.0.smithi099.stdout:5/647: fdatasync d6/da/d14/fb3 0 2024-01-31T05:13:19.871 INFO:tasks.workunit.client.0.smithi099.stdout:8/776: sync 2024-01-31T05:13:19.871 INFO:tasks.workunit.client.0.smithi099.stdout:7/735: sync 2024-01-31T05:13:19.871 INFO:tasks.workunit.client.0.smithi099.stdout:3/712: sync 2024-01-31T05:13:19.871 INFO:tasks.workunit.client.0.smithi099.stdout:9/692: sync 2024-01-31T05:13:19.871 INFO:tasks.workunit.client.0.smithi099.stdout:1/581: sync 2024-01-31T05:13:19.871 INFO:tasks.workunit.client.0.smithi099.stdout:2/691: sync 2024-01-31T05:13:19.871 INFO:tasks.workunit.client.0.smithi099.stdout:1/582: fsync d4/db/d24/d4b/f77 0 2024-01-31T05:13:19.872 INFO:tasks.workunit.client.0.smithi099.stdout:4/777: sync 2024-01-31T05:13:19.872 INFO:tasks.workunit.client.0.smithi099.stdout:4/778: chown d0/d8/d19/d98/d9b/dab 1184068 1 2024-01-31T05:13:19.872 INFO:tasks.workunit.client.0.smithi099.stdout:9/693: creat d0/d7/da6/ff1 x:0 0 0 2024-01-31T05:13:19.872 INFO:tasks.workunit.client.0.smithi099.stdout:1/583: truncate d4/dc/d29/fa8 5213380 0 2024-01-31T05:13:19.872 INFO:tasks.workunit.client.0.smithi099.stdout:9/694: chown d0 1507929 1 2024-01-31T05:13:19.872 INFO:tasks.workunit.client.0.smithi099.stdout:9/695: creat d0/d3e/d87/dc9/d5e/d72/d89/ff2 x:0 0 0 2024-01-31T05:13:19.872 INFO:tasks.workunit.client.0.smithi099.stdout:2/692: write d10/d1c/d43/fc6 [97248,97493] 0 2024-01-31T05:13:19.872 INFO:tasks.workunit.client.0.smithi099.stdout:6/627: sync 2024-01-31T05:13:19.873 INFO:tasks.workunit.client.0.smithi099.stdout:5/648: rename d6/f3e to d6/da/d3f/d5a/fd3 0 2024-01-31T05:13:19.875 INFO:tasks.workunit.client.0.smithi099.stdout:7/736: creat d6/d32/d3d/d4b/fee x:0 0 0 2024-01-31T05:13:19.876 INFO:tasks.workunit.client.0.smithi099.stdout:4/779: write d0/d1e/d61/fe2 [2129680,22329] 0 2024-01-31T05:13:19.876 INFO:tasks.workunit.client.0.smithi099.stdout:4/780: write d0/d2/d4b/d93/d59/dff/d43/df9/f104 [335585,20420] 0 2024-01-31T05:13:19.876 INFO:tasks.workunit.client.0.smithi099.stdout:4/781: chown d0/d2/d4b/d93/d39/fec 25 1 2024-01-31T05:13:19.882 INFO:tasks.workunit.client.0.smithi099.stdout:9/696: creat d0/d3e/d87/dc9/d5e/ff3 x:0 0 0 2024-01-31T05:13:19.883 INFO:tasks.workunit.client.0.smithi099.stdout:8/777: mkdir d1/dd/d101 0 2024-01-31T05:13:19.885 INFO:tasks.workunit.client.0.smithi099.stdout:3/713: write d10/f16 [5448698,2074] 0 2024-01-31T05:13:19.886 INFO:tasks.workunit.client.0.smithi099.stdout:3/714: fsync d10/d32/d85/d77/fd0 0 2024-01-31T05:13:19.887 INFO:tasks.workunit.client.0.smithi099.stdout:5/649: rename d6/da/d14/d3d/lca to d6/da/d14/d3d/d6e/d21/ld4 0 2024-01-31T05:13:19.888 INFO:tasks.workunit.client.0.smithi099.stdout:4/782: truncate d0/d2/f9f 123615 0 2024-01-31T05:13:19.891 INFO:tasks.workunit.client.0.smithi099.stdout:2/693: dread d10/d1c/f2d [0,4194304] 0 2024-01-31T05:13:19.891 INFO:tasks.workunit.client.0.smithi099.stdout:2/694: fdatasync d10/f15 0 2024-01-31T05:13:19.891 INFO:tasks.workunit.client.0.smithi099.stdout:2/695: fsync d10/d2b/d58/fb1 0 2024-01-31T05:13:19.892 INFO:tasks.workunit.client.0.smithi099.stdout:8/778: rmdir d1/dd/d101 0 2024-01-31T05:13:19.892 INFO:tasks.workunit.client.0.smithi099.stdout:8/779: creat d1/dd/d1d/f102 x:0 0 0 2024-01-31T05:13:19.893 INFO:tasks.workunit.client.0.smithi099.stdout:0/723: dread d1/d37/f93 [0,4194304] 0 2024-01-31T05:13:19.893 INFO:tasks.workunit.client.0.smithi099.stdout:0/724: fsync d1/d30/d45/d66/d97/fe1 0 2024-01-31T05:13:19.893 INFO:tasks.workunit.client.0.smithi099.stdout:4/783: rename d0/d2/d4b/d93/d59/dff/dee to d0/d2/d4b/d93/d17/d105 0 2024-01-31T05:13:19.900 INFO:tasks.workunit.client.0.smithi099.stdout:2/696: write d10/d20/f50 [1541302,75585] 0 2024-01-31T05:13:19.901 INFO:tasks.workunit.client.0.smithi099.stdout:8/780: symlink d1/dd/dba/d19/l103 0 2024-01-31T05:13:19.901 INFO:tasks.workunit.client.0.smithi099.stdout:8/781: truncate d1/dd/dba/d29/fa2 120464 0 2024-01-31T05:13:19.901 INFO:tasks.workunit.client.0.smithi099.stdout:5/650: rmdir d6/da/d14/d3d/d57/d92 39 2024-01-31T05:13:19.901 INFO:tasks.workunit.client.0.smithi099.stdout:5/651: truncate d6/da/d14/d3d/d51/d82/d9a/fb5 2190102 0 2024-01-31T05:13:19.904 INFO:tasks.workunit.client.0.smithi099.stdout:3/715: dread d10/d1e/f25 [0,4194304] 0 2024-01-31T05:13:19.904 INFO:tasks.workunit.client.0.smithi099.stdout:3/716: chown d10/d27/d34/d44/d60/cbc 54699960 1 2024-01-31T05:13:19.904 INFO:tasks.workunit.client.0.smithi099.stdout:3/717: fsync d10/d27/d34/d44/d60/fa8 0 2024-01-31T05:13:19.904 INFO:tasks.workunit.client.0.smithi099.stdout:3/718: creat d10/d27/d34/d44/d95/daf/f101 x:0 0 0 2024-01-31T05:13:19.904 INFO:tasks.workunit.client.0.smithi099.stdout:8/782: mkdir d1/dd/dba/da9/d104 0 2024-01-31T05:13:19.904 INFO:tasks.workunit.client.0.smithi099.stdout:4/784: link d0/d2/d4b/d93/fcb d0/d2/d4b/d93/d17/def/f106 0 2024-01-31T05:13:19.904 INFO:tasks.workunit.client.0.smithi099.stdout:6/628: unlink d14/d18/d52/l1d 0 2024-01-31T05:13:19.904 INFO:tasks.workunit.client.0.smithi099.stdout:2/697: write d10/d3a/d69/d82/f98 [621620,63864] 0 2024-01-31T05:13:19.904 INFO:tasks.workunit.client.0.smithi099.stdout:5/652: mkdir d6/da/dd5 0 2024-01-31T05:13:19.904 INFO:tasks.workunit.client.0.smithi099.stdout:5/653: readlink d6/da/l5d 0 2024-01-31T05:13:19.906 INFO:tasks.workunit.client.0.smithi099.stdout:1/584: truncate d4/dc/d15/f32 1744408 0 2024-01-31T05:13:19.906 INFO:tasks.workunit.client.0.smithi099.stdout:1/585: write d4/dc/d48/fab [870261,59829] 0 2024-01-31T05:13:19.908 INFO:tasks.workunit.client.0.smithi099.stdout:1/586: creat d4/db/d24/d69/fb7 x:0 0 0 2024-01-31T05:13:19.909 INFO:tasks.workunit.client.0.smithi099.stdout:9/697: dwrite d0/d5d/db6/fbb [0,4194304] 0 2024-01-31T05:13:19.910 INFO:tasks.workunit.client.0.smithi099.stdout:6/629: creat d14/d18/d52/d7e/d1c/da6/fc9 x:0 0 0 2024-01-31T05:13:19.910 INFO:tasks.workunit.client.0.smithi099.stdout:6/630: chown d14/d18/d3b/f6f 434473011 1 2024-01-31T05:13:19.910 INFO:tasks.workunit.client.0.smithi099.stdout:7/737: dwrite d6/d32/d3d/d4b/d33/d37/d50/d5e/fb0 [0,4194304] 0 2024-01-31T05:13:19.910 INFO:tasks.workunit.client.0.smithi099.stdout:3/719: creat d10/d27/d34/d44/d60/d75/d8c/f102 x:0 0 0 2024-01-31T05:13:19.910 INFO:tasks.workunit.client.0.smithi099.stdout:3/720: chown d10/d27/d89/cac 2 1 2024-01-31T05:13:19.911 INFO:tasks.workunit.client.0.smithi099.stdout:5/654: symlink d6/da/d14/d3d/d6e/ld6 0 2024-01-31T05:13:19.912 INFO:tasks.workunit.client.0.smithi099.stdout:1/587: symlink d4/dc/d4d/lb8 0 2024-01-31T05:13:19.917 INFO:tasks.workunit.client.0.smithi099.stdout:9/698: creat d0/d3e/d87/dc9/d5e/de0/ff4 x:0 0 0 2024-01-31T05:13:19.922 INFO:tasks.workunit.client.0.smithi099.stdout:3/721: symlink d10/d1e/da2/l103 0 2024-01-31T05:13:19.924 INFO:tasks.workunit.client.0.smithi099.stdout:1/588: mkdir d4/db/d3a/d7e/db9 0 2024-01-31T05:13:19.927 INFO:tasks.workunit.client.0.smithi099.stdout:7/738: dread d6/d32/d3d/d4b/d33/d37/d50/d25/d72/d8e/f96 [0,4194304] 0 2024-01-31T05:13:19.928 INFO:tasks.workunit.client.0.smithi099.stdout:9/699: dread d0/f8e [0,4194304] 0 2024-01-31T05:13:19.928 INFO:tasks.workunit.client.0.smithi099.stdout:5/655: write d6/da/d14/d61/d98/fbc [3893928,113383] 0 2024-01-31T05:13:19.928 INFO:tasks.workunit.client.0.smithi099.stdout:9/700: readlink d0/d7/d2e/l2c 0 2024-01-31T05:13:19.929 INFO:tasks.workunit.client.0.smithi099.stdout:3/722: mknod d10/d27/d89/c104 0 2024-01-31T05:13:19.931 INFO:tasks.workunit.client.0.smithi099.stdout:1/589: creat d4/db/d3a/d7e/fba x:0 0 0 2024-01-31T05:13:19.932 INFO:tasks.workunit.client.0.smithi099.stdout:1/590: write d4/dc/d48/fab [1794357,100068] 0 2024-01-31T05:13:19.935 INFO:tasks.workunit.client.0.smithi099.stdout:7/739: mknod d6/d98/de3/cef 0 2024-01-31T05:13:19.937 INFO:tasks.workunit.client.0.smithi099.stdout:5/656: symlink d6/da/d14/d3d/d57/dc6/ld7 0 2024-01-31T05:13:19.938 INFO:tasks.workunit.client.0.smithi099.stdout:9/701: rename d0/d3e/d87/dc9/d5e/d72/dbf/ccf to d0/d3e/d87/dc9/d24/d2b/ddf/cf5 0 2024-01-31T05:13:19.940 INFO:tasks.workunit.client.0.smithi099.stdout:7/740: truncate d6/d32/d3d/d4b/d33/d37/d50/d25/f92 85224 0 2024-01-31T05:13:19.941 INFO:tasks.workunit.client.0.smithi099.stdout:5/657: mknod d6/da/d14/d3d/d51/dae/cd8 0 2024-01-31T05:13:19.942 INFO:tasks.workunit.client.0.smithi099.stdout:5/658: write d6/da/d14/d3d/d6e/f85 [704912,42020] 0 2024-01-31T05:13:19.942 INFO:tasks.workunit.client.0.smithi099.stdout:1/591: rmdir d4/db/d24 39 2024-01-31T05:13:19.943 INFO:tasks.workunit.client.0.smithi099.stdout:1/592: symlink d4/db/d24/d4b/d9a/lbb 0 2024-01-31T05:13:19.944 INFO:tasks.workunit.client.0.smithi099.stdout:7/741: rename d6/d32/d3d/d4b/d33/d37/l7d to d6/d32/d3d/de6/lf0 0 2024-01-31T05:13:19.944 INFO:tasks.workunit.client.0.smithi099.stdout:7/742: write d6/d32/d3d/d46/fab [650436,93994] 0 2024-01-31T05:13:19.945 INFO:tasks.workunit.client.0.smithi099.stdout:5/659: link d6/da/d14/d3d/d51/f74 d6/da/d14/d3d/d8c/fd9 0 2024-01-31T05:13:19.946 INFO:tasks.workunit.client.0.smithi099.stdout:7/743: truncate d6/d32/d3d/d4b/d33/d37/d4e/fa6 3254131 0 2024-01-31T05:13:19.947 INFO:tasks.workunit.client.0.smithi099.stdout:5/660: unlink d6/da/d14/d3d/d6e/l4c 0 2024-01-31T05:13:19.948 INFO:tasks.workunit.client.0.smithi099.stdout:9/702: dread d0/d44/f53 [0,4194304] 0 2024-01-31T05:13:19.949 INFO:tasks.workunit.client.0.smithi099.stdout:5/661: link d6/da/d3f/d5a/d81/cc4 d6/da/d14/d61/d98/da0/cda 0 2024-01-31T05:13:19.951 INFO:tasks.workunit.client.0.smithi099.stdout:8/783: dwrite d1/dd/d1d/dea/f82 [4194304,4194304] 0 2024-01-31T05:13:19.952 INFO:tasks.workunit.client.0.smithi099.stdout:2/698: dwrite d10/d20/f68 [0,4194304] 0 2024-01-31T05:13:19.952 INFO:tasks.workunit.client.0.smithi099.stdout:2/699: truncate d10/d1b/d4d/fd1 829718 0 2024-01-31T05:13:19.952 INFO:tasks.workunit.client.0.smithi099.stdout:6/631: dwrite d14/d18/d3b/d7b/f95 [0,4194304] 0 2024-01-31T05:13:19.952 INFO:tasks.workunit.client.0.smithi099.stdout:2/700: chown d10/d1b/d4d/d5a/c63 271850 1 2024-01-31T05:13:19.952 INFO:tasks.workunit.client.0.smithi099.stdout:2/701: dread - d10/d1b/d7d/d7a/dad/fd2 zero size 2024-01-31T05:13:19.952 INFO:tasks.workunit.client.0.smithi099.stdout:6/632: read - d14/d18/d52/d7e/d1c/da6/fc9 zero size 2024-01-31T05:13:19.952 INFO:tasks.workunit.client.0.smithi099.stdout:6/633: write d14/d18/d52/d7e/fbf [793936,24419] 0 2024-01-31T05:13:19.952 INFO:tasks.workunit.client.0.smithi099.stdout:0/725: dwrite d1/d37/d4a/fd7 [0,4194304] 0 2024-01-31T05:13:19.952 INFO:tasks.workunit.client.0.smithi099.stdout:5/662: truncate d6/da/d3f/f45 1042345 0 2024-01-31T05:13:19.952 INFO:tasks.workunit.client.0.smithi099.stdout:4/785: dwrite d0/d2/f47 [0,4194304] 0 2024-01-31T05:13:19.953 INFO:tasks.workunit.client.0.smithi099.stdout:7/744: rename d6/d32/d3d/d4b/d33/d37/d50/d4d/d58 to d6/d32/d3d/de6/df1 0 2024-01-31T05:13:19.954 INFO:tasks.workunit.client.0.smithi099.stdout:4/786: chown d0/d2/d4b/d93/d59/d9c 0 1 2024-01-31T05:13:19.956 INFO:tasks.workunit.client.0.smithi099.stdout:4/787: creat d0/d2/d4b/d93/d86/d8d/f107 x:0 0 0 2024-01-31T05:13:19.959 INFO:tasks.workunit.client.0.smithi099.stdout:8/784: write d1/dd/f2b [3537123,83088] 0 2024-01-31T05:13:19.968 INFO:tasks.workunit.client.0.smithi099.stdout:7/745: write d6/f52 [2826713,94244] 0 2024-01-31T05:13:19.977 INFO:tasks.workunit.client.0.smithi099.stdout:0/726: creat d1/d56/d103/f104 x:0 0 0 2024-01-31T05:13:19.978 INFO:tasks.workunit.client.0.smithi099.stdout:9/703: rename d0/d3e/d87/dc9/d24/d48/f6a to d0/d3e/d87/dc9/d5e/d72/d89/d98/dc1/ff6 0 2024-01-31T05:13:19.980 INFO:tasks.workunit.client.0.smithi099.stdout:2/702: getdents d10/d3a/d94 0 2024-01-31T05:13:19.980 INFO:tasks.workunit.client.0.smithi099.stdout:2/703: write d10/d1c/f2d [157084,31818] 0 2024-01-31T05:13:19.981 INFO:tasks.workunit.client.0.smithi099.stdout:6/634: dwrite d14/d18/d52/d7e/d1c/f44 [0,4194304] 0 2024-01-31T05:13:19.984 INFO:tasks.workunit.client.0.smithi099.stdout:0/727: link d1/d37/d4a/d7b/fc2 d1/d37/d4a/d6f/dc9/dcf/f105 0 2024-01-31T05:13:19.985 INFO:tasks.workunit.client.0.smithi099.stdout:8/785: dread d1/dd/dba/d29/d3f/d56/da0/f3b [0,4194304] 0 2024-01-31T05:13:19.989 INFO:tasks.workunit.client.0.smithi099.stdout:4/788: creat d0/d2/d20/f108 x:0 0 0 2024-01-31T05:13:19.989 INFO:tasks.workunit.client.0.smithi099.stdout:2/704: creat d10/d3a/fdc x:0 0 0 2024-01-31T05:13:19.990 INFO:tasks.workunit.client.0.smithi099.stdout:1/593: fdatasync d4/db/d24/d4b/d50/d91/f3e 0 2024-01-31T05:13:19.992 INFO:tasks.workunit.client.0.smithi099.stdout:4/789: rename d0/d2/d4b/d93/d39/fec to d0/d2/d4b/d93/d59/dff/d43/f109 0 2024-01-31T05:13:19.992 INFO:tasks.workunit.client.0.smithi099.stdout:4/790: dread - d0/d2/d4b/d93/d59/dff/d43/f7e zero size 2024-01-31T05:13:19.992 INFO:tasks.workunit.client.0.smithi099.stdout:1/594: creat d4/dc/d4d/d5d/d87/fbc x:0 0 0 2024-01-31T05:13:19.994 INFO:tasks.workunit.client.0.smithi099.stdout:2/705: unlink d10/d1b/d4d/fa9 0 2024-01-31T05:13:19.995 INFO:tasks.workunit.client.0.smithi099.stdout:1/595: mkdir d4/dc/d4d/d5d/d87/d56/d83/dbd 0 2024-01-31T05:13:19.995 INFO:tasks.workunit.client.0.smithi099.stdout:9/704: write d0/d3e/d87/dc9/fe [3385984,9095] 0 2024-01-31T05:13:19.996 INFO:tasks.workunit.client.0.smithi099.stdout:6/635: dread d14/f16 [0,4194304] 0 2024-01-31T05:13:19.997 INFO:tasks.workunit.client.0.smithi099.stdout:9/705: mknod d0/d3e/d87/dc9/d5e/ddb/cf7 0 2024-01-31T05:13:19.997 INFO:tasks.workunit.client.0.smithi099.stdout:9/706: creat d0/d7/dd2/ff8 x:0 0 0 2024-01-31T05:13:20.002 INFO:tasks.workunit.client.0.smithi099.stdout:7/746: dwrite d6/d32/d3d/d4b/d33/d37/d50/d25/d72/d8e/f96 [0,4194304] 0 2024-01-31T05:13:20.002 INFO:tasks.workunit.client.0.smithi099.stdout:0/728: dread d1/d16/f50 [0,4194304] 0 2024-01-31T05:13:20.002 INFO:tasks.workunit.client.0.smithi099.stdout:0/729: chown d1/d56 30900 1 2024-01-31T05:13:20.005 INFO:tasks.workunit.client.0.smithi099.stdout:0/730: symlink d1/d64/ded/dee/l106 0 2024-01-31T05:13:20.005 INFO:tasks.workunit.client.0.smithi099.stdout:0/731: dread - d1/d30/d45/dad/ff1 zero size 2024-01-31T05:13:20.007 INFO:tasks.workunit.client.0.smithi099.stdout:0/732: mknod d1/d37/d4a/d6f/def/c107 0 2024-01-31T05:13:20.009 INFO:tasks.workunit.client.0.smithi099.stdout:0/733: unlink d1/d30/d45/dad/l70 0 2024-01-31T05:13:20.012 INFO:tasks.workunit.client.0.smithi099.stdout:1/596: dread d4/db/d24/d4b/f77 [0,4194304] 0 2024-01-31T05:13:20.013 INFO:tasks.workunit.client.0.smithi099.stdout:1/597: chown d4/db/d24/d4b/l8b 15720 1 2024-01-31T05:13:20.013 INFO:tasks.workunit.client.0.smithi099.stdout:8/786: dwrite d1/dd/d4f/d51/f5d [0,4194304] 0 2024-01-31T05:13:20.015 INFO:tasks.workunit.client.0.smithi099.stdout:1/598: mknod d4/db/d3a/d7e/db9/cbe 0 2024-01-31T05:13:20.015 INFO:tasks.workunit.client.0.smithi099.stdout:1/599: chown d4/dc/d15/fb1 113 1 2024-01-31T05:13:20.016 INFO:tasks.workunit.client.0.smithi099.stdout:8/787: rmdir d1/dd/dba/d19 39 2024-01-31T05:13:20.016 INFO:tasks.workunit.client.0.smithi099.stdout:8/788: chown d1/dd/l9b 7963 1 2024-01-31T05:13:20.017 INFO:tasks.workunit.client.0.smithi099.stdout:1/600: getdents d4 0 2024-01-31T05:13:20.018 INFO:tasks.workunit.client.0.smithi099.stdout:8/789: creat d1/dd/dba/d29/f105 x:0 0 0 2024-01-31T05:13:20.018 INFO:tasks.workunit.client.0.smithi099.stdout:8/790: stat d1/dd/d1d/dea/c6a 0 2024-01-31T05:13:20.018 INFO:tasks.workunit.client.0.smithi099.stdout:8/791: write d1/da6/fcb [4571510,75917] 0 2024-01-31T05:13:20.020 INFO:tasks.workunit.client.0.smithi099.stdout:1/601: getdents d4/db/d24 0 2024-01-31T05:13:20.033 INFO:tasks.workunit.client.0.smithi099.stdout:9/707: dwrite d0/d7/dd2/ff8 [0,4194304] 0 2024-01-31T05:13:20.033 INFO:tasks.workunit.client.0.smithi099.stdout:9/708: truncate d0/d3e/d87/dc9/d24/f75 271521 0 2024-01-31T05:13:20.033 INFO:tasks.workunit.client.0.smithi099.stdout:4/791: dwrite d0/d8/d19/d98/d9b/dab/fd9 [0,4194304] 0 2024-01-31T05:13:20.034 INFO:tasks.workunit.client.0.smithi099.stdout:7/747: dwrite d6/d32/d3d/de6/df1/f97 [0,4194304] 0 2024-01-31T05:13:20.034 INFO:tasks.workunit.client.0.smithi099.stdout:7/748: stat d6/d12/lb8 0 2024-01-31T05:13:20.034 INFO:tasks.workunit.client.0.smithi099.stdout:7/749: chown d6/cd3 2950 1 2024-01-31T05:13:20.034 INFO:tasks.workunit.client.0.smithi099.stdout:7/750: chown d6/d32/d3d/d4b/d33/d37/d50/d25/d79 959477 1 2024-01-31T05:13:20.034 INFO:tasks.workunit.client.0.smithi099.stdout:7/751: truncate d6/f3f 4725992 0 2024-01-31T05:13:20.034 INFO:tasks.workunit.client.0.smithi099.stdout:9/709: mkdir d0/d3e/d87/dc9/d24/d2b/de9/df9 0 2024-01-31T05:13:20.035 INFO:tasks.workunit.client.0.smithi099.stdout:9/710: chown d0/d3e/d87/dc9/d24/d48/fc3 7603 1 2024-01-31T05:13:20.035 INFO:tasks.workunit.client.0.smithi099.stdout:9/711: fdatasync d0/d44/f53 0 2024-01-31T05:13:20.037 INFO:tasks.workunit.client.0.smithi099.stdout:7/752: symlink d6/d32/d3d/d4b/d33/d37/d50/d25/d7a/lf2 0 2024-01-31T05:13:20.039 INFO:tasks.workunit.client.0.smithi099.stdout:0/734: dwrite d1/f2a [0,4194304] 0 2024-01-31T05:13:20.039 INFO:tasks.workunit.client.0.smithi099.stdout:9/712: link d0/d3e/d87/dc9/c45 d0/d3e/d87/dc9/d24/d2b/ddf/cfa 0 2024-01-31T05:13:20.045 INFO:tasks.workunit.client.0.smithi099.stdout:9/713: link d0/d3e/d87/dc9/d24/d2b/c20 d0/d3e/d87/dc9/d5e/d72/dbf/dd1/cfb 0 2024-01-31T05:13:20.046 INFO:tasks.workunit.client.0.smithi099.stdout:9/714: mknod d0/d3e/d87/dc9/d24/d2b/ddf/cfc 0 2024-01-31T05:13:20.046 INFO:tasks.workunit.client.0.smithi099.stdout:9/715: fsync d0/d7/fdd 0 2024-01-31T05:13:20.047 INFO:tasks.workunit.client.0.smithi099.stdout:1/602: dwrite d4/f8d [0,4194304] 0 2024-01-31T05:13:20.047 INFO:tasks.workunit.client.0.smithi099.stdout:9/716: truncate d0/d3e/f5f 1711258 0 2024-01-31T05:13:20.047 INFO:tasks.workunit.client.0.smithi099.stdout:9/717: chown d0/d3e/d87/lf0 103634 1 2024-01-31T05:13:20.047 INFO:tasks.workunit.client.0.smithi099.stdout:9/718: stat d0/d7/dd2/fd5 0 2024-01-31T05:13:20.049 INFO:tasks.workunit.client.0.smithi099.stdout:1/603: mkdir d4/dc/d4d/da5/dbf 0 2024-01-31T05:13:20.050 INFO:tasks.workunit.client.0.smithi099.stdout:1/604: dread d4/db/d24/d4b/d50/d91/f99 [0,4194304] 0 2024-01-31T05:13:20.052 INFO:tasks.workunit.client.0.smithi099.stdout:9/719: dread d0/d44/f9a [0,4194304] 0 2024-01-31T05:13:20.055 INFO:tasks.workunit.client.0.smithi099.stdout:7/753: dread d6/d32/d3d/f4a [0,4194304] 0 2024-01-31T05:13:20.055 INFO:tasks.workunit.client.0.smithi099.stdout:7/754: chown d6/d32/d3d/d4b/d33/d37/d50/d25/d72/d8e/d9a 783 1 2024-01-31T05:13:20.066 INFO:tasks.workunit.client.0.smithi099.stdout:4/792: dwrite d0/d8/d19/d54/d76/f9d [4194304,4194304] 0 2024-01-31T05:13:20.069 INFO:tasks.workunit.client.0.smithi099.stdout:0/735: dwrite d1/d30/d45/d66/f6d [0,4194304] 0 2024-01-31T05:13:20.069 INFO:tasks.workunit.client.0.smithi099.stdout:9/720: dread d0/d3e/d87/dc9/f9c [0,4194304] 0 2024-01-31T05:13:20.069 INFO:tasks.workunit.client.0.smithi099.stdout:9/721: fdatasync d0/d3e/d87/dc9/d24/d2b/d63/da7/daa/fc0 0 2024-01-31T05:13:20.071 INFO:tasks.workunit.client.0.smithi099.stdout:0/736: unlink d1/d16/f1c 0 2024-01-31T05:13:20.075 INFO:tasks.workunit.client.0.smithi099.stdout:7/755: dread d6/d32/d3d/d4b/d33/d37/d50/d25/d72/d8e/f96 [0,4194304] 0 2024-01-31T05:13:20.075 INFO:tasks.workunit.client.0.smithi099.stdout:7/756: chown d6/d32/d3d/d4b/d33/d37/d50/d25/d72/d8e 221515 1 2024-01-31T05:13:20.075 INFO:tasks.workunit.client.0.smithi099.stdout:7/757: creat d6/d32/d3d/d4b/d33/d37/d50/d25/d7a/ff3 x:0 0 0 2024-01-31T05:13:20.075 INFO:tasks.workunit.client.0.smithi099.stdout:9/722: dread d0/d3e/f5f [0,4194304] 0 2024-01-31T05:13:20.075 INFO:tasks.workunit.client.0.smithi099.stdout:9/723: fsync d0/d3e/d87/dc9/d24/fa1 0 2024-01-31T05:13:20.077 INFO:tasks.workunit.client.0.smithi099.stdout:7/758: mkdir d6/d32/d3d/d46/df4 0 2024-01-31T05:13:20.079 INFO:tasks.workunit.client.0.smithi099.stdout:9/724: rename d0/d3e/d87/dc9/d5e/d72/cd8 to d0/d3e/d87/dc9/d24/d2b/d63/cfd 0 2024-01-31T05:13:20.080 INFO:tasks.workunit.client.0.smithi099.stdout:7/759: creat d6/d32/d3d/de6/df1/ff5 x:0 0 0 2024-01-31T05:13:20.080 INFO:tasks.workunit.client.0.smithi099.stdout:1/605: dwrite d4/db/d24/d4b/f52 [0,4194304] 0 2024-01-31T05:13:20.080 INFO:tasks.workunit.client.0.smithi099.stdout:0/737: dread d1/d30/fb2 [0,4194304] 0 2024-01-31T05:13:20.080 INFO:tasks.workunit.client.0.smithi099.stdout:7/760: stat d6/d32/d3d/d4b/d33/d37/d50/c89 0 2024-01-31T05:13:20.082 INFO:tasks.workunit.client.0.smithi099.stdout:0/738: creat d1/d37/d4a/d7a/f108 x:0 0 0 2024-01-31T05:13:20.082 INFO:tasks.workunit.client.0.smithi099.stdout:0/739: write d1/d37/d4a/d7a/fdf [307115,7641] 0 2024-01-31T05:13:20.083 INFO:tasks.workunit.client.0.smithi099.stdout:0/740: symlink d1/d37/d73/db7/dc5/l109 0 2024-01-31T05:13:20.090 INFO:tasks.workunit.client.0.smithi099.stdout:1/606: truncate d4/dc/d48/f31 4827689 0 2024-01-31T05:13:20.091 INFO:tasks.workunit.client.0.smithi099.stdout:4/793: dwrite d0/d2/d4b/d93/d86/db4/f6c [0,4194304] 0 2024-01-31T05:13:20.091 INFO:tasks.workunit.client.0.smithi099.stdout:4/794: dread - d0/d2/d4b/d93/d59/d8f/dd6/fe8 zero size 2024-01-31T05:13:20.091 INFO:tasks.workunit.client.0.smithi099.stdout:4/795: write d0/d2/d4b/d93/d59/d82/f103 [548326,124470] 0 2024-01-31T05:13:20.091 INFO:tasks.workunit.client.0.smithi099.stdout:1/607: write d4/dc/d4d/f51 [1368830,73812] 0 2024-01-31T05:13:20.092 INFO:tasks.workunit.client.0.smithi099.stdout:4/796: mknod d0/d2/d4b/d93/d17/de1/c10a 0 2024-01-31T05:13:20.106 INFO:tasks.workunit.client.0.smithi099.stdout:1/608: write d4/dc/d4d/d5d/f7f [302950,43259] 0 2024-01-31T05:13:20.112 INFO:tasks.workunit.client.0.smithi099.stdout:7/761: dwrite d6/d12/f85 [0,4194304] 0 2024-01-31T05:13:20.112 INFO:tasks.workunit.client.0.smithi099.stdout:0/741: dwrite d1/f80 [0,4194304] 0 2024-01-31T05:13:20.112 INFO:tasks.workunit.client.0.smithi099.stdout:0/742: dread - d1/d37/d4a/d6f/fe7 zero size 2024-01-31T05:13:20.116 INFO:tasks.workunit.client.0.smithi099.stdout:1/609: rename d4/db/d24 to d4/db/d12/dc0 0 2024-01-31T05:13:20.116 INFO:tasks.workunit.client.0.smithi099.stdout:1/610: dread - d4/db/d12/dc0/d4b/d50/fa7 zero size 2024-01-31T05:13:20.117 INFO:tasks.workunit.client.0.smithi099.stdout:9/725: dwrite d0/d3e/f5f [0,4194304] 0 2024-01-31T05:13:20.123 INFO:tasks.workunit.client.0.smithi099.stdout:7/762: dread d6/d32/d3d/d4b/d33/d37/d50/d25/d7a/fa3 [0,4194304] 0 2024-01-31T05:13:20.126 INFO:tasks.workunit.client.0.smithi099.stdout:1/611: dread d4/db/d12/dc0/d4b/f52 [4194304,4194304] 0 2024-01-31T05:13:20.128 INFO:tasks.workunit.client.0.smithi099.stdout:1/612: rmdir d4/db/d12/dc0/d4b/d50 39 2024-01-31T05:13:20.132 INFO:tasks.workunit.client.0.smithi099.stdout:9/726: dread d0/d3e/d87/dc9/d24/d2b/f3c [0,4194304] 0 2024-01-31T05:13:20.132 INFO:tasks.workunit.client.0.smithi099.stdout:1/613: mkdir d4/dc/d15/dc1 0 2024-01-31T05:13:20.132 INFO:tasks.workunit.client.0.smithi099.stdout:1/614: creat d4/dc/d4d/d5d/fc2 x:0 0 0 2024-01-31T05:13:20.132 INFO:tasks.workunit.client.0.smithi099.stdout:1/615: truncate d4/dc/d15/fb1 523112 0 2024-01-31T05:13:20.132 INFO:tasks.workunit.client.0.smithi099.stdout:1/616: fdatasync d4/dc/d4d/d5d/d87/fbc 0 2024-01-31T05:13:20.133 INFO:tasks.workunit.client.0.smithi099.stdout:1/617: dread - d4/dc/d55/f8e zero size 2024-01-31T05:13:20.133 INFO:tasks.workunit.client.0.smithi099.stdout:1/618: chown d4/f8d 214 1 2024-01-31T05:13:20.133 INFO:tasks.workunit.client.0.smithi099.stdout:1/619: write d4/dc/d15/f5a [446045,26273] 0 2024-01-31T05:13:20.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:19 smithi179 ceph-mon[35652]: pgmap v407: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 178 MiB/s rd, 217 MiB/s wr, 2.03k op/s 2024-01-31T05:13:20.133 INFO:tasks.workunit.client.0.smithi099.stdout:9/727: rmdir d0/d3e/d87 39 2024-01-31T05:13:20.135 INFO:tasks.workunit.client.0.smithi099.stdout:9/728: creat d0/d3e/d87/dc9/d5e/d72/d89/d98/dc1/dca/ffe x:0 0 0 2024-01-31T05:13:20.136 INFO:tasks.workunit.client.0.smithi099.stdout:0/743: dwrite d1/d37/d4a/faa [0,4194304] 0 2024-01-31T05:13:20.137 INFO:tasks.workunit.client.0.smithi099.stdout:0/744: fsync d1/d64/f82 0 2024-01-31T05:13:20.139 INFO:tasks.workunit.client.0.smithi099.stdout:0/745: mknod d1/d8/c10a 0 2024-01-31T05:13:20.139 INFO:tasks.workunit.client.0.smithi099.stdout:0/746: rmdir d1/d64/ded 39 2024-01-31T05:13:20.140 INFO:tasks.workunit.client.0.smithi099.stdout:0/747: fsync d1/d56/d103/d8b/fd4 0 2024-01-31T05:13:20.140 INFO:tasks.workunit.client.0.smithi099.stdout:0/748: write d1/d37/d4a/d7b/fc6 [556520,65989] 0 2024-01-31T05:13:20.140 INFO:tasks.workunit.client.0.smithi099.stdout:9/729: dread d0/d7/fdd [0,4194304] 0 2024-01-31T05:13:20.141 INFO:tasks.workunit.client.0.smithi099.stdout:0/749: creat d1/d37/d4a/d7b/dfe/f10b x:0 0 0 2024-01-31T05:13:20.143 INFO:tasks.workunit.client.0.smithi099.stdout:9/730: dread d0/d3e/d87/dc9/d24/d48/f9f [0,4194304] 0 2024-01-31T05:13:20.143 INFO:tasks.workunit.client.0.smithi099.stdout:9/731: write d0/d3e/d87/dc9/d5e/d72/d89/d98/fbd [87813,7317] 0 2024-01-31T05:13:20.144 INFO:tasks.workunit.client.0.smithi099.stdout:1/620: dread d4/dc/d4d/d5d/f7f [0,4194304] 0 2024-01-31T05:13:20.153 INFO:tasks.workunit.client.0.smithi099.stdout:7/763: dwrite d6/d32/d3d/d4b/d33/d37/d50/d25/f29 [0,4194304] 0 2024-01-31T05:13:20.153 INFO:tasks.workunit.client.0.smithi099.stdout:7/764: readlink d6/d32/d3d/d4b/d33/d37/lb5 0 2024-01-31T05:13:20.155 INFO:tasks.workunit.client.0.smithi099.stdout:9/732: write d0/d7/d2e/f43 [4667078,16501] 0 2024-01-31T05:13:20.155 INFO:tasks.workunit.client.0.smithi099.stdout:7/765: creat d6/d32/d3d/d4b/d33/d37/d50/ff6 x:0 0 0 2024-01-31T05:13:20.157 INFO:tasks.workunit.client.0.smithi099.stdout:9/733: creat d0/d3e/d87/dc9/d24/d48/fff x:0 0 0 2024-01-31T05:13:20.157 INFO:tasks.workunit.client.0.smithi099.stdout:7/766: mkdir d6/d32/d3d/d4b/d33/d37/d50/d25/d72/d8e/df7 0 2024-01-31T05:13:20.159 INFO:tasks.workunit.client.0.smithi099.stdout:9/734: mkdir d0/d3e/d87/dc9/d5e/d72/dbf/d100 0 2024-01-31T05:13:20.159 INFO:tasks.workunit.client.0.smithi099.stdout:9/735: chown d0/d3e/d87/dc9/d24/d2b/ddf/fec 64451631 1 2024-01-31T05:13:20.159 INFO:tasks.workunit.client.0.smithi099.stdout:9/736: fsync d0/d5d/db6/fc5 0 2024-01-31T05:13:20.160 INFO:tasks.workunit.client.0.smithi099.stdout:7/767: symlink d6/d32/d3d/d4b/d33/d37/d50/d7b/lf8 0 2024-01-31T05:13:20.161 INFO:tasks.workunit.client.0.smithi099.stdout:9/737: mkdir d0/d3e/d87/dc9/d24/d2b/d63/da7/daa/d101 0 2024-01-31T05:13:20.162 INFO:tasks.workunit.client.0.smithi099.stdout:7/768: link d6/d32/d3d/d4b/d33/d37/d50/d25/d72/fd0 d6/d98/de3/ff9 0 2024-01-31T05:13:20.164 INFO:tasks.workunit.client.0.smithi099.stdout:0/750: dwrite d1/d56/d103/fe2 [0,4194304] 0 2024-01-31T05:13:20.167 INFO:tasks.workunit.client.0.smithi099.stdout:1/621: rename d4/dc/l49 to d4/dc/d4d/d5d/lc3 0 2024-01-31T05:13:20.167 INFO:tasks.workunit.client.0.smithi099.stdout:0/751: symlink d1/d37/d4a/d7a/l10c 0 2024-01-31T05:13:20.168 INFO:tasks.workunit.client.0.smithi099.stdout:0/752: fdatasync d1/d37/d4a/d6f/dc9/dcf/ff6 0 2024-01-31T05:13:20.168 INFO:tasks.workunit.client.0.smithi099.stdout:0/753: stat d1/cec 0 2024-01-31T05:13:20.168 INFO:tasks.workunit.client.0.smithi099.stdout:1/622: creat d4/dc/d4d/d5d/fc4 x:0 0 0 2024-01-31T05:13:20.169 INFO:tasks.workunit.client.0.smithi099.stdout:1/623: chown d4/db/d12/dc0/d4b/d50/d91/l21 30845108 1 2024-01-31T05:13:20.170 INFO:tasks.workunit.client.0.smithi099.stdout:9/738: rename d0/d7/f68 to d0/d3e/d87/dc9/f102 0 2024-01-31T05:13:20.173 INFO:tasks.workunit.client.0.smithi099.stdout:7/769: read d6/d32/d3d/d4b/d33/d37/d50/d25/f4c [3379981,45223] 0 2024-01-31T05:13:20.176 INFO:tasks.workunit.client.0.smithi099.stdout:1/624: mknod d4/dc/d4d/cc5 0 2024-01-31T05:13:20.177 INFO:tasks.workunit.client.0.smithi099.stdout:7/770: mknod d6/d32/d3d/de6/cfa 0 2024-01-31T05:13:20.177 INFO:tasks.workunit.client.0.smithi099.stdout:7/771: truncate d6/d32/d3d/d4b/d33/d37/d50/d25/d7a/fa3 4224251 0 2024-01-31T05:13:20.177 INFO:tasks.workunit.client.0.smithi099.stdout:7/772: chown d6/d32/d3d/d4b/d33/d37/d50/d25/d72 146 1 2024-01-31T05:13:20.191 INFO:tasks.workunit.client.0.smithi099.stdout:7/773: dread d6/d12/f85 [0,4194304] 0 2024-01-31T05:13:20.192 INFO:tasks.workunit.client.0.smithi099.stdout:7/774: rmdir d6/d32 39 2024-01-31T05:13:20.193 INFO:tasks.workunit.client.0.smithi099.stdout:7/775: mknod d6/d32/d3d/d4b/cfb 0 2024-01-31T05:13:20.193 INFO:tasks.workunit.client.0.smithi099.stdout:7/776: truncate d6/d32/d3d/d4b/d33/d37/f40 5905411 0 2024-01-31T05:13:20.205 INFO:tasks.workunit.client.0.smithi099.stdout:0/754: dwrite d1/d37/d4a/faa [4194304,4194304] 0 2024-01-31T05:13:20.205 INFO:tasks.workunit.client.0.smithi099.stdout:9/739: dwrite d0/d3e/f6f [0,4194304] 0 2024-01-31T05:13:20.205 INFO:tasks.workunit.client.0.smithi099.stdout:1/625: dwrite d4/dc/d15/f32 [0,4194304] 0 2024-01-31T05:13:20.205 INFO:tasks.workunit.client.0.smithi099.stdout:1/626: chown d4/dc/d4d/d5d/d87/f54 9777 1 2024-01-31T05:13:20.206 INFO:tasks.workunit.client.0.smithi099.stdout:0/755: link d1/d16/f31 d1/d37/d4a/d7b/dfe/f10d 0 2024-01-31T05:13:20.219 INFO:tasks.workunit.client.0.smithi099.stdout:0/756: unlink d1/d56/c79 0 2024-01-31T05:13:20.219 INFO:tasks.workunit.client.0.smithi099.stdout:9/740: write d0/d7/f66 [4170484,39250] 0 2024-01-31T05:13:20.219 INFO:tasks.workunit.client.0.smithi099.stdout:0/757: write d1/d56/d103/f63 [405769,111353] 0 2024-01-31T05:13:20.220 INFO:tasks.workunit.client.0.smithi099.stdout:9/741: dread d0/d3e/d87/dc9/d5e/d72/d89/d98/fbd [0,4194304] 0 2024-01-31T05:13:20.221 INFO:tasks.workunit.client.0.smithi099.stdout:0/758: read d1/d64/f67 [366023,21100] 0 2024-01-31T05:13:20.238 INFO:tasks.workunit.client.0.smithi099.stdout:9/742: dwrite d0/d3e/d87/dc9/d5e/d72/d89/feb [0,4194304] 0 2024-01-31T05:13:20.241 INFO:tasks.workunit.client.0.smithi099.stdout:9/743: rmdir d0 39 2024-01-31T05:13:20.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:19 smithi099 ceph-mon[31615]: pgmap v407: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 178 MiB/s rd, 217 MiB/s wr, 2.03k op/s 2024-01-31T05:13:20.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:19 smithi181 ceph-mon[36434]: pgmap v407: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 178 MiB/s rd, 217 MiB/s wr, 2.03k op/s 2024-01-31T05:13:22.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:21 smithi179 ceph-mon[35652]: pgmap v408: 97 pgs: 97 active+clean; 1.3 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 181 MiB/s rd, 225 MiB/s wr, 1.85k op/s 2024-01-31T05:13:22.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:21 smithi179 ceph-mon[35652]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:13:22.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:21 smithi179 ceph-mon[35652]: scrub summary: idle 2024-01-31T05:13:22.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:21 smithi179 ceph-mon[35652]: scrub summary: idle 2024-01-31T05:13:22.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:21 smithi179 ceph-mon[35652]: scrub summary: idle 2024-01-31T05:13:22.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:21 smithi179 ceph-mon[35652]: scrub summary: idle 2024-01-31T05:13:22.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:21 smithi099 ceph-mon[31615]: pgmap v408: 97 pgs: 97 active+clean; 1.3 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 181 MiB/s rd, 225 MiB/s wr, 1.85k op/s 2024-01-31T05:13:22.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:21 smithi099 ceph-mon[31615]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:13:22.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:21 smithi099 ceph-mon[31615]: scrub summary: idle 2024-01-31T05:13:22.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:21 smithi099 ceph-mon[31615]: scrub summary: idle 2024-01-31T05:13:22.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:21 smithi099 ceph-mon[31615]: scrub summary: idle 2024-01-31T05:13:22.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:21 smithi099 ceph-mon[31615]: scrub summary: idle 2024-01-31T05:13:22.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:21 smithi181 ceph-mon[36434]: pgmap v408: 97 pgs: 97 active+clean; 1.3 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 181 MiB/s rd, 225 MiB/s wr, 1.85k op/s 2024-01-31T05:13:22.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:21 smithi181 ceph-mon[36434]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:13:22.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:21 smithi181 ceph-mon[36434]: scrub summary: idle 2024-01-31T05:13:22.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:21 smithi181 ceph-mon[36434]: scrub summary: idle 2024-01-31T05:13:22.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:21 smithi181 ceph-mon[36434]: scrub summary: idle 2024-01-31T05:13:22.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:21 smithi181 ceph-mon[36434]: scrub summary: idle 2024-01-31T05:13:22.484 INFO:tasks.workunit.client.0.smithi099.stdout:6/636: sync 2024-01-31T05:13:22.484 INFO:tasks.workunit.client.0.smithi099.stdout:4/797: sync 2024-01-31T05:13:22.485 INFO:tasks.workunit.client.0.smithi099.stdout:6/637: chown d14/d18/d52/d7e/d1c/d29/d43/f87 4 1 2024-01-31T05:13:22.485 INFO:tasks.workunit.client.0.smithi099.stdout:2/706: sync 2024-01-31T05:13:22.485 INFO:tasks.workunit.client.0.smithi099.stdout:4/798: read - d0/d2/d4b/d93/d59/d8f/fd1 zero size 2024-01-31T05:13:22.485 INFO:tasks.workunit.client.0.smithi099.stdout:9/744: sync 2024-01-31T05:13:22.485 INFO:tasks.workunit.client.0.smithi099.stdout:1/627: sync 2024-01-31T05:13:22.486 INFO:tasks.workunit.client.0.smithi099.stdout:4/799: readlink d0/d8/d19/d99/lbf 0 2024-01-31T05:13:22.486 INFO:tasks.workunit.client.0.smithi099.stdout:3/723: sync 2024-01-31T05:13:22.486 INFO:tasks.workunit.client.0.smithi099.stdout:4/800: fdatasync d0/f60 0 2024-01-31T05:13:22.486 INFO:tasks.workunit.client.0.smithi099.stdout:5/663: sync 2024-01-31T05:13:22.486 INFO:tasks.workunit.client.0.smithi099.stdout:4/801: fdatasync d0/d2/d4b/d93/d59/dff/d43/fe3 0 2024-01-31T05:13:22.487 INFO:tasks.workunit.client.0.smithi099.stdout:5/664: fsync d6/da/d14/d3d/d51/d82/f2c 0 2024-01-31T05:13:22.487 INFO:tasks.workunit.client.0.smithi099.stdout:3/724: write d10/d32/f36 [1483928,108410] 0 2024-01-31T05:13:22.487 INFO:tasks.workunit.client.0.smithi099.stdout:8/792: sync 2024-01-31T05:13:22.487 INFO:tasks.workunit.client.0.smithi099.stdout:3/725: dread - d10/d27/d34/d44/d95/daf/fc7 zero size 2024-01-31T05:13:22.487 INFO:tasks.workunit.client.0.smithi099.stdout:7/777: sync 2024-01-31T05:13:22.488 INFO:tasks.workunit.client.0.smithi099.stdout:8/793: dread - d1/dd/d65/d7f/d81/dc7/fd1 zero size 2024-01-31T05:13:22.488 INFO:tasks.workunit.client.0.smithi099.stdout:0/759: sync 2024-01-31T05:13:22.488 INFO:tasks.workunit.client.0.smithi099.stdout:0/760: truncate d1/d37/d4a/fe3 368256 0 2024-01-31T05:13:22.488 INFO:tasks.workunit.client.0.smithi099.stdout:2/707: mknod d10/d2b/d58/dc3/dcd/cdd 0 2024-01-31T05:13:22.489 INFO:tasks.workunit.client.0.smithi099.stdout:9/745: creat d0/d3e/d87/dc9/d5e/d72/f103 x:0 0 0 2024-01-31T05:13:22.489 INFO:tasks.workunit.client.0.smithi099.stdout:1/628: symlink d4/db/lc6 0 2024-01-31T05:13:22.490 INFO:tasks.workunit.client.0.smithi099.stdout:5/665: creat d6/da/d14/fdb x:0 0 0 2024-01-31T05:13:22.490 INFO:tasks.workunit.client.0.smithi099.stdout:5/666: stat d6/da/d14/d94 0 2024-01-31T05:13:22.491 INFO:tasks.workunit.client.0.smithi099.stdout:5/667: write d6/da/d3f/d5a/fd3 [4091166,30560] 0 2024-01-31T05:13:22.493 INFO:tasks.workunit.client.0.smithi099.stdout:3/726: unlink d10/d32/d33/f61 0 2024-01-31T05:13:22.493 INFO:tasks.workunit.client.0.smithi099.stdout:3/727: stat d10/d1e/l90 0 2024-01-31T05:13:22.493 INFO:tasks.workunit.client.0.smithi099.stdout:3/728: stat d10/lcc 0 2024-01-31T05:13:22.495 INFO:tasks.workunit.client.0.smithi099.stdout:8/794: creat d1/dd/d7b/f106 x:0 0 0 2024-01-31T05:13:22.495 INFO:tasks.workunit.client.0.smithi099.stdout:8/795: chown l0 1633188 1 2024-01-31T05:13:22.496 INFO:tasks.workunit.client.0.smithi099.stdout:2/708: symlink d10/d1c/lde 0 2024-01-31T05:13:22.496 INFO:tasks.workunit.client.0.smithi099.stdout:2/709: truncate d10/d1c/f85 1341014 0 2024-01-31T05:13:22.498 INFO:tasks.workunit.client.0.smithi099.stdout:5/668: link d6/da/d3f/f9c d6/da/d3f/fdc 0 2024-01-31T05:13:22.499 INFO:tasks.workunit.client.0.smithi099.stdout:3/729: readlink d10/d27/l3d 0 2024-01-31T05:13:22.502 INFO:tasks.workunit.client.0.smithi099.stdout:1/629: write d4/dc/d55/f72 [2162974,23607] 0 2024-01-31T05:13:22.502 INFO:tasks.workunit.client.0.smithi099.stdout:8/796: unlink d1/dd/d4f/d51/d83/cfb 0 2024-01-31T05:13:22.502 INFO:tasks.workunit.client.0.smithi099.stdout:0/761: dread d1/d37/d4a/f9a [0,4194304] 0 2024-01-31T05:13:22.503 INFO:tasks.workunit.client.0.smithi099.stdout:0/762: dread - d1/d30/d45/dad/ff1 zero size 2024-01-31T05:13:22.504 INFO:tasks.workunit.client.0.smithi099.stdout:8/797: mknod d1/dd/d65/d7f/d81/dc4/c107 0 2024-01-31T05:13:22.504 INFO:tasks.workunit.client.0.smithi099.stdout:8/798: write d1/dd/fd2 [378550,82401] 0 2024-01-31T05:13:22.505 INFO:tasks.workunit.client.0.smithi099.stdout:3/730: creat d10/d27/d34/f105 x:0 0 0 2024-01-31T05:13:22.507 INFO:tasks.workunit.client.0.smithi099.stdout:1/630: dread d4/dc/d4d/d5d/d87/f9d [0,4194304] 0 2024-01-31T05:13:22.510 INFO:tasks.workunit.client.0.smithi099.stdout:6/638: dwrite d14/d18/d52/d7e/f83 [0,4194304] 0 2024-01-31T05:13:22.510 INFO:tasks.workunit.client.0.smithi099.stdout:6/639: readlink d14/d18/l5a 0 2024-01-31T05:13:22.512 INFO:tasks.workunit.client.0.smithi099.stdout:1/631: rmdir d4/db/d3a/d7e/d85/d96 39 2024-01-31T05:13:22.513 INFO:tasks.workunit.client.0.smithi099.stdout:2/710: dread d10/d20/f68 [4194304,4194304] 0 2024-01-31T05:13:22.513 INFO:tasks.workunit.client.0.smithi099.stdout:1/632: mkdir d4/db/d12/dc0/d4b/d9a/dc7 0 2024-01-31T05:13:22.514 INFO:tasks.workunit.client.0.smithi099.stdout:2/711: write d10/d20/f50 [5279891,72849] 0 2024-01-31T05:13:22.514 INFO:tasks.workunit.client.0.smithi099.stdout:5/669: dread d6/ff [0,4194304] 0 2024-01-31T05:13:22.517 INFO:tasks.workunit.client.0.smithi099.stdout:9/746: dwrite d0/d3e/f42 [4194304,4194304] 0 2024-01-31T05:13:22.517 INFO:tasks.workunit.client.0.smithi099.stdout:1/633: creat d4/dc/d44/fc8 x:0 0 0 2024-01-31T05:13:22.517 INFO:tasks.workunit.client.0.smithi099.stdout:9/747: chown d0/d44/f4f 1620327 1 2024-01-31T05:13:22.517 INFO:tasks.workunit.client.0.smithi099.stdout:9/748: readlink d0/d7/l3f 0 2024-01-31T05:13:22.519 INFO:tasks.workunit.client.0.smithi099.stdout:5/670: creat d6/da/d3f/d73/fdd x:0 0 0 2024-01-31T05:13:22.527 INFO:tasks.workunit.client.0.smithi099.stdout:9/749: truncate d0/d7/f66 1441689 0 2024-01-31T05:13:22.528 INFO:tasks.workunit.client.0.smithi099.stdout:5/671: mkdir d6/da/d14/d3d/da8/dde 0 2024-01-31T05:13:22.528 INFO:tasks.workunit.client.0.smithi099.stdout:5/672: chown d6/da/d14/d3d/d51/lb8 872901776 1 2024-01-31T05:13:22.529 INFO:tasks.workunit.client.0.smithi099.stdout:2/712: dread f1 [0,4194304] 0 2024-01-31T05:13:22.529 INFO:tasks.workunit.client.0.smithi099.stdout:2/713: read d10/f31 [1859588,20912] 0 2024-01-31T05:13:22.530 INFO:tasks.workunit.client.0.smithi099.stdout:1/634: truncate d4/dc/d55/f72 932133 0 2024-01-31T05:13:22.531 INFO:tasks.workunit.client.0.smithi099.stdout:5/673: mkdir d6/da/ddf 0 2024-01-31T05:13:22.531 INFO:tasks.workunit.client.0.smithi099.stdout:2/714: mknod d10/d1b/d7d/d7a/dd7/cdf 0 2024-01-31T05:13:22.531 INFO:tasks.workunit.client.0.smithi099.stdout:1/635: creat d4/db/d12/dc0/d4b/d50/fc9 x:0 0 0 2024-01-31T05:13:22.531 INFO:tasks.workunit.client.0.smithi099.stdout:1/636: chown d4/db/d12/dc0/d4b/d9a/dc7 2632 1 2024-01-31T05:13:22.532 INFO:tasks.workunit.client.0.smithi099.stdout:5/674: mknod d6/da/d3f/d5a/ce0 0 2024-01-31T05:13:22.533 INFO:tasks.workunit.client.0.smithi099.stdout:2/715: creat d10/d51/fe0 x:0 0 0 2024-01-31T05:13:22.535 INFO:tasks.workunit.client.0.smithi099.stdout:1/637: mknod d4/db/d3a/d7e/db9/cca 0 2024-01-31T05:13:22.535 INFO:tasks.workunit.client.0.smithi099.stdout:6/640: dwrite d14/d18/d52/d22/d71/f72 [4194304,4194304] 0 2024-01-31T05:13:22.538 INFO:tasks.workunit.client.0.smithi099.stdout:5/675: creat d6/da/d14/d3d/d8c/d99/fe1 x:0 0 0 2024-01-31T05:13:22.538 INFO:tasks.workunit.client.0.smithi099.stdout:5/676: truncate d6/da/d3f/fdc 887867 0 2024-01-31T05:13:22.538 INFO:tasks.workunit.client.0.smithi099.stdout:5/677: write d6/da/d3f/d5a/fd3 [1433487,112475] 0 2024-01-31T05:13:22.540 INFO:tasks.workunit.client.0.smithi099.stdout:9/750: dread d0/d3e/d87/dc9/d5e/d72/fa9 [0,4194304] 0 2024-01-31T05:13:22.540 INFO:tasks.workunit.client.0.smithi099.stdout:9/751: write d0/d7/f66 [2304772,91985] 0 2024-01-31T05:13:22.541 INFO:tasks.workunit.client.0.smithi099.stdout:2/716: rmdir d10/d1c/d43/db8/dce 0 2024-01-31T05:13:22.545 INFO:tasks.workunit.client.0.smithi099.stdout:2/717: rmdir d10/d1b/d7d/d7a/dad/dbf 0 2024-01-31T05:13:22.545 INFO:tasks.workunit.client.0.smithi099.stdout:2/718: write d10/d3a/f70 [481196,33919] 0 2024-01-31T05:13:22.547 INFO:tasks.workunit.client.0.smithi099.stdout:5/678: symlink d6/da/d14/d3d/d57/le2 0 2024-01-31T05:13:22.547 INFO:tasks.workunit.client.0.smithi099.stdout:5/679: chown d6/da/d14/d94/f8d 1256493 1 2024-01-31T05:13:22.552 INFO:tasks.workunit.client.0.smithi099.stdout:4/802: rename d0/d8/d19/d54/dd4 to d0/d2/d4b/d93/d59/dff/db9/d10b 0 2024-01-31T05:13:22.555 INFO:tasks.workunit.client.0.smithi099.stdout:7/778: rename d6/d12/l3a to d6/d32/d3d/d4b/d33/d37/d50/d5e/de8/lfc 0 2024-01-31T05:13:22.555 INFO:tasks.workunit.client.0.smithi099.stdout:5/680: fsync d6/da/d14/d3d/d8c/d99/fe1 0 2024-01-31T05:13:22.556 INFO:tasks.workunit.client.0.smithi099.stdout:5/681: chown d6/da/d14/d3d/d6e/d21/l30 10598681 1 2024-01-31T05:13:22.556 INFO:tasks.workunit.client.0.smithi099.stdout:5/682: fdatasync d6/da/d14/d3d/d51/f9f 0 2024-01-31T05:13:22.556 INFO:tasks.workunit.client.0.smithi099.stdout:7/779: dread d6/d32/d3d/d4b/d33/d37/d50/d25/d7a/fc2 [0,4194304] 0 2024-01-31T05:13:22.559 INFO:tasks.workunit.client.0.smithi099.stdout:8/799: rename d1/dd/d4f/dcd/fcf to d1/dd/f108 0 2024-01-31T05:13:22.559 INFO:tasks.workunit.client.0.smithi099.stdout:7/780: read d6/d32/d3d/d4b/d33/d37/d50/d4d/fbf [838280,110493] 0 2024-01-31T05:13:22.560 INFO:tasks.workunit.client.0.smithi099.stdout:4/803: mknod d0/d8/d19/d98/d9b/dab/c10c 0 2024-01-31T05:13:22.566 INFO:tasks.workunit.client.0.smithi099.stdout:3/731: rename d10/d27/d34/d44/la1 to d10/d24/d40/d81/l106 0 2024-01-31T05:13:22.566 INFO:tasks.workunit.client.0.smithi099.stdout:3/732: fdatasync d10/d32/f4e 0 2024-01-31T05:13:22.568 INFO:tasks.workunit.client.0.smithi099.stdout:8/800: mkdir d1/dd/dba/d29/d3f/d56/d57/d109 0 2024-01-31T05:13:22.571 INFO:tasks.workunit.client.0.smithi099.stdout:5/683: read d6/da/d14/d61/d98/faf [1518842,66142] 0 2024-01-31T05:13:22.572 INFO:tasks.workunit.client.0.smithi099.stdout:1/638: dwrite d4/dc/d29/f36 [4194304,4194304] 0 2024-01-31T05:13:22.574 INFO:tasks.workunit.client.0.smithi099.stdout:3/733: rename d10/d32/d85/d77/c87 to d10/d24/d40/d81/c107 0 2024-01-31T05:13:22.574 INFO:tasks.workunit.client.0.smithi099.stdout:3/734: stat d10/d27/d34/d44/d95/daf/ff7 0 2024-01-31T05:13:22.574 INFO:tasks.workunit.client.0.smithi099.stdout:3/735: truncate d10/fbf 4360627 0 2024-01-31T05:13:22.574 INFO:tasks.workunit.client.0.smithi099.stdout:3/736: fsync d10/d27/f53 0 2024-01-31T05:13:22.576 INFO:tasks.workunit.client.0.smithi099.stdout:9/752: dwrite d0/d3e/d87/dc9/d24/d2b/f1b [0,4194304] 0 2024-01-31T05:13:22.576 INFO:tasks.workunit.client.0.smithi099.stdout:3/737: mkdir d10/d1e/df2/d108 0 2024-01-31T05:13:22.576 INFO:tasks.workunit.client.0.smithi099.stdout:9/753: chown d0/d3e/d87/dc9/d24/d2b/d63/cfd 5 1 2024-01-31T05:13:22.576 INFO:tasks.workunit.client.0.smithi099.stdout:9/754: dread - d0/fc2 zero size 2024-01-31T05:13:22.577 INFO:tasks.workunit.client.0.smithi099.stdout:9/755: mknod d0/d5d/db5/c104 0 2024-01-31T05:13:22.580 INFO:tasks.workunit.client.0.smithi099.stdout:8/801: write d1/da6/fcb [1086242,114577] 0 2024-01-31T05:13:22.580 INFO:tasks.workunit.client.0.smithi099.stdout:9/756: creat d0/d3e/d87/dc9/d24/d2b/d63/da7/f105 x:0 0 0 2024-01-31T05:13:22.580 INFO:tasks.workunit.client.0.smithi099.stdout:9/757: write d0/d7/dd2/fe7 [654130,66253] 0 2024-01-31T05:13:22.580 INFO:tasks.workunit.client.0.smithi099.stdout:9/758: truncate d0/d7/da6/ff1 336468 0 2024-01-31T05:13:22.580 INFO:tasks.workunit.client.0.smithi099.stdout:9/759: write d0/d3e/d87/dc9/d24/d2b/d63/f94 [958216,70120] 0 2024-01-31T05:13:22.581 INFO:tasks.workunit.client.0.smithi099.stdout:8/802: creat d1/dd/d65/f10a x:0 0 0 2024-01-31T05:13:22.582 INFO:tasks.workunit.client.0.smithi099.stdout:9/760: truncate d0/d7/d2e/f43 941423 0 2024-01-31T05:13:22.582 INFO:tasks.workunit.client.0.smithi099.stdout:8/803: symlink d1/dd/dba/d20/l10b 0 2024-01-31T05:13:22.582 INFO:tasks.workunit.client.0.smithi099.stdout:8/804: readlink d1/la 0 2024-01-31T05:13:22.582 INFO:tasks.workunit.client.0.smithi099.stdout:8/805: chown d1/dd/dba/d29/d3f/d56/da0/d2e/c75 16194982 1 2024-01-31T05:13:22.583 INFO:tasks.workunit.client.0.smithi099.stdout:2/719: dwrite d10/d1c/f64 [0,4194304] 0 2024-01-31T05:13:22.583 INFO:tasks.workunit.client.0.smithi099.stdout:2/720: creat d10/d51/fe1 x:0 0 0 2024-01-31T05:13:22.583 INFO:tasks.workunit.client.0.smithi099.stdout:8/806: fsync d1/dd/dba/d29/d3f/d56/da0/f44 0 2024-01-31T05:13:22.584 INFO:tasks.workunit.client.0.smithi099.stdout:5/684: dread d6/f18 [0,4194304] 0 2024-01-31T05:13:22.584 INFO:tasks.workunit.client.0.smithi099.stdout:5/685: write d6/da/d14/d3d/d51/f9f [677393,91897] 0 2024-01-31T05:13:22.584 INFO:tasks.workunit.client.0.smithi099.stdout:5/686: chown d6/da/d14/d61/d98/da0/ccb 6171 1 2024-01-31T05:13:22.584 INFO:tasks.workunit.client.0.smithi099.stdout:5/687: chown d6/da/d14/d3d/d57/dc6 379 1 2024-01-31T05:13:22.584 INFO:tasks.workunit.client.0.smithi099.stdout:5/688: creat d6/da/d14/d2b/d7b/fe3 x:0 0 0 2024-01-31T05:13:22.585 INFO:tasks.workunit.client.0.smithi099.stdout:9/761: mknod d0/d3e/c106 0 2024-01-31T05:13:22.585 INFO:tasks.workunit.client.0.smithi099.stdout:7/781: dwrite d6/d32/d3d/d4b/d33/d37/d50/f3e [0,4194304] 0 2024-01-31T05:13:22.585 INFO:tasks.workunit.client.0.smithi099.stdout:4/804: dwrite d0/d2/f9f [0,4194304] 0 2024-01-31T05:13:22.585 INFO:tasks.workunit.client.0.smithi099.stdout:6/641: link d14/c19 d14/d18/d52/d7e/d1c/d29/d94/da3/cca 0 2024-01-31T05:13:22.587 INFO:tasks.workunit.client.0.smithi099.stdout:6/642: symlink d14/d18/d52/d7e/d66/d99/lcb 0 2024-01-31T05:13:22.590 INFO:tasks.workunit.client.0.smithi099.stdout:1/639: read d4/dc/d15/f1a [2738918,61375] 0 2024-01-31T05:13:22.597 INFO:tasks.workunit.client.0.smithi099.stdout:3/738: dread d10/dfa/fca [0,4194304] 0 2024-01-31T05:13:22.598 INFO:tasks.workunit.client.0.smithi099.stdout:9/762: mknod d0/d5d/db5/c107 0 2024-01-31T05:13:22.598 INFO:tasks.workunit.client.0.smithi099.stdout:9/763: fsync d0/d7/da6/ff1 0 2024-01-31T05:13:22.598 INFO:tasks.workunit.client.0.smithi099.stdout:4/805: dread d0/d1e/d61/fe2 [0,4194304] 0 2024-01-31T05:13:22.599 INFO:tasks.workunit.client.0.smithi099.stdout:5/689: read d6/da/d14/d3d/f53 [1043291,50427] 0 2024-01-31T05:13:22.611 INFO:tasks.workunit.client.0.smithi099.stdout:7/782: rmdir d6/d32/d3d/dd7/dc5 39 2024-01-31T05:13:22.613 INFO:tasks.workunit.client.0.smithi099.stdout:3/739: dread d10/d27/d34/d52/f7d [0,4194304] 0 2024-01-31T05:13:22.614 INFO:tasks.workunit.client.0.smithi099.stdout:3/740: readlink d10/d32/d33/l6a 0 2024-01-31T05:13:22.616 INFO:tasks.workunit.client.0.smithi099.stdout:1/640: dwrite d4/dc/d44/fc8 [0,4194304] 0 2024-01-31T05:13:22.617 INFO:tasks.workunit.client.0.smithi099.stdout:9/764: creat d0/d3e/d87/dc9/d5e/d72/dbf/f108 x:0 0 0 2024-01-31T05:13:22.620 INFO:tasks.workunit.client.0.smithi099.stdout:3/741: symlink d10/d27/d34/d44/d60/d75/l109 0 2024-01-31T05:13:22.621 INFO:tasks.workunit.client.0.smithi099.stdout:3/742: readlink d10/d24/d40/d81/lfb 0 2024-01-31T05:13:22.621 INFO:tasks.workunit.client.0.smithi099.stdout:9/765: dread d0/d3e/d87/dc9/d5e/d72/d89/d98/fbd [0,4194304] 0 2024-01-31T05:13:22.621 INFO:tasks.workunit.client.0.smithi099.stdout:9/766: write d0/d3e/d87/dc9/d5e/d72/dbf/f108 [723142,123451] 0 2024-01-31T05:13:22.621 INFO:tasks.workunit.client.0.smithi099.stdout:9/767: write d0/d44/f9a [1121323,122248] 0 2024-01-31T05:13:22.624 INFO:tasks.workunit.client.0.smithi099.stdout:5/690: dwrite d6/da/d14/d61/f64 [0,4194304] 0 2024-01-31T05:13:22.626 INFO:tasks.workunit.client.0.smithi099.stdout:7/783: symlink d6/d32/d3d/d4b/d9b/lfd 0 2024-01-31T05:13:22.629 INFO:tasks.workunit.client.0.smithi099.stdout:9/768: symlink d0/d7/da6/l109 0 2024-01-31T05:13:22.629 INFO:tasks.workunit.client.0.smithi099.stdout:9/769: fdatasync d0/d3e/d87/dc9/d5e/d72/d89/d98/fb9 0 2024-01-31T05:13:22.629 INFO:tasks.workunit.client.0.smithi099.stdout:1/641: getdents d4/dc/d15/d45 0 2024-01-31T05:13:22.631 INFO:tasks.workunit.client.0.smithi099.stdout:6/643: truncate d14/f17 3195526 0 2024-01-31T05:13:22.632 INFO:tasks.workunit.client.0.smithi099.stdout:6/644: mknod d14/d18/d52/d7e/d1c/d29/d79/dc6/ccc 0 2024-01-31T05:13:22.632 INFO:tasks.workunit.client.0.smithi099.stdout:5/691: mkdir d6/da/d3f/d73/de4 0 2024-01-31T05:13:22.633 INFO:tasks.workunit.client.0.smithi099.stdout:6/645: creat d14/d18/d52/d7e/d1c/da6/dba/fcd x:0 0 0 2024-01-31T05:13:22.634 INFO:tasks.workunit.client.0.smithi099.stdout:6/646: creat d14/d18/d52/d22/fce x:0 0 0 2024-01-31T05:13:22.635 INFO:tasks.workunit.client.0.smithi099.stdout:9/770: unlink d0/d7/dd2/fd5 0 2024-01-31T05:13:22.636 INFO:tasks.workunit.client.0.smithi099.stdout:5/692: mknod d6/da/d14/d3d/d8c/ce5 0 2024-01-31T05:13:22.643 INFO:tasks.workunit.client.0.smithi099.stdout:5/693: dread d6/ff [0,4194304] 0 2024-01-31T05:13:22.646 INFO:tasks.workunit.client.0.smithi099.stdout:1/642: write d4/dc/d29/f36 [2334066,68059] 0 2024-01-31T05:13:22.648 INFO:tasks.workunit.client.0.smithi099.stdout:1/643: mknod d4/dc/d4d/d5d/ccb 0 2024-01-31T05:13:22.649 INFO:tasks.workunit.client.0.smithi099.stdout:1/644: creat d4/dc/d29/fcc x:0 0 0 2024-01-31T05:13:22.650 INFO:tasks.workunit.client.0.smithi099.stdout:8/807: rename d1/dd/dba/d19/c4d to d1/dd/d65/d7f/d81/dc4/c10c 0 2024-01-31T05:13:22.651 INFO:tasks.workunit.client.0.smithi099.stdout:7/784: dwrite d6/d32/f5b [0,4194304] 0 2024-01-31T05:13:22.656 INFO:tasks.workunit.client.0.smithi099.stdout:3/743: rename d10/d27/d34/d44/d60/ffc to d10/d27/d34/d44/d60/d75/d8c/db1/f10a 0 2024-01-31T05:13:22.657 INFO:tasks.workunit.client.0.smithi099.stdout:7/785: mkdir d6/d32/d3d/d4b/d33/d37/dfe 0 2024-01-31T05:13:22.657 INFO:tasks.workunit.client.0.smithi099.stdout:7/786: write d6/d32/d3d/dd7/dc5/fe9 [490205,115776] 0 2024-01-31T05:13:22.659 INFO:tasks.workunit.client.0.smithi099.stdout:7/787: mknod d6/d32/d3d/d46/cff 0 2024-01-31T05:13:22.662 INFO:tasks.workunit.client.0.smithi099.stdout:7/788: rename d6/d32/d3d/d4b/d33/d37/d50/d7b/fa5 to d6/d32/d3d/d4b/d33/d37/d50/d25/d7a/f100 0 2024-01-31T05:13:22.662 INFO:tasks.workunit.client.0.smithi099.stdout:3/744: dread d10/d32/d85/f2c [0,4194304] 0 2024-01-31T05:13:22.662 INFO:tasks.workunit.client.0.smithi099.stdout:3/745: write d10/d27/d34/f88 [1735949,113438] 0 2024-01-31T05:13:22.662 INFO:tasks.workunit.client.0.smithi099.stdout:3/746: fdatasync d10/d32/fad 0 2024-01-31T05:13:22.674 INFO:tasks.workunit.client.0.smithi099.stdout:5/694: dwrite d6/da/d14/d2b/d7b/fe3 [0,4194304] 0 2024-01-31T05:13:22.674 INFO:tasks.workunit.client.0.smithi099.stdout:5/695: chown d6/da/d14/d3d/d57/le2 92 1 2024-01-31T05:13:22.674 INFO:tasks.workunit.client.0.smithi099.stdout:5/696: write d6/da/d14/d3d/d6e/f85 [1382411,45937] 0 2024-01-31T05:13:22.675 INFO:tasks.workunit.client.0.smithi099.stdout:8/808: dwrite d1/dd/dba/d29/d3f/d56/fc2 [0,4194304] 0 2024-01-31T05:13:22.681 INFO:tasks.workunit.client.0.smithi099.stdout:7/789: dread d6/d32/d3d/d4b/d33/d37/fa2 [0,4194304] 0 2024-01-31T05:13:22.681 INFO:tasks.workunit.client.0.smithi099.stdout:1/645: dwrite d4/dc/d29/fa8 [0,4194304] 0 2024-01-31T05:13:22.683 INFO:tasks.workunit.client.0.smithi099.stdout:7/790: symlink d6/d32/d3d/d4b/d33/d37/d50/d25/d72/d8e/d9a/l101 0 2024-01-31T05:13:22.684 INFO:tasks.workunit.client.0.smithi099.stdout:7/791: creat d6/d32/d3d/d4b/f102 x:0 0 0 2024-01-31T05:13:22.684 INFO:tasks.workunit.client.0.smithi099.stdout:3/747: dwrite d10/d27/d34/d44/d60/fa8 [0,4194304] 0 2024-01-31T05:13:22.687 INFO:tasks.workunit.client.0.smithi099.stdout:3/748: mknod d10/d27/d34/d44/d60/d75/d8c/d92/c10b 0 2024-01-31T05:13:22.688 INFO:tasks.workunit.client.0.smithi099.stdout:3/749: fsync d10/d32/d85/f1d 0 2024-01-31T05:13:22.688 INFO:tasks.workunit.client.0.smithi099.stdout:3/750: truncate d10/d32/d85/f1d 4973646 0 2024-01-31T05:13:22.688 INFO:tasks.workunit.client.0.smithi099.stdout:3/751: fdatasync d10/f19 0 2024-01-31T05:13:22.688 INFO:tasks.workunit.client.0.smithi099.stdout:5/697: write d6/da/d14/d61/f64 [39829,120179] 0 2024-01-31T05:13:22.690 INFO:tasks.workunit.client.0.smithi099.stdout:1/646: unlink d4/db/d12/dc0/d4b/f79 0 2024-01-31T05:13:22.690 INFO:tasks.workunit.client.0.smithi099.stdout:1/647: write d4/dc/d15/fb1 [598944,60058] 0 2024-01-31T05:13:22.690 INFO:tasks.workunit.client.0.smithi099.stdout:1/648: write d4/db/d3a/d7e/fba [445595,41829] 0 2024-01-31T05:13:22.690 INFO:tasks.workunit.client.0.smithi099.stdout:1/649: dread - d4/db/fa4 zero size 2024-01-31T05:13:22.690 INFO:tasks.workunit.client.0.smithi099.stdout:5/698: write d6/da/d14/f3b [475130,129953] 0 2024-01-31T05:13:22.690 INFO:tasks.workunit.client.0.smithi099.stdout:5/699: readlink d6/da/d14/d3d/d51/lb8 0 2024-01-31T05:13:22.691 INFO:tasks.workunit.client.0.smithi099.stdout:1/650: rename d4/db/d3a/f60 to d4/db/d3a/d7e/d85/d96/fcd 0 2024-01-31T05:13:22.692 INFO:tasks.workunit.client.0.smithi099.stdout:1/651: readlink d4/db/lc6 0 2024-01-31T05:13:22.692 INFO:tasks.workunit.client.0.smithi099.stdout:1/652: chown d4/dc/d15/d45 354 1 2024-01-31T05:13:22.695 INFO:tasks.workunit.client.0.smithi099.stdout:5/700: rename d6/da/d14/d2b/d7b to d6/da/d14/d3d/d8c/de6 0 2024-01-31T05:13:22.697 INFO:tasks.workunit.client.0.smithi099.stdout:5/701: mkdir d6/da/d14/de7 0 2024-01-31T05:13:22.699 INFO:tasks.workunit.client.0.smithi099.stdout:8/809: link d1/da6/db4/le7 d1/dd/d65/d7f/d81/dc7/dce/l10d 0 2024-01-31T05:13:22.699 INFO:tasks.workunit.client.0.smithi099.stdout:5/702: creat d6/da/d14/d3d/d51/dae/fe8 x:0 0 0 2024-01-31T05:13:22.699 INFO:tasks.workunit.client.0.smithi099.stdout:5/703: readlink d6/da/d14/d3d/d8c/d99/lc2 0 2024-01-31T05:13:22.699 INFO:tasks.workunit.client.0.smithi099.stdout:5/704: chown d6/da/d14/d61/d98/da0 230119 1 2024-01-31T05:13:22.699 INFO:tasks.workunit.client.0.smithi099.stdout:5/705: chown d6/da/d14/d3d/d51/f74 16 1 2024-01-31T05:13:22.702 INFO:tasks.workunit.client.0.smithi099.stdout:7/792: dwrite d6/d32/d3d/d4b/d9b/fc7 [0,4194304] 0 2024-01-31T05:13:22.703 INFO:tasks.workunit.client.0.smithi099.stdout:5/706: link d6/da/d14/d3d/d6e/f3a d6/da/d14/d61/fe9 0 2024-01-31T05:13:22.703 INFO:tasks.workunit.client.0.smithi099.stdout:3/752: dread d10/d32/d85/f1d [0,4194304] 0 2024-01-31T05:13:22.703 INFO:tasks.workunit.client.0.smithi099.stdout:3/753: chown d10/d1e/f25 17903 1 2024-01-31T05:13:22.710 INFO:tasks.workunit.client.0.smithi099.stdout:5/707: unlink d6/da/d14/d61/d98/faf 0 2024-01-31T05:13:22.713 INFO:tasks.workunit.client.0.smithi099.stdout:8/810: rmdir d1/dd/d65/d7f 39 2024-01-31T05:13:22.714 INFO:tasks.workunit.client.0.smithi099.stdout:7/793: dread d6/d32/d3d/f7c [0,4194304] 0 2024-01-31T05:13:22.714 INFO:tasks.workunit.client.0.smithi099.stdout:5/708: mknod d6/cea 0 2024-01-31T05:13:22.715 INFO:tasks.workunit.client.0.smithi099.stdout:5/709: fsync d6/f91 0 2024-01-31T05:13:22.716 INFO:tasks.workunit.client.0.smithi099.stdout:3/754: link d10/d27/d34/d44/d95/la6 d10/d24/l10c 0 2024-01-31T05:13:22.717 INFO:tasks.workunit.client.0.smithi099.stdout:7/794: creat d6/d32/d3d/d4b/d33/d37/f103 x:0 0 0 2024-01-31T05:13:22.718 INFO:tasks.workunit.client.0.smithi099.stdout:7/795: mkdir d6/d32/d3d/d4b/d33/d37/d50/d25/d7a/d104 0 2024-01-31T05:13:22.723 INFO:tasks.workunit.client.0.smithi099.stdout:1/653: dwrite d4/dc/d48/f3d [0,4194304] 0 2024-01-31T05:13:22.723 INFO:tasks.workunit.client.0.smithi099.stdout:1/654: dread - d4/db/d12/dc0/d4b/d50/d91/f7b zero size 2024-01-31T05:13:22.723 INFO:tasks.workunit.client.0.smithi099.stdout:1/655: readlink d4/db/d12/dc0/d4b/d50/l68 0 2024-01-31T05:13:22.726 INFO:tasks.workunit.client.0.smithi099.stdout:3/755: dread d10/d27/d34/d44/d95/f76 [0,4194304] 0 2024-01-31T05:13:22.730 INFO:tasks.workunit.client.0.smithi099.stdout:3/756: link d10/d27/d34/d44/d95/la6 d10/d27/d34/d44/d60/d75/d8c/db1/l10d 0 2024-01-31T05:13:22.730 INFO:tasks.workunit.client.0.smithi099.stdout:3/757: readlink d10/d24/d40/d81/lfb 0 2024-01-31T05:13:22.730 INFO:tasks.workunit.client.0.smithi099.stdout:1/656: symlink d4/db/d12/dc0/d8f/lce 0 2024-01-31T05:13:22.733 INFO:tasks.workunit.client.0.smithi099.stdout:7/796: read d6/d32/d3d/d4b/d33/fca [7156108,126353] 0 2024-01-31T05:13:22.737 INFO:tasks.workunit.client.0.smithi099.stdout:5/710: dwrite d6/da/d14/d3d/d51/d82/f43 [0,4194304] 0 2024-01-31T05:13:22.737 INFO:tasks.workunit.client.0.smithi099.stdout:5/711: getdents d6/da/d14/d3d/da8/dde 0 2024-01-31T05:13:22.737 INFO:tasks.workunit.client.0.smithi099.stdout:5/712: fdatasync d6/da/d14/d3d/d8c/fbb 0 2024-01-31T05:13:22.739 INFO:tasks.workunit.client.0.smithi099.stdout:2/721: sync 2024-01-31T05:13:22.739 INFO:tasks.workunit.client.0.smithi099.stdout:0/763: sync 2024-01-31T05:13:22.739 INFO:tasks.workunit.client.0.smithi099.stdout:0/764: dread - d1/d37/d4a/d6f/fe7 zero size 2024-01-31T05:13:22.740 INFO:tasks.workunit.client.0.smithi099.stdout:5/713: dread d6/da/d14/d2b/fab [0,4194304] 0 2024-01-31T05:13:22.740 INFO:tasks.workunit.client.0.smithi099.stdout:0/765: mkdir d1/d37/d4a/d10e 0 2024-01-31T05:13:22.740 INFO:tasks.workunit.client.0.smithi099.stdout:0/766: truncate d1/d56/d103/fa7 4421671 0 2024-01-31T05:13:22.741 INFO:tasks.workunit.client.0.smithi099.stdout:7/797: dread d6/d32/d3d/dd7/dc5/fdb [0,4194304] 0 2024-01-31T05:13:22.741 INFO:tasks.workunit.client.0.smithi099.stdout:7/798: creat d6/d32/d3d/d4b/d33/d37/f105 x:0 0 0 2024-01-31T05:13:22.742 INFO:tasks.workunit.client.0.smithi099.stdout:1/657: read d4/dc/d15/f7a [1982588,45538] 0 2024-01-31T05:13:22.742 INFO:tasks.workunit.client.0.smithi099.stdout:0/767: mknod d1/d56/d103/d8b/c10f 0 2024-01-31T05:13:22.744 INFO:tasks.workunit.client.0.smithi099.stdout:7/799: mkdir d6/d32/d3d/d4b/d33/d37/d106 0 2024-01-31T05:13:22.744 INFO:tasks.workunit.client.0.smithi099.stdout:0/768: creat d1/d16/f110 x:0 0 0 2024-01-31T05:13:22.745 INFO:tasks.workunit.client.0.smithi099.stdout:7/800: mkdir d6/d32/d3d/d4b/d33/d37/d50/d5e/d107 0 2024-01-31T05:13:22.746 INFO:tasks.workunit.client.0.smithi099.stdout:0/769: creat d1/d30/d45/f111 x:0 0 0 2024-01-31T05:13:22.749 INFO:tasks.workunit.client.0.smithi099.stdout:0/770: link d1/d37/d4a/l4d d1/d37/d4a/d7a/d7d/l112 0 2024-01-31T05:13:22.751 INFO:tasks.workunit.client.0.smithi099.stdout:5/714: dread d6/da/d14/d3d/d57/d92/fa7 [0,4194304] 0 2024-01-31T05:13:22.753 INFO:tasks.workunit.client.0.smithi099.stdout:5/715: mknod d6/da/d3f/d73/ceb 0 2024-01-31T05:13:22.753 INFO:tasks.workunit.client.0.smithi099.stdout:5/716: write d6/da/d3f/f4d [1441503,34308] 0 2024-01-31T05:13:22.755 INFO:tasks.workunit.client.0.smithi099.stdout:5/717: rename d6/da/d3f/d73/lbf to d6/da/d14/d2b/d9e/lec 0 2024-01-31T05:13:22.758 INFO:tasks.workunit.client.0.smithi099.stdout:0/771: dread d1/d37/d4a/d6f/f71 [0,4194304] 0 2024-01-31T05:13:22.758 INFO:tasks.workunit.client.0.smithi099.stdout:0/772: dread - d1/d37/d4a/d6f/dc9/dcf/ff6 zero size 2024-01-31T05:13:22.763 INFO:tasks.workunit.client.0.smithi099.stdout:3/758: dwrite d10/d27/d34/f5c [4194304,4194304] 0 2024-01-31T05:13:22.764 INFO:tasks.workunit.client.0.smithi099.stdout:3/759: link d10/d32/d33/d51/l54 d10/d32/l10e 0 2024-01-31T05:13:22.767 INFO:tasks.workunit.client.0.smithi099.stdout:3/760: mkdir d10/d27/d34/d44/d60/d75/d8c/d10f 0 2024-01-31T05:13:22.767 INFO:tasks.workunit.client.0.smithi099.stdout:3/761: fsync d10/d1e/da2/fb4 0 2024-01-31T05:13:22.768 INFO:tasks.workunit.client.0.smithi099.stdout:2/722: dwrite d10/d1b/f6f [0,4194304] 0 2024-01-31T05:13:22.769 INFO:tasks.workunit.client.0.smithi099.stdout:3/762: mknod d10/d27/d34/d44/d60/d75/d8c/c110 0 2024-01-31T05:13:22.770 INFO:tasks.workunit.client.0.smithi099.stdout:0/773: read d1/d30/d45/dad/f55 [3019839,87183] 0 2024-01-31T05:13:22.770 INFO:tasks.workunit.client.0.smithi099.stdout:3/763: mkdir d10/d27/d34/d111 0 2024-01-31T05:13:22.770 INFO:tasks.workunit.client.0.smithi099.stdout:3/764: read d10/f66 [3993308,105387] 0 2024-01-31T05:13:22.770 INFO:tasks.workunit.client.0.smithi099.stdout:3/765: creat d10/d27/d34/d44/d60/d75/d8c/d92/f112 x:0 0 0 2024-01-31T05:13:22.771 INFO:tasks.workunit.client.0.smithi099.stdout:0/774: creat d1/d64/ded/dee/f113 x:0 0 0 2024-01-31T05:13:22.771 INFO:tasks.workunit.client.0.smithi099.stdout:0/775: chown d1/d30/d45/d66/d97/ld2 2015378131 1 2024-01-31T05:13:22.771 INFO:tasks.workunit.client.0.smithi099.stdout:0/776: stat d1/d37/d4a/d7a/d7d/fa0 0 2024-01-31T05:13:22.771 INFO:tasks.workunit.client.0.smithi099.stdout:0/777: chown d1/d56/d103/lc7 8294 1 2024-01-31T05:13:22.772 INFO:tasks.workunit.client.0.smithi099.stdout:0/778: mknod d1/d64/ded/dee/df2/c114 0 2024-01-31T05:13:22.773 INFO:tasks.workunit.client.0.smithi099.stdout:3/766: symlink d10/d24/l113 0 2024-01-31T05:13:22.774 INFO:tasks.workunit.client.0.smithi099.stdout:0/779: creat d1/d8/dd6/f115 x:0 0 0 2024-01-31T05:13:22.780 INFO:tasks.workunit.client.0.smithi099.stdout:1/658: dwrite d4/dc/d29/fa8 [0,4194304] 0 2024-01-31T05:13:22.780 INFO:tasks.workunit.client.0.smithi099.stdout:7/801: dwrite d6/d32/d3d/d4b/f23 [0,4194304] 0 2024-01-31T05:13:22.780 INFO:tasks.workunit.client.0.smithi099.stdout:7/802: chown d6/d32/d3d/de6/df1/lc3 23940284 1 2024-01-31T05:13:22.781 INFO:tasks.workunit.client.0.smithi099.stdout:1/659: mkdir d4/dc/d4d/da5/dcf 0 2024-01-31T05:13:22.784 INFO:tasks.workunit.client.0.smithi099.stdout:3/767: dread d10/d32/d85/d77/fd0 [0,4194304] 0 2024-01-31T05:13:22.784 INFO:tasks.workunit.client.0.smithi099.stdout:3/768: readlink d10/d27/d34/d44/d60/d75/d8c/la4 0 2024-01-31T05:13:22.785 INFO:tasks.workunit.client.0.smithi099.stdout:7/803: getdents d6/d12 0 2024-01-31T05:13:22.785 INFO:tasks.workunit.client.0.smithi099.stdout:7/804: write d6/d32/d3d/d4b/d33/d37/d50/ff6 [877812,46470] 0 2024-01-31T05:13:22.786 INFO:tasks.workunit.client.0.smithi099.stdout:3/769: creat d10/d27/d34/d44/d60/d75/d8c/dff/f114 x:0 0 0 2024-01-31T05:13:22.787 INFO:tasks.workunit.client.0.smithi099.stdout:7/805: symlink d6/d32/d3d/d4b/d33/d37/d50/d25/d72/d8e/df7/l108 0 2024-01-31T05:13:22.789 INFO:tasks.workunit.client.0.smithi099.stdout:7/806: symlink d6/d32/d3d/d4b/d33/d37/d50/d25/d7a/d104/l109 0 2024-01-31T05:13:22.789 INFO:tasks.workunit.client.0.smithi099.stdout:7/807: chown d6/lb 4358787 1 2024-01-31T05:13:22.794 INFO:tasks.workunit.client.0.smithi099.stdout:1/660: write d4/f90 [1010995,45869] 0 2024-01-31T05:13:22.794 INFO:tasks.workunit.client.0.smithi099.stdout:2/723: dwrite d10/d3a/f70 [0,4194304] 0 2024-01-31T05:13:22.799 INFO:tasks.workunit.client.0.smithi099.stdout:3/770: dread ff [0,4194304] 0 2024-01-31T05:13:22.800 INFO:tasks.workunit.client.0.smithi099.stdout:1/661: creat d4/fd0 x:0 0 0 2024-01-31T05:13:22.800 INFO:tasks.workunit.client.0.smithi099.stdout:1/662: write d4/db/d12/dc0/d4b/d50/d91/f7b [816499,33543] 0 2024-01-31T05:13:22.800 INFO:tasks.workunit.client.0.smithi099.stdout:1/663: truncate d4/dc/d15/f5a 703820 0 2024-01-31T05:13:22.803 INFO:tasks.workunit.client.0.smithi099.stdout:2/724: dread d10/d20/f68 [4194304,4194304] 0 2024-01-31T05:13:22.804 INFO:tasks.workunit.client.0.smithi099.stdout:0/780: dwrite d1/d37/d4a/d7a/d9d/fae [0,4194304] 0 2024-01-31T05:13:22.814 INFO:tasks.workunit.client.0.smithi099.stdout:7/808: dwrite d6/d32/d3d/d4b/f102 [0,4194304] 0 2024-01-31T05:13:22.814 INFO:tasks.workunit.client.0.smithi099.stdout:3/771: write d10/d24/d40/f82 [1999918,82621] 0 2024-01-31T05:13:22.818 INFO:tasks.workunit.client.0.smithi099.stdout:7/809: link d6/d32/d3d/d4b/d33/d37/d50/d4d/c78 d6/d32/d3d/d4b/d33/d37/d50/d25/d72/c10a 0 2024-01-31T05:13:22.818 INFO:tasks.workunit.client.0.smithi099.stdout:7/810: write d6/d32/d3d/d4b/d33/fac [450685,125238] 0 2024-01-31T05:13:22.819 INFO:tasks.workunit.client.0.smithi099.stdout:3/772: mkdir d10/d27/d34/d111/d115 0 2024-01-31T05:13:22.819 INFO:tasks.workunit.client.0.smithi099.stdout:3/773: fsync d10/d32/d85/da3/fd3 0 2024-01-31T05:13:22.821 INFO:tasks.workunit.client.0.smithi099.stdout:7/811: creat d6/d32/d3d/d4b/d33/d37/dfe/f10b x:0 0 0 2024-01-31T05:13:22.821 INFO:tasks.workunit.client.0.smithi099.stdout:7/812: truncate d6/d32/d3d/d4b/d33/d37/d50/d4d/dad/daf/fc0 653957 0 2024-01-31T05:13:22.822 INFO:tasks.workunit.client.0.smithi099.stdout:1/664: dwrite d4/db/d12/dc0/f41 [0,4194304] 0 2024-01-31T05:13:22.835 INFO:tasks.workunit.client.0.smithi099.stdout:0/781: dwrite d1/d37/d4a/d7b/fc2 [0,4194304] 0 2024-01-31T05:13:22.839 INFO:tasks.workunit.client.0.smithi099.stdout:2/725: dwrite d10/d2b/d58/fc9 [0,4194304] 0 2024-01-31T05:13:22.843 INFO:tasks.workunit.client.0.smithi099.stdout:2/726: creat d10/d20/fe2 x:0 0 0 2024-01-31T05:13:22.846 INFO:tasks.workunit.client.0.smithi099.stdout:0/782: write d1/d37/d4a/fd7 [1664326,109896] 0 2024-01-31T05:13:22.846 INFO:tasks.workunit.client.0.smithi099.stdout:0/783: truncate d1/d37/d4a/d7a/f4b 355593 0 2024-01-31T05:13:22.846 INFO:tasks.workunit.client.0.smithi099.stdout:1/665: dwrite d4/db/d12/dc0/d69/f70 [0,4194304] 0 2024-01-31T05:13:22.846 INFO:tasks.workunit.client.0.smithi099.stdout:1/666: fdatasync d4/db/d12/dc0/d4b/d50/fc9 0 2024-01-31T05:13:22.846 INFO:tasks.workunit.client.0.smithi099.stdout:1/667: write d4/dc/d15/f7a [309445,35265] 0 2024-01-31T05:13:22.846 INFO:tasks.workunit.client.0.smithi099.stdout:1/668: readlink d4/dc/d4d/lb8 0 2024-01-31T05:13:22.847 INFO:tasks.workunit.client.0.smithi099.stdout:0/784: getdents d1/d30/d45/dad 0 2024-01-31T05:13:22.847 INFO:tasks.workunit.client.0.smithi099.stdout:0/785: creat d1/d30/d45/d6e/f116 x:0 0 0 2024-01-31T05:13:22.847 INFO:tasks.workunit.client.0.smithi099.stdout:0/786: write d1/d37/d4a/d6f/f71 [194817,18321] 0 2024-01-31T05:13:22.850 INFO:tasks.workunit.client.0.smithi099.stdout:0/787: mknod d1/d37/d73/dbc/dfd/c117 0 2024-01-31T05:13:22.850 INFO:tasks.workunit.client.0.smithi099.stdout:0/788: stat d1/ff3 0 2024-01-31T05:13:22.850 INFO:tasks.workunit.client.0.smithi099.stdout:0/789: truncate d1/d56/d103/d8b/fa9 414496 0 2024-01-31T05:13:22.851 INFO:tasks.workunit.client.0.smithi099.stdout:0/790: dread d1/d37/d4a/fe3 [0,4194304] 0 2024-01-31T05:13:22.851 INFO:tasks.workunit.client.0.smithi099.stdout:0/791: creat d1/d16/f118 x:0 0 0 2024-01-31T05:13:22.853 INFO:tasks.workunit.client.0.smithi099.stdout:0/792: rmdir d1/d37/d73 39 2024-01-31T05:13:22.855 INFO:tasks.workunit.client.0.smithi099.stdout:0/793: creat d1/d56/f119 x:0 0 0 2024-01-31T05:13:22.855 INFO:tasks.workunit.client.0.smithi099.stdout:0/794: chown d1/d56/d103/d8b/c10f 61560 1 2024-01-31T05:13:22.856 INFO:tasks.workunit.client.0.smithi099.stdout:0/795: mkdir d1/d37/d73/db7/dc5/d11a 0 2024-01-31T05:13:22.856 INFO:tasks.workunit.client.0.smithi099.stdout:0/796: dread - d1/d37/d4a/d7a/d7d/f8d zero size 2024-01-31T05:13:22.857 INFO:tasks.workunit.client.0.smithi099.stdout:0/797: link d1/d64/ded/dee/l106 d1/d37/d4a/d7a/l11b 0 2024-01-31T05:13:22.858 INFO:tasks.workunit.client.0.smithi099.stdout:4/806: sync 2024-01-31T05:13:22.860 INFO:tasks.workunit.client.0.smithi099.stdout:4/807: dread d0/d2/d4b/d93/d59/dff/fa6 [0,4194304] 0 2024-01-31T05:13:22.861 INFO:tasks.workunit.client.0.smithi099.stdout:4/808: mknod d0/d2/d4b/d93/d86/c10d 0 2024-01-31T05:13:22.867 INFO:tasks.workunit.client.0.smithi099.stdout:0/798: read d1/d8/f65 [2816873,2865] 0 2024-01-31T05:13:22.868 INFO:tasks.workunit.client.0.smithi099.stdout:2/727: rename d10/d1b/d4d/l6e to d10/d1c/le3 0 2024-01-31T05:13:22.872 INFO:tasks.workunit.client.0.smithi099.stdout:2/728: rmdir d10/d2b/d7c 39 2024-01-31T05:13:22.873 INFO:tasks.workunit.client.0.smithi099.stdout:2/729: rmdir d10/d1b/d4d/d5a 39 2024-01-31T05:13:22.874 INFO:tasks.workunit.client.0.smithi099.stdout:2/730: creat d10/d1b/d83/d86/d95/fe4 x:0 0 0 2024-01-31T05:13:22.874 INFO:tasks.workunit.client.0.smithi099.stdout:2/731: chown d10/d3a/d69 76037146 1 2024-01-31T05:13:22.875 INFO:tasks.workunit.client.0.smithi099.stdout:2/732: getdents d10/d2b/d58/dc3 0 2024-01-31T05:13:22.875 INFO:tasks.workunit.client.0.smithi099.stdout:2/733: chown d10/d2b/l72 1564 1 2024-01-31T05:13:22.892 INFO:tasks.workunit.client.0.smithi099.stdout:4/809: dwrite d0/d2/d4b/f5f [0,4194304] 0 2024-01-31T05:13:22.893 INFO:tasks.workunit.client.0.smithi099.stdout:0/799: dwrite d1/d64/ded/dee/f113 [0,4194304] 0 2024-01-31T05:13:22.893 INFO:tasks.workunit.client.0.smithi099.stdout:1/669: rename d4/db/d12/dc0/d4b/d50/d91/f3e to d4/db/fd1 0 2024-01-31T05:13:22.901 INFO:tasks.workunit.client.0.smithi099.stdout:4/810: creat d0/d2/d4b/d93/d59/d82/dfa/f10e x:0 0 0 2024-01-31T05:13:22.901 INFO:tasks.workunit.client.0.smithi099.stdout:4/811: dread - d0/d2/d4b/d93/d17/d7d/db2/dc7/dcc/fd7 zero size 2024-01-31T05:13:22.905 INFO:tasks.workunit.client.0.smithi099.stdout:4/812: unlink d0/d2/d4b/d93/d86/db4/cba 0 2024-01-31T05:13:22.905 INFO:tasks.workunit.client.0.smithi099.stdout:4/813: write d0/f3 [555071,129083] 0 2024-01-31T05:13:22.905 INFO:tasks.workunit.client.0.smithi099.stdout:4/814: chown d0/d8/d19/d54/d76/le0 730421907 1 2024-01-31T05:13:22.912 INFO:tasks.workunit.client.0.smithi099.stdout:4/815: dread d0/d1e/d61/fe2 [0,4194304] 0 2024-01-31T05:13:22.914 INFO:tasks.workunit.client.0.smithi099.stdout:4/816: creat d0/d2/d4b/d93/f10f x:0 0 0 2024-01-31T05:13:22.915 INFO:tasks.workunit.client.0.smithi099.stdout:4/817: fdatasync d0/d2/d20/f108 0 2024-01-31T05:13:22.915 INFO:tasks.workunit.client.0.smithi099.stdout:1/670: dwrite d4/dc/d29/f46 [0,4194304] 0 2024-01-31T05:13:22.917 INFO:tasks.workunit.client.0.smithi099.stdout:1/671: mkdir d4/db/d3a/d7e/d85/d96/dd2 0 2024-01-31T05:13:22.918 INFO:tasks.workunit.client.0.smithi099.stdout:1/672: mknod d4/db/d12/cd3 0 2024-01-31T05:13:22.918 INFO:tasks.workunit.client.0.smithi099.stdout:1/673: fdatasync d4/dc/f43 0 2024-01-31T05:13:22.918 INFO:tasks.workunit.client.0.smithi099.stdout:1/674: write d4/dc/d4d/d5d/d87/fbc [5891,30868] 0 2024-01-31T05:13:22.919 INFO:tasks.workunit.client.0.smithi099.stdout:1/675: dread - d4/dc/d48/f5f zero size 2024-01-31T05:13:22.919 INFO:tasks.workunit.client.0.smithi099.stdout:0/800: dwrite d1/d30/ff4 [0,4194304] 0 2024-01-31T05:13:22.920 INFO:tasks.workunit.client.0.smithi099.stdout:4/818: dread d0/d2/d4b/d93/d17/d3d/fb7 [0,4194304] 0 2024-01-31T05:13:22.920 INFO:tasks.workunit.client.0.smithi099.stdout:1/676: read d4/db/d12/dc0/d4b/d50/d91/f7b [734605,82707] 0 2024-01-31T05:13:22.921 INFO:tasks.workunit.client.0.smithi099.stdout:1/677: chown d4/dc/d15/fb1 210 1 2024-01-31T05:13:22.921 INFO:tasks.workunit.client.0.smithi099.stdout:1/678: readlink d4/db/d12/dc0/d8f/lce 0 2024-01-31T05:13:22.922 INFO:tasks.workunit.client.0.smithi099.stdout:0/801: creat d1/d56/d103/f11c x:0 0 0 2024-01-31T05:13:22.922 INFO:tasks.workunit.client.0.smithi099.stdout:0/802: chown d1/d30/d45/dad/cca 7940158 1 2024-01-31T05:13:22.922 INFO:tasks.workunit.client.0.smithi099.stdout:0/803: readlink d1/d37/l40 0 2024-01-31T05:13:22.922 INFO:tasks.workunit.client.0.smithi099.stdout:0/804: dread - d1/d56/d103/d8b/fd4 zero size 2024-01-31T05:13:22.922 INFO:tasks.workunit.client.0.smithi099.stdout:2/734: rename d10/d3a/d94/fa6 to d10/d20/d5b/fe5 0 2024-01-31T05:13:22.922 INFO:tasks.workunit.client.0.smithi099.stdout:2/735: chown d10/d3a/l3e 601 1 2024-01-31T05:13:22.923 INFO:tasks.workunit.client.0.smithi099.stdout:1/679: unlink c0 0 2024-01-31T05:13:22.923 INFO:tasks.workunit.client.0.smithi099.stdout:5/718: sync 2024-01-31T05:13:22.923 INFO:tasks.workunit.client.0.smithi099.stdout:9/771: sync 2024-01-31T05:13:22.923 INFO:tasks.workunit.client.0.smithi099.stdout:6/647: sync 2024-01-31T05:13:22.923 INFO:tasks.workunit.client.0.smithi099.stdout:8/811: sync 2024-01-31T05:13:22.923 INFO:tasks.workunit.client.0.smithi099.stdout:5/719: write d6/f18 [4061109,92304] 0 2024-01-31T05:13:22.924 INFO:tasks.workunit.client.0.smithi099.stdout:5/720: chown d6/da/d3f/d73/fdd 231370226 1 2024-01-31T05:13:22.924 INFO:tasks.workunit.client.0.smithi099.stdout:2/736: unlink d10/d1b/c21 0 2024-01-31T05:13:22.925 INFO:tasks.workunit.client.0.smithi099.stdout:9/772: dread d0/f8e [0,4194304] 0 2024-01-31T05:13:22.925 INFO:tasks.workunit.client.0.smithi099.stdout:4/819: stat d0/d8/d19/d99/ff6 0 2024-01-31T05:13:22.925 INFO:tasks.workunit.client.0.smithi099.stdout:7/813: sync 2024-01-31T05:13:22.926 INFO:tasks.workunit.client.0.smithi099.stdout:3/774: sync 2024-01-31T05:13:22.927 INFO:tasks.workunit.client.0.smithi099.stdout:1/680: rename d4/db/d3a/d7e/d85/d96 to d4/dc/d4d/da5/dcf/dd4 0 2024-01-31T05:13:22.927 INFO:tasks.workunit.client.0.smithi099.stdout:1/681: write d4/db/d12/dc0/d4b/d50/d91/f99 [652855,12535] 0 2024-01-31T05:13:22.927 INFO:tasks.workunit.client.0.smithi099.stdout:1/682: readlink d4/dc/d4d/lb8 0 2024-01-31T05:13:22.928 INFO:tasks.workunit.client.0.smithi099.stdout:6/648: rename d14/d18/d52/d7e/d66/la0 to d14/d18/d52/d7e/d66/d99/lcf 0 2024-01-31T05:13:22.933 INFO:tasks.workunit.client.0.smithi099.stdout:8/812: mknod d1/dd/dba/d19/d21/d3c/c10e 0 2024-01-31T05:13:22.934 INFO:tasks.workunit.client.0.smithi099.stdout:5/721: mkdir d6/da/d14/de7/ded 0 2024-01-31T05:13:22.934 INFO:tasks.workunit.client.0.smithi099.stdout:7/814: rmdir d6/d32/d3d/d4b/d33/d37/d50/d5e 39 2024-01-31T05:13:22.934 INFO:tasks.workunit.client.0.smithi099.stdout:5/722: write d6/da/d14/d61/f84 [261989,58261] 0 2024-01-31T05:13:22.934 INFO:tasks.workunit.client.0.smithi099.stdout:5/723: fsync d6/da/d14/fdb 0 2024-01-31T05:13:22.940 INFO:tasks.workunit.client.0.smithi099.stdout:9/773: rename d0/d3e/d87/dc9/d24/d2b/f3c to d0/d3e/d87/f10a 0 2024-01-31T05:13:22.942 INFO:tasks.workunit.client.0.smithi099.stdout:6/649: mkdir d14/dd0 0 2024-01-31T05:13:22.942 INFO:tasks.workunit.client.0.smithi099.stdout:6/650: stat d14/d18/d52/d90/d9a/cb4 0 2024-01-31T05:13:22.943 INFO:tasks.workunit.client.0.smithi099.stdout:6/651: getdents d14/d18/d52/d7e/d1c/d29/d79 0 2024-01-31T05:13:22.943 INFO:tasks.workunit.client.0.smithi099.stdout:6/652: chown d14/f40 0 1 2024-01-31T05:13:22.948 INFO:tasks.workunit.client.0.smithi099.stdout:2/737: dread d10/d1c/d43/db8/fc8 [0,4194304] 0 2024-01-31T05:13:22.948 INFO:tasks.workunit.client.0.smithi099.stdout:3/775: getdents d10/d27/d34/d44/d95 0 2024-01-31T05:13:22.949 INFO:tasks.workunit.client.0.smithi099.stdout:9/774: creat d0/d3e/d87/dc9/d5e/ddb/f10b x:0 0 0 2024-01-31T05:13:22.951 INFO:tasks.workunit.client.0.smithi099.stdout:8/813: write d1/da6/f8f [7310517,116016] 0 2024-01-31T05:13:22.951 INFO:tasks.workunit.client.0.smithi099.stdout:8/814: truncate d1/dd/dba/d19/d21/d3c/fe4 4832021 0 2024-01-31T05:13:22.951 INFO:tasks.workunit.client.0.smithi099.stdout:8/815: fsync d1/dd/ff 0 2024-01-31T05:13:22.951 INFO:tasks.workunit.client.0.smithi099.stdout:8/816: chown d1/dd/d65 124 1 2024-01-31T05:13:22.952 INFO:tasks.workunit.client.0.smithi099.stdout:9/775: mkdir d0/d7/dd2/d10c 0 2024-01-31T05:13:22.953 INFO:tasks.workunit.client.0.smithi099.stdout:2/738: mkdir d10/d2b/de6 0 2024-01-31T05:13:22.954 INFO:tasks.workunit.client.0.smithi099.stdout:9/776: symlink d0/l10d 0 2024-01-31T05:13:22.956 INFO:tasks.workunit.client.0.smithi099.stdout:2/739: creat d10/d51/d8d/fe7 x:0 0 0 2024-01-31T05:13:22.956 INFO:tasks.workunit.client.0.smithi099.stdout:9/777: creat d0/d5d/def/f10e x:0 0 0 2024-01-31T05:13:22.958 INFO:tasks.workunit.client.0.smithi099.stdout:1/683: dwrite d4/db/f25 [0,4194304] 0 2024-01-31T05:13:22.959 INFO:tasks.workunit.client.0.smithi099.stdout:2/740: rmdir d10/d2b/d7c 39 2024-01-31T05:13:22.959 INFO:tasks.workunit.client.0.smithi099.stdout:2/741: readlink d10/d2b/d7c/lb6 0 2024-01-31T05:13:22.961 INFO:tasks.workunit.client.0.smithi099.stdout:1/684: symlink d4/db/d12/dc0/d4b/d9a/dc7/ld5 0 2024-01-31T05:13:22.961 INFO:tasks.workunit.client.0.smithi099.stdout:2/742: truncate d10/d51/f54 2231768 0 2024-01-31T05:13:22.962 INFO:tasks.workunit.client.0.smithi099.stdout:1/685: creat d4/db/d12/dc0/d69/fd6 x:0 0 0 2024-01-31T05:13:22.963 INFO:tasks.workunit.client.0.smithi099.stdout:2/743: mkdir d10/d1b/d83/de8 0 2024-01-31T05:13:22.963 INFO:tasks.workunit.client.0.smithi099.stdout:2/744: fsync d10/d3a/f52 0 2024-01-31T05:13:22.965 INFO:tasks.workunit.client.0.smithi099.stdout:5/724: dwrite d6/da/d14/d61/fe9 [0,4194304] 0 2024-01-31T05:13:22.965 INFO:tasks.workunit.client.0.smithi099.stdout:8/817: dread d1/dd/d7b/fb2 [0,4194304] 0 2024-01-31T05:13:22.965 INFO:tasks.workunit.client.0.smithi099.stdout:8/818: creat d1/dd/d1d/f10f x:0 0 0 2024-01-31T05:13:22.966 INFO:tasks.workunit.client.0.smithi099.stdout:8/819: write d1/dd/d65/d7f/d81/dc7/dce/ff9 [457649,87400] 0 2024-01-31T05:13:22.966 INFO:tasks.workunit.client.0.smithi099.stdout:2/745: mknod d10/d2b/ce9 0 2024-01-31T05:13:22.968 INFO:tasks.workunit.client.0.smithi099.stdout:6/653: link d14/d18/d3b/l97 d14/d18/d52/dbc/ld1 0 2024-01-31T05:13:22.969 INFO:tasks.workunit.client.0.smithi099.stdout:8/820: link d1/dd/dba/d19/d21/f5c d1/dd/dba/df0/f110 0 2024-01-31T05:13:22.972 INFO:tasks.workunit.client.0.smithi099.stdout:3/776: dwrite ff [0,4194304] 0 2024-01-31T05:13:22.972 INFO:tasks.workunit.client.0.smithi099.stdout:3/777: fdatasync d10/d27/d89/fbe 0 2024-01-31T05:13:22.975 INFO:tasks.workunit.client.0.smithi099.stdout:6/654: write fa [1243176,129506] 0 2024-01-31T05:13:22.976 INFO:tasks.workunit.client.0.smithi099.stdout:6/655: symlink d14/d18/d52/d7e/d1c/d29/d79/dc6/ld2 0 2024-01-31T05:13:22.977 INFO:tasks.workunit.client.0.smithi099.stdout:8/821: mkdir d1/dd/dba/d29/d3f/d56/da0/d111 0 2024-01-31T05:13:22.982 INFO:tasks.workunit.client.0.smithi099.stdout:4/820: rename d0/d8/d19/d54/d76/c8e to d0/d2/d4b/d93/d59/dff/c110 0 2024-01-31T05:13:22.982 INFO:tasks.workunit.client.0.smithi099.stdout:1/686: link d4/f90 d4/db/d12/dc0/d4b/d9a/fd7 0 2024-01-31T05:13:22.983 INFO:tasks.workunit.client.0.smithi099.stdout:4/821: creat d0/d2/d4b/f111 x:0 0 0 2024-01-31T05:13:22.983 INFO:tasks.workunit.client.0.smithi099.stdout:4/822: fdatasync d0/d8/d19/d98/fbd 0 2024-01-31T05:13:22.984 INFO:tasks.workunit.client.0.smithi099.stdout:5/725: rename d6/da/d14/d61/d98/da0/cda to d6/da/d14/d3d/d8c/cee 0 2024-01-31T05:13:22.984 INFO:tasks.workunit.client.0.smithi099.stdout:5/726: chown d6/da/ddf 239371944 1 2024-01-31T05:13:22.985 INFO:tasks.workunit.client.0.smithi099.stdout:4/823: creat d0/d2/d4b/d93/d86/f112 x:0 0 0 2024-01-31T05:13:22.986 INFO:tasks.workunit.client.0.smithi099.stdout:5/727: truncate d6/f91 28343 0 2024-01-31T05:13:22.986 INFO:tasks.workunit.client.0.smithi099.stdout:5/728: dread - d6/da/d14/d3d/d51/fd2 zero size 2024-01-31T05:13:22.986 INFO:tasks.workunit.client.0.smithi099.stdout:1/687: mkdir d4/dc/d4d/d5d/d87/d56/dd8 0 2024-01-31T05:13:22.987 INFO:tasks.workunit.client.0.smithi099.stdout:4/824: mkdir d0/d2/d4b/d93/d39/dcf/d113 0 2024-01-31T05:13:22.990 INFO:tasks.workunit.client.0.smithi099.stdout:1/688: mknod d4/cd9 0 2024-01-31T05:13:22.990 INFO:tasks.workunit.client.0.smithi099.stdout:1/689: chown d4/db/d3a/d7e/l93 1835261 1 2024-01-31T05:13:22.993 INFO:tasks.workunit.client.0.smithi099.stdout:4/825: dread d0/d2/d4b/d93/d17/d3d/fb7 [0,4194304] 0 2024-01-31T05:13:22.999 INFO:tasks.workunit.client.0.smithi099.stdout:8/822: dwrite d1/dd/dba/d29/d3f/d56/d57/f89 [4194304,4194304] 0 2024-01-31T05:13:22.999 INFO:tasks.workunit.client.0.smithi099.stdout:4/826: fsync d0/d2/d4b/f111 0 2024-01-31T05:13:23.000 INFO:tasks.workunit.client.0.smithi099.stdout:5/729: dread d6/da/d14/d3d/d51/d82/f76 [0,4194304] 0 2024-01-31T05:13:23.004 INFO:tasks.workunit.client.0.smithi099.stdout:2/746: rename d10/d20/f50 to d10/d2b/d97/fea 0 2024-01-31T05:13:23.006 INFO:tasks.workunit.client.0.smithi099.stdout:3/778: rename d10/d27/d34/d44/d60/d75/d8c/db6/cbb to d10/c116 0 2024-01-31T05:13:23.010 INFO:tasks.workunit.client.0.smithi099.stdout:4/827: dread d0/d8/d19/f83 [0,4194304] 0 2024-01-31T05:13:23.011 INFO:tasks.workunit.client.0.smithi099.stdout:5/730: dread d6/da/d14/d3d/d51/d82/d9a/fc8 [0,4194304] 0 2024-01-31T05:13:23.011 INFO:tasks.workunit.client.0.smithi099.stdout:5/731: fsync d6/da/d14/d61/d98/fa5 0 2024-01-31T05:13:23.011 INFO:tasks.workunit.client.0.smithi099.stdout:4/828: creat d0/d2/d4b/d93/f114 x:0 0 0 2024-01-31T05:13:23.011 INFO:tasks.workunit.client.0.smithi099.stdout:4/829: write d0/d2/d4b/d93/d17/d24/fd2 [657712,21202] 0 2024-01-31T05:13:23.012 INFO:tasks.workunit.client.0.smithi099.stdout:5/732: mkdir d6/da/d14/d61/def 0 2024-01-31T05:13:23.012 INFO:tasks.workunit.client.0.smithi099.stdout:5/733: fdatasync d6/da/d14/d3d/d51/f74 0 2024-01-31T05:13:23.013 INFO:tasks.workunit.client.0.smithi099.stdout:5/734: truncate d6/da/d14/d61/f84 598066 0 2024-01-31T05:13:23.013 INFO:tasks.workunit.client.0.smithi099.stdout:5/735: fdatasync d6/da/d14/d2b/f77 0 2024-01-31T05:13:23.014 INFO:tasks.workunit.client.0.smithi099.stdout:5/736: mkdir d6/da/d14/d3d/d6e/d21/df0 0 2024-01-31T05:13:23.014 INFO:tasks.workunit.client.0.smithi099.stdout:5/737: write d6/da/d14/d3d/f53 [1828594,130095] 0 2024-01-31T05:13:23.016 INFO:tasks.workunit.client.0.smithi099.stdout:5/738: link d6/da/d14/d3d/d8c/d99/lc2 d6/da/d14/d3d/da8/lf1 0 2024-01-31T05:13:23.016 INFO:tasks.workunit.client.0.smithi099.stdout:5/739: write d6/da/d14/d2b/fab [1503583,41945] 0 2024-01-31T05:13:23.017 INFO:tasks.workunit.client.0.smithi099.stdout:6/656: rename d14/d18/d52/d22/d71/fb6 to d14/d18/d52/d7e/fd3 0 2024-01-31T05:13:23.020 INFO:tasks.workunit.client.0.smithi099.stdout:1/690: dwrite d4/dc/d4d/d5d/d87/f9d [0,4194304] 0 2024-01-31T05:13:23.020 INFO:tasks.workunit.client.0.smithi099.stdout:1/691: write d4/db/d12/f65 [152349,22056] 0 2024-01-31T05:13:23.020 INFO:tasks.workunit.client.0.smithi099.stdout:8/823: rename d1/dd/dba/d29/d3f/d56/da0/d2e/c75 to d1/c112 0 2024-01-31T05:13:23.020 INFO:tasks.workunit.client.0.smithi099.stdout:8/824: creat d1/dd/dba/d29/d3f/d56/d57/f113 x:0 0 0 2024-01-31T05:13:23.021 INFO:tasks.workunit.client.0.smithi099.stdout:6/657: mkdir d14/d18/d3b/d7b/dd4 0 2024-01-31T05:13:23.022 INFO:tasks.workunit.client.0.smithi099.stdout:6/658: dread d14/d18/d52/d22/f88 [0,4194304] 0 2024-01-31T05:13:23.026 INFO:tasks.workunit.client.0.smithi099.stdout:8/825: creat d1/dd/d4f/f114 x:0 0 0 2024-01-31T05:13:23.027 INFO:tasks.workunit.client.0.smithi099.stdout:8/826: read d1/dd/dba/d19/f9d [1457,126640] 0 2024-01-31T05:13:23.029 INFO:tasks.workunit.client.0.smithi099.stdout:8/827: creat d1/dd/dba/d19/dc5/f115 x:0 0 0 2024-01-31T05:13:23.031 INFO:tasks.workunit.client.0.smithi099.stdout:8/828: symlink d1/dd/dba/d19/dbd/l116 0 2024-01-31T05:13:23.032 INFO:tasks.workunit.client.0.smithi099.stdout:8/829: truncate d1/dd/dba/d29/d3f/d56/da0/f27 2059640 0 2024-01-31T05:13:23.033 INFO:tasks.workunit.client.0.smithi099.stdout:1/692: write d4/dc/f43 [1862920,33322] 0 2024-01-31T05:13:23.033 INFO:tasks.workunit.client.0.smithi099.stdout:5/740: read d6/da/d14/d3d/d6e/f22 [5004390,57068] 0 2024-01-31T05:13:23.033 INFO:tasks.workunit.client.0.smithi099.stdout:5/741: chown d6/da/d14/d3d/d57/c7d 64607007 1 2024-01-31T05:13:23.033 INFO:tasks.workunit.client.0.smithi099.stdout:6/659: write d14/d18/d52/d7e/d1c/d29/f76 [583432,96905] 0 2024-01-31T05:13:23.034 INFO:tasks.workunit.client.0.smithi099.stdout:8/830: truncate d1/dd/f2b 222405 0 2024-01-31T05:13:23.036 INFO:tasks.workunit.client.0.smithi099.stdout:2/747: dwrite d10/d1c/fa3 [0,4194304] 0 2024-01-31T05:13:23.036 INFO:tasks.workunit.client.0.smithi099.stdout:3/779: write d10/d1e/f25 [4131057,129474] 0 2024-01-31T05:13:23.041 INFO:tasks.workunit.client.0.smithi099.stdout:1/693: rename d4/db/d3a/d7e/fba to d4/dc/d48/fda 0 2024-01-31T05:13:23.045 INFO:tasks.workunit.client.0.smithi099.stdout:3/780: dread d10/d27/f5b [0,4194304] 0 2024-01-31T05:13:23.049 INFO:tasks.workunit.client.0.smithi099.stdout:8/831: creat d1/dd/dba/d19/f117 x:0 0 0 2024-01-31T05:13:23.050 INFO:tasks.workunit.client.0.smithi099.stdout:5/742: write d6/da/d3f/f63 [2470383,56583] 0 2024-01-31T05:13:23.053 INFO:tasks.workunit.client.0.smithi099.stdout:1/694: symlink d4/dc/d29/ldb 0 2024-01-31T05:13:23.053 INFO:tasks.workunit.client.0.smithi099.stdout:1/695: creat d4/dc/d4d/d5d/d87/fdc x:0 0 0 2024-01-31T05:13:23.056 INFO:tasks.workunit.client.0.smithi099.stdout:3/781: mkdir d10/d1e/da2/d117 0 2024-01-31T05:13:23.059 INFO:tasks.workunit.client.0.smithi099.stdout:8/832: chown d1/dd/dba/d29/d3f/d56/da0/f22 1733 1 2024-01-31T05:13:23.059 INFO:tasks.workunit.client.0.smithi099.stdout:8/833: fsync d1/dd/dba/d19/f9d 0 2024-01-31T05:13:23.059 INFO:tasks.workunit.client.0.smithi099.stdout:8/834: write d1/dd/dba/d19/f1f [3756810,91274] 0 2024-01-31T05:13:23.072 INFO:tasks.workunit.client.0.smithi099.stdout:2/748: dwrite d10/d1b/f59 [0,4194304] 0 2024-01-31T05:13:23.076 INFO:tasks.workunit.client.0.smithi099.stdout:2/749: link d10/d1b/c91 d10/d1b/d83/ceb 0 2024-01-31T05:13:23.078 INFO:tasks.workunit.client.0.smithi099.stdout:2/750: rename d10/d1c/d43/db8/fc8 to d10/d2b/d97/fec 0 2024-01-31T05:13:23.078 INFO:tasks.workunit.client.0.smithi099.stdout:2/751: write d10/d3a/f4f [922933,71158] 0 2024-01-31T05:13:23.080 INFO:tasks.workunit.client.0.smithi099.stdout:2/752: dread d10/d1b/d4d/fd1 [0,4194304] 0 2024-01-31T05:13:23.080 INFO:tasks.workunit.client.0.smithi099.stdout:2/753: write d10/d3a/d69/fa1 [36916,120019] 0 2024-01-31T05:13:23.082 INFO:tasks.workunit.client.0.smithi099.stdout:5/743: dwrite d6/da/d14/d3d/d6e/f85 [0,4194304] 0 2024-01-31T05:13:23.082 INFO:tasks.workunit.client.0.smithi099.stdout:3/782: dwrite d10/fc2 [0,4194304] 0 2024-01-31T05:13:23.085 INFO:tasks.workunit.client.0.smithi099.stdout:5/744: creat d6/da/d14/de7/ff2 x:0 0 0 2024-01-31T05:13:23.085 INFO:tasks.workunit.client.0.smithi099.stdout:5/745: stat d6/da/dd5 0 2024-01-31T05:13:23.087 INFO:tasks.workunit.client.0.smithi099.stdout:3/783: creat d10/d27/d34/d44/f118 x:0 0 0 2024-01-31T05:13:23.089 INFO:tasks.workunit.client.0.smithi099.stdout:1/696: dwrite d4/dc/d29/fa8 [0,4194304] 0 2024-01-31T05:13:23.089 INFO:tasks.workunit.client.0.smithi099.stdout:8/835: dwrite d1/dd/d65/d7f/d81/dd4/fef [0,4194304] 0 2024-01-31T05:13:23.089 INFO:tasks.workunit.client.0.smithi099.stdout:8/836: readlink d1/dd/dba/d19/d21/d3c/l7d 0 2024-01-31T05:13:23.089 INFO:tasks.workunit.client.0.smithi099.stdout:5/746: symlink d6/da/d14/d3d/d51/d82/d9a/lf3 0 2024-01-31T05:13:23.091 INFO:tasks.workunit.client.0.smithi099.stdout:3/784: creat d10/d27/d89/f119 x:0 0 0 2024-01-31T05:13:23.092 INFO:tasks.workunit.client.0.smithi099.stdout:8/837: mkdir d1/dd/dba/d118 0 2024-01-31T05:13:23.095 INFO:tasks.workunit.client.0.smithi099.stdout:8/838: rmdir d1/dd/dba/d19/d21 39 2024-01-31T05:13:23.096 INFO:tasks.workunit.client.0.smithi099.stdout:8/839: chown d1/dd/dba/d20/l28 2 1 2024-01-31T05:13:23.096 INFO:tasks.workunit.client.0.smithi099.stdout:8/840: write d1/dd/dba/d19/d21/d3c/fdb [217698,65770] 0 2024-01-31T05:13:23.096 INFO:tasks.workunit.client.0.smithi099.stdout:8/841: write d1/dd/dba/d20/f97 [314572,128131] 0 2024-01-31T05:13:23.096 INFO:tasks.workunit.client.0.smithi099.stdout:8/842: write d1/dd/dba/d29/d3f/d56/d57/f61 [331853,112556] 0 2024-01-31T05:13:23.096 INFO:tasks.workunit.client.0.smithi099.stdout:8/843: write d1/dd/dba/d19/f1f [316649,107705] 0 2024-01-31T05:13:23.096 INFO:tasks.workunit.client.0.smithi099.stdout:5/747: getdents d6/da/d14/d3d/da8 0 2024-01-31T05:13:23.098 INFO:tasks.workunit.client.0.smithi099.stdout:3/785: dread d10/d1e/f25 [0,4194304] 0 2024-01-31T05:13:23.098 INFO:tasks.workunit.client.0.smithi099.stdout:8/844: link d1/c112 d1/dd/dba/d118/c119 0 2024-01-31T05:13:23.098 INFO:tasks.workunit.client.0.smithi099.stdout:8/845: write d1/dd/dba/d29/d3f/d56/d57/f61 [431257,63135] 0 2024-01-31T05:13:23.098 INFO:tasks.workunit.client.0.smithi099.stdout:8/846: fsync d1/f10 0 2024-01-31T05:13:23.098 INFO:tasks.workunit.client.0.smithi099.stdout:5/748: mkdir d6/da/d14/d61/def/df4 0 2024-01-31T05:13:23.101 INFO:tasks.workunit.client.0.smithi099.stdout:3/786: rename d10/d27/d34/d44/d60/ld6 to d10/d32/d85/da3/de7/l11a 0 2024-01-31T05:13:23.102 INFO:tasks.workunit.client.0.smithi099.stdout:8/847: getdents d1/dd/dba/d29/d3f 0 2024-01-31T05:13:23.102 INFO:tasks.workunit.client.0.smithi099.stdout:8/848: creat d1/dd/dba/d19/dbd/f11a x:0 0 0 2024-01-31T05:13:23.102 INFO:tasks.workunit.client.0.smithi099.stdout:8/849: chown d1/dd/dba/d29/d3f/d56/d57/f96 5785 1 2024-01-31T05:13:23.103 INFO:tasks.workunit.client.0.smithi099.stdout:3/787: creat d10/d27/d34/d44/d60/d75/d8c/f11b x:0 0 0 2024-01-31T05:13:23.104 INFO:tasks.workunit.client.0.smithi099.stdout:3/788: link d10/d27/d89/f119 d10/d32/d85/f11c 0 2024-01-31T05:13:23.106 INFO:tasks.workunit.client.0.smithi099.stdout:3/789: rename d10/d27/d34/d44/d60/d75/d8c/d92/cbd to d10/d27/d34/d44/d60/d75/d8c/db1/c11d 0 2024-01-31T05:13:23.106 INFO:tasks.workunit.client.0.smithi099.stdout:3/790: creat d10/d32/d33/d51/f11e x:0 0 0 2024-01-31T05:13:23.106 INFO:tasks.workunit.client.0.smithi099.stdout:3/791: truncate d10/d1e/f6f 5489288 0 2024-01-31T05:13:23.109 INFO:tasks.workunit.client.0.smithi099.stdout:3/792: rmdir d10/d27/d34/d50 39 2024-01-31T05:13:23.122 INFO:tasks.workunit.client.0.smithi099.stdout:1/697: link d4/db/d12/dc0/d4b/d50/d91/f34 d4/db/d12/dc0/fdd 0 2024-01-31T05:13:23.124 INFO:tasks.workunit.client.0.smithi099.stdout:1/698: mkdir d4/db/d12/dc0/d69/dde 0 2024-01-31T05:13:23.127 INFO:tasks.workunit.client.0.smithi099.stdout:8/850: dwrite d1/da6/feb [0,4194304] 0 2024-01-31T05:13:23.128 INFO:tasks.workunit.client.0.smithi099.stdout:5/749: dwrite d6/da/f19 [0,4194304] 0 2024-01-31T05:13:23.128 INFO:tasks.workunit.client.0.smithi099.stdout:8/851: symlink d1/dd/d65/d7f/d81/dc4/l11b 0 2024-01-31T05:13:23.131 INFO:tasks.workunit.client.0.smithi099.stdout:8/852: link d1/dd/d1d/f10f d1/dd/dba/d29/f11c 0 2024-01-31T05:13:23.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:22 smithi179 ceph-mon[35652]: scrub summary: idle 2024-01-31T05:13:23.133 INFO:tasks.workunit.client.0.smithi099.stdout:8/853: rename d1/dd/dba/d29/d3f/d56/da0/d2e/c79 to d1/dd/d1d/c11d 0 2024-01-31T05:13:23.133 INFO:tasks.workunit.client.0.smithi099.stdout:8/854: dread - d1/dd/d65/d7f/d81/fb5 zero size 2024-01-31T05:13:23.143 INFO:tasks.workunit.client.0.smithi099.stdout:5/750: dread d6/f18 [0,4194304] 0 2024-01-31T05:13:23.150 INFO:tasks.workunit.client.0.smithi099.stdout:5/751: dread d6/da/d14/d3d/d57/d92/fa7 [0,4194304] 0 2024-01-31T05:13:23.152 INFO:tasks.workunit.client.0.smithi099.stdout:5/752: creat d6/da/d14/d3d/d51/d82/ff5 x:0 0 0 2024-01-31T05:13:23.156 INFO:tasks.workunit.client.0.smithi099.stdout:1/699: dwrite d4/dc/d48/f8c [0,4194304] 0 2024-01-31T05:13:23.157 INFO:tasks.workunit.client.0.smithi099.stdout:8/855: dwrite d1/da6/f8f [4194304,4194304] 0 2024-01-31T05:13:23.177 INFO:tasks.workunit.client.0.smithi099.stdout:5/753: dwrite d6/da/d3f/f4d [0,4194304] 0 2024-01-31T05:13:23.177 INFO:tasks.workunit.client.0.smithi099.stdout:5/754: chown d6/da/d14/c72 0 1 2024-01-31T05:13:23.179 INFO:tasks.workunit.client.0.smithi099.stdout:5/755: mknod d6/da/d14/d3d/d51/d82/cf6 0 2024-01-31T05:13:23.180 INFO:tasks.workunit.client.0.smithi099.stdout:1/700: rename d4/db/d12/dc0/d8f to d4/dc/d29/daa/ddf 0 2024-01-31T05:13:23.185 INFO:tasks.workunit.client.0.smithi099.stdout:8/856: dwrite d1/dd/d7b/fb2 [0,4194304] 0 2024-01-31T05:13:23.185 INFO:tasks.workunit.client.0.smithi099.stdout:5/756: dread d6/f6d [0,4194304] 0 2024-01-31T05:13:23.186 INFO:tasks.workunit.client.0.smithi099.stdout:5/757: readlink d6/da/d3f/d73/la1 0 2024-01-31T05:13:23.186 INFO:tasks.workunit.client.0.smithi099.stdout:8/857: write d1/dd/ff [4079752,53613] 0 2024-01-31T05:13:23.186 INFO:tasks.workunit.client.0.smithi099.stdout:8/858: write d1/dd/dba/d19/d21/f62 [1416068,79124] 0 2024-01-31T05:13:23.186 INFO:tasks.workunit.client.0.smithi099.stdout:8/859: stat d1/dd/dba 0 2024-01-31T05:13:23.187 INFO:tasks.workunit.client.0.smithi099.stdout:0/805: sync 2024-01-31T05:13:23.187 INFO:tasks.workunit.client.0.smithi099.stdout:4/830: sync 2024-01-31T05:13:23.187 INFO:tasks.workunit.client.0.smithi099.stdout:7/815: sync 2024-01-31T05:13:23.188 INFO:tasks.workunit.client.0.smithi099.stdout:9/778: sync 2024-01-31T05:13:23.188 INFO:tasks.workunit.client.0.smithi099.stdout:5/758: mkdir d6/da/d14/de7/df7 0 2024-01-31T05:13:23.188 INFO:tasks.workunit.client.0.smithi099.stdout:8/860: truncate d1/da6/feb 3063482 0 2024-01-31T05:13:23.188 INFO:tasks.workunit.client.0.smithi099.stdout:8/861: read - d1/dd/dba/d29/d3f/d56/d57/f113 zero size 2024-01-31T05:13:23.189 INFO:tasks.workunit.client.0.smithi099.stdout:0/806: creat d1/d37/d4a/d7b/f11d x:0 0 0 2024-01-31T05:13:23.189 INFO:tasks.workunit.client.0.smithi099.stdout:4/831: rmdir d0/d2/d20/d84 39 2024-01-31T05:13:23.189 INFO:tasks.workunit.client.0.smithi099.stdout:4/832: chown d0/d2/d4b/d93/d17/d24 964341 1 2024-01-31T05:13:23.190 INFO:tasks.workunit.client.0.smithi099.stdout:9/779: symlink d0/d7/l10f 0 2024-01-31T05:13:23.190 INFO:tasks.workunit.client.0.smithi099.stdout:9/780: dread - d0/d3e/d87/dc9/d24/d48/fff zero size 2024-01-31T05:13:23.191 INFO:tasks.workunit.client.0.smithi099.stdout:7/816: mknod d6/d32/d3d/d4b/d33/d37/d50/d5e/c10c 0 2024-01-31T05:13:23.192 INFO:tasks.workunit.client.0.smithi099.stdout:5/759: symlink d6/da/d14/d3d/d8c/lf8 0 2024-01-31T05:13:23.193 INFO:tasks.workunit.client.0.smithi099.stdout:5/760: mknod d6/da/d3f/d5a/d81/cf9 0 2024-01-31T05:13:23.194 INFO:tasks.workunit.client.0.smithi099.stdout:5/761: symlink d6/da/d14/d3d/lfa 0 2024-01-31T05:13:23.194 INFO:tasks.workunit.client.0.smithi099.stdout:5/762: chown d6/da/d14/d3d/d8c/fd9 34 1 2024-01-31T05:13:23.203 INFO:tasks.workunit.client.0.smithi099.stdout:0/807: dread d1/d56/d103/fe2 [0,4194304] 0 2024-01-31T05:13:23.203 INFO:tasks.workunit.client.0.smithi099.stdout:0/808: readlink d1/d30/d45/d66/d97/l99 0 2024-01-31T05:13:23.204 INFO:tasks.workunit.client.0.smithi099.stdout:5/763: read d6/da/d14/d61/d98/fa5 [1690496,47011] 0 2024-01-31T05:13:23.205 INFO:tasks.workunit.client.0.smithi099.stdout:5/764: readlink d6/da/d14/d2b/d9e/lec 0 2024-01-31T05:13:23.205 INFO:tasks.workunit.client.0.smithi099.stdout:0/809: creat d1/d37/d4a/d10e/f11e x:0 0 0 2024-01-31T05:13:23.205 INFO:tasks.workunit.client.0.smithi099.stdout:0/810: read d1/d37/d4a/d7a/f4b [147606,121605] 0 2024-01-31T05:13:23.205 INFO:tasks.workunit.client.0.smithi099.stdout:0/811: creat d1/d64/ded/dee/f11f x:0 0 0 2024-01-31T05:13:23.206 INFO:tasks.workunit.client.0.smithi099.stdout:1/701: rename d4/db/lc6 to d4/db/d12/dc0/d4b/d50/d91/le0 0 2024-01-31T05:13:23.207 INFO:tasks.workunit.client.0.smithi099.stdout:5/765: link d6/da/d14/d3d/d6e/f85 d6/da/d14/d3d/d6e/ffb 0 2024-01-31T05:13:23.207 INFO:tasks.workunit.client.0.smithi099.stdout:0/812: read d1/d30/f101 [1373802,66559] 0 2024-01-31T05:13:23.208 INFO:tasks.workunit.client.0.smithi099.stdout:7/817: dread d6/d32/d3d/d4b/d33/d37/d50/d25/d47/fd8 [0,4194304] 0 2024-01-31T05:13:23.209 INFO:tasks.workunit.client.0.smithi099.stdout:5/766: rmdir d6/da/d3f 39 2024-01-31T05:13:23.211 INFO:tasks.workunit.client.0.smithi099.stdout:7/818: creat d6/d32/d3d/d4b/d33/d37/d50/d25/d72/d8e/f10d x:0 0 0 2024-01-31T05:13:23.211 INFO:tasks.workunit.client.0.smithi099.stdout:7/819: stat d6/d32/d3d/d4b/d33/d37/d4e/l88 0 2024-01-31T05:13:23.212 INFO:tasks.workunit.client.0.smithi099.stdout:0/813: getdents d1/d8/dd6 0 2024-01-31T05:13:23.212 INFO:tasks.workunit.client.0.smithi099.stdout:0/814: write d1/d37/d4a/d7a/d7d/fa0 [222091,118356] 0 2024-01-31T05:13:23.212 INFO:tasks.workunit.client.0.smithi099.stdout:0/815: read d1/d30/d45/d66/f5b [2491168,65889] 0 2024-01-31T05:13:23.212 INFO:tasks.workunit.client.0.smithi099.stdout:8/862: dwrite d1/f10 [0,4194304] 0 2024-01-31T05:13:23.213 INFO:tasks.workunit.client.0.smithi099.stdout:7/820: truncate d6/d32/d3d/d4b/d33/d37/d50/d25/f4c 4015945 0 2024-01-31T05:13:23.215 INFO:tasks.workunit.client.0.smithi099.stdout:0/816: symlink d1/d37/d4a/d7b/dfe/l120 0 2024-01-31T05:13:23.218 INFO:tasks.workunit.client.0.smithi099.stdout:0/817: creat d1/d8/dd6/f121 x:0 0 0 2024-01-31T05:13:23.226 INFO:tasks.workunit.client.0.smithi099.stdout:7/821: dread d6/d32/d3d/dd7/fbc [0,4194304] 0 2024-01-31T05:13:23.228 INFO:tasks.workunit.client.0.smithi099.stdout:7/822: creat d6/d32/d3d/d4b/d33/d37/d50/d25/d7a/d104/f10e x:0 0 0 2024-01-31T05:13:23.229 INFO:tasks.workunit.client.0.smithi099.stdout:7/823: mknod d6/d12/c10f 0 2024-01-31T05:13:23.231 INFO:tasks.workunit.client.0.smithi099.stdout:4/833: rename d0/d2/d4b/d93/d59/d82/dfa to d0/d2/d115 0 2024-01-31T05:13:23.231 INFO:tasks.workunit.client.0.smithi099.stdout:4/834: dread - d0/d2/d4b/d93/f10f zero size 2024-01-31T05:13:23.233 INFO:tasks.workunit.client.0.smithi099.stdout:9/781: rename d0/d3e/d87/dc9/d24/d2b/l21 to d0/d3e/d87/dc9/d5e/d72/dbf/l110 0 2024-01-31T05:13:23.235 INFO:tasks.workunit.client.0.smithi099.stdout:4/835: unlink d0/d8/d19/d54/d76/f9d 0 2024-01-31T05:13:23.235 INFO:tasks.workunit.client.0.smithi099.stdout:4/836: fsync d0/d2/d4b/d93/d17/f25 0 2024-01-31T05:13:23.236 INFO:tasks.workunit.client.0.smithi099.stdout:8/863: rename d1/dd/d1d/f10f to d1/dd/dba/d118/f11e 0 2024-01-31T05:13:23.237 INFO:tasks.workunit.client.0.smithi099.stdout:9/782: mknod d0/d3e/d87/dc9/d5e/d72/dbf/c111 0 2024-01-31T05:13:23.237 INFO:tasks.workunit.client.0.smithi099.stdout:9/783: chown d0/d3e/d33/d8a/fd0 13949 1 2024-01-31T05:13:23.237 INFO:tasks.workunit.client.0.smithi099.stdout:5/767: dwrite d6/da/d14/d3d/d8c/fc1 [0,4194304] 0 2024-01-31T05:13:23.239 INFO:tasks.workunit.client.0.smithi099.stdout:7/824: rename d6/d32/d3d/d4b/d33/d37/d50/l31 to d6/d32/d3d/d4b/d33/d37/d106/l110 0 2024-01-31T05:13:23.239 INFO:tasks.workunit.client.0.smithi099.stdout:7/825: chown d6/d12/c28 4970013 1 2024-01-31T05:13:23.239 INFO:tasks.workunit.client.0.smithi099.stdout:7/826: fsync d6/d32/d3d/d4b/d33/d37/d4e/f55 0 2024-01-31T05:13:23.239 INFO:tasks.workunit.client.0.smithi099.stdout:7/827: dread - d6/d32/d3d/d4b/d33/d37/d50/d25/d7a/ff3 zero size 2024-01-31T05:13:23.239 INFO:tasks.workunit.client.0.smithi099.stdout:8/864: stat d1/dd/dba/d29/d3f/d56/da0/d2e 0 2024-01-31T05:13:23.239 INFO:tasks.workunit.client.0.smithi099.stdout:8/865: creat d1/dd/dba/d19/dc5/f11f x:0 0 0 2024-01-31T05:13:23.241 INFO:tasks.workunit.client.0.smithi099.stdout:1/702: dwrite d4/dc/d4d/d5d/f7f [0,4194304] 0 2024-01-31T05:13:23.242 INFO:tasks.workunit.client.0.smithi099.stdout:1/703: chown d4/dc/l1f 109 1 2024-01-31T05:13:23.244 INFO:tasks.workunit.client.0.smithi099.stdout:5/768: truncate d6/f11 282074 0 2024-01-31T05:13:23.244 INFO:tasks.workunit.client.0.smithi099.stdout:5/769: chown d6/da/f19 1563158281 1 2024-01-31T05:13:23.245 INFO:tasks.workunit.client.0.smithi099.stdout:7/828: mkdir d6/d32/d3d/d4b/d33/d37/d50/d25/d72/d8e/df7/d111 0 2024-01-31T05:13:23.246 INFO:tasks.workunit.client.0.smithi099.stdout:7/829: truncate d6/d32/d3d/d4b/d33/d37/d50/d25/d79/fd2 994527 0 2024-01-31T05:13:23.246 INFO:tasks.workunit.client.0.smithi099.stdout:7/830: fdatasync d6/d32/d3d/d4b/f23 0 2024-01-31T05:13:23.246 INFO:tasks.workunit.client.0.smithi099.stdout:7/831: chown d6/d32/d3d/de6/lf0 46019 1 2024-01-31T05:13:23.246 INFO:tasks.workunit.client.0.smithi099.stdout:7/832: fsync d6/d32/d3d/d4b/d33/d37/d50/d25/f4c 0 2024-01-31T05:13:23.247 INFO:tasks.workunit.client.0.smithi099.stdout:8/866: unlink d1/dd/dba/d29/f11c 0 2024-01-31T05:13:23.247 INFO:tasks.workunit.client.0.smithi099.stdout:8/867: write d1/dd/d65/f10a [326929,110792] 0 2024-01-31T05:13:23.247 INFO:tasks.workunit.client.0.smithi099.stdout:8/868: stat d1/dd/d1d/f102 0 2024-01-31T05:13:23.248 INFO:tasks.workunit.client.0.smithi099.stdout:8/869: creat d1/dd/d65/d7f/f120 x:0 0 0 2024-01-31T05:13:23.249 INFO:tasks.workunit.client.0.smithi099.stdout:0/818: dwrite d1/d56/d103/d8b/fa9 [0,4194304] 0 2024-01-31T05:13:23.252 INFO:tasks.workunit.client.0.smithi099.stdout:9/784: dread d0/d7/f1f [0,4194304] 0 2024-01-31T05:13:23.252 INFO:tasks.workunit.client.0.smithi099.stdout:9/785: stat d0/d3e/d33/dab/cce 0 2024-01-31T05:13:23.255 INFO:tasks.workunit.client.0.smithi099.stdout:4/837: dwrite d0/d2/d4b/d93/fcb [0,4194304] 0 2024-01-31T05:13:23.255 INFO:tasks.workunit.client.0.smithi099.stdout:9/786: rename d0/d3e/f40 to d0/d3e/d87/dc9/d5e/d72/dbf/f112 0 2024-01-31T05:13:23.255 INFO:tasks.workunit.client.0.smithi099.stdout:9/787: creat d0/d3e/d33/dab/f113 x:0 0 0 2024-01-31T05:13:23.257 INFO:tasks.workunit.client.0.smithi099.stdout:4/838: creat d0/d2/d4b/d93/d59/d102/f116 x:0 0 0 2024-01-31T05:13:23.258 INFO:tasks.workunit.client.0.smithi099.stdout:0/819: getdents d1/d37/d4a/d10e 0 2024-01-31T05:13:23.258 INFO:tasks.workunit.client.0.smithi099.stdout:8/870: dread d1/dd/dba/d20/f4b [0,4194304] 0 2024-01-31T05:13:23.260 INFO:tasks.workunit.client.0.smithi099.stdout:6/660: sync 2024-01-31T05:13:23.260 INFO:tasks.workunit.client.0.smithi099.stdout:2/754: sync 2024-01-31T05:13:23.260 INFO:tasks.workunit.client.0.smithi099.stdout:6/661: dread - d14/d18/d52/d7e/d66/fc7 zero size 2024-01-31T05:13:23.260 INFO:tasks.workunit.client.0.smithi099.stdout:2/755: getdents d10/d2b/d58 0 2024-01-31T05:13:23.260 INFO:tasks.workunit.client.0.smithi099.stdout:6/662: truncate d14/d18/d52/d7e/d1c/d29/d4f/f89 5225590 0 2024-01-31T05:13:23.260 INFO:tasks.workunit.client.0.smithi099.stdout:6/663: fdatasync d14/d18/d3b/d7b/fa4 0 2024-01-31T05:13:23.260 INFO:tasks.workunit.client.0.smithi099.stdout:6/664: chown d14/d18/d52/d7e/d66/d99/lcf 21711 1 2024-01-31T05:13:23.265 INFO:tasks.workunit.client.0.smithi099.stdout:6/665: mknod d14/d18/d52/d22/cd5 0 2024-01-31T05:13:23.266 INFO:tasks.workunit.client.0.smithi099.stdout:2/756: creat d10/d2b/d58/dc3/dcd/fed x:0 0 0 2024-01-31T05:13:23.273 INFO:tasks.workunit.client.0.smithi099.stdout:2/757: mknod d10/d1c/d43/db8/cee 0 2024-01-31T05:13:23.273 INFO:tasks.workunit.client.0.smithi099.stdout:2/758: fsync f1 0 2024-01-31T05:13:23.274 INFO:tasks.workunit.client.0.smithi099.stdout:0/820: dread d1/f4 [0,4194304] 0 2024-01-31T05:13:23.275 INFO:tasks.workunit.client.0.smithi099.stdout:2/759: mknod d10/d2b/de6/cef 0 2024-01-31T05:13:23.276 INFO:tasks.workunit.client.0.smithi099.stdout:3/793: sync 2024-01-31T05:13:23.276 INFO:tasks.workunit.client.0.smithi099.stdout:0/821: creat d1/d37/d4a/d6f/f122 x:0 0 0 2024-01-31T05:13:23.276 INFO:tasks.workunit.client.0.smithi099.stdout:0/822: stat d1/d30/d45/d6e/l8c 0 2024-01-31T05:13:23.277 INFO:tasks.workunit.client.0.smithi099.stdout:6/666: write d14/d18/d52/d7e/d1c/da6/fc0 [550432,88494] 0 2024-01-31T05:13:23.278 INFO:tasks.workunit.client.0.smithi099.stdout:8/871: dwrite d1/dd/dba/d29/d3f/d56/da0/f44 [0,4194304] 0 2024-01-31T05:13:23.278 INFO:tasks.workunit.client.0.smithi099.stdout:6/667: creat d14/d18/d52/fd6 x:0 0 0 2024-01-31T05:13:23.279 INFO:tasks.workunit.client.0.smithi099.stdout:8/872: write d1/dd/d65/d7f/d81/dc7/dce/ff9 [175824,122049] 0 2024-01-31T05:13:23.279 INFO:tasks.workunit.client.0.smithi099.stdout:6/668: dread d14/d18/d52/d7e/d1c/d29/d43/f87 [0,4194304] 0 2024-01-31T05:13:23.279 INFO:tasks.workunit.client.0.smithi099.stdout:6/669: readlink d14/d18/d52/d7e/d66/d99/l9c 0 2024-01-31T05:13:23.280 INFO:tasks.workunit.client.0.smithi099.stdout:8/873: symlink d1/dd/dba/da9/d104/l121 0 2024-01-31T05:13:23.280 INFO:tasks.workunit.client.0.smithi099.stdout:8/874: read - d1/dd/d4f/d51/d83/ffe zero size 2024-01-31T05:13:23.286 INFO:tasks.workunit.client.0.smithi099.stdout:3/794: dread d10/d27/d34/d44/d95/f6e [0,4194304] 0 2024-01-31T05:13:23.294 INFO:tasks.workunit.client.0.smithi099.stdout:9/788: dwrite d0/d3e/d33/dab/fe1 [0,4194304] 0 2024-01-31T05:13:23.296 INFO:tasks.workunit.client.0.smithi099.stdout:9/789: symlink d0/d3e/d87/dc9/d5e/ddb/l114 0 2024-01-31T05:13:23.296 INFO:tasks.workunit.client.0.smithi099.stdout:4/839: rename d0/d74 to d0/d2/d4b/d93/d17/de1/d117 0 2024-01-31T05:13:23.296 INFO:tasks.workunit.client.0.smithi099.stdout:4/840: chown d0 256410 1 2024-01-31T05:13:23.297 INFO:tasks.workunit.client.0.smithi099.stdout:4/841: unlink d0/d8/d19/d54/d76/cfe 0 2024-01-31T05:13:23.299 INFO:tasks.workunit.client.0.smithi099.stdout:2/760: dread d10/d1b/f23 [0,4194304] 0 2024-01-31T05:13:23.300 INFO:tasks.workunit.client.0.smithi099.stdout:6/670: dread d14/d18/d52/d7e/d1c/f44 [0,4194304] 0 2024-01-31T05:13:23.301 INFO:tasks.workunit.client.0.smithi099.stdout:6/671: mknod d14/d18/d52/dbc/cd7 0 2024-01-31T05:13:23.311 INFO:tasks.workunit.client.0.smithi099.stdout:9/790: write d0/d3e/d87/dc9/f102 [2159252,20904] 0 2024-01-31T05:13:23.311 INFO:tasks.workunit.client.0.smithi099.stdout:9/791: creat d0/d3e/d87/dc9/d5e/d72/f115 x:0 0 0 2024-01-31T05:13:23.311 INFO:tasks.workunit.client.0.smithi099.stdout:9/792: write d0/d3e/d87/dc9/d5e/de0/ff4 [146277,11178] 0 2024-01-31T05:13:23.312 INFO:tasks.workunit.client.0.smithi099.stdout:3/795: dwrite d10/d27/f30 [0,4194304] 0 2024-01-31T05:13:23.312 INFO:tasks.workunit.client.0.smithi099.stdout:3/796: stat d10/d27/d34/d44/d60/d75/d8c/db6/cd8 0 2024-01-31T05:13:23.316 INFO:tasks.workunit.client.0.smithi099.stdout:3/797: symlink d10/d27/d34/d44/d60/d75/d8c/l11f 0 2024-01-31T05:13:23.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:22 smithi099 ceph-mon[31615]: scrub summary: idle 2024-01-31T05:13:23.320 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:22 smithi181 ceph-mon[36434]: scrub summary: idle 2024-01-31T05:13:23.328 INFO:tasks.workunit.client.0.smithi099.stdout:3/798: dread d10/d27/d34/d52/f62 [0,4194304] 0 2024-01-31T05:13:23.330 INFO:tasks.workunit.client.0.smithi099.stdout:2/761: dwrite d10/f15 [0,4194304] 0 2024-01-31T05:13:23.330 INFO:tasks.workunit.client.0.smithi099.stdout:4/842: dwrite d0/d2/d4b/d93/d17/d3d/f41 [0,4194304] 0 2024-01-31T05:13:23.331 INFO:tasks.workunit.client.0.smithi099.stdout:4/843: readlink d0/d8/d19/d54/d76/le0 0 2024-01-31T05:13:23.331 INFO:tasks.workunit.client.0.smithi099.stdout:4/844: getdents d0/d2/d4b/d93/d17/d7d/db2/dc7/dfd 0 2024-01-31T05:13:23.332 INFO:tasks.workunit.client.0.smithi099.stdout:2/762: truncate d10/fcf 830321 0 2024-01-31T05:13:23.333 INFO:tasks.workunit.client.0.smithi099.stdout:4/845: mkdir d0/d8/d19/d99/d118 0 2024-01-31T05:13:23.334 INFO:tasks.workunit.client.0.smithi099.stdout:2/763: chown l6 170 1 2024-01-31T05:13:23.335 INFO:tasks.workunit.client.0.smithi099.stdout:4/846: mkdir d0/d8/d19/d54/d119 0 2024-01-31T05:13:23.337 INFO:tasks.workunit.client.0.smithi099.stdout:4/847: mkdir d0/d2/d4b/d93/d59/d9c/d11a 0 2024-01-31T05:13:23.337 INFO:tasks.workunit.client.0.smithi099.stdout:3/799: dread d10/d27/d34/f68 [0,4194304] 0 2024-01-31T05:13:23.337 INFO:tasks.workunit.client.0.smithi099.stdout:2/764: truncate d10/d3a/f4f 3022808 0 2024-01-31T05:13:23.338 INFO:tasks.workunit.client.0.smithi099.stdout:4/848: symlink d0/d2/d4b/d93/d39/dcf/l11b 0 2024-01-31T05:13:23.339 INFO:tasks.workunit.client.0.smithi099.stdout:4/849: truncate d0/d2/d4b/d93/d17/de1/d117/fc6 3622299 0 2024-01-31T05:13:23.342 INFO:tasks.workunit.client.0.smithi099.stdout:9/793: rename d0/d44/cac to d0/d3e/d87/dc9/d5e/ddb/c116 0 2024-01-31T05:13:23.347 INFO:tasks.workunit.client.0.smithi099.stdout:9/794: mkdir d0/d3e/d87/dc9/d24/d48/d117 0 2024-01-31T05:13:23.351 INFO:tasks.workunit.client.0.smithi099.stdout:3/800: dread d10/d32/f5a [0,4194304] 0 2024-01-31T05:13:23.351 INFO:tasks.workunit.client.0.smithi099.stdout:3/801: fsync d10/d1e/f25 0 2024-01-31T05:13:23.351 INFO:tasks.workunit.client.0.smithi099.stdout:3/802: fdatasync d10/f66 0 2024-01-31T05:13:23.353 INFO:tasks.workunit.client.0.smithi099.stdout:4/850: read d0/d79/f92 [427643,34516] 0 2024-01-31T05:13:23.354 INFO:tasks.workunit.client.0.smithi099.stdout:3/803: truncate d10/d27/d34/d44/d60/fa8 1304098 0 2024-01-31T05:13:23.354 INFO:tasks.workunit.client.0.smithi099.stdout:3/804: read - d10/d27/d34/d44/d60/d75/d8c/db0/fec zero size 2024-01-31T05:13:23.355 INFO:tasks.workunit.client.0.smithi099.stdout:3/805: rename d10/d27/d34/d52 to d10/dfa/d120 0 2024-01-31T05:13:23.356 INFO:tasks.workunit.client.0.smithi099.stdout:3/806: fsync d10/d27/d34/d44/d60/d75/d8c/db0/fd9 0 2024-01-31T05:13:23.359 INFO:tasks.workunit.client.0.smithi099.stdout:9/795: dread d0/d3e/d87/dc9/d24/d2b/d7b/f9d [0,4194304] 0 2024-01-31T05:13:23.360 INFO:tasks.workunit.client.0.smithi099.stdout:9/796: mknod d0/d3e/d87/dc9/d24/d2b/de9/df9/c118 0 2024-01-31T05:13:23.362 INFO:tasks.workunit.client.0.smithi099.stdout:2/765: link ce d10/d1b/d7d/d7a/dad/cf0 0 2024-01-31T05:13:23.362 INFO:tasks.workunit.client.0.smithi099.stdout:2/766: chown d10/d2b/d7c/lb6 11091 1 2024-01-31T05:13:23.362 INFO:tasks.workunit.client.0.smithi099.stdout:2/767: chown d10/d2b/de6 27525 1 2024-01-31T05:13:23.363 INFO:tasks.workunit.client.0.smithi099.stdout:2/768: getdents d10/d1c/d43 0 2024-01-31T05:13:23.366 INFO:tasks.workunit.client.0.smithi099.stdout:4/851: dread d0/d2/f47 [0,4194304] 0 2024-01-31T05:13:23.367 INFO:tasks.workunit.client.0.smithi099.stdout:4/852: creat d0/d2/d4b/d93/d59/dff/db9/f11c x:0 0 0 2024-01-31T05:13:23.368 INFO:tasks.workunit.client.0.smithi099.stdout:4/853: getdents d0/d2/d4b/d93/d86/db4 0 2024-01-31T05:13:23.373 INFO:tasks.workunit.client.0.smithi099.stdout:3/807: write d10/d24/f99 [1005792,92793] 0 2024-01-31T05:13:23.375 INFO:tasks.workunit.client.0.smithi099.stdout:3/808: rmdir d10/d32/d85/d77 39 2024-01-31T05:13:23.376 INFO:tasks.workunit.client.0.smithi099.stdout:3/809: getdents d10/d1e/da2/d117 0 2024-01-31T05:13:23.383 INFO:tasks.workunit.client.0.smithi099.stdout:2/769: dwrite d10/d1b/d4d/fb3 [0,4194304] 0 2024-01-31T05:13:23.384 INFO:tasks.workunit.client.0.smithi099.stdout:3/810: dread d10/d32/f5a [0,4194304] 0 2024-01-31T05:13:23.385 INFO:tasks.workunit.client.0.smithi099.stdout:3/811: symlink d10/d27/d34/d111/l121 0 2024-01-31T05:13:23.390 INFO:tasks.workunit.client.0.smithi099.stdout:3/812: dread d10/d1e/f25 [0,4194304] 0 2024-01-31T05:13:23.391 INFO:tasks.workunit.client.0.smithi099.stdout:3/813: truncate d10/fbf 1208050 0 2024-01-31T05:13:23.392 INFO:tasks.workunit.client.0.smithi099.stdout:3/814: truncate d10/d32/d33/f63 2748950 0 2024-01-31T05:13:23.392 INFO:tasks.workunit.client.0.smithi099.stdout:3/815: creat d10/d27/d34/d44/d60/d75/d8c/db1/f122 x:0 0 0 2024-01-31T05:13:23.396 INFO:tasks.workunit.client.0.smithi099.stdout:2/770: rename d10/d3a/l3e to d10/d3a/d69/lf1 0 2024-01-31T05:13:23.397 INFO:tasks.workunit.client.0.smithi099.stdout:2/771: mknod d10/d2b/d58/dc3/dcd/cf2 0 2024-01-31T05:13:23.397 INFO:tasks.workunit.client.0.smithi099.stdout:2/772: readlink d10/d1c/d43/db8/ld9 0 2024-01-31T05:13:23.397 INFO:tasks.workunit.client.0.smithi099.stdout:2/773: truncate d10/d3a/f4f 2233361 0 2024-01-31T05:13:23.400 INFO:tasks.workunit.client.0.smithi099.stdout:2/774: unlink l6 0 2024-01-31T05:13:23.400 INFO:tasks.workunit.client.0.smithi099.stdout:2/775: chown d10/d1b/d7d/d7a/dd7/cdf 3341393 1 2024-01-31T05:13:23.400 INFO:tasks.workunit.client.0.smithi099.stdout:2/776: write d10/d20/f4c [2857026,33203] 0 2024-01-31T05:13:23.401 INFO:tasks.workunit.client.0.smithi099.stdout:2/777: creat d10/d1c/d43/ff3 x:0 0 0 2024-01-31T05:13:23.401 INFO:tasks.workunit.client.0.smithi099.stdout:2/778: write d10/d1b/d83/d86/d95/fe4 [167992,49025] 0 2024-01-31T05:13:23.401 INFO:tasks.workunit.client.0.smithi099.stdout:2/779: truncate d10/d2b/d7c/f90 4475086 0 2024-01-31T05:13:23.403 INFO:tasks.workunit.client.0.smithi099.stdout:2/780: getdents d10/d2b/d97 0 2024-01-31T05:13:23.406 INFO:tasks.workunit.client.0.smithi099.stdout:7/833: sync 2024-01-31T05:13:23.406 INFO:tasks.workunit.client.0.smithi099.stdout:5/770: sync 2024-01-31T05:13:23.406 INFO:tasks.workunit.client.0.smithi099.stdout:1/704: sync 2024-01-31T05:13:23.408 INFO:tasks.workunit.client.0.smithi099.stdout:7/834: symlink d6/d32/d3d/d4b/d33/d37/d50/d5e/d107/l112 0 2024-01-31T05:13:23.409 INFO:tasks.workunit.client.0.smithi099.stdout:5/771: symlink d6/da/d3f/lfc 0 2024-01-31T05:13:23.414 INFO:tasks.workunit.client.0.smithi099.stdout:3/816: dwrite d10/d27/d34/f105 [0,4194304] 0 2024-01-31T05:13:23.416 INFO:tasks.workunit.client.0.smithi099.stdout:3/817: chown d10/d27/d34/d44/d60/d75/d8c/l9b 0 1 2024-01-31T05:13:23.419 INFO:tasks.workunit.client.0.smithi099.stdout:3/818: mkdir d10/d27/d34/d44/d60/d75/d8c/d92/d123 0 2024-01-31T05:13:23.422 INFO:tasks.workunit.client.0.smithi099.stdout:3/819: creat d10/d24/d40/d81/de4/f124 x:0 0 0 2024-01-31T05:13:23.422 INFO:tasks.workunit.client.0.smithi099.stdout:3/820: stat d10/d32/d85/d77/ff9 0 2024-01-31T05:13:23.429 INFO:tasks.workunit.client.0.smithi099.stdout:7/835: write d6/d98/fc1 [2902727,105103] 0 2024-01-31T05:13:23.431 INFO:tasks.workunit.client.0.smithi099.stdout:7/836: link d6/f69 d6/d12/f113 0 2024-01-31T05:13:23.434 INFO:tasks.workunit.client.0.smithi099.stdout:1/705: dwrite d4/db/d12/dc0/d4b/d50/fc9 [0,4194304] 0 2024-01-31T05:13:23.436 INFO:tasks.workunit.client.0.smithi099.stdout:1/706: unlink d4/dc/l57 0 2024-01-31T05:13:23.436 INFO:tasks.workunit.client.0.smithi099.stdout:1/707: chown d4/dc/d15/d45/ca0 373045382 1 2024-01-31T05:13:23.437 INFO:tasks.workunit.client.0.smithi099.stdout:1/708: truncate d4/dc/d15/d45/faf 336078 0 2024-01-31T05:13:23.437 INFO:tasks.workunit.client.0.smithi099.stdout:1/709: stat d4/dc 0 2024-01-31T05:13:23.438 INFO:tasks.workunit.client.0.smithi099.stdout:1/710: unlink d4/dc/d4d/d5d/d87/d56/d83/f9f 0 2024-01-31T05:13:23.438 INFO:tasks.workunit.client.0.smithi099.stdout:7/837: read d6/d32/d3d/d4b/d33/d37/d50/d25/d47/fd8 [3458937,14723] 0 2024-01-31T05:13:23.439 INFO:tasks.workunit.client.0.smithi099.stdout:2/781: dwrite d10/d2b/d7c/fba [0,4194304] 0 2024-01-31T05:13:23.440 INFO:tasks.workunit.client.0.smithi099.stdout:2/782: mknod d10/d1b/d83/d86/d95/cf4 0 2024-01-31T05:13:23.453 INFO:tasks.workunit.client.0.smithi099.stdout:7/838: dread d6/d32/f5b [0,4194304] 0 2024-01-31T05:13:23.455 INFO:tasks.workunit.client.0.smithi099.stdout:1/711: rename d4/db/d12/dc0/d69/c82 to d4/dc/d4d/d5d/d87/d56/ce1 0 2024-01-31T05:13:23.455 INFO:tasks.workunit.client.0.smithi099.stdout:1/712: write d4/dc/d15/f4e [881311,120266] 0 2024-01-31T05:13:23.455 INFO:tasks.workunit.client.0.smithi099.stdout:1/713: readlink d4/dc/d29/l2e 0 2024-01-31T05:13:23.455 INFO:tasks.workunit.client.0.smithi099.stdout:1/714: chown d4/dc/d48/fda 231 1 2024-01-31T05:13:23.457 INFO:tasks.workunit.client.0.smithi099.stdout:1/715: rename d4/dc/d15/f7a to d4/dc/d4d/da5/dcf/dd4/dd2/fe2 0 2024-01-31T05:13:23.459 INFO:tasks.workunit.client.0.smithi099.stdout:2/783: dwrite d10/d1c/f2d [4194304,4194304] 0 2024-01-31T05:13:23.459 INFO:tasks.workunit.client.0.smithi099.stdout:1/716: mkdir d4/db/d12/dc0/d4b/de3 0 2024-01-31T05:13:23.460 INFO:tasks.workunit.client.0.smithi099.stdout:2/784: chown d10/d2b/ca0 1 1 2024-01-31T05:13:23.461 INFO:tasks.workunit.client.0.smithi099.stdout:1/717: rmdir d4/dc/d15/d45 39 2024-01-31T05:13:23.461 INFO:tasks.workunit.client.0.smithi099.stdout:2/785: mknod d10/d20/dd0/cf5 0 2024-01-31T05:13:23.461 INFO:tasks.workunit.client.0.smithi099.stdout:1/718: mknod d4/db/d3a/ce4 0 2024-01-31T05:13:23.461 INFO:tasks.workunit.client.0.smithi099.stdout:1/719: write d4/dc/d15/f5a [1002334,27865] 0 2024-01-31T05:13:23.462 INFO:tasks.workunit.client.0.smithi099.stdout:1/720: truncate d4/fd0 700358 0 2024-01-31T05:13:23.478 INFO:tasks.workunit.client.0.smithi099.stdout:7/839: dwrite d6/ff [0,4194304] 0 2024-01-31T05:13:23.478 INFO:tasks.workunit.client.0.smithi099.stdout:7/840: getdents d6/d32/d3d/d4b/d33/d37/d50/d25/d72/d8e/df7 0 2024-01-31T05:13:23.480 INFO:tasks.workunit.client.0.smithi099.stdout:1/721: link d4/db/d12/d74/l84 d4/db/d12/dc0/d4b/d50/db5/le5 0 2024-01-31T05:13:23.480 INFO:tasks.workunit.client.0.smithi099.stdout:1/722: write d4/dc/d15/f4e [917481,15486] 0 2024-01-31T05:13:23.485 INFO:tasks.workunit.client.0.smithi099.stdout:7/841: rmdir d6/d32/d3d/d4b 39 2024-01-31T05:13:23.488 INFO:tasks.workunit.client.0.smithi099.stdout:7/842: rmdir d6/d32/d3d/dd7/dc5 39 2024-01-31T05:13:23.489 INFO:tasks.workunit.client.0.smithi099.stdout:7/843: mkdir d6/d32/d3d/d4b/d33/d37/d50/d25/d7a/d104/d114 0 2024-01-31T05:13:23.492 INFO:tasks.workunit.client.0.smithi099.stdout:2/786: dwrite d10/d1b/d7d/d7a/fbd [0,4194304] 0 2024-01-31T05:13:23.492 INFO:tasks.workunit.client.0.smithi099.stdout:7/844: creat d6/d32/d3d/dd7/dc5/f115 x:0 0 0 2024-01-31T05:13:23.492 INFO:tasks.workunit.client.0.smithi099.stdout:1/723: write d4/db/d12/dc0/f41 [1808568,89816] 0 2024-01-31T05:13:23.494 INFO:tasks.workunit.client.0.smithi099.stdout:2/787: creat d10/d1b/d83/d86/d95/ff6 x:0 0 0 2024-01-31T05:13:23.499 INFO:tasks.workunit.client.0.smithi099.stdout:7/845: mkdir d6/d116 0 2024-01-31T05:13:23.499 INFO:tasks.workunit.client.0.smithi099.stdout:7/846: stat d6/d32/d3d/d4b/d33/d37/d4e/fbe 0 2024-01-31T05:13:23.500 INFO:tasks.workunit.client.0.smithi099.stdout:7/847: creat d6/d32/d3d/d4b/d33/d37/d50/d4d/f117 x:0 0 0 2024-01-31T05:13:23.506 INFO:tasks.workunit.client.0.smithi099.stdout:1/724: dread d4/dc/d15/f6c [0,4194304] 0 2024-01-31T05:13:23.506 INFO:tasks.workunit.client.0.smithi099.stdout:1/725: chown d4/dc/d4d 645568 1 2024-01-31T05:13:23.507 INFO:tasks.workunit.client.0.smithi099.stdout:1/726: creat d4/dc/d48/fe6 x:0 0 0 2024-01-31T05:13:23.507 INFO:tasks.workunit.client.0.smithi099.stdout:1/727: stat d4/dc/d15/f6c 0 2024-01-31T05:13:23.507 INFO:tasks.workunit.client.0.smithi099.stdout:1/728: readlink d4/dc/l1f 0 2024-01-31T05:13:23.507 INFO:tasks.workunit.client.0.smithi099.stdout:1/729: truncate d4/db/fa4 897544 0 2024-01-31T05:13:23.511 INFO:tasks.workunit.client.0.smithi099.stdout:1/730: write d4/db/d12/dc0/d4b/d50/d91/f22 [4988838,102761] 0 2024-01-31T05:13:23.521 INFO:tasks.workunit.client.0.smithi099.stdout:7/848: dwrite d6/d32/d3d/d4b/d33/d37/d4e/f62 [0,4194304] 0 2024-01-31T05:13:23.522 INFO:tasks.workunit.client.0.smithi099.stdout:7/849: creat d6/d32/d3d/de6/df1/f118 x:0 0 0 2024-01-31T05:13:23.522 INFO:tasks.workunit.client.0.smithi099.stdout:0/823: sync 2024-01-31T05:13:23.522 INFO:tasks.workunit.client.0.smithi099.stdout:0/824: fdatasync d1/d30/d45/dad/ff1 0 2024-01-31T05:13:23.522 INFO:tasks.workunit.client.0.smithi099.stdout:0/825: chown d1/d8/f102 13077 1 2024-01-31T05:13:23.525 INFO:tasks.workunit.client.0.smithi099.stdout:7/850: link d6/d32/d3d/d4b/d33/d37/d50/l51 d6/d32/d3d/d4b/d33/d37/d50/d25/d72/d8e/df7/l119 0 2024-01-31T05:13:23.528 INFO:tasks.workunit.client.0.smithi099.stdout:7/851: symlink d6/l11a 0 2024-01-31T05:13:23.531 INFO:tasks.workunit.client.0.smithi099.stdout:0/826: dread d1/d37/d4a/faa [0,4194304] 0 2024-01-31T05:13:23.532 INFO:tasks.workunit.client.0.smithi099.stdout:0/827: mknod d1/d37/d4a/d7b/dfe/c123 0 2024-01-31T05:13:23.538 INFO:tasks.workunit.client.0.smithi099.stdout:0/828: rmdir d1/d37/d4a/d7b/dfe 39 2024-01-31T05:13:23.540 INFO:tasks.workunit.client.0.smithi099.stdout:0/829: symlink d1/d8/l124 0 2024-01-31T05:13:23.540 INFO:tasks.workunit.client.0.smithi099.stdout:0/830: write d1/d37/f87 [616441,80953] 0 2024-01-31T05:13:23.541 INFO:tasks.workunit.client.0.smithi099.stdout:0/831: mknod d1/d37/d4a/de6/c125 0 2024-01-31T05:13:23.541 INFO:tasks.workunit.client.0.smithi099.stdout:0/832: chown d1/d30/ff4 407264 1 2024-01-31T05:13:23.544 INFO:tasks.workunit.client.0.smithi099.stdout:0/833: rename d1/d30/d45/dad/f62 to d1/d56/d103/f126 0 2024-01-31T05:13:23.544 INFO:tasks.workunit.client.0.smithi099.stdout:0/834: chown d1/d30/d45/dad/c85 46 1 2024-01-31T05:13:23.621 INFO:tasks.workunit.client.0.smithi099.stdout:8/875: sync 2024-01-31T05:13:23.622 INFO:tasks.workunit.client.0.smithi099.stdout:4/854: sync 2024-01-31T05:13:23.622 INFO:tasks.workunit.client.0.smithi099.stdout:9/797: sync 2024-01-31T05:13:23.622 INFO:tasks.workunit.client.0.smithi099.stdout:6/672: sync 2024-01-31T05:13:23.622 INFO:tasks.workunit.client.0.smithi099.stdout:6/673: dread - d14/d18/d52/d7e/fc4 zero size 2024-01-31T05:13:23.622 INFO:tasks.workunit.client.0.smithi099.stdout:6/674: creat d14/d18/d52/d7e/d1c/d29/d79/fd8 x:0 0 0 2024-01-31T05:13:23.623 INFO:tasks.workunit.client.0.smithi099.stdout:6/675: creat d14/d18/d52/d7e/d1c/d29/d43/fd9 x:0 0 0 2024-01-31T05:13:23.623 INFO:tasks.workunit.client.0.smithi099.stdout:6/676: creat d14/d18/d52/d7e/d1c/d29/d79/fda x:0 0 0 2024-01-31T05:13:23.627 INFO:tasks.workunit.client.0.smithi099.stdout:8/876: mknod d1/dd/d4f/dcd/c122 0 2024-01-31T05:13:23.627 INFO:tasks.workunit.client.0.smithi099.stdout:9/798: mknod d0/d3e/d87/dc9/d5e/d72/dbf/d100/c119 0 2024-01-31T05:13:23.628 INFO:tasks.workunit.client.0.smithi099.stdout:6/677: mknod d14/d18/cdb 0 2024-01-31T05:13:23.628 INFO:tasks.workunit.client.0.smithi099.stdout:6/678: read - d14/d18/d52/d7e/d1c/fad zero size 2024-01-31T05:13:23.629 INFO:tasks.workunit.client.0.smithi099.stdout:8/877: getdents d1/dd/dba/da9 0 2024-01-31T05:13:23.629 INFO:tasks.workunit.client.0.smithi099.stdout:8/878: chown d1/dd/dba/d29/d3f/d56/f88 48 1 2024-01-31T05:13:23.629 INFO:tasks.workunit.client.0.smithi099.stdout:8/879: write d1/dd/dba/d19/dc5/f115 [615310,39685] 0 2024-01-31T05:13:23.629 INFO:tasks.workunit.client.0.smithi099.stdout:8/880: chown d1/dd/dba/d19/d21/d3c/l52 287 1 2024-01-31T05:13:23.630 INFO:tasks.workunit.client.0.smithi099.stdout:8/881: creat d1/dd/dba/d29/d3f/d56/da0/d2e/f123 x:0 0 0 2024-01-31T05:13:23.642 INFO:tasks.workunit.client.0.smithi099.stdout:8/882: dread d1/dd/dba/d29/d3f/d56/da0/d2e/de1/fe3 [0,4194304] 0 2024-01-31T05:13:23.642 INFO:tasks.workunit.client.0.smithi099.stdout:8/883: write d1/dd/d65/d7f/d81/fb5 [719508,127465] 0 2024-01-31T05:13:23.642 INFO:tasks.workunit.client.0.smithi099.stdout:8/884: dread - d1/dd/dba/d29/d3f/d56/da0/d2e/fad zero size 2024-01-31T05:13:23.642 INFO:tasks.workunit.client.0.smithi099.stdout:8/885: fdatasync d1/dd/dba/d29/d3f/d56/da0/d2e/fad 0 2024-01-31T05:13:23.643 INFO:tasks.workunit.client.0.smithi099.stdout:8/886: rmdir d1/dd/dba/df0 39 2024-01-31T05:13:23.643 INFO:tasks.workunit.client.0.smithi099.stdout:8/887: stat d1/dd/dba/d29/fa2 0 2024-01-31T05:13:23.643 INFO:tasks.workunit.client.0.smithi099.stdout:8/888: fdatasync d1/dd/dba/d19/f1f 0 2024-01-31T05:13:23.643 INFO:tasks.workunit.client.0.smithi099.stdout:8/889: mknod d1/dd/dba/d19/d21/c124 0 2024-01-31T05:13:23.651 INFO:tasks.workunit.client.0.smithi099.stdout:4/855: dwrite d0/d2/d4b/d93/d17/d7d/ff3 [0,4194304] 0 2024-01-31T05:13:23.651 INFO:tasks.workunit.client.0.smithi099.stdout:9/799: dwrite d0/d3e/d87/dc9/d24/d2b/d63/da7/fc8 [0,4194304] 0 2024-01-31T05:13:23.651 INFO:tasks.workunit.client.0.smithi099.stdout:9/800: chown d0/d3e/d87/dc9/c6e 38828406 1 2024-01-31T05:13:23.654 INFO:tasks.workunit.client.0.smithi099.stdout:9/801: symlink d0/d3e/l11a 0 2024-01-31T05:13:23.654 INFO:tasks.workunit.client.0.smithi099.stdout:9/802: readlink d0/d3e/d87/dc9/l8f 0 2024-01-31T05:13:23.656 INFO:tasks.workunit.client.0.smithi099.stdout:6/679: rename d14/d18/d52/d7e/d1c/d29/d43/c8a to d14/d18/d3b/d7b/dd4/cdc 0 2024-01-31T05:13:23.656 INFO:tasks.workunit.client.0.smithi099.stdout:6/680: readlink le 0 2024-01-31T05:13:23.656 INFO:tasks.workunit.client.0.smithi099.stdout:6/681: chown d14/d18/d3b/f6f 3 1 2024-01-31T05:13:23.661 INFO:tasks.workunit.client.0.smithi099.stdout:6/682: rmdir d14/d18/d52/dbc 39 2024-01-31T05:13:23.663 INFO:tasks.workunit.client.0.smithi099.stdout:6/683: mkdir d14/d18/d52/d7e/ddd 0 2024-01-31T05:13:23.665 INFO:tasks.workunit.client.0.smithi099.stdout:6/684: unlink d14/d18/d52/d7e/d1c/d29/d43/f87 0 2024-01-31T05:13:23.670 INFO:tasks.workunit.client.0.smithi099.stdout:8/890: dwrite d1/dd/dba/d29/d3f/d56/d57/f96 [0,4194304] 0 2024-01-31T05:13:23.670 INFO:tasks.workunit.client.0.smithi099.stdout:8/891: dread - d1/dd/d1d/fae zero size 2024-01-31T05:13:23.675 INFO:tasks.workunit.client.0.smithi099.stdout:9/803: dwrite d0/d3e/d87/dc9/d5e/d72/d89/d98/fbd [0,4194304] 0 2024-01-31T05:13:23.675 INFO:tasks.workunit.client.0.smithi099.stdout:9/804: chown d0/d3e/d87/dc9/d5e/ddb/f10b 6044433 1 2024-01-31T05:13:23.676 INFO:tasks.workunit.client.0.smithi099.stdout:4/856: rename d0/d2/d20/dea to d0/d2/d4b/d93/d59/dff/d43/df9/d11d 0 2024-01-31T05:13:23.676 INFO:tasks.workunit.client.0.smithi099.stdout:5/772: sync 2024-01-31T05:13:23.677 INFO:tasks.workunit.client.0.smithi099.stdout:6/685: write d14/d18/d52/d7e/f83 [733253,109108] 0 2024-01-31T05:13:23.679 INFO:tasks.workunit.client.0.smithi099.stdout:5/773: mknod d6/da/d3f/d5a/d81/cfd 0 2024-01-31T05:13:23.683 INFO:tasks.workunit.client.0.smithi099.stdout:2/788: sync 2024-01-31T05:13:23.683 INFO:tasks.workunit.client.0.smithi099.stdout:3/821: sync 2024-01-31T05:13:23.684 INFO:tasks.workunit.client.0.smithi099.stdout:0/835: sync 2024-01-31T05:13:23.684 INFO:tasks.workunit.client.0.smithi099.stdout:7/852: sync 2024-01-31T05:13:23.684 INFO:tasks.workunit.client.0.smithi099.stdout:1/731: sync 2024-01-31T05:13:23.684 INFO:tasks.workunit.client.0.smithi099.stdout:1/732: fsync d4/dc/d4d/da5/dcf/dd4/fb2 0 2024-01-31T05:13:23.684 INFO:tasks.workunit.client.0.smithi099.stdout:2/789: readlink d10/d1b/l27 0 2024-01-31T05:13:23.686 INFO:tasks.workunit.client.0.smithi099.stdout:7/853: symlink d6/d98/de3/l11b 0 2024-01-31T05:13:23.686 INFO:tasks.workunit.client.0.smithi099.stdout:7/854: stat d6/d32/d3d/d4b/d33/d37/d50/d5e/de8 0 2024-01-31T05:13:23.690 INFO:tasks.workunit.client.0.smithi099.stdout:3/822: mkdir d10/d27/d125 0 2024-01-31T05:13:23.691 INFO:tasks.workunit.client.0.smithi099.stdout:0/836: write d1/f4 [1126628,72998] 0 2024-01-31T05:13:23.692 INFO:tasks.workunit.client.0.smithi099.stdout:2/790: creat d10/d2b/d7c/ff7 x:0 0 0 2024-01-31T05:13:23.693 INFO:tasks.workunit.client.0.smithi099.stdout:3/823: stat d10/d24/l4c 0 2024-01-31T05:13:23.694 INFO:tasks.workunit.client.0.smithi099.stdout:7/855: rename d6/d32/d3d/de6/df1/l9f to d6/d32/d3d/d4b/d33/d37/d50/d25/d72/d8e/d9a/l11c 0 2024-01-31T05:13:23.697 INFO:tasks.workunit.client.0.smithi099.stdout:7/856: link d6/d32/d3d/d46/cb3 d6/d32/d3d/d4b/d33/d37/d50/d25/d72/d8e/df7/c11d 0 2024-01-31T05:13:23.699 INFO:tasks.workunit.client.0.smithi099.stdout:7/857: creat d6/d32/d3d/dd7/f11e x:0 0 0 2024-01-31T05:13:23.702 INFO:tasks.workunit.client.0.smithi099.stdout:0/837: dread d1/d37/f86 [0,4194304] 0 2024-01-31T05:13:23.702 INFO:tasks.workunit.client.0.smithi099.stdout:7/858: mkdir d6/d32/d3d/d46/d11f 0 2024-01-31T05:13:23.703 INFO:tasks.workunit.client.0.smithi099.stdout:7/859: symlink d6/d32/d3d/dd7/dc5/l120 0 2024-01-31T05:13:23.705 INFO:tasks.workunit.client.0.smithi099.stdout:0/838: dread d1/d30/d45/dad/fa4 [0,4194304] 0 2024-01-31T05:13:23.705 INFO:tasks.workunit.client.0.smithi099.stdout:0/839: fsync d1/d56/d103/d8b/fbf 0 2024-01-31T05:13:23.708 INFO:tasks.workunit.client.0.smithi099.stdout:0/840: getdents d1 0 2024-01-31T05:13:23.711 INFO:tasks.workunit.client.0.smithi099.stdout:0/841: link d1/d37/d4a/d10e/f11e d1/d64/f127 0 2024-01-31T05:13:23.713 INFO:tasks.workunit.client.0.smithi099.stdout:6/686: dread d14/d18/d52/d7e/d1c/d29/d4f/f89 [0,4194304] 0 2024-01-31T05:13:23.713 INFO:tasks.workunit.client.0.smithi099.stdout:9/805: dwrite d0/d7/f66 [0,4194304] 0 2024-01-31T05:13:23.714 INFO:tasks.workunit.client.0.smithi099.stdout:0/842: creat d1/d37/d73/db7/dc5/f128 x:0 0 0 2024-01-31T05:13:23.714 INFO:tasks.workunit.client.0.smithi099.stdout:4/857: link d0/d8/d19/d99/lbf d0/d2/d4b/d93/d86/d8d/l11e 0 2024-01-31T05:13:23.715 INFO:tasks.workunit.client.0.smithi099.stdout:9/806: mknod d0/d3e/d87/dc9/d5e/d72/d89/c11b 0 2024-01-31T05:13:23.715 INFO:tasks.workunit.client.0.smithi099.stdout:6/687: rmdir d14/d18/d52/d7e/d1c/d29/d94 39 2024-01-31T05:13:23.716 INFO:tasks.workunit.client.0.smithi099.stdout:8/892: dwrite d1/dd/dba/d29/f2a [0,4194304] 0 2024-01-31T05:13:23.717 INFO:tasks.workunit.client.0.smithi099.stdout:5/774: write d6/da/d14/d3d/d6e/f85 [1988106,41080] 0 2024-01-31T05:13:23.717 INFO:tasks.workunit.client.0.smithi099.stdout:8/893: chown d1/dd/dba/d29/d3f/d56/f100 4194059 1 2024-01-31T05:13:23.717 INFO:tasks.workunit.client.0.smithi099.stdout:8/894: chown d1/dd/dba/d29/d3f/d56/d57/f113 6 1 2024-01-31T05:13:23.717 INFO:tasks.workunit.client.0.smithi099.stdout:8/895: creat d1/dd/dba/d19/dc5/f125 x:0 0 0 2024-01-31T05:13:23.717 INFO:tasks.workunit.client.0.smithi099.stdout:8/896: write d1/dd/dba/d19/f53 [3341603,80760] 0 2024-01-31T05:13:23.717 INFO:tasks.workunit.client.0.smithi099.stdout:8/897: fdatasync d1/da6/fcb 0 2024-01-31T05:13:23.717 INFO:tasks.workunit.client.0.smithi099.stdout:8/898: readlink d1/dd/dba/d29/l45 0 2024-01-31T05:13:23.717 INFO:tasks.workunit.client.0.smithi099.stdout:8/899: fsync d1/f5e 0 2024-01-31T05:13:23.718 INFO:tasks.workunit.client.0.smithi099.stdout:6/688: creat d14/d18/d52/d7e/ddd/fde x:0 0 0 2024-01-31T05:13:23.721 INFO:tasks.workunit.client.0.smithi099.stdout:9/807: symlink d0/d3e/d87/dc9/d5e/d72/d89/d98/dc1/l11c 0 2024-01-31T05:13:23.721 INFO:tasks.workunit.client.0.smithi099.stdout:9/808: write d0/d7/f1f [5546662,63477] 0 2024-01-31T05:13:23.724 INFO:tasks.workunit.client.0.smithi099.stdout:1/733: dwrite d4/dc/d15/f4e [0,4194304] 0 2024-01-31T05:13:23.725 INFO:tasks.workunit.client.0.smithi099.stdout:8/900: creat d1/dd/dba/df0/f126 x:0 0 0 2024-01-31T05:13:23.725 INFO:tasks.workunit.client.0.smithi099.stdout:9/809: dread d0/f8e [0,4194304] 0 2024-01-31T05:13:23.730 INFO:tasks.workunit.client.0.smithi099.stdout:9/810: creat d0/d7/dd2/d10c/f11d x:0 0 0 2024-01-31T05:13:23.732 INFO:tasks.workunit.client.0.smithi099.stdout:1/734: link d4/db/d12/dc0/fdd d4/db/d12/dc0/d4b/d9a/dc7/fe7 0 2024-01-31T05:13:23.733 INFO:tasks.workunit.client.0.smithi099.stdout:1/735: mkdir d4/db/d3a/d7e/d85/de8 0 2024-01-31T05:13:23.733 INFO:tasks.workunit.client.0.smithi099.stdout:2/791: dwrite d10/f11 [0,4194304] 0 2024-01-31T05:13:23.735 INFO:tasks.workunit.client.0.smithi099.stdout:1/736: mknod d4/db/d12/ce9 0 2024-01-31T05:13:23.736 INFO:tasks.workunit.client.0.smithi099.stdout:1/737: chown d4/dc/d29/daa/ddf/lb0 17439 1 2024-01-31T05:13:23.736 INFO:tasks.workunit.client.0.smithi099.stdout:1/738: chown d4/dc/d15/f4e 346227283 1 2024-01-31T05:13:23.737 INFO:tasks.workunit.client.0.smithi099.stdout:7/860: dwrite d6/d32/d3d/d4b/d33/d37/d50/d25/f29 [0,4194304] 0 2024-01-31T05:13:23.737 INFO:tasks.workunit.client.0.smithi099.stdout:7/861: fsync d6/d12/f22 0 2024-01-31T05:13:23.743 INFO:tasks.workunit.client.0.smithi099.stdout:3/824: dwrite d10/d27/fa7 [4194304,4194304] 0 2024-01-31T05:13:23.743 INFO:tasks.workunit.client.0.smithi099.stdout:3/825: dread - d10/d32/d85/d77/ff9 zero size 2024-01-31T05:13:23.747 INFO:tasks.workunit.client.0.smithi099.stdout:3/826: symlink d10/dfa/l126 0 2024-01-31T05:13:23.747 INFO:tasks.workunit.client.0.smithi099.stdout:3/827: truncate d10/d24/d40/d81/de4/f124 1009139 0 2024-01-31T05:13:23.747 INFO:tasks.workunit.client.0.smithi099.stdout:3/828: chown d10/dfa/d120/f7d 34222394 1 2024-01-31T05:13:23.747 INFO:tasks.workunit.client.0.smithi099.stdout:3/829: chown d10/d27/d34/d44/d60/d75/d8c/db1/f122 132195 1 2024-01-31T05:13:23.747 INFO:tasks.workunit.client.0.smithi099.stdout:3/830: fsync d10/d72/f9c 0 2024-01-31T05:13:23.747 INFO:tasks.workunit.client.0.smithi099.stdout:3/831: dread - d10/d27/d34/fdf zero size 2024-01-31T05:13:23.750 INFO:tasks.workunit.client.0.smithi099.stdout:3/832: creat d10/d27/d125/f127 x:0 0 0 2024-01-31T05:13:23.752 INFO:tasks.workunit.client.0.smithi099.stdout:3/833: stat d10/d24/d40/d81/c107 0 2024-01-31T05:13:23.755 INFO:tasks.workunit.client.0.smithi099.stdout:3/834: mkdir d10/d27/d34/d44/d60/d75/d8c/db1/d128 0 2024-01-31T05:13:23.756 INFO:tasks.workunit.client.0.smithi099.stdout:0/843: dwrite d1/d37/d4a/d6f/fe7 [0,4194304] 0 2024-01-31T05:13:23.756 INFO:tasks.workunit.client.0.smithi099.stdout:0/844: write d1/d56/d103/d8b/f9c [4664137,102247] 0 2024-01-31T05:13:23.757 INFO:tasks.workunit.client.0.smithi099.stdout:5/775: dwrite d6/da/d3f/d73/fdd [0,4194304] 0 2024-01-31T05:13:23.757 INFO:tasks.workunit.client.0.smithi099.stdout:5/776: chown d6/da/d14/d94/fa6 0 1 2024-01-31T05:13:23.760 INFO:tasks.workunit.client.0.smithi099.stdout:3/835: link d10/d27/d34/d44/d60/d75/d8c/f11b d10/d27/d34/d44/d60/d75/d8c/f129 0 2024-01-31T05:13:23.762 INFO:tasks.workunit.client.0.smithi099.stdout:5/777: dread d6/da/d14/d61/f84 [0,4194304] 0 2024-01-31T05:13:23.767 INFO:tasks.workunit.client.0.smithi099.stdout:2/792: write d10/fcf [248185,108834] 0 2024-01-31T05:13:23.768 INFO:tasks.workunit.client.0.smithi099.stdout:0/845: write d1/d8/f61 [2132130,124545] 0 2024-01-31T05:13:23.768 INFO:tasks.workunit.client.0.smithi099.stdout:6/689: dwrite d14/d18/d52/d7e/d1c/d29/f2b [0,4194304] 0 2024-01-31T05:13:23.775 INFO:tasks.workunit.client.0.smithi099.stdout:5/778: dread d6/da/d14/d3d/d8c/de6/f8b [0,4194304] 0 2024-01-31T05:13:23.777 INFO:tasks.workunit.client.0.smithi099.stdout:5/779: mknod d6/da/d14/d61/d98/da0/cfe 0 2024-01-31T05:13:23.778 INFO:tasks.workunit.client.0.smithi099.stdout:3/836: write d10/f16 [1936422,25750] 0 2024-01-31T05:13:23.778 INFO:tasks.workunit.client.0.smithi099.stdout:3/837: write d10/d24/d40/f47 [2007023,38015] 0 2024-01-31T05:13:23.778 INFO:tasks.workunit.client.0.smithi099.stdout:3/838: creat d10/d27/d125/f12a x:0 0 0 2024-01-31T05:13:23.778 INFO:tasks.workunit.client.0.smithi099.stdout:3/839: chown d10/d24/c7a 9654075 1 2024-01-31T05:13:23.778 INFO:tasks.workunit.client.0.smithi099.stdout:3/840: dread - d10/ff1 zero size 2024-01-31T05:13:23.781 INFO:tasks.workunit.client.0.smithi099.stdout:4/858: dwrite d0/d2/d4b/d93/d59/f8b [0,4194304] 0 2024-01-31T05:13:23.781 INFO:tasks.workunit.client.0.smithi099.stdout:4/859: write d0/d8/d19/f1c [1078327,81411] 0 2024-01-31T05:13:23.784 INFO:tasks.workunit.client.0.smithi099.stdout:5/780: dread d6/da/d14/d3d/d8c/de6/f8b [0,4194304] 0 2024-01-31T05:13:23.784 INFO:tasks.workunit.client.0.smithi099.stdout:9/811: dwrite d0/d3e/d87/dc9/d5e/d72/d89/f90 [0,4194304] 0 2024-01-31T05:13:23.786 INFO:tasks.workunit.client.0.smithi099.stdout:1/739: dwrite d4/dc/d4d/d5d/fc4 [0,4194304] 0 2024-01-31T05:13:23.787 INFO:tasks.workunit.client.0.smithi099.stdout:5/781: creat d6/da/d14/d61/def/df4/fff x:0 0 0 2024-01-31T05:13:23.787 INFO:tasks.workunit.client.0.smithi099.stdout:5/782: readlink d6/da/d14/l15 0 2024-01-31T05:13:23.789 INFO:tasks.workunit.client.0.smithi099.stdout:7/862: dwrite d6/d32/d3d/d4b/f2f [0,4194304] 0 2024-01-31T05:13:23.790 INFO:tasks.workunit.client.0.smithi099.stdout:1/740: link d4/dc/d48/f8c d4/dc/d4d/da5/dcf/fea 0 2024-01-31T05:13:23.790 INFO:tasks.workunit.client.0.smithi099.stdout:5/783: symlink d6/da/d14/d3d/l100 0 2024-01-31T05:13:23.793 INFO:tasks.workunit.client.0.smithi099.stdout:7/863: mkdir d6/d32/d3d/d4b/d33/d37/d50/d25/d79/d121 0 2024-01-31T05:13:23.795 INFO:tasks.workunit.client.0.smithi099.stdout:5/784: truncate d6/da/d3f/f9c 273230 0 2024-01-31T05:13:23.797 INFO:tasks.workunit.client.0.smithi099.stdout:2/793: link d10/d1b/d7d/d7a/l87 d10/d2b/d58/lf8 0 2024-01-31T05:13:23.797 INFO:tasks.workunit.client.0.smithi099.stdout:2/794: write d10/f42 [3085123,130675] 0 2024-01-31T05:13:23.797 INFO:tasks.workunit.client.0.smithi099.stdout:2/795: readlink d10/d1b/d83/d86/ld4 0 2024-01-31T05:13:23.797 INFO:tasks.workunit.client.0.smithi099.stdout:2/796: write d10/d1b/d83/d86/d95/fe4 [1079148,130185] 0 2024-01-31T05:13:23.799 INFO:tasks.workunit.client.0.smithi099.stdout:2/797: mkdir d10/d1c/d43/db8/df9 0 2024-01-31T05:13:23.800 INFO:tasks.workunit.client.0.smithi099.stdout:1/741: write d4/db/d12/dc0/d69/f70 [4100650,5511] 0 2024-01-31T05:13:23.802 INFO:tasks.workunit.client.0.smithi099.stdout:2/798: mknod d10/d1c/cfa 0 2024-01-31T05:13:23.804 INFO:tasks.workunit.client.0.smithi099.stdout:2/799: dread d10/d3a/d69/fa1 [0,4194304] 0 2024-01-31T05:13:23.804 INFO:tasks.workunit.client.0.smithi099.stdout:6/690: dwrite d14/d18/d52/d22/f88 [0,4194304] 0 2024-01-31T05:13:23.804 INFO:tasks.workunit.client.0.smithi099.stdout:2/800: write d10/d1b/d7d/d7a/dad/fd2 [611695,30253] 0 2024-01-31T05:13:23.804 INFO:tasks.workunit.client.0.smithi099.stdout:2/801: chown d10/d1b/d83/d86/d95/cf4 66950778 1 2024-01-31T05:13:23.805 INFO:tasks.workunit.client.0.smithi099.stdout:2/802: creat d10/d1b/d83/ffb x:0 0 0 2024-01-31T05:13:23.806 INFO:tasks.workunit.client.0.smithi099.stdout:6/691: mknod d14/d18/d52/d7e/d1c/d29/d4f/cdf 0 2024-01-31T05:13:23.806 INFO:tasks.workunit.client.0.smithi099.stdout:6/692: chown d14/d18/d9d 0 1 2024-01-31T05:13:23.806 INFO:tasks.workunit.client.0.smithi099.stdout:0/846: dwrite d1/d16/f50 [0,4194304] 0 2024-01-31T05:13:23.807 INFO:tasks.workunit.client.0.smithi099.stdout:9/812: dread d0/d3e/d87/dc9/d24/d2b/d59/f70 [0,4194304] 0 2024-01-31T05:13:23.811 INFO:tasks.workunit.client.0.smithi099.stdout:9/813: creat d0/d3e/d87/f11e x:0 0 0 2024-01-31T05:13:23.812 INFO:tasks.workunit.client.0.smithi099.stdout:9/814: mkdir d0/d3e/d87/dc9/d24/d2b/d63/da7/daa/d11f 0 2024-01-31T05:13:23.817 INFO:tasks.workunit.client.0.smithi099.stdout:9/815: dread d0/d5d/db6/fc5 [0,4194304] 0 2024-01-31T05:13:23.819 INFO:tasks.workunit.client.0.smithi099.stdout:9/816: rename d0/d3e/d87/dc9/c45 to d0/d5d/def/c120 0 2024-01-31T05:13:23.822 INFO:tasks.workunit.client.0.smithi099.stdout:7/864: dwrite d6/d32/d3d/d4b/d33/d37/d50/f3e [0,4194304] 0 2024-01-31T05:13:23.828 INFO:tasks.workunit.client.0.smithi099.stdout:7/865: link d6/d32/d3d/d4b/d33/d37/d50/c6b d6/d32/d3d/dd7/c122 0 2024-01-31T05:13:23.832 INFO:tasks.workunit.client.0.smithi099.stdout:7/866: link d6/d32/d3d/d4b/d33/d37/d50/d5e/l64 d6/d32/d3d/d46/d11f/l123 0 2024-01-31T05:13:23.835 INFO:tasks.workunit.client.0.smithi099.stdout:0/847: write d1/d37/d4a/d6f/fe7 [2172998,62383] 0 2024-01-31T05:13:23.836 INFO:tasks.workunit.client.0.smithi099.stdout:7/867: write d6/d32/d3d/d4b/d33/d37/d50/d25/d72/d8e/d9a/fcb [976711,30313] 0 2024-01-31T05:13:23.836 INFO:tasks.workunit.client.0.smithi099.stdout:7/868: read - d6/d32/d3d/d4b/d33/d37/dfe/f10b zero size 2024-01-31T05:13:23.836 INFO:tasks.workunit.client.0.smithi099.stdout:7/869: dread - d6/d32/d3d/d4b/d33/d37/d50/d25/d7a/ff3 zero size 2024-01-31T05:13:23.837 INFO:tasks.workunit.client.0.smithi099.stdout:0/848: mkdir d1/d37/d4a/d7a/d129 0 2024-01-31T05:13:23.839 INFO:tasks.workunit.client.0.smithi099.stdout:0/849: creat d1/d37/d4a/de6/f12a x:0 0 0 2024-01-31T05:13:23.839 INFO:tasks.workunit.client.0.smithi099.stdout:1/742: dwrite d4/dc/d29/fcc [0,4194304] 0 2024-01-31T05:13:23.842 INFO:tasks.workunit.client.0.smithi099.stdout:1/743: symlink d4/dc/d4d/da5/dbf/leb 0 2024-01-31T05:13:23.842 INFO:tasks.workunit.client.0.smithi099.stdout:1/744: chown d4/db/d12/dc0/d69 5 1 2024-01-31T05:13:23.847 INFO:tasks.workunit.client.0.smithi099.stdout:6/693: dwrite d14/d18/d52/d7e/d66/fc7 [0,4194304] 0 2024-01-31T05:13:23.847 INFO:tasks.workunit.client.0.smithi099.stdout:6/694: chown d14/d18/l73 9300 1 2024-01-31T05:13:23.847 INFO:tasks.workunit.client.0.smithi099.stdout:6/695: write d14/d18/d52/d7e/d1c/d29/d43/fd9 [11930,19989] 0 2024-01-31T05:13:23.848 INFO:tasks.workunit.client.0.smithi099.stdout:2/803: dwrite d10/d2b/d97/fb9 [0,4194304] 0 2024-01-31T05:13:23.849 INFO:tasks.workunit.client.0.smithi099.stdout:9/817: dwrite d0/d3e/d87/dc9/d24/d2b/d7b/fd6 [0,4194304] 0 2024-01-31T05:13:23.850 INFO:tasks.workunit.client.0.smithi099.stdout:6/696: chown d14/d18/d52/c54 14 1 2024-01-31T05:13:23.851 INFO:tasks.workunit.client.0.smithi099.stdout:2/804: dread d10/d1b/d7d/d7a/dad/fd2 [0,4194304] 0 2024-01-31T05:13:23.851 INFO:tasks.workunit.client.0.smithi099.stdout:2/805: chown d10/f15 57 1 2024-01-31T05:13:23.856 INFO:tasks.workunit.client.0.smithi099.stdout:7/870: write d6/ff [3899904,29789] 0 2024-01-31T05:13:23.859 INFO:tasks.workunit.client.0.smithi099.stdout:6/697: mkdir d14/d18/d52/d7e/d1c/de0 0 2024-01-31T05:13:23.862 INFO:tasks.workunit.client.0.smithi099.stdout:2/806: rename d10/d2b/d7c/ff7 to d10/d2b/de6/ffc 0 2024-01-31T05:13:23.863 INFO:tasks.workunit.client.0.smithi099.stdout:2/807: getdents d10/d2b/d58 0 2024-01-31T05:13:23.866 INFO:tasks.workunit.client.0.smithi099.stdout:0/850: dwrite d1/d56/d103/f126 [0,4194304] 0 2024-01-31T05:13:23.866 INFO:tasks.workunit.client.0.smithi099.stdout:0/851: stat d1/d37/d4a/d7a/fdf 0 2024-01-31T05:13:23.872 INFO:tasks.workunit.client.0.smithi099.stdout:1/745: dwrite d4/db/d12/dc0/d4b/d50/d91/f97 [0,4194304] 0 2024-01-31T05:13:23.873 INFO:tasks.workunit.client.0.smithi099.stdout:1/746: mknod d4/dc/d4d/d5d/d87/d56/d83/cec 0 2024-01-31T05:13:23.874 INFO:tasks.workunit.client.0.smithi099.stdout:9/818: dwrite d0/d3e/d87/dc9/f9c [0,4194304] 0 2024-01-31T05:13:23.874 INFO:tasks.workunit.client.0.smithi099.stdout:6/698: write d14/d18/d52/d7e/d1c/da6/fc0 [670971,6790] 0 2024-01-31T05:13:23.875 INFO:tasks.workunit.client.0.smithi099.stdout:6/699: creat d14/d18/d52/d7e/d66/fe1 x:0 0 0 2024-01-31T05:13:23.875 INFO:tasks.workunit.client.0.smithi099.stdout:6/700: write d14/d18/d52/d7e/d1c/d29/d94/faf [376347,100433] 0 2024-01-31T05:13:23.883 INFO:tasks.workunit.client.0.smithi099.stdout:7/871: dwrite d6/f52 [0,4194304] 0 2024-01-31T05:13:23.884 INFO:tasks.workunit.client.0.smithi099.stdout:1/747: write d4/db/d12/dc0/f2b [1929097,62617] 0 2024-01-31T05:13:23.894 INFO:tasks.workunit.client.0.smithi099.stdout:9/819: dwrite d0/d44/f4f [4194304,4194304] 0 2024-01-31T05:13:23.894 INFO:tasks.workunit.client.0.smithi099.stdout:9/820: creat d0/d7/d2e/f121 x:0 0 0 2024-01-31T05:13:23.894 INFO:tasks.workunit.client.0.smithi099.stdout:9/821: dread - d0/d3e/d87/dc9/d5e/d72/d89/d98/dc1/dca/ffe zero size 2024-01-31T05:13:23.894 INFO:tasks.workunit.client.0.smithi099.stdout:9/822: write d0/d3e/d33/dab/f113 [600090,62783] 0 2024-01-31T05:13:23.899 INFO:tasks.workunit.client.0.smithi099.stdout:1/748: write d4/dc/d4d/da5/dcf/fea [3796168,109920] 0 2024-01-31T05:13:23.908 INFO:tasks.workunit.client.0.smithi099.stdout:9/823: write d0/d7/f1f [2277798,120879] 0 2024-01-31T05:13:23.911 INFO:tasks.workunit.client.0.smithi099.stdout:9/824: creat d0/d3e/d87/dc9/d24/d48/d117/f122 x:0 0 0 2024-01-31T05:13:23.918 INFO:tasks.workunit.client.0.smithi099.stdout:1/749: dwrite d4/dc/d55/f95 [4194304,4194304] 0 2024-01-31T05:13:23.920 INFO:tasks.workunit.client.0.smithi099.stdout:1/750: symlink d4/dc/d15/d45/led 0 2024-01-31T05:13:23.924 INFO:tasks.workunit.client.0.smithi099.stdout:1/751: mkdir d4/db/d3a/d7e/db9/dee 0 2024-01-31T05:13:23.930 INFO:tasks.workunit.client.0.smithi099.stdout:9/825: dwrite d0/f95 [0,4194304] 0 2024-01-31T05:13:23.933 INFO:tasks.workunit.client.0.smithi099.stdout:8/901: sync 2024-01-31T05:13:23.933 INFO:tasks.workunit.client.0.smithi099.stdout:8/902: write d1/dd/dba/d29/f105 [283615,9705] 0 2024-01-31T05:13:23.934 INFO:tasks.workunit.client.0.smithi099.stdout:9/826: symlink d0/d3e/d87/dc9/d24/d2b/d7b/l123 0 2024-01-31T05:13:23.934 INFO:tasks.workunit.client.0.smithi099.stdout:9/827: stat d0/d5d/fb4 0 2024-01-31T05:13:23.934 INFO:tasks.workunit.client.0.smithi099.stdout:9/828: read - d0/d3e/d87/dc9/d24/d2b/d63/da7/f105 zero size 2024-01-31T05:13:23.939 INFO:tasks.workunit.client.0.smithi099.stdout:3/841: sync 2024-01-31T05:13:23.939 INFO:tasks.workunit.client.0.smithi099.stdout:3/842: mknod d10/d27/d34/d44/d60/d75/c12b 0 2024-01-31T05:13:23.940 INFO:tasks.workunit.client.0.smithi099.stdout:3/843: mkdir d10/d32/d33/d51/d12c 0 2024-01-31T05:13:23.942 INFO:tasks.workunit.client.0.smithi099.stdout:3/844: link d10/d27/d34/d44/d95/la6 d10/d27/d89/l12d 0 2024-01-31T05:13:23.944 INFO:tasks.workunit.client.0.smithi099.stdout:8/903: dread d1/dd/dba/d19/f53 [0,4194304] 0 2024-01-31T05:13:23.945 INFO:tasks.workunit.client.0.smithi099.stdout:8/904: symlink d1/dd/d1d/l127 0 2024-01-31T05:13:23.946 INFO:tasks.workunit.client.0.smithi099.stdout:1/752: dwrite d4/dc/d4d/f51 [0,4194304] 0 2024-01-31T05:13:23.946 INFO:tasks.workunit.client.0.smithi099.stdout:1/753: stat d4/dc/d29/l61 0 2024-01-31T05:13:23.946 INFO:tasks.workunit.client.0.smithi099.stdout:1/754: readlink d4/db/d3a/la2 0 2024-01-31T05:13:23.946 INFO:tasks.workunit.client.0.smithi099.stdout:1/755: truncate d4/dc/d44/fa9 602882 0 2024-01-31T05:13:23.946 INFO:tasks.workunit.client.0.smithi099.stdout:1/756: chown d4/dc/d4d/d5d/d87/d56/ce1 10138 1 2024-01-31T05:13:23.946 INFO:tasks.workunit.client.0.smithi099.stdout:1/757: write d4/dc/d29/fcc [4385429,66842] 0 2024-01-31T05:13:23.948 INFO:tasks.workunit.client.0.smithi099.stdout:1/758: symlink d4/dc/lef 0 2024-01-31T05:13:23.948 INFO:tasks.workunit.client.0.smithi099.stdout:1/759: chown d4/db/d12/dc0/d4b/d9a/dc7/ld5 25329 1 2024-01-31T05:13:23.948 INFO:tasks.workunit.client.0.smithi099.stdout:1/760: dread - d4/db/d3a/fac zero size 2024-01-31T05:13:23.948 INFO:tasks.workunit.client.0.smithi099.stdout:1/761: dread - d4/dc/d55/f8e zero size 2024-01-31T05:13:23.955 INFO:tasks.workunit.client.0.smithi099.stdout:9/829: dwrite d0/d3e/d87/dc9/d5e/d72/d89/d98/fb9 [0,4194304] 0 2024-01-31T05:13:23.958 INFO:tasks.workunit.client.0.smithi099.stdout:3/845: dread d10/d32/f4e [0,4194304] 0 2024-01-31T05:13:23.960 INFO:tasks.workunit.client.0.smithi099.stdout:3/846: symlink d10/d27/d125/l12e 0 2024-01-31T05:13:23.972 INFO:tasks.workunit.client.0.smithi099.stdout:1/762: dwrite d4/dc/d4d/d5d/d87/fdc [0,4194304] 0 2024-01-31T05:13:23.977 INFO:tasks.workunit.client.0.smithi099.stdout:1/763: write d4/db/d12/dc0/d4b/f52 [9467368,95081] 0 2024-01-31T05:13:23.978 INFO:tasks.workunit.client.0.smithi099.stdout:1/764: getdents d4/db/d3a 0 2024-01-31T05:13:23.979 INFO:tasks.workunit.client.0.smithi099.stdout:1/765: mkdir d4/dc/d4d/d5d/d87/d56/d83/dbd/df0 0 2024-01-31T05:13:23.999 INFO:tasks.workunit.client.0.smithi099.stdout:1/766: dwrite d4/f8d [0,4194304] 0 2024-01-31T05:13:24.011 INFO:tasks.workunit.client.0.smithi099.stdout:1/767: rename d4/db/d12/dc0/d4b/l8b to d4/dc/d48/lf1 0 2024-01-31T05:13:24.011 INFO:tasks.workunit.client.0.smithi099.stdout:1/768: creat d4/dc/d48/ff2 x:0 0 0 2024-01-31T05:13:24.012 INFO:tasks.workunit.client.0.smithi099.stdout:1/769: mknod d4/db/d12/d74/cf3 0 2024-01-31T05:13:24.012 INFO:tasks.workunit.client.0.smithi099.stdout:1/770: chown d4/dc/d15/fb3 14333919 1 2024-01-31T05:13:24.013 INFO:tasks.workunit.client.0.smithi099.stdout:1/771: symlink d4/db/d3a/d7e/d85/de8/lf4 0 2024-01-31T05:13:24.014 INFO:tasks.workunit.client.0.smithi099.stdout:1/772: creat d4/db/d12/dc0/d4b/ff5 x:0 0 0 2024-01-31T05:13:24.025 INFO:tasks.workunit.client.0.smithi099.stdout:1/773: read d4/dc/d4d/d5d/d87/f9d [2758881,26263] 0 2024-01-31T05:13:24.029 INFO:tasks.workunit.client.0.smithi099.stdout:4/860: sync 2024-01-31T05:13:24.030 INFO:tasks.workunit.client.0.smithi099.stdout:4/861: creat d0/d2/d4b/d93/d59/d82/f11f x:0 0 0 2024-01-31T05:13:24.031 INFO:tasks.workunit.client.0.smithi099.stdout:4/862: truncate d0/d8/f11 40276 0 2024-01-31T05:13:24.032 INFO:tasks.workunit.client.0.smithi099.stdout:4/863: truncate d0/d2/d20/f31 5306665 0 2024-01-31T05:13:24.034 INFO:tasks.workunit.client.0.smithi099.stdout:4/864: mkdir d0/d8/d120 0 2024-01-31T05:13:24.034 INFO:tasks.workunit.client.0.smithi099.stdout:4/865: dread - d0/d2/d4b/d93/d86/f112 zero size 2024-01-31T05:13:24.048 INFO:tasks.workunit.client.0.smithi099.stdout:4/866: rename d0/d2/d4b/d93/d59/c80 to d0/d8/d19/d98/d9b/c121 0 2024-01-31T05:13:24.066 INFO:tasks.workunit.client.0.smithi099.stdout:4/867: dwrite d0/d8/d19/d99/d9e/feb [0,4194304] 0 2024-01-31T05:13:24.093 INFO:tasks.workunit.client.0.smithi099.stdout:4/868: dwrite d0/d2/d4b/d93/f114 [0,4194304] 0 2024-01-31T05:13:24.095 INFO:tasks.workunit.client.0.smithi099.stdout:4/869: mknod d0/d2/d4b/d93/d17/d24/c122 0 2024-01-31T05:13:24.096 INFO:tasks.workunit.client.0.smithi099.stdout:4/870: truncate d0/d2/d4b/d93/d17/d24/fd2 347412 0 2024-01-31T05:13:24.098 INFO:tasks.workunit.client.0.smithi099.stdout:4/871: creat d0/d8/d19/f123 x:0 0 0 2024-01-31T05:13:24.099 INFO:tasks.workunit.client.0.smithi099.stdout:4/872: creat d0/d2/d4b/d93/d17/f124 x:0 0 0 2024-01-31T05:13:24.100 INFO:tasks.workunit.client.0.smithi099.stdout:4/873: mkdir d0/d8/d19/d65/d125 0 2024-01-31T05:13:24.101 INFO:tasks.workunit.client.0.smithi099.stdout:4/874: link d0/d2/d20/c4f d0/d2/c126 0 2024-01-31T05:13:24.110 INFO:tasks.workunit.client.0.smithi099.stdout:4/875: dread d0/d2/f9f [0,4194304] 0 2024-01-31T05:13:24.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:23 smithi179 ceph-mon[35652]: pgmap v409: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 200 MiB/s rd, 248 MiB/s wr, 1.89k op/s 2024-01-31T05:13:24.137 INFO:tasks.workunit.client.0.smithi099.stdout:4/876: dwrite d0/d8/f11 [0,4194304] 0 2024-01-31T05:13:24.137 INFO:tasks.workunit.client.0.smithi099.stdout:4/877: write d0/d79/f92 [310660,71430] 0 2024-01-31T05:13:24.150 INFO:tasks.workunit.client.0.smithi099.stdout:4/878: rename d0/d79 to d0/d2/d4b/d93/d39/dcf/d127 0 2024-01-31T05:13:24.158 INFO:tasks.workunit.client.0.smithi099.stdout:4/879: dread d0/f60 [0,4194304] 0 2024-01-31T05:13:24.169 INFO:tasks.workunit.client.0.smithi099.stdout:4/880: dread d0/d8/d19/d98/fad [0,4194304] 0 2024-01-31T05:13:24.170 INFO:tasks.workunit.client.0.smithi099.stdout:4/881: creat d0/d2/d4b/d93/d59/dff/d43/f128 x:0 0 0 2024-01-31T05:13:24.171 INFO:tasks.workunit.client.0.smithi099.stdout:4/882: dread - d0/d2/d4b/d93/d59/d82/f11f zero size 2024-01-31T05:13:24.172 INFO:tasks.workunit.client.0.smithi099.stdout:4/883: unlink d0/d2/f15 0 2024-01-31T05:13:24.180 INFO:tasks.workunit.client.0.smithi099.stdout:4/884: write d0/d2/d4b/d93/d39/fcd [2478770,117470] 0 2024-01-31T05:13:24.191 INFO:tasks.workunit.client.0.smithi099.stdout:4/885: dread d0/d2/d4b/d93/d17/de1/d117/fb8 [0,4194304] 0 2024-01-31T05:13:24.199 INFO:tasks.workunit.client.0.smithi099.stdout:2/808: sync 2024-01-31T05:13:24.199 INFO:tasks.workunit.client.0.smithi099.stdout:5/785: sync 2024-01-31T05:13:24.199 INFO:tasks.workunit.client.0.smithi099.stdout:0/852: sync 2024-01-31T05:13:24.199 INFO:tasks.workunit.client.0.smithi099.stdout:0/853: fsync d1/d37/d4a/d7a/fdf 0 2024-01-31T05:13:24.200 INFO:tasks.workunit.client.0.smithi099.stdout:2/809: creat d10/d20/dd0/ffd x:0 0 0 2024-01-31T05:13:24.200 INFO:tasks.workunit.client.0.smithi099.stdout:2/810: chown d10/d1b/d83/l92 177905 1 2024-01-31T05:13:24.201 INFO:tasks.workunit.client.0.smithi099.stdout:5/786: creat d6/da/d3f/d73/de4/f101 x:0 0 0 2024-01-31T05:13:24.201 INFO:tasks.workunit.client.0.smithi099.stdout:2/811: truncate d10/d20/f68 1084321 0 2024-01-31T05:13:24.202 INFO:tasks.workunit.client.0.smithi099.stdout:0/854: unlink d1/d37/d4a/d7a/l81 0 2024-01-31T05:13:24.203 INFO:tasks.workunit.client.0.smithi099.stdout:5/787: creat d6/da/d14/d61/d98/da0/f102 x:0 0 0 2024-01-31T05:13:24.205 INFO:tasks.workunit.client.0.smithi099.stdout:0/855: creat d1/d30/d45/dad/f12b x:0 0 0 2024-01-31T05:13:24.205 INFO:tasks.workunit.client.0.smithi099.stdout:0/856: chown d1/d37/d4a/d7b/fc2 772284 1 2024-01-31T05:13:24.206 INFO:tasks.workunit.client.0.smithi099.stdout:0/857: fdatasync d1/d30/d45/fa3 0 2024-01-31T05:13:24.206 INFO:tasks.workunit.client.0.smithi099.stdout:5/788: symlink d6/da/d14/d3d/da8/l103 0 2024-01-31T05:13:24.206 INFO:tasks.workunit.client.0.smithi099.stdout:5/789: truncate d6/da/d14/d3d/d51/dae/fe8 1005458 0 2024-01-31T05:13:24.206 INFO:tasks.workunit.client.0.smithi099.stdout:5/790: chown d6/da/d14 5787 1 2024-01-31T05:13:24.206 INFO:tasks.workunit.client.0.smithi099.stdout:5/791: chown d6/da/d14/d3d/d51/d82 8322 1 2024-01-31T05:13:24.212 INFO:tasks.workunit.client.0.smithi099.stdout:5/792: write d6/da/d14/d3d/d8c/fd9 [3212424,107443] 0 2024-01-31T05:13:24.214 INFO:tasks.workunit.client.0.smithi099.stdout:5/793: mknod d6/da/d14/d3d/d6e/d21/df0/c104 0 2024-01-31T05:13:24.215 INFO:tasks.workunit.client.0.smithi099.stdout:5/794: mkdir d6/da/d3f/d5a/d81/d105 0 2024-01-31T05:13:24.215 INFO:tasks.workunit.client.0.smithi099.stdout:5/795: read - d6/da/d14/d3d/d51/d82/ff5 zero size 2024-01-31T05:13:24.215 INFO:tasks.workunit.client.0.smithi099.stdout:5/796: readlink d6/da/d14/lcf 0 2024-01-31T05:13:24.237 INFO:tasks.workunit.client.0.smithi099.stdout:2/812: dwrite d10/d1b/d4d/fd1 [0,4194304] 0 2024-01-31T05:13:24.238 INFO:tasks.workunit.client.0.smithi099.stdout:2/813: readlink d10/d1b/d7d/l9d 0 2024-01-31T05:13:24.238 INFO:tasks.workunit.client.0.smithi099.stdout:2/814: read - d10/d1b/d7d/d7a/dad/fc4 zero size 2024-01-31T05:13:24.238 INFO:tasks.workunit.client.0.smithi099.stdout:2/815: mknod d10/d51/cfe 0 2024-01-31T05:13:24.240 INFO:tasks.workunit.client.0.smithi099.stdout:2/816: mkdir d10/d20/d5b/dff 0 2024-01-31T05:13:24.240 INFO:tasks.workunit.client.0.smithi099.stdout:2/817: creat d10/d1c/d43/f100 x:0 0 0 2024-01-31T05:13:24.247 INFO:tasks.workunit.client.0.smithi099.stdout:0/858: dwrite d1/d30/d45/d66/f33 [0,4194304] 0 2024-01-31T05:13:24.247 INFO:tasks.workunit.client.0.smithi099.stdout:0/859: chown d1/d37/f93 686 1 2024-01-31T05:13:24.247 INFO:tasks.workunit.client.0.smithi099.stdout:5/797: dwrite d6/f11 [0,4194304] 0 2024-01-31T05:13:24.247 INFO:tasks.workunit.client.0.smithi099.stdout:5/798: fsync d6/da/d14/d3d/d6e/f22 0 2024-01-31T05:13:24.248 INFO:tasks.workunit.client.0.smithi099.stdout:0/860: mknod d1/d37/d4a/d7a/d9d/c12c 0 2024-01-31T05:13:24.251 INFO:tasks.workunit.client.0.smithi099.stdout:5/799: rename d6/da/d3f/d5a to d6/da/d14/d61/d98/d106 0 2024-01-31T05:13:24.251 INFO:tasks.workunit.client.0.smithi099.stdout:5/800: fsync d6/da/d14/d61/d98/fbc 0 2024-01-31T05:13:24.251 INFO:tasks.workunit.client.0.smithi099.stdout:5/801: truncate d6/da/d14/d61/d98/fbc 2860582 0 2024-01-31T05:13:24.253 INFO:tasks.workunit.client.0.smithi099.stdout:2/818: link d10/l17 d10/d1b/d7d/d7a/l101 0 2024-01-31T05:13:24.261 INFO:tasks.workunit.client.0.smithi099.stdout:0/861: dread d1/d56/d103/fa7 [0,4194304] 0 2024-01-31T05:13:24.262 INFO:tasks.workunit.client.0.smithi099.stdout:2/819: unlink d10/d2b/d58/lf8 0 2024-01-31T05:13:24.264 INFO:tasks.workunit.client.0.smithi099.stdout:2/820: creat d10/d1b/d83/d86/f102 x:0 0 0 2024-01-31T05:13:24.274 INFO:tasks.workunit.client.0.smithi099.stdout:2/821: dread d10/d1b/d7d/d7a/fbd [0,4194304] 0 2024-01-31T05:13:24.276 INFO:tasks.workunit.client.0.smithi099.stdout:2/822: unlink d10/f42 0 2024-01-31T05:13:24.277 INFO:tasks.workunit.client.0.smithi099.stdout:2/823: creat d10/f103 x:0 0 0 2024-01-31T05:13:24.278 INFO:tasks.workunit.client.0.smithi099.stdout:2/824: dread - d10/d20/fe2 zero size 2024-01-31T05:13:24.278 INFO:tasks.workunit.client.0.smithi099.stdout:2/825: symlink d10/d1b/d83/de8/l104 0 2024-01-31T05:13:24.279 INFO:tasks.workunit.client.0.smithi099.stdout:5/802: dwrite d6/da/d14/d3d/d8c/fd9 [4194304,4194304] 0 2024-01-31T05:13:24.280 INFO:tasks.workunit.client.0.smithi099.stdout:2/826: creat d10/d1b/d7d/d7a/dd7/f105 x:0 0 0 2024-01-31T05:13:24.280 INFO:tasks.workunit.client.0.smithi099.stdout:2/827: write d10/d1c/f74 [1024268,61093] 0 2024-01-31T05:13:24.290 INFO:tasks.workunit.client.0.smithi099.stdout:0/862: dwrite d1/d37/d4a/d7a/d9d/fd9 [0,4194304] 0 2024-01-31T05:13:24.292 INFO:tasks.workunit.client.0.smithi099.stdout:0/863: truncate d1/d56/d103/fe2 436677 0 2024-01-31T05:13:24.292 INFO:tasks.workunit.client.0.smithi099.stdout:5/803: write d6/da/d14/d3d/d51/d82/f41 [3435870,123614] 0 2024-01-31T05:13:24.296 INFO:tasks.workunit.client.0.smithi099.stdout:5/804: mkdir d6/da/d14/d61/d98/da0/d107 0 2024-01-31T05:13:24.296 INFO:tasks.workunit.client.0.smithi099.stdout:6/701: sync 2024-01-31T05:13:24.298 INFO:tasks.workunit.client.0.smithi099.stdout:5/805: rename d6/da/d14/l80 to d6/l108 0 2024-01-31T05:13:24.300 INFO:tasks.workunit.client.0.smithi099.stdout:2/828: dwrite d10/d20/f4c [0,4194304] 0 2024-01-31T05:13:24.300 INFO:tasks.workunit.client.0.smithi099.stdout:2/829: fdatasync d10/d3a/d69/fbc 0 2024-01-31T05:13:24.301 INFO:tasks.workunit.client.0.smithi099.stdout:8/905: sync 2024-01-31T05:13:24.301 INFO:tasks.workunit.client.0.smithi099.stdout:7/872: sync 2024-01-31T05:13:24.301 INFO:tasks.workunit.client.0.smithi099.stdout:9/830: sync 2024-01-31T05:13:24.301 INFO:tasks.workunit.client.0.smithi099.stdout:1/774: sync 2024-01-31T05:13:24.301 INFO:tasks.workunit.client.0.smithi099.stdout:4/886: sync 2024-01-31T05:13:24.301 INFO:tasks.workunit.client.0.smithi099.stdout:3/847: sync 2024-01-31T05:13:24.301 INFO:tasks.workunit.client.0.smithi099.stdout:3/848: fdatasync d10/d27/d34/f68 0 2024-01-31T05:13:24.302 INFO:tasks.workunit.client.0.smithi099.stdout:8/906: truncate d1/dd/d65/d7f/d81/dc7/dce/ffd 1136783 0 2024-01-31T05:13:24.302 INFO:tasks.workunit.client.0.smithi099.stdout:2/830: unlink d10/d1b/d83/d86/f102 0 2024-01-31T05:13:24.302 INFO:tasks.workunit.client.0.smithi099.stdout:5/806: rename d6/da/d14/lba to d6/da/dd5/l109 0 2024-01-31T05:13:24.313 INFO:tasks.workunit.client.0.smithi099.stdout:9/831: rename d0/c22 to d0/d3e/d87/dc9/c124 0 2024-01-31T05:13:24.313 INFO:tasks.workunit.client.0.smithi099.stdout:8/907: write d1/dd/dba/d19/d21/d3c/fe4 [5584748,92985] 0 2024-01-31T05:13:24.314 INFO:tasks.workunit.client.0.smithi099.stdout:8/908: write d1/dd/dba/d20/f4b [5892257,26167] 0 2024-01-31T05:13:24.315 INFO:tasks.workunit.client.0.smithi099.stdout:5/807: link d6/da/d14/d3d/d8c/d99/fe1 d6/da/d14/d2b/d9e/f10a 0 2024-01-31T05:13:24.317 INFO:tasks.workunit.client.0.smithi099.stdout:3/849: mkdir d10/d27/d34/d50/d12f 0 2024-01-31T05:13:24.317 INFO:tasks.workunit.client.0.smithi099.stdout:4/887: write d0/d2/d4b/d93/d17/d7d/ff3 [1303973,120078] 0 2024-01-31T05:13:24.317 INFO:tasks.workunit.client.0.smithi099.stdout:4/888: readlink d0/d2/d4b/d93/d59/d82/l97 0 2024-01-31T05:13:24.318 INFO:tasks.workunit.client.0.smithi099.stdout:9/832: mknod d0/d3e/d87/c125 0 2024-01-31T05:13:24.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:23 smithi099 ceph-mon[31615]: pgmap v409: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 200 MiB/s rd, 248 MiB/s wr, 1.89k op/s 2024-01-31T05:13:24.319 INFO:tasks.workunit.client.0.smithi099.stdout:4/889: creat d0/d1e/d61/f129 x:0 0 0 2024-01-31T05:13:24.319 INFO:tasks.workunit.client.0.smithi099.stdout:8/909: symlink d1/dd/dba/d19/l128 0 2024-01-31T05:13:24.320 INFO:tasks.workunit.client.0.smithi099.stdout:8/910: write d1/dd/d1d/f102 [845473,43923] 0 2024-01-31T05:13:24.320 INFO:tasks.workunit.client.0.smithi099.stdout:2/831: getdents d10/d2b/d7c 0 2024-01-31T05:13:24.320 INFO:tasks.workunit.client.0.smithi099.stdout:4/890: mknod d0/d1e/d61/c12a 0 2024-01-31T05:13:24.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:23 smithi181 ceph-mon[36434]: pgmap v409: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 200 MiB/s rd, 248 MiB/s wr, 1.89k op/s 2024-01-31T05:13:24.321 INFO:tasks.workunit.client.0.smithi099.stdout:3/850: symlink d10/d27/d34/d44/d95/l130 0 2024-01-31T05:13:24.321 INFO:tasks.workunit.client.0.smithi099.stdout:3/851: chown d10/d32/l10e 6 1 2024-01-31T05:13:24.322 INFO:tasks.workunit.client.0.smithi099.stdout:9/833: link d0/d3e/d87/dc9/d24/d2b/d59/f9b d0/d5d/f126 0 2024-01-31T05:13:24.322 INFO:tasks.workunit.client.0.smithi099.stdout:4/891: write d0/d8/d19/f1c [633686,57472] 0 2024-01-31T05:13:24.323 INFO:tasks.workunit.client.0.smithi099.stdout:2/832: creat d10/d2b/d97/f106 x:0 0 0 2024-01-31T05:13:24.324 INFO:tasks.workunit.client.0.smithi099.stdout:3/852: creat d10/d32/d33/f131 x:0 0 0 2024-01-31T05:13:24.324 INFO:tasks.workunit.client.0.smithi099.stdout:3/853: fsync d10/d32/d33/f63 0 2024-01-31T05:13:24.324 INFO:tasks.workunit.client.0.smithi099.stdout:3/854: write d10/dfa/d120/fd1 [169503,30442] 0 2024-01-31T05:13:24.329 INFO:tasks.workunit.client.0.smithi099.stdout:4/892: mkdir d0/d2/d4b/d93/d17/d7d/db2/dc7/dfd/d12b 0 2024-01-31T05:13:24.331 INFO:tasks.workunit.client.0.smithi099.stdout:4/893: creat d0/d2/d4b/d93/d59/dff/d43/df9/d11d/f12c x:0 0 0 2024-01-31T05:13:24.332 INFO:tasks.workunit.client.0.smithi099.stdout:4/894: chown d0/d8/d19/d98/d9b/dab/l71 120759 1 2024-01-31T05:13:24.332 INFO:tasks.workunit.client.0.smithi099.stdout:4/895: readlink d0/d2/d4b/l52 0 2024-01-31T05:13:24.335 INFO:tasks.workunit.client.0.smithi099.stdout:4/896: rmdir d0/d2/d20 39 2024-01-31T05:13:24.337 INFO:tasks.workunit.client.0.smithi099.stdout:7/873: dwrite d6/d32/d3d/d4b/d33/d37/d50/d4d/dad/daf/fc0 [0,4194304] 0 2024-01-31T05:13:24.337 INFO:tasks.workunit.client.0.smithi099.stdout:7/874: truncate d6/d32/d3d/d4b/d33/d37/d50/f3e 4848414 0 2024-01-31T05:13:24.337 INFO:tasks.workunit.client.0.smithi099.stdout:7/875: chown d6/d32/d3d/d4b/d33/d37/d50/d25/d47/f57 9111924 1 2024-01-31T05:13:24.338 INFO:tasks.workunit.client.0.smithi099.stdout:4/897: mkdir d0/d2/d4b/d93/d59/dff/db9/d10b/d12d 0 2024-01-31T05:13:24.340 INFO:tasks.workunit.client.0.smithi099.stdout:4/898: creat d0/d2/d4b/d93/d17/d105/f12e x:0 0 0 2024-01-31T05:13:24.340 INFO:tasks.workunit.client.0.smithi099.stdout:4/899: write d0/d2/d4b/d93/f10f [1026442,45721] 0 2024-01-31T05:13:24.340 INFO:tasks.workunit.client.0.smithi099.stdout:4/900: chown d0/d1e/f35 435435588 1 2024-01-31T05:13:24.344 INFO:tasks.workunit.client.0.smithi099.stdout:4/901: creat d0/d2/d4b/d93/d17/d7d/db2/dc7/dcc/f12f x:0 0 0 2024-01-31T05:13:24.346 INFO:tasks.workunit.client.0.smithi099.stdout:6/702: dwrite d14/d18/d52/d7e/d1c/fc3 [0,4194304] 0 2024-01-31T05:13:24.346 INFO:tasks.workunit.client.0.smithi099.stdout:6/703: stat d14/d18/d52/d7e/d1c/d29/d4f/f92 0 2024-01-31T05:13:24.346 INFO:tasks.workunit.client.0.smithi099.stdout:6/704: fsync d14/d18/d52/d90/fb1 0 2024-01-31T05:13:24.347 INFO:tasks.workunit.client.0.smithi099.stdout:4/902: chown d0/d2/d4b/c5d 1 1 2024-01-31T05:13:24.347 INFO:tasks.workunit.client.0.smithi099.stdout:6/705: symlink d14/d18/d52/d7e/d1c/d29/d94/da3/le2 0 2024-01-31T05:13:24.348 INFO:tasks.workunit.client.0.smithi099.stdout:4/903: mknod d0/d2/d20/d84/c130 0 2024-01-31T05:13:24.348 INFO:tasks.workunit.client.0.smithi099.stdout:4/904: read - d0/d2/d4b/d93/d59/dff/fd0 zero size 2024-01-31T05:13:24.349 INFO:tasks.workunit.client.0.smithi099.stdout:4/905: mkdir d0/d8/d19/d99/d131 0 2024-01-31T05:13:24.357 INFO:tasks.workunit.client.0.smithi099.stdout:9/834: dwrite d0/d3e/d87/dc9/d5e/d72/d89/d98/fb9 [0,4194304] 0 2024-01-31T05:13:24.357 INFO:tasks.workunit.client.0.smithi099.stdout:9/835: creat d0/d5d/def/f127 x:0 0 0 2024-01-31T05:13:24.357 INFO:tasks.workunit.client.0.smithi099.stdout:9/836: read - d0/d3e/d87/dc9/d24/d48/fff zero size 2024-01-31T05:13:24.357 INFO:tasks.workunit.client.0.smithi099.stdout:9/837: read - d0/d3e/d87/dc9/d5e/d72/f103 zero size 2024-01-31T05:13:24.360 INFO:tasks.workunit.client.0.smithi099.stdout:9/838: symlink d0/d3e/l128 0 2024-01-31T05:13:24.360 INFO:tasks.workunit.client.0.smithi099.stdout:1/775: dwrite d4/dc/d15/f32 [0,4194304] 0 2024-01-31T05:13:24.361 INFO:tasks.workunit.client.0.smithi099.stdout:1/776: mknod d4/dc/d4d/d5d/d87/cf6 0 2024-01-31T05:13:24.362 INFO:tasks.workunit.client.0.smithi099.stdout:9/839: creat d0/d7/f129 x:0 0 0 2024-01-31T05:13:24.362 INFO:tasks.workunit.client.0.smithi099.stdout:6/706: dread d14/d18/f93 [0,4194304] 0 2024-01-31T05:13:24.363 INFO:tasks.workunit.client.0.smithi099.stdout:1/777: creat d4/dc/d55/ff7 x:0 0 0 2024-01-31T05:13:24.365 INFO:tasks.workunit.client.0.smithi099.stdout:6/707: creat d14/d18/d52/dbc/fe3 x:0 0 0 2024-01-31T05:13:24.365 INFO:tasks.workunit.client.0.smithi099.stdout:6/708: chown d14/d18/d3b/l97 177 1 2024-01-31T05:13:24.367 INFO:tasks.workunit.client.0.smithi099.stdout:8/911: dwrite d1/dd/dba/d29/d3f/d56/d57/f89 [0,4194304] 0 2024-01-31T05:13:24.373 INFO:tasks.workunit.client.0.smithi099.stdout:2/833: rename d10/d1c/d43/db8/df9 to d10/d1b/d7d/d7a/d107 0 2024-01-31T05:13:24.374 INFO:tasks.workunit.client.0.smithi099.stdout:2/834: mkdir d10/d1c/d43/db8/d108 0 2024-01-31T05:13:24.376 INFO:tasks.workunit.client.0.smithi099.stdout:2/835: link d10/d3a/c71 d10/d1c/d43/c109 0 2024-01-31T05:13:24.381 INFO:tasks.workunit.client.0.smithi099.stdout:6/709: dread d14/d18/d52/d22/f88 [0,4194304] 0 2024-01-31T05:13:24.385 INFO:tasks.workunit.client.0.smithi099.stdout:6/710: dread fa [0,4194304] 0 2024-01-31T05:13:24.385 INFO:tasks.workunit.client.0.smithi099.stdout:3/855: dwrite d10/d1e/f6f [0,4194304] 0 2024-01-31T05:13:24.385 INFO:tasks.workunit.client.0.smithi099.stdout:6/711: chown d14/d18/d52/d22/f65 38758 1 2024-01-31T05:13:24.386 INFO:tasks.workunit.client.0.smithi099.stdout:7/876: dwrite d6/d32/d3d/d4b/d33/d37/d4e/f55 [0,4194304] 0 2024-01-31T05:13:24.387 INFO:tasks.workunit.client.0.smithi099.stdout:9/840: dwrite d0/d7/f13 [0,4194304] 0 2024-01-31T05:13:24.387 INFO:tasks.workunit.client.0.smithi099.stdout:2/836: dread d10/d1b/d4d/fd1 [0,4194304] 0 2024-01-31T05:13:24.387 INFO:tasks.workunit.client.0.smithi099.stdout:2/837: read f1 [2479376,33011] 0 2024-01-31T05:13:24.387 INFO:tasks.workunit.client.0.smithi099.stdout:3/856: creat d10/d24/f132 x:0 0 0 2024-01-31T05:13:24.393 INFO:tasks.workunit.client.0.smithi099.stdout:4/906: rename d0/d8/d19/d99/d131 to d0/d2/d4b/d93/d86/db4/d132 0 2024-01-31T05:13:24.393 INFO:tasks.workunit.client.0.smithi099.stdout:9/841: mknod d0/d3e/d87/dc9/d5e/d72/dbf/c12a 0 2024-01-31T05:13:24.393 INFO:tasks.workunit.client.0.smithi099.stdout:9/842: dread - d0/d3e/d87/dc9/d24/d2b/d59/f9b zero size 2024-01-31T05:13:24.395 INFO:tasks.workunit.client.0.smithi099.stdout:9/843: dread d0/d3e/d87/dc9/d24/d48/f4b [0,4194304] 0 2024-01-31T05:13:24.395 INFO:tasks.workunit.client.0.smithi099.stdout:9/844: truncate d0/d3e/d87/dc9/d24/d48/d117/f122 704938 0 2024-01-31T05:13:24.395 INFO:tasks.workunit.client.0.smithi099.stdout:9/845: fdatasync d0/d3e/d87/dc9/d24/d48/fff 0 2024-01-31T05:13:24.395 INFO:tasks.workunit.client.0.smithi099.stdout:9/846: fsync d0/d7/dd2/fe7 0 2024-01-31T05:13:24.395 INFO:tasks.workunit.client.0.smithi099.stdout:9/847: truncate d0/d3e/d87/dc9/d24/fa1 4582744 0 2024-01-31T05:13:24.395 INFO:tasks.workunit.client.0.smithi099.stdout:9/848: stat d0/d3e/d87/dc9/d24/f75 0 2024-01-31T05:13:24.395 INFO:tasks.workunit.client.0.smithi099.stdout:9/849: write d0/d7/fdd [1557381,103324] 0 2024-01-31T05:13:24.395 INFO:tasks.workunit.client.0.smithi099.stdout:9/850: creat d0/d3e/d33/d8a/f12b x:0 0 0 2024-01-31T05:13:24.396 INFO:tasks.workunit.client.0.smithi099.stdout:7/877: mkdir d6/d32/d3d/d4b/d9b/d124 0 2024-01-31T05:13:24.397 INFO:tasks.workunit.client.0.smithi099.stdout:7/878: symlink d6/d32/d3d/d4b/d9b/d124/l125 0 2024-01-31T05:13:24.398 INFO:tasks.workunit.client.0.smithi099.stdout:6/712: read d14/d18/d52/d7e/d1c/f44 [1153801,69605] 0 2024-01-31T05:13:24.398 INFO:tasks.workunit.client.0.smithi099.stdout:6/713: creat d14/d18/d52/d7e/d1c/da6/fe4 x:0 0 0 2024-01-31T05:13:24.398 INFO:tasks.workunit.client.0.smithi099.stdout:6/714: chown d14/d18/d52/d22/f88 410597 1 2024-01-31T05:13:24.399 INFO:tasks.workunit.client.0.smithi099.stdout:7/879: link d6/d32/d3d/d4b/c2a d6/d12/c126 0 2024-01-31T05:13:24.400 INFO:tasks.workunit.client.0.smithi099.stdout:6/715: symlink d14/d18/d52/d22/le5 0 2024-01-31T05:13:24.400 INFO:tasks.workunit.client.0.smithi099.stdout:2/838: mknod d10/d1b/d7d/d7a/d107/c10a 0 2024-01-31T05:13:24.402 INFO:tasks.workunit.client.0.smithi099.stdout:7/880: link d6/d32/ld6 d6/d32/d3d/d4b/d33/d37/d50/d25/d7a/d104/l127 0 2024-01-31T05:13:24.402 INFO:tasks.workunit.client.0.smithi099.stdout:7/881: chown d6/d32/d3d/d4b/d33/d37/d50/ff6 846977 1 2024-01-31T05:13:24.408 INFO:tasks.workunit.client.0.smithi099.stdout:3/857: dwrite d10/d1e/f25 [4194304,4194304] 0 2024-01-31T05:13:24.410 INFO:tasks.workunit.client.0.smithi099.stdout:2/839: dread f1 [0,4194304] 0 2024-01-31T05:13:24.425 INFO:tasks.workunit.client.0.smithi099.stdout:2/840: write d10/d1b/d4d/fb3 [518490,77379] 0 2024-01-31T05:13:24.428 INFO:tasks.workunit.client.0.smithi099.stdout:1/778: rename d4/db/d3a/la2 to d4/dc/d4d/d5d/lf8 0 2024-01-31T05:13:24.430 INFO:tasks.workunit.client.0.smithi099.stdout:3/858: dwrite d10/d24/d40/d81/fb7 [0,4194304] 0 2024-01-31T05:13:24.430 INFO:tasks.workunit.client.0.smithi099.stdout:3/859: stat d10/d1e/fc1 0 2024-01-31T05:13:24.432 INFO:tasks.workunit.client.0.smithi099.stdout:2/841: chown d10/l16 46433 1 2024-01-31T05:13:24.432 INFO:tasks.workunit.client.0.smithi099.stdout:2/842: fdatasync d10/d1c/f2d 0 2024-01-31T05:13:24.433 INFO:tasks.workunit.client.0.smithi099.stdout:3/860: rmdir d10/d27/d34/d44/d60/d75 39 2024-01-31T05:13:24.433 INFO:tasks.workunit.client.0.smithi099.stdout:3/861: write d10/d27/d34/d44/d60/fa8 [2179938,68274] 0 2024-01-31T05:13:24.433 INFO:tasks.workunit.client.0.smithi099.stdout:3/862: fsync d10/d72/f9c 0 2024-01-31T05:13:24.433 INFO:tasks.workunit.client.0.smithi099.stdout:3/863: chown d10/d27/d34/d44/le0 502835842 1 2024-01-31T05:13:24.445 INFO:tasks.workunit.client.0.smithi099.stdout:4/907: rename d0/d2/d20/d84/lb1 to d0/d2/d4b/d93/d17/de1/l133 0 2024-01-31T05:13:24.445 INFO:tasks.workunit.client.0.smithi099.stdout:4/908: creat d0/d2/d4b/d93/d59/dff/d43/df9/f134 x:0 0 0 2024-01-31T05:13:24.445 INFO:tasks.workunit.client.0.smithi099.stdout:4/909: truncate d0/d2/d4b/f90 579601 0 2024-01-31T05:13:24.447 INFO:tasks.workunit.client.0.smithi099.stdout:4/910: truncate d0/d2/d4b/d93/d17/def/f106 3527239 0 2024-01-31T05:13:24.447 INFO:tasks.workunit.client.0.smithi099.stdout:4/911: stat d0/c87 0 2024-01-31T05:13:24.447 INFO:tasks.workunit.client.0.smithi099.stdout:4/912: dread - d0/d2/d4b/d93/d59/dff/fd0 zero size 2024-01-31T05:13:24.447 INFO:tasks.workunit.client.0.smithi099.stdout:7/882: rename d6/d32/d3d/d4b/d33/d37/d50/d25/d79/fd2 to d6/d98/de3/f128 0 2024-01-31T05:13:24.448 INFO:tasks.workunit.client.0.smithi099.stdout:4/913: symlink d0/d2/d4b/d93/d59/dff/d43/l135 0 2024-01-31T05:13:24.448 INFO:tasks.workunit.client.0.smithi099.stdout:4/914: fsync d0/d2/d4b/d93/d17/d24/fd2 0 2024-01-31T05:13:24.449 INFO:tasks.workunit.client.0.smithi099.stdout:3/864: rename d10/d27/d34/d44/d60/d75/d8c/f129 to d10/d27/d34/d44/d95/f133 0 2024-01-31T05:13:24.450 INFO:tasks.workunit.client.0.smithi099.stdout:4/915: mkdir d0/d2/d4b/d93/d39/d136 0 2024-01-31T05:13:24.450 INFO:tasks.workunit.client.0.smithi099.stdout:4/916: write d0/f5b [1486363,123157] 0 2024-01-31T05:13:24.450 INFO:tasks.workunit.client.0.smithi099.stdout:7/883: mknod d6/d32/d3d/d4b/d33/d37/d50/d5e/d107/c129 0 2024-01-31T05:13:24.450 INFO:tasks.workunit.client.0.smithi099.stdout:7/884: truncate d6/d32/d3d/d4b/fee 128119 0 2024-01-31T05:13:24.451 INFO:tasks.workunit.client.0.smithi099.stdout:7/885: mknod d6/d32/d3d/dd7/dc5/c12a 0 2024-01-31T05:13:24.451 INFO:tasks.workunit.client.0.smithi099.stdout:4/917: mkdir d0/d8/d19/d98/d9b/d137 0 2024-01-31T05:13:24.453 INFO:tasks.workunit.client.0.smithi099.stdout:7/886: mkdir d6/d32/d3d/d4b/d12b 0 2024-01-31T05:13:24.454 INFO:tasks.workunit.client.0.smithi099.stdout:1/779: dwrite d4/db/d12/dc0/d4b/d50/fc9 [0,4194304] 0 2024-01-31T05:13:24.455 INFO:tasks.workunit.client.0.smithi099.stdout:1/780: truncate d4/dc/d15/fb1 927845 0 2024-01-31T05:13:24.455 INFO:tasks.workunit.client.0.smithi099.stdout:7/887: unlink d6/d98/fd1 0 2024-01-31T05:13:24.455 INFO:tasks.workunit.client.0.smithi099.stdout:7/888: fsync d6/d32/d3d/d4b/d33/d37/d50/d25/d7a/fa3 0 2024-01-31T05:13:24.455 INFO:tasks.workunit.client.0.smithi099.stdout:7/889: chown d6/d32/d3d/d4b/d33/d37/d4e/f55 7 1 2024-01-31T05:13:24.456 INFO:tasks.workunit.client.0.smithi099.stdout:2/843: dwrite d10/d2b/de6/ffc [0,4194304] 0 2024-01-31T05:13:24.457 INFO:tasks.workunit.client.0.smithi099.stdout:2/844: dread - d10/d51/fe1 zero size 2024-01-31T05:13:24.457 INFO:tasks.workunit.client.0.smithi099.stdout:1/781: rename d4/dc/d55 to d4/df9 0 2024-01-31T05:13:24.467 INFO:tasks.workunit.client.0.smithi099.stdout:0/864: sync 2024-01-31T05:13:24.469 INFO:tasks.workunit.client.0.smithi099.stdout:0/865: rename d1/f80 to d1/d37/d4a/d6f/f12d 0 2024-01-31T05:13:24.471 INFO:tasks.workunit.client.0.smithi099.stdout:1/782: dread d4/dc/d48/f8c [0,4194304] 0 2024-01-31T05:13:24.478 INFO:tasks.workunit.client.0.smithi099.stdout:7/890: dwrite d6/d32/d3d/d4b/d33/d37/d50/d25/d72/d8e/f96 [0,4194304] 0 2024-01-31T05:13:24.479 INFO:tasks.workunit.client.0.smithi099.stdout:2/845: write d10/d3a/d69/f8b [3390623,119362] 0 2024-01-31T05:13:24.480 INFO:tasks.workunit.client.0.smithi099.stdout:4/918: dwrite d0/d2/d4b/d93/d59/dff/d43/df9/f104 [0,4194304] 0 2024-01-31T05:13:24.480 INFO:tasks.workunit.client.0.smithi099.stdout:4/919: truncate d0/d1e/d61/fc3 4883500 0 2024-01-31T05:13:24.480 INFO:tasks.workunit.client.0.smithi099.stdout:4/920: readlink d0/d2/d4b/d93/d86/lae 0 2024-01-31T05:13:24.480 INFO:tasks.workunit.client.0.smithi099.stdout:7/891: rename d6/d32/d3d/d4b/d9b/fc7 to d6/d32/d3d/d4b/d9b/d124/f12c 0 2024-01-31T05:13:24.480 INFO:tasks.workunit.client.0.smithi099.stdout:7/892: write d6/d32/d3d/d4b/d33/d37/d50/d25/f2b [582825,12702] 0 2024-01-31T05:13:24.480 INFO:tasks.workunit.client.0.smithi099.stdout:7/893: dread - d6/d32/d3d/d4b/d33/d37/f105 zero size 2024-01-31T05:13:24.481 INFO:tasks.workunit.client.0.smithi099.stdout:7/894: chown d6/d32/d3d/d4b/d33/d37/d50/d5e/d107/c129 153221016 1 2024-01-31T05:13:24.481 INFO:tasks.workunit.client.0.smithi099.stdout:2/846: mkdir d10/d1b/d83/d86/d10b 0 2024-01-31T05:13:24.481 INFO:tasks.workunit.client.0.smithi099.stdout:7/895: symlink d6/d12/l12d 0 2024-01-31T05:13:24.482 INFO:tasks.workunit.client.0.smithi099.stdout:2/847: mknod d10/d3a/d94/c10c 0 2024-01-31T05:13:24.483 INFO:tasks.workunit.client.0.smithi099.stdout:7/896: mknod d6/d32/d3d/d4b/d33/d37/d50/d4d/c12e 0 2024-01-31T05:13:24.483 INFO:tasks.workunit.client.0.smithi099.stdout:0/866: dread d1/d56/d103/f3e [0,4194304] 0 2024-01-31T05:13:24.483 INFO:tasks.workunit.client.0.smithi099.stdout:7/897: rmdir d6/d98/de3 39 2024-01-31T05:13:24.484 INFO:tasks.workunit.client.0.smithi099.stdout:2/848: symlink d10/d1b/d7d/d7a/l10d 0 2024-01-31T05:13:24.485 INFO:tasks.workunit.client.0.smithi099.stdout:0/867: creat d1/f12e x:0 0 0 2024-01-31T05:13:24.485 INFO:tasks.workunit.client.0.smithi099.stdout:0/868: fdatasync d1/d30/d45/d66/d97/fe1 0 2024-01-31T05:13:24.486 INFO:tasks.workunit.client.0.smithi099.stdout:7/898: mkdir d6/d32/d12f 0 2024-01-31T05:13:24.487 INFO:tasks.workunit.client.0.smithi099.stdout:2/849: creat d10/f10e x:0 0 0 2024-01-31T05:13:24.488 INFO:tasks.workunit.client.0.smithi099.stdout:0/869: unlink d1/c27 0 2024-01-31T05:13:24.489 INFO:tasks.workunit.client.0.smithi099.stdout:0/870: creat d1/d37/d4a/d6f/def/f12f x:0 0 0 2024-01-31T05:13:24.490 INFO:tasks.workunit.client.0.smithi099.stdout:0/871: stat d1/d37/d4a/d6f 0 2024-01-31T05:13:24.490 INFO:tasks.workunit.client.0.smithi099.stdout:0/872: write d1/d30/d45/f111 [875744,14564] 0 2024-01-31T05:13:24.494 INFO:tasks.workunit.client.0.smithi099.stdout:2/850: dread d10/d3a/f4f [0,4194304] 0 2024-01-31T05:13:24.498 INFO:tasks.workunit.client.0.smithi099.stdout:7/899: read d6/d32/d3d/f4a [573003,10122] 0 2024-01-31T05:13:24.502 INFO:tasks.workunit.client.0.smithi099.stdout:4/921: link d0/d2/d4b/d93/d17/d3d/c4e d0/d2/d4b/d93/d17/d105/c138 0 2024-01-31T05:13:24.502 INFO:tasks.workunit.client.0.smithi099.stdout:4/922: creat d0/d8/d19/d99/d9e/f139 x:0 0 0 2024-01-31T05:13:24.503 INFO:tasks.workunit.client.0.smithi099.stdout:7/900: write d6/d32/d3d/d4b/d33/d37/f94 [1316938,82976] 0 2024-01-31T05:13:24.508 INFO:tasks.workunit.client.0.smithi099.stdout:2/851: dread d10/f15 [0,4194304] 0 2024-01-31T05:13:24.508 INFO:tasks.workunit.client.0.smithi099.stdout:2/852: creat d10/d1b/d83/d86/f10f x:0 0 0 2024-01-31T05:13:24.509 INFO:tasks.workunit.client.0.smithi099.stdout:2/853: truncate d10/d20/f4c 3625126 0 2024-01-31T05:13:24.512 INFO:tasks.workunit.client.0.smithi099.stdout:2/854: rmdir d10/d1b/d7d/d7a/dd6 0 2024-01-31T05:13:24.512 INFO:tasks.workunit.client.0.smithi099.stdout:0/873: dwrite d1/d56/d103/d8b/fa9 [0,4194304] 0 2024-01-31T05:13:24.513 INFO:tasks.workunit.client.0.smithi099.stdout:4/923: dread d0/d2/d4b/d93/d86/db4/f6c [0,4194304] 0 2024-01-31T05:13:24.513 INFO:tasks.workunit.client.0.smithi099.stdout:4/924: truncate d0/d2/d4b/d93/d59/dff/d43/f128 641271 0 2024-01-31T05:13:24.513 INFO:tasks.workunit.client.0.smithi099.stdout:2/855: mknod d10/d51/c110 0 2024-01-31T05:13:24.513 INFO:tasks.workunit.client.0.smithi099.stdout:2/856: dread - d10/d2b/d58/dc3/dcd/fed zero size 2024-01-31T05:13:24.514 INFO:tasks.workunit.client.0.smithi099.stdout:2/857: symlink d10/d20/dd0/l111 0 2024-01-31T05:13:24.515 INFO:tasks.workunit.client.0.smithi099.stdout:0/874: symlink d1/d37/d73/db7/dc5/l130 0 2024-01-31T05:13:24.516 INFO:tasks.workunit.client.0.smithi099.stdout:0/875: getdents d1/d37/d4a 0 2024-01-31T05:13:24.517 INFO:tasks.workunit.client.0.smithi099.stdout:0/876: symlink d1/d37/d73/db7/dc5/l131 0 2024-01-31T05:13:24.519 INFO:tasks.workunit.client.0.smithi099.stdout:0/877: unlink d1/d56/la6 0 2024-01-31T05:13:24.519 INFO:tasks.workunit.client.0.smithi099.stdout:2/858: dread d10/d1b/f81 [0,4194304] 0 2024-01-31T05:13:24.519 INFO:tasks.workunit.client.0.smithi099.stdout:2/859: chown d10/d20/l61 1 1 2024-01-31T05:13:24.520 INFO:tasks.workunit.client.0.smithi099.stdout:0/878: symlink d1/d8/l132 0 2024-01-31T05:13:24.520 INFO:tasks.workunit.client.0.smithi099.stdout:0/879: creat d1/d37/d4a/d7a/f133 x:0 0 0 2024-01-31T05:13:24.520 INFO:tasks.workunit.client.0.smithi099.stdout:2/860: dread - d10/d2b/fb2 zero size 2024-01-31T05:13:24.522 INFO:tasks.workunit.client.0.smithi099.stdout:0/880: mkdir d1/d37/d4a/d7a/d9d/d134 0 2024-01-31T05:13:24.525 INFO:tasks.workunit.client.0.smithi099.stdout:0/881: dread d1/d37/d73/ffb [0,4194304] 0 2024-01-31T05:13:24.527 INFO:tasks.workunit.client.0.smithi099.stdout:0/882: getdents d1/d37/d4a/d7b 0 2024-01-31T05:13:24.527 INFO:tasks.workunit.client.0.smithi099.stdout:0/883: write d1/d37/d4a/d6f/dc9/dcf/ff6 [140281,120059] 0 2024-01-31T05:13:24.528 INFO:tasks.workunit.client.0.smithi099.stdout:0/884: chown d1/d30/d45/f111 60 1 2024-01-31T05:13:24.529 INFO:tasks.workunit.client.0.smithi099.stdout:7/901: dwrite d6/d32/d3d/de6/df1/ff5 [0,4194304] 0 2024-01-31T05:13:24.530 INFO:tasks.workunit.client.0.smithi099.stdout:0/885: rmdir d1/d37/d4a/d7a/d9d/d134 0 2024-01-31T05:13:24.530 INFO:tasks.workunit.client.0.smithi099.stdout:0/886: readlink d1/d37/d4a/d7a/l43 0 2024-01-31T05:13:24.530 INFO:tasks.workunit.client.0.smithi099.stdout:0/887: truncate d1/d64/f127 789799 0 2024-01-31T05:13:24.530 INFO:tasks.workunit.client.0.smithi099.stdout:0/888: read d1/d64/f127 [163331,94704] 0 2024-01-31T05:13:24.536 INFO:tasks.workunit.client.0.smithi099.stdout:4/925: dwrite d0/d2/d4b/d93/d86/f112 [0,4194304] 0 2024-01-31T05:13:24.540 INFO:tasks.workunit.client.0.smithi099.stdout:4/926: mkdir d0/d2/d4b/d93/d17/d7d/db2/d13a 0 2024-01-31T05:13:24.541 INFO:tasks.workunit.client.0.smithi099.stdout:4/927: chown d0/d2/d4b/d93/d59/d8f/dd6/ddb/ldc 1 1 2024-01-31T05:13:24.548 INFO:tasks.workunit.client.0.smithi099.stdout:2/861: dwrite d10/f10e [0,4194304] 0 2024-01-31T05:13:24.548 INFO:tasks.workunit.client.0.smithi099.stdout:2/862: truncate d10/d51/fe1 448350 0 2024-01-31T05:13:24.548 INFO:tasks.workunit.client.0.smithi099.stdout:2/863: chown d10/d2b/d7c/c9f 178295 1 2024-01-31T05:13:24.550 INFO:tasks.workunit.client.0.smithi099.stdout:5/808: sync 2024-01-31T05:13:24.550 INFO:tasks.workunit.client.0.smithi099.stdout:5/809: write d6/f18 [3421745,82860] 0 2024-01-31T05:13:24.552 INFO:tasks.workunit.client.0.smithi099.stdout:5/810: link d6/da/d14/d2b/l67 d6/da/d14/d3d/d8c/dce/l10b 0 2024-01-31T05:13:24.552 INFO:tasks.workunit.client.0.smithi099.stdout:2/864: rename d10/d1b/d83/ceb to d10/d1b/d83/d86/d10b/c112 0 2024-01-31T05:13:24.553 INFO:tasks.workunit.client.0.smithi099.stdout:5/811: symlink d6/da/d3f/l10c 0 2024-01-31T05:13:24.554 INFO:tasks.workunit.client.0.smithi099.stdout:0/889: dwrite d1/fdb [0,4194304] 0 2024-01-31T05:13:24.554 INFO:tasks.workunit.client.0.smithi099.stdout:0/890: stat d1/d37/d4a/d7a/d7d/fa0 0 2024-01-31T05:13:24.555 INFO:tasks.workunit.client.0.smithi099.stdout:2/865: unlink d10/c66 0 2024-01-31T05:13:24.555 INFO:tasks.workunit.client.0.smithi099.stdout:5/812: mkdir d6/da/d14/d3d/d8c/d10d 0 2024-01-31T05:13:24.558 INFO:tasks.workunit.client.0.smithi099.stdout:5/813: link d6/da/d14/d3d/d8c/dce/l10b d6/da/d14/d61/d98/da0/dd0/l10e 0 2024-01-31T05:13:24.559 INFO:tasks.workunit.client.0.smithi099.stdout:5/814: creat d6/da/d14/d3d/d51/dae/db0/f10f x:0 0 0 2024-01-31T05:13:24.567 INFO:tasks.workunit.client.0.smithi099.stdout:5/815: dread d6/da/d14/d61/d98/fbc [0,4194304] 0 2024-01-31T05:13:24.567 INFO:tasks.workunit.client.0.smithi099.stdout:5/816: readlink d6/da/d14/d3d/d8c/de6/la9 0 2024-01-31T05:13:24.569 INFO:tasks.workunit.client.0.smithi099.stdout:2/866: read d10/d1c/f2d [4335920,108706] 0 2024-01-31T05:13:24.569 INFO:tasks.workunit.client.0.smithi099.stdout:2/867: truncate d10/d2b/d58/f5f 1515125 0 2024-01-31T05:13:24.569 INFO:tasks.workunit.client.0.smithi099.stdout:2/868: fdatasync d10/d20/dd0/ffd 0 2024-01-31T05:13:24.570 INFO:tasks.workunit.client.0.smithi099.stdout:7/902: dwrite d6/d32/d3d/d4b/d33/d37/d50/d25/d72/d8e/f96 [4194304,4194304] 0 2024-01-31T05:13:24.570 INFO:tasks.workunit.client.0.smithi099.stdout:7/903: stat d6/d32/d3d/d4b/d33/d37/d50/d5e/de8/l61 0 2024-01-31T05:13:24.570 INFO:tasks.workunit.client.0.smithi099.stdout:7/904: write d6/d32/d3d/d4b/d33/d37/d50/ff6 [1033669,59524] 0 2024-01-31T05:13:24.570 INFO:tasks.workunit.client.0.smithi099.stdout:4/928: dwrite d0/d2/d4b/d93/d17/d7d/db2/dc7/dcc/fd7 [0,4194304] 0 2024-01-31T05:13:24.572 INFO:tasks.workunit.client.0.smithi099.stdout:7/905: creat d6/f130 x:0 0 0 2024-01-31T05:13:24.573 INFO:tasks.workunit.client.0.smithi099.stdout:2/869: dread d10/d2b/d58/f5f [0,4194304] 0 2024-01-31T05:13:24.574 INFO:tasks.workunit.client.0.smithi099.stdout:4/929: unlink d0/d2/d4b/d93/d17/de1/c101 0 2024-01-31T05:13:24.575 INFO:tasks.workunit.client.0.smithi099.stdout:7/906: link d6/d32/d3d/d4b/d33/d37/fa2 d6/d32/d12f/f131 0 2024-01-31T05:13:24.575 INFO:tasks.workunit.client.0.smithi099.stdout:0/891: dwrite d1/d8/f65 [4194304,4194304] 0 2024-01-31T05:13:24.575 INFO:tasks.workunit.client.0.smithi099.stdout:0/892: fsync d1/d37/d4a/d7b/f11d 0 2024-01-31T05:13:24.577 INFO:tasks.workunit.client.0.smithi099.stdout:7/907: fsync d6/d32/d3d/d4b/d33/d37/d50/ff6 0 2024-01-31T05:13:24.578 INFO:tasks.workunit.client.0.smithi099.stdout:2/870: symlink d10/d51/l113 0 2024-01-31T05:13:24.579 INFO:tasks.workunit.client.0.smithi099.stdout:2/871: fsync f1 0 2024-01-31T05:13:24.581 INFO:tasks.workunit.client.0.smithi099.stdout:5/817: dread d6/da/d14/d61/fe9 [0,4194304] 0 2024-01-31T05:13:24.582 INFO:tasks.workunit.client.0.smithi099.stdout:5/818: chown d6/da/c39 1529739 1 2024-01-31T05:13:24.582 INFO:tasks.workunit.client.0.smithi099.stdout:5/819: readlink d6/da/d14/d61/d98/d106/l71 0 2024-01-31T05:13:24.583 INFO:tasks.workunit.client.0.smithi099.stdout:4/930: write d0/d2/d4b/d93/d59/dff/d43/df9/f104 [4091433,8944] 0 2024-01-31T05:13:24.584 INFO:tasks.workunit.client.0.smithi099.stdout:4/931: creat d0/d8/d19/d99/d9e/f13b x:0 0 0 2024-01-31T05:13:24.585 INFO:tasks.workunit.client.0.smithi099.stdout:0/893: creat d1/d37/d4a/d7a/d7d/f135 x:0 0 0 2024-01-31T05:13:24.586 INFO:tasks.workunit.client.0.smithi099.stdout:7/908: creat d6/d32/d3d/d4b/d33/d37/d50/d25/d72/d8e/df7/f132 x:0 0 0 2024-01-31T05:13:24.588 INFO:tasks.workunit.client.0.smithi099.stdout:2/872: symlink d10/d2b/d97/l114 0 2024-01-31T05:13:24.589 INFO:tasks.workunit.client.0.smithi099.stdout:2/873: fdatasync d10/d2b/d58/fb1 0 2024-01-31T05:13:24.590 INFO:tasks.workunit.client.0.smithi099.stdout:5/820: rename d6/da/d14/d3d/d6e/c90 to d6/da/d3f/d73/de4/c110 0 2024-01-31T05:13:24.592 INFO:tasks.workunit.client.0.smithi099.stdout:0/894: link d1/d64/f7f d1/d37/d73/f136 0 2024-01-31T05:13:24.593 INFO:tasks.workunit.client.0.smithi099.stdout:7/909: mkdir d6/d32/d3d/d4b/d33/d37/d50/d4d/dad/daf/d133 0 2024-01-31T05:13:24.595 INFO:tasks.workunit.client.0.smithi099.stdout:5/821: creat d6/da/d14/d3d/d57/d92/f111 x:0 0 0 2024-01-31T05:13:24.596 INFO:tasks.workunit.client.0.smithi099.stdout:9/851: sync 2024-01-31T05:13:24.597 INFO:tasks.workunit.client.0.smithi099.stdout:0/895: rmdir d1/d64/ded 39 2024-01-31T05:13:24.597 INFO:tasks.workunit.client.0.smithi099.stdout:0/896: chown d1/d37/d4a/d7a/c5c 2 1 2024-01-31T05:13:24.598 INFO:tasks.workunit.client.0.smithi099.stdout:0/897: fsync d1/f8f 0 2024-01-31T05:13:24.598 INFO:tasks.workunit.client.0.smithi099.stdout:8/912: sync 2024-01-31T05:13:24.599 INFO:tasks.workunit.client.0.smithi099.stdout:8/913: creat d1/dd/d65/d7f/d81/dc7/f129 x:0 0 0 2024-01-31T05:13:24.609 INFO:tasks.workunit.client.0.smithi099.stdout:5/822: write d6/ff [195825,90903] 0 2024-01-31T05:13:24.611 INFO:tasks.workunit.client.0.smithi099.stdout:5/823: rename d6/da/d14/d3d/d8c/dce/l10b to d6/da/d14/d61/def/l112 0 2024-01-31T05:13:24.614 INFO:tasks.workunit.client.0.smithi099.stdout:5/824: mknod d6/da/d14/de7/df7/c113 0 2024-01-31T05:13:24.614 INFO:tasks.workunit.client.0.smithi099.stdout:5/825: truncate d6/da/d14/d61/def/df4/fff 755123 0 2024-01-31T05:13:24.614 INFO:tasks.workunit.client.0.smithi099.stdout:5/826: write d6/da/d3f/f63 [2320836,48229] 0 2024-01-31T05:13:24.614 INFO:tasks.workunit.client.0.smithi099.stdout:5/827: write d6/da/d14/d3d/d57/d92/f111 [902525,75483] 0 2024-01-31T05:13:24.614 INFO:tasks.workunit.client.0.smithi099.stdout:8/914: read d1/dd/dba/d29/d3f/d56/d57/f96 [2244838,83139] 0 2024-01-31T05:13:24.616 INFO:tasks.workunit.client.0.smithi099.stdout:5/828: rename d6/da/d3f/d73/l7f to d6/da/d14/d61/d98/da0/dd0/l114 0 2024-01-31T05:13:24.616 INFO:tasks.workunit.client.0.smithi099.stdout:5/829: dread - d6/da/d3f/fc9 zero size 2024-01-31T05:13:24.617 INFO:tasks.workunit.client.0.smithi099.stdout:8/915: symlink d1/dd/dba/l12a 0 2024-01-31T05:13:24.618 INFO:tasks.workunit.client.0.smithi099.stdout:8/916: mkdir d1/dd/dba/da9/d12b 0 2024-01-31T05:13:24.620 INFO:tasks.workunit.client.0.smithi099.stdout:8/917: mknod d1/dd/dba/d29/d3f/d56/d57/c12c 0 2024-01-31T05:13:24.620 INFO:tasks.workunit.client.0.smithi099.stdout:8/918: fsync d1/dd/dba/d19/dbd/f11a 0 2024-01-31T05:13:24.620 INFO:tasks.workunit.client.0.smithi099.stdout:4/932: dwrite d0/d1e/d61/f129 [0,4194304] 0 2024-01-31T05:13:24.621 INFO:tasks.workunit.client.0.smithi099.stdout:4/933: truncate d0/d2/d4b/d93/f10f 572059 0 2024-01-31T05:13:24.621 INFO:tasks.workunit.client.0.smithi099.stdout:4/934: dread - d0/d8/d19/d65/ffb zero size 2024-01-31T05:13:24.624 INFO:tasks.workunit.client.0.smithi099.stdout:8/919: dread d1/dd/dba/d29/d3f/fb3 [0,4194304] 0 2024-01-31T05:13:24.624 INFO:tasks.workunit.client.0.smithi099.stdout:8/920: stat d1/dd/ff 0 2024-01-31T05:13:24.624 INFO:tasks.workunit.client.0.smithi099.stdout:8/921: fsync d1/dd/d4f/f114 0 2024-01-31T05:13:24.625 INFO:tasks.workunit.client.0.smithi099.stdout:8/922: truncate d1/dd/dba/d29/d3f/d56/fc2 3967430 0 2024-01-31T05:13:24.625 INFO:tasks.workunit.client.0.smithi099.stdout:8/923: chown d1/dd/dba/d29/d3f/d56/da0/d2e/de1 59717178 1 2024-01-31T05:13:24.625 INFO:tasks.workunit.client.0.smithi099.stdout:8/924: fdatasync d1/dd/dba/d29/f58 0 2024-01-31T05:13:24.626 INFO:tasks.workunit.client.0.smithi099.stdout:8/925: symlink d1/dd/dba/da9/d104/l12d 0 2024-01-31T05:13:24.627 INFO:tasks.workunit.client.0.smithi099.stdout:9/852: dwrite d0/d7/da6/ff1 [0,4194304] 0 2024-01-31T05:13:24.627 INFO:tasks.workunit.client.0.smithi099.stdout:2/874: dwrite d10/f11 [0,4194304] 0 2024-01-31T05:13:24.628 INFO:tasks.workunit.client.0.smithi099.stdout:0/898: dwrite d1/d30/d45/d66/f15 [0,4194304] 0 2024-01-31T05:13:24.630 INFO:tasks.workunit.client.0.smithi099.stdout:8/926: dread d1/dd/d1d/f102 [0,4194304] 0 2024-01-31T05:13:24.635 INFO:tasks.workunit.client.0.smithi099.stdout:2/875: symlink d10/d51/l115 0 2024-01-31T05:13:24.636 INFO:tasks.workunit.client.0.smithi099.stdout:8/927: mknod d1/dd/d4f/d51/c12e 0 2024-01-31T05:13:24.637 INFO:tasks.workunit.client.0.smithi099.stdout:2/876: link d10/d1b/l27 d10/d1b/d7d/d7a/dad/l116 0 2024-01-31T05:13:24.639 INFO:tasks.workunit.client.0.smithi099.stdout:8/928: symlink d1/dd/dba/l12f 0 2024-01-31T05:13:24.639 INFO:tasks.workunit.client.0.smithi099.stdout:8/929: chown d1/dd/d4f/dcd/c122 0 1 2024-01-31T05:13:24.639 INFO:tasks.workunit.client.0.smithi099.stdout:8/930: chown d1/dd/d65/l72 22565392 1 2024-01-31T05:13:24.639 INFO:tasks.workunit.client.0.smithi099.stdout:2/877: creat d10/d1b/d4d/d5a/f117 x:0 0 0 2024-01-31T05:13:24.639 INFO:tasks.workunit.client.0.smithi099.stdout:2/878: stat d10/d1c/d43/l44 0 2024-01-31T05:13:24.645 INFO:tasks.workunit.client.0.smithi099.stdout:8/931: symlink d1/dd/dba/da9/d104/l130 0 2024-01-31T05:13:24.645 INFO:tasks.workunit.client.0.smithi099.stdout:2/879: unlink d10/d2b/d58/dc3/dcd/fed 0 2024-01-31T05:13:24.645 INFO:tasks.workunit.client.0.smithi099.stdout:2/880: mknod d10/d51/d8d/c118 0 2024-01-31T05:13:24.645 INFO:tasks.workunit.client.0.smithi099.stdout:2/881: stat d10/d1c/d43/db8/fc1 0 2024-01-31T05:13:24.645 INFO:tasks.workunit.client.0.smithi099.stdout:2/882: creat d10/d1b/d4d/d5a/f119 x:0 0 0 2024-01-31T05:13:24.648 INFO:tasks.workunit.client.0.smithi099.stdout:8/932: dread d1/f7 [0,4194304] 0 2024-01-31T05:13:24.652 INFO:tasks.workunit.client.0.smithi099.stdout:5/830: dwrite d6/f6d [0,4194304] 0 2024-01-31T05:13:24.652 INFO:tasks.workunit.client.0.smithi099.stdout:4/935: dwrite d0/d2/d4b/d93/d59/dff/db9/f11c [0,4194304] 0 2024-01-31T05:13:24.654 INFO:tasks.workunit.client.0.smithi099.stdout:8/933: dread d1/dd/dba/d19/f53 [0,4194304] 0 2024-01-31T05:13:24.655 INFO:tasks.workunit.client.0.smithi099.stdout:5/831: symlink d6/da/d14/d61/d98/d106/d81/l115 0 2024-01-31T05:13:24.655 INFO:tasks.workunit.client.0.smithi099.stdout:5/832: write d6/fcd [2477107,82089] 0 2024-01-31T05:13:24.657 INFO:tasks.workunit.client.0.smithi099.stdout:2/883: write d10/d20/f89 [3916496,89469] 0 2024-01-31T05:13:24.662 INFO:tasks.workunit.client.0.smithi099.stdout:4/936: truncate d0/d8/d19/d98/d9b/dab/f6b 2563828 0 2024-01-31T05:13:24.662 INFO:tasks.workunit.client.0.smithi099.stdout:4/937: write d0/d2/d4b/d93/d86/d8d/f107 [796101,114699] 0 2024-01-31T05:13:24.662 INFO:tasks.workunit.client.0.smithi099.stdout:0/899: dwrite d1/d37/d4a/d7a/d7d/f135 [0,4194304] 0 2024-01-31T05:13:24.662 INFO:tasks.workunit.client.0.smithi099.stdout:1/783: sync 2024-01-31T05:13:24.662 INFO:tasks.workunit.client.0.smithi099.stdout:3/865: sync 2024-01-31T05:13:24.662 INFO:tasks.workunit.client.0.smithi099.stdout:6/716: sync 2024-01-31T05:13:24.662 INFO:tasks.workunit.client.0.smithi099.stdout:5/833: mkdir d6/da/d14/d3d/d51/d82/d9a/d116 0 2024-01-31T05:13:24.663 INFO:tasks.workunit.client.0.smithi099.stdout:1/784: mknod d4/dc/d4d/d5d/d87/d56/d83/cfa 0 2024-01-31T05:13:24.666 INFO:tasks.workunit.client.0.smithi099.stdout:0/900: creat d1/d37/d73/dbc/f137 x:0 0 0 2024-01-31T05:13:24.666 INFO:tasks.workunit.client.0.smithi099.stdout:6/717: mkdir d14/d18/d9d/de6 0 2024-01-31T05:13:24.668 INFO:tasks.workunit.client.0.smithi099.stdout:3/866: link d10/d27/d125/l12e d10/d32/l134 0 2024-01-31T05:13:24.668 INFO:tasks.workunit.client.0.smithi099.stdout:3/867: write d10/d27/d34/fdf [64060,67059] 0 2024-01-31T05:13:24.668 INFO:tasks.workunit.client.0.smithi099.stdout:3/868: creat d10/d32/d33/d51/f135 x:0 0 0 2024-01-31T05:13:24.670 INFO:tasks.workunit.client.0.smithi099.stdout:5/834: mknod d6/da/d14/d94/c117 0 2024-01-31T05:13:24.670 INFO:tasks.workunit.client.0.smithi099.stdout:5/835: chown d6/da/d14/d3d/d6e/l5e 53919 1 2024-01-31T05:13:24.671 INFO:tasks.workunit.client.0.smithi099.stdout:2/884: dread d10/d1c/fa3 [0,4194304] 0 2024-01-31T05:13:24.671 INFO:tasks.workunit.client.0.smithi099.stdout:2/885: readlink d10/d1b/d9b/lda 0 2024-01-31T05:13:24.672 INFO:tasks.workunit.client.0.smithi099.stdout:1/785: creat d4/db/d12/dc0/ffb x:0 0 0 2024-01-31T05:13:24.674 INFO:tasks.workunit.client.0.smithi099.stdout:6/718: unlink d14/d18/d52/f67 0 2024-01-31T05:13:24.674 INFO:tasks.workunit.client.0.smithi099.stdout:6/719: stat d14/d18/d52/d22/f80 0 2024-01-31T05:13:24.674 INFO:tasks.workunit.client.0.smithi099.stdout:6/720: write d14/d18/d52/fd6 [966228,50536] 0 2024-01-31T05:13:24.676 INFO:tasks.workunit.client.0.smithi099.stdout:4/938: write d0/d2/d4b/d93/d59/d8f/dd6/ddb/fde [3452024,33557] 0 2024-01-31T05:13:24.676 INFO:tasks.workunit.client.0.smithi099.stdout:8/934: dwrite d1/dd/dba/d29/d3f/d56/f88 [0,4194304] 0 2024-01-31T05:13:24.676 INFO:tasks.workunit.client.0.smithi099.stdout:8/935: read d1/dd/dba/d20/f4b [1788160,90004] 0 2024-01-31T05:13:24.676 INFO:tasks.workunit.client.0.smithi099.stdout:8/936: write d1/dd/d7b/d85/fbb [2172558,10372] 0 2024-01-31T05:13:24.677 INFO:tasks.workunit.client.0.smithi099.stdout:4/939: creat d0/d2/d4b/d93/d17/d7d/db2/d13a/f13c x:0 0 0 2024-01-31T05:13:24.680 INFO:tasks.workunit.client.0.smithi099.stdout:0/901: link d1/d37/d4a/d6f/dc9/dcf/ld0 d1/l138 0 2024-01-31T05:13:24.680 INFO:tasks.workunit.client.0.smithi099.stdout:3/869: stat d10/d27/d89/l100 0 2024-01-31T05:13:24.681 INFO:tasks.workunit.client.0.smithi099.stdout:5/836: link d6/da/d14/fb3 d6/da/d14/d3d/d51/d82/d9a/d116/f118 0 2024-01-31T05:13:24.681 INFO:tasks.workunit.client.0.smithi099.stdout:5/837: dread - d6/da/d14/d2b/d9e/f10a zero size 2024-01-31T05:13:24.684 INFO:tasks.workunit.client.0.smithi099.stdout:4/940: rename d0/d2/d20/d84/c130 to d0/d8/d19/d99/d118/c13d 0 2024-01-31T05:13:24.686 INFO:tasks.workunit.client.0.smithi099.stdout:3/870: link d10/d24/d40/d81/fb7 d10/d32/d85/da3/f136 0 2024-01-31T05:13:24.688 INFO:tasks.workunit.client.0.smithi099.stdout:3/871: creat d10/d32/d85/da3/de7/f137 x:0 0 0 2024-01-31T05:13:24.689 INFO:tasks.workunit.client.0.smithi099.stdout:5/838: rmdir d6/da/d14/d3d 39 2024-01-31T05:13:24.689 INFO:tasks.workunit.client.0.smithi099.stdout:5/839: write d6/da/f56 [599553,63970] 0 2024-01-31T05:13:24.690 INFO:tasks.workunit.client.0.smithi099.stdout:3/872: creat d10/d27/d34/d44/d60/d75/d8c/db1/d128/f138 x:0 0 0 2024-01-31T05:13:24.690 INFO:tasks.workunit.client.0.smithi099.stdout:8/937: write d1/dd/dba/d29/d3f/d56/d57/f89 [7398670,53342] 0 2024-01-31T05:13:24.691 INFO:tasks.workunit.client.0.smithi099.stdout:5/840: mkdir d6/da/d14/d3d/d57/d92/d119 0 2024-01-31T05:13:24.691 INFO:tasks.workunit.client.0.smithi099.stdout:5/841: chown d6/da/d14/d3d/d51/c79 0 1 2024-01-31T05:13:24.691 INFO:tasks.workunit.client.0.smithi099.stdout:5/842: write d6/da/d14/d3d/d51/d82/f43 [2260909,81659] 0 2024-01-31T05:13:24.693 INFO:tasks.workunit.client.0.smithi099.stdout:3/873: symlink d10/d32/d33/d51/l139 0 2024-01-31T05:13:24.693 INFO:tasks.workunit.client.0.smithi099.stdout:8/938: mknod d1/dd/dba/da9/d104/c131 0 2024-01-31T05:13:24.694 INFO:tasks.workunit.client.0.smithi099.stdout:5/843: symlink d6/da/d14/de7/df7/l11a 0 2024-01-31T05:13:24.694 INFO:tasks.workunit.client.0.smithi099.stdout:5/844: truncate d6/da/f4f 466273 0 2024-01-31T05:13:24.697 INFO:tasks.workunit.client.0.smithi099.stdout:3/874: symlink d10/d27/l13a 0 2024-01-31T05:13:24.697 INFO:tasks.workunit.client.0.smithi099.stdout:4/941: write d0/d2/d4b/d93/d17/d7d/db2/dc7/dcc/fd7 [3240587,35511] 0 2024-01-31T05:13:24.697 INFO:tasks.workunit.client.0.smithi099.stdout:4/942: fdatasync d0/d2/d4b/d93/d17/d7d/db2/d13a/f13c 0 2024-01-31T05:13:24.697 INFO:tasks.workunit.client.0.smithi099.stdout:3/875: truncate d10/d32/d85/d77/fdc 202351 0 2024-01-31T05:13:24.699 INFO:tasks.workunit.client.0.smithi099.stdout:4/943: creat d0/d2/d4b/d93/d59/dff/f13e x:0 0 0 2024-01-31T05:13:24.699 INFO:tasks.workunit.client.0.smithi099.stdout:4/944: write d0/d2/d4b/d93/d59/dff/fa6 [1244448,55617] 0 2024-01-31T05:13:24.699 INFO:tasks.workunit.client.0.smithi099.stdout:3/876: symlink d10/l13b 0 2024-01-31T05:13:24.700 INFO:tasks.workunit.client.0.smithi099.stdout:0/902: dread d1/d30/d45/dad/f94 [0,4194304] 0 2024-01-31T05:13:24.700 INFO:tasks.workunit.client.0.smithi099.stdout:3/877: mknod d10/d32/d33/c13c 0 2024-01-31T05:13:24.701 INFO:tasks.workunit.client.0.smithi099.stdout:0/903: unlink d1/d37/d4a/d6f/c84 0 2024-01-31T05:13:24.703 INFO:tasks.workunit.client.0.smithi099.stdout:6/721: dwrite d14/d18/d52/d22/fce [0,4194304] 0 2024-01-31T05:13:24.704 INFO:tasks.workunit.client.0.smithi099.stdout:0/904: creat d1/d37/d73/db7/f139 x:0 0 0 2024-01-31T05:13:24.704 INFO:tasks.workunit.client.0.smithi099.stdout:1/786: dwrite d4/db/d12/dc0/d4b/d50/d91/f99 [0,4194304] 0 2024-01-31T05:13:24.704 INFO:tasks.workunit.client.0.smithi099.stdout:0/905: rmdir d1/d37/d73/dbc/dfd 39 2024-01-31T05:13:24.705 INFO:tasks.workunit.client.0.smithi099.stdout:8/939: write d1/f5e [3413102,10084] 0 2024-01-31T05:13:24.705 INFO:tasks.workunit.client.0.smithi099.stdout:8/940: truncate d1/dd/d65/d7f/d81/dc7/fd1 560153 0 2024-01-31T05:13:24.706 INFO:tasks.workunit.client.0.smithi099.stdout:1/787: creat d4/dc/d15/ffc x:0 0 0 2024-01-31T05:13:24.706 INFO:tasks.workunit.client.0.smithi099.stdout:6/722: truncate d14/d18/d52/d7e/f37 940300 0 2024-01-31T05:13:24.707 INFO:tasks.workunit.client.0.smithi099.stdout:3/878: getdents d10/d32/d85/da3 0 2024-01-31T05:13:24.707 INFO:tasks.workunit.client.0.smithi099.stdout:3/879: chown d10/d32/d85/da3/de7/f137 53657 1 2024-01-31T05:13:24.709 INFO:tasks.workunit.client.0.smithi099.stdout:6/723: mknod d14/d18/d52/d7e/d1c/da6/dba/ce7 0 2024-01-31T05:13:24.709 INFO:tasks.workunit.client.0.smithi099.stdout:6/724: dread - d14/d18/d52/d7e/fc2 zero size 2024-01-31T05:13:24.712 INFO:tasks.workunit.client.0.smithi099.stdout:6/725: mkdir d14/d18/d52/dbc/de8 0 2024-01-31T05:13:24.712 INFO:tasks.workunit.client.0.smithi099.stdout:0/906: mknod d1/d30/d45/d66/c13a 0 2024-01-31T05:13:24.714 INFO:tasks.workunit.client.0.smithi099.stdout:1/788: rmdir d4 39 2024-01-31T05:13:24.715 INFO:tasks.workunit.client.0.smithi099.stdout:1/789: rmdir d4/db/d12/dc0/d4b/d9a/dc7 39 2024-01-31T05:13:24.716 INFO:tasks.workunit.client.0.smithi099.stdout:0/907: rmdir d1/d37/d4a/d7a/d129 0 2024-01-31T05:13:24.717 INFO:tasks.workunit.client.0.smithi099.stdout:8/941: dread d1/dd/dba/d29/d3f/d56/da0/f27 [0,4194304] 0 2024-01-31T05:13:24.717 INFO:tasks.workunit.client.0.smithi099.stdout:8/942: dread - d1/dd/dba/d29/d3f/d56/d57/ff2 zero size 2024-01-31T05:13:24.725 INFO:tasks.workunit.client.0.smithi099.stdout:0/908: dread d1/d30/d45/dad/f55 [0,4194304] 0 2024-01-31T05:13:24.725 INFO:tasks.workunit.client.0.smithi099.stdout:0/909: creat d1/d37/d4a/d7a/d7d/f13b x:0 0 0 2024-01-31T05:13:24.725 INFO:tasks.workunit.client.0.smithi099.stdout:0/910: write d1/d37/d4a/f9a [379987,32072] 0 2024-01-31T05:13:24.726 INFO:tasks.workunit.client.0.smithi099.stdout:6/726: write d14/d18/d52/f84 [3092783,7217] 0 2024-01-31T05:13:24.726 INFO:tasks.workunit.client.0.smithi099.stdout:6/727: chown d14/d18/d52/d7e/d1c/fad 54229849 1 2024-01-31T05:13:24.727 INFO:tasks.workunit.client.0.smithi099.stdout:6/728: mkdir d14/d18/d52/dbc/de8/de9 0 2024-01-31T05:13:24.727 INFO:tasks.workunit.client.0.smithi099.stdout:2/886: dwrite d10/d1c/f85 [0,4194304] 0 2024-01-31T05:13:24.728 INFO:tasks.workunit.client.0.smithi099.stdout:5/845: dwrite d6/f11 [4194304,4194304] 0 2024-01-31T05:13:24.729 INFO:tasks.workunit.client.0.smithi099.stdout:1/790: dread d4/df9/f95 [0,4194304] 0 2024-01-31T05:13:24.730 INFO:tasks.workunit.client.0.smithi099.stdout:6/729: symlink d14/d18/d52/d7e/d1c/d29/d43/lea 0 2024-01-31T05:13:24.730 INFO:tasks.workunit.client.0.smithi099.stdout:6/730: chown d14/d18/d52/d7e/ddd 1 1 2024-01-31T05:13:24.730 INFO:tasks.workunit.client.0.smithi099.stdout:0/911: dread - d1/d56/fcc zero size 2024-01-31T05:13:24.731 INFO:tasks.workunit.client.0.smithi099.stdout:3/880: dwrite d10/dfa/fca [0,4194304] 0 2024-01-31T05:13:24.731 INFO:tasks.workunit.client.0.smithi099.stdout:3/881: creat d10/d27/d89/f13d x:0 0 0 2024-01-31T05:13:24.731 INFO:tasks.workunit.client.0.smithi099.stdout:3/882: chown d10/d32/d33/c13c 1216 1 2024-01-31T05:13:24.733 INFO:tasks.workunit.client.0.smithi099.stdout:4/945: rename d0/d2/d20/d84/la2 to d0/d2/d4b/d93/d17/def/l13f 0 2024-01-31T05:13:24.733 INFO:tasks.workunit.client.0.smithi099.stdout:4/946: truncate d0/d2/d4b/d93/d17/f124 949239 0 2024-01-31T05:13:24.733 INFO:tasks.workunit.client.0.smithi099.stdout:0/912: dread d1/d37/d4a/d7a/f4b [0,4194304] 0 2024-01-31T05:13:24.739 INFO:tasks.workunit.client.0.smithi099.stdout:0/913: mkdir d1/d16/d13c 0 2024-01-31T05:13:24.742 INFO:tasks.workunit.client.0.smithi099.stdout:8/943: dwrite d1/dd/dba/d29/d3f/d56/fc2 [0,4194304] 0 2024-01-31T05:13:24.745 INFO:tasks.workunit.client.0.smithi099.stdout:3/883: read d10/d32/d33/d51/f67 [2660426,60815] 0 2024-01-31T05:13:24.745 INFO:tasks.workunit.client.0.smithi099.stdout:3/884: fdatasync d10/d27/d34/d44/d95/f8d 0 2024-01-31T05:13:24.751 INFO:tasks.workunit.client.0.smithi099.stdout:4/947: creat d0/d2/d4b/d93/d39/dcf/d127/f140 x:0 0 0 2024-01-31T05:13:24.751 INFO:tasks.workunit.client.0.smithi099.stdout:8/944: creat d1/dd/dba/d19/d21/f132 x:0 0 0 2024-01-31T05:13:24.751 INFO:tasks.workunit.client.0.smithi099.stdout:4/948: creat d0/d8/d19/d99/d9e/f141 x:0 0 0 2024-01-31T05:13:24.751 INFO:tasks.workunit.client.0.smithi099.stdout:0/914: mkdir d1/d37/d4a/d7b/d13d 0 2024-01-31T05:13:24.751 INFO:tasks.workunit.client.0.smithi099.stdout:4/949: write d0/d2/d4b/d93/d59/dff/f13e [812259,67789] 0 2024-01-31T05:13:24.751 INFO:tasks.workunit.client.0.smithi099.stdout:4/950: dread - d0/d2/d4b/d93/d17/d7d/db2/d13a/f13c zero size 2024-01-31T05:13:24.751 INFO:tasks.workunit.client.0.smithi099.stdout:0/915: write d1/d16/f50 [4697738,75631] 0 2024-01-31T05:13:24.752 INFO:tasks.workunit.client.0.smithi099.stdout:0/916: getdents d1/d37/d73/db7/dc5/d11a 0 2024-01-31T05:13:24.752 INFO:tasks.workunit.client.0.smithi099.stdout:0/917: chown d1/d37/d4a/d7a 354 1 2024-01-31T05:13:24.752 INFO:tasks.workunit.client.0.smithi099.stdout:7/910: sync 2024-01-31T05:13:24.753 INFO:tasks.workunit.client.0.smithi099.stdout:8/945: link d1/dd/d1d/f40 d1/dd/dba/da9/d12b/f133 0 2024-01-31T05:13:24.754 INFO:tasks.workunit.client.0.smithi099.stdout:9/853: sync 2024-01-31T05:13:24.757 INFO:tasks.workunit.client.0.smithi099.stdout:8/946: getdents d1 0 2024-01-31T05:13:24.758 INFO:tasks.workunit.client.0.smithi099.stdout:2/887: dwrite d10/d1b/d4d/f84 [0,4194304] 0 2024-01-31T05:13:24.758 INFO:tasks.workunit.client.0.smithi099.stdout:0/918: getdents d1/d64 0 2024-01-31T05:13:24.758 INFO:tasks.workunit.client.0.smithi099.stdout:0/919: chown d1/d37/d4a/d6f/f71 3874 1 2024-01-31T05:13:24.759 INFO:tasks.workunit.client.0.smithi099.stdout:2/888: write d10/d1b/f23 [4304682,62594] 0 2024-01-31T05:13:24.759 INFO:tasks.workunit.client.0.smithi099.stdout:2/889: dread - d10/d51/d8d/fe7 zero size 2024-01-31T05:13:24.760 INFO:tasks.workunit.client.0.smithi099.stdout:3/885: write d10/d27/d34/f68 [4006913,64005] 0 2024-01-31T05:13:24.760 INFO:tasks.workunit.client.0.smithi099.stdout:9/854: unlink d0/d7/fdd 0 2024-01-31T05:13:24.760 INFO:tasks.workunit.client.0.smithi099.stdout:9/855: truncate d0/d3e/d87/dc9/d24/d48/fff 1014462 0 2024-01-31T05:13:24.760 INFO:tasks.workunit.client.0.smithi099.stdout:9/856: creat d0/d3e/d87/dc9/d5e/ddb/f12c x:0 0 0 2024-01-31T05:13:24.762 INFO:tasks.workunit.client.0.smithi099.stdout:8/947: creat d1/dd/dba/d29/d3f/d56/da0/d2e/f134 x:0 0 0 2024-01-31T05:13:24.763 INFO:tasks.workunit.client.0.smithi099.stdout:4/951: dread d0/d2/d4b/d93/d59/dff/d43/fe3 [0,4194304] 0 2024-01-31T05:13:24.763 INFO:tasks.workunit.client.0.smithi099.stdout:0/920: link d1/d37/l40 d1/d37/d4a/d6f/l13e 0 2024-01-31T05:13:24.764 INFO:tasks.workunit.client.0.smithi099.stdout:4/952: getdents d0/d2/d4b/d93/d17/d7d/db2 0 2024-01-31T05:13:24.764 INFO:tasks.workunit.client.0.smithi099.stdout:4/953: write d0/d2/d4b/d93/d17/d7d/db2/dc7/dcc/f12f [352734,29744] 0 2024-01-31T05:13:24.764 INFO:tasks.workunit.client.0.smithi099.stdout:3/886: getdents d10/d27/d34/d50 0 2024-01-31T05:13:24.765 INFO:tasks.workunit.client.0.smithi099.stdout:4/954: truncate d0/d2/d4b/d93/d17/de1/d117/fc6 2528752 0 2024-01-31T05:13:24.765 INFO:tasks.workunit.client.0.smithi099.stdout:4/955: chown d0/d2/d4b/d93/d17/c29 16615998 1 2024-01-31T05:13:24.766 INFO:tasks.workunit.client.0.smithi099.stdout:5/846: dwrite d6/da/d14/d3d/d51/d82/ff5 [0,4194304] 0 2024-01-31T05:13:24.769 INFO:tasks.workunit.client.0.smithi099.stdout:8/948: creat d1/dd/dba/da9/d12b/f135 x:0 0 0 2024-01-31T05:13:24.769 INFO:tasks.workunit.client.0.smithi099.stdout:8/949: readlink d1/dd/dba/d29/d3f/la5 0 2024-01-31T05:13:24.769 INFO:tasks.workunit.client.0.smithi099.stdout:8/950: write d1/dd/dba/d19/fda [586583,44627] 0 2024-01-31T05:13:24.769 INFO:tasks.workunit.client.0.smithi099.stdout:8/951: dread - d1/dd/d4f/d51/d83/ffe zero size 2024-01-31T05:13:24.769 INFO:tasks.workunit.client.0.smithi099.stdout:8/952: stat d1/dd/d7b/d85/lab 0 2024-01-31T05:13:24.769 INFO:tasks.workunit.client.0.smithi099.stdout:0/921: rmdir d1/d37/d4a/d7b/d13d 0 2024-01-31T05:13:24.772 INFO:tasks.workunit.client.0.smithi099.stdout:3/887: unlink d10/dfa/d120/fe5 0 2024-01-31T05:13:24.772 INFO:tasks.workunit.client.0.smithi099.stdout:3/888: fdatasync d10/d24/f38 0 2024-01-31T05:13:24.773 INFO:tasks.workunit.client.0.smithi099.stdout:1/791: dwrite d4/dc/d48/f31 [0,4194304] 0 2024-01-31T05:13:24.774 INFO:tasks.workunit.client.0.smithi099.stdout:6/731: rename d14/d18/d52/d7e/d66/d99 to d14/d18/d52/d7e/d1c/d29/d79/deb 0 2024-01-31T05:13:24.775 INFO:tasks.workunit.client.0.smithi099.stdout:8/953: mknod d1/dd/dba/da9/d104/c136 0 2024-01-31T05:13:24.778 INFO:tasks.workunit.client.0.smithi099.stdout:9/857: dread d0/d3e/d87/dc9/d24/d2b/d63/da7/daa/fcc [0,4194304] 0 2024-01-31T05:13:24.782 INFO:tasks.workunit.client.0.smithi099.stdout:0/922: link d1/d37/d4a/d7a/l10c d1/d30/d45/d66/l13f 0 2024-01-31T05:13:24.783 INFO:tasks.workunit.client.0.smithi099.stdout:0/923: dread - d1/d37/d4a/d7a/d7d/f13b zero size 2024-01-31T05:13:24.783 INFO:tasks.workunit.client.0.smithi099.stdout:1/792: mknod d4/dc/d29/daa/cfd 0 2024-01-31T05:13:24.783 INFO:tasks.workunit.client.0.smithi099.stdout:1/793: write d4/dc/f88 [680041,94673] 0 2024-01-31T05:13:24.786 INFO:tasks.workunit.client.0.smithi099.stdout:7/911: rename d6/d32/d3d/d4b/d33/d37/d50/c89 to d6/d32/d3d/d4b/d33/d37/d50/d25/d7a/d104/c134 0 2024-01-31T05:13:24.788 INFO:tasks.workunit.client.0.smithi099.stdout:9/858: symlink d0/d3e/d87/dc9/d24/d2b/d63/da7/daa/l12d 0 2024-01-31T05:13:24.788 INFO:tasks.workunit.client.0.smithi099.stdout:9/859: chown d0/d3e/d87/dc9/l7d 24349 1 2024-01-31T05:13:24.788 INFO:tasks.workunit.client.0.smithi099.stdout:6/732: dread d14/f40 [0,4194304] 0 2024-01-31T05:13:24.788 INFO:tasks.workunit.client.0.smithi099.stdout:0/924: mkdir d1/d140 0 2024-01-31T05:13:24.790 INFO:tasks.workunit.client.0.smithi099.stdout:5/847: dwrite d6/da/d14/fdb [0,4194304] 0 2024-01-31T05:13:24.790 INFO:tasks.workunit.client.0.smithi099.stdout:5/848: creat d6/da/d14/d61/def/df4/f11b x:0 0 0 2024-01-31T05:13:24.790 INFO:tasks.workunit.client.0.smithi099.stdout:5/849: chown d6/da/d3f/d73 14987 1 2024-01-31T05:13:24.791 INFO:tasks.workunit.client.0.smithi099.stdout:1/794: mknod d4/db/d3a/d7e/d85/de8/cfe 0 2024-01-31T05:13:24.793 INFO:tasks.workunit.client.0.smithi099.stdout:2/890: rename d10/c1d to d10/d2b/d97/c11a 0 2024-01-31T05:13:24.794 INFO:tasks.workunit.client.0.smithi099.stdout:7/912: mkdir d6/d32/d3d/d4b/d33/d37/d50/d4d/dad/d135 0 2024-01-31T05:13:24.794 INFO:tasks.workunit.client.0.smithi099.stdout:7/913: fdatasync d6/d32/f5b 0 2024-01-31T05:13:24.796 INFO:tasks.workunit.client.0.smithi099.stdout:5/850: symlink d6/da/d3f/l11c 0 2024-01-31T05:13:24.796 INFO:tasks.workunit.client.0.smithi099.stdout:3/889: dwrite d10/d27/d34/f68 [0,4194304] 0 2024-01-31T05:13:24.797 INFO:tasks.workunit.client.0.smithi099.stdout:1/795: rmdir d4/dc/d4d/da5 39 2024-01-31T05:13:24.798 INFO:tasks.workunit.client.0.smithi099.stdout:9/860: rename d0/d3e/d87/dc9/d24/d2b/d63/da7/daa/d101 to d0/d7/d2e/d12e 0 2024-01-31T05:13:24.798 INFO:tasks.workunit.client.0.smithi099.stdout:9/861: truncate d0/d5d/f91 3730757 0 2024-01-31T05:13:24.799 INFO:tasks.workunit.client.0.smithi099.stdout:5/851: mkdir d6/da/d14/d61/d11d 0 2024-01-31T05:13:24.801 INFO:tasks.workunit.client.0.smithi099.stdout:3/890: creat d10/d1e/df2/d108/f13e x:0 0 0 2024-01-31T05:13:24.801 INFO:tasks.workunit.client.0.smithi099.stdout:0/925: dread d1/d30/d45/d66/f15 [0,4194304] 0 2024-01-31T05:13:24.804 INFO:tasks.workunit.client.0.smithi099.stdout:5/852: link d6/f6d d6/da/d14/d94/f11e 0 2024-01-31T05:13:24.804 INFO:tasks.workunit.client.0.smithi099.stdout:5/853: write d6/da/d14/d3d/d6e/f22 [4467860,70921] 0 2024-01-31T05:13:24.810 INFO:tasks.workunit.client.0.smithi099.stdout:2/891: dread d10/d1b/f73 [0,4194304] 0 2024-01-31T05:13:24.811 INFO:tasks.workunit.client.0.smithi099.stdout:2/892: symlink d10/d20/d5b/l11b 0 2024-01-31T05:13:24.811 INFO:tasks.workunit.client.0.smithi099.stdout:2/893: chown d10/d3a/d69/ld8 0 1 2024-01-31T05:13:24.812 INFO:tasks.workunit.client.0.smithi099.stdout:0/926: creat d1/d37/d4a/d7b/f141 x:0 0 0 2024-01-31T05:13:24.812 INFO:tasks.workunit.client.0.smithi099.stdout:1/796: getdents d4/dc/d44 0 2024-01-31T05:13:24.812 INFO:tasks.workunit.client.0.smithi099.stdout:0/927: dread - d1/d64/ded/dee/f11f zero size 2024-01-31T05:13:24.812 INFO:tasks.workunit.client.0.smithi099.stdout:0/928: dread - d1/d56/d103/f104 zero size 2024-01-31T05:13:24.813 INFO:tasks.workunit.client.0.smithi099.stdout:1/797: symlink d4/dc/d4d/d5d/d87/d56/lff 0 2024-01-31T05:13:24.813 INFO:tasks.workunit.client.0.smithi099.stdout:1/798: fsync d4/dc/d29/f46 0 2024-01-31T05:13:24.814 INFO:tasks.workunit.client.0.smithi099.stdout:6/733: rename d14/d18/d52/dbc/cd7 to d14/d18/d52/d7e/d1c/d29/d43/cec 0 2024-01-31T05:13:24.814 INFO:tasks.workunit.client.0.smithi099.stdout:0/929: symlink d1/d16/d13c/l142 0 2024-01-31T05:13:24.814 INFO:tasks.workunit.client.0.smithi099.stdout:6/734: creat d14/d18/d52/d7e/d1c/da6/fed x:0 0 0 2024-01-31T05:13:24.814 INFO:tasks.workunit.client.0.smithi099.stdout:0/930: write d1/d64/ded/dee/f11f [644166,100722] 0 2024-01-31T05:13:24.814 INFO:tasks.workunit.client.0.smithi099.stdout:0/931: chown d1/d37/d73/db7 89095 1 2024-01-31T05:13:24.816 INFO:tasks.workunit.client.0.smithi099.stdout:9/862: rename d0/d7/l3f to d0/d5d/db6/l12f 0 2024-01-31T05:13:24.817 INFO:tasks.workunit.client.0.smithi099.stdout:7/914: dread d6/d32/d3d/d4b/d33/f5a [0,4194304] 0 2024-01-31T05:13:24.817 INFO:tasks.workunit.client.0.smithi099.stdout:8/954: dwrite d1/dd/d65/d7f/d81/fb5 [0,4194304] 0 2024-01-31T05:13:24.817 INFO:tasks.workunit.client.0.smithi099.stdout:1/799: dread d4/dc/d48/fda [0,4194304] 0 2024-01-31T05:13:24.817 INFO:tasks.workunit.client.0.smithi099.stdout:1/800: write d4/f8d [4672395,125127] 0 2024-01-31T05:13:24.818 INFO:tasks.workunit.client.0.smithi099.stdout:3/891: read ff [3999667,83043] 0 2024-01-31T05:13:24.818 INFO:tasks.workunit.client.0.smithi099.stdout:3/892: truncate d10/d1e/f6c 50720 0 2024-01-31T05:13:24.818 INFO:tasks.workunit.client.0.smithi099.stdout:0/932: mknod d1/d37/c143 0 2024-01-31T05:13:24.818 INFO:tasks.workunit.client.0.smithi099.stdout:0/933: truncate d1/d8/dd6/f121 656213 0 2024-01-31T05:13:24.821 INFO:tasks.workunit.client.0.smithi099.stdout:9/863: mkdir d0/d3e/d87/dc9/d5e/de0/d130 0 2024-01-31T05:13:24.821 INFO:tasks.workunit.client.0.smithi099.stdout:3/893: rmdir d10/d27/d34/d44/d60/d75/d8c/d92/d123 0 2024-01-31T05:13:24.821 INFO:tasks.workunit.client.0.smithi099.stdout:8/955: write d1/dd/dba/d29/d3f/d56/da0/f3b [483347,57113] 0 2024-01-31T05:13:24.821 INFO:tasks.workunit.client.0.smithi099.stdout:0/934: creat d1/d37/d4a/d6f/dc9/dcf/f144 x:0 0 0 2024-01-31T05:13:24.822 INFO:tasks.workunit.client.0.smithi099.stdout:9/864: mknod d0/d3e/d87/dc9/d24/d2b/d59/c131 0 2024-01-31T05:13:24.824 INFO:tasks.workunit.client.0.smithi099.stdout:3/894: mkdir d10/d32/d85/d77/d13f 0 2024-01-31T05:13:24.824 INFO:tasks.workunit.client.0.smithi099.stdout:9/865: creat d0/d3e/d87/dc9/d5e/de0/f132 x:0 0 0 2024-01-31T05:13:24.825 INFO:tasks.workunit.client.0.smithi099.stdout:9/866: chown d0/d3e/d87/dc9/d24/d2b/cd7 113060169 1 2024-01-31T05:13:24.827 INFO:tasks.workunit.client.0.smithi099.stdout:9/867: mkdir d0/d3e/d87/dc9/d5e/de0/d130/d133 0 2024-01-31T05:13:24.832 INFO:tasks.workunit.client.0.smithi099.stdout:7/915: dread d6/f69 [0,4194304] 0 2024-01-31T05:13:24.836 INFO:tasks.workunit.client.0.smithi099.stdout:5/854: dwrite d6/da/d14/d94/fa6 [0,4194304] 0 2024-01-31T05:13:24.836 INFO:tasks.workunit.client.0.smithi099.stdout:5/855: chown d6/da/d14/d2b/l67 688092 1 2024-01-31T05:13:24.836 INFO:tasks.workunit.client.0.smithi099.stdout:7/916: mknod d6/d32/d3d/d4b/d12b/c136 0 2024-01-31T05:13:24.839 INFO:tasks.workunit.client.0.smithi099.stdout:3/895: write d10/d27/fa7 [8157728,43976] 0 2024-01-31T05:13:24.842 INFO:tasks.workunit.client.0.smithi099.stdout:7/917: creat d6/d32/d3d/d4b/d33/d37/d50/d25/d7a/d104/d114/f137 x:0 0 0 2024-01-31T05:13:24.847 INFO:tasks.workunit.client.0.smithi099.stdout:9/868: rmdir d0/d3e/d87/dc9/d5e/de0 39 2024-01-31T05:13:24.847 INFO:tasks.workunit.client.0.smithi099.stdout:9/869: write d0/d3e/d33/dab/fd4 [744103,119424] 0 2024-01-31T05:13:24.848 INFO:tasks.workunit.client.0.smithi099.stdout:8/956: dwrite d1/dd/dba/f68 [0,4194304] 0 2024-01-31T05:13:24.848 INFO:tasks.workunit.client.0.smithi099.stdout:8/957: write d1/dd/dba/d29/d3f/d56/d57/f61 [813720,126490] 0 2024-01-31T05:13:24.848 INFO:tasks.workunit.client.0.smithi099.stdout:8/958: write d1/dd/dba/d19/f6d [855645,23057] 0 2024-01-31T05:13:24.850 INFO:tasks.workunit.client.0.smithi099.stdout:3/896: dread d10/d27/f6b [0,4194304] 0 2024-01-31T05:13:24.850 INFO:tasks.workunit.client.0.smithi099.stdout:3/897: chown d10/d27/d34/d111/l121 128027 1 2024-01-31T05:13:24.850 INFO:tasks.workunit.client.0.smithi099.stdout:3/898: write d10/d1e/fc1 [6452886,117720] 0 2024-01-31T05:13:24.850 INFO:tasks.workunit.client.0.smithi099.stdout:3/899: chown d10/d27/d89/fbe 2 1 2024-01-31T05:13:24.852 INFO:tasks.workunit.client.0.smithi099.stdout:9/870: unlink d0/f95 0 2024-01-31T05:13:24.853 INFO:tasks.workunit.client.0.smithi099.stdout:1/801: dwrite d4/dc/d29/f7c [0,4194304] 0 2024-01-31T05:13:24.856 INFO:tasks.workunit.client.0.smithi099.stdout:8/959: creat d1/dd/dba/d29/d3f/d56/da0/f137 x:0 0 0 2024-01-31T05:13:24.857 INFO:tasks.workunit.client.0.smithi099.stdout:3/900: mknod d10/d72/c140 0 2024-01-31T05:13:24.857 INFO:tasks.workunit.client.0.smithi099.stdout:3/901: fsync d10/d27/d34/d44/d60/d75/d8c/db1/f122 0 2024-01-31T05:13:24.857 INFO:tasks.workunit.client.0.smithi099.stdout:3/902: write d10/d27/fa7 [8382828,114099] 0 2024-01-31T05:13:24.858 INFO:tasks.workunit.client.0.smithi099.stdout:9/871: mkdir d0/d3e/d87/dc9/d24/d2b/de9/df9/d134 0 2024-01-31T05:13:24.861 INFO:tasks.workunit.client.0.smithi099.stdout:1/802: chown d4/lb6 23783446 1 2024-01-31T05:13:24.861 INFO:tasks.workunit.client.0.smithi099.stdout:6/735: rename d14/d18/d3b to d14/d18/d52/d22/d71/dee 0 2024-01-31T05:13:24.861 INFO:tasks.workunit.client.0.smithi099.stdout:6/736: getdents d14/d18/d52/dbc/de8/de9 0 2024-01-31T05:13:24.862 INFO:tasks.workunit.client.0.smithi099.stdout:1/803: getdents d4/db/d12/dc0/d4b/d9a/dc7 0 2024-01-31T05:13:24.864 INFO:tasks.workunit.client.0.smithi099.stdout:1/804: creat d4/dc/d4d/d5d/d87/d56/d83/dbd/f100 x:0 0 0 2024-01-31T05:13:24.864 INFO:tasks.workunit.client.0.smithi099.stdout:1/805: write d4/db/fa4 [988120,53527] 0 2024-01-31T05:13:24.864 INFO:tasks.workunit.client.0.smithi099.stdout:9/872: symlink d0/d3e/d87/dc9/d24/d2b/d59/l135 0 2024-01-31T05:13:24.864 INFO:tasks.workunit.client.0.smithi099.stdout:9/873: dread - d0/d3e/d87/dc9/d5e/de0/f132 zero size 2024-01-31T05:13:24.874 INFO:tasks.workunit.client.0.smithi099.stdout:9/874: dread d0/d3e/d87/dc9/f9c [0,4194304] 0 2024-01-31T05:13:24.878 INFO:tasks.workunit.client.0.smithi099.stdout:5/856: rename d6/da/d14/d3d/d8c/d99 to d6/da/d14/d61/d98/da0/d11f 0 2024-01-31T05:13:24.882 INFO:tasks.workunit.client.0.smithi099.stdout:7/918: rename d6/ld4 to d6/d32/d3d/d4b/d33/d37/d50/d4d/l138 0 2024-01-31T05:13:24.884 INFO:tasks.workunit.client.0.smithi099.stdout:5/857: symlink d6/da/d14/d61/d98/da0/d107/l120 0 2024-01-31T05:13:24.885 INFO:tasks.workunit.client.0.smithi099.stdout:8/960: dwrite d1/dd/dba/d19/d21/d3c/f46 [4194304,4194304] 0 2024-01-31T05:13:24.886 INFO:tasks.workunit.client.0.smithi099.stdout:5/858: dread d6/da/d14/d94/f8d [0,4194304] 0 2024-01-31T05:13:24.890 INFO:tasks.workunit.client.0.smithi099.stdout:8/961: rename d1/dd/d1d/dbc/lee to d1/dd/d4f/dcd/l138 0 2024-01-31T05:13:24.890 INFO:tasks.workunit.client.0.smithi099.stdout:9/875: getdents d0/d3e/d87/dc9/d24/d48 0 2024-01-31T05:13:24.891 INFO:tasks.workunit.client.0.smithi099.stdout:9/876: mknod d0/d7/dd2/c136 0 2024-01-31T05:13:24.893 INFO:tasks.workunit.client.0.smithi099.stdout:7/919: dread d6/d32/d3d/d4b/d33/d37/f40 [0,4194304] 0 2024-01-31T05:13:24.893 INFO:tasks.workunit.client.0.smithi099.stdout:7/920: stat d6/f69 0 2024-01-31T05:13:24.893 INFO:tasks.workunit.client.0.smithi099.stdout:7/921: rename d6/d32/d3d/d4b to d6/d32/d3d/d4b/d139 22 2024-01-31T05:13:24.893 INFO:tasks.workunit.client.0.smithi099.stdout:9/877: mknod d0/d3e/d87/c137 0 2024-01-31T05:13:24.893 INFO:tasks.workunit.client.0.smithi099.stdout:8/962: write d1/dd/dba/f31 [4213855,75841] 0 2024-01-31T05:13:24.894 INFO:tasks.workunit.client.0.smithi099.stdout:7/922: creat d6/d32/d3d/de6/f13a x:0 0 0 2024-01-31T05:13:24.895 INFO:tasks.workunit.client.0.smithi099.stdout:8/963: symlink d1/dd/d1d/dea/l139 0 2024-01-31T05:13:24.895 INFO:tasks.workunit.client.0.smithi099.stdout:3/903: dwrite d10/d27/d125/f12a [0,4194304] 0 2024-01-31T05:13:24.899 INFO:tasks.workunit.client.0.smithi099.stdout:8/964: link d1/dd/dba/d19/dbd/l116 d1/da6/db4/l13a 0 2024-01-31T05:13:24.902 INFO:tasks.workunit.client.0.smithi099.stdout:1/806: dwrite d4/dc/d44/fc8 [4194304,4194304] 0 2024-01-31T05:13:24.902 INFO:tasks.workunit.client.0.smithi099.stdout:1/807: write d4/dc/d48/f2f [456349,122619] 0 2024-01-31T05:13:24.902 INFO:tasks.workunit.client.0.smithi099.stdout:8/965: link d1/dd/dba/d19/dc5/f11f d1/dd/dba/f13b 0 2024-01-31T05:13:24.903 INFO:tasks.workunit.client.0.smithi099.stdout:1/808: creat d4/db/d12/dc0/d4b/d9a/dc7/f101 x:0 0 0 2024-01-31T05:13:24.905 INFO:tasks.workunit.client.0.smithi099.stdout:7/923: dread d6/fc [0,4194304] 0 2024-01-31T05:13:24.905 INFO:tasks.workunit.client.0.smithi099.stdout:7/924: chown d6/d32/d3d/d4b/d33/d37/d50/l51 55158 1 2024-01-31T05:13:24.905 INFO:tasks.workunit.client.0.smithi099.stdout:6/737: dwrite d14/d18/d52/d7e/d1c/da6/fc9 [0,4194304] 0 2024-01-31T05:13:24.906 INFO:tasks.workunit.client.0.smithi099.stdout:6/738: mknod d14/d18/d52/d22/cef 0 2024-01-31T05:13:24.908 INFO:tasks.workunit.client.0.smithi099.stdout:3/904: write d10/d1e/f25 [6613129,53538] 0 2024-01-31T05:13:24.909 INFO:tasks.workunit.client.0.smithi099.stdout:8/966: mkdir d1/dd/dba/d19/d13c 0 2024-01-31T05:13:24.909 INFO:tasks.workunit.client.0.smithi099.stdout:8/967: chown d1/dd/dba/d19/d21/d3c/l9f 370448718 1 2024-01-31T05:13:24.909 INFO:tasks.workunit.client.0.smithi099.stdout:8/968: readlink d1/la 0 2024-01-31T05:13:24.909 INFO:tasks.workunit.client.0.smithi099.stdout:5/859: dwrite d6/f18 [0,4194304] 0 2024-01-31T05:13:24.910 INFO:tasks.workunit.client.0.smithi099.stdout:7/925: dread d6/d32/d3d/d4b/d33/d37/d50/d25/d72/d8e/d9a/fcb [0,4194304] 0 2024-01-31T05:13:24.911 INFO:tasks.workunit.client.0.smithi099.stdout:7/926: fsync d6/d12/f73 0 2024-01-31T05:13:24.912 INFO:tasks.workunit.client.0.smithi099.stdout:7/927: read d6/d32/d3d/d46/fab [320011,24905] 0 2024-01-31T05:13:24.912 INFO:tasks.workunit.client.0.smithi099.stdout:7/928: stat d6/d32/d3d/d4b/d33/d37/d50/d25/d72/fd0 0 2024-01-31T05:13:24.919 INFO:tasks.workunit.client.0.smithi099.stdout:5/860: dread d6/da/d14/d3d/d51/d82/f2c [0,4194304] 0 2024-01-31T05:13:24.920 INFO:tasks.workunit.client.0.smithi099.stdout:3/905: creat d10/d32/d85/d77/f141 x:0 0 0 2024-01-31T05:13:24.920 INFO:tasks.workunit.client.0.smithi099.stdout:3/906: fsync d10/d32/d85/da3/f136 0 2024-01-31T05:13:24.921 INFO:tasks.workunit.client.0.smithi099.stdout:3/907: fdatasync d10/d27/f53 0 2024-01-31T05:13:24.921 INFO:tasks.workunit.client.0.smithi099.stdout:3/908: write d10/d27/d34/d44/d60/d75/d8c/d92/f112 [855539,47557] 0 2024-01-31T05:13:24.922 INFO:tasks.workunit.client.0.smithi099.stdout:7/929: write d6/d32/f5b [387431,1594] 0 2024-01-31T05:13:24.922 INFO:tasks.workunit.client.0.smithi099.stdout:7/930: dread - d6/f130 zero size 2024-01-31T05:13:24.924 INFO:tasks.workunit.client.0.smithi099.stdout:4/956: sync 2024-01-31T05:13:24.924 INFO:tasks.workunit.client.0.smithi099.stdout:4/957: dread - d0/d2/d4b/d93/d59/d82/f11f zero size 2024-01-31T05:13:24.924 INFO:tasks.workunit.client.0.smithi099.stdout:4/958: fsync d0/d2/d4b/f69 0 2024-01-31T05:13:24.930 INFO:tasks.workunit.client.0.smithi099.stdout:8/969: rename d1/dd/dba/d19/dc5 to d1/dd/dba/da9/d104/d13d 0 2024-01-31T05:13:24.930 INFO:tasks.workunit.client.0.smithi099.stdout:7/931: mknod d6/c13b 0 2024-01-31T05:13:24.931 INFO:tasks.workunit.client.0.smithi099.stdout:7/932: truncate d6/d32/d3d/d4b/d33/d37/d50/d25/f29 4965542 0 2024-01-31T05:13:24.931 INFO:tasks.workunit.client.0.smithi099.stdout:7/933: write d6/d12/f113 [2902743,26334] 0 2024-01-31T05:13:24.931 INFO:tasks.workunit.client.0.smithi099.stdout:4/959: dread d0/d2/d4b/d93/d59/dff/d43/df9/f104 [0,4194304] 0 2024-01-31T05:13:24.931 INFO:tasks.workunit.client.0.smithi099.stdout:5/861: rename d6/da/d14/d3d/d57/le2 to d6/da/d14/d3d/da8/dde/l121 0 2024-01-31T05:13:24.932 INFO:tasks.workunit.client.0.smithi099.stdout:8/970: truncate d1/dd/d7b/d85/fbb 2575937 0 2024-01-31T05:13:24.932 INFO:tasks.workunit.client.0.smithi099.stdout:8/971: truncate d1/dd/dba/da9/d104/d13d/f115 1166878 0 2024-01-31T05:13:24.933 INFO:tasks.workunit.client.0.smithi099.stdout:4/960: mknod d0/d2/d4b/d93/d59/d82/c142 0 2024-01-31T05:13:24.933 INFO:tasks.workunit.client.0.smithi099.stdout:4/961: fdatasync d0/d2/d4b/d93/d39/fcd 0 2024-01-31T05:13:24.934 INFO:tasks.workunit.client.0.smithi099.stdout:3/909: read d10/d27/d34/d44/d60/d75/f9e [4120258,71197] 0 2024-01-31T05:13:24.934 INFO:tasks.workunit.client.0.smithi099.stdout:7/934: symlink d6/d32/d3d/d46/d11f/l13c 0 2024-01-31T05:13:24.934 INFO:tasks.workunit.client.0.smithi099.stdout:7/935: write d6/d32/d3d/d46/f83 [4462799,60769] 0 2024-01-31T05:13:24.934 INFO:tasks.workunit.client.0.smithi099.stdout:8/972: write d1/dd/dba/d19/fda [538654,29531] 0 2024-01-31T05:13:24.936 INFO:tasks.workunit.client.0.smithi099.stdout:1/809: dread d4/db/fd1 [0,4194304] 0 2024-01-31T05:13:24.936 INFO:tasks.workunit.client.0.smithi099.stdout:1/810: fsync d4/dc/d4d/da5/dcf/dd4/fb2 0 2024-01-31T05:13:24.936 INFO:tasks.workunit.client.0.smithi099.stdout:6/739: write d14/d18/f96 [746014,15272] 0 2024-01-31T05:13:24.936 INFO:tasks.workunit.client.0.smithi099.stdout:6/740: symlink d14/d18/d52/d7e/d1c/lf0 0 2024-01-31T05:13:24.937 INFO:tasks.workunit.client.0.smithi099.stdout:6/741: symlink d14/d18/d52/d46/lf1 0 2024-01-31T05:13:24.942 INFO:tasks.workunit.client.0.smithi099.stdout:2/894: sync 2024-01-31T05:13:24.942 INFO:tasks.workunit.client.0.smithi099.stdout:0/935: sync 2024-01-31T05:13:24.942 INFO:tasks.workunit.client.0.smithi099.stdout:0/936: fdatasync d1/d8/f5f 0 2024-01-31T05:13:24.943 INFO:tasks.workunit.client.0.smithi099.stdout:2/895: dread - d10/d1b/d4d/d5a/f119 zero size 2024-01-31T05:13:24.943 INFO:tasks.workunit.client.0.smithi099.stdout:0/937: truncate d1/d64/f78 473492 0 2024-01-31T05:13:24.943 INFO:tasks.workunit.client.0.smithi099.stdout:7/936: creat d6/d32/d3d/d4b/d33/d37/d50/d25/d79/d121/f13d x:0 0 0 2024-01-31T05:13:24.944 INFO:tasks.workunit.client.0.smithi099.stdout:8/973: rename d1/dd/dba/f1e to d1/dd/dba/d20/f13e 0 2024-01-31T05:13:24.947 INFO:tasks.workunit.client.0.smithi099.stdout:0/938: mknod d1/d64/c145 0 2024-01-31T05:13:24.947 INFO:tasks.workunit.client.0.smithi099.stdout:7/937: mkdir d6/d98/de3/d13e 0 2024-01-31T05:13:24.948 INFO:tasks.workunit.client.0.smithi099.stdout:8/974: symlink d1/dd/dba/da9/l13f 0 2024-01-31T05:13:24.949 INFO:tasks.workunit.client.0.smithi099.stdout:8/975: write d1/f7 [1330559,102248] 0 2024-01-31T05:13:24.950 INFO:tasks.workunit.client.0.smithi099.stdout:7/938: rmdir d6/d32/d3d/d4b/d9b/d124 39 2024-01-31T05:13:24.951 INFO:tasks.workunit.client.0.smithi099.stdout:7/939: chown d6/d98/de3/ff9 6362617 1 2024-01-31T05:13:24.953 INFO:tasks.workunit.client.0.smithi099.stdout:7/940: dread d6/d32/d3d/dd7/dc5/fdb [0,4194304] 0 2024-01-31T05:13:24.953 INFO:tasks.workunit.client.0.smithi099.stdout:7/941: write d6/d32/d3d/d4b/d33/d37/d50/d25/d7a/f100 [489028,46079] 0 2024-01-31T05:13:24.954 INFO:tasks.workunit.client.0.smithi099.stdout:4/962: dread d0/d8/d19/d98/d9b/dab/f6b [0,4194304] 0 2024-01-31T05:13:24.955 INFO:tasks.workunit.client.0.smithi099.stdout:7/942: rmdir d6/d116 0 2024-01-31T05:13:24.955 INFO:tasks.workunit.client.0.smithi099.stdout:7/943: chown d6/d32/d3d/d46/lec 1738827793 1 2024-01-31T05:13:24.957 INFO:tasks.workunit.client.0.smithi099.stdout:7/944: creat d6/d32/d3d/d4b/d33/d37/d50/f13f x:0 0 0 2024-01-31T05:13:24.960 INFO:tasks.workunit.client.0.smithi099.stdout:8/976: write d1/dd/dba/d29/d3f/d56/d57/fec [427934,10380] 0 2024-01-31T05:13:24.962 INFO:tasks.workunit.client.0.smithi099.stdout:8/977: rename d1/dd/dba/d29/d3f/d56/da0/d2e/de1/ded to d1/dd/dba/d19/dbd/d140 0 2024-01-31T05:13:24.964 INFO:tasks.workunit.client.0.smithi099.stdout:3/910: dwrite d10/d24/d40/f82 [4194304,4194304] 0 2024-01-31T05:13:24.970 INFO:tasks.workunit.client.0.smithi099.stdout:5/862: dwrite d6/da/d14/d3d/d51/dae/fe8 [0,4194304] 0 2024-01-31T05:13:24.970 INFO:tasks.workunit.client.0.smithi099.stdout:5/863: truncate d6/da/fc7 1018012 0 2024-01-31T05:13:24.970 INFO:tasks.workunit.client.0.smithi099.stdout:1/811: write d4/dc/d4d/d5d/f7f [5742086,47191] 0 2024-01-31T05:13:24.976 INFO:tasks.workunit.client.0.smithi099.stdout:5/864: mkdir d6/da/d14/d61/d98/da0/d107/d122 0 2024-01-31T05:13:24.976 INFO:tasks.workunit.client.0.smithi099.stdout:5/865: write d6/da/d14/d61/d98/da0/d11f/fe1 [560141,48565] 0 2024-01-31T05:13:24.976 INFO:tasks.workunit.client.0.smithi099.stdout:5/866: fdatasync d6/da/d14/d61/d98/fa5 0 2024-01-31T05:13:24.976 INFO:tasks.workunit.client.0.smithi099.stdout:5/867: chown d6/da/d14/d2b/fab 466 1 2024-01-31T05:13:24.980 INFO:tasks.workunit.client.0.smithi099.stdout:2/896: write d10/d1b/f73 [479810,24341] 0 2024-01-31T05:13:24.980 INFO:tasks.workunit.client.0.smithi099.stdout:2/897: write d10/d3a/d69/fa1 [1041242,57156] 0 2024-01-31T05:13:24.980 INFO:tasks.workunit.client.0.smithi099.stdout:2/898: write d10/d1c/d43/ff3 [732859,1262] 0 2024-01-31T05:13:24.980 INFO:tasks.workunit.client.0.smithi099.stdout:0/939: dwrite d1/d56/faf [0,4194304] 0 2024-01-31T05:13:24.982 INFO:tasks.workunit.client.0.smithi099.stdout:2/899: mknod d10/d1b/d7d/d7a/dad/c11c 0 2024-01-31T05:13:24.982 INFO:tasks.workunit.client.0.smithi099.stdout:2/900: write d10/d1b/f81 [1835586,46631] 0 2024-01-31T05:13:24.984 INFO:tasks.workunit.client.0.smithi099.stdout:0/940: rename d1/d56/d103/d8b to d1/d30/d45/d66/d97/d146 0 2024-01-31T05:13:24.985 INFO:tasks.workunit.client.0.smithi099.stdout:2/901: rename d10/d1b/d4d/d5a/f119 to d10/d1b/d83/de8/f11d 0 2024-01-31T05:13:24.986 INFO:tasks.workunit.client.0.smithi099.stdout:0/941: symlink d1/d37/d4a/d7a/l147 0 2024-01-31T05:13:24.986 INFO:tasks.workunit.client.0.smithi099.stdout:6/742: dwrite d14/d18/d52/d7e/d1c/da6/fe4 [0,4194304] 0 2024-01-31T05:13:24.986 INFO:tasks.workunit.client.0.smithi099.stdout:4/963: dwrite d0/d2/d4b/d93/d59/d8f/dd6/ddb/fde [0,4194304] 0 2024-01-31T05:13:24.986 INFO:tasks.workunit.client.0.smithi099.stdout:6/743: fdatasync d14/d18/d52/d7e/d1c/d29/f3f 0 2024-01-31T05:13:24.988 INFO:tasks.workunit.client.0.smithi099.stdout:4/964: truncate d0/d2/d4b/d93/d86/db4/f6c 1787516 0 2024-01-31T05:13:24.988 INFO:tasks.workunit.client.0.smithi099.stdout:0/942: truncate d1/d37/d4a/d6f/f12d 5234138 0 2024-01-31T05:13:24.989 INFO:tasks.workunit.client.0.smithi099.stdout:2/902: mkdir d10/d1c/d43/db8/d11e 0 2024-01-31T05:13:24.990 INFO:tasks.workunit.client.0.smithi099.stdout:0/943: mknod d1/d30/c148 0 2024-01-31T05:13:24.990 INFO:tasks.workunit.client.0.smithi099.stdout:0/944: creat d1/d16/f149 x:0 0 0 2024-01-31T05:13:24.991 INFO:tasks.workunit.client.0.smithi099.stdout:2/903: creat d10/d1b/d7d/f11f x:0 0 0 2024-01-31T05:13:24.992 INFO:tasks.workunit.client.0.smithi099.stdout:2/904: mkdir d10/d20/d5b/d120 0 2024-01-31T05:13:24.993 INFO:tasks.workunit.client.0.smithi099.stdout:2/905: chown d10/d51/c110 19 1 2024-01-31T05:13:24.994 INFO:tasks.workunit.client.0.smithi099.stdout:0/945: unlink d1/d37/d4a/d7a/c54 0 2024-01-31T05:13:24.995 INFO:tasks.workunit.client.0.smithi099.stdout:4/965: dread d0/d2/d4b/d93/d59/f8b [0,4194304] 0 2024-01-31T05:13:24.995 INFO:tasks.workunit.client.0.smithi099.stdout:2/906: symlink d10/d51/l121 0 2024-01-31T05:13:24.995 INFO:tasks.workunit.client.0.smithi099.stdout:4/966: chown d0/d2/d4b/d93/d59/d82/l97 1 1 2024-01-31T05:13:24.996 INFO:tasks.workunit.client.0.smithi099.stdout:0/946: write d1/d37/f93 [4499852,31062] 0 2024-01-31T05:13:25.000 INFO:tasks.workunit.client.0.smithi099.stdout:3/911: dwrite d10/dfa/d120/f62 [4194304,4194304] 0 2024-01-31T05:13:25.001 INFO:tasks.workunit.client.0.smithi099.stdout:3/912: mknod d10/d1e/da2/c142 0 2024-01-31T05:13:25.001 INFO:tasks.workunit.client.0.smithi099.stdout:3/913: chown d10/d27 79 1 2024-01-31T05:13:25.004 INFO:tasks.workunit.client.0.smithi099.stdout:0/947: dread d1/d37/d4a/d7b/dfe/f10d [0,4194304] 0 2024-01-31T05:13:25.005 INFO:tasks.workunit.client.0.smithi099.stdout:3/914: link c9 d10/d27/d34/d50/d12f/c143 0 2024-01-31T05:13:25.007 INFO:tasks.workunit.client.0.smithi099.stdout:0/948: rename d1/d56/d103/f57 to d1/d37/d4a/d7b/dfe/f14a 0 2024-01-31T05:13:25.008 INFO:tasks.workunit.client.0.smithi099.stdout:3/915: mknod d10/d1e/da2/d117/c144 0 2024-01-31T05:13:25.010 INFO:tasks.workunit.client.0.smithi099.stdout:3/916: unlink d10/d32/d33/c13c 0 2024-01-31T05:13:25.010 INFO:tasks.workunit.client.0.smithi099.stdout:3/917: chown d10/d72/f9c 1805803135 1 2024-01-31T05:13:25.011 INFO:tasks.workunit.client.0.smithi099.stdout:8/978: dwrite d1/dd/dba/d20/f13e [0,4194304] 0 2024-01-31T05:13:25.012 INFO:tasks.workunit.client.0.smithi099.stdout:0/949: mkdir d1/d37/d4a/d6f/dc9/deb/d14b 0 2024-01-31T05:13:25.012 INFO:tasks.workunit.client.0.smithi099.stdout:0/950: fsync d1/d37/d4a/de6/f12a 0 2024-01-31T05:13:25.012 INFO:tasks.workunit.client.0.smithi099.stdout:3/918: unlink d10/d27/d125/l12e 0 2024-01-31T05:13:25.015 INFO:tasks.workunit.client.0.smithi099.stdout:0/951: unlink d1/d37/d73/lc1 0 2024-01-31T05:13:25.015 INFO:tasks.workunit.client.0.smithi099.stdout:0/952: write d1/d56/d103/f63 [788719,95234] 0 2024-01-31T05:13:25.015 INFO:tasks.workunit.client.0.smithi099.stdout:3/919: creat d10/d24/f145 x:0 0 0 2024-01-31T05:13:25.015 INFO:tasks.workunit.client.0.smithi099.stdout:3/920: chown d10/d32/d85/c79 11914798 1 2024-01-31T05:13:25.016 INFO:tasks.workunit.client.0.smithi099.stdout:0/953: creat d1/d64/ded/f14c x:0 0 0 2024-01-31T05:13:25.017 INFO:tasks.workunit.client.0.smithi099.stdout:3/921: symlink d10/d32/l146 0 2024-01-31T05:13:25.017 INFO:tasks.workunit.client.0.smithi099.stdout:3/922: chown d10/d24/d40/fef 3439170 1 2024-01-31T05:13:25.017 INFO:tasks.workunit.client.0.smithi099.stdout:3/923: mkdir d10/d27/d34/d44/d95/d147 0 2024-01-31T05:13:25.021 INFO:tasks.workunit.client.0.smithi099.stdout:5/868: dwrite d6/da/d14/d3d/d51/d82/f4e [0,4194304] 0 2024-01-31T05:13:25.021 INFO:tasks.workunit.client.0.smithi099.stdout:5/869: chown d6/da/d14/d3d/d51/d82/d9a/fc8 1805 1 2024-01-31T05:13:25.026 INFO:tasks.workunit.client.0.smithi099.stdout:5/870: creat d6/da/d14/d3d/d8c/f123 x:0 0 0 2024-01-31T05:13:25.027 INFO:tasks.workunit.client.0.smithi099.stdout:6/744: dwrite d14/d18/d52/d7e/f37 [0,4194304] 0 2024-01-31T05:13:25.027 INFO:tasks.workunit.client.0.smithi099.stdout:6/745: dread - d14/d18/d52/d22/f59 zero size 2024-01-31T05:13:25.027 INFO:tasks.workunit.client.0.smithi099.stdout:4/967: dwrite d0/d2/d4b/d93/d59/dff/d43/f109 [0,4194304] 0 2024-01-31T05:13:25.029 INFO:tasks.workunit.client.0.smithi099.stdout:6/746: getdents d14/d18/d52/d7e/d1c/d29/d79/dc6 0 2024-01-31T05:13:25.030 INFO:tasks.workunit.client.0.smithi099.stdout:5/871: creat d6/da/d14/d61/d98/da0/d11f/f124 x:0 0 0 2024-01-31T05:13:25.030 INFO:tasks.workunit.client.0.smithi099.stdout:5/872: write d6/da/d14/d3d/d6e/ffb [2590336,79361] 0 2024-01-31T05:13:25.030 INFO:tasks.workunit.client.0.smithi099.stdout:5/873: chown d6/da/d14/d2b/l83 783 1 2024-01-31T05:13:25.030 INFO:tasks.workunit.client.0.smithi099.stdout:5/874: chown d6/da/d14/d61/d98/d106/d81/l7c 8544 1 2024-01-31T05:13:25.030 INFO:tasks.workunit.client.0.smithi099.stdout:6/747: rmdir d14/d18/d52/d90/d9a 39 2024-01-31T05:13:25.031 INFO:tasks.workunit.client.0.smithi099.stdout:6/748: truncate d14/d18/d52/fd6 1632609 0 2024-01-31T05:13:25.031 INFO:tasks.workunit.client.0.smithi099.stdout:4/968: creat d0/d2/d20/f143 x:0 0 0 2024-01-31T05:13:25.034 INFO:tasks.workunit.client.0.smithi099.stdout:0/954: dread d1/d30/fb2 [0,4194304] 0 2024-01-31T05:13:25.037 INFO:tasks.workunit.client.0.smithi099.stdout:5/875: getdents d6/da 0 2024-01-31T05:13:25.038 INFO:tasks.workunit.client.0.smithi099.stdout:5/876: getdents d6/da/ddf 0 2024-01-31T05:13:25.041 INFO:tasks.workunit.client.0.smithi099.stdout:3/924: dwrite d10/d24/d40/d81/de4/f124 [0,4194304] 0 2024-01-31T05:13:25.041 INFO:tasks.workunit.client.0.smithi099.stdout:3/925: creat d10/d27/d34/d44/d60/d75/d8c/db0/f148 x:0 0 0 2024-01-31T05:13:25.042 INFO:tasks.workunit.client.0.smithi099.stdout:3/926: fdatasync d10/d24/d40/fef 0 2024-01-31T05:13:25.046 INFO:tasks.workunit.client.0.smithi099.stdout:5/877: rmdir d6/da/d14/d61 39 2024-01-31T05:13:25.062 INFO:tasks.workunit.client.0.smithi099.stdout:0/955: rename d1/cec to d1/d30/d45/dad/db1/c14d 0 2024-01-31T05:13:25.062 INFO:tasks.workunit.client.0.smithi099.stdout:0/956: truncate d1/d37/d73/dbc/f137 775765 0 2024-01-31T05:13:25.062 INFO:tasks.workunit.client.0.smithi099.stdout:0/957: chown d1/d37/d4a/d7a/d7d/f13b 4 1 2024-01-31T05:13:25.062 INFO:tasks.workunit.client.0.smithi099.stdout:4/969: dwrite d0/d8/d19/f123 [0,4194304] 0 2024-01-31T05:13:25.062 INFO:tasks.workunit.client.0.smithi099.stdout:4/970: chown d0/d8/d19/d99 90 1 2024-01-31T05:13:25.067 INFO:tasks.workunit.client.0.smithi099.stdout:6/749: truncate d14/d18/d52/d7e/d1c/fc3 3186497 0 2024-01-31T05:13:25.067 INFO:tasks.workunit.client.0.smithi099.stdout:4/971: dread d0/d2/f9f [0,4194304] 0 2024-01-31T05:13:25.070 INFO:tasks.workunit.client.0.smithi099.stdout:0/958: rmdir d1/d56/d103 39 2024-01-31T05:13:25.076 INFO:tasks.workunit.client.0.smithi099.stdout:5/878: dwrite d6/f91 [0,4194304] 0 2024-01-31T05:13:25.077 INFO:tasks.workunit.client.0.smithi099.stdout:3/927: dwrite d10/d1e/f25 [0,4194304] 0 2024-01-31T05:13:25.079 INFO:tasks.workunit.client.0.smithi099.stdout:4/972: dread d0/d2/d4b/d93/f94 [0,4194304] 0 2024-01-31T05:13:25.081 INFO:tasks.workunit.client.0.smithi099.stdout:0/959: write d1/d37/d4a/d7b/dfe/f14a [921571,130669] 0 2024-01-31T05:13:25.081 INFO:tasks.workunit.client.0.smithi099.stdout:0/960: chown d1/d56/d103/f7c 2487915 1 2024-01-31T05:13:25.081 INFO:tasks.workunit.client.0.smithi099.stdout:0/961: readlink d1/d37/d4a/d7a/l10c 0 2024-01-31T05:13:25.081 INFO:tasks.workunit.client.0.smithi099.stdout:5/879: symlink d6/da/d14/d61/d11d/l125 0 2024-01-31T05:13:25.081 INFO:tasks.workunit.client.0.smithi099.stdout:4/973: creat d0/d2/d4b/d93/d59/dff/db9/f144 x:0 0 0 2024-01-31T05:13:25.081 INFO:tasks.workunit.client.0.smithi099.stdout:4/974: chown d0/d2/d4b/d93/d59/d102 230388 1 2024-01-31T05:13:25.081 INFO:tasks.workunit.client.0.smithi099.stdout:9/878: sync 2024-01-31T05:13:25.082 INFO:tasks.workunit.client.0.smithi099.stdout:4/975: creat d0/d2/d4b/d93/d39/dcf/f145 x:0 0 0 2024-01-31T05:13:25.082 INFO:tasks.workunit.client.0.smithi099.stdout:3/928: dread - d10/d32/d85/f11c zero size 2024-01-31T05:13:25.082 INFO:tasks.workunit.client.0.smithi099.stdout:4/976: chown d0/d1e/l2b 24674 1 2024-01-31T05:13:25.082 INFO:tasks.workunit.client.0.smithi099.stdout:9/879: write d0/d5d/db6/fc5 [72889,68214] 0 2024-01-31T05:13:25.084 INFO:tasks.workunit.client.0.smithi099.stdout:0/962: unlink d1/d30/d45/d66/d97/cd3 0 2024-01-31T05:13:25.085 INFO:tasks.workunit.client.0.smithi099.stdout:3/929: mknod d10/d27/d34/d44/d60/d75/d8c/d10f/c149 0 2024-01-31T05:13:25.085 INFO:tasks.workunit.client.0.smithi099.stdout:1/812: sync 2024-01-31T05:13:25.085 INFO:tasks.workunit.client.0.smithi099.stdout:7/945: sync 2024-01-31T05:13:25.086 INFO:tasks.workunit.client.0.smithi099.stdout:8/979: sync 2024-01-31T05:13:25.086 INFO:tasks.workunit.client.0.smithi099.stdout:2/907: sync 2024-01-31T05:13:25.086 INFO:tasks.workunit.client.0.smithi099.stdout:2/908: fdatasync d10/d3a/d69/d82/f98 0 2024-01-31T05:13:25.086 INFO:tasks.workunit.client.0.smithi099.stdout:2/909: readlink d10/d20/d5b/l11b 0 2024-01-31T05:13:25.086 INFO:tasks.workunit.client.0.smithi099.stdout:2/910: chown d10/d1b/d7d/f11f 30 1 2024-01-31T05:13:25.086 INFO:tasks.workunit.client.0.smithi099.stdout:1/813: truncate d4/db/d12/dc0/d4b/d50/d91/f7b 825737 0 2024-01-31T05:13:25.087 INFO:tasks.workunit.client.0.smithi099.stdout:9/880: mknod d0/d3e/d87/dc9/d5e/de0/c138 0 2024-01-31T05:13:25.087 INFO:tasks.workunit.client.0.smithi099.stdout:0/963: mkdir d1/d37/d4a/d6f/dc9/d14e 0 2024-01-31T05:13:25.088 INFO:tasks.workunit.client.0.smithi099.stdout:1/814: creat d4/db/d12/dc0/d4b/f102 x:0 0 0 2024-01-31T05:13:25.088 INFO:tasks.workunit.client.0.smithi099.stdout:7/946: truncate d6/d32/d12f/f131 3367449 0 2024-01-31T05:13:25.091 INFO:tasks.workunit.client.0.smithi099.stdout:8/980: creat d1/dd/dba/d29/d3f/d56/da0/d2e/f141 x:0 0 0 2024-01-31T05:13:25.091 INFO:tasks.workunit.client.0.smithi099.stdout:0/964: mknod d1/d37/d4a/d6f/dc9/d14e/c14f 0 2024-01-31T05:13:25.091 INFO:tasks.workunit.client.0.smithi099.stdout:0/965: chown d1/d64/f82 0 1 2024-01-31T05:13:25.091 INFO:tasks.workunit.client.0.smithi099.stdout:7/947: mkdir d6/d98/de3/d140 0 2024-01-31T05:13:25.093 INFO:tasks.workunit.client.0.smithi099.stdout:1/815: rmdir d4 39 2024-01-31T05:13:25.093 INFO:tasks.workunit.client.0.smithi099.stdout:1/816: dread - d4/db/d12/dc0/d4b/f102 zero size 2024-01-31T05:13:25.094 INFO:tasks.workunit.client.0.smithi099.stdout:5/880: write d6/da/d3f/f4d [3647608,15110] 0 2024-01-31T05:13:25.096 INFO:tasks.workunit.client.0.smithi099.stdout:9/881: dread d0/d3e/d87/dc9/d5e/d72/d89/d98/dc1/ff6 [0,4194304] 0 2024-01-31T05:13:25.097 INFO:tasks.workunit.client.0.smithi099.stdout:3/930: write d10/d27/d34/d44/d60/d75/d8c/db0/fd9 [1724182,11083] 0 2024-01-31T05:13:25.101 INFO:tasks.workunit.client.0.smithi099.stdout:2/911: dread d10/d1b/f59 [0,4194304] 0 2024-01-31T05:13:25.101 INFO:tasks.workunit.client.0.smithi099.stdout:8/981: creat d1/dd/dba/d29/d3f/f142 x:0 0 0 2024-01-31T05:13:25.101 INFO:tasks.workunit.client.0.smithi099.stdout:0/966: symlink d1/d30/d45/dad/db1/l150 0 2024-01-31T05:13:25.101 INFO:tasks.workunit.client.0.smithi099.stdout:7/948: link d6/d32/d3d/d4b/d33/d37/d50/d5e/l64 d6/d32/d3d/d4b/l141 0 2024-01-31T05:13:25.101 INFO:tasks.workunit.client.0.smithi099.stdout:6/750: dread d14/d18/d52/d7e/d1c/f5f [0,4194304] 0 2024-01-31T05:13:25.101 INFO:tasks.workunit.client.0.smithi099.stdout:4/977: link d0/d1e/d61/f129 d0/d2/d4b/d93/d59/dff/db9/d10b/d12d/f146 0 2024-01-31T05:13:25.102 INFO:tasks.workunit.client.0.smithi099.stdout:8/982: mkdir d1/dd/d65/d7f/d81/dc7/dce/d143 0 2024-01-31T05:13:25.102 INFO:tasks.workunit.client.0.smithi099.stdout:8/983: fdatasync d1/f5e 0 2024-01-31T05:13:25.104 INFO:tasks.workunit.client.0.smithi099.stdout:4/978: mknod d0/d2/d4b/d93/d17/c147 0 2024-01-31T05:13:25.104 INFO:tasks.workunit.client.0.smithi099.stdout:4/979: dread - d0/d2/d20/f143 zero size 2024-01-31T05:13:25.104 INFO:tasks.workunit.client.0.smithi099.stdout:4/980: write d0/d8/fa1 [484028,68766] 0 2024-01-31T05:13:25.104 INFO:tasks.workunit.client.0.smithi099.stdout:4/981: write d0/d2/d4b/d93/d59/dff/fd0 [486134,46684] 0 2024-01-31T05:13:25.104 INFO:tasks.workunit.client.0.smithi099.stdout:4/982: readlink d0/d2/d4b/d93/d17/d3d/l78 0 2024-01-31T05:13:25.104 INFO:tasks.workunit.client.0.smithi099.stdout:4/983: truncate d0/d2/d4b/d93/d59/dff/fa6 1306266 0 2024-01-31T05:13:25.104 INFO:tasks.workunit.client.0.smithi099.stdout:0/967: rename d1/d37/d73/f136 to d1/d30/d45/d66/d97/d146/f151 0 2024-01-31T05:13:25.105 INFO:tasks.workunit.client.0.smithi099.stdout:4/984: truncate d0/d2/d4b/d93/d59/dff/db9/d10b/d12d/f146 3464097 0 2024-01-31T05:13:25.105 INFO:tasks.workunit.client.0.smithi099.stdout:8/984: dread d1/dd/d65/d7f/d81/dc7/dce/ff9 [0,4194304] 0 2024-01-31T05:13:25.107 INFO:tasks.workunit.client.0.smithi099.stdout:6/751: creat d14/d18/d52/d22/d71/dee/d7b/dd4/ff2 x:0 0 0 2024-01-31T05:13:25.112 INFO:tasks.workunit.client.0.smithi099.stdout:4/985: creat d0/d1e/f148 x:0 0 0 2024-01-31T05:13:25.112 INFO:tasks.workunit.client.0.smithi099.stdout:4/986: truncate d0/d8/d19/f1c 1567343 0 2024-01-31T05:13:25.119 INFO:tasks.workunit.client.0.smithi099.stdout:4/987: write d0/d2/d4b/d93/d59/d8f/fa4 [792063,59462] 0 2024-01-31T05:13:25.119 INFO:tasks.workunit.client.0.smithi099.stdout:4/988: readlink d0/d8/d19/d65/lf0 0 2024-01-31T05:13:25.121 INFO:tasks.workunit.client.0.smithi099.stdout:4/989: creat d0/d2/d4b/d93/d59/dff/db9/d10b/f149 x:0 0 0 2024-01-31T05:13:25.121 INFO:tasks.workunit.client.0.smithi099.stdout:2/912: write d10/d1b/d4d/fd1 [184589,94189] 0 2024-01-31T05:13:25.123 INFO:tasks.workunit.client.0.smithi099.stdout:4/990: creat d0/d1e/d61/f14a x:0 0 0 2024-01-31T05:13:25.124 INFO:tasks.workunit.client.0.smithi099.stdout:9/882: dread d0/d7/dd2/ff8 [0,4194304] 0 2024-01-31T05:13:25.124 INFO:tasks.workunit.client.0.smithi099.stdout:9/883: write d0/d5d/def/f10e [418655,107524] 0 2024-01-31T05:13:25.124 INFO:tasks.workunit.client.0.smithi099.stdout:4/991: mkdir d0/d8/d19/d65/d14b 0 2024-01-31T05:13:25.124 INFO:tasks.workunit.client.0.smithi099.stdout:1/817: dwrite d4/df9/ff7 [0,4194304] 0 2024-01-31T05:13:25.127 INFO:tasks.workunit.client.0.smithi099.stdout:7/949: write d6/d32/d3d/d4b/d33/d37/d50/d25/d79/f8c [1715415,126037] 0 2024-01-31T05:13:25.127 INFO:tasks.workunit.client.0.smithi099.stdout:4/992: dread d0/d2/d4b/d93/f10f [0,4194304] 0 2024-01-31T05:13:25.130 INFO:tasks.workunit.client.0.smithi099.stdout:7/950: getdents d6/d32/d12f 0 2024-01-31T05:13:25.130 INFO:tasks.workunit.client.0.smithi099.stdout:7/951: fsync d6/d32/d3d/d4b/f1b 0 2024-01-31T05:13:25.131 INFO:tasks.workunit.client.0.smithi099.stdout:2/913: dread d10/d20/d5b/fe5 [0,4194304] 0 2024-01-31T05:13:25.131 INFO:tasks.workunit.client.0.smithi099.stdout:2/914: dread - d10/d2b/d97/fc5 zero size 2024-01-31T05:13:25.131 INFO:tasks.workunit.client.0.smithi099.stdout:4/993: creat d0/d8/d19/d98/dac/f14c x:0 0 0 2024-01-31T05:13:25.131 INFO:tasks.workunit.client.0.smithi099.stdout:4/994: read - d0/d2/d4b/d93/d17/d105/f12e zero size 2024-01-31T05:13:25.132 INFO:tasks.workunit.client.0.smithi099.stdout:9/884: dread d0/d3e/d87/dc9/d24/d48/f9f [0,4194304] 0 2024-01-31T05:13:25.132 INFO:tasks.workunit.client.0.smithi099.stdout:9/885: creat d0/d5d/db6/f139 x:0 0 0 2024-01-31T05:13:25.133 INFO:tasks.workunit.client.0.smithi099.stdout:7/952: unlink d6/d32/d3d/d4b/d33/d37/d50/l2d 0 2024-01-31T05:13:25.133 INFO:tasks.workunit.client.0.smithi099.stdout:7/953: stat d6/d32/d3d/d4b/cfb 0 2024-01-31T05:13:25.133 INFO:tasks.workunit.client.0.smithi099.stdout:7/954: chown d6/d32/d3d/d4b/d33/d37/d50/d25/d72/d8e/df7 2 1 2024-01-31T05:13:25.133 INFO:tasks.workunit.client.0.smithi099.stdout:4/995: dread d0/d8/faf [0,4194304] 0 2024-01-31T05:13:25.135 INFO:tasks.workunit.client.0.smithi099.stdout:7/955: mkdir d6/d32/d3d/d4b/d33/d37/dfe/d142 0 2024-01-31T05:13:25.136 INFO:tasks.workunit.client.0.smithi099.stdout:4/996: mknod d0/d8/d19/d98/d9b/d137/c14d 0 2024-01-31T05:13:25.137 INFO:tasks.workunit.client.0.smithi099.stdout:7/956: rmdir d6/d32/d3d/d4b/d33/d37/d50/d25 39 2024-01-31T05:13:25.139 INFO:tasks.workunit.client.0.smithi099.stdout:0/968: dwrite d1/d30/fb2 [0,4194304] 0 2024-01-31T05:13:25.139 INFO:tasks.workunit.client.0.smithi099.stdout:7/957: creat d6/d32/f143 x:0 0 0 2024-01-31T05:13:25.141 INFO:tasks.workunit.client.0.smithi099.stdout:7/958: write d6/d32/d3d/d4b/d33/d37/d50/d25/d7a/ff3 [882319,34553] 0 2024-01-31T05:13:25.142 INFO:tasks.workunit.client.0.smithi099.stdout:7/959: chown d6/d32/d3d/dd7/fbc 7692 1 2024-01-31T05:13:25.143 INFO:tasks.workunit.client.0.smithi099.stdout:7/960: creat d6/d32/d3d/d46/df4/f144 x:0 0 0 2024-01-31T05:13:25.144 INFO:tasks.workunit.client.0.smithi099.stdout:7/961: creat d6/d32/d3d/d4b/d33/d37/d50/d4d/dad/d135/f145 x:0 0 0 2024-01-31T05:13:25.144 INFO:tasks.workunit.client.0.smithi099.stdout:1/818: read d4/dc/d29/f36 [7951262,77653] 0 2024-01-31T05:13:25.145 INFO:tasks.workunit.client.0.smithi099.stdout:5/881: dwrite d6/da/d14/d3d/d57/f97 [0,4194304] 0 2024-01-31T05:13:25.147 INFO:tasks.workunit.client.0.smithi099.stdout:6/752: rename d14/c56 to d14/d18/d52/d90/cf3 0 2024-01-31T05:13:25.147 INFO:tasks.workunit.client.0.smithi099.stdout:6/753: chown d14/d18/d52/d7e/d1c/d29/f2b 58 1 2024-01-31T05:13:25.151 INFO:tasks.workunit.client.0.smithi099.stdout:2/915: write d10/d1c/f85 [4107815,70217] 0 2024-01-31T05:13:25.152 INFO:tasks.workunit.client.0.smithi099.stdout:8/985: dwrite d1/dd/dba/d20/f97 [0,4194304] 0 2024-01-31T05:13:25.152 INFO:tasks.workunit.client.0.smithi099.stdout:3/931: dwrite d10/d27/d34/d44/d60/d75/d8c/db1/f122 [0,4194304] 0 2024-01-31T05:13:25.152 INFO:tasks.workunit.client.0.smithi099.stdout:8/986: chown d1/f5e 117665225 1 2024-01-31T05:13:25.157 INFO:tasks.workunit.client.0.smithi099.stdout:9/886: dread d0/d3e/d87/dc9/d24/d2b/f17 [0,4194304] 0 2024-01-31T05:13:25.164 INFO:tasks.workunit.client.0.smithi099.stdout:0/969: write d1/d37/d73/f7e [578014,81336] 0 2024-01-31T05:13:25.164 INFO:tasks.workunit.client.0.smithi099.stdout:8/987: rename d1/dd/dba/d19/d21/c55 to d1/dd/dba/d19/c144 0 2024-01-31T05:13:25.166 INFO:tasks.workunit.client.0.smithi099.stdout:9/887: mknod d0/d7/d2e/d12e/c13a 0 2024-01-31T05:13:25.166 INFO:tasks.workunit.client.0.smithi099.stdout:9/888: chown d0/d3e/d87/dc9 30821 1 2024-01-31T05:13:25.168 INFO:tasks.workunit.client.0.smithi099.stdout:7/962: read d6/d32/d3d/d4b/d33/d37/d4e/f65 [3367747,35327] 0 2024-01-31T05:13:25.168 INFO:tasks.workunit.client.0.smithi099.stdout:7/963: chown d6/d32/ld6 7487040 1 2024-01-31T05:13:25.169 INFO:tasks.workunit.client.0.smithi099.stdout:8/988: creat d1/dd/d65/d7f/d81/dc4/f145 x:0 0 0 2024-01-31T05:13:25.171 INFO:tasks.workunit.client.0.smithi099.stdout:1/819: write d4/f8d [815543,11121] 0 2024-01-31T05:13:25.172 INFO:tasks.workunit.client.0.smithi099.stdout:0/970: rename d1/d37/d4a/d6f/dc9/dcf/f144 to d1/d30/d45/d66/d97/f152 0 2024-01-31T05:13:25.173 INFO:tasks.workunit.client.0.smithi099.stdout:7/964: symlink d6/d32/d3d/d4b/d33/d37/d4e/l146 0 2024-01-31T05:13:25.173 INFO:tasks.workunit.client.0.smithi099.stdout:8/989: truncate d1/dd/dba/da9/d12b/f133 61696 0 2024-01-31T05:13:25.175 INFO:tasks.workunit.client.0.smithi099.stdout:5/882: dwrite d6/da/d14/d3d/d57/d92/fa7 [0,4194304] 0 2024-01-31T05:13:25.175 INFO:tasks.workunit.client.0.smithi099.stdout:5/883: write d6/da/d14/d61/f84 [1102069,13086] 0 2024-01-31T05:13:25.175 INFO:tasks.workunit.client.0.smithi099.stdout:2/916: dread d10/d1b/d4d/fb3 [0,4194304] 0 2024-01-31T05:13:25.177 INFO:tasks.workunit.client.0.smithi099.stdout:7/965: write d6/d32/d3d/dd7/dc5/fe9 [447461,53074] 0 2024-01-31T05:13:25.179 INFO:tasks.workunit.client.0.smithi099.stdout:7/966: mkdir d6/d32/d3d/d4b/d33/d147 0 2024-01-31T05:13:25.181 INFO:tasks.workunit.client.0.smithi099.stdout:7/967: mknod d6/d32/d3d/d4b/d33/d37/d50/d25/d47/c148 0 2024-01-31T05:13:25.181 INFO:tasks.workunit.client.0.smithi099.stdout:7/968: dread - d6/d32/d3d/d4b/d33/d37/d50/d25/d72/d8e/f10d zero size 2024-01-31T05:13:25.184 INFO:tasks.workunit.client.0.smithi099.stdout:7/969: creat d6/d32/d3d/d4b/d33/d37/dfe/f149 x:0 0 0 2024-01-31T05:13:25.184 INFO:tasks.workunit.client.0.smithi099.stdout:7/970: chown d6/d32/d3d/de6/df1/lc3 5864606 1 2024-01-31T05:13:25.185 INFO:tasks.workunit.client.0.smithi099.stdout:3/932: dwrite d10/d27/d34/d44/d95/daf/f101 [0,4194304] 0 2024-01-31T05:13:25.189 INFO:tasks.workunit.client.0.smithi099.stdout:3/933: creat d10/dfa/d120/f14a x:0 0 0 2024-01-31T05:13:25.190 INFO:tasks.workunit.client.0.smithi099.stdout:6/754: dwrite d14/d18/d52/d7e/d1c/fc3 [0,4194304] 0 2024-01-31T05:13:25.192 INFO:tasks.workunit.client.0.smithi099.stdout:3/934: creat d10/d27/d34/d44/d60/f14b x:0 0 0 2024-01-31T05:13:25.192 INFO:tasks.workunit.client.0.smithi099.stdout:6/755: symlink d14/d18/d52/d22/lf4 0 2024-01-31T05:13:25.192 INFO:tasks.workunit.client.0.smithi099.stdout:3/935: chown d10/d27/d34/d44/d60/d75/d8c/d92/c10b 4326027 1 2024-01-31T05:13:25.192 INFO:tasks.workunit.client.0.smithi099.stdout:6/756: fdatasync d14/d18/d52/d22/d71/dee/d7b/f95 0 2024-01-31T05:13:25.192 INFO:tasks.workunit.client.0.smithi099.stdout:6/757: creat d14/d18/d9d/ff5 x:0 0 0 2024-01-31T05:13:25.192 INFO:tasks.workunit.client.0.smithi099.stdout:6/758: dread - d14/d18/d9d/fc8 zero size 2024-01-31T05:13:25.192 INFO:tasks.workunit.client.0.smithi099.stdout:3/936: write d10/d27/d125/f127 [566041,99581] 0 2024-01-31T05:13:25.193 INFO:tasks.workunit.client.0.smithi099.stdout:6/759: truncate d14/d18/d52/d22/f88 1767577 0 2024-01-31T05:13:25.195 INFO:tasks.workunit.client.0.smithi099.stdout:3/937: dread d10/d27/d34/d44/d95/f76 [0,4194304] 0 2024-01-31T05:13:25.195 INFO:tasks.workunit.client.0.smithi099.stdout:3/938: fsync d10/d1e/f25 0 2024-01-31T05:13:25.196 INFO:tasks.workunit.client.0.smithi099.stdout:6/760: mkdir d14/d18/d52/df6 0 2024-01-31T05:13:25.196 INFO:tasks.workunit.client.0.smithi099.stdout:6/761: fdatasync d14/f16 0 2024-01-31T05:13:25.198 INFO:tasks.workunit.client.0.smithi099.stdout:3/939: unlink d10/f19 0 2024-01-31T05:13:25.199 INFO:tasks.workunit.client.0.smithi099.stdout:3/940: link d10/d32/d85/da3/fc5 d10/d1e/da2/f14c 0 2024-01-31T05:13:25.201 INFO:tasks.workunit.client.0.smithi099.stdout:6/762: rmdir d14/d18/d52/d22/d71/dee/d7b/dd4 39 2024-01-31T05:13:25.203 INFO:tasks.workunit.client.0.smithi099.stdout:6/763: truncate d14/d18/d52/d7e/d66/f9f 2165439 0 2024-01-31T05:13:25.203 INFO:tasks.workunit.client.0.smithi099.stdout:0/971: dwrite d1/d30/d45/f111 [0,4194304] 0 2024-01-31T05:13:25.203 INFO:tasks.workunit.client.0.smithi099.stdout:0/972: write d1/d37/d4a/d7a/f90 [165623,113445] 0 2024-01-31T05:13:25.203 INFO:tasks.workunit.client.0.smithi099.stdout:0/973: dread - d1/fb4 zero size 2024-01-31T05:13:25.205 INFO:tasks.workunit.client.0.smithi099.stdout:0/974: mknod d1/d37/d73/c153 0 2024-01-31T05:13:25.207 INFO:tasks.workunit.client.0.smithi099.stdout:1/820: dwrite d4/df9/f95 [4194304,4194304] 0 2024-01-31T05:13:25.219 INFO:tasks.workunit.client.0.smithi099.stdout:8/990: dwrite d1/dd/dba/d29/d3f/d56/da0/f22 [0,4194304] 0 2024-01-31T05:13:25.220 INFO:tasks.workunit.client.0.smithi099.stdout:5/884: dwrite d6/da/d14/d3d/d57/d92/fa7 [0,4194304] 0 2024-01-31T05:13:25.224 INFO:tasks.workunit.client.0.smithi099.stdout:5/885: creat d6/da/d14/d3d/d51/d82/d9a/d116/f126 x:0 0 0 2024-01-31T05:13:25.224 INFO:tasks.workunit.client.0.smithi099.stdout:5/886: read d6/da/d3f/f9b [8927,15922] 0 2024-01-31T05:13:25.224 INFO:tasks.workunit.client.0.smithi099.stdout:3/941: dwrite d10/d24/f99 [0,4194304] 0 2024-01-31T05:13:25.224 INFO:tasks.workunit.client.0.smithi099.stdout:3/942: truncate d10/d27/d34/d44/d60/f14b 711897 0 2024-01-31T05:13:25.224 INFO:tasks.workunit.client.0.smithi099.stdout:3/943: truncate d10/dfa/d120/fd1 510789 0 2024-01-31T05:13:25.225 INFO:tasks.workunit.client.0.smithi099.stdout:2/917: rename d10/d20/d5b/l11b to d10/d2b/d7c/l122 0 2024-01-31T05:13:25.225 INFO:tasks.workunit.client.0.smithi099.stdout:2/918: fdatasync d10/d1b/f81 0 2024-01-31T05:13:25.225 INFO:tasks.workunit.client.0.smithi099.stdout:2/919: chown d10/d2b/d97/ca8 15280 1 2024-01-31T05:13:25.226 INFO:tasks.workunit.client.0.smithi099.stdout:3/944: symlink d10/d24/d40/d81/l14d 0 2024-01-31T05:13:25.228 INFO:tasks.workunit.client.0.smithi099.stdout:7/971: rename d6/d32/d3d/d4b/d33/d37/d50/d25/d72/cd5 to d6/d98/de3/d140/c14a 0 2024-01-31T05:13:25.230 INFO:tasks.workunit.client.0.smithi099.stdout:7/972: rmdir d6/d32/d3d/d4b/d33/d37/d50/d25/d7a 39 2024-01-31T05:13:25.230 INFO:tasks.workunit.client.0.smithi099.stdout:7/973: truncate d6/d32/d3d/d4b/d33/d37/d50/d4d/f117 660416 0 2024-01-31T05:13:25.231 INFO:tasks.workunit.client.0.smithi099.stdout:3/945: getdents d10/d72 0 2024-01-31T05:13:25.233 INFO:tasks.workunit.client.0.smithi099.stdout:7/974: mknod d6/d32/d3d/d4b/d33/d37/d50/d25/d7a/d104/d114/c14b 0 2024-01-31T05:13:25.235 INFO:tasks.workunit.client.0.smithi099.stdout:1/821: dwrite d4/dc/d48/fe6 [0,4194304] 0 2024-01-31T05:13:25.236 INFO:tasks.workunit.client.0.smithi099.stdout:0/975: dwrite d1/d30/d45/dad/fac [0,4194304] 0 2024-01-31T05:13:25.236 INFO:tasks.workunit.client.0.smithi099.stdout:7/975: mknod d6/d32/d3d/d4b/d33/d37/c14c 0 2024-01-31T05:13:25.236 INFO:tasks.workunit.client.0.smithi099.stdout:7/976: getdents d6/d32/d3d/d4b/d33/d37/d50/d25/d72/d8e/df7/d111 0 2024-01-31T05:13:25.236 INFO:tasks.workunit.client.0.smithi099.stdout:1/822: creat d4/db/d12/dc0/d69/f103 x:0 0 0 2024-01-31T05:13:25.236 INFO:tasks.workunit.client.0.smithi099.stdout:1/823: write d4/dc/d4d/da5/dcf/fea [2148752,56542] 0 2024-01-31T05:13:25.241 INFO:tasks.workunit.client.0.smithi099.stdout:0/976: creat d1/d16/d13c/f154 x:0 0 0 2024-01-31T05:13:25.244 INFO:tasks.workunit.client.0.smithi099.stdout:0/977: symlink d1/d30/d45/dad/l155 0 2024-01-31T05:13:25.249 INFO:tasks.workunit.client.0.smithi099.stdout:3/946: write d10/fbf [2238828,20316] 0 2024-01-31T05:13:25.255 INFO:tasks.workunit.client.0.smithi099.stdout:5/887: dwrite d6/da/d14/d3d/d8c/de6/f8b [4194304,4194304] 0 2024-01-31T05:13:25.255 INFO:tasks.workunit.client.0.smithi099.stdout:2/920: dwrite d10/f33 [0,4194304] 0 2024-01-31T05:13:25.258 INFO:tasks.workunit.client.0.smithi099.stdout:7/977: dwrite d6/d32/d3d/d46/fab [0,4194304] 0 2024-01-31T05:13:25.259 INFO:tasks.workunit.client.0.smithi099.stdout:6/764: rename d14/d18/d52/d7e/d1c/d29/d79/dc6/ccc to d14/d18/d52/d7e/d1c/d29/d79/deb/cf7 0 2024-01-31T05:13:25.259 INFO:tasks.workunit.client.0.smithi099.stdout:6/765: chown d14/d18/d52/d90/fb1 99579 1 2024-01-31T05:13:25.263 INFO:tasks.workunit.client.0.smithi099.stdout:6/766: mknod d14/d18/d52/d22/d71/dee/d7b/dd4/cf8 0 2024-01-31T05:13:25.263 INFO:tasks.workunit.client.0.smithi099.stdout:6/767: stat d14/d18/d52/l6a 0 2024-01-31T05:13:25.267 INFO:tasks.workunit.client.0.smithi099.stdout:0/978: dwrite d1/d8/fa2 [0,4194304] 0 2024-01-31T05:13:25.270 INFO:tasks.workunit.client.0.smithi099.stdout:5/888: dread d6/da/d14/fdb [0,4194304] 0 2024-01-31T05:13:25.271 INFO:tasks.workunit.client.0.smithi099.stdout:5/889: creat d6/da/d14/d3d/d57/dc6/f127 x:0 0 0 2024-01-31T05:13:25.273 INFO:tasks.workunit.client.0.smithi099.stdout:4/997: sync 2024-01-31T05:13:25.273 INFO:tasks.workunit.client.0.smithi099.stdout:9/889: sync 2024-01-31T05:13:25.273 INFO:tasks.workunit.client.0.smithi099.stdout:9/890: chown d0/d7/l54 195044 1 2024-01-31T05:13:25.275 INFO:tasks.workunit.client.0.smithi099.stdout:6/768: write d14/d18/d52/d46/f8d [1166222,76747] 0 2024-01-31T05:13:25.275 INFO:tasks.workunit.client.0.smithi099.stdout:6/769: chown d14/d18/l7c 60 1 2024-01-31T05:13:25.281 INFO:tasks.workunit.client.0.smithi099.stdout:2/921: write d10/d1b/d4d/f84 [1492498,35808] 0 2024-01-31T05:13:25.282 INFO:tasks.workunit.client.0.smithi099.stdout:3/947: dwrite d10/d27/d34/f5c [4194304,4194304] 0 2024-01-31T05:13:25.284 INFO:tasks.workunit.client.0.smithi099.stdout:7/978: dwrite d6/d32/d3d/d46/f83 [0,4194304] 0 2024-01-31T05:13:25.284 INFO:tasks.workunit.client.0.smithi099.stdout:7/979: readlink d6/d32/d3d/d4b/d33/d37/d50/d25/d72/d8e/df7/l108 0 2024-01-31T05:13:25.284 INFO:tasks.workunit.client.0.smithi099.stdout:3/948: truncate d10/dfa/d120/f7d 5445811 0 2024-01-31T05:13:25.287 INFO:tasks.workunit.client.0.smithi099.stdout:3/949: mkdir d10/d27/d34/d50/d14e 0 2024-01-31T05:13:25.287 INFO:tasks.workunit.client.0.smithi099.stdout:7/980: symlink d6/d32/d3d/dd7/dc5/l14d 0 2024-01-31T05:13:25.287 INFO:tasks.workunit.client.0.smithi099.stdout:6/770: dread d14/f17 [0,4194304] 0 2024-01-31T05:13:25.287 INFO:tasks.workunit.client.0.smithi099.stdout:6/771: chown d14/d18/d52/d7e/d1c/cb8 36485 1 2024-01-31T05:13:25.287 INFO:tasks.workunit.client.0.smithi099.stdout:6/772: readlink d14/d18/d52/d7e/lb9 0 2024-01-31T05:13:25.287 INFO:tasks.workunit.client.0.smithi099.stdout:6/773: write d14/d18/d52/d7e/d66/fe1 [791101,94430] 0 2024-01-31T05:13:25.287 INFO:tasks.workunit.client.0.smithi099.stdout:6/774: chown d14/d18/d52/d22/d71/dee/d7b/f95 54689562 1 2024-01-31T05:13:25.289 INFO:tasks.workunit.client.0.smithi099.stdout:6/775: mkdir d14/df9 0 2024-01-31T05:13:25.290 INFO:tasks.workunit.client.0.smithi099.stdout:8/991: rename d1/dd/d4f/d51/d83/ffe to d1/dd/d65/d7f/d81/dc7/f146 0 2024-01-31T05:13:25.290 INFO:tasks.workunit.client.0.smithi099.stdout:7/981: rmdir d6/d32/d3d/d4b/d33/d37/d50/d25/d79/d121 39 2024-01-31T05:13:25.293 INFO:tasks.workunit.client.0.smithi099.stdout:0/979: rename d1/d37/d4a/d7a/d7d/fba to d1/d30/d45/d66/d97/f156 0 2024-01-31T05:13:25.293 INFO:tasks.workunit.client.0.smithi099.stdout:0/980: write d1/d30/d45/d66/d97/d146/fd4 [896635,107380] 0 2024-01-31T05:13:25.294 INFO:tasks.workunit.client.0.smithi099.stdout:5/890: rename d6/da/d14/d3d/da8/l103 to d6/da/d14/d3d/d6e/l128 0 2024-01-31T05:13:25.295 INFO:tasks.workunit.client.0.smithi099.stdout:5/891: truncate f1 634236 0 2024-01-31T05:13:25.295 INFO:tasks.workunit.client.0.smithi099.stdout:5/892: chown d6/da/d14/d61/d98/d106/d81/cc4 6902135 1 2024-01-31T05:13:25.297 INFO:tasks.workunit.client.0.smithi099.stdout:5/893: unlink d6/da/d14/c72 0 2024-01-31T05:13:25.297 INFO:tasks.workunit.client.0.smithi099.stdout:5/894: stat d6/da/d14/d3d/lfa 0 2024-01-31T05:13:25.297 INFO:tasks.workunit.client.0.smithi099.stdout:5/895: stat d6/da/d14 0 2024-01-31T05:13:25.297 INFO:tasks.workunit.client.0.smithi099.stdout:5/896: fdatasync d6/da/d3f/f9b 0 2024-01-31T05:13:25.301 INFO:tasks.workunit.client.0.smithi099.stdout:7/982: write d6/d32/d3d/d4b/d33/d37/d50/d25/d79/f8c [5521188,41202] 0 2024-01-31T05:13:25.305 INFO:tasks.workunit.client.0.smithi099.stdout:6/776: write d14/f15 [4621635,33970] 0 2024-01-31T05:13:25.309 INFO:tasks.workunit.client.0.smithi099.stdout:9/891: dwrite d0/d5d/fb4 [0,4194304] 0 2024-01-31T05:13:25.311 INFO:tasks.workunit.client.0.smithi099.stdout:8/992: read d1/dd/dba/d29/f58 [1550657,107409] 0 2024-01-31T05:13:25.312 INFO:tasks.workunit.client.0.smithi099.stdout:8/993: write d1/dd/d4f/f114 [705991,12664] 0 2024-01-31T05:13:25.312 INFO:tasks.workunit.client.0.smithi099.stdout:4/998: dwrite d0/d2/d4b/d93/d17/d7d/db2/dc7/dcc/f12f [0,4194304] 0 2024-01-31T05:13:25.312 INFO:tasks.workunit.client.0.smithi099.stdout:4/999: dread - d0/d2/d4b/d93/d59/dff/d43/f7e zero size 2024-01-31T05:13:25.313 INFO:tasks.workunit.client.0.smithi099.stdout:9/892: mkdir d0/d3e/d87/dc9/d5e/d72/d89/d98/d13b 0 2024-01-31T05:13:25.319 INFO:tasks.workunit.client.0.smithi099.stdout:8/994: mknod d1/dd/dba/d29/d3f/d56/da0/d111/c147 0 2024-01-31T05:13:25.319 INFO:tasks.workunit.client.0.smithi099.stdout:8/995: truncate d1/dd/dba/da9/d104/d13d/f125 329045 0 2024-01-31T05:13:25.321 INFO:tasks.workunit.client.0.smithi099.stdout:0/981: dwrite d1/d37/f96 [0,4194304] 0 2024-01-31T05:13:25.321 INFO:tasks.workunit.client.0.smithi099.stdout:0/982: chown d1/d37/d4a/d7a/f46 0 1 2024-01-31T05:13:25.322 INFO:tasks.workunit.client.0.smithi099.stdout:9/893: creat d0/d3e/d87/dc9/d5e/de0/d130/d133/f13c x:0 0 0 2024-01-31T05:13:25.328 INFO:tasks.workunit.client.0.smithi099.stdout:2/922: rename d10/d1b/d83/d86/d95/ff6 to d10/d2b/d58/f123 0 2024-01-31T05:13:25.331 INFO:tasks.workunit.client.0.smithi099.stdout:0/983: creat d1/d64/f157 x:0 0 0 2024-01-31T05:13:25.334 INFO:tasks.workunit.client.0.smithi099.stdout:5/897: rename d6/da/d14/d61/d98/da0/dd0 to d6/da/d14/d3d/da8/d129 0 2024-01-31T05:13:25.334 INFO:tasks.workunit.client.0.smithi099.stdout:5/898: write d6/da/f56 [2205654,85714] 0 2024-01-31T05:13:25.334 INFO:tasks.workunit.client.0.smithi099.stdout:7/983: dwrite d6/d32/d3d/d46/df4/f144 [0,4194304] 0 2024-01-31T05:13:25.334 INFO:tasks.workunit.client.0.smithi099.stdout:6/777: dwrite d14/d18/d52/d7e/d1c/f34 [0,4194304] 0 2024-01-31T05:13:25.335 INFO:tasks.workunit.client.0.smithi099.stdout:0/984: symlink d1/d30/d45/d66/d97/l158 0 2024-01-31T05:13:25.336 INFO:tasks.workunit.client.0.smithi099.stdout:8/996: write d1/dd/dba/d29/f2a [2880324,20646] 0 2024-01-31T05:13:25.337 INFO:tasks.workunit.client.0.smithi099.stdout:5/899: mkdir d6/da/d14/d61/d98/da0/d11f/d12a 0 2024-01-31T05:13:25.340 INFO:tasks.workunit.client.0.smithi099.stdout:6/778: unlink d14/d18/d52/l5c 0 2024-01-31T05:13:25.340 INFO:tasks.workunit.client.0.smithi099.stdout:6/779: truncate d14/d18/d52/d7e/d1c/da6/fed 308407 0 2024-01-31T05:13:25.340 INFO:tasks.workunit.client.0.smithi099.stdout:6/780: dread - d14/d18/d9d/fb5 zero size 2024-01-31T05:13:25.340 INFO:tasks.workunit.client.0.smithi099.stdout:7/984: unlink d6/d98/ca4 0 2024-01-31T05:13:25.340 INFO:tasks.workunit.client.0.smithi099.stdout:7/985: chown d6/d32/d3d/d4b/d33/d37/d50/d25/d47/l56 64839788 1 2024-01-31T05:13:25.342 INFO:tasks.workunit.client.0.smithi099.stdout:5/900: creat d6/da/ddf/f12b x:0 0 0 2024-01-31T05:13:25.343 INFO:tasks.workunit.client.0.smithi099.stdout:6/781: dread d14/d18/f6c [0,4194304] 0 2024-01-31T05:13:25.343 INFO:tasks.workunit.client.0.smithi099.stdout:6/782: chown d14/d18/d52/d22/l4c 4 1 2024-01-31T05:13:25.343 INFO:tasks.workunit.client.0.smithi099.stdout:7/986: mkdir d6/d32/d3d/d4b/d33/d37/d14e 0 2024-01-31T05:13:25.344 INFO:tasks.workunit.client.0.smithi099.stdout:5/901: mknod d6/da/c12c 0 2024-01-31T05:13:25.345 INFO:tasks.workunit.client.0.smithi099.stdout:6/783: unlink d14/d18/d52/d7e/d1c/d29/d4f/f6e 0 2024-01-31T05:13:25.346 INFO:tasks.workunit.client.0.smithi099.stdout:5/902: truncate d6/da/d14/d3d/d6e/ffb 4148270 0 2024-01-31T05:13:25.348 INFO:tasks.workunit.client.0.smithi099.stdout:7/987: truncate d6/d32/d3d/d46/df4/f144 1799590 0 2024-01-31T05:13:25.350 INFO:tasks.workunit.client.0.smithi099.stdout:5/903: rename d6/da/d14/d61/def/df4 to d6/da/d14/d2b/d12d 0 2024-01-31T05:13:25.360 INFO:tasks.workunit.client.0.smithi099.stdout:8/997: dread d1/dd/dba/d29/d3f/d56/da0/f3d [0,4194304] 0 2024-01-31T05:13:25.360 INFO:tasks.workunit.client.0.smithi099.stdout:8/998: write d1/dd/dba/d29/d3f/d56/da0/d2e/f141 [762199,127878] 0 2024-01-31T05:13:25.373 INFO:tasks.workunit.client.0.smithi099.stdout:8/999: read d1/dd/dba/d29/d3f/d56/da0/d2e/de1/fe3 [3196178,13391] 0 2024-01-31T05:13:25.377 INFO:tasks.workunit.client.0.smithi099.stdout:9/894: dwrite d0/d3e/d33/dab/fe1 [0,4194304] 0 2024-01-31T05:13:25.377 INFO:tasks.workunit.client.0.smithi099.stdout:6/784: dwrite d14/d18/d52/d7e/d1c/da6/fe4 [0,4194304] 0 2024-01-31T05:13:25.378 INFO:tasks.workunit.client.0.smithi099.stdout:6/785: mknod d14/d18/d52/d7e/ddd/cfa 0 2024-01-31T05:13:25.379 INFO:tasks.workunit.client.0.smithi099.stdout:6/786: dread - d14/d18/d9d/fbe zero size 2024-01-31T05:13:25.379 INFO:tasks.workunit.client.0.smithi099.stdout:9/895: creat d0/d3e/d87/dc9/d24/d2b/d63/da7/daa/f13d x:0 0 0 2024-01-31T05:13:25.379 INFO:tasks.workunit.client.0.smithi099.stdout:9/896: write d0/d3e/d33/fa8 [726652,103233] 0 2024-01-31T05:13:25.379 INFO:tasks.workunit.client.0.smithi099.stdout:6/787: dread d14/d18/d52/d90/fb1 [0,4194304] 0 2024-01-31T05:13:25.380 INFO:tasks.workunit.client.0.smithi099.stdout:6/788: mknod d14/d18/d52/d7e/ddd/cfb 0 2024-01-31T05:13:25.381 INFO:tasks.workunit.client.0.smithi099.stdout:7/988: dwrite d6/d32/d3d/d4b/d33/d37/d50/d25/f4c [0,4194304] 0 2024-01-31T05:13:25.381 INFO:tasks.workunit.client.0.smithi099.stdout:2/923: dwrite d10/d1c/f85 [0,4194304] 0 2024-01-31T05:13:25.381 INFO:tasks.workunit.client.0.smithi099.stdout:0/985: dwrite d1/d30/d45/d6e/f116 [0,4194304] 0 2024-01-31T05:13:25.382 INFO:tasks.workunit.client.0.smithi099.stdout:5/904: dwrite d6/da/d14/d61/d98/da0/d11f/fe1 [0,4194304] 0 2024-01-31T05:13:25.382 INFO:tasks.workunit.client.0.smithi099.stdout:7/989: chown d6/d32/d3d/d4b/d33/d37/d50/d25/d72/d8e/c9c 3 1 2024-01-31T05:13:25.390 INFO:tasks.workunit.client.0.smithi099.stdout:5/905: mknod d6/da/d14/d61/d98/c12e 0 2024-01-31T05:13:25.391 INFO:tasks.workunit.client.0.smithi099.stdout:7/990: symlink d6/d98/de3/d13e/l14f 0 2024-01-31T05:13:25.393 INFO:tasks.workunit.client.0.smithi099.stdout:9/897: dread d0/d3e/d87/f10a [0,4194304] 0 2024-01-31T05:13:25.394 INFO:tasks.workunit.client.0.smithi099.stdout:5/906: rename d6/da/dd5/l109 to d6/da/d14/de7/l12f 0 2024-01-31T05:13:25.394 INFO:tasks.workunit.client.0.smithi099.stdout:5/907: chown d6/da/d14/d3d/d51/d82/ff5 39665001 1 2024-01-31T05:13:25.395 INFO:tasks.workunit.client.0.smithi099.stdout:7/991: symlink d6/d32/d3d/d46/l150 0 2024-01-31T05:13:25.396 INFO:tasks.workunit.client.0.smithi099.stdout:0/986: dread d1/d8/f5f [0,4194304] 0 2024-01-31T05:13:25.396 INFO:tasks.workunit.client.0.smithi099.stdout:9/898: mknod d0/d3e/d87/dc9/d5e/d72/d89/d98/c13e 0 2024-01-31T05:13:25.397 INFO:tasks.workunit.client.0.smithi099.stdout:5/908: creat d6/da/d14/d61/d98/d106/f130 x:0 0 0 2024-01-31T05:13:25.398 INFO:tasks.workunit.client.0.smithi099.stdout:7/992: getdents d6/d32/d3d/d4b/d33/d37/d50/d4d/dad/daf 0 2024-01-31T05:13:25.399 INFO:tasks.workunit.client.0.smithi099.stdout:0/987: creat d1/d30/d45/dad/db1/f159 x:0 0 0 2024-01-31T05:13:25.399 INFO:tasks.workunit.client.0.smithi099.stdout:0/988: chown d1/d37/d4a/d6f/l98 469646 1 2024-01-31T05:13:25.400 INFO:tasks.workunit.client.0.smithi099.stdout:1/824: sync 2024-01-31T05:13:25.400 INFO:tasks.workunit.client.0.smithi099.stdout:9/899: symlink d0/d3e/d87/dc9/d5e/de0/d130/d133/l13f 0 2024-01-31T05:13:25.401 INFO:tasks.workunit.client.0.smithi099.stdout:6/789: dwrite d14/d18/d52/d7e/d1c/f34 [4194304,4194304] 0 2024-01-31T05:13:25.402 INFO:tasks.workunit.client.0.smithi099.stdout:6/790: chown lb 0 1 2024-01-31T05:13:25.402 INFO:tasks.workunit.client.0.smithi099.stdout:7/993: creat d6/d32/d3d/d4b/d33/d37/d50/d25/d7a/d104/f151 x:0 0 0 2024-01-31T05:13:25.402 INFO:tasks.workunit.client.0.smithi099.stdout:3/950: sync 2024-01-31T05:13:25.402 INFO:tasks.workunit.client.0.smithi099.stdout:6/791: readlink d14/d18/d52/d7e/d1c/d29/d79/deb/lcf 0 2024-01-31T05:13:25.402 INFO:tasks.workunit.client.0.smithi099.stdout:1/825: mkdir d4/dc/d48/d104 0 2024-01-31T05:13:25.402 INFO:tasks.workunit.client.0.smithi099.stdout:1/826: chown d4/dc/d15/d45/c63 32515020 1 2024-01-31T05:13:25.404 INFO:tasks.workunit.client.0.smithi099.stdout:9/900: creat d0/d3e/d87/dc9/d5e/d72/dbf/dd1/f140 x:0 0 0 2024-01-31T05:13:25.404 INFO:tasks.workunit.client.0.smithi099.stdout:9/901: stat d0/d3e/d87/dc9/d5e/ddb/c116 0 2024-01-31T05:13:25.405 INFO:tasks.workunit.client.0.smithi099.stdout:7/994: rmdir d6/d32/d3d/d4b/d33/d37/d50/d25/d72/d8e/d9a 39 2024-01-31T05:13:25.406 INFO:tasks.workunit.client.0.smithi099.stdout:3/951: chown d10/d32/d33/d51/l139 9893 1 2024-01-31T05:13:25.406 INFO:tasks.workunit.client.0.smithi099.stdout:3/952: dread - d10/d27/d89/f119 zero size 2024-01-31T05:13:25.406 INFO:tasks.workunit.client.0.smithi099.stdout:7/995: stat d6/d98/de3/d140/c14a 0 2024-01-31T05:13:25.408 INFO:tasks.workunit.client.0.smithi099.stdout:3/953: mkdir d10/d32/d14f 0 2024-01-31T05:13:25.409 INFO:tasks.workunit.client.0.smithi099.stdout:7/996: dread d6/d32/d3d/dd7/dc5/fe9 [0,4194304] 0 2024-01-31T05:13:25.409 INFO:tasks.workunit.client.0.smithi099.stdout:7/997: write d6/d32/d3d/d4b/d33/d37/f105 [239885,99148] 0 2024-01-31T05:13:25.411 INFO:tasks.workunit.client.0.smithi099.stdout:6/792: getdents d14/d18/d52/d22/d71/dee 0 2024-01-31T05:13:25.411 INFO:tasks.workunit.client.0.smithi099.stdout:0/989: dread d1/d37/d4a/d6f/dc9/dcf/fde [0,4194304] 0 2024-01-31T05:13:25.414 INFO:tasks.workunit.client.0.smithi099.stdout:3/954: mkdir d10/d32/d150 0 2024-01-31T05:13:25.417 INFO:tasks.workunit.client.0.smithi099.stdout:6/793: creat d14/d18/d9d/de6/ffc x:0 0 0 2024-01-31T05:13:25.419 INFO:tasks.workunit.client.0.smithi099.stdout:6/794: mkdir d14/d18/d52/d46/dfd 0 2024-01-31T05:13:25.419 INFO:tasks.workunit.client.0.smithi099.stdout:6/795: truncate d14/d18/d9d/ff5 422066 0 2024-01-31T05:13:25.419 INFO:tasks.workunit.client.0.smithi099.stdout:6/796: creat d14/d18/d9d/ffe x:0 0 0 2024-01-31T05:13:25.420 INFO:tasks.workunit.client.0.smithi099.stdout:6/797: rename d14/d18/d52/d22/lf4 to d14/d18/d52/dbc/lff 0 2024-01-31T05:13:25.421 INFO:tasks.workunit.client.0.smithi099.stdout:0/990: mknod d1/d56/c15a 0 2024-01-31T05:13:25.421 INFO:tasks.workunit.client.0.smithi099.stdout:0/991: read - d1/d64/ded/f14c zero size 2024-01-31T05:13:25.421 INFO:tasks.workunit.client.0.smithi099.stdout:0/992: write d1/d37/d4a/d7a/d7d/fea [98801,124485] 0 2024-01-31T05:13:25.424 INFO:tasks.workunit.client.0.smithi099.stdout:3/955: getdents d10/d27/d34/d44/d60/d75/d8c 0 2024-01-31T05:13:25.425 INFO:tasks.workunit.client.0.smithi099.stdout:6/798: creat d14/d18/d52/d22/d71/dee/d7b/dd4/f100 x:0 0 0 2024-01-31T05:13:25.427 INFO:tasks.workunit.client.0.smithi099.stdout:0/993: mknod d1/d56/c15b 0 2024-01-31T05:13:25.427 INFO:tasks.workunit.client.0.smithi099.stdout:6/799: creat d14/d18/d52/dbc/de8/f101 x:0 0 0 2024-01-31T05:13:25.427 INFO:tasks.workunit.client.0.smithi099.stdout:6/800: chown d14/d18/d52/d22/d71/dee 2128566629 1 2024-01-31T05:13:25.428 INFO:tasks.workunit.client.0.smithi099.stdout:0/994: symlink d1/d37/d4a/d6f/dc9/deb/d14b/l15c 0 2024-01-31T05:13:25.428 INFO:tasks.workunit.client.0.smithi099.stdout:0/995: fdatasync d1/d37/d4a/d6f/dc9/dcf/f105 0 2024-01-31T05:13:25.428 INFO:tasks.workunit.client.0.smithi099.stdout:0/996: truncate d1/d56/faf 385216 0 2024-01-31T05:13:25.429 INFO:tasks.workunit.client.0.smithi099.stdout:0/997: getdents d1/d37 0 2024-01-31T05:13:25.430 INFO:tasks.workunit.client.0.smithi099.stdout:0/998: write d1/d37/d4a/d7a/f90 [379523,125490] 0 2024-01-31T05:13:25.431 INFO:tasks.workunit.client.0.smithi099.stdout:9/902: dwrite d0/d3e/d87/dc9/d5e/d72/d89/feb [0,4194304] 0 2024-01-31T05:13:25.432 INFO:tasks.workunit.client.0.smithi099.stdout:0/999: dread d1/d37/f87 [0,4194304] 0 2024-01-31T05:13:25.433 INFO:tasks.workunit.client.0.smithi099.stdout:1/827: dwrite d4/db/d12/dc0/d4b/d50/d91/f99 [0,4194304] 0 2024-01-31T05:13:25.434 INFO:tasks.workunit.client.0.smithi099.stdout:9/903: creat d0/f141 x:0 0 0 2024-01-31T05:13:25.435 INFO:tasks.workunit.client.0.smithi099.stdout:1/828: creat d4/dc/d15/dc1/f105 x:0 0 0 2024-01-31T05:13:25.436 INFO:tasks.workunit.client.0.smithi099.stdout:1/829: dread - d4/db/d12/dc0/d4b/d9a/dc7/f101 zero size 2024-01-31T05:13:25.436 INFO:tasks.workunit.client.0.smithi099.stdout:1/830: write d4/db/d12/dc0/f41 [157685,50997] 0 2024-01-31T05:13:25.436 INFO:tasks.workunit.client.0.smithi099.stdout:1/831: creat d4/db/d3a/d7e/f106 x:0 0 0 2024-01-31T05:13:25.439 INFO:tasks.workunit.client.0.smithi099.stdout:1/832: creat d4/dc/f107 x:0 0 0 2024-01-31T05:13:25.440 INFO:tasks.workunit.client.0.smithi099.stdout:3/956: dread d10/d24/d40/f82 [0,4194304] 0 2024-01-31T05:13:25.440 INFO:tasks.workunit.client.0.smithi099.stdout:3/957: read - d10/d1e/da2/f14c zero size 2024-01-31T05:13:25.442 INFO:tasks.workunit.client.0.smithi099.stdout:3/958: truncate d10/d1e/f6c 223522 0 2024-01-31T05:13:25.442 INFO:tasks.workunit.client.0.smithi099.stdout:3/959: truncate ff 2826488 0 2024-01-31T05:13:25.442 INFO:tasks.workunit.client.0.smithi099.stdout:3/960: creat d10/d27/d89/f151 x:0 0 0 2024-01-31T05:13:25.444 INFO:tasks.workunit.client.0.smithi099.stdout:3/961: mkdir d10/d27/d34/d44/d60/d75/d8c/d152 0 2024-01-31T05:13:25.445 INFO:tasks.workunit.client.0.smithi099.stdout:3/962: chown d10/d27/d34/d44/d60/d75/d8c/dff 755273 1 2024-01-31T05:13:25.445 INFO:tasks.workunit.client.0.smithi099.stdout:3/963: stat d10/d32/cf8 0 2024-01-31T05:13:25.452 INFO:tasks.workunit.client.0.smithi099.stdout:3/964: dread d10/d27/d34/d44/d60/fa8 [0,4194304] 0 2024-01-31T05:13:25.454 INFO:tasks.workunit.client.0.smithi099.stdout:3/965: creat d10/d27/d34/d50/d12f/f153 x:0 0 0 2024-01-31T05:13:25.456 INFO:tasks.workunit.client.0.smithi099.stdout:3/966: unlink d10/d1e/da2/l103 0 2024-01-31T05:13:25.456 INFO:tasks.workunit.client.0.smithi099.stdout:3/967: dread - d10/d32/d85/da3/fc5 zero size 2024-01-31T05:13:25.460 INFO:tasks.workunit.client.0.smithi099.stdout:3/968: link d10/d32/l10e d10/d27/d34/d111/d115/l154 0 2024-01-31T05:13:25.461 INFO:tasks.workunit.client.0.smithi099.stdout:3/969: getdents d10/d27/d34/d44/d95 0 2024-01-31T05:13:25.466 INFO:tasks.workunit.client.0.smithi099.stdout:3/970: dread d10/d27/d34/d44/d95/fd2 [0,4194304] 0 2024-01-31T05:13:25.467 INFO:tasks.workunit.client.0.smithi099.stdout:3/971: creat d10/d27/d34/d50/d12f/f155 x:0 0 0 2024-01-31T05:13:25.467 INFO:tasks.workunit.client.0.smithi099.stdout:3/972: write d10/d27/d34/d44/f118 [785525,78662] 0 2024-01-31T05:13:25.468 INFO:tasks.workunit.client.0.smithi099.stdout:3/973: creat d10/d32/d85/da3/f156 x:0 0 0 2024-01-31T05:13:25.468 INFO:tasks.workunit.client.0.smithi099.stdout:3/974: truncate d10/d24/f145 70090 0 2024-01-31T05:13:25.469 INFO:tasks.workunit.client.0.smithi099.stdout:3/975: stat d10/d32/d85/d77/ced 0 2024-01-31T05:13:25.469 INFO:tasks.workunit.client.0.smithi099.stdout:3/976: creat d10/d27/d34/d44/d60/d75/d8c/db0/f157 x:0 0 0 2024-01-31T05:13:25.469 INFO:tasks.workunit.client.0.smithi099.stdout:3/977: chown d10/dfa/d120/f7d 3 1 2024-01-31T05:13:25.470 INFO:tasks.workunit.client.0.smithi099.stdout:7/998: dwrite d6/d32/d3d/f4a [0,4194304] 0 2024-01-31T05:13:25.470 INFO:tasks.workunit.client.0.smithi099.stdout:9/904: dwrite d0/d3e/d87/dc9/d24/d48/f9f [0,4194304] 0 2024-01-31T05:13:25.470 INFO:tasks.workunit.client.0.smithi099.stdout:3/978: creat d10/d32/d33/d51/d12c/f158 x:0 0 0 2024-01-31T05:13:25.471 INFO:tasks.workunit.client.0.smithi099.stdout:7/999: mkdir d6/d12/d152 0 2024-01-31T05:13:25.473 INFO:tasks.workunit.client.0.smithi099.stdout:9/905: dread d0/d3e/d87/dc9/d5e/d72/dbf/f108 [0,4194304] 0 2024-01-31T05:13:25.473 INFO:tasks.workunit.client.0.smithi099.stdout:9/906: creat d0/d3e/d87/dc9/d5e/d72/dbf/f142 x:0 0 0 2024-01-31T05:13:25.481 INFO:tasks.workunit.client.0.smithi099.stdout:6/801: rename d14/d18/d52/dbc/de8/f101 to d14/d18/d52/d22/d71/dee/d7b/dd4/f102 0 2024-01-31T05:13:25.481 INFO:tasks.workunit.client.0.smithi099.stdout:6/802: dread - d14/d18/d52/d7e/d1c/d29/d79/fda zero size 2024-01-31T05:13:25.482 INFO:tasks.workunit.client.0.smithi099.stdout:9/907: write d0/d5d/db6/fbb [1256852,56195] 0 2024-01-31T05:13:25.484 INFO:tasks.workunit.client.0.smithi099.stdout:2/924: sync 2024-01-31T05:13:25.485 INFO:tasks.workunit.client.0.smithi099.stdout:2/925: readlink d10/d1c/d43/db8/ld9 0 2024-01-31T05:13:25.489 INFO:tasks.workunit.client.0.smithi099.stdout:2/926: unlink d10/d2b/d58/f123 0 2024-01-31T05:13:25.492 INFO:tasks.workunit.client.0.smithi099.stdout:2/927: mkdir d10/d1c/d43/db8/d11e/d124 0 2024-01-31T05:13:25.492 INFO:tasks.workunit.client.0.smithi099.stdout:2/928: write d10/d1c/d43/fc6 [564886,107032] 0 2024-01-31T05:13:25.492 INFO:tasks.workunit.client.0.smithi099.stdout:2/929: readlink d10/d20/d5b/l77 0 2024-01-31T05:13:25.494 INFO:tasks.workunit.client.0.smithi099.stdout:6/803: write d14/d18/d52/d22/d71/f72 [4364597,41688] 0 2024-01-31T05:13:25.502 INFO:tasks.workunit.client.0.smithi099.stdout:9/908: dwrite d0/d3e/d87/dc9/d24/d2b/d63/da7/daa/fc0 [4194304,4194304] 0 2024-01-31T05:13:25.506 INFO:tasks.workunit.client.0.smithi099.stdout:1/833: rename d4/db/d12/dc0/d4b/d9a/dc7/ld5 to d4/dc/d29/daa/l108 0 2024-01-31T05:13:25.508 INFO:tasks.workunit.client.0.smithi099.stdout:3/979: rename d10/d27/d34/d50 to d10/d27/d34/d44/d60/d75/d8c/d159 0 2024-01-31T05:13:25.509 INFO:tasks.workunit.client.0.smithi099.stdout:9/909: rename d0/d3e/l128 to d0/d3e/d87/dc9/d24/d2b/l143 0 2024-01-31T05:13:25.510 INFO:tasks.workunit.client.0.smithi099.stdout:9/910: read d0/d5d/def/f10e [429886,32329] 0 2024-01-31T05:13:25.512 INFO:tasks.workunit.client.0.smithi099.stdout:3/980: unlink d10/d27/d34/d44/d95/daf/fc7 0 2024-01-31T05:13:25.526 INFO:tasks.workunit.client.0.smithi099.stdout:9/911: unlink d0/d3e/d87/dc9/d5e/c8c 0 2024-01-31T05:13:25.526 INFO:tasks.workunit.client.0.smithi099.stdout:9/912: rmdir d0/d3e/d87/dc9/d24/d48 39 2024-01-31T05:13:25.528 INFO:tasks.workunit.client.0.smithi099.stdout:9/913: symlink d0/d3e/d87/dc9/d24/d48/l144 0 2024-01-31T05:13:25.534 INFO:tasks.workunit.client.0.smithi099.stdout:6/804: dwrite d14/d18/d52/d7e/d1c/f8f [0,4194304] 0 2024-01-31T05:13:25.542 INFO:tasks.workunit.client.0.smithi099.stdout:3/981: dwrite d10/d32/d33/d51/f135 [0,4194304] 0 2024-01-31T05:13:25.542 INFO:tasks.workunit.client.0.smithi099.stdout:3/982: write d10/d27/d34/d44/d60/d75/d8c/d159/d12f/f153 [360541,77878] 0 2024-01-31T05:13:25.544 INFO:tasks.workunit.client.0.smithi099.stdout:1/834: rename d4/db/d12/dc0/d4b/d9a/dc7/fe7 to d4/dc/d4d/da5/f109 0 2024-01-31T05:13:25.544 INFO:tasks.workunit.client.0.smithi099.stdout:5/909: sync 2024-01-31T05:13:25.544 INFO:tasks.workunit.client.0.smithi099.stdout:6/805: link d14/d18/d52/fd6 d14/d18/d52/d7e/d1c/da6/dba/f103 0 2024-01-31T05:13:25.546 INFO:tasks.workunit.client.0.smithi099.stdout:1/835: creat d4/db/d12/dc0/d4b/de3/f10a x:0 0 0 2024-01-31T05:13:25.546 INFO:tasks.workunit.client.0.smithi099.stdout:3/983: link d10/d32/d85/f11c d10/d24/d40/d81/f15a 0 2024-01-31T05:13:25.546 INFO:tasks.workunit.client.0.smithi099.stdout:1/836: creat d4/dc/d48/d104/f10b x:0 0 0 2024-01-31T05:13:25.548 INFO:tasks.workunit.client.0.smithi099.stdout:3/984: mknod d10/d32/d33/c15b 0 2024-01-31T05:13:25.548 INFO:tasks.workunit.client.0.smithi099.stdout:3/985: creat d10/d27/d34/f15c x:0 0 0 2024-01-31T05:13:25.548 INFO:tasks.workunit.client.0.smithi099.stdout:3/986: write d10/d27/d34/d44/d60/d75/d8c/faa [9217756,130407] 0 2024-01-31T05:13:25.548 INFO:tasks.workunit.client.0.smithi099.stdout:1/837: symlink d4/dc/d29/l10c 0 2024-01-31T05:13:25.549 INFO:tasks.workunit.client.0.smithi099.stdout:3/987: mkdir d10/d1e/da2/d15d 0 2024-01-31T05:13:25.550 INFO:tasks.workunit.client.0.smithi099.stdout:1/838: creat d4/db/d12/d74/f10d x:0 0 0 2024-01-31T05:13:25.551 INFO:tasks.workunit.client.0.smithi099.stdout:3/988: creat d10/d32/f15e x:0 0 0 2024-01-31T05:13:25.552 INFO:tasks.workunit.client.0.smithi099.stdout:3/989: symlink d10/d27/d34/d44/d95/daf/l15f 0 2024-01-31T05:13:25.574 INFO:tasks.workunit.client.0.smithi099.stdout:6/806: dwrite d14/d18/d52/d7e/d1c/da6/dba/f103 [0,4194304] 0 2024-01-31T05:13:25.574 INFO:tasks.workunit.client.0.smithi099.stdout:3/990: dwrite d10/d27/d34/d44/f118 [0,4194304] 0 2024-01-31T05:13:25.575 INFO:tasks.workunit.client.0.smithi099.stdout:3/991: chown d10/d27/d89/cac 10 1 2024-01-31T05:13:25.577 INFO:tasks.workunit.client.0.smithi099.stdout:6/807: mknod d14/d18/d52/dbc/c104 0 2024-01-31T05:13:25.577 INFO:tasks.workunit.client.0.smithi099.stdout:3/992: mknod d10/d27/d34/d44/d60/d75/d8c/d10f/c160 0 2024-01-31T05:13:25.578 INFO:tasks.workunit.client.0.smithi099.stdout:6/808: chown d14/d18/d52/d7e/d1c/d29/c2a 13850351 1 2024-01-31T05:13:25.579 INFO:tasks.workunit.client.0.smithi099.stdout:6/809: creat d14/d18/d52/d7e/d1c/f105 x:0 0 0 2024-01-31T05:13:25.580 INFO:tasks.workunit.client.0.smithi099.stdout:6/810: mknod d14/d18/d52/d7e/d1c/d29/d43/c106 0 2024-01-31T05:13:25.581 INFO:tasks.workunit.client.0.smithi099.stdout:6/811: creat d14/d18/d52/d7e/d1c/d29/d79/deb/f107 x:0 0 0 2024-01-31T05:13:25.582 INFO:tasks.workunit.client.0.smithi099.stdout:1/839: rename d4/dc/d4d/d5d/d87/d56 to d4/db/d10e 0 2024-01-31T05:13:25.582 INFO:tasks.workunit.client.0.smithi099.stdout:6/812: mkdir d14/d18/d52/d22/d108 0 2024-01-31T05:13:25.583 INFO:tasks.workunit.client.0.smithi099.stdout:1/840: symlink d4/dc/d4d/d5d/d87/l10f 0 2024-01-31T05:13:25.587 INFO:tasks.workunit.client.0.smithi099.stdout:1/841: write d4/dc/d15/d45/faf [767860,124781] 0 2024-01-31T05:13:25.587 INFO:tasks.workunit.client.0.smithi099.stdout:1/842: dread - d4/db/d12/dc0/ffb zero size 2024-01-31T05:13:25.587 INFO:tasks.workunit.client.0.smithi099.stdout:1/843: chown d4/fd0 28538 1 2024-01-31T05:13:25.587 INFO:tasks.workunit.client.0.smithi099.stdout:3/993: write d10/d27/d34/d44/f118 [1368134,114208] 0 2024-01-31T05:13:25.593 INFO:tasks.workunit.client.0.smithi099.stdout:2/930: sync 2024-01-31T05:13:25.600 INFO:tasks.workunit.client.0.smithi099.stdout:3/994: dread d10/d32/d33/f63 [0,4194304] 0 2024-01-31T05:13:25.600 INFO:tasks.workunit.client.0.smithi099.stdout:3/995: chown c9 12410 1 2024-01-31T05:13:25.601 INFO:tasks.workunit.client.0.smithi099.stdout:2/931: dread d10/d3a/d69/d82/f98 [0,4194304] 0 2024-01-31T05:13:25.601 INFO:tasks.workunit.client.0.smithi099.stdout:2/932: read f1 [317541,43867] 0 2024-01-31T05:13:25.601 INFO:tasks.workunit.client.0.smithi099.stdout:2/933: truncate d10/d1b/d4d/d5a/fc0 319094 0 2024-01-31T05:13:25.601 INFO:tasks.workunit.client.0.smithi099.stdout:2/934: write d10/d3a/f52 [562086,103340] 0 2024-01-31T05:13:25.601 INFO:tasks.workunit.client.0.smithi099.stdout:3/996: readlink d10/d32/l146 0 2024-01-31T05:13:25.603 INFO:tasks.workunit.client.0.smithi099.stdout:6/813: dwrite d14/d18/d52/d22/f80 [4194304,4194304] 0 2024-01-31T05:13:25.603 INFO:tasks.workunit.client.0.smithi099.stdout:6/814: chown d14/d18/d52/d7e/d1c/d29/d4f/l74 452858884 1 2024-01-31T05:13:25.603 INFO:tasks.workunit.client.0.smithi099.stdout:6/815: chown l5 62711 1 2024-01-31T05:13:25.603 INFO:tasks.workunit.client.0.smithi099.stdout:3/997: getdents d10/d27/d34/d44/d60/d75/d8c 0 2024-01-31T05:13:25.603 INFO:tasks.workunit.client.0.smithi099.stdout:3/998: dread - d10/d27/d89/f119 zero size 2024-01-31T05:13:25.604 INFO:tasks.workunit.client.0.smithi099.stdout:3/999: stat d10/d27/c5e 0 2024-01-31T05:13:25.605 INFO:tasks.workunit.client.0.smithi099.stdout:2/935: dread d10/d1c/d43/fc6 [0,4194304] 0 2024-01-31T05:13:25.608 INFO:tasks.workunit.client.0.smithi099.stdout:2/936: rmdir d10/d1c/d43/db8/d11e/d124 0 2024-01-31T05:13:25.608 INFO:tasks.workunit.client.0.smithi099.stdout:2/937: write d10/d3a/f4f [3155709,128264] 0 2024-01-31T05:13:25.608 INFO:tasks.workunit.client.0.smithi099.stdout:2/938: fdatasync d10/d20/d5b/fe5 0 2024-01-31T05:13:25.609 INFO:tasks.workunit.client.0.smithi099.stdout:1/844: dwrite d4/dc/d15/d45/faf [0,4194304] 0 2024-01-31T05:13:25.609 INFO:tasks.workunit.client.0.smithi099.stdout:1/845: chown d4/db 293886 1 2024-01-31T05:13:25.610 INFO:tasks.workunit.client.0.smithi099.stdout:2/939: creat d10/d1c/d43/db8/d11e/f125 x:0 0 0 2024-01-31T05:13:25.610 INFO:tasks.workunit.client.0.smithi099.stdout:2/940: creat d10/d51/d8d/f126 x:0 0 0 2024-01-31T05:13:25.610 INFO:tasks.workunit.client.0.smithi099.stdout:1/846: mknod d4/db/d12/dc0/d4b/d9a/dc7/c110 0 2024-01-31T05:13:25.611 INFO:tasks.workunit.client.0.smithi099.stdout:2/941: mkdir d10/d20/dd0/d127 0 2024-01-31T05:13:25.611 INFO:tasks.workunit.client.0.smithi099.stdout:1/847: getdents d4/db/d12/dc0/d4b/d50/db5 0 2024-01-31T05:13:25.612 INFO:tasks.workunit.client.0.smithi099.stdout:1/848: dread - d4/db/d12/dc0/d4b/ff5 zero size 2024-01-31T05:13:25.612 INFO:tasks.workunit.client.0.smithi099.stdout:1/849: mknod d4/db/d10e/d83/dbd/c111 0 2024-01-31T05:13:25.613 INFO:tasks.workunit.client.0.smithi099.stdout:1/850: mknod d4/dc/d48/d104/c112 0 2024-01-31T05:13:25.619 INFO:tasks.workunit.client.0.smithi099.stdout:1/851: write d4/dc/d15/f20 [318490,17986] 0 2024-01-31T05:13:25.619 INFO:tasks.workunit.client.0.smithi099.stdout:1/852: chown d4/lb6 57485 1 2024-01-31T05:13:25.623 INFO:tasks.workunit.client.0.smithi099.stdout:6/816: rename d14/d18/d52/dbc/fe3 to d14/d18/d9d/f109 0 2024-01-31T05:13:25.625 INFO:tasks.workunit.client.0.smithi099.stdout:1/853: rename d4/db/d3a/d7e/d85/de8/lf4 to d4/db/d12/dc0/l113 0 2024-01-31T05:13:25.625 INFO:tasks.workunit.client.0.smithi099.stdout:2/942: link d10/d1b/d4d/d5a/fc0 d10/d2b/d58/dc3/dcd/f128 0 2024-01-31T05:13:25.626 INFO:tasks.workunit.client.0.smithi099.stdout:1/854: chown d4/db/d12/dc0/d69/c76 182 1 2024-01-31T05:13:25.630 INFO:tasks.workunit.client.0.smithi099.stdout:6/817: read d14/d18/d52/d22/f88 [60098,93116] 0 2024-01-31T05:13:25.632 INFO:tasks.workunit.client.0.smithi099.stdout:2/943: mknod d10/d2b/d7c/c129 0 2024-01-31T05:13:25.641 INFO:tasks.workunit.client.0.smithi099.stdout:6/818: dread d14/d18/d52/d22/d71/dee/d7b/f95 [0,4194304] 0 2024-01-31T05:13:25.642 INFO:tasks.workunit.client.0.smithi099.stdout:6/819: creat d14/df9/f10a x:0 0 0 2024-01-31T05:13:25.645 INFO:tasks.workunit.client.0.smithi099.stdout:1/855: dwrite d4/db/f94 [4194304,4194304] 0 2024-01-31T05:13:25.646 INFO:tasks.workunit.client.0.smithi099.stdout:1/856: write d4/dc/d4d/d5d/d87/f9d [759175,49760] 0 2024-01-31T05:13:25.646 INFO:tasks.workunit.client.0.smithi099.stdout:1/857: chown d4/dc/d4d/d5d/d87/l10f 118017242 1 2024-01-31T05:13:25.648 INFO:tasks.workunit.client.0.smithi099.stdout:1/858: mkdir d4/dc/d48/d104/d114 0 2024-01-31T05:13:25.650 INFO:tasks.workunit.client.0.smithi099.stdout:1/859: truncate d4/dc/d48/fe6 3493622 0 2024-01-31T05:13:25.652 INFO:tasks.workunit.client.0.smithi099.stdout:1/860: mkdir d4/db/d3a/d7e/d85/d115 0 2024-01-31T05:13:25.652 INFO:tasks.workunit.client.0.smithi099.stdout:1/861: write d4/dc/d4d/da5/dcf/dd4/fb2 [32652,56718] 0 2024-01-31T05:13:25.652 INFO:tasks.workunit.client.0.smithi099.stdout:1/862: dread - d4/db/d12/dc0/d69/fd6 zero size 2024-01-31T05:13:25.669 INFO:tasks.workunit.client.0.smithi099.stdout:2/944: dwrite d10/d1b/f59 [0,4194304] 0 2024-01-31T05:13:25.669 INFO:tasks.workunit.client.0.smithi099.stdout:6/820: dwrite d14/d18/d52/d7e/d1c/fad [0,4194304] 0 2024-01-31T05:13:25.669 INFO:tasks.workunit.client.0.smithi099.stdout:6/821: chown d14/d18/d9d/f109 25761401 1 2024-01-31T05:13:25.674 INFO:tasks.workunit.client.0.smithi099.stdout:1/863: rename d4/dc/d29/daa/cfd to d4/db/d12/dc0/d4b/d9a/c116 0 2024-01-31T05:13:25.676 INFO:tasks.workunit.client.0.smithi099.stdout:1/864: symlink d4/db/d12/dc0/d4b/d50/d91/l117 0 2024-01-31T05:13:25.678 INFO:tasks.workunit.client.0.smithi099.stdout:1/865: mknod d4/dc/d48/c118 0 2024-01-31T05:13:25.680 INFO:tasks.workunit.client.0.smithi099.stdout:6/822: rename d14/d18/d52/d22/d71/dee/f42 to d14/d18/d52/d22/d71/dee/d7b/dd4/f10b 0 2024-01-31T05:13:25.680 INFO:tasks.workunit.client.0.smithi099.stdout:6/823: fsync d14/d18/d52/d22/f59 0 2024-01-31T05:13:25.680 INFO:tasks.workunit.client.0.smithi099.stdout:6/824: chown d14/df9/f10a 19911 1 2024-01-31T05:13:25.682 INFO:tasks.workunit.client.0.smithi099.stdout:2/945: write d10/d2b/d58/fc9 [1394798,51752] 0 2024-01-31T05:13:25.682 INFO:tasks.workunit.client.0.smithi099.stdout:6/825: unlink d14/d18/d52/dbc/lff 0 2024-01-31T05:13:25.683 INFO:tasks.workunit.client.0.smithi099.stdout:5/910: sync 2024-01-31T05:13:25.683 INFO:tasks.workunit.client.0.smithi099.stdout:9/914: sync 2024-01-31T05:13:25.683 INFO:tasks.workunit.client.0.smithi099.stdout:2/946: rmdir d10/d51/d8d 39 2024-01-31T05:13:25.684 INFO:tasks.workunit.client.0.smithi099.stdout:9/915: truncate d0/d44/f53 1612401 0 2024-01-31T05:13:25.684 INFO:tasks.workunit.client.0.smithi099.stdout:6/826: creat d14/d18/d52/d90/d9a/f10c x:0 0 0 2024-01-31T05:13:25.684 INFO:tasks.workunit.client.0.smithi099.stdout:2/947: creat d10/d3a/d69/f12a x:0 0 0 2024-01-31T05:13:25.685 INFO:tasks.workunit.client.0.smithi099.stdout:9/916: getdents d0/d3e/d87/dc9/d24/d2b 0 2024-01-31T05:13:25.685 INFO:tasks.workunit.client.0.smithi099.stdout:9/917: chown d0/c1e 220535 1 2024-01-31T05:13:25.685 INFO:tasks.workunit.client.0.smithi099.stdout:6/827: unlink d14/d18/d52/d7e/d1c/d29/f2b 0 2024-01-31T05:13:25.686 INFO:tasks.workunit.client.0.smithi099.stdout:2/948: mknod d10/d2b/d58/c12b 0 2024-01-31T05:13:25.687 INFO:tasks.workunit.client.0.smithi099.stdout:6/828: mkdir d14/d18/d52/dbc/de8/d10d 0 2024-01-31T05:13:25.688 INFO:tasks.workunit.client.0.smithi099.stdout:9/918: rmdir d0/d3e/d87/dc9/d5e/d72/d89/d98/dc1 39 2024-01-31T05:13:25.689 INFO:tasks.workunit.client.0.smithi099.stdout:2/949: getdents d10/d2b 0 2024-01-31T05:13:25.690 INFO:tasks.workunit.client.0.smithi099.stdout:6/829: write d14/d18/d52/d22/d71/dee/d7b/f95 [4652476,37663] 0 2024-01-31T05:13:25.690 INFO:tasks.workunit.client.0.smithi099.stdout:6/830: creat d14/d18/d52/d90/d9a/f10e x:0 0 0 2024-01-31T05:13:25.691 INFO:tasks.workunit.client.0.smithi099.stdout:9/919: link d0/d3e/d87/dc9/d24/fae d0/d3e/d87/dc9/d24/d2b/f145 0 2024-01-31T05:13:25.691 INFO:tasks.workunit.client.0.smithi099.stdout:9/920: dread - d0/d3e/d87/dc9/d5e/de0/d130/d133/f13c zero size 2024-01-31T05:13:25.692 INFO:tasks.workunit.client.0.smithi099.stdout:6/831: symlink d14/d18/l10f 0 2024-01-31T05:13:25.696 INFO:tasks.workunit.client.0.smithi099.stdout:9/921: mkdir d0/d3e/d87/dc9/d24/d2b/de9/df9/d134/d146 0 2024-01-31T05:13:25.699 INFO:tasks.workunit.client.0.smithi099.stdout:5/911: dread d6/da/d14/d3d/d51/d82/f43 [0,4194304] 0 2024-01-31T05:13:25.700 INFO:tasks.workunit.client.0.smithi099.stdout:5/912: fsync d6/da/d14/d3d/d51/d82/f41 0 2024-01-31T05:13:25.701 INFO:tasks.workunit.client.0.smithi099.stdout:5/913: truncate d6/fcd 3913408 0 2024-01-31T05:13:25.713 INFO:tasks.workunit.client.0.smithi099.stdout:2/950: dwrite d10/d1b/d7d/d7a/fb0 [0,4194304] 0 2024-01-31T05:13:25.728 INFO:tasks.workunit.client.0.smithi099.stdout:9/922: dwrite d0/d3e/d33/dab/fb8 [0,4194304] 0 2024-01-31T05:13:25.728 INFO:tasks.workunit.client.0.smithi099.stdout:1/866: dwrite d4/dc/d48/f31 [4194304,4194304] 0 2024-01-31T05:13:25.728 INFO:tasks.workunit.client.0.smithi099.stdout:5/914: dwrite d6/da/d14/d3d/d57/d92/f111 [0,4194304] 0 2024-01-31T05:13:25.728 INFO:tasks.workunit.client.0.smithi099.stdout:5/915: read d6/da/d14/d3d/d6e/f22 [7968504,127787] 0 2024-01-31T05:13:25.729 INFO:tasks.workunit.client.0.smithi099.stdout:1/867: write d4/db/fa4 [378455,31708] 0 2024-01-31T05:13:25.730 INFO:tasks.workunit.client.0.smithi099.stdout:1/868: creat d4/db/d12/dc0/d4b/d9a/f119 x:0 0 0 2024-01-31T05:13:25.734 INFO:tasks.workunit.client.0.smithi099.stdout:2/951: rename d10/d1b/d83/d86/lb4 to d10/d20/dd0/l12c 0 2024-01-31T05:13:25.735 INFO:tasks.workunit.client.0.smithi099.stdout:2/952: creat d10/d20/dd0/d127/f12d x:0 0 0 2024-01-31T05:13:25.737 INFO:tasks.workunit.client.0.smithi099.stdout:9/923: rename d0/d3e/d87/dc9/d24/d2b/d59/f62 to d0/d3e/d87/f147 0 2024-01-31T05:13:25.737 INFO:tasks.workunit.client.0.smithi099.stdout:9/924: creat d0/d3e/d87/dc9/d5e/d72/dbf/f148 x:0 0 0 2024-01-31T05:13:25.739 INFO:tasks.workunit.client.0.smithi099.stdout:2/953: mkdir d10/d1b/d7d/d12e 0 2024-01-31T05:13:25.739 INFO:tasks.workunit.client.0.smithi099.stdout:2/954: chown d10/d1c/d43/db8/d11e 949940377 1 2024-01-31T05:13:25.739 INFO:tasks.workunit.client.0.smithi099.stdout:5/916: write d6/da/d14/d3d/d8c/de6/fe3 [837740,124061] 0 2024-01-31T05:13:25.739 INFO:tasks.workunit.client.0.smithi099.stdout:5/917: write d6/f6d [4322657,67946] 0 2024-01-31T05:13:25.739 INFO:tasks.workunit.client.0.smithi099.stdout:9/925: creat d0/d3e/d87/dc9/d24/d2b/f149 x:0 0 0 2024-01-31T05:13:25.739 INFO:tasks.workunit.client.0.smithi099.stdout:9/926: chown d0/d3e/d87/dc9/d24/d2b/d7b/f9d 57135 1 2024-01-31T05:13:25.739 INFO:tasks.workunit.client.0.smithi099.stdout:9/927: fsync d0/d3e/d87/dc9/d5e/d72/d89/d98/fbd 0 2024-01-31T05:13:25.740 INFO:tasks.workunit.client.0.smithi099.stdout:9/928: link d0/d3e/cde d0/d5d/def/c14a 0 2024-01-31T05:13:25.740 INFO:tasks.workunit.client.0.smithi099.stdout:9/929: truncate d0/d3e/d87/dc9/d5e/d72/d89/ff2 403614 0 2024-01-31T05:13:25.742 INFO:tasks.workunit.client.0.smithi099.stdout:9/930: symlink d0/d3e/l14b 0 2024-01-31T05:13:25.743 INFO:tasks.workunit.client.0.smithi099.stdout:9/931: mknod d0/d7/c14c 0 2024-01-31T05:13:25.743 INFO:tasks.workunit.client.0.smithi099.stdout:9/932: truncate d0/d3e/d87/dc9/d24/f69 4738620 0 2024-01-31T05:13:25.750 INFO:tasks.workunit.client.0.smithi099.stdout:2/955: read d10/d1b/d7d/d7a/fc7 [3526140,124325] 0 2024-01-31T05:13:25.761 INFO:tasks.workunit.client.0.smithi099.stdout:1/869: dwrite d4/dc/d15/ffc [0,4194304] 0 2024-01-31T05:13:25.762 INFO:tasks.workunit.client.0.smithi099.stdout:1/870: unlink d4/db/d12/dc0/d4b/f77 0 2024-01-31T05:13:25.768 INFO:tasks.workunit.client.0.smithi099.stdout:5/918: dwrite d6/da/f56 [0,4194304] 0 2024-01-31T05:13:25.772 INFO:tasks.workunit.client.0.smithi099.stdout:1/871: dread d4/f8d [0,4194304] 0 2024-01-31T05:13:25.773 INFO:tasks.workunit.client.0.smithi099.stdout:1/872: mkdir d4/db/d11a 0 2024-01-31T05:13:25.779 INFO:tasks.workunit.client.0.smithi099.stdout:2/956: dwrite d10/d1b/f59 [0,4194304] 0 2024-01-31T05:13:25.779 INFO:tasks.workunit.client.0.smithi099.stdout:2/957: fdatasync d10/d2b/d97/fb9 0 2024-01-31T05:13:25.779 INFO:tasks.workunit.client.0.smithi099.stdout:2/958: fdatasync d10/d1b/d7d/d7a/fbd 0 2024-01-31T05:13:25.782 INFO:tasks.workunit.client.0.smithi099.stdout:2/959: dread d10/d1b/f81 [0,4194304] 0 2024-01-31T05:13:25.792 INFO:tasks.workunit.client.0.smithi099.stdout:2/960: dread d10/d1b/f6f [0,4194304] 0 2024-01-31T05:13:25.797 INFO:tasks.workunit.client.0.smithi099.stdout:1/873: dwrite d4/dc/d29/fa8 [4194304,4194304] 0 2024-01-31T05:13:25.798 INFO:tasks.workunit.client.0.smithi099.stdout:1/874: creat d4/dc/d48/d104/d114/f11b x:0 0 0 2024-01-31T05:13:25.810 INFO:tasks.workunit.client.0.smithi099.stdout:2/961: dwrite d10/d1c/f26 [4194304,4194304] 0 2024-01-31T05:13:25.833 INFO:tasks.workunit.client.0.smithi099.stdout:6/832: sync 2024-01-31T05:13:25.833 INFO:tasks.workunit.client.0.smithi099.stdout:6/833: read d14/d18/f6c [741846,98939] 0 2024-01-31T05:13:25.833 INFO:tasks.workunit.client.0.smithi099.stdout:6/834: creat d14/d18/d9d/de6/f110 x:0 0 0 2024-01-31T05:13:25.833 INFO:tasks.workunit.client.0.smithi099.stdout:6/835: chown d14/d18/d52/d7e/d1c/cb8 5588628 1 2024-01-31T05:13:25.833 INFO:tasks.workunit.client.0.smithi099.stdout:6/836: creat d14/d18/d52/d7e/d1c/da6/f111 x:0 0 0 2024-01-31T05:13:25.835 INFO:tasks.workunit.client.0.smithi099.stdout:2/962: dwrite d10/d1b/f59 [0,4194304] 0 2024-01-31T05:13:25.835 INFO:tasks.workunit.client.0.smithi099.stdout:6/837: unlink d14/d18/d9d/fbe 0 2024-01-31T05:13:25.837 INFO:tasks.workunit.client.0.smithi099.stdout:2/963: rename d10/d1b/d7d/d12e to d10/d1b/d83/d86/d10b/d12f 0 2024-01-31T05:13:25.839 INFO:tasks.workunit.client.0.smithi099.stdout:6/838: truncate d14/d18/d52/d7e/d1c/f5f 3533990 0 2024-01-31T05:13:25.857 INFO:tasks.workunit.client.0.smithi099.stdout:2/964: dwrite d10/d20/f4c [0,4194304] 0 2024-01-31T05:13:25.857 INFO:tasks.workunit.client.0.smithi099.stdout:6/839: rename fa to d14/d18/d52/f112 0 2024-01-31T05:13:25.858 INFO:tasks.workunit.client.0.smithi099.stdout:2/965: symlink d10/d1b/d7d/d7a/dd7/l130 0 2024-01-31T05:13:25.858 INFO:tasks.workunit.client.0.smithi099.stdout:6/840: creat d14/d18/d52/dbc/de8/de9/f113 x:0 0 0 2024-01-31T05:13:25.859 INFO:tasks.workunit.client.0.smithi099.stdout:6/841: read d14/d18/d52/d7e/d1c/d29/d79/fb7 [584422,105289] 0 2024-01-31T05:13:25.859 INFO:tasks.workunit.client.0.smithi099.stdout:6/842: creat d14/d18/d9d/de6/f114 x:0 0 0 2024-01-31T05:13:25.859 INFO:tasks.workunit.client.0.smithi099.stdout:2/966: rmdir d10/d1b/d83/de8 39 2024-01-31T05:13:25.860 INFO:tasks.workunit.client.0.smithi099.stdout:2/967: mkdir d10/d1b/d83/d86/d10b/d131 0 2024-01-31T05:13:25.863 INFO:tasks.workunit.client.0.smithi099.stdout:6/843: dread d14/d18/d52/d22/f88 [0,4194304] 0 2024-01-31T05:13:25.863 INFO:tasks.workunit.client.0.smithi099.stdout:6/844: read - d14/d18/d52/d7e/fc2 zero size 2024-01-31T05:13:25.863 INFO:tasks.workunit.client.0.smithi099.stdout:6/845: creat d14/d18/d52/d46/dfd/f115 x:0 0 0 2024-01-31T05:13:25.864 INFO:tasks.workunit.client.0.smithi099.stdout:6/846: truncate d14/d18/d52/d7e/d1c/d29/d79/fda 246105 0 2024-01-31T05:13:25.867 INFO:tasks.workunit.client.0.smithi099.stdout:6/847: getdents d14/d18/d52/dbc/de8/de9 0 2024-01-31T05:13:25.867 INFO:tasks.workunit.client.0.smithi099.stdout:6/848: creat d14/d18/d52/d22/d71/dee/d7b/dd4/f116 x:0 0 0 2024-01-31T05:13:25.869 INFO:tasks.workunit.client.0.smithi099.stdout:6/849: mkdir d14/d18/d52/d22/d71/dee/d7b/d117 0 2024-01-31T05:13:25.869 INFO:tasks.workunit.client.0.smithi099.stdout:6/850: truncate d14/d18/d52/d7e/d1c/d29/d79/fda 726435 0 2024-01-31T05:13:25.869 INFO:tasks.workunit.client.0.smithi099.stdout:2/968: dread d10/d2b/d7c/f90 [0,4194304] 0 2024-01-31T05:13:25.870 INFO:tasks.workunit.client.0.smithi099.stdout:2/969: creat d10/d51/f132 x:0 0 0 2024-01-31T05:13:25.871 INFO:tasks.workunit.client.0.smithi099.stdout:2/970: getdents d10/d20/dd0/d127 0 2024-01-31T05:13:25.872 INFO:tasks.workunit.client.0.smithi099.stdout:2/971: creat d10/d1b/d7d/d7a/d107/f133 x:0 0 0 2024-01-31T05:13:25.873 INFO:tasks.workunit.client.0.smithi099.stdout:6/851: dread d14/d18/d52/d22/f88 [0,4194304] 0 2024-01-31T05:13:25.874 INFO:tasks.workunit.client.0.smithi099.stdout:6/852: mkdir d14/d18/d52/d7e/d1c/d29/d79/d118 0 2024-01-31T05:13:25.882 INFO:tasks.workunit.client.0.smithi099.stdout:9/933: sync 2024-01-31T05:13:25.882 INFO:tasks.workunit.client.0.smithi099.stdout:9/934: dread - d0/d3e/d87/dc9/d5e/ddb/f10b zero size 2024-01-31T05:13:25.882 INFO:tasks.workunit.client.0.smithi099.stdout:9/935: chown d0/d3e/d33/dab/fbe 460 1 2024-01-31T05:13:25.882 INFO:tasks.workunit.client.0.smithi099.stdout:9/936: fsync d0/d3e/d87/dc9/d5e/de0/d130/d133/f13c 0 2024-01-31T05:13:25.882 INFO:tasks.workunit.client.0.smithi099.stdout:9/937: creat d0/d3e/d33/f14d x:0 0 0 2024-01-31T05:13:25.884 INFO:tasks.workunit.client.0.smithi099.stdout:9/938: link d0/d5d/db6/fbb d0/d3e/d87/dc9/d24/d2b/de9/df9/f14e 0 2024-01-31T05:13:25.884 INFO:tasks.workunit.client.0.smithi099.stdout:9/939: write d0/d3e/d87/dc9/d5e/de0/d130/d133/f13c [292777,44212] 0 2024-01-31T05:13:25.884 INFO:tasks.workunit.client.0.smithi099.stdout:9/940: write d0/d3e/d87/dc9/d24/d2b/d63/f93 [491040,29316] 0 2024-01-31T05:13:25.884 INFO:tasks.workunit.client.0.smithi099.stdout:9/941: readlink d0/d7/da6/l109 0 2024-01-31T05:13:25.890 INFO:tasks.workunit.client.0.smithi099.stdout:6/853: rename d14/d18/d52/d90/d9a/cb4 to d14/dd0/c119 0 2024-01-31T05:13:25.891 INFO:tasks.workunit.client.0.smithi099.stdout:6/854: getdents d14/d18/d52/d7e/d66 0 2024-01-31T05:13:25.892 INFO:tasks.workunit.client.0.smithi099.stdout:6/855: stat d14/d18/d52/d22/f88 0 2024-01-31T05:13:25.900 INFO:tasks.workunit.client.0.smithi099.stdout:2/972: dwrite d10/d51/f54 [0,4194304] 0 2024-01-31T05:13:25.900 INFO:tasks.workunit.client.0.smithi099.stdout:2/973: chown d10/d1b/f59 57 1 2024-01-31T05:13:25.901 INFO:tasks.workunit.client.0.smithi099.stdout:2/974: creat d10/d1b/d83/d86/d10b/d131/f134 x:0 0 0 2024-01-31T05:13:25.902 INFO:tasks.workunit.client.0.smithi099.stdout:2/975: mknod d10/d2b/d58/c135 0 2024-01-31T05:13:25.906 INFO:tasks.workunit.client.0.smithi099.stdout:9/942: dwrite d0/d3e/d87/dc9/d24/d2b/d63/fb7 [0,4194304] 0 2024-01-31T05:13:25.907 INFO:tasks.workunit.client.0.smithi099.stdout:9/943: fdatasync d0/d3e/f8b 0 2024-01-31T05:13:25.907 INFO:tasks.workunit.client.0.smithi099.stdout:2/976: dread d10/d3a/f4f [0,4194304] 0 2024-01-31T05:13:25.908 INFO:tasks.workunit.client.0.smithi099.stdout:9/944: read d0/d3e/d33/dab/f113 [186785,55866] 0 2024-01-31T05:13:25.910 INFO:tasks.workunit.client.0.smithi099.stdout:6/856: rename d14/d18/d52/dbc/ld1 to d14/d18/d52/d7e/d1c/d29/d79/dc6/l11a 0 2024-01-31T05:13:25.911 INFO:tasks.workunit.client.0.smithi099.stdout:9/945: mknod d0/d3e/d87/dc9/d5e/c14f 0 2024-01-31T05:13:25.911 INFO:tasks.workunit.client.0.smithi099.stdout:9/946: truncate d0/f141 145283 0 2024-01-31T05:13:25.913 INFO:tasks.workunit.client.0.smithi099.stdout:5/919: sync 2024-01-31T05:13:25.913 INFO:tasks.workunit.client.0.smithi099.stdout:1/875: sync 2024-01-31T05:13:25.915 INFO:tasks.workunit.client.0.smithi099.stdout:5/920: dread d6/fac [0,4194304] 0 2024-01-31T05:13:25.917 INFO:tasks.workunit.client.0.smithi099.stdout:5/921: creat d6/da/d14/d3d/d6e/f131 x:0 0 0 2024-01-31T05:13:25.917 INFO:tasks.workunit.client.0.smithi099.stdout:5/922: creat d6/da/d14/d3d/d51/f132 x:0 0 0 2024-01-31T05:13:25.920 INFO:tasks.workunit.client.0.smithi099.stdout:6/857: dread d14/d18/d52/d7e/f83 [0,4194304] 0 2024-01-31T05:13:25.921 INFO:tasks.workunit.client.0.smithi099.stdout:6/858: symlink d14/d18/d52/d46/dfd/l11b 0 2024-01-31T05:13:25.922 INFO:tasks.workunit.client.0.smithi099.stdout:6/859: chown d14/d18/d52/d22/f80 10 1 2024-01-31T05:13:25.923 INFO:tasks.workunit.client.0.smithi099.stdout:6/860: truncate d14/f15 8372890 0 2024-01-31T05:13:25.923 INFO:tasks.workunit.client.0.smithi099.stdout:6/861: chown d14/d18/d9d/fc8 3 1 2024-01-31T05:13:25.925 INFO:tasks.workunit.client.0.smithi099.stdout:9/947: dread d0/d7/f28 [0,4194304] 0 2024-01-31T05:13:25.927 INFO:tasks.workunit.client.0.smithi099.stdout:2/977: dwrite d10/d1b/d7d/d7a/dad/fd2 [0,4194304] 0 2024-01-31T05:13:25.927 INFO:tasks.workunit.client.0.smithi099.stdout:9/948: creat d0/d3e/d87/dc9/d24/d2b/d63/da7/daa/d11f/f150 x:0 0 0 2024-01-31T05:13:25.928 INFO:tasks.workunit.client.0.smithi099.stdout:9/949: symlink d0/d3e/d87/dc9/d5e/d72/dbf/dd1/l151 0 2024-01-31T05:13:25.933 INFO:tasks.workunit.client.0.smithi099.stdout:5/923: dread d6/da/d14/d3d/d57/d92/fa7 [0,4194304] 0 2024-01-31T05:13:25.933 INFO:tasks.workunit.client.0.smithi099.stdout:5/924: truncate d6/da/d14/d2b/fab 2466638 0 2024-01-31T05:13:25.933 INFO:tasks.workunit.client.0.smithi099.stdout:5/925: creat d6/da/d14/d61/def/f133 x:0 0 0 2024-01-31T05:13:25.937 INFO:tasks.workunit.client.0.smithi099.stdout:1/876: dwrite d4/dc/d4d/d5d/fc2 [0,4194304] 0 2024-01-31T05:13:25.937 INFO:tasks.workunit.client.0.smithi099.stdout:1/877: fsync d4/dc/d4d/da5/dcf/dd4/dd2/fe2 0 2024-01-31T05:13:25.944 INFO:tasks.workunit.client.0.smithi099.stdout:2/978: dread d10/d2b/d97/fea [0,4194304] 0 2024-01-31T05:13:25.945 INFO:tasks.workunit.client.0.smithi099.stdout:5/926: write d6/f11 [2621235,71275] 0 2024-01-31T05:13:25.946 INFO:tasks.workunit.client.0.smithi099.stdout:2/979: mknod d10/d1b/d7d/d7a/d107/c136 0 2024-01-31T05:13:25.946 INFO:tasks.workunit.client.0.smithi099.stdout:2/980: creat d10/d1b/d7d/f137 x:0 0 0 2024-01-31T05:13:25.947 INFO:tasks.workunit.client.0.smithi099.stdout:2/981: stat d10/d3a/c71 0 2024-01-31T05:13:25.948 INFO:tasks.workunit.client.0.smithi099.stdout:2/982: chown d10/d1b/d7d/d7a/fbd 7937355 1 2024-01-31T05:13:25.977 INFO:tasks.workunit.client.0.smithi099.stdout:9/950: dwrite d0/d44/f53 [0,4194304] 0 2024-01-31T05:13:25.977 INFO:tasks.workunit.client.0.smithi099.stdout:9/951: write d0/d3e/d87/dc9/d24/d2b/f145 [1026070,10025] 0 2024-01-31T05:13:25.977 INFO:tasks.workunit.client.0.smithi099.stdout:9/952: chown d0/d5d/db6/f139 773378589 1 2024-01-31T05:13:25.977 INFO:tasks.workunit.client.0.smithi099.stdout:1/878: dwrite d4/db/d12/dc0/d4b/d50/fc9 [0,4194304] 0 2024-01-31T05:13:25.977 INFO:tasks.workunit.client.0.smithi099.stdout:1/879: fdatasync d4/dc/d48/f2f 0 2024-01-31T05:13:25.977 INFO:tasks.workunit.client.0.smithi099.stdout:9/953: write d0/d5d/db6/fbb [597369,93393] 0 2024-01-31T05:13:25.977 INFO:tasks.workunit.client.0.smithi099.stdout:9/954: chown d0/d3e/d87/dc9/d5e 1249 1 2024-01-31T05:13:25.977 INFO:tasks.workunit.client.0.smithi099.stdout:9/955: creat d0/d3e/d33/d8a/f152 x:0 0 0 2024-01-31T05:13:25.977 INFO:tasks.workunit.client.0.smithi099.stdout:9/956: fdatasync d0/d3e/d87/dc9/d5e/d72/f115 0 2024-01-31T05:13:25.977 INFO:tasks.workunit.client.0.smithi099.stdout:2/983: dwrite d10/d2b/fb2 [0,4194304] 0 2024-01-31T05:13:25.978 INFO:tasks.workunit.client.0.smithi099.stdout:2/984: fdatasync d10/d1b/d7d/d7a/dd7/f105 0 2024-01-31T05:13:25.978 INFO:tasks.workunit.client.0.smithi099.stdout:1/880: creat d4/db/d12/dc0/d4b/d9a/dc7/f11c x:0 0 0 2024-01-31T05:13:25.978 INFO:tasks.workunit.client.0.smithi099.stdout:1/881: chown d4/db/d12/dc0/ca6 4885521 1 2024-01-31T05:13:25.978 INFO:tasks.workunit.client.0.smithi099.stdout:2/985: mkdir d10/d20/d5b/d120/d138 0 2024-01-31T05:13:25.979 INFO:tasks.workunit.client.0.smithi099.stdout:2/986: mkdir d10/d20/dd0/d127/d139 0 2024-01-31T05:13:25.982 INFO:tasks.workunit.client.0.smithi099.stdout:9/957: rename d0/d3e/d87/dc9/d5e/d72/dbf/f108 to d0/d3e/d87/dc9/d24/d48/f153 0 2024-01-31T05:13:26.003 INFO:tasks.workunit.client.0.smithi099.stdout:1/882: dwrite d4/db/d12/dc0/ffb [0,4194304] 0 2024-01-31T05:13:26.005 INFO:tasks.workunit.client.0.smithi099.stdout:2/987: dwrite d10/f11 [0,4194304] 0 2024-01-31T05:13:26.009 INFO:tasks.workunit.client.0.smithi099.stdout:9/958: dwrite d0/d3e/d87/dc9/d24/d2b/de9/df9/f14e [0,4194304] 0 2024-01-31T05:13:26.062 INFO:tasks.workunit.client.0.smithi099.stdout:1/883: rename d4/db/d12/d74/l84 to d4/dc/d15/d45/l11d 0 2024-01-31T05:13:26.068 INFO:tasks.workunit.client.0.smithi099.stdout:2/988: mknod d10/d2b/d58/dc3/dcd/c13a 0 2024-01-31T05:13:26.081 INFO:tasks.workunit.client.0.smithi099.stdout:9/959: mkdir d0/d3e/d87/dc9/d24/d2b/d63/d154 0 2024-01-31T05:13:26.085 INFO:tasks.workunit.client.0.smithi099.stdout:1/884: creat d4/f11e x:0 0 0 2024-01-31T05:13:26.086 INFO:tasks.workunit.client.0.smithi099.stdout:2/989: creat d10/d2b/d58/dc3/f13b x:0 0 0 2024-01-31T05:13:26.087 INFO:tasks.workunit.client.0.smithi099.stdout:2/990: symlink d10/d20/dd0/l13c 0 2024-01-31T05:13:26.087 INFO:tasks.workunit.client.0.smithi099.stdout:2/991: readlink d10/d1b/d4d/d5a/l5e 0 2024-01-31T05:13:26.087 INFO:tasks.workunit.client.0.smithi099.stdout:2/992: write d10/d2b/fb2 [4642768,36267] 0 2024-01-31T05:13:26.088 INFO:tasks.workunit.client.0.smithi099.stdout:1/885: dread d4/db/d12/dc0/d4b/d50/d91/f34 [0,4194304] 0 2024-01-31T05:13:26.088 INFO:tasks.workunit.client.0.smithi099.stdout:1/886: fdatasync d4/db/d12/dc0/d69/f103 0 2024-01-31T05:13:26.089 INFO:tasks.workunit.client.0.smithi099.stdout:1/887: rmdir d4/db/d10e/d83/dbd 39 2024-01-31T05:13:26.091 INFO:tasks.workunit.client.0.smithi099.stdout:9/960: dread d0/d3e/f5f [0,4194304] 0 2024-01-31T05:13:26.091 INFO:tasks.workunit.client.0.smithi099.stdout:9/961: chown d0/d3e/d87/dc9/d5e/de0/d130/d133/l13f 2564186 1 2024-01-31T05:13:26.091 INFO:tasks.workunit.client.0.smithi099.stdout:9/962: chown d0/d7/c76 47 1 2024-01-31T05:13:26.093 INFO:tasks.workunit.client.0.smithi099.stdout:1/888: symlink d4/l11f 0 2024-01-31T05:13:26.095 INFO:tasks.workunit.client.0.smithi099.stdout:1/889: truncate d4/dc/d44/fa9 125061 0 2024-01-31T05:13:26.095 INFO:tasks.workunit.client.0.smithi099.stdout:1/890: chown d4/dc/f88 1 1 2024-01-31T05:13:26.097 INFO:tasks.workunit.client.0.smithi099.stdout:1/891: truncate d4/df9/ff7 3329675 0 2024-01-31T05:13:26.102 INFO:tasks.workunit.client.0.smithi099.stdout:6/862: sync 2024-01-31T05:13:26.102 INFO:tasks.workunit.client.0.smithi099.stdout:5/927: sync 2024-01-31T05:13:26.104 INFO:tasks.workunit.client.0.smithi099.stdout:6/863: mkdir d14/d18/d52/dbc/de8/de9/d11c 0 2024-01-31T05:13:26.107 INFO:tasks.workunit.client.0.smithi099.stdout:6/864: creat d14/d18/f11d x:0 0 0 2024-01-31T05:13:26.111 INFO:tasks.workunit.client.0.smithi099.stdout:5/928: rename d6/da/d3f to d6/da/d14/d3d/d51/d82/d134 0 2024-01-31T05:13:26.111 INFO:tasks.workunit.client.0.smithi099.stdout:5/929: write d6/da/d14/d3d/d57/fad [608143,30057] 0 2024-01-31T05:13:26.111 INFO:tasks.workunit.client.0.smithi099.stdout:5/930: write d6/da/d14/d61/d98/d106/fd3 [2826492,62590] 0 2024-01-31T05:13:26.112 INFO:tasks.workunit.client.0.smithi099.stdout:6/865: creat d14/d18/d52/d22/d71/dee/d7b/f11e x:0 0 0 2024-01-31T05:13:26.113 INFO:tasks.workunit.client.0.smithi099.stdout:5/931: mkdir d6/da/d14/d3d/d51/dae/db0/d135 0 2024-01-31T05:13:26.114 INFO:tasks.workunit.client.0.smithi099.stdout:6/866: creat d14/d18/d52/d90/f11f x:0 0 0 2024-01-31T05:13:26.114 INFO:tasks.workunit.client.0.smithi099.stdout:6/867: mkdir d14/d18/d52/dbc/d120 0 2024-01-31T05:13:26.115 INFO:tasks.workunit.client.0.smithi099.stdout:6/868: symlink d14/d18/d52/d22/d71/l121 0 2024-01-31T05:13:26.116 INFO:tasks.workunit.client.0.smithi099.stdout:5/932: write d6/da/d14/d3d/d51/f9f [422844,117227] 0 2024-01-31T05:13:26.116 INFO:tasks.workunit.client.0.smithi099.stdout:5/933: write d6/da/d14/d2b/d12d/f11b [266973,124678] 0 2024-01-31T05:13:26.116 INFO:tasks.workunit.client.0.smithi099.stdout:6/869: mknod d14/d18/d52/d22/d108/c122 0 2024-01-31T05:13:26.117 INFO:tasks.workunit.client.0.smithi099.stdout:5/934: mkdir d6/da/d14/d136 0 2024-01-31T05:13:26.117 INFO:tasks.workunit.client.0.smithi099.stdout:6/870: stat d14/d18/d52/d22/la7 0 2024-01-31T05:13:26.124 INFO:tasks.workunit.client.0.smithi099.stdout:2/993: dwrite d10/d51/d8d/f126 [0,4194304] 0 2024-01-31T05:13:26.124 INFO:tasks.workunit.client.0.smithi099.stdout:9/963: dwrite d0/d3e/d87/dc9/d24/d2b/d63/da7/fc8 [0,4194304] 0 2024-01-31T05:13:26.125 INFO:tasks.workunit.client.0.smithi099.stdout:1/892: dwrite d4/dc/d48/fab [0,4194304] 0 2024-01-31T05:13:26.125 INFO:tasks.workunit.client.0.smithi099.stdout:1/893: fdatasync d4/dc/d15/f1a 0 2024-01-31T05:13:26.126 INFO:tasks.workunit.client.0.smithi099.stdout:1/894: mkdir d4/db/d12/dc0/d4b/d9a/dc7/d120 0 2024-01-31T05:13:26.126 INFO:tasks.workunit.client.0.smithi099.stdout:1/895: stat d4/db/d12/dc0/ffb 0 2024-01-31T05:13:26.127 INFO:tasks.workunit.client.0.smithi099.stdout:1/896: mknod d4/db/d12/dc0/d4b/d9a/dc7/c121 0 2024-01-31T05:13:26.127 INFO:tasks.workunit.client.0.smithi099.stdout:1/897: chown d4/db/d12/dc0/d69/c76 7790 1 2024-01-31T05:13:26.131 INFO:tasks.workunit.client.0.smithi099.stdout:5/935: rmdir d6/da/d14 39 2024-01-31T05:13:26.133 INFO:tasks.workunit.client.0.smithi099.stdout:9/964: creat d0/d3e/d87/dc9/d5e/d72/d89/d98/dc1/f155 x:0 0 0 2024-01-31T05:13:26.133 INFO:tasks.workunit.client.0.smithi099.stdout:9/965: write d0/d7/f14 [1114185,54560] 0 2024-01-31T05:13:26.140 INFO:tasks.workunit.client.0.smithi099.stdout:1/898: read d4/dc/d15/f4e [1443421,87121] 0 2024-01-31T05:13:26.140 INFO:tasks.workunit.client.0.smithi099.stdout:5/936: rename d6/da/d14/d61/d98/c12e to d6/da/d14/d3d/d57/d92/d119/c137 0 2024-01-31T05:13:26.140 INFO:tasks.workunit.client.0.smithi099.stdout:5/937: readlink d6/da/d14/d3d/d51/dae/lb6 0 2024-01-31T05:13:26.141 INFO:tasks.workunit.client.0.smithi099.stdout:5/938: symlink d6/da/d14/d3d/d8c/l138 0 2024-01-31T05:13:26.142 INFO:tasks.workunit.client.0.smithi099.stdout:5/939: creat d6/da/d14/d3d/d8c/de6/f139 x:0 0 0 2024-01-31T05:13:26.157 INFO:tasks.workunit.client.0.smithi099.stdout:2/994: dwrite d10/d2b/d7c/f90 [4194304,4194304] 0 2024-01-31T05:13:26.162 INFO:tasks.workunit.client.0.smithi099.stdout:2/995: dread d10/d2b/d7c/f90 [0,4194304] 0 2024-01-31T05:13:26.162 INFO:tasks.workunit.client.0.smithi099.stdout:2/996: read - d10/d20/dd0/d127/f12d zero size 2024-01-31T05:13:26.164 INFO:tasks.workunit.client.0.smithi099.stdout:2/997: mkdir d10/d1c/d43/db8/d13d 0 2024-01-31T05:13:26.164 INFO:tasks.workunit.client.0.smithi099.stdout:6/871: dwrite d14/d18/d52/d7e/fd3 [0,4194304] 0 2024-01-31T05:13:26.164 INFO:tasks.workunit.client.0.smithi099.stdout:9/966: dwrite d0/d5d/f126 [0,4194304] 0 2024-01-31T05:13:26.165 INFO:tasks.workunit.client.0.smithi099.stdout:6/872: readlink d14/d18/d52/d7e/d1c/d29/d79/deb/lbb 0 2024-01-31T05:13:26.168 INFO:tasks.workunit.client.0.smithi099.stdout:1/899: dwrite d4/dc/d4d/d5d/d87/fbc [0,4194304] 0 2024-01-31T05:13:26.168 INFO:tasks.workunit.client.0.smithi099.stdout:6/873: mkdir d14/d18/d52/d22/d71/dee/d7b/d123 0 2024-01-31T05:13:26.170 INFO:tasks.workunit.client.0.smithi099.stdout:1/900: link d4/db/d12/c89 d4/dc/c122 0 2024-01-31T05:13:26.171 INFO:tasks.workunit.client.0.smithi099.stdout:6/874: mknod d14/d18/d9d/de6/c124 0 2024-01-31T05:13:26.172 INFO:tasks.workunit.client.0.smithi099.stdout:1/901: creat d4/dc/d4d/d5d/d87/f123 x:0 0 0 2024-01-31T05:13:26.173 INFO:tasks.workunit.client.0.smithi099.stdout:1/902: readlink d4/db/d12/dc0/d4b/d50/d91/l21 0 2024-01-31T05:13:26.173 INFO:tasks.workunit.client.0.smithi099.stdout:2/998: truncate d10/d1b/f73 391543 0 2024-01-31T05:13:26.173 INFO:tasks.workunit.client.0.smithi099.stdout:2/999: chown d10/d2b/de6 32677578 1 2024-01-31T05:13:26.175 INFO:tasks.workunit.client.0.smithi099.stdout:1/903: unlink d4/dc/f88 0 2024-01-31T05:13:26.176 INFO:tasks.workunit.client.0.smithi099.stdout:1/904: mkdir d4/db/d11a/d124 0 2024-01-31T05:13:26.176 INFO:tasks.workunit.client.0.smithi099.stdout:9/967: write d0/d3e/d33/dab/fe1 [2915349,70150] 0 2024-01-31T05:13:26.178 INFO:tasks.workunit.client.0.smithi099.stdout:1/905: creat d4/dc/d4d/da5/dcf/f125 x:0 0 0 2024-01-31T05:13:26.181 INFO:tasks.workunit.client.0.smithi099.stdout:9/968: mknod d0/d3e/d87/dc9/d5e/d72/dbf/dd1/c156 0 2024-01-31T05:13:26.188 INFO:tasks.workunit.client.0.smithi099.stdout:1/906: write d4/dc/d4d/f51 [3390733,9737] 0 2024-01-31T05:13:26.192 INFO:tasks.workunit.client.0.smithi099.stdout:6/875: rename d14/d18/d52/d7e/d1c/d29 to d14/d18/d52/dbc/de8/d125 0 2024-01-31T05:13:26.192 INFO:tasks.workunit.client.0.smithi099.stdout:9/969: write d0/d3e/d87/dc9/d24/d2b/d59/f9b [2639147,50892] 0 2024-01-31T05:13:26.192 INFO:tasks.workunit.client.0.smithi099.stdout:9/970: dread - d0/d3e/d33/d8a/fd0 zero size 2024-01-31T05:13:26.193 INFO:tasks.workunit.client.0.smithi099.stdout:9/971: readlink d0/d7/l86 0 2024-01-31T05:13:26.193 INFO:tasks.workunit.client.0.smithi099.stdout:9/972: chown d0/d7/c76 2884602 1 2024-01-31T05:13:26.193 INFO:tasks.workunit.client.0.smithi099.stdout:9/973: chown d0/d3e/d87/dc9/d24/d2b 838 1 2024-01-31T05:13:26.193 INFO:tasks.workunit.client.0.smithi099.stdout:9/974: creat d0/d3e/d87/dc9/d24/d2b/d63/da7/daa/f157 x:0 0 0 2024-01-31T05:13:26.194 INFO:tasks.workunit.client.0.smithi099.stdout:9/975: mknod d0/d3e/d87/dc9/d5e/d72/d89/d98/c158 0 2024-01-31T05:13:26.195 INFO:tasks.workunit.client.0.smithi099.stdout:9/976: creat d0/d3e/d87/dc9/d5e/d72/dbf/d100/f159 x:0 0 0 2024-01-31T05:13:26.196 INFO:tasks.workunit.client.0.smithi099.stdout:9/977: mknod d0/d3e/d87/dc9/d5e/d72/d89/d98/d13b/c15a 0 2024-01-31T05:13:26.206 INFO:tasks.workunit.client.0.smithi099.stdout:9/978: dread d0/d7/dd2/ff8 [0,4194304] 0 2024-01-31T05:13:26.206 INFO:tasks.workunit.client.0.smithi099.stdout:9/979: chown d0/d3e/d87/dc9/l8f 135772 1 2024-01-31T05:13:26.206 INFO:tasks.workunit.client.0.smithi099.stdout:9/980: dread - d0/d3e/d87/dc9/d5e/d72/dbf/dd1/f140 zero size 2024-01-31T05:13:26.207 INFO:tasks.workunit.client.0.smithi099.stdout:6/876: dread d14/d18/d52/d7e/fd3 [0,4194304] 0 2024-01-31T05:13:26.207 INFO:tasks.workunit.client.0.smithi099.stdout:6/877: truncate d14/d18/d52/dbc/de8/d125/d79/deb/f107 642083 0 2024-01-31T05:13:26.207 INFO:tasks.workunit.client.0.smithi099.stdout:6/878: write d14/d18/d52/f84 [211233,12950] 0 2024-01-31T05:13:26.207 INFO:tasks.workunit.client.0.smithi099.stdout:6/879: getdents d14/d18/d52/d22/d71/dee/d7b/d123 0 2024-01-31T05:13:26.208 INFO:tasks.workunit.client.0.smithi099.stdout:9/981: unlink d0/d3e/d87/dc9/d5e/de0/ff4 0 2024-01-31T05:13:26.209 INFO:tasks.workunit.client.0.smithi099.stdout:9/982: symlink d0/d3e/d87/dc9/d24/d2b/l15b 0 2024-01-31T05:13:26.209 INFO:tasks.workunit.client.0.smithi099.stdout:1/907: dwrite d4/db/d12/f65 [0,4194304] 0 2024-01-31T05:13:26.210 INFO:tasks.workunit.client.0.smithi099.stdout:9/983: dread d0/d3e/d87/dc9/d24/d48/f4b [0,4194304] 0 2024-01-31T05:13:26.210 INFO:tasks.workunit.client.0.smithi099.stdout:9/984: chown d0/d5d/f126 51226984 1 2024-01-31T05:13:26.217 INFO:tasks.workunit.client.0.smithi099.stdout:5/940: sync 2024-01-31T05:13:26.218 INFO:tasks.workunit.client.0.smithi099.stdout:6/880: dread d14/f16 [0,4194304] 0 2024-01-31T05:13:26.218 INFO:tasks.workunit.client.0.smithi099.stdout:6/881: fsync d14/d18/d52/d7e/d1c/f105 0 2024-01-31T05:13:26.218 INFO:tasks.workunit.client.0.smithi099.stdout:6/882: dread - d14/d18/faa zero size 2024-01-31T05:13:26.218 INFO:tasks.workunit.client.0.smithi099.stdout:6/883: creat d14/d18/d52/d46/dfd/f126 x:0 0 0 2024-01-31T05:13:26.218 INFO:tasks.workunit.client.0.smithi099.stdout:5/941: truncate d6/da/f4f 402435 0 2024-01-31T05:13:26.218 INFO:tasks.workunit.client.0.smithi099.stdout:6/884: dread d14/d18/d52/dbc/de8/d125/d79/deb/f107 [0,4194304] 0 2024-01-31T05:13:26.220 INFO:tasks.workunit.client.0.smithi099.stdout:6/885: mknod d14/d18/d52/d22/d71/dee/c127 0 2024-01-31T05:13:26.222 INFO:tasks.workunit.client.0.smithi099.stdout:6/886: creat d14/dd0/f128 x:0 0 0 2024-01-31T05:13:26.225 INFO:tasks.workunit.client.0.smithi099.stdout:6/887: unlink d14/d18/d52/d90/cf3 0 2024-01-31T05:13:26.225 INFO:tasks.workunit.client.0.smithi099.stdout:6/888: dread - d14/d18/d52/d22/d71/dee/d7b/dd4/f100 zero size 2024-01-31T05:13:26.225 INFO:tasks.workunit.client.0.smithi099.stdout:6/889: write d14/d18/d52/d7e/d1c/da6/f111 [158467,17506] 0 2024-01-31T05:13:26.229 INFO:tasks.workunit.client.0.smithi099.stdout:5/942: dread d6/da/d14/d61/d98/d106/fd3 [0,4194304] 0 2024-01-31T05:13:26.230 INFO:tasks.workunit.client.0.smithi099.stdout:5/943: rmdir d6/da/d14/d3d/d57/d92/d119 39 2024-01-31T05:13:26.230 INFO:tasks.workunit.client.0.smithi099.stdout:5/944: mkdir d6/da/ddf/d13a 0 2024-01-31T05:13:26.232 INFO:tasks.workunit.client.0.smithi099.stdout:5/945: creat d6/da/d14/d3d/da8/d129/f13b x:0 0 0 2024-01-31T05:13:26.233 INFO:tasks.workunit.client.0.smithi099.stdout:1/908: dwrite d4/db/d3a/d7e/f106 [0,4194304] 0 2024-01-31T05:13:26.240 INFO:tasks.workunit.client.0.smithi099.stdout:6/890: dread d14/d18/d52/d7e/d66/fc7 [0,4194304] 0 2024-01-31T05:13:26.241 INFO:tasks.workunit.client.0.smithi099.stdout:6/891: creat d14/d18/d52/d7e/d1c/da6/f129 x:0 0 0 2024-01-31T05:13:26.250 INFO:tasks.workunit.client.0.smithi099.stdout:1/909: dread d4/dc/d48/f31 [4194304,4194304] 0 2024-01-31T05:13:26.251 INFO:tasks.workunit.client.0.smithi099.stdout:1/910: mkdir d4/db/d3a/d7e/d85/d115/d126 0 2024-01-31T05:13:26.265 INFO:tasks.workunit.client.0.smithi099.stdout:6/892: dwrite d14/d18/d9d/fc8 [0,4194304] 0 2024-01-31T05:13:26.266 INFO:tasks.workunit.client.0.smithi099.stdout:5/946: dwrite d6/da/d14/d94/fa6 [0,4194304] 0 2024-01-31T05:13:26.268 INFO:tasks.workunit.client.0.smithi099.stdout:1/911: write d4/db/d12/dc0/fdd [362512,6273] 0 2024-01-31T05:13:26.269 INFO:tasks.workunit.client.0.smithi099.stdout:5/947: creat d6/da/d14/d3d/d57/f13c x:0 0 0 2024-01-31T05:13:26.272 INFO:tasks.workunit.client.0.smithi099.stdout:6/893: rmdir d14/d18/d52/d22/d71/dee/d7b/d123 0 2024-01-31T05:13:26.289 INFO:tasks.workunit.client.0.smithi099.stdout:1/912: rename d4/dc/d4d/d5d/d87 to d4/db/d3a/d7e/db9/d127 0 2024-01-31T05:13:26.289 INFO:tasks.workunit.client.0.smithi099.stdout:1/913: creat d4/dc/d15/dc1/f128 x:0 0 0 2024-01-31T05:13:26.290 INFO:tasks.workunit.client.0.smithi099.stdout:1/914: mkdir d4/db/d12/dc0/d4b/de3/d129 0 2024-01-31T05:13:26.290 INFO:tasks.workunit.client.0.smithi099.stdout:5/948: rename d6/da/lb to d6/da/d14/d3d/d57/d92/d119/l13d 0 2024-01-31T05:13:26.292 INFO:tasks.workunit.client.0.smithi099.stdout:5/949: symlink d6/da/d14/d61/l13e 0 2024-01-31T05:13:26.292 INFO:tasks.workunit.client.0.smithi099.stdout:5/950: chown d6/da/d14/d3d/d51/d82/d134/f9b 408 1 2024-01-31T05:13:26.292 INFO:tasks.workunit.client.0.smithi099.stdout:5/951: stat d6/da/d14/d61/d98/d106/d81/l7c 0 2024-01-31T05:13:26.292 INFO:tasks.workunit.client.0.smithi099.stdout:5/952: write d6/da/d14/d61/d98/d106/f130 [707156,58301] 0 2024-01-31T05:13:26.292 INFO:tasks.workunit.client.0.smithi099.stdout:5/953: write d6/da/d14/d3d/d51/d82/d9a/fb5 [3043838,112423] 0 2024-01-31T05:13:26.301 INFO:tasks.workunit.client.0.smithi099.stdout:6/894: dwrite d14/d18/d52/d7e/d1c/da6/fc9 [0,4194304] 0 2024-01-31T05:13:26.301 INFO:tasks.workunit.client.0.smithi099.stdout:6/895: chown d14/d18/d52/d46/fa2 526339199 1 2024-01-31T05:13:26.309 INFO:tasks.workunit.client.0.smithi099.stdout:5/954: dread d6/fcd [0,4194304] 0 2024-01-31T05:13:26.310 INFO:tasks.workunit.client.0.smithi099.stdout:9/985: sync 2024-01-31T05:13:26.311 INFO:tasks.workunit.client.0.smithi099.stdout:9/986: mknod d0/d3e/d87/dc9/d5e/d72/d89/d98/dc1/c15c 0 2024-01-31T05:13:26.312 INFO:tasks.workunit.client.0.smithi099.stdout:9/987: truncate d0/d7/f14 1473592 0 2024-01-31T05:13:26.314 INFO:tasks.workunit.client.0.smithi099.stdout:9/988: link d0/d3e/d87/dc9/d24/d2b/d59/f60 d0/d3e/d87/dc9/d5e/de0/f15d 0 2024-01-31T05:13:26.314 INFO:tasks.workunit.client.0.smithi099.stdout:9/989: dread - d0/d3e/d87/dc9/d5e/d72/dbf/f142 zero size 2024-01-31T05:13:26.314 INFO:tasks.workunit.client.0.smithi099.stdout:9/990: write d0/d3e/d87/dc9/f102 [3872868,89920] 0 2024-01-31T05:13:26.314 INFO:tasks.workunit.client.0.smithi099.stdout:9/991: getdents d0/d3e/d87/dc9/d24 0 2024-01-31T05:13:26.315 INFO:tasks.workunit.client.0.smithi099.stdout:6/896: write d14/d18/d52/d7e/d1c/da6/fc9 [3587902,37602] 0 2024-01-31T05:13:26.316 INFO:tasks.workunit.client.0.smithi099.stdout:9/992: symlink d0/d3e/d87/dc9/d5e/d72/dbf/d100/l15e 0 2024-01-31T05:13:26.318 INFO:tasks.workunit.client.0.smithi099.stdout:6/897: mknod d14/d18/c12a 0 2024-01-31T05:13:26.318 INFO:tasks.workunit.client.0.smithi099.stdout:6/898: dread - d14/d18/faa zero size 2024-01-31T05:13:26.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:25 smithi099 ceph-mon[31615]: pgmap v410: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 132 MiB/s rd, 166 MiB/s wr, 1.47k op/s 2024-01-31T05:13:26.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:25 smithi099 ceph-mon[31615]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:13:26.319 INFO:tasks.workunit.client.0.smithi099.stdout:6/899: mknod d14/d18/d52/d22/d71/c12b 0 2024-01-31T05:13:26.319 INFO:tasks.workunit.client.0.smithi099.stdout:6/900: getdents d14/d18/d52/dbc/de8/d125/d4f 0 2024-01-31T05:13:26.321 INFO:tasks.workunit.client.0.smithi099.stdout:6/901: creat d14/d18/d52/dbc/de8/d125/f12c x:0 0 0 2024-01-31T05:13:26.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:25 smithi181 ceph-mon[36434]: pgmap v410: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 132 MiB/s rd, 166 MiB/s wr, 1.47k op/s 2024-01-31T05:13:26.321 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:25 smithi181 ceph-mon[36434]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:13:26.322 INFO:tasks.workunit.client.0.smithi099.stdout:5/955: write d6/da/d14/d2b/f77 [1685736,48375] 0 2024-01-31T05:13:26.323 INFO:tasks.workunit.client.0.smithi099.stdout:5/956: write d6/da/d14/d3d/d51/d82/d134/f9b [257349,65730] 0 2024-01-31T05:13:26.323 INFO:tasks.workunit.client.0.smithi099.stdout:6/902: unlink d14/d18/d52/d7e/d1c/fad 0 2024-01-31T05:13:26.323 INFO:tasks.workunit.client.0.smithi099.stdout:5/957: getdents d6/da/d14/d61/d98 0 2024-01-31T05:13:26.324 INFO:tasks.workunit.client.0.smithi099.stdout:6/903: dread d14/d18/d52/d7e/f8b [0,4194304] 0 2024-01-31T05:13:26.324 INFO:tasks.workunit.client.0.smithi099.stdout:6/904: dread - d14/d18/d9d/de6/f110 zero size 2024-01-31T05:13:26.325 INFO:tasks.workunit.client.0.smithi099.stdout:6/905: mkdir d14/d18/d52/d22/d71/dee/d7b/d12d 0 2024-01-31T05:13:26.326 INFO:tasks.workunit.client.0.smithi099.stdout:6/906: creat d14/d18/d52/d90/d9a/f12e x:0 0 0 2024-01-31T05:13:26.327 INFO:tasks.workunit.client.0.smithi099.stdout:9/993: read d0/d44/f53 [2800,30714] 0 2024-01-31T05:13:26.327 INFO:tasks.workunit.client.0.smithi099.stdout:9/994: fdatasync d0/d3e/d87/dc9/d24/d2b/d7b/fa4 0 2024-01-31T05:13:26.328 INFO:tasks.workunit.client.0.smithi099.stdout:6/907: symlink d14/d18/d52/d22/d71/dee/d7b/dd4/l12f 0 2024-01-31T05:13:26.328 INFO:tasks.workunit.client.0.smithi099.stdout:9/995: unlink d0/d3e/d33/dab/cce 0 2024-01-31T05:13:26.330 INFO:tasks.workunit.client.0.smithi099.stdout:9/996: rename d0/d3e/cde to d0/d7/d2e/d12e/c15f 0 2024-01-31T05:13:26.331 INFO:tasks.workunit.client.0.smithi099.stdout:9/997: mkdir d0/d3e/d87/dc9/d5e/d72/d89/d98/d13b/d160 0 2024-01-31T05:13:26.331 INFO:tasks.workunit.client.0.smithi099.stdout:9/998: creat d0/d3e/d87/dc9/d5e/d72/f161 x:0 0 0 2024-01-31T05:13:26.331 INFO:tasks.workunit.client.0.smithi099.stdout:9/999: readlink d0/d3e/d87/dc9/d24/d2b/d59/la3 0 2024-01-31T05:13:26.332 INFO:tasks.workunit.client.0.smithi099.stdout:5/958: write d6/da/d14/d3d/d57/f97 [2426120,73758] 0 2024-01-31T05:13:26.333 INFO:tasks.workunit.client.0.smithi099.stdout:5/959: symlink d6/da/d14/d3d/d51/d82/d9a/l13f 0 2024-01-31T05:13:26.334 INFO:tasks.workunit.client.0.smithi099.stdout:5/960: truncate d6/da/d14/d3d/d6e/f22 9400164 0 2024-01-31T05:13:26.334 INFO:tasks.workunit.client.0.smithi099.stdout:5/961: mkdir d6/da/d14/de7/df7/d140 0 2024-01-31T05:13:26.340 INFO:tasks.workunit.client.0.smithi099.stdout:6/908: rmdir d14/d18/d52/d22/d71/dee 39 2024-01-31T05:13:26.340 INFO:tasks.workunit.client.0.smithi099.stdout:6/909: write d14/d18/d9d/de6/ffc [886461,66841] 0 2024-01-31T05:13:26.341 INFO:tasks.workunit.client.0.smithi099.stdout:6/910: fdatasync d14/d18/d52/dbc/de8/d125/f76 0 2024-01-31T05:13:26.341 INFO:tasks.workunit.client.0.smithi099.stdout:6/911: write d14/d18/d52/d46/f8d [1352714,54608] 0 2024-01-31T05:13:26.341 INFO:tasks.workunit.client.0.smithi099.stdout:6/912: stat d14/d18/d52/dbc/de8 0 2024-01-31T05:13:26.342 INFO:tasks.workunit.client.0.smithi099.stdout:5/962: dread d6/ff [0,4194304] 0 2024-01-31T05:13:26.346 INFO:tasks.workunit.client.0.smithi099.stdout:6/913: write d14/d18/d52/d7e/d66/fc7 [2247188,121856] 0 2024-01-31T05:13:26.352 INFO:tasks.workunit.client.0.smithi099.stdout:5/963: link d6/da/d14/d3d/d6e/f85 d6/da/d14/d3d/d57/dc6/f141 0 2024-01-31T05:13:26.357 INFO:tasks.workunit.client.0.smithi099.stdout:6/914: dread d14/d18/d52/d7e/d66/f9f [0,4194304] 0 2024-01-31T05:13:26.375 INFO:tasks.workunit.client.0.smithi099.stdout:5/964: dwrite d6/da/d14/d3d/d57/fa4 [0,4194304] 0 2024-01-31T05:13:26.375 INFO:tasks.workunit.client.0.smithi099.stdout:5/965: read - d6/da/d14/d3d/d8c/de6/f139 zero size 2024-01-31T05:13:26.377 INFO:tasks.workunit.client.0.smithi099.stdout:5/966: rmdir d6/da/d14/d61/d98/da0/d11f/d12a 0 2024-01-31T05:13:26.378 INFO:tasks.workunit.client.0.smithi099.stdout:5/967: mkdir d6/da/d14/d61/d98/d106/d142 0 2024-01-31T05:13:26.379 INFO:tasks.workunit.client.0.smithi099.stdout:5/968: creat d6/da/d14/d3d/d51/dae/f143 x:0 0 0 2024-01-31T05:13:26.382 INFO:tasks.workunit.client.0.smithi099.stdout:6/915: dwrite d14/d18/d9d/de6/f114 [0,4194304] 0 2024-01-31T05:13:26.382 INFO:tasks.workunit.client.0.smithi099.stdout:6/916: truncate d14/d18/d52/d7e/fbf 1849164 0 2024-01-31T05:13:26.382 INFO:tasks.workunit.client.0.smithi099.stdout:6/917: truncate d14/d18/d52/d7e/d1c/da6/dba/fcd 15718 0 2024-01-31T05:13:26.382 INFO:tasks.workunit.client.0.smithi099.stdout:6/918: chown d14/d18/d52/d22/l4c 4 1 2024-01-31T05:13:26.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:25 smithi179 ceph-mon[35652]: pgmap v410: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 132 MiB/s rd, 166 MiB/s wr, 1.47k op/s 2024-01-31T05:13:26.383 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:25 smithi179 ceph-mon[35652]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:13:26.394 INFO:tasks.workunit.client.0.smithi099.stdout:1/915: sync 2024-01-31T05:13:26.395 INFO:tasks.workunit.client.0.smithi099.stdout:1/916: getdents d4/db/d3a/d7e/d85/de8 0 2024-01-31T05:13:26.397 INFO:tasks.workunit.client.0.smithi099.stdout:1/917: symlink d4/dc/d4d/l12a 0 2024-01-31T05:13:26.397 INFO:tasks.workunit.client.0.smithi099.stdout:1/918: creat d4/dc/d4d/da5/dcf/f12b x:0 0 0 2024-01-31T05:13:26.407 INFO:tasks.workunit.client.0.smithi099.stdout:5/969: dwrite d6/da/d14/d61/fe9 [0,4194304] 0 2024-01-31T05:13:26.407 INFO:tasks.workunit.client.0.smithi099.stdout:5/970: chown d6/da/d14/d3d/d51/d82/d134/d73/lb9 987 1 2024-01-31T05:13:26.413 INFO:tasks.workunit.client.0.smithi099.stdout:6/919: dwrite d14/d18/d52/d7e/d1c/da6/fc9 [0,4194304] 0 2024-01-31T05:13:26.418 INFO:tasks.workunit.client.0.smithi099.stdout:5/971: link d6/da/d14/d3d/d57/dc6/ld7 d6/da/d14/d94/l144 0 2024-01-31T05:13:26.418 INFO:tasks.workunit.client.0.smithi099.stdout:5/972: chown d6/da/d14/d3d/d51/d82/d134/c68 1194 1 2024-01-31T05:13:26.420 INFO:tasks.workunit.client.0.smithi099.stdout:1/919: dwrite d4/dc/f2c [0,4194304] 0 2024-01-31T05:13:26.420 INFO:tasks.workunit.client.0.smithi099.stdout:1/920: truncate d4/df9/f8e 953580 0 2024-01-31T05:13:26.425 INFO:tasks.workunit.client.0.smithi099.stdout:1/921: write d4/dc/d4d/da5/f109 [719004,47047] 0 2024-01-31T05:13:26.425 INFO:tasks.workunit.client.0.smithi099.stdout:1/922: chown d4/dc/d29/l2e 763 1 2024-01-31T05:13:26.425 INFO:tasks.workunit.client.0.smithi099.stdout:1/923: truncate d4/db/d12/dc0/ffb 4309738 0 2024-01-31T05:13:26.433 INFO:tasks.workunit.client.0.smithi099.stdout:6/920: dwrite d14/dd0/f128 [0,4194304] 0 2024-01-31T05:13:26.446 INFO:tasks.workunit.client.0.smithi099.stdout:6/921: write d14/dd0/f128 [3231485,70488] 0 2024-01-31T05:13:26.446 INFO:tasks.workunit.client.0.smithi099.stdout:5/973: dwrite d6/da/d14/d3d/d51/dae/fe8 [4194304,4194304] 0 2024-01-31T05:13:26.451 INFO:tasks.workunit.client.0.smithi099.stdout:5/974: link d6/da/d14/d3d/d6e/l128 d6/da/d14/d3d/d57/d92/d119/l145 0 2024-01-31T05:13:26.451 INFO:tasks.workunit.client.0.smithi099.stdout:5/975: chown d6/da/d14/d3d/d57/f97 15 1 2024-01-31T05:13:26.452 INFO:tasks.workunit.client.0.smithi099.stdout:5/976: creat d6/da/d14/d3d/d51/d82/d134/d73/f146 x:0 0 0 2024-01-31T05:13:26.454 INFO:tasks.workunit.client.0.smithi099.stdout:6/922: dread d14/dd0/f128 [0,4194304] 0 2024-01-31T05:13:26.455 INFO:tasks.workunit.client.0.smithi099.stdout:5/977: read d6/da/d14/d3d/d51/d82/d134/fdc [145785,75676] 0 2024-01-31T05:13:26.455 INFO:tasks.workunit.client.0.smithi099.stdout:5/978: write d6/da/ddf/f12b [928099,87704] 0 2024-01-31T05:13:26.456 INFO:tasks.workunit.client.0.smithi099.stdout:5/979: mkdir d6/da/d14/d94/d147 0 2024-01-31T05:13:26.457 INFO:tasks.workunit.client.0.smithi099.stdout:5/980: creat d6/da/d14/d61/d98/da0/d107/d122/f148 x:0 0 0 2024-01-31T05:13:26.457 INFO:tasks.workunit.client.0.smithi099.stdout:5/981: creat d6/da/d14/d3d/d57/f149 x:0 0 0 2024-01-31T05:13:26.459 INFO:tasks.workunit.client.0.smithi099.stdout:5/982: symlink d6/da/d14/d3d/d8c/de6/l14a 0 2024-01-31T05:13:26.465 INFO:tasks.workunit.client.0.smithi099.stdout:6/923: write d14/d18/d52/d46/fa2 [468068,67895] 0 2024-01-31T05:13:26.465 INFO:tasks.workunit.client.0.smithi099.stdout:6/924: fdatasync d14/d18/f6c 0 2024-01-31T05:13:26.465 INFO:tasks.workunit.client.0.smithi099.stdout:6/925: write d14/d18/d52/dbc/de8/d125/f76 [614767,104562] 0 2024-01-31T05:13:26.474 INFO:tasks.workunit.client.0.smithi099.stdout:6/926: link d14/d18/d52/d22/d71/c12b d14/d18/d52/d7e/d1c/da6/c130 0 2024-01-31T05:13:26.474 INFO:tasks.workunit.client.0.smithi099.stdout:6/927: write d14/d18/d52/d90/d9a/f10c [586500,91791] 0 2024-01-31T05:13:26.474 INFO:tasks.workunit.client.0.smithi099.stdout:6/928: write d14/d18/f6c [2489854,11887] 0 2024-01-31T05:13:26.481 INFO:tasks.workunit.client.0.smithi099.stdout:5/983: dwrite d6/da/d14/d3d/d57/f97 [0,4194304] 0 2024-01-31T05:13:26.483 INFO:tasks.workunit.client.0.smithi099.stdout:5/984: unlink d6/da/d14/d3d/d51/d82/d9a/lf3 0 2024-01-31T05:13:26.487 INFO:tasks.workunit.client.0.smithi099.stdout:5/985: dread f1 [0,4194304] 0 2024-01-31T05:13:26.487 INFO:tasks.workunit.client.0.smithi099.stdout:5/986: fdatasync d6/da/d14/d94/f87 0 2024-01-31T05:13:26.488 INFO:tasks.workunit.client.0.smithi099.stdout:5/987: mknod d6/da/d14/de7/df7/d140/c14b 0 2024-01-31T05:13:26.488 INFO:tasks.workunit.client.0.smithi099.stdout:6/929: dread d14/d18/d52/d7e/d1c/f44 [0,4194304] 0 2024-01-31T05:13:26.488 INFO:tasks.workunit.client.0.smithi099.stdout:5/988: symlink d6/da/d14/d2b/d12d/l14c 0 2024-01-31T05:13:26.489 INFO:tasks.workunit.client.0.smithi099.stdout:5/989: mknod d6/da/d14/d61/d98/c14d 0 2024-01-31T05:13:26.494 INFO:tasks.workunit.client.0.smithi099.stdout:6/930: dread d14/d18/d52/d46/f8d [0,4194304] 0 2024-01-31T05:13:26.495 INFO:tasks.workunit.client.0.smithi099.stdout:6/931: symlink d14/d18/d52/d90/l131 0 2024-01-31T05:13:26.495 INFO:tasks.workunit.client.0.smithi099.stdout:6/932: fdatasync d14/f40 0 2024-01-31T05:13:26.496 INFO:tasks.workunit.client.0.smithi099.stdout:6/933: chown le 372758 1 2024-01-31T05:13:26.498 INFO:tasks.workunit.client.0.smithi099.stdout:6/934: rmdir d14/d18/d52/d7e 39 2024-01-31T05:13:26.500 INFO:tasks.workunit.client.0.smithi099.stdout:6/935: creat d14/d18/d52/d22/d71/dee/d7b/d117/f132 x:0 0 0 2024-01-31T05:13:26.501 INFO:tasks.workunit.client.0.smithi099.stdout:6/936: chown d14/d18/d52/d7e/d1c/fa5 10886129 1 2024-01-31T05:13:26.510 INFO:tasks.workunit.client.0.smithi099.stdout:5/990: dwrite d6/da/d14/d3d/d51/d82/d134/f63 [0,4194304] 0 2024-01-31T05:13:26.516 INFO:tasks.workunit.client.0.smithi099.stdout:5/991: mknod d6/da/d14/d2b/d9e/c14e 0 2024-01-31T05:13:26.520 INFO:tasks.workunit.client.0.smithi099.stdout:6/937: link d14/d18/d52/d7e/d1c/f8f d14/d18/f133 0 2024-01-31T05:13:26.521 INFO:tasks.workunit.client.0.smithi099.stdout:6/938: creat d14/d18/d52/dbc/f134 x:0 0 0 2024-01-31T05:13:26.523 INFO:tasks.workunit.client.0.smithi099.stdout:1/924: sync 2024-01-31T05:13:26.526 INFO:tasks.workunit.client.0.smithi099.stdout:1/925: creat d4/db/d3a/d7e/d85/f12c x:0 0 0 2024-01-31T05:13:26.528 INFO:tasks.workunit.client.0.smithi099.stdout:1/926: symlink d4/dc/d29/daa/ddf/l12d 0 2024-01-31T05:13:26.534 INFO:tasks.workunit.client.0.smithi099.stdout:6/939: link d14/d18/faa d14/d18/d52/d7e/ddd/f135 0 2024-01-31T05:13:26.537 INFO:tasks.workunit.client.0.smithi099.stdout:1/927: write d4/db/d3a/d7e/db9/d127/fdc [2578843,19503] 0 2024-01-31T05:13:26.539 INFO:tasks.workunit.client.0.smithi099.stdout:1/928: symlink d4/db/l12e 0 2024-01-31T05:13:26.547 INFO:tasks.workunit.client.0.smithi099.stdout:1/929: dread d4/dc/d48/fab [0,4194304] 0 2024-01-31T05:13:26.570 INFO:tasks.workunit.client.0.smithi099.stdout:1/930: dwrite d4/dc/d15/f4e [4194304,4194304] 0 2024-01-31T05:13:26.572 INFO:tasks.workunit.client.0.smithi099.stdout:1/931: mkdir d4/db/d3a/d7e/d85/de8/d12f 0 2024-01-31T05:13:26.573 INFO:tasks.workunit.client.0.smithi099.stdout:1/932: mkdir d4/dc/d15/dc1/d130 0 2024-01-31T05:13:26.573 INFO:tasks.workunit.client.0.smithi099.stdout:1/933: chown d4/db/d3a/d7e/db9/d127/l81 1764 1 2024-01-31T05:13:26.594 INFO:tasks.workunit.client.0.smithi099.stdout:1/934: dwrite d4/db/d12/d74/f10d [0,4194304] 0 2024-01-31T05:13:26.615 INFO:tasks.workunit.client.0.smithi099.stdout:1/935: dwrite d4/db/d12/dc0/fdd [0,4194304] 0 2024-01-31T05:13:26.615 INFO:tasks.workunit.client.0.smithi099.stdout:1/936: readlink d4/db/d10e/lff 0 2024-01-31T05:13:26.615 INFO:tasks.workunit.client.0.smithi099.stdout:1/937: creat d4/db/d12/dc0/d4b/d9a/f131 x:0 0 0 2024-01-31T05:13:26.616 INFO:tasks.workunit.client.0.smithi099.stdout:1/938: creat d4/dc/d15/d45/f132 x:0 0 0 2024-01-31T05:13:26.628 INFO:tasks.workunit.client.0.smithi099.stdout:5/992: sync 2024-01-31T05:13:26.628 INFO:tasks.workunit.client.0.smithi099.stdout:1/939: rename d4/db/d12/dc0/d4b/d50/d91/c1b to d4/dc/d15/dc1/d130/c133 0 2024-01-31T05:13:26.628 INFO:tasks.workunit.client.0.smithi099.stdout:5/993: truncate d6/da/d14/d3d/d57/f149 464274 0 2024-01-31T05:13:26.629 INFO:tasks.workunit.client.0.smithi099.stdout:1/940: readlink d4/db/d12/dc0/d4b/d50/d91/l1d 0 2024-01-31T05:13:26.656 INFO:tasks.workunit.client.0.smithi099.stdout:5/994: dwrite d6/da/d14/d3d/d51/dae/f143 [0,4194304] 0 2024-01-31T05:13:26.656 INFO:tasks.workunit.client.0.smithi099.stdout:1/941: dwrite d4/dc/d4d/f51 [0,4194304] 0 2024-01-31T05:13:26.662 INFO:tasks.workunit.client.0.smithi099.stdout:6/940: sync 2024-01-31T05:13:26.664 INFO:tasks.workunit.client.0.smithi099.stdout:6/941: readlink d14/d18/d52/dbc/de8/d125/d79/deb/lcb 0 2024-01-31T05:13:26.665 INFO:tasks.workunit.client.0.smithi099.stdout:6/942: creat d14/d18/d52/dbc/d120/f136 x:0 0 0 2024-01-31T05:13:26.666 INFO:tasks.workunit.client.0.smithi099.stdout:1/942: dread d4/db/f94 [0,4194304] 0 2024-01-31T05:13:26.666 INFO:tasks.workunit.client.0.smithi099.stdout:6/943: creat d14/d18/d52/d7e/d66/f137 x:0 0 0 2024-01-31T05:13:26.666 INFO:tasks.workunit.client.0.smithi099.stdout:6/944: chown d14/d18/d52/d7e/d1c 2338872 1 2024-01-31T05:13:26.666 INFO:tasks.workunit.client.0.smithi099.stdout:6/945: stat d14/d18/d52/dbc/de8/d125/f76 0 2024-01-31T05:13:26.668 INFO:tasks.workunit.client.0.smithi099.stdout:1/943: truncate d4/dc/d48/f2f 447650 0 2024-01-31T05:13:26.668 INFO:tasks.workunit.client.0.smithi099.stdout:6/946: mkdir d14/d18/d52/dbc/de8/d125/d4f/d138 0 2024-01-31T05:13:26.671 INFO:tasks.workunit.client.0.smithi099.stdout:1/944: link d4/db/d12/dc0/d4b/d50/d91/f22 d4/db/d3a/f134 0 2024-01-31T05:13:26.681 INFO:tasks.workunit.client.0.smithi099.stdout:5/995: dwrite d6/f6d [0,4194304] 0 2024-01-31T05:13:26.683 INFO:tasks.workunit.client.0.smithi099.stdout:5/996: creat d6/da/d14/d3d/d51/d82/d134/d73/de4/f14f x:0 0 0 2024-01-31T05:13:26.687 INFO:tasks.workunit.client.0.smithi099.stdout:5/997: rename d6/da/d14/d3d/d51/d82/f43 to d6/da/d14/d94/d147/f150 0 2024-01-31T05:13:26.687 INFO:tasks.workunit.client.0.smithi099.stdout:5/998: fsync d6/da/d14/d3d/d51/d82/d134/d73/f146 0 2024-01-31T05:13:26.687 INFO:tasks.workunit.client.0.smithi099.stdout:5/999: chown d6/da/d14/d3d/d51/d82/d134/l11c 1675862 1 2024-01-31T05:13:26.687 INFO:tasks.workunit.client.0.smithi099.stdout:6/947: dread d14/d18/d52/dbc/de8/d125/d43/f91 [0,4194304] 0 2024-01-31T05:13:26.689 INFO:tasks.workunit.client.0.smithi099.stdout:6/948: rename d14/d18/d52/d22/f59 to d14/d18/d52/d90/d9a/f139 0 2024-01-31T05:13:26.690 INFO:tasks.workunit.client.0.smithi099.stdout:6/949: symlink d14/d18/d52/d7e/d66/l13a 0 2024-01-31T05:13:26.691 INFO:tasks.workunit.client.0.smithi099.stdout:6/950: symlink d14/d18/d52/d7e/d1c/da6/l13b 0 2024-01-31T05:13:26.702 INFO:tasks.workunit.client.0.smithi099.stdout:1/945: dwrite d4/db/d3a/d7e/db9/d127/f54 [4194304,4194304] 0 2024-01-31T05:13:26.702 INFO:tasks.workunit.client.0.smithi099.stdout:6/951: dread d14/f15 [4194304,4194304] 0 2024-01-31T05:13:26.704 INFO:tasks.workunit.client.0.smithi099.stdout:6/952: truncate d14/d18/d9d/de6/f114 1172492 0 2024-01-31T05:13:26.706 INFO:tasks.workunit.client.0.smithi099.stdout:1/946: unlink d4/db/d3a/d7e/db9/d127/fbc 0 2024-01-31T05:13:26.706 INFO:tasks.workunit.client.0.smithi099.stdout:6/953: mkdir d14/d18/d52/dbc/de8/d125/d79/d118/d13c 0 2024-01-31T05:13:26.723 INFO:tasks.workunit.client.0.smithi099.stdout:6/954: rename d14/d18/d52/d90/d9a to d14/d18/d52/d22/d71/dee/d7b/d13d 0 2024-01-31T05:13:26.725 INFO:tasks.workunit.client.0.smithi099.stdout:6/955: rmdir d14/d18/d52/d22/d71/dee/d7b/d117 39 2024-01-31T05:13:26.727 INFO:tasks.workunit.client.0.smithi099.stdout:1/947: dwrite d4/db/d12/dc0/d69/f70 [0,4194304] 0 2024-01-31T05:13:26.729 INFO:tasks.workunit.client.0.smithi099.stdout:1/948: link d4/dc/d29/daa/l108 d4/db/d12/d74/l135 0 2024-01-31T05:13:26.730 INFO:tasks.workunit.client.0.smithi099.stdout:1/949: symlink d4/dc/d4d/da5/l136 0 2024-01-31T05:13:26.735 INFO:tasks.workunit.client.0.smithi099.stdout:6/956: link d14/d18/d52/d46/dfd/f126 d14/d18/d52/d7e/d1c/de0/f13e 0 2024-01-31T05:13:26.735 INFO:tasks.workunit.client.0.smithi099.stdout:6/957: creat d14/d18/d52/d46/f13f x:0 0 0 2024-01-31T05:13:26.738 INFO:tasks.workunit.client.0.smithi099.stdout:6/958: write d14/d18/d52/d7e/d1c/f5f [495567,49502] 0 2024-01-31T05:13:26.743 INFO:tasks.workunit.client.0.smithi099.stdout:6/959: write d14/d18/d52/d7e/d66/f9f [2052499,50922] 0 2024-01-31T05:13:26.745 INFO:tasks.workunit.client.0.smithi099.stdout:6/960: write d14/d18/d52/d7e/d1c/de0/f13e [755174,33642] 0 2024-01-31T05:13:26.746 INFO:tasks.workunit.client.0.smithi099.stdout:6/961: mkdir d14/d18/d52/df6/d140 0 2024-01-31T05:13:26.753 INFO:tasks.workunit.client.0.smithi099.stdout:1/950: dwrite d4/dc/d48/d104/d114/f11b [0,4194304] 0 2024-01-31T05:13:26.754 INFO:tasks.workunit.client.0.smithi099.stdout:1/951: symlink d4/db/d10e/d83/l137 0 2024-01-31T05:13:26.755 INFO:tasks.workunit.client.0.smithi099.stdout:1/952: getdents d4/db/d11a 0 2024-01-31T05:13:26.755 INFO:tasks.workunit.client.0.smithi099.stdout:1/953: write d4/dc/d4d/da5/dcf/f12b [618618,106177] 0 2024-01-31T05:13:26.755 INFO:tasks.workunit.client.0.smithi099.stdout:1/954: creat d4/db/d12/dc0/d4b/d9a/dc7/f138 x:0 0 0 2024-01-31T05:13:26.755 INFO:tasks.workunit.client.0.smithi099.stdout:1/955: chown d4/db/d12/dc0/d4b/d9a/lbb 2 1 2024-01-31T05:13:26.756 INFO:tasks.workunit.client.0.smithi099.stdout:1/956: getdents d4/db/d3a/d7e/d85/de8 0 2024-01-31T05:13:26.756 INFO:tasks.workunit.client.0.smithi099.stdout:1/957: creat d4/db/d12/dc0/d4b/de3/f139 x:0 0 0 2024-01-31T05:13:26.756 INFO:tasks.workunit.client.0.smithi099.stdout:1/958: chown d4/db/d3a/d7e/db9 429485 1 2024-01-31T05:13:26.758 INFO:tasks.workunit.client.0.smithi099.stdout:1/959: symlink d4/dc/d44/l13a 0 2024-01-31T05:13:26.758 INFO:tasks.workunit.client.0.smithi099.stdout:1/960: truncate d4/df9/ff7 3749282 0 2024-01-31T05:13:26.759 INFO:tasks.workunit.client.0.smithi099.stdout:1/961: creat d4/db/d3a/d7e/d85/d115/f13b x:0 0 0 2024-01-31T05:13:26.762 INFO:tasks.workunit.client.0.smithi099.stdout:6/962: dread d14/d18/d52/d7e/d1c/da6/fc9 [0,4194304] 0 2024-01-31T05:13:26.769 INFO:tasks.workunit.client.0.smithi099.stdout:6/963: dread d14/d18/d52/d22/d71/dee/d7b/f7d [0,4194304] 0 2024-01-31T05:13:26.769 INFO:tasks.workunit.client.0.smithi099.stdout:6/964: write d14/d18/d52/d46/f13f [825224,15914] 0 2024-01-31T05:13:26.778 INFO:tasks.workunit.client.0.smithi099.stdout:1/962: dwrite d4/db/d3a/d7e/db9/d127/f9d [4194304,4194304] 0 2024-01-31T05:13:26.778 INFO:tasks.workunit.client.0.smithi099.stdout:1/963: chown d4/dc/d29/f46 61197 1 2024-01-31T05:13:26.779 INFO:tasks.workunit.client.0.smithi099.stdout:6/965: write d14/d18/d9d/fc8 [1682122,18534] 0 2024-01-31T05:13:26.779 INFO:tasks.workunit.client.0.smithi099.stdout:6/966: fdatasync d14/d18/d52/d22/d71/dee/d7b/dd4/f10b 0 2024-01-31T05:13:26.782 INFO:tasks.workunit.client.0.smithi099.stdout:6/967: link d14/d18/d52/d7e/d1c/c3c d14/d18/d52/dbc/de8/d125/c141 0 2024-01-31T05:13:26.782 INFO:tasks.workunit.client.0.smithi099.stdout:6/968: stat d14/d18/d9d/de6/f114 0 2024-01-31T05:13:26.784 INFO:tasks.workunit.client.0.smithi099.stdout:6/969: creat d14/d18/d52/d7e/ddd/f142 x:0 0 0 2024-01-31T05:13:26.784 INFO:tasks.workunit.client.0.smithi099.stdout:1/964: truncate d4/db/d12/dc0/d69/f70 1765157 0 2024-01-31T05:13:26.784 INFO:tasks.workunit.client.0.smithi099.stdout:1/965: fdatasync d4/dc/d48/d104/d114/f11b 0 2024-01-31T05:13:26.786 INFO:tasks.workunit.client.0.smithi099.stdout:1/966: mkdir d4/db/d3a/d7e/db9/d13c 0 2024-01-31T05:13:26.786 INFO:tasks.workunit.client.0.smithi099.stdout:1/967: creat d4/db/d3a/d7e/d85/d115/f13d x:0 0 0 2024-01-31T05:13:26.788 INFO:tasks.workunit.client.0.smithi099.stdout:1/968: symlink d4/db/d3a/d7e/d85/l13e 0 2024-01-31T05:13:26.792 INFO:tasks.workunit.client.0.smithi099.stdout:6/970: dread d14/d18/d52/d7e/d1c/da6/fc9 [0,4194304] 0 2024-01-31T05:13:26.798 INFO:tasks.workunit.client.0.smithi099.stdout:1/969: dread d4/dc/f2c [0,4194304] 0 2024-01-31T05:13:26.799 INFO:tasks.workunit.client.0.smithi099.stdout:1/970: write d4/fd0 [239619,31213] 0 2024-01-31T05:13:26.830 INFO:tasks.workunit.client.0.smithi099.stdout:1/971: dwrite d4/db/d12/dc0/d4b/d50/fc9 [0,4194304] 0 2024-01-31T05:13:26.831 INFO:tasks.workunit.client.0.smithi099.stdout:6/971: dwrite d14/d18/f93 [0,4194304] 0 2024-01-31T05:13:26.831 INFO:tasks.workunit.client.0.smithi099.stdout:6/972: fdatasync d14/d18/d52/d90/fb1 0 2024-01-31T05:13:26.844 INFO:tasks.workunit.client.0.smithi099.stdout:6/973: link le d14/d18/d52/dbc/de8/d125/d79/d118/l143 0 2024-01-31T05:13:26.845 INFO:tasks.workunit.client.0.smithi099.stdout:6/974: mknod d14/d18/d52/df6/d140/c144 0 2024-01-31T05:13:26.848 INFO:tasks.workunit.client.0.smithi099.stdout:1/972: dwrite d4/db/d12/dc0/d4b/d9a/dc7/f138 [0,4194304] 0 2024-01-31T05:13:26.853 INFO:tasks.workunit.client.0.smithi099.stdout:6/975: dread d14/d18/d52/d7e/fd3 [0,4194304] 0 2024-01-31T05:13:26.853 INFO:tasks.workunit.client.0.smithi099.stdout:6/976: write d14/d18/d52/d7e/d1c/da6/dba/fcd [155881,49947] 0 2024-01-31T05:13:26.853 INFO:tasks.workunit.client.0.smithi099.stdout:6/977: chown d14/d18/d52/d22/d71 11671191 1 2024-01-31T05:13:26.853 INFO:tasks.workunit.client.0.smithi099.stdout:6/978: write d14/d18/faa [873886,6353] 0 2024-01-31T05:13:26.855 INFO:tasks.workunit.client.0.smithi099.stdout:6/979: symlink d14/d18/d52/d7e/d1c/l145 0 2024-01-31T05:13:26.857 INFO:tasks.workunit.client.0.smithi099.stdout:6/980: unlink d14/d18/l10f 0 2024-01-31T05:13:26.859 INFO:tasks.workunit.client.0.smithi099.stdout:6/981: symlink d14/d18/d52/d7e/ddd/l146 0 2024-01-31T05:13:26.870 INFO:tasks.workunit.client.0.smithi099.stdout:1/973: dwrite d4/db/d12/dc0/d4b/d9a/f119 [0,4194304] 0 2024-01-31T05:13:26.886 INFO:tasks.workunit.client.0.smithi099.stdout:6/982: dwrite d14/d18/d52/d7e/d1c/fc3 [0,4194304] 0 2024-01-31T05:13:26.888 INFO:tasks.workunit.client.0.smithi099.stdout:6/983: link d14/d18/d52/df6/d140/c144 d14/d18/d52/dbc/c147 0 2024-01-31T05:13:26.889 INFO:tasks.workunit.client.0.smithi099.stdout:6/984: mknod d14/d18/d52/dbc/de8/c148 0 2024-01-31T05:13:26.892 INFO:tasks.workunit.client.0.smithi099.stdout:6/985: getdents d14/d18/d52/d7e/d1c/da6/dba 0 2024-01-31T05:13:26.892 INFO:tasks.workunit.client.0.smithi099.stdout:1/974: dwrite d4/db/d3a/d7e/d85/f12c [0,4194304] 0 2024-01-31T05:13:26.892 INFO:tasks.workunit.client.0.smithi099.stdout:1/975: mkdir d4/db/d12/d74/d13f 0 2024-01-31T05:13:26.892 INFO:tasks.workunit.client.0.smithi099.stdout:1/976: chown d4/dc/d4d/da5/dcf/f125 257858431 1 2024-01-31T05:13:26.903 INFO:tasks.workunit.client.0.smithi099.stdout:6/986: write d14/d18/d52/d22/fce [1041453,36563] 0 2024-01-31T05:13:26.904 INFO:tasks.workunit.client.0.smithi099.stdout:6/987: mknod d14/d18/d52/d22/d71/dee/d7b/d117/c149 0 2024-01-31T05:13:26.906 INFO:tasks.workunit.client.0.smithi099.stdout:6/988: getdents d14/d18/d52/d22 0 2024-01-31T05:13:26.906 INFO:tasks.workunit.client.0.smithi099.stdout:6/989: chown d14/dd0/c119 282426 1 2024-01-31T05:13:26.906 INFO:tasks.workunit.client.0.smithi099.stdout:6/990: chown d14/d18/d52/d22/d71/dee/d7b/f7d 474 1 2024-01-31T05:13:26.907 INFO:tasks.workunit.client.0.smithi099.stdout:1/977: write d4/dc/d15/d45/faf [1845414,33034] 0 2024-01-31T05:13:26.907 INFO:tasks.workunit.client.0.smithi099.stdout:6/991: getdents d14/d18/d52/dbc/de8/de9 0 2024-01-31T05:13:26.912 INFO:tasks.workunit.client.0.smithi099.stdout:6/992: creat d14/d18/d52/d7e/d1c/da6/dba/f14a x:0 0 0 2024-01-31T05:13:26.925 INFO:tasks.workunit.client.0.smithi099.stdout:1/978: dwrite d4/db/f94 [0,4194304] 0 2024-01-31T05:13:26.936 INFO:tasks.workunit.client.0.smithi099.stdout:1/979: write d4/dc/d29/f46 [3445095,20055] 0 2024-01-31T05:13:26.938 INFO:tasks.workunit.client.0.smithi099.stdout:1/980: rename d4/db/d12/l47 to d4/db/d3a/d7e/l140 0 2024-01-31T05:13:26.942 INFO:tasks.workunit.client.0.smithi099.stdout:1/981: write d4/dc/d4d/d5d/f7f [1817932,12912] 0 2024-01-31T05:13:26.943 INFO:tasks.workunit.client.0.smithi099.stdout:1/982: chown d4/db/d3a/d7e/db9/d127/cf6 954192737 1 2024-01-31T05:13:26.943 INFO:tasks.workunit.client.0.smithi099.stdout:1/983: creat d4/db/d12/dc0/f141 x:0 0 0 2024-01-31T05:13:26.953 INFO:tasks.workunit.client.0.smithi099.stdout:1/984: link d4/db/d12/dc0/d4b/d50/d91/l21 d4/db/l142 0 2024-01-31T05:13:26.953 INFO:tasks.workunit.client.0.smithi099.stdout:1/985: truncate d4/db/d12/dc0/d4b/f102 234116 0 2024-01-31T05:13:26.975 INFO:tasks.workunit.client.0.smithi099.stdout:1/986: dwrite d4/db/d12/f65 [0,4194304] 0 2024-01-31T05:13:26.982 INFO:tasks.workunit.client.0.smithi099.stdout:1/987: dread d4/dc/d48/f31 [4194304,4194304] 0 2024-01-31T05:13:26.983 INFO:tasks.workunit.client.0.smithi099.stdout:1/988: getdents d4/db/d11a/d124 0 2024-01-31T05:13:26.984 INFO:tasks.workunit.client.0.smithi099.stdout:1/989: chown d4/dc/d4d/d5d/ca3 1109635625 1 2024-01-31T05:13:26.992 INFO:tasks.workunit.client.0.smithi099.stdout:6/993: sync 2024-01-31T05:13:26.993 INFO:tasks.workunit.client.0.smithi099.stdout:6/994: rmdir d14/d18/d52/d22/d71/dee/d7b/dd4 39 2024-01-31T05:13:26.993 INFO:tasks.workunit.client.0.smithi099.stdout:6/995: truncate d14/d18/d52/d7e/d1c/da6/f111 305623 0 2024-01-31T05:13:26.995 INFO:tasks.workunit.client.0.smithi099.stdout:6/996: rmdir d14/d18/d52/dbc/de8/d125/d43 39 2024-01-31T05:13:26.996 INFO:tasks.workunit.client.0.smithi099.stdout:6/997: getdents d14/d18/d52/d7e/d1c/da6/dba 0 2024-01-31T05:13:26.997 INFO:tasks.workunit.client.0.smithi099.stdout:6/998: creat d14/d18/f14b x:0 0 0 2024-01-31T05:13:27.001 INFO:tasks.workunit.client.0.smithi099.stdout:6/999: unlink d14/d18/d52/d22/d71/dee/cac 0 2024-01-31T05:13:27.004 INFO:tasks.workunit.client.0.smithi099.stdout:1/990: dwrite d4/dc/f2c [0,4194304] 0 2024-01-31T05:13:27.006 INFO:tasks.workunit.client.0.smithi099.stdout:1/991: getdents d4/dc/d4d/da5 0 2024-01-31T05:13:27.006 INFO:tasks.workunit.client.0.smithi099.stdout:1/992: chown d4/dc/d4d/d5d/fc4 2527265 1 2024-01-31T05:13:27.007 INFO:tasks.workunit.client.0.smithi099.stdout:1/993: mkdir d4/db/d12/d74/d13f/d143 0 2024-01-31T05:13:27.007 INFO:tasks.workunit.client.0.smithi099.stdout:1/994: readlink d4/db/d12/d74/l135 0 2024-01-31T05:13:27.007 INFO:tasks.workunit.client.0.smithi099.stdout:1/995: truncate d4/dc/d29/fa8 78516 0 2024-01-31T05:13:27.027 INFO:tasks.workunit.client.0.smithi099.stdout:1/996: dwrite d4/db/d3a/d7e/db9/d127/f9d [4194304,4194304] 0 2024-01-31T05:13:27.028 INFO:tasks.workunit.client.0.smithi099.stdout:1/997: mkdir d4/dc/d15/d144 0 2024-01-31T05:13:27.031 INFO:tasks.workunit.client.0.smithi099.stdout:1/998: truncate d4/db/d12/dc0/d4b/d50/d91/f22 4950130 0 2024-01-31T05:13:27.032 INFO:tasks.workunit.client.0.smithi099.stdout:1/999: creat d4/db/d3a/d7e/db9/d127/f145 x:0 0 0 2024-01-31T05:13:27.035 INFO:tasks.workunit.client.0.smithi099.stderr:+ rm -rf -- ./tmp.CwtY0f2R9N 2024-01-31T05:13:27.839 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.837+0000 7ff594078640 1 -- 172.21.15.99:0/1330503810 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff58c1029b0 msgr2=0x7ff58c109240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:27.839 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.837+0000 7ff594078640 1 --2- 172.21.15.99:0/1330503810 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff58c1029b0 0x7ff58c109240 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7ff584009ca0 tx=0x7ff58402c0f0 comp rx=0 tx=0).stop 2024-01-31T05:13:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.837+0000 7ff594078640 1 -- 172.21.15.99:0/1330503810 shutdown_connections 2024-01-31T05:13:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.837+0000 7ff594078640 1 --2- 172.21.15.99:0/1330503810 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff58c1029b0 0x7ff58c109240 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.837+0000 7ff594078640 1 --2- 172.21.15.99:0/1330503810 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff58c101ff0 0x7ff58c102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.837+0000 7ff594078640 1 --2- 172.21.15.99:0/1330503810 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff58c0ff020 0x7ff58c0ff440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.837+0000 7ff594078640 1 -- 172.21.15.99:0/1330503810 >> 172.21.15.99:0/1330503810 conn(0x7ff58c0fa950 msgr2=0x7ff58c0fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.837+0000 7ff594078640 1 -- 172.21.15.99:0/1330503810 shutdown_connections 2024-01-31T05:13:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.837+0000 7ff594078640 1 -- 172.21.15.99:0/1330503810 wait complete. 2024-01-31T05:13:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.838+0000 7ff594078640 1 Processor -- start 2024-01-31T05:13:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.838+0000 7ff594078640 1 -- start start 2024-01-31T05:13:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.838+0000 7ff594078640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff58c0ff020 0x7ff58c198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.838+0000 7ff594078640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff58c101ff0 0x7ff58c1993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.838+0000 7ff594078640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff58c1029b0 0x7ff58c1a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.838+0000 7ff594078640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58c1a0950 con 0x7ff58c0ff020 2024-01-31T05:13:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.838+0000 7ff594078640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58c1a0ac0 con 0x7ff58c1029b0 2024-01-31T05:13:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.838+0000 7ff594078640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58c1a0c80 con 0x7ff58c101ff0 2024-01-31T05:13:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.838+0000 7ff591e14640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff58c0ff020 0x7ff58c198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.838+0000 7ff591613640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff58c101ff0 0x7ff58c1993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.838+0000 7ff591e14640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff58c0ff020 0x7ff58c198e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36504/0 (socket says 172.21.15.99:36504) 2024-01-31T05:13:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.838+0000 7ff591e14640 1 -- 172.21.15.99:0/3752796436 learned_addr learned my addr 172.21.15.99:0/3752796436 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.838+0000 7ff592615640 1 --2- 172.21.15.99:0/3752796436 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff58c1029b0 0x7ff58c1a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.838+0000 7ff591e14640 1 -- 172.21.15.99:0/3752796436 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff58c101ff0 msgr2=0x7ff58c1993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.838+0000 7ff591e14640 1 --2- 172.21.15.99:0/3752796436 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff58c101ff0 0x7ff58c1993a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.838+0000 7ff591e14640 1 -- 172.21.15.99:0/3752796436 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff58c1029b0 msgr2=0x7ff58c1a0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.838+0000 7ff591e14640 1 --2- 172.21.15.99:0/3752796436 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff58c1029b0 0x7ff58c1a0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.838+0000 7ff591e14640 1 -- 172.21.15.99:0/3752796436 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff584009900 con 0x7ff58c0ff020 2024-01-31T05:13:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.838+0000 7ff591613640 1 --2- 172.21.15.99:0/3752796436 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff58c101ff0 0x7ff58c1993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:13:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.838+0000 7ff591e14640 1 --2- 172.21.15.99:0/3752796436 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff58c0ff020 0x7ff58c198e60 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7ff58800e9c0 tx=0x7ff58800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:27.842 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.838+0000 7ff582ffd640 1 -- 172.21.15.99:0/3752796436 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff588009700 con 0x7ff58c0ff020 2024-01-31T05:13:27.842 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.838+0000 7ff582ffd640 1 -- 172.21.15.99:0/3752796436 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff5880044e0 con 0x7ff58c0ff020 2024-01-31T05:13:27.842 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.838+0000 7ff594078640 1 -- 172.21.15.99:0/3752796436 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff58c1a0f60 con 0x7ff58c0ff020 2024-01-31T05:13:27.842 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.839+0000 7ff582ffd640 1 -- 172.21.15.99:0/3752796436 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff588010430 con 0x7ff58c0ff020 2024-01-31T05:13:27.842 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.839+0000 7ff594078640 1 -- 172.21.15.99:0/3752796436 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff58c1a1380 con 0x7ff58c0ff020 2024-01-31T05:13:27.848 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.841+0000 7ff582ffd640 1 -- 172.21.15.99:0/3752796436 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 20) v1 ==== 135895+0+0 (secure 0 0 0) 0x7ff588003f60 con 0x7ff58c0ff020 2024-01-31T05:13:27.848 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.841+0000 7ff596e44740 1 Processor -- start 2024-01-31T05:13:27.848 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.841+0000 7ff596e44740 1 -- start start 2024-01-31T05:13:27.848 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.841+0000 7ff596e44740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e5a00b270 0x559e5a00b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:27.848 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.841+0000 7ff596e44740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e5a00bc60 0x559e5a010760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:27.849 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.841+0000 7ff596e44740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559e5a010dd0 0x559e5a013260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:27.849 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.841+0000 7ff596e44740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e59f7b040 con 0x559e5a00bc60 2024-01-31T05:13:27.849 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.841+0000 7ff596e44740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e59f78730 con 0x559e5a010dd0 2024-01-31T05:13:27.849 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.841+0000 7ff596e44740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e59f74020 con 0x559e5a00b270 2024-01-31T05:13:27.849 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.841+0000 7ff582ffd640 1 --2- 172.21.15.99:0/3752796436 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff5780a1380 0x7ff5780a3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:27.849 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.841+0000 7ff591e14640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e5a00bc60 0x559e5a010760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:27.849 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.841+0000 7ff591e14640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e5a00bc60 0x559e5a010760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36516/0 (socket says 172.21.15.99:36516) 2024-01-31T05:13:27.849 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.841+0000 7ff591e14640 1 -- 172.21.15.99:0/4058264031 learned_addr learned my addr 172.21.15.99:0/4058264031 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:27.849 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.841+0000 7ff591613640 1 --2- 172.21.15.99:0/4058264031 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559e5a010dd0 0x559e5a013260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:27.849 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.841+0000 7ff592615640 1 --2- 172.21.15.99:0/3752796436 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff5780a1380 0x7ff5780a3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:27.849 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.841+0000 7ff592615640 1 --2- 172.21.15.99:0/4058264031 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e5a00b270 0x559e5a00b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:27.849 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.842+0000 7ff582ffd640 1 -- 172.21.15.99:0/3752796436 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7ff588014070 con 0x7ff58c0ff020 2024-01-31T05:13:27.849 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.842+0000 7ff591613640 1 -- 172.21.15.99:0/4058264031 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e5a00b270 msgr2=0x559e5a00b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:27.849 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.842+0000 7ff591613640 1 --2- 172.21.15.99:0/4058264031 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e5a00b270 0x559e5a00b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:27.849 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.842+0000 7ff591613640 1 -- 172.21.15.99:0/4058264031 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e5a00bc60 msgr2=0x559e5a010760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:27.850 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.842+0000 7ff591613640 1 --2- 172.21.15.99:0/4058264031 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e5a00bc60 0x559e5a010760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:27.850 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.842+0000 7ff591613640 1 -- 172.21.15.99:0/4058264031 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e59f6be40 con 0x559e5a010dd0 2024-01-31T05:13:27.850 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.842+0000 7ff591613640 1 --2- 172.21.15.99:0/4058264031 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559e5a010dd0 0x559e5a013260 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff57c009fa0 tx=0x7ff57c0118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae089bb4362cddbc server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:27.850 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.842+0000 7ff592615640 1 --2- 172.21.15.99:0/3752796436 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff5780a1380 0x7ff5780a3840 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff584006010 tx=0x7ff58402e040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:27.850 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.842+0000 7ff577fff640 1 -- 172.21.15.99:0/4058264031 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57c004310 con 0x559e5a010dd0 2024-01-31T05:13:27.850 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.842+0000 7ff577fff640 1 -- 172.21.15.99:0/4058264031 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff57c004470 con 0x559e5a010dd0 2024-01-31T05:13:27.850 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.842+0000 7ff577fff640 1 -- 172.21.15.99:0/4058264031 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57c0035f0 con 0x559e5a010dd0 2024-01-31T05:13:27.850 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.843+0000 7ff596e44740 1 -- 172.21.15.99:0/4058264031 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559e5a010dd0 msgr2=0x559e5a013260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:27.850 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.843+0000 7ff596e44740 1 --2- 172.21.15.99:0/4058264031 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559e5a010dd0 0x559e5a013260 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff57c009fa0 tx=0x7ff57c0118d0 comp rx=0 tx=0).stop 2024-01-31T05:13:27.850 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.843+0000 7ff596e44740 1 -- 172.21.15.99:0/4058264031 shutdown_connections 2024-01-31T05:13:27.850 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.843+0000 7ff596e44740 1 --2- 172.21.15.99:0/4058264031 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559e5a010dd0 0x559e5a013260 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:27.850 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.843+0000 7ff596e44740 1 --2- 172.21.15.99:0/4058264031 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e5a00bc60 0x559e5a010760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:27.850 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.843+0000 7ff596e44740 1 --2- 172.21.15.99:0/4058264031 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e5a00b270 0x559e5a00b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:27.850 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.843+0000 7ff596e44740 1 -- 172.21.15.99:0/4058264031 >> 172.21.15.99:0/4058264031 conn(0x559e5a0067e0 msgr2=0x559e5a006be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:27.851 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.843+0000 7ff596e44740 1 -- 172.21.15.99:0/4058264031 shutdown_connections 2024-01-31T05:13:27.851 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.843+0000 7ff596e44740 1 -- 172.21.15.99:0/4058264031 wait complete. 2024-01-31T05:13:27.851 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.843+0000 7ff596e44740 1 -- start start 2024-01-31T05:13:27.851 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.843+0000 7ff596e44740 1 Processor -- start 2024-01-31T05:13:27.851 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.844+0000 7ff596e44740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e5a00b270 0x559e5a015160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:27.851 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.844+0000 7ff596e44740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559e5a00bc60 0x559e5a0156a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:27.851 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.844+0000 7ff596e44740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e5a010dd0 0x559e5a01c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:27.851 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.844+0000 7ff596e44740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e59f2d1b0 con 0x559e5a00b270 2024-01-31T05:13:27.851 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.844+0000 7ff596e44740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e59f2ce50 con 0x559e5a00bc60 2024-01-31T05:13:27.851 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.844+0000 7ff596e44740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e59ef2090 con 0x559e5a010dd0 2024-01-31T05:13:27.851 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.844+0000 7ff596e44740 10 client.0 _ll_register_callbacks cb 0x559e59f17a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:13:27.851 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.844+0000 7ff591e14640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e5a00b270 0x559e5a015160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:27.851 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.844+0000 7ff591e14640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e5a00b270 0x559e5a015160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36520/0 (socket says 172.21.15.99:36520) 2024-01-31T05:13:27.851 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.844+0000 7ff591e14640 1 -- 172.21.15.99:0/3021578350 learned_addr learned my addr 172.21.15.99:0/3021578350 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:27.852 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.844+0000 7ff591613640 1 --2- 172.21.15.99:0/3021578350 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559e5a00bc60 0x559e5a0156a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:27.852 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.844+0000 7ff592615640 1 --2- 172.21.15.99:0/3021578350 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e5a010dd0 0x559e5a01c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:27.852 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.844+0000 7ff591e14640 1 -- 172.21.15.99:0/3021578350 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e5a010dd0 msgr2=0x559e5a01c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:27.852 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.844+0000 7ff591e14640 1 --2- 172.21.15.99:0/3021578350 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e5a010dd0 0x559e5a01c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:27.852 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.844+0000 7ff591e14640 1 -- 172.21.15.99:0/3021578350 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559e5a00bc60 msgr2=0x559e5a0156a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:27.852 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.844+0000 7ff591e14640 1 --2- 172.21.15.99:0/3021578350 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559e5a00bc60 0x559e5a0156a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:27.852 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.844+0000 7ff591e14640 1 -- 172.21.15.99:0/3021578350 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff57c009c00 con 0x559e5a00b270 2024-01-31T05:13:27.852 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.844+0000 7ff591e14640 1 --2- 172.21.15.99:0/3021578350 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e5a00b270 0x559e5a015160 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ff58809a030 tx=0x7ff58809a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=480036b46c0f7e21 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:27.852 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.844+0000 7ff5757fa640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:13:27.852 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.844+0000 7ff5757fa640 1 -- 172.21.15.99:0/3021578350 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58809a0a0 con 0x559e5a00b270 2024-01-31T05:13:27.852 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.844+0000 7ff5757fa640 1 -- 172.21.15.99:0/3021578350 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7ff588098440 con 0x559e5a00b270 2024-01-31T05:13:27.852 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.845+0000 7ff596e44740 1 -- 172.21.15.99:0/3021578350 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559e59f6d010 con 0x559e5a00b270 2024-01-31T05:13:27.852 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.845+0000 7ff5757fa640 1 -- 172.21.15.99:0/3021578350 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5880b81d0 con 0x559e5a00b270 2024-01-31T05:13:27.853 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.845+0000 7ff596e44740 10 client.16077 fetch_fsmap learned FSMap version 34 2024-01-31T05:13:27.853 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.845+0000 7ff596e44740 1 -- 172.21.15.99:0/3021578350 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x559e59f726a0 con 0x559e5a00b270 2024-01-31T05:13:27.853 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.845+0000 7ff5757fa640 1 -- 172.21.15.99:0/3021578350 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559e59f6d010 con 0x559e5a00b270 2024-01-31T05:13:27.853 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.845+0000 7ff5757fa640 1 -- 172.21.15.99:0/3021578350 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 34) v1 ==== 7910+0+0 (secure 0 0 0) 0x7ff58801f060 con 0x559e5a00b270 2024-01-31T05:13:27.853 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.845+0000 7ff596e44740 10 client.16077 fetch_fsmap finished waiting for FSMap version 34 2024-01-31T05:13:27.853 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.845+0000 7ff596e44740 10 client.16077 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-01-31T05:13:27.853 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.845+0000 7ff596e44740 20 client.16077 populate_metadata read hostname 'smithi099' 2024-01-31T05:13:27.853 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.845+0000 7ff596e44740 1 --2- 172.21.15.99:0/3021578350 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x559e5a021140 0x559e5a023580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:27.853 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.845+0000 7ff596e44740 4 client.16077 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:13:27.853 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.845+0000 7ff596e44740 1 -- 172.21.15.99:0/3021578350 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559e59f6cd30 con 0x559e5a021140 2024-01-31T05:13:27.853 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.845+0000 7ff591613640 1 --2- 172.21.15.99:0/3021578350 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x559e5a021140 0x559e5a023580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:27.853 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.846+0000 7ff5757fa640 10 client.16077 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:13:27.853 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.846+0000 7ff591613640 1 --2- 172.21.15.99:0/3021578350 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x559e5a021140 0x559e5a023580 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77bf8baaa1d8a382 server_cookie=ee5dd681ebe84e38 in_seq=0 out_seq=0 2024-01-31T05:13:27.853 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.846+0000 7ff5757fa640 1 -- 172.21.15.99:0/3021578350 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559e59f6cd30 con 0x559e5a021140 2024-01-31T05:13:27.854 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.846+0000 7ff5757fa640 10 client.16077 handle_command_reply: tid=0 2024-01-31T05:13:27.854 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.846+0000 7ff596e44740 1 client.16077 shutdown 2024-01-31T05:13:27.854 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.847+0000 7ff596e44740 1 -- 172.21.15.99:0/3021578350 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e5a00b270 msgr2=0x559e5a015160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:27.854 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.847+0000 7ff596e44740 1 --2- 172.21.15.99:0/3021578350 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e5a00b270 0x559e5a015160 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ff58809a030 tx=0x7ff58809a8e0 comp rx=0 tx=0).stop 2024-01-31T05:13:27.854 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.847+0000 7ff596e44740 1 -- 172.21.15.99:0/3021578350 shutdown_connections 2024-01-31T05:13:27.854 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.847+0000 7ff596e44740 1 --2- 172.21.15.99:0/3021578350 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e5a010dd0 0x559e5a01c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:27.854 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.847+0000 7ff596e44740 1 --2- 172.21.15.99:0/3021578350 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x559e5a021140 0x559e5a023580 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:27.854 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.847+0000 7ff596e44740 1 --2- 172.21.15.99:0/3021578350 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559e5a00bc60 0x559e5a0156a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:27.854 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.847+0000 7ff596e44740 1 --2- 172.21.15.99:0/3021578350 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e5a00b270 0x559e5a015160 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:27.854 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.847+0000 7ff5757fa640 0 client.16077 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:13:27.854 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.847+0000 7ff596e44740 1 -- 172.21.15.99:0/3021578350 >> 172.21.15.99:0/3021578350 conn(0x559e5a0067e0 msgr2=0x559e5a005a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:27.854 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.847+0000 7ff596e44740 1 -- 172.21.15.99:0/3021578350 shutdown_connections 2024-01-31T05:13:27.854 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.847+0000 7ff596e44740 1 -- 172.21.15.99:0/3021578350 wait complete. 2024-01-31T05:13:27.854 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.847+0000 7ff596e44740 20 client.16077 trim_cache size 0 max 16384 2024-01-31T05:13:27.864 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.860+0000 7ff596e44740 1 Processor -- start 2024-01-31T05:13:27.865 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.860+0000 7ff596e44740 1 -- start start 2024-01-31T05:13:27.865 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.860+0000 7ff596e44740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e5a00b270 0x559e5a0061a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:27.865 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.860+0000 7ff596e44740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559e5a00bc60 0x559e5a01c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:27.865 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.860+0000 7ff596e44740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e5a010dd0 0x559e5a010490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:27.865 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.860+0000 7ff596e44740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e5a028850 con 0x559e5a010dd0 2024-01-31T05:13:27.865 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.860+0000 7ff596e44740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e5a00c070 con 0x559e5a00bc60 2024-01-31T05:13:27.865 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.860+0000 7ff596e44740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e5a002270 con 0x559e5a00b270 2024-01-31T05:13:27.865 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.860+0000 7ff592615640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e5a010dd0 0x559e5a010490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:27.865 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.860+0000 7ff592615640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e5a010dd0 0x559e5a010490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36530/0 (socket says 172.21.15.99:36530) 2024-01-31T05:13:27.865 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.860+0000 7ff592615640 1 -- 172.21.15.99:0/3435118553 learned_addr learned my addr 172.21.15.99:0/3435118553 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:27.865 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.860+0000 7ff591613640 1 --2- 172.21.15.99:0/3435118553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559e5a00bc60 0x559e5a01c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:27.865 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.860+0000 7ff591e14640 1 --2- 172.21.15.99:0/3435118553 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e5a00b270 0x559e5a0061a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:27.865 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.860+0000 7ff592615640 1 -- 172.21.15.99:0/3435118553 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e5a00b270 msgr2=0x559e5a0061a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:27.866 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.860+0000 7ff592615640 1 --2- 172.21.15.99:0/3435118553 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e5a00b270 0x559e5a0061a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:27.866 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.860+0000 7ff592615640 1 -- 172.21.15.99:0/3435118553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559e5a00bc60 msgr2=0x559e5a01c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:27.866 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.860+0000 7ff592615640 1 --2- 172.21.15.99:0/3435118553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559e5a00bc60 0x559e5a01c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:27.866 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.860+0000 7ff592615640 1 -- 172.21.15.99:0/3435118553 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e59f0f030 con 0x559e5a010dd0 2024-01-31T05:13:27.866 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.861+0000 7ff592615640 1 --2- 172.21.15.99:0/3435118553 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e5a010dd0 0x559e5a010490 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7ff5840098d0 tx=0x7ff584032690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3897a41af4cffe27 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:27.866 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.861+0000 7ff5777fe640 1 -- 172.21.15.99:0/3435118553 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff584034c70 con 0x559e5a010dd0 2024-01-31T05:13:27.866 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.861+0000 7ff5777fe640 1 -- 172.21.15.99:0/3435118553 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff584034770 con 0x559e5a010dd0 2024-01-31T05:13:27.866 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.861+0000 7ff5777fe640 1 -- 172.21.15.99:0/3435118553 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff584043430 con 0x559e5a010dd0 2024-01-31T05:13:27.866 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.861+0000 7ff596e44740 1 -- 172.21.15.99:0/3435118553 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e5a010dd0 msgr2=0x559e5a010490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:27.866 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.861+0000 7ff596e44740 1 --2- 172.21.15.99:0/3435118553 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e5a010dd0 0x559e5a010490 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7ff5840098d0 tx=0x7ff584032690 comp rx=0 tx=0).stop 2024-01-31T05:13:27.866 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.861+0000 7ff596e44740 1 -- 172.21.15.99:0/3435118553 shutdown_connections 2024-01-31T05:13:27.866 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.861+0000 7ff596e44740 1 --2- 172.21.15.99:0/3435118553 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e5a010dd0 0x559e5a010490 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:27.866 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.861+0000 7ff596e44740 1 --2- 172.21.15.99:0/3435118553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559e5a00bc60 0x559e5a01c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:27.866 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.861+0000 7ff596e44740 1 --2- 172.21.15.99:0/3435118553 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e5a00b270 0x559e5a0061a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:27.866 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.861+0000 7ff596e44740 1 -- 172.21.15.99:0/3435118553 >> 172.21.15.99:0/3435118553 conn(0x559e5a0067e0 msgr2=0x559e5a006bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:27.867 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.861+0000 7ff596e44740 1 -- 172.21.15.99:0/3435118553 shutdown_connections 2024-01-31T05:13:27.867 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.862+0000 7ff596e44740 1 -- 172.21.15.99:0/3435118553 wait complete. 2024-01-31T05:13:27.867 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.862+0000 7ff596e44740 1 -- start start 2024-01-31T05:13:27.867 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.862+0000 7ff596e44740 1 Processor -- start 2024-01-31T05:13:27.867 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.862+0000 7ff596e44740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559e5a00b270 0x559e5a01ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:27.867 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.862+0000 7ff596e44740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e5a00bc60 0x559e5a01b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:27.867 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.862+0000 7ff596e44740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e5a010dd0 0x559e5a01b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:27.867 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.862+0000 7ff596e44740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e5a01c990 con 0x559e5a010dd0 2024-01-31T05:13:27.867 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.862+0000 7ff596e44740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e5a01cb00 con 0x559e5a00b270 2024-01-31T05:13:27.867 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.862+0000 7ff596e44740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e5a077710 con 0x559e5a00bc60 2024-01-31T05:13:27.867 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.862+0000 7ff596e44740 10 client.0 _ll_register_callbacks cb 0x7ff57c009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:13:27.867 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.862+0000 7ff592615640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e5a010dd0 0x559e5a01b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:27.867 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.862+0000 7ff591e14640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559e5a00b270 0x559e5a01ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:27.867 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.862+0000 7ff592615640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e5a010dd0 0x559e5a01b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36534/0 (socket says 172.21.15.99:36534) 2024-01-31T05:13:27.867 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.862+0000 7ff592615640 1 -- 172.21.15.99:0/943232410 learned_addr learned my addr 172.21.15.99:0/943232410 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:27.868 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.862+0000 7ff591613640 1 --2- 172.21.15.99:0/943232410 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e5a00bc60 0x559e5a01b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:27.868 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.862+0000 7ff592615640 1 -- 172.21.15.99:0/943232410 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e5a00bc60 msgr2=0x559e5a01b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:27.868 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.862+0000 7ff592615640 1 --2- 172.21.15.99:0/943232410 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e5a00bc60 0x559e5a01b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:27.868 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.863+0000 7ff592615640 1 -- 172.21.15.99:0/943232410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559e5a00b270 msgr2=0x559e5a01ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:27.868 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.863+0000 7ff592615640 1 --2- 172.21.15.99:0/943232410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559e5a00b270 0x559e5a01ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:27.868 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.863+0000 7ff592615640 1 -- 172.21.15.99:0/943232410 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff58c109a80 con 0x559e5a010dd0 2024-01-31T05:13:27.868 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.863+0000 7ff592615640 1 --2- 172.21.15.99:0/943232410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e5a010dd0 0x559e5a01b860 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7ff58402c630 tx=0x7ff584035cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d444198434e1a62 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:27.868 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.863+0000 7ff5757fa640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:13:27.868 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.863+0000 7ff5757fa640 1 -- 172.21.15.99:0/943232410 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff584003b70 con 0x559e5a010dd0 2024-01-31T05:13:27.868 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.863+0000 7ff5757fa640 1 -- 172.21.15.99:0/943232410 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7ff584048040 con 0x559e5a010dd0 2024-01-31T05:13:27.868 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.863+0000 7ff596e44740 1 -- 172.21.15.99:0/943232410 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff57c004470 con 0x559e5a010dd0 2024-01-31T05:13:27.868 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.863+0000 7ff5757fa640 1 -- 172.21.15.99:0/943232410 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5840042d0 con 0x559e5a010dd0 2024-01-31T05:13:27.868 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.863+0000 7ff596e44740 10 client.16083 fetch_fsmap learned FSMap version 34 2024-01-31T05:13:27.869 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.863+0000 7ff596e44740 1 -- 172.21.15.99:0/943232410 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x559e59f34a50 con 0x559e5a010dd0 2024-01-31T05:13:27.869 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.863+0000 7ff5757fa640 1 -- 172.21.15.99:0/943232410 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff57c004470 con 0x559e5a010dd0 2024-01-31T05:13:27.869 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.863+0000 7ff5757fa640 1 -- 172.21.15.99:0/943232410 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 34) v1 ==== 7910+0+0 (secure 0 0 0) 0x7ff584057b20 con 0x559e5a010dd0 2024-01-31T05:13:27.869 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.863+0000 7ff596e44740 10 client.16083 fetch_fsmap finished waiting for FSMap version 34 2024-01-31T05:13:27.869 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.863+0000 7ff596e44740 10 client.16083 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-01-31T05:13:27.869 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.863+0000 7ff596e44740 20 client.16083 populate_metadata read hostname 'smithi099' 2024-01-31T05:13:27.869 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.863+0000 7ff596e44740 1 --2- 172.21.15.99:0/943232410 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x559e5a078fe0 0x559e5a07b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:27.869 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.863+0000 7ff596e44740 4 client.16083 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-01-31T05:13:27.869 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.863+0000 7ff596e44740 1 -- 172.21.15.99:0/943232410 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559e59c73600 con 0x559e5a078fe0 2024-01-31T05:13:27.869 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.864+0000 7ff591e14640 1 --2- 172.21.15.99:0/943232410 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x559e5a078fe0 0x559e5a07b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:27.869 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.864+0000 7ff591e14640 1 --2- 172.21.15.99:0/943232410 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x559e5a078fe0 0x559e5a07b400 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=913e42ff584a7ce2 server_cookie=78a6cfc9bc8e3265 in_seq=0 out_seq=0 2024-01-31T05:13:27.869 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:27.864+0000 7ff5757fa640 10 client.16083 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:13:28.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:27 smithi099 ceph-mon[31615]: pgmap v411: 97 pgs: 97 active+clean; 1.7 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 138 MiB/s rd, 163 MiB/s wr, 1.37k op/s 2024-01-31T05:13:28.320 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:27 smithi181 ceph-mon[36434]: pgmap v411: 97 pgs: 97 active+clean; 1.7 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 138 MiB/s rd, 163 MiB/s wr, 1.37k op/s 2024-01-31T05:13:28.363 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:28.362+0000 7ff5757fa640 1 -- 172.21.15.99:0/943232410 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559e59c73600 con 0x559e5a078fe0 2024-01-31T05:13:28.363 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:28.362+0000 7ff5757fa640 10 client.16083 handle_command_reply: tid=0 2024-01-31T05:13:28.363 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:28.362+0000 7ff596e44740 1 client.16083 shutdown 2024-01-31T05:13:28.363 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:28.362+0000 7ff596e44740 1 -- 172.21.15.99:0/943232410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e5a010dd0 msgr2=0x559e5a01b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:28.363 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:28.362+0000 7ff596e44740 1 --2- 172.21.15.99:0/943232410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e5a010dd0 0x559e5a01b860 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7ff58402c630 tx=0x7ff584035cb0 comp rx=0 tx=0).stop 2024-01-31T05:13:28.363 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:28.362+0000 7ff596e44740 1 -- 172.21.15.99:0/943232410 shutdown_connections 2024-01-31T05:13:28.363 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:28.362+0000 7ff596e44740 1 --2- 172.21.15.99:0/943232410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e5a010dd0 0x559e5a01b860 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:28.363 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:28.362+0000 7ff596e44740 1 --2- 172.21.15.99:0/943232410 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559e5a00bc60 0x559e5a01b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:28.363 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:28.362+0000 7ff596e44740 1 --2- 172.21.15.99:0/943232410 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x559e5a078fe0 0x559e5a07b400 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:28.363 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:28.362+0000 7ff596e44740 1 --2- 172.21.15.99:0/943232410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559e5a00b270 0x559e5a01ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:28.364 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:28.362+0000 7ff5757fa640 0 client.16083 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:13:28.364 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:28.362+0000 7ff596e44740 1 -- 172.21.15.99:0/943232410 >> 172.21.15.99:0/943232410 conn(0x559e5a0067e0 msgr2=0x559e5a009a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:28.364 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:28.362+0000 7ff596e44740 1 -- 172.21.15.99:0/943232410 shutdown_connections 2024-01-31T05:13:28.364 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:28.362+0000 7ff596e44740 1 -- 172.21.15.99:0/943232410 wait complete. 2024-01-31T05:13:28.364 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:28.362+0000 7ff596e44740 20 client.16083 trim_cache size 0 max 16384 2024-01-31T05:13:28.364 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout:{ 2024-01-31T05:13:28.364 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout: "message": "", 2024-01-31T05:13:28.364 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout: "return_code": 0 2024-01-31T05:13:28.364 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout:} 2024-01-31T05:13:28.365 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:28.363+0000 7ff594078640 1 -- 172.21.15.99:0/3752796436 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff5780a1380 msgr2=0x7ff5780a3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:28.365 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:28.363+0000 7ff594078640 1 --2- 172.21.15.99:0/3752796436 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff5780a1380 0x7ff5780a3840 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff584006010 tx=0x7ff58402e040 comp rx=0 tx=0).stop 2024-01-31T05:13:28.365 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:28.363+0000 7ff594078640 1 -- 172.21.15.99:0/3752796436 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff58c0ff020 msgr2=0x7ff58c198e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:28.365 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:28.363+0000 7ff594078640 1 --2- 172.21.15.99:0/3752796436 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff58c0ff020 0x7ff58c198e60 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7ff58800e9c0 tx=0x7ff58800ee80 comp rx=0 tx=0).stop 2024-01-31T05:13:28.365 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:28.363+0000 7ff594078640 1 -- 172.21.15.99:0/3752796436 shutdown_connections 2024-01-31T05:13:28.366 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:28.363+0000 7ff594078640 1 --2- 172.21.15.99:0/3752796436 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7ff5780a1380 0x7ff5780a3840 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:28.366 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:28.363+0000 7ff594078640 1 --2- 172.21.15.99:0/3752796436 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff58c1029b0 0x7ff58c1a0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:28.366 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:28.363+0000 7ff594078640 1 --2- 172.21.15.99:0/3752796436 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff58c101ff0 0x7ff58c1993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:28.366 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:28.363+0000 7ff594078640 1 --2- 172.21.15.99:0/3752796436 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff58c0ff020 0x7ff58c198e60 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:28.366 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:28.363+0000 7ff594078640 1 -- 172.21.15.99:0/3752796436 >> 172.21.15.99:0/3752796436 conn(0x7ff58c0fa950 msgr2=0x7ff58c105290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:28.366 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:28.363+0000 7ff594078640 1 -- 172.21.15.99:0/3752796436 shutdown_connections 2024-01-31T05:13:28.366 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:28.363+0000 7ff594078640 1 -- 172.21.15.99:0/3752796436 wait complete. 2024-01-31T05:13:28.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:27 smithi179 ceph-mon[35652]: pgmap v411: 97 pgs: 97 active+clean; 1.7 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 138 MiB/s rd, 163 MiB/s wr, 1.37k op/s 2024-01-31T05:13:29.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:29 smithi099 ceph-mon[31615]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:13:29.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:29 smithi099 ceph-mon[31615]: pgmap v412: 97 pgs: 97 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 144 MiB/s rd, 178 MiB/s wr, 1.05k op/s 2024-01-31T05:13:29.570 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:29 smithi181 ceph-mon[36434]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:13:29.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:29 smithi181 ceph-mon[36434]: pgmap v412: 97 pgs: 97 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 144 MiB/s rd, 178 MiB/s wr, 1.05k op/s 2024-01-31T05:13:29.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:29 smithi179 ceph-mon[35652]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:13:29.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:29 smithi179 ceph-mon[35652]: pgmap v412: 97 pgs: 97 active+clean; 2.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 144 MiB/s rd, 178 MiB/s wr, 1.05k op/s 2024-01-31T05:13:32.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:31 smithi099 ceph-mon[31615]: pgmap v413: 97 pgs: 97 active+clean; 2.1 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 109 MiB/s rd, 134 MiB/s wr, 335 op/s 2024-01-31T05:13:32.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:31 smithi181 ceph-mon[36434]: pgmap v413: 97 pgs: 97 active+clean; 2.1 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 109 MiB/s rd, 134 MiB/s wr, 335 op/s 2024-01-31T05:13:32.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:31 smithi179 ceph-mon[35652]: pgmap v413: 97 pgs: 97 active+clean; 2.1 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 109 MiB/s rd, 134 MiB/s wr, 335 op/s 2024-01-31T05:13:34.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:33 smithi099 ceph-mon[31615]: pgmap v414: 97 pgs: 97 active+clean; 1.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 108 MiB/s rd, 126 MiB/s wr, 596 op/s 2024-01-31T05:13:34.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:33 smithi099 ceph-mon[31615]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:13:34.073 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:33 smithi181 ceph-mon[36434]: pgmap v414: 97 pgs: 97 active+clean; 1.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 108 MiB/s rd, 126 MiB/s wr, 596 op/s 2024-01-31T05:13:34.073 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:33 smithi181 ceph-mon[36434]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:13:34.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:33 smithi179 ceph-mon[35652]: pgmap v414: 97 pgs: 97 active+clean; 1.7 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 108 MiB/s rd, 126 MiB/s wr, 596 op/s 2024-01-31T05:13:34.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:33 smithi179 ceph-mon[35652]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:13:35.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:34 smithi099 ceph-mon[31615]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:13:35.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:34 smithi181 ceph-mon[36434]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:13:35.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:34 smithi179 ceph-mon[35652]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:13:36.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:35 smithi099 ceph-mon[31615]: pgmap v415: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 86 MiB/s rd, 99 MiB/s wr, 586 op/s 2024-01-31T05:13:36.070 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:35 smithi181 ceph-mon[36434]: pgmap v415: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 86 MiB/s rd, 99 MiB/s wr, 586 op/s 2024-01-31T05:13:36.120 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-01-31T05:13:36.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:35 smithi179 ceph-mon[35652]: pgmap v415: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 86 MiB/s rd, 99 MiB/s wr, 586 op/s 2024-01-31T05:13:36.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.266+0000 7f87da271640 1 -- 172.21.15.99:0/2286970659 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87d40ffbf0 msgr2=0x7f87d4100010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:36.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.266+0000 7f87da271640 1 --2- 172.21.15.99:0/2286970659 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87d40ffbf0 0x7f87d4100010 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f87c4009900 tx=0x7f87c402bc30 comp rx=0 tx=0).stop 2024-01-31T05:13:36.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.267+0000 7f87da271640 1 -- 172.21.15.99:0/2286970659 shutdown_connections 2024-01-31T05:13:36.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.267+0000 7f87da271640 1 --2- 172.21.15.99:0/2286970659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87d41017a0 0x7f87d4108030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.267+0000 7f87da271640 1 --2- 172.21.15.99:0/2286970659 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87d4100de0 0x7f87d4101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.267+0000 7f87da271640 1 --2- 172.21.15.99:0/2286970659 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87d40ffbf0 0x7f87d4100010 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.267+0000 7f87da271640 1 -- 172.21.15.99:0/2286970659 >> 172.21.15.99:0/2286970659 conn(0x7f87d40fb180 msgr2=0x7f87d40fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:36.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.267+0000 7f87da271640 1 -- 172.21.15.99:0/2286970659 shutdown_connections 2024-01-31T05:13:36.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.267+0000 7f87da271640 1 -- 172.21.15.99:0/2286970659 wait complete. 2024-01-31T05:13:36.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.267+0000 7f87da271640 1 Processor -- start 2024-01-31T05:13:36.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.268+0000 7f87da271640 1 -- start start 2024-01-31T05:13:36.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.268+0000 7f87da271640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87d40ffbf0 0x7f87d4068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:36.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.268+0000 7f87da271640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87d4100de0 0x7f87d41997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:36.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.268+0000 7f87da271640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87d41017a0 0x7f87d4199e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:36.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.268+0000 7f87da271640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d419a5d0 con 0x7f87d40ffbf0 2024-01-31T05:13:36.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.268+0000 7f87da271640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d419a740 con 0x7f87d4100de0 2024-01-31T05:13:36.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.268+0000 7f87da271640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d419a900 con 0x7f87d41017a0 2024-01-31T05:13:36.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.268+0000 7f87d3fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87d40ffbf0 0x7f87d4068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:36.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.268+0000 7f87d3fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87d40ffbf0 0x7f87d4068a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35278/0 (socket says 172.21.15.99:35278) 2024-01-31T05:13:36.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.268+0000 7f87d880e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87d41017a0 0x7f87d4199e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:36.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.268+0000 7f87d3fff640 1 -- 172.21.15.99:0/189470869 learned_addr learned my addr 172.21.15.99:0/189470869 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:36.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.268+0000 7f87d37fe640 1 --2- 172.21.15.99:0/189470869 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87d4100de0 0x7f87d41997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:36.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.269+0000 7f87d880e640 1 -- 172.21.15.99:0/189470869 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87d4100de0 msgr2=0x7f87d41997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:36.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.269+0000 7f87d880e640 1 --2- 172.21.15.99:0/189470869 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87d4100de0 0x7f87d41997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.269+0000 7f87d880e640 1 -- 172.21.15.99:0/189470869 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87d40ffbf0 msgr2=0x7f87d4068a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:36.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.269+0000 7f87d880e640 1 --2- 172.21.15.99:0/189470869 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87d40ffbf0 0x7f87d4068a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.269+0000 7f87d880e640 1 -- 172.21.15.99:0/189470869 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c4009560 con 0x7f87d41017a0 2024-01-31T05:13:36.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.269+0000 7f87d880e640 1 --2- 172.21.15.99:0/189470869 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87d41017a0 0x7f87d4199e40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f87cc009fd0 tx=0x7f87cc00ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:36.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.269+0000 7f87d17fa640 1 -- 172.21.15.99:0/189470869 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87cc00ce20 con 0x7f87d41017a0 2024-01-31T05:13:36.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.269+0000 7f87da271640 1 -- 172.21.15.99:0/189470869 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87d419abe0 con 0x7f87d41017a0 2024-01-31T05:13:36.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.269+0000 7f87d17fa640 1 -- 172.21.15.99:0/189470869 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f87cc005020 con 0x7f87d41017a0 2024-01-31T05:13:36.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.269+0000 7f87d17fa640 1 -- 172.21.15.99:0/189470869 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87cc010670 con 0x7f87d41017a0 2024-01-31T05:13:36.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.269+0000 7f87da271640 1 -- 172.21.15.99:0/189470869 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87d419b0f0 con 0x7f87d41017a0 2024-01-31T05:13:36.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.272+0000 7f87dd033740 1 Processor -- start 2024-01-31T05:13:36.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.273+0000 7f87d17fa640 1 -- 172.21.15.99:0/189470869 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 20) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f87cc005450 con 0x7f87d41017a0 2024-01-31T05:13:36.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.273+0000 7f87dd033740 1 -- start start 2024-01-31T05:13:36.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.273+0000 7f87dd033740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555657b77a20 0x555657b77e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:36.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.273+0000 7f87dd033740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555657b78410 0x555657b7cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:36.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.273+0000 7f87dd033740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555657b7d580 0x555657b7fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:36.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.273+0000 7f87dd033740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x555657ae6380 con 0x555657b7d580 2024-01-31T05:13:36.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.273+0000 7f87dd033740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x555657ae3a70 con 0x555657b78410 2024-01-31T05:13:36.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.273+0000 7f87dd033740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x555657adf360 con 0x555657b77a20 2024-01-31T05:13:36.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.273+0000 7f87d37fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555657b77a20 0x555657b77e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:36.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.273+0000 7f87d3fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555657b78410 0x555657b7cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:36.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.273+0000 7f87d3fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555657b78410 0x555657b7cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.99:39306/0 (socket says 172.21.15.99:39306) 2024-01-31T05:13:36.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.273+0000 7f87d3fff640 1 -- 172.21.15.99:0/3334960336 learned_addr learned my addr 172.21.15.99:0/3334960336 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:36.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.273+0000 7f87d37fe640 1 --2- 172.21.15.99:0/3334960336 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555657b7d580 0x555657b7fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:36.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.273+0000 7f87d17fa640 1 --2- 172.21.15.99:0/189470869 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f87bc0a13b0 0x7f87bc0a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:36.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.274+0000 7f87d17fa640 1 -- 172.21.15.99:0/189470869 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f87cc014070 con 0x7f87d41017a0 2024-01-31T05:13:36.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.274+0000 7f87d37fe640 1 -- 172.21.15.99:0/3334960336 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555657b77a20 msgr2=0x555657b77e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:36.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.274+0000 7f87d37fe640 1 --2- 172.21.15.99:0/3334960336 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555657b77a20 0x555657b77e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.274+0000 7f87d37fe640 1 -- 172.21.15.99:0/3334960336 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555657b78410 msgr2=0x555657b7cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:36.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.274+0000 7f87d37fe640 1 --2- 172.21.15.99:0/3334960336 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555657b78410 0x555657b7cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.274+0000 7f87d37fe640 1 -- 172.21.15.99:0/3334960336 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555657aa17e0 con 0x555657b7d580 2024-01-31T05:13:36.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.274+0000 7f87d880e640 1 --2- 172.21.15.99:0/189470869 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f87bc0a13b0 0x7f87bc0a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:36.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.274+0000 7f87d37fe640 1 --2- 172.21.15.99:0/3334960336 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555657b7d580 0x555657b7fa10 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f87c8005d00 tx=0x7f87c800b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b3660dab1486ddf server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:36.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.274+0000 7f87ba7fc640 1 -- 172.21.15.99:0/3334960336 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c8005020 con 0x555657b7d580 2024-01-31T05:13:36.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.274+0000 7f87d880e640 1 --2- 172.21.15.99:0/189470869 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f87bc0a13b0 0x7f87bc0a3870 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f87cc096d70 tx=0x7f87cc01bfd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:36.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.274+0000 7f87ba7fc640 1 -- 172.21.15.99:0/3334960336 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f87c8005640 con 0x555657b7d580 2024-01-31T05:13:36.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.274+0000 7f87ba7fc640 1 -- 172.21.15.99:0/3334960336 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c80098d0 con 0x555657b7d580 2024-01-31T05:13:36.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.275+0000 7f87dd033740 1 -- 172.21.15.99:0/3334960336 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555657b7d580 msgr2=0x555657b7fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:36.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.275+0000 7f87dd033740 1 --2- 172.21.15.99:0/3334960336 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555657b7d580 0x555657b7fa10 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f87c8005d00 tx=0x7f87c800b390 comp rx=0 tx=0).stop 2024-01-31T05:13:36.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.275+0000 7f87dd033740 1 -- 172.21.15.99:0/3334960336 shutdown_connections 2024-01-31T05:13:36.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.275+0000 7f87dd033740 1 --2- 172.21.15.99:0/3334960336 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555657b7d580 0x555657b7fa10 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.275+0000 7f87dd033740 1 --2- 172.21.15.99:0/3334960336 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555657b78410 0x555657b7cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.275+0000 7f87dd033740 1 --2- 172.21.15.99:0/3334960336 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555657b77a20 0x555657b77e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.275+0000 7f87dd033740 1 -- 172.21.15.99:0/3334960336 >> 172.21.15.99:0/3334960336 conn(0x555657b72f90 msgr2=0x555657b73390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:36.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.275+0000 7f87dd033740 1 -- 172.21.15.99:0/3334960336 shutdown_connections 2024-01-31T05:13:36.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.275+0000 7f87dd033740 1 -- 172.21.15.99:0/3334960336 wait complete. 2024-01-31T05:13:36.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.276+0000 7f87dd033740 1 -- start start 2024-01-31T05:13:36.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.276+0000 7f87dd033740 1 Processor -- start 2024-01-31T05:13:36.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.276+0000 7f87dd033740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555657b77a20 0x555657b81c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:36.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.276+0000 7f87dd033740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555657b78410 0x555657b82180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:36.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.276+0000 7f87dd033740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555657b7d580 0x555657b891c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:36.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.276+0000 7f87dd033740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x555657a98750 con 0x555657b78410 2024-01-31T05:13:36.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.276+0000 7f87dd033740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x555657a983f0 con 0x555657b77a20 2024-01-31T05:13:36.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.276+0000 7f87dd033740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x555657a5d3f0 con 0x555657b7d580 2024-01-31T05:13:36.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.276+0000 7f87dd033740 10 client.0 _ll_register_callbacks cb 0x555657a9ab60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:13:36.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.276+0000 7f87d37fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555657b77a20 0x555657b81c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:36.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.276+0000 7f87d3fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555657b78410 0x555657b82180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:36.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.276+0000 7f87d37fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555657b77a20 0x555657b81c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.99:39308/0 (socket says 172.21.15.99:39308) 2024-01-31T05:13:36.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.276+0000 7f87d37fe640 1 -- 172.21.15.99:0/211250285 learned_addr learned my addr 172.21.15.99:0/211250285 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:36.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.276+0000 7f87d37fe640 1 --2- 172.21.15.99:0/211250285 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555657b7d580 0x555657b891c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:36.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.277+0000 7f87d3fff640 1 -- 172.21.15.99:0/211250285 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555657b7d580 msgr2=0x555657b891c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:36.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.277+0000 7f87d3fff640 1 --2- 172.21.15.99:0/211250285 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555657b7d580 0x555657b891c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.277+0000 7f87d3fff640 1 -- 172.21.15.99:0/211250285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555657b77a20 msgr2=0x555657b81c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:36.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.277+0000 7f87d3fff640 1 --2- 172.21.15.99:0/211250285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555657b77a20 0x555657b81c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.277+0000 7f87d3fff640 1 -- 172.21.15.99:0/211250285 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c801a040 con 0x555657b78410 2024-01-31T05:13:36.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.277+0000 7f87d3fff640 1 --2- 172.21.15.99:0/211250285 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555657b78410 0x555657b82180 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x555657b73f00 tx=0x7f87c4004a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57510d8c375e3047 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:36.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.277+0000 7f87b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:13:36.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.278+0000 7f87b37fe640 1 -- 172.21.15.99:0/211250285 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c4004250 con 0x555657b78410 2024-01-31T05:13:36.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.278+0000 7f87b37fe640 1 -- 172.21.15.99:0/211250285 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f87c4046070 con 0x555657b78410 2024-01-31T05:13:36.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.278+0000 7f87dd033740 1 -- 172.21.15.99:0/211250285 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555657ab4210 con 0x555657b78410 2024-01-31T05:13:36.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.278+0000 7f87b37fe640 1 -- 172.21.15.99:0/211250285 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f87c40043b0 con 0x555657b78410 2024-01-31T05:13:36.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.278+0000 7f87dd033740 10 client.16095 fetch_fsmap learned FSMap version 37 2024-01-31T05:13:36.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.278+0000 7f87dd033740 1 -- 172.21.15.99:0/211250285 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x555657add9e0 con 0x555657b78410 2024-01-31T05:13:36.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.278+0000 7f87b37fe640 1 -- 172.21.15.99:0/211250285 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x555657ab4210 con 0x555657b78410 2024-01-31T05:13:36.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.279+0000 7f87b37fe640 1 -- 172.21.15.99:0/211250285 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 37) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f87c403c040 con 0x555657b78410 2024-01-31T05:13:36.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.279+0000 7f87dd033740 10 client.16095 fetch_fsmap finished waiting for FSMap version 37 2024-01-31T05:13:36.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.279+0000 7f87dd033740 10 client.16095 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-01-31T05:13:36.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.279+0000 7f87dd033740 20 client.16095 populate_metadata read hostname 'smithi099' 2024-01-31T05:13:36.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.279+0000 7f87dd033740 1 --2- 172.21.15.99:0/211250285 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x555657b8dec0 0x555657b902e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:36.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.279+0000 7f87dd033740 4 client.16095 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:13:36.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.279+0000 7f87dd033740 1 -- 172.21.15.99:0/211250285 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555657ab1b20 con 0x555657b8dec0 2024-01-31T05:13:36.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.279+0000 7f87d37fe640 1 --2- 172.21.15.99:0/211250285 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x555657b8dec0 0x555657b902e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:36.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.279+0000 7f87b37fe640 10 client.16095 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:13:36.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.279+0000 7f87d37fe640 1 --2- 172.21.15.99:0/211250285 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x555657b8dec0 0x555657b902e0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ada6249836e7021 server_cookie=ef5d4794ec9bb7bc in_seq=0 out_seq=0 2024-01-31T05:13:36.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.281+0000 7f87b37fe640 1 -- 172.21.15.99:0/211250285 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555657ab1b20 con 0x555657b8dec0 2024-01-31T05:13:36.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.281+0000 7f87b37fe640 10 client.16095 handle_command_reply: tid=0 2024-01-31T05:13:36.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.281+0000 7f87dd033740 1 client.16095 shutdown 2024-01-31T05:13:36.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.282+0000 7f87dd033740 1 -- 172.21.15.99:0/211250285 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555657b78410 msgr2=0x555657b82180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:36.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.282+0000 7f87dd033740 1 --2- 172.21.15.99:0/211250285 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555657b78410 0x555657b82180 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x555657b73f00 tx=0x7f87c4004a10 comp rx=0 tx=0).stop 2024-01-31T05:13:36.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.282+0000 7f87dd033740 1 -- 172.21.15.99:0/211250285 shutdown_connections 2024-01-31T05:13:36.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.282+0000 7f87dd033740 1 --2- 172.21.15.99:0/211250285 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555657b7d580 0x555657b891c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.282+0000 7f87dd033740 1 --2- 172.21.15.99:0/211250285 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555657b78410 0x555657b82180 secure :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0x555657b73f00 tx=0x7f87c4004a10 comp rx=0 tx=0).stop 2024-01-31T05:13:36.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.282+0000 7f87dd033740 1 --2- 172.21.15.99:0/211250285 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x555657b8dec0 0x555657b902e0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.282+0000 7f87dd033740 1 --2- 172.21.15.99:0/211250285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555657b77a20 0x555657b81c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.282+0000 7f87dd033740 1 -- 172.21.15.99:0/211250285 >> 172.21.15.99:0/211250285 conn(0x555657b72f90 msgr2=0x555657b72210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:36.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.282+0000 7f87b37fe640 0 client.16095 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:13:36.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.282+0000 7f87dd033740 1 -- 172.21.15.99:0/211250285 shutdown_connections 2024-01-31T05:13:36.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.282+0000 7f87dd033740 1 -- 172.21.15.99:0/211250285 wait complete. 2024-01-31T05:13:36.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.283+0000 7f87dd033740 20 client.16095 trim_cache size 0 max 16384 2024-01-31T05:13:36.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.304+0000 7f87dd033740 1 Processor -- start 2024-01-31T05:13:36.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.304+0000 7f87dd033740 1 -- start start 2024-01-31T05:13:36.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.304+0000 7f87dd033740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555657b77a20 0x555657b79970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:36.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.304+0000 7f87dd033740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555657b78410 0x555657b89180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:36.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.304+0000 7f87dd033740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555657b7d580 0x555657b79eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:36.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.304+0000 7f87dd033740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x555657b81a80 con 0x555657b77a20 2024-01-31T05:13:36.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.304+0000 7f87dd033740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x555657ab4210 con 0x555657b78410 2024-01-31T05:13:36.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.304+0000 7f87dd033740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x555657b6ea60 con 0x555657b7d580 2024-01-31T05:13:36.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.304+0000 7f87d37fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555657b77a20 0x555657b79970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:36.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.304+0000 7f87d3fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555657b78410 0x555657b89180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:36.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.304+0000 7f87d37fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555657b77a20 0x555657b79970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35308/0 (socket says 172.21.15.99:35308) 2024-01-31T05:13:36.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.304+0000 7f87d37fe640 1 -- 172.21.15.99:0/2325173078 learned_addr learned my addr 172.21.15.99:0/2325173078 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:36.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.304+0000 7f87d37fe640 1 --2- 172.21.15.99:0/2325173078 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555657b7d580 0x555657b79eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:36.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.304+0000 7f87d3fff640 1 -- 172.21.15.99:0/2325173078 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555657b7d580 msgr2=0x555657b79eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:36.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.304+0000 7f87d3fff640 1 --2- 172.21.15.99:0/2325173078 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555657b7d580 0x555657b79eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.304+0000 7f87d3fff640 1 -- 172.21.15.99:0/2325173078 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555657b77a20 msgr2=0x555657b79970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:36.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.304+0000 7f87d3fff640 1 --2- 172.21.15.99:0/2325173078 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555657b77a20 0x555657b79970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.304+0000 7f87d3fff640 1 -- 172.21.15.99:0/2325173078 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555657a7a4f0 con 0x555657b78410 2024-01-31T05:13:36.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.304+0000 7f87d37fe640 1 --2- 172.21.15.99:0/2325173078 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555657b77a20 0x555657b79970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:13:36.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.305+0000 7f87d3fff640 1 --2- 172.21.15.99:0/2325173078 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555657b78410 0x555657b89180 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f87c4036040 tx=0x7f87c402bc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f753584ea44bc3ab server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:36.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.305+0000 7f87b9ffb640 1 -- 172.21.15.99:0/2325173078 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c40055a0 con 0x555657b78410 2024-01-31T05:13:36.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.305+0000 7f87b9ffb640 1 -- 172.21.15.99:0/2325173078 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f87c4044070 con 0x555657b78410 2024-01-31T05:13:36.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.305+0000 7f87b9ffb640 1 -- 172.21.15.99:0/2325173078 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c4003ab0 con 0x555657b78410 2024-01-31T05:13:36.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.306+0000 7f87dd033740 1 -- 172.21.15.99:0/2325173078 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555657b78410 msgr2=0x555657b89180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:36.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.306+0000 7f87dd033740 1 --2- 172.21.15.99:0/2325173078 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555657b78410 0x555657b89180 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f87c4036040 tx=0x7f87c402bc30 comp rx=0 tx=0).stop 2024-01-31T05:13:36.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.306+0000 7f87dd033740 1 -- 172.21.15.99:0/2325173078 shutdown_connections 2024-01-31T05:13:36.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.306+0000 7f87dd033740 1 --2- 172.21.15.99:0/2325173078 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555657b7d580 0x555657b79eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.306+0000 7f87dd033740 1 --2- 172.21.15.99:0/2325173078 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555657b78410 0x555657b89180 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.306+0000 7f87dd033740 1 --2- 172.21.15.99:0/2325173078 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555657b77a20 0x555657b79970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.306+0000 7f87dd033740 1 -- 172.21.15.99:0/2325173078 >> 172.21.15.99:0/2325173078 conn(0x555657b72f90 msgr2=0x555657b81c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:36.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.306+0000 7f87dd033740 1 -- 172.21.15.99:0/2325173078 shutdown_connections 2024-01-31T05:13:36.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.306+0000 7f87dd033740 1 -- 172.21.15.99:0/2325173078 wait complete. 2024-01-31T05:13:36.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.306+0000 7f87dd033740 1 -- start start 2024-01-31T05:13:36.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.306+0000 7f87dd033740 1 Processor -- start 2024-01-31T05:13:36.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.306+0000 7f87dd033740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555657b77a20 0x555657b87870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:36.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.306+0000 7f87dd033740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555657b78410 0x555657b87db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:36.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.306+0000 7f87dd033740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555657b7d580 0x555657b882f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:36.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.306+0000 7f87dd033740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x555657b89470 con 0x555657b78410 2024-01-31T05:13:36.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.306+0000 7f87dd033740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x555657be43d0 con 0x555657b77a20 2024-01-31T05:13:36.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.306+0000 7f87dd033740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x555657be4510 con 0x555657b7d580 2024-01-31T05:13:36.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.306+0000 7f87dd033740 10 client.0 _ll_register_callbacks cb 0x7f87c40046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:13:36.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.307+0000 7f87d37fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555657b7d580 0x555657b882f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:36.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.307+0000 7f87d3fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555657b78410 0x555657b87db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:36.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.307+0000 7f87d37fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555657b7d580 0x555657b882f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:56998/0 (socket says 172.21.15.99:56998) 2024-01-31T05:13:36.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.307+0000 7f87d37fe640 1 -- 172.21.15.99:0/3113311373 learned_addr learned my addr 172.21.15.99:0/3113311373 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:36.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.307+0000 7f87d37fe640 1 --2- 172.21.15.99:0/3113311373 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555657b77a20 0x555657b87870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:36.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.307+0000 7f87d3fff640 1 -- 172.21.15.99:0/3113311373 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555657b7d580 msgr2=0x555657b882f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:36.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.307+0000 7f87d3fff640 1 --2- 172.21.15.99:0/3113311373 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555657b7d580 0x555657b882f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.307+0000 7f87d3fff640 1 -- 172.21.15.99:0/3113311373 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555657b77a20 msgr2=0x555657b87870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:36.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.307+0000 7f87d3fff640 1 --2- 172.21.15.99:0/3113311373 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555657b77a20 0x555657b87870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.307+0000 7f87d3fff640 1 -- 172.21.15.99:0/3113311373 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555657aa17e0 con 0x555657b78410 2024-01-31T05:13:36.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.307+0000 7f87d37fe640 1 --2- 172.21.15.99:0/3113311373 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555657b7d580 0x555657b882f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:13:36.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.307+0000 7f87d3fff640 1 --2- 172.21.15.99:0/3113311373 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555657b78410 0x555657b87db0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x555657b8da50 tx=0x7f87c402c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e149aa14d15760a6 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:36.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.307+0000 7f87b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:13:36.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.307+0000 7f87b37fe640 1 -- 172.21.15.99:0/3113311373 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c40037f0 con 0x555657b78410 2024-01-31T05:13:36.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.307+0000 7f87b37fe640 1 -- 172.21.15.99:0/3113311373 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f87c4046070 con 0x555657b78410 2024-01-31T05:13:36.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.307+0000 7f87dd033740 1 -- 172.21.15.99:0/3113311373 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555657b06bd0 con 0x555657b78410 2024-01-31T05:13:36.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.307+0000 7f87b37fe640 1 -- 172.21.15.99:0/3113311373 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f87c4003950 con 0x555657b78410 2024-01-31T05:13:36.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.307+0000 7f87dd033740 10 client.16101 fetch_fsmap learned FSMap version 37 2024-01-31T05:13:36.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.307+0000 7f87dd033740 1 -- 172.21.15.99:0/3113311373 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x555657add9e0 con 0x555657b78410 2024-01-31T05:13:36.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.308+0000 7f87b37fe640 1 -- 172.21.15.99:0/3113311373 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x555657b06bd0 con 0x555657b78410 2024-01-31T05:13:36.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.308+0000 7f87b37fe640 1 -- 172.21.15.99:0/3113311373 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 37) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f87c403c040 con 0x555657b78410 2024-01-31T05:13:36.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.308+0000 7f87dd033740 10 client.16101 fetch_fsmap finished waiting for FSMap version 37 2024-01-31T05:13:36.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.308+0000 7f87dd033740 10 client.16101 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-01-31T05:13:36.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.308+0000 7f87dd033740 20 client.16101 populate_metadata read hostname 'smithi099' 2024-01-31T05:13:36.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.308+0000 7f87dd033740 1 --2- 172.21.15.99:0/3113311373 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x555657be5bd0 0x555657be7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:36.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.308+0000 7f87dd033740 4 client.16101 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-01-31T05:13:36.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.308+0000 7f87dd033740 1 -- 172.21.15.99:0/3113311373 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x555657ad81f0 con 0x555657be5bd0 2024-01-31T05:13:36.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.308+0000 7f87d37fe640 1 --2- 172.21.15.99:0/3113311373 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x555657be5bd0 0x555657be7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:36.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.308+0000 7f87d37fe640 1 --2- 172.21.15.99:0/3113311373 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x555657be5bd0 0x555657be7ff0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5837f0132006c13a server_cookie=a67c703e4d6ae3e2 in_seq=0 out_seq=0 2024-01-31T05:13:36.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.308+0000 7f87b37fe640 10 client.16101 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:13:36.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.310+0000 7f87b37fe640 1 -- 172.21.15.99:0/3113311373 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x555657ad81f0 con 0x555657be5bd0 2024-01-31T05:13:36.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.310+0000 7f87b37fe640 10 client.16101 handle_command_reply: tid=0 2024-01-31T05:13:36.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.310+0000 7f87dd033740 1 client.16101 shutdown 2024-01-31T05:13:36.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.310+0000 7f87dd033740 1 -- 172.21.15.99:0/3113311373 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555657b78410 msgr2=0x555657b87db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:36.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.311+0000 7f87dd033740 1 --2- 172.21.15.99:0/3113311373 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555657b78410 0x555657b87db0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x555657b8da50 tx=0x7f87c402c780 comp rx=0 tx=0).stop 2024-01-31T05:13:36.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.311+0000 7f87dd033740 1 -- 172.21.15.99:0/3113311373 shutdown_connections 2024-01-31T05:13:36.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.311+0000 7f87dd033740 1 --2- 172.21.15.99:0/3113311373 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555657b7d580 0x555657b882f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.311+0000 7f87dd033740 1 --2- 172.21.15.99:0/3113311373 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555657b78410 0x555657b87db0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.311+0000 7f87dd033740 1 --2- 172.21.15.99:0/3113311373 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x555657be5bd0 0x555657be7ff0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.311+0000 7f87dd033740 1 --2- 172.21.15.99:0/3113311373 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555657b77a20 0x555657b87870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.311+0000 7f87b37fe640 0 client.16101 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:13:36.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.311+0000 7f87dd033740 1 -- 172.21.15.99:0/3113311373 >> 172.21.15.99:0/3113311373 conn(0x555657b72f90 msgr2=0x555657b81a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:36.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.311+0000 7f87dd033740 1 -- 172.21.15.99:0/3113311373 shutdown_connections 2024-01-31T05:13:36.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.311+0000 7f87dd033740 1 -- 172.21.15.99:0/3113311373 wait complete. 2024-01-31T05:13:36.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.311+0000 7f87dd033740 20 client.16101 trim_cache size 0 max 16384 2024-01-31T05:13:36.320 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-01-31T05:13:36.320 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "no active scrubs running", 2024-01-31T05:13:36.320 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": {} 2024-01-31T05:13:36.320 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-01-31T05:13:36.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.311+0000 7f87da271640 1 -- 172.21.15.99:0/189470869 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f87bc0a13b0 msgr2=0x7f87bc0a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:36.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.311+0000 7f87da271640 1 --2- 172.21.15.99:0/189470869 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f87bc0a13b0 0x7f87bc0a3870 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f87cc096d70 tx=0x7f87cc01bfd0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.311+0000 7f87da271640 1 -- 172.21.15.99:0/189470869 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87d41017a0 msgr2=0x7f87d4199e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:36.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.311+0000 7f87da271640 1 --2- 172.21.15.99:0/189470869 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87d41017a0 0x7f87d4199e40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f87cc009fd0 tx=0x7f87cc00ef10 comp rx=0 tx=0).stop 2024-01-31T05:13:36.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.311+0000 7f87da271640 1 -- 172.21.15.99:0/189470869 shutdown_connections 2024-01-31T05:13:36.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.311+0000 7f87da271640 1 --2- 172.21.15.99:0/189470869 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f87bc0a13b0 0x7f87bc0a3870 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.311+0000 7f87da271640 1 --2- 172.21.15.99:0/189470869 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87d41017a0 0x7f87d4199e40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.311+0000 7f87da271640 1 --2- 172.21.15.99:0/189470869 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87d4100de0 0x7f87d41997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.311+0000 7f87da271640 1 --2- 172.21.15.99:0/189470869 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87d40ffbf0 0x7f87d4068a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.311+0000 7f87da271640 1 -- 172.21.15.99:0/189470869 >> 172.21.15.99:0/189470869 conn(0x7f87d40fb180 msgr2=0x7f87d4104100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:36.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.311+0000 7f87da271640 1 -- 172.21.15.99:0/189470869 shutdown_connections 2024-01-31T05:13:36.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.311+0000 7f87da271640 1 -- 172.21.15.99:0/189470869 wait complete. 2024-01-31T05:13:36.323 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-01-31T05:13:36.323 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T05:13:36.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.432+0000 7f89259cd640 1 -- 172.21.15.99:0/4135698480 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8920100d30 msgr2=0x7f8920101150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:36.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.432+0000 7f89259cd640 1 --2- 172.21.15.99:0/4135698480 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8920100d30 0x7f8920101150 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f8918009900 tx=0x7f891802bc30 comp rx=0 tx=0).stop 2024-01-31T05:13:36.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.432+0000 7f89259cd640 1 -- 172.21.15.99:0/4135698480 shutdown_connections 2024-01-31T05:13:36.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.432+0000 7f89259cd640 1 --2- 172.21.15.99:0/4135698480 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89201028e0 0x7f8920109170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.432+0000 7f89259cd640 1 --2- 172.21.15.99:0/4135698480 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8920101f20 0x7f89201023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.432+0000 7f89259cd640 1 --2- 172.21.15.99:0/4135698480 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8920100d30 0x7f8920101150 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.432+0000 7f89259cd640 1 -- 172.21.15.99:0/4135698480 >> 172.21.15.99:0/4135698480 conn(0x7f89200fc2a0 msgr2=0x7f89200fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:36.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.432+0000 7f89259cd640 1 -- 172.21.15.99:0/4135698480 shutdown_connections 2024-01-31T05:13:36.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.432+0000 7f89259cd640 1 -- 172.21.15.99:0/4135698480 wait complete. 2024-01-31T05:13:36.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.433+0000 7f89259cd640 1 Processor -- start 2024-01-31T05:13:36.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.433+0000 7f89259cd640 1 -- start start 2024-01-31T05:13:36.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.433+0000 7f89259cd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8920100d30 0x7f8920196d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:36.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.433+0000 7f89259cd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8920101f20 0x7f8920197260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:36.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.433+0000 7f89259cd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89201028e0 0x7f892019e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:36.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.433+0000 7f89259cd640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f892019e800 con 0x7f89201028e0 2024-01-31T05:13:36.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.433+0000 7f89259cd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f892019e970 con 0x7f8920100d30 2024-01-31T05:13:36.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.433+0000 7f89259cd640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f892019eb30 con 0x7f8920101f20 2024-01-31T05:13:36.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.434+0000 7f891f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89201028e0 0x7f892019e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:36.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.434+0000 7f891e7fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8920101f20 0x7f8920197260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:36.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.434+0000 7f891e7fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8920101f20 0x7f8920197260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:57014/0 (socket says 172.21.15.99:57014) 2024-01-31T05:13:36.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.434+0000 7f891e7fc640 1 -- 172.21.15.99:0/938593391 learned_addr learned my addr 172.21.15.99:0/938593391 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:36.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.434+0000 7f891effd640 1 --2- 172.21.15.99:0/938593391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8920100d30 0x7f8920196d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:36.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.434+0000 7f891f7fe640 1 -- 172.21.15.99:0/938593391 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8920101f20 msgr2=0x7f8920197260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:36.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.434+0000 7f891f7fe640 1 --2- 172.21.15.99:0/938593391 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8920101f20 0x7f8920197260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.434+0000 7f891f7fe640 1 -- 172.21.15.99:0/938593391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8920100d30 msgr2=0x7f8920196d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:36.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.434+0000 7f891f7fe640 1 --2- 172.21.15.99:0/938593391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8920100d30 0x7f8920196d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.434+0000 7f891f7fe640 1 -- 172.21.15.99:0/938593391 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8918009560 con 0x7f89201028e0 2024-01-31T05:13:36.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.434+0000 7f891e7fc640 1 --2- 172.21.15.99:0/938593391 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8920101f20 0x7f8920197260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:13:36.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.434+0000 7f891f7fe640 1 --2- 172.21.15.99:0/938593391 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89201028e0 0x7f892019e290 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f891000e970 tx=0x7f891000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:36.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.434+0000 7f89249cb640 1 -- 172.21.15.99:0/938593391 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8910009620 con 0x7f89201028e0 2024-01-31T05:13:36.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.434+0000 7f89249cb640 1 -- 172.21.15.99:0/938593391 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f891000ccc0 con 0x7f89201028e0 2024-01-31T05:13:36.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.434+0000 7f89259cd640 1 -- 172.21.15.99:0/938593391 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f892019ee10 con 0x7f89201028e0 2024-01-31T05:13:36.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.434+0000 7f89249cb640 1 -- 172.21.15.99:0/938593391 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8910004a00 con 0x7f89201028e0 2024-01-31T05:13:36.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.434+0000 7f89259cd640 1 -- 172.21.15.99:0/938593391 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f892019f1e0 con 0x7f89201028e0 2024-01-31T05:13:36.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.435+0000 7f89259cd640 1 -- 172.21.15.99:0/938593391 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8920108120 con 0x7f89201028e0 2024-01-31T05:13:36.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.436+0000 7f89249cb640 1 -- 172.21.15.99:0/938593391 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 20) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f8910004b60 con 0x7f89201028e0 2024-01-31T05:13:36.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.437+0000 7f89249cb640 1 --2- 172.21.15.99:0/938593391 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f89080a12e0 0x7f89080a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:36.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.437+0000 7f891effd640 1 --2- 172.21.15.99:0/938593391 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f89080a12e0 0x7f89080a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:36.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.437+0000 7f89249cb640 1 -- 172.21.15.99:0/938593391 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f8910014070 con 0x7f89201028e0 2024-01-31T05:13:36.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.438+0000 7f891effd640 1 --2- 172.21.15.99:0/938593391 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f89080a12e0 0x7f89080a37a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8918000c00 tx=0x7f891802c5d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:36.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.441+0000 7f89249cb640 1 -- 172.21.15.99:0/938593391 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f8910096030 con 0x7f89201028e0 2024-01-31T05:13:36.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.673+0000 7f89259cd640 1 -- 172.21.15.99:0/938593391 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f892010c810 con 0x7f89201028e0 2024-01-31T05:13:36.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.674+0000 7f89249cb640 1 -- 172.21.15.99:0/938593391 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+11406 (secure 0 0 0) 0x7f8910099650 con 0x7f89201028e0 2024-01-31T05:13:36.674 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:13:36.674 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/1488539026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1488539026},{"type":"v1","addr":"172.21.15.99:6835","nonce":1488539026}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/1649552652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1649552652},{"type":"v1","addr":"172.21.15.99:6837","nonce":1649552652}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":37,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-01-31T05:09:20.564215+0000","modified":"2024-01-31T05:13:33.176343+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24461,"mds_2":24457,"mds_3":24439,"mds_4":14619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6839/4070477446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4070477446},{"type":"v1","addr":"172.21.15.99:6839","nonce":4070477446}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":61,"addr":"172.21.15.99:6841/3069939345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6840","nonce":3069939345},{"type":"v1","addr":"172.21.15.99:6841","nonce":3069939345}]},"join_fscid":-1,"export_targets":[0],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24376":{"gid":24376,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6833/427201290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":427201290},{"type":"v1","addr":"172.21.15.181:6833","nonce":427201290}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24401":{"gid":24401,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/472161020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":472161020},{"type":"v1","addr":"172.21.15.179:6833","nonce":472161020}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24427":{"gid":24427,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/1038715471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1038715471},{"type":"v1","addr":"172.21.15.181:6835","nonce":1038715471}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24434":{"gid":24434,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/966976592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":966976592},{"type":"v1","addr":"172.21.15.179:6835","nonce":966976592}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24439":{"gid":24439,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":65,"addr":"172.21.15.181:6837/3875964154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3875964154},{"type":"v1","addr":"172.21.15.181:6837","nonce":3875964154}]},"join_fscid":-1,"export_targets":[2],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24457":{"gid":24457,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":63,"addr":"172.21.15.181:6839/996120687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":996120687},{"type":"v1","addr":"172.21.15.181:6839","nonce":996120687}]},"join_fscid":-1,"export_targets":[0,3],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":63,"addr":"172.21.15.179:6837/837402830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":837402830},{"type":"v1","addr":"172.21.15.179:6837","nonce":837402830}]},"join_fscid":-1,"export_targets":[0,2,4],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6839/754762785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":754762785},{"type":"v1","addr":"172.21.15.179:6839","nonce":754762785}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-31T05:13:36.674 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 37 2024-01-31T05:13:36.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.676+0000 7f89259cd640 1 -- 172.21.15.99:0/938593391 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f89080a12e0 msgr2=0x7f89080a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:36.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.676+0000 7f89259cd640 1 --2- 172.21.15.99:0/938593391 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f89080a12e0 0x7f89080a37a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8918000c00 tx=0x7f891802c5d0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.676+0000 7f89259cd640 1 -- 172.21.15.99:0/938593391 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89201028e0 msgr2=0x7f892019e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:36.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.676+0000 7f89259cd640 1 --2- 172.21.15.99:0/938593391 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89201028e0 0x7f892019e290 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f891000e970 tx=0x7f891000ee30 comp rx=0 tx=0).stop 2024-01-31T05:13:36.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.676+0000 7f89259cd640 1 -- 172.21.15.99:0/938593391 shutdown_connections 2024-01-31T05:13:36.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.676+0000 7f89259cd640 1 --2- 172.21.15.99:0/938593391 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f89080a12e0 0x7f89080a37a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.676+0000 7f89259cd640 1 --2- 172.21.15.99:0/938593391 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89201028e0 0x7f892019e290 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.676+0000 7f89259cd640 1 --2- 172.21.15.99:0/938593391 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8920101f20 0x7f8920197260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.676+0000 7f89259cd640 1 --2- 172.21.15.99:0/938593391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8920100d30 0x7f8920196d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.676+0000 7f89259cd640 1 -- 172.21.15.99:0/938593391 >> 172.21.15.99:0/938593391 conn(0x7f89200fc2a0 msgr2=0x7f89201052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:36.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.677+0000 7f89259cd640 1 -- 172.21.15.99:0/938593391 shutdown_connections 2024-01-31T05:13:36.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.677+0000 7f89259cd640 1 -- 172.21.15.99:0/938593391 wait complete. 2024-01-31T05:13:36.687 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-01-31T05:13:36.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.799+0000 7feeeceb8640 1 -- 172.21.15.99:0/2641001881 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feee81017a0 msgr2=0x7feee8108030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:36.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.799+0000 7feeeceb8640 1 --2- 172.21.15.99:0/2641001881 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feee81017a0 0x7feee8108030 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7feee0009ca0 tx=0x7feee002c0f0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.799+0000 7feeeceb8640 1 -- 172.21.15.99:0/2641001881 shutdown_connections 2024-01-31T05:13:36.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.799+0000 7feeeceb8640 1 --2- 172.21.15.99:0/2641001881 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feee81017a0 0x7feee8108030 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.799+0000 7feeeceb8640 1 --2- 172.21.15.99:0/2641001881 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feee8100de0 0x7feee8101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.799+0000 7feeeceb8640 1 --2- 172.21.15.99:0/2641001881 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feee80ffbf0 0x7feee8100010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.799+0000 7feeeceb8640 1 -- 172.21.15.99:0/2641001881 >> 172.21.15.99:0/2641001881 conn(0x7feee80fb180 msgr2=0x7feee80fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:36.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.799+0000 7feeeceb8640 1 -- 172.21.15.99:0/2641001881 shutdown_connections 2024-01-31T05:13:36.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.799+0000 7feeeceb8640 1 -- 172.21.15.99:0/2641001881 wait complete. 2024-01-31T05:13:36.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.800+0000 7feeeceb8640 1 Processor -- start 2024-01-31T05:13:36.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.800+0000 7feeeceb8640 1 -- start start 2024-01-31T05:13:36.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.800+0000 7feeeceb8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feee80ffbf0 0x7feee80689e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:36.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.800+0000 7feeeceb8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feee8100de0 0x7feee819b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:36.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.800+0000 7feeeceb8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feee81017a0 0x7feee819e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:36.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.800+0000 7feeeceb8640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee819e790 con 0x7feee8100de0 2024-01-31T05:13:36.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.800+0000 7feeeceb8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee819e900 con 0x7feee80ffbf0 2024-01-31T05:13:36.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.800+0000 7feeeceb8640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee819eac0 con 0x7feee81017a0 2024-01-31T05:13:36.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.800+0000 7feee5d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feee8100de0 0x7feee819b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:36.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.800+0000 7feee5d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feee8100de0 0x7feee819b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35366/0 (socket says 172.21.15.99:35366) 2024-01-31T05:13:36.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.800+0000 7feee5d9b640 1 -- 172.21.15.99:0/4029997818 learned_addr learned my addr 172.21.15.99:0/4029997818 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:36.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.800+0000 7feee659c640 1 --2- 172.21.15.99:0/4029997818 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feee80ffbf0 0x7feee80689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:36.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.800+0000 7feee5d9b640 1 -- 172.21.15.99:0/4029997818 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feee81017a0 msgr2=0x7feee819e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:36.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.800+0000 7feee5d9b640 1 --2- 172.21.15.99:0/4029997818 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feee81017a0 0x7feee819e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.800+0000 7feee5d9b640 1 -- 172.21.15.99:0/4029997818 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feee80ffbf0 msgr2=0x7feee80689e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:36.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.800+0000 7feee5d9b640 1 --2- 172.21.15.99:0/4029997818 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feee80ffbf0 0x7feee80689e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.800+0000 7feee5d9b640 1 -- 172.21.15.99:0/4029997818 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee0009900 con 0x7feee8100de0 2024-01-31T05:13:36.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.800+0000 7feee5d9b640 1 --2- 172.21.15.99:0/4029997818 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feee8100de0 0x7feee819b9c0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7feed800e9f0 tx=0x7feed800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:36.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.801+0000 7feedf7fe640 1 -- 172.21.15.99:0/4029997818 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed8009700 con 0x7feee8100de0 2024-01-31T05:13:36.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.801+0000 7feedf7fe640 1 -- 172.21.15.99:0/4029997818 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feed800cd80 con 0x7feee8100de0 2024-01-31T05:13:36.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.801+0000 7feedf7fe640 1 -- 172.21.15.99:0/4029997818 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed8018860 con 0x7feee8100de0 2024-01-31T05:13:36.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.801+0000 7feeeceb8640 1 -- 172.21.15.99:0/4029997818 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feee819eda0 con 0x7feee8100de0 2024-01-31T05:13:36.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.801+0000 7feeeceb8640 1 -- 172.21.15.99:0/4029997818 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee819f270 con 0x7feee8100de0 2024-01-31T05:13:36.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.803+0000 7feedf7fe640 1 -- 172.21.15.99:0/4029997818 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 20) v1 ==== 135895+0+0 (secure 0 0 0) 0x7feed80189c0 con 0x7feee8100de0 2024-01-31T05:13:36.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.803+0000 7feeefc7b740 1 Processor -- start 2024-01-31T05:13:36.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.803+0000 7feeefc7b740 1 -- start start 2024-01-31T05:13:36.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.803+0000 7feedf7fe640 1 --2- 172.21.15.99:0/4029997818 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7feed40a1360 0x7feed40a3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:36.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.803+0000 7feeefc7b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b47221e320 0x55b47221e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:36.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.803+0000 7feeefc7b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b47221ed10 0x55b472223810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:36.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.803+0000 7feeefc7b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b472223e80 0x55b472226310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:36.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.803+0000 7feeefc7b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b472188240 con 0x55b472223e80 2024-01-31T05:13:36.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.803+0000 7feeefc7b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b472185930 con 0x55b47221e320 2024-01-31T05:13:36.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.803+0000 7feeefc7b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b472181220 con 0x55b47221ed10 2024-01-31T05:13:36.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.804+0000 7feedf7fe640 1 -- 172.21.15.99:0/4029997818 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7feed8014070 con 0x7feee8100de0 2024-01-31T05:13:36.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.804+0000 7feee6d9d640 1 --2- 172.21.15.99:0/4029997818 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7feed40a1360 0x7feed40a3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:36.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.804+0000 7feee5d9b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b47221ed10 0x55b472223810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:36.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.804+0000 7feee659c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b47221e320 0x55b47221e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:36.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.804+0000 7feee6d9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b472223e80 0x55b472226310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:36.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.804+0000 7feee5d9b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b47221ed10 0x55b472223810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:57054/0 (socket says 172.21.15.99:57054) 2024-01-31T05:13:36.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.804+0000 7feee5d9b640 1 -- 172.21.15.99:0/3786141439 learned_addr learned my addr 172.21.15.99:0/3786141439 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:36.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.804+0000 7feee659c640 1 -- 172.21.15.99:0/3786141439 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b47221ed10 msgr2=0x55b472223810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:36.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.804+0000 7feee659c640 1 --2- 172.21.15.99:0/3786141439 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b47221ed10 0x55b472223810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.804+0000 7feee659c640 1 -- 172.21.15.99:0/3786141439 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b472223e80 msgr2=0x55b472226310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:36.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.804+0000 7feee659c640 1 --2- 172.21.15.99:0/3786141439 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b472223e80 0x55b472226310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.804+0000 7feee659c640 1 -- 172.21.15.99:0/3786141439 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b4721437c0 con 0x55b47221e320 2024-01-31T05:13:36.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.804+0000 7feee6d9d640 1 --2- 172.21.15.99:0/4029997818 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7feed40a1360 0x7feed40a3820 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7feee002c630 tx=0x7feee0032340 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:36.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.804+0000 7feee659c640 1 --2- 172.21.15.99:0/3786141439 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b47221e320 0x55b47221e740 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7feee8100c40 tx=0x7feed00103d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a309ac1a13dfc1f1 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:36.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.804+0000 7feedcff9640 1 -- 172.21.15.99:0/3786141439 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed0010e30 con 0x55b47221e320 2024-01-31T05:13:36.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.804+0000 7feedcff9640 1 -- 172.21.15.99:0/3786141439 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feed0015070 con 0x55b47221e320 2024-01-31T05:13:36.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.804+0000 7feedcff9640 1 -- 172.21.15.99:0/3786141439 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed0011710 con 0x55b47221e320 2024-01-31T05:13:36.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.805+0000 7feeefc7b740 1 -- 172.21.15.99:0/3786141439 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b47221e320 msgr2=0x55b47221e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:36.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.805+0000 7feeefc7b740 1 --2- 172.21.15.99:0/3786141439 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b47221e320 0x55b47221e740 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7feee8100c40 tx=0x7feed00103d0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.805+0000 7feeefc7b740 1 -- 172.21.15.99:0/3786141439 shutdown_connections 2024-01-31T05:13:36.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.805+0000 7feeefc7b740 1 --2- 172.21.15.99:0/3786141439 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b472223e80 0x55b472226310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.805+0000 7feeefc7b740 1 --2- 172.21.15.99:0/3786141439 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b47221ed10 0x55b472223810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.805+0000 7feeefc7b740 1 --2- 172.21.15.99:0/3786141439 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b47221e320 0x55b47221e740 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.805+0000 7feeefc7b740 1 -- 172.21.15.99:0/3786141439 >> 172.21.15.99:0/3786141439 conn(0x55b472215480 msgr2=0x55b472215880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:36.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.805+0000 7feeefc7b740 1 -- 172.21.15.99:0/3786141439 shutdown_connections 2024-01-31T05:13:36.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.805+0000 7feeefc7b740 1 -- 172.21.15.99:0/3786141439 wait complete. 2024-01-31T05:13:36.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.805+0000 7feeefc7b740 1 -- start start 2024-01-31T05:13:36.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.806+0000 7feeefc7b740 1 Processor -- start 2024-01-31T05:13:36.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.806+0000 7feeefc7b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b47221e320 0x55b472228510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:36.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.806+0000 7feeefc7b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b47221ed10 0x55b472228a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:36.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.806+0000 7feeefc7b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b472223e80 0x55b47222fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:36.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.806+0000 7feeefc7b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b47213a5e0 con 0x55b472223e80 2024-01-31T05:13:36.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.806+0000 7feeefc7b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b47213a280 con 0x55b47221ed10 2024-01-31T05:13:36.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.806+0000 7feeefc7b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4720ff3d0 con 0x55b47221e320 2024-01-31T05:13:36.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.806+0000 7feeefc7b740 10 client.0 _ll_register_callbacks cb 0x55b472177eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:13:36.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.806+0000 7feee5d9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b47221ed10 0x55b472228a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:36.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.806+0000 7feee6d9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b472223e80 0x55b47222fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:36.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.806+0000 7feee5d9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b47221ed10 0x55b472228a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.99:39386/0 (socket says 172.21.15.99:39386) 2024-01-31T05:13:36.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.806+0000 7feee5d9b640 1 -- 172.21.15.99:0/3869500506 learned_addr learned my addr 172.21.15.99:0/3869500506 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:36.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.806+0000 7feee659c640 1 --2- 172.21.15.99:0/3869500506 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b47221e320 0x55b472228510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:36.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.806+0000 7feee6d9d640 1 -- 172.21.15.99:0/3869500506 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b47221e320 msgr2=0x55b472228510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:36.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.806+0000 7feee6d9d640 1 --2- 172.21.15.99:0/3869500506 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b47221e320 0x55b472228510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.806+0000 7feee6d9d640 1 -- 172.21.15.99:0/3869500506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b47221ed10 msgr2=0x55b472228a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:36.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.806+0000 7feee6d9d640 1 --2- 172.21.15.99:0/3869500506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b47221ed10 0x55b472228a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.806+0000 7feee6d9d640 1 -- 172.21.15.99:0/3869500506 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feed000b860 con 0x55b472223e80 2024-01-31T05:13:36.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.806+0000 7feee5d9b640 1 --2- 172.21.15.99:0/3869500506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b47221ed10 0x55b472228a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:13:36.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.806+0000 7feee6d9d640 1 --2- 172.21.15.99:0/3869500506 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b472223e80 0x55b47222fa90 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7feee0009430 tx=0x7feee0032690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea4055342235ff73 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:36.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.806+0000 7feecdffb640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:13:36.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.806+0000 7feecdffb640 1 -- 172.21.15.99:0/3869500506 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee0032790 con 0x55b472223e80 2024-01-31T05:13:36.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.807+0000 7feeefc7b740 1 -- 172.21.15.99:0/3869500506 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b47217a0b0 con 0x55b472223e80 2024-01-31T05:13:36.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.807+0000 7feecdffb640 1 -- 172.21.15.99:0/3869500506 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7feee00328f0 con 0x55b472223e80 2024-01-31T05:13:36.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.807+0000 7feecdffb640 1 -- 172.21.15.99:0/3869500506 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7feee0032ab0 con 0x55b472223e80 2024-01-31T05:13:36.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.807+0000 7feeefc7b740 10 client.16119 fetch_fsmap learned FSMap version 37 2024-01-31T05:13:36.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.807+0000 7feeefc7b740 1 -- 172.21.15.99:0/3869500506 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55b47217f8a0 con 0x55b472223e80 2024-01-31T05:13:36.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.807+0000 7feecdffb640 1 -- 172.21.15.99:0/3869500506 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b47217a0b0 con 0x55b472223e80 2024-01-31T05:13:36.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.807+0000 7feecdffb640 1 -- 172.21.15.99:0/3869500506 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 37) v1 ==== 7926+0+0 (secure 0 0 0) 0x7feee0004040 con 0x55b472223e80 2024-01-31T05:13:36.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.807+0000 7feeefc7b740 10 client.16119 fetch_fsmap finished waiting for FSMap version 37 2024-01-31T05:13:36.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.807+0000 7feeefc7b740 10 client.16119 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-01-31T05:13:36.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.807+0000 7feeefc7b740 20 client.16119 populate_metadata read hostname 'smithi099' 2024-01-31T05:13:36.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.807+0000 7feeefc7b740 1 --2- 172.21.15.99:0/3869500506 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x55b472234490 0x55b4722368b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:36.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.807+0000 7feeefc7b740 4 client.16119 mds_command: new command op to 14619 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:13:36.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.807+0000 7feeefc7b740 1 -- 172.21.15.99:0/3869500506 --> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b472179dd0 con 0x55b472234490 2024-01-31T05:13:36.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.807+0000 7feee659c640 1 --2- 172.21.15.99:0/3869500506 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x55b472234490 0x55b4722368b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:36.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.808+0000 7feecdffb640 10 client.16119 ms_handle_connect on v2:172.21.15.99:6840/3069939345 2024-01-31T05:13:36.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.808+0000 7feee659c640 1 --2- 172.21.15.99:0/3869500506 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x55b472234490 0x55b4722368b0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=142a0f705a0f5e5b server_cookie=541ba2d674523260 in_seq=0 out_seq=0 2024-01-31T05:13:36.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.808+0000 7feecdffb640 1 -- 172.21.15.99:0/3869500506 <== mds.4 v2:172.21.15.99:6840/3069939345 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b472179dd0 con 0x55b472234490 2024-01-31T05:13:36.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.808+0000 7feecdffb640 10 client.16119 handle_command_reply: tid=0 2024-01-31T05:13:36.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.808+0000 7feeefc7b740 1 client.16119 shutdown 2024-01-31T05:13:36.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.808+0000 7feeefc7b740 1 -- 172.21.15.99:0/3869500506 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b472223e80 msgr2=0x55b47222fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:36.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.808+0000 7feeefc7b740 1 --2- 172.21.15.99:0/3869500506 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b472223e80 0x55b47222fa90 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7feee0009430 tx=0x7feee0032690 comp rx=0 tx=0).stop 2024-01-31T05:13:36.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.808+0000 7feeefc7b740 1 -- 172.21.15.99:0/3869500506 shutdown_connections 2024-01-31T05:13:36.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.808+0000 7feeefc7b740 1 --2- 172.21.15.99:0/3869500506 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x55b472234490 0x55b4722368b0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.808+0000 7feeefc7b740 1 --2- 172.21.15.99:0/3869500506 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b472223e80 0x55b47222fa90 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.808+0000 7feecdffb640 0 client.16119 ms_handle_reset on v2:172.21.15.99:6840/3069939345 2024-01-31T05:13:36.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.808+0000 7feeefc7b740 1 --2- 172.21.15.99:0/3869500506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b47221ed10 0x55b472228a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.808+0000 7feeefc7b740 1 --2- 172.21.15.99:0/3869500506 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b47221e320 0x55b472228510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.808+0000 7feeefc7b740 1 -- 172.21.15.99:0/3869500506 >> 172.21.15.99:0/3869500506 conn(0x55b472215480 msgr2=0x55b4722147c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:36.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.808+0000 7feeefc7b740 1 -- 172.21.15.99:0/3869500506 shutdown_connections 2024-01-31T05:13:36.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.808+0000 7feeefc7b740 1 -- 172.21.15.99:0/3869500506 wait complete. 2024-01-31T05:13:36.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.808+0000 7feeefc7b740 20 client.16119 trim_cache size 0 max 16384 2024-01-31T05:13:36.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.820+0000 7feeefc7b740 1 Processor -- start 2024-01-31T05:13:36.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.820+0000 7feeefc7b740 1 -- start start 2024-01-31T05:13:36.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.821+0000 7feeefc7b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b472215480 0x55b4722201d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:36.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.821+0000 7feeefc7b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b47221e320 0x55b472220710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:36.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.821+0000 7feeefc7b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b47221ed10 0x55b47222fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:36.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.821+0000 7feeefc7b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b472232980 con 0x55b472215480 2024-01-31T05:13:36.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.821+0000 7feeefc7b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b472179dd0 con 0x55b47221e320 2024-01-31T05:13:36.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.821+0000 7feeefc7b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b47217a0b0 con 0x55b47221ed10 2024-01-31T05:13:36.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.821+0000 7feee659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b472215480 0x55b4722201d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:36.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.821+0000 7feee659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b472215480 0x55b4722201d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35394/0 (socket says 172.21.15.99:35394) 2024-01-31T05:13:36.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.821+0000 7feee659c640 1 -- 172.21.15.99:0/2465975268 learned_addr learned my addr 172.21.15.99:0/2465975268 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:36.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.821+0000 7feee5d9b640 1 --2- 172.21.15.99:0/2465975268 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b47221e320 0x55b472220710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:36.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.821+0000 7feee6d9d640 1 --2- 172.21.15.99:0/2465975268 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b47221ed10 0x55b47222fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:36.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.821+0000 7feee659c640 1 -- 172.21.15.99:0/2465975268 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b47221ed10 msgr2=0x55b47222fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:36.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.821+0000 7feee659c640 1 --2- 172.21.15.99:0/2465975268 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b47221ed10 0x55b47222fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.821+0000 7feee659c640 1 -- 172.21.15.99:0/2465975268 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b47221e320 msgr2=0x55b472220710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:36.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.821+0000 7feee659c640 1 --2- 172.21.15.99:0/2465975268 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b47221e320 0x55b472220710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.821+0000 7feee659c640 1 -- 172.21.15.99:0/2465975268 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b47211c4d0 con 0x55b472215480 2024-01-31T05:13:36.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.821+0000 7feee5d9b640 1 --2- 172.21.15.99:0/2465975268 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b47221e320 0x55b472220710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:13:36.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.821+0000 7feee659c640 1 --2- 172.21.15.99:0/2465975268 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b472215480 0x55b4722201d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7feee8100c40 tx=0x7feed001e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=100ba250176c2d3c server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:36.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.821+0000 7feecffff640 1 -- 172.21.15.99:0/2465975268 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed0021040 con 0x55b472215480 2024-01-31T05:13:36.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.821+0000 7feecffff640 1 -- 172.21.15.99:0/2465975268 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feed0022040 con 0x55b472215480 2024-01-31T05:13:36.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.821+0000 7feecffff640 1 -- 172.21.15.99:0/2465975268 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed0029050 con 0x55b472215480 2024-01-31T05:13:36.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.822+0000 7feeefc7b740 1 -- 172.21.15.99:0/2465975268 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b472215480 msgr2=0x55b4722201d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:36.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.822+0000 7feeefc7b740 1 --2- 172.21.15.99:0/2465975268 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b472215480 0x55b4722201d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7feee8100c40 tx=0x7feed001e040 comp rx=0 tx=0).stop 2024-01-31T05:13:36.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.822+0000 7feeefc7b740 1 -- 172.21.15.99:0/2465975268 shutdown_connections 2024-01-31T05:13:36.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.822+0000 7feeefc7b740 1 --2- 172.21.15.99:0/2465975268 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b47221ed10 0x55b47222fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.822+0000 7feeefc7b740 1 --2- 172.21.15.99:0/2465975268 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b47221e320 0x55b472220710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.822+0000 7feeefc7b740 1 --2- 172.21.15.99:0/2465975268 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b472215480 0x55b4722201d0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.822+0000 7feeefc7b740 1 -- 172.21.15.99:0/2465975268 >> 172.21.15.99:0/2465975268 conn(0x55b47221faf0 msgr2=0x55b472228510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:36.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.822+0000 7feeefc7b740 1 -- 172.21.15.99:0/2465975268 shutdown_connections 2024-01-31T05:13:36.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.822+0000 7feeefc7b740 1 -- 172.21.15.99:0/2465975268 wait complete. 2024-01-31T05:13:36.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.822+0000 7feeefc7b740 1 -- start start 2024-01-31T05:13:36.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.822+0000 7feeefc7b740 1 Processor -- start 2024-01-31T05:13:36.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.823+0000 7feeefc7b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b472215480 0x55b47222e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:36.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.823+0000 7feeefc7b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b47221e320 0x55b47222e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:36.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.823+0000 7feeefc7b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b47221ed10 0x55b47222ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:36.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.823+0000 7feeefc7b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b47228aa50 con 0x55b472215480 2024-01-31T05:13:36.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.823+0000 7feeefc7b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b47228abc0 con 0x55b47221e320 2024-01-31T05:13:36.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.823+0000 7feeefc7b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b47228ad80 con 0x55b47221ed10 2024-01-31T05:13:36.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.823+0000 7feeefc7b740 10 client.0 _ll_register_callbacks cb 0x7feed000b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:13:36.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.823+0000 7feee659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b472215480 0x55b47222e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:36.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.823+0000 7feee659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b472215480 0x55b47222e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35398/0 (socket says 172.21.15.99:35398) 2024-01-31T05:13:36.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.823+0000 7feee659c640 1 -- 172.21.15.99:0/2986962435 learned_addr learned my addr 172.21.15.99:0/2986962435 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:36.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.823+0000 7feee5d9b640 1 --2- 172.21.15.99:0/2986962435 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b47221e320 0x55b47222e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:36.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.823+0000 7feee6d9d640 1 --2- 172.21.15.99:0/2986962435 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b47221ed10 0x55b47222ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:36.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.823+0000 7feee659c640 1 -- 172.21.15.99:0/2986962435 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b47221ed10 msgr2=0x55b47222ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:36.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.823+0000 7feee659c640 1 --2- 172.21.15.99:0/2986962435 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b47221ed10 0x55b47222ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.823+0000 7feee659c640 1 -- 172.21.15.99:0/2986962435 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b47221e320 msgr2=0x55b47222e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:36.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.823+0000 7feee659c640 1 --2- 172.21.15.99:0/2986962435 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b47221e320 0x55b47222e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.823+0000 7feee659c640 1 -- 172.21.15.99:0/2986962435 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee819f270 con 0x55b472215480 2024-01-31T05:13:36.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.823+0000 7feee659c640 1 --2- 172.21.15.99:0/2986962435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b472215480 0x55b47222e4a0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7feed001e010 tx=0x7feed0010bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=763b553e09c71f71 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:36.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.823+0000 7feecdffb640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:13:36.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.823+0000 7feecdffb640 1 -- 172.21.15.99:0/2986962435 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed0029050 con 0x55b472215480 2024-01-31T05:13:36.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.823+0000 7feecdffb640 1 -- 172.21.15.99:0/2986962435 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7feed0038070 con 0x55b472215480 2024-01-31T05:13:36.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.823+0000 7feeefc7b740 1 -- 172.21.15.99:0/2986962435 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7feed0015070 con 0x55b472215480 2024-01-31T05:13:36.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.823+0000 7feecdffb640 1 -- 172.21.15.99:0/2986962435 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7feed0043070 con 0x55b472215480 2024-01-31T05:13:36.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.823+0000 7feeefc7b740 10 client.16125 fetch_fsmap learned FSMap version 37 2024-01-31T05:13:36.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.823+0000 7feeefc7b740 1 -- 172.21.15.99:0/2986962435 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55b4721437c0 con 0x55b472215480 2024-01-31T05:13:36.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.824+0000 7feecdffb640 1 -- 172.21.15.99:0/2986962435 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feed0015070 con 0x55b472215480 2024-01-31T05:13:36.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.824+0000 7feecdffb640 1 -- 172.21.15.99:0/2986962435 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 37) v1 ==== 7926+0+0 (secure 0 0 0) 0x7feed001c850 con 0x55b472215480 2024-01-31T05:13:36.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.824+0000 7feeefc7b740 10 client.16125 fetch_fsmap finished waiting for FSMap version 37 2024-01-31T05:13:36.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.824+0000 7feeefc7b740 10 client.16125 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-01-31T05:13:36.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.824+0000 7feeefc7b740 20 client.16125 populate_metadata read hostname 'smithi099' 2024-01-31T05:13:36.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.824+0000 7feeefc7b740 1 --2- 172.21.15.99:0/2986962435 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x55b472223e80 0x55b47228e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:36.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.824+0000 7feeefc7b740 4 client.16125 mds_command: new command op to 14619 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-01-31T05:13:36.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.824+0000 7feeefc7b740 1 -- 172.21.15.99:0/2986962435 --> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b471e807e0 con 0x55b472223e80 2024-01-31T05:13:36.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.824+0000 7feee5d9b640 1 --2- 172.21.15.99:0/2986962435 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x55b472223e80 0x55b47228e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:36.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.824+0000 7feee5d9b640 1 --2- 172.21.15.99:0/2986962435 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x55b472223e80 0x55b47228e430 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2d874d29659c0eb server_cookie=b5276ab8890409d7 in_seq=0 out_seq=0 2024-01-31T05:13:36.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.824+0000 7feecdffb640 10 client.16125 ms_handle_connect on v2:172.21.15.99:6840/3069939345 2024-01-31T05:13:36.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.825+0000 7feecdffb640 1 -- 172.21.15.99:0/2986962435 <== mds.4 v2:172.21.15.99:6840/3069939345 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+27293 (crc 0 0 0) 0x55b471e807e0 con 0x55b472223e80 2024-01-31T05:13:36.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.825+0000 7feecdffb640 10 client.16125 handle_command_reply: tid=0 2024-01-31T05:13:36.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.825+0000 7feeefc7b740 1 client.16125 shutdown 2024-01-31T05:13:36.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.825+0000 7feeefc7b740 1 -- 172.21.15.99:0/2986962435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b472215480 msgr2=0x55b47222e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:36.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.825+0000 7feeefc7b740 1 --2- 172.21.15.99:0/2986962435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b472215480 0x55b47222e4a0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7feed001e010 tx=0x7feed0010bf0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.825+0000 7feeefc7b740 1 -- 172.21.15.99:0/2986962435 shutdown_connections 2024-01-31T05:13:36.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.825+0000 7feeefc7b740 1 --2- 172.21.15.99:0/2986962435 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b47221ed10 0x55b47222ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.825+0000 7feeefc7b740 1 --2- 172.21.15.99:0/2986962435 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b47221e320 0x55b47222e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.825+0000 7feeefc7b740 1 --2- 172.21.15.99:0/2986962435 >> [v2:172.21.15.99:6840/3069939345,v1:172.21.15.99:6841/3069939345] conn(0x55b472223e80 0x55b47228e430 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.825+0000 7feeefc7b740 1 --2- 172.21.15.99:0/2986962435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b472215480 0x55b47222e4a0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.825+0000 7feecdffb640 0 client.16125 ms_handle_reset on v2:172.21.15.99:6840/3069939345 2024-01-31T05:13:36.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.825+0000 7feeefc7b740 1 -- 172.21.15.99:0/2986962435 >> 172.21.15.99:0/2986962435 conn(0x55b47221faf0 msgr2=0x55b472228510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:36.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.825+0000 7feeefc7b740 1 -- 172.21.15.99:0/2986962435 shutdown_connections 2024-01-31T05:13:36.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.826+0000 7feeefc7b740 1 -- 172.21.15.99:0/2986962435 wait complete. 2024-01-31T05:13:36.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.826+0000 7feeefc7b740 20 client.16125 trim_cache size 0 max 16384 2024-01-31T05:13:36.832 INFO:teuthology.orchestra.run.smithi099.stdout:[ 2024-01-31T05:13:36.833 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.833 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.833 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 9468209, 2024-01-31T05:13:36.833 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636719, 2024-01-31T05:13:36.833 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_sigkill.te" 2024-01-31T05:13:36.833 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.833 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.833 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.833 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 73693379, 2024-01-31T05:13:36.833 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636718, 2024-01-31T05:13:36.833 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_fdreceive.te" 2024-01-31T05:13:36.833 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.834 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.834 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.834 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 85489341, 2024-01-31T05:13:36.834 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636364, 2024-01-31T05:13:36.834 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/aio/aio01/Makefile" 2024-01-31T05:13:36.834 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.834 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.834 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.834 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 87092543, 2024-01-31T05:13:36.834 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635812, 2024-01-31T05:13:36.834 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns03.c" 2024-01-31T05:13:36.834 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.834 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.834 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.835 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 93772553, 2024-01-31T05:13:36.835 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636721, 2024-01-31T05:13:36.835 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_relabel.te" 2024-01-31T05:13:36.835 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.835 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.835 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.835 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 182590143, 2024-01-31T05:13:36.835 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636722, 2024-01-31T05:13:36.835 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_sysctl.te" 2024-01-31T05:13:36.835 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.835 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.835 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.835 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 220402213, 2024-01-31T05:13:36.835 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635356, 2024-01-31T05:13:36.836 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks" 2024-01-31T05:13:36.836 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.836 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.836 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.836 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 234435619, 2024-01-31T05:13:36.836 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635814, 2024-01-31T05:13:36.836 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns20.c" 2024-01-31T05:13:36.836 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.836 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.836 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.836 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 241741068, 2024-01-31T05:13:36.836 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635393, 2024-01-31T05:13:36.837 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/stress.c" 2024-01-31T05:13:36.837 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.837 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.837 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.837 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 295933448, 2024-01-31T05:13:36.837 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635357, 2024-01-31T05:13:36.837 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks/Makefile" 2024-01-31T05:13:36.837 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.837 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.837 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.837 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 300746224, 2024-01-31T05:13:36.837 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635355, 2024-01-31T05:13:36.837 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/coverage.txt" 2024-01-31T05:13:36.838 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.838 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.838 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.838 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 321352611, 2024-01-31T05:13:36.838 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636063, 2024-01-31T05:13:36.838 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/pthreads/pth_str01.h" 2024-01-31T05:13:36.838 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.838 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.838 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.838 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 356941741, 2024-01-31T05:13:36.838 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635813, 2024-01-31T05:13:36.838 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns04.c" 2024-01-31T05:13:36.838 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.839 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.839 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.839 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 404082670, 2024-01-31T05:13:36.839 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635068, 2024-01-31T05:13:36.839 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/NOTES" 2024-01-31T05:13:36.839 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.839 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.839 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.839 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 430152618, 2024-01-31T05:13:36.839 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635639, 2024-01-31T05:13:36.839 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/pthreads/Makefile" 2024-01-31T05:13:36.839 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.839 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.839 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.840 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 480825046, 2024-01-31T05:13:36.840 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635815, 2024-01-31T05:13:36.840 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns16.c" 2024-01-31T05:13:36.840 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.840 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.840 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.840 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 547765345, 2024-01-31T05:13:36.840 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635803, 2024-01-31T05:13:36.840 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns12.c" 2024-01-31T05:13:36.840 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.841 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.841 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.841 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 548791768, 2024-01-31T05:13:36.841 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636642, 2024-01-31T05:13:36.841 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_policy.if" 2024-01-31T05:13:36.841 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.841 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.841 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.841 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 611434046, 2024-01-31T05:13:36.841 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511634901, 2024-01-31T05:13:36.841 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks/invaliddates.c" 2024-01-31T05:13:36.841 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.842 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.842 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.842 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 618856528, 2024-01-31T05:13:36.842 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636635, 2024-01-31T05:13:36.842 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_setnice.te" 2024-01-31T05:13:36.842 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.842 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.842 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.842 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 685129943, 2024-01-31T05:13:36.842 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635359, 2024-01-31T05:13:36.843 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers/Makefile" 2024-01-31T05:13:36.843 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.843 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.843 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.843 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 765124000, 2024-01-31T05:13:36.843 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635817, 2024-01-31T05:13:36.843 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns30.c" 2024-01-31T05:13:36.843 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.843 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.843 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.843 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 861302020, 2024-01-31T05:13:36.843 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636713, 2024-01-31T05:13:36.843 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_execshare.te" 2024-01-31T05:13:36.844 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.844 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.844 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.844 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 869040392, 2024-01-31T05:13:36.844 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637129, 2024-01-31T05:13:36.844 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sgetmask/Makefile" 2024-01-31T05:13:36.844 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.844 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.844 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.844 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 879406549, 2024-01-31T05:13:36.844 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636723, 2024-01-31T05:13:36.844 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_dyntrans.te" 2024-01-31T05:13:36.845 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.845 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.845 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.845 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 911416436, 2024-01-31T05:13:36.845 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511634900, 2024-01-31T05:13:36.845 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks/twopsetclock.c" 2024-01-31T05:13:36.845 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.845 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.845 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.845 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 956002919, 2024-01-31T05:13:36.846 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636720, 2024-01-31T05:13:36.846 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_open.te" 2024-01-31T05:13:36.846 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.846 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.846 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.846 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 956565295, 2024-01-31T05:13:36.846 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636734, 2024-01-31T05:13:36.846 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_inherit.te" 2024-01-31T05:13:36.846 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.846 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.846 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.846 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 961914881, 2024-01-31T05:13:36.847 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635159, 2024-01-31T05:13:36.847 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/vmtests/stack_space.c" 2024-01-31T05:13:36.847 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.847 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.847 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.847 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 969733216, 2024-01-31T05:13:36.847 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635642, 2024-01-31T05:13:36.847 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/pthreads/pth_str02.c" 2024-01-31T05:13:36.847 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.848 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.848 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.848 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 981969688, 2024-01-31T05:13:36.848 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637745, 2024-01-31T05:13:36.848 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sgetmask/sgetmask01.c" 2024-01-31T05:13:36.848 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.848 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.848 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.848 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 985447773, 2024-01-31T05:13:36.848 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636643, 2024-01-31T05:13:36.848 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_mkdir.te" 2024-01-31T05:13:36.849 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.849 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.849 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.849 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1137705744, 2024-01-31T05:13:36.849 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635809, 2024-01-31T05:13:36.849 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns13.c" 2024-01-31T05:13:36.849 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.849 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.849 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.849 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1187515402, 2024-01-31T05:13:36.849 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636715, 2024-01-31T05:13:36.849 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/Makefile" 2024-01-31T05:13:36.849 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.850 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.850 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.850 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1192300756, 2024-01-31T05:13:36.850 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636709, 2024-01-31T05:13:36.850 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_stat.te" 2024-01-31T05:13:36.850 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.850 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.850 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.850 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1197401422, 2024-01-31T05:13:36.850 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636644, 2024-01-31T05:13:36.851 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_ptrace.te" 2024-01-31T05:13:36.851 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.851 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.851 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.851 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1222956303, 2024-01-31T05:13:36.851 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635808, 2024-01-31T05:13:36.851 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns17.c" 2024-01-31T05:13:36.851 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.851 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.851 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.851 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1320307053, 2024-01-31T05:13:36.851 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636733, 2024-01-31T05:13:36.851 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_rxdir.te" 2024-01-31T05:13:36.852 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.852 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.852 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.852 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1334262837, 2024-01-31T05:13:36.852 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635810, 2024-01-31T05:13:36.852 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns31.c" 2024-01-31T05:13:36.852 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.852 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.853 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.853 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1340622293, 2024-01-31T05:13:36.853 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636732, 2024-01-31T05:13:36.853 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_task_create.te" 2024-01-31T05:13:36.853 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.853 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.853 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.853 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1373515725, 2024-01-31T05:13:36.853 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636710, 2024-01-31T05:13:36.853 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_execute_no_trans.te" 2024-01-31T05:13:36.853 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.853 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.853 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.854 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1457072414, 2024-01-31T05:13:36.854 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636728, 2024-01-31T05:13:36.854 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_dyntrace.te" 2024-01-31T05:13:36.854 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.854 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.854 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.854 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1491275114, 2024-01-31T05:13:36.854 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511634904, 2024-01-31T05:13:36.854 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/run.sh" 2024-01-31T05:13:36.854 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.854 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.854 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.854 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1501204855, 2024-01-31T05:13:36.854 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635811, 2024-01-31T05:13:36.855 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/README" 2024-01-31T05:13:36.855 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.855 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.855 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.855 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1505170828, 2024-01-31T05:13:36.855 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636716, 2024-01-31T05:13:36.855 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_wait.te" 2024-01-31T05:13:36.855 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.855 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.855 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.855 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1509477444, 2024-01-31T05:13:36.855 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511634902, 2024-01-31T05:13:36.855 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers/twoevtimers.c" 2024-01-31T05:13:36.855 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.856 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.856 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.856 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1514318455, 2024-01-31T05:13:36.856 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637069, 2024-01-31T05:13:36.856 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/wait4/wait401.c" 2024-01-31T05:13:36.856 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.856 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.856 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.856 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1603718702, 2024-01-31T05:13:36.856 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635807, 2024-01-31T05:13:36.856 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/runpidnstest.sh" 2024-01-31T05:13:36.856 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.856 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.857 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.857 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1640393753, 2024-01-31T05:13:36.857 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636729, 2024-01-31T05:13:36.857 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_task_getsched.te" 2024-01-31T05:13:36.857 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.857 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.857 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.857 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1657276184, 2024-01-31T05:13:36.857 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511634898, 2024-01-31T05:13:36.857 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/Makefile" 2024-01-31T05:13:36.857 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.857 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.857 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.857 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1710490270, 2024-01-31T05:13:36.857 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635160, 2024-01-31T05:13:36.858 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/vmtests/data_space.c" 2024-01-31T05:13:36.858 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.858 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.858 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.858 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1714178056, 2024-01-31T05:13:36.858 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636731, 2024-01-31T05:13:36.858 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_task_getsid.te" 2024-01-31T05:13:36.858 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.858 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.858 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.858 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1793362971, 2024-01-31T05:13:36.858 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511634905, 2024-01-31T05:13:36.858 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/plan.txt" 2024-01-31T05:13:36.858 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.858 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.859 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.859 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1828456547, 2024-01-31T05:13:36.859 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511634983, 2024-01-31T05:13:36.859 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/testfrmw.c" 2024-01-31T05:13:36.859 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.859 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.859 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.859 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1888928850, 2024-01-31T05:13:36.859 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635901, 2024-01-31T05:13:36.859 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/writetest/writetest.c" 2024-01-31T05:13:36.859 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.859 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.859 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.859 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1893756085, 2024-01-31T05:13:36.859 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636726, 2024-01-31T05:13:36.860 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_exectrace.te" 2024-01-31T05:13:36.860 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.860 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.860 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.860 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1924695563, 2024-01-31T05:13:36.860 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637753, 2024-01-31T05:13:36.860 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sched_yield/sched_yield01.c" 2024-01-31T05:13:36.860 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.860 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.860 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.860 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1964287920, 2024-01-31T05:13:36.860 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636923, 2024-01-31T05:13:36.861 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll_create1/epoll_create1_01.c" 2024-01-31T05:13:36.861 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.861 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.861 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.861 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2054056691, 2024-01-31T05:13:36.861 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635900, 2024-01-31T05:13:36.861 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/aio/aio01/aio01.c" 2024-01-31T05:13:36.861 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.861 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.861 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.861 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2062174332, 2024-01-31T05:13:36.861 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635684, 2024-01-31T05:13:36.861 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/vmtests/Makefile" 2024-01-31T05:13:36.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.862 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.862 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.862 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2111689328, 2024-01-31T05:13:36.862 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637024, 2024-01-31T05:13:36.862 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_rename.te" 2024-01-31T05:13:36.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.862 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.863 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.863 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2139854376, 2024-01-31T05:13:36.863 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636343, 2024-01-31T05:13:36.863 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns02.c" 2024-01-31T05:13:36.863 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.863 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.863 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.863 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2153104073, 2024-01-31T05:13:36.863 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636725, 2024-01-31T05:13:36.863 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_setattr.te" 2024-01-31T05:13:36.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.864 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.864 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.864 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2180303108, 2024-01-31T05:13:36.864 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637034, 2024-01-31T05:13:36.864 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setegid/setegid01.c" 2024-01-31T05:13:36.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.864 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.864 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.864 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2191190163, 2024-01-31T05:13:36.865 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635902, 2024-01-31T05:13:36.865 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/writetest/gpl.txt" 2024-01-31T05:13:36.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.865 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.865 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.865 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2291902148, 2024-01-31T05:13:36.865 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635641, 2024-01-31T05:13:36.865 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/pthreads/pth_str03.c" 2024-01-31T05:13:36.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.866 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.866 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.866 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2367145305, 2024-01-31T05:13:36.866 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637137, 2024-01-31T05:13:36.866 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sched_yield/Makefile" 2024-01-31T05:13:36.866 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.866 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.866 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.866 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2413228119, 2024-01-31T05:13:36.867 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636724, 2024-01-31T05:13:36.867 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_transition.te" 2024-01-31T05:13:36.867 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.867 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.867 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.867 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2516518835, 2024-01-31T05:13:36.867 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636641, 2024-01-31T05:13:36.867 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_readlink.te" 2024-01-31T05:13:36.867 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.868 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.868 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.868 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2659977834, 2024-01-31T05:13:36.868 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635802, 2024-01-31T05:13:36.868 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns06.c" 2024-01-31T05:13:36.868 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.868 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.868 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.869 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2677084489, 2024-01-31T05:13:36.869 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637068, 2024-01-31T05:13:36.869 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/wait4/wait402.c" 2024-01-31T05:13:36.869 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.869 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.869 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.869 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2685112848, 2024-01-31T05:13:36.869 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636717, 2024-01-31T05:13:36.869 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_entrypoint.te" 2024-01-31T05:13:36.869 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.869 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.869 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.870 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2872310622, 2024-01-31T05:13:36.870 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635067, 2024-01-31T05:13:36.870 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/testfrmw.h" 2024-01-31T05:13:36.870 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.870 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.870 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.870 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2924376330, 2024-01-31T05:13:36.870 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636639, 2024-01-31T05:13:36.870 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_task_setsched.te" 2024-01-31T05:13:36.870 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.870 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.870 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.870 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2957520350, 2024-01-31T05:13:36.871 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636637, 2024-01-31T05:13:36.871 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_ipc.te" 2024-01-31T05:13:36.871 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.871 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.871 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.871 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2991346579, 2024-01-31T05:13:36.871 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636636, 2024-01-31T05:13:36.871 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_link.te" 2024-01-31T05:13:36.871 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.871 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.871 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.871 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3120588064, 2024-01-31T05:13:36.871 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635640, 2024-01-31T05:13:36.871 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/pthreads/pth_str01.c" 2024-01-31T05:13:36.871 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.871 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.872 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.872 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3147379371, 2024-01-31T05:13:36.872 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636714, 2024-01-31T05:13:36.872 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_file.te" 2024-01-31T05:13:36.872 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.872 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.872 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.872 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3200778098, 2024-01-31T05:13:36.872 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636712, 2024-01-31T05:13:36.872 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_capable_sys.te" 2024-01-31T05:13:36.872 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.872 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.872 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.872 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3247303953, 2024-01-31T05:13:36.873 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635806, 2024-01-31T05:13:36.873 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/Makefile" 2024-01-31T05:13:36.873 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.873 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.873 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.873 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3269687231, 2024-01-31T05:13:36.873 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636730, 2024-01-31T05:13:36.873 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_capable_net.te" 2024-01-31T05:13:36.873 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.873 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.873 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.873 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3282276612, 2024-01-31T05:13:36.873 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636366, 2024-01-31T05:13:36.873 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/writetest/Makefile" 2024-01-31T05:13:36.874 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.874 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.874 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.874 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3388504079, 2024-01-31T05:13:36.874 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636711, 2024-01-31T05:13:36.874 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_task_getpgid.te" 2024-01-31T05:13:36.874 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.874 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.874 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.874 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3439240981, 2024-01-31T05:13:36.874 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635816, 2024-01-31T05:13:36.874 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns05.c" 2024-01-31T05:13:36.874 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.874 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.875 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.875 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3445123495, 2024-01-31T05:13:36.875 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511634903, 2024-01-31T05:13:36.875 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers/twoptimers.c" 2024-01-31T05:13:36.875 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.875 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.875 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.875 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3459781208, 2024-01-31T05:13:36.875 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636634, 2024-01-31T05:13:36.875 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_task_setpgid.te" 2024-01-31T05:13:36.875 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.875 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.875 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.876 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3484775275, 2024-01-31T05:13:36.876 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511634982, 2024-01-31T05:13:36.876 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/Makefile" 2024-01-31T05:13:36.876 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.876 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.876 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.876 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3507960926, 2024-01-31T05:13:36.876 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636638, 2024-01-31T05:13:36.876 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_ioctl.te" 2024-01-31T05:13:36.876 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.876 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.876 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.877 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3584699627, 2024-01-31T05:13:36.877 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635804, 2024-01-31T05:13:36.877 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns10.c" 2024-01-31T05:13:36.877 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.877 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.877 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.877 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3596465967, 2024-01-31T05:13:36.877 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635358, 2024-01-31T05:13:36.877 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers" 2024-01-31T05:13:36.877 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.877 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.877 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.878 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3607588523, 2024-01-31T05:13:36.878 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635805, 2024-01-31T05:13:36.878 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns01.c" 2024-01-31T05:13:36.878 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.878 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.878 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.878 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3687755089, 2024-01-31T05:13:36.878 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511634899, 2024-01-31T05:13:36.878 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/assertions.xml" 2024-01-31T05:13:36.878 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.878 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.878 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.878 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3801739144, 2024-01-31T05:13:36.878 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635069, 2024-01-31T05:13:36.879 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/LICENCE" 2024-01-31T05:13:36.879 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.879 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.879 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.879 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3914191286, 2024-01-31T05:13:36.879 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636727, 2024-01-31T05:13:36.879 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_global.te" 2024-01-31T05:13:36.879 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.879 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.880 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.880 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3939263850, 2024-01-31T05:13:36.880 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636640, 2024-01-31T05:13:36.880 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_capable_file.te" 2024-01-31T05:13:36.880 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.880 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.880 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.880 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4039223270, 2024-01-31T05:13:36.880 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637667, 2024-01-31T05:13:36.880 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setegid/Makefile" 2024-01-31T05:13:36.880 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.881 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.881 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.881 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4110723647, 2024-01-31T05:13:36.881 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637394, 2024-01-31T05:13:36.881 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll_create1/Makefile" 2024-01-31T05:13:36.881 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:36.881 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:36.881 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:36.881 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4224895085, 2024-01-31T05:13:36.881 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637693, 2024-01-31T05:13:36.881 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/wait4/Makefile" 2024-01-31T05:13:36.881 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:13:36.881 INFO:teuthology.orchestra.run.smithi099.stdout:] 2024-01-31T05:13:36.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.826+0000 7feeeceb8640 1 -- 172.21.15.99:0/4029997818 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7feed40a1360 msgr2=0x7feed40a3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:36.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.826+0000 7feeeceb8640 1 --2- 172.21.15.99:0/4029997818 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7feed40a1360 0x7feed40a3820 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7feee002c630 tx=0x7feee0032340 comp rx=0 tx=0).stop 2024-01-31T05:13:36.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.826+0000 7feeeceb8640 1 -- 172.21.15.99:0/4029997818 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feee8100de0 msgr2=0x7feee819b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:36.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.826+0000 7feeeceb8640 1 --2- 172.21.15.99:0/4029997818 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feee8100de0 0x7feee819b9c0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7feed800e9f0 tx=0x7feed800eeb0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.826+0000 7feeeceb8640 1 -- 172.21.15.99:0/4029997818 shutdown_connections 2024-01-31T05:13:36.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.826+0000 7feeeceb8640 1 --2- 172.21.15.99:0/4029997818 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7feed40a1360 0x7feed40a3820 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.826+0000 7feeeceb8640 1 --2- 172.21.15.99:0/4029997818 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feee81017a0 0x7feee819e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.826+0000 7feeeceb8640 1 --2- 172.21.15.99:0/4029997818 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feee8100de0 0x7feee819b9c0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.826+0000 7feeeceb8640 1 --2- 172.21.15.99:0/4029997818 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feee80ffbf0 0x7feee80689e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.826+0000 7feeeceb8640 1 -- 172.21.15.99:0/4029997818 >> 172.21.15.99:0/4029997818 conn(0x7feee80fb180 msgr2=0x7feee8104200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:36.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.826+0000 7feeeceb8640 1 -- 172.21.15.99:0/4029997818 shutdown_connections 2024-01-31T05:13:36.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.826+0000 7feeeceb8640 1 -- 172.21.15.99:0/4029997818 wait complete. 2024-01-31T05:13:36.885 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-01-31T05:13:36.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.995+0000 7faea69c9640 1 -- 172.21.15.99:0/2454778386 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faea01017d0 msgr2=0x7faea0103bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:36.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.995+0000 7faea69c9640 1 --2- 172.21.15.99:0/2454778386 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faea01017d0 0x7faea0103bc0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fae90009900 tx=0x7fae9002bc30 comp rx=0 tx=0).stop 2024-01-31T05:13:36.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.995+0000 7faea69c9640 1 -- 172.21.15.99:0/2454778386 shutdown_connections 2024-01-31T05:13:36.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.995+0000 7faea69c9640 1 --2- 172.21.15.99:0/2454778386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faea0106a30 0x7faea0108e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.995+0000 7faea69c9640 1 --2- 172.21.15.99:0/2454778386 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faea0104100 0x7faea01064f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.995+0000 7faea69c9640 1 --2- 172.21.15.99:0/2454778386 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faea01017d0 0x7faea0103bc0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.995+0000 7faea69c9640 1 -- 172.21.15.99:0/2454778386 >> 172.21.15.99:0/2454778386 conn(0x7faea00fb180 msgr2=0x7faea00fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:36.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.995+0000 7faea69c9640 1 -- 172.21.15.99:0/2454778386 shutdown_connections 2024-01-31T05:13:36.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.995+0000 7faea69c9640 1 -- 172.21.15.99:0/2454778386 wait complete. 2024-01-31T05:13:36.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.996+0000 7faea69c9640 1 Processor -- start 2024-01-31T05:13:36.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.996+0000 7faea69c9640 1 -- start start 2024-01-31T05:13:36.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.996+0000 7faea69c9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faea01017d0 0x7faea0196d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:36.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.996+0000 7faea69c9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faea0104100 0x7faea0197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:36.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.996+0000 7faea69c9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faea0106a30 0x7faea019e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:36.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.996+0000 7faea69c9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea019e830 con 0x7faea0106a30 2024-01-31T05:13:36.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.996+0000 7faea69c9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea019e9a0 con 0x7faea01017d0 2024-01-31T05:13:36.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.996+0000 7faea69c9640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea019eb60 con 0x7faea0104100 2024-01-31T05:13:36.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.996+0000 7faea4f66640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faea0106a30 0x7faea019e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:36.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.996+0000 7fae9ffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faea01017d0 0x7faea0196d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:36.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.996+0000 7faea4f66640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faea0106a30 0x7faea019e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35406/0 (socket says 172.21.15.99:35406) 2024-01-31T05:13:36.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.996+0000 7faea4f66640 1 -- 172.21.15.99:0/1224112645 learned_addr learned my addr 172.21.15.99:0/1224112645 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:36.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.996+0000 7fae9f7fe640 1 --2- 172.21.15.99:0/1224112645 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faea0104100 0x7faea0197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:36.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.996+0000 7faea4f66640 1 -- 172.21.15.99:0/1224112645 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faea0104100 msgr2=0x7faea0197280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:36.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.996+0000 7faea4f66640 1 --2- 172.21.15.99:0/1224112645 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faea0104100 0x7faea0197280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.996+0000 7faea4f66640 1 -- 172.21.15.99:0/1224112645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faea01017d0 msgr2=0x7faea0196d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:36.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.996+0000 7faea4f66640 1 --2- 172.21.15.99:0/1224112645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faea01017d0 0x7faea0196d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:36.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.996+0000 7faea4f66640 1 -- 172.21.15.99:0/1224112645 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae90009560 con 0x7faea0106a30 2024-01-31T05:13:36.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.997+0000 7faea4f66640 1 --2- 172.21.15.99:0/1224112645 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faea0106a30 0x7faea019e2f0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fae9800eb10 tx=0x7fae9800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:36.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.997+0000 7fae9d7fa640 1 -- 172.21.15.99:0/1224112645 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae98004b20 con 0x7faea0106a30 2024-01-31T05:13:36.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.997+0000 7faea69c9640 1 -- 172.21.15.99:0/1224112645 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faea019ee40 con 0x7faea0106a30 2024-01-31T05:13:36.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.997+0000 7fae9d7fa640 1 -- 172.21.15.99:0/1224112645 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fae98004c80 con 0x7faea0106a30 2024-01-31T05:13:36.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.997+0000 7fae9d7fa640 1 -- 172.21.15.99:0/1224112645 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae98010690 con 0x7faea0106a30 2024-01-31T05:13:36.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.997+0000 7faea69c9640 1 -- 172.21.15.99:0/1224112645 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faea019f270 con 0x7faea0106a30 2024-01-31T05:13:37.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.999+0000 7fae9d7fa640 1 -- 172.21.15.99:0/1224112645 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 20) v1 ==== 135895+0+0 (secure 0 0 0) 0x7fae98005020 con 0x7faea0106a30 2024-01-31T05:13:37.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.999+0000 7faea9783740 1 Processor -- start 2024-01-31T05:13:37.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.999+0000 7faea9783740 1 -- start start 2024-01-31T05:13:37.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:36.999+0000 7fae9d7fa640 1 --2- 172.21.15.99:0/1224112645 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fae880a12e0 0x7fae880a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.000+0000 7faea9783740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d6f4341f10 0x55d6f4342330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.000+0000 7faea9783740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d6f4342900 0x55d6f4347400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.000+0000 7faea9783740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6f4347a70 0x55d6f4349f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.000+0000 7faea9783740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6f42b0240 con 0x55d6f4347a70 2024-01-31T05:13:37.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.000+0000 7faea9783740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6f42ad930 con 0x55d6f4341f10 2024-01-31T05:13:37.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.000+0000 7faea9783740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6f42a9220 con 0x55d6f4342900 2024-01-31T05:13:37.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.000+0000 7fae9f7fe640 1 --2- 172.21.15.99:0/1224112645 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fae880a12e0 0x7fae880a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.000+0000 7faea4f66640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6f4347a70 0x55d6f4349f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.000+0000 7fae9ffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d6f4341f10 0x55d6f4342330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.000+0000 7faea4f66640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6f4347a70 0x55d6f4349f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35416/0 (socket says 172.21.15.99:35416) 2024-01-31T05:13:37.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.000+0000 7faea4f66640 1 -- 172.21.15.99:0/3241367523 learned_addr learned my addr 172.21.15.99:0/3241367523 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:37.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.000+0000 7fae9d7fa640 1 -- 172.21.15.99:0/1224112645 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fae98014070 con 0x7faea0106a30 2024-01-31T05:13:37.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.000+0000 7fae9f7fe640 1 --2- 172.21.15.99:0/3241367523 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d6f4342900 0x55d6f4347400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.000+0000 7faea4f66640 1 -- 172.21.15.99:0/3241367523 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d6f4342900 msgr2=0x55d6f4347400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:37.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.000+0000 7faea4f66640 1 --2- 172.21.15.99:0/3241367523 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d6f4342900 0x55d6f4347400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.000+0000 7faea4f66640 1 -- 172.21.15.99:0/3241367523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d6f4341f10 msgr2=0x55d6f4342330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:37.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.000+0000 7faea4f66640 1 --2- 172.21.15.99:0/3241367523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d6f4341f10 0x55d6f4342330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.000+0000 7faea4f66640 1 -- 172.21.15.99:0/3241367523 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d6f426b7c0 con 0x55d6f4347a70 2024-01-31T05:13:37.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.000+0000 7fae9ffff640 1 --2- 172.21.15.99:0/3241367523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d6f4341f10 0x55d6f4342330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:13:37.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.000+0000 7faea4f66640 1 --2- 172.21.15.99:0/3241367523 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6f4347a70 0x55d6f4349f00 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fae98096c60 tx=0x7fae98014f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cf8f9210774a861 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:37.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.000+0000 7fae9f7fe640 1 --2- 172.21.15.99:0/1224112645 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fae880a12e0 0x7fae880a37a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fae94009710 tx=0x7fae94013880 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:37.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.000+0000 7fae867fc640 1 -- 172.21.15.99:0/3241367523 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae98099b50 con 0x55d6f4347a70 2024-01-31T05:13:37.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.000+0000 7fae867fc640 1 -- 172.21.15.99:0/3241367523 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fae98064f60 con 0x55d6f4347a70 2024-01-31T05:13:37.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.000+0000 7fae867fc640 1 -- 172.21.15.99:0/3241367523 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9809a280 con 0x55d6f4347a70 2024-01-31T05:13:37.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.001+0000 7faea9783740 1 -- 172.21.15.99:0/3241367523 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6f4347a70 msgr2=0x55d6f4349f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:37.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.001+0000 7faea9783740 1 --2- 172.21.15.99:0/3241367523 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6f4347a70 0x55d6f4349f00 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fae98096c60 tx=0x7fae98014f40 comp rx=0 tx=0).stop 2024-01-31T05:13:37.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.001+0000 7faea9783740 1 -- 172.21.15.99:0/3241367523 shutdown_connections 2024-01-31T05:13:37.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.001+0000 7faea9783740 1 --2- 172.21.15.99:0/3241367523 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6f4347a70 0x55d6f4349f00 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.001+0000 7faea9783740 1 --2- 172.21.15.99:0/3241367523 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d6f4342900 0x55d6f4347400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.001+0000 7faea9783740 1 --2- 172.21.15.99:0/3241367523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d6f4341f10 0x55d6f4342330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.001+0000 7faea9783740 1 -- 172.21.15.99:0/3241367523 >> 172.21.15.99:0/3241367523 conn(0x55d6f433d480 msgr2=0x55d6f433d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:37.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.001+0000 7faea9783740 1 -- 172.21.15.99:0/3241367523 shutdown_connections 2024-01-31T05:13:37.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.001+0000 7faea9783740 1 -- 172.21.15.99:0/3241367523 wait complete. 2024-01-31T05:13:37.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.001+0000 7faea9783740 1 -- start start 2024-01-31T05:13:37.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.002+0000 7faea9783740 1 Processor -- start 2024-01-31T05:13:37.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.002+0000 7faea9783740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d6f4341f10 0x55d6f434c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.002+0000 7faea9783740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d6f4342900 0x55d6f434c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.002+0000 7faea9783740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6f4347a70 0x55d6f4353640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.002+0000 7faea9783740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6f42625e0 con 0x55d6f4347a70 2024-01-31T05:13:37.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.002+0000 7faea9783740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6f4262280 con 0x55d6f4341f10 2024-01-31T05:13:37.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.002+0000 7faea9783740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6f42273d0 con 0x55d6f4342900 2024-01-31T05:13:37.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.002+0000 7faea9783740 10 client.0 _ll_register_callbacks cb 0x55d6f429feb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:13:37.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.002+0000 7faea4f66640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6f4347a70 0x55d6f4353640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.002+0000 7fae9ffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d6f4341f10 0x55d6f434c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.002+0000 7faea4f66640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6f4347a70 0x55d6f4353640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35424/0 (socket says 172.21.15.99:35424) 2024-01-31T05:13:37.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.002+0000 7faea4f66640 1 -- 172.21.15.99:0/1289996444 learned_addr learned my addr 172.21.15.99:0/1289996444 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:37.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.002+0000 7fae9f7fe640 1 --2- 172.21.15.99:0/1289996444 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d6f4342900 0x55d6f434c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.002+0000 7faea4f66640 1 -- 172.21.15.99:0/1289996444 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d6f4342900 msgr2=0x55d6f434c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:37.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.002+0000 7faea4f66640 1 --2- 172.21.15.99:0/1289996444 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d6f4342900 0x55d6f434c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.002+0000 7faea4f66640 1 -- 172.21.15.99:0/1289996444 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d6f4341f10 msgr2=0x55d6f434c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:37.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.002+0000 7faea4f66640 1 --2- 172.21.15.99:0/1289996444 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d6f4341f10 0x55d6f434c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.002+0000 7faea4f66640 1 -- 172.21.15.99:0/1289996444 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faea019f270 con 0x55d6f4347a70 2024-01-31T05:13:37.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.002+0000 7fae9f7fe640 1 --2- 172.21.15.99:0/1289996444 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d6f4342900 0x55d6f434c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:13:37.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.002+0000 7fae9ffff640 1 --2- 172.21.15.99:0/1289996444 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d6f4341f10 0x55d6f434c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:13:37.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.002+0000 7faea4f66640 1 --2- 172.21.15.99:0/1289996444 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6f4347a70 0x55d6f4353640 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fae980a2050 tx=0x7fae980167f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29323ead1e995290 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:37.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.002+0000 7fae7f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:13:37.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.003+0000 7fae7f7fe640 1 -- 172.21.15.99:0/1289996444 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae98099b50 con 0x55d6f4347a70 2024-01-31T05:13:37.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.003+0000 7fae7f7fe640 1 -- 172.21.15.99:0/1289996444 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fae9809a8f0 con 0x55d6f4347a70 2024-01-31T05:13:37.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.003+0000 7faea9783740 1 -- 172.21.15.99:0/1289996444 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d6f42a20b0 con 0x55d6f4347a70 2024-01-31T05:13:37.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.003+0000 7fae7f7fe640 1 -- 172.21.15.99:0/1289996444 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae9809e340 con 0x55d6f4347a70 2024-01-31T05:13:37.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.003+0000 7faea9783740 10 client.16137 fetch_fsmap learned FSMap version 37 2024-01-31T05:13:37.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.003+0000 7faea9783740 1 -- 172.21.15.99:0/1289996444 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55d6f42a78a0 con 0x55d6f4347a70 2024-01-31T05:13:37.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.003+0000 7fae7f7fe640 1 -- 172.21.15.99:0/1289996444 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fae980b1020 con 0x55d6f4347a70 2024-01-31T05:13:37.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.003+0000 7fae7f7fe640 1 -- 172.21.15.99:0/1289996444 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 37) v1 ==== 7926+0+0 (secure 0 0 0) 0x7fae98062020 con 0x55d6f4347a70 2024-01-31T05:13:37.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.003+0000 7faea9783740 10 client.16137 fetch_fsmap finished waiting for FSMap version 37 2024-01-31T05:13:37.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.003+0000 7faea9783740 10 client.16137 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-01-31T05:13:37.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.003+0000 7faea9783740 20 client.16137 populate_metadata read hostname 'smithi099' 2024-01-31T05:13:37.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.003+0000 7faea9783740 1 --2- 172.21.15.99:0/1289996444 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x55d6f4357c20 0x55d6f435a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.003+0000 7faea9783740 4 client.16137 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:13:37.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.003+0000 7faea9783740 1 -- 172.21.15.99:0/1289996444 --> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d6f42a1dd0 con 0x55d6f4357c20 2024-01-31T05:13:37.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.003+0000 7fae9ffff640 1 --2- 172.21.15.99:0/1289996444 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x55d6f4357c20 0x55d6f435a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.004+0000 7fae7f7fe640 10 client.16137 ms_handle_connect on v2:172.21.15.181:6836/3875964154 2024-01-31T05:13:37.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.004+0000 7fae9ffff640 1 --2- 172.21.15.99:0/1289996444 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x55d6f4357c20 0x55d6f435a040 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6825d8d878e92b28 server_cookie=683094bdfa29ec0a in_seq=0 out_seq=0 2024-01-31T05:13:37.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.004+0000 7fae7f7fe640 1 -- 172.21.15.99:0/1289996444 <== mds.3 v2:172.21.15.181:6836/3875964154 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d6f42a1dd0 con 0x55d6f4357c20 2024-01-31T05:13:37.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.004+0000 7fae7f7fe640 10 client.16137 handle_command_reply: tid=0 2024-01-31T05:13:37.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.004+0000 7faea9783740 1 client.16137 shutdown 2024-01-31T05:13:37.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.004+0000 7faea9783740 1 -- 172.21.15.99:0/1289996444 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6f4347a70 msgr2=0x55d6f4353640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:37.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.004+0000 7faea9783740 1 --2- 172.21.15.99:0/1289996444 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6f4347a70 0x55d6f4353640 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fae980a2050 tx=0x7fae980167f0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.004+0000 7faea9783740 1 -- 172.21.15.99:0/1289996444 shutdown_connections 2024-01-31T05:13:37.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.004+0000 7faea9783740 1 --2- 172.21.15.99:0/1289996444 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x55d6f4357c20 0x55d6f435a040 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.004+0000 7faea9783740 1 --2- 172.21.15.99:0/1289996444 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6f4347a70 0x55d6f4353640 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.004+0000 7faea9783740 1 --2- 172.21.15.99:0/1289996444 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d6f4342900 0x55d6f434c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.004+0000 7fae7f7fe640 0 client.16137 ms_handle_reset on v2:172.21.15.181:6836/3875964154 2024-01-31T05:13:37.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.004+0000 7faea9783740 1 --2- 172.21.15.99:0/1289996444 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d6f4341f10 0x55d6f434c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.005+0000 7faea9783740 1 -- 172.21.15.99:0/1289996444 >> 172.21.15.99:0/1289996444 conn(0x55d6f433d480 msgr2=0x55d6f433c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:37.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.005+0000 7faea9783740 1 -- 172.21.15.99:0/1289996444 shutdown_connections 2024-01-31T05:13:37.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.005+0000 7faea9783740 1 -- 172.21.15.99:0/1289996444 wait complete. 2024-01-31T05:13:37.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.005+0000 7faea9783740 20 client.16137 trim_cache size 0 max 16384 2024-01-31T05:13:37.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.017+0000 7faea9783740 1 Processor -- start 2024-01-31T05:13:37.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.017+0000 7faea9783740 1 -- start start 2024-01-31T05:13:37.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.017+0000 7faea9783740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d6f4341f10 0x55d6f434c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.017+0000 7faea9783740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6f4342900 0x55d6f434c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.017+0000 7faea9783740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d6f4347a70 0x55d6f4353600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.017+0000 7faea9783740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6f433e480 con 0x55d6f4342900 2024-01-31T05:13:37.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.017+0000 7faea9783740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6f42a1dd0 con 0x55d6f4347a70 2024-01-31T05:13:37.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.017+0000 7faea9783740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6f4338d10 con 0x55d6f4341f10 2024-01-31T05:13:37.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.017+0000 7fae9f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6f4342900 0x55d6f434c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.017+0000 7fae9f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6f4342900 0x55d6f434c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35430/0 (socket says 172.21.15.99:35430) 2024-01-31T05:13:37.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.017+0000 7fae9f7fe640 1 -- 172.21.15.99:0/3027586620 learned_addr learned my addr 172.21.15.99:0/3027586620 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:37.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.017+0000 7faea4f66640 1 --2- 172.21.15.99:0/3027586620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d6f4347a70 0x55d6f4353600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.018+0000 7fae9ffff640 1 --2- 172.21.15.99:0/3027586620 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d6f4341f10 0x55d6f434c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.018+0000 7fae9f7fe640 1 -- 172.21.15.99:0/3027586620 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d6f4341f10 msgr2=0x55d6f434c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:37.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.018+0000 7fae9f7fe640 1 --2- 172.21.15.99:0/3027586620 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d6f4341f10 0x55d6f434c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.018+0000 7fae9f7fe640 1 -- 172.21.15.99:0/3027586620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d6f4347a70 msgr2=0x55d6f4353600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:37.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.018+0000 7fae9f7fe640 1 --2- 172.21.15.99:0/3027586620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d6f4347a70 0x55d6f4353600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.018+0000 7fae9f7fe640 1 -- 172.21.15.99:0/3027586620 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d6f42444d0 con 0x55d6f4342900 2024-01-31T05:13:37.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.018+0000 7fae9f7fe640 1 --2- 172.21.15.99:0/3027586620 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6f4342900 0x55d6f434c600 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fae940123e0 tx=0x7fae9401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c77bf84a99e74225 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:37.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.018+0000 7fae85ffb640 1 -- 172.21.15.99:0/3027586620 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae94003b70 con 0x55d6f4342900 2024-01-31T05:13:37.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.018+0000 7fae85ffb640 1 -- 172.21.15.99:0/3027586620 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fae94003cd0 con 0x55d6f4342900 2024-01-31T05:13:37.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.018+0000 7fae85ffb640 1 -- 172.21.15.99:0/3027586620 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae94010690 con 0x55d6f4342900 2024-01-31T05:13:37.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.019+0000 7faea9783740 1 -- 172.21.15.99:0/3027586620 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6f4342900 msgr2=0x55d6f434c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:37.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.019+0000 7faea9783740 1 --2- 172.21.15.99:0/3027586620 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6f4342900 0x55d6f434c600 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fae940123e0 tx=0x7fae9401f000 comp rx=0 tx=0).stop 2024-01-31T05:13:37.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.019+0000 7faea9783740 1 -- 172.21.15.99:0/3027586620 shutdown_connections 2024-01-31T05:13:37.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.019+0000 7faea9783740 1 --2- 172.21.15.99:0/3027586620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d6f4347a70 0x55d6f4353600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.019+0000 7faea9783740 1 --2- 172.21.15.99:0/3027586620 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6f4342900 0x55d6f434c600 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.019+0000 7faea9783740 1 --2- 172.21.15.99:0/3027586620 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d6f4341f10 0x55d6f434c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.019+0000 7faea9783740 1 -- 172.21.15.99:0/3027586620 >> 172.21.15.99:0/3027586620 conn(0x55d6f433d480 msgr2=0x55d6f435e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:37.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.019+0000 7faea9783740 1 -- 172.21.15.99:0/3027586620 shutdown_connections 2024-01-31T05:13:37.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.019+0000 7faea9783740 1 -- 172.21.15.99:0/3027586620 wait complete. 2024-01-31T05:13:37.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.019+0000 7faea9783740 1 -- start start 2024-01-31T05:13:37.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.019+0000 7faea9783740 1 Processor -- start 2024-01-31T05:13:37.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.020+0000 7faea9783740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d6f4341f10 0x55d6f4353600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.020+0000 7faea9783740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6f4342900 0x55d6f4351cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.020+0000 7faea9783740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d6f4347a70 0x55d6f4352210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.020+0000 7faea9783740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6f4352910 con 0x55d6f4342900 2024-01-31T05:13:37.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.020+0000 7faea9783740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6f4352a80 con 0x55d6f4341f10 2024-01-31T05:13:37.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.020+0000 7faea9783740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6f43ae150 con 0x55d6f4347a70 2024-01-31T05:13:37.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.020+0000 7faea9783740 10 client.0 _ll_register_callbacks cb 0x7fae9804ff50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:13:37.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.020+0000 7fae9f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6f4342900 0x55d6f4351cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.020+0000 7fae9f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6f4342900 0x55d6f4351cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35444/0 (socket says 172.21.15.99:35444) 2024-01-31T05:13:37.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.020+0000 7fae9f7fe640 1 -- 172.21.15.99:0/2602010733 learned_addr learned my addr 172.21.15.99:0/2602010733 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:37.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.020+0000 7fae9ffff640 1 --2- 172.21.15.99:0/2602010733 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d6f4341f10 0x55d6f4353600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.020+0000 7faea4f66640 1 --2- 172.21.15.99:0/2602010733 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d6f4347a70 0x55d6f4352210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.020+0000 7fae9f7fe640 1 -- 172.21.15.99:0/2602010733 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d6f4347a70 msgr2=0x55d6f4352210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:37.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.020+0000 7fae9f7fe640 1 --2- 172.21.15.99:0/2602010733 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d6f4347a70 0x55d6f4352210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.020+0000 7fae9f7fe640 1 -- 172.21.15.99:0/2602010733 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d6f4341f10 msgr2=0x55d6f4353600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:37.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.020+0000 7fae9f7fe640 1 --2- 172.21.15.99:0/2602010733 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d6f4341f10 0x55d6f4353600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.020+0000 7fae9f7fe640 1 -- 172.21.15.99:0/2602010733 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae94012110 con 0x55d6f4342900 2024-01-31T05:13:37.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.020+0000 7fae9f7fe640 1 --2- 172.21.15.99:0/2602010733 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6f4342900 0x55d6f4351cd0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fae94009880 tx=0x7fae940091e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6444e8913eef1c02 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:37.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.020+0000 7fae7f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:13:37.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.020+0000 7fae7f7fe640 1 -- 172.21.15.99:0/2602010733 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae94003b70 con 0x55d6f4342900 2024-01-31T05:13:37.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.020+0000 7fae7f7fe640 1 -- 172.21.15.99:0/2602010733 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fae94003e40 con 0x55d6f4342900 2024-01-31T05:13:37.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.020+0000 7faea9783740 1 -- 172.21.15.99:0/2602010733 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fae98064f60 con 0x55d6f4342900 2024-01-31T05:13:37.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.020+0000 7fae7f7fe640 1 -- 172.21.15.99:0/2602010733 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae94038070 con 0x55d6f4342900 2024-01-31T05:13:37.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.020+0000 7faea9783740 10 client.16143 fetch_fsmap learned FSMap version 37 2024-01-31T05:13:37.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.020+0000 7faea9783740 1 -- 172.21.15.99:0/2602010733 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55d6f426a020 con 0x55d6f4342900 2024-01-31T05:13:37.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.021+0000 7fae7f7fe640 1 -- 172.21.15.99:0/2602010733 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fae98064f60 con 0x55d6f4342900 2024-01-31T05:13:37.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.021+0000 7fae7f7fe640 1 -- 172.21.15.99:0/2602010733 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 37) v1 ==== 7926+0+0 (secure 0 0 0) 0x7fae94029460 con 0x55d6f4342900 2024-01-31T05:13:37.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.021+0000 7faea9783740 10 client.16143 fetch_fsmap finished waiting for FSMap version 37 2024-01-31T05:13:37.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.021+0000 7faea9783740 10 client.16143 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-01-31T05:13:37.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.021+0000 7faea9783740 20 client.16143 populate_metadata read hostname 'smithi099' 2024-01-31T05:13:37.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.021+0000 7faea9783740 1 --2- 172.21.15.99:0/2602010733 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x55d6f43afbc0 0x55d6f43b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.021+0000 7faea9783740 4 client.16143 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-01-31T05:13:37.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.021+0000 7faea9783740 1 -- 172.21.15.99:0/2602010733 --> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55d6f3fa87e0 con 0x55d6f43afbc0 2024-01-31T05:13:37.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.021+0000 7fae9ffff640 1 --2- 172.21.15.99:0/2602010733 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x55d6f43afbc0 0x55d6f43b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.021+0000 7fae9ffff640 1 --2- 172.21.15.99:0/2602010733 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x55d6f43afbc0 0x55d6f43b1fe0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=782bc44da21c6c0f server_cookie=974dee389d7239d in_seq=0 out_seq=0 2024-01-31T05:13:37.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.021+0000 7fae7f7fe640 10 client.16143 ms_handle_connect on v2:172.21.15.181:6836/3875964154 2024-01-31T05:13:37.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.024+0000 7fae7f7fe640 1 -- 172.21.15.99:0/2602010733 <== mds.3 v2:172.21.15.181:6836/3875964154 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+122088 (crc 0 0 0) 0x55d6f3fa87e0 con 0x55d6f43afbc0 2024-01-31T05:13:37.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.024+0000 7fae7f7fe640 10 client.16143 handle_command_reply: tid=0 2024-01-31T05:13:37.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.024+0000 7faea9783740 1 client.16143 shutdown 2024-01-31T05:13:37.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.024+0000 7faea9783740 1 -- 172.21.15.99:0/2602010733 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6f4342900 msgr2=0x55d6f4351cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:37.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.024+0000 7faea9783740 1 --2- 172.21.15.99:0/2602010733 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6f4342900 0x55d6f4351cd0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fae94009880 tx=0x7fae940091e0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.024+0000 7faea9783740 1 -- 172.21.15.99:0/2602010733 shutdown_connections 2024-01-31T05:13:37.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.024+0000 7faea9783740 1 --2- 172.21.15.99:0/2602010733 >> [v2:172.21.15.181:6836/3875964154,v1:172.21.15.181:6837/3875964154] conn(0x55d6f43afbc0 0x55d6f43b1fe0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.024+0000 7faea9783740 1 --2- 172.21.15.99:0/2602010733 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d6f4347a70 0x55d6f4352210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.024+0000 7fae7f7fe640 0 client.16143 ms_handle_reset on v2:172.21.15.181:6836/3875964154 2024-01-31T05:13:37.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.024+0000 7faea9783740 1 --2- 172.21.15.99:0/2602010733 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6f4342900 0x55d6f4351cd0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.024+0000 7faea9783740 1 --2- 172.21.15.99:0/2602010733 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d6f4341f10 0x55d6f4353600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.024+0000 7faea9783740 1 -- 172.21.15.99:0/2602010733 >> 172.21.15.99:0/2602010733 conn(0x55d6f433d480 msgr2=0x55d6f4343dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:37.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.024+0000 7faea9783740 1 -- 172.21.15.99:0/2602010733 shutdown_connections 2024-01-31T05:13:37.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.024+0000 7faea9783740 1 -- 172.21.15.99:0/2602010733 wait complete. 2024-01-31T05:13:37.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.024+0000 7faea9783740 20 client.16143 trim_cache size 0 max 16384 2024-01-31T05:13:37.033 INFO:teuthology.orchestra.run.smithi099.stdout:[ 2024-01-31T05:13:37.033 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.033 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.033 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3436862, 2024-01-31T05:13:37.033 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637008, 2024-01-31T05:13:37.034 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src" 2024-01-31T05:13:37.034 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.034 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.034 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.034 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 5013199, 2024-01-31T05:13:37.034 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636807, 2024-01-31T05:13:37.034 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_capable_sys.sh" 2024-01-31T05:13:37.034 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.034 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.034 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.034 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 5102006, 2024-01-31T05:13:37.035 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636622, 2024-01-31T05:13:37.035 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_mkdir.te" 2024-01-31T05:13:37.035 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.035 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.035 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.035 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 6553805, 2024-01-31T05:13:37.035 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636567, 2024-01-31T05:13:37.035 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/Makefile" 2024-01-31T05:13:37.035 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.035 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.035 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.035 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 18339753, 2024-01-31T05:13:37.036 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636810, 2024-01-31T05:13:37.036 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_nice.c" 2024-01-31T05:13:37.036 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.036 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.036 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.036 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 40003341, 2024-01-31T05:13:37.036 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636545, 2024-01-31T05:13:37.036 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/notroot.c" 2024-01-31T05:13:37.036 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.036 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.036 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.036 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 46718451, 2024-01-31T05:13:37.036 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636744, 2024-01-31T05:13:37.036 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_setattr.te" 2024-01-31T05:13:37.037 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.037 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.037 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.037 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 57884436, 2024-01-31T05:13:37.037 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637316, 2024-01-31T05:13:37.037 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys" 2024-01-31T05:13:37.037 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.037 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.037 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.037 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 62517879, 2024-01-31T05:13:37.037 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636573, 2024-01-31T05:13:37.037 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/cap_bounds_r.c" 2024-01-31T05:13:37.037 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.037 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.038 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.038 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 83461041, 2024-01-31T05:13:37.038 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636774, 2024-01-31T05:13:37.038 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ptrace/selinux_ptrace_wait.sh" 2024-01-31T05:13:37.038 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.038 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.038 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.038 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 99840133, 2024-01-31T05:13:37.038 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636778, 2024-01-31T05:13:37.038 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/inherit/selinux_inherit.sh" 2024-01-31T05:13:37.038 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.038 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.038 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.038 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 99883120, 2024-01-31T05:13:37.039 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636746, 2024-01-31T05:13:37.039 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_global.te" 2024-01-31T05:13:37.039 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.039 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.039 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.039 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 101948988, 2024-01-31T05:13:37.039 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637291, 2024-01-31T05:13:37.039 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ptrace" 2024-01-31T05:13:37.039 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.039 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.039 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.039 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 106159548, 2024-01-31T05:13:37.039 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637328, 2024-01-31T05:13:37.039 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/domain_trans" 2024-01-31T05:13:37.040 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.040 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.040 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 141082177, 2024-01-31T05:13:37.040 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637333, 2024-01-31T05:13:37.040 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/readlink/Makefile" 2024-01-31T05:13:37.040 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.040 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.040 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 183993949, 2024-01-31T05:13:37.040 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636542, 2024-01-31T05:13:37.040 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_doi.sh" 2024-01-31T05:13:37.040 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.041 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.041 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 186533812, 2024-01-31T05:13:37.041 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636851, 2024-01-31T05:13:37.041 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/rxdir/Makefile" 2024-01-31T05:13:37.041 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.041 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.041 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.041 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 214972330, 2024-01-31T05:13:37.041 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636551, 2024-01-31T05:13:37.041 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/p9auth/runp9auth.sh" 2024-01-31T05:13:37.041 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.041 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.041 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.041 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 222581309, 2024-01-31T05:13:37.042 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636819, 2024-01-31T05:13:37.042 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrans/selinux_dyntrans_parent.c" 2024-01-31T05:13:37.042 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.042 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.042 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.042 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 230335495, 2024-01-31T05:13:37.042 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635785, 2024-01-31T05:13:37.042 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/Makefile" 2024-01-31T05:13:37.042 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.042 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.042 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.042 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 246010014, 2024-01-31T05:13:37.042 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636859, 2024-01-31T05:13:37.042 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/tomoyo/tomoyo_file_test.c" 2024-01-31T05:13:37.042 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.043 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.043 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 248679825, 2024-01-31T05:13:37.043 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636877, 2024-01-31T05:13:37.043 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/assign_password.sh" 2024-01-31T05:13:37.043 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.043 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.043 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 252880777, 2024-01-31T05:13:37.043 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637336, 2024-01-31T05:13:37.043 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sigkill" 2024-01-31T05:13:37.043 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.043 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.043 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 258115547, 2024-01-31T05:13:37.044 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637277, 2024-01-31T05:13:37.044 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/relabel" 2024-01-31T05:13:37.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.044 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.044 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.044 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 263935388, 2024-01-31T05:13:37.044 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636569, 2024-01-31T05:13:37.044 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/run_capbounds.sh" 2024-01-31T05:13:37.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.044 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.044 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.044 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 267607926, 2024-01-31T05:13:37.044 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635801, 2024-01-31T05:13:37.044 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns/mqns_01.c" 2024-01-31T05:13:37.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.045 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.045 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 268466860, 2024-01-31T05:13:37.045 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636547, 2024-01-31T05:13:37.045 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_load.sh" 2024-01-31T05:13:37.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.045 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.045 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 279256678, 2024-01-31T05:13:37.045 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636771, 2024-01-31T05:13:37.045 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setattr/selinux_setattr.sh" 2024-01-31T05:13:37.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.045 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.046 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 282654958, 2024-01-31T05:13:37.046 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636860, 2024-01-31T05:13:37.046 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/tomoyo/newns.c" 2024-01-31T05:13:37.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.046 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.046 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 291216287, 2024-01-31T05:13:37.046 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635827, 2024-01-31T05:13:37.046 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/check_netns_enabled.c" 2024-01-31T05:13:37.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.046 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.046 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 291536351, 2024-01-31T05:13:37.046 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636566, 2024-01-31T05:13:37.046 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/cap_bounds_rw.c" 2024-01-31T05:13:37.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.047 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.047 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 291713127, 2024-01-31T05:13:37.047 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636850, 2024-01-31T05:13:37.047 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/bounds/selinux_bounds_thread.c" 2024-01-31T05:13:37.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.047 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.047 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 295711732, 2024-01-31T05:13:37.047 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636853, 2024-01-31T05:13:37.047 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getsid/selinux_task_getsid.sh" 2024-01-31T05:13:37.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.048 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.048 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 297819612, 2024-01-31T05:13:37.048 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636831, 2024-01-31T05:13:37.048 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/msg/selinux_msgget.c" 2024-01-31T05:13:37.048 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.048 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.048 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 311727462, 2024-01-31T05:13:37.048 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637015, 2024-01-31T05:13:37.048 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/exec_without_inh.c" 2024-01-31T05:13:37.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.049 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.049 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 317401247, 2024-01-31T05:13:37.049 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636873, 2024-01-31T05:13:37.049 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/README" 2024-01-31T05:13:37.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.049 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.049 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 317582072, 2024-01-31T05:13:37.049 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636591, 2024-01-31T05:13:37.049 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_file.te" 2024-01-31T05:13:37.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.050 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.050 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 317861344, 2024-01-31T05:13:37.050 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636844, 2024-01-31T05:13:37.050 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/fdreceive/selinux_fdreceive_server.c" 2024-01-31T05:13:37.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.051 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.051 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 318046772, 2024-01-31T05:13:37.051 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636779, 2024-01-31T05:13:37.051 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/inherit/Makefile" 2024-01-31T05:13:37.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.051 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.051 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 321941904, 2024-01-31T05:13:37.051 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636747, 2024-01-31T05:13:37.051 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_dyntrace.te" 2024-01-31T05:13:37.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.051 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.052 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 330248364, 2024-01-31T05:13:37.052 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637348, 2024-01-31T05:13:37.052 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setnice" 2024-01-31T05:13:37.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.052 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.052 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 375280137, 2024-01-31T05:13:37.052 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637330, 2024-01-31T05:13:37.052 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/wait" 2024-01-31T05:13:37.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.053 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.053 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 377941292, 2024-01-31T05:13:37.053 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637020, 2024-01-31T05:13:37.053 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy" 2024-01-31T05:13:37.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.053 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.053 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 403268660, 2024-01-31T05:13:37.053 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636595, 2024-01-31T05:13:37.053 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_socket.te" 2024-01-31T05:13:37.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.054 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.054 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 404769836, 2024-01-31T05:13:37.054 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637339, 2024-01-31T05:13:37.054 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ioctl/selinux_ioctl.sh" 2024-01-31T05:13:37.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.054 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.054 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 427516491, 2024-01-31T05:13:37.054 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635841, 2024-01-31T05:13:37.054 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/nw_under_ns.sh" 2024-01-31T05:13:37.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.055 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.055 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 428226298, 2024-01-31T05:13:37.055 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636755, 2024-01-31T05:13:37.055 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/relabel/selinux_relabel.sh" 2024-01-31T05:13:37.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.055 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.055 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 433884155, 2024-01-31T05:13:37.055 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637346, 2024-01-31T05:13:37.055 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/fdreceive" 2024-01-31T05:13:37.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.056 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.056 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 445144241, 2024-01-31T05:13:37.056 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637295, 2024-01-31T05:13:37.056 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execute_no_trans" 2024-01-31T05:13:37.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.056 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.057 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 455220273, 2024-01-31T05:13:37.057 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636601, 2024-01-31T05:13:37.057 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_dyntrans.te" 2024-01-31T05:13:37.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.057 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.057 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 456862412, 2024-01-31T05:13:37.057 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636339, 2024-01-31T05:13:37.057 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/mesgq_nstest.c" 2024-01-31T05:13:37.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.057 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.058 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 461116970, 2024-01-31T05:13:37.058 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636550, 2024-01-31T05:13:37.058 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_cipso.sh" 2024-01-31T05:13:37.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.058 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.058 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 475643869, 2024-01-31T05:13:37.058 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636823, 2024-01-31T05:13:37.058 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/wait/Makefile" 2024-01-31T05:13:37.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.059 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.059 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 485566783, 2024-01-31T05:13:37.059 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635839, 2024-01-31T05:13:37.059 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/runallnetworktests_parent.sh" 2024-01-31T05:13:37.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.059 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.059 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 514363824, 2024-01-31T05:13:37.059 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636782, 2024-01-31T05:13:37.060 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_mmap.c" 2024-01-31T05:13:37.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.060 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.060 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 547211181, 2024-01-31T05:13:37.060 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635848, 2024-01-31T05:13:37.060 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/childipv6.sh" 2024-01-31T05:13:37.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.061 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.061 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 552675717, 2024-01-31T05:13:37.061 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636763, 2024-01-31T05:13:37.061 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/shm/Makefile" 2024-01-31T05:13:37.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.061 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.061 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 568507279, 2024-01-31T05:13:37.061 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636871, 2024-01-31T05:13:37.062 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/LICENSE" 2024-01-31T05:13:37.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.062 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.062 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 572009320, 2024-01-31T05:13:37.062 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636801, 2024-01-31T05:13:37.062 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setpgid/selinux_task_setpgid.sh" 2024-01-31T05:13:37.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.063 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.063 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 573417428, 2024-01-31T05:13:37.063 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637001, 2024-01-31T05:13:37.063 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/p9auth" 2024-01-31T05:13:37.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.063 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.063 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 575240955, 2024-01-31T05:13:37.063 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636863, 2024-01-31T05:13:37.063 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/checkforlibcap.sh" 2024-01-31T05:13:37.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.064 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.064 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 578277095, 2024-01-31T05:13:37.064 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637324, 2024-01-31T05:13:37.064 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrans" 2024-01-31T05:13:37.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.064 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.064 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 578942240, 2024-01-31T05:13:37.064 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635959, 2024-01-31T05:13:37.064 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/dev_sim_framework/kernel_space/tmod.c" 2024-01-31T05:13:37.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.065 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.065 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 590881750, 2024-01-31T05:13:37.065 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635823, 2024-01-31T05:13:37.065 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/paripv6.sh" 2024-01-31T05:13:37.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.065 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.065 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 594345760, 2024-01-31T05:13:37.065 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635795, 2024-01-31T05:13:37.065 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/README" 2024-01-31T05:13:37.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.066 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.066 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 603846760, 2024-01-31T05:13:37.066 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636620, 2024-01-31T05:13:37.066 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_readlink.te" 2024-01-31T05:13:37.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.066 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.066 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 612476289, 2024-01-31T05:13:37.066 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636836, 2024-01-31T05:13:37.066 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ioctl/selinux_ioctl.c" 2024-01-31T05:13:37.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.066 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.067 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 615430568, 2024-01-31T05:13:37.067 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637320, 2024-01-31T05:13:37.067 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/entrypoint" 2024-01-31T05:13:37.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.067 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.067 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 627946897, 2024-01-31T05:13:37.067 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636864, 2024-01-31T05:13:37.067 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/Makefile" 2024-01-31T05:13:37.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.068 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.068 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 640201261, 2024-01-31T05:13:37.068 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635851, 2024-01-31T05:13:37.068 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/container_ftp.pl" 2024-01-31T05:13:37.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.068 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.068 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 642183091, 2024-01-31T05:13:37.068 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636752, 2024-01-31T05:13:37.068 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_rxdir.te" 2024-01-31T05:13:37.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.068 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.069 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 647166146, 2024-01-31T05:13:37.069 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636741, 2024-01-31T05:13:37.069 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_sysctl.te" 2024-01-31T05:13:37.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.069 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.069 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 655586273, 2024-01-31T05:13:37.069 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636570, 2024-01-31T05:13:37.069 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/check_for_libcap.sh" 2024-01-31T05:13:37.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.069 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.069 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 661163550, 2024-01-31T05:13:37.069 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636548, 2024-01-31T05:13:37.070 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_socket_labels.c" 2024-01-31T05:13:37.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.070 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.070 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 693469779, 2024-01-31T05:13:37.070 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637303, 2024-01-31T05:13:37.070 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setscheduler/selinux_task_setscheduler_source.c" 2024-01-31T05:13:37.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.070 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.070 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 698115339, 2024-01-31T05:13:37.070 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636603, 2024-01-31T05:13:37.070 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_setattr.te" 2024-01-31T05:13:37.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.071 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.071 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 699694038, 2024-01-31T05:13:37.071 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637360, 2024-01-31T05:13:37.071 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security" 2024-01-31T05:13:37.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.071 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.071 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 724200128, 2024-01-31T05:13:37.071 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637115, 2024-01-31T05:13:37.071 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresgid/getresgid03.c" 2024-01-31T05:13:37.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.071 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.071 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 736570898, 2024-01-31T05:13:37.072 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636556, 2024-01-31T05:13:37.072 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/policy/Makefile" 2024-01-31T05:13:37.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.072 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.072 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 742439485, 2024-01-31T05:13:37.072 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635844, 2024-01-31T05:13:37.072 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/par_chld_ftp.c" 2024-01-31T05:13:37.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.072 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.072 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 755402738, 2024-01-31T05:13:37.072 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636767, 2024-01-31T05:13:37.072 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/rename/selinux_rename.sh" 2024-01-31T05:13:37.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.073 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.073 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 756273556, 2024-01-31T05:13:37.073 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637005, 2024-01-31T05:13:37.073 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/policy" 2024-01-31T05:13:37.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.073 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.073 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 762577963, 2024-01-31T05:13:37.073 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636585, 2024-01-31T05:13:37.073 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_stat.te" 2024-01-31T05:13:37.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.074 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.074 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 777245458, 2024-01-31T05:13:37.074 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635837, 2024-01-31T05:13:37.074 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/childns.sh" 2024-01-31T05:13:37.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.074 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.074 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 779359581, 2024-01-31T05:13:37.074 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636553, 2024-01-31T05:13:37.074 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/p9auth/Makefile" 2024-01-31T05:13:37.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.074 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.074 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 783426840, 2024-01-31T05:13:37.075 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637023, 2024-01-31T05:13:37.075 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5" 2024-01-31T05:13:37.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.075 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.075 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 786293557, 2024-01-31T05:13:37.075 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635786, 2024-01-31T05:13:37.075 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/container_test.sh" 2024-01-31T05:13:37.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.075 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.075 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 797792605, 2024-01-31T05:13:37.076 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637292, 2024-01-31T05:13:37.076 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ptrace/selinux_ptrace.c" 2024-01-31T05:13:37.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.076 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.076 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 802325517, 2024-01-31T05:13:37.076 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636809, 2024-01-31T05:13:37.076 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_rawio.c" 2024-01-31T05:13:37.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.076 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.076 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 804066063, 2024-01-31T05:13:37.076 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637342, 2024-01-31T05:13:37.077 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execshare" 2024-01-31T05:13:37.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.077 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.077 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 822567423, 2024-01-31T05:13:37.077 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636758, 2024-01-31T05:13:37.077 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sem/selinux_sem.sh" 2024-01-31T05:13:37.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.077 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.077 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 824807227, 2024-01-31T05:13:37.077 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636564, 2024-01-31T05:13:37.077 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/tests/ima_violations.sh" 2024-01-31T05:13:37.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.078 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.078 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 847790649, 2024-01-31T05:13:37.078 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635845, 2024-01-31T05:13:37.078 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/runallnetworktests_child.sh" 2024-01-31T05:13:37.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.078 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.078 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 850637168, 2024-01-31T05:13:37.078 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636611, 2024-01-31T05:13:37.078 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_rxdir.te" 2024-01-31T05:13:37.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.079 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.079 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 877928416, 2024-01-31T05:13:37.079 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636840, 2024-01-31T05:13:37.079 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execshare/selinux_execshare.sh" 2024-01-31T05:13:37.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.079 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.079 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 891371682, 2024-01-31T05:13:37.079 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635826, 2024-01-31T05:13:37.079 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/readme" 2024-01-31T05:13:37.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.080 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.080 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 892529025, 2024-01-31T05:13:37.080 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636562, 2024-01-31T05:13:37.080 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/tests/Makefile" 2024-01-31T05:13:37.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.080 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.080 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 905655217, 2024-01-31T05:13:37.080 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636587, 2024-01-31T05:13:37.080 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_task_getpgid.te" 2024-01-31T05:13:37.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.080 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.081 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 913927129, 2024-01-31T05:13:37.081 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635834, 2024-01-31T05:13:37.081 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/child_2.sh" 2024-01-31T05:13:37.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.081 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.081 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 922220634, 2024-01-31T05:13:37.081 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637017, 2024-01-31T05:13:37.081 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy" 2024-01-31T05:13:37.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.081 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.082 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 931554516, 2024-01-31T05:13:37.082 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636824, 2024-01-31T05:13:37.082 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/wait/selinux_wait_child.c" 2024-01-31T05:13:37.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.082 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.082 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 937639266, 2024-01-31T05:13:37.082 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636764, 2024-01-31T05:13:37.082 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/shm/selinux_shmget.c" 2024-01-31T05:13:37.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.082 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.082 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 940847937, 2024-01-31T05:13:37.083 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636738, 2024-01-31T05:13:37.083 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_open.te" 2024-01-31T05:13:37.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.083 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.083 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 956380775, 2024-01-31T05:13:37.083 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636854, 2024-01-31T05:13:37.083 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getsid/selinux_task_getsid_target.c" 2024-01-31T05:13:37.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.083 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.083 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 967217682, 2024-01-31T05:13:37.083 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636874, 2024-01-31T05:13:37.083 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/AUTHORS" 2024-01-31T05:13:37.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.084 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.084 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 969614479, 2024-01-31T05:13:37.084 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636800, 2024-01-31T05:13:37.084 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrace/selinux_dyntrace_child.c" 2024-01-31T05:13:37.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.084 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.084 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 981639298, 2024-01-31T05:13:37.084 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635859, 2024-01-31T05:13:37.084 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/disktest/man1/disktest_manual.html" 2024-01-31T05:13:37.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.084 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.085 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 983665868, 2024-01-31T05:13:37.085 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637358, 2024-01-31T05:13:37.085 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps" 2024-01-31T05:13:37.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.085 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.085 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 983971364, 2024-01-31T05:13:37.085 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636340, 2024-01-31T05:13:37.085 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns" 2024-01-31T05:13:37.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.086 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.086 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 990465855, 2024-01-31T05:13:37.086 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635832, 2024-01-31T05:13:37.086 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/Makefile" 2024-01-31T05:13:37.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.086 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.086 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1000656128, 2024-01-31T05:13:37.086 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635794, 2024-01-31T05:13:37.086 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/semtest_2ns.c" 2024-01-31T05:13:37.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.087 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.087 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1013486418, 2024-01-31T05:13:37.087 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636766, 2024-01-31T05:13:37.087 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/shm/selinux_shmat.c" 2024-01-31T05:13:37.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.087 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.087 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1093438057, 2024-01-31T05:13:37.087 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636578, 2024-01-31T05:13:37.087 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_ipc.te" 2024-01-31T05:13:37.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.088 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.088 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1094431374, 2024-01-31T05:13:37.088 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635820, 2024-01-31T05:13:37.088 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/parent_view.sh" 2024-01-31T05:13:37.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.088 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.088 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1104829914, 2024-01-31T05:13:37.088 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636769, 2024-01-31T05:13:37.089 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/exectrace/selinux_exectrace_child.c" 2024-01-31T05:13:37.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.089 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.089 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1116846382, 2024-01-31T05:13:37.089 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635829, 2024-01-31T05:13:37.089 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/parent.sh" 2024-01-31T05:13:37.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.089 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.089 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1117567022, 2024-01-31T05:13:37.090 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636563, 2024-01-31T05:13:37.090 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/tests/ima_tpm.sh" 2024-01-31T05:13:37.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.090 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.090 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1119225534, 2024-01-31T05:13:37.090 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635830, 2024-01-31T05:13:37.090 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/parent_share.sh" 2024-01-31T05:13:37.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.090 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.091 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1136655211, 2024-01-31T05:13:37.091 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636586, 2024-01-31T05:13:37.091 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_execute_no_trans.te" 2024-01-31T05:13:37.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.091 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.091 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1137275256, 2024-01-31T05:13:37.091 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637727, 2024-01-31T05:13:37.091 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresgid/getresgid01.c" 2024-01-31T05:13:37.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.091 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.092 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1141472687, 2024-01-31T05:13:37.092 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637006, 2024-01-31T05:13:37.092 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/policy/measure.policy-invalid" 2024-01-31T05:13:37.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.092 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.092 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1144347395, 2024-01-31T05:13:37.092 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637114, 2024-01-31T05:13:37.092 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresgid/Makefile" 2024-01-31T05:13:37.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.093 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.093 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1155545167, 2024-01-31T05:13:37.093 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637305, 2024-01-31T05:13:37.093 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/mkdir/Makefile" 2024-01-31T05:13:37.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.093 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.093 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1158019828, 2024-01-31T05:13:37.093 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635843, 2024-01-31T05:13:37.093 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/sysfsview.c" 2024-01-31T05:13:37.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.094 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.094 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1174917775, 2024-01-31T05:13:37.094 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636783, 2024-01-31T05:13:37.094 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/Makefile" 2024-01-31T05:13:37.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.094 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.094 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1185024840, 2024-01-31T05:13:37.094 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636589, 2024-01-31T05:13:37.094 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_capable_sys.te" 2024-01-31T05:13:37.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.095 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.095 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1186476904, 2024-01-31T05:13:37.095 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636748, 2024-01-31T05:13:37.095 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_task_getsched.te" 2024-01-31T05:13:37.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.096 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.096 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1210649320, 2024-01-31T05:13:37.096 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635833, 2024-01-31T05:13:37.096 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/runnetnstest.sh" 2024-01-31T05:13:37.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.096 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.096 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1251888450, 2024-01-31T05:13:37.096 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637335, 2024-01-31T05:13:37.097 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/msg/selinux_msg.sh" 2024-01-31T05:13:37.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.097 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.097 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1271889904, 2024-01-31T05:13:37.097 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636594, 2024-01-31T05:13:37.097 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_entrypoint.te" 2024-01-31T05:13:37.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.098 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.098 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1276835292, 2024-01-31T05:13:37.098 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635800, 2024-01-31T05:13:37.098 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns/mqns_04.c" 2024-01-31T05:13:37.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.098 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.098 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1278335893, 2024-01-31T05:13:37.098 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635825, 2024-01-31T05:13:37.098 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/par_chld_ipv6.c" 2024-01-31T05:13:37.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.099 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.099 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1285492851, 2024-01-31T05:13:37.099 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637300, 2024-01-31T05:13:37.099 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_fcntl.c" 2024-01-31T05:13:37.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.099 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.099 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1293872917, 2024-01-31T05:13:37.099 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636222, 2024-01-31T05:13:37.100 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/user_space/Makefile" 2024-01-31T05:13:37.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.100 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.100 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1304604352, 2024-01-31T05:13:37.100 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636607, 2024-01-31T05:13:37.100 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_task_getsched.te" 2024-01-31T05:13:37.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.100 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.101 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1307003114, 2024-01-31T05:13:37.101 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637359, 2024-01-31T05:13:37.101 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/print_caps.c" 2024-01-31T05:13:37.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.101 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.101 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1316331786, 2024-01-31T05:13:37.101 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636596, 2024-01-31T05:13:37.101 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_fdreceive.te" 2024-01-31T05:13:37.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.102 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.102 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1317046008, 2024-01-31T05:13:37.102 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636765, 2024-01-31T05:13:37.102 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/shm/selinux_shm.sh" 2024-01-31T05:13:37.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.102 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.102 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1336495318, 2024-01-31T05:13:37.102 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637326, 2024-01-31T05:13:37.102 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sysctl" 2024-01-31T05:13:37.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.103 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.103 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1338092967, 2024-01-31T05:13:37.103 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636615, 2024-01-31T05:13:37.103 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_link.te" 2024-01-31T05:13:37.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.103 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.103 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1351721418, 2024-01-31T05:13:37.103 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637298, 2024-01-31T05:13:37.103 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/inherit/selinux_inherit_parent.c" 2024-01-31T05:13:37.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.103 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.104 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1352213895, 2024-01-31T05:13:37.104 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637354, 2024-01-31T05:13:37.104 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getsid" 2024-01-31T05:13:37.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.104 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.104 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1354053335, 2024-01-31T05:13:37.104 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636602, 2024-01-31T05:13:37.104 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_transition.te" 2024-01-31T05:13:37.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.104 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.104 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1373451458, 2024-01-31T05:13:37.104 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636772, 2024-01-31T05:13:37.105 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ptrace/selinux_ptrace.sh" 2024-01-31T05:13:37.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.105 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.105 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1375550182, 2024-01-31T05:13:37.105 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636756, 2024-01-31T05:13:37.105 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_file/Makefile" 2024-01-31T05:13:37.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.105 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.105 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1376541415, 2024-01-31T05:13:37.105 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636780, 2024-01-31T05:13:37.105 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/inherit/selinux_inherit_child.c" 2024-01-31T05:13:37.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.106 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.106 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1377664386, 2024-01-31T05:13:37.106 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636395, 2024-01-31T05:13:37.106 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/dev_sim_framework/kernel_space/load_tmod.sh" 2024-01-31T05:13:37.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.106 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.106 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1397297084, 2024-01-31T05:13:37.106 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637294, 2024-01-31T05:13:37.106 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_create/selinux_task_create.sh" 2024-01-31T05:13:37.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.106 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.107 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1399544984, 2024-01-31T05:13:37.107 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636568, 2024-01-31T05:13:37.107 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/exec_with_inh.c" 2024-01-31T05:13:37.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.107 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.107 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1404597938, 2024-01-31T05:13:37.107 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636614, 2024-01-31T05:13:37.107 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_setnice.te" 2024-01-31T05:13:37.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.107 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.107 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1405742558, 2024-01-31T05:13:37.107 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636572, 2024-01-31T05:13:37.108 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/check_pe.c" 2024-01-31T05:13:37.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.108 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.108 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1411275548, 2024-01-31T05:13:37.108 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636754, 2024-01-31T05:13:37.108 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/README" 2024-01-31T05:13:37.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.108 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.108 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1412161715, 2024-01-31T05:13:37.108 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636630, 2024-01-31T05:13:37.109 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/Makefile" 2024-01-31T05:13:37.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.109 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.109 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1417482831, 2024-01-31T05:13:37.109 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636828, 2024-01-31T05:13:37.109 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/msg/selinux_msgctl.c" 2024-01-31T05:13:37.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.109 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.109 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1438646690, 2024-01-31T05:13:37.109 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635798, 2024-01-31T05:13:37.109 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns/mqns_02.c" 2024-01-31T05:13:37.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.110 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.110 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1441560789, 2024-01-31T05:13:37.110 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636598, 2024-01-31T05:13:37.110 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_open.te" 2024-01-31T05:13:37.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.110 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.110 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1456877458, 2024-01-31T05:13:37.110 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637306, 2024-01-31T05:13:37.110 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setnice" 2024-01-31T05:13:37.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.110 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.111 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1479239456, 2024-01-31T05:13:37.111 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636543, 2024-01-31T05:13:37.111 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/Makefile" 2024-01-31T05:13:37.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.111 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.111 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1482425558, 2024-01-31T05:13:37.111 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637304, 2024-01-31T05:13:37.111 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/mkdir" 2024-01-31T05:13:37.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.111 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.111 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1483466370, 2024-01-31T05:13:37.111 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636337, 2024-01-31T05:13:37.112 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/TEST_PLAN.txt" 2024-01-31T05:13:37.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.112 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.112 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1493352239, 2024-01-31T05:13:37.112 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636599, 2024-01-31T05:13:37.112 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_relabel.te" 2024-01-31T05:13:37.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.112 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.112 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1498815539, 2024-01-31T05:13:37.112 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636736, 2024-01-31T05:13:37.112 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_fdreceive.te" 2024-01-31T05:13:37.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.113 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.113 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1506924820, 2024-01-31T05:13:37.113 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635956, 2024-01-31T05:13:37.113 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/dev_sim_framework/kernel_space/Makefile" 2024-01-31T05:13:37.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.113 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.113 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1531072735, 2024-01-31T05:13:37.113 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636861, 2024-01-31T05:13:37.113 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/tomoyo/include.h" 2024-01-31T05:13:37.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.114 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.114 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1534558109, 2024-01-31T05:13:37.114 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637314, 2024-01-31T05:13:37.114 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net" 2024-01-31T05:13:37.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.114 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.114 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1541871819, 2024-01-31T05:13:37.114 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636558, 2024-01-31T05:13:37.114 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/ima_boot_aggregate.c" 2024-01-31T05:13:37.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.114 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.114 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1554618558, 2024-01-31T05:13:37.115 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637019, 2024-01-31T05:13:37.115 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/Makefile" 2024-01-31T05:13:37.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.115 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.115 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1555897925, 2024-01-31T05:13:37.115 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636606, 2024-01-31T05:13:37.115 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_dyntrace.te" 2024-01-31T05:13:37.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.115 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.115 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1559075531, 2024-01-31T05:13:37.115 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637010, 2024-01-31T05:13:37.115 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/tests" 2024-01-31T05:13:37.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.116 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.116 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1575955648, 2024-01-31T05:13:37.116 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636624, 2024-01-31T05:13:37.116 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_stat.te" 2024-01-31T05:13:37.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.116 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.116 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1606246579, 2024-01-31T05:13:37.116 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635822, 2024-01-31T05:13:37.116 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/two_children_ns.c" 2024-01-31T05:13:37.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.117 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.117 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1628673544, 2024-01-31T05:13:37.117 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637310, 2024-01-31T05:13:37.117 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrace" 2024-01-31T05:13:37.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.117 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.117 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1637627536, 2024-01-31T05:13:37.117 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636600, 2024-01-31T05:13:37.117 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_sysctl.te" 2024-01-31T05:13:37.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.117 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.117 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1638853355, 2024-01-31T05:13:37.118 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635835, 2024-01-31T05:13:37.118 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/child_1.sh" 2024-01-31T05:13:37.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.118 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.118 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1644689065, 2024-01-31T05:13:37.118 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636735, 2024-01-31T05:13:37.118 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_policy.fc" 2024-01-31T05:13:37.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.118 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.118 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1657995474, 2024-01-31T05:13:37.118 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636649, 2024-01-31T05:13:37.118 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space" 2024-01-31T05:13:37.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.119 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.119 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1660881950, 2024-01-31T05:13:37.119 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636760, 2024-01-31T05:13:37.119 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sem/Makefile" 2024-01-31T05:13:37.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.119 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.119 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1668539388, 2024-01-31T05:13:37.119 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636814, 2024-01-31T05:13:37.119 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getpgid/selinux_task_getpgid_source.c" 2024-01-31T05:13:37.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.120 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.120 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1676839898, 2024-01-31T05:13:37.120 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636577, 2024-01-31T05:13:37.120 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_link.te" 2024-01-31T05:13:37.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.120 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.120 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1695834127, 2024-01-31T05:13:37.120 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635831, 2024-01-31T05:13:37.120 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/parent_1.sh" 2024-01-31T05:13:37.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.121 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.121 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1697618810, 2024-01-31T05:13:37.121 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636588, 2024-01-31T05:13:37.121 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_attrib.te" 2024-01-31T05:13:37.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.121 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.121 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1724597203, 2024-01-31T05:13:37.121 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637009, 2024-01-31T05:13:37.121 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/ima_measure.c" 2024-01-31T05:13:37.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.122 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.122 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1738512877, 2024-01-31T05:13:37.122 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636593, 2024-01-31T05:13:37.122 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_wait.te" 2024-01-31T05:13:37.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.122 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.122 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1741378282, 2024-01-31T05:13:37.122 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637299, 2024-01-31T05:13:37.122 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file" 2024-01-31T05:13:37.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.123 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.123 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1755814900, 2024-01-31T05:13:37.123 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636798, 2024-01-31T05:13:37.123 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrace/selinux_dyntrace_parent.c" 2024-01-31T05:13:37.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.123 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.123 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1761075935, 2024-01-31T05:13:37.123 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636808, 2024-01-31T05:13:37.123 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/Makefile" 2024-01-31T05:13:37.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.123 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.124 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1763209919, 2024-01-31T05:13:37.124 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636838, 2024-01-31T05:13:37.124 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execshare/Makefile" 2024-01-31T05:13:37.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.124 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.124 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1771919030, 2024-01-31T05:13:37.124 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637016, 2024-01-31T05:13:37.124 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite" 2024-01-31T05:13:37.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.124 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.124 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1783374719, 2024-01-31T05:13:37.125 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636552, 2024-01-31T05:13:37.125 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/p9auth/p9unpriv.sh" 2024-01-31T05:13:37.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.125 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.125 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1783490789, 2024-01-31T05:13:37.125 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636855, 2024-01-31T05:13:37.125 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/Makefile.inc" 2024-01-31T05:13:37.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.125 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.125 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1794203135, 2024-01-31T05:13:37.125 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636737, 2024-01-31T05:13:37.126 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_sigkill.te" 2024-01-31T05:13:37.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.126 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.126 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1795272467, 2024-01-31T05:13:37.126 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637302, 2024-01-31T05:13:37.126 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setscheduler" 2024-01-31T05:13:37.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.126 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.126 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1799760386, 2024-01-31T05:13:37.126 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636345, 2024-01-31T05:13:37.126 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/libclone/Makefile" 2024-01-31T05:13:37.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.126 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.127 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1811033828, 2024-01-31T05:13:37.127 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636865, 2024-01-31T05:13:37.127 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/filecapstest.sh" 2024-01-31T05:13:37.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.127 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.127 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1812020701, 2024-01-31T05:13:37.127 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635737, 2024-01-31T05:13:37.127 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-nsec-timestamps/Makefile" 2024-01-31T05:13:37.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.128 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.128 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1815301203, 2024-01-31T05:13:37.128 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636609, 2024-01-31T05:13:37.128 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_task_getsid.te" 2024-01-31T05:13:37.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.128 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.128 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1832843819, 2024-01-31T05:13:37.128 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635792, 2024-01-31T05:13:37.128 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/sem_nstest.c" 2024-01-31T05:13:37.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.129 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.129 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1844759956, 2024-01-31T05:13:37.129 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636761, 2024-01-31T05:13:37.129 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sem/selinux_semop.c" 2024-01-31T05:13:37.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.129 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.129 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1848562297, 2024-01-31T05:13:37.130 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636796, 2024-01-31T05:13:37.130 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setnice/selinux_setnice.sh" 2024-01-31T05:13:37.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.130 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.130 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1857162262, 2024-01-31T05:13:37.130 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636623, 2024-01-31T05:13:37.130 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_ptrace.te" 2024-01-31T05:13:37.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.130 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.130 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1858199077, 2024-01-31T05:13:37.131 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637361, 2024-01-31T05:13:37.131 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/change_password.sh" 2024-01-31T05:13:37.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.131 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.131 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1858264496, 2024-01-31T05:13:37.131 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637297, 2024-01-31T05:13:37.131 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/inherit" 2024-01-31T05:13:37.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.132 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.132 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1878961475, 2024-01-31T05:13:37.132 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635796, 2024-01-31T05:13:37.132 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns/mqns_03.c" 2024-01-31T05:13:37.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.135 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.135 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1897527793, 2024-01-31T05:13:37.136 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636627, 2024-01-31T05:13:37.136 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_capable_sys.te" 2024-01-31T05:13:37.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.136 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.136 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1906756836, 2024-01-31T05:13:37.136 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637289, 2024-01-31T05:13:37.136 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setattr" 2024-01-31T05:13:37.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.136 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.136 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1913093061, 2024-01-31T05:13:37.137 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636581, 2024-01-31T05:13:37.137 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_capable_file.te" 2024-01-31T05:13:37.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.137 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.137 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1926535297, 2024-01-31T05:13:37.137 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636832, 2024-01-31T05:13:37.137 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sigkill/selinux_sigkill.sh" 2024-01-31T05:13:37.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.138 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.138 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1926556748, 2024-01-31T05:13:37.138 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637353, 2024-01-31T05:13:37.138 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/rxdir/selinux_rxdir.sh" 2024-01-31T05:13:37.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.138 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.138 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1930195330, 2024-01-31T05:13:37.138 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637341, 2024-01-31T05:13:37.139 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/link/Makefile" 2024-01-31T05:13:37.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.139 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.139 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1933325429, 2024-01-31T05:13:37.139 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637296, 2024-01-31T05:13:37.139 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execute_no_trans/Makefile" 2024-01-31T05:13:37.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.139 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.140 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1935263233, 2024-01-31T05:13:37.140 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635828, 2024-01-31T05:13:37.140 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/parent_2.sh" 2024-01-31T05:13:37.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.140 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.140 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1944067924, 2024-01-31T05:13:37.140 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636856, 2024-01-31T05:13:37.141 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/ChangeLog" 2024-01-31T05:13:37.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.141 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.141 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1953044467, 2024-01-31T05:13:37.141 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635849, 2024-01-31T05:13:37.141 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/crtchild.c" 2024-01-31T05:13:37.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.141 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.141 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1955830580, 2024-01-31T05:13:37.141 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636557, 2024-01-31T05:13:37.141 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/README" 2024-01-31T05:13:37.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.142 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.142 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1965252990, 2024-01-31T05:13:37.142 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636803, 2024-01-31T05:13:37.142 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/Makefile" 2024-01-31T05:13:37.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.142 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.142 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1966340447, 2024-01-31T05:13:37.142 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636802, 2024-01-31T05:13:37.142 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setpgid/selinux_task_setpgid_source.c" 2024-01-31T05:13:37.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.143 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.143 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1969577858, 2024-01-31T05:13:37.143 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636822, 2024-01-31T05:13:37.143 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/domain_trans/selinux_domain_trans.sh" 2024-01-31T05:13:37.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.143 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.143 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1993182959, 2024-01-31T05:13:37.143 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635818, 2024-01-31T05:13:37.143 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/libclone/libclone.c" 2024-01-31T05:13:37.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.143 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.143 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1993297801, 2024-01-31T05:13:37.144 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636633, 2024-01-31T05:13:37.144 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_bounds.te" 2024-01-31T05:13:37.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.144 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.144 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2002716618, 2024-01-31T05:13:37.144 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635846, 2024-01-31T05:13:37.144 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/rename_net.sh" 2024-01-31T05:13:37.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.144 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.144 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2004921902, 2024-01-31T05:13:37.144 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636561, 2024-01-31T05:13:37.145 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/tests/ima_measurements.sh" 2024-01-31T05:13:37.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.145 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.145 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2008084138, 2024-01-31T05:13:37.145 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637352, 2024-01-31T05:13:37.145 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/rxdir" 2024-01-31T05:13:37.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.145 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.145 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2014799797, 2024-01-31T05:13:37.145 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636560, 2024-01-31T05:13:37.145 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/ima_mmap.c" 2024-01-31T05:13:37.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.146 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.146 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2038461920, 2024-01-31T05:13:37.146 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636843, 2024-01-31T05:13:37.146 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getscheduler/selinux_task_getscheduler_source.c" 2024-01-31T05:13:37.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.146 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.146 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2074910099, 2024-01-31T05:13:37.146 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636739, 2024-01-31T05:13:37.146 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/TODO" 2024-01-31T05:13:37.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.147 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.147 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2103632644, 2024-01-31T05:13:37.147 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636817, 2024-01-31T05:13:37.147 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/open/selinux_open.sh" 2024-01-31T05:13:37.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.147 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.147 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2114279397, 2024-01-31T05:13:37.147 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637116, 2024-01-31T05:13:37.147 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresgid/getresgid02.c" 2024-01-31T05:13:37.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.147 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.148 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2116806696, 2024-01-31T05:13:37.148 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636745, 2024-01-31T05:13:37.148 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_exectrace.te" 2024-01-31T05:13:37.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.148 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.148 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2123802246, 2024-01-31T05:13:37.148 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636628, 2024-01-31T05:13:37.148 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_execshare.te" 2024-01-31T05:13:37.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.148 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.148 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2124832846, 2024-01-31T05:13:37.149 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636773, 2024-01-31T05:13:37.149 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ptrace/Makefile" 2024-01-31T05:13:37.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.149 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.149 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2129128306, 2024-01-31T05:13:37.149 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636549, 2024-01-31T05:13:37.149 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_netlabel.sh" 2024-01-31T05:13:37.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.149 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.149 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2133158920, 2024-01-31T05:13:37.149 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636776, 2024-01-31T05:13:37.149 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_create/selinux_task_create_parent.c" 2024-01-31T05:13:37.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.150 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.150 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2137962706, 2024-01-31T05:13:37.150 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636583, 2024-01-31T05:13:37.150 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_mkdir.te" 2024-01-31T05:13:37.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.150 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.150 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2156043629, 2024-01-31T05:13:37.150 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637004, 2024-01-31T05:13:37.150 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima" 2024-01-31T05:13:37.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.151 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.151 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2158925658, 2024-01-31T05:13:37.151 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636790, 2024-01-31T05:13:37.151 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setscheduler/Makefile" 2024-01-31T05:13:37.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.151 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.151 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2191123063, 2024-01-31T05:13:37.151 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635292, 2024-01-31T05:13:37.151 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-nsec-timestamps/ext4_nsec_timestamps_test.sh" 2024-01-31T05:13:37.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.151 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.151 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2197275699, 2024-01-31T05:13:37.151 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637351, 2024-01-31T05:13:37.152 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/bounds/Makefile" 2024-01-31T05:13:37.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.152 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.152 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2198736398, 2024-01-31T05:13:37.152 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636631, 2024-01-31T05:13:37.152 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_wait.te" 2024-01-31T05:13:37.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.152 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.152 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2221104585, 2024-01-31T05:13:37.152 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636867, 2024-01-31T05:13:37.152 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/README" 2024-01-31T05:13:37.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.153 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.153 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2256546397, 2024-01-31T05:13:37.153 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637311, 2024-01-31T05:13:37.153 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrace/Makefile" 2024-01-31T05:13:37.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.153 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.153 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2276773744, 2024-01-31T05:13:37.153 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636799, 2024-01-31T05:13:37.153 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrace/selinux_dyntrace.sh" 2024-01-31T05:13:37.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.153 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.153 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2281867176, 2024-01-31T05:13:37.154 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637331, 2024-01-31T05:13:37.154 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/wait/selinux_wait_parent.c" 2024-01-31T05:13:37.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.154 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.154 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2291622812, 2024-01-31T05:13:37.154 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636579, 2024-01-31T05:13:37.154 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_ioctl.te" 2024-01-31T05:13:37.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.154 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.154 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2322397910, 2024-01-31T05:13:37.154 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636842, 2024-01-31T05:13:37.154 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getscheduler/selinux_task_getscheduler.sh" 2024-01-31T05:13:37.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.155 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.155 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2323417003, 2024-01-31T05:13:37.155 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636792, 2024-01-31T05:13:37.155 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setscheduler/selinux_task_setscheduler_target.c" 2024-01-31T05:13:37.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.155 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.155 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2349249594, 2024-01-31T05:13:37.155 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636751, 2024-01-31T05:13:37.155 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_task_create.te" 2024-01-31T05:13:37.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.155 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.155 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2349985668, 2024-01-31T05:13:37.156 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636617, 2024-01-31T05:13:37.156 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_ioctl.te" 2024-01-31T05:13:37.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.156 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.156 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2350789191, 2024-01-31T05:13:37.156 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635791, 2024-01-31T05:13:37.156 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/check_ipcns_enabled.c" 2024-01-31T05:13:37.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.156 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.156 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2351169558, 2024-01-31T05:13:37.156 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636812, 2024-01-31T05:13:37.156 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getpgid/Makefile" 2024-01-31T05:13:37.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.157 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.157 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2360596523, 2024-01-31T05:13:37.157 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636554, 2024-01-31T05:13:37.157 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/p9auth/unhex.c" 2024-01-31T05:13:37.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.157 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.157 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2360989667, 2024-01-31T05:13:37.157 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636544, 2024-01-31T05:13:37.157 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_common.sh" 2024-01-31T05:13:37.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.158 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.158 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2362488042, 2024-01-31T05:13:37.158 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636789, 2024-01-31T05:13:37.158 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_nofcntl.c" 2024-01-31T05:13:37.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.158 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.158 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2403826794, 2024-01-31T05:13:37.158 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637356, 2024-01-31T05:13:37.158 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/tomoyo" 2024-01-31T05:13:37.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.158 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.159 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2411799138, 2024-01-31T05:13:37.159 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636625, 2024-01-31T05:13:37.159 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_execute_no_trans.te" 2024-01-31T05:13:37.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.159 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.159 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2421223856, 2024-01-31T05:13:37.159 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637281, 2024-01-31T05:13:37.159 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sem" 2024-01-31T05:13:37.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.159 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.159 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2437451401, 2024-01-31T05:13:37.160 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636827, 2024-01-31T05:13:37.160 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/msg/Makefile" 2024-01-31T05:13:37.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.160 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.160 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2464719725, 2024-01-31T05:13:37.160 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637327, 2024-01-31T05:13:37.160 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sysctl/selinux_sysctl.sh" 2024-01-31T05:13:37.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.160 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.160 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2466627531, 2024-01-31T05:13:37.161 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636848, 2024-01-31T05:13:37.161 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setnice/selinux_task_setnice.sh" 2024-01-31T05:13:37.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.161 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.161 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.161 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2473984858, 2024-01-31T05:13:37.161 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637308, 2024-01-31T05:13:37.161 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/stat" 2024-01-31T05:13:37.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.161 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.161 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.161 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2479243435, 2024-01-31T05:13:37.161 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636872, 2024-01-31T05:13:37.161 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/Makefile" 2024-01-31T05:13:37.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.162 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.162 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.162 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2483459759, 2024-01-31T05:13:37.162 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636787, 2024-01-31T05:13:37.162 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_mprotect.c" 2024-01-31T05:13:37.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.162 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.162 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.162 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2484103566, 2024-01-31T05:13:37.162 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636546, 2024-01-31T05:13:37.162 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/README" 2024-01-31T05:13:37.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.162 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.163 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.163 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2505870062, 2024-01-31T05:13:37.163 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636757, 2024-01-31T05:13:37.163 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_file/selinux_capable_file.sh" 2024-01-31T05:13:37.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.163 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.163 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.163 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2524977372, 2024-01-31T05:13:37.163 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636538, 2024-01-31T05:13:37.163 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_ambient.sh" 2024-01-31T05:13:37.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.163 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.164 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.164 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2541813959, 2024-01-31T05:13:37.164 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636749, 2024-01-31T05:13:37.164 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_capable_net.te" 2024-01-31T05:13:37.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.164 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.164 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.164 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2546641235, 2024-01-31T05:13:37.164 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636742, 2024-01-31T05:13:37.164 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_dyntrans.te" 2024-01-31T05:13:37.165 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.165 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.165 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.165 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2550519138, 2024-01-31T05:13:37.165 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636868, 2024-01-31T05:13:37.165 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/checkforfilecaps.sh" 2024-01-31T05:13:37.165 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.165 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.165 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.165 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2557166141, 2024-01-31T05:13:37.165 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637307, 2024-01-31T05:13:37.165 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setnice/Makefile" 2024-01-31T05:13:37.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.166 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.166 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2563564078, 2024-01-31T05:13:37.166 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636632, 2024-01-31T05:13:37.166 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_entrypoint.te" 2024-01-31T05:13:37.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.166 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.166 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2566659916, 2024-01-31T05:13:37.166 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637325, 2024-01-31T05:13:37.167 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrans/Makefile" 2024-01-31T05:13:37.167 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.167 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.167 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.167 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2586842862, 2024-01-31T05:13:37.167 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637286, 2024-01-31T05:13:37.167 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/rename/Makefile" 2024-01-31T05:13:37.167 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.167 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.167 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.167 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2595201308, 2024-01-31T05:13:37.167 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636805, 2024-01-31T05:13:37.168 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/selinux_raw.c" 2024-01-31T05:13:37.168 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.168 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.168 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.168 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2599582028, 2024-01-31T05:13:37.168 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636791, 2024-01-31T05:13:37.168 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setscheduler/selinux_task_setscheduler.sh" 2024-01-31T05:13:37.168 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.168 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.169 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.169 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2599974278, 2024-01-31T05:13:37.169 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635291, 2024-01-31T05:13:37.169 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-nsec-timestamps/ext4_file_time.c" 2024-01-31T05:13:37.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.169 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.169 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.169 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2603933848, 2024-01-31T05:13:37.169 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636785, 2024-01-31T05:13:37.169 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_lock.c" 2024-01-31T05:13:37.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.169 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.170 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.170 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2607835347, 2024-01-31T05:13:37.170 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635790, 2024-01-31T05:13:37.170 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/Makefile" 2024-01-31T05:13:37.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.170 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.170 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.170 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2618498152, 2024-01-31T05:13:37.170 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637282, 2024-01-31T05:13:37.170 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sem/selinux_semget.c" 2024-01-31T05:13:37.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.171 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.171 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2631601409, 2024-01-31T05:13:37.171 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636576, 2024-01-31T05:13:37.171 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_setnice.te" 2024-01-31T05:13:37.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.171 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.171 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2634059646, 2024-01-31T05:13:37.171 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637318, 2024-01-31T05:13:37.172 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getpgid" 2024-01-31T05:13:37.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.172 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.172 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.172 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2641747508, 2024-01-31T05:13:37.172 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636347, 2024-01-31T05:13:37.172 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/delchild.sh" 2024-01-31T05:13:37.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.172 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.172 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.172 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2650353769, 2024-01-31T05:13:37.172 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636858, 2024-01-31T05:13:37.173 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/tomoyo/testall.sh" 2024-01-31T05:13:37.173 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.173 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.173 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.173 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2655208791, 2024-01-31T05:13:37.173 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636740, 2024-01-31T05:13:37.173 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_relabel.te" 2024-01-31T05:13:37.173 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.173 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.173 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.174 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2657202749, 2024-01-31T05:13:37.174 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637288, 2024-01-31T05:13:37.174 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/exectrace/selinux_exectrace.sh" 2024-01-31T05:13:37.174 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.174 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.174 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.174 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2674686775, 2024-01-31T05:13:37.174 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636806, 2024-01-31T05:13:37.174 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/runtest.sh" 2024-01-31T05:13:37.174 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.174 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.174 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.175 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2699552990, 2024-01-31T05:13:37.175 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637315, 2024-01-31T05:13:37.175 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/selinux_capable_net.sh" 2024-01-31T05:13:37.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.175 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.175 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2712296504, 2024-01-31T05:13:37.175 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636869, 2024-01-31T05:13:37.175 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/inh_capped.c" 2024-01-31T05:13:37.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.176 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.176 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2722085856, 2024-01-31T05:13:37.176 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636833, 2024-01-31T05:13:37.176 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sigkill/selinux_sigkill_server.c" 2024-01-31T05:13:37.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.176 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.176 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2723300346, 2024-01-31T05:13:37.176 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636590, 2024-01-31T05:13:37.176 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_execshare.te" 2024-01-31T05:13:37.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.177 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.177 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2741037383, 2024-01-31T05:13:37.177 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636768, 2024-01-31T05:13:37.177 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/exectrace/Makefile" 2024-01-31T05:13:37.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.177 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.177 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2752571887, 2024-01-31T05:13:37.177 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636574, 2024-01-31T05:13:37.177 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/dummy.c" 2024-01-31T05:13:37.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.178 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.178 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.178 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2753986854, 2024-01-31T05:13:37.178 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637347, 2024-01-31T05:13:37.178 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/fdreceive/Makefile" 2024-01-31T05:13:37.178 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.178 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.178 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.178 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2763245351, 2024-01-31T05:13:37.178 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637340, 2024-01-31T05:13:37.178 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/link" 2024-01-31T05:13:37.178 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.178 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.178 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.178 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2763387413, 2024-01-31T05:13:37.179 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636852, 2024-01-31T05:13:37.179 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getsid/selinux_task_getsid_source.c" 2024-01-31T05:13:37.179 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.179 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.179 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.179 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2774054345, 2024-01-31T05:13:37.179 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635788, 2024-01-31T05:13:37.179 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/runtests_noltp.sh" 2024-01-31T05:13:37.179 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.179 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.179 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.179 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2780892347, 2024-01-31T05:13:37.180 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636342, 2024-01-31T05:13:37.180 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns" 2024-01-31T05:13:37.180 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.180 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.180 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.180 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2807111154, 2024-01-31T05:13:37.180 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636565, 2024-01-31T05:13:37.180 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/tests/ima_setup.sh" 2024-01-31T05:13:37.180 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.180 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.180 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.180 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2807302063, 2024-01-31T05:13:37.181 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635821, 2024-01-31T05:13:37.181 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/parentns.sh" 2024-01-31T05:13:37.181 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.181 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.181 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.181 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2816953258, 2024-01-31T05:13:37.181 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636626, 2024-01-31T05:13:37.181 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_task_getpgid.te" 2024-01-31T05:13:37.181 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.181 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.181 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.181 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2830950026, 2024-01-31T05:13:37.181 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637283, 2024-01-31T05:13:37.182 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/shm" 2024-01-31T05:13:37.182 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.182 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.182 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.182 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2837235077, 2024-01-31T05:13:37.182 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636629, 2024-01-31T05:13:37.182 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_file.te" 2024-01-31T05:13:37.182 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.182 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.182 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.182 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2853508875, 2024-01-31T05:13:37.182 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636610, 2024-01-31T05:13:37.182 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_task_create.te" 2024-01-31T05:13:37.182 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.183 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.183 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.183 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2879012194, 2024-01-31T05:13:37.183 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636619, 2024-01-31T05:13:37.183 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_capable_file.te" 2024-01-31T05:13:37.183 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.183 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.183 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.183 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2881888966, 2024-01-31T05:13:37.183 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635850, 2024-01-31T05:13:37.183 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/ch_ftp.sh" 2024-01-31T05:13:37.183 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.183 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.183 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.183 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2915895689, 2024-01-31T05:13:37.184 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636443, 2024-01-31T05:13:37.184 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/stress/memcg_process_stress.c" 2024-01-31T05:13:37.184 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.184 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.184 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.184 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2928506008, 2024-01-31T05:13:37.184 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637003, 2024-01-31T05:13:37.184 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity" 2024-01-31T05:13:37.184 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.184 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.184 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.184 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2939280511, 2024-01-31T05:13:37.184 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637293, 2024-01-31T05:13:37.185 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_create" 2024-01-31T05:13:37.185 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.185 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.185 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.185 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2939392081, 2024-01-31T05:13:37.185 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636795, 2024-01-31T05:13:37.185 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setnice/selinux_setnice_child.c" 2024-01-31T05:13:37.185 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.185 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.185 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.185 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2945555348, 2024-01-31T05:13:37.185 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637350, 2024-01-31T05:13:37.185 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/bounds" 2024-01-31T05:13:37.185 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.186 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.186 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.186 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2971406775, 2024-01-31T05:13:37.186 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637338, 2024-01-31T05:13:37.186 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ioctl" 2024-01-31T05:13:37.186 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.186 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.186 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.186 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2973556779, 2024-01-31T05:13:37.186 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636584, 2024-01-31T05:13:37.186 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_ptrace.te" 2024-01-31T05:13:37.186 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.186 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.186 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.187 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2982628118, 2024-01-31T05:13:37.187 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637332, 2024-01-31T05:13:37.187 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/readlink" 2024-01-31T05:13:37.187 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.187 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.187 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.187 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2994187761, 2024-01-31T05:13:37.187 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636818, 2024-01-31T05:13:37.187 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/open/selinux_append2write.c" 2024-01-31T05:13:37.187 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.187 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.187 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.187 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3030569023, 2024-01-31T05:13:37.187 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636999, 2024-01-31T05:13:37.188 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack" 2024-01-31T05:13:37.188 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.188 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.188 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.188 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3036892441, 2024-01-31T05:13:37.188 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636804, 2024-01-31T05:13:37.188 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/selinux_bind.c" 2024-01-31T05:13:37.188 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.188 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.188 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.188 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3079757606, 2024-01-31T05:13:37.188 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636759, 2024-01-31T05:13:37.188 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sem/selinux_getinfo.c" 2024-01-31T05:13:37.188 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.189 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.189 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.189 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3084520001, 2024-01-31T05:13:37.189 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637007, 2024-01-31T05:13:37.189 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/Makefile" 2024-01-31T05:13:37.189 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.189 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.189 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.189 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3107793217, 2024-01-31T05:13:37.189 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637138, 2024-01-31T05:13:37.189 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pathconf/pathconf01.c" 2024-01-31T05:13:37.189 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.189 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.189 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.190 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3148967818, 2024-01-31T05:13:37.190 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636826, 2024-01-31T05:13:37.190 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/readlink/selinux_readlink.sh" 2024-01-31T05:13:37.190 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.190 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.190 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3152907690, 2024-01-31T05:13:37.190 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635957, 2024-01-31T05:13:37.190 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/dev_sim_framework/kernel_space/tmod.h" 2024-01-31T05:13:37.190 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.190 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.190 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3153257984, 2024-01-31T05:13:37.190 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636793, 2024-01-31T05:13:37.191 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/mkdir/selinux_mkdir.sh" 2024-01-31T05:13:37.191 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.191 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.191 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.191 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3156794597, 2024-01-31T05:13:37.191 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637301, 2024-01-31T05:13:37.191 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/Makefile" 2024-01-31T05:13:37.191 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.191 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.191 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.191 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3171258783, 2024-01-31T05:13:37.191 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636820, 2024-01-31T05:13:37.191 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrans/selinux_dyntrans.sh" 2024-01-31T05:13:37.191 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.192 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.192 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3173777508, 2024-01-31T05:13:37.192 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637276, 2024-01-31T05:13:37.192 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests" 2024-01-31T05:13:37.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.192 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.192 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3177947792, 2024-01-31T05:13:37.192 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636592, 2024-01-31T05:13:37.192 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/Makefile" 2024-01-31T05:13:37.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.193 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.193 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3191624344, 2024-01-31T05:13:37.193 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636753, 2024-01-31T05:13:37.193 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_inherit.te" 2024-01-31T05:13:37.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.193 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.193 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3207629508, 2024-01-31T05:13:37.193 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635787, 2024-01-31T05:13:37.193 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/shmem_2nstest.c" 2024-01-31T05:13:37.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.193 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.193 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3227607429, 2024-01-31T05:13:37.194 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635960, 2024-01-31T05:13:37.194 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/dev_sim_framework/kernel_space/tmod.mod.c" 2024-01-31T05:13:37.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.194 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.194 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3228800735, 2024-01-31T05:13:37.194 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636816, 2024-01-31T05:13:37.194 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/open/selinux_fopen.c" 2024-01-31T05:13:37.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.194 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.194 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3232237874, 2024-01-31T05:13:37.194 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636786, 2024-01-31T05:13:37.194 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_sigiotask.c" 2024-01-31T05:13:37.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.195 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.195 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.195 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3234446000, 2024-01-31T05:13:37.195 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637284, 2024-01-31T05:13:37.195 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/shm/selinux_shmctl.c" 2024-01-31T05:13:37.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.195 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.195 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.195 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3238161046, 2024-01-31T05:13:37.195 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636857, 2024-01-31T05:13:37.195 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/tomoyo/README" 2024-01-31T05:13:37.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.196 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.196 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3256815966, 2024-01-31T05:13:37.196 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637317, 2024-01-31T05:13:37.196 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_chroot.c" 2024-01-31T05:13:37.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.196 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.196 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3263262623, 2024-01-31T05:13:37.196 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635860, 2024-01-31T05:13:37.196 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/disktest/man1/disktest.1" 2024-01-31T05:13:37.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.196 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.197 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3265161524, 2024-01-31T05:13:37.197 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636777, 2024-01-31T05:13:37.197 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execute_no_trans/selinux_execute_no_trans.sh" 2024-01-31T05:13:37.197 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.197 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.197 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.197 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3272779336, 2024-01-31T05:13:37.197 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636837, 2024-01-31T05:13:37.197 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/link/selinux_link.sh" 2024-01-31T05:13:37.197 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.197 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.197 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.197 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3279399555, 2024-01-31T05:13:37.198 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636346, 2024-01-31T05:13:37.198 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns" 2024-01-31T05:13:37.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.198 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.198 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.198 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3282981060, 2024-01-31T05:13:37.198 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636834, 2024-01-31T05:13:37.198 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ioctl/Makefile" 2024-01-31T05:13:37.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.198 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.198 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.198 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3284448331, 2024-01-31T05:13:37.198 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636775, 2024-01-31T05:13:37.199 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_create/Makefile" 2024-01-31T05:13:37.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.199 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.199 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3290474265, 2024-01-31T05:13:37.199 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636849, 2024-01-31T05:13:37.199 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/bounds/selinux_bounds.sh" 2024-01-31T05:13:37.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.199 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.199 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3293234558, 2024-01-31T05:13:37.199 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636762, 2024-01-31T05:13:37.199 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sem/selinux_semctl.c" 2024-01-31T05:13:37.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.200 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.200 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3310983023, 2024-01-31T05:13:37.200 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636784, 2024-01-31T05:13:37.200 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_seek.c" 2024-01-31T05:13:37.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.200 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.200 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3332352496, 2024-01-31T05:13:37.200 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637280, 2024-01-31T05:13:37.200 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_file/selinux_lease.c" 2024-01-31T05:13:37.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.200 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.201 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3339429834, 2024-01-31T05:13:37.201 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637312, 2024-01-31T05:13:37.201 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setpgid" 2024-01-31T05:13:37.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.201 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.201 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3348483077, 2024-01-31T05:13:37.201 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637014, 2024-01-31T05:13:37.201 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound" 2024-01-31T05:13:37.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.202 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.202 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3356586858, 2024-01-31T05:13:37.202 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636442, 2024-01-31T05:13:37.202 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/stress/Makefile" 2024-01-31T05:13:37.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.202 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.202 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3358053166, 2024-01-31T05:13:37.202 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636618, 2024-01-31T05:13:37.202 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_task_setsched.te" 2024-01-31T05:13:37.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.203 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.203 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.203 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3367775655, 2024-01-31T05:13:37.203 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637018, 2024-01-31T05:13:37.203 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_rename.te" 2024-01-31T05:13:37.203 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.203 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.203 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.203 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3394529778, 2024-01-31T05:13:37.203 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635847, 2024-01-31T05:13:37.203 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/create_container.c" 2024-01-31T05:13:37.204 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.204 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.204 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.204 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3395797290, 2024-01-31T05:13:37.204 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636541, 2024-01-31T05:13:37.204 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_file_access.sh" 2024-01-31T05:13:37.204 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.204 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.204 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.204 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3399212533, 2024-01-31T05:13:37.204 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636846, 2024-01-31T05:13:37.205 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/fdreceive/selinux_fdreceive_client.c" 2024-01-31T05:13:37.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.205 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.205 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3402607518, 2024-01-31T05:13:37.205 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637002, 2024-01-31T05:13:37.205 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/p9auth/p9priv.sh" 2024-01-31T05:13:37.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.205 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.205 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3403983402, 2024-01-31T05:13:37.205 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637278, 2024-01-31T05:13:37.205 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/relabel/Makefile" 2024-01-31T05:13:37.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.206 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.206 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3423513171, 2024-01-31T05:13:37.206 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636616, 2024-01-31T05:13:37.206 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_ipc.te" 2024-01-31T05:13:37.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.206 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.206 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3436284842, 2024-01-31T05:13:37.206 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637349, 2024-01-31T05:13:37.206 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setnice/Makefile" 2024-01-31T05:13:37.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.207 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.207 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3443824401, 2024-01-31T05:13:37.207 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636825, 2024-01-31T05:13:37.207 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/wait/selinux_wait.sh" 2024-01-31T05:13:37.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.207 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.207 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3445623345, 2024-01-31T05:13:37.207 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636830, 2024-01-31T05:13:37.207 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/msg/selinux_msgsnd.c" 2024-01-31T05:13:37.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.207 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.207 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3447472533, 2024-01-31T05:13:37.207 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636559, 2024-01-31T05:13:37.208 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/Makefile" 2024-01-31T05:13:37.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.208 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.208 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3460361093, 2024-01-31T05:13:37.208 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636608, 2024-01-31T05:13:37.208 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_capable_net.te" 2024-01-31T05:13:37.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.208 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.208 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3475452705, 2024-01-31T05:13:37.208 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635797, 2024-01-31T05:13:37.209 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns/Makefile" 2024-01-31T05:13:37.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.209 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.209 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.209 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3480811406, 2024-01-31T05:13:37.209 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636575, 2024-01-31T05:13:37.209 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_task_setpgid.te" 2024-01-31T05:13:37.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.209 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.209 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.210 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3494104678, 2024-01-31T05:13:37.210 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636580, 2024-01-31T05:13:37.210 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_task_setsched.te" 2024-01-31T05:13:37.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.210 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.210 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3499572378, 2024-01-31T05:13:37.210 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636839, 2024-01-31T05:13:37.210 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execshare/selinux_execshare_parent.c" 2024-01-31T05:13:37.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.211 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.211 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3501160387, 2024-01-31T05:13:37.211 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637323, 2024-01-31T05:13:37.211 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/open/Makefile" 2024-01-31T05:13:37.211 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.211 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.211 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3533512423, 2024-01-31T05:13:37.211 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635853, 2024-01-31T05:13:37.212 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/Makefile.inc" 2024-01-31T05:13:37.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.212 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.212 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3547747894, 2024-01-31T05:13:37.212 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636621, 2024-01-31T05:13:37.212 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_policy.if" 2024-01-31T05:13:37.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.213 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.213 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3551132963, 2024-01-31T05:13:37.213 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635799, 2024-01-31T05:13:37.213 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns/mqns.h" 2024-01-31T05:13:37.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.213 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.213 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3562267446, 2024-01-31T05:13:37.213 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637961, 2024-01-31T05:13:37.213 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getpgid/selinux_task_getpgid.sh" 2024-01-31T05:13:37.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.214 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.214 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3568201830, 2024-01-31T05:13:37.214 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637344, 2024-01-31T05:13:37.214 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getscheduler" 2024-01-31T05:13:37.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.214 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.214 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3599719001, 2024-01-31T05:13:37.215 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636811, 2024-01-31T05:13:37.215 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_hostname.c" 2024-01-31T05:13:37.215 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.215 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.215 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.215 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3603418506, 2024-01-31T05:13:37.215 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636582, 2024-01-31T05:13:37.215 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_readlink.te" 2024-01-31T05:13:37.215 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.215 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.216 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.216 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3608170922, 2024-01-31T05:13:37.216 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636335, 2024-01-31T05:13:37.216 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/utsname" 2024-01-31T05:13:37.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.216 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.216 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3628186825, 2024-01-31T05:13:37.216 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636750, 2024-01-31T05:13:37.217 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_task_getsid.te" 2024-01-31T05:13:37.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.217 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.217 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3642417974, 2024-01-31T05:13:37.217 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635789, 2024-01-31T05:13:37.217 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/shmnstest.c" 2024-01-31T05:13:37.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.217 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.218 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3661802596, 2024-01-31T05:13:37.218 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636973, 2024-01-31T05:13:37.218 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/stress/memcg_stress_test.sh" 2024-01-31T05:13:37.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.218 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.218 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3686347945, 2024-01-31T05:13:37.218 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637279, 2024-01-31T05:13:37.218 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_file" 2024-01-31T05:13:37.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.218 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.218 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3688395865, 2024-01-31T05:13:37.219 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637345, 2024-01-31T05:13:37.219 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getscheduler/selinux_task_getscheduler_target.c" 2024-01-31T05:13:37.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.219 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.219 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3694430751, 2024-01-31T05:13:37.219 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637322, 2024-01-31T05:13:37.219 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/open" 2024-01-31T05:13:37.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.219 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.219 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3699308369, 2024-01-31T05:13:37.219 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636605, 2024-01-31T05:13:37.219 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_global.te" 2024-01-31T05:13:37.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.220 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.220 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3702433524, 2024-01-31T05:13:37.220 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636815, 2024-01-31T05:13:37.220 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/entrypoint/Makefile" 2024-01-31T05:13:37.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.220 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.220 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3723222913, 2024-01-31T05:13:37.220 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636571, 2024-01-31T05:13:37.220 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/cap_bset_inh_bounds.c" 2024-01-31T05:13:37.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.221 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.221 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3742890879, 2024-01-31T05:13:37.221 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635824, 2024-01-31T05:13:37.221 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/common.c" 2024-01-31T05:13:37.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.221 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.221 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3744306975, 2024-01-31T05:13:37.221 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636613, 2024-01-31T05:13:37.221 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_task_setpgid.te" 2024-01-31T05:13:37.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.221 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.222 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3773437967, 2024-01-31T05:13:37.222 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637321, 2024-01-31T05:13:37.222 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/entrypoint/selinux_entrypoint.sh" 2024-01-31T05:13:37.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.222 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.222 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3781494494, 2024-01-31T05:13:37.222 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636338, 2024-01-31T05:13:37.222 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc" 2024-01-31T05:13:37.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.222 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.222 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3841383641, 2024-01-31T05:13:37.223 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636597, 2024-01-31T05:13:37.223 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_sigkill.te" 2024-01-31T05:13:37.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.223 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.223 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3842108806, 2024-01-31T05:13:37.223 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637334, 2024-01-31T05:13:37.223 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/msg" 2024-01-31T05:13:37.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.223 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.223 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3845848178, 2024-01-31T05:13:37.223 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637012, 2024-01-31T05:13:37.223 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/Makefile" 2024-01-31T05:13:37.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.224 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.224 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3847948411, 2024-01-31T05:13:37.224 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636829, 2024-01-31T05:13:37.224 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/msg/selinux_msgrcv.c" 2024-01-31T05:13:37.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.224 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.224 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3853030012, 2024-01-31T05:13:37.224 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635838, 2024-01-31T05:13:37.224 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/crtchild_delchild.c" 2024-01-31T05:13:37.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.225 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.225 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3865592136, 2024-01-31T05:13:37.225 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635793, 2024-01-31T05:13:37.225 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/runipcnstest.sh" 2024-01-31T05:13:37.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.225 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.225 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3869658701, 2024-01-31T05:13:37.225 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637285, 2024-01-31T05:13:37.225 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/rename" 2024-01-31T05:13:37.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.226 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.226 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3880842030, 2024-01-31T05:13:37.226 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636341, 2024-01-31T05:13:37.226 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns/runmqnstest.sh" 2024-01-31T05:13:37.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.226 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.226 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3886183172, 2024-01-31T05:13:37.226 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636847, 2024-01-31T05:13:37.226 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setnice/selinux_task_setnice_target.c" 2024-01-31T05:13:37.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.227 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.227 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3896150841, 2024-01-31T05:13:37.227 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635836, 2024-01-31T05:13:37.227 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/child.sh" 2024-01-31T05:13:37.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.227 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.227 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.227 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3905390650, 2024-01-31T05:13:37.227 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635842, 2024-01-31T05:13:37.227 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/par_ftp.sh" 2024-01-31T05:13:37.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.227 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.227 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.227 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3908088095, 2024-01-31T05:13:37.228 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636845, 2024-01-31T05:13:37.228 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/fdreceive/selinux_fdreceive.sh" 2024-01-31T05:13:37.228 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.228 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.228 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3914352761, 2024-01-31T05:13:37.228 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636356, 2024-01-31T05:13:37.228 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/disktest/man1/disktest.1.gz" 2024-01-31T05:13:37.228 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.228 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.228 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3917185640, 2024-01-31T05:13:37.229 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636813, 2024-01-31T05:13:37.229 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getpgid/selinux_task_getpgid_target.c" 2024-01-31T05:13:37.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.229 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.229 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3938999840, 2024-01-31T05:13:37.229 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637357, 2024-01-31T05:13:37.229 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/tomoyo/Makefile" 2024-01-31T05:13:37.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.229 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.229 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3945202303, 2024-01-31T05:13:37.230 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636647, 2024-01-31T05:13:37.230 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/user_space" 2024-01-31T05:13:37.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.230 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.230 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.230 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3952719392, 2024-01-31T05:13:37.230 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636770, 2024-01-31T05:13:37.230 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/exectrace/selinux_exectrace_parent.c" 2024-01-31T05:13:37.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.230 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.230 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.230 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3954287557, 2024-01-31T05:13:37.230 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636788, 2024-01-31T05:13:37.230 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_file.sh" 2024-01-31T05:13:37.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.231 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.231 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3954704266, 2024-01-31T05:13:37.231 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636743, 2024-01-31T05:13:37.231 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_transition.te" 2024-01-31T05:13:37.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.231 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.231 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3965266009, 2024-01-31T05:13:37.231 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637021, 2024-01-31T05:13:37.231 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_rename.te" 2024-01-31T05:13:37.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.232 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.232 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3965283437, 2024-01-31T05:13:37.232 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637013, 2024-01-31T05:13:37.232 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/Makefile" 2024-01-31T05:13:37.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.232 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.232 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3979861341, 2024-01-31T05:13:37.232 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637000, 2024-01-31T05:13:37.232 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_current.sh" 2024-01-31T05:13:37.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.233 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.233 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3986664730, 2024-01-31T05:13:37.233 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637313, 2024-01-31T05:13:37.233 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setpgid/Makefile" 2024-01-31T05:13:37.233 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.233 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.233 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.233 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4033528365, 2024-01-31T05:13:37.233 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635958, 2024-01-31T05:13:37.233 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/dev_sim_framework/kernel_space/str_mod.h" 2024-01-31T05:13:37.233 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.234 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.234 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.234 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4035974762, 2024-01-31T05:13:37.234 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636344, 2024-01-31T05:13:37.234 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/libclone" 2024-01-31T05:13:37.234 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.234 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.234 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.234 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4036981881, 2024-01-31T05:13:37.234 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637290, 2024-01-31T05:13:37.234 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setattr/Makefile" 2024-01-31T05:13:37.234 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.235 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.235 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4038952077, 2024-01-31T05:13:37.235 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637287, 2024-01-31T05:13:37.235 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/exectrace" 2024-01-31T05:13:37.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.235 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.235 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4046242518, 2024-01-31T05:13:37.235 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636612, 2024-01-31T05:13:37.235 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_inherit.te" 2024-01-31T05:13:37.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.236 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.236 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4046549537, 2024-01-31T05:13:37.236 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637329, 2024-01-31T05:13:37.236 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/domain_trans/Makefile" 2024-01-31T05:13:37.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.236 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.236 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.236 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4048331204, 2024-01-31T05:13:37.236 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637755, 2024-01-31T05:13:37.236 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pathconf/Makefile" 2024-01-31T05:13:37.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.236 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.236 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.237 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4053375885, 2024-01-31T05:13:37.237 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636540, 2024-01-31T05:13:37.237 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_direct.sh" 2024-01-31T05:13:37.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.237 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.237 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4053412320, 2024-01-31T05:13:37.237 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636604, 2024-01-31T05:13:37.237 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_exectrace.te" 2024-01-31T05:13:37.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.237 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.237 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4066837958, 2024-01-31T05:13:37.237 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636870, 2024-01-31T05:13:37.238 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/ask_password.sh" 2024-01-31T05:13:37.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.238 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.238 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4067787890, 2024-01-31T05:13:37.238 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636841, 2024-01-31T05:13:37.238 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getscheduler/Makefile" 2024-01-31T05:13:37.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.238 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.238 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4081427595, 2024-01-31T05:13:37.238 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635852, 2024-01-31T05:13:37.239 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/child_propagate.sh" 2024-01-31T05:13:37.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.239 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.239 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4084664635, 2024-01-31T05:13:37.239 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637022, 2024-01-31T05:13:37.239 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat" 2024-01-31T05:13:37.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.239 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.239 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4089874593, 2024-01-31T05:13:37.239 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636781, 2024-01-31T05:13:37.239 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_wait_io.c" 2024-01-31T05:13:37.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.240 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.240 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4099308121, 2024-01-31T05:13:37.240 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637343, 2024-01-31T05:13:37.240 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execshare/selinux_execshare_child.c" 2024-01-31T05:13:37.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.240 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.240 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4129716266, 2024-01-31T05:13:37.240 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635819, 2024-01-31T05:13:37.240 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/libclone/libclone.h" 2024-01-31T05:13:37.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.241 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.241 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4130072899, 2024-01-31T05:13:37.241 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637337, 2024-01-31T05:13:37.241 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sigkill/Makefile" 2024-01-31T05:13:37.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.241 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.241 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4131261482, 2024-01-31T05:13:37.241 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636794, 2024-01-31T05:13:37.242 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setnice/selinux_setnice_parent.c" 2024-01-31T05:13:37.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.242 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.242 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4148338416, 2024-01-31T05:13:37.242 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636862, 2024-01-31T05:13:37.242 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/verify_caps_exec.c" 2024-01-31T05:13:37.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.242 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.242 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4172298542, 2024-01-31T05:13:37.242 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636821, 2024-01-31T05:13:37.243 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sysctl/Makefile" 2024-01-31T05:13:37.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.243 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.243 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4230421804, 2024-01-31T05:13:37.243 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635840, 2024-01-31T05:13:37.243 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/initialize.sh" 2024-01-31T05:13:37.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.243 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.243 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4233637999, 2024-01-31T05:13:37.244 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636875, 2024-01-31T05:13:37.244 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/force_erase.sh" 2024-01-31T05:13:37.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.244 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.244 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4237074154, 2024-01-31T05:13:37.244 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636866, 2024-01-31T05:13:37.244 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/check_simple_capset.c" 2024-01-31T05:13:37.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.244 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.245 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4245620542, 2024-01-31T05:13:37.245 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636648, 2024-01-31T05:13:37.245 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/user_space/user_tdrm.c" 2024-01-31T05:13:37.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.245 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.245 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4252486071, 2024-01-31T05:13:37.245 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637011, 2024-01-31T05:13:37.245 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/tests/ima_policy.sh" 2024-01-31T05:13:37.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.246 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.246 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4260858607, 2024-01-31T05:13:37.246 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636539, 2024-01-31T05:13:37.246 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_onlycap.sh" 2024-01-31T05:13:37.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.246 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.246 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4263732381, 2024-01-31T05:13:37.246 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637355, 2024-01-31T05:13:37.246 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getsid/Makefile" 2024-01-31T05:13:37.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.247 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.247 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4268290947, 2024-01-31T05:13:37.247 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636835, 2024-01-31T05:13:37.247 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ioctl/selinux_noioctl.c" 2024-01-31T05:13:37.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.247 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.247 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4284372442, 2024-01-31T05:13:37.247 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636876, 2024-01-31T05:13:37.247 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/remove_password.sh" 2024-01-31T05:13:37.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.248 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.248 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4289219854, 2024-01-31T05:13:37.248 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636555, 2024-01-31T05:13:37.248 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/policy/measure.policy" 2024-01-31T05:13:37.248 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:13:37.248 INFO:teuthology.orchestra.run.smithi099.stdout:] 2024-01-31T05:13:37.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.025+0000 7faea69c9640 1 -- 172.21.15.99:0/1224112645 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fae880a12e0 msgr2=0x7fae880a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:37.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.025+0000 7faea69c9640 1 --2- 172.21.15.99:0/1224112645 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fae880a12e0 0x7fae880a37a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fae94009710 tx=0x7fae94013880 comp rx=0 tx=0).stop 2024-01-31T05:13:37.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.025+0000 7faea69c9640 1 -- 172.21.15.99:0/1224112645 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faea0106a30 msgr2=0x7faea019e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:37.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.025+0000 7faea69c9640 1 --2- 172.21.15.99:0/1224112645 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faea0106a30 0x7faea019e2f0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fae9800eb10 tx=0x7fae9800c2d0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.025+0000 7faea69c9640 1 -- 172.21.15.99:0/1224112645 shutdown_connections 2024-01-31T05:13:37.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.025+0000 7faea69c9640 1 --2- 172.21.15.99:0/1224112645 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fae880a12e0 0x7fae880a37a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.025+0000 7faea69c9640 1 --2- 172.21.15.99:0/1224112645 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faea0106a30 0x7faea019e2f0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.025+0000 7faea69c9640 1 --2- 172.21.15.99:0/1224112645 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faea0104100 0x7faea0197280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.025+0000 7faea69c9640 1 --2- 172.21.15.99:0/1224112645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faea01017d0 0x7faea0196d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.025+0000 7faea69c9640 1 -- 172.21.15.99:0/1224112645 >> 172.21.15.99:0/1224112645 conn(0x7faea00fb180 msgr2=0x7faea0103660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:37.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.025+0000 7faea69c9640 1 -- 172.21.15.99:0/1224112645 shutdown_connections 2024-01-31T05:13:37.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.025+0000 7faea69c9640 1 -- 172.21.15.99:0/1224112645 wait complete. 2024-01-31T05:13:37.251 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:36 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/938593391' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:13:37.253 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-01-31T05:13:37.254 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:36 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/938593391' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:13:37.254 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:36 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/938593391' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:13:37.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.371+0000 7f9fa14a3640 1 -- 172.21.15.99:0/3940748277 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f9c1017a0 msgr2=0x7f9f9c108030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:37.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.371+0000 7f9fa14a3640 1 --2- 172.21.15.99:0/3940748277 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f9c1017a0 0x7f9f9c108030 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f9f94009ca0 tx=0x7f9f9402c0f0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.371+0000 7f9fa14a3640 1 -- 172.21.15.99:0/3940748277 shutdown_connections 2024-01-31T05:13:37.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.371+0000 7f9fa14a3640 1 --2- 172.21.15.99:0/3940748277 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f9c1017a0 0x7f9f9c108030 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.371+0000 7f9fa14a3640 1 --2- 172.21.15.99:0/3940748277 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f9c100de0 0x7f9f9c101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.371+0000 7f9fa14a3640 1 --2- 172.21.15.99:0/3940748277 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9f9c0ffbf0 0x7f9f9c100010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.371+0000 7f9fa14a3640 1 -- 172.21.15.99:0/3940748277 >> 172.21.15.99:0/3940748277 conn(0x7f9f9c0fb180 msgr2=0x7f9f9c0fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:37.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.371+0000 7f9fa14a3640 1 -- 172.21.15.99:0/3940748277 shutdown_connections 2024-01-31T05:13:37.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.371+0000 7f9fa14a3640 1 -- 172.21.15.99:0/3940748277 wait complete. 2024-01-31T05:13:37.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.371+0000 7f9fa14a3640 1 Processor -- start 2024-01-31T05:13:37.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.372+0000 7f9fa14a3640 1 -- start start 2024-01-31T05:13:37.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.372+0000 7f9fa14a3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f9c0ffbf0 0x7f9f9c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.372+0000 7f9fa14a3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f9c100de0 0x7f9f9c19b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.372+0000 7f9fa14a3640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9f9c1017a0 0x7f9f9c19e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.372+0000 7f9fa14a3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c19e7e0 con 0x7f9f9c0ffbf0 2024-01-31T05:13:37.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.372+0000 7f9fa14a3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c19e950 con 0x7f9f9c100de0 2024-01-31T05:13:37.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.372+0000 7f9fa14a3640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c19eb10 con 0x7f9f9c1017a0 2024-01-31T05:13:37.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.372+0000 7f9f9affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f9c0ffbf0 0x7f9f9c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.372+0000 7f9f9affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f9c0ffbf0 0x7f9f9c0689c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35466/0 (socket says 172.21.15.99:35466) 2024-01-31T05:13:37.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.372+0000 7f9f9affd640 1 -- 172.21.15.99:0/3097577437 learned_addr learned my addr 172.21.15.99:0/3097577437 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:37.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.372+0000 7f9f927fc640 1 --2- 172.21.15.99:0/3097577437 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f9c100de0 0x7f9f9c19b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.372+0000 7f9f9b7fe640 1 --2- 172.21.15.99:0/3097577437 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9f9c1017a0 0x7f9f9c19e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.372+0000 7f9f9affd640 1 -- 172.21.15.99:0/3097577437 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9f9c1017a0 msgr2=0x7f9f9c19e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:37.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.372+0000 7f9f9affd640 1 --2- 172.21.15.99:0/3097577437 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9f9c1017a0 0x7f9f9c19e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.372+0000 7f9f9affd640 1 -- 172.21.15.99:0/3097577437 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f9c100de0 msgr2=0x7f9f9c19b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:37.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.372+0000 7f9f9affd640 1 --2- 172.21.15.99:0/3097577437 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f9c100de0 0x7f9f9c19b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.372+0000 7f9f9affd640 1 -- 172.21.15.99:0/3097577437 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f94009900 con 0x7f9f9c0ffbf0 2024-01-31T05:13:37.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.372+0000 7f9f9affd640 1 --2- 172.21.15.99:0/3097577437 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f9c0ffbf0 0x7f9f9c0689c0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c00c970 tx=0x7f9f8c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:37.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.372+0000 7f9f98ff9640 1 -- 172.21.15.99:0/3097577437 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c004220 con 0x7f9f9c0ffbf0 2024-01-31T05:13:37.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.372+0000 7f9f98ff9640 1 -- 172.21.15.99:0/3097577437 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9f8c007e70 con 0x7f9f9c0ffbf0 2024-01-31T05:13:37.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.372+0000 7f9f98ff9640 1 -- 172.21.15.99:0/3097577437 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c004a00 con 0x7f9f9c0ffbf0 2024-01-31T05:13:37.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.372+0000 7f9fa14a3640 1 -- 172.21.15.99:0/3097577437 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f9c19ed90 con 0x7f9f9c0ffbf0 2024-01-31T05:13:37.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.373+0000 7f9fa14a3640 1 -- 172.21.15.99:0/3097577437 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f9c19f1e0 con 0x7f9f9c0ffbf0 2024-01-31T05:13:37.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.375+0000 7f9f98ff9640 1 -- 172.21.15.99:0/3097577437 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 20) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f9f8c0079b0 con 0x7f9f9c0ffbf0 2024-01-31T05:13:37.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.375+0000 7f9fa426a740 1 Processor -- start 2024-01-31T05:13:37.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.375+0000 7f9fa426a740 1 -- start start 2024-01-31T05:13:37.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.375+0000 7f9fa426a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654af27ef10 0x5654af27f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.375+0000 7f9fa426a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654af27f900 0x5654af284400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.375+0000 7f9fa426a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5654af284a70 0x5654af286f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.375+0000 7f9fa426a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654af1ed240 con 0x5654af284a70 2024-01-31T05:13:37.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.375+0000 7f9fa426a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654af1ea930 con 0x5654af27ef10 2024-01-31T05:13:37.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.375+0000 7f9fa426a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654af1e6220 con 0x5654af27f900 2024-01-31T05:13:37.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.375+0000 7f9f98ff9640 1 --2- 172.21.15.99:0/3097577437 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f9f880a1360 0x7f9f880a3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.375+0000 7f9f927fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5654af284a70 0x5654af286f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.375+0000 7f9f927fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5654af284a70 0x5654af286f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35472/0 (socket says 172.21.15.99:35472) 2024-01-31T05:13:37.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.375+0000 7f9f927fc640 1 -- 172.21.15.99:0/2300202941 learned_addr learned my addr 172.21.15.99:0/2300202941 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:37.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.375+0000 7f9f9b7fe640 1 --2- 172.21.15.99:0/2300202941 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654af27ef10 0x5654af27f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.375+0000 7f9f9b7fe640 1 --2- 172.21.15.99:0/3097577437 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f9f880a1360 0x7f9f880a3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.376+0000 7f9f98ff9640 1 -- 172.21.15.99:0/3097577437 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f9f8c0cc6e0 con 0x7f9f9c0ffbf0 2024-01-31T05:13:37.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.376+0000 7f9f9affd640 1 --2- 172.21.15.99:0/2300202941 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654af27f900 0x5654af284400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.376+0000 7f9f927fc640 1 -- 172.21.15.99:0/2300202941 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654af27f900 msgr2=0x5654af284400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:37.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.376+0000 7f9f927fc640 1 --2- 172.21.15.99:0/2300202941 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654af27f900 0x5654af284400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.376+0000 7f9f927fc640 1 -- 172.21.15.99:0/2300202941 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654af27ef10 msgr2=0x5654af27f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:37.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.376+0000 7f9f927fc640 1 --2- 172.21.15.99:0/2300202941 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654af27ef10 0x5654af27f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.376+0000 7f9f927fc640 1 -- 172.21.15.99:0/2300202941 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654af1a87c0 con 0x5654af284a70 2024-01-31T05:13:37.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.376+0000 7f9f927fc640 1 --2- 172.21.15.99:0/2300202941 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5654af284a70 0x5654af286f00 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f9f84009c90 tx=0x7f9f84011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaddff47fdd05f45 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:37.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.376+0000 7f9f9b7fe640 1 --2- 172.21.15.99:0/3097577437 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f9f880a1360 0x7f9f880a3820 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x5654af280160 tx=0x7f9f9402c0f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:37.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.376+0000 7f9f917fa640 1 -- 172.21.15.99:0/2300202941 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f84019630 con 0x5654af284a70 2024-01-31T05:13:37.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.376+0000 7f9f917fa640 1 -- 172.21.15.99:0/2300202941 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9f84019c50 con 0x5654af284a70 2024-01-31T05:13:37.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.376+0000 7f9f917fa640 1 -- 172.21.15.99:0/2300202941 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8400eaa0 con 0x5654af284a70 2024-01-31T05:13:37.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.377+0000 7f9fa426a740 1 -- 172.21.15.99:0/2300202941 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5654af284a70 msgr2=0x5654af286f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:37.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.377+0000 7f9fa426a740 1 --2- 172.21.15.99:0/2300202941 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5654af284a70 0x5654af286f00 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f9f84009c90 tx=0x7f9f84011810 comp rx=0 tx=0).stop 2024-01-31T05:13:37.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.377+0000 7f9fa426a740 1 -- 172.21.15.99:0/2300202941 shutdown_connections 2024-01-31T05:13:37.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.377+0000 7f9fa426a740 1 --2- 172.21.15.99:0/2300202941 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5654af284a70 0x5654af286f00 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.377+0000 7f9fa426a740 1 --2- 172.21.15.99:0/2300202941 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654af27f900 0x5654af284400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.377+0000 7f9fa426a740 1 --2- 172.21.15.99:0/2300202941 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654af27ef10 0x5654af27f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.377+0000 7f9fa426a740 1 -- 172.21.15.99:0/2300202941 >> 172.21.15.99:0/2300202941 conn(0x5654af27a480 msgr2=0x5654af27a880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:37.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.377+0000 7f9fa426a740 1 -- 172.21.15.99:0/2300202941 shutdown_connections 2024-01-31T05:13:37.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.377+0000 7f9fa426a740 1 -- 172.21.15.99:0/2300202941 wait complete. 2024-01-31T05:13:37.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.377+0000 7f9fa426a740 1 -- start start 2024-01-31T05:13:37.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.377+0000 7f9fa426a740 1 Processor -- start 2024-01-31T05:13:37.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.377+0000 7f9fa426a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5654af27ef10 0x5654af28d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.377+0000 7f9fa426a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654af27f900 0x5654af28da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.377+0000 7f9fa426a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654af284a70 0x5654af294a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.377+0000 7f9fa426a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654af19f5e0 con 0x5654af27ef10 2024-01-31T05:13:37.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.377+0000 7f9fa426a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654af19f280 con 0x5654af27f900 2024-01-31T05:13:37.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.377+0000 7f9fa426a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654af1643d0 con 0x5654af284a70 2024-01-31T05:13:37.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.377+0000 7f9fa426a740 10 client.0 _ll_register_callbacks cb 0x5654af1dceb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:13:37.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.378+0000 7f9f9affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5654af27ef10 0x5654af28d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.378+0000 7f9f9affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5654af27ef10 0x5654af28d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35482/0 (socket says 172.21.15.99:35482) 2024-01-31T05:13:37.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.378+0000 7f9f9affd640 1 -- 172.21.15.99:0/2226101868 learned_addr learned my addr 172.21.15.99:0/2226101868 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:37.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.378+0000 7f9f927fc640 1 --2- 172.21.15.99:0/2226101868 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654af27f900 0x5654af28da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.378+0000 7f9f9b7fe640 1 --2- 172.21.15.99:0/2226101868 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654af284a70 0x5654af294a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.378+0000 7f9f9affd640 1 -- 172.21.15.99:0/2226101868 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654af284a70 msgr2=0x5654af294a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:37.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.378+0000 7f9f9affd640 1 --2- 172.21.15.99:0/2226101868 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654af284a70 0x5654af294a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.378+0000 7f9f9affd640 1 -- 172.21.15.99:0/2226101868 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654af27f900 msgr2=0x5654af28da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:37.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.378+0000 7f9f9affd640 1 --2- 172.21.15.99:0/2226101868 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654af27f900 0x5654af28da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.378+0000 7f9f9affd640 1 -- 172.21.15.99:0/2226101868 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f840098f0 con 0x5654af27ef10 2024-01-31T05:13:37.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.378+0000 7f9f9affd640 1 --2- 172.21.15.99:0/2226101868 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5654af27ef10 0x5654af28d500 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c0058c0 tx=0x7f9f8c004380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c30c8e81ce90ce7e server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:37.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.378+0000 7f9f827fc640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:13:37.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.378+0000 7f9f827fc640 1 -- 172.21.15.99:0/2226101868 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c0b90c0 con 0x5654af27ef10 2024-01-31T05:13:37.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.378+0000 7f9f827fc640 1 -- 172.21.15.99:0/2226101868 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f9f8c0998e0 con 0x5654af27ef10 2024-01-31T05:13:37.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.378+0000 7f9fa426a740 1 -- 172.21.15.99:0/2226101868 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5654af1df0b0 con 0x5654af27ef10 2024-01-31T05:13:37.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.378+0000 7f9f827fc640 1 -- 172.21.15.99:0/2226101868 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f8c09da30 con 0x5654af27ef10 2024-01-31T05:13:37.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.378+0000 7f9fa426a740 10 client.16155 fetch_fsmap learned FSMap version 37 2024-01-31T05:13:37.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.378+0000 7f9fa426a740 1 -- 172.21.15.99:0/2226101868 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x5654af1e48a0 con 0x5654af27ef10 2024-01-31T05:13:37.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.378+0000 7f9f827fc640 1 -- 172.21.15.99:0/2226101868 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5654af1df0b0 con 0x5654af27ef10 2024-01-31T05:13:37.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.378+0000 7f9f827fc640 1 -- 172.21.15.99:0/2226101868 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 37) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f9f8c016030 con 0x5654af27ef10 2024-01-31T05:13:37.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.379+0000 7f9fa426a740 10 client.16155 fetch_fsmap finished waiting for FSMap version 37 2024-01-31T05:13:37.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.379+0000 7f9fa426a740 10 client.16155 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-01-31T05:13:37.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.379+0000 7f9fa426a740 20 client.16155 populate_metadata read hostname 'smithi099' 2024-01-31T05:13:37.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.379+0000 7f9fa426a740 1 --2- 172.21.15.99:0/2226101868 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x5654af299460 0x5654af29b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.379+0000 7f9fa426a740 4 client.16155 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:13:37.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.379+0000 7f9fa426a740 1 -- 172.21.15.99:0/2226101868 --> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5654af1dedd0 con 0x5654af299460 2024-01-31T05:13:37.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.379+0000 7f9f927fc640 1 --2- 172.21.15.99:0/2226101868 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x5654af299460 0x5654af29b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.379+0000 7f9f927fc640 1 --2- 172.21.15.99:0/2226101868 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x5654af299460 0x5654af29b8a0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ba07e1a84ec34038 server_cookie=9576e7590cc3cf95 in_seq=0 out_seq=0 2024-01-31T05:13:37.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.379+0000 7f9f827fc640 10 client.16155 ms_handle_connect on v2:172.21.15.181:6838/996120687 2024-01-31T05:13:37.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.380+0000 7f9f827fc640 1 -- 172.21.15.99:0/2226101868 <== mds.2 v2:172.21.15.181:6838/996120687 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5654af1dedd0 con 0x5654af299460 2024-01-31T05:13:37.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.380+0000 7f9f827fc640 10 client.16155 handle_command_reply: tid=0 2024-01-31T05:13:37.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.380+0000 7f9fa426a740 1 client.16155 shutdown 2024-01-31T05:13:37.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.380+0000 7f9fa426a740 1 -- 172.21.15.99:0/2226101868 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5654af27ef10 msgr2=0x5654af28d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:37.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.380+0000 7f9fa426a740 1 --2- 172.21.15.99:0/2226101868 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5654af27ef10 0x5654af28d500 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c0058c0 tx=0x7f9f8c004380 comp rx=0 tx=0).stop 2024-01-31T05:13:37.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.380+0000 7f9fa426a740 1 -- 172.21.15.99:0/2226101868 shutdown_connections 2024-01-31T05:13:37.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.380+0000 7f9fa426a740 1 --2- 172.21.15.99:0/2226101868 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x5654af299460 0x5654af29b8a0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.380+0000 7f9fa426a740 1 --2- 172.21.15.99:0/2226101868 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654af284a70 0x5654af294a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.380+0000 7f9fa426a740 1 --2- 172.21.15.99:0/2226101868 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654af27f900 0x5654af28da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.380+0000 7f9f827fc640 0 client.16155 ms_handle_reset on v2:172.21.15.181:6838/996120687 2024-01-31T05:13:37.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.380+0000 7f9fa426a740 1 --2- 172.21.15.99:0/2226101868 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5654af27ef10 0x5654af28d500 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.380+0000 7f9fa426a740 1 -- 172.21.15.99:0/2226101868 >> 172.21.15.99:0/2226101868 conn(0x5654af27a480 msgr2=0x5654af2797c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:37.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.380+0000 7f9fa426a740 1 -- 172.21.15.99:0/2226101868 shutdown_connections 2024-01-31T05:13:37.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.380+0000 7f9fa426a740 1 -- 172.21.15.99:0/2226101868 wait complete. 2024-01-31T05:13:37.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.380+0000 7f9fa426a740 20 client.16155 trim_cache size 0 max 16384 2024-01-31T05:13:37.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.393+0000 7f9fa426a740 1 Processor -- start 2024-01-31T05:13:37.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.393+0000 7f9fa426a740 1 -- start start 2024-01-31T05:13:37.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.393+0000 7f9fa426a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654af27ef10 0x5654af27a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.393+0000 7f9fa426a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654af27f900 0x5654af294a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.393+0000 7f9fa426a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5654af284a70 0x5654af28d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.393+0000 7f9fa426a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654af1df0b0 con 0x5654af284a70 2024-01-31T05:13:37.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.393+0000 7f9fa426a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654af27fff0 con 0x5654af27ef10 2024-01-31T05:13:37.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.393+0000 7f9fa426a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654af275f50 con 0x5654af27f900 2024-01-31T05:13:37.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.393+0000 7f9f9b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5654af284a70 0x5654af28d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.393+0000 7f9f9affd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654af27ef10 0x5654af27a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.393+0000 7f9f9b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5654af284a70 0x5654af28d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35498/0 (socket says 172.21.15.99:35498) 2024-01-31T05:13:37.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.393+0000 7f9f9b7fe640 1 -- 172.21.15.99:0/4171034644 learned_addr learned my addr 172.21.15.99:0/4171034644 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:37.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.393+0000 7f9f927fc640 1 --2- 172.21.15.99:0/4171034644 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654af27f900 0x5654af294a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.393+0000 7f9f9affd640 1 -- 172.21.15.99:0/4171034644 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654af27f900 msgr2=0x5654af294a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:37.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.393+0000 7f9f9affd640 1 --2- 172.21.15.99:0/4171034644 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654af27f900 0x5654af294a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.393+0000 7f9f9affd640 1 -- 172.21.15.99:0/4171034644 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5654af284a70 msgr2=0x5654af28d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:37.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.393+0000 7f9f9affd640 1 --2- 172.21.15.99:0/4171034644 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5654af284a70 0x5654af28d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.393+0000 7f9f9affd640 1 -- 172.21.15.99:0/4171034644 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654af1814d0 con 0x5654af27ef10 2024-01-31T05:13:37.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.394+0000 7f9f9b7fe640 1 --2- 172.21.15.99:0/4171034644 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5654af284a70 0x5654af28d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:13:37.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.394+0000 7f9f9affd640 1 --2- 172.21.15.99:0/4171034644 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654af27ef10 0x5654af27a860 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c0ca2f0 tx=0x7f9f8c099420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb0a1333d8c089ca server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:37.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.394+0000 7f9f90ff9640 1 -- 172.21.15.99:0/4171034644 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c0998e0 con 0x5654af27ef10 2024-01-31T05:13:37.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.394+0000 7f9f90ff9640 1 -- 172.21.15.99:0/4171034644 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9f8c09da30 con 0x5654af27ef10 2024-01-31T05:13:37.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.394+0000 7f9f90ff9640 1 -- 172.21.15.99:0/4171034644 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c084280 con 0x5654af27ef10 2024-01-31T05:13:37.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.395+0000 7f9fa426a740 1 -- 172.21.15.99:0/4171034644 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654af27ef10 msgr2=0x5654af27a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:37.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.395+0000 7f9fa426a740 1 --2- 172.21.15.99:0/4171034644 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654af27ef10 0x5654af27a860 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c0ca2f0 tx=0x7f9f8c099420 comp rx=0 tx=0).stop 2024-01-31T05:13:37.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.395+0000 7f9fa426a740 1 -- 172.21.15.99:0/4171034644 shutdown_connections 2024-01-31T05:13:37.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.395+0000 7f9fa426a740 1 --2- 172.21.15.99:0/4171034644 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5654af284a70 0x5654af28d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.395+0000 7f9fa426a740 1 --2- 172.21.15.99:0/4171034644 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654af27f900 0x5654af294a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.395+0000 7f9fa426a740 1 --2- 172.21.15.99:0/4171034644 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654af27ef10 0x5654af27a860 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.395+0000 7f9fa426a740 1 -- 172.21.15.99:0/4171034644 >> 172.21.15.99:0/4171034644 conn(0x5654af27a480 msgr2=0x5654af275650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:37.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.395+0000 7f9fa426a740 1 -- 172.21.15.99:0/4171034644 shutdown_connections 2024-01-31T05:13:37.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.395+0000 7f9fa426a740 1 -- 172.21.15.99:0/4171034644 wait complete. 2024-01-31T05:13:37.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.395+0000 7f9fa426a740 1 -- start start 2024-01-31T05:13:37.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.395+0000 7f9fa426a740 1 Processor -- start 2024-01-31T05:13:37.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.395+0000 7f9fa426a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5654af27ef10 0x5654af294970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.395+0000 7f9fa426a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654af27f900 0x5654af292fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.395+0000 7f9fa426a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654af284a70 0x5654af293510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.395+0000 7f9fa426a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654af293bc0 con 0x5654af27ef10 2024-01-31T05:13:37.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.395+0000 7f9fa426a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654af293d30 con 0x5654af27f900 2024-01-31T05:13:37.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.395+0000 7f9fa426a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654af2ef9b0 con 0x5654af284a70 2024-01-31T05:13:37.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.395+0000 7f9fa426a740 10 client.0 _ll_register_callbacks cb 0x7f9f840097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:13:37.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.395+0000 7f9f9affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5654af27ef10 0x5654af294970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.395+0000 7f9f9affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5654af27ef10 0x5654af294970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35514/0 (socket says 172.21.15.99:35514) 2024-01-31T05:13:37.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.395+0000 7f9f9affd640 1 -- 172.21.15.99:0/94155194 learned_addr learned my addr 172.21.15.99:0/94155194 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:37.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.395+0000 7f9f9b7fe640 1 --2- 172.21.15.99:0/94155194 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654af284a70 0x5654af293510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.395+0000 7f9f927fc640 1 --2- 172.21.15.99:0/94155194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654af27f900 0x5654af292fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.396+0000 7f9f9affd640 1 -- 172.21.15.99:0/94155194 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654af284a70 msgr2=0x5654af293510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:37.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.396+0000 7f9f9affd640 1 --2- 172.21.15.99:0/94155194 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654af284a70 0x5654af293510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.396+0000 7f9f9affd640 1 -- 172.21.15.99:0/94155194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654af27f900 msgr2=0x5654af292fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:37.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.396+0000 7f9f9affd640 1 --2- 172.21.15.99:0/94155194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654af27f900 0x5654af292fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.396+0000 7f9f9affd640 1 -- 172.21.15.99:0/94155194 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f9c108930 con 0x5654af27ef10 2024-01-31T05:13:37.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.396+0000 7f9f9affd640 1 --2- 172.21.15.99:0/94155194 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5654af27ef10 0x5654af294970 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c099870 tx=0x7f9f8c0ca320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5008a23d8d85b6f8 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:37.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.396+0000 7f9f827fc640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:13:37.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.396+0000 7f9f827fc640 1 -- 172.21.15.99:0/94155194 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c0a1c70 con 0x5654af27ef10 2024-01-31T05:13:37.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.396+0000 7f9f827fc640 1 -- 172.21.15.99:0/94155194 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f9f8c0998e0 con 0x5654af27ef10 2024-01-31T05:13:37.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.396+0000 7f9fa426a740 1 -- 172.21.15.99:0/94155194 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9f84019c50 con 0x5654af27ef10 2024-01-31T05:13:37.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.396+0000 7f9f827fc640 1 -- 172.21.15.99:0/94155194 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f8c098840 con 0x5654af27ef10 2024-01-31T05:13:37.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.396+0000 7f9fa426a740 10 client.16161 fetch_fsmap learned FSMap version 37 2024-01-31T05:13:37.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.396+0000 7f9fa426a740 1 -- 172.21.15.99:0/94155194 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x5654af1e48a0 con 0x5654af27ef10 2024-01-31T05:13:37.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.396+0000 7f9f827fc640 1 -- 172.21.15.99:0/94155194 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9f8c0a5080 con 0x5654af27ef10 2024-01-31T05:13:37.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.396+0000 7f9f827fc640 1 -- 172.21.15.99:0/94155194 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 37) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f9f8c016070 con 0x5654af27ef10 2024-01-31T05:13:37.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.396+0000 7f9fa426a740 10 client.16161 fetch_fsmap finished waiting for FSMap version 37 2024-01-31T05:13:37.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.396+0000 7f9fa426a740 10 client.16161 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-01-31T05:13:37.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.396+0000 7f9fa426a740 20 client.16161 populate_metadata read hostname 'smithi099' 2024-01-31T05:13:37.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.396+0000 7f9fa426a740 1 --2- 172.21.15.99:0/94155194 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x5654af2f0f80 0x5654af2f33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.396+0000 7f9fa426a740 4 client.16161 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-01-31T05:13:37.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.396+0000 7f9fa426a740 1 -- 172.21.15.99:0/94155194 --> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5654aeee57e0 con 0x5654af2f0f80 2024-01-31T05:13:37.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.397+0000 7f9f927fc640 1 --2- 172.21.15.99:0/94155194 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x5654af2f0f80 0x5654af2f33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.397+0000 7f9f927fc640 1 --2- 172.21.15.99:0/94155194 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x5654af2f0f80 0x5654af2f33a0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ca9af6e65d26b271 server_cookie=d94b6abbe76e7db9 in_seq=0 out_seq=0 2024-01-31T05:13:37.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.397+0000 7f9f827fc640 10 client.16161 ms_handle_connect on v2:172.21.15.181:6838/996120687 2024-01-31T05:13:37.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.398+0000 7f9f827fc640 1 -- 172.21.15.99:0/94155194 <== mds.2 v2:172.21.15.181:6838/996120687 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+52083 (crc 0 0 0) 0x5654aeee57e0 con 0x5654af2f0f80 2024-01-31T05:13:37.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.398+0000 7f9f827fc640 10 client.16161 handle_command_reply: tid=0 2024-01-31T05:13:37.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.398+0000 7f9fa426a740 1 client.16161 shutdown 2024-01-31T05:13:37.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.398+0000 7f9fa426a740 1 -- 172.21.15.99:0/94155194 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5654af27ef10 msgr2=0x5654af294970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:37.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.398+0000 7f9fa426a740 1 --2- 172.21.15.99:0/94155194 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5654af27ef10 0x5654af294970 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c099870 tx=0x7f9f8c0ca320 comp rx=0 tx=0).stop 2024-01-31T05:13:37.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.398+0000 7f9fa426a740 1 -- 172.21.15.99:0/94155194 shutdown_connections 2024-01-31T05:13:37.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.398+0000 7f9fa426a740 1 --2- 172.21.15.99:0/94155194 >> [v2:172.21.15.181:6838/996120687,v1:172.21.15.181:6839/996120687] conn(0x5654af2f0f80 0x5654af2f33a0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.398+0000 7f9fa426a740 1 --2- 172.21.15.99:0/94155194 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5654af284a70 0x5654af293510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.398+0000 7f9fa426a740 1 --2- 172.21.15.99:0/94155194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654af27f900 0x5654af292fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.398+0000 7f9fa426a740 1 --2- 172.21.15.99:0/94155194 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5654af27ef10 0x5654af294970 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.398+0000 7f9f827fc640 0 client.16161 ms_handle_reset on v2:172.21.15.181:6838/996120687 2024-01-31T05:13:37.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.398+0000 7f9fa426a740 1 -- 172.21.15.99:0/94155194 >> 172.21.15.99:0/94155194 conn(0x5654af27a480 msgr2=0x5654af27a860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:37.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.398+0000 7f9fa426a740 1 -- 172.21.15.99:0/94155194 shutdown_connections 2024-01-31T05:13:37.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.398+0000 7f9fa426a740 1 -- 172.21.15.99:0/94155194 wait complete. 2024-01-31T05:13:37.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.399+0000 7f9fa426a740 20 client.16161 trim_cache size 0 max 16384 2024-01-31T05:13:37.407 INFO:teuthology.orchestra.run.smithi099.stdout:[ 2024-01-31T05:13:37.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.407 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.407 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 9155645, 2024-01-31T05:13:37.407 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636281, 2024-01-31T05:13:37.408 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_load_balance_test/cpuset_load_balance_test.sh" 2024-01-31T05:13:37.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.408 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.408 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 28763760, 2024-01-31T05:13:37.408 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636424, 2024-01-31T05:13:37.408 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/README" 2024-01-31T05:13:37.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.408 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.408 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 52690954, 2024-01-31T05:13:37.408 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636702, 2024-01-31T05:13:37.408 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_pressure_test/Makefile" 2024-01-31T05:13:37.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.409 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.409 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 59501054, 2024-01-31T05:13:37.409 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636308, 2024-01-31T05:13:37.409 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_6_2.c" 2024-01-31T05:13:37.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.409 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.409 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 134085551, 2024-01-31T05:13:37.409 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637824, 2024-01-31T05:13:37.409 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigsuspend/Makefile" 2024-01-31T05:13:37.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.410 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.410 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 145534572, 2024-01-31T05:13:37.410 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636455, 2024-01-31T05:13:37.410 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/timed_forkbomb.c" 2024-01-31T05:13:37.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.410 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.410 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 188826742, 2024-01-31T05:13:37.410 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636282, 2024-01-31T05:13:37.410 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_load_balance_test/Makefile" 2024-01-31T05:13:37.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.410 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.411 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 192881911, 2024-01-31T05:13:37.411 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636317, 2024-01-31T05:13:37.411 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_def_task04.c" 2024-01-31T05:13:37.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.411 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.411 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 243589652, 2024-01-31T05:13:37.411 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636287, 2024-01-31T05:13:37.411 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_spread_test/cpuset_memory_spread_testset.sh" 2024-01-31T05:13:37.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.411 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.411 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 244495233, 2024-01-31T05:13:37.411 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636976, 2024-01-31T05:13:37.412 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/libcontrollers" 2024-01-31T05:13:37.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.412 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.412 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 257190611, 2024-01-31T05:13:37.412 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636681, 2024-01-31T05:13:37.412 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset" 2024-01-31T05:13:37.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.412 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.412 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 257281380, 2024-01-31T05:13:37.412 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636412, 2024-01-31T05:13:37.412 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/README" 2024-01-31T05:13:37.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.413 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.413 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 262671240, 2024-01-31T05:13:37.413 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636708, 2024-01-31T05:13:37.413 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_9_2.sh" 2024-01-31T05:13:37.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.413 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.413 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 264726019, 2024-01-31T05:13:37.413 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636705, 2024-01-31T05:13:37.413 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl_fj" 2024-01-31T05:13:37.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.414 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.414 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 303411693, 2024-01-31T05:13:37.414 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636305, 2024-01-31T05:13:37.414 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_3_1.sh" 2024-01-31T05:13:37.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.414 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.414 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 310717533, 2024-01-31T05:13:37.414 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636261, 2024-01-31T05:13:37.414 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memctl/Makefile" 2024-01-31T05:13:37.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.414 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.414 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 335185741, 2024-01-31T05:13:37.415 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636415, 2024-01-31T05:13:37.415 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_def_task02.c" 2024-01-31T05:13:37.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.415 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.415 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 381550333, 2024-01-31T05:13:37.415 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636683, 2024-01-31T05:13:37.415 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/cpuinfo.c" 2024-01-31T05:13:37.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.415 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.415 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 382049010, 2024-01-31T05:13:37.415 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636431, 2024-01-31T05:13:37.415 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuacct/README" 2024-01-31T05:13:37.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.416 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.416 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 398214186, 2024-01-31T05:13:37.416 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636291, 2024-01-31T05:13:37.416 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_funcs.sh" 2024-01-31T05:13:37.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.416 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.416 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 422830809, 2024-01-31T05:13:37.416 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636960, 2024-01-31T05:13:37.416 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl" 2024-01-31T05:13:37.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.416 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.417 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 466401206, 2024-01-31T05:13:37.417 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636315, 2024-01-31T05:13:37.417 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_latency_test.c" 2024-01-31T05:13:37.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.417 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.417 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 522082972, 2024-01-31T05:13:37.417 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636470, 2024-01-31T05:13:37.417 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/run_io_throttle_test.sh" 2024-01-31T05:13:37.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.417 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.417 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 552413583, 2024-01-31T05:13:37.417 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636429, 2024-01-31T05:13:37.418 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuacct/cpuacct_task01.c" 2024-01-31T05:13:37.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.418 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.418 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 552795140, 2024-01-31T05:13:37.418 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636243, 2024-01-31T05:13:37.418 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/acpi/Makefile" 2024-01-31T05:13:37.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.418 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.418 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 600182973, 2024-01-31T05:13:37.418 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635451, 2024-01-31T05:13:37.418 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/quota_remount/Makefile" 2024-01-31T05:13:37.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.419 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.419 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 619646016, 2024-01-31T05:13:37.419 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636288, 2024-01-31T05:13:37.419 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_hierarchy_test/Makefile" 2024-01-31T05:13:37.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.419 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.419 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 636456874, 2024-01-31T05:13:37.419 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636469, 2024-01-31T05:13:37.419 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/Makefile" 2024-01-31T05:13:37.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.419 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.420 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 681890558, 2024-01-31T05:13:37.420 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636284, 2024-01-31T05:13:37.420 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/README" 2024-01-31T05:13:37.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.420 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.420 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 705995134, 2024-01-31T05:13:37.420 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636425, 2024-01-31T05:13:37.420 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/cgroup_fj_proc.c" 2024-01-31T05:13:37.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.420 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.420 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 762934855, 2024-01-31T05:13:37.421 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636441, 2024-01-31T05:13:37.421 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/README" 2024-01-31T05:13:37.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.421 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.421 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 782269982, 2024-01-31T05:13:37.421 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636878, 2024-01-31T05:13:37.421 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/waitid/Makefile" 2024-01-31T05:13:37.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.421 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.421 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 794186725, 2024-01-31T05:13:37.421 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636290, 2024-01-31T05:13:37.422 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/run_cpuset_test.sh" 2024-01-31T05:13:37.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.422 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.422 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 815036105, 2024-01-31T05:13:37.422 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636267, 2024-01-31T05:13:37.422 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/bitmask.h" 2024-01-31T05:13:37.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.422 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.422 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 825593937, 2024-01-31T05:13:37.422 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636413, 2024-01-31T05:13:37.422 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/run_cpuctl_stress_test.sh" 2024-01-31T05:13:37.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.423 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.423 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 828176468, 2024-01-31T05:13:37.423 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636263, 2024-01-31T05:13:37.423 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memctl/memctl_testplan.txt" 2024-01-31T05:13:37.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.423 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.423 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 861869162, 2024-01-31T05:13:37.423 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636682, 2024-01-31T05:13:37.423 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib" 2024-01-31T05:13:37.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.423 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.424 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 873729449, 2024-01-31T05:13:37.424 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636700, 2024-01-31T05:13:37.424 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_inherit_test/Makefile" 2024-01-31T05:13:37.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.424 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.424 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 907334921, 2024-01-31T05:13:37.424 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636264, 2024-01-31T05:13:37.424 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memctl/run_memctl_test.sh" 2024-01-31T05:13:37.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.424 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.424 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 920180932, 2024-01-31T05:13:37.424 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636458, 2024-01-31T05:13:37.425 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/stop_freeze_sleep_thaw_cont.sh" 2024-01-31T05:13:37.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.425 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.425 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 921825565, 2024-01-31T05:13:37.425 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636266, 2024-01-31T05:13:37.425 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/Makefile" 2024-01-31T05:13:37.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.425 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.425 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 928111540, 2024-01-31T05:13:37.425 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636421, 2024-01-31T05:13:37.425 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/Makefile" 2024-01-31T05:13:37.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.426 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.426 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 930406090, 2024-01-31T05:13:37.426 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636277, 2024-01-31T05:13:37.426 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_syscall_test/cpuset_syscall_testset.sh" 2024-01-31T05:13:37.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.426 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.426 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 947977905, 2024-01-31T05:13:37.426 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636454, 2024-01-31T05:13:37.426 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/freeze_sleep_thaw.sh" 2024-01-31T05:13:37.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.427 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.427 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 951098816, 2024-01-31T05:13:37.427 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636685, 2024-01-31T05:13:37.427 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_syscall_test/Makefile" 2024-01-31T05:13:37.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.427 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.427 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 977213141, 2024-01-31T05:13:37.427 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636461, 2024-01-31T05:13:37.427 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/freeze_thaw.sh" 2024-01-31T05:13:37.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.428 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.428 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 978318482, 2024-01-31T05:13:37.428 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636970, 2024-01-31T05:13:37.428 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/functional" 2024-01-31T05:13:37.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.428 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.428 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 985617233, 2024-01-31T05:13:37.428 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636439, 2024-01-31T05:13:37.428 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/functional/memcg_getpagesize.c" 2024-01-31T05:13:37.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.429 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.429 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 991971078, 2024-01-31T05:13:37.429 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636692, 2024-01-31T05:13:37.429 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_exclusive_test/cpuset_exclusive_test.sh" 2024-01-31T05:13:37.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.429 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.429 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1003589963, 2024-01-31T05:13:37.430 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636963, 2024-01-31T05:13:37.430 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/run_cgroup_test_fj.sh" 2024-01-31T05:13:37.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.430 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.430 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1007897995, 2024-01-31T05:13:37.430 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636462, 2024-01-31T05:13:37.430 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/libcgroup_freezer" 2024-01-31T05:13:37.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.430 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.430 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1037060886, 2024-01-31T05:13:37.431 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636473, 2024-01-31T05:13:37.431 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/iobw.c" 2024-01-31T05:13:37.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.431 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.431 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1038603051, 2024-01-31T05:13:37.431 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636292, 2024-01-31T05:13:37.431 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_inherit_test/cpuset_inherit_testset.sh" 2024-01-31T05:13:37.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.431 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.432 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1064353843, 2024-01-31T05:13:37.432 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636472, 2024-01-31T05:13:37.432 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/myfunctions-io.sh" 2024-01-31T05:13:37.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.432 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.432 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1075070401, 2024-01-31T05:13:37.432 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636426, 2024-01-31T05:13:37.432 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/cgroup_fj_function2.sh" 2024-01-31T05:13:37.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.432 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.433 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1080579831, 2024-01-31T05:13:37.433 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636423, 2024-01-31T05:13:37.433 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/cgroup_fj_testcases" 2024-01-31T05:13:37.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.433 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.433 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1082235695, 2024-01-31T05:13:37.433 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636706, 2024-01-31T05:13:37.433 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl_fj/cpuctl_fj_simple_echo.c" 2024-01-31T05:13:37.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.433 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.434 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1087020526, 2024-01-31T05:13:37.434 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636417, 2024-01-31T05:13:37.434 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/README" 2024-01-31T05:13:37.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.434 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.434 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1108653475, 2024-01-31T05:13:37.434 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636414, 2024-01-31T05:13:37.434 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_latency_check_task.c" 2024-01-31T05:13:37.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.435 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.435 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1115946697, 2024-01-31T05:13:37.435 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636430, 2024-01-31T05:13:37.435 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuacct/Makefile" 2024-01-31T05:13:37.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.435 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.435 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1125023043, 2024-01-31T05:13:37.435 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637175, 2024-01-31T05:13:37.435 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/exit_group/Makefile" 2024-01-31T05:13:37.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.436 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.436 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1258450411, 2024-01-31T05:13:37.436 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636979, 2024-01-31T05:13:37.436 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/io_throttle_testplan.txt" 2024-01-31T05:13:37.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.436 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.436 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1320652921, 2024-01-31T05:13:37.436 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636966, 2024-01-31T05:13:37.436 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg" 2024-01-31T05:13:37.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.437 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.437 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1332067593, 2024-01-31T05:13:37.437 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636416, 2024-01-31T05:13:37.437 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_def_task01.c" 2024-01-31T05:13:37.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.437 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.437 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1375823048, 2024-01-31T05:13:37.437 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636304, 2024-01-31T05:13:37.437 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_3_2.sh" 2024-01-31T05:13:37.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.438 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.438 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1390313570, 2024-01-31T05:13:37.438 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636465, 2024-01-31T05:13:37.438 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/freeze_kill_thaw.sh" 2024-01-31T05:13:37.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.438 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.438 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1447516868, 2024-01-31T05:13:37.438 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636693, 2024-01-31T05:13:37.438 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_spread_test" 2024-01-31T05:13:37.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.439 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.439 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1465305986, 2024-01-31T05:13:37.439 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636471, 2024-01-31T05:13:37.439 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/README" 2024-01-31T05:13:37.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.439 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.439 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1490776051, 2024-01-31T05:13:37.439 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636460, 2024-01-31T05:13:37.439 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/fork_exec_loop.c" 2024-01-31T05:13:37.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.439 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.440 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1582681261, 2024-01-31T05:13:37.440 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636448, 2024-01-31T05:13:37.440 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/freeze_move_thaw.sh" 2024-01-31T05:13:37.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.440 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.440 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1599729861, 2024-01-31T05:13:37.440 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636686, 2024-01-31T05:13:37.440 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_hotplug_test" 2024-01-31T05:13:37.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.440 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.440 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1714697047, 2024-01-31T05:13:37.440 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636272, 2024-01-31T05:13:37.441 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/libbitmask.c" 2024-01-31T05:13:37.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.441 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.441 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1784086811, 2024-01-31T05:13:37.441 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636459, 2024-01-31T05:13:37.441 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/freeze_self_thaw.sh" 2024-01-31T05:13:37.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.441 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.441 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1838119887, 2024-01-31T05:13:37.441 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636306, 2024-01-31T05:13:37.442 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/Makefile" 2024-01-31T05:13:37.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.442 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.442 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1863567726, 2024-01-31T05:13:37.442 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636280, 2024-01-31T05:13:37.442 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_load_balance_test/cpuset_sched_domains_test.sh" 2024-01-31T05:13:37.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.442 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.443 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1865085299, 2024-01-31T05:13:37.443 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636962, 2024-01-31T05:13:37.443 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj" 2024-01-31T05:13:37.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.443 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.443 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1866644731, 2024-01-31T05:13:37.443 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636432, 2024-01-31T05:13:37.443 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuacct/cpuacct_testplan.txt" 2024-01-31T05:13:37.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.444 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.444 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1882901764, 2024-01-31T05:13:37.444 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636433, 2024-01-31T05:13:37.444 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/regression/memcg_test_4.sh" 2024-01-31T05:13:37.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.444 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.444 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1892249745, 2024-01-31T05:13:37.444 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636031, 2024-01-31T05:13:37.444 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/quota_remount/quota_remount_test01.sh" 2024-01-31T05:13:37.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.445 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.445 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1909728326, 2024-01-31T05:13:37.445 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636690, 2024-01-31T05:13:37.445 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_load_balance_test/cpuset_sched_domains_check.c" 2024-01-31T05:13:37.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.445 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.445 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1918746553, 2024-01-31T05:13:37.445 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636679, 2024-01-31T05:13:37.445 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memctl" 2024-01-31T05:13:37.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.445 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.445 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1971645311, 2024-01-31T05:13:37.446 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636453, 2024-01-31T05:13:37.446 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/Makefile" 2024-01-31T05:13:37.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.446 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.446 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1991087207, 2024-01-31T05:13:37.446 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636309, 2024-01-31T05:13:37.446 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/README" 2024-01-31T05:13:37.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.446 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.446 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1993440907, 2024-01-31T05:13:37.446 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636699, 2024-01-31T05:13:37.446 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_inherit_test" 2024-01-31T05:13:37.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.447 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.447 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2009447856, 2024-01-31T05:13:37.447 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636299, 2024-01-31T05:13:37.447 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl_fj/Makefile" 2024-01-31T05:13:37.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.447 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.447 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2050346341, 2024-01-31T05:13:37.447 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636463, 2024-01-31T05:13:37.447 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/vfork_freeze.sh" 2024-01-31T05:13:37.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.447 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.448 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2069809941, 2024-01-31T05:13:37.448 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636446, 2024-01-31T05:13:37.448 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/00_description.txt" 2024-01-31T05:13:37.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.448 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.448 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2087244977, 2024-01-31T05:13:37.448 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636316, 2024-01-31T05:13:37.448 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/parameters.sh" 2024-01-31T05:13:37.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.448 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.448 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2146724123, 2024-01-31T05:13:37.449 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636704, 2024-01-31T05:13:37.449 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_test/Makefile" 2024-01-31T05:13:37.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.449 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.449 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2148016376, 2024-01-31T05:13:37.449 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636662, 2024-01-31T05:13:37.449 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/acpi/LtpAcpi.h" 2024-01-31T05:13:37.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.449 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.449 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2159213867, 2024-01-31T05:13:37.449 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636268, 2024-01-31T05:13:37.449 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/libcpuset.c" 2024-01-31T05:13:37.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.450 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.450 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2163400128, 2024-01-31T05:13:37.450 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636311, 2024-01-31T05:13:37.450 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_10_2.sh" 2024-01-31T05:13:37.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.450 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.450 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2197245130, 2024-01-31T05:13:37.450 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636296, 2024-01-31T05:13:37.450 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_test/cpuset_memory_testset.sh" 2024-01-31T05:13:37.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.450 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.451 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2200674756, 2024-01-31T05:13:37.451 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636972, 2024-01-31T05:13:37.451 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/stress" 2024-01-31T05:13:37.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.451 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.451 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2248001689, 2024-01-31T05:13:37.451 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636303, 2024-01-31T05:13:37.451 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/fork_processes.c" 2024-01-31T05:13:37.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.451 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.451 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2255962387, 2024-01-31T05:13:37.451 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636437, 2024-01-31T05:13:37.451 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/regression/memcg_test_1.c" 2024-01-31T05:13:37.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.452 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.452 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2266245235, 2024-01-31T05:13:37.452 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636687, 2024-01-31T05:13:37.452 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_hotplug_test/Makefile" 2024-01-31T05:13:37.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.452 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.452 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2272690476, 2024-01-31T05:13:37.452 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636438, 2024-01-31T05:13:37.452 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/functional/Makefile" 2024-01-31T05:13:37.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.453 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.453 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2291880093, 2024-01-31T05:13:37.453 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636418, 2024-01-31T05:13:37.453 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/cgroup_fj_stress.sh" 2024-01-31T05:13:37.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.453 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.453 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2313389239, 2024-01-31T05:13:37.453 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636408, 2024-01-31T05:13:37.453 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_def_task03.c" 2024-01-31T05:13:37.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.453 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.453 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2313494513, 2024-01-31T05:13:37.454 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636410, 2024-01-31T05:13:37.454 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/run_cpuctl_test.sh" 2024-01-31T05:13:37.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.454 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.454 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2316158661, 2024-01-31T05:13:37.454 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636428, 2024-01-31T05:13:37.454 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuacct/run_cpuacct_test.sh" 2024-01-31T05:13:37.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.454 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.454 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2388103535, 2024-01-31T05:13:37.454 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636978, 2024-01-31T05:13:37.454 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle" 2024-01-31T05:13:37.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.455 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.455 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2417059810, 2024-01-31T05:13:37.455 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636314, 2024-01-31T05:13:37.455 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/cgroup_regression_test.sh" 2024-01-31T05:13:37.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.455 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.455 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2455496604, 2024-01-31T05:13:37.455 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636245, 2024-01-31T05:13:37.455 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/acpi/README" 2024-01-31T05:13:37.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.455 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.455 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2512945374, 2024-01-31T05:13:37.456 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636694, 2024-01-31T05:13:37.456 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_spread_test/Makefile" 2024-01-31T05:13:37.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.456 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.456 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2515151758, 2024-01-31T05:13:37.456 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636269, 2024-01-31T05:13:37.456 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/cpuinfo.h" 2024-01-31T05:13:37.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.456 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.456 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2579449390, 2024-01-31T05:13:37.456 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636310, 2024-01-31T05:13:37.457 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_6_1.sh" 2024-01-31T05:13:37.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.457 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.457 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2584084537, 2024-01-31T05:13:37.457 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637227, 2024-01-31T05:13:37.457 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigsuspend/sigsuspend01.c" 2024-01-31T05:13:37.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.457 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.457 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2595898868, 2024-01-31T05:13:37.457 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636684, 2024-01-31T05:13:37.457 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_syscall_test" 2024-01-31T05:13:37.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.458 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.458 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2605918473, 2024-01-31T05:13:37.458 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636273, 2024-01-31T05:13:37.458 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/common.h" 2024-01-31T05:13:37.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.458 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.458 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2617400037, 2024-01-31T05:13:37.458 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636696, 2024-01-31T05:13:37.458 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_hierarchy_test/cpuset_hierarchy_test.sh" 2024-01-31T05:13:37.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.458 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.459 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2630978404, 2024-01-31T05:13:37.459 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636293, 2024-01-31T05:13:37.459 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_pressure_test/cpuset_memory_pressure_testset.sh" 2024-01-31T05:13:37.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.459 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.459 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2675270843, 2024-01-31T05:13:37.459 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636468, 2024-01-31T05:13:37.459 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/libcontrollers/Makefile" 2024-01-31T05:13:37.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.459 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.459 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2678044541, 2024-01-31T05:13:37.459 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636452, 2024-01-31T05:13:37.459 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/libltp" 2024-01-31T05:13:37.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.460 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.460 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2728839120, 2024-01-31T05:13:37.460 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636701, 2024-01-31T05:13:37.460 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_pressure_test" 2024-01-31T05:13:37.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.460 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.460 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2735784760, 2024-01-31T05:13:37.460 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636286, 2024-01-31T05:13:37.460 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_spread_test/cpuset_mem_hog.c" 2024-01-31T05:13:37.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.461 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.461 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2772613512, 2024-01-31T05:13:37.461 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636313, 2024-01-31T05:13:37.461 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/getdelays.c" 2024-01-31T05:13:37.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.461 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.461 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2774346697, 2024-01-31T05:13:37.461 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636974, 2024-01-31T05:13:37.461 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer" 2024-01-31T05:13:37.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.461 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.462 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2780158651, 2024-01-31T05:13:37.462 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637364, 2024-01-31T05:13:37.462 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/waitid/waitid01.c" 2024-01-31T05:13:37.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.462 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.462 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2814712864, 2024-01-31T05:13:37.462 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636697, 2024-01-31T05:13:37.462 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_base_ops_test" 2024-01-31T05:13:37.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.462 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.462 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2821562977, 2024-01-31T05:13:37.463 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636975, 2024-01-31T05:13:37.463 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/COPYING" 2024-01-31T05:13:37.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.463 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.463 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2832182673, 2024-01-31T05:13:37.463 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636436, 2024-01-31T05:13:37.463 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/regression/memcg_test_2.c" 2024-01-31T05:13:37.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.463 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.463 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2886723062, 2024-01-31T05:13:37.463 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636449, 2024-01-31T05:13:37.463 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/write_freezing.sh" 2024-01-31T05:13:37.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.464 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.464 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2891139515, 2024-01-31T05:13:37.464 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636244, 2024-01-31T05:13:37.464 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/acpi/LtpAcpiCmds.c" 2024-01-31T05:13:37.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.464 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.464 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2909393032, 2024-01-31T05:13:37.464 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636270, 2024-01-31T05:13:37.464 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/cpuset_funcs.sh" 2024-01-31T05:13:37.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.464 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.464 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2929818425, 2024-01-31T05:13:37.464 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636466, 2024-01-31T05:13:37.465 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/freeze_write_freezing.sh" 2024-01-31T05:13:37.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.465 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.465 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2931764397, 2024-01-31T05:13:37.465 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636689, 2024-01-31T05:13:37.465 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_load_balance_test" 2024-01-31T05:13:37.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.465 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.465 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2987646244, 2024-01-31T05:13:37.465 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636427, 2024-01-31T05:13:37.465 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/test_controllers.sh" 2024-01-31T05:13:37.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.466 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.466 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3006745939, 2024-01-31T05:13:37.466 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636971, 2024-01-31T05:13:37.466 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/functional/memcg_process.c" 2024-01-31T05:13:37.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.466 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.466 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3057719988, 2024-01-31T05:13:37.467 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636271, 2024-01-31T05:13:37.467 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/meminfo.h" 2024-01-31T05:13:37.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.467 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.467 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3067600316, 2024-01-31T05:13:37.467 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636467, 2024-01-31T05:13:37.467 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/libcontrollers/libcontrollers.h" 2024-01-31T05:13:37.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.467 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.467 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3083358164, 2024-01-31T05:13:37.467 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636695, 2024-01-31T05:13:37.468 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_hierarchy_test" 2024-01-31T05:13:37.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.468 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.468 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3099028012, 2024-01-31T05:13:37.468 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636967, 2024-01-31T05:13:37.468 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/regression" 2024-01-31T05:13:37.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.469 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.469 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3214529145, 2024-01-31T05:13:37.469 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636445, 2024-01-31T05:13:37.469 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/vfork.c" 2024-01-31T05:13:37.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.469 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.469 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3216363674, 2024-01-31T05:13:37.469 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636420, 2024-01-31T05:13:37.469 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/cgroup_fj_utility.sh" 2024-01-31T05:13:37.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.470 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.470 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3221108789, 2024-01-31T05:13:37.470 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636242, 2024-01-31T05:13:37.470 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/acpi/LtpAcpiMain.c" 2024-01-31T05:13:37.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.470 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.470 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3238196576, 2024-01-31T05:13:37.470 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636276, 2024-01-31T05:13:37.471 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_syscall_test/cpuset_syscall_test.c" 2024-01-31T05:13:37.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.471 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.471 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3238400800, 2024-01-31T05:13:37.471 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636440, 2024-01-31T05:13:37.471 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/functional/memcg_function_test.sh" 2024-01-31T05:13:37.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.471 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.471 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3240394607, 2024-01-31T05:13:37.471 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636405, 2024-01-31T05:13:37.471 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_test02.c" 2024-01-31T05:13:37.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.472 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.472 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3263329392, 2024-01-31T05:13:37.472 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636447, 2024-01-31T05:13:37.472 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/CHANGELOG" 2024-01-31T05:13:37.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.472 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.473 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3264298616, 2024-01-31T05:13:37.473 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636968, 2024-01-31T05:13:37.473 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/regression/memcg_test_4.c" 2024-01-31T05:13:37.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.473 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.473 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3291860811, 2024-01-31T05:13:37.473 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636961, 2024-01-31T05:13:37.473 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_test03.c" 2024-01-31T05:13:37.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.473 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.473 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3305224259, 2024-01-31T05:13:37.474 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636457, 2024-01-31T05:13:37.474 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/TODO" 2024-01-31T05:13:37.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.474 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.474 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3305566594, 2024-01-31T05:13:37.474 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636275, 2024-01-31T05:13:37.474 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/cpuset.h" 2024-01-31T05:13:37.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.474 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.475 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3314112248, 2024-01-31T05:13:37.475 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636297, 2024-01-31T05:13:37.475 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_test/cpuset_memory_test.c" 2024-01-31T05:13:37.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.475 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.475 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3348851742, 2024-01-31T05:13:37.475 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636274, 2024-01-31T05:13:37.475 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/meminfo.c" 2024-01-31T05:13:37.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.476 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.476 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3379626497, 2024-01-31T05:13:37.476 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636450, 2024-01-31T05:13:37.476 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/fork_freeze.sh" 2024-01-31T05:13:37.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.476 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.476 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3390661953, 2024-01-31T05:13:37.476 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636411, 2024-01-31T05:13:37.476 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_test04.c" 2024-01-31T05:13:37.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.477 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.477 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3431196103, 2024-01-31T05:13:37.477 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636698, 2024-01-31T05:13:37.477 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_base_ops_test/cpuset_base_ops_testset.sh" 2024-01-31T05:13:37.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.477 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.477 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3442726910, 2024-01-31T05:13:37.477 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636688, 2024-01-31T05:13:37.477 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/Makefile" 2024-01-31T05:13:37.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.478 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.478 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3508236709, 2024-01-31T05:13:37.478 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636435, 2024-01-31T05:13:37.478 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/regression/memcg_regression_test.sh" 2024-01-31T05:13:37.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.478 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.478 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3511563827, 2024-01-31T05:13:37.479 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636977, 2024-01-31T05:13:37.479 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/libcontrollers/libcontrollers.c" 2024-01-31T05:13:37.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.479 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.479 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3589775205, 2024-01-31T05:13:37.479 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636285, 2024-01-31T05:13:37.479 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_exclusive_test/Makefile" 2024-01-31T05:13:37.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.479 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.479 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3598862843, 2024-01-31T05:13:37.479 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636294, 2024-01-31T05:13:37.479 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_pressure_test/cpuset_memory_pressure.c" 2024-01-31T05:13:37.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.480 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.480 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3622130744, 2024-01-31T05:13:37.480 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636451, 2024-01-31T05:13:37.480 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/stop_freeze_thaw_cont.sh" 2024-01-31T05:13:37.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.480 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.480 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3637326280, 2024-01-31T05:13:37.480 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636283, 2024-01-31T05:13:37.480 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_load_balance_test/cpuset_cpu_hog.c" 2024-01-31T05:13:37.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.481 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.481 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3659947054, 2024-01-31T05:13:37.481 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636419, 2024-01-31T05:13:37.481 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/cgroup_fj_function.sh" 2024-01-31T05:13:37.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.481 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.481 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3664342523, 2024-01-31T05:13:37.481 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636300, 2024-01-31T05:13:37.481 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl_fj/README" 2024-01-31T05:13:37.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.481 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.481 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3678202466, 2024-01-31T05:13:37.482 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636289, 2024-01-31T05:13:37.482 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_base_ops_test/Makefile" 2024-01-31T05:13:37.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.482 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.482 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3691635378, 2024-01-31T05:13:37.482 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636312, 2024-01-31T05:13:37.482 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_9_1.sh" 2024-01-31T05:13:37.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.483 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.483 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3726091267, 2024-01-31T05:13:37.483 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636464, 2024-01-31T05:13:37.483 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/freeze_cancel.sh" 2024-01-31T05:13:37.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.483 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.483 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3729423929, 2024-01-31T05:13:37.483 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636246, 2024-01-31T05:13:37.483 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/acpi/ltpacpi.sh" 2024-01-31T05:13:37.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.483 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.483 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3731134400, 2024-01-31T05:13:37.484 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636302, 2024-01-31T05:13:37.484 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl_fj/cpuctl_fj_cpu-hog.c" 2024-01-31T05:13:37.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.484 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.484 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3808305558, 2024-01-31T05:13:37.484 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636301, 2024-01-31T05:13:37.484 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl_fj/run_cpuctl_test_fj.sh" 2024-01-31T05:13:37.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.484 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.484 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3832779757, 2024-01-31T05:13:37.484 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636969, 2024-01-31T05:13:37.484 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/Makefile" 2024-01-31T05:13:37.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.485 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.485 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3837895233, 2024-01-31T05:13:37.485 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636318, 2024-01-31T05:13:37.485 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/run_cpuctl_latency_test.sh" 2024-01-31T05:13:37.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.485 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.485 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3839268943, 2024-01-31T05:13:37.485 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636964, 2024-01-31T05:13:37.485 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuacct" 2024-01-31T05:13:37.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.486 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.486 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3840368498, 2024-01-31T05:13:37.486 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636265, 2024-01-31T05:13:37.486 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memctl/myfunctions.sh" 2024-01-31T05:13:37.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.486 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.486 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3876344108, 2024-01-31T05:13:37.486 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636422, 2024-01-31T05:13:37.486 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/cgroup_fj_release_agent" 2024-01-31T05:13:37.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.486 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.486 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3909330179, 2024-01-31T05:13:37.487 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636444, 2024-01-31T05:13:37.487 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/run_freezer.sh" 2024-01-31T05:13:37.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.487 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.487 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3935102608, 2024-01-31T05:13:37.487 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636295, 2024-01-31T05:13:37.487 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/Makefile.inc" 2024-01-31T05:13:37.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.487 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.487 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3948102982, 2024-01-31T05:13:37.487 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636434, 2024-01-31T05:13:37.487 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/regression/Makefile" 2024-01-31T05:13:37.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.488 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.488 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3953790990, 2024-01-31T05:13:37.488 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636409, 2024-01-31T05:13:37.488 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_test01.c" 2024-01-31T05:13:37.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.488 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.488 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3957177949, 2024-01-31T05:13:37.488 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636703, 2024-01-31T05:13:37.488 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_test" 2024-01-31T05:13:37.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.488 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.489 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4004983063, 2024-01-31T05:13:37.489 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636278, 2024-01-31T05:13:37.489 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_hotplug_test/cpuset_hotplug_test.sh" 2024-01-31T05:13:37.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.489 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.489 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4027258013, 2024-01-31T05:13:37.489 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636406, 2024-01-31T05:13:37.489 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/Makefile" 2024-01-31T05:13:37.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.489 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.489 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4081053829, 2024-01-31T05:13:37.490 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636707, 2024-01-31T05:13:37.490 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup" 2024-01-31T05:13:37.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.490 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.490 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4084264509, 2024-01-31T05:13:37.490 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636407, 2024-01-31T05:13:37.490 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_testplan.txt" 2024-01-31T05:13:37.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.490 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.490 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4086026649, 2024-01-31T05:13:37.490 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637789, 2024-01-31T05:13:37.490 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/exit_group/exit_group01.c" 2024-01-31T05:13:37.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.491 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.491 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4125184219, 2024-01-31T05:13:37.491 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636279, 2024-01-31T05:13:37.491 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_hotplug_test/cpuset_list_compute.c" 2024-01-31T05:13:37.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.491 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.491 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4132783926, 2024-01-31T05:13:37.491 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636680, 2024-01-31T05:13:37.491 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memctl/memctl_test01.c" 2024-01-31T05:13:37.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.491 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.492 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4149014641, 2024-01-31T05:13:37.492 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636879, 2024-01-31T05:13:37.492 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/waitid/waitid02.c" 2024-01-31T05:13:37.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.492 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.492 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4161954254, 2024-01-31T05:13:37.492 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636456, 2024-01-31T05:13:37.492 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/README" 2024-01-31T05:13:37.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.492 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.492 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4164129214, 2024-01-31T05:13:37.492 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636678, 2024-01-31T05:13:37.493 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/testplan.txt" 2024-01-31T05:13:37.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.493 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.493 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4194194333, 2024-01-31T05:13:37.493 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636474, 2024-01-31T05:13:37.493 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/Makefile.inc" 2024-01-31T05:13:37.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.493 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.493 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4209129878, 2024-01-31T05:13:37.493 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636262, 2024-01-31T05:13:37.493 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memctl/README" 2024-01-31T05:13:37.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.494 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.494 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4216469646, 2024-01-31T05:13:37.494 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636691, 2024-01-31T05:13:37.494 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_exclusive_test" 2024-01-31T05:13:37.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.494 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.494 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4228048066, 2024-01-31T05:13:37.494 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636307, 2024-01-31T05:13:37.494 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_10_1.sh" 2024-01-31T05:13:37.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.494 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.494 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4251156841, 2024-01-31T05:13:37.495 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636965, 2024-01-31T05:13:37.495 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuacct/cpuacct_setup.sh" 2024-01-31T05:13:37.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.495 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.495 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4287600724, 2024-01-31T05:13:37.495 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636298, 2024-01-31T05:13:37.495 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/Makefile" 2024-01-31T05:13:37.495 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:13:37.495 INFO:teuthology.orchestra.run.smithi099.stdout:] 2024-01-31T05:13:37.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.399+0000 7f9fa14a3640 1 -- 172.21.15.99:0/3097577437 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f9f880a1360 msgr2=0x7f9f880a3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:37.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.399+0000 7f9fa14a3640 1 --2- 172.21.15.99:0/3097577437 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f9f880a1360 0x7f9f880a3820 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x5654af280160 tx=0x7f9f9402c0f0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.399+0000 7f9fa14a3640 1 -- 172.21.15.99:0/3097577437 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f9c0ffbf0 msgr2=0x7f9f9c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:37.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.399+0000 7f9fa14a3640 1 --2- 172.21.15.99:0/3097577437 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f9c0ffbf0 0x7f9f9c0689c0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c00c970 tx=0x7f9f8c00ce30 comp rx=0 tx=0).stop 2024-01-31T05:13:37.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.399+0000 7f9fa14a3640 1 -- 172.21.15.99:0/3097577437 shutdown_connections 2024-01-31T05:13:37.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.399+0000 7f9fa14a3640 1 --2- 172.21.15.99:0/3097577437 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f9f880a1360 0x7f9f880a3820 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.399+0000 7f9fa14a3640 1 --2- 172.21.15.99:0/3097577437 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9f9c1017a0 0x7f9f9c19e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.399+0000 7f9fa14a3640 1 --2- 172.21.15.99:0/3097577437 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f9c100de0 0x7f9f9c19b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.399+0000 7f9fa14a3640 1 --2- 172.21.15.99:0/3097577437 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f9c0ffbf0 0x7f9f9c0689c0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.399+0000 7f9fa14a3640 1 -- 172.21.15.99:0/3097577437 >> 172.21.15.99:0/3097577437 conn(0x7f9f9c0fb180 msgr2=0x7f9f9c104200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:37.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.399+0000 7f9fa14a3640 1 -- 172.21.15.99:0/3097577437 shutdown_connections 2024-01-31T05:13:37.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.399+0000 7f9fa14a3640 1 -- 172.21.15.99:0/3097577437 wait complete. 2024-01-31T05:13:37.499 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-01-31T05:13:37.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.611+0000 7f1660e5e640 1 -- 172.21.15.99:0/3676480198 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f165c1011e0 msgr2=0x7f165c101600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:37.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.611+0000 7f1660e5e640 1 --2- 172.21.15.99:0/3676480198 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f165c1011e0 0x7f165c101600 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f164c009860 tx=0x7f164c02bb70 comp rx=0 tx=0).stop 2024-01-31T05:13:37.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.611+0000 7f1660e5e640 1 -- 172.21.15.99:0/3676480198 shutdown_connections 2024-01-31T05:13:37.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.611+0000 7f1660e5e640 1 --2- 172.21.15.99:0/3676480198 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f165c1007f0 0x7f165c108090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.611+0000 7f1660e5e640 1 --2- 172.21.15.99:0/3676480198 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f165c0ffe30 0x7f165c1002b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.611+0000 7f1660e5e640 1 --2- 172.21.15.99:0/3676480198 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f165c1011e0 0x7f165c101600 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.611+0000 7f1660e5e640 1 -- 172.21.15.99:0/3676480198 >> 172.21.15.99:0/3676480198 conn(0x7f165c0fa900 msgr2=0x7f165c0fcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:37.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.611+0000 7f1660e5e640 1 -- 172.21.15.99:0/3676480198 shutdown_connections 2024-01-31T05:13:37.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.611+0000 7f1660e5e640 1 -- 172.21.15.99:0/3676480198 wait complete. 2024-01-31T05:13:37.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.612+0000 7f1660e5e640 1 Processor -- start 2024-01-31T05:13:37.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.612+0000 7f1660e5e640 1 -- start start 2024-01-31T05:13:37.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.612+0000 7f1660e5e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f165c0ffe30 0x7f165c10a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.612+0000 7f1660e5e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f165c1007f0 0x7f165c108b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.612+0000 7f1660e5e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f165c1011e0 0x7f165c109050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.612+0000 7f1660e5e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f165c1097b0 con 0x7f165c1011e0 2024-01-31T05:13:37.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.612+0000 7f1660e5e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f165c109920 con 0x7f165c1007f0 2024-01-31T05:13:37.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.612+0000 7f1660e5e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f165c1a0d60 con 0x7f165c0ffe30 2024-01-31T05:13:37.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.612+0000 7f165ad9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f165c1011e0 0x7f165c109050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.612+0000 7f1659d9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f165c1007f0 0x7f165c108b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.612+0000 7f165ad9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f165c1011e0 0x7f165c109050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35542/0 (socket says 172.21.15.99:35542) 2024-01-31T05:13:37.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.612+0000 7f165ad9d640 1 -- 172.21.15.99:0/42558018 learned_addr learned my addr 172.21.15.99:0/42558018 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:37.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.612+0000 7f165a59c640 1 --2- 172.21.15.99:0/42558018 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f165c0ffe30 0x7f165c10a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.613+0000 7f165ad9d640 1 -- 172.21.15.99:0/42558018 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f165c0ffe30 msgr2=0x7f165c10a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:37.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.613+0000 7f165ad9d640 1 --2- 172.21.15.99:0/42558018 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f165c0ffe30 0x7f165c10a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.613+0000 7f165ad9d640 1 -- 172.21.15.99:0/42558018 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f165c1007f0 msgr2=0x7f165c108b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:37.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.613+0000 7f165ad9d640 1 --2- 172.21.15.99:0/42558018 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f165c1007f0 0x7f165c108b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.613+0000 7f165ad9d640 1 -- 172.21.15.99:0/42558018 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1654009900 con 0x7f165c1011e0 2024-01-31T05:13:37.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.613+0000 7f1659d9b640 1 --2- 172.21.15.99:0/42558018 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f165c1007f0 0x7f165c108b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:13:37.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.613+0000 7f165ad9d640 1 --2- 172.21.15.99:0/42558018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f165c1011e0 0x7f165c109050 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f165400c370 tx=0x7f165400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:37.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.613+0000 7f164b7fe640 1 -- 172.21.15.99:0/42558018 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1654003970 con 0x7f165c1011e0 2024-01-31T05:13:37.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.613+0000 7f164b7fe640 1 -- 172.21.15.99:0/42558018 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1654004020 con 0x7f165c1011e0 2024-01-31T05:13:37.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.613+0000 7f1660e5e640 1 -- 172.21.15.99:0/42558018 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f164c009490 con 0x7f165c1011e0 2024-01-31T05:13:37.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.613+0000 7f164b7fe640 1 -- 172.21.15.99:0/42558018 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165400b8b0 con 0x7f165c1011e0 2024-01-31T05:13:37.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.613+0000 7f1660e5e640 1 -- 172.21.15.99:0/42558018 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f165c1a12b0 con 0x7f165c1011e0 2024-01-31T05:13:37.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.615+0000 7f164b7fe640 1 -- 172.21.15.99:0/42558018 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 20) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f165400a040 con 0x7f165c1011e0 2024-01-31T05:13:37.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.615+0000 7f1663c24740 1 Processor -- start 2024-01-31T05:13:37.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.615+0000 7f1663c24740 1 -- start start 2024-01-31T05:13:37.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.616+0000 7f1663c24740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55aadcc13f10 0x55aadcc14330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.616+0000 7f164b7fe640 1 --2- 172.21.15.99:0/42558018 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f16440a12e0 0x7f16440a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.616+0000 7f1663c24740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55aadcc14900 0x55aadcc19400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.616+0000 7f1663c24740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55aadcc19a70 0x55aadcc1bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.616+0000 7f1663c24740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aadcb82240 con 0x55aadcc14900 2024-01-31T05:13:37.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.616+0000 7f1663c24740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aadcb7f930 con 0x55aadcc13f10 2024-01-31T05:13:37.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.616+0000 7f1663c24740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aadcb7b220 con 0x55aadcc19a70 2024-01-31T05:13:37.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.616+0000 7f1659d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55aadcc14900 0x55aadcc19400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.616+0000 7f165ad9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55aadcc19a70 0x55aadcc1bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.616+0000 7f165a59c640 1 --2- 172.21.15.99:0/42558018 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f16440a12e0 0x7f16440a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.616+0000 7f165ad9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55aadcc19a70 0x55aadcc1bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:57222/0 (socket says 172.21.15.99:57222) 2024-01-31T05:13:37.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.616+0000 7f1659d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55aadcc14900 0x55aadcc19400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35548/0 (socket says 172.21.15.99:35548) 2024-01-31T05:13:37.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.616+0000 7f165ad9d640 1 -- 172.21.15.99:0/3329116424 learned_addr learned my addr 172.21.15.99:0/3329116424 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:37.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.616+0000 7f1659d9b640 1 --2- 172.21.15.99:0/3329116424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55aadcc13f10 0x55aadcc14330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.616+0000 7f164b7fe640 1 -- 172.21.15.99:0/42558018 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f16540ccbe0 con 0x7f165c1011e0 2024-01-31T05:13:37.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.616+0000 7f165ad9d640 1 -- 172.21.15.99:0/3329116424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55aadcc13f10 msgr2=0x55aadcc14330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:37.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.616+0000 7f165ad9d640 1 --2- 172.21.15.99:0/3329116424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55aadcc13f10 0x55aadcc14330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.616+0000 7f165ad9d640 1 -- 172.21.15.99:0/3329116424 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55aadcc14900 msgr2=0x55aadcc19400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:37.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.616+0000 7f165ad9d640 1 --2- 172.21.15.99:0/3329116424 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55aadcc14900 0x55aadcc19400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.616+0000 7f165ad9d640 1 -- 172.21.15.99:0/3329116424 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aadcb3d7c0 con 0x55aadcc19a70 2024-01-31T05:13:37.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.616+0000 7f165a59c640 1 --2- 172.21.15.99:0/42558018 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f16440a12e0 0x7f16440a37a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f164c02cf50 tx=0x7f164c034af0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:37.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.616+0000 7f165ad9d640 1 --2- 172.21.15.99:0/3329116424 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55aadcc19a70 0x55aadcc1bf00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1654004870 tx=0x7f16540961e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8682fe926a24e35e server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:37.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.616+0000 7f1648ff9640 1 -- 172.21.15.99:0/3329116424 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16540ac220 con 0x55aadcc19a70 2024-01-31T05:13:37.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.616+0000 7f1648ff9640 1 -- 172.21.15.99:0/3329116424 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f16540b9070 con 0x55aadcc19a70 2024-01-31T05:13:37.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.617+0000 7f1648ff9640 1 -- 172.21.15.99:0/3329116424 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1654099de0 con 0x55aadcc19a70 2024-01-31T05:13:37.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.617+0000 7f1663c24740 1 -- 172.21.15.99:0/3329116424 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55aadcc19a70 msgr2=0x55aadcc1bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:37.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.617+0000 7f1663c24740 1 --2- 172.21.15.99:0/3329116424 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55aadcc19a70 0x55aadcc1bf00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1654004870 tx=0x7f16540961e0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.617+0000 7f1663c24740 1 -- 172.21.15.99:0/3329116424 shutdown_connections 2024-01-31T05:13:37.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.617+0000 7f1663c24740 1 --2- 172.21.15.99:0/3329116424 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55aadcc19a70 0x55aadcc1bf00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.617+0000 7f1663c24740 1 --2- 172.21.15.99:0/3329116424 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55aadcc14900 0x55aadcc19400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.617+0000 7f1663c24740 1 --2- 172.21.15.99:0/3329116424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55aadcc13f10 0x55aadcc14330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.617+0000 7f1663c24740 1 -- 172.21.15.99:0/3329116424 >> 172.21.15.99:0/3329116424 conn(0x55aadcc0f480 msgr2=0x55aadcc0f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:37.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.617+0000 7f1663c24740 1 -- 172.21.15.99:0/3329116424 shutdown_connections 2024-01-31T05:13:37.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.617+0000 7f1663c24740 1 -- 172.21.15.99:0/3329116424 wait complete. 2024-01-31T05:13:37.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.618+0000 7f1663c24740 1 -- start start 2024-01-31T05:13:37.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.618+0000 7f1663c24740 1 Processor -- start 2024-01-31T05:13:37.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.618+0000 7f1663c24740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55aadcc13f10 0x55aadcc1e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.618+0000 7f1663c24740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55aadcc14900 0x55aadcc1e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.618+0000 7f1663c24740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55aadcc19a70 0x55aadcc25680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.618+0000 7f1663c24740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aadcb345e0 con 0x55aadcc19a70 2024-01-31T05:13:37.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.618+0000 7f1663c24740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aadcb34280 con 0x55aadcc13f10 2024-01-31T05:13:37.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.618+0000 7f1663c24740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aadcaf93d0 con 0x55aadcc14900 2024-01-31T05:13:37.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.618+0000 7f1663c24740 10 client.0 _ll_register_callbacks cb 0x55aadcb71eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:13:37.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.618+0000 7f165ad9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55aadcc19a70 0x55aadcc25680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.618+0000 7f165a59c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55aadcc13f10 0x55aadcc1e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.618+0000 7f1659d9b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55aadcc14900 0x55aadcc1e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.618+0000 7f165ad9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55aadcc19a70 0x55aadcc25680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35564/0 (socket says 172.21.15.99:35564) 2024-01-31T05:13:37.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.618+0000 7f165a59c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55aadcc13f10 0x55aadcc1e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.99:39568/0 (socket says 172.21.15.99:39568) 2024-01-31T05:13:37.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.618+0000 7f165ad9d640 1 -- 172.21.15.99:0/1819384687 learned_addr learned my addr 172.21.15.99:0/1819384687 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:37.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.618+0000 7f165ad9d640 1 -- 172.21.15.99:0/1819384687 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55aadcc14900 msgr2=0x55aadcc1e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:37.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.618+0000 7f165ad9d640 1 --2- 172.21.15.99:0/1819384687 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55aadcc14900 0x55aadcc1e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.618+0000 7f165ad9d640 1 -- 172.21.15.99:0/1819384687 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55aadcc13f10 msgr2=0x55aadcc1e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:37.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.618+0000 7f165ad9d640 1 --2- 172.21.15.99:0/1819384687 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55aadcc13f10 0x55aadcc1e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.618+0000 7f165ad9d640 1 -- 172.21.15.99:0/1819384687 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f165c1a12b0 con 0x55aadcc19a70 2024-01-31T05:13:37.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.618+0000 7f165ad9d640 1 --2- 172.21.15.99:0/1819384687 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55aadcc19a70 0x55aadcc25680 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f1654096850 tx=0x7f16540ac1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=601a7ceb559607c0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:37.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.618+0000 7f1641ffb640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:13:37.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.619+0000 7f1641ffb640 1 -- 172.21.15.99:0/1819384687 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165409dfb0 con 0x55aadcc19a70 2024-01-31T05:13:37.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.619+0000 7f1641ffb640 1 -- 172.21.15.99:0/1819384687 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f16540a2170 con 0x55aadcc19a70 2024-01-31T05:13:37.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.619+0000 7f1663c24740 1 -- 172.21.15.99:0/1819384687 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55aadcb740b0 con 0x55aadcc19a70 2024-01-31T05:13:37.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.619+0000 7f1641ffb640 1 -- 172.21.15.99:0/1819384687 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1654099de0 con 0x55aadcc19a70 2024-01-31T05:13:37.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.619+0000 7f1663c24740 10 client.16173 fetch_fsmap learned FSMap version 37 2024-01-31T05:13:37.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.619+0000 7f1663c24740 1 -- 172.21.15.99:0/1819384687 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55aadcb798a0 con 0x55aadcc19a70 2024-01-31T05:13:37.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.619+0000 7f1641ffb640 1 -- 172.21.15.99:0/1819384687 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f16540b6030 con 0x55aadcc19a70 2024-01-31T05:13:37.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.619+0000 7f1641ffb640 1 -- 172.21.15.99:0/1819384687 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 37) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f16540a1ce0 con 0x55aadcc19a70 2024-01-31T05:13:37.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.619+0000 7f1663c24740 10 client.16173 fetch_fsmap finished waiting for FSMap version 37 2024-01-31T05:13:37.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.619+0000 7f1663c24740 10 client.16173 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-01-31T05:13:37.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.619+0000 7f1663c24740 20 client.16173 populate_metadata read hostname 'smithi099' 2024-01-31T05:13:37.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.619+0000 7f1663c24740 1 --2- 172.21.15.99:0/1819384687 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x55aadcc29b80 0x55aadcc2bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.619+0000 7f1663c24740 4 client.16173 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:13:37.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.619+0000 7f1663c24740 1 -- 172.21.15.99:0/1819384687 --> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55aadcb73dd0 con 0x55aadcc29b80 2024-01-31T05:13:37.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.619+0000 7f165a59c640 1 --2- 172.21.15.99:0/1819384687 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x55aadcc29b80 0x55aadcc2bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.620+0000 7f1641ffb640 10 client.16173 ms_handle_connect on v2:172.21.15.179:6836/837402830 2024-01-31T05:13:37.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.620+0000 7f165a59c640 1 --2- 172.21.15.99:0/1819384687 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x55aadcc29b80 0x55aadcc2bfa0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3a659f4be1e4af2b server_cookie=3694fa458322a3e0 in_seq=0 out_seq=0 2024-01-31T05:13:37.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.621+0000 7f1641ffb640 1 -- 172.21.15.99:0/1819384687 <== mds.1 v2:172.21.15.179:6836/837402830 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55aadcb73dd0 con 0x55aadcc29b80 2024-01-31T05:13:37.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.621+0000 7f1641ffb640 10 client.16173 handle_command_reply: tid=0 2024-01-31T05:13:37.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.621+0000 7f1663c24740 1 client.16173 shutdown 2024-01-31T05:13:37.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.621+0000 7f1663c24740 1 -- 172.21.15.99:0/1819384687 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55aadcc19a70 msgr2=0x55aadcc25680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:37.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.621+0000 7f1663c24740 1 --2- 172.21.15.99:0/1819384687 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55aadcc19a70 0x55aadcc25680 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f1654096850 tx=0x7f16540ac1e0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.621+0000 7f1663c24740 1 -- 172.21.15.99:0/1819384687 shutdown_connections 2024-01-31T05:13:37.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.621+0000 7f1663c24740 1 --2- 172.21.15.99:0/1819384687 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x55aadcc29b80 0x55aadcc2bfa0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.621+0000 7f1663c24740 1 --2- 172.21.15.99:0/1819384687 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55aadcc19a70 0x55aadcc25680 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.621+0000 7f1663c24740 1 --2- 172.21.15.99:0/1819384687 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55aadcc14900 0x55aadcc1e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.621+0000 7f1663c24740 1 --2- 172.21.15.99:0/1819384687 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55aadcc13f10 0x55aadcc1e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.621+0000 7f1641ffb640 0 client.16173 ms_handle_reset on v2:172.21.15.179:6836/837402830 2024-01-31T05:13:37.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.621+0000 7f1663c24740 1 -- 172.21.15.99:0/1819384687 >> 172.21.15.99:0/1819384687 conn(0x55aadcc0f480 msgr2=0x55aadcc0e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:37.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.621+0000 7f1663c24740 1 -- 172.21.15.99:0/1819384687 shutdown_connections 2024-01-31T05:13:37.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.621+0000 7f1663c24740 1 -- 172.21.15.99:0/1819384687 wait complete. 2024-01-31T05:13:37.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.621+0000 7f1663c24740 20 client.16173 trim_cache size 0 max 16384 2024-01-31T05:13:37.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.633+0000 7f1663c24740 1 Processor -- start 2024-01-31T05:13:37.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.633+0000 7f1663c24740 1 -- start start 2024-01-31T05:13:37.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.633+0000 7f1663c24740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55aadcc13f10 0x55aadcc15dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.633+0000 7f1663c24740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55aadcc14900 0x55aadcc25640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.633+0000 7f1663c24740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55aadcc19a70 0x55aadcc16300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.633+0000 7f1663c24740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aadcb73dd0 con 0x55aadcc13f10 2024-01-31T05:13:37.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.633+0000 7f1663c24740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aadcc14ff0 con 0x55aadcc14900 2024-01-31T05:13:37.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.633+0000 7f1663c24740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aadcc26170 con 0x55aadcc19a70 2024-01-31T05:13:37.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.633+0000 7f165a59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55aadcc13f10 0x55aadcc15dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.633+0000 7f165a59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55aadcc13f10 0x55aadcc15dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35574/0 (socket says 172.21.15.99:35574) 2024-01-31T05:13:37.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.633+0000 7f165a59c640 1 -- 172.21.15.99:0/896487916 learned_addr learned my addr 172.21.15.99:0/896487916 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:37.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.633+0000 7f1659d9b640 1 --2- 172.21.15.99:0/896487916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55aadcc14900 0x55aadcc25640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.633+0000 7f165ad9d640 1 --2- 172.21.15.99:0/896487916 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55aadcc19a70 0x55aadcc16300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.633+0000 7f165a59c640 1 -- 172.21.15.99:0/896487916 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55aadcc19a70 msgr2=0x55aadcc16300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:37.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.633+0000 7f165a59c640 1 --2- 172.21.15.99:0/896487916 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55aadcc19a70 0x55aadcc16300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.633+0000 7f165a59c640 1 -- 172.21.15.99:0/896487916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55aadcc14900 msgr2=0x55aadcc25640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:37.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.633+0000 7f165a59c640 1 --2- 172.21.15.99:0/896487916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55aadcc14900 0x55aadcc25640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.633+0000 7f165a59c640 1 -- 172.21.15.99:0/896487916 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aadcb164d0 con 0x55aadcc13f10 2024-01-31T05:13:37.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.633+0000 7f165ad9d640 1 --2- 172.21.15.99:0/896487916 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55aadcc19a70 0x55aadcc16300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:13:37.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.634+0000 7f165a59c640 1 --2- 172.21.15.99:0/896487916 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55aadcc13f10 0x55aadcc15dc0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f165c068db0 tx=0x7f164c03f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9da3618fac2950de server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:37.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.634+0000 7f1643fff640 1 -- 172.21.15.99:0/896487916 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164c051ea0 con 0x55aadcc13f10 2024-01-31T05:13:37.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.634+0000 7f1643fff640 1 -- 172.21.15.99:0/896487916 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f164c02c9d0 con 0x55aadcc13f10 2024-01-31T05:13:37.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.634+0000 7f1643fff640 1 -- 172.21.15.99:0/896487916 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164c051700 con 0x55aadcc13f10 2024-01-31T05:13:37.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.634+0000 7f1663c24740 1 -- 172.21.15.99:0/896487916 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55aadcc13f10 msgr2=0x55aadcc15dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:37.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.634+0000 7f1663c24740 1 --2- 172.21.15.99:0/896487916 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55aadcc13f10 0x55aadcc15dc0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f165c068db0 tx=0x7f164c03f000 comp rx=0 tx=0).stop 2024-01-31T05:13:37.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.635+0000 7f1663c24740 1 -- 172.21.15.99:0/896487916 shutdown_connections 2024-01-31T05:13:37.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.635+0000 7f1663c24740 1 --2- 172.21.15.99:0/896487916 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55aadcc19a70 0x55aadcc16300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.635+0000 7f1663c24740 1 --2- 172.21.15.99:0/896487916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55aadcc14900 0x55aadcc25640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.635+0000 7f1663c24740 1 --2- 172.21.15.99:0/896487916 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55aadcc13f10 0x55aadcc15dc0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.635+0000 7f1663c24740 1 -- 172.21.15.99:0/896487916 >> 172.21.15.99:0/896487916 conn(0x55aadcc0f480 msgr2=0x55aadcc1e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:37.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.635+0000 7f1663c24740 1 -- 172.21.15.99:0/896487916 shutdown_connections 2024-01-31T05:13:37.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.635+0000 7f1663c24740 1 -- 172.21.15.99:0/896487916 wait complete. 2024-01-31T05:13:37.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.635+0000 7f1663c24740 1 -- start start 2024-01-31T05:13:37.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.635+0000 7f1663c24740 1 Processor -- start 2024-01-31T05:13:37.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.635+0000 7f1663c24740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55aadcc13f10 0x55aadcc24c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.635+0000 7f1663c24740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55aadcc14900 0x55aadcc25180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.635+0000 7f1663c24740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55aadcc19a70 0x55aadcc80590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.635+0000 7f1663c24740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aadcc80ad0 con 0x55aadcc19a70 2024-01-31T05:13:37.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.635+0000 7f1663c24740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aadcc80c10 con 0x55aadcc14900 2024-01-31T05:13:37.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.635+0000 7f1663c24740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aadcc80da0 con 0x55aadcc13f10 2024-01-31T05:13:37.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.635+0000 7f1663c24740 10 client.0 _ll_register_callbacks cb 0x7f1650009e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:13:37.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.635+0000 7f165ad9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55aadcc19a70 0x55aadcc80590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.635+0000 7f165a59c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55aadcc13f10 0x55aadcc24c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.635+0000 7f165ad9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55aadcc19a70 0x55aadcc80590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35578/0 (socket says 172.21.15.99:35578) 2024-01-31T05:13:37.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.635+0000 7f165ad9d640 1 -- 172.21.15.99:0/2270063449 learned_addr learned my addr 172.21.15.99:0/2270063449 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:37.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.635+0000 7f1659d9b640 1 --2- 172.21.15.99:0/2270063449 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55aadcc14900 0x55aadcc25180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.635+0000 7f165ad9d640 1 -- 172.21.15.99:0/2270063449 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55aadcc13f10 msgr2=0x55aadcc24c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:37.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.635+0000 7f165ad9d640 1 --2- 172.21.15.99:0/2270063449 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55aadcc13f10 0x55aadcc24c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.635+0000 7f165ad9d640 1 -- 172.21.15.99:0/2270063449 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55aadcc14900 msgr2=0x55aadcc25180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:37.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.635+0000 7f165ad9d640 1 --2- 172.21.15.99:0/2270063449 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55aadcc14900 0x55aadcc25180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.636+0000 7f165ad9d640 1 -- 172.21.15.99:0/2270063449 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f165c0fed20 con 0x55aadcc19a70 2024-01-31T05:13:37.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.636+0000 7f165ad9d640 1 --2- 172.21.15.99:0/2270063449 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55aadcc19a70 0x55aadcc80590 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f1654099ae0 tx=0x7f165409a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfafc95a1cdcf999 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:37.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.636+0000 7f1641ffb640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:13:37.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.636+0000 7f1641ffb640 1 -- 172.21.15.99:0/2270063449 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16540adc20 con 0x55aadcc19a70 2024-01-31T05:13:37.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.636+0000 7f1641ffb640 1 -- 172.21.15.99:0/2270063449 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f16540a2170 con 0x55aadcc19a70 2024-01-31T05:13:37.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.636+0000 7f1663c24740 1 -- 172.21.15.99:0/2270063449 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f16540b9070 con 0x55aadcc19a70 2024-01-31T05:13:37.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.636+0000 7f1641ffb640 1 -- 172.21.15.99:0/2270063449 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1654099de0 con 0x55aadcc19a70 2024-01-31T05:13:37.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.636+0000 7f1663c24740 10 client.16179 fetch_fsmap learned FSMap version 37 2024-01-31T05:13:37.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.636+0000 7f1663c24740 1 -- 172.21.15.99:0/2270063449 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55aadcb3c020 con 0x55aadcc19a70 2024-01-31T05:13:37.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.636+0000 7f1641ffb640 1 -- 172.21.15.99:0/2270063449 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f16540b9070 con 0x55aadcc19a70 2024-01-31T05:13:37.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.636+0000 7f1641ffb640 1 -- 172.21.15.99:0/2270063449 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 37) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f1654098d40 con 0x55aadcc19a70 2024-01-31T05:13:37.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.636+0000 7f1663c24740 10 client.16179 fetch_fsmap finished waiting for FSMap version 37 2024-01-31T05:13:37.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.636+0000 7f1663c24740 10 client.16179 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-01-31T05:13:37.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.636+0000 7f1663c24740 20 client.16179 populate_metadata read hostname 'smithi099' 2024-01-31T05:13:37.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.636+0000 7f1663c24740 1 --2- 172.21.15.99:0/2270063449 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x55aadcc82410 0x55aadcc84830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.636+0000 7f1663c24740 4 client.16179 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-01-31T05:13:37.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.636+0000 7f1663c24740 1 -- 172.21.15.99:0/2270063449 --> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55aadc87a7e0 con 0x55aadcc82410 2024-01-31T05:13:37.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.636+0000 7f165a59c640 1 --2- 172.21.15.99:0/2270063449 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x55aadcc82410 0x55aadcc84830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.637+0000 7f165a59c640 1 --2- 172.21.15.99:0/2270063449 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x55aadcc82410 0x55aadcc84830 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=16b504acb1b839f4 server_cookie=1e13122973cedcff in_seq=0 out_seq=0 2024-01-31T05:13:37.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.637+0000 7f1641ffb640 10 client.16179 ms_handle_connect on v2:172.21.15.179:6836/837402830 2024-01-31T05:13:37.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.637+0000 7f1641ffb640 1 -- 172.21.15.99:0/2270063449 <== mds.1 v2:172.21.15.179:6836/837402830 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19478 (crc 0 0 0) 0x55aadc87a7e0 con 0x55aadcc82410 2024-01-31T05:13:37.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.637+0000 7f1641ffb640 10 client.16179 handle_command_reply: tid=0 2024-01-31T05:13:37.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.637+0000 7f1663c24740 1 client.16179 shutdown 2024-01-31T05:13:37.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.638+0000 7f1663c24740 1 -- 172.21.15.99:0/2270063449 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55aadcc19a70 msgr2=0x55aadcc80590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:37.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.638+0000 7f1663c24740 1 --2- 172.21.15.99:0/2270063449 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55aadcc19a70 0x55aadcc80590 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f1654099ae0 tx=0x7f165409a650 comp rx=0 tx=0).stop 2024-01-31T05:13:37.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.638+0000 7f1663c24740 1 -- 172.21.15.99:0/2270063449 shutdown_connections 2024-01-31T05:13:37.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.638+0000 7f1663c24740 1 --2- 172.21.15.99:0/2270063449 >> [v2:172.21.15.179:6836/837402830,v1:172.21.15.179:6837/837402830] conn(0x55aadcc82410 0x55aadcc84830 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.638+0000 7f1663c24740 1 --2- 172.21.15.99:0/2270063449 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55aadcc19a70 0x55aadcc80590 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.638+0000 7f1663c24740 1 --2- 172.21.15.99:0/2270063449 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55aadcc14900 0x55aadcc25180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.638+0000 7f1641ffb640 0 client.16179 ms_handle_reset on v2:172.21.15.179:6836/837402830 2024-01-31T05:13:37.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.638+0000 7f1663c24740 1 --2- 172.21.15.99:0/2270063449 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55aadcc13f10 0x55aadcc24c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.638+0000 7f1663c24740 1 -- 172.21.15.99:0/2270063449 >> 172.21.15.99:0/2270063449 conn(0x55aadcc0f480 msgr2=0x55aadcc1e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:37.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.638+0000 7f1663c24740 1 -- 172.21.15.99:0/2270063449 shutdown_connections 2024-01-31T05:13:37.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.638+0000 7f1663c24740 1 -- 172.21.15.99:0/2270063449 wait complete. 2024-01-31T05:13:37.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.638+0000 7f1663c24740 20 client.16179 trim_cache size 0 max 16384 2024-01-31T05:13:37.644 INFO:teuthology.orchestra.run.smithi099.stdout:[ 2024-01-31T05:13:37.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.644 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.644 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 52393769, 2024-01-31T05:13:37.644 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635559, 2024-01-31T05:13:37.645 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test24" 2024-01-31T05:13:37.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.645 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.645 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 116397240, 2024-01-31T05:13:37.645 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636259, 2024-01-31T05:13:37.645 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/connectors/pec/pec_listener.c" 2024-01-31T05:13:37.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.645 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.645 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 181228585, 2024-01-31T05:13:37.645 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635523, 2024-01-31T05:13:37.645 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test22" 2024-01-31T05:13:37.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.646 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.646 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 260085630, 2024-01-31T05:13:37.646 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635074, 2024-01-31T05:13:37.646 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/LICENCE" 2024-01-31T05:13:37.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.646 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.646 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 299333345, 2024-01-31T05:13:37.646 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635522, 2024-01-31T05:13:37.646 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test10" 2024-01-31T05:13:37.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.646 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.646 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 409235203, 2024-01-31T05:13:37.647 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635533, 2024-01-31T05:13:37.647 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test04" 2024-01-31T05:13:37.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.647 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.647 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 445367478, 2024-01-31T05:13:37.647 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635542, 2024-01-31T05:13:37.647 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test29" 2024-01-31T05:13:37.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.647 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.647 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 447480632, 2024-01-31T05:13:37.647 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636336, 2024-01-31T05:13:37.647 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/utsname/runtests_noltp.sh" 2024-01-31T05:13:37.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.648 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.648 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 466754113, 2024-01-31T05:13:37.648 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635527, 2024-01-31T05:13:37.648 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test34" 2024-01-31T05:13:37.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.648 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.648 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 512638973, 2024-01-31T05:13:37.648 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636676, 2024-01-31T05:13:37.648 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/connectors/pec/event_generator.c" 2024-01-31T05:13:37.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.649 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.649 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 532277680, 2024-01-31T05:13:37.649 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635557, 2024-01-31T05:13:37.649 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test39" 2024-01-31T05:13:37.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.649 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.649 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 611281358, 2024-01-31T05:13:37.649 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635526, 2024-01-31T05:13:37.649 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test23" 2024-01-31T05:13:37.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.650 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.650 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 649226571, 2024-01-31T05:13:37.650 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635558, 2024-01-31T05:13:37.650 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test01" 2024-01-31T05:13:37.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.650 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.650 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 914360973, 2024-01-31T05:13:37.650 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635540, 2024-01-31T05:13:37.650 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test14" 2024-01-31T05:13:37.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.650 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.650 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 961499438, 2024-01-31T05:13:37.651 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635539, 2024-01-31T05:13:37.651 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test11" 2024-01-31T05:13:37.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.651 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.651 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1088677987, 2024-01-31T05:13:37.651 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635551, 2024-01-31T05:13:37.651 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test18" 2024-01-31T05:13:37.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.651 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.651 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1146094812, 2024-01-31T05:13:37.651 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635521, 2024-01-31T05:13:37.651 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test33" 2024-01-31T05:13:37.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.652 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.652 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1327750009, 2024-01-31T05:13:37.652 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635532, 2024-01-31T05:13:37.652 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test06" 2024-01-31T05:13:37.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.652 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.652 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1406870871, 2024-01-31T05:13:37.652 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635546, 2024-01-31T05:13:37.652 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test37" 2024-01-31T05:13:37.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.653 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.653 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1506940652, 2024-01-31T05:13:37.653 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635782, 2024-01-31T05:13:37.653 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/utsname/README" 2024-01-31T05:13:37.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.653 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.653 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1553351783, 2024-01-31T05:13:37.653 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635537, 2024-01-31T05:13:37.653 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test30" 2024-01-31T05:13:37.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.653 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.653 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1567556430, 2024-01-31T05:13:37.653 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635525, 2024-01-31T05:13:37.654 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test03" 2024-01-31T05:13:37.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.654 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.654 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1596318644, 2024-01-31T05:13:37.654 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635072, 2024-01-31T05:13:37.654 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/testfrmw.h" 2024-01-31T05:13:37.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.654 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.655 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1623373313, 2024-01-31T05:13:37.655 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636258, 2024-01-31T05:13:37.655 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/connectors/pec/run_pec_test" 2024-01-31T05:13:37.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.655 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.655 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1687345103, 2024-01-31T05:13:37.655 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635544, 2024-01-31T05:13:37.655 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test08" 2024-01-31T05:13:37.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.655 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.655 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1743627842, 2024-01-31T05:13:37.656 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635545, 2024-01-31T05:13:37.656 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test27" 2024-01-31T05:13:37.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.656 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.656 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1746032903, 2024-01-31T05:13:37.656 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635552, 2024-01-31T05:13:37.656 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test36" 2024-01-31T05:13:37.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.657 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.657 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1747710079, 2024-01-31T05:13:37.657 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637309, 2024-01-31T05:13:37.657 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/stat/Makefile" 2024-01-31T05:13:37.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.657 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.657 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1880339536, 2024-01-31T05:13:37.657 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635535, 2024-01-31T05:13:37.657 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test15" 2024-01-31T05:13:37.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.658 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.658 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1883773029, 2024-01-31T05:13:37.658 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635548, 2024-01-31T05:13:37.658 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test07-2" 2024-01-31T05:13:37.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.658 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.658 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1924164131, 2024-01-31T05:13:37.658 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635520, 2024-01-31T05:13:37.658 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test26" 2024-01-31T05:13:37.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.659 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.659 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1939122782, 2024-01-31T05:13:37.659 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636797, 2024-01-31T05:13:37.659 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/stat/selinux_stat.sh" 2024-01-31T05:13:37.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.659 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.659 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1958568556, 2024-01-31T05:13:37.660 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637199, 2024-01-31T05:13:37.660 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/recvmsg/recvmsg01.c" 2024-01-31T05:13:37.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.660 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.660 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1964941109, 2024-01-31T05:13:37.660 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637103, 2024-01-31T05:13:37.660 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/access/Makefile" 2024-01-31T05:13:37.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.660 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.661 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2035160296, 2024-01-31T05:13:37.661 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635531, 2024-01-31T05:13:37.661 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test25" 2024-01-31T05:13:37.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.661 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.661 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2082078921, 2024-01-31T05:13:37.661 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635071, 2024-01-31T05:13:37.661 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/testfrmw.c" 2024-01-31T05:13:37.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.661 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.662 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2204449916, 2024-01-31T05:13:37.662 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635536, 2024-01-31T05:13:37.662 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test21" 2024-01-31T05:13:37.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.662 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.662 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2237802804, 2024-01-31T05:13:37.662 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635556, 2024-01-31T05:13:37.662 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test05" 2024-01-31T05:13:37.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.663 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.663 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2253074782, 2024-01-31T05:13:37.663 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637475, 2024-01-31T05:13:37.663 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/renameat/renameat01.c" 2024-01-31T05:13:37.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.663 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.663 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2267138183, 2024-01-31T05:13:37.663 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636257, 2024-01-31T05:13:37.663 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/connectors/pec/README" 2024-01-31T05:13:37.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.664 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.664 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2359135425, 2024-01-31T05:13:37.664 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635543, 2024-01-31T05:13:37.664 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test07" 2024-01-31T05:13:37.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.664 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.664 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2532379160, 2024-01-31T05:13:37.664 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635547, 2024-01-31T05:13:37.664 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test02" 2024-01-31T05:13:37.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.665 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.665 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2534448682, 2024-01-31T05:13:37.665 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636256, 2024-01-31T05:13:37.665 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/connectors/pec/Makefile" 2024-01-31T05:13:37.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.665 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.665 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2537330424, 2024-01-31T05:13:37.665 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635554, 2024-01-31T05:13:37.665 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test38" 2024-01-31T05:13:37.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.666 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.666 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2631958408, 2024-01-31T05:13:37.666 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635784, 2024-01-31T05:13:37.666 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/utsname/runutstest.sh" 2024-01-31T05:13:37.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.666 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.666 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2651869098, 2024-01-31T05:13:37.666 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637102, 2024-01-31T05:13:37.666 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/access/access04.c" 2024-01-31T05:13:37.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.667 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.667 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2726901436, 2024-01-31T05:13:37.667 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637178, 2024-01-31T05:13:37.667 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/personality/Makefile" 2024-01-31T05:13:37.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.667 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.667 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2750805361, 2024-01-31T05:13:37.667 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637179, 2024-01-31T05:13:37.667 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/personality/personality01.c" 2024-01-31T05:13:37.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.667 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.667 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2790137056, 2024-01-31T05:13:37.667 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635780, 2024-01-31T05:13:37.668 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/utsname/utstest.c" 2024-01-31T05:13:37.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.668 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.668 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2798322295, 2024-01-31T05:13:37.668 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637105, 2024-01-31T05:13:37.668 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/access/access05.c" 2024-01-31T05:13:37.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.668 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.668 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2841784172, 2024-01-31T05:13:37.668 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637104, 2024-01-31T05:13:37.668 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/access/access01.c" 2024-01-31T05:13:37.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.669 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.669 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2900721230, 2024-01-31T05:13:37.669 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635550, 2024-01-31T05:13:37.669 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test32" 2024-01-31T05:13:37.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.669 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.669 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 2973417145, 2024-01-31T05:13:37.669 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635075, 2024-01-31T05:13:37.669 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/threads_scenarii.c" 2024-01-31T05:13:37.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.669 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.669 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3078329606, 2024-01-31T05:13:37.670 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635541, 2024-01-31T05:13:37.670 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test09" 2024-01-31T05:13:37.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.670 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.670 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3094476506, 2024-01-31T05:13:37.670 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637717, 2024-01-31T05:13:37.670 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/access/access02.c" 2024-01-31T05:13:37.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.670 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.670 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3269472682, 2024-01-31T05:13:37.670 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635528, 2024-01-31T05:13:37.670 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test17" 2024-01-31T05:13:37.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.671 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.671 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3310716439, 2024-01-31T05:13:37.671 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635529, 2024-01-31T05:13:37.671 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test28" 2024-01-31T05:13:37.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.671 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.671 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3454231830, 2024-01-31T05:13:37.671 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637101, 2024-01-31T05:13:37.671 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/access/access03.c" 2024-01-31T05:13:37.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.671 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.671 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3458646227, 2024-01-31T05:13:37.671 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635524, 2024-01-31T05:13:37.671 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test13" 2024-01-31T05:13:37.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.672 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.672 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3499452828, 2024-01-31T05:13:37.672 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635073, 2024-01-31T05:13:37.672 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/NOTES" 2024-01-31T05:13:37.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.672 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.672 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3504666447, 2024-01-31T05:13:37.672 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511636049, 2024-01-31T05:13:37.672 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test20" 2024-01-31T05:13:37.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.673 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.673 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3512599925, 2024-01-31T05:13:37.673 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637793, 2024-01-31T05:13:37.673 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/personality/personality02.c" 2024-01-31T05:13:37.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.673 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.673 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3652903028, 2024-01-31T05:13:37.673 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635781, 2024-01-31T05:13:37.673 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/utsname/Makefile" 2024-01-31T05:13:37.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.673 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.673 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3670747192, 2024-01-31T05:13:37.674 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635553, 2024-01-31T05:13:37.674 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test35" 2024-01-31T05:13:37.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.674 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.674 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3670773174, 2024-01-31T05:13:37.674 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635534, 2024-01-31T05:13:37.674 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test12" 2024-01-31T05:13:37.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.674 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.674 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3718354949, 2024-01-31T05:13:37.674 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635538, 2024-01-31T05:13:37.674 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/00_Descriptions.txt" 2024-01-31T05:13:37.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.675 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.675 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3725875969, 2024-01-31T05:13:37.675 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635070, 2024-01-31T05:13:37.675 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/Makefile" 2024-01-31T05:13:37.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.675 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.675 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3905913833, 2024-01-31T05:13:37.675 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635555, 2024-01-31T05:13:37.675 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test31" 2024-01-31T05:13:37.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.675 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.675 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 3992620780, 2024-01-31T05:13:37.675 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635646, 2024-01-31T05:13:37.675 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/stress.c" 2024-01-31T05:13:37.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.676 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.676 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4107810518, 2024-01-31T05:13:37.676 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511637807, 2024-01-31T05:13:37.676 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/recvmsg/Makefile" 2024-01-31T05:13:37.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.676 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.676 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4111427913, 2024-01-31T05:13:37.676 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511638000, 2024-01-31T05:13:37.676 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/renameat/Makefile" 2024-01-31T05:13:37.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.677 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.677 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4149717588, 2024-01-31T05:13:37.677 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635549, 2024-01-31T05:13:37.677 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test16" 2024-01-31T05:13:37.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.677 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.677 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4216652488, 2024-01-31T05:13:37.677 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635783, 2024-01-31T05:13:37.677 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/utsname/check_utsns_enabled.c" 2024-01-31T05:13:37.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:13:37.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:13:37.677 INFO:teuthology.orchestra.run.smithi099.stdout: "damage_type": "backtrace", 2024-01-31T05:13:37.677 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4290165583, 2024-01-31T05:13:37.678 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 1099511635530, 2024-01-31T05:13:37.678 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test19" 2024-01-31T05:13:37.678 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:13:37.678 INFO:teuthology.orchestra.run.smithi099.stdout:] 2024-01-31T05:13:37.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.638+0000 7f1660e5e640 1 -- 172.21.15.99:0/42558018 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f16440a12e0 msgr2=0x7f16440a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:37.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.638+0000 7f1660e5e640 1 --2- 172.21.15.99:0/42558018 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f16440a12e0 0x7f16440a37a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f164c02cf50 tx=0x7f164c034af0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.638+0000 7f1660e5e640 1 -- 172.21.15.99:0/42558018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f165c1011e0 msgr2=0x7f165c109050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:37.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.638+0000 7f1660e5e640 1 --2- 172.21.15.99:0/42558018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f165c1011e0 0x7f165c109050 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f165400c370 tx=0x7f165400c830 comp rx=0 tx=0).stop 2024-01-31T05:13:37.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.638+0000 7f1660e5e640 1 -- 172.21.15.99:0/42558018 shutdown_connections 2024-01-31T05:13:37.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.638+0000 7f1660e5e640 1 --2- 172.21.15.99:0/42558018 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f16440a12e0 0x7f16440a37a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.638+0000 7f1660e5e640 1 --2- 172.21.15.99:0/42558018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f165c1011e0 0x7f165c109050 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.638+0000 7f1660e5e640 1 --2- 172.21.15.99:0/42558018 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f165c1007f0 0x7f165c108b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.638+0000 7f1660e5e640 1 --2- 172.21.15.99:0/42558018 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f165c0ffe30 0x7f165c10a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.638+0000 7f1660e5e640 1 -- 172.21.15.99:0/42558018 >> 172.21.15.99:0/42558018 conn(0x7f165c0fa900 msgr2=0x7f165c104230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:37.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.638+0000 7f1660e5e640 1 -- 172.21.15.99:0/42558018 shutdown_connections 2024-01-31T05:13:37.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.638+0000 7f1660e5e640 1 -- 172.21.15.99:0/42558018 wait complete. 2024-01-31T05:13:37.681 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-01-31T05:13:37.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.799+0000 7f3f3519a640 1 -- 172.21.15.99:0/1413315088 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f30100d20 msgr2=0x7f3f30101140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:37.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.799+0000 7f3f3519a640 1 --2- 172.21.15.99:0/1413315088 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f30100d20 0x7f3f30101140 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f3f20009900 tx=0x7f3f2002bc30 comp rx=0 tx=0).stop 2024-01-31T05:13:37.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.799+0000 7f3f3519a640 1 -- 172.21.15.99:0/1413315088 shutdown_connections 2024-01-31T05:13:37.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.799+0000 7f3f3519a640 1 --2- 172.21.15.99:0/1413315088 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f301028d0 0x7f3f30109160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.799+0000 7f3f3519a640 1 --2- 172.21.15.99:0/1413315088 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f30101f10 0x7f3f30102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.799+0000 7f3f3519a640 1 --2- 172.21.15.99:0/1413315088 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f30100d20 0x7f3f30101140 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.799+0000 7f3f3519a640 1 -- 172.21.15.99:0/1413315088 >> 172.21.15.99:0/1413315088 conn(0x7f3f300fc290 msgr2=0x7f3f300fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:37.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.799+0000 7f3f3519a640 1 -- 172.21.15.99:0/1413315088 shutdown_connections 2024-01-31T05:13:37.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.799+0000 7f3f3519a640 1 -- 172.21.15.99:0/1413315088 wait complete. 2024-01-31T05:13:37.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.800+0000 7f3f3519a640 1 Processor -- start 2024-01-31T05:13:37.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.800+0000 7f3f3519a640 1 -- start start 2024-01-31T05:13:37.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.800+0000 7f3f3519a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f30100d20 0x7f3f30196cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.800+0000 7f3f3519a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f30101f10 0x7f3f30197200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.800+0000 7f3f3519a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f301028d0 0x7f3f3019e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.800+0000 7f3f3519a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3019e7d0 con 0x7f3f30100d20 2024-01-31T05:13:37.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.800+0000 7f3f3519a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3019e940 con 0x7f3f301028d0 2024-01-31T05:13:37.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.800+0000 7f3f3519a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3019eb00 con 0x7f3f30101f10 2024-01-31T05:13:37.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.800+0000 7f3f2ed9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f30100d20 0x7f3f30196cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.800+0000 7f3f2ed9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f30100d20 0x7f3f30196cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35590/0 (socket says 172.21.15.99:35590) 2024-01-31T05:13:37.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.800+0000 7f3f2ed9d640 1 -- 172.21.15.99:0/1975966483 learned_addr learned my addr 172.21.15.99:0/1975966483 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:37.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.800+0000 7f3f2e59c640 1 --2- 172.21.15.99:0/1975966483 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f30101f10 0x7f3f30197200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.800+0000 7f3f2f59e640 1 --2- 172.21.15.99:0/1975966483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f301028d0 0x7f3f3019e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.800+0000 7f3f2ed9d640 1 -- 172.21.15.99:0/1975966483 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f30101f10 msgr2=0x7f3f30197200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:37.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.800+0000 7f3f2ed9d640 1 --2- 172.21.15.99:0/1975966483 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f30101f10 0x7f3f30197200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.800+0000 7f3f2ed9d640 1 -- 172.21.15.99:0/1975966483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f301028d0 msgr2=0x7f3f3019e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:37.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.800+0000 7f3f2ed9d640 1 --2- 172.21.15.99:0/1975966483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f301028d0 0x7f3f3019e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.800+0000 7f3f2ed9d640 1 -- 172.21.15.99:0/1975966483 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f20009560 con 0x7f3f30100d20 2024-01-31T05:13:37.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.801+0000 7f3f2ed9d640 1 --2- 172.21.15.99:0/1975966483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f30100d20 0x7f3f30196cc0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f3f20009230 tx=0x7f3f20004dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:37.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.801+0000 7f3f17fff640 1 -- 172.21.15.99:0/1975966483 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f200042d0 con 0x7f3f30100d20 2024-01-31T05:13:37.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.801+0000 7f3f3519a640 1 -- 172.21.15.99:0/1975966483 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f3019ed80 con 0x7f3f30100d20 2024-01-31T05:13:37.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.801+0000 7f3f17fff640 1 -- 172.21.15.99:0/1975966483 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3f20004430 con 0x7f3f30100d20 2024-01-31T05:13:37.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.801+0000 7f3f17fff640 1 -- 172.21.15.99:0/1975966483 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f20003d60 con 0x7f3f30100d20 2024-01-31T05:13:37.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.801+0000 7f3f3519a640 1 -- 172.21.15.99:0/1975966483 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f3019f1d0 con 0x7f3f30100d20 2024-01-31T05:13:37.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.803+0000 7f3f17fff640 1 -- 172.21.15.99:0/1975966483 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 20) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f3f20005000 con 0x7f3f30100d20 2024-01-31T05:13:37.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.803+0000 7f3f38036740 1 Processor -- start 2024-01-31T05:13:37.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.803+0000 7f3f38036740 1 -- start start 2024-01-31T05:13:37.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.804+0000 7f3f38036740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b85180f10 0x556b85181330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.804+0000 7f3f38036740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556b85181900 0x556b85186400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.804+0000 7f3f38036740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b85186a70 0x556b85188f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.804+0000 7f3f38036740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b850ef240 con 0x556b85186a70 2024-01-31T05:13:37.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.804+0000 7f3f38036740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b850ec930 con 0x556b85181900 2024-01-31T05:13:37.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.804+0000 7f3f38036740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b850e8220 con 0x556b85180f10 2024-01-31T05:13:37.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.804+0000 7f3f17fff640 1 --2- 172.21.15.99:0/1975966483 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f3f180a12e0 0x7f3f180a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.804+0000 7f3f2e59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b85186a70 0x556b85188f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.804+0000 7f3f2e59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b85186a70 0x556b85188f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35606/0 (socket says 172.21.15.99:35606) 2024-01-31T05:13:37.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.804+0000 7f3f2f59e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b85180f10 0x556b85181330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.804+0000 7f3f2e59c640 1 -- 172.21.15.99:0/3948741427 learned_addr learned my addr 172.21.15.99:0/3948741427 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:37.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.804+0000 7f3f2f59e640 1 --2- 172.21.15.99:0/1975966483 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f3f180a12e0 0x7f3f180a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.804+0000 7f3f2ed9d640 1 --2- 172.21.15.99:0/3948741427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556b85181900 0x556b85186400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.804+0000 7f3f17fff640 1 -- 172.21.15.99:0/1975966483 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f3f200ef260 con 0x7f3f30100d20 2024-01-31T05:13:37.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.804+0000 7f3f2e59c640 1 -- 172.21.15.99:0/3948741427 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b85180f10 msgr2=0x556b85181330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:37.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.804+0000 7f3f2e59c640 1 --2- 172.21.15.99:0/3948741427 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b85180f10 0x556b85181330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.804+0000 7f3f2e59c640 1 -- 172.21.15.99:0/3948741427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556b85181900 msgr2=0x556b85186400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:37.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.804+0000 7f3f2e59c640 1 --2- 172.21.15.99:0/3948741427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556b85181900 0x556b85186400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.804+0000 7f3f2e59c640 1 -- 172.21.15.99:0/3948741427 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556b850aa7c0 con 0x556b85186a70 2024-01-31T05:13:37.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.804+0000 7f3f2ed9d640 1 --2- 172.21.15.99:0/3948741427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556b85181900 0x556b85186400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:13:37.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.804+0000 7f3f2e59c640 1 --2- 172.21.15.99:0/3948741427 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b85186a70 0x556b85188f00 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f3f24009c90 tx=0x7f3f24011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f520e3762feb3155 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:37.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.804+0000 7f3f2f59e640 1 --2- 172.21.15.99:0/1975966483 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f3f180a12e0 0x7f3f180a37a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x556b85182160 tx=0x7f3f28009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:37.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.804+0000 7f3f157fa640 1 -- 172.21.15.99:0/3948741427 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f24019630 con 0x556b85186a70 2024-01-31T05:13:37.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.804+0000 7f3f157fa640 1 -- 172.21.15.99:0/3948741427 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3f24009e40 con 0x556b85186a70 2024-01-31T05:13:37.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.804+0000 7f3f157fa640 1 -- 172.21.15.99:0/3948741427 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2400ead0 con 0x556b85186a70 2024-01-31T05:13:37.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.805+0000 7f3f38036740 1 -- 172.21.15.99:0/3948741427 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b85186a70 msgr2=0x556b85188f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:37.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.805+0000 7f3f38036740 1 --2- 172.21.15.99:0/3948741427 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b85186a70 0x556b85188f00 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f3f24009c90 tx=0x7f3f24011810 comp rx=0 tx=0).stop 2024-01-31T05:13:37.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.805+0000 7f3f38036740 1 -- 172.21.15.99:0/3948741427 shutdown_connections 2024-01-31T05:13:37.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.805+0000 7f3f38036740 1 --2- 172.21.15.99:0/3948741427 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b85186a70 0x556b85188f00 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.805+0000 7f3f38036740 1 --2- 172.21.15.99:0/3948741427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556b85181900 0x556b85186400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.805+0000 7f3f38036740 1 --2- 172.21.15.99:0/3948741427 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b85180f10 0x556b85181330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.805+0000 7f3f38036740 1 -- 172.21.15.99:0/3948741427 >> 172.21.15.99:0/3948741427 conn(0x556b8517c480 msgr2=0x556b8517c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:37.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.805+0000 7f3f38036740 1 -- 172.21.15.99:0/3948741427 shutdown_connections 2024-01-31T05:13:37.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.805+0000 7f3f38036740 1 -- 172.21.15.99:0/3948741427 wait complete. 2024-01-31T05:13:37.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.805+0000 7f3f38036740 1 -- start start 2024-01-31T05:13:37.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.805+0000 7f3f38036740 1 Processor -- start 2024-01-31T05:13:37.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.806+0000 7f3f38036740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b85180f10 0x556b8518b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.806+0000 7f3f38036740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556b85181900 0x556b8518b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.806+0000 7f3f38036740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b85186a70 0x556b85192650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.806+0000 7f3f38036740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b850a15e0 con 0x556b85180f10 2024-01-31T05:13:37.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.806+0000 7f3f38036740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b850a1280 con 0x556b85181900 2024-01-31T05:13:37.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.806+0000 7f3f38036740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b850663d0 con 0x556b85186a70 2024-01-31T05:13:37.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.806+0000 7f3f38036740 10 client.0 _ll_register_callbacks cb 0x556b850deeb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:13:37.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.806+0000 7f3f2ed9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b85180f10 0x556b8518b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.806+0000 7f3f2ed9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b85180f10 0x556b8518b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35612/0 (socket says 172.21.15.99:35612) 2024-01-31T05:13:37.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.806+0000 7f3f2e59c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556b85181900 0x556b8518b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.806+0000 7f3f2ed9d640 1 -- 172.21.15.99:0/1507532735 learned_addr learned my addr 172.21.15.99:0/1507532735 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:37.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.806+0000 7f3f2f59e640 1 --2- 172.21.15.99:0/1507532735 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b85186a70 0x556b85192650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.806+0000 7f3f2ed9d640 1 -- 172.21.15.99:0/1507532735 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b85186a70 msgr2=0x556b85192650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:37.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.806+0000 7f3f2ed9d640 1 --2- 172.21.15.99:0/1507532735 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b85186a70 0x556b85192650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.806+0000 7f3f2ed9d640 1 -- 172.21.15.99:0/1507532735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556b85181900 msgr2=0x556b8518b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:37.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.806+0000 7f3f2ed9d640 1 --2- 172.21.15.99:0/1507532735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556b85181900 0x556b8518b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.806+0000 7f3f2ed9d640 1 -- 172.21.15.99:0/1507532735 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f240098f0 con 0x556b85180f10 2024-01-31T05:13:37.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.806+0000 7f3f2e59c640 1 --2- 172.21.15.99:0/1507532735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556b85181900 0x556b8518b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:13:37.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.806+0000 7f3f2ed9d640 1 --2- 172.21.15.99:0/1507532735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b85180f10 0x556b8518b0d0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f3f200b8ed0 tx=0x7f3f20045d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcc5717b5a287325 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:37.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.806+0000 7f3f12ff5640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:13:37.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.806+0000 7f3f12ff5640 1 -- 172.21.15.99:0/1507532735 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f200bcb60 con 0x556b85180f10 2024-01-31T05:13:37.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.806+0000 7f3f12ff5640 1 -- 172.21.15.99:0/1507532735 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f3f200d3060 con 0x556b85180f10 2024-01-31T05:13:37.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.806+0000 7f3f38036740 1 -- 172.21.15.99:0/1507532735 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556b850e10b0 con 0x556b85180f10 2024-01-31T05:13:37.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.807+0000 7f3f12ff5640 1 -- 172.21.15.99:0/1507532735 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f200bc460 con 0x556b85180f10 2024-01-31T05:13:37.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.807+0000 7f3f38036740 10 client.16191 fetch_fsmap learned FSMap version 38 2024-01-31T05:13:37.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.807+0000 7f3f38036740 1 -- 172.21.15.99:0/1507532735 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x556b850e68a0 con 0x556b85180f10 2024-01-31T05:13:37.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.807+0000 7f3f12ff5640 1 -- 172.21.15.99:0/1507532735 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556b850e10b0 con 0x556b85180f10 2024-01-31T05:13:37.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.807+0000 7f3f12ff5640 1 -- 172.21.15.99:0/1507532735 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 38) v1 ==== 7930+0+0 (secure 0 0 0) 0x7f3f2003c070 con 0x556b85180f10 2024-01-31T05:13:37.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.807+0000 7f3f38036740 10 client.16191 fetch_fsmap finished waiting for FSMap version 38 2024-01-31T05:13:37.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.807+0000 7f3f38036740 10 client.16191 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-01-31T05:13:37.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.807+0000 7f3f38036740 20 client.16191 populate_metadata read hostname 'smithi099' 2024-01-31T05:13:37.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.807+0000 7f3f38036740 1 --2- 172.21.15.99:0/1507532735 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x556b85196d00 0x556b85199120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.807+0000 7f3f38036740 4 client.16191 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:13:37.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.807+0000 7f3f38036740 1 -- 172.21.15.99:0/1507532735 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556b850e0dd0 con 0x556b85196d00 2024-01-31T05:13:37.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.807+0000 7f3f2e59c640 1 --2- 172.21.15.99:0/1507532735 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x556b85196d00 0x556b85199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.807+0000 7f3f12ff5640 10 client.16191 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:13:37.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.807+0000 7f3f2e59c640 1 --2- 172.21.15.99:0/1507532735 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x556b85196d00 0x556b85199120 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3010a24e680f490 server_cookie=1cc4f5789a8c3f24 in_seq=0 out_seq=0 2024-01-31T05:13:37.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.808+0000 7f3f12ff5640 1 -- 172.21.15.99:0/1507532735 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556b850e0dd0 con 0x556b85196d00 2024-01-31T05:13:37.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.808+0000 7f3f12ff5640 10 client.16191 handle_command_reply: tid=0 2024-01-31T05:13:37.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.808+0000 7f3f38036740 1 client.16191 shutdown 2024-01-31T05:13:37.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.808+0000 7f3f38036740 1 -- 172.21.15.99:0/1507532735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b85180f10 msgr2=0x556b8518b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:37.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.808+0000 7f3f38036740 1 --2- 172.21.15.99:0/1507532735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b85180f10 0x556b8518b0d0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f3f200b8ed0 tx=0x7f3f20045d10 comp rx=0 tx=0).stop 2024-01-31T05:13:37.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.808+0000 7f3f38036740 1 -- 172.21.15.99:0/1507532735 shutdown_connections 2024-01-31T05:13:37.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.808+0000 7f3f38036740 1 --2- 172.21.15.99:0/1507532735 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b85186a70 0x556b85192650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.808+0000 7f3f38036740 1 --2- 172.21.15.99:0/1507532735 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x556b85196d00 0x556b85199120 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.808+0000 7f3f38036740 1 --2- 172.21.15.99:0/1507532735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556b85181900 0x556b8518b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.808+0000 7f3f38036740 1 --2- 172.21.15.99:0/1507532735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b85180f10 0x556b8518b0d0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.808+0000 7f3f12ff5640 0 client.16191 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:13:37.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.808+0000 7f3f38036740 1 -- 172.21.15.99:0/1507532735 >> 172.21.15.99:0/1507532735 conn(0x556b8517c480 msgr2=0x556b8517b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:37.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.808+0000 7f3f38036740 1 -- 172.21.15.99:0/1507532735 shutdown_connections 2024-01-31T05:13:37.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.808+0000 7f3f38036740 1 -- 172.21.15.99:0/1507532735 wait complete. 2024-01-31T05:13:37.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.808+0000 7f3f38036740 20 client.16191 trim_cache size 0 max 16384 2024-01-31T05:13:37.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.820+0000 7f3f38036740 1 Processor -- start 2024-01-31T05:13:37.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.820+0000 7f3f38036740 1 -- start start 2024-01-31T05:13:37.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.820+0000 7f3f38036740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b85180f10 0x556b8518ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.820+0000 7f3f38036740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b85181900 0x556b8518b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.820+0000 7f3f38036740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556b85186a70 0x556b8517af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.820+0000 7f3f38036740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b85177ab0 con 0x556b85181900 2024-01-31T05:13:37.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.820+0000 7f3f38036740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b85178260 con 0x556b85186a70 2024-01-31T05:13:37.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.820+0000 7f3f38036740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b850e0dd0 con 0x556b85180f10 2024-01-31T05:13:37.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.820+0000 7f3f2e59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b85181900 0x556b8518b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.820+0000 7f3f2e59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b85181900 0x556b8518b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35622/0 (socket says 172.21.15.99:35622) 2024-01-31T05:13:37.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.820+0000 7f3f2e59c640 1 -- 172.21.15.99:0/3154282645 learned_addr learned my addr 172.21.15.99:0/3154282645 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:37.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.820+0000 7f3f2ed9d640 1 --2- 172.21.15.99:0/3154282645 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b85180f10 0x556b8518ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.821+0000 7f3f2e59c640 1 -- 172.21.15.99:0/3154282645 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b85180f10 msgr2=0x556b8518ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:37.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.821+0000 7f3f2e59c640 1 --2- 172.21.15.99:0/3154282645 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b85180f10 0x556b8518ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.821+0000 7f3f2e59c640 1 -- 172.21.15.99:0/3154282645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556b85186a70 msgr2=0x556b8517af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:37.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.821+0000 7f3f2e59c640 1 --2- 172.21.15.99:0/3154282645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556b85186a70 0x556b8517af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.821+0000 7f3f2e59c640 1 -- 172.21.15.99:0/3154282645 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556b850834d0 con 0x556b85181900 2024-01-31T05:13:37.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.821+0000 7f3f2e59c640 1 --2- 172.21.15.99:0/3154282645 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b85181900 0x556b8518b220 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f3f24014040 tx=0x7f3f24009bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad22f2faee736c57 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:37.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.821+0000 7f3f14ff9640 1 -- 172.21.15.99:0/3154282645 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f24029070 con 0x556b85181900 2024-01-31T05:13:37.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.821+0000 7f3f14ff9640 1 -- 172.21.15.99:0/3154282645 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3f24003ab0 con 0x556b85181900 2024-01-31T05:13:37.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.821+0000 7f3f14ff9640 1 -- 172.21.15.99:0/3154282645 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2400e820 con 0x556b85181900 2024-01-31T05:13:37.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.821+0000 7f3f38036740 1 -- 172.21.15.99:0/3154282645 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b85181900 msgr2=0x556b8518b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:37.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.822+0000 7f3f38036740 1 --2- 172.21.15.99:0/3154282645 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b85181900 0x556b8518b220 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f3f24014040 tx=0x7f3f24009bc0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.822+0000 7f3f38036740 1 -- 172.21.15.99:0/3154282645 shutdown_connections 2024-01-31T05:13:37.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.822+0000 7f3f38036740 1 --2- 172.21.15.99:0/3154282645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556b85186a70 0x556b8517af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.822+0000 7f3f38036740 1 --2- 172.21.15.99:0/3154282645 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b85181900 0x556b8518b220 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.822+0000 7f3f38036740 1 --2- 172.21.15.99:0/3154282645 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b85180f10 0x556b8518ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.822+0000 7f3f38036740 1 -- 172.21.15.99:0/3154282645 >> 172.21.15.99:0/3154282645 conn(0x556b8517c480 msgr2=0x556b85182e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:37.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.822+0000 7f3f38036740 1 -- 172.21.15.99:0/3154282645 shutdown_connections 2024-01-31T05:13:37.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.822+0000 7f3f38036740 1 -- 172.21.15.99:0/3154282645 wait complete. 2024-01-31T05:13:37.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.822+0000 7f3f38036740 1 -- start start 2024-01-31T05:13:37.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.822+0000 7f3f38036740 1 Processor -- start 2024-01-31T05:13:37.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.822+0000 7f3f38036740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556b85180f10 0x556b851e9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.822+0000 7f3f38036740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b85181900 0x556b851ea4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.822+0000 7f3f38036740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b85186a70 0x556b851f14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.822+0000 7f3f38036740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b851f1a20 con 0x556b85186a70 2024-01-31T05:13:37.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.822+0000 7f3f38036740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b851f1b60 con 0x556b85180f10 2024-01-31T05:13:37.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.822+0000 7f3f38036740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b851f1cd0 con 0x556b85181900 2024-01-31T05:13:37.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.822+0000 7f3f38036740 10 client.0 _ll_register_callbacks cb 0x7f3f240097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:13:37.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.822+0000 7f3f2f59e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b85186a70 0x556b851f14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.822+0000 7f3f2ed9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556b85180f10 0x556b851e9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.822+0000 7f3f2f59e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b85186a70 0x556b851f14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35630/0 (socket says 172.21.15.99:35630) 2024-01-31T05:13:37.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.822+0000 7f3f2f59e640 1 -- 172.21.15.99:0/2056791278 learned_addr learned my addr 172.21.15.99:0/2056791278 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:37.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.822+0000 7f3f2e59c640 1 --2- 172.21.15.99:0/2056791278 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b85181900 0x556b851ea4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.822+0000 7f3f2f59e640 1 -- 172.21.15.99:0/2056791278 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b85181900 msgr2=0x556b851ea4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:37.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.822+0000 7f3f2f59e640 1 --2- 172.21.15.99:0/2056791278 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b85181900 0x556b851ea4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.822+0000 7f3f2f59e640 1 -- 172.21.15.99:0/2056791278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556b85180f10 msgr2=0x556b851e9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:37.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.823+0000 7f3f2f59e640 1 --2- 172.21.15.99:0/2056791278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556b85180f10 0x556b851e9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.823+0000 7f3f2f59e640 1 -- 172.21.15.99:0/2056791278 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556b850aa7c0 con 0x556b85186a70 2024-01-31T05:13:37.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.823+0000 7f3f2ed9d640 1 --2- 172.21.15.99:0/2056791278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556b85180f10 0x556b851e9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:13:37.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.823+0000 7f3f2f59e640 1 --2- 172.21.15.99:0/2056791278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b85186a70 0x556b851f14e0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f3f28009270 tx=0x7f3f28009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1855155092bcb72 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:37.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.823+0000 7f3f12ff5640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:13:37.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.823+0000 7f3f12ff5640 1 -- 172.21.15.99:0/2056791278 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f28025070 con 0x556b85186a70 2024-01-31T05:13:37.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.823+0000 7f3f12ff5640 1 -- 172.21.15.99:0/2056791278 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f3f280044b0 con 0x556b85186a70 2024-01-31T05:13:37.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.823+0000 7f3f38036740 1 -- 172.21.15.99:0/2056791278 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3f24009e40 con 0x556b85186a70 2024-01-31T05:13:37.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.823+0000 7f3f12ff5640 1 -- 172.21.15.99:0/2056791278 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f28004670 con 0x556b85186a70 2024-01-31T05:13:37.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.823+0000 7f3f38036740 10 client.16197 fetch_fsmap learned FSMap version 38 2024-01-31T05:13:37.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.823+0000 7f3f38036740 1 -- 172.21.15.99:0/2056791278 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x556b850a9020 con 0x556b85186a70 2024-01-31T05:13:37.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.823+0000 7f3f12ff5640 1 -- 172.21.15.99:0/2056791278 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3f24009e40 con 0x556b85186a70 2024-01-31T05:13:37.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.823+0000 7f3f12ff5640 1 -- 172.21.15.99:0/2056791278 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 38) v1 ==== 7930+0+0 (secure 0 0 0) 0x7f3f2802b410 con 0x556b85186a70 2024-01-31T05:13:37.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.823+0000 7f3f38036740 10 client.16197 fetch_fsmap finished waiting for FSMap version 38 2024-01-31T05:13:37.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.823+0000 7f3f38036740 10 client.16197 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-01-31T05:13:37.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.823+0000 7f3f38036740 20 client.16197 populate_metadata read hostname 'smithi099' 2024-01-31T05:13:37.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.823+0000 7f3f38036740 1 --2- 172.21.15.99:0/2056791278 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x556b851f3980 0x556b851f5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:37.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.823+0000 7f3f38036740 4 client.16197 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-01-31T05:13:37.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.823+0000 7f3f38036740 1 -- 172.21.15.99:0/2056791278 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556b84de77e0 con 0x556b851f3980 2024-01-31T05:13:37.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.824+0000 7f3f2ed9d640 1 --2- 172.21.15.99:0/2056791278 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x556b851f3980 0x556b851f5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:37.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.824+0000 7f3f12ff5640 10 client.16197 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:13:37.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.824+0000 7f3f2ed9d640 1 --2- 172.21.15.99:0/2056791278 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x556b851f3980 0x556b851f5da0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=574e4be64d7a02b server_cookie=177936884ff1f6b0 in_seq=0 out_seq=0 2024-01-31T05:13:37.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.824+0000 7f3f12ff5640 1 -- 172.21.15.99:0/2056791278 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556b84de77e0 con 0x556b851f3980 2024-01-31T05:13:37.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.824+0000 7f3f12ff5640 10 client.16197 handle_command_reply: tid=0 2024-01-31T05:13:37.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.824+0000 7f3f38036740 1 client.16197 shutdown 2024-01-31T05:13:37.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.824+0000 7f3f38036740 1 -- 172.21.15.99:0/2056791278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b85186a70 msgr2=0x556b851f14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:37.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.824+0000 7f3f38036740 1 --2- 172.21.15.99:0/2056791278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b85186a70 0x556b851f14e0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f3f28009270 tx=0x7f3f28009bb0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.824+0000 7f3f38036740 1 -- 172.21.15.99:0/2056791278 shutdown_connections 2024-01-31T05:13:37.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.824+0000 7f3f38036740 1 --2- 172.21.15.99:0/2056791278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556b85186a70 0x556b851f14e0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.824+0000 7f3f38036740 1 --2- 172.21.15.99:0/2056791278 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556b85181900 0x556b851ea4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.824+0000 7f3f38036740 1 --2- 172.21.15.99:0/2056791278 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x556b851f3980 0x556b851f5da0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.824+0000 7f3f38036740 1 --2- 172.21.15.99:0/2056791278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556b85180f10 0x556b851e9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.824+0000 7f3f12ff5640 0 client.16197 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:13:37.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.824+0000 7f3f38036740 1 -- 172.21.15.99:0/2056791278 >> 172.21.15.99:0/2056791278 conn(0x556b8517c480 msgr2=0x556b8518ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:37.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.824+0000 7f3f38036740 1 -- 172.21.15.99:0/2056791278 shutdown_connections 2024-01-31T05:13:37.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.824+0000 7f3f38036740 1 -- 172.21.15.99:0/2056791278 wait complete. 2024-01-31T05:13:37.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.824+0000 7f3f38036740 20 client.16197 trim_cache size 0 max 16384 2024-01-31T05:13:37.833 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-01-31T05:13:37.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.825+0000 7f3f3519a640 1 -- 172.21.15.99:0/1975966483 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f3f180a12e0 msgr2=0x7f3f180a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:37.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.825+0000 7f3f3519a640 1 --2- 172.21.15.99:0/1975966483 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f3f180a12e0 0x7f3f180a37a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x556b85182160 tx=0x7f3f28009500 comp rx=0 tx=0).stop 2024-01-31T05:13:37.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.825+0000 7f3f3519a640 1 -- 172.21.15.99:0/1975966483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f30100d20 msgr2=0x7f3f30196cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:37.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.825+0000 7f3f3519a640 1 --2- 172.21.15.99:0/1975966483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f30100d20 0x7f3f30196cc0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f3f20009230 tx=0x7f3f20004dd0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.825+0000 7f3f3519a640 1 -- 172.21.15.99:0/1975966483 shutdown_connections 2024-01-31T05:13:37.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.825+0000 7f3f3519a640 1 --2- 172.21.15.99:0/1975966483 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f3f180a12e0 0x7f3f180a37a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.825+0000 7f3f3519a640 1 --2- 172.21.15.99:0/1975966483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f301028d0 0x7f3f3019e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.825+0000 7f3f3519a640 1 --2- 172.21.15.99:0/1975966483 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f30101f10 0x7f3f30197200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.825+0000 7f3f3519a640 1 --2- 172.21.15.99:0/1975966483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f30100d20 0x7f3f30196cc0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:37.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.825+0000 7f3f3519a640 1 -- 172.21.15.99:0/1975966483 >> 172.21.15.99:0/1975966483 conn(0x7f3f300fc290 msgr2=0x7f3f30105290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:37.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.825+0000 7f3f3519a640 1 -- 172.21.15.99:0/1975966483 shutdown_connections 2024-01-31T05:13:37.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:13:37.825+0000 7f3f3519a640 1 -- 172.21.15.99:0/1975966483 wait complete. 2024-01-31T05:13:37.836 ERROR:tasks.fwd_scrub:rank 4 damaged: [{'damage_type': 'backtrace', 'id': 9468209, 'ino': 1099511636719, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_sigkill.te'}, {'damage_type': 'backtrace', 'id': 73693379, 'ino': 1099511636718, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_fdreceive.te'}, {'damage_type': 'backtrace', 'id': 85489341, 'ino': 1099511636364, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/aio/aio01/Makefile'}, {'damage_type': 'backtrace', 'id': 87092543, 'ino': 1099511635812, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns03.c'}, {'damage_type': 'backtrace', 'id': 93772553, 'ino': 1099511636721, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_relabel.te'}, {'damage_type': 'backtrace', 'id': 182590143, 'ino': 1099511636722, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_sysctl.te'}, {'damage_type': 'backtrace', 'id': 220402213, 'ino': 1099511635356, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks'}, {'damage_type': 'backtrace', 'id': 234435619, 'ino': 1099511635814, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns20.c'}, {'damage_type': 'backtrace', 'id': 241741068, 'ino': 1099511635393, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/stress.c'}, {'damage_type': 'backtrace', 'id': 295933448, 'ino': 1099511635357, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks/Makefile'}, {'damage_type': 'backtrace', 'id': 300746224, 'ino': 1099511635355, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/coverage.txt'}, {'damage_type': 'backtrace', 'id': 321352611, 'ino': 1099511636063, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/pthreads/pth_str01.h'}, {'damage_type': 'backtrace', 'id': 356941741, 'ino': 1099511635813, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns04.c'}, {'damage_type': 'backtrace', 'id': 404082670, 'ino': 1099511635068, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/NOTES'}, {'damage_type': 'backtrace', 'id': 430152618, 'ino': 1099511635639, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/pthreads/Makefile'}, {'damage_type': 'backtrace', 'id': 480825046, 'ino': 1099511635815, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns16.c'}, {'damage_type': 'backtrace', 'id': 547765345, 'ino': 1099511635803, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns12.c'}, {'damage_type': 'backtrace', 'id': 548791768, 'ino': 1099511636642, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_policy.if'}, {'damage_type': 'backtrace', 'id': 611434046, 'ino': 1099511634901, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks/invaliddates.c'}, {'damage_type': 'backtrace', 'id': 618856528, 'ino': 1099511636635, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_setnice.te'}, {'damage_type': 'backtrace', 'id': 685129943, 'ino': 1099511635359, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers/Makefile'}, {'damage_type': 'backtrace', 'id': 765124000, 'ino': 1099511635817, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns30.c'}, {'damage_type': 'backtrace', 'id': 861302020, 'ino': 1099511636713, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_execshare.te'}, {'damage_type': 'backtrace', 'id': 869040392, 'ino': 1099511637129, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sgetmask/Makefile'}, {'damage_type': 'backtrace', 'id': 879406549, 'ino': 1099511636723, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_dyntrans.te'}, {'damage_type': 'backtrace', 'id': 911416436, 'ino': 1099511634900, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks/twopsetclock.c'}, {'damage_type': 'backtrace', 'id': 956002919, 'ino': 1099511636720, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_open.te'}, {'damage_type': 'backtrace', 'id': 956565295, 'ino': 1099511636734, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_inherit.te'}, {'damage_type': 'backtrace', 'id': 961914881, 'ino': 1099511635159, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/vmtests/stack_space.c'}, {'damage_type': 'backtrace', 'id': 969733216, 'ino': 1099511635642, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/pthreads/pth_str02.c'}, {'damage_type': 'backtrace', 'id': 981969688, 'ino': 1099511637745, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sgetmask/sgetmask01.c'}, {'damage_type': 'backtrace', 'id': 985447773, 'ino': 1099511636643, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_mkdir.te'}, {'damage_type': 'backtrace', 'id': 1137705744, 'ino': 1099511635809, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns13.c'}, {'damage_type': 'backtrace', 'id': 1187515402, 'ino': 1099511636715, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/Makefile'}, {'damage_type': 'backtrace', 'id': 1192300756, 'ino': 1099511636709, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_stat.te'}, {'damage_type': 'backtrace', 'id': 1197401422, 'ino': 1099511636644, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_ptrace.te'}, {'damage_type': 'backtrace', 'id': 1222956303, 'ino': 1099511635808, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns17.c'}, {'damage_type': 'backtrace', 'id': 1320307053, 'ino': 1099511636733, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_rxdir.te'}, {'damage_type': 'backtrace', 'id': 1334262837, 'ino': 1099511635810, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns31.c'}, {'damage_type': 'backtrace', 'id': 1340622293, 'ino': 1099511636732, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_task_create.te'}, {'damage_type': 'backtrace', 'id': 1373515725, 'ino': 1099511636710, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_execute_no_trans.te'}, {'damage_type': 'backtrace', 'id': 1457072414, 'ino': 1099511636728, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_dyntrace.te'}, {'damage_type': 'backtrace', 'id': 1491275114, 'ino': 1099511634904, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/run.sh'}, {'damage_type': 'backtrace', 'id': 1501204855, 'ino': 1099511635811, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/README'}, {'damage_type': 'backtrace', 'id': 1505170828, 'ino': 1099511636716, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_wait.te'}, {'damage_type': 'backtrace', 'id': 1509477444, 'ino': 1099511634902, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers/twoevtimers.c'}, {'damage_type': 'backtrace', 'id': 1514318455, 'ino': 1099511637069, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/wait4/wait401.c'}, {'damage_type': 'backtrace', 'id': 1603718702, 'ino': 1099511635807, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/runpidnstest.sh'}, {'damage_type': 'backtrace', 'id': 1640393753, 'ino': 1099511636729, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_task_getsched.te'}, {'damage_type': 'backtrace', 'id': 1657276184, 'ino': 1099511634898, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/Makefile'}, {'damage_type': 'backtrace', 'id': 1710490270, 'ino': 1099511635160, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/vmtests/data_space.c'}, {'damage_type': 'backtrace', 'id': 1714178056, 'ino': 1099511636731, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_task_getsid.te'}, {'damage_type': 'backtrace', 'id': 1793362971, 'ino': 1099511634905, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/plan.txt'}, {'damage_type': 'backtrace', 'id': 1828456547, 'ino': 1099511634983, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/testfrmw.c'}, {'damage_type': 'backtrace', 'id': 1888928850, 'ino': 1099511635901, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/writetest/writetest.c'}, {'damage_type': 'backtrace', 'id': 1893756085, 'ino': 1099511636726, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_exectrace.te'}, {'damage_type': 'backtrace', 'id': 1924695563, 'ino': 1099511637753, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sched_yield/sched_yield01.c'}, {'damage_type': 'backtrace', 'id': 1964287920, 'ino': 1099511636923, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll_create1/epoll_create1_01.c'}, {'damage_type': 'backtrace', 'id': 2054056691, 'ino': 1099511635900, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/aio/aio01/aio01.c'}, {'damage_type': 'backtrace', 'id': 2062174332, 'ino': 1099511635684, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/vmtests/Makefile'}, {'damage_type': 'backtrace', 'id': 2111689328, 'ino': 1099511637024, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_rename.te'}, {'damage_type': 'backtrace', 'id': 2139854376, 'ino': 1099511636343, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns02.c'}, {'damage_type': 'backtrace', 'id': 2153104073, 'ino': 1099511636725, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_setattr.te'}, {'damage_type': 'backtrace', 'id': 2180303108, 'ino': 1099511637034, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setegid/setegid01.c'}, {'damage_type': 'backtrace', 'id': 2191190163, 'ino': 1099511635902, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/writetest/gpl.txt'}, {'damage_type': 'backtrace', 'id': 2291902148, 'ino': 1099511635641, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/pthreads/pth_str03.c'}, {'damage_type': 'backtrace', 'id': 2367145305, 'ino': 1099511637137, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sched_yield/Makefile'}, {'damage_type': 'backtrace', 'id': 2413228119, 'ino': 1099511636724, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_transition.te'}, {'damage_type': 'backtrace', 'id': 2516518835, 'ino': 1099511636641, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_readlink.te'}, {'damage_type': 'backtrace', 'id': 2659977834, 'ino': 1099511635802, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns06.c'}, {'damage_type': 'backtrace', 'id': 2677084489, 'ino': 1099511637068, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/wait4/wait402.c'}, {'damage_type': 'backtrace', 'id': 2685112848, 'ino': 1099511636717, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_entrypoint.te'}, {'damage_type': 'backtrace', 'id': 2872310622, 'ino': 1099511635067, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/testfrmw.h'}, {'damage_type': 'backtrace', 'id': 2924376330, 'ino': 1099511636639, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_task_setsched.te'}, {'damage_type': 'backtrace', 'id': 2957520350, 'ino': 1099511636637, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_ipc.te'}, {'damage_type': 'backtrace', 'id': 2991346579, 'ino': 1099511636636, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_link.te'}, {'damage_type': 'backtrace', 'id': 3120588064, 'ino': 1099511635640, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/pthreads/pth_str01.c'}, {'damage_type': 'backtrace', 'id': 3147379371, 'ino': 1099511636714, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_file.te'}, {'damage_type': 'backtrace', 'id': 3200778098, 'ino': 1099511636712, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_capable_sys.te'}, {'damage_type': 'backtrace', 'id': 3247303953, 'ino': 1099511635806, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/Makefile'}, {'damage_type': 'backtrace', 'id': 3269687231, 'ino': 1099511636730, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_capable_net.te'}, {'damage_type': 'backtrace', 'id': 3282276612, 'ino': 1099511636366, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/writetest/Makefile'}, {'damage_type': 'backtrace', 'id': 3388504079, 'ino': 1099511636711, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_task_getpgid.te'}, {'damage_type': 'backtrace', 'id': 3439240981, 'ino': 1099511635816, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns05.c'}, {'damage_type': 'backtrace', 'id': 3445123495, 'ino': 1099511634903, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers/twoptimers.c'}, {'damage_type': 'backtrace', 'id': 3459781208, 'ino': 1099511636634, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_task_setpgid.te'}, {'damage_type': 'backtrace', 'id': 3484775275, 'ino': 1099511634982, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/Makefile'}, {'damage_type': 'backtrace', 'id': 3507960926, 'ino': 1099511636638, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_ioctl.te'}, {'damage_type': 'backtrace', 'id': 3584699627, 'ino': 1099511635804, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns10.c'}, {'damage_type': 'backtrace', 'id': 3596465967, 'ino': 1099511635358, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers'}, {'damage_type': 'backtrace', 'id': 3607588523, 'ino': 1099511635805, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns/pidns01.c'}, {'damage_type': 'backtrace', 'id': 3687755089, 'ino': 1099511634899, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/assertions.xml'}, {'damage_type': 'backtrace', 'id': 3801739144, 'ino': 1099511635069, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/LICENCE'}, {'damage_type': 'backtrace', 'id': 3914191286, 'ino': 1099511636727, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_global.te'}, {'damage_type': 'backtrace', 'id': 3939263850, 'ino': 1099511636640, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5/test_capable_file.te'}, {'damage_type': 'backtrace', 'id': 4039223270, 'ino': 1099511637667, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setegid/Makefile'}, {'damage_type': 'backtrace', 'id': 4110723647, 'ino': 1099511637394, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/epoll_create1/Makefile'}, {'damage_type': 'backtrace', 'id': 4224895085, 'ino': 1099511637693, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/wait4/Makefile'}] 2024-01-31T05:13:37.837 ERROR:tasks.fwd_scrub:rank 3 damaged: [{'damage_type': 'backtrace', 'id': 3436862, 'ino': 1099511637008, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src'}, {'damage_type': 'backtrace', 'id': 5013199, 'ino': 1099511636807, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_capable_sys.sh'}, {'damage_type': 'backtrace', 'id': 5102006, 'ino': 1099511636622, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_mkdir.te'}, {'damage_type': 'backtrace', 'id': 6553805, 'ino': 1099511636567, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/Makefile'}, {'damage_type': 'backtrace', 'id': 18339753, 'ino': 1099511636810, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_nice.c'}, {'damage_type': 'backtrace', 'id': 40003341, 'ino': 1099511636545, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/notroot.c'}, {'damage_type': 'backtrace', 'id': 46718451, 'ino': 1099511636744, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_setattr.te'}, {'damage_type': 'backtrace', 'id': 57884436, 'ino': 1099511637316, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys'}, {'damage_type': 'backtrace', 'id': 62517879, 'ino': 1099511636573, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/cap_bounds_r.c'}, {'damage_type': 'backtrace', 'id': 83461041, 'ino': 1099511636774, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ptrace/selinux_ptrace_wait.sh'}, {'damage_type': 'backtrace', 'id': 99840133, 'ino': 1099511636778, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/inherit/selinux_inherit.sh'}, {'damage_type': 'backtrace', 'id': 99883120, 'ino': 1099511636746, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_global.te'}, {'damage_type': 'backtrace', 'id': 101948988, 'ino': 1099511637291, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ptrace'}, {'damage_type': 'backtrace', 'id': 106159548, 'ino': 1099511637328, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/domain_trans'}, {'damage_type': 'backtrace', 'id': 141082177, 'ino': 1099511637333, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/readlink/Makefile'}, {'damage_type': 'backtrace', 'id': 183993949, 'ino': 1099511636542, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_doi.sh'}, {'damage_type': 'backtrace', 'id': 186533812, 'ino': 1099511636851, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/rxdir/Makefile'}, {'damage_type': 'backtrace', 'id': 214972330, 'ino': 1099511636551, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/p9auth/runp9auth.sh'}, {'damage_type': 'backtrace', 'id': 222581309, 'ino': 1099511636819, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrans/selinux_dyntrans_parent.c'}, {'damage_type': 'backtrace', 'id': 230335495, 'ino': 1099511635785, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/Makefile'}, {'damage_type': 'backtrace', 'id': 246010014, 'ino': 1099511636859, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/tomoyo/tomoyo_file_test.c'}, {'damage_type': 'backtrace', 'id': 248679825, 'ino': 1099511636877, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/assign_password.sh'}, {'damage_type': 'backtrace', 'id': 252880777, 'ino': 1099511637336, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sigkill'}, {'damage_type': 'backtrace', 'id': 258115547, 'ino': 1099511637277, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/relabel'}, {'damage_type': 'backtrace', 'id': 263935388, 'ino': 1099511636569, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/run_capbounds.sh'}, {'damage_type': 'backtrace', 'id': 267607926, 'ino': 1099511635801, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns/mqns_01.c'}, {'damage_type': 'backtrace', 'id': 268466860, 'ino': 1099511636547, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_load.sh'}, {'damage_type': 'backtrace', 'id': 279256678, 'ino': 1099511636771, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setattr/selinux_setattr.sh'}, {'damage_type': 'backtrace', 'id': 282654958, 'ino': 1099511636860, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/tomoyo/newns.c'}, {'damage_type': 'backtrace', 'id': 291216287, 'ino': 1099511635827, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/check_netns_enabled.c'}, {'damage_type': 'backtrace', 'id': 291536351, 'ino': 1099511636566, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/cap_bounds_rw.c'}, {'damage_type': 'backtrace', 'id': 291713127, 'ino': 1099511636850, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/bounds/selinux_bounds_thread.c'}, {'damage_type': 'backtrace', 'id': 295711732, 'ino': 1099511636853, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getsid/selinux_task_getsid.sh'}, {'damage_type': 'backtrace', 'id': 297819612, 'ino': 1099511636831, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/msg/selinux_msgget.c'}, {'damage_type': 'backtrace', 'id': 311727462, 'ino': 1099511637015, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/exec_without_inh.c'}, {'damage_type': 'backtrace', 'id': 317401247, 'ino': 1099511636873, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/README'}, {'damage_type': 'backtrace', 'id': 317582072, 'ino': 1099511636591, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_file.te'}, {'damage_type': 'backtrace', 'id': 317861344, 'ino': 1099511636844, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/fdreceive/selinux_fdreceive_server.c'}, {'damage_type': 'backtrace', 'id': 318046772, 'ino': 1099511636779, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/inherit/Makefile'}, {'damage_type': 'backtrace', 'id': 321941904, 'ino': 1099511636747, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_dyntrace.te'}, {'damage_type': 'backtrace', 'id': 330248364, 'ino': 1099511637348, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setnice'}, {'damage_type': 'backtrace', 'id': 375280137, 'ino': 1099511637330, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/wait'}, {'damage_type': 'backtrace', 'id': 377941292, 'ino': 1099511637020, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy'}, {'damage_type': 'backtrace', 'id': 403268660, 'ino': 1099511636595, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_socket.te'}, {'damage_type': 'backtrace', 'id': 404769836, 'ino': 1099511637339, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ioctl/selinux_ioctl.sh'}, {'damage_type': 'backtrace', 'id': 427516491, 'ino': 1099511635841, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/nw_under_ns.sh'}, {'damage_type': 'backtrace', 'id': 428226298, 'ino': 1099511636755, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/relabel/selinux_relabel.sh'}, {'damage_type': 'backtrace', 'id': 433884155, 'ino': 1099511637346, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/fdreceive'}, {'damage_type': 'backtrace', 'id': 445144241, 'ino': 1099511637295, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execute_no_trans'}, {'damage_type': 'backtrace', 'id': 455220273, 'ino': 1099511636601, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_dyntrans.te'}, {'damage_type': 'backtrace', 'id': 456862412, 'ino': 1099511636339, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/mesgq_nstest.c'}, {'damage_type': 'backtrace', 'id': 461116970, 'ino': 1099511636550, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_cipso.sh'}, {'damage_type': 'backtrace', 'id': 475643869, 'ino': 1099511636823, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/wait/Makefile'}, {'damage_type': 'backtrace', 'id': 485566783, 'ino': 1099511635839, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/runallnetworktests_parent.sh'}, {'damage_type': 'backtrace', 'id': 514363824, 'ino': 1099511636782, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_mmap.c'}, {'damage_type': 'backtrace', 'id': 547211181, 'ino': 1099511635848, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/childipv6.sh'}, {'damage_type': 'backtrace', 'id': 552675717, 'ino': 1099511636763, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/shm/Makefile'}, {'damage_type': 'backtrace', 'id': 568507279, 'ino': 1099511636871, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/LICENSE'}, {'damage_type': 'backtrace', 'id': 572009320, 'ino': 1099511636801, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setpgid/selinux_task_setpgid.sh'}, {'damage_type': 'backtrace', 'id': 573417428, 'ino': 1099511637001, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/p9auth'}, {'damage_type': 'backtrace', 'id': 575240955, 'ino': 1099511636863, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/checkforlibcap.sh'}, {'damage_type': 'backtrace', 'id': 578277095, 'ino': 1099511637324, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrans'}, {'damage_type': 'backtrace', 'id': 578942240, 'ino': 1099511635959, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/dev_sim_framework/kernel_space/tmod.c'}, {'damage_type': 'backtrace', 'id': 590881750, 'ino': 1099511635823, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/paripv6.sh'}, {'damage_type': 'backtrace', 'id': 594345760, 'ino': 1099511635795, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/README'}, {'damage_type': 'backtrace', 'id': 603846760, 'ino': 1099511636620, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_readlink.te'}, {'damage_type': 'backtrace', 'id': 612476289, 'ino': 1099511636836, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ioctl/selinux_ioctl.c'}, {'damage_type': 'backtrace', 'id': 615430568, 'ino': 1099511637320, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/entrypoint'}, {'damage_type': 'backtrace', 'id': 627946897, 'ino': 1099511636864, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/Makefile'}, {'damage_type': 'backtrace', 'id': 640201261, 'ino': 1099511635851, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/container_ftp.pl'}, {'damage_type': 'backtrace', 'id': 642183091, 'ino': 1099511636752, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_rxdir.te'}, {'damage_type': 'backtrace', 'id': 647166146, 'ino': 1099511636741, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_sysctl.te'}, {'damage_type': 'backtrace', 'id': 655586273, 'ino': 1099511636570, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/check_for_libcap.sh'}, {'damage_type': 'backtrace', 'id': 661163550, 'ino': 1099511636548, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_socket_labels.c'}, {'damage_type': 'backtrace', 'id': 693469779, 'ino': 1099511637303, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setscheduler/selinux_task_setscheduler_source.c'}, {'damage_type': 'backtrace', 'id': 698115339, 'ino': 1099511636603, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_setattr.te'}, {'damage_type': 'backtrace', 'id': 699694038, 'ino': 1099511637360, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security'}, {'damage_type': 'backtrace', 'id': 724200128, 'ino': 1099511637115, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresgid/getresgid03.c'}, {'damage_type': 'backtrace', 'id': 736570898, 'ino': 1099511636556, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/policy/Makefile'}, {'damage_type': 'backtrace', 'id': 742439485, 'ino': 1099511635844, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/par_chld_ftp.c'}, {'damage_type': 'backtrace', 'id': 755402738, 'ino': 1099511636767, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/rename/selinux_rename.sh'}, {'damage_type': 'backtrace', 'id': 756273556, 'ino': 1099511637005, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/policy'}, {'damage_type': 'backtrace', 'id': 762577963, 'ino': 1099511636585, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_stat.te'}, {'damage_type': 'backtrace', 'id': 777245458, 'ino': 1099511635837, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/childns.sh'}, {'damage_type': 'backtrace', 'id': 779359581, 'ino': 1099511636553, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/p9auth/Makefile'}, {'damage_type': 'backtrace', 'id': 783426840, 'ino': 1099511637023, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat/5'}, {'damage_type': 'backtrace', 'id': 786293557, 'ino': 1099511635786, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/container_test.sh'}, {'damage_type': 'backtrace', 'id': 797792605, 'ino': 1099511637292, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ptrace/selinux_ptrace.c'}, {'damage_type': 'backtrace', 'id': 802325517, 'ino': 1099511636809, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_rawio.c'}, {'damage_type': 'backtrace', 'id': 804066063, 'ino': 1099511637342, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execshare'}, {'damage_type': 'backtrace', 'id': 822567423, 'ino': 1099511636758, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sem/selinux_sem.sh'}, {'damage_type': 'backtrace', 'id': 824807227, 'ino': 1099511636564, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/tests/ima_violations.sh'}, {'damage_type': 'backtrace', 'id': 847790649, 'ino': 1099511635845, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/runallnetworktests_child.sh'}, {'damage_type': 'backtrace', 'id': 850637168, 'ino': 1099511636611, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_rxdir.te'}, {'damage_type': 'backtrace', 'id': 877928416, 'ino': 1099511636840, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execshare/selinux_execshare.sh'}, {'damage_type': 'backtrace', 'id': 891371682, 'ino': 1099511635826, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/readme'}, {'damage_type': 'backtrace', 'id': 892529025, 'ino': 1099511636562, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/tests/Makefile'}, {'damage_type': 'backtrace', 'id': 905655217, 'ino': 1099511636587, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_task_getpgid.te'}, {'damage_type': 'backtrace', 'id': 913927129, 'ino': 1099511635834, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/child_2.sh'}, {'damage_type': 'backtrace', 'id': 922220634, 'ino': 1099511637017, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy'}, {'damage_type': 'backtrace', 'id': 931554516, 'ino': 1099511636824, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/wait/selinux_wait_child.c'}, {'damage_type': 'backtrace', 'id': 937639266, 'ino': 1099511636764, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/shm/selinux_shmget.c'}, {'damage_type': 'backtrace', 'id': 940847937, 'ino': 1099511636738, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_open.te'}, {'damage_type': 'backtrace', 'id': 956380775, 'ino': 1099511636854, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getsid/selinux_task_getsid_target.c'}, {'damage_type': 'backtrace', 'id': 967217682, 'ino': 1099511636874, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/AUTHORS'}, {'damage_type': 'backtrace', 'id': 969614479, 'ino': 1099511636800, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrace/selinux_dyntrace_child.c'}, {'damage_type': 'backtrace', 'id': 981639298, 'ino': 1099511635859, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/disktest/man1/disktest_manual.html'}, {'damage_type': 'backtrace', 'id': 983665868, 'ino': 1099511637358, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps'}, {'damage_type': 'backtrace', 'id': 983971364, 'ino': 1099511636340, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns'}, {'damage_type': 'backtrace', 'id': 990465855, 'ino': 1099511635832, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/Makefile'}, {'damage_type': 'backtrace', 'id': 1000656128, 'ino': 1099511635794, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/semtest_2ns.c'}, {'damage_type': 'backtrace', 'id': 1013486418, 'ino': 1099511636766, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/shm/selinux_shmat.c'}, {'damage_type': 'backtrace', 'id': 1093438057, 'ino': 1099511636578, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_ipc.te'}, {'damage_type': 'backtrace', 'id': 1094431374, 'ino': 1099511635820, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/parent_view.sh'}, {'damage_type': 'backtrace', 'id': 1104829914, 'ino': 1099511636769, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/exectrace/selinux_exectrace_child.c'}, {'damage_type': 'backtrace', 'id': 1116846382, 'ino': 1099511635829, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/parent.sh'}, {'damage_type': 'backtrace', 'id': 1117567022, 'ino': 1099511636563, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/tests/ima_tpm.sh'}, {'damage_type': 'backtrace', 'id': 1119225534, 'ino': 1099511635830, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/parent_share.sh'}, {'damage_type': 'backtrace', 'id': 1136655211, 'ino': 1099511636586, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_execute_no_trans.te'}, {'damage_type': 'backtrace', 'id': 1137275256, 'ino': 1099511637727, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresgid/getresgid01.c'}, {'damage_type': 'backtrace', 'id': 1141472687, 'ino': 1099511637006, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/policy/measure.policy-invalid'}, {'damage_type': 'backtrace', 'id': 1144347395, 'ino': 1099511637114, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresgid/Makefile'}, {'damage_type': 'backtrace', 'id': 1155545167, 'ino': 1099511637305, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/mkdir/Makefile'}, {'damage_type': 'backtrace', 'id': 1158019828, 'ino': 1099511635843, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/sysfsview.c'}, {'damage_type': 'backtrace', 'id': 1174917775, 'ino': 1099511636783, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/Makefile'}, {'damage_type': 'backtrace', 'id': 1185024840, 'ino': 1099511636589, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_capable_sys.te'}, {'damage_type': 'backtrace', 'id': 1186476904, 'ino': 1099511636748, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_task_getsched.te'}, {'damage_type': 'backtrace', 'id': 1210649320, 'ino': 1099511635833, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/runnetnstest.sh'}, {'damage_type': 'backtrace', 'id': 1251888450, 'ino': 1099511637335, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/msg/selinux_msg.sh'}, {'damage_type': 'backtrace', 'id': 1271889904, 'ino': 1099511636594, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_entrypoint.te'}, {'damage_type': 'backtrace', 'id': 1276835292, 'ino': 1099511635800, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns/mqns_04.c'}, {'damage_type': 'backtrace', 'id': 1278335893, 'ino': 1099511635825, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/par_chld_ipv6.c'}, {'damage_type': 'backtrace', 'id': 1285492851, 'ino': 1099511637300, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_fcntl.c'}, {'damage_type': 'backtrace', 'id': 1293872917, 'ino': 1099511636222, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/user_space/Makefile'}, {'damage_type': 'backtrace', 'id': 1304604352, 'ino': 1099511636607, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_task_getsched.te'}, {'damage_type': 'backtrace', 'id': 1307003114, 'ino': 1099511637359, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/print_caps.c'}, {'damage_type': 'backtrace', 'id': 1316331786, 'ino': 1099511636596, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_fdreceive.te'}, {'damage_type': 'backtrace', 'id': 1317046008, 'ino': 1099511636765, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/shm/selinux_shm.sh'}, {'damage_type': 'backtrace', 'id': 1336495318, 'ino': 1099511637326, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sysctl'}, {'damage_type': 'backtrace', 'id': 1338092967, 'ino': 1099511636615, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_link.te'}, {'damage_type': 'backtrace', 'id': 1351721418, 'ino': 1099511637298, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/inherit/selinux_inherit_parent.c'}, {'damage_type': 'backtrace', 'id': 1352213895, 'ino': 1099511637354, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getsid'}, {'damage_type': 'backtrace', 'id': 1354053335, 'ino': 1099511636602, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_transition.te'}, {'damage_type': 'backtrace', 'id': 1373451458, 'ino': 1099511636772, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ptrace/selinux_ptrace.sh'}, {'damage_type': 'backtrace', 'id': 1375550182, 'ino': 1099511636756, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_file/Makefile'}, {'damage_type': 'backtrace', 'id': 1376541415, 'ino': 1099511636780, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/inherit/selinux_inherit_child.c'}, {'damage_type': 'backtrace', 'id': 1377664386, 'ino': 1099511636395, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/dev_sim_framework/kernel_space/load_tmod.sh'}, {'damage_type': 'backtrace', 'id': 1397297084, 'ino': 1099511637294, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_create/selinux_task_create.sh'}, {'damage_type': 'backtrace', 'id': 1399544984, 'ino': 1099511636568, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/exec_with_inh.c'}, {'damage_type': 'backtrace', 'id': 1404597938, 'ino': 1099511636614, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_setnice.te'}, {'damage_type': 'backtrace', 'id': 1405742558, 'ino': 1099511636572, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/check_pe.c'}, {'damage_type': 'backtrace', 'id': 1411275548, 'ino': 1099511636754, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/README'}, {'damage_type': 'backtrace', 'id': 1412161715, 'ino': 1099511636630, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/Makefile'}, {'damage_type': 'backtrace', 'id': 1417482831, 'ino': 1099511636828, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/msg/selinux_msgctl.c'}, {'damage_type': 'backtrace', 'id': 1438646690, 'ino': 1099511635798, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns/mqns_02.c'}, {'damage_type': 'backtrace', 'id': 1441560789, 'ino': 1099511636598, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_open.te'}, {'damage_type': 'backtrace', 'id': 1456877458, 'ino': 1099511637306, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setnice'}, {'damage_type': 'backtrace', 'id': 1479239456, 'ino': 1099511636543, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/Makefile'}, {'damage_type': 'backtrace', 'id': 1482425558, 'ino': 1099511637304, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/mkdir'}, {'damage_type': 'backtrace', 'id': 1483466370, 'ino': 1099511636337, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/TEST_PLAN.txt'}, {'damage_type': 'backtrace', 'id': 1493352239, 'ino': 1099511636599, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_relabel.te'}, {'damage_type': 'backtrace', 'id': 1498815539, 'ino': 1099511636736, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_fdreceive.te'}, {'damage_type': 'backtrace', 'id': 1506924820, 'ino': 1099511635956, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/dev_sim_framework/kernel_space/Makefile'}, {'damage_type': 'backtrace', 'id': 1531072735, 'ino': 1099511636861, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/tomoyo/include.h'}, {'damage_type': 'backtrace', 'id': 1534558109, 'ino': 1099511637314, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net'}, {'damage_type': 'backtrace', 'id': 1541871819, 'ino': 1099511636558, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/ima_boot_aggregate.c'}, {'damage_type': 'backtrace', 'id': 1554618558, 'ino': 1099511637019, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/Makefile'}, {'damage_type': 'backtrace', 'id': 1555897925, 'ino': 1099511636606, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_dyntrace.te'}, {'damage_type': 'backtrace', 'id': 1559075531, 'ino': 1099511637010, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/tests'}, {'damage_type': 'backtrace', 'id': 1575955648, 'ino': 1099511636624, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_stat.te'}, {'damage_type': 'backtrace', 'id': 1606246579, 'ino': 1099511635822, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/two_children_ns.c'}, {'damage_type': 'backtrace', 'id': 1628673544, 'ino': 1099511637310, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrace'}, {'damage_type': 'backtrace', 'id': 1637627536, 'ino': 1099511636600, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_sysctl.te'}, {'damage_type': 'backtrace', 'id': 1638853355, 'ino': 1099511635835, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/child_1.sh'}, {'damage_type': 'backtrace', 'id': 1644689065, 'ino': 1099511636735, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_policy.fc'}, {'damage_type': 'backtrace', 'id': 1657995474, 'ino': 1099511636649, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space'}, {'damage_type': 'backtrace', 'id': 1660881950, 'ino': 1099511636760, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sem/Makefile'}, {'damage_type': 'backtrace', 'id': 1668539388, 'ino': 1099511636814, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getpgid/selinux_task_getpgid_source.c'}, {'damage_type': 'backtrace', 'id': 1676839898, 'ino': 1099511636577, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_link.te'}, {'damage_type': 'backtrace', 'id': 1695834127, 'ino': 1099511635831, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/parent_1.sh'}, {'damage_type': 'backtrace', 'id': 1697618810, 'ino': 1099511636588, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_attrib.te'}, {'damage_type': 'backtrace', 'id': 1724597203, 'ino': 1099511637009, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/ima_measure.c'}, {'damage_type': 'backtrace', 'id': 1738512877, 'ino': 1099511636593, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_wait.te'}, {'damage_type': 'backtrace', 'id': 1741378282, 'ino': 1099511637299, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file'}, {'damage_type': 'backtrace', 'id': 1755814900, 'ino': 1099511636798, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrace/selinux_dyntrace_parent.c'}, {'damage_type': 'backtrace', 'id': 1761075935, 'ino': 1099511636808, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/Makefile'}, {'damage_type': 'backtrace', 'id': 1763209919, 'ino': 1099511636838, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execshare/Makefile'}, {'damage_type': 'backtrace', 'id': 1771919030, 'ino': 1099511637016, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite'}, {'damage_type': 'backtrace', 'id': 1783374719, 'ino': 1099511636552, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/p9auth/p9unpriv.sh'}, {'damage_type': 'backtrace', 'id': 1783490789, 'ino': 1099511636855, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/Makefile.inc'}, {'damage_type': 'backtrace', 'id': 1794203135, 'ino': 1099511636737, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_sigkill.te'}, {'damage_type': 'backtrace', 'id': 1795272467, 'ino': 1099511637302, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setscheduler'}, {'damage_type': 'backtrace', 'id': 1799760386, 'ino': 1099511636345, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/libclone/Makefile'}, {'damage_type': 'backtrace', 'id': 1811033828, 'ino': 1099511636865, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/filecapstest.sh'}, {'damage_type': 'backtrace', 'id': 1812020701, 'ino': 1099511635737, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-nsec-timestamps/Makefile'}, {'damage_type': 'backtrace', 'id': 1815301203, 'ino': 1099511636609, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_task_getsid.te'}, {'damage_type': 'backtrace', 'id': 1832843819, 'ino': 1099511635792, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/sem_nstest.c'}, {'damage_type': 'backtrace', 'id': 1844759956, 'ino': 1099511636761, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sem/selinux_semop.c'}, {'damage_type': 'backtrace', 'id': 1848562297, 'ino': 1099511636796, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setnice/selinux_setnice.sh'}, {'damage_type': 'backtrace', 'id': 1857162262, 'ino': 1099511636623, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_ptrace.te'}, {'damage_type': 'backtrace', 'id': 1858199077, 'ino': 1099511637361, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/change_password.sh'}, {'damage_type': 'backtrace', 'id': 1858264496, 'ino': 1099511637297, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/inherit'}, {'damage_type': 'backtrace', 'id': 1878961475, 'ino': 1099511635796, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns/mqns_03.c'}, {'damage_type': 'backtrace', 'id': 1897527793, 'ino': 1099511636627, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_capable_sys.te'}, {'damage_type': 'backtrace', 'id': 1906756836, 'ino': 1099511637289, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setattr'}, {'damage_type': 'backtrace', 'id': 1913093061, 'ino': 1099511636581, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_capable_file.te'}, {'damage_type': 'backtrace', 'id': 1926535297, 'ino': 1099511636832, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sigkill/selinux_sigkill.sh'}, {'damage_type': 'backtrace', 'id': 1926556748, 'ino': 1099511637353, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/rxdir/selinux_rxdir.sh'}, {'damage_type': 'backtrace', 'id': 1930195330, 'ino': 1099511637341, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/link/Makefile'}, {'damage_type': 'backtrace', 'id': 1933325429, 'ino': 1099511637296, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execute_no_trans/Makefile'}, {'damage_type': 'backtrace', 'id': 1935263233, 'ino': 1099511635828, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/parent_2.sh'}, {'damage_type': 'backtrace', 'id': 1944067924, 'ino': 1099511636856, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/ChangeLog'}, {'damage_type': 'backtrace', 'id': 1953044467, 'ino': 1099511635849, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/crtchild.c'}, {'damage_type': 'backtrace', 'id': 1955830580, 'ino': 1099511636557, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/README'}, {'damage_type': 'backtrace', 'id': 1965252990, 'ino': 1099511636803, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/Makefile'}, {'damage_type': 'backtrace', 'id': 1966340447, 'ino': 1099511636802, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setpgid/selinux_task_setpgid_source.c'}, {'damage_type': 'backtrace', 'id': 1969577858, 'ino': 1099511636822, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/domain_trans/selinux_domain_trans.sh'}, {'damage_type': 'backtrace', 'id': 1993182959, 'ino': 1099511635818, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/libclone/libclone.c'}, {'damage_type': 'backtrace', 'id': 1993297801, 'ino': 1099511636633, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_bounds.te'}, {'damage_type': 'backtrace', 'id': 2002716618, 'ino': 1099511635846, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/rename_net.sh'}, {'damage_type': 'backtrace', 'id': 2004921902, 'ino': 1099511636561, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/tests/ima_measurements.sh'}, {'damage_type': 'backtrace', 'id': 2008084138, 'ino': 1099511637352, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/rxdir'}, {'damage_type': 'backtrace', 'id': 2014799797, 'ino': 1099511636560, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/ima_mmap.c'}, {'damage_type': 'backtrace', 'id': 2038461920, 'ino': 1099511636843, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getscheduler/selinux_task_getscheduler_source.c'}, {'damage_type': 'backtrace', 'id': 2074910099, 'ino': 1099511636739, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/TODO'}, {'damage_type': 'backtrace', 'id': 2103632644, 'ino': 1099511636817, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/open/selinux_open.sh'}, {'damage_type': 'backtrace', 'id': 2114279397, 'ino': 1099511637116, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getresgid/getresgid02.c'}, {'damage_type': 'backtrace', 'id': 2116806696, 'ino': 1099511636745, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_exectrace.te'}, {'damage_type': 'backtrace', 'id': 2123802246, 'ino': 1099511636628, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_execshare.te'}, {'damage_type': 'backtrace', 'id': 2124832846, 'ino': 1099511636773, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ptrace/Makefile'}, {'damage_type': 'backtrace', 'id': 2129128306, 'ino': 1099511636549, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_netlabel.sh'}, {'damage_type': 'backtrace', 'id': 2133158920, 'ino': 1099511636776, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_create/selinux_task_create_parent.c'}, {'damage_type': 'backtrace', 'id': 2137962706, 'ino': 1099511636583, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_mkdir.te'}, {'damage_type': 'backtrace', 'id': 2156043629, 'ino': 1099511637004, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima'}, {'damage_type': 'backtrace', 'id': 2158925658, 'ino': 1099511636790, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setscheduler/Makefile'}, {'damage_type': 'backtrace', 'id': 2191123063, 'ino': 1099511635292, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-nsec-timestamps/ext4_nsec_timestamps_test.sh'}, {'damage_type': 'backtrace', 'id': 2197275699, 'ino': 1099511637351, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/bounds/Makefile'}, {'damage_type': 'backtrace', 'id': 2198736398, 'ino': 1099511636631, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_wait.te'}, {'damage_type': 'backtrace', 'id': 2221104585, 'ino': 1099511636867, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/README'}, {'damage_type': 'backtrace', 'id': 2256546397, 'ino': 1099511637311, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrace/Makefile'}, {'damage_type': 'backtrace', 'id': 2276773744, 'ino': 1099511636799, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrace/selinux_dyntrace.sh'}, {'damage_type': 'backtrace', 'id': 2281867176, 'ino': 1099511637331, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/wait/selinux_wait_parent.c'}, {'damage_type': 'backtrace', 'id': 2291622812, 'ino': 1099511636579, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_ioctl.te'}, {'damage_type': 'backtrace', 'id': 2322397910, 'ino': 1099511636842, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getscheduler/selinux_task_getscheduler.sh'}, {'damage_type': 'backtrace', 'id': 2323417003, 'ino': 1099511636792, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setscheduler/selinux_task_setscheduler_target.c'}, {'damage_type': 'backtrace', 'id': 2349249594, 'ino': 1099511636751, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_task_create.te'}, {'damage_type': 'backtrace', 'id': 2349985668, 'ino': 1099511636617, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_ioctl.te'}, {'damage_type': 'backtrace', 'id': 2350789191, 'ino': 1099511635791, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/check_ipcns_enabled.c'}, {'damage_type': 'backtrace', 'id': 2351169558, 'ino': 1099511636812, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getpgid/Makefile'}, {'damage_type': 'backtrace', 'id': 2360596523, 'ino': 1099511636554, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/p9auth/unhex.c'}, {'damage_type': 'backtrace', 'id': 2360989667, 'ino': 1099511636544, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_common.sh'}, {'damage_type': 'backtrace', 'id': 2362488042, 'ino': 1099511636789, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_nofcntl.c'}, {'damage_type': 'backtrace', 'id': 2403826794, 'ino': 1099511637356, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/tomoyo'}, {'damage_type': 'backtrace', 'id': 2411799138, 'ino': 1099511636625, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_execute_no_trans.te'}, {'damage_type': 'backtrace', 'id': 2421223856, 'ino': 1099511637281, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sem'}, {'damage_type': 'backtrace', 'id': 2437451401, 'ino': 1099511636827, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/msg/Makefile'}, {'damage_type': 'backtrace', 'id': 2464719725, 'ino': 1099511637327, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sysctl/selinux_sysctl.sh'}, {'damage_type': 'backtrace', 'id': 2466627531, 'ino': 1099511636848, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setnice/selinux_task_setnice.sh'}, {'damage_type': 'backtrace', 'id': 2473984858, 'ino': 1099511637308, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/stat'}, {'damage_type': 'backtrace', 'id': 2479243435, 'ino': 1099511636872, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/Makefile'}, {'damage_type': 'backtrace', 'id': 2483459759, 'ino': 1099511636787, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_mprotect.c'}, {'damage_type': 'backtrace', 'id': 2484103566, 'ino': 1099511636546, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/README'}, {'damage_type': 'backtrace', 'id': 2505870062, 'ino': 1099511636757, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_file/selinux_capable_file.sh'}, {'damage_type': 'backtrace', 'id': 2524977372, 'ino': 1099511636538, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_ambient.sh'}, {'damage_type': 'backtrace', 'id': 2541813959, 'ino': 1099511636749, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_capable_net.te'}, {'damage_type': 'backtrace', 'id': 2546641235, 'ino': 1099511636742, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_dyntrans.te'}, {'damage_type': 'backtrace', 'id': 2550519138, 'ino': 1099511636868, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/checkforfilecaps.sh'}, {'damage_type': 'backtrace', 'id': 2557166141, 'ino': 1099511637307, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setnice/Makefile'}, {'damage_type': 'backtrace', 'id': 2563564078, 'ino': 1099511636632, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_entrypoint.te'}, {'damage_type': 'backtrace', 'id': 2566659916, 'ino': 1099511637325, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrans/Makefile'}, {'damage_type': 'backtrace', 'id': 2586842862, 'ino': 1099511637286, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/rename/Makefile'}, {'damage_type': 'backtrace', 'id': 2595201308, 'ino': 1099511636805, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/selinux_raw.c'}, {'damage_type': 'backtrace', 'id': 2599582028, 'ino': 1099511636791, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setscheduler/selinux_task_setscheduler.sh'}, {'damage_type': 'backtrace', 'id': 2599974278, 'ino': 1099511635291, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-nsec-timestamps/ext4_file_time.c'}, {'damage_type': 'backtrace', 'id': 2603933848, 'ino': 1099511636785, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_lock.c'}, {'damage_type': 'backtrace', 'id': 2607835347, 'ino': 1099511635790, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/Makefile'}, {'damage_type': 'backtrace', 'id': 2618498152, 'ino': 1099511637282, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sem/selinux_semget.c'}, {'damage_type': 'backtrace', 'id': 2631601409, 'ino': 1099511636576, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_setnice.te'}, {'damage_type': 'backtrace', 'id': 2634059646, 'ino': 1099511637318, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getpgid'}, {'damage_type': 'backtrace', 'id': 2641747508, 'ino': 1099511636347, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/delchild.sh'}, {'damage_type': 'backtrace', 'id': 2650353769, 'ino': 1099511636858, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/tomoyo/testall.sh'}, {'damage_type': 'backtrace', 'id': 2655208791, 'ino': 1099511636740, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_relabel.te'}, {'damage_type': 'backtrace', 'id': 2657202749, 'ino': 1099511637288, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/exectrace/selinux_exectrace.sh'}, {'damage_type': 'backtrace', 'id': 2674686775, 'ino': 1099511636806, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/runtest.sh'}, {'damage_type': 'backtrace', 'id': 2699552990, 'ino': 1099511637315, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/selinux_capable_net.sh'}, {'damage_type': 'backtrace', 'id': 2712296504, 'ino': 1099511636869, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/inh_capped.c'}, {'damage_type': 'backtrace', 'id': 2722085856, 'ino': 1099511636833, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sigkill/selinux_sigkill_server.c'}, {'damage_type': 'backtrace', 'id': 2723300346, 'ino': 1099511636590, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_execshare.te'}, {'damage_type': 'backtrace', 'id': 2741037383, 'ino': 1099511636768, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/exectrace/Makefile'}, {'damage_type': 'backtrace', 'id': 2752571887, 'ino': 1099511636574, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/dummy.c'}, {'damage_type': 'backtrace', 'id': 2753986854, 'ino': 1099511637347, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/fdreceive/Makefile'}, {'damage_type': 'backtrace', 'id': 2763245351, 'ino': 1099511637340, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/link'}, {'damage_type': 'backtrace', 'id': 2763387413, 'ino': 1099511636852, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getsid/selinux_task_getsid_source.c'}, {'damage_type': 'backtrace', 'id': 2774054345, 'ino': 1099511635788, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/runtests_noltp.sh'}, {'damage_type': 'backtrace', 'id': 2780892347, 'ino': 1099511636342, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/pidns'}, {'damage_type': 'backtrace', 'id': 2807111154, 'ino': 1099511636565, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/tests/ima_setup.sh'}, {'damage_type': 'backtrace', 'id': 2807302063, 'ino': 1099511635821, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/parentns.sh'}, {'damage_type': 'backtrace', 'id': 2816953258, 'ino': 1099511636626, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_task_getpgid.te'}, {'damage_type': 'backtrace', 'id': 2830950026, 'ino': 1099511637283, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/shm'}, {'damage_type': 'backtrace', 'id': 2837235077, 'ino': 1099511636629, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_file.te'}, {'damage_type': 'backtrace', 'id': 2853508875, 'ino': 1099511636610, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_task_create.te'}, {'damage_type': 'backtrace', 'id': 2879012194, 'ino': 1099511636619, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_capable_file.te'}, {'damage_type': 'backtrace', 'id': 2881888966, 'ino': 1099511635850, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/ch_ftp.sh'}, {'damage_type': 'backtrace', 'id': 2915895689, 'ino': 1099511636443, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/stress/memcg_process_stress.c'}, {'damage_type': 'backtrace', 'id': 2928506008, 'ino': 1099511637003, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity'}, {'damage_type': 'backtrace', 'id': 2939280511, 'ino': 1099511637293, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_create'}, {'damage_type': 'backtrace', 'id': 2939392081, 'ino': 1099511636795, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setnice/selinux_setnice_child.c'}, {'damage_type': 'backtrace', 'id': 2945555348, 'ino': 1099511637350, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/bounds'}, {'damage_type': 'backtrace', 'id': 2971406775, 'ino': 1099511637338, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ioctl'}, {'damage_type': 'backtrace', 'id': 2973556779, 'ino': 1099511636584, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_ptrace.te'}, {'damage_type': 'backtrace', 'id': 2982628118, 'ino': 1099511637332, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/readlink'}, {'damage_type': 'backtrace', 'id': 2994187761, 'ino': 1099511636818, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/open/selinux_append2write.c'}, {'damage_type': 'backtrace', 'id': 3030569023, 'ino': 1099511636999, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack'}, {'damage_type': 'backtrace', 'id': 3036892441, 'ino': 1099511636804, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/selinux_bind.c'}, {'damage_type': 'backtrace', 'id': 3079757606, 'ino': 1099511636759, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sem/selinux_getinfo.c'}, {'damage_type': 'backtrace', 'id': 3084520001, 'ino': 1099511637007, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/Makefile'}, {'damage_type': 'backtrace', 'id': 3107793217, 'ino': 1099511637138, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pathconf/pathconf01.c'}, {'damage_type': 'backtrace', 'id': 3148967818, 'ino': 1099511636826, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/readlink/selinux_readlink.sh'}, {'damage_type': 'backtrace', 'id': 3152907690, 'ino': 1099511635957, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/dev_sim_framework/kernel_space/tmod.h'}, {'damage_type': 'backtrace', 'id': 3153257984, 'ino': 1099511636793, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/mkdir/selinux_mkdir.sh'}, {'damage_type': 'backtrace', 'id': 3156794597, 'ino': 1099511637301, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/Makefile'}, {'damage_type': 'backtrace', 'id': 3171258783, 'ino': 1099511636820, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/dyntrans/selinux_dyntrans.sh'}, {'damage_type': 'backtrace', 'id': 3173777508, 'ino': 1099511637276, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests'}, {'damage_type': 'backtrace', 'id': 3177947792, 'ino': 1099511636592, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/Makefile'}, {'damage_type': 'backtrace', 'id': 3191624344, 'ino': 1099511636753, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_inherit.te'}, {'damage_type': 'backtrace', 'id': 3207629508, 'ino': 1099511635787, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/shmem_2nstest.c'}, {'damage_type': 'backtrace', 'id': 3227607429, 'ino': 1099511635960, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/dev_sim_framework/kernel_space/tmod.mod.c'}, {'damage_type': 'backtrace', 'id': 3228800735, 'ino': 1099511636816, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/open/selinux_fopen.c'}, {'damage_type': 'backtrace', 'id': 3232237874, 'ino': 1099511636786, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_sigiotask.c'}, {'damage_type': 'backtrace', 'id': 3234446000, 'ino': 1099511637284, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/shm/selinux_shmctl.c'}, {'damage_type': 'backtrace', 'id': 3238161046, 'ino': 1099511636857, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/tomoyo/README'}, {'damage_type': 'backtrace', 'id': 3256815966, 'ino': 1099511637317, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_chroot.c'}, {'damage_type': 'backtrace', 'id': 3263262623, 'ino': 1099511635860, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/disktest/man1/disktest.1'}, {'damage_type': 'backtrace', 'id': 3265161524, 'ino': 1099511636777, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execute_no_trans/selinux_execute_no_trans.sh'}, {'damage_type': 'backtrace', 'id': 3272779336, 'ino': 1099511636837, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/link/selinux_link.sh'}, {'damage_type': 'backtrace', 'id': 3279399555, 'ino': 1099511636346, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns'}, {'damage_type': 'backtrace', 'id': 3282981060, 'ino': 1099511636834, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ioctl/Makefile'}, {'damage_type': 'backtrace', 'id': 3284448331, 'ino': 1099511636775, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_create/Makefile'}, {'damage_type': 'backtrace', 'id': 3290474265, 'ino': 1099511636849, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/bounds/selinux_bounds.sh'}, {'damage_type': 'backtrace', 'id': 3293234558, 'ino': 1099511636762, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sem/selinux_semctl.c'}, {'damage_type': 'backtrace', 'id': 3310983023, 'ino': 1099511636784, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_seek.c'}, {'damage_type': 'backtrace', 'id': 3332352496, 'ino': 1099511637280, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_file/selinux_lease.c'}, {'damage_type': 'backtrace', 'id': 3339429834, 'ino': 1099511637312, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setpgid'}, {'damage_type': 'backtrace', 'id': 3348483077, 'ino': 1099511637014, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound'}, {'damage_type': 'backtrace', 'id': 3356586858, 'ino': 1099511636442, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/stress/Makefile'}, {'damage_type': 'backtrace', 'id': 3358053166, 'ino': 1099511636618, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_task_setsched.te'}, {'damage_type': 'backtrace', 'id': 3367775655, 'ino': 1099511637018, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_rename.te'}, {'damage_type': 'backtrace', 'id': 3394529778, 'ino': 1099511635847, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/create_container.c'}, {'damage_type': 'backtrace', 'id': 3395797290, 'ino': 1099511636541, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_file_access.sh'}, {'damage_type': 'backtrace', 'id': 3399212533, 'ino': 1099511636846, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/fdreceive/selinux_fdreceive_client.c'}, {'damage_type': 'backtrace', 'id': 3402607518, 'ino': 1099511637002, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/p9auth/p9priv.sh'}, {'damage_type': 'backtrace', 'id': 3403983402, 'ino': 1099511637278, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/relabel/Makefile'}, {'damage_type': 'backtrace', 'id': 3423513171, 'ino': 1099511636616, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_ipc.te'}, {'damage_type': 'backtrace', 'id': 3436284842, 'ino': 1099511637349, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setnice/Makefile'}, {'damage_type': 'backtrace', 'id': 3443824401, 'ino': 1099511636825, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/wait/selinux_wait.sh'}, {'damage_type': 'backtrace', 'id': 3445623345, 'ino': 1099511636830, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/msg/selinux_msgsnd.c'}, {'damage_type': 'backtrace', 'id': 3447472533, 'ino': 1099511636559, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/Makefile'}, {'damage_type': 'backtrace', 'id': 3460361093, 'ino': 1099511636608, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_capable_net.te'}, {'damage_type': 'backtrace', 'id': 3475452705, 'ino': 1099511635797, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns/Makefile'}, {'damage_type': 'backtrace', 'id': 3480811406, 'ino': 1099511636575, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_task_setpgid.te'}, {'damage_type': 'backtrace', 'id': 3494104678, 'ino': 1099511636580, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_task_setsched.te'}, {'damage_type': 'backtrace', 'id': 3499572378, 'ino': 1099511636839, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execshare/selinux_execshare_parent.c'}, {'damage_type': 'backtrace', 'id': 3501160387, 'ino': 1099511637323, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/open/Makefile'}, {'damage_type': 'backtrace', 'id': 3533512423, 'ino': 1099511635853, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/Makefile.inc'}, {'damage_type': 'backtrace', 'id': 3547747894, 'ino': 1099511636621, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_policy.if'}, {'damage_type': 'backtrace', 'id': 3551132963, 'ino': 1099511635799, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns/mqns.h'}, {'damage_type': 'backtrace', 'id': 3562267446, 'ino': 1099511637961, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getpgid/selinux_task_getpgid.sh'}, {'damage_type': 'backtrace', 'id': 3568201830, 'ino': 1099511637344, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getscheduler'}, {'damage_type': 'backtrace', 'id': 3599719001, 'ino': 1099511636811, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_hostname.c'}, {'damage_type': 'backtrace', 'id': 3603418506, 'ino': 1099511636582, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_readlink.te'}, {'damage_type': 'backtrace', 'id': 3608170922, 'ino': 1099511636335, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/utsname'}, {'damage_type': 'backtrace', 'id': 3628186825, 'ino': 1099511636750, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_task_getsid.te'}, {'damage_type': 'backtrace', 'id': 3642417974, 'ino': 1099511635789, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/shmnstest.c'}, {'damage_type': 'backtrace', 'id': 3661802596, 'ino': 1099511636973, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/stress/memcg_stress_test.sh'}, {'damage_type': 'backtrace', 'id': 3686347945, 'ino': 1099511637279, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_file'}, {'damage_type': 'backtrace', 'id': 3688395865, 'ino': 1099511637345, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getscheduler/selinux_task_getscheduler_target.c'}, {'damage_type': 'backtrace', 'id': 3694430751, 'ino': 1099511637322, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/open'}, {'damage_type': 'backtrace', 'id': 3699308369, 'ino': 1099511636605, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_global.te'}, {'damage_type': 'backtrace', 'id': 3702433524, 'ino': 1099511636815, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/entrypoint/Makefile'}, {'damage_type': 'backtrace', 'id': 3723222913, 'ino': 1099511636571, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/cap_bound/cap_bset_inh_bounds.c'}, {'damage_type': 'backtrace', 'id': 3742890879, 'ino': 1099511635824, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/common.c'}, {'damage_type': 'backtrace', 'id': 3744306975, 'ino': 1099511636613, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_task_setpgid.te'}, {'damage_type': 'backtrace', 'id': 3773437967, 'ino': 1099511637321, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/entrypoint/selinux_entrypoint.sh'}, {'damage_type': 'backtrace', 'id': 3781494494, 'ino': 1099511636338, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc'}, {'damage_type': 'backtrace', 'id': 3841383641, 'ino': 1099511636597, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_sigkill.te'}, {'damage_type': 'backtrace', 'id': 3842108806, 'ino': 1099511637334, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/msg'}, {'damage_type': 'backtrace', 'id': 3845848178, 'ino': 1099511637012, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/Makefile'}, {'damage_type': 'backtrace', 'id': 3847948411, 'ino': 1099511636829, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/msg/selinux_msgrcv.c'}, {'damage_type': 'backtrace', 'id': 3853030012, 'ino': 1099511635838, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/crtchild_delchild.c'}, {'damage_type': 'backtrace', 'id': 3865592136, 'ino': 1099511635793, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/sysvipc/runipcnstest.sh'}, {'damage_type': 'backtrace', 'id': 3869658701, 'ino': 1099511637285, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/rename'}, {'damage_type': 'backtrace', 'id': 3880842030, 'ino': 1099511636341, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/mqns/runmqnstest.sh'}, {'damage_type': 'backtrace', 'id': 3886183172, 'ino': 1099511636847, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setnice/selinux_task_setnice_target.c'}, {'damage_type': 'backtrace', 'id': 3896150841, 'ino': 1099511635836, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/child.sh'}, {'damage_type': 'backtrace', 'id': 3905390650, 'ino': 1099511635842, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/par_ftp.sh'}, {'damage_type': 'backtrace', 'id': 3908088095, 'ino': 1099511636845, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/fdreceive/selinux_fdreceive.sh'}, {'damage_type': 'backtrace', 'id': 3914352761, 'ino': 1099511636356, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/io/disktest/man1/disktest.1.gz'}, {'damage_type': 'backtrace', 'id': 3917185640, 'ino': 1099511636813, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getpgid/selinux_task_getpgid_target.c'}, {'damage_type': 'backtrace', 'id': 3938999840, 'ino': 1099511637357, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/tomoyo/Makefile'}, {'damage_type': 'backtrace', 'id': 3945202303, 'ino': 1099511636647, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/user_space'}, {'damage_type': 'backtrace', 'id': 3952719392, 'ino': 1099511636770, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/exectrace/selinux_exectrace_parent.c'}, {'damage_type': 'backtrace', 'id': 3954287557, 'ino': 1099511636788, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_file.sh'}, {'damage_type': 'backtrace', 'id': 3954704266, 'ino': 1099511636743, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_transition.te'}, {'damage_type': 'backtrace', 'id': 3965266009, 'ino': 1099511637021, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/test_rename.te'}, {'damage_type': 'backtrace', 'id': 3965283437, 'ino': 1099511637013, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/Makefile'}, {'damage_type': 'backtrace', 'id': 3979861341, 'ino': 1099511637000, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_current.sh'}, {'damage_type': 'backtrace', 'id': 3986664730, 'ino': 1099511637313, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_setpgid/Makefile'}, {'damage_type': 'backtrace', 'id': 4033528365, 'ino': 1099511635958, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/dev_sim_framework/kernel_space/str_mod.h'}, {'damage_type': 'backtrace', 'id': 4035974762, 'ino': 1099511636344, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/libclone'}, {'damage_type': 'backtrace', 'id': 4036981881, 'ino': 1099511637290, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setattr/Makefile'}, {'damage_type': 'backtrace', 'id': 4038952077, 'ino': 1099511637287, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/exectrace'}, {'damage_type': 'backtrace', 'id': 4046242518, 'ino': 1099511636612, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_inherit.te'}, {'damage_type': 'backtrace', 'id': 4046549537, 'ino': 1099511637329, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/domain_trans/Makefile'}, {'damage_type': 'backtrace', 'id': 4048331204, 'ino': 1099511637755, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/pathconf/Makefile'}, {'damage_type': 'backtrace', 'id': 4053375885, 'ino': 1099511636540, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_direct.sh'}, {'damage_type': 'backtrace', 'id': 4053412320, 'ino': 1099511636604, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/policy/test_exectrace.te'}, {'damage_type': 'backtrace', 'id': 4066837958, 'ino': 1099511636870, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/ask_password.sh'}, {'damage_type': 'backtrace', 'id': 4067787890, 'ino': 1099511636841, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getscheduler/Makefile'}, {'damage_type': 'backtrace', 'id': 4081427595, 'ino': 1099511635852, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/child_propagate.sh'}, {'damage_type': 'backtrace', 'id': 4084664635, 'ino': 1099511637022, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/refpolicy/redhat'}, {'damage_type': 'backtrace', 'id': 4089874593, 'ino': 1099511636781, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/file/selinux_wait_io.c'}, {'damage_type': 'backtrace', 'id': 4099308121, 'ino': 1099511637343, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/execshare/selinux_execshare_child.c'}, {'damage_type': 'backtrace', 'id': 4129716266, 'ino': 1099511635819, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/libclone/libclone.h'}, {'damage_type': 'backtrace', 'id': 4130072899, 'ino': 1099511637337, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sigkill/Makefile'}, {'damage_type': 'backtrace', 'id': 4131261482, 'ino': 1099511636794, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/setnice/selinux_setnice_parent.c'}, {'damage_type': 'backtrace', 'id': 4148338416, 'ino': 1099511636862, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/verify_caps_exec.c'}, {'damage_type': 'backtrace', 'id': 4172298542, 'ino': 1099511636821, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/sysctl/Makefile'}, {'damage_type': 'backtrace', 'id': 4230421804, 'ino': 1099511635840, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/netns/initialize.sh'}, {'damage_type': 'backtrace', 'id': 4233637999, 'ino': 1099511636875, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/force_erase.sh'}, {'damage_type': 'backtrace', 'id': 4237074154, 'ino': 1099511636866, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/filecaps/check_simple_capset.c'}, {'damage_type': 'backtrace', 'id': 4245620542, 'ino': 1099511636648, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/user_space/user_tdrm.c'}, {'damage_type': 'backtrace', 'id': 4252486071, 'ino': 1099511637011, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/tests/ima_policy.sh'}, {'damage_type': 'backtrace', 'id': 4260858607, 'ino': 1099511636539, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/smack/smack_set_onlycap.sh'}, {'damage_type': 'backtrace', 'id': 4263732381, 'ino': 1099511637355, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/task_getsid/Makefile'}, {'damage_type': 'backtrace', 'id': 4268290947, 'ino': 1099511636835, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/ioctl/selinux_noioctl.c'}, {'damage_type': 'backtrace', 'id': 4284372442, 'ino': 1099511636876, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/mmc_security/remove_password.sh'}, {'damage_type': 'backtrace', 'id': 4289219854, 'ino': 1099511636555, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/policy/measure.policy'}] 2024-01-31T05:13:37.838 ERROR:tasks.fwd_scrub:rank 2 damaged: [{'damage_type': 'backtrace', 'id': 9155645, 'ino': 1099511636281, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_load_balance_test/cpuset_load_balance_test.sh'}, {'damage_type': 'backtrace', 'id': 28763760, 'ino': 1099511636424, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/README'}, {'damage_type': 'backtrace', 'id': 52690954, 'ino': 1099511636702, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_pressure_test/Makefile'}, {'damage_type': 'backtrace', 'id': 59501054, 'ino': 1099511636308, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_6_2.c'}, {'damage_type': 'backtrace', 'id': 134085551, 'ino': 1099511637824, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigsuspend/Makefile'}, {'damage_type': 'backtrace', 'id': 145534572, 'ino': 1099511636455, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/timed_forkbomb.c'}, {'damage_type': 'backtrace', 'id': 188826742, 'ino': 1099511636282, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_load_balance_test/Makefile'}, {'damage_type': 'backtrace', 'id': 192881911, 'ino': 1099511636317, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_def_task04.c'}, {'damage_type': 'backtrace', 'id': 243589652, 'ino': 1099511636287, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_spread_test/cpuset_memory_spread_testset.sh'}, {'damage_type': 'backtrace', 'id': 244495233, 'ino': 1099511636976, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/libcontrollers'}, {'damage_type': 'backtrace', 'id': 257190611, 'ino': 1099511636681, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset'}, {'damage_type': 'backtrace', 'id': 257281380, 'ino': 1099511636412, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/README'}, {'damage_type': 'backtrace', 'id': 262671240, 'ino': 1099511636708, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_9_2.sh'}, {'damage_type': 'backtrace', 'id': 264726019, 'ino': 1099511636705, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl_fj'}, {'damage_type': 'backtrace', 'id': 303411693, 'ino': 1099511636305, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_3_1.sh'}, {'damage_type': 'backtrace', 'id': 310717533, 'ino': 1099511636261, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memctl/Makefile'}, {'damage_type': 'backtrace', 'id': 335185741, 'ino': 1099511636415, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_def_task02.c'}, {'damage_type': 'backtrace', 'id': 381550333, 'ino': 1099511636683, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/cpuinfo.c'}, {'damage_type': 'backtrace', 'id': 382049010, 'ino': 1099511636431, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuacct/README'}, {'damage_type': 'backtrace', 'id': 398214186, 'ino': 1099511636291, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_funcs.sh'}, {'damage_type': 'backtrace', 'id': 422830809, 'ino': 1099511636960, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl'}, {'damage_type': 'backtrace', 'id': 466401206, 'ino': 1099511636315, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_latency_test.c'}, {'damage_type': 'backtrace', 'id': 522082972, 'ino': 1099511636470, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/run_io_throttle_test.sh'}, {'damage_type': 'backtrace', 'id': 552413583, 'ino': 1099511636429, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuacct/cpuacct_task01.c'}, {'damage_type': 'backtrace', 'id': 552795140, 'ino': 1099511636243, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/acpi/Makefile'}, {'damage_type': 'backtrace', 'id': 600182973, 'ino': 1099511635451, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/quota_remount/Makefile'}, {'damage_type': 'backtrace', 'id': 619646016, 'ino': 1099511636288, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_hierarchy_test/Makefile'}, {'damage_type': 'backtrace', 'id': 636456874, 'ino': 1099511636469, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/Makefile'}, {'damage_type': 'backtrace', 'id': 681890558, 'ino': 1099511636284, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/README'}, {'damage_type': 'backtrace', 'id': 705995134, 'ino': 1099511636425, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/cgroup_fj_proc.c'}, {'damage_type': 'backtrace', 'id': 762934855, 'ino': 1099511636441, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/README'}, {'damage_type': 'backtrace', 'id': 782269982, 'ino': 1099511636878, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/waitid/Makefile'}, {'damage_type': 'backtrace', 'id': 794186725, 'ino': 1099511636290, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/run_cpuset_test.sh'}, {'damage_type': 'backtrace', 'id': 815036105, 'ino': 1099511636267, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/bitmask.h'}, {'damage_type': 'backtrace', 'id': 825593937, 'ino': 1099511636413, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/run_cpuctl_stress_test.sh'}, {'damage_type': 'backtrace', 'id': 828176468, 'ino': 1099511636263, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memctl/memctl_testplan.txt'}, {'damage_type': 'backtrace', 'id': 861869162, 'ino': 1099511636682, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib'}, {'damage_type': 'backtrace', 'id': 873729449, 'ino': 1099511636700, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_inherit_test/Makefile'}, {'damage_type': 'backtrace', 'id': 907334921, 'ino': 1099511636264, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memctl/run_memctl_test.sh'}, {'damage_type': 'backtrace', 'id': 920180932, 'ino': 1099511636458, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/stop_freeze_sleep_thaw_cont.sh'}, {'damage_type': 'backtrace', 'id': 921825565, 'ino': 1099511636266, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/Makefile'}, {'damage_type': 'backtrace', 'id': 928111540, 'ino': 1099511636421, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/Makefile'}, {'damage_type': 'backtrace', 'id': 930406090, 'ino': 1099511636277, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_syscall_test/cpuset_syscall_testset.sh'}, {'damage_type': 'backtrace', 'id': 947977905, 'ino': 1099511636454, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/freeze_sleep_thaw.sh'}, {'damage_type': 'backtrace', 'id': 951098816, 'ino': 1099511636685, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_syscall_test/Makefile'}, {'damage_type': 'backtrace', 'id': 977213141, 'ino': 1099511636461, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/freeze_thaw.sh'}, {'damage_type': 'backtrace', 'id': 978318482, 'ino': 1099511636970, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/functional'}, {'damage_type': 'backtrace', 'id': 985617233, 'ino': 1099511636439, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/functional/memcg_getpagesize.c'}, {'damage_type': 'backtrace', 'id': 991971078, 'ino': 1099511636692, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_exclusive_test/cpuset_exclusive_test.sh'}, {'damage_type': 'backtrace', 'id': 1003589963, 'ino': 1099511636963, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/run_cgroup_test_fj.sh'}, {'damage_type': 'backtrace', 'id': 1007897995, 'ino': 1099511636462, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/libcgroup_freezer'}, {'damage_type': 'backtrace', 'id': 1037060886, 'ino': 1099511636473, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/iobw.c'}, {'damage_type': 'backtrace', 'id': 1038603051, 'ino': 1099511636292, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_inherit_test/cpuset_inherit_testset.sh'}, {'damage_type': 'backtrace', 'id': 1064353843, 'ino': 1099511636472, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/myfunctions-io.sh'}, {'damage_type': 'backtrace', 'id': 1075070401, 'ino': 1099511636426, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/cgroup_fj_function2.sh'}, {'damage_type': 'backtrace', 'id': 1080579831, 'ino': 1099511636423, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/cgroup_fj_testcases'}, {'damage_type': 'backtrace', 'id': 1082235695, 'ino': 1099511636706, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl_fj/cpuctl_fj_simple_echo.c'}, {'damage_type': 'backtrace', 'id': 1087020526, 'ino': 1099511636417, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/README'}, {'damage_type': 'backtrace', 'id': 1108653475, 'ino': 1099511636414, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_latency_check_task.c'}, {'damage_type': 'backtrace', 'id': 1115946697, 'ino': 1099511636430, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuacct/Makefile'}, {'damage_type': 'backtrace', 'id': 1125023043, 'ino': 1099511637175, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/exit_group/Makefile'}, {'damage_type': 'backtrace', 'id': 1258450411, 'ino': 1099511636979, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/io_throttle_testplan.txt'}, {'damage_type': 'backtrace', 'id': 1320652921, 'ino': 1099511636966, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg'}, {'damage_type': 'backtrace', 'id': 1332067593, 'ino': 1099511636416, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_def_task01.c'}, {'damage_type': 'backtrace', 'id': 1375823048, 'ino': 1099511636304, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_3_2.sh'}, {'damage_type': 'backtrace', 'id': 1390313570, 'ino': 1099511636465, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/freeze_kill_thaw.sh'}, {'damage_type': 'backtrace', 'id': 1447516868, 'ino': 1099511636693, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_spread_test'}, {'damage_type': 'backtrace', 'id': 1465305986, 'ino': 1099511636471, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/README'}, {'damage_type': 'backtrace', 'id': 1490776051, 'ino': 1099511636460, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/fork_exec_loop.c'}, {'damage_type': 'backtrace', 'id': 1582681261, 'ino': 1099511636448, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/freeze_move_thaw.sh'}, {'damage_type': 'backtrace', 'id': 1599729861, 'ino': 1099511636686, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_hotplug_test'}, {'damage_type': 'backtrace', 'id': 1714697047, 'ino': 1099511636272, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/libbitmask.c'}, {'damage_type': 'backtrace', 'id': 1784086811, 'ino': 1099511636459, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/freeze_self_thaw.sh'}, {'damage_type': 'backtrace', 'id': 1838119887, 'ino': 1099511636306, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/Makefile'}, {'damage_type': 'backtrace', 'id': 1863567726, 'ino': 1099511636280, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_load_balance_test/cpuset_sched_domains_test.sh'}, {'damage_type': 'backtrace', 'id': 1865085299, 'ino': 1099511636962, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj'}, {'damage_type': 'backtrace', 'id': 1866644731, 'ino': 1099511636432, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuacct/cpuacct_testplan.txt'}, {'damage_type': 'backtrace', 'id': 1882901764, 'ino': 1099511636433, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/regression/memcg_test_4.sh'}, {'damage_type': 'backtrace', 'id': 1892249745, 'ino': 1099511636031, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/quota_remount/quota_remount_test01.sh'}, {'damage_type': 'backtrace', 'id': 1909728326, 'ino': 1099511636690, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_load_balance_test/cpuset_sched_domains_check.c'}, {'damage_type': 'backtrace', 'id': 1918746553, 'ino': 1099511636679, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memctl'}, {'damage_type': 'backtrace', 'id': 1971645311, 'ino': 1099511636453, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/Makefile'}, {'damage_type': 'backtrace', 'id': 1991087207, 'ino': 1099511636309, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/README'}, {'damage_type': 'backtrace', 'id': 1993440907, 'ino': 1099511636699, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_inherit_test'}, {'damage_type': 'backtrace', 'id': 2009447856, 'ino': 1099511636299, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl_fj/Makefile'}, {'damage_type': 'backtrace', 'id': 2050346341, 'ino': 1099511636463, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/vfork_freeze.sh'}, {'damage_type': 'backtrace', 'id': 2069809941, 'ino': 1099511636446, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/00_description.txt'}, {'damage_type': 'backtrace', 'id': 2087244977, 'ino': 1099511636316, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/parameters.sh'}, {'damage_type': 'backtrace', 'id': 2146724123, 'ino': 1099511636704, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_test/Makefile'}, {'damage_type': 'backtrace', 'id': 2148016376, 'ino': 1099511636662, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/acpi/LtpAcpi.h'}, {'damage_type': 'backtrace', 'id': 2159213867, 'ino': 1099511636268, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/libcpuset.c'}, {'damage_type': 'backtrace', 'id': 2163400128, 'ino': 1099511636311, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_10_2.sh'}, {'damage_type': 'backtrace', 'id': 2197245130, 'ino': 1099511636296, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_test/cpuset_memory_testset.sh'}, {'damage_type': 'backtrace', 'id': 2200674756, 'ino': 1099511636972, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/stress'}, {'damage_type': 'backtrace', 'id': 2248001689, 'ino': 1099511636303, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/fork_processes.c'}, {'damage_type': 'backtrace', 'id': 2255962387, 'ino': 1099511636437, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/regression/memcg_test_1.c'}, {'damage_type': 'backtrace', 'id': 2266245235, 'ino': 1099511636687, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_hotplug_test/Makefile'}, {'damage_type': 'backtrace', 'id': 2272690476, 'ino': 1099511636438, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/functional/Makefile'}, {'damage_type': 'backtrace', 'id': 2291880093, 'ino': 1099511636418, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/cgroup_fj_stress.sh'}, {'damage_type': 'backtrace', 'id': 2313389239, 'ino': 1099511636408, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_def_task03.c'}, {'damage_type': 'backtrace', 'id': 2313494513, 'ino': 1099511636410, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/run_cpuctl_test.sh'}, {'damage_type': 'backtrace', 'id': 2316158661, 'ino': 1099511636428, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuacct/run_cpuacct_test.sh'}, {'damage_type': 'backtrace', 'id': 2388103535, 'ino': 1099511636978, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle'}, {'damage_type': 'backtrace', 'id': 2417059810, 'ino': 1099511636314, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/cgroup_regression_test.sh'}, {'damage_type': 'backtrace', 'id': 2455496604, 'ino': 1099511636245, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/acpi/README'}, {'damage_type': 'backtrace', 'id': 2512945374, 'ino': 1099511636694, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_spread_test/Makefile'}, {'damage_type': 'backtrace', 'id': 2515151758, 'ino': 1099511636269, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/cpuinfo.h'}, {'damage_type': 'backtrace', 'id': 2579449390, 'ino': 1099511636310, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_6_1.sh'}, {'damage_type': 'backtrace', 'id': 2584084537, 'ino': 1099511637227, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sigsuspend/sigsuspend01.c'}, {'damage_type': 'backtrace', 'id': 2595898868, 'ino': 1099511636684, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_syscall_test'}, {'damage_type': 'backtrace', 'id': 2605918473, 'ino': 1099511636273, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/common.h'}, {'damage_type': 'backtrace', 'id': 2617400037, 'ino': 1099511636696, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_hierarchy_test/cpuset_hierarchy_test.sh'}, {'damage_type': 'backtrace', 'id': 2630978404, 'ino': 1099511636293, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_pressure_test/cpuset_memory_pressure_testset.sh'}, {'damage_type': 'backtrace', 'id': 2675270843, 'ino': 1099511636468, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/libcontrollers/Makefile'}, {'damage_type': 'backtrace', 'id': 2678044541, 'ino': 1099511636452, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/libltp'}, {'damage_type': 'backtrace', 'id': 2728839120, 'ino': 1099511636701, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_pressure_test'}, {'damage_type': 'backtrace', 'id': 2735784760, 'ino': 1099511636286, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_spread_test/cpuset_mem_hog.c'}, {'damage_type': 'backtrace', 'id': 2772613512, 'ino': 1099511636313, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/getdelays.c'}, {'damage_type': 'backtrace', 'id': 2774346697, 'ino': 1099511636974, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer'}, {'damage_type': 'backtrace', 'id': 2780158651, 'ino': 1099511637364, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/waitid/waitid01.c'}, {'damage_type': 'backtrace', 'id': 2814712864, 'ino': 1099511636697, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_base_ops_test'}, {'damage_type': 'backtrace', 'id': 2821562977, 'ino': 1099511636975, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/COPYING'}, {'damage_type': 'backtrace', 'id': 2832182673, 'ino': 1099511636436, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/regression/memcg_test_2.c'}, {'damage_type': 'backtrace', 'id': 2886723062, 'ino': 1099511636449, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/write_freezing.sh'}, {'damage_type': 'backtrace', 'id': 2891139515, 'ino': 1099511636244, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/acpi/LtpAcpiCmds.c'}, {'damage_type': 'backtrace', 'id': 2909393032, 'ino': 1099511636270, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/cpuset_funcs.sh'}, {'damage_type': 'backtrace', 'id': 2929818425, 'ino': 1099511636466, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/freeze_write_freezing.sh'}, {'damage_type': 'backtrace', 'id': 2931764397, 'ino': 1099511636689, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_load_balance_test'}, {'damage_type': 'backtrace', 'id': 2987646244, 'ino': 1099511636427, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/test_controllers.sh'}, {'damage_type': 'backtrace', 'id': 3006745939, 'ino': 1099511636971, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/functional/memcg_process.c'}, {'damage_type': 'backtrace', 'id': 3057719988, 'ino': 1099511636271, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/meminfo.h'}, {'damage_type': 'backtrace', 'id': 3067600316, 'ino': 1099511636467, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/libcontrollers/libcontrollers.h'}, {'damage_type': 'backtrace', 'id': 3083358164, 'ino': 1099511636695, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_hierarchy_test'}, {'damage_type': 'backtrace', 'id': 3099028012, 'ino': 1099511636967, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/regression'}, {'damage_type': 'backtrace', 'id': 3214529145, 'ino': 1099511636445, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/vfork.c'}, {'damage_type': 'backtrace', 'id': 3216363674, 'ino': 1099511636420, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/cgroup_fj_utility.sh'}, {'damage_type': 'backtrace', 'id': 3221108789, 'ino': 1099511636242, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/acpi/LtpAcpiMain.c'}, {'damage_type': 'backtrace', 'id': 3238196576, 'ino': 1099511636276, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_syscall_test/cpuset_syscall_test.c'}, {'damage_type': 'backtrace', 'id': 3238400800, 'ino': 1099511636440, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/functional/memcg_function_test.sh'}, {'damage_type': 'backtrace', 'id': 3240394607, 'ino': 1099511636405, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_test02.c'}, {'damage_type': 'backtrace', 'id': 3263329392, 'ino': 1099511636447, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/CHANGELOG'}, {'damage_type': 'backtrace', 'id': 3264298616, 'ino': 1099511636968, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/regression/memcg_test_4.c'}, {'damage_type': 'backtrace', 'id': 3291860811, 'ino': 1099511636961, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_test03.c'}, {'damage_type': 'backtrace', 'id': 3305224259, 'ino': 1099511636457, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/TODO'}, {'damage_type': 'backtrace', 'id': 3305566594, 'ino': 1099511636275, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/cpuset.h'}, {'damage_type': 'backtrace', 'id': 3314112248, 'ino': 1099511636297, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_test/cpuset_memory_test.c'}, {'damage_type': 'backtrace', 'id': 3348851742, 'ino': 1099511636274, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_lib/meminfo.c'}, {'damage_type': 'backtrace', 'id': 3379626497, 'ino': 1099511636450, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/fork_freeze.sh'}, {'damage_type': 'backtrace', 'id': 3390661953, 'ino': 1099511636411, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_test04.c'}, {'damage_type': 'backtrace', 'id': 3431196103, 'ino': 1099511636698, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_base_ops_test/cpuset_base_ops_testset.sh'}, {'damage_type': 'backtrace', 'id': 3442726910, 'ino': 1099511636688, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/Makefile'}, {'damage_type': 'backtrace', 'id': 3508236709, 'ino': 1099511636435, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/regression/memcg_regression_test.sh'}, {'damage_type': 'backtrace', 'id': 3511563827, 'ino': 1099511636977, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/libcontrollers/libcontrollers.c'}, {'damage_type': 'backtrace', 'id': 3589775205, 'ino': 1099511636285, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_exclusive_test/Makefile'}, {'damage_type': 'backtrace', 'id': 3598862843, 'ino': 1099511636294, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_pressure_test/cpuset_memory_pressure.c'}, {'damage_type': 'backtrace', 'id': 3622130744, 'ino': 1099511636451, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/stop_freeze_thaw_cont.sh'}, {'damage_type': 'backtrace', 'id': 3637326280, 'ino': 1099511636283, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_load_balance_test/cpuset_cpu_hog.c'}, {'damage_type': 'backtrace', 'id': 3659947054, 'ino': 1099511636419, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/cgroup_fj_function.sh'}, {'damage_type': 'backtrace', 'id': 3664342523, 'ino': 1099511636300, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl_fj/README'}, {'damage_type': 'backtrace', 'id': 3678202466, 'ino': 1099511636289, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_base_ops_test/Makefile'}, {'damage_type': 'backtrace', 'id': 3691635378, 'ino': 1099511636312, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_9_1.sh'}, {'damage_type': 'backtrace', 'id': 3726091267, 'ino': 1099511636464, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/freeze_cancel.sh'}, {'damage_type': 'backtrace', 'id': 3729423929, 'ino': 1099511636246, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/acpi/ltpacpi.sh'}, {'damage_type': 'backtrace', 'id': 3731134400, 'ino': 1099511636302, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl_fj/cpuctl_fj_cpu-hog.c'}, {'damage_type': 'backtrace', 'id': 3808305558, 'ino': 1099511636301, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl_fj/run_cpuctl_test_fj.sh'}, {'damage_type': 'backtrace', 'id': 3832779757, 'ino': 1099511636969, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/Makefile'}, {'damage_type': 'backtrace', 'id': 3837895233, 'ino': 1099511636318, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/run_cpuctl_latency_test.sh'}, {'damage_type': 'backtrace', 'id': 3839268943, 'ino': 1099511636964, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuacct'}, {'damage_type': 'backtrace', 'id': 3840368498, 'ino': 1099511636265, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memctl/myfunctions.sh'}, {'damage_type': 'backtrace', 'id': 3876344108, 'ino': 1099511636422, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup_fj/cgroup_fj_release_agent'}, {'damage_type': 'backtrace', 'id': 3909330179, 'ino': 1099511636444, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/run_freezer.sh'}, {'damage_type': 'backtrace', 'id': 3935102608, 'ino': 1099511636295, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/Makefile.inc'}, {'damage_type': 'backtrace', 'id': 3948102982, 'ino': 1099511636434, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/regression/Makefile'}, {'damage_type': 'backtrace', 'id': 3953790990, 'ino': 1099511636409, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_test01.c'}, {'damage_type': 'backtrace', 'id': 3957177949, 'ino': 1099511636703, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_test'}, {'damage_type': 'backtrace', 'id': 4004983063, 'ino': 1099511636278, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_hotplug_test/cpuset_hotplug_test.sh'}, {'damage_type': 'backtrace', 'id': 4027258013, 'ino': 1099511636406, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/Makefile'}, {'damage_type': 'backtrace', 'id': 4081053829, 'ino': 1099511636707, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup'}, {'damage_type': 'backtrace', 'id': 4084264509, 'ino': 1099511636407, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuctl/cpuctl_testplan.txt'}, {'damage_type': 'backtrace', 'id': 4086026649, 'ino': 1099511637789, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/exit_group/exit_group01.c'}, {'damage_type': 'backtrace', 'id': 4125184219, 'ino': 1099511636279, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_hotplug_test/cpuset_list_compute.c'}, {'damage_type': 'backtrace', 'id': 4132783926, 'ino': 1099511636680, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memctl/memctl_test01.c'}, {'damage_type': 'backtrace', 'id': 4149014641, 'ino': 1099511636879, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/waitid/waitid02.c'}, {'damage_type': 'backtrace', 'id': 4161954254, 'ino': 1099511636456, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/freezer/README'}, {'damage_type': 'backtrace', 'id': 4164129214, 'ino': 1099511636678, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/testplan.txt'}, {'damage_type': 'backtrace', 'id': 4194194333, 'ino': 1099511636474, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/Makefile.inc'}, {'damage_type': 'backtrace', 'id': 4209129878, 'ino': 1099511636262, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memctl/README'}, {'damage_type': 'backtrace', 'id': 4216469646, 'ino': 1099511636691, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_exclusive_test'}, {'damage_type': 'backtrace', 'id': 4228048066, 'ino': 1099511636307, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cgroup/test_10_1.sh'}, {'damage_type': 'backtrace', 'id': 4251156841, 'ino': 1099511636965, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuacct/cpuacct_setup.sh'}, {'damage_type': 'backtrace', 'id': 4287600724, 'ino': 1099511636298, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/Makefile'}] 2024-01-31T05:13:37.838 ERROR:tasks.fwd_scrub:rank 1 damaged: [{'damage_type': 'backtrace', 'id': 52393769, 'ino': 1099511635559, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test24'}, {'damage_type': 'backtrace', 'id': 116397240, 'ino': 1099511636259, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/connectors/pec/pec_listener.c'}, {'damage_type': 'backtrace', 'id': 181228585, 'ino': 1099511635523, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test22'}, {'damage_type': 'backtrace', 'id': 260085630, 'ino': 1099511635074, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/LICENCE'}, {'damage_type': 'backtrace', 'id': 299333345, 'ino': 1099511635522, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test10'}, {'damage_type': 'backtrace', 'id': 409235203, 'ino': 1099511635533, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test04'}, {'damage_type': 'backtrace', 'id': 445367478, 'ino': 1099511635542, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test29'}, {'damage_type': 'backtrace', 'id': 447480632, 'ino': 1099511636336, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/utsname/runtests_noltp.sh'}, {'damage_type': 'backtrace', 'id': 466754113, 'ino': 1099511635527, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test34'}, {'damage_type': 'backtrace', 'id': 512638973, 'ino': 1099511636676, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/connectors/pec/event_generator.c'}, {'damage_type': 'backtrace', 'id': 532277680, 'ino': 1099511635557, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test39'}, {'damage_type': 'backtrace', 'id': 611281358, 'ino': 1099511635526, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test23'}, {'damage_type': 'backtrace', 'id': 649226571, 'ino': 1099511635558, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test01'}, {'damage_type': 'backtrace', 'id': 914360973, 'ino': 1099511635540, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test14'}, {'damage_type': 'backtrace', 'id': 961499438, 'ino': 1099511635539, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test11'}, {'damage_type': 'backtrace', 'id': 1088677987, 'ino': 1099511635551, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test18'}, {'damage_type': 'backtrace', 'id': 1146094812, 'ino': 1099511635521, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test33'}, {'damage_type': 'backtrace', 'id': 1327750009, 'ino': 1099511635532, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test06'}, {'damage_type': 'backtrace', 'id': 1406870871, 'ino': 1099511635546, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test37'}, {'damage_type': 'backtrace', 'id': 1506940652, 'ino': 1099511635782, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/utsname/README'}, {'damage_type': 'backtrace', 'id': 1553351783, 'ino': 1099511635537, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test30'}, {'damage_type': 'backtrace', 'id': 1567556430, 'ino': 1099511635525, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test03'}, {'damage_type': 'backtrace', 'id': 1596318644, 'ino': 1099511635072, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/testfrmw.h'}, {'damage_type': 'backtrace', 'id': 1623373313, 'ino': 1099511636258, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/connectors/pec/run_pec_test'}, {'damage_type': 'backtrace', 'id': 1687345103, 'ino': 1099511635544, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test08'}, {'damage_type': 'backtrace', 'id': 1743627842, 'ino': 1099511635545, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test27'}, {'damage_type': 'backtrace', 'id': 1746032903, 'ino': 1099511635552, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test36'}, {'damage_type': 'backtrace', 'id': 1747710079, 'ino': 1099511637309, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/stat/Makefile'}, {'damage_type': 'backtrace', 'id': 1880339536, 'ino': 1099511635535, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test15'}, {'damage_type': 'backtrace', 'id': 1883773029, 'ino': 1099511635548, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test07-2'}, {'damage_type': 'backtrace', 'id': 1924164131, 'ino': 1099511635520, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test26'}, {'damage_type': 'backtrace', 'id': 1939122782, 'ino': 1099511636797, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/stat/selinux_stat.sh'}, {'damage_type': 'backtrace', 'id': 1958568556, 'ino': 1099511637199, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/recvmsg/recvmsg01.c'}, {'damage_type': 'backtrace', 'id': 1964941109, 'ino': 1099511637103, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/access/Makefile'}, {'damage_type': 'backtrace', 'id': 2035160296, 'ino': 1099511635531, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test25'}, {'damage_type': 'backtrace', 'id': 2082078921, 'ino': 1099511635071, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/testfrmw.c'}, {'damage_type': 'backtrace', 'id': 2204449916, 'ino': 1099511635536, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test21'}, {'damage_type': 'backtrace', 'id': 2237802804, 'ino': 1099511635556, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test05'}, {'damage_type': 'backtrace', 'id': 2253074782, 'ino': 1099511637475, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/renameat/renameat01.c'}, {'damage_type': 'backtrace', 'id': 2267138183, 'ino': 1099511636257, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/connectors/pec/README'}, {'damage_type': 'backtrace', 'id': 2359135425, 'ino': 1099511635543, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test07'}, {'damage_type': 'backtrace', 'id': 2532379160, 'ino': 1099511635547, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test02'}, {'damage_type': 'backtrace', 'id': 2534448682, 'ino': 1099511636256, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/connectors/pec/Makefile'}, {'damage_type': 'backtrace', 'id': 2537330424, 'ino': 1099511635554, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test38'}, {'damage_type': 'backtrace', 'id': 2631958408, 'ino': 1099511635784, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/utsname/runutstest.sh'}, {'damage_type': 'backtrace', 'id': 2651869098, 'ino': 1099511637102, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/access/access04.c'}, {'damage_type': 'backtrace', 'id': 2726901436, 'ino': 1099511637178, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/personality/Makefile'}, {'damage_type': 'backtrace', 'id': 2750805361, 'ino': 1099511637179, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/personality/personality01.c'}, {'damage_type': 'backtrace', 'id': 2790137056, 'ino': 1099511635780, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/utsname/utstest.c'}, {'damage_type': 'backtrace', 'id': 2798322295, 'ino': 1099511637105, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/access/access05.c'}, {'damage_type': 'backtrace', 'id': 2841784172, 'ino': 1099511637104, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/access/access01.c'}, {'damage_type': 'backtrace', 'id': 2900721230, 'ino': 1099511635550, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test32'}, {'damage_type': 'backtrace', 'id': 2973417145, 'ino': 1099511635075, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/threads_scenarii.c'}, {'damage_type': 'backtrace', 'id': 3078329606, 'ino': 1099511635541, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test09'}, {'damage_type': 'backtrace', 'id': 3094476506, 'ino': 1099511637717, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/access/access02.c'}, {'damage_type': 'backtrace', 'id': 3269472682, 'ino': 1099511635528, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test17'}, {'damage_type': 'backtrace', 'id': 3310716439, 'ino': 1099511635529, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test28'}, {'damage_type': 'backtrace', 'id': 3454231830, 'ino': 1099511637101, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/access/access03.c'}, {'damage_type': 'backtrace', 'id': 3458646227, 'ino': 1099511635524, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test13'}, {'damage_type': 'backtrace', 'id': 3499452828, 'ino': 1099511635073, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/NOTES'}, {'damage_type': 'backtrace', 'id': 3504666447, 'ino': 1099511636049, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test20'}, {'damage_type': 'backtrace', 'id': 3512599925, 'ino': 1099511637793, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/personality/personality02.c'}, {'damage_type': 'backtrace', 'id': 3652903028, 'ino': 1099511635781, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/utsname/Makefile'}, {'damage_type': 'backtrace', 'id': 3670747192, 'ino': 1099511635553, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test35'}, {'damage_type': 'backtrace', 'id': 3670773174, 'ino': 1099511635534, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test12'}, {'damage_type': 'backtrace', 'id': 3718354949, 'ino': 1099511635538, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/00_Descriptions.txt'}, {'damage_type': 'backtrace', 'id': 3725875969, 'ino': 1099511635070, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/Makefile'}, {'damage_type': 'backtrace', 'id': 3905913833, 'ino': 1099511635555, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test31'}, {'damage_type': 'backtrace', 'id': 3992620780, 'ino': 1099511635646, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/stress.c'}, {'damage_type': 'backtrace', 'id': 4107810518, 'ino': 1099511637807, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/recvmsg/Makefile'}, {'damage_type': 'backtrace', 'id': 4111427913, 'ino': 1099511638000, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/renameat/Makefile'}, {'damage_type': 'backtrace', 'id': 4149717588, 'ino': 1099511635549, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test16'}, {'damage_type': 'backtrace', 'id': 4216652488, 'ino': 1099511635783, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/containers/utsname/check_utsns_enabled.c'}, {'damage_type': 'backtrace', 'id': 4290165583, 'ino': 1099511635530, 'path': '/volumes/qa/sv_1/afb5b294-2883-459a-b856-3d1b5cb21c6f/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_bind/rbind/test19'}] 2024-01-31T05:13:37.838 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa/tasks/fwd_scrub.py", line 38, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa/tasks/fwd_scrub.py", line 55, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa/tasks/fwd_scrub.py", line 79, in _scrub self._check_damage() File "/home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa/tasks/fwd_scrub.py", line 90, in _check_damage raise RuntimeError(f"rank damage found: {types}") RuntimeError: rank damage found: {'backtrace'} 2024-01-31T05:13:38.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:37 smithi099 ceph-mon[31615]: pgmap v416: 97 pgs: 97 active+clean; 1.3 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 80 MiB/s rd, 92 MiB/s wr, 600 op/s 2024-01-31T05:13:38.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:37 smithi181 ceph-mon[36434]: pgmap v416: 97 pgs: 97 active+clean; 1.3 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 80 MiB/s rd, 92 MiB/s wr, 600 op/s 2024-01-31T05:13:38.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:37 smithi179 ceph-mon[35652]: pgmap v416: 97 pgs: 97 active+clean; 1.3 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 80 MiB/s rd, 92 MiB/s wr, 600 op/s 2024-01-31T05:13:39.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:38 smithi099 ceph-mon[31615]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:13:39.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:38 smithi181 ceph-mon[36434]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:13:39.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:38 smithi179 ceph-mon[35652]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:13:39.996 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-01-31T05:13:39.996 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-01-31T05:13:40.019 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:39 smithi099 ceph-mon[31615]: pgmap v417: 97 pgs: 97 active+clean; 921 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 54 MiB/s rd, 67 MiB/s wr, 675 op/s 2024-01-31T05:13:40.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:39 smithi181 ceph-mon[36434]: pgmap v417: 97 pgs: 97 active+clean; 921 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 54 MiB/s rd, 67 MiB/s wr, 675 op/s 2024-01-31T05:13:40.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:39 smithi179 ceph-mon[35652]: pgmap v417: 97 pgs: 97 active+clean; 921 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 54 MiB/s rd, 67 MiB/s wr, 675 op/s 2024-01-31T05:13:41.453 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.453+0000 7fee88c78640 1 -- 172.21.15.99:0/1896440995 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee841028f0 msgr2=0x7fee84109180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:41.453 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.453+0000 7fee88c78640 1 --2- 172.21.15.99:0/1896440995 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee841028f0 0x7fee84109180 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fee7c009ca0 tx=0x7fee7c02c0f0 comp rx=0 tx=0).stop 2024-01-31T05:13:41.453 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.454+0000 7fee88c78640 1 -- 172.21.15.99:0/1896440995 shutdown_connections 2024-01-31T05:13:41.453 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.454+0000 7fee88c78640 1 --2- 172.21.15.99:0/1896440995 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee841028f0 0x7fee84109180 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:41.453 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.454+0000 7fee88c78640 1 --2- 172.21.15.99:0/1896440995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee84101f30 0x7fee841023b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:41.453 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.454+0000 7fee88c78640 1 --2- 172.21.15.99:0/1896440995 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fee84100d40 0x7fee84101160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:41.453 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.454+0000 7fee88c78640 1 -- 172.21.15.99:0/1896440995 >> 172.21.15.99:0/1896440995 conn(0x7fee840fc2b0 msgr2=0x7fee840fe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:41.453 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.454+0000 7fee88c78640 1 -- 172.21.15.99:0/1896440995 shutdown_connections 2024-01-31T05:13:41.454 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.454+0000 7fee88c78640 1 -- 172.21.15.99:0/1896440995 wait complete. 2024-01-31T05:13:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.454+0000 7fee88c78640 1 Processor -- start 2024-01-31T05:13:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.454+0000 7fee88c78640 1 -- start start 2024-01-31T05:13:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.455+0000 7fee88c78640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fee84100d40 0x7fee84196bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.455+0000 7fee88c78640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee84101f30 0x7fee84197130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.455+0000 7fee88c78640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee841028f0 0x7fee8419e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.455+0000 7fee88c78640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee8419e6e0 con 0x7fee84101f30 2024-01-31T05:13:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.455+0000 7fee88c78640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee8419e850 con 0x7fee841028f0 2024-01-31T05:13:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.455+0000 7fee88c78640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee8419ea10 con 0x7fee84100d40 2024-01-31T05:13:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.455+0000 7fee81d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee84101f30 0x7fee84197130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.455+0000 7fee82d9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee841028f0 0x7fee8419e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.455+0000 7fee81d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee84101f30 0x7fee84197130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35640/0 (socket says 172.21.15.99:35640) 2024-01-31T05:13:41.457 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.455+0000 7fee81d9b640 1 -- 172.21.15.99:0/537722386 learned_addr learned my addr 172.21.15.99:0/537722386 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:41.457 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.455+0000 7fee8259c640 1 --2- 172.21.15.99:0/537722386 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fee84100d40 0x7fee84196bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:41.457 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.455+0000 7fee81d9b640 1 -- 172.21.15.99:0/537722386 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fee84100d40 msgr2=0x7fee84196bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:41.457 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.455+0000 7fee81d9b640 1 --2- 172.21.15.99:0/537722386 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fee84100d40 0x7fee84196bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:41.457 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.455+0000 7fee81d9b640 1 -- 172.21.15.99:0/537722386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee841028f0 msgr2=0x7fee8419e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:41.457 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.455+0000 7fee81d9b640 1 --2- 172.21.15.99:0/537722386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee841028f0 0x7fee8419e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:41.457 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.455+0000 7fee81d9b640 1 -- 172.21.15.99:0/537722386 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee7c009900 con 0x7fee84101f30 2024-01-31T05:13:41.457 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.455+0000 7fee82d9d640 1 --2- 172.21.15.99:0/537722386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee841028f0 0x7fee8419e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:13:41.457 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.455+0000 7fee81d9b640 1 --2- 172.21.15.99:0/537722386 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee84101f30 0x7fee84197130 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fee7800d950 tx=0x7fee7800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:41.457 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.455+0000 7fee737fe640 1 -- 172.21.15.99:0/537722386 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee78009c30 con 0x7fee84101f30 2024-01-31T05:13:41.457 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.455+0000 7fee737fe640 1 -- 172.21.15.99:0/537722386 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fee78009d90 con 0x7fee84101f30 2024-01-31T05:13:41.457 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.455+0000 7fee737fe640 1 -- 172.21.15.99:0/537722386 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7800f740 con 0x7fee84101f30 2024-01-31T05:13:41.457 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.455+0000 7fee88c78640 1 -- 172.21.15.99:0/537722386 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee8419ecf0 con 0x7fee84101f30 2024-01-31T05:13:41.457 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.455+0000 7fee88c78640 1 -- 172.21.15.99:0/537722386 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee8419f1b0 con 0x7fee84101f30 2024-01-31T05:13:41.463 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.457+0000 7fee737fe640 1 -- 172.21.15.99:0/537722386 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 20) v1 ==== 135895+0+0 (secure 0 0 0) 0x7fee78010a20 con 0x7fee84101f30 2024-01-31T05:13:41.463 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.458+0000 7fee8ba39740 1 Processor -- start 2024-01-31T05:13:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.458+0000 7fee8ba39740 1 -- start start 2024-01-31T05:13:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.458+0000 7fee737fe640 1 --2- 172.21.15.99:0/537722386 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fee6c0a1380 0x7fee6c0a3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.459+0000 7fee8ba39740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5627d290a270 0x5627d290a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.459+0000 7fee8ba39740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627d290ac60 0x5627d290f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.459+0000 7fee82d9d640 1 --2- 172.21.15.99:0/537722386 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fee6c0a1380 0x7fee6c0a3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.459+0000 7fee8ba39740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5627d290fdd0 0x5627d2912260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.459+0000 7fee8ba39740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d287a040 con 0x5627d290ac60 2024-01-31T05:13:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.459+0000 7fee8ba39740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d2877730 con 0x5627d290fdd0 2024-01-31T05:13:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.459+0000 7fee8ba39740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d2873020 con 0x5627d290a270 2024-01-31T05:13:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.459+0000 7fee737fe640 1 -- 172.21.15.99:0/537722386 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fee780cc670 con 0x7fee84101f30 2024-01-31T05:13:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.459+0000 7fee8259c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5627d290a270 0x5627d290a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.459+0000 7fee81d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627d290ac60 0x5627d290f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:41.465 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.459+0000 7fee8259c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5627d290a270 0x5627d290a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:57352/0 (socket says 172.21.15.99:57352) 2024-01-31T05:13:41.465 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.459+0000 7fee82d9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5627d290fdd0 0x5627d2912260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:41.465 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.459+0000 7fee8259c640 1 -- 172.21.15.99:0/3937429585 learned_addr learned my addr 172.21.15.99:0/3937429585 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:41.465 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.459+0000 7fee81d9b640 1 -- 172.21.15.99:0/3937429585 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5627d290a270 msgr2=0x5627d290a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:41.465 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.459+0000 7fee81d9b640 1 --2- 172.21.15.99:0/3937429585 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5627d290a270 0x5627d290a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:41.465 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.459+0000 7fee81d9b640 1 -- 172.21.15.99:0/3937429585 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5627d290fdd0 msgr2=0x5627d2912260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:41.465 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.459+0000 7fee81d9b640 1 --2- 172.21.15.99:0/3937429585 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5627d290fdd0 0x5627d2912260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:41.465 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.459+0000 7fee82d9d640 1 --2- 172.21.15.99:0/537722386 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fee6c0a1380 0x7fee6c0a3840 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fee7c005e30 tx=0x7fee7c032eb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:41.465 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.459+0000 7fee81d9b640 1 -- 172.21.15.99:0/3937429585 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627d286ae40 con 0x5627d290ac60 2024-01-31T05:13:41.465 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.459+0000 7fee81d9b640 1 --2- 172.21.15.99:0/3937429585 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627d290ac60 0x5627d290f760 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fee780ca260 tx=0x7fee78099800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cbf0e1653715e35 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:41.465 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.459+0000 7fee70ff9640 1 -- 172.21.15.99:0/3937429585 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee780b9070 con 0x5627d290ac60 2024-01-31T05:13:41.465 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.459+0000 7fee70ff9640 1 -- 172.21.15.99:0/3937429585 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fee780a1be0 con 0x5627d290ac60 2024-01-31T05:13:41.465 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.459+0000 7fee70ff9640 1 -- 172.21.15.99:0/3937429585 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee780b7bb0 con 0x5627d290ac60 2024-01-31T05:13:41.465 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.460+0000 7fee8ba39740 1 -- 172.21.15.99:0/3937429585 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627d290ac60 msgr2=0x5627d290f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:41.465 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.460+0000 7fee8ba39740 1 --2- 172.21.15.99:0/3937429585 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627d290ac60 0x5627d290f760 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fee780ca260 tx=0x7fee78099800 comp rx=0 tx=0).stop 2024-01-31T05:13:41.466 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.460+0000 7fee8ba39740 1 -- 172.21.15.99:0/3937429585 shutdown_connections 2024-01-31T05:13:41.466 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.460+0000 7fee8ba39740 1 --2- 172.21.15.99:0/3937429585 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5627d290fdd0 0x5627d2912260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:41.466 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.460+0000 7fee8ba39740 1 --2- 172.21.15.99:0/3937429585 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627d290ac60 0x5627d290f760 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:41.466 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.460+0000 7fee8ba39740 1 --2- 172.21.15.99:0/3937429585 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5627d290a270 0x5627d290a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:41.466 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.460+0000 7fee8ba39740 1 -- 172.21.15.99:0/3937429585 >> 172.21.15.99:0/3937429585 conn(0x5627d29057e0 msgr2=0x5627d2905be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:41.466 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.460+0000 7fee8ba39740 1 -- 172.21.15.99:0/3937429585 shutdown_connections 2024-01-31T05:13:41.466 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.460+0000 7fee8ba39740 1 -- 172.21.15.99:0/3937429585 wait complete. 2024-01-31T05:13:41.466 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.461+0000 7fee8ba39740 1 -- start start 2024-01-31T05:13:41.466 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.461+0000 7fee8ba39740 1 Processor -- start 2024-01-31T05:13:41.466 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.461+0000 7fee8ba39740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5627d290a270 0x5627d2914240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:41.466 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.461+0000 7fee8ba39740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627d290ac60 0x5627d2914780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:41.466 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.461+0000 7fee8ba39740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5627d290fdd0 0x5627d291b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:41.467 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.461+0000 7fee8ba39740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d282c1b0 con 0x5627d290ac60 2024-01-31T05:13:41.467 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.461+0000 7fee8ba39740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d282be50 con 0x5627d290a270 2024-01-31T05:13:41.467 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.461+0000 7fee8ba39740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d27f1090 con 0x5627d290fdd0 2024-01-31T05:13:41.467 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.461+0000 7fee81d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627d290ac60 0x5627d2914780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:41.467 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.461+0000 7fee81d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627d290ac60 0x5627d2914780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35652/0 (socket says 172.21.15.99:35652) 2024-01-31T05:13:41.467 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.461+0000 7fee81d9b640 1 -- 172.21.15.99:0/2516334765 learned_addr learned my addr 172.21.15.99:0/2516334765 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:41.467 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.461+0000 7fee82d9d640 1 --2- 172.21.15.99:0/2516334765 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5627d290fdd0 0x5627d291b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:41.467 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.461+0000 7fee8259c640 1 --2- 172.21.15.99:0/2516334765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5627d290a270 0x5627d2914240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:41.467 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.461+0000 7fee8ba39740 10 client.0 _ll_register_callbacks cb 0x5627d2816a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:13:41.467 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.461+0000 7fee81d9b640 1 -- 172.21.15.99:0/2516334765 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5627d290fdd0 msgr2=0x5627d291b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:41.467 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.461+0000 7fee81d9b640 1 --2- 172.21.15.99:0/2516334765 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5627d290fdd0 0x5627d291b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:41.467 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.461+0000 7fee81d9b640 1 -- 172.21.15.99:0/2516334765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5627d290a270 msgr2=0x5627d2914240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:41.467 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.461+0000 7fee81d9b640 1 --2- 172.21.15.99:0/2516334765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5627d290a270 0x5627d2914240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:41.467 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.461+0000 7fee81d9b640 1 -- 172.21.15.99:0/2516334765 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee8419f1b0 con 0x5627d290ac60 2024-01-31T05:13:41.468 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.461+0000 7fee81d9b640 1 --2- 172.21.15.99:0/2516334765 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627d290ac60 0x5627d2914780 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fee78096370 tx=0x7fee78095c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=132ac6c9ee1729b4 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:41.468 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.461+0000 7fee69ffb640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:13:41.468 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.461+0000 7fee69ffb640 1 -- 172.21.15.99:0/2516334765 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee78097ca0 con 0x5627d290ac60 2024-01-31T05:13:41.468 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.461+0000 7fee69ffb640 1 -- 172.21.15.99:0/2516334765 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fee78096010 con 0x5627d290ac60 2024-01-31T05:13:41.468 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.461+0000 7fee8ba39740 1 -- 172.21.15.99:0/2516334765 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5627d286c010 con 0x5627d290ac60 2024-01-31T05:13:41.468 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.462+0000 7fee69ffb640 1 -- 172.21.15.99:0/2516334765 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee780b7bb0 con 0x5627d290ac60 2024-01-31T05:13:41.468 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.462+0000 7fee8ba39740 10 client.16209 fetch_fsmap learned FSMap version 39 2024-01-31T05:13:41.468 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.462+0000 7fee8ba39740 1 -- 172.21.15.99:0/2516334765 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5627d28716a0 con 0x5627d290ac60 2024-01-31T05:13:41.468 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.462+0000 7fee69ffb640 1 -- 172.21.15.99:0/2516334765 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5627d286c010 con 0x5627d290ac60 2024-01-31T05:13:41.468 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.462+0000 7fee69ffb640 1 -- 172.21.15.99:0/2516334765 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 39) v1 ==== 7934+0+0 (secure 0 0 0) 0x7fee7809abf0 con 0x5627d290ac60 2024-01-31T05:13:41.468 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.462+0000 7fee8ba39740 10 client.16209 fetch_fsmap finished waiting for FSMap version 39 2024-01-31T05:13:41.468 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.462+0000 7fee8ba39740 10 client.16209 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-01-31T05:13:41.468 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.462+0000 7fee8ba39740 20 client.16209 populate_metadata read hostname 'smithi099' 2024-01-31T05:13:41.468 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.462+0000 7fee8ba39740 1 --2- 172.21.15.99:0/2516334765 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5627d291fb70 0x5627d2921f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:41.469 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.462+0000 7fee8ba39740 4 client.16209 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:13:41.469 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.462+0000 7fee8ba39740 1 -- 172.21.15.99:0/2516334765 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5627d286bd30 con 0x5627d291fb70 2024-01-31T05:13:41.469 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.462+0000 7fee8259c640 1 --2- 172.21.15.99:0/2516334765 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5627d291fb70 0x5627d2921f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:41.469 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.463+0000 7fee69ffb640 10 client.16209 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:13:41.469 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.463+0000 7fee8259c640 1 --2- 172.21.15.99:0/2516334765 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5627d291fb70 0x5627d2921f90 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54d76e13439b29c3 server_cookie=f244239165e98733 in_seq=0 out_seq=0 2024-01-31T05:13:41.469 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.464+0000 7fee69ffb640 1 -- 172.21.15.99:0/2516334765 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5627d286bd30 con 0x5627d291fb70 2024-01-31T05:13:41.469 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.464+0000 7fee69ffb640 10 client.16209 handle_command_reply: tid=0 2024-01-31T05:13:41.469 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.464+0000 7fee8ba39740 1 client.16209 shutdown 2024-01-31T05:13:41.469 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.464+0000 7fee8ba39740 1 -- 172.21.15.99:0/2516334765 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627d290ac60 msgr2=0x5627d2914780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:41.469 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.464+0000 7fee8ba39740 1 --2- 172.21.15.99:0/2516334765 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627d290ac60 0x5627d2914780 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fee78096370 tx=0x7fee78095c40 comp rx=0 tx=0).stop 2024-01-31T05:13:41.469 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.464+0000 7fee8ba39740 1 -- 172.21.15.99:0/2516334765 shutdown_connections 2024-01-31T05:13:41.469 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.464+0000 7fee8ba39740 1 --2- 172.21.15.99:0/2516334765 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5627d290fdd0 0x5627d291b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:41.469 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.464+0000 7fee8ba39740 1 --2- 172.21.15.99:0/2516334765 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627d290ac60 0x5627d2914780 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:41.469 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.464+0000 7fee8ba39740 1 --2- 172.21.15.99:0/2516334765 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5627d291fb70 0x5627d2921f90 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:41.470 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.464+0000 7fee8ba39740 1 --2- 172.21.15.99:0/2516334765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5627d290a270 0x5627d2914240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:41.470 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.464+0000 7fee8ba39740 1 -- 172.21.15.99:0/2516334765 >> 172.21.15.99:0/2516334765 conn(0x5627d29057e0 msgr2=0x5627d2904a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:41.470 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.464+0000 7fee69ffb640 0 client.16209 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:13:41.470 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.464+0000 7fee8ba39740 1 -- 172.21.15.99:0/2516334765 shutdown_connections 2024-01-31T05:13:41.470 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.464+0000 7fee8ba39740 1 -- 172.21.15.99:0/2516334765 wait complete. 2024-01-31T05:13:41.470 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.464+0000 7fee8ba39740 20 client.16209 trim_cache size 0 max 16384 2024-01-31T05:13:41.481 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.477+0000 7fee8ba39740 1 Processor -- start 2024-01-31T05:13:41.481 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.477+0000 7fee8ba39740 1 -- start start 2024-01-31T05:13:41.481 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.478+0000 7fee8ba39740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627d290a270 0x5627d2914240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:41.481 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.478+0000 7fee8ba39740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5627d290ac60 0x5627d2914780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:41.481 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.478+0000 7fee8ba39740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5627d290fdd0 0x5627d291b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:41.481 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.478+0000 7fee8ba39740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d29012b0 con 0x5627d290a270 2024-01-31T05:13:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.478+0000 7fee8ba39740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d2901050 con 0x5627d290ac60 2024-01-31T05:13:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.478+0000 7fee8ba39740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d29067b0 con 0x5627d290fdd0 2024-01-31T05:13:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.478+0000 7fee8259c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627d290a270 0x5627d2914240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.478+0000 7fee8259c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627d290a270 0x5627d2914240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35658/0 (socket says 172.21.15.99:35658) 2024-01-31T05:13:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.478+0000 7fee8259c640 1 -- 172.21.15.99:0/601110115 learned_addr learned my addr 172.21.15.99:0/601110115 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.478+0000 7fee81d9b640 1 --2- 172.21.15.99:0/601110115 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5627d290ac60 0x5627d2914780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.478+0000 7fee8259c640 1 -- 172.21.15.99:0/601110115 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5627d290fdd0 msgr2=0x5627d291b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.478+0000 7fee8259c640 1 --2- 172.21.15.99:0/601110115 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5627d290fdd0 0x5627d291b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.478+0000 7fee8259c640 1 -- 172.21.15.99:0/601110115 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5627d290ac60 msgr2=0x5627d2914780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.478+0000 7fee8259c640 1 --2- 172.21.15.99:0/601110115 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5627d290ac60 0x5627d2914780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.478+0000 7fee8259c640 1 -- 172.21.15.99:0/601110115 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627d280e030 con 0x5627d290a270 2024-01-31T05:13:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.478+0000 7fee8259c640 1 --2- 172.21.15.99:0/601110115 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627d290a270 0x5627d2914240 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fee74005940 tx=0x7fee7400b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d20fafb8bf842d9 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.478+0000 7fee6bfff640 1 -- 172.21.15.99:0/601110115 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee74016040 con 0x5627d290a270 2024-01-31T05:13:41.483 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.478+0000 7fee6bfff640 1 -- 172.21.15.99:0/601110115 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fee74017040 con 0x5627d290a270 2024-01-31T05:13:41.483 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.478+0000 7fee6bfff640 1 -- 172.21.15.99:0/601110115 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7401f350 con 0x5627d290a270 2024-01-31T05:13:41.483 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.479+0000 7fee8ba39740 1 -- 172.21.15.99:0/601110115 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627d290a270 msgr2=0x5627d2914240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:41.483 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.479+0000 7fee8ba39740 1 --2- 172.21.15.99:0/601110115 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627d290a270 0x5627d2914240 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fee74005940 tx=0x7fee7400b390 comp rx=0 tx=0).stop 2024-01-31T05:13:41.483 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.479+0000 7fee8ba39740 1 -- 172.21.15.99:0/601110115 shutdown_connections 2024-01-31T05:13:41.483 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.479+0000 7fee8ba39740 1 --2- 172.21.15.99:0/601110115 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5627d290fdd0 0x5627d291b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:41.483 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.479+0000 7fee8ba39740 1 --2- 172.21.15.99:0/601110115 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5627d290ac60 0x5627d2914780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:41.483 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.479+0000 7fee8ba39740 1 --2- 172.21.15.99:0/601110115 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627d290a270 0x5627d2914240 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:41.483 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.479+0000 7fee8ba39740 1 -- 172.21.15.99:0/601110115 >> 172.21.15.99:0/601110115 conn(0x5627d29057e0 msgr2=0x5627d290bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:41.483 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.479+0000 7fee8ba39740 1 -- 172.21.15.99:0/601110115 shutdown_connections 2024-01-31T05:13:41.483 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.479+0000 7fee8ba39740 1 -- 172.21.15.99:0/601110115 wait complete. 2024-01-31T05:13:41.483 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.479+0000 7fee8ba39740 1 -- start start 2024-01-31T05:13:41.483 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.479+0000 7fee8ba39740 1 Processor -- start 2024-01-31T05:13:41.483 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.479+0000 7fee8ba39740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5627d290a270 0x5627d2919fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:41.483 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.479+0000 7fee8ba39740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627d290ac60 0x5627d291a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:41.484 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.479+0000 7fee8ba39740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5627d290fdd0 0x5627d291aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:41.484 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.479+0000 7fee8ba39740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d2976060 con 0x5627d290ac60 2024-01-31T05:13:41.484 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.479+0000 7fee8ba39740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d29761a0 con 0x5627d290a270 2024-01-31T05:13:41.484 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.479+0000 7fee8ba39740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d29762e0 con 0x5627d290fdd0 2024-01-31T05:13:41.484 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.479+0000 7fee8ba39740 10 client.0 _ll_register_callbacks cb 0x7fee78009f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:13:41.484 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.479+0000 7fee81d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627d290ac60 0x5627d291a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:41.484 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.479+0000 7fee8259c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5627d290a270 0x5627d2919fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:41.484 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.479+0000 7fee81d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627d290ac60 0x5627d291a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35666/0 (socket says 172.21.15.99:35666) 2024-01-31T05:13:41.484 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.479+0000 7fee81d9b640 1 -- 172.21.15.99:0/2756352973 learned_addr learned my addr 172.21.15.99:0/2756352973 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:41.484 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.480+0000 7fee82d9d640 1 --2- 172.21.15.99:0/2756352973 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5627d290fdd0 0x5627d291aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:41.484 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.480+0000 7fee81d9b640 1 -- 172.21.15.99:0/2756352973 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5627d290fdd0 msgr2=0x5627d291aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:41.484 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.480+0000 7fee81d9b640 1 --2- 172.21.15.99:0/2756352973 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5627d290fdd0 0x5627d291aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:41.484 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.480+0000 7fee81d9b640 1 -- 172.21.15.99:0/2756352973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5627d290a270 msgr2=0x5627d2919fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.480+0000 7fee81d9b640 1 --2- 172.21.15.99:0/2756352973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5627d290a270 0x5627d2919fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.480+0000 7fee81d9b640 1 -- 172.21.15.99:0/2756352973 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee7400bb90 con 0x5627d290ac60 2024-01-31T05:13:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.480+0000 7fee8259c640 1 --2- 172.21.15.99:0/2756352973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5627d290a270 0x5627d2919fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:13:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.480+0000 7fee81d9b640 1 --2- 172.21.15.99:0/2756352973 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627d290ac60 0x5627d291a520 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fee78009fd0 tx=0x7fee780988b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9a5216ca9da42b8 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.480+0000 7fee69ffb640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:13:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.480+0000 7fee69ffb640 1 -- 172.21.15.99:0/2756352973 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee780a1750 con 0x5627d290ac60 2024-01-31T05:13:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.480+0000 7fee69ffb640 1 -- 172.21.15.99:0/2756352973 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fee78098be0 con 0x5627d290ac60 2024-01-31T05:13:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.480+0000 7fee8ba39740 1 -- 172.21.15.99:0/2756352973 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fee780a1be0 con 0x5627d290ac60 2024-01-31T05:13:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.480+0000 7fee69ffb640 1 -- 172.21.15.99:0/2756352973 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee7809ab80 con 0x5627d290ac60 2024-01-31T05:13:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.480+0000 7fee8ba39740 10 client.16215 fetch_fsmap learned FSMap version 39 2024-01-31T05:13:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.480+0000 7fee8ba39740 1 -- 172.21.15.99:0/2756352973 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5627d2833a50 con 0x5627d290ac60 2024-01-31T05:13:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.480+0000 7fee69ffb640 1 -- 172.21.15.99:0/2756352973 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fee780a1be0 con 0x5627d290ac60 2024-01-31T05:13:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.480+0000 7fee69ffb640 1 -- 172.21.15.99:0/2756352973 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 39) v1 ==== 7934+0+0 (secure 0 0 0) 0x7fee78084110 con 0x5627d290ac60 2024-01-31T05:13:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.481+0000 7fee8ba39740 10 client.16215 fetch_fsmap finished waiting for FSMap version 39 2024-01-31T05:13:41.486 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.481+0000 7fee8ba39740 10 client.16215 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-01-31T05:13:41.486 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.481+0000 7fee8ba39740 20 client.16215 populate_metadata read hostname 'smithi099' 2024-01-31T05:13:41.486 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.481+0000 7fee8ba39740 1 --2- 172.21.15.99:0/2756352973 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5627d2977860 0x5627d2979c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:41.486 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.481+0000 7fee8ba39740 4 client.16215 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-01-31T05:13:41.486 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.481+0000 7fee8ba39740 1 -- 172.21.15.99:0/2756352973 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5627d2572600 con 0x5627d2977860 2024-01-31T05:13:41.486 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.481+0000 7fee8259c640 1 --2- 172.21.15.99:0/2756352973 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5627d2977860 0x5627d2979c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:41.486 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.481+0000 7fee69ffb640 10 client.16215 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:13:41.486 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.481+0000 7fee8259c640 1 --2- 172.21.15.99:0/2756352973 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5627d2977860 0x5627d2979c80 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86ad0703789d2733 server_cookie=6bab5e3fd0c5738a in_seq=0 out_seq=0 2024-01-31T05:13:41.560 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.560+0000 7fee69ffb640 1 -- 172.21.15.99:0/2756352973 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5627d2572600 con 0x5627d2977860 2024-01-31T05:13:41.561 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.560+0000 7fee69ffb640 10 client.16215 handle_command_reply: tid=0 2024-01-31T05:13:41.561 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.560+0000 7fee8ba39740 1 client.16215 shutdown 2024-01-31T05:13:41.561 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.561+0000 7fee8ba39740 1 -- 172.21.15.99:0/2756352973 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627d290ac60 msgr2=0x5627d291a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:41.561 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.561+0000 7fee8ba39740 1 --2- 172.21.15.99:0/2756352973 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627d290ac60 0x5627d291a520 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fee78009fd0 tx=0x7fee780988b0 comp rx=0 tx=0).stop 2024-01-31T05:13:41.561 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.561+0000 7fee8ba39740 1 -- 172.21.15.99:0/2756352973 shutdown_connections 2024-01-31T05:13:41.561 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.561+0000 7fee8ba39740 1 --2- 172.21.15.99:0/2756352973 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5627d290fdd0 0x5627d291aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:41.561 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.561+0000 7fee8ba39740 1 --2- 172.21.15.99:0/2756352973 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627d290ac60 0x5627d291a520 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:41.561 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.561+0000 7fee8ba39740 1 --2- 172.21.15.99:0/2756352973 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5627d2977860 0x5627d2979c80 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:41.561 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.561+0000 7fee69ffb640 0 client.16215 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:13:41.561 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.561+0000 7fee8ba39740 1 --2- 172.21.15.99:0/2756352973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5627d290a270 0x5627d2919fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:41.561 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.561+0000 7fee8ba39740 1 -- 172.21.15.99:0/2756352973 >> 172.21.15.99:0/2756352973 conn(0x5627d29057e0 msgr2=0x5627d290bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:41.561 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.561+0000 7fee8ba39740 1 -- 172.21.15.99:0/2756352973 shutdown_connections 2024-01-31T05:13:41.561 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.561+0000 7fee8ba39740 1 -- 172.21.15.99:0/2756352973 wait complete. 2024-01-31T05:13:41.561 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.561+0000 7fee8ba39740 20 client.16215 trim_cache size 0 max 16384 2024-01-31T05:13:41.562 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout:{ 2024-01-31T05:13:41.562 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout: "message": "", 2024-01-31T05:13:41.562 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout: "return_code": 0 2024-01-31T05:13:41.562 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout:} 2024-01-31T05:13:41.563 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.562+0000 7fee88c78640 1 -- 172.21.15.99:0/537722386 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fee6c0a1380 msgr2=0x7fee6c0a3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:41.563 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.562+0000 7fee88c78640 1 --2- 172.21.15.99:0/537722386 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fee6c0a1380 0x7fee6c0a3840 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fee7c005e30 tx=0x7fee7c032eb0 comp rx=0 tx=0).stop 2024-01-31T05:13:41.563 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.562+0000 7fee88c78640 1 -- 172.21.15.99:0/537722386 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee84101f30 msgr2=0x7fee84197130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:41.563 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.562+0000 7fee88c78640 1 --2- 172.21.15.99:0/537722386 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee84101f30 0x7fee84197130 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fee7800d950 tx=0x7fee7800de10 comp rx=0 tx=0).stop 2024-01-31T05:13:41.563 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.562+0000 7fee88c78640 1 -- 172.21.15.99:0/537722386 shutdown_connections 2024-01-31T05:13:41.563 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.562+0000 7fee88c78640 1 --2- 172.21.15.99:0/537722386 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fee6c0a1380 0x7fee6c0a3840 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:41.563 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.562+0000 7fee88c78640 1 --2- 172.21.15.99:0/537722386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee841028f0 0x7fee8419e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:41.563 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.562+0000 7fee88c78640 1 --2- 172.21.15.99:0/537722386 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee84101f30 0x7fee84197130 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:41.563 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.562+0000 7fee88c78640 1 --2- 172.21.15.99:0/537722386 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fee84100d40 0x7fee84196bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:41.563 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.562+0000 7fee88c78640 1 -- 172.21.15.99:0/537722386 >> 172.21.15.99:0/537722386 conn(0x7fee840fc2b0 msgr2=0x7fee84105230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:41.563 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.562+0000 7fee88c78640 1 -- 172.21.15.99:0/537722386 shutdown_connections 2024-01-31T05:13:41.563 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:41.562+0000 7fee88c78640 1 -- 172.21.15.99:0/537722386 wait complete. 2024-01-31T05:13:42.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:41 smithi099 ceph-mon[31615]: pgmap v418: 97 pgs: 97 active+clean; 766 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 15 MiB/s wr, 558 op/s 2024-01-31T05:13:42.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:41 smithi099 ceph-mon[31615]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:13:42.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:41 smithi181 ceph-mon[36434]: pgmap v418: 97 pgs: 97 active+clean; 766 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 15 MiB/s wr, 558 op/s 2024-01-31T05:13:42.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:41 smithi181 ceph-mon[36434]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:13:42.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:41 smithi179 ceph-mon[35652]: pgmap v418: 97 pgs: 97 active+clean; 766 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 15 MiB/s wr, 558 op/s 2024-01-31T05:13:42.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:41 smithi179 ceph-mon[35652]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:13:43.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:43 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:13:43.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:43 smithi099 ceph-mon[31615]: pgmap v419: 97 pgs: 97 active+clean; 165 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 5.4 MiB/s wr, 669 op/s 2024-01-31T05:13:43.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:43 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:13:43.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:43 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:13:43.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:43 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:13:43.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:43 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:13:43.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:43 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:13:43.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:43 smithi181 ceph-mon[36434]: pgmap v419: 97 pgs: 97 active+clean; 165 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 5.4 MiB/s wr, 669 op/s 2024-01-31T05:13:43.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:43 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:13:43.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:43 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:13:43.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:43 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:13:43.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:43 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:13:43.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:43 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:13:43.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:43 smithi179 ceph-mon[35652]: pgmap v419: 97 pgs: 97 active+clean; 165 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 5.4 MiB/s wr, 669 op/s 2024-01-31T05:13:43.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:43 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:13:43.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:43 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:13:43.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:43 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:13:43.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:43 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:13:44.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:44 smithi099 ceph-mon[31615]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:13:44.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:44 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:13:44.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:44 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:13:44.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:44 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:13:44.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:44 smithi181 ceph-mon[36434]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:13:44.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:44 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:13:44.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:44 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:13:44.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:44 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:13:44.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:44 smithi179 ceph-mon[35652]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:13:44.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:44 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:13:44.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:44 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:13:44.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:44 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:13:45.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:45 smithi099 ceph-mon[31615]: pgmap v420: 97 pgs: 97 active+clean; 79 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 951 KiB/s wr, 359 op/s 2024-01-31T05:13:45.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:45 smithi181 ceph-mon[36434]: pgmap v420: 97 pgs: 97 active+clean; 79 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 951 KiB/s wr, 359 op/s 2024-01-31T05:13:45.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:45 smithi179 ceph-mon[35652]: pgmap v420: 97 pgs: 97 active+clean; 79 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 951 KiB/s wr, 359 op/s 2024-01-31T05:13:48.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:47 smithi099 ceph-mon[31615]: pgmap v421: 97 pgs: 97 active+clean; 77 MiB data, 1010 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 397 op/s 2024-01-31T05:13:48.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:47 smithi181 ceph-mon[36434]: pgmap v421: 97 pgs: 97 active+clean; 77 MiB data, 1010 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 397 op/s 2024-01-31T05:13:48.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:47 smithi179 ceph-mon[35652]: pgmap v421: 97 pgs: 97 active+clean; 77 MiB data, 1010 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 397 op/s 2024-01-31T05:13:50.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:49 smithi099 ceph-mon[31615]: pgmap v422: 97 pgs: 97 active+clean; 76 MiB data, 905 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 451 op/s 2024-01-31T05:13:50.070 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:49 smithi181 ceph-mon[36434]: pgmap v422: 97 pgs: 97 active+clean; 76 MiB data, 905 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 451 op/s 2024-01-31T05:13:50.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:49 smithi179 ceph-mon[35652]: pgmap v422: 97 pgs: 97 active+clean; 76 MiB data, 905 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 451 op/s 2024-01-31T05:13:52.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:51 smithi099 ceph-mon[31615]: pgmap v423: 97 pgs: 97 active+clean; 76 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1016 KiB/s wr, 362 op/s 2024-01-31T05:13:52.070 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:51 smithi181 ceph-mon[36434]: pgmap v423: 97 pgs: 97 active+clean; 76 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1016 KiB/s wr, 362 op/s 2024-01-31T05:13:52.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:51 smithi179 ceph-mon[35652]: pgmap v423: 97 pgs: 97 active+clean; 76 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1016 KiB/s wr, 362 op/s 2024-01-31T05:13:53.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:53 smithi099 ceph-mon[31615]: pgmap v424: 97 pgs: 97 active+clean; 81 MiB data, 928 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 500 op/s 2024-01-31T05:13:53.570 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:53 smithi181 ceph-mon[36434]: pgmap v424: 97 pgs: 97 active+clean; 81 MiB data, 928 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 500 op/s 2024-01-31T05:13:53.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:53 smithi179 ceph-mon[35652]: pgmap v424: 97 pgs: 97 active+clean; 81 MiB data, 928 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 500 op/s 2024-01-31T05:13:54.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:54 smithi099 ceph-mon[31615]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:13:54.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:54 smithi181 ceph-mon[36434]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:13:54.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:54 smithi179 ceph-mon[35652]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:13:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.661+0000 7fcb1057c640 1 -- 172.21.15.99:0/3111386366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb080ff720 msgr2=0x7fcb081092d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.661+0000 7fcb1057c640 1 --2- 172.21.15.99:0/3111386366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb080ff720 0x7fcb081092d0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fcb00009ca0 tx=0x7fcb0002c0f0 comp rx=0 tx=0).stop 2024-01-31T05:13:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.661+0000 7fcb1057c640 1 -- 172.21.15.99:0/3111386366 shutdown_connections 2024-01-31T05:13:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.661+0000 7fcb1057c640 1 --2- 172.21.15.99:0/3111386366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb080ff720 0x7fcb081092d0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.661+0000 7fcb1057c640 1 --2- 172.21.15.99:0/3111386366 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcb080fed60 0x7fcb080ff1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.661+0000 7fcb1057c640 1 --2- 172.21.15.99:0/3111386366 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb081022f0 0x7fcb08102710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.661+0000 7fcb1057c640 1 -- 172.21.15.99:0/3111386366 >> 172.21.15.99:0/3111386366 conn(0x7fcb080fa940 msgr2=0x7fcb080fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.661+0000 7fcb1057c640 1 -- 172.21.15.99:0/3111386366 shutdown_connections 2024-01-31T05:13:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.661+0000 7fcb1057c640 1 -- 172.21.15.99:0/3111386366 wait complete. 2024-01-31T05:13:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.662+0000 7fcb1057c640 1 Processor -- start 2024-01-31T05:13:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.662+0000 7fcb1057c640 1 -- start start 2024-01-31T05:13:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.662+0000 7fcb1057c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb080fed60 0x7fcb081019f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.662+0000 7fcb1057c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb080ff720 0x7fcb08100030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.662+0000 7fcb1057c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcb081022f0 0x7fcb08100570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.662+0000 7fcb1057c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb08100cd0 con 0x7fcb080ff720 2024-01-31T05:13:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.662+0000 7fcb1057c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb08100e40 con 0x7fcb080fed60 2024-01-31T05:13:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.662+0000 7fcb1057c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb081a0c40 con 0x7fcb081022f0 2024-01-31T05:13:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.662+0000 7fcb0db17640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb080ff720 0x7fcb08100030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.662+0000 7fcb0db17640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb080ff720 0x7fcb08100030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57816/0 (socket says 172.21.15.99:57816) 2024-01-31T05:13:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.662+0000 7fcb0db17640 1 -- 172.21.15.99:0/2144499408 learned_addr learned my addr 172.21.15.99:0/2144499408 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.662+0000 7fcb0e318640 1 --2- 172.21.15.99:0/2144499408 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb080fed60 0x7fcb081019f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.662+0000 7fcb0eb19640 1 --2- 172.21.15.99:0/2144499408 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcb081022f0 0x7fcb08100570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.662+0000 7fcb0db17640 1 -- 172.21.15.99:0/2144499408 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcb081022f0 msgr2=0x7fcb08100570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.662+0000 7fcb0db17640 1 --2- 172.21.15.99:0/2144499408 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcb081022f0 0x7fcb08100570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.662+0000 7fcb0db17640 1 -- 172.21.15.99:0/2144499408 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb080fed60 msgr2=0x7fcb081019f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.662+0000 7fcb0db17640 1 --2- 172.21.15.99:0/2144499408 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb080fed60 0x7fcb081019f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.662+0000 7fcb0db17640 1 -- 172.21.15.99:0/2144499408 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb00009900 con 0x7fcb080ff720 2024-01-31T05:13:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.662+0000 7fcb0eb19640 1 --2- 172.21.15.99:0/2144499408 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcb081022f0 0x7fcb08100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:13:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.663+0000 7fcb0db17640 1 --2- 172.21.15.99:0/2144499408 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb080ff720 0x7fcb08100030 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fcaf800d980 tx=0x7fcaf800de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.663+0000 7fcaff7fe640 1 -- 172.21.15.99:0/2144499408 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8009c30 con 0x7fcb080ff720 2024-01-31T05:13:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.663+0000 7fcaff7fe640 1 -- 172.21.15.99:0/2144499408 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcaf800b660 con 0x7fcb080ff720 2024-01-31T05:13:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.663+0000 7fcb1057c640 1 -- 172.21.15.99:0/2144499408 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb081a0ef0 con 0x7fcb080ff720 2024-01-31T05:13:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.663+0000 7fcaff7fe640 1 -- 172.21.15.99:0/2144499408 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf800f620 con 0x7fcb080ff720 2024-01-31T05:13:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.663+0000 7fcb1057c640 1 -- 172.21.15.99:0/2144499408 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb081a1370 con 0x7fcb080ff720 2024-01-31T05:13:54.673 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.665+0000 7fcaff7fe640 1 -- 172.21.15.99:0/2144499408 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 20) v1 ==== 135895+0+0 (secure 0 0 0) 0x7fcaf8010460 con 0x7fcb080ff720 2024-01-31T05:13:54.673 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.666+0000 7fcb1341b740 1 Processor -- start 2024-01-31T05:13:54.673 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.666+0000 7fcb1341b740 1 -- start start 2024-01-31T05:13:54.673 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.666+0000 7fcb1341b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564dd8d12270 0x564dd8d12690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:54.673 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.666+0000 7fcb1341b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dd8d12c60 0x564dd8d17760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:54.673 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.666+0000 7fcaff7fe640 1 --2- 172.21.15.99:0/2144499408 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fcaf40a1380 0x7fcaf40a3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:54.673 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.666+0000 7fcb1341b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564dd8d17dd0 0x564dd8d1a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:54.673 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.666+0000 7fcb1341b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dd8c82040 con 0x564dd8d17dd0 2024-01-31T05:13:54.673 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.666+0000 7fcb1341b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dd8c7f730 con 0x564dd8d12c60 2024-01-31T05:13:54.673 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.666+0000 7fcb1341b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dd8c7b020 con 0x564dd8d12270 2024-01-31T05:13:54.673 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.666+0000 7fcb0db17640 1 --2- 172.21.15.99:0/2144499408 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fcaf40a1380 0x7fcaf40a3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:54.673 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.666+0000 7fcb0e318640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dd8d12c60 0x564dd8d17760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:54.674 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.666+0000 7fcb0e318640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dd8d12c60 0x564dd8d17760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.99:49286/0 (socket says 172.21.15.99:49286) 2024-01-31T05:13:54.674 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.666+0000 7fcb0e318640 1 -- 172.21.15.99:0/147552200 learned_addr learned my addr 172.21.15.99:0/147552200 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:54.674 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.666+0000 7fcb0eb19640 1 --2- 172.21.15.99:0/147552200 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564dd8d17dd0 0x564dd8d1a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:54.674 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.667+0000 7fcaff7fe640 1 -- 172.21.15.99:0/2144499408 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fcaf80cc640 con 0x7fcb080ff720 2024-01-31T05:13:54.674 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.667+0000 7fcb0eb19640 1 --2- 172.21.15.99:0/147552200 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564dd8d12270 0x564dd8d12690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:54.674 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.667+0000 7fcb0e318640 1 -- 172.21.15.99:0/147552200 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564dd8d12270 msgr2=0x564dd8d12690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:54.674 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.667+0000 7fcb0e318640 1 --2- 172.21.15.99:0/147552200 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564dd8d12270 0x564dd8d12690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:54.674 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.667+0000 7fcb0e318640 1 -- 172.21.15.99:0/147552200 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564dd8d17dd0 msgr2=0x564dd8d1a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:54.674 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.667+0000 7fcb0e318640 1 --2- 172.21.15.99:0/147552200 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564dd8d17dd0 0x564dd8d1a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:54.674 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.667+0000 7fcb0e318640 1 -- 172.21.15.99:0/147552200 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564dd8c72e40 con 0x564dd8d12c60 2024-01-31T05:13:54.674 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.667+0000 7fcb0eb19640 1 --2- 172.21.15.99:0/147552200 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564dd8d17dd0 0x564dd8d1a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:13:54.674 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.667+0000 7fcb0e318640 1 --2- 172.21.15.99:0/147552200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dd8d12c60 0x564dd8d17760 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcb04009ca0 tx=0x7fcb04011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d5827b617ce3e02 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:54.674 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.667+0000 7fcb0db17640 1 --2- 172.21.15.99:0/2144499408 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fcaf40a1380 0x7fcaf40a3840 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8009610 tx=0x7fcaf8084040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:54.674 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.667+0000 7fcafcbfe640 1 -- 172.21.15.99:0/147552200 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb04004220 con 0x564dd8d12c60 2024-01-31T05:13:54.674 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.667+0000 7fcafcbfe640 1 -- 172.21.15.99:0/147552200 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcb04004380 con 0x564dd8d12c60 2024-01-31T05:13:54.675 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.667+0000 7fcafcbfe640 1 -- 172.21.15.99:0/147552200 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb040197a0 con 0x564dd8d12c60 2024-01-31T05:13:54.675 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.668+0000 7fcb1341b740 1 -- 172.21.15.99:0/147552200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dd8d12c60 msgr2=0x564dd8d17760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:54.675 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.668+0000 7fcb1341b740 1 --2- 172.21.15.99:0/147552200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dd8d12c60 0x564dd8d17760 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcb04009ca0 tx=0x7fcb04011810 comp rx=0 tx=0).stop 2024-01-31T05:13:54.675 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.668+0000 7fcb1341b740 1 -- 172.21.15.99:0/147552200 shutdown_connections 2024-01-31T05:13:54.675 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.668+0000 7fcb1341b740 1 --2- 172.21.15.99:0/147552200 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564dd8d17dd0 0x564dd8d1a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:54.675 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.668+0000 7fcb1341b740 1 --2- 172.21.15.99:0/147552200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dd8d12c60 0x564dd8d17760 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:54.675 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.668+0000 7fcb1341b740 1 --2- 172.21.15.99:0/147552200 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564dd8d12270 0x564dd8d12690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:54.675 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.668+0000 7fcb1341b740 1 -- 172.21.15.99:0/147552200 >> 172.21.15.99:0/147552200 conn(0x564dd8d0d7e0 msgr2=0x564dd8d0dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:54.675 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.668+0000 7fcb1341b740 1 -- 172.21.15.99:0/147552200 shutdown_connections 2024-01-31T05:13:54.675 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.668+0000 7fcb1341b740 1 -- 172.21.15.99:0/147552200 wait complete. 2024-01-31T05:13:54.675 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.668+0000 7fcb1341b740 1 -- start start 2024-01-31T05:13:54.675 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.668+0000 7fcb1341b740 1 Processor -- start 2024-01-31T05:13:54.676 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.669+0000 7fcb1341b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dd8d12270 0x564dd8d1c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:54.676 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.669+0000 7fcb1341b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564dd8d12c60 0x564dd8d1c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:54.676 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.669+0000 7fcb1341b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564dd8d17dd0 0x564dd8d236b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:54.676 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.669+0000 7fcb1341b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dd8c341b0 con 0x564dd8d12c60 2024-01-31T05:13:54.676 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.669+0000 7fcb1341b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dd8c33e50 con 0x564dd8d12270 2024-01-31T05:13:54.676 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.669+0000 7fcb1341b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dd8bf9090 con 0x564dd8d17dd0 2024-01-31T05:13:54.676 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.669+0000 7fcb1341b740 10 client.0 _ll_register_callbacks cb 0x564dd8c1ea90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:13:54.676 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.669+0000 7fcb0e318640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564dd8d12c60 0x564dd8d1c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:54.676 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.669+0000 7fcb0e318640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564dd8d12c60 0x564dd8d1c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57832/0 (socket says 172.21.15.99:57832) 2024-01-31T05:13:54.676 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.669+0000 7fcb0e318640 1 -- 172.21.15.99:0/3959013609 learned_addr learned my addr 172.21.15.99:0/3959013609 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:54.676 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.669+0000 7fcb0eb19640 1 --2- 172.21.15.99:0/3959013609 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dd8d12270 0x564dd8d1c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:54.677 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.669+0000 7fcb0eb19640 1 --2- 172.21.15.99:0/3959013609 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564dd8d17dd0 0x564dd8d236b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:54.677 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.669+0000 7fcb0e318640 1 -- 172.21.15.99:0/3959013609 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564dd8d17dd0 msgr2=0x564dd8d236b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:54.677 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.669+0000 7fcb0e318640 1 --2- 172.21.15.99:0/3959013609 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564dd8d17dd0 0x564dd8d236b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:54.677 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.669+0000 7fcb0e318640 1 -- 172.21.15.99:0/3959013609 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dd8d12270 msgr2=0x564dd8d1c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:54.677 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.669+0000 7fcb0e318640 1 --2- 172.21.15.99:0/3959013609 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dd8d12270 0x564dd8d1c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:54.677 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.669+0000 7fcb0e318640 1 -- 172.21.15.99:0/3959013609 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb040098d0 con 0x564dd8d12c60 2024-01-31T05:13:54.677 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.669+0000 7fcb0eb19640 1 --2- 172.21.15.99:0/3959013609 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dd8d12270 0x564dd8d1c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:13:54.677 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.669+0000 7fcb0e318640 1 --2- 172.21.15.99:0/3959013609 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564dd8d12c60 0x564dd8d1c670 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fcb04000c00 tx=0x7fcb04003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91cc5ce2389ce06c server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:54.677 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.669+0000 7fcaf1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:13:54.677 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.669+0000 7fcaf1ffb640 1 -- 172.21.15.99:0/3959013609 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb04005cc0 con 0x564dd8d12c60 2024-01-31T05:13:54.677 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.669+0000 7fcaf1ffb640 1 -- 172.21.15.99:0/3959013609 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fcb04003a10 con 0x564dd8d12c60 2024-01-31T05:13:54.677 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.669+0000 7fcb1341b740 1 -- 172.21.15.99:0/3959013609 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564dd8c74010 con 0x564dd8d12c60 2024-01-31T05:13:54.677 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.670+0000 7fcaf1ffb640 1 -- 172.21.15.99:0/3959013609 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb04005250 con 0x564dd8d12c60 2024-01-31T05:13:54.678 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.670+0000 7fcb1341b740 10 client.16227 fetch_fsmap learned FSMap version 41 2024-01-31T05:13:54.678 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.670+0000 7fcb1341b740 1 -- 172.21.15.99:0/3959013609 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x564dd8c796a0 con 0x564dd8d12c60 2024-01-31T05:13:54.678 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.670+0000 7fcaf1ffb640 1 -- 172.21.15.99:0/3959013609 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564dd8c74010 con 0x564dd8d12c60 2024-01-31T05:13:54.678 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.670+0000 7fcaf1ffb640 1 -- 172.21.15.99:0/3959013609 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 41) v1 ==== 7946+0+0 (secure 0 0 0) 0x7fcb040194a0 con 0x564dd8d12c60 2024-01-31T05:13:54.678 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.670+0000 7fcb1341b740 10 client.16227 fetch_fsmap finished waiting for FSMap version 41 2024-01-31T05:13:54.678 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.670+0000 7fcb1341b740 10 client.16227 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-01-31T05:13:54.678 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.670+0000 7fcb1341b740 20 client.16227 populate_metadata read hostname 'smithi099' 2024-01-31T05:13:54.678 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.670+0000 7fcb1341b740 1 --2- 172.21.15.99:0/3959013609 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x564dd8d27fd0 0x564dd8d2a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:54.678 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.670+0000 7fcb1341b740 4 client.16227 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:13:54.678 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.670+0000 7fcb1341b740 1 -- 172.21.15.99:0/3959013609 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564dd8c73d30 con 0x564dd8d27fd0 2024-01-31T05:13:54.678 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.670+0000 7fcb0eb19640 1 --2- 172.21.15.99:0/3959013609 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x564dd8d27fd0 0x564dd8d2a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:54.678 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.671+0000 7fcaf1ffb640 10 client.16227 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:13:54.678 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.671+0000 7fcb0eb19640 1 --2- 172.21.15.99:0/3959013609 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x564dd8d27fd0 0x564dd8d2a3f0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c66461ce37140b89 server_cookie=da20450310a7ec19 in_seq=0 out_seq=0 2024-01-31T05:13:54.678 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.671+0000 7fcaf1ffb640 1 -- 172.21.15.99:0/3959013609 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564dd8c73d30 con 0x564dd8d27fd0 2024-01-31T05:13:54.678 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.671+0000 7fcaf1ffb640 10 client.16227 handle_command_reply: tid=0 2024-01-31T05:13:54.679 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.671+0000 7fcb1341b740 1 client.16227 shutdown 2024-01-31T05:13:54.679 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.671+0000 7fcb1341b740 1 -- 172.21.15.99:0/3959013609 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564dd8d12c60 msgr2=0x564dd8d1c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:54.679 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.671+0000 7fcb1341b740 1 --2- 172.21.15.99:0/3959013609 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564dd8d12c60 0x564dd8d1c670 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fcb04000c00 tx=0x7fcb04003820 comp rx=0 tx=0).stop 2024-01-31T05:13:54.679 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.672+0000 7fcb1341b740 1 -- 172.21.15.99:0/3959013609 shutdown_connections 2024-01-31T05:13:54.679 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.672+0000 7fcb1341b740 1 --2- 172.21.15.99:0/3959013609 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564dd8d17dd0 0x564dd8d236b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:54.679 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.672+0000 7fcb1341b740 1 --2- 172.21.15.99:0/3959013609 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564dd8d12c60 0x564dd8d1c670 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:54.679 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.672+0000 7fcb1341b740 1 --2- 172.21.15.99:0/3959013609 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x564dd8d27fd0 0x564dd8d2a3f0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:54.679 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.672+0000 7fcb1341b740 1 --2- 172.21.15.99:0/3959013609 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dd8d12270 0x564dd8d1c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:54.679 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.672+0000 7fcb1341b740 1 -- 172.21.15.99:0/3959013609 >> 172.21.15.99:0/3959013609 conn(0x564dd8d0d7e0 msgr2=0x564dd8d0ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:54.679 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.672+0000 7fcaf1ffb640 0 client.16227 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:13:54.679 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.672+0000 7fcb1341b740 1 -- 172.21.15.99:0/3959013609 shutdown_connections 2024-01-31T05:13:54.679 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.672+0000 7fcb1341b740 1 -- 172.21.15.99:0/3959013609 wait complete. 2024-01-31T05:13:54.679 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.672+0000 7fcb1341b740 20 client.16227 trim_cache size 0 max 16384 2024-01-31T05:13:54.691 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.686+0000 7fcb1341b740 1 Processor -- start 2024-01-31T05:13:54.691 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.687+0000 7fcb1341b740 1 -- start start 2024-01-31T05:13:54.692 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.687+0000 7fcb1341b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564dd8d12270 0x564dd8d13e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:54.692 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.687+0000 7fcb1341b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564dd8d12c60 0x564dd8d143a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:54.692 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.687+0000 7fcb1341b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dd8d17dd0 0x564dd8d23670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:54.692 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.687+0000 7fcb1341b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dd8c73d30 con 0x564dd8d12270 2024-01-31T05:13:54.692 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.687+0000 7fcb1341b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dd8c74010 con 0x564dd8d17dd0 2024-01-31T05:13:54.692 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.687+0000 7fcb1341b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dd8d1a970 con 0x564dd8d12c60 2024-01-31T05:13:54.692 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.687+0000 7fcb0eb19640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564dd8d12270 0x564dd8d13e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:54.692 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.687+0000 7fcb0eb19640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564dd8d12270 0x564dd8d13e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57840/0 (socket says 172.21.15.99:57840) 2024-01-31T05:13:54.692 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.687+0000 7fcb0eb19640 1 -- 172.21.15.99:0/1198561571 learned_addr learned my addr 172.21.15.99:0/1198561571 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.687+0000 7fcb0e318640 1 --2- 172.21.15.99:0/1198561571 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564dd8d12c60 0x564dd8d143a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.687+0000 7fcb0eb19640 1 --2- 172.21.15.99:0/1198561571 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dd8d17dd0 0x564dd8d23670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.687+0000 7fcb0eb19640 1 -- 172.21.15.99:0/1198561571 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564dd8d12c60 msgr2=0x564dd8d143a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.687+0000 7fcb0eb19640 1 --2- 172.21.15.99:0/1198561571 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564dd8d12c60 0x564dd8d143a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.687+0000 7fcb0eb19640 1 -- 172.21.15.99:0/1198561571 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dd8d17dd0 msgr2=0x564dd8d23670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.687+0000 7fcb0eb19640 1 --2- 172.21.15.99:0/1198561571 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dd8d17dd0 0x564dd8d23670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.687+0000 7fcb0eb19640 1 -- 172.21.15.99:0/1198561571 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564dd8c16030 con 0x564dd8d12270 2024-01-31T05:13:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.687+0000 7fcb0eb19640 1 --2- 172.21.15.99:0/1198561571 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564dd8d12270 0x564dd8d13e60 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fcb00002230 tx=0x7fcb00046040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c41cb005de610bbd server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.687+0000 7fcaf3fff640 1 -- 172.21.15.99:0/1198561571 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb00049070 con 0x564dd8d12270 2024-01-31T05:13:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.688+0000 7fcaf3fff640 1 -- 172.21.15.99:0/1198561571 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcb00032d10 con 0x564dd8d12270 2024-01-31T05:13:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.688+0000 7fcaf3fff640 1 -- 172.21.15.99:0/1198561571 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb00034df0 con 0x564dd8d12270 2024-01-31T05:13:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.688+0000 7fcb1341b740 1 -- 172.21.15.99:0/1198561571 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564dd8d12270 msgr2=0x564dd8d13e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.688+0000 7fcb1341b740 1 --2- 172.21.15.99:0/1198561571 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564dd8d12270 0x564dd8d13e60 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fcb00002230 tx=0x7fcb00046040 comp rx=0 tx=0).stop 2024-01-31T05:13:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.688+0000 7fcb1341b740 1 -- 172.21.15.99:0/1198561571 shutdown_connections 2024-01-31T05:13:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.688+0000 7fcb1341b740 1 --2- 172.21.15.99:0/1198561571 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dd8d17dd0 0x564dd8d23670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:54.694 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.688+0000 7fcb1341b740 1 --2- 172.21.15.99:0/1198561571 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564dd8d12c60 0x564dd8d143a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:54.694 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.688+0000 7fcb1341b740 1 --2- 172.21.15.99:0/1198561571 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564dd8d12270 0x564dd8d13e60 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:54.695 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.688+0000 7fcb1341b740 1 -- 172.21.15.99:0/1198561571 >> 172.21.15.99:0/1198561571 conn(0x564dd8d0d7e0 msgr2=0x564dd8d1c130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:54.695 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.688+0000 7fcb1341b740 1 -- 172.21.15.99:0/1198561571 shutdown_connections 2024-01-31T05:13:54.695 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.688+0000 7fcb1341b740 1 -- 172.21.15.99:0/1198561571 wait complete. 2024-01-31T05:13:54.695 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.689+0000 7fcb1341b740 1 -- start start 2024-01-31T05:13:54.696 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.689+0000 7fcb1341b740 1 Processor -- start 2024-01-31T05:13:54.696 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.689+0000 7fcb1341b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dd8d12270 0x564dd8d23130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:54.696 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.689+0000 7fcb1341b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564dd8d12c60 0x564dd8d23670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:54.696 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.689+0000 7fcb1341b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564dd8d17dd0 0x564dd8d21740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:54.696 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.689+0000 7fcb1341b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dd8d21e40 con 0x564dd8d12c60 2024-01-31T05:13:54.696 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.689+0000 7fcb1341b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dd8d21fb0 con 0x564dd8d12270 2024-01-31T05:13:54.697 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.689+0000 7fcb1341b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dd8d22170 con 0x564dd8d17dd0 2024-01-31T05:13:54.697 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.689+0000 7fcb1341b740 10 client.0 _ll_register_callbacks cb 0x7fcb040097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:13:54.697 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.689+0000 7fcb0e318640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564dd8d12c60 0x564dd8d23670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:54.697 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.689+0000 7fcb0e318640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564dd8d12c60 0x564dd8d23670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57848/0 (socket says 172.21.15.99:57848) 2024-01-31T05:13:54.697 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.689+0000 7fcb0e318640 1 -- 172.21.15.99:0/1582272270 learned_addr learned my addr 172.21.15.99:0/1582272270 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:13:54.698 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.689+0000 7fcb0eb19640 1 --2- 172.21.15.99:0/1582272270 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564dd8d17dd0 0x564dd8d21740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:54.698 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.689+0000 7fcb0eb19640 1 --2- 172.21.15.99:0/1582272270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dd8d12270 0x564dd8d23130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:54.698 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.689+0000 7fcb0e318640 1 -- 172.21.15.99:0/1582272270 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564dd8d17dd0 msgr2=0x564dd8d21740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:54.698 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.689+0000 7fcb0e318640 1 --2- 172.21.15.99:0/1582272270 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564dd8d17dd0 0x564dd8d21740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:54.698 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.689+0000 7fcb0e318640 1 -- 172.21.15.99:0/1582272270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dd8d12270 msgr2=0x564dd8d23130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:13:54.698 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.689+0000 7fcb0e318640 1 --2- 172.21.15.99:0/1582272270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dd8d12270 0x564dd8d23130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:54.699 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.689+0000 7fcb0e318640 1 -- 172.21.15.99:0/1582272270 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb08109a50 con 0x564dd8d12c60 2024-01-31T05:13:54.699 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.689+0000 7fcb0e318640 1 --2- 172.21.15.99:0/1582272270 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564dd8d12c60 0x564dd8d23670 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x564dd8d1d610 tx=0x7fcb04009af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d76d40c22dbbad30 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:13:54.699 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.689+0000 7fcaf1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:13:54.699 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.690+0000 7fcaf1ffb640 1 -- 172.21.15.99:0/1582272270 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb04003a90 con 0x564dd8d12c60 2024-01-31T05:13:54.699 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.690+0000 7fcaf1ffb640 1 -- 172.21.15.99:0/1582272270 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fcb04019a70 con 0x564dd8d12c60 2024-01-31T05:13:54.699 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.690+0000 7fcb1341b740 1 -- 172.21.15.99:0/1582272270 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcb04004380 con 0x564dd8d12c60 2024-01-31T05:13:54.699 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.690+0000 7fcaf1ffb640 1 -- 172.21.15.99:0/1582272270 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb04019640 con 0x564dd8d12c60 2024-01-31T05:13:54.700 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.690+0000 7fcb1341b740 10 client.16233 fetch_fsmap learned FSMap version 41 2024-01-31T05:13:54.700 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.690+0000 7fcb1341b740 1 -- 172.21.15.99:0/1582272270 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x564dd8c3ba50 con 0x564dd8d12c60 2024-01-31T05:13:54.700 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.690+0000 7fcaf1ffb640 1 -- 172.21.15.99:0/1582272270 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcb04004380 con 0x564dd8d12c60 2024-01-31T05:13:54.700 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.690+0000 7fcaf1ffb640 1 -- 172.21.15.99:0/1582272270 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 41) v1 ==== 7946+0+0 (secure 0 0 0) 0x7fcb04004700 con 0x564dd8d12c60 2024-01-31T05:13:54.700 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.690+0000 7fcb1341b740 10 client.16233 fetch_fsmap finished waiting for FSMap version 41 2024-01-31T05:13:54.700 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.690+0000 7fcb1341b740 10 client.16233 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-01-31T05:13:54.700 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.690+0000 7fcb1341b740 20 client.16233 populate_metadata read hostname 'smithi099' 2024-01-31T05:13:54.700 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.690+0000 7fcb1341b740 1 --2- 172.21.15.99:0/1582272270 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x564dd8d7f760 0x564dd8d81b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:13:54.701 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.690+0000 7fcb1341b740 4 client.16233 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-01-31T05:13:54.701 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.690+0000 7fcb1341b740 1 -- 172.21.15.99:0/1582272270 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564dd897a600 con 0x564dd8d7f760 2024-01-31T05:13:54.701 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.690+0000 7fcb0eb19640 1 --2- 172.21.15.99:0/1582272270 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x564dd8d7f760 0x564dd8d81b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:13:54.701 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.691+0000 7fcaf1ffb640 10 client.16233 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:13:54.701 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.691+0000 7fcb0eb19640 1 --2- 172.21.15.99:0/1582272270 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x564dd8d7f760 0x564dd8d81b80 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=682b5c56cccaa799 server_cookie=6079a3cc21fc682c in_seq=0 out_seq=0 2024-01-31T05:13:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.738+0000 7fcaf1ffb640 1 -- 172.21.15.99:0/1582272270 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564dd897a600 con 0x564dd8d7f760 2024-01-31T05:13:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.738+0000 7fcaf1ffb640 10 client.16233 handle_command_reply: tid=0 2024-01-31T05:13:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.738+0000 7fcb1341b740 1 client.16233 shutdown 2024-01-31T05:13:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.738+0000 7fcb1341b740 1 -- 172.21.15.99:0/1582272270 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564dd8d12c60 msgr2=0x564dd8d23670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.738+0000 7fcb1341b740 1 --2- 172.21.15.99:0/1582272270 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564dd8d12c60 0x564dd8d23670 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x564dd8d1d610 tx=0x7fcb04009af0 comp rx=0 tx=0).stop 2024-01-31T05:13:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.738+0000 7fcb1341b740 1 -- 172.21.15.99:0/1582272270 shutdown_connections 2024-01-31T05:13:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.738+0000 7fcb1341b740 1 --2- 172.21.15.99:0/1582272270 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564dd8d17dd0 0x564dd8d21740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.738+0000 7fcb1341b740 1 --2- 172.21.15.99:0/1582272270 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564dd8d12c60 0x564dd8d23670 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.738+0000 7fcb1341b740 1 --2- 172.21.15.99:0/1582272270 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x564dd8d7f760 0x564dd8d81b80 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.738+0000 7fcb1341b740 1 --2- 172.21.15.99:0/1582272270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564dd8d12270 0x564dd8d23130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.738+0000 7fcaf1ffb640 0 client.16233 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:13:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.739+0000 7fcb1341b740 1 -- 172.21.15.99:0/1582272270 >> 172.21.15.99:0/1582272270 conn(0x564dd8d0d7e0 msgr2=0x564dd8d1c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.739+0000 7fcb1341b740 1 -- 172.21.15.99:0/1582272270 shutdown_connections 2024-01-31T05:13:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.739+0000 7fcb1341b740 1 -- 172.21.15.99:0/1582272270 wait complete. 2024-01-31T05:13:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.739+0000 7fcb1341b740 20 client.16233 trim_cache size 0 max 16384 2024-01-31T05:13:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout:{ 2024-01-31T05:13:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout: "message": "", 2024-01-31T05:13:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout: "return_code": 0 2024-01-31T05:13:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout:} 2024-01-31T05:13:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.739+0000 7fcb1057c640 1 -- 172.21.15.99:0/2144499408 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fcaf40a1380 msgr2=0x7fcaf40a3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.739+0000 7fcb1057c640 1 --2- 172.21.15.99:0/2144499408 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fcaf40a1380 0x7fcaf40a3840 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8009610 tx=0x7fcaf8084040 comp rx=0 tx=0).stop 2024-01-31T05:13:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.739+0000 7fcb1057c640 1 -- 172.21.15.99:0/2144499408 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb080ff720 msgr2=0x7fcb08100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:13:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.739+0000 7fcb1057c640 1 --2- 172.21.15.99:0/2144499408 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb080ff720 0x7fcb08100030 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fcaf800d980 tx=0x7fcaf800de40 comp rx=0 tx=0).stop 2024-01-31T05:13:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.739+0000 7fcb1057c640 1 -- 172.21.15.99:0/2144499408 shutdown_connections 2024-01-31T05:13:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.739+0000 7fcb1057c640 1 --2- 172.21.15.99:0/2144499408 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fcaf40a1380 0x7fcaf40a3840 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.739+0000 7fcb1057c640 1 --2- 172.21.15.99:0/2144499408 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcb081022f0 0x7fcb08100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.739+0000 7fcb1057c640 1 --2- 172.21.15.99:0/2144499408 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb080ff720 0x7fcb08100030 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.739+0000 7fcb1057c640 1 --2- 172.21.15.99:0/2144499408 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb080fed60 0x7fcb081019f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:13:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.739+0000 7fcb1057c640 1 -- 172.21.15.99:0/2144499408 >> 172.21.15.99:0/2144499408 conn(0x7fcb080fa940 msgr2=0x7fcb08105380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:13:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.740+0000 7fcb1057c640 1 -- 172.21.15.99:0/2144499408 shutdown_connections 2024-01-31T05:13:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:13:54.740+0000 7fcb1057c640 1 -- 172.21.15.99:0/2144499408 wait complete. 2024-01-31T05:13:55.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:55 smithi099 ceph-mon[31615]: pgmap v425: 97 pgs: 97 active+clean; 82 MiB data, 938 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 390 op/s 2024-01-31T05:13:55.570 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:55 smithi181 ceph-mon[36434]: pgmap v425: 97 pgs: 97 active+clean; 82 MiB data, 938 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 390 op/s 2024-01-31T05:13:55.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:55 smithi179 ceph-mon[35652]: pgmap v425: 97 pgs: 97 active+clean; 82 MiB data, 938 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 390 op/s 2024-01-31T05:13:58.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:57 smithi099 ceph-mon[31615]: pgmap v426: 97 pgs: 97 active+clean; 62 MiB data, 913 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 419 op/s 2024-01-31T05:13:58.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:57 smithi181 ceph-mon[36434]: pgmap v426: 97 pgs: 97 active+clean; 62 MiB data, 913 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 419 op/s 2024-01-31T05:13:58.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:57 smithi179 ceph-mon[35652]: pgmap v426: 97 pgs: 97 active+clean; 62 MiB data, 913 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 419 op/s 2024-01-31T05:13:59.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:59 smithi099 ceph-mon[31615]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:13:59.569 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:13:59 smithi099 ceph-mon[31615]: pgmap v427: 97 pgs: 97 active+clean; 61 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 447 op/s 2024-01-31T05:13:59.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:59 smithi181 ceph-mon[36434]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:13:59.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:13:59 smithi181 ceph-mon[36434]: pgmap v427: 97 pgs: 97 active+clean; 61 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 447 op/s 2024-01-31T05:13:59.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:59 smithi179 ceph-mon[35652]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-31T05:13:59.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:13:59 smithi179 ceph-mon[35652]: pgmap v427: 97 pgs: 97 active+clean; 61 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 447 op/s 2024-01-31T05:14:02.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:14:01 smithi099 ceph-mon[31615]: pgmap v428: 97 pgs: 97 active+clean; 59 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 393 op/s 2024-01-31T05:14:02.070 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:14:01 smithi181 ceph-mon[36434]: pgmap v428: 97 pgs: 97 active+clean; 59 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 393 op/s 2024-01-31T05:14:02.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:14:01 smithi179 ceph-mon[35652]: pgmap v428: 97 pgs: 97 active+clean; 59 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 393 op/s 2024-01-31T05:14:03.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:14:03 smithi099 ceph-mon[31615]: pgmap v429: 97 pgs: 97 active+clean; 51 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 516 op/s 2024-01-31T05:14:03.570 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:14:03 smithi181 ceph-mon[36434]: pgmap v429: 97 pgs: 97 active+clean; 51 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 516 op/s 2024-01-31T05:14:03.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:14:03 smithi179 ceph-mon[35652]: pgmap v429: 97 pgs: 97 active+clean; 51 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 516 op/s 2024-01-31T05:14:06.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:14:05 smithi099 ceph-mon[31615]: pgmap v430: 97 pgs: 97 active+clean; 54 MiB data, 876 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 420 op/s 2024-01-31T05:14:06.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:14:05 smithi181 ceph-mon[36434]: pgmap v430: 97 pgs: 97 active+clean; 54 MiB data, 876 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 420 op/s 2024-01-31T05:14:06.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:14:05 smithi179 ceph-mon[35652]: pgmap v430: 97 pgs: 97 active+clean; 54 MiB data, 876 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 420 op/s 2024-01-31T05:14:07.834 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.832+0000 7f7ab7709640 1 -- 172.21.15.99:0/3641958382 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ab0100e50 msgr2=0x7f7ab01012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.832+0000 7f7ab7709640 1 --2- 172.21.15.99:0/3641958382 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ab0100e50 0x7f7ab01012d0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0009900 tx=0x7f7aa002bc30 comp rx=0 tx=0).stop 2024-01-31T05:14:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.832+0000 7f7ab7709640 1 -- 172.21.15.99:0/3641958382 shutdown_connections 2024-01-31T05:14:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.832+0000 7f7ab7709640 1 --2- 172.21.15.99:0/3641958382 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ab0101810 0x7f7ab01080a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.832+0000 7f7ab7709640 1 --2- 172.21.15.99:0/3641958382 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ab0100e50 0x7f7ab01012d0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.832+0000 7f7ab7709640 1 --2- 172.21.15.99:0/3641958382 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ab00ffc60 0x7f7ab0100080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.832+0000 7f7ab7709640 1 -- 172.21.15.99:0/3641958382 >> 172.21.15.99:0/3641958382 conn(0x7f7ab00fb1d0 msgr2=0x7f7ab00fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:14:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.832+0000 7f7ab7709640 1 -- 172.21.15.99:0/3641958382 shutdown_connections 2024-01-31T05:14:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.832+0000 7f7ab7709640 1 -- 172.21.15.99:0/3641958382 wait complete. 2024-01-31T05:14:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.833+0000 7f7ab7709640 1 Processor -- start 2024-01-31T05:14:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.833+0000 7f7ab7709640 1 -- start start 2024-01-31T05:14:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.833+0000 7f7ab7709640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ab00ffc60 0x7f7ab006a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.833+0000 7f7ab7709640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ab0100e50 0x7f7ab019ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.833+0000 7f7ab7709640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ab0101810 0x7f7ab01a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.833+0000 7f7ab7709640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab01a09d0 con 0x7f7ab0100e50 2024-01-31T05:14:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.833+0000 7f7ab7709640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab01a0b40 con 0x7f7ab0101810 2024-01-31T05:14:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.833+0000 7f7ab7709640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab01a0d00 con 0x7f7ab00ffc60 2024-01-31T05:14:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.833+0000 7f7ab4ca4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ab0100e50 0x7f7ab019ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.833+0000 7f7ab54a5640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ab00ffc60 0x7f7ab006a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.833+0000 7f7ab4ca4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ab0100e50 0x7f7ab019ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51366/0 (socket says 172.21.15.99:51366) 2024-01-31T05:14:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.833+0000 7f7ab4ca4640 1 -- 172.21.15.99:0/2401702694 learned_addr learned my addr 172.21.15.99:0/2401702694 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:14:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.833+0000 7f7ab5ca6640 1 --2- 172.21.15.99:0/2401702694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ab0101810 0x7f7ab01a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.833+0000 7f7ab4ca4640 1 -- 172.21.15.99:0/2401702694 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ab00ffc60 msgr2=0x7f7ab006a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.833+0000 7f7ab4ca4640 1 --2- 172.21.15.99:0/2401702694 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ab00ffc60 0x7f7ab006a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.833+0000 7f7ab4ca4640 1 -- 172.21.15.99:0/2401702694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ab0101810 msgr2=0x7f7ab01a0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.833+0000 7f7ab4ca4640 1 --2- 172.21.15.99:0/2401702694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ab0101810 0x7f7ab01a0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.833+0000 7f7ab4ca4640 1 -- 172.21.15.99:0/2401702694 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa0009560 con 0x7f7ab0100e50 2024-01-31T05:14:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.833+0000 7f7ab4ca4640 1 --2- 172.21.15.99:0/2401702694 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ab0100e50 0x7f7ab019ddc0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0009230 tx=0x7f7aa0004ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:14:07.837 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.834+0000 7f7aa67fc640 1 -- 172.21.15.99:0/2401702694 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa0004350 con 0x7f7ab0100e50 2024-01-31T05:14:07.837 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.834+0000 7f7aa67fc640 1 -- 172.21.15.99:0/2401702694 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7aa00044b0 con 0x7f7ab0100e50 2024-01-31T05:14:07.837 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.834+0000 7f7aa67fc640 1 -- 172.21.15.99:0/2401702694 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa0003e10 con 0x7f7ab0100e50 2024-01-31T05:14:07.837 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.834+0000 7f7ab7709640 1 -- 172.21.15.99:0/2401702694 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ab01a0f20 con 0x7f7ab0100e50 2024-01-31T05:14:07.837 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.834+0000 7f7ab7709640 1 -- 172.21.15.99:0/2401702694 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab01a13a0 con 0x7f7ab0100e50 2024-01-31T05:14:07.844 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.836+0000 7f7aa67fc640 1 -- 172.21.15.99:0/2401702694 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 20) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f7aa0005000 con 0x7f7ab0100e50 2024-01-31T05:14:07.844 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.836+0000 7f7aba5a8740 1 Processor -- start 2024-01-31T05:14:07.844 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.836+0000 7f7aba5a8740 1 -- start start 2024-01-31T05:14:07.844 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.837+0000 7f7aa67fc640 1 --2- 172.21.15.99:0/2401702694 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f7a9c0a1430 0x7f7a9c0a38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:07.844 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.837+0000 7f7aba5a8740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5620c8589270 0x5620c8589690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:07.844 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.837+0000 7f7aba5a8740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620c8589c60 0x5620c858e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:07.844 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.837+0000 7f7aba5a8740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5620c858edd0 0x5620c8591260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:07.844 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.837+0000 7f7aba5a8740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620c84f9040 con 0x5620c8589c60 2024-01-31T05:14:07.844 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.837+0000 7f7aba5a8740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620c84f6730 con 0x5620c8589270 2024-01-31T05:14:07.844 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.837+0000 7f7aba5a8740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620c84f2020 con 0x5620c858edd0 2024-01-31T05:14:07.844 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.837+0000 7f7ab4ca4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620c8589c60 0x5620c858e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:07.844 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.837+0000 7f7ab5ca6640 1 --2- 172.21.15.99:0/2401702694 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f7a9c0a1430 0x7f7a9c0a38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:07.845 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.837+0000 7f7ab54a5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5620c8589270 0x5620c8589690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:07.845 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.837+0000 7f7ab4ca4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620c8589c60 0x5620c858e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51374/0 (socket says 172.21.15.99:51374) 2024-01-31T05:14:07.845 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.837+0000 7f7ab4ca4640 1 -- 172.21.15.99:0/2230124198 learned_addr learned my addr 172.21.15.99:0/2230124198 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:14:07.845 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.837+0000 7f7ab5ca6640 1 --2- 172.21.15.99:0/2230124198 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5620c858edd0 0x5620c8591260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:07.845 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.837+0000 7f7aa67fc640 1 -- 172.21.15.99:0/2401702694 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f7aa00ef2a0 con 0x7f7ab0100e50 2024-01-31T05:14:07.845 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.837+0000 7f7ab54a5640 1 -- 172.21.15.99:0/2230124198 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5620c858edd0 msgr2=0x5620c8591260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:14:07.845 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.837+0000 7f7ab54a5640 1 --2- 172.21.15.99:0/2230124198 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5620c858edd0 0x5620c8591260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:07.845 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.837+0000 7f7ab54a5640 1 -- 172.21.15.99:0/2230124198 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620c8589c60 msgr2=0x5620c858e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:14:07.845 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.837+0000 7f7ab54a5640 1 --2- 172.21.15.99:0/2230124198 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620c8589c60 0x5620c858e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:07.845 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.837+0000 7f7ab54a5640 1 -- 172.21.15.99:0/2230124198 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5620c84e9e40 con 0x5620c8589270 2024-01-31T05:14:07.845 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.837+0000 7f7ab5ca6640 1 --2- 172.21.15.99:0/2401702694 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f7a9c0a1430 0x7f7a9c0a38f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8005fd0 tx=0x7f7aa8009b60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:14:07.845 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.837+0000 7f7ab54a5640 1 --2- 172.21.15.99:0/2230124198 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5620c8589270 0x5620c8589690 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7aac009bf0 tx=0x7f7aac011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b9cd97bbea1afd2 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:14:07.845 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.837+0000 7f7a9b7fe640 1 -- 172.21.15.99:0/2230124198 <== mon.2 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac009da0 con 0x5620c8589270 2024-01-31T05:14:07.846 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.838+0000 7f7a9b7fe640 1 -- 172.21.15.99:0/2230124198 <== mon.2 v2:172.21.15.179:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7aac0044f0 con 0x5620c8589270 2024-01-31T05:14:07.846 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.838+0000 7f7a9b7fe640 1 -- 172.21.15.99:0/2230124198 <== mon.2 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac004a00 con 0x5620c8589270 2024-01-31T05:14:07.846 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.838+0000 7f7aba5a8740 1 -- 172.21.15.99:0/2230124198 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5620c8589270 msgr2=0x5620c8589690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:07.846 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.838+0000 7f7aba5a8740 1 --2- 172.21.15.99:0/2230124198 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5620c8589270 0x5620c8589690 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7aac009bf0 tx=0x7f7aac011810 comp rx=0 tx=0).stop 2024-01-31T05:14:07.846 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.838+0000 7f7aba5a8740 1 -- 172.21.15.99:0/2230124198 shutdown_connections 2024-01-31T05:14:07.846 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.838+0000 7f7aba5a8740 1 --2- 172.21.15.99:0/2230124198 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5620c858edd0 0x5620c8591260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:07.846 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.838+0000 7f7aba5a8740 1 --2- 172.21.15.99:0/2230124198 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620c8589c60 0x5620c858e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:07.846 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.838+0000 7f7aba5a8740 1 --2- 172.21.15.99:0/2230124198 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5620c8589270 0x5620c8589690 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:07.846 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.838+0000 7f7aba5a8740 1 -- 172.21.15.99:0/2230124198 >> 172.21.15.99:0/2230124198 conn(0x5620c85847e0 msgr2=0x5620c8584be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:14:07.846 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.838+0000 7f7aba5a8740 1 -- 172.21.15.99:0/2230124198 shutdown_connections 2024-01-31T05:14:07.846 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.838+0000 7f7aba5a8740 1 -- 172.21.15.99:0/2230124198 wait complete. 2024-01-31T05:14:07.846 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.839+0000 7f7aba5a8740 1 -- start start 2024-01-31T05:14:07.846 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.839+0000 7f7aba5a8740 1 Processor -- start 2024-01-31T05:14:07.846 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.839+0000 7f7aba5a8740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5620c8589270 0x5620c85930c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:07.846 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.839+0000 7f7aba5a8740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620c8589c60 0x5620c8593600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:07.847 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.839+0000 7f7aba5a8740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5620c858edd0 0x5620c859a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:07.847 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.839+0000 7f7aba5a8740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620c84ab1b0 con 0x5620c8589c60 2024-01-31T05:14:07.847 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.839+0000 7f7aba5a8740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620c84aae50 con 0x5620c858edd0 2024-01-31T05:14:07.847 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.839+0000 7f7aba5a8740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620c8470090 con 0x5620c8589270 2024-01-31T05:14:07.847 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.839+0000 7f7aba5a8740 10 client.0 _ll_register_callbacks cb 0x5620c8495a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:14:07.847 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.839+0000 7f7ab4ca4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620c8589c60 0x5620c8593600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:07.847 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.839+0000 7f7ab4ca4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620c8589c60 0x5620c8593600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51386/0 (socket says 172.21.15.99:51386) 2024-01-31T05:14:07.847 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.839+0000 7f7ab4ca4640 1 -- 172.21.15.99:0/3406457893 learned_addr learned my addr 172.21.15.99:0/3406457893 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:14:07.847 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.839+0000 7f7ab5ca6640 1 --2- 172.21.15.99:0/3406457893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5620c858edd0 0x5620c859a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:07.847 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.839+0000 7f7ab54a5640 1 --2- 172.21.15.99:0/3406457893 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5620c8589270 0x5620c85930c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:07.847 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.839+0000 7f7ab4ca4640 1 -- 172.21.15.99:0/3406457893 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5620c8589270 msgr2=0x5620c85930c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:14:07.847 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.839+0000 7f7ab4ca4640 1 --2- 172.21.15.99:0/3406457893 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5620c8589270 0x5620c85930c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:07.847 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.839+0000 7f7ab4ca4640 1 -- 172.21.15.99:0/3406457893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5620c858edd0 msgr2=0x5620c859a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:14:07.847 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.839+0000 7f7ab4ca4640 1 --2- 172.21.15.99:0/3406457893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5620c858edd0 0x5620c859a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:07.847 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.839+0000 7f7ab4ca4640 1 -- 172.21.15.99:0/3406457893 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aac009850 con 0x5620c8589c60 2024-01-31T05:14:07.848 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.839+0000 7f7ab5ca6640 1 --2- 172.21.15.99:0/3406457893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5620c858edd0 0x5620c859a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:14:07.848 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.840+0000 7f7ab4ca4640 1 --2- 172.21.15.99:0/3406457893 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620c8589c60 0x5620c8593600 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0005770 tx=0x7f7aa0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a4376c3fd48fa06 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:14:07.848 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.840+0000 7f7a98ff9640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-01-31T05:14:07.848 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.840+0000 7f7a98ff9640 1 -- 172.21.15.99:0/3406457893 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa00bbe00 con 0x5620c8589c60 2024-01-31T05:14:07.848 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.840+0000 7f7a98ff9640 1 -- 172.21.15.99:0/3406457893 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f7aa00bcba0 con 0x5620c8589c60 2024-01-31T05:14:07.848 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.840+0000 7f7aba5a8740 1 -- 172.21.15.99:0/3406457893 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5620c84eb010 con 0x5620c8589c60 2024-01-31T05:14:07.848 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.840+0000 7f7a98ff9640 1 -- 172.21.15.99:0/3406457893 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7aa00d4dc0 con 0x5620c8589c60 2024-01-31T05:14:07.848 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.840+0000 7f7aba5a8740 10 client.16245 fetch_fsmap learned FSMap version 42 2024-01-31T05:14:07.848 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.840+0000 7f7aba5a8740 1 -- 172.21.15.99:0/3406457893 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) v3 -- 0x5620c84f06a0 con 0x5620c8589c60 2024-01-31T05:14:07.848 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.840+0000 7f7a98ff9640 1 -- 172.21.15.99:0/3406457893 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5620c84eb010 con 0x5620c8589c60 2024-01-31T05:14:07.848 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.840+0000 7f7a98ff9640 1 -- 172.21.15.99:0/3406457893 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 42) v1 ==== 7950+0+0 (secure 0 0 0) 0x7f7aa003c070 con 0x5620c8589c60 2024-01-31T05:14:07.848 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.840+0000 7f7aba5a8740 10 client.16245 fetch_fsmap finished waiting for FSMap version 42 2024-01-31T05:14:07.848 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.840+0000 7f7aba5a8740 10 client.16245 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-01-31T05:14:07.849 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.840+0000 7f7aba5a8740 20 client.16245 populate_metadata read hostname 'smithi099' 2024-01-31T05:14:07.849 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.840+0000 7f7aba5a8740 1 --2- 172.21.15.99:0/3406457893 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5620c859edf0 0x5620c85a1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:07.849 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.840+0000 7f7aba5a8740 4 client.16245 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-31T05:14:07.849 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.840+0000 7f7aba5a8740 1 -- 172.21.15.99:0/3406457893 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5620c84ead30 con 0x5620c859edf0 2024-01-31T05:14:07.849 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.840+0000 7f7ab54a5640 1 --2- 172.21.15.99:0/3406457893 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5620c859edf0 0x5620c85a1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:07.849 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.841+0000 7f7a98ff9640 10 client.16245 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:14:07.849 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.841+0000 7f7ab54a5640 1 --2- 172.21.15.99:0/3406457893 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5620c859edf0 0x5620c85a1210 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86f0c32a35793e19 server_cookie=12adc314510e363d in_seq=0 out_seq=0 2024-01-31T05:14:07.849 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.842+0000 7f7a98ff9640 1 -- 172.21.15.99:0/3406457893 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5620c84ead30 con 0x5620c859edf0 2024-01-31T05:14:07.849 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.842+0000 7f7a98ff9640 10 client.16245 handle_command_reply: tid=0 2024-01-31T05:14:07.849 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.842+0000 7f7aba5a8740 1 client.16245 shutdown 2024-01-31T05:14:07.849 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.843+0000 7f7aba5a8740 1 -- 172.21.15.99:0/3406457893 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620c8589c60 msgr2=0x5620c8593600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:07.849 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.843+0000 7f7aba5a8740 1 --2- 172.21.15.99:0/3406457893 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620c8589c60 0x5620c8593600 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0005770 tx=0x7f7aa0009260 comp rx=0 tx=0).stop 2024-01-31T05:14:07.849 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.843+0000 7f7aba5a8740 1 -- 172.21.15.99:0/3406457893 shutdown_connections 2024-01-31T05:14:07.849 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.843+0000 7f7aba5a8740 1 --2- 172.21.15.99:0/3406457893 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5620c859edf0 0x5620c85a1210 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:07.850 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.843+0000 7f7aba5a8740 1 --2- 172.21.15.99:0/3406457893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5620c858edd0 0x5620c859a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:07.850 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.843+0000 7f7aba5a8740 1 --2- 172.21.15.99:0/3406457893 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620c8589c60 0x5620c8593600 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:07.850 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.843+0000 7f7a98ff9640 0 client.16245 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:14:07.850 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.843+0000 7f7aba5a8740 1 --2- 172.21.15.99:0/3406457893 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5620c8589270 0x5620c85930c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:07.850 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.843+0000 7f7aba5a8740 1 -- 172.21.15.99:0/3406457893 >> 172.21.15.99:0/3406457893 conn(0x5620c85847e0 msgr2=0x5620c8583a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:14:07.850 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.843+0000 7f7aba5a8740 1 -- 172.21.15.99:0/3406457893 shutdown_connections 2024-01-31T05:14:07.850 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.843+0000 7f7aba5a8740 1 -- 172.21.15.99:0/3406457893 wait complete. 2024-01-31T05:14:07.850 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.843+0000 7f7aba5a8740 20 client.16245 trim_cache size 0 max 16384 2024-01-31T05:14:07.858 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.856+0000 7f7aba5a8740 1 Processor -- start 2024-01-31T05:14:07.859 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.856+0000 7f7aba5a8740 1 -- start start 2024-01-31T05:14:07.859 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.856+0000 7f7aba5a8740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5620c8589270 0x5620c85911c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:07.859 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.856+0000 7f7aba5a8740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5620c8589c60 0x5620c859a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:07.859 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.856+0000 7f7aba5a8740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620c858edd0 0x5620c858ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:07.859 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.856+0000 7f7aba5a8740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620c84eb010 con 0x5620c858edd0 2024-01-31T05:14:07.859 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.856+0000 7f7aba5a8740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620c858a350 con 0x5620c8589c60 2024-01-31T05:14:07.859 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.856+0000 7f7aba5a8740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620c858a040 con 0x5620c8589270 2024-01-31T05:14:07.859 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.856+0000 7f7ab5ca6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620c858edd0 0x5620c858ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:07.859 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.856+0000 7f7ab5ca6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620c858edd0 0x5620c858ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51396/0 (socket says 172.21.15.99:51396) 2024-01-31T05:14:07.860 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.856+0000 7f7ab5ca6640 1 -- 172.21.15.99:0/3734981827 learned_addr learned my addr 172.21.15.99:0/3734981827 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:14:07.860 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.856+0000 7f7ab4ca4640 1 --2- 172.21.15.99:0/3734981827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5620c8589c60 0x5620c859a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:07.860 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.856+0000 7f7ab54a5640 1 --2- 172.21.15.99:0/3734981827 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5620c8589270 0x5620c85911c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:07.860 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.856+0000 7f7ab5ca6640 1 -- 172.21.15.99:0/3734981827 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5620c8589270 msgr2=0x5620c85911c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:14:07.860 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.856+0000 7f7ab5ca6640 1 --2- 172.21.15.99:0/3734981827 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5620c8589270 0x5620c85911c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:07.860 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.856+0000 7f7ab5ca6640 1 -- 172.21.15.99:0/3734981827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5620c8589c60 msgr2=0x5620c859a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:14:07.860 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.856+0000 7f7ab5ca6640 1 --2- 172.21.15.99:0/3734981827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5620c8589c60 0x5620c859a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:07.860 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.856+0000 7f7ab5ca6640 1 -- 172.21.15.99:0/3734981827 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5620c848d030 con 0x5620c858edd0 2024-01-31T05:14:07.860 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.857+0000 7f7ab5ca6640 1 --2- 172.21.15.99:0/3734981827 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620c858edd0 0x5620c858ada0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8010de0 tx=0x7f7aa80096a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8b84886126442fd server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:14:07.860 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.857+0000 7f7a9affd640 1 -- 172.21.15.99:0/3734981827 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa8024070 con 0x5620c858edd0 2024-01-31T05:14:07.860 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.857+0000 7f7a9affd640 1 -- 172.21.15.99:0/3734981827 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7aa80288d0 con 0x5620c858edd0 2024-01-31T05:14:07.860 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.857+0000 7f7a9affd640 1 -- 172.21.15.99:0/3734981827 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa80115c0 con 0x5620c858edd0 2024-01-31T05:14:07.860 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.857+0000 7f7aba5a8740 1 -- 172.21.15.99:0/3734981827 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620c858edd0 msgr2=0x5620c858ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:07.860 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.857+0000 7f7aba5a8740 1 --2- 172.21.15.99:0/3734981827 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620c858edd0 0x5620c858ada0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8010de0 tx=0x7f7aa80096a0 comp rx=0 tx=0).stop 2024-01-31T05:14:07.861 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.857+0000 7f7aba5a8740 1 -- 172.21.15.99:0/3734981827 shutdown_connections 2024-01-31T05:14:07.861 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.857+0000 7f7aba5a8740 1 --2- 172.21.15.99:0/3734981827 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620c858edd0 0x5620c858ada0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:07.861 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.857+0000 7f7aba5a8740 1 --2- 172.21.15.99:0/3734981827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5620c8589c60 0x5620c859a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:07.861 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.857+0000 7f7aba5a8740 1 --2- 172.21.15.99:0/3734981827 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5620c8589270 0x5620c85911c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:07.861 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.857+0000 7f7aba5a8740 1 -- 172.21.15.99:0/3734981827 >> 172.21.15.99:0/3734981827 conn(0x5620c85847e0 msgr2=0x5620c85930c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:14:07.861 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.857+0000 7f7aba5a8740 1 -- 172.21.15.99:0/3734981827 shutdown_connections 2024-01-31T05:14:07.861 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.857+0000 7f7aba5a8740 1 -- 172.21.15.99:0/3734981827 wait complete. 2024-01-31T05:14:07.861 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.858+0000 7f7aba5a8740 1 -- start start 2024-01-31T05:14:07.861 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.858+0000 7f7aba5a8740 1 Processor -- start 2024-01-31T05:14:07.861 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.858+0000 7f7aba5a8740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5620c8589270 0x5620c859a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:07.861 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.858+0000 7f7aba5a8740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5620c8589c60 0x5620c8598900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:07.864 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.858+0000 7f7aba5a8740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620c858edd0 0x5620c8598e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:07.864 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.858+0000 7f7aba5a8740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620c8599380 con 0x5620c858edd0 2024-01-31T05:14:07.864 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.858+0000 7f7aba5a8740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620c85994f0 con 0x5620c8589270 2024-01-31T05:14:07.864 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.858+0000 7f7aba5a8740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620c85996b0 con 0x5620c8589c60 2024-01-31T05:14:07.864 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.858+0000 7f7aba5a8740 10 client.0 _ll_register_callbacks cb 0x7f7aac0097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-31T05:14:07.864 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.858+0000 7f7ab5ca6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620c858edd0 0x5620c8598e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:07.864 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.858+0000 7f7ab4ca4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5620c8589c60 0x5620c8598900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:07.864 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.858+0000 7f7ab54a5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5620c8589270 0x5620c859a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:07.865 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.858+0000 7f7ab4ca4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5620c8589c60 0x5620c8598900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:39796/0 (socket says 172.21.15.99:39796) 2024-01-31T05:14:07.865 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.858+0000 7f7ab54a5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5620c8589270 0x5620c859a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.99:45098/0 (socket says 172.21.15.99:45098) 2024-01-31T05:14:07.865 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.858+0000 7f7ab4ca4640 1 -- 172.21.15.99:0/1633177569 learned_addr learned my addr 172.21.15.99:0/1633177569 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:14:07.865 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.858+0000 7f7ab4ca4640 1 -- 172.21.15.99:0/1633177569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5620c8589270 msgr2=0x5620c859a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:14:07.865 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.858+0000 7f7ab4ca4640 1 --2- 172.21.15.99:0/1633177569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5620c8589270 0x5620c859a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:07.865 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.858+0000 7f7ab4ca4640 1 -- 172.21.15.99:0/1633177569 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620c858edd0 msgr2=0x5620c8598e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-31T05:14:07.865 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.858+0000 7f7ab4ca4640 1 --2- 172.21.15.99:0/1633177569 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620c858edd0 0x5620c8598e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:07.865 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.858+0000 7f7ab4ca4640 1 -- 172.21.15.99:0/1633177569 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aa801a040 con 0x5620c8589c60 2024-01-31T05:14:07.865 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.858+0000 7f7ab54a5640 1 --2- 172.21.15.99:0/1633177569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5620c8589270 0x5620c859a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:14:07.865 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.858+0000 7f7ab5ca6640 1 --2- 172.21.15.99:0/1633177569 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620c858edd0 0x5620c8598e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-31T05:14:07.865 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.859+0000 7f7ab4ca4640 1 --2- 172.21.15.99:0/1633177569 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5620c8589c60 0x5620c8598900 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7aa00b8ec0 tx=0x7f7aa00bbe00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17a1022638a52fe server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:14:07.865 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.859+0000 7f7a98ff9640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-01-31T05:14:07.865 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.859+0000 7f7a98ff9640 1 -- 172.21.15.99:0/1633177569 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa00bcba0 con 0x5620c8589c60 2024-01-31T05:14:07.865 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.859+0000 7f7aba5a8740 1 -- 172.21.15.99:0/1633177569 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7aac0044f0 con 0x5620c8589c60 2024-01-31T05:14:07.866 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.859+0000 7f7a98ff9640 1 -- 172.21.15.99:0/1633177569 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f7aa00d4dc0 con 0x5620c8589c60 2024-01-31T05:14:07.866 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.859+0000 7f7a98ff9640 1 -- 172.21.15.99:0/1633177569 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7aa00bc4a0 con 0x5620c8589c60 2024-01-31T05:14:07.866 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.859+0000 7f7aba5a8740 10 client.25540 fetch_fsmap learned FSMap version 42 2024-01-31T05:14:07.866 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.859+0000 7f7aba5a8740 1 -- 172.21.15.99:0/1633177569 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) v3 -- 0x5620c84b2a50 con 0x5620c8589c60 2024-01-31T05:14:07.866 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.859+0000 7f7a98ff9640 1 -- 172.21.15.99:0/1633177569 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7aac0044f0 con 0x5620c8589c60 2024-01-31T05:14:07.866 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.859+0000 7f7a98ff9640 1 -- 172.21.15.99:0/1633177569 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 42) v1 ==== 7950+0+0 (secure 0 0 0) 0x7f7aa003c040 con 0x5620c8589c60 2024-01-31T05:14:07.866 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.859+0000 7f7aba5a8740 10 client.25540 fetch_fsmap finished waiting for FSMap version 42 2024-01-31T05:14:07.866 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.859+0000 7f7aba5a8740 10 client.25540 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-01-31T05:14:07.866 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.859+0000 7f7aba5a8740 20 client.25540 populate_metadata read hostname 'smithi099' 2024-01-31T05:14:07.866 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.859+0000 7f7aba5a8740 1 --2- 172.21.15.99:0/1633177569 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5620c859edf0 0x5620c85f8570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:07.866 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.859+0000 7f7aba5a8740 4 client.25540 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-01-31T05:14:07.866 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.859+0000 7f7aba5a8740 1 -- 172.21.15.99:0/1633177569 --> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5620c81f1600 con 0x5620c859edf0 2024-01-31T05:14:07.866 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.860+0000 7f7ab54a5640 1 --2- 172.21.15.99:0/1633177569 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5620c859edf0 0x5620c85f8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:07.866 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.860+0000 7f7ab54a5640 1 --2- 172.21.15.99:0/1633177569 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5620c859edf0 0x5620c85f8570 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9cea1f2729a0a46b server_cookie=b67c98bd822fe7a7 in_seq=0 out_seq=0 2024-01-31T05:14:07.867 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:07.860+0000 7f7a98ff9640 10 client.25540 ms_handle_connect on v2:172.21.15.179:6838/754762785 2024-01-31T05:14:08.035 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:08.033+0000 7f7a98ff9640 1 -- 172.21.15.99:0/1633177569 <== mds.0 v2:172.21.15.179:6838/754762785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5620c81f1600 con 0x5620c859edf0 2024-01-31T05:14:08.035 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:08.033+0000 7f7a98ff9640 10 client.25540 handle_command_reply: tid=0 2024-01-31T05:14:08.035 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:08.033+0000 7f7aba5a8740 1 client.25540 shutdown 2024-01-31T05:14:08.035 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:08.034+0000 7f7aba5a8740 1 -- 172.21.15.99:0/1633177569 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5620c8589c60 msgr2=0x5620c8598900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:08.035 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:08.034+0000 7f7aba5a8740 1 --2- 172.21.15.99:0/1633177569 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5620c8589c60 0x5620c8598900 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7aa00b8ec0 tx=0x7f7aa00bbe00 comp rx=0 tx=0).stop 2024-01-31T05:14:08.035 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:08.034+0000 7f7aba5a8740 1 -- 172.21.15.99:0/1633177569 shutdown_connections 2024-01-31T05:14:08.035 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:08.034+0000 7f7aba5a8740 1 --2- 172.21.15.99:0/1633177569 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620c858edd0 0x5620c8598e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:08.035 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:08.034+0000 7f7aba5a8740 1 --2- 172.21.15.99:0/1633177569 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5620c8589c60 0x5620c8598900 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:08.035 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:08.034+0000 7f7aba5a8740 1 --2- 172.21.15.99:0/1633177569 >> [v2:172.21.15.179:6838/754762785,v1:172.21.15.179:6839/754762785] conn(0x5620c859edf0 0x5620c85f8570 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:08.035 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:08.034+0000 7f7aba5a8740 1 --2- 172.21.15.99:0/1633177569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5620c8589270 0x5620c859a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:08.035 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:08.034+0000 7f7a98ff9640 0 client.25540 ms_handle_reset on v2:172.21.15.179:6838/754762785 2024-01-31T05:14:08.036 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:08.034+0000 7f7aba5a8740 1 -- 172.21.15.99:0/1633177569 >> 172.21.15.99:0/1633177569 conn(0x5620c85847e0 msgr2=0x5620c8587a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:14:08.036 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:08.034+0000 7f7aba5a8740 1 -- 172.21.15.99:0/1633177569 shutdown_connections 2024-01-31T05:14:08.036 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:08.034+0000 7f7aba5a8740 1 -- 172.21.15.99:0/1633177569 wait complete. 2024-01-31T05:14:08.036 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:08.034+0000 7f7aba5a8740 20 client.25540 trim_cache size 0 max 16384 2024-01-31T05:14:08.036 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout:{ 2024-01-31T05:14:08.036 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout: "message": "", 2024-01-31T05:14:08.036 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout: "return_code": 0 2024-01-31T05:14:08.036 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stdout:} 2024-01-31T05:14:08.037 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:08.035+0000 7f7ab7709640 1 -- 172.21.15.99:0/2401702694 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f7a9c0a1430 msgr2=0x7f7a9c0a38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:08.037 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:08.035+0000 7f7ab7709640 1 --2- 172.21.15.99:0/2401702694 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f7a9c0a1430 0x7f7a9c0a38f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8005fd0 tx=0x7f7aa8009b60 comp rx=0 tx=0).stop 2024-01-31T05:14:08.037 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:08.035+0000 7f7ab7709640 1 -- 172.21.15.99:0/2401702694 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ab0100e50 msgr2=0x7f7ab019ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:08.037 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:08.035+0000 7f7ab7709640 1 --2- 172.21.15.99:0/2401702694 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ab0100e50 0x7f7ab019ddc0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0009230 tx=0x7f7aa0004ec0 comp rx=0 tx=0).stop 2024-01-31T05:14:08.038 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:08.035+0000 7f7ab7709640 1 -- 172.21.15.99:0/2401702694 shutdown_connections 2024-01-31T05:14:08.038 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:08.035+0000 7f7ab7709640 1 --2- 172.21.15.99:0/2401702694 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f7a9c0a1430 0x7f7a9c0a38f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:08.038 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:08.035+0000 7f7ab7709640 1 --2- 172.21.15.99:0/2401702694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ab0101810 0x7f7ab01a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:08.038 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:08.035+0000 7f7ab7709640 1 --2- 172.21.15.99:0/2401702694 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ab0100e50 0x7f7ab019ddc0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:08.038 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:08.035+0000 7f7ab7709640 1 --2- 172.21.15.99:0/2401702694 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ab00ffc60 0x7f7ab006a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:08.038 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:08.035+0000 7f7ab7709640 1 -- 172.21.15.99:0/2401702694 >> 172.21.15.99:0/2401702694 conn(0x7f7ab00fb1d0 msgr2=0x7f7ab0104150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:14:08.038 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:08.035+0000 7f7ab7709640 1 -- 172.21.15.99:0/2401702694 shutdown_connections 2024-01-31T05:14:08.038 INFO:teuthology.task.background_exec.ubuntu@smithi099.front.sepia.ceph.com.smithi099.stderr:2024-01-31T05:14:08.035+0000 7f7ab7709640 1 -- 172.21.15.99:0/2401702694 wait complete. 2024-01-31T05:14:08.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:14:07 smithi099 ceph-mon[31615]: pgmap v431: 97 pgs: 97 active+clean; 53 MiB data, 873 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 432 op/s 2024-01-31T05:14:08.070 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:14:07 smithi181 ceph-mon[36434]: pgmap v431: 97 pgs: 97 active+clean; 53 MiB data, 873 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 432 op/s 2024-01-31T05:14:08.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:14:07 smithi179 ceph-mon[35652]: pgmap v431: 97 pgs: 97 active+clean; 53 MiB data, 873 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 432 op/s 2024-01-31T05:14:10.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:14:09 smithi099 ceph-mon[31615]: pgmap v432: 97 pgs: 97 active+clean; 56 MiB data, 873 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 479 op/s 2024-01-31T05:14:10.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:14:09 smithi181 ceph-mon[36434]: pgmap v432: 97 pgs: 97 active+clean; 56 MiB data, 873 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 479 op/s 2024-01-31T05:14:10.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:14:09 smithi179 ceph-mon[35652]: pgmap v432: 97 pgs: 97 active+clean; 56 MiB data, 873 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 479 op/s 2024-01-31T05:14:12.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:14:11 smithi099 ceph-mon[31615]: pgmap v433: 97 pgs: 97 active+clean; 56 MiB data, 873 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 375 op/s 2024-01-31T05:14:12.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:14:11 smithi181 ceph-mon[36434]: pgmap v433: 97 pgs: 97 active+clean; 56 MiB data, 873 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 375 op/s 2024-01-31T05:14:12.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:14:11 smithi179 ceph-mon[35652]: pgmap v433: 97 pgs: 97 active+clean; 56 MiB data, 873 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 375 op/s 2024-01-31T05:14:13.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:14:13 smithi099 ceph-mon[31615]: pgmap v434: 97 pgs: 97 active+clean; 50 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 556 op/s 2024-01-31T05:14:13.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:14:13 smithi181 ceph-mon[36434]: pgmap v434: 97 pgs: 97 active+clean; 50 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 556 op/s 2024-01-31T05:14:13.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:14:13 smithi179 ceph-mon[35652]: pgmap v434: 97 pgs: 97 active+clean; 50 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 556 op/s 2024-01-31T05:14:16.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:14:15 smithi099 ceph-mon[31615]: pgmap v435: 97 pgs: 97 active+clean; 41 MiB data, 840 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 462 op/s 2024-01-31T05:14:16.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:14:15 smithi181 ceph-mon[36434]: pgmap v435: 97 pgs: 97 active+clean; 41 MiB data, 840 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 462 op/s 2024-01-31T05:14:16.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:14:15 smithi179 ceph-mon[35652]: pgmap v435: 97 pgs: 97 active+clean; 41 MiB data, 840 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 462 op/s 2024-01-31T05:14:18.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:14:17 smithi099 ceph-mon[31615]: pgmap v436: 97 pgs: 97 active+clean; 42 MiB data, 810 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 469 op/s 2024-01-31T05:14:18.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:14:17 smithi181 ceph-mon[36434]: pgmap v436: 97 pgs: 97 active+clean; 42 MiB data, 810 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 469 op/s 2024-01-31T05:14:18.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:14:17 smithi179 ceph-mon[35652]: pgmap v436: 97 pgs: 97 active+clean; 42 MiB data, 810 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 469 op/s 2024-01-31T05:14:20.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:14:19 smithi099 ceph-mon[31615]: pgmap v437: 97 pgs: 97 active+clean; 42 MiB data, 799 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 533 op/s 2024-01-31T05:14:20.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:14:19 smithi181 ceph-mon[36434]: pgmap v437: 97 pgs: 97 active+clean; 42 MiB data, 799 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 533 op/s 2024-01-31T05:14:20.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:14:19 smithi179 ceph-mon[35652]: pgmap v437: 97 pgs: 97 active+clean; 42 MiB data, 799 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 533 op/s 2024-01-31T05:14:20.513 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-01-31T05:14:20.513 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-01-31T05:14:20.847 DEBUG:teuthology.parallel:result is None 2024-01-31T05:14:20.848 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-01-31T05:14:20.899 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-01-31T05:14:20.899 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-01-31T05:14:20.909 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi099.front.sepia.ceph.com 2024-01-31T05:14:20.917 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-01-31T05:14:20.928 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-01-31T05:14:20.928 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-01-31T05:14:20.929 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-01-31T05:14:20.944 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:14:21.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.060+0000 7f11fc35e640 1 -- 172.21.15.99:0/1024180734 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11f4101790 msgr2=0x7f11f4103b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:21.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.060+0000 7f11fc35e640 1 --2- 172.21.15.99:0/1024180734 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11f4101790 0x7f11f4103b80 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f11e8009900 tx=0x7f11e802bc30 comp rx=0 tx=0).stop 2024-01-31T05:14:21.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.060+0000 7f11fc35e640 1 -- 172.21.15.99:0/1024180734 shutdown_connections 2024-01-31T05:14:21.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.060+0000 7f11fc35e640 1 --2- 172.21.15.99:0/1024180734 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11f41069f0 0x7f11f4108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:21.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.060+0000 7f11fc35e640 1 --2- 172.21.15.99:0/1024180734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11f41040c0 0x7f11f41064b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:21.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.060+0000 7f11fc35e640 1 --2- 172.21.15.99:0/1024180734 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11f4101790 0x7f11f4103b80 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:21.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.060+0000 7f11fc35e640 1 -- 172.21.15.99:0/1024180734 >> 172.21.15.99:0/1024180734 conn(0x7f11f40fb180 msgr2=0x7f11f40fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:14:21.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.060+0000 7f11fc35e640 1 -- 172.21.15.99:0/1024180734 shutdown_connections 2024-01-31T05:14:21.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.060+0000 7f11fc35e640 1 -- 172.21.15.99:0/1024180734 wait complete. 2024-01-31T05:14:21.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.060+0000 7f11fc35e640 1 Processor -- start 2024-01-31T05:14:21.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.061+0000 7f11fc35e640 1 -- start start 2024-01-31T05:14:21.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.061+0000 7f11fc35e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11f4101790 0x7f11f4196d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:21.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.061+0000 7f11fc35e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11f41040c0 0x7f11f4197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:21.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.061+0000 7f11fc35e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11f41069f0 0x7f11f419e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:21.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.061+0000 7f11fc35e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f419e820 con 0x7f11f4101790 2024-01-31T05:14:21.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.061+0000 7f11fc35e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f419e990 con 0x7f11f41069f0 2024-01-31T05:14:21.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.061+0000 7f11fc35e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f419eb50 con 0x7f11f41040c0 2024-01-31T05:14:21.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.061+0000 7f11fa0fa640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11f4101790 0x7f11f4196d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:21.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.061+0000 7f11fa0fa640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11f4101790 0x7f11f4196d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59402/0 (socket says 172.21.15.99:59402) 2024-01-31T05:14:21.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.061+0000 7f11fa0fa640 1 -- 172.21.15.99:0/2551977393 learned_addr learned my addr 172.21.15.99:0/2551977393 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:14:21.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.061+0000 7f11f98f9640 1 --2- 172.21.15.99:0/2551977393 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11f41040c0 0x7f11f4197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:21.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.061+0000 7f11fa0fa640 1 -- 172.21.15.99:0/2551977393 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11f41040c0 msgr2=0x7f11f4197280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:21.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.061+0000 7f11fa0fa640 1 --2- 172.21.15.99:0/2551977393 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11f41040c0 0x7f11f4197280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:21.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.061+0000 7f11fa0fa640 1 -- 172.21.15.99:0/2551977393 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11f41069f0 msgr2=0x7f11f419e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:21.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.061+0000 7f11fa0fa640 1 --2- 172.21.15.99:0/2551977393 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11f41069f0 0x7f11f419e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:21.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.061+0000 7f11fa0fa640 1 -- 172.21.15.99:0/2551977393 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e8009560 con 0x7f11f4101790 2024-01-31T05:14:21.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.061+0000 7f11fa0fa640 1 --2- 172.21.15.99:0/2551977393 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11f4101790 0x7f11f4196d40 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f11e8009230 tx=0x7f11e8004ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:14:21.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.061+0000 7f11e77fe640 1 -- 172.21.15.99:0/2551977393 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e80043d0 con 0x7f11f4101790 2024-01-31T05:14:21.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.061+0000 7f11e77fe640 1 -- 172.21.15.99:0/2551977393 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f11e80054c0 con 0x7f11f4101790 2024-01-31T05:14:21.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.061+0000 7f11fc35e640 1 -- 172.21.15.99:0/2551977393 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11f419edd0 con 0x7f11f4101790 2024-01-31T05:14:21.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.061+0000 7f11e77fe640 1 -- 172.21.15.99:0/2551977393 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e803e450 con 0x7f11f4101790 2024-01-31T05:14:21.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.062+0000 7f11fc35e640 1 -- 172.21.15.99:0/2551977393 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11f419f220 con 0x7f11f4101790 2024-01-31T05:14:21.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.062+0000 7f11fc35e640 1 -- 172.21.15.99:0/2551977393 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11f40fcc70 con 0x7f11f4101790 2024-01-31T05:14:21.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.063+0000 7f11e77fe640 1 -- 172.21.15.99:0/2551977393 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 20) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f11e80035f0 con 0x7f11f4101790 2024-01-31T05:14:21.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.064+0000 7f11e77fe640 1 --2- 172.21.15.99:0/2551977393 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f11e00a12e0 0x7f11e00a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:21.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.064+0000 7f11f98f9640 1 --2- 172.21.15.99:0/2551977393 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f11e00a12e0 0x7f11e00a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:21.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.064+0000 7f11e77fe640 1 -- 172.21.15.99:0/2551977393 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f11e80ef5e0 con 0x7f11f4101790 2024-01-31T05:14:21.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.064+0000 7f11f98f9640 1 --2- 172.21.15.99:0/2551977393 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f11e00a12e0 0x7f11e00a37a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f11f0005fd0 tx=0x7f11f0005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:14:21.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.068+0000 7f11e77fe640 1 -- 172.21.15.99:0/2551977393 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f11e80b8a90 con 0x7f11f4101790 2024-01-31T05:14:21.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.243+0000 7f11fc35e640 1 -- 172.21.15.99:0/2551977393 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f11f402cb50 con 0x7f11f4101790 2024-01-31T05:14:21.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.244+0000 7f11e77fe640 1 -- 172.21.15.99:0/2551977393 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22426 (secure 0 0 0) 0x7f11e80ba9c0 con 0x7f11f4101790 2024-01-31T05:14:21.244 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:14:21.244 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":88,"fsid":"9288ff44-bff5-11ee-95b3-87774f69a715","created":"2024-01-31T05:01:26.130917+0000","modified":"2024-01-31T05:10:21.675877+0000","last_up_change":"2024-01-31T05:08:31.228478+0000","last_in_change":"2024-01-31T05:08:10.799511+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:46.842423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:09:18.693558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-31T05:09:19.734003+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b45878d9-28f1-4821-ba72-26a32d3fc780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6803","nonce":1213805280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6805","nonce":1213805280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6809","nonce":1213805280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6807","nonce":1213805280}]},"public_addr":"172.21.15.99:6803/1213805280","cluster_addr":"172.21.15.99:6805/1213805280","heartbeat_back_addr":"172.21.15.99:6809/1213805280","heartbeat_front_addr":"172.21.15.99:6807/1213805280","state":["exists","up"]},{"osd":1,"uuid":"e0b71ff3-5d97-4659-8dea-4c9091e1beb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6801","nonce":2019451677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6803","nonce":2019451677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6807","nonce":2019451677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6805","nonce":2019451677}]},"public_addr":"172.21.15.179:6801/2019451677","cluster_addr":"172.21.15.179:6803/2019451677","heartbeat_back_addr":"172.21.15.179:6807/2019451677","heartbeat_front_addr":"172.21.15.179:6805/2019451677","state":["exists","up"]},{"osd":2,"uuid":"11c919c8-19a9-48b0-8880-3002efcb64f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6801","nonce":3934284457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6803","nonce":3934284457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6807","nonce":3934284457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6805","nonce":3934284457}]},"public_addr":"172.21.15.181:6801/3934284457","cluster_addr":"172.21.15.181:6803/3934284457","heartbeat_back_addr":"172.21.15.181:6807/3934284457","heartbeat_front_addr":"172.21.15.181:6805/3934284457","state":["exists","up"]},{"osd":3,"uuid":"bcab5135-a5d1-45ae-a9b8-674425d3999e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6811","nonce":4207675427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6813","nonce":4207675427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6817","nonce":4207675427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6815","nonce":4207675427}]},"public_addr":"172.21.15.99:6811/4207675427","cluster_addr":"172.21.15.99:6813/4207675427","heartbeat_back_addr":"172.21.15.99:6817/4207675427","heartbeat_front_addr":"172.21.15.99:6815/4207675427","state":["exists","up"]},{"osd":4,"uuid":"0250d7ac-3894-457a-9c04-cc7205d61eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6809","nonce":2861083896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6811","nonce":2861083896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6815","nonce":2861083896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6813","nonce":2861083896}]},"public_addr":"172.21.15.179:6809/2861083896","cluster_addr":"172.21.15.179:6811/2861083896","heartbeat_back_addr":"172.21.15.179:6815/2861083896","heartbeat_front_addr":"172.21.15.179:6813/2861083896","state":["exists","up"]},{"osd":5,"uuid":"5e19222a-c2a4-45bc-8445-1d302f26d11c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6809","nonce":1485017095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6811","nonce":1485017095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6815","nonce":1485017095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6813","nonce":1485017095}]},"public_addr":"172.21.15.181:6809/1485017095","cluster_addr":"172.21.15.181:6811/1485017095","heartbeat_back_addr":"172.21.15.181:6815/1485017095","heartbeat_front_addr":"172.21.15.181:6813/1485017095","state":["exists","up"]},{"osd":6,"uuid":"56555035-f9fc-4e91-96dd-caa632d58adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6819","nonce":1534047839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6821","nonce":1534047839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6825","nonce":1534047839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6823","nonce":1534047839}]},"public_addr":"172.21.15.99:6819/1534047839","cluster_addr":"172.21.15.99:6821/1534047839","heartbeat_back_addr":"172.21.15.99:6825/1534047839","heartbeat_front_addr":"172.21.15.99:6823/1534047839","state":["exists","up"]},{"osd":7,"uuid":"5e079cf5-1340-4599-88a6-df410ef0148e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6817","nonce":3875950553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6819","nonce":3875950553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6823","nonce":3875950553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6821","nonce":3875950553}]},"public_addr":"172.21.15.179:6817/3875950553","cluster_addr":"172.21.15.179:6819/3875950553","heartbeat_back_addr":"172.21.15.179:6823/3875950553","heartbeat_front_addr":"172.21.15.179:6821/3875950553","state":["exists","up"]},{"osd":8,"uuid":"10a73592-4251-4492-b67d-ce9b9d7fff32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6817","nonce":179568936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6819","nonce":179568936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6823","nonce":179568936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6821","nonce":179568936}]},"public_addr":"172.21.15.181:6817/179568936","cluster_addr":"172.21.15.181:6819/179568936","heartbeat_back_addr":"172.21.15.181:6823/179568936","heartbeat_front_addr":"172.21.15.181:6821/179568936","state":["exists","up"]},{"osd":9,"uuid":"f6620e1e-f761-4f1c-917f-cbc748df32a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6827","nonce":315759515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6829","nonce":315759515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6833","nonce":315759515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6831","nonce":315759515}]},"public_addr":"172.21.15.99:6827/315759515","cluster_addr":"172.21.15.99:6829/315759515","heartbeat_back_addr":"172.21.15.99:6833/315759515","heartbeat_front_addr":"172.21.15.99:6831/315759515","state":["exists","up"]},{"osd":10,"uuid":"ee86af7d-66f8-4795-bcc3-dfec79e4680c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6825","nonce":2985063934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6827","nonce":2985063934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6831","nonce":2985063934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6829","nonce":2985063934}]},"public_addr":"172.21.15.179:6825/2985063934","cluster_addr":"172.21.15.179:6827/2985063934","heartbeat_back_addr":"172.21.15.179:6831/2985063934","heartbeat_front_addr":"172.21.15.179:6829/2985063934","state":["exists","up"]},{"osd":11,"uuid":"82f04fee-f6ae-4630-a75b-b12a9c4ab2e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6825","nonce":1858219600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6827","nonce":1858219600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6831","nonce":1858219600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6829","nonce":1858219600}]},"public_addr":"172.21.15.181:6825/1858219600","cluster_addr":"172.21.15.181:6827/1858219600","heartbeat_back_addr":"172.21.15.181:6831/1858219600","heartbeat_front_addr":"172.21.15.181:6829/1858219600","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:55.518970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:04:19.936339+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:04:44.064814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:09.331683+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:34.616774+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:58.881810+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:06:23.869838+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:06:49.127331+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:07:12.847187+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:07:38.231045+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:08:03.949162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:08:28.471802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:0/401101729":"2024-02-01T05:02:20.510858+0000","172.21.15.99:6801/1993198206":"2024-02-01T05:02:20.510858+0000","172.21.15.99:0/3819754569":"2024-02-01T05:02:20.510858+0000","172.21.15.99:0/475390265":"2024-02-01T05:01:53.732026+0000","172.21.15.99:6800/1993198206":"2024-02-01T05:02:20.510858+0000","172.21.15.99:6800/1706888338":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/4150146075":"2024-02-01T05:01:53.732026+0000","172.21.15.99:6801/1706888338":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/2851066598":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/1865156424":"2024-02-01T05:02:20.510858+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:14:21.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.246+0000 7f11fc35e640 1 -- 172.21.15.99:0/2551977393 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f11e00a12e0 msgr2=0x7f11e00a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:21.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.246+0000 7f11fc35e640 1 --2- 172.21.15.99:0/2551977393 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f11e00a12e0 0x7f11e00a37a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f11f0005fd0 tx=0x7f11f0005850 comp rx=0 tx=0).stop 2024-01-31T05:14:21.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.246+0000 7f11fc35e640 1 -- 172.21.15.99:0/2551977393 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11f4101790 msgr2=0x7f11f4196d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:21.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.246+0000 7f11fc35e640 1 --2- 172.21.15.99:0/2551977393 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11f4101790 0x7f11f4196d40 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f11e8009230 tx=0x7f11e8004ee0 comp rx=0 tx=0).stop 2024-01-31T05:14:21.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.246+0000 7f11fc35e640 1 -- 172.21.15.99:0/2551977393 shutdown_connections 2024-01-31T05:14:21.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.246+0000 7f11fc35e640 1 --2- 172.21.15.99:0/2551977393 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f11e00a12e0 0x7f11e00a37a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:21.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.246+0000 7f11fc35e640 1 --2- 172.21.15.99:0/2551977393 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11f41069f0 0x7f11f419e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:21.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.246+0000 7f11fc35e640 1 --2- 172.21.15.99:0/2551977393 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11f41040c0 0x7f11f4197280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:21.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.246+0000 7f11fc35e640 1 --2- 172.21.15.99:0/2551977393 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11f4101790 0x7f11f4196d40 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:21.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.246+0000 7f11fc35e640 1 -- 172.21.15.99:0/2551977393 >> 172.21.15.99:0/2551977393 conn(0x7f11f40fb180 msgr2=0x7f11f41020d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:14:21.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.246+0000 7f11fc35e640 1 -- 172.21.15.99:0/2551977393 shutdown_connections 2024-01-31T05:14:21.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.246+0000 7f11fc35e640 1 -- 172.21.15.99:0/2551977393 wait complete. 2024-01-31T05:14:21.257 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-31T05:04:46.842423+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-31T05:09:18.693558+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-31T05:09:19.734003+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-31T05:14:21.257 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-31T05:14:21.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.365+0000 7f36cc099640 1 -- 172.21.15.99:0/1071887845 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36c4100d20 msgr2=0x7f36c4101140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:21.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.365+0000 7f36cc099640 1 --2- 172.21.15.99:0/1071887845 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36c4100d20 0x7f36c4101140 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f36c0009900 tx=0x7f36c002bc30 comp rx=0 tx=0).stop 2024-01-31T05:14:21.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.365+0000 7f36cc099640 1 -- 172.21.15.99:0/1071887845 shutdown_connections 2024-01-31T05:14:21.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.365+0000 7f36cc099640 1 --2- 172.21.15.99:0/1071887845 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36c41028d0 0x7f36c4109160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:21.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.365+0000 7f36cc099640 1 --2- 172.21.15.99:0/1071887845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36c4101f10 0x7f36c4102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:21.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.365+0000 7f36cc099640 1 --2- 172.21.15.99:0/1071887845 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36c4100d20 0x7f36c4101140 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:21.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.365+0000 7f36cc099640 1 -- 172.21.15.99:0/1071887845 >> 172.21.15.99:0/1071887845 conn(0x7f36c40fc290 msgr2=0x7f36c40fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:14:21.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.365+0000 7f36cc099640 1 -- 172.21.15.99:0/1071887845 shutdown_connections 2024-01-31T05:14:21.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.365+0000 7f36cc099640 1 -- 172.21.15.99:0/1071887845 wait complete. 2024-01-31T05:14:21.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.366+0000 7f36cc099640 1 Processor -- start 2024-01-31T05:14:21.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.366+0000 7f36cc099640 1 -- start start 2024-01-31T05:14:21.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.366+0000 7f36cc099640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36c4100d20 0x7f36c419d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:21.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.366+0000 7f36cc099640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36c4101f10 0x7f36c419d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:21.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.366+0000 7f36cc099640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36c41028d0 0x7f36c41a48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:21.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.366+0000 7f36cc099640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c41a4e10 con 0x7f36c4101f10 2024-01-31T05:14:21.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.366+0000 7f36cc099640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c41a4f80 con 0x7f36c41028d0 2024-01-31T05:14:21.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.366+0000 7f36cc099640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c41a5140 con 0x7f36c4100d20 2024-01-31T05:14:21.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.366+0000 7f36c9634640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36c4101f10 0x7f36c419d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:21.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.366+0000 7f36c9634640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36c4101f10 0x7f36c419d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59430/0 (socket says 172.21.15.99:59430) 2024-01-31T05:14:21.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.366+0000 7f36c9634640 1 -- 172.21.15.99:0/2553202546 learned_addr learned my addr 172.21.15.99:0/2553202546 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:14:21.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.366+0000 7f36c9e35640 1 --2- 172.21.15.99:0/2553202546 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36c4100d20 0x7f36c419d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:21.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.366+0000 7f36ca636640 1 --2- 172.21.15.99:0/2553202546 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36c41028d0 0x7f36c41a48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:21.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.366+0000 7f36c9634640 1 -- 172.21.15.99:0/2553202546 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36c4100d20 msgr2=0x7f36c419d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:21.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.366+0000 7f36c9634640 1 --2- 172.21.15.99:0/2553202546 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36c4100d20 0x7f36c419d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:21.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.366+0000 7f36c9634640 1 -- 172.21.15.99:0/2553202546 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36c41028d0 msgr2=0x7f36c41a48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:21.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.366+0000 7f36c9634640 1 --2- 172.21.15.99:0/2553202546 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36c41028d0 0x7f36c41a48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:21.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.366+0000 7f36c9634640 1 -- 172.21.15.99:0/2553202546 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c0009560 con 0x7f36c4101f10 2024-01-31T05:14:21.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.366+0000 7f36c9634640 1 --2- 172.21.15.99:0/2553202546 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36c4101f10 0x7f36c419d860 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f36b400d950 tx=0x7f36b400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:14:21.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.367+0000 7f36baffd640 1 -- 172.21.15.99:0/2553202546 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b4009a30 con 0x7f36c4101f10 2024-01-31T05:14:21.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.367+0000 7f36baffd640 1 -- 172.21.15.99:0/2553202546 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f36b4009b90 con 0x7f36c4101f10 2024-01-31T05:14:21.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.367+0000 7f36baffd640 1 -- 172.21.15.99:0/2553202546 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b40047a0 con 0x7f36c4101f10 2024-01-31T05:14:21.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.367+0000 7f36cc099640 1 -- 172.21.15.99:0/2553202546 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36c41a5420 con 0x7f36c4101f10 2024-01-31T05:14:21.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.367+0000 7f36cc099640 1 -- 172.21.15.99:0/2553202546 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36c41a5930 con 0x7f36c4101f10 2024-01-31T05:14:21.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.368+0000 7f36cc099640 1 -- 172.21.15.99:0/2553202546 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36c4106120 con 0x7f36c4101f10 2024-01-31T05:14:21.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.369+0000 7f36baffd640 1 -- 172.21.15.99:0/2553202546 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 20) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f36b4009d00 con 0x7f36c4101f10 2024-01-31T05:14:21.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.369+0000 7f36baffd640 1 --2- 172.21.15.99:0/2553202546 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f36b00a12e0 0x7f36b00a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:21.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.369+0000 7f36c9e35640 1 --2- 172.21.15.99:0/2553202546 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f36b00a12e0 0x7f36b00a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:21.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.370+0000 7f36baffd640 1 -- 172.21.15.99:0/2553202546 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f36b40ccb80 con 0x7f36c4101f10 2024-01-31T05:14:21.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.370+0000 7f36c9e35640 1 --2- 172.21.15.99:0/2553202546 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f36b00a12e0 0x7f36b00a37a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f36c0000c00 tx=0x7f36c002c5d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:14:21.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.374+0000 7f36baffd640 1 -- 172.21.15.99:0/2553202546 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f36b40960c0 con 0x7f36c4101f10 2024-01-31T05:14:21.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.550+0000 7f36cc099640 1 -- 172.21.15.99:0/2553202546 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f36c410c800 con 0x7f36c4101f10 2024-01-31T05:14:21.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.551+0000 7f36baffd640 1 -- 172.21.15.99:0/2553202546 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f36b4017020 con 0x7f36c4101f10 2024-01-31T05:14:21.550 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-01-31T05:14:21.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.553+0000 7f36cc099640 1 -- 172.21.15.99:0/2553202546 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f36b00a12e0 msgr2=0x7f36b00a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:21.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.553+0000 7f36cc099640 1 --2- 172.21.15.99:0/2553202546 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f36b00a12e0 0x7f36b00a37a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f36c0000c00 tx=0x7f36c002c5d0 comp rx=0 tx=0).stop 2024-01-31T05:14:21.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.553+0000 7f36cc099640 1 -- 172.21.15.99:0/2553202546 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36c4101f10 msgr2=0x7f36c419d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:21.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.553+0000 7f36cc099640 1 --2- 172.21.15.99:0/2553202546 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36c4101f10 0x7f36c419d860 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f36b400d950 tx=0x7f36b400de10 comp rx=0 tx=0).stop 2024-01-31T05:14:21.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.553+0000 7f36cc099640 1 -- 172.21.15.99:0/2553202546 shutdown_connections 2024-01-31T05:14:21.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.553+0000 7f36cc099640 1 --2- 172.21.15.99:0/2553202546 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f36b00a12e0 0x7f36b00a37a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:21.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.553+0000 7f36cc099640 1 --2- 172.21.15.99:0/2553202546 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36c41028d0 0x7f36c41a48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:21.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.553+0000 7f36cc099640 1 --2- 172.21.15.99:0/2553202546 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36c4101f10 0x7f36c419d860 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:21.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.553+0000 7f36cc099640 1 --2- 172.21.15.99:0/2553202546 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36c4100d20 0x7f36c419d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:21.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.553+0000 7f36cc099640 1 -- 172.21.15.99:0/2553202546 >> 172.21.15.99:0/2553202546 conn(0x7f36c40fc290 msgr2=0x7f36c41032f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:14:21.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.553+0000 7f36cc099640 1 -- 172.21.15.99:0/2553202546 shutdown_connections 2024-01-31T05:14:21.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.553+0000 7f36cc099640 1 -- 172.21.15.99:0/2553202546 wait complete. 2024-01-31T05:14:21.563 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-31T05:14:21.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.668+0000 7facbbf7c640 1 -- 172.21.15.99:0/2460959057 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7facb40ffc10 msgr2=0x7facb4100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:21.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.668+0000 7facbbf7c640 1 --2- 172.21.15.99:0/2460959057 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7facb40ffc10 0x7facb4100030 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7facb0009900 tx=0x7facb002bc30 comp rx=0 tx=0).stop 2024-01-31T05:14:21.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.668+0000 7facbbf7c640 1 -- 172.21.15.99:0/2460959057 shutdown_connections 2024-01-31T05:14:21.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.668+0000 7facbbf7c640 1 --2- 172.21.15.99:0/2460959057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facb41017c0 0x7facb4108050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:21.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.668+0000 7facbbf7c640 1 --2- 172.21.15.99:0/2460959057 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7facb4100e00 0x7facb4101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:21.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.668+0000 7facbbf7c640 1 --2- 172.21.15.99:0/2460959057 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7facb40ffc10 0x7facb4100030 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:21.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.668+0000 7facbbf7c640 1 -- 172.21.15.99:0/2460959057 >> 172.21.15.99:0/2460959057 conn(0x7facb40fb1a0 msgr2=0x7facb40fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:14:21.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.668+0000 7facbbf7c640 1 -- 172.21.15.99:0/2460959057 shutdown_connections 2024-01-31T05:14:21.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.668+0000 7facbbf7c640 1 -- 172.21.15.99:0/2460959057 wait complete. 2024-01-31T05:14:21.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.669+0000 7facbbf7c640 1 Processor -- start 2024-01-31T05:14:21.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.669+0000 7facbbf7c640 1 -- start start 2024-01-31T05:14:21.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.669+0000 7facbbf7c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facb40ffc10 0x7facb4196d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:21.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.669+0000 7facbbf7c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7facb4100e00 0x7facb4197290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:21.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.669+0000 7facbbf7c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7facb41017c0 0x7facb419e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:21.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.669+0000 7facbbf7c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb419e830 con 0x7facb4100e00 2024-01-31T05:14:21.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.669+0000 7facbbf7c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb419e9a0 con 0x7facb40ffc10 2024-01-31T05:14:21.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.669+0000 7facbbf7c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb419eb60 con 0x7facb41017c0 2024-01-31T05:14:21.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.669+0000 7facb9517640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7facb4100e00 0x7facb4197290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:21.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.669+0000 7facb9517640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7facb4100e00 0x7facb4197290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59454/0 (socket says 172.21.15.99:59454) 2024-01-31T05:14:21.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.669+0000 7facb9517640 1 -- 172.21.15.99:0/4094079167 learned_addr learned my addr 172.21.15.99:0/4094079167 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:14:21.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.669+0000 7facb9d18640 1 --2- 172.21.15.99:0/4094079167 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facb40ffc10 0x7facb4196d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:21.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.669+0000 7facba519640 1 --2- 172.21.15.99:0/4094079167 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7facb41017c0 0x7facb419e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:21.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.669+0000 7facb9517640 1 -- 172.21.15.99:0/4094079167 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7facb41017c0 msgr2=0x7facb419e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:21.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.669+0000 7facb9517640 1 --2- 172.21.15.99:0/4094079167 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7facb41017c0 0x7facb419e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:21.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.669+0000 7facb9517640 1 -- 172.21.15.99:0/4094079167 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facb40ffc10 msgr2=0x7facb4196d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:21.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.669+0000 7facb9517640 1 --2- 172.21.15.99:0/4094079167 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facb40ffc10 0x7facb4196d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:21.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.669+0000 7facb9517640 1 -- 172.21.15.99:0/4094079167 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb0009560 con 0x7facb4100e00 2024-01-31T05:14:21.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.670+0000 7facb9517640 1 --2- 172.21.15.99:0/4094079167 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7facb4100e00 0x7facb4197290 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7faca400b4a0 tx=0x7faca400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:14:21.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.670+0000 7facaaffd640 1 -- 172.21.15.99:0/4094079167 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca4010610 con 0x7facb4100e00 2024-01-31T05:14:21.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.670+0000 7facaaffd640 1 -- 172.21.15.99:0/4094079167 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faca4010c30 con 0x7facb4100e00 2024-01-31T05:14:21.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.670+0000 7facbbf7c640 1 -- 172.21.15.99:0/4094079167 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb419ee40 con 0x7facb4100e00 2024-01-31T05:14:21.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.670+0000 7facaaffd640 1 -- 172.21.15.99:0/4094079167 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca4017dd0 con 0x7facb4100e00 2024-01-31T05:14:21.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.670+0000 7facbbf7c640 1 -- 172.21.15.99:0/4094079167 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb419f2e0 con 0x7facb4100e00 2024-01-31T05:14:21.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.671+0000 7facbbf7c640 1 -- 172.21.15.99:0/4094079167 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facb4107020 con 0x7facb4100e00 2024-01-31T05:14:21.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.672+0000 7facaaffd640 1 -- 172.21.15.99:0/4094079167 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 20) v1 ==== 135895+0+0 (secure 0 0 0) 0x7faca40173f0 con 0x7facb4100e00 2024-01-31T05:14:21.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.672+0000 7facaaffd640 1 --2- 172.21.15.99:0/4094079167 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7faca00a12e0 0x7faca00a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:21.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.673+0000 7facb9d18640 1 --2- 172.21.15.99:0/4094079167 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7faca00a12e0 0x7faca00a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:21.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.673+0000 7facaaffd640 1 -- 172.21.15.99:0/4094079167 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7faca40cc490 con 0x7facb4100e00 2024-01-31T05:14:21.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.673+0000 7facb9d18640 1 --2- 172.21.15.99:0/4094079167 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7faca00a12e0 0x7faca00a37a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7facb0000c00 tx=0x7facb002c5d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:14:21.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.676+0000 7facaaffd640 1 -- 172.21.15.99:0/4094079167 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7faca40959f0 con 0x7facb4100e00 2024-01-31T05:14:21.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:14:21 smithi099 ceph-mon[31615]: pgmap v438: 97 pgs: 97 active+clean; 41 MiB data, 782 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 438 op/s 2024-01-31T05:14:21.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:14:21 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/2551977393' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:14:21.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:14:21 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/2553202546' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-31T05:14:21.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.849+0000 7facbbf7c640 1 -- 172.21.15.99:0/4094079167 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7facb410c620 con 0x7facb4100e00 2024-01-31T05:14:21.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.850+0000 7facaaffd640 1 -- 172.21.15.99:0/4094079167 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7faca40092b0 con 0x7facb4100e00 2024-01-31T05:14:21.849 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-01-31T05:14:21.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.851+0000 7facbbf7c640 1 -- 172.21.15.99:0/4094079167 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7faca00a12e0 msgr2=0x7faca00a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:21.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.851+0000 7facbbf7c640 1 --2- 172.21.15.99:0/4094079167 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7faca00a12e0 0x7faca00a37a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7facb0000c00 tx=0x7facb002c5d0 comp rx=0 tx=0).stop 2024-01-31T05:14:21.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.851+0000 7facbbf7c640 1 -- 172.21.15.99:0/4094079167 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7facb4100e00 msgr2=0x7facb4197290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:21.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.851+0000 7facbbf7c640 1 --2- 172.21.15.99:0/4094079167 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7facb4100e00 0x7facb4197290 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7faca400b4a0 tx=0x7faca400b960 comp rx=0 tx=0).stop 2024-01-31T05:14:21.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.852+0000 7facbbf7c640 1 -- 172.21.15.99:0/4094079167 shutdown_connections 2024-01-31T05:14:21.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.852+0000 7facbbf7c640 1 --2- 172.21.15.99:0/4094079167 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7faca00a12e0 0x7faca00a37a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:21.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.852+0000 7facbbf7c640 1 --2- 172.21.15.99:0/4094079167 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7facb41017c0 0x7facb419e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:21.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.852+0000 7facbbf7c640 1 --2- 172.21.15.99:0/4094079167 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7facb4100e00 0x7facb4197290 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:21.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.852+0000 7facbbf7c640 1 --2- 172.21.15.99:0/4094079167 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facb40ffc10 0x7facb4196d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:21.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.852+0000 7facbbf7c640 1 -- 172.21.15.99:0/4094079167 >> 172.21.15.99:0/4094079167 conn(0x7facb40fb1a0 msgr2=0x7facb41041f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:14:21.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.852+0000 7facbbf7c640 1 -- 172.21.15.99:0/4094079167 shutdown_connections 2024-01-31T05:14:21.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.852+0000 7facbbf7c640 1 -- 172.21.15.99:0/4094079167 wait complete. 2024-01-31T05:14:21.862 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-31T05:14:21.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.968+0000 7fb39631f640 1 -- 172.21.15.99:0/3223191723 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb390101790 msgr2=0x7fb390103b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:21.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.968+0000 7fb39631f640 1 --2- 172.21.15.99:0/3223191723 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb390101790 0x7fb390103b80 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fb380009900 tx=0x7fb38002bc30 comp rx=0 tx=0).stop 2024-01-31T05:14:21.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.968+0000 7fb39631f640 1 -- 172.21.15.99:0/3223191723 shutdown_connections 2024-01-31T05:14:21.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.968+0000 7fb39631f640 1 --2- 172.21.15.99:0/3223191723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3901069f0 0x7fb390108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:21.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.968+0000 7fb39631f640 1 --2- 172.21.15.99:0/3223191723 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3901040c0 0x7fb3901064b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:21.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.968+0000 7fb39631f640 1 --2- 172.21.15.99:0/3223191723 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb390101790 0x7fb390103b80 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:21.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.968+0000 7fb39631f640 1 -- 172.21.15.99:0/3223191723 >> 172.21.15.99:0/3223191723 conn(0x7fb3900fb1a0 msgr2=0x7fb3900fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:14:21.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.968+0000 7fb39631f640 1 -- 172.21.15.99:0/3223191723 shutdown_connections 2024-01-31T05:14:21.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.968+0000 7fb39631f640 1 -- 172.21.15.99:0/3223191723 wait complete. 2024-01-31T05:14:21.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.968+0000 7fb39631f640 1 Processor -- start 2024-01-31T05:14:21.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.968+0000 7fb39631f640 1 -- start start 2024-01-31T05:14:21.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.969+0000 7fb39631f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb390101790 0x7fb390196d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:21.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.969+0000 7fb39631f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3901040c0 0x7fb390197260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:21.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.969+0000 7fb39631f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3901069f0 0x7fb39019e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:21.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.969+0000 7fb39631f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39019e800 con 0x7fb390101790 2024-01-31T05:14:21.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.969+0000 7fb39631f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39019e970 con 0x7fb3901069f0 2024-01-31T05:14:21.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.969+0000 7fb39631f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39019eb30 con 0x7fb3901040c0 2024-01-31T05:14:21.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.969+0000 7fb38ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb390101790 0x7fb390196d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:21.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.969+0000 7fb38ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb390101790 0x7fb390196d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59472/0 (socket says 172.21.15.99:59472) 2024-01-31T05:14:21.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.969+0000 7fb38ffff640 1 -- 172.21.15.99:0/2675909747 learned_addr learned my addr 172.21.15.99:0/2675909747 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:14:21.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.969+0000 7fb38f7fe640 1 --2- 172.21.15.99:0/2675909747 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3901040c0 0x7fb390197260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:21.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.969+0000 7fb3948bc640 1 --2- 172.21.15.99:0/2675909747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3901069f0 0x7fb39019e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:21.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.969+0000 7fb38ffff640 1 -- 172.21.15.99:0/2675909747 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3901040c0 msgr2=0x7fb390197260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:21.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.969+0000 7fb38ffff640 1 --2- 172.21.15.99:0/2675909747 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3901040c0 0x7fb390197260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:21.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.969+0000 7fb38ffff640 1 -- 172.21.15.99:0/2675909747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3901069f0 msgr2=0x7fb39019e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:21.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.969+0000 7fb38ffff640 1 --2- 172.21.15.99:0/2675909747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3901069f0 0x7fb39019e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:21.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.969+0000 7fb38ffff640 1 -- 172.21.15.99:0/2675909747 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb380009560 con 0x7fb390101790 2024-01-31T05:14:21.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.969+0000 7fb38ffff640 1 --2- 172.21.15.99:0/2675909747 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb390101790 0x7fb390196d20 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fb380009230 tx=0x7fb380004ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:14:21.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.969+0000 7fb38d7fa640 1 -- 172.21.15.99:0/2675909747 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3800043d0 con 0x7fb390101790 2024-01-31T05:14:21.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.969+0000 7fb38d7fa640 1 -- 172.21.15.99:0/2675909747 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb3800054c0 con 0x7fb390101790 2024-01-31T05:14:21.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.969+0000 7fb39631f640 1 -- 172.21.15.99:0/2675909747 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb39019edb0 con 0x7fb390101790 2024-01-31T05:14:21.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.969+0000 7fb38d7fa640 1 -- 172.21.15.99:0/2675909747 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38003e450 con 0x7fb390101790 2024-01-31T05:14:21.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.970+0000 7fb39631f640 1 -- 172.21.15.99:0/2675909747 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb39019f200 con 0x7fb390101790 2024-01-31T05:14:21.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.970+0000 7fb39631f640 1 -- 172.21.15.99:0/2675909747 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3900fcc90 con 0x7fb390101790 2024-01-31T05:14:21.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.971+0000 7fb38d7fa640 1 -- 172.21.15.99:0/2675909747 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 20) v1 ==== 135895+0+0 (secure 0 0 0) 0x7fb3800035f0 con 0x7fb390101790 2024-01-31T05:14:21.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.972+0000 7fb38d7fa640 1 --2- 172.21.15.99:0/2675909747 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb3780a12e0 0x7fb3780a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:21.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.972+0000 7fb38f7fe640 1 --2- 172.21.15.99:0/2675909747 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb3780a12e0 0x7fb3780a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:21.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.972+0000 7fb38d7fa640 1 -- 172.21.15.99:0/2675909747 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fb3800ef410 con 0x7fb390101790 2024-01-31T05:14:21.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.972+0000 7fb38f7fe640 1 --2- 172.21.15.99:0/2675909747 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb3780a12e0 0x7fb3780a37a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb3840058c0 tx=0x7fb38400a250 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:14:21.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:21.976+0000 7fb38d7fa640 1 -- 172.21.15.99:0/2675909747 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fb3800b88c0 con 0x7fb390101790 2024-01-31T05:14:22.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:14:21 smithi181 ceph-mon[36434]: pgmap v438: 97 pgs: 97 active+clean; 41 MiB data, 782 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 438 op/s 2024-01-31T05:14:22.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:14:21 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/2551977393' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:14:22.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:14:21 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/2553202546' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-31T05:14:22.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:14:21 smithi179 ceph-mon[35652]: pgmap v438: 97 pgs: 97 active+clean; 41 MiB data, 782 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 438 op/s 2024-01-31T05:14:22.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:14:21 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/2551977393' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:14:22.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:14:21 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/2553202546' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-31T05:14:22.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.150+0000 7fb39631f640 1 -- 172.21.15.99:0/2675909747 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb39010c800 con 0x7fb390101790 2024-01-31T05:14:22.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.150+0000 7fb38d7fa640 1 -- 172.21.15.99:0/2675909747 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb3800430a0 con 0x7fb390101790 2024-01-31T05:14:22.150 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 64 2024-01-31T05:14:22.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.152+0000 7fb39631f640 1 -- 172.21.15.99:0/2675909747 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb3780a12e0 msgr2=0x7fb3780a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:22.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.152+0000 7fb39631f640 1 --2- 172.21.15.99:0/2675909747 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb3780a12e0 0x7fb3780a37a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb3840058c0 tx=0x7fb38400a250 comp rx=0 tx=0).stop 2024-01-31T05:14:22.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.152+0000 7fb39631f640 1 -- 172.21.15.99:0/2675909747 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb390101790 msgr2=0x7fb390196d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:22.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.152+0000 7fb39631f640 1 --2- 172.21.15.99:0/2675909747 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb390101790 0x7fb390196d20 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fb380009230 tx=0x7fb380004ee0 comp rx=0 tx=0).stop 2024-01-31T05:14:22.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.152+0000 7fb39631f640 1 -- 172.21.15.99:0/2675909747 shutdown_connections 2024-01-31T05:14:22.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.152+0000 7fb39631f640 1 --2- 172.21.15.99:0/2675909747 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb3780a12e0 0x7fb3780a37a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:22.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.152+0000 7fb39631f640 1 --2- 172.21.15.99:0/2675909747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3901069f0 0x7fb39019e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:22.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.152+0000 7fb39631f640 1 --2- 172.21.15.99:0/2675909747 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3901040c0 0x7fb390197260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:22.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.152+0000 7fb39631f640 1 --2- 172.21.15.99:0/2675909747 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb390101790 0x7fb390196d20 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:22.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.152+0000 7fb39631f640 1 -- 172.21.15.99:0/2675909747 >> 172.21.15.99:0/2675909747 conn(0x7fb3900fb1a0 msgr2=0x7fb3901022b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:14:22.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.152+0000 7fb39631f640 1 -- 172.21.15.99:0/2675909747 shutdown_connections 2024-01-31T05:14:22.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.152+0000 7fb39631f640 1 -- 172.21.15.99:0/2675909747 wait complete. 2024-01-31T05:14:22.163 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-01-31T05:14:22.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.265+0000 7f4681f5f640 1 -- 172.21.15.99:0/3538384116 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f467c101f00 msgr2=0x7f467c102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:22.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.265+0000 7f4681f5f640 1 --2- 172.21.15.99:0/3538384116 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f467c101f00 0x7f467c102380 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f4670009900 tx=0x7f467002bc30 comp rx=0 tx=0).stop 2024-01-31T05:14:22.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.265+0000 7f4681f5f640 1 -- 172.21.15.99:0/3538384116 shutdown_connections 2024-01-31T05:14:22.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.265+0000 7f4681f5f640 1 --2- 172.21.15.99:0/3538384116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f467c1028c0 0x7f467c109150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:22.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.265+0000 7f4681f5f640 1 --2- 172.21.15.99:0/3538384116 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f467c101f00 0x7f467c102380 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:22.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.265+0000 7f4681f5f640 1 --2- 172.21.15.99:0/3538384116 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f467c100d10 0x7f467c101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:22.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.265+0000 7f4681f5f640 1 -- 172.21.15.99:0/3538384116 >> 172.21.15.99:0/3538384116 conn(0x7f467c0fc2a0 msgr2=0x7f467c0fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:14:22.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.265+0000 7f4681f5f640 1 -- 172.21.15.99:0/3538384116 shutdown_connections 2024-01-31T05:14:22.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.265+0000 7f4681f5f640 1 -- 172.21.15.99:0/3538384116 wait complete. 2024-01-31T05:14:22.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.266+0000 7f4681f5f640 1 Processor -- start 2024-01-31T05:14:22.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.266+0000 7f4681f5f640 1 -- start start 2024-01-31T05:14:22.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.266+0000 7f4681f5f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f467c100d10 0x7f467c196d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:22.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.266+0000 7f4681f5f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f467c101f00 0x7f467c197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:22.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.266+0000 7f4681f5f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f467c1028c0 0x7f467c19e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:22.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.266+0000 7f4681f5f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467c19e7e0 con 0x7f467c1028c0 2024-01-31T05:14:22.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.266+0000 7f4681f5f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467c19e950 con 0x7f467c100d10 2024-01-31T05:14:22.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.266+0000 7f4681f5f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467c19eb10 con 0x7f467c101f00 2024-01-31T05:14:22.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.266+0000 7f467bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f467c1028c0 0x7f467c19e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:22.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.266+0000 7f467bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f467c1028c0 0x7f467c19e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59486/0 (socket says 172.21.15.99:59486) 2024-01-31T05:14:22.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.266+0000 7f467bfff640 1 -- 172.21.15.99:0/2142214876 learned_addr learned my addr 172.21.15.99:0/2142214876 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:14:22.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.266+0000 7f467affd640 1 --2- 172.21.15.99:0/2142214876 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f467c101f00 0x7f467c197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:22.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.266+0000 7f467b7fe640 1 --2- 172.21.15.99:0/2142214876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f467c100d10 0x7f467c196d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:22.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.266+0000 7f467bfff640 1 -- 172.21.15.99:0/2142214876 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f467c101f00 msgr2=0x7f467c197240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:22.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.266+0000 7f467bfff640 1 --2- 172.21.15.99:0/2142214876 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f467c101f00 0x7f467c197240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:22.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.266+0000 7f467bfff640 1 -- 172.21.15.99:0/2142214876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f467c100d10 msgr2=0x7f467c196d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:22.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.266+0000 7f467bfff640 1 --2- 172.21.15.99:0/2142214876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f467c100d10 0x7f467c196d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:22.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.266+0000 7f467bfff640 1 -- 172.21.15.99:0/2142214876 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4670009560 con 0x7f467c1028c0 2024-01-31T05:14:22.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.267+0000 7f467bfff640 1 --2- 172.21.15.99:0/2142214876 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f467c1028c0 0x7f467c19e270 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f467400cad0 tx=0x7f467400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:14:22.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.267+0000 7f4678ff9640 1 -- 172.21.15.99:0/2142214876 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467400ae20 con 0x7f467c1028c0 2024-01-31T05:14:22.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.267+0000 7f4678ff9640 1 -- 172.21.15.99:0/2142214876 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4674005020 con 0x7f467c1028c0 2024-01-31T05:14:22.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.267+0000 7f4681f5f640 1 -- 172.21.15.99:0/2142214876 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f467c19edf0 con 0x7f467c1028c0 2024-01-31T05:14:22.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.267+0000 7f4678ff9640 1 -- 172.21.15.99:0/2142214876 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467400f6b0 con 0x7f467c1028c0 2024-01-31T05:14:22.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.267+0000 7f4681f5f640 1 -- 172.21.15.99:0/2142214876 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f467c19f1c0 con 0x7f467c1028c0 2024-01-31T05:14:22.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.268+0000 7f4681f5f640 1 -- 172.21.15.99:0/2142214876 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f467c1080a0 con 0x7f467c1028c0 2024-01-31T05:14:22.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.269+0000 7f4678ff9640 1 -- 172.21.15.99:0/2142214876 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 20) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f4674005190 con 0x7f467c1028c0 2024-01-31T05:14:22.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.269+0000 7f4678ff9640 1 --2- 172.21.15.99:0/2142214876 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f46640a12e0 0x7f46640a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:22.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.270+0000 7f467b7fe640 1 --2- 172.21.15.99:0/2142214876 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f46640a12e0 0x7f46640a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:22.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.270+0000 7f4678ff9640 1 -- 172.21.15.99:0/2142214876 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f46740cce90 con 0x7f467c1028c0 2024-01-31T05:14:22.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.270+0000 7f467b7fe640 1 --2- 172.21.15.99:0/2142214876 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f46640a12e0 0x7f46640a37a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f467c1981d0 tx=0x7f466c00a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:14:22.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.273+0000 7f4678ff9640 1 -- 172.21.15.99:0/2142214876 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f46740963f0 con 0x7f467c1028c0 2024-01-31T05:14:22.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.493+0000 7f4681f5f640 1 -- 172.21.15.99:0/2142214876 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7f467c10c810 con 0x7f467c1028c0 2024-01-31T05:14:22.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.501+0000 7f4678ff9640 1 -- 172.21.15.99:0/2142214876 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v20) v1 ==== 81+0+732464 (secure 0 0 0) 0x7f467401d020 con 0x7f467c1028c0 2024-01-31T05:14:22.510 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:14:22.510 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-01-31T05:14:22.511 INFO:teuthology.orchestra.run.smithi099.stdout: "epoch": 20, 2024-01-31T05:14:22.511 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.511 INFO:teuthology.orchestra.run.smithi099.stdout: "active_gid": 14152, 2024-01-31T05:14:22.511 INFO:teuthology.orchestra.run.smithi099.stdout: "active_name": "x", 2024-01-31T05:14:22.511 INFO:teuthology.orchestra.run.smithi099.stdout: "active_addrs": { 2024-01-31T05:14:22.511 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-01-31T05:14:22.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:22.511 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-01-31T05:14:22.511 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6800", 2024-01-31T05:14:22.511 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3925720924 2024-01-31T05:14:22.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:22.511 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-01-31T05:14:22.511 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6801", 2024-01-31T05:14:22.511 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3925720924 2024-01-31T05:14:22.512 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.512 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-01-31T05:14:22.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.512 INFO:teuthology.orchestra.run.smithi099.stdout: "active_addr": "172.21.15.99:6801/3925720924", 2024-01-31T05:14:22.512 INFO:teuthology.orchestra.run.smithi099.stdout: "active_change": "2024-01-31T05:02:20.510969+0000", 2024-01-31T05:14:22.512 INFO:teuthology.orchestra.run.smithi099.stdout: "active_mgr_features": 4540701272860131327, 2024-01-31T05:14:22.512 INFO:teuthology.orchestra.run.smithi099.stdout: "available": true, 2024-01-31T05:14:22.512 INFO:teuthology.orchestra.run.smithi099.stdout: "standbys": [ 2024-01-31T05:14:22.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:22.512 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 24106, 2024-01-31T05:14:22.512 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "z", 2024-01-31T05:14:22.512 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr_features": 4540701272860131327, 2024-01-31T05:14:22.512 INFO:teuthology.orchestra.run.smithi099.stdout: "available_modules": [ 2024-01-31T05:14:22.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:22.513 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "alerts", 2024-01-31T05:14:22.513 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:22.513 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:22.513 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:22.513 INFO:teuthology.orchestra.run.smithi099.stdout: "interval": { 2024-01-31T05:14:22.513 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "interval", 2024-01-31T05:14:22.513 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:22.513 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.513 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.513 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "60", 2024-01-31T05:14:22.513 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.513 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.513 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.514 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "How frequently to reexamine health status", 2024-01-31T05:14:22.514 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.514 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.514 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.514 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:22.514 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:22.514 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.514 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.514 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.514 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.514 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.514 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.514 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.514 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.515 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.515 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.515 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.515 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.515 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.515 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.515 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.515 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.515 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.515 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.515 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:22.515 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:22.515 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.515 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.516 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.516 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.516 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.516 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.516 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.516 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.516 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.516 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.516 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.516 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:22.516 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:22.516 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.517 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.517 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.517 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:22.517 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.517 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.517 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.517 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.517 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.517 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.517 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.517 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.517 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.517 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.517 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.518 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.518 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.518 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.518 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:22.518 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:22.518 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.518 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.518 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.518 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.518 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.518 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.518 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.518 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.518 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.519 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.519 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.519 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_destination": { 2024-01-31T05:14:22.519 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_destination", 2024-01-31T05:14:22.519 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.519 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.519 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.519 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.519 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.519 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.519 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.519 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Email address to send alerts to", 2024-01-31T05:14:22.519 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.520 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.520 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.520 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_from_name": { 2024-01-31T05:14:22.520 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_from_name", 2024-01-31T05:14:22.520 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.520 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.520 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.520 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "Ceph", 2024-01-31T05:14:22.520 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.520 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.520 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.520 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Email From: name", 2024-01-31T05:14:22.520 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.521 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.521 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.521 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_host": { 2024-01-31T05:14:22.521 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_host", 2024-01-31T05:14:22.521 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.521 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.521 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.521 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.521 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.521 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.521 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.521 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "SMTP server", 2024-01-31T05:14:22.521 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.521 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.522 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.522 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_password": { 2024-01-31T05:14:22.522 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_password", 2024-01-31T05:14:22.522 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.522 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.522 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.522 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.522 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.522 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.522 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.522 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Password to authenticate with", 2024-01-31T05:14:22.522 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.522 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.522 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.523 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_port": { 2024-01-31T05:14:22.523 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_port", 2024-01-31T05:14:22.523 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:22.523 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.523 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.523 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "465", 2024-01-31T05:14:22.523 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.523 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.523 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.523 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "SMTP port", 2024-01-31T05:14:22.523 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.523 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.523 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.524 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_sender": { 2024-01-31T05:14:22.524 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_sender", 2024-01-31T05:14:22.524 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.524 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.524 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.524 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.524 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.524 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.524 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.524 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "SMTP envelope sender", 2024-01-31T05:14:22.524 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.524 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.524 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.525 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_ssl": { 2024-01-31T05:14:22.525 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_ssl", 2024-01-31T05:14:22.525 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.525 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.525 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.525 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:22.525 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.525 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.525 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.525 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Use SSL to connect to SMTP server", 2024-01-31T05:14:22.525 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.525 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.526 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.526 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_user": { 2024-01-31T05:14:22.526 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_user", 2024-01-31T05:14:22.526 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.526 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.526 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.526 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.526 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.526 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.526 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.526 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "User to authenticate as", 2024-01-31T05:14:22.526 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.526 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.527 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.527 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.527 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:22.527 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "balancer", 2024-01-31T05:14:22.527 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:22.527 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:22.527 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:22.527 INFO:teuthology.orchestra.run.smithi099.stdout: "active": { 2024-01-31T05:14:22.527 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "active", 2024-01-31T05:14:22.527 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.527 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.527 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.527 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:22.528 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.528 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.528 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.528 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "automatically balance PGs across cluster", 2024-01-31T05:14:22.528 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.528 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.528 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.528 INFO:teuthology.orchestra.run.smithi099.stdout: "begin_time": { 2024-01-31T05:14:22.528 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "begin_time", 2024-01-31T05:14:22.528 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.528 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.528 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.529 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0000", 2024-01-31T05:14:22.529 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.529 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.529 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.529 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "beginning time of day to automatically balance", 2024-01-31T05:14:22.529 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-01-31T05:14:22.529 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.529 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.529 INFO:teuthology.orchestra.run.smithi099.stdout: "begin_weekday": { 2024-01-31T05:14:22.529 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "begin_weekday", 2024-01-31T05:14:22.529 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "uint", 2024-01-31T05:14:22.529 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.529 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.530 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0", 2024-01-31T05:14:22.530 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "0", 2024-01-31T05:14:22.530 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "6", 2024-01-31T05:14:22.530 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.530 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-01-31T05:14:22.530 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-01-31T05:14:22.530 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.530 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.530 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_compat_max_iterations": { 2024-01-31T05:14:22.530 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "crush_compat_max_iterations", 2024-01-31T05:14:22.530 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "uint", 2024-01-31T05:14:22.530 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.531 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.531 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "25", 2024-01-31T05:14:22.531 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "1", 2024-01-31T05:14:22.531 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "250", 2024-01-31T05:14:22.531 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.531 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-01-31T05:14:22.531 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.531 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.531 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.531 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_compat_metrics": { 2024-01-31T05:14:22.531 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "crush_compat_metrics", 2024-01-31T05:14:22.531 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.531 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.531 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.532 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "pgs,objects,bytes", 2024-01-31T05:14:22.532 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.532 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.532 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.532 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-01-31T05:14:22.532 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-01-31T05:14:22.532 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.532 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.532 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_compat_step": { 2024-01-31T05:14:22.532 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "crush_compat_step", 2024-01-31T05:14:22.532 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "float", 2024-01-31T05:14:22.532 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.532 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.533 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0.5", 2024-01-31T05:14:22.533 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "0.001", 2024-01-31T05:14:22.533 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "0.999", 2024-01-31T05:14:22.533 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.533 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "aggressiveness of optimization", 2024-01-31T05:14:22.533 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-01-31T05:14:22.533 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.533 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.533 INFO:teuthology.orchestra.run.smithi099.stdout: "end_time": { 2024-01-31T05:14:22.533 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "end_time", 2024-01-31T05:14:22.533 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.533 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.533 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.534 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "2359", 2024-01-31T05:14:22.534 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.534 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.534 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.534 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "ending time of day to automatically balance", 2024-01-31T05:14:22.534 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-01-31T05:14:22.534 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.534 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.534 INFO:teuthology.orchestra.run.smithi099.stdout: "end_weekday": { 2024-01-31T05:14:22.534 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "end_weekday", 2024-01-31T05:14:22.534 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "uint", 2024-01-31T05:14:22.534 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.534 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.535 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0", 2024-01-31T05:14:22.535 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "0", 2024-01-31T05:14:22.535 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "6", 2024-01-31T05:14:22.535 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.535 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-01-31T05:14:22.535 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-01-31T05:14:22.535 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.535 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.535 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:22.535 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:22.535 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.535 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.535 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.535 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.536 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.536 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.536 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.536 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.536 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.536 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.536 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.536 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.536 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.536 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.536 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.536 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.536 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.536 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.537 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:22.537 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:22.537 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.537 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.537 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.537 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.537 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.537 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.537 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.537 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.537 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.537 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.537 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.538 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:22.538 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:22.538 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.538 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.538 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.538 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:22.538 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.538 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.538 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.538 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.538 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.538 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.538 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.538 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.539 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.539 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.539 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.539 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.539 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.539 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.539 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:22.539 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:22.539 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.539 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.539 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.539 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.539 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.540 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.540 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.540 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.540 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.540 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.540 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.540 INFO:teuthology.orchestra.run.smithi099.stdout: "min_score": { 2024-01-31T05:14:22.540 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "min_score", 2024-01-31T05:14:22.540 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "float", 2024-01-31T05:14:22.540 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.540 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.540 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0", 2024-01-31T05:14:22.541 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.541 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.541 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.541 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-01-31T05:14:22.541 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.541 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.541 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.541 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": { 2024-01-31T05:14:22.541 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "mode", 2024-01-31T05:14:22.541 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.541 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.541 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.541 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "upmap", 2024-01-31T05:14:22.542 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.542 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.542 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.542 INFO:teuthology.orchestra.run.smithi099.stdout: "crush-compat", 2024-01-31T05:14:22.542 INFO:teuthology.orchestra.run.smithi099.stdout: "none", 2024-01-31T05:14:22.542 INFO:teuthology.orchestra.run.smithi099.stdout: "upmap" 2024-01-31T05:14:22.542 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.542 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Balancer mode", 2024-01-31T05:14:22.542 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.542 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.542 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.542 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ids": { 2024-01-31T05:14:22.543 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "pool_ids", 2024-01-31T05:14:22.543 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.543 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.543 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.543 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.543 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.543 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.543 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.543 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-01-31T05:14:22.543 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.543 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.543 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.543 INFO:teuthology.orchestra.run.smithi099.stdout: "sleep_interval": { 2024-01-31T05:14:22.544 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "sleep_interval", 2024-01-31T05:14:22.544 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:22.544 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.544 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.544 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "60", 2024-01-31T05:14:22.544 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.544 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.544 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.544 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-01-31T05:14:22.544 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.544 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.544 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.544 INFO:teuthology.orchestra.run.smithi099.stdout: "upmap_max_deviation": { 2024-01-31T05:14:22.545 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "upmap_max_deviation", 2024-01-31T05:14:22.545 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:22.545 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.545 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.545 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "5", 2024-01-31T05:14:22.545 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "1", 2024-01-31T05:14:22.545 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.545 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.545 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "deviation below which no optimization is attempted", 2024-01-31T05:14:22.545 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-01-31T05:14:22.545 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.545 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.545 INFO:teuthology.orchestra.run.smithi099.stdout: "upmap_max_optimizations": { 2024-01-31T05:14:22.545 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "upmap_max_optimizations", 2024-01-31T05:14:22.546 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "uint", 2024-01-31T05:14:22.546 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.546 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.546 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10", 2024-01-31T05:14:22.546 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.546 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.546 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.546 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-01-31T05:14:22.546 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.546 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.546 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.546 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.546 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:22.547 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "cephadm", 2024-01-31T05:14:22.547 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:22.547 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:22.547 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:22.547 INFO:teuthology.orchestra.run.smithi099.stdout: "agent_down_multiplier": { 2024-01-31T05:14:22.547 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "agent_down_multiplier", 2024-01-31T05:14:22.547 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "float", 2024-01-31T05:14:22.547 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.547 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.547 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "3.0", 2024-01-31T05:14:22.547 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.547 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.547 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.548 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-01-31T05:14:22.548 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.548 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.548 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.548 INFO:teuthology.orchestra.run.smithi099.stdout: "agent_refresh_rate": { 2024-01-31T05:14:22.548 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "agent_refresh_rate", 2024-01-31T05:14:22.548 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:22.548 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.548 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.548 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "20", 2024-01-31T05:14:22.548 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.548 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.548 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.549 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-01-31T05:14:22.549 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.549 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.549 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.549 INFO:teuthology.orchestra.run.smithi099.stdout: "agent_starting_port": { 2024-01-31T05:14:22.549 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "agent_starting_port", 2024-01-31T05:14:22.549 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:22.549 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.549 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.549 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "4721", 2024-01-31T05:14:22.549 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.549 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.549 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.550 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-01-31T05:14:22.550 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.550 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.550 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.550 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_ptrace": { 2024-01-31T05:14:22.550 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "allow_ptrace", 2024-01-31T05:14:22.550 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.550 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.550 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.550 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.550 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.550 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.551 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.551 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-01-31T05:14:22.551 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-01-31T05:14:22.551 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.551 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.551 INFO:teuthology.orchestra.run.smithi099.stdout: "autotune_interval": { 2024-01-31T05:14:22.551 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "autotune_interval", 2024-01-31T05:14:22.551 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:22.551 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.551 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.551 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "600", 2024-01-31T05:14:22.551 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.552 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.552 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.552 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how frequently to autotune daemon memory", 2024-01-31T05:14:22.552 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.552 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.552 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.552 INFO:teuthology.orchestra.run.smithi099.stdout: "autotune_memory_target_ratio": { 2024-01-31T05:14:22.552 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "autotune_memory_target_ratio", 2024-01-31T05:14:22.552 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "float", 2024-01-31T05:14:22.552 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.552 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.552 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0.7", 2024-01-31T05:14:22.552 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.553 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.553 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.553 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-01-31T05:14:22.553 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.553 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.553 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.553 INFO:teuthology.orchestra.run.smithi099.stdout: "cephadm_log_destination": { 2024-01-31T05:14:22.553 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "cephadm_log_destination", 2024-01-31T05:14:22.553 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.553 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.553 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.553 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.554 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.554 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.554 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.554 INFO:teuthology.orchestra.run.smithi099.stdout: "file", 2024-01-31T05:14:22.554 INFO:teuthology.orchestra.run.smithi099.stdout: "file,syslog", 2024-01-31T05:14:22.554 INFO:teuthology.orchestra.run.smithi099.stdout: "syslog" 2024-01-31T05:14:22.554 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.554 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-01-31T05:14:22.554 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.554 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.554 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.554 INFO:teuthology.orchestra.run.smithi099.stdout: "cgroups_split": { 2024-01-31T05:14:22.554 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "cgroups_split", 2024-01-31T05:14:22.555 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.555 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.555 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.555 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:22.555 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.555 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.555 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.555 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-01-31T05:14:22.555 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.555 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.555 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.555 INFO:teuthology.orchestra.run.smithi099.stdout: "config_checks_enabled": { 2024-01-31T05:14:22.555 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "config_checks_enabled", 2024-01-31T05:14:22.556 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.556 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.556 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.556 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.556 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.556 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.556 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.556 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-01-31T05:14:22.556 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.556 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.556 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.556 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.556 INFO:teuthology.orchestra.run.smithi099.stdout: "config_dashboard": { 2024-01-31T05:14:22.556 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "config_dashboard", 2024-01-31T05:14:22.557 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.557 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.557 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.557 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:22.557 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.557 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.557 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.557 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-01-31T05:14:22.557 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.557 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.557 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.557 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_alertmanager": { 2024-01-31T05:14:22.557 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_alertmanager", 2024-01-31T05:14:22.558 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.558 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.558 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.558 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-01-31T05:14:22.558 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.558 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.558 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.558 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Prometheus container image", 2024-01-31T05:14:22.558 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.558 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.558 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.558 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.558 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_base": { 2024-01-31T05:14:22.558 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_base", 2024-01-31T05:14:22.559 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.559 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.559 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.559 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/ceph/ceph", 2024-01-31T05:14:22.559 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.559 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.559 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.559 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Container image name, without the tag", 2024-01-31T05:14:22.559 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.559 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.559 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.559 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_elasticsearch": { 2024-01-31T05:14:22.560 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_elasticsearch", 2024-01-31T05:14:22.560 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.560 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.560 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.560 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-01-31T05:14:22.560 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.560 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.560 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.560 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "elasticsearch container image", 2024-01-31T05:14:22.560 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.560 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.560 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.560 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_grafana": { 2024-01-31T05:14:22.561 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_grafana", 2024-01-31T05:14:22.561 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.561 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.561 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.561 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.12", 2024-01-31T05:14:22.561 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.561 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.561 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.561 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Prometheus container image", 2024-01-31T05:14:22.561 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.561 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.561 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.561 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_haproxy": { 2024-01-31T05:14:22.562 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_haproxy", 2024-01-31T05:14:22.562 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.562 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.562 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.562 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-01-31T05:14:22.562 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.562 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.562 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.562 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "HAproxy container image", 2024-01-31T05:14:22.562 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.562 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.562 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.562 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_jaeger_agent": { 2024-01-31T05:14:22.563 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_jaeger_agent", 2024-01-31T05:14:22.563 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.563 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.563 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.563 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-01-31T05:14:22.563 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.563 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.563 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.563 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Jaeger agent container image", 2024-01-31T05:14:22.563 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.563 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.563 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.564 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_jaeger_collector": { 2024-01-31T05:14:22.564 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_jaeger_collector", 2024-01-31T05:14:22.564 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.564 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.564 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.564 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-01-31T05:14:22.564 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.564 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.564 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.564 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Jaeger collector container image", 2024-01-31T05:14:22.564 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.564 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.564 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.565 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_jaeger_query": { 2024-01-31T05:14:22.565 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_jaeger_query", 2024-01-31T05:14:22.565 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.565 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.565 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.565 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-01-31T05:14:22.565 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.565 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.565 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.565 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Jaeger query container image", 2024-01-31T05:14:22.565 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.565 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.565 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.566 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_keepalived": { 2024-01-31T05:14:22.566 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_keepalived", 2024-01-31T05:14:22.566 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.566 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.566 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.566 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-01-31T05:14:22.566 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.566 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.566 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.566 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Keepalived container image", 2024-01-31T05:14:22.566 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.566 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.566 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.566 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_loki": { 2024-01-31T05:14:22.567 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_loki", 2024-01-31T05:14:22.567 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.567 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.567 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.567 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-01-31T05:14:22.567 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.567 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.567 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.567 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Loki container image", 2024-01-31T05:14:22.567 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.567 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.567 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.567 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_node_exporter": { 2024-01-31T05:14:22.568 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_node_exporter", 2024-01-31T05:14:22.568 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.568 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.568 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.568 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-01-31T05:14:22.568 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.568 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.568 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.568 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Prometheus container image", 2024-01-31T05:14:22.568 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.568 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.568 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.568 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_nvmeof": { 2024-01-31T05:14:22.569 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_nvmeof", 2024-01-31T05:14:22.569 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.569 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.569 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.569 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/ceph/nvmeof:latest", 2024-01-31T05:14:22.569 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.569 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.569 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.569 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Nvme-of container image", 2024-01-31T05:14:22.569 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.569 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.569 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.569 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_prometheus": { 2024-01-31T05:14:22.569 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_prometheus", 2024-01-31T05:14:22.570 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.570 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.570 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.570 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-01-31T05:14:22.570 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.570 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.570 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.570 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Prometheus container image", 2024-01-31T05:14:22.570 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.570 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.570 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.570 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_promtail": { 2024-01-31T05:14:22.570 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_promtail", 2024-01-31T05:14:22.570 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.570 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.571 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.571 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-01-31T05:14:22.571 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.571 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.571 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.571 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Promtail container image", 2024-01-31T05:14:22.571 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.571 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.571 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.571 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_snmp_gateway": { 2024-01-31T05:14:22.571 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_snmp_gateway", 2024-01-31T05:14:22.571 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.571 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.571 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.571 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-01-31T05:14:22.571 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.572 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.572 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.572 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "SNMP Gateway container image", 2024-01-31T05:14:22.572 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.572 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.572 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.572 INFO:teuthology.orchestra.run.smithi099.stdout: "container_init": { 2024-01-31T05:14:22.572 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_init", 2024-01-31T05:14:22.572 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.572 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.572 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.572 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:22.573 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.573 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.573 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.573 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Run podman/docker with `--init`", 2024-01-31T05:14:22.573 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.573 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.573 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.573 INFO:teuthology.orchestra.run.smithi099.stdout: "daemon_cache_timeout": { 2024-01-31T05:14:22.573 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "daemon_cache_timeout", 2024-01-31T05:14:22.573 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:22.573 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.573 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.573 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "600", 2024-01-31T05:14:22.573 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.574 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.574 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.574 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-01-31T05:14:22.574 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.574 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.574 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.574 INFO:teuthology.orchestra.run.smithi099.stdout: "default_cephadm_command_timeout": { 2024-01-31T05:14:22.574 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "default_cephadm_command_timeout", 2024-01-31T05:14:22.574 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:22.574 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.574 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.575 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "900", 2024-01-31T05:14:22.575 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.575 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.575 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.575 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-01-31T05:14:22.575 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.575 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.575 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.575 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.575 INFO:teuthology.orchestra.run.smithi099.stdout: "default_registry": { 2024-01-31T05:14:22.575 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "default_registry", 2024-01-31T05:14:22.575 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.575 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.575 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.575 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "docker.io", 2024-01-31T05:14:22.576 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.576 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.576 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.576 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-01-31T05:14:22.576 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.576 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.576 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.576 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.576 INFO:teuthology.orchestra.run.smithi099.stdout: "device_cache_timeout": { 2024-01-31T05:14:22.576 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "device_cache_timeout", 2024-01-31T05:14:22.576 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:22.576 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.576 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.576 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "1800", 2024-01-31T05:14:22.577 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.577 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.577 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.577 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "seconds to cache device inventory", 2024-01-31T05:14:22.577 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.577 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.577 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.577 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.577 INFO:teuthology.orchestra.run.smithi099.stdout: "device_enhanced_scan": { 2024-01-31T05:14:22.577 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "device_enhanced_scan", 2024-01-31T05:14:22.577 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.577 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.577 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.577 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.577 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.578 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.578 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.578 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Use libstoragemgmt during device scans", 2024-01-31T05:14:22.578 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.578 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.578 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.578 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.578 INFO:teuthology.orchestra.run.smithi099.stdout: "facts_cache_timeout": { 2024-01-31T05:14:22.578 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "facts_cache_timeout", 2024-01-31T05:14:22.578 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:22.578 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.579 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.579 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "60", 2024-01-31T05:14:22.579 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.579 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.579 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.579 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "seconds to cache host facts data", 2024-01-31T05:14:22.579 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.579 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.579 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.579 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.579 INFO:teuthology.orchestra.run.smithi099.stdout: "host_check_interval": { 2024-01-31T05:14:22.579 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "host_check_interval", 2024-01-31T05:14:22.579 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:22.580 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.580 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.580 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "600", 2024-01-31T05:14:22.580 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.580 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.580 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.580 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how frequently to perform a host check", 2024-01-31T05:14:22.580 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.580 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.580 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.580 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.580 INFO:teuthology.orchestra.run.smithi099.stdout: "inventory_list_all": { 2024-01-31T05:14:22.580 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "inventory_list_all", 2024-01-31T05:14:22.580 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.581 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.581 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.581 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.581 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.581 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.581 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.581 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-01-31T05:14:22.581 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.581 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.581 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.581 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.581 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:22.581 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:22.581 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.582 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.582 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.582 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.582 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.582 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.582 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.582 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.582 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.582 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.582 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.582 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.582 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.582 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.583 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.583 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.583 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.583 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.583 INFO:teuthology.orchestra.run.smithi099.stdout: "log_refresh_metadata": { 2024-01-31T05:14:22.583 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_refresh_metadata", 2024-01-31T05:14:22.583 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.583 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.583 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.583 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.583 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.583 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.583 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.583 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-01-31T05:14:22.584 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.584 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.584 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.584 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.584 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:22.584 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:22.584 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.584 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.584 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.584 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:22.584 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.584 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.584 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.584 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-01-31T05:14:22.585 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.585 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.585 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.585 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.585 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:22.585 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:22.585 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.585 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.585 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.585 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:22.585 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.585 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.585 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.586 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.586 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.586 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.586 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.586 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.586 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.586 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.586 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.586 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.586 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.586 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.586 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.586 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:22.586 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:22.587 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.587 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.587 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.587 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.587 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.587 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.587 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.587 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.587 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.587 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.587 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.587 INFO:teuthology.orchestra.run.smithi099.stdout: "manage_etc_ceph_ceph_conf": { 2024-01-31T05:14:22.588 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-01-31T05:14:22.588 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.588 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.588 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.588 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.588 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.588 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.588 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.588 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-01-31T05:14:22.588 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.588 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.588 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.588 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.589 INFO:teuthology.orchestra.run.smithi099.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-01-31T05:14:22.589 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-01-31T05:14:22.589 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.589 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.589 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.589 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "*", 2024-01-31T05:14:22.589 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.589 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.589 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.589 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-01-31T05:14:22.589 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.589 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.589 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.590 INFO:teuthology.orchestra.run.smithi099.stdout: "max_count_per_host": { 2024-01-31T05:14:22.590 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "max_count_per_host", 2024-01-31T05:14:22.590 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:22.590 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.590 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.590 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10", 2024-01-31T05:14:22.590 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.590 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.590 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.590 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "max number of daemons per service per host", 2024-01-31T05:14:22.590 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.590 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.590 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.591 INFO:teuthology.orchestra.run.smithi099.stdout: "max_osd_draining_count": { 2024-01-31T05:14:22.591 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "max_osd_draining_count", 2024-01-31T05:14:22.591 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:22.591 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.591 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.591 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10", 2024-01-31T05:14:22.591 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.591 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.591 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.591 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-01-31T05:14:22.591 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.591 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.591 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.592 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.592 INFO:teuthology.orchestra.run.smithi099.stdout: "migration_current": { 2024-01-31T05:14:22.592 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "migration_current", 2024-01-31T05:14:22.592 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:22.592 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.592 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.592 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.592 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.592 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.592 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.592 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "internal - do not modify", 2024-01-31T05:14:22.592 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.592 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.593 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.593 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.593 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": { 2024-01-31T05:14:22.593 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "mode", 2024-01-31T05:14:22.593 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.593 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.593 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.593 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "root", 2024-01-31T05:14:22.593 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.593 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.593 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.593 INFO:teuthology.orchestra.run.smithi099.stdout: "cephadm-package", 2024-01-31T05:14:22.593 INFO:teuthology.orchestra.run.smithi099.stdout: "root" 2024-01-31T05:14:22.593 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.593 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "mode for remote execution of cephadm", 2024-01-31T05:14:22.593 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.593 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.594 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.594 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.594 INFO:teuthology.orchestra.run.smithi099.stdout: "prometheus_alerts_path": { 2024-01-31T05:14:22.594 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "prometheus_alerts_path", 2024-01-31T05:14:22.594 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.594 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.594 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.594 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-01-31T05:14:22.594 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.594 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.594 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.594 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-01-31T05:14:22.594 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.595 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.595 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.595 INFO:teuthology.orchestra.run.smithi099.stdout: "registry_insecure": { 2024-01-31T05:14:22.595 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "registry_insecure", 2024-01-31T05:14:22.595 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.595 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.595 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.595 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.595 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.595 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.595 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.595 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-01-31T05:14:22.595 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.596 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.596 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.596 INFO:teuthology.orchestra.run.smithi099.stdout: "registry_password": { 2024-01-31T05:14:22.596 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "registry_password", 2024-01-31T05:14:22.596 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.596 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.596 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.596 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.596 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.596 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.596 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.596 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-01-31T05:14:22.597 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.597 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.597 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.597 INFO:teuthology.orchestra.run.smithi099.stdout: "registry_url": { 2024-01-31T05:14:22.597 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "registry_url", 2024-01-31T05:14:22.597 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.597 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.597 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.597 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.597 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.597 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.597 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.597 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-01-31T05:14:22.597 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.598 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.598 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.598 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.598 INFO:teuthology.orchestra.run.smithi099.stdout: "registry_username": { 2024-01-31T05:14:22.598 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "registry_username", 2024-01-31T05:14:22.598 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.598 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.598 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.598 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.598 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.598 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.598 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.598 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-01-31T05:14:22.598 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.599 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.599 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.599 INFO:teuthology.orchestra.run.smithi099.stdout: "secure_monitoring_stack": { 2024-01-31T05:14:22.599 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "secure_monitoring_stack", 2024-01-31T05:14:22.599 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.599 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.599 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.599 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.599 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.599 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.599 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.599 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-01-31T05:14:22.600 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.600 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.600 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.600 INFO:teuthology.orchestra.run.smithi099.stdout: "service_discovery_port": { 2024-01-31T05:14:22.600 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "service_discovery_port", 2024-01-31T05:14:22.600 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:22.600 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.600 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.600 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "8765", 2024-01-31T05:14:22.600 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.600 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.600 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.600 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "cephadm service discovery port", 2024-01-31T05:14:22.600 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.601 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.601 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.601 INFO:teuthology.orchestra.run.smithi099.stdout: "ssh_config_file": { 2024-01-31T05:14:22.601 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ssh_config_file", 2024-01-31T05:14:22.601 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.601 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.601 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.601 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.601 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.601 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.601 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.601 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-01-31T05:14:22.601 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.602 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.602 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.602 INFO:teuthology.orchestra.run.smithi099.stdout: "use_agent": { 2024-01-31T05:14:22.602 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "use_agent", 2024-01-31T05:14:22.602 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.602 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.602 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.602 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.602 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.602 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.602 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.602 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-01-31T05:14:22.602 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.602 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.603 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.603 INFO:teuthology.orchestra.run.smithi099.stdout: "use_repo_digest": { 2024-01-31T05:14:22.603 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "use_repo_digest", 2024-01-31T05:14:22.603 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.603 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.603 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.603 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:22.603 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.603 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.603 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.603 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-01-31T05:14:22.603 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.603 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.604 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.604 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.604 INFO:teuthology.orchestra.run.smithi099.stdout: "warn_on_failed_host_check": { 2024-01-31T05:14:22.604 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "warn_on_failed_host_check", 2024-01-31T05:14:22.604 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.604 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.604 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.604 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:22.604 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.604 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.604 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.604 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "raise a health warning if the host check fails", 2024-01-31T05:14:22.604 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.605 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.605 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.605 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.605 INFO:teuthology.orchestra.run.smithi099.stdout: "warn_on_stray_daemons": { 2024-01-31T05:14:22.605 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "warn_on_stray_daemons", 2024-01-31T05:14:22.605 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.605 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.605 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.605 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:22.605 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.605 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.605 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.605 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-01-31T05:14:22.605 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.605 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.605 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.606 INFO:teuthology.orchestra.run.smithi099.stdout: "warn_on_stray_hosts": { 2024-01-31T05:14:22.606 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "warn_on_stray_hosts", 2024-01-31T05:14:22.606 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.606 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.606 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.606 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:22.606 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.606 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.606 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.606 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-01-31T05:14:22.606 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.606 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.606 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.607 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.607 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:22.607 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "crash", 2024-01-31T05:14:22.607 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:22.607 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:22.607 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:22.607 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:22.607 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:22.607 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.607 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.607 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.607 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.607 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.608 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.608 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.608 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.608 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.608 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.608 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.608 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.608 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.608 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.608 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.608 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.608 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.608 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.609 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:22.609 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:22.609 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.609 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.609 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.609 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.609 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.609 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.609 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.609 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.609 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.609 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.609 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.610 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:22.610 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:22.610 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.610 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.610 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.610 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:22.610 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.610 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.610 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.610 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.610 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.610 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.610 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.610 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.610 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.611 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.611 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.611 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.611 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.611 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.611 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.611 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:22.611 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:22.611 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.611 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.611 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.611 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.611 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.611 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.612 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.612 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.612 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.612 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.612 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.612 INFO:teuthology.orchestra.run.smithi099.stdout: "retain_interval": { 2024-01-31T05:14:22.612 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "retain_interval", 2024-01-31T05:14:22.612 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:22.612 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.612 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.612 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "31536000", 2024-01-31T05:14:22.612 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.613 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.613 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.613 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how long to retain crashes before pruning them", 2024-01-31T05:14:22.613 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.613 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.613 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.613 INFO:teuthology.orchestra.run.smithi099.stdout: "warn_recent_interval": { 2024-01-31T05:14:22.613 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "warn_recent_interval", 2024-01-31T05:14:22.613 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:22.613 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.613 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.613 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "1209600", 2024-01-31T05:14:22.613 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.613 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.614 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.614 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "time interval in which to warn about recent crashes", 2024-01-31T05:14:22.614 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.614 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.614 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.614 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.614 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:22.614 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "dashboard", 2024-01-31T05:14:22.614 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:22.614 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:22.614 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:22.614 INFO:teuthology.orchestra.run.smithi099.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-01-31T05:14:22.615 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-01-31T05:14:22.615 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:22.615 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.615 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.615 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10", 2024-01-31T05:14:22.615 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.615 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.615 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.615 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.615 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.615 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.615 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.615 INFO:teuthology.orchestra.run.smithi099.stdout: "ALERTMANAGER_API_HOST": { 2024-01-31T05:14:22.615 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ALERTMANAGER_API_HOST", 2024-01-31T05:14:22.616 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.616 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.616 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.616 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.616 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.616 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.616 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.616 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.616 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.616 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.616 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.616 INFO:teuthology.orchestra.run.smithi099.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-01-31T05:14:22.617 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-01-31T05:14:22.617 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.617 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.617 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.617 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:22.617 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.617 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.617 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.617 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.617 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.617 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.617 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.617 INFO:teuthology.orchestra.run.smithi099.stdout: "AUDIT_API_ENABLED": { 2024-01-31T05:14:22.617 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "AUDIT_API_ENABLED", 2024-01-31T05:14:22.618 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.618 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.618 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.618 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.618 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.618 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.618 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.618 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.618 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.618 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.618 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.618 INFO:teuthology.orchestra.run.smithi099.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-01-31T05:14:22.618 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-01-31T05:14:22.619 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.619 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.619 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.619 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:22.619 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.619 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.619 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.619 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.619 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.619 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.619 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.619 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.619 INFO:teuthology.orchestra.run.smithi099.stdout: "ENABLE_BROWSABLE_API": { 2024-01-31T05:14:22.619 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ENABLE_BROWSABLE_API", 2024-01-31T05:14:22.619 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.620 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.620 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.620 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:22.620 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.620 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.620 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.620 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.620 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.620 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.620 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.620 INFO:teuthology.orchestra.run.smithi099.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-01-31T05:14:22.620 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-01-31T05:14:22.621 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.621 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.621 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.621 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:22.621 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.621 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.621 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.621 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.621 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.621 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.621 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.621 INFO:teuthology.orchestra.run.smithi099.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-01-31T05:14:22.621 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-01-31T05:14:22.622 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.622 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.622 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.622 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:22.622 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.622 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.622 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.622 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.622 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.622 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.622 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.622 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.622 INFO:teuthology.orchestra.run.smithi099.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-01-31T05:14:22.622 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-01-31T05:14:22.622 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.623 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.623 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.623 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:22.623 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.623 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.623 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.623 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.623 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.623 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.623 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.623 INFO:teuthology.orchestra.run.smithi099.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-01-31T05:14:22.623 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-01-31T05:14:22.623 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.623 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.624 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.624 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:22.624 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.624 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.624 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.624 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.624 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.624 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.624 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.624 INFO:teuthology.orchestra.run.smithi099.stdout: "FEATURE_TOGGLE_NFS": { 2024-01-31T05:14:22.624 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-01-31T05:14:22.624 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.624 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.625 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.625 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:22.625 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.625 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.625 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.625 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.625 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.625 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.625 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.625 INFO:teuthology.orchestra.run.smithi099.stdout: "FEATURE_TOGGLE_RBD": { 2024-01-31T05:14:22.625 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-01-31T05:14:22.625 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.626 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.626 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.626 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:22.626 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.626 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.626 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.626 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.626 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.626 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.626 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.626 INFO:teuthology.orchestra.run.smithi099.stdout: "FEATURE_TOGGLE_RGW": { 2024-01-31T05:14:22.626 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-01-31T05:14:22.626 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.626 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.627 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.627 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:22.627 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.627 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.627 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.627 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.627 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.627 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.627 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.627 INFO:teuthology.orchestra.run.smithi099.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-01-31T05:14:22.627 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-01-31T05:14:22.627 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.627 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.628 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.628 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.628 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.628 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.628 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.628 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.628 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.628 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.628 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.628 INFO:teuthology.orchestra.run.smithi099.stdout: "GRAFANA_API_PASSWORD": { 2024-01-31T05:14:22.628 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "GRAFANA_API_PASSWORD", 2024-01-31T05:14:22.628 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.628 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.629 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.629 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "admin", 2024-01-31T05:14:22.629 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.629 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.629 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.629 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.629 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.629 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.629 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.629 INFO:teuthology.orchestra.run.smithi099.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-01-31T05:14:22.629 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-01-31T05:14:22.629 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.629 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.629 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.630 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:22.630 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.630 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.630 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.630 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.630 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.630 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.630 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.630 INFO:teuthology.orchestra.run.smithi099.stdout: "GRAFANA_API_URL": { 2024-01-31T05:14:22.630 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "GRAFANA_API_URL", 2024-01-31T05:14:22.630 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.630 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.630 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.631 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.631 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.631 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.631 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.631 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.631 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.631 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.631 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.631 INFO:teuthology.orchestra.run.smithi099.stdout: "GRAFANA_API_USERNAME": { 2024-01-31T05:14:22.631 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "GRAFANA_API_USERNAME", 2024-01-31T05:14:22.631 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.631 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.631 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.631 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "admin", 2024-01-31T05:14:22.632 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.632 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.632 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.632 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.632 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.632 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.632 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.632 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.632 INFO:teuthology.orchestra.run.smithi099.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-01-31T05:14:22.632 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-01-31T05:14:22.632 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.632 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.632 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.632 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.633 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.633 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.633 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.633 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.633 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.633 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.633 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.633 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.633 INFO:teuthology.orchestra.run.smithi099.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-01-31T05:14:22.633 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-01-31T05:14:22.633 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.633 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.633 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.633 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.633 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.634 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.634 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.634 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.634 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.634 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.634 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.634 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.634 INFO:teuthology.orchestra.run.smithi099.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-01-31T05:14:22.634 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-01-31T05:14:22.634 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.634 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.634 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.634 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:22.634 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.635 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.635 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.635 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.635 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.635 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.635 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.635 INFO:teuthology.orchestra.run.smithi099.stdout: "ISSUE_TRACKER_API_KEY": { 2024-01-31T05:14:22.635 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-01-31T05:14:22.635 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.635 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.635 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.635 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.635 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.635 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.636 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.636 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.636 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.636 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.636 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.636 INFO:teuthology.orchestra.run.smithi099.stdout: "PROMETHEUS_API_HOST": { 2024-01-31T05:14:22.636 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PROMETHEUS_API_HOST", 2024-01-31T05:14:22.636 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.636 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.636 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.636 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.636 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.636 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.637 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.637 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.637 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.637 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.637 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.637 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.637 INFO:teuthology.orchestra.run.smithi099.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-01-31T05:14:22.637 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-01-31T05:14:22.637 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.637 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.637 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.637 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:22.637 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.637 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.638 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.638 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.638 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.638 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.638 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.638 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.638 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-01-31T05:14:22.638 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-01-31T05:14:22.638 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.638 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.638 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.638 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.638 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.638 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.639 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.639 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.639 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.639 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.639 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.639 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-01-31T05:14:22.639 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-01-31T05:14:22.639 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.639 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.639 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.639 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.639 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.639 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.639 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.640 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.640 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.640 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.640 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.640 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-01-31T05:14:22.640 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-01-31T05:14:22.640 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.640 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.640 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.640 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:22.640 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.640 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.640 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.641 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.641 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.641 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.641 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.641 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-01-31T05:14:22.641 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-01-31T05:14:22.641 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.641 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.641 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.641 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:22.641 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.641 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.642 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.642 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.642 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.642 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.642 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.642 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-01-31T05:14:22.642 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-01-31T05:14:22.642 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.642 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.642 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.642 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.642 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.642 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.642 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.643 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.643 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.643 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.643 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.643 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.643 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-01-31T05:14:22.643 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-01-31T05:14:22.643 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.643 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.643 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.643 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.643 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.643 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.644 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.644 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.644 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.644 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.644 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.644 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.644 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-01-31T05:14:22.644 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-01-31T05:14:22.644 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.644 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.644 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.644 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.644 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.644 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.645 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.645 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.645 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.645 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.645 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.645 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_ENABLED": { 2024-01-31T05:14:22.645 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_ENABLED", 2024-01-31T05:14:22.645 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.645 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.645 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.645 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:22.645 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.646 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.646 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.646 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.646 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.646 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.646 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.646 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-01-31T05:14:22.646 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-01-31T05:14:22.646 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.646 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.646 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.646 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-01-31T05:14:22.646 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.647 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.647 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.647 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.647 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.647 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.647 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.647 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-01-31T05:14:22.647 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-01-31T05:14:22.647 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:22.647 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.647 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.647 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10", 2024-01-31T05:14:22.647 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.648 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.648 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.648 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.648 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.648 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.648 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.648 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-01-31T05:14:22.648 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-01-31T05:14:22.648 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:22.648 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.648 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.648 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "8", 2024-01-31T05:14:22.648 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.649 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.649 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.649 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.649 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.649 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.649 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.649 INFO:teuthology.orchestra.run.smithi099.stdout: "REST_REQUESTS_TIMEOUT": { 2024-01-31T05:14:22.649 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-01-31T05:14:22.649 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:22.649 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.649 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.649 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "45", 2024-01-31T05:14:22.649 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.650 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.650 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.650 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.650 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.650 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.650 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.650 INFO:teuthology.orchestra.run.smithi099.stdout: "RGW_API_ACCESS_KEY": { 2024-01-31T05:14:22.650 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "RGW_API_ACCESS_KEY", 2024-01-31T05:14:22.650 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.650 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.650 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.650 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.650 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.651 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.651 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.651 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.651 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.651 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.651 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.651 INFO:teuthology.orchestra.run.smithi099.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-01-31T05:14:22.651 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-01-31T05:14:22.651 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.651 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.651 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.651 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "admin", 2024-01-31T05:14:22.652 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.652 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.652 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.652 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.652 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.652 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.652 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.652 INFO:teuthology.orchestra.run.smithi099.stdout: "RGW_API_SECRET_KEY": { 2024-01-31T05:14:22.652 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "RGW_API_SECRET_KEY", 2024-01-31T05:14:22.652 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.652 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.652 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.652 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.653 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.653 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.653 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.653 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.653 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.653 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.653 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.653 INFO:teuthology.orchestra.run.smithi099.stdout: "RGW_API_SSL_VERIFY": { 2024-01-31T05:14:22.653 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "RGW_API_SSL_VERIFY", 2024-01-31T05:14:22.653 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.653 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.653 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.653 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:22.654 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.654 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.654 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.654 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.654 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.654 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.654 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.654 INFO:teuthology.orchestra.run.smithi099.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-01-31T05:14:22.654 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-01-31T05:14:22.654 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:22.654 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.654 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.654 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0", 2024-01-31T05:14:22.655 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.655 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.655 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.655 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.655 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.655 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.655 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.655 INFO:teuthology.orchestra.run.smithi099.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-01-31T05:14:22.655 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-01-31T05:14:22.655 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:22.655 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.655 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.655 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10", 2024-01-31T05:14:22.656 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.656 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.656 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.656 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.656 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.656 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.656 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.656 INFO:teuthology.orchestra.run.smithi099.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-01-31T05:14:22.656 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-01-31T05:14:22.656 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:22.656 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.656 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.656 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "5", 2024-01-31T05:14:22.657 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.657 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.657 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.657 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.657 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.657 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.657 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.657 INFO:teuthology.orchestra.run.smithi099.stdout: "cross_origin_url": { 2024-01-31T05:14:22.657 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "cross_origin_url", 2024-01-31T05:14:22.657 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.657 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.657 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.657 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.658 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.658 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.658 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.658 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.658 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.658 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.658 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.658 INFO:teuthology.orchestra.run.smithi099.stdout: "crt_file": { 2024-01-31T05:14:22.658 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "crt_file", 2024-01-31T05:14:22.658 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.658 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.658 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.658 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.658 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.659 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.659 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.659 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.659 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.659 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.659 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.659 INFO:teuthology.orchestra.run.smithi099.stdout: "debug": { 2024-01-31T05:14:22.659 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "debug", 2024-01-31T05:14:22.659 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.659 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.659 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.659 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.659 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.660 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.660 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.660 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Enable/disable debug options", 2024-01-31T05:14:22.660 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.660 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.660 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.660 INFO:teuthology.orchestra.run.smithi099.stdout: "jwt_token_ttl": { 2024-01-31T05:14:22.660 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "jwt_token_ttl", 2024-01-31T05:14:22.660 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:22.660 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.660 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.660 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "28800", 2024-01-31T05:14:22.660 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.661 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.661 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.661 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.661 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.661 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.661 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.661 INFO:teuthology.orchestra.run.smithi099.stdout: "key_file": { 2024-01-31T05:14:22.661 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "key_file", 2024-01-31T05:14:22.661 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.661 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.661 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.661 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.661 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.662 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.662 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.662 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.662 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.662 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.662 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.662 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:22.662 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:22.662 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.662 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.662 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.662 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.662 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.663 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.663 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.663 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.663 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.663 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.663 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.663 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.663 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.663 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.663 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.663 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.663 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.663 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.664 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:22.664 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:22.664 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.664 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.664 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.664 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.664 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.664 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.664 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.664 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.664 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.664 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.664 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.665 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:22.665 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:22.665 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.665 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.665 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.665 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:22.665 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.665 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.665 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.665 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.665 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.665 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.665 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.666 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.666 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.666 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.666 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.666 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.666 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.666 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.666 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:22.666 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:22.666 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.666 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.666 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.666 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.667 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.667 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.667 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.667 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.667 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.667 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.667 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.667 INFO:teuthology.orchestra.run.smithi099.stdout: "motd": { 2024-01-31T05:14:22.667 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "motd", 2024-01-31T05:14:22.667 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.667 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.667 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.667 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.667 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.668 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.668 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.668 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "The message of the day", 2024-01-31T05:14:22.668 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.668 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.668 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.668 INFO:teuthology.orchestra.run.smithi099.stdout: "redirect_resolve_ip_addr": { 2024-01-31T05:14:22.668 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "redirect_resolve_ip_addr", 2024-01-31T05:14:22.668 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.668 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.668 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.668 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.668 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.669 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.669 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.669 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.669 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.669 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.669 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.669 INFO:teuthology.orchestra.run.smithi099.stdout: "server_addr": { 2024-01-31T05:14:22.669 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "server_addr", 2024-01-31T05:14:22.669 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.669 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.669 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.669 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "::", 2024-01-31T05:14:22.669 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.670 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.670 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.670 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.670 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.670 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.670 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.670 INFO:teuthology.orchestra.run.smithi099.stdout: "server_port": { 2024-01-31T05:14:22.670 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "server_port", 2024-01-31T05:14:22.670 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:22.670 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.670 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.670 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "8080", 2024-01-31T05:14:22.670 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.671 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.671 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.671 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.671 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.671 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.671 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.671 INFO:teuthology.orchestra.run.smithi099.stdout: "ssl": { 2024-01-31T05:14:22.671 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ssl", 2024-01-31T05:14:22.671 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.671 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.671 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.671 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:22.671 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.671 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.672 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.672 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.672 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.672 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.672 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.672 INFO:teuthology.orchestra.run.smithi099.stdout: "ssl_server_port": { 2024-01-31T05:14:22.672 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ssl_server_port", 2024-01-31T05:14:22.672 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:22.672 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.672 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.672 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "8443", 2024-01-31T05:14:22.672 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.672 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.673 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.673 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.673 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.673 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.673 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.673 INFO:teuthology.orchestra.run.smithi099.stdout: "standby_behaviour": { 2024-01-31T05:14:22.673 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "standby_behaviour", 2024-01-31T05:14:22.673 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.673 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.673 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.673 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "redirect", 2024-01-31T05:14:22.673 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.674 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.674 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.674 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.674 INFO:teuthology.orchestra.run.smithi099.stdout: "redirect" 2024-01-31T05:14:22.674 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.674 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.674 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.674 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.674 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.674 INFO:teuthology.orchestra.run.smithi099.stdout: "standby_error_status_code": { 2024-01-31T05:14:22.674 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "standby_error_status_code", 2024-01-31T05:14:22.674 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:22.674 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.675 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.675 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "500", 2024-01-31T05:14:22.675 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "400", 2024-01-31T05:14:22.675 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "599", 2024-01-31T05:14:22.675 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.675 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.675 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.675 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.675 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.675 INFO:teuthology.orchestra.run.smithi099.stdout: "url_prefix": { 2024-01-31T05:14:22.675 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "url_prefix", 2024-01-31T05:14:22.675 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.675 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.675 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.676 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.676 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.676 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.676 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.676 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.676 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.676 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.676 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.676 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.676 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:22.676 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "devicehealth", 2024-01-31T05:14:22.677 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:22.677 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:22.677 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:22.677 INFO:teuthology.orchestra.run.smithi099.stdout: "enable_monitoring": { 2024-01-31T05:14:22.677 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "enable_monitoring", 2024-01-31T05:14:22.677 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.677 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.677 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.677 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:22.677 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.677 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.677 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.677 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "monitor device health metrics", 2024-01-31T05:14:22.677 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.678 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.678 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.678 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:22.678 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:22.678 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.678 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.678 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.678 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.678 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.678 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.678 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.678 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.678 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.679 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.679 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.679 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.679 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.679 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.679 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.679 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.679 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.679 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.679 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:22.680 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:22.680 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.680 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.680 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.680 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.680 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.680 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.680 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.680 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.680 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.680 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.680 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.680 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:22.681 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:22.681 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.681 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.681 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.681 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:22.681 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.681 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.681 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.681 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.681 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.681 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.681 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.681 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.681 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.682 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.682 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.682 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.682 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.682 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.682 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:22.682 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:22.682 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.682 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.682 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.682 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.682 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.682 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.682 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.683 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.683 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.683 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.683 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.683 INFO:teuthology.orchestra.run.smithi099.stdout: "mark_out_threshold": { 2024-01-31T05:14:22.683 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "mark_out_threshold", 2024-01-31T05:14:22.683 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:22.683 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.683 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.683 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "2419200", 2024-01-31T05:14:22.683 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.683 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.684 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.684 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-01-31T05:14:22.684 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.684 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.684 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.684 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": { 2024-01-31T05:14:22.684 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "pool_name", 2024-01-31T05:14:22.684 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.684 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.684 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.684 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "device_health_metrics", 2024-01-31T05:14:22.684 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.684 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.685 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.685 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "name of pool in which to store device health metrics", 2024-01-31T05:14:22.685 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.685 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.685 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.685 INFO:teuthology.orchestra.run.smithi099.stdout: "retention_period": { 2024-01-31T05:14:22.685 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "retention_period", 2024-01-31T05:14:22.685 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:22.685 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.685 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.685 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "15552000", 2024-01-31T05:14:22.685 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.685 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.686 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.686 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how long to retain device health metrics", 2024-01-31T05:14:22.686 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.686 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.686 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.686 INFO:teuthology.orchestra.run.smithi099.stdout: "scrape_frequency": { 2024-01-31T05:14:22.686 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "scrape_frequency", 2024-01-31T05:14:22.686 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:22.686 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.686 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.686 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "86400", 2024-01-31T05:14:22.686 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.686 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.686 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.687 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how frequently to scrape device health metrics", 2024-01-31T05:14:22.687 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.687 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.687 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.687 INFO:teuthology.orchestra.run.smithi099.stdout: "self_heal": { 2024-01-31T05:14:22.687 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "self_heal", 2024-01-31T05:14:22.687 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.687 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.687 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.687 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:22.687 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.687 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.687 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.687 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-01-31T05:14:22.688 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.688 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.688 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.688 INFO:teuthology.orchestra.run.smithi099.stdout: "sleep_interval": { 2024-01-31T05:14:22.688 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "sleep_interval", 2024-01-31T05:14:22.688 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:22.688 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.688 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.688 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "600", 2024-01-31T05:14:22.688 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.688 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.688 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.688 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how frequently to wake up and check device health", 2024-01-31T05:14:22.689 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.689 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.689 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.689 INFO:teuthology.orchestra.run.smithi099.stdout: "warn_threshold": { 2024-01-31T05:14:22.689 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "warn_threshold", 2024-01-31T05:14:22.689 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:22.689 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.689 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.689 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "7257600", 2024-01-31T05:14:22.689 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.689 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.689 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.689 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-01-31T05:14:22.690 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.690 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.690 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.690 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.690 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:22.690 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "diskprediction_local", 2024-01-31T05:14:22.690 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:22.690 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:22.690 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:22.690 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:22.690 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:22.690 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.690 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.691 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.691 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.691 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.691 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.691 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.691 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.691 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.691 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.691 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.691 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.691 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.691 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.691 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.691 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.692 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.692 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.692 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:22.692 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:22.692 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.692 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.692 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.692 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.692 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.692 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.692 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.692 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.692 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.693 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.693 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.693 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:22.693 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:22.693 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.693 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.693 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.693 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:22.693 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.693 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.693 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.693 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.693 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.693 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.694 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.694 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.694 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.694 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.694 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.694 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.694 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.694 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.694 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:22.694 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:22.694 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.694 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.694 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.694 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.695 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.695 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.695 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.695 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.695 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.695 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.695 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.695 INFO:teuthology.orchestra.run.smithi099.stdout: "predict_interval": { 2024-01-31T05:14:22.695 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "predict_interval", 2024-01-31T05:14:22.695 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.695 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.695 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.695 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "86400", 2024-01-31T05:14:22.696 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.696 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.696 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.696 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.696 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.696 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.696 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.696 INFO:teuthology.orchestra.run.smithi099.stdout: "predictor_model": { 2024-01-31T05:14:22.696 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "predictor_model", 2024-01-31T05:14:22.696 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.696 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.696 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.696 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "prophetstor", 2024-01-31T05:14:22.697 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.697 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.697 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.697 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.697 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.697 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.697 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.697 INFO:teuthology.orchestra.run.smithi099.stdout: "sleep_interval": { 2024-01-31T05:14:22.697 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "sleep_interval", 2024-01-31T05:14:22.697 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.697 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.697 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.697 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "600", 2024-01-31T05:14:22.698 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.698 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.698 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.698 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.698 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.698 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.698 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.698 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.698 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:22.698 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "influx", 2024-01-31T05:14:22.698 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": false, 2024-01-31T05:14:22.698 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "influxdb python module not found", 2024-01-31T05:14:22.698 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:22.699 INFO:teuthology.orchestra.run.smithi099.stdout: "batch_size": { 2024-01-31T05:14:22.699 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "batch_size", 2024-01-31T05:14:22.699 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:22.699 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.699 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.699 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "5000", 2024-01-31T05:14:22.699 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.699 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.699 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.699 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-01-31T05:14:22.699 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.699 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.699 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.700 INFO:teuthology.orchestra.run.smithi099.stdout: "database": { 2024-01-31T05:14:22.700 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "database", 2024-01-31T05:14:22.700 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.700 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.700 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.700 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "ceph", 2024-01-31T05:14:22.700 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.700 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.700 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.700 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-01-31T05:14:22.700 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.700 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.700 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.701 INFO:teuthology.orchestra.run.smithi099.stdout: "hostname": { 2024-01-31T05:14:22.701 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "hostname", 2024-01-31T05:14:22.701 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.701 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.701 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.701 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.701 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.701 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.701 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.701 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "InfluxDB server hostname", 2024-01-31T05:14:22.701 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.701 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.701 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.701 INFO:teuthology.orchestra.run.smithi099.stdout: "interval": { 2024-01-31T05:14:22.702 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "interval", 2024-01-31T05:14:22.702 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:22.702 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.702 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.702 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "30", 2024-01-31T05:14:22.702 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "5", 2024-01-31T05:14:22.702 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.702 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.702 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-01-31T05:14:22.702 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.702 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.702 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.702 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:22.703 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:22.703 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.703 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.703 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.703 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.703 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.703 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.703 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.703 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.703 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.703 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.703 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.703 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.703 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.703 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.703 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.704 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.704 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.704 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.704 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:22.704 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:22.704 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.704 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.704 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.704 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.704 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.704 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.705 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.705 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.705 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.705 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.705 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.705 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:22.705 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:22.705 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.705 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.705 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.705 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:22.705 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.705 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.706 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.706 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.706 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.706 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.706 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.706 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.706 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.706 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.706 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.706 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.706 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.706 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.706 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:22.706 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:22.707 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.707 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.707 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.707 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.707 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.707 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.707 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.707 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.707 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.707 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.707 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.707 INFO:teuthology.orchestra.run.smithi099.stdout: "password": { 2024-01-31T05:14:22.707 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "password", 2024-01-31T05:14:22.707 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.708 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.708 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.708 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.708 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.708 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.708 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.708 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "password of InfluxDB server user", 2024-01-31T05:14:22.708 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.708 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.708 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.708 INFO:teuthology.orchestra.run.smithi099.stdout: "port": { 2024-01-31T05:14:22.708 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "port", 2024-01-31T05:14:22.709 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:22.709 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.709 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.709 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "8086", 2024-01-31T05:14:22.709 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.709 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.709 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.709 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "InfluxDB server port", 2024-01-31T05:14:22.709 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.709 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.709 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.709 INFO:teuthology.orchestra.run.smithi099.stdout: "ssl": { 2024-01-31T05:14:22.709 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ssl", 2024-01-31T05:14:22.710 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.710 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.710 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.710 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "false", 2024-01-31T05:14:22.710 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.710 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.710 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.710 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-01-31T05:14:22.710 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.710 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.710 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.710 INFO:teuthology.orchestra.run.smithi099.stdout: "threads": { 2024-01-31T05:14:22.710 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "threads", 2024-01-31T05:14:22.710 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:22.710 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.711 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.711 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "5", 2024-01-31T05:14:22.711 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "1", 2024-01-31T05:14:22.711 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "32", 2024-01-31T05:14:22.711 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.711 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-01-31T05:14:22.711 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.711 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.711 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.711 INFO:teuthology.orchestra.run.smithi099.stdout: "username": { 2024-01-31T05:14:22.711 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "username", 2024-01-31T05:14:22.711 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.711 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.711 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.712 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.712 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.712 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.712 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.712 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "username of InfluxDB server user", 2024-01-31T05:14:22.712 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.712 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.712 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.712 INFO:teuthology.orchestra.run.smithi099.stdout: "verify_ssl": { 2024-01-31T05:14:22.712 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "verify_ssl", 2024-01-31T05:14:22.712 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.712 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.712 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.713 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "true", 2024-01-31T05:14:22.713 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.713 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.713 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.713 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-01-31T05:14:22.713 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.713 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.713 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.713 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.713 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:22.713 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "insights", 2024-01-31T05:14:22.713 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:22.713 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:22.714 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:22.714 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:22.714 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:22.714 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.714 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.714 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.714 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.714 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.714 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.714 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.714 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.714 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.714 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.714 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.715 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.715 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.715 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.715 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.715 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.715 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.715 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.715 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:22.715 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:22.715 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.715 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.715 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.715 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.715 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.716 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.716 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.716 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.716 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.716 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.716 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.716 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:22.716 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:22.716 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.716 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.716 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.717 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:22.717 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.717 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.717 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.717 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.717 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.717 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.717 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.717 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.717 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.717 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.717 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.717 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.717 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.718 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.718 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:22.718 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:22.718 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.718 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.718 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.718 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.718 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.718 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.718 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.718 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.718 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.718 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.719 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.719 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.719 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:22.719 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "iostat", 2024-01-31T05:14:22.719 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:22.719 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:22.719 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:22.719 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:22.719 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:22.719 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.719 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.719 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.719 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.720 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.720 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.720 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.720 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.720 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.720 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.720 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.720 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.720 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.720 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.720 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.720 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.720 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.721 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.721 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:22.721 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:22.721 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.721 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.721 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.721 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.721 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.721 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.721 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.721 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.721 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.721 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.721 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.722 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:22.722 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:22.722 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.722 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.722 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.722 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:22.722 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.722 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.722 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.722 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.722 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.722 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.722 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.723 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.723 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.723 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.723 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.723 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.723 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.723 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.723 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:22.723 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:22.723 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.723 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.723 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.723 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.724 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.724 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.724 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.724 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.724 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.724 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.724 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.724 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.724 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:22.724 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "k8sevents", 2024-01-31T05:14:22.724 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:22.724 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:22.725 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:22.725 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_event_retention_days": { 2024-01-31T05:14:22.725 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ceph_event_retention_days", 2024-01-31T05:14:22.725 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:22.725 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.725 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.725 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "7", 2024-01-31T05:14:22.725 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.725 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.725 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.725 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Days to hold ceph event information within local cache", 2024-01-31T05:14:22.725 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.725 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.725 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.726 INFO:teuthology.orchestra.run.smithi099.stdout: "config_check_secs": { 2024-01-31T05:14:22.726 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "config_check_secs", 2024-01-31T05:14:22.726 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:22.726 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.726 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.726 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10", 2024-01-31T05:14:22.726 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "10", 2024-01-31T05:14:22.726 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.726 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.726 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-01-31T05:14:22.726 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.726 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.726 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.727 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:22.727 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:22.727 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.727 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.727 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.727 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.727 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.727 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.727 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.727 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.727 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.727 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.727 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.727 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.727 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.728 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.728 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.728 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.728 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.728 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.728 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:22.728 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:22.728 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.728 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.728 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.728 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.728 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.728 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.729 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.729 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.729 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.729 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.729 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.729 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:22.729 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:22.729 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.729 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.729 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.729 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:22.729 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.729 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.729 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.730 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.730 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.730 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.730 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.730 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.730 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.730 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.730 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.730 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.730 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.730 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.730 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:22.730 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:22.731 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.731 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.731 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.731 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.731 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.731 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.731 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.731 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.731 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.731 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.731 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.731 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.731 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:22.732 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "localpool", 2024-01-31T05:14:22.732 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:22.732 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:22.732 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:22.732 INFO:teuthology.orchestra.run.smithi099.stdout: "failure_domain": { 2024-01-31T05:14:22.732 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "failure_domain", 2024-01-31T05:14:22.732 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.732 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.732 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.732 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "host", 2024-01-31T05:14:22.732 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.732 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.732 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.732 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "failure domain for any created local pool", 2024-01-31T05:14:22.733 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-01-31T05:14:22.733 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.733 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.733 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:22.733 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:22.733 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.733 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.733 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.733 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.733 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.733 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.733 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.733 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.734 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.734 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.734 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.734 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.734 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.734 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.734 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.734 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.734 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.734 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.734 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:22.734 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:22.734 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.735 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.735 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.735 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.735 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.735 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.735 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.735 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.735 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.735 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.735 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.735 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:22.735 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:22.735 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.735 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.736 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.736 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:22.736 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.736 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.736 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.736 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.736 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.736 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.736 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.736 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.736 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.736 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.736 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.737 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.737 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.737 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.737 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.737 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:22.737 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:22.737 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.737 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.737 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.737 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.737 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.737 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.737 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.737 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.737 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.738 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.738 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.738 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": { 2024-01-31T05:14:22.738 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "min_size", 2024-01-31T05:14:22.738 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:22.738 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.738 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.738 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.738 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.738 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.738 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.738 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "default min_size for any created local pool", 2024-01-31T05:14:22.738 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-01-31T05:14:22.738 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.738 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.739 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rep": { 2024-01-31T05:14:22.739 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "num_rep", 2024-01-31T05:14:22.739 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:22.739 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.739 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.739 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "3", 2024-01-31T05:14:22.739 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.739 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.739 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.739 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "default replica count for any created local pool", 2024-01-31T05:14:22.739 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.739 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.739 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.740 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": { 2024-01-31T05:14:22.740 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "pg_num", 2024-01-31T05:14:22.740 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:22.740 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.740 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.740 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "128", 2024-01-31T05:14:22.740 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.740 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.740 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.740 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "default pg_num for any created local pool", 2024-01-31T05:14:22.740 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.740 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.740 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.741 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.741 INFO:teuthology.orchestra.run.smithi099.stdout: "prefix": { 2024-01-31T05:14:22.741 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "prefix", 2024-01-31T05:14:22.741 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.741 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.741 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.741 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.741 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.741 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.741 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.741 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "name prefix for any created local pool", 2024-01-31T05:14:22.741 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.741 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.741 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.741 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.742 INFO:teuthology.orchestra.run.smithi099.stdout: "subtree": { 2024-01-31T05:14:22.742 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "subtree", 2024-01-31T05:14:22.742 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.742 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.742 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.742 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "rack", 2024-01-31T05:14:22.742 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.742 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.742 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.742 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "CRUSH level for which to create a local pool", 2024-01-31T05:14:22.742 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-01-31T05:14:22.742 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.742 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.742 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.743 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.743 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.743 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:22.743 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "mds_autoscaler", 2024-01-31T05:14:22.743 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:22.743 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:22.743 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:22.743 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:22.743 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:22.743 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.743 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.743 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.743 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.743 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.744 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.744 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.744 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.744 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.744 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.744 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.744 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.744 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.744 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.744 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.744 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.744 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.744 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.745 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.745 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:22.745 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:22.745 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.745 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.745 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.745 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.745 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.745 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.745 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.745 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.745 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.745 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.745 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.746 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.746 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:22.746 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:22.746 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.746 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.746 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.746 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:22.746 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.746 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.746 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.746 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.746 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.746 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.746 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.746 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.747 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.747 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.747 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.747 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.747 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.747 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.747 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.747 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:22.747 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:22.747 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.747 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.747 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.747 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.747 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.748 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.748 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.748 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.748 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.748 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.748 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.748 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.748 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.748 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.748 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:22.748 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "mirroring", 2024-01-31T05:14:22.748 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:22.748 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:22.749 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:22.749 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:22.749 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:22.749 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.749 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.749 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.749 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.749 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.749 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.749 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.749 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.749 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.749 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.749 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.749 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.750 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.750 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.750 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.750 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.750 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.750 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.750 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.750 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:22.750 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:22.750 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.750 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.750 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.750 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.750 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.750 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.751 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.751 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.751 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.751 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.751 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.751 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.751 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:22.751 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:22.751 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.751 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.751 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.751 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:22.751 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.751 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.752 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.752 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.752 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.752 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.752 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.752 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.752 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.752 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.752 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.752 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.752 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.752 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.752 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.752 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:22.753 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:22.753 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.753 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.753 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.753 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.753 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.753 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.753 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.753 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.753 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.753 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.753 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.753 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.753 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.754 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:22.754 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "nfs", 2024-01-31T05:14:22.754 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:22.754 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:22.754 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:22.754 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:22.754 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:22.754 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.754 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.754 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.754 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.754 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.755 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.755 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.755 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.755 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.755 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.755 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.755 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.755 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.755 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.755 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.755 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.755 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.755 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.755 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.755 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:22.756 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:22.756 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.756 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.756 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.756 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.756 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.756 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.756 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.756 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.756 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.756 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.756 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.756 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.756 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:22.757 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:22.757 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.757 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.757 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.757 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:22.757 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.757 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.757 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.757 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.757 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.757 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.757 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.757 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.758 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.758 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.758 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.758 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.758 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.758 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.758 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.758 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:22.758 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:22.758 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.758 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.758 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.758 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.759 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.759 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.759 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.759 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.759 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.759 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.759 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.759 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.759 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.759 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.759 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:22.759 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "orchestrator", 2024-01-31T05:14:22.759 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:22.759 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:22.760 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:22.760 INFO:teuthology.orchestra.run.smithi099.stdout: "fail_fs": { 2024-01-31T05:14:22.760 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "fail_fs", 2024-01-31T05:14:22.760 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.760 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.760 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.760 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.760 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.760 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.760 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.760 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-01-31T05:14:22.760 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.760 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.761 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.761 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.761 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:22.761 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:22.761 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.761 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.761 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.761 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.761 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.761 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.761 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.761 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.761 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.761 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.761 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.762 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.762 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.762 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.762 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.762 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.762 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.762 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.762 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:22.762 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:22.762 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.762 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.762 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.762 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.763 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.763 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.763 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.763 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.763 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.763 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.763 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.763 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.763 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:22.763 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:22.763 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.763 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.763 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.764 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:22.764 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.764 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.764 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.764 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.764 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.764 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.764 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.764 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.764 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.764 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.764 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.764 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.764 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.764 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.765 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:22.765 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:22.765 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.765 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.765 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.765 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.765 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.765 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.765 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.765 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.765 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.765 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.765 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.766 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.766 INFO:teuthology.orchestra.run.smithi099.stdout: "orchestrator": { 2024-01-31T05:14:22.766 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "orchestrator", 2024-01-31T05:14:22.766 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.766 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.766 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.766 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.766 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.766 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.766 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.766 INFO:teuthology.orchestra.run.smithi099.stdout: "cephadm", 2024-01-31T05:14:22.766 INFO:teuthology.orchestra.run.smithi099.stdout: "rook", 2024-01-31T05:14:22.766 INFO:teuthology.orchestra.run.smithi099.stdout: "test_orchestrator" 2024-01-31T05:14:22.766 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.767 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Orchestrator backend", 2024-01-31T05:14:22.767 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.767 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.767 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.767 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.767 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.767 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:22.767 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "osd_perf_query", 2024-01-31T05:14:22.767 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:22.767 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:22.767 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:22.767 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:22.767 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:22.768 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.768 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.768 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.768 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.768 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.768 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.768 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.768 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.768 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.768 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.768 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.768 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.768 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.769 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.769 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.769 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.769 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.769 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.769 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:22.769 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:22.769 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.769 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.769 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.769 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.769 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.769 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.769 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.770 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.770 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.770 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.770 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.770 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:22.770 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:22.770 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.770 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.770 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.770 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:22.770 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.770 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.771 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.771 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.771 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.771 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.771 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.771 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.771 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.771 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.771 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.771 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.771 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.771 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.771 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:22.771 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:22.772 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.772 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.772 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.772 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.772 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.772 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.772 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.772 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.772 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.772 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.772 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.772 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.773 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:22.773 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "osd_support", 2024-01-31T05:14:22.773 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:22.773 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:22.773 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:22.773 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:22.773 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:22.773 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.773 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.773 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.773 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.773 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.774 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.774 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.774 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.774 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.774 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.774 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.774 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.774 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.774 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.774 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.774 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.774 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.774 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.775 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:22.775 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:22.775 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.775 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.775 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.775 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.775 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.775 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.775 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.775 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.775 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.775 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.775 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.776 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:22.776 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:22.776 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.776 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.776 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.776 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:22.776 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.776 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.776 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.776 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.776 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.776 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.776 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.777 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.777 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.777 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.777 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.777 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.777 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.777 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.777 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:22.777 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:22.777 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.777 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.777 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.777 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.778 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.778 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.778 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.778 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.778 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.778 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.778 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.778 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.778 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.778 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.778 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:22.778 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "pg_autoscaler", 2024-01-31T05:14:22.778 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:22.778 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:22.778 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:22.779 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:22.779 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:22.779 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.779 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.779 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.779 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.779 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.779 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.779 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.779 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.779 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.779 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.780 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.780 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.780 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.780 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.780 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.780 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.780 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.780 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.780 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:22.780 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:22.780 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.780 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.780 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.781 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.781 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.781 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.781 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.781 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.781 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.781 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.781 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.781 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.781 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:22.781 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:22.781 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.781 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.781 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.781 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:22.782 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.782 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.782 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.782 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.782 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.782 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.782 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.782 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.782 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.782 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.782 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.782 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.782 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.782 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.782 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.783 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:22.783 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:22.783 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.783 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.783 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.783 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.783 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.783 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.783 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.783 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.783 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.783 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.783 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.784 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.784 INFO:teuthology.orchestra.run.smithi099.stdout: "sleep_interval": { 2024-01-31T05:14:22.784 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "sleep_interval", 2024-01-31T05:14:22.784 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:22.784 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.784 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.784 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "60", 2024-01-31T05:14:22.784 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.784 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.784 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.784 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.784 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.784 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.784 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.785 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.785 INFO:teuthology.orchestra.run.smithi099.stdout: "threshold": { 2024-01-31T05:14:22.785 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "threshold", 2024-01-31T05:14:22.785 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "float", 2024-01-31T05:14:22.785 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.785 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.785 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "3.0", 2024-01-31T05:14:22.785 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "1.0", 2024-01-31T05:14:22.785 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.785 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.785 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "scaling threshold", 2024-01-31T05:14:22.785 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-01-31T05:14:22.785 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.785 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.786 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.786 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.786 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.786 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:22.786 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "progress", 2024-01-31T05:14:22.786 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:22.786 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:22.786 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:22.786 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_pg_recovery_event": { 2024-01-31T05:14:22.786 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "allow_pg_recovery_event", 2024-01-31T05:14:22.786 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.786 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.786 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.787 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.787 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.787 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.787 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.787 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "allow the module to show pg recovery progress", 2024-01-31T05:14:22.787 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.787 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.787 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.787 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": { 2024-01-31T05:14:22.787 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "enabled", 2024-01-31T05:14:22.787 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.787 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.787 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.787 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:22.788 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.788 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.788 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.788 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.788 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.788 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.788 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.788 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.788 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:22.788 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:22.788 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.788 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.788 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.789 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.789 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.789 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.789 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.789 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.789 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.789 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.789 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.789 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.789 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.789 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.789 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.789 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.789 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.790 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.790 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.790 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:22.790 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:22.790 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.790 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.790 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.790 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.790 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.790 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.790 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.790 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.790 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.790 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.791 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.791 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:22.791 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:22.791 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.791 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.791 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.791 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:22.791 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.791 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.791 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.791 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.791 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.791 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.792 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.792 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.792 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.792 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.792 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.792 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.792 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.792 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.792 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:22.792 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:22.792 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.792 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.792 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.793 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.793 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.793 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.793 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.793 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.793 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.793 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.793 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.793 INFO:teuthology.orchestra.run.smithi099.stdout: "max_completed_events": { 2024-01-31T05:14:22.793 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "max_completed_events", 2024-01-31T05:14:22.793 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:22.793 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.793 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.793 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "50", 2024-01-31T05:14:22.794 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.794 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.794 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.794 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "number of past completed events to remember", 2024-01-31T05:14:22.794 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.794 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.794 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.794 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.794 INFO:teuthology.orchestra.run.smithi099.stdout: "sleep_interval": { 2024-01-31T05:14:22.794 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "sleep_interval", 2024-01-31T05:14:22.794 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:22.794 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.794 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.794 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "5", 2024-01-31T05:14:22.794 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.795 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.795 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.795 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how long the module is going to sleep", 2024-01-31T05:14:22.795 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.795 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.795 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.795 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.795 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.795 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.795 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:22.795 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "prometheus", 2024-01-31T05:14:22.795 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:22.795 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:22.795 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:22.795 INFO:teuthology.orchestra.run.smithi099.stdout: "cache": { 2024-01-31T05:14:22.796 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "cache", 2024-01-31T05:14:22.796 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.796 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.796 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.796 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:22.796 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.796 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.796 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.796 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.796 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.796 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.796 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.796 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.796 INFO:teuthology.orchestra.run.smithi099.stdout: "exclude_perf_counters": { 2024-01-31T05:14:22.797 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "exclude_perf_counters", 2024-01-31T05:14:22.797 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.799 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.799 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.799 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:22.799 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.799 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.800 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.800 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-01-31T05:14:22.800 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-01-31T05:14:22.800 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.800 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.800 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.800 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:22.800 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:22.800 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.800 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.800 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.800 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.800 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.800 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.801 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.801 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.801 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.801 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.801 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.801 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.801 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.801 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.801 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.801 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.801 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.801 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.802 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:22.802 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:22.802 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.802 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.802 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.802 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.802 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.802 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.802 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.802 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.802 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.802 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.802 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.802 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.803 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:22.803 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:22.803 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.803 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.803 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.803 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:22.803 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.803 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.803 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.803 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.803 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.803 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.803 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.803 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.803 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.804 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.804 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.804 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.804 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.804 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.804 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:22.804 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:22.804 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.804 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.804 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.804 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.804 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.805 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.805 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.805 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.805 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.805 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.805 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.805 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_stats_pools": { 2024-01-31T05:14:22.805 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rbd_stats_pools", 2024-01-31T05:14:22.805 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.805 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.805 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.805 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.805 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.805 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.806 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.806 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.806 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.806 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.806 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.806 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.806 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_stats_pools_refresh_interval": { 2024-01-31T05:14:22.806 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-01-31T05:14:22.806 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:22.806 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.806 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.806 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "300", 2024-01-31T05:14:22.806 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.806 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.807 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.807 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.807 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.807 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.807 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.807 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.807 INFO:teuthology.orchestra.run.smithi099.stdout: "scrape_interval": { 2024-01-31T05:14:22.807 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "scrape_interval", 2024-01-31T05:14:22.807 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "float", 2024-01-31T05:14:22.807 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.807 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.807 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "15.0", 2024-01-31T05:14:22.807 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.808 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.808 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.808 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.808 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.808 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.808 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.808 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.808 INFO:teuthology.orchestra.run.smithi099.stdout: "server_addr": { 2024-01-31T05:14:22.808 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "server_addr", 2024-01-31T05:14:22.808 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.808 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.808 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.808 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "::", 2024-01-31T05:14:22.809 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.809 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.809 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.809 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-01-31T05:14:22.809 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.809 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.809 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.809 INFO:teuthology.orchestra.run.smithi099.stdout: "server_port": { 2024-01-31T05:14:22.809 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "server_port", 2024-01-31T05:14:22.809 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:22.809 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.809 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.809 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "9283", 2024-01-31T05:14:22.810 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.810 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.810 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.810 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-01-31T05:14:22.810 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.810 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.810 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.810 INFO:teuthology.orchestra.run.smithi099.stdout: "stale_cache_strategy": { 2024-01-31T05:14:22.810 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "stale_cache_strategy", 2024-01-31T05:14:22.810 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.810 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.810 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.810 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "log", 2024-01-31T05:14:22.810 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.811 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.811 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.811 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.811 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.811 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.811 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.811 INFO:teuthology.orchestra.run.smithi099.stdout: "standby_behaviour": { 2024-01-31T05:14:22.811 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "standby_behaviour", 2024-01-31T05:14:22.811 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.811 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.811 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.811 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "default", 2024-01-31T05:14:22.811 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.811 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.812 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.812 INFO:teuthology.orchestra.run.smithi099.stdout: "default", 2024-01-31T05:14:22.812 INFO:teuthology.orchestra.run.smithi099.stdout: "error" 2024-01-31T05:14:22.812 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.812 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.812 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.812 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.812 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.812 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.812 INFO:teuthology.orchestra.run.smithi099.stdout: "standby_error_status_code": { 2024-01-31T05:14:22.812 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "standby_error_status_code", 2024-01-31T05:14:22.812 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:22.812 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.812 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.813 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "500", 2024-01-31T05:14:22.813 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "400", 2024-01-31T05:14:22.813 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "599", 2024-01-31T05:14:22.813 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.813 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.813 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.813 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.813 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.813 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.813 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.813 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.813 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:22.813 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rbd_support", 2024-01-31T05:14:22.813 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:22.814 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:22.814 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:22.814 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:22.814 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:22.814 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.814 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.814 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.814 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.814 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.814 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.814 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.814 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.814 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.814 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.814 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.814 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.815 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.815 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.815 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.815 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.815 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.815 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.815 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:22.815 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:22.815 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.815 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.815 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.815 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.815 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.815 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.816 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.816 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.816 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.816 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.816 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.816 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.816 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:22.816 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:22.816 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.816 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.816 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.816 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:22.816 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.817 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.817 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.817 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.817 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.817 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.817 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.817 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.817 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.817 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.817 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.817 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.817 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.817 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.817 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.818 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:22.818 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:22.818 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.818 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.818 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.818 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.818 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.818 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.818 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.818 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.818 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.818 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.818 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.818 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.819 INFO:teuthology.orchestra.run.smithi099.stdout: "max_concurrent_snap_create": { 2024-01-31T05:14:22.819 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "max_concurrent_snap_create", 2024-01-31T05:14:22.819 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:22.819 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.819 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.819 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10", 2024-01-31T05:14:22.819 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.819 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.819 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.819 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.819 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.819 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.819 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.819 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.820 INFO:teuthology.orchestra.run.smithi099.stdout: "mirror_snapshot_schedule": { 2024-01-31T05:14:22.820 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "mirror_snapshot_schedule", 2024-01-31T05:14:22.820 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.820 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.820 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.820 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.820 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.820 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.820 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.820 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.820 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.820 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.820 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.820 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.821 INFO:teuthology.orchestra.run.smithi099.stdout: "trash_purge_schedule": { 2024-01-31T05:14:22.821 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "trash_purge_schedule", 2024-01-31T05:14:22.821 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.821 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.821 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.821 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.821 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.821 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.821 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.821 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.821 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.821 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.821 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.821 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.821 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.822 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.822 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:22.822 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "restful", 2024-01-31T05:14:22.822 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:22.822 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:22.822 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:22.822 INFO:teuthology.orchestra.run.smithi099.stdout: "enable_auth": { 2024-01-31T05:14:22.822 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "enable_auth", 2024-01-31T05:14:22.822 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.822 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.822 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.822 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:22.822 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.822 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.822 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.823 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.823 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.823 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.823 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.823 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.823 INFO:teuthology.orchestra.run.smithi099.stdout: "key_file": { 2024-01-31T05:14:22.823 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "key_file", 2024-01-31T05:14:22.823 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.823 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.823 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.823 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.823 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.823 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.823 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.823 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.824 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.824 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.824 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.824 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.824 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:22.824 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:22.824 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.824 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.824 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.824 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.824 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.824 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.824 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.825 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.825 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.825 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.825 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.825 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.825 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.825 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.825 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.825 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.825 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.825 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.825 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.825 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:22.825 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:22.825 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.826 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.826 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.826 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.826 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.826 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.826 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.826 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.826 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.826 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.826 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.826 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.826 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:22.826 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:22.826 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.826 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.826 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.827 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:22.827 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.827 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.827 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.827 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.827 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.827 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.827 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.827 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.827 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.827 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.827 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.827 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.827 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.828 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.828 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.828 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:22.828 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:22.828 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.828 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.828 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.828 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.828 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.828 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.829 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.829 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.829 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.829 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.829 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.829 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.829 INFO:teuthology.orchestra.run.smithi099.stdout: "server_addr": { 2024-01-31T05:14:22.829 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "server_addr", 2024-01-31T05:14:22.829 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.829 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.829 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.829 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.829 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.830 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.830 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.830 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.830 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.830 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.830 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.830 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.830 INFO:teuthology.orchestra.run.smithi099.stdout: "server_port": { 2024-01-31T05:14:22.830 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "server_port", 2024-01-31T05:14:22.830 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.830 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.830 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.830 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.830 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.831 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.831 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.831 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.831 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.831 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.831 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.831 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.831 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.831 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.831 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:22.831 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rgw", 2024-01-31T05:14:22.831 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:22.831 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:22.831 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:22.832 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:22.832 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:22.832 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.832 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.832 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.832 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.832 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.832 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.832 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.832 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.832 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.832 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.832 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.833 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.833 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.833 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.833 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.833 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.833 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.833 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.833 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.833 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:22.833 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:22.833 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.833 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.833 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.833 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.834 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.834 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.834 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.834 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.834 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.834 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.834 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.834 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.834 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:22.834 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:22.834 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.834 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.834 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.834 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:22.835 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.835 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.835 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.835 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.835 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.835 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.835 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.835 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.835 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.835 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.835 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.835 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.835 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.835 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.836 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.836 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:22.836 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:22.836 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.836 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.836 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.836 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.836 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.836 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.836 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.836 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.836 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.836 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.836 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.837 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.837 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.837 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.837 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:22.837 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rook", 2024-01-31T05:14:22.837 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:22.837 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:22.837 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:22.837 INFO:teuthology.orchestra.run.smithi099.stdout: "drive_group_interval": { 2024-01-31T05:14:22.837 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "drive_group_interval", 2024-01-31T05:14:22.837 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "float", 2024-01-31T05:14:22.837 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.837 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.837 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "300.0", 2024-01-31T05:14:22.837 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.838 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.838 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.838 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2024-01-31T05:14:22.838 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.838 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.838 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.838 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.838 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:22.838 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:22.838 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.838 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.838 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.838 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.838 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.839 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.839 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.839 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.839 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.839 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.839 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.839 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.839 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.839 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.839 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.839 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.839 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.839 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.839 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.839 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:22.840 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:22.840 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.840 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.840 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.840 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.840 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.840 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.840 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.840 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.840 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.840 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.840 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.840 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.840 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:22.841 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:22.841 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.841 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.841 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.841 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:22.841 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.841 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.841 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.841 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.841 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.841 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.841 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.841 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.841 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.842 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.842 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.842 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.842 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.842 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.842 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.842 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:22.842 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:22.842 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.842 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.842 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.842 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.842 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.843 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.843 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.843 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.843 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.843 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.843 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.843 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.843 INFO:teuthology.orchestra.run.smithi099.stdout: "storage_class": { 2024-01-31T05:14:22.843 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "storage_class", 2024-01-31T05:14:22.843 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.843 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.843 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.843 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "local", 2024-01-31T05:14:22.843 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.844 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.844 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.844 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-01-31T05:14:22.844 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.844 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.844 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.844 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.844 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.844 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.844 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:22.844 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "selftest", 2024-01-31T05:14:22.844 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:22.844 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:22.845 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:22.845 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:22.845 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:22.845 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.845 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.845 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.845 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.845 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.845 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.845 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.845 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.845 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.845 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.845 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.845 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.845 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.846 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.846 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.846 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.846 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.846 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.846 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.846 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:22.846 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:22.846 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.846 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.846 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.846 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.846 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.846 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.846 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.847 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.847 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.847 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.847 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.847 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.847 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:22.847 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:22.847 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.847 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.847 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.847 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:22.847 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.847 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.847 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.848 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.848 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.848 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.848 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.848 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.848 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.848 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.848 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.848 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.848 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.848 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.848 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.848 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:22.849 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:22.849 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.849 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.849 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.849 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.849 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.849 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.849 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.849 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.849 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.849 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.849 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.849 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.849 INFO:teuthology.orchestra.run.smithi099.stdout: "roption1": { 2024-01-31T05:14:22.850 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "roption1", 2024-01-31T05:14:22.850 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.850 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.850 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.850 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.850 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.850 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.850 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.850 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.850 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.850 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.850 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.850 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.850 INFO:teuthology.orchestra.run.smithi099.stdout: "roption2": { 2024-01-31T05:14:22.851 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "roption2", 2024-01-31T05:14:22.851 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.851 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.851 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.851 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "xyz", 2024-01-31T05:14:22.851 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.851 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.851 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.851 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.851 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.851 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.851 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.851 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.851 INFO:teuthology.orchestra.run.smithi099.stdout: "rwoption1": { 2024-01-31T05:14:22.852 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rwoption1", 2024-01-31T05:14:22.852 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.852 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.852 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.852 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.852 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.852 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.852 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.852 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.852 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.852 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.852 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.852 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.853 INFO:teuthology.orchestra.run.smithi099.stdout: "rwoption2": { 2024-01-31T05:14:22.853 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rwoption2", 2024-01-31T05:14:22.853 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:22.853 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.853 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.853 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.853 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.853 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.853 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.853 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.853 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.853 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.853 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.853 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.854 INFO:teuthology.orchestra.run.smithi099.stdout: "rwoption3": { 2024-01-31T05:14:22.854 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rwoption3", 2024-01-31T05:14:22.854 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "float", 2024-01-31T05:14:22.854 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.854 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.854 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.854 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.854 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.854 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.854 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.854 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.854 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.854 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.854 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.854 INFO:teuthology.orchestra.run.smithi099.stdout: "rwoption4": { 2024-01-31T05:14:22.854 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rwoption4", 2024-01-31T05:14:22.855 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.855 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.855 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.855 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.855 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.855 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.855 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.855 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.855 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.855 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.855 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.855 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.855 INFO:teuthology.orchestra.run.smithi099.stdout: "rwoption5": { 2024-01-31T05:14:22.855 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rwoption5", 2024-01-31T05:14:22.855 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.856 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.856 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.856 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.856 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.856 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.856 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.856 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.856 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.856 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.856 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.856 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.856 INFO:teuthology.orchestra.run.smithi099.stdout: "rwoption6": { 2024-01-31T05:14:22.856 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rwoption6", 2024-01-31T05:14:22.856 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.857 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.857 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.857 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:22.857 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.857 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.857 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.857 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.857 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.857 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.857 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.857 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.857 INFO:teuthology.orchestra.run.smithi099.stdout: "rwoption7": { 2024-01-31T05:14:22.857 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rwoption7", 2024-01-31T05:14:22.857 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:22.858 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.858 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.858 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.858 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "1", 2024-01-31T05:14:22.858 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "42", 2024-01-31T05:14:22.858 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.858 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.858 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.858 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.858 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.858 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.858 INFO:teuthology.orchestra.run.smithi099.stdout: "testkey": { 2024-01-31T05:14:22.858 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "testkey", 2024-01-31T05:14:22.858 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.859 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.859 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.859 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.859 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.859 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.859 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.859 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.859 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.859 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.859 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.859 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.859 INFO:teuthology.orchestra.run.smithi099.stdout: "testlkey": { 2024-01-31T05:14:22.859 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "testlkey", 2024-01-31T05:14:22.859 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.859 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.860 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.860 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.860 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.860 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.860 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.860 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.860 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.860 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.860 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.860 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.860 INFO:teuthology.orchestra.run.smithi099.stdout: "testnewline": { 2024-01-31T05:14:22.860 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "testnewline", 2024-01-31T05:14:22.860 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.861 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.861 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.861 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.861 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.861 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.861 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.861 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.861 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.861 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.861 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.861 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.861 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.861 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.861 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:22.861 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "snap_schedule", 2024-01-31T05:14:22.862 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:22.862 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:22.862 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:22.862 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_m_granularity": { 2024-01-31T05:14:22.862 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "allow_m_granularity", 2024-01-31T05:14:22.862 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.862 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.862 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.862 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.862 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.862 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.862 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.862 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "allow minute scheduled snapshots", 2024-01-31T05:14:22.862 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.863 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.863 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.863 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.863 INFO:teuthology.orchestra.run.smithi099.stdout: "dump_on_update": { 2024-01-31T05:14:22.863 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "dump_on_update", 2024-01-31T05:14:22.863 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.863 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.863 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.863 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.863 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.863 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.863 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.863 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "dump database to debug log on update", 2024-01-31T05:14:22.863 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.864 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.864 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.864 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:22.864 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:22.864 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.864 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.864 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.864 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.864 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.864 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.864 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.864 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.864 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.865 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.865 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.865 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.865 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.865 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.865 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.865 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.865 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.865 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.865 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:22.865 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:22.865 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.865 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.866 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.866 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.866 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.866 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.866 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.866 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.866 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.866 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.866 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.866 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.866 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:22.866 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:22.866 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.866 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.866 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.867 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:22.867 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.867 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.867 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.867 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.867 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.867 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.867 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.867 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.867 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.867 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.867 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.867 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.867 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.867 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.868 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.868 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:22.868 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:22.868 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.868 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.868 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.868 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.868 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.868 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.868 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.868 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.868 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.868 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.868 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.869 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.869 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.869 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.869 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:22.869 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "stats", 2024-01-31T05:14:22.869 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:22.869 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:22.869 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:22.869 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:22.869 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:22.869 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.869 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.869 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.869 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.870 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.870 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.870 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.870 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.870 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.870 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.870 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.870 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.870 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.870 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.870 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.870 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.870 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.871 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.871 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.871 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:22.871 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:22.871 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.871 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.871 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.871 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.871 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.871 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.871 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.871 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.871 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.871 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.872 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.872 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.872 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:22.872 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:22.872 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.872 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.872 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.872 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:22.872 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.872 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.872 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.872 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.872 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.872 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.873 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.873 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.873 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.873 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.873 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.873 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.873 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.873 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.873 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.873 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:22.873 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:22.873 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.873 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.873 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.873 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.873 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.874 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.874 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.874 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.874 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.874 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.874 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.874 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.874 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.874 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.874 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:22.874 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "status", 2024-01-31T05:14:22.874 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:22.874 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:22.874 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:22.874 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:22.875 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:22.875 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.875 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.875 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.875 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.875 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.875 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.875 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.875 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.875 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.875 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.875 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.875 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.876 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.876 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.876 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.876 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.876 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.876 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.876 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.876 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:22.876 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:22.876 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.876 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.876 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.876 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.876 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.877 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.877 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.877 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.877 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.877 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.877 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.877 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.877 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:22.877 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:22.877 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.877 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.877 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.877 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:22.877 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.878 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.878 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.878 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.878 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.878 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.878 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.878 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.878 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.878 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.878 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.878 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.878 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.878 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.879 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.879 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:22.879 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:22.879 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.879 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.879 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.879 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.879 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.879 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.879 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.879 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.879 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.880 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.880 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.880 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.880 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.880 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.880 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:22.880 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "telegraf", 2024-01-31T05:14:22.880 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:22.880 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:22.880 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:22.880 INFO:teuthology.orchestra.run.smithi099.stdout: "address": { 2024-01-31T05:14:22.880 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "address", 2024-01-31T05:14:22.880 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.881 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.881 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.881 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-01-31T05:14:22.881 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.881 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.881 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.881 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.881 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.881 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.881 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.881 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.881 INFO:teuthology.orchestra.run.smithi099.stdout: "interval": { 2024-01-31T05:14:22.881 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "interval", 2024-01-31T05:14:22.881 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:22.881 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.882 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.882 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "15", 2024-01-31T05:14:22.882 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.882 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.882 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.882 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.882 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.882 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.882 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.882 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.882 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:22.882 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:22.882 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.882 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.883 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.883 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.883 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.883 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.883 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.883 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.883 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.883 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.883 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.883 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.883 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.883 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.883 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.883 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.884 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.884 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.884 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.884 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:22.884 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:22.884 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.884 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.884 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.884 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.884 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.884 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.884 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.884 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.885 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.885 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.885 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.885 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.885 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:22.885 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:22.885 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.885 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.885 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.885 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:22.885 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.885 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.885 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.885 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.885 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.886 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.886 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.886 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.886 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.886 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.886 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.886 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.886 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.886 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.886 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.886 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:22.886 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:22.886 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.886 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.886 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.886 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.887 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.887 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.887 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.887 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.887 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.887 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.887 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.887 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.887 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.887 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.887 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:22.887 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "telemetry", 2024-01-31T05:14:22.887 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:22.887 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:22.887 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:22.888 INFO:teuthology.orchestra.run.smithi099.stdout: "channel_basic": { 2024-01-31T05:14:22.888 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "channel_basic", 2024-01-31T05:14:22.888 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.888 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.888 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.888 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:22.888 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.888 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.888 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.888 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Share basic cluster information (size, version)", 2024-01-31T05:14:22.888 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.888 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.888 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.889 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.889 INFO:teuthology.orchestra.run.smithi099.stdout: "channel_crash": { 2024-01-31T05:14:22.889 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "channel_crash", 2024-01-31T05:14:22.889 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.889 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.889 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.889 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:22.889 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.889 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.889 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.889 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-01-31T05:14:22.889 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.889 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.889 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.890 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.890 INFO:teuthology.orchestra.run.smithi099.stdout: "channel_device": { 2024-01-31T05:14:22.890 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "channel_device", 2024-01-31T05:14:22.890 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.890 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.890 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.890 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:22.890 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.890 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.890 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.890 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-01-31T05:14:22.890 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.890 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.890 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.891 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.891 INFO:teuthology.orchestra.run.smithi099.stdout: "channel_ident": { 2024-01-31T05:14:22.891 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "channel_ident", 2024-01-31T05:14:22.891 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.891 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.891 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.891 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.891 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.891 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.891 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.891 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-01-31T05:14:22.891 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.891 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.891 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.892 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.892 INFO:teuthology.orchestra.run.smithi099.stdout: "channel_perf": { 2024-01-31T05:14:22.892 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "channel_perf", 2024-01-31T05:14:22.892 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.892 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.892 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.892 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.892 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.892 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.892 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.892 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Share various performance metrics of a cluster", 2024-01-31T05:14:22.892 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.892 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.892 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.893 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.893 INFO:teuthology.orchestra.run.smithi099.stdout: "contact": { 2024-01-31T05:14:22.893 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "contact", 2024-01-31T05:14:22.893 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.893 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.893 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.893 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.893 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.893 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.893 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.893 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.893 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.893 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.893 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.893 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.894 INFO:teuthology.orchestra.run.smithi099.stdout: "description": { 2024-01-31T05:14:22.894 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "description", 2024-01-31T05:14:22.894 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.894 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.894 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.894 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.894 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.894 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.894 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.894 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.894 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.894 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.894 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.895 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.895 INFO:teuthology.orchestra.run.smithi099.stdout: "device_url": { 2024-01-31T05:14:22.895 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "device_url", 2024-01-31T05:14:22.895 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.895 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.895 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.895 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-01-31T05:14:22.895 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.895 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.895 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.895 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.895 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.895 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.895 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.895 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.896 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": { 2024-01-31T05:14:22.896 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "enabled", 2024-01-31T05:14:22.896 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.896 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.896 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.896 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.896 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.896 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.896 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.896 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.896 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.896 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.896 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.897 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.897 INFO:teuthology.orchestra.run.smithi099.stdout: "interval": { 2024-01-31T05:14:22.897 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "interval", 2024-01-31T05:14:22.897 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:22.897 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.897 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.897 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "24", 2024-01-31T05:14:22.897 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "8", 2024-01-31T05:14:22.897 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.897 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.897 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.897 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.897 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.897 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.898 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.898 INFO:teuthology.orchestra.run.smithi099.stdout: "last_opt_revision": { 2024-01-31T05:14:22.898 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "last_opt_revision", 2024-01-31T05:14:22.898 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:22.898 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.898 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.898 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "1", 2024-01-31T05:14:22.898 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.898 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.898 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.898 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.898 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.898 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.898 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.898 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.899 INFO:teuthology.orchestra.run.smithi099.stdout: "leaderboard": { 2024-01-31T05:14:22.899 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "leaderboard", 2024-01-31T05:14:22.899 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.899 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.899 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.899 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.899 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.899 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.899 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.899 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.899 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.899 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.899 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.900 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.900 INFO:teuthology.orchestra.run.smithi099.stdout: "leaderboard_description": { 2024-01-31T05:14:22.900 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "leaderboard_description", 2024-01-31T05:14:22.900 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.900 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.900 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.900 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.900 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.900 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.900 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.900 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.900 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.900 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.900 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.901 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.901 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:22.901 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:22.901 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.901 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.901 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.901 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.901 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.901 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.901 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.901 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.901 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.901 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.901 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.901 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.902 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.902 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.902 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.902 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.902 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.902 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.902 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.902 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:22.902 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:22.902 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.902 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.902 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.902 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.902 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.903 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.903 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.903 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.903 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.903 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.903 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.903 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.903 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:22.903 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:22.903 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.903 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.903 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.903 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:22.903 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.904 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.904 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.904 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.904 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.904 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.904 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.904 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.904 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.904 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.904 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.904 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.904 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.904 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.905 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:22.905 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:22.905 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.905 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.905 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.905 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.905 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.905 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.905 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.905 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.905 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.905 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.905 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.906 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.906 INFO:teuthology.orchestra.run.smithi099.stdout: "organization": { 2024-01-31T05:14:22.906 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "organization", 2024-01-31T05:14:22.906 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.906 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.906 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.906 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.906 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.906 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.906 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.906 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.906 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.906 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.906 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.906 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.906 INFO:teuthology.orchestra.run.smithi099.stdout: "proxy": { 2024-01-31T05:14:22.907 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "proxy", 2024-01-31T05:14:22.907 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.907 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.907 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.907 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.907 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.907 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.907 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.907 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.907 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.907 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.907 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.907 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.907 INFO:teuthology.orchestra.run.smithi099.stdout: "url": { 2024-01-31T05:14:22.907 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "url", 2024-01-31T05:14:22.907 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.908 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.908 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.908 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-01-31T05:14:22.908 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.908 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.908 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.908 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.908 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.908 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.908 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.908 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.908 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.908 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.908 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:22.908 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "test_orchestrator", 2024-01-31T05:14:22.909 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:22.909 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:22.909 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:22.909 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:22.909 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:22.909 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.909 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.909 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.909 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.909 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.909 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.909 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.909 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.909 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.910 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.910 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.910 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.910 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.910 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.910 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.910 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.910 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.910 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.910 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.910 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:22.910 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:22.910 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.910 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.910 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.910 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.911 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.911 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.911 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.911 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.911 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.911 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.911 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.911 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:22.911 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:22.911 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.911 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.911 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.911 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:22.912 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.912 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.912 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.912 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.912 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.912 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.912 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.912 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.912 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.912 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.912 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.912 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.912 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.913 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.913 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.913 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:22.913 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:22.913 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.913 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.913 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.913 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.913 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.913 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.913 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.913 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.913 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.913 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.914 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.914 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.914 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.914 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.914 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:22.914 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "volumes", 2024-01-31T05:14:22.914 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:22.914 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:22.914 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:22.914 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:22.914 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:22.914 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.914 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.914 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.914 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.914 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.915 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.915 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.915 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.915 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.915 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.915 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.915 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.915 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.915 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.915 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.915 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.915 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.915 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.915 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.916 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:22.916 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:22.916 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.916 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.916 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.916 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.916 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.916 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.916 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.916 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.916 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.916 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.916 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.916 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.917 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:22.917 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:22.917 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.917 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.917 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.917 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:22.917 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.917 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.917 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.917 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.917 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.917 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.917 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.918 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.918 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.918 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.918 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.918 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.918 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.918 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.918 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.918 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:22.918 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:22.918 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.918 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.918 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.918 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.918 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.918 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.919 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.919 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.919 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.919 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.919 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.919 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.919 INFO:teuthology.orchestra.run.smithi099.stdout: "max_concurrent_clones": { 2024-01-31T05:14:22.919 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "max_concurrent_clones", 2024-01-31T05:14:22.919 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:22.919 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.919 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.919 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "4", 2024-01-31T05:14:22.919 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.919 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.920 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.920 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Number of asynchronous cloner threads", 2024-01-31T05:14:22.920 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.920 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.920 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.920 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.920 INFO:teuthology.orchestra.run.smithi099.stdout: "periodic_async_work": { 2024-01-31T05:14:22.920 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "periodic_async_work", 2024-01-31T05:14:22.920 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.920 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.920 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.920 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.920 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.920 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.920 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.921 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Periodically check for async work", 2024-01-31T05:14:22.921 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.921 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.921 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.921 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.921 INFO:teuthology.orchestra.run.smithi099.stdout: "snapshot_clone_delay": { 2024-01-31T05:14:22.921 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "snapshot_clone_delay", 2024-01-31T05:14:22.921 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:22.921 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.921 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.921 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0", 2024-01-31T05:14:22.921 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.921 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.921 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.921 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-01-31T05:14:22.922 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.922 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.922 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.922 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.922 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.922 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.922 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:22.922 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "zabbix", 2024-01-31T05:14:22.922 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:22.922 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:22.922 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:22.922 INFO:teuthology.orchestra.run.smithi099.stdout: "discovery_interval": { 2024-01-31T05:14:22.922 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "discovery_interval", 2024-01-31T05:14:22.922 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "uint", 2024-01-31T05:14:22.922 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.922 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.923 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "100", 2024-01-31T05:14:22.923 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.923 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.923 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.923 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.923 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.923 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.923 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.923 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.923 INFO:teuthology.orchestra.run.smithi099.stdout: "identifier": { 2024-01-31T05:14:22.923 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "identifier", 2024-01-31T05:14:22.923 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.923 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.923 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.923 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.924 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.924 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.924 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.924 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.924 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.924 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.924 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.924 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.924 INFO:teuthology.orchestra.run.smithi099.stdout: "interval": { 2024-01-31T05:14:22.924 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "interval", 2024-01-31T05:14:22.924 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:22.924 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.924 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.925 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "60", 2024-01-31T05:14:22.925 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.925 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.925 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.925 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.925 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.925 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.925 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.925 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.925 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:22.925 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:22.925 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.925 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.925 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.925 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.925 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.926 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.926 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.926 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.926 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.926 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.926 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.926 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.926 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.926 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.926 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.926 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.926 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.926 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.926 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.926 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:22.927 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:22.927 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.927 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.927 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.927 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.927 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.927 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.927 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.927 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.927 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.927 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.927 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.927 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.927 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:22.927 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:22.927 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.928 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.928 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.928 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:22.928 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.928 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.928 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.928 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.928 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.928 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.928 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.928 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.928 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.929 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.929 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.929 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.929 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.929 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.929 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.929 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:22.929 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:22.929 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.929 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.929 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.929 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.929 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.929 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.929 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.930 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.930 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.930 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.930 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.930 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.930 INFO:teuthology.orchestra.run.smithi099.stdout: "zabbix_host": { 2024-01-31T05:14:22.930 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "zabbix_host", 2024-01-31T05:14:22.930 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.930 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.930 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.930 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.930 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.930 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.930 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.931 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.931 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.931 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.931 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.931 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.931 INFO:teuthology.orchestra.run.smithi099.stdout: "zabbix_port": { 2024-01-31T05:14:22.931 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "zabbix_port", 2024-01-31T05:14:22.931 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:22.931 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.931 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.931 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10051", 2024-01-31T05:14:22.931 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.931 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.931 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.931 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.932 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.932 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.932 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.932 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.932 INFO:teuthology.orchestra.run.smithi099.stdout: "zabbix_sender": { 2024-01-31T05:14:22.932 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "zabbix_sender", 2024-01-31T05:14:22.932 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.932 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.932 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.932 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-01-31T05:14:22.932 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.932 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.932 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.932 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.933 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.933 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.933 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.933 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.933 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.933 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.933 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-01-31T05:14:22.933 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.933 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:22.933 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 24110, 2024-01-31T05:14:22.933 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "y", 2024-01-31T05:14:22.933 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr_features": 4540701272860131327, 2024-01-31T05:14:22.933 INFO:teuthology.orchestra.run.smithi099.stdout: "available_modules": [ 2024-01-31T05:14:22.933 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:22.933 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "alerts", 2024-01-31T05:14:22.934 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:22.934 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:22.934 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:22.934 INFO:teuthology.orchestra.run.smithi099.stdout: "interval": { 2024-01-31T05:14:22.934 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "interval", 2024-01-31T05:14:22.934 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:22.934 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.934 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.934 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "60", 2024-01-31T05:14:22.934 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.934 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.934 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.934 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "How frequently to reexamine health status", 2024-01-31T05:14:22.934 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.934 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.934 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.935 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.935 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:22.935 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:22.935 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.935 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.935 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.935 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.935 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.935 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.935 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.935 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.935 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.935 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.935 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.935 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.936 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.936 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.936 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.936 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.936 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.936 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.936 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.936 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:22.936 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:22.936 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.936 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.936 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.936 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.936 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.936 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.937 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.937 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.937 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.937 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.937 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.937 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.937 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:22.937 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:22.937 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.937 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.937 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.937 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:22.937 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.937 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.938 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.938 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.938 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.938 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.938 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.938 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.938 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.938 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.938 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.938 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.938 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.938 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.938 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.939 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:22.939 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:22.939 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.939 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.939 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.939 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.939 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.939 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.939 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.939 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.939 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.939 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.939 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.939 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.939 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_destination": { 2024-01-31T05:14:22.940 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_destination", 2024-01-31T05:14:22.940 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.940 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.940 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.940 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.940 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.940 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.940 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.940 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Email address to send alerts to", 2024-01-31T05:14:22.940 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.940 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.940 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.940 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.941 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_from_name": { 2024-01-31T05:14:22.941 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_from_name", 2024-01-31T05:14:22.941 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.941 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.941 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.941 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "Ceph", 2024-01-31T05:14:22.941 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.941 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.941 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.941 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Email From: name", 2024-01-31T05:14:22.941 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.941 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.941 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.941 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.942 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_host": { 2024-01-31T05:14:22.942 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_host", 2024-01-31T05:14:22.942 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.942 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.942 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.942 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.942 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.942 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.942 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.942 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "SMTP server", 2024-01-31T05:14:22.942 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.942 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.942 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.942 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.942 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_password": { 2024-01-31T05:14:22.943 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_password", 2024-01-31T05:14:22.943 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.943 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.943 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.943 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.943 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.943 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.943 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.943 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Password to authenticate with", 2024-01-31T05:14:22.943 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.943 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.943 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.943 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.943 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_port": { 2024-01-31T05:14:22.943 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_port", 2024-01-31T05:14:22.943 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:22.944 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.944 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.944 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "465", 2024-01-31T05:14:22.944 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.944 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.944 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.944 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "SMTP port", 2024-01-31T05:14:22.944 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.944 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.944 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.944 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.944 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_sender": { 2024-01-31T05:14:22.944 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_sender", 2024-01-31T05:14:22.945 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.945 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.945 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.945 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.945 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.945 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.945 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.945 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "SMTP envelope sender", 2024-01-31T05:14:22.945 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.945 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.945 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.945 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.945 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_ssl": { 2024-01-31T05:14:22.945 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_ssl", 2024-01-31T05:14:22.945 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.945 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.946 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.946 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:22.946 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.946 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.946 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.946 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Use SSL to connect to SMTP server", 2024-01-31T05:14:22.946 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.946 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.946 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.946 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.946 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_user": { 2024-01-31T05:14:22.946 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_user", 2024-01-31T05:14:22.946 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.946 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.946 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.947 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.947 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.947 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.947 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.947 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "User to authenticate as", 2024-01-31T05:14:22.947 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.947 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.947 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.947 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.947 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.947 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.947 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:22.947 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "balancer", 2024-01-31T05:14:22.947 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:22.947 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:22.948 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:22.948 INFO:teuthology.orchestra.run.smithi099.stdout: "active": { 2024-01-31T05:14:22.948 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "active", 2024-01-31T05:14:22.948 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.948 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.948 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.948 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:22.948 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.948 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.948 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.948 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "automatically balance PGs across cluster", 2024-01-31T05:14:22.948 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.948 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.948 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.949 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.949 INFO:teuthology.orchestra.run.smithi099.stdout: "begin_time": { 2024-01-31T05:14:22.949 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "begin_time", 2024-01-31T05:14:22.949 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.949 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.949 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.949 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0000", 2024-01-31T05:14:22.949 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.949 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.949 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.949 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "beginning time of day to automatically balance", 2024-01-31T05:14:22.949 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-01-31T05:14:22.949 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.949 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.949 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.950 INFO:teuthology.orchestra.run.smithi099.stdout: "begin_weekday": { 2024-01-31T05:14:22.950 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "begin_weekday", 2024-01-31T05:14:22.950 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "uint", 2024-01-31T05:14:22.950 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.950 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.950 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0", 2024-01-31T05:14:22.950 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "0", 2024-01-31T05:14:22.950 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "6", 2024-01-31T05:14:22.950 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.950 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-01-31T05:14:22.950 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-01-31T05:14:22.950 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.950 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.950 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.951 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_compat_max_iterations": { 2024-01-31T05:14:22.951 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "crush_compat_max_iterations", 2024-01-31T05:14:22.951 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "uint", 2024-01-31T05:14:22.951 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.951 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.951 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "25", 2024-01-31T05:14:22.951 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "1", 2024-01-31T05:14:22.951 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "250", 2024-01-31T05:14:22.951 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.951 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-01-31T05:14:22.951 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.951 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.951 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.952 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.952 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_compat_metrics": { 2024-01-31T05:14:22.952 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "crush_compat_metrics", 2024-01-31T05:14:22.952 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.952 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.952 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.952 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "pgs,objects,bytes", 2024-01-31T05:14:22.952 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.952 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.952 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.952 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-01-31T05:14:22.952 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-01-31T05:14:22.952 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.952 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.953 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.953 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_compat_step": { 2024-01-31T05:14:22.953 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "crush_compat_step", 2024-01-31T05:14:22.953 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "float", 2024-01-31T05:14:22.953 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.953 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.953 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0.5", 2024-01-31T05:14:22.953 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "0.001", 2024-01-31T05:14:22.953 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "0.999", 2024-01-31T05:14:22.953 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.953 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "aggressiveness of optimization", 2024-01-31T05:14:22.953 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-01-31T05:14:22.953 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.954 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.954 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.954 INFO:teuthology.orchestra.run.smithi099.stdout: "end_time": { 2024-01-31T05:14:22.954 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "end_time", 2024-01-31T05:14:22.954 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.954 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.954 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.954 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "2359", 2024-01-31T05:14:22.954 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.954 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.954 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.954 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "ending time of day to automatically balance", 2024-01-31T05:14:22.954 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-01-31T05:14:22.954 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.955 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.955 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.955 INFO:teuthology.orchestra.run.smithi099.stdout: "end_weekday": { 2024-01-31T05:14:22.955 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "end_weekday", 2024-01-31T05:14:22.955 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "uint", 2024-01-31T05:14:22.955 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.955 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.955 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0", 2024-01-31T05:14:22.955 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "0", 2024-01-31T05:14:22.955 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "6", 2024-01-31T05:14:22.955 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.955 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-01-31T05:14:22.955 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-01-31T05:14:22.955 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.956 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.956 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.956 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:22.956 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:22.956 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.956 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.956 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.956 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.956 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.956 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.956 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.956 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.956 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.957 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.957 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.957 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.957 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.957 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.957 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.957 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.957 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.957 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.957 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.957 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:22.957 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:22.957 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.957 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.958 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.958 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.958 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.958 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.958 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.958 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.958 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.958 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.958 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.958 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.958 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:22.958 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:22.958 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.958 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.959 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.959 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:22.959 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.959 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.959 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.959 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:22.959 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:22.959 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:22.959 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:22.959 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:22.959 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:22.959 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.959 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.959 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.959 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.960 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.960 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.960 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:22.960 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:22.960 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.960 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.960 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.960 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.960 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.960 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.960 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.960 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:22.960 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.961 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.961 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.961 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.961 INFO:teuthology.orchestra.run.smithi099.stdout: "min_score": { 2024-01-31T05:14:22.961 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "min_score", 2024-01-31T05:14:22.961 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "float", 2024-01-31T05:14:22.961 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.961 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.961 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0", 2024-01-31T05:14:22.961 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.961 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.961 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.961 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-01-31T05:14:22.961 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.962 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.962 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.962 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.962 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": { 2024-01-31T05:14:22.962 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "mode", 2024-01-31T05:14:22.962 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.962 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.962 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.962 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "upmap", 2024-01-31T05:14:22.962 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.962 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.962 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.962 INFO:teuthology.orchestra.run.smithi099.stdout: "crush-compat", 2024-01-31T05:14:22.962 INFO:teuthology.orchestra.run.smithi099.stdout: "none", 2024-01-31T05:14:22.962 INFO:teuthology.orchestra.run.smithi099.stdout: "upmap" 2024-01-31T05:14:22.963 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.963 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Balancer mode", 2024-01-31T05:14:22.963 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.963 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.963 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.963 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.963 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ids": { 2024-01-31T05:14:22.963 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "pool_ids", 2024-01-31T05:14:22.963 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.963 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.963 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.963 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.963 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.963 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.964 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.964 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-01-31T05:14:22.964 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.964 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.964 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.964 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.964 INFO:teuthology.orchestra.run.smithi099.stdout: "sleep_interval": { 2024-01-31T05:14:22.964 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "sleep_interval", 2024-01-31T05:14:22.964 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:22.964 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.964 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.964 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "60", 2024-01-31T05:14:22.964 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.965 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.965 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.965 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-01-31T05:14:22.965 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.965 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.965 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.965 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.965 INFO:teuthology.orchestra.run.smithi099.stdout: "upmap_max_deviation": { 2024-01-31T05:14:22.965 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "upmap_max_deviation", 2024-01-31T05:14:22.965 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:22.965 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.965 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.965 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "5", 2024-01-31T05:14:22.965 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "1", 2024-01-31T05:14:22.966 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.966 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.966 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "deviation below which no optimization is attempted", 2024-01-31T05:14:22.966 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-01-31T05:14:22.966 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.966 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.966 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.966 INFO:teuthology.orchestra.run.smithi099.stdout: "upmap_max_optimizations": { 2024-01-31T05:14:22.966 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "upmap_max_optimizations", 2024-01-31T05:14:22.966 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "uint", 2024-01-31T05:14:22.966 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.966 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.966 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10", 2024-01-31T05:14:22.966 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.967 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.967 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.967 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-01-31T05:14:22.967 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.967 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.967 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.967 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.967 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:22.967 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.967 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:22.967 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "cephadm", 2024-01-31T05:14:22.967 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:22.967 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:22.967 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:22.968 INFO:teuthology.orchestra.run.smithi099.stdout: "agent_down_multiplier": { 2024-01-31T05:14:22.968 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "agent_down_multiplier", 2024-01-31T05:14:22.968 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "float", 2024-01-31T05:14:22.968 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.968 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.968 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "3.0", 2024-01-31T05:14:22.968 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.968 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.968 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.968 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-01-31T05:14:22.968 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.968 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.968 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.969 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.969 INFO:teuthology.orchestra.run.smithi099.stdout: "agent_refresh_rate": { 2024-01-31T05:14:22.969 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "agent_refresh_rate", 2024-01-31T05:14:22.969 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:22.969 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.969 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.969 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "20", 2024-01-31T05:14:22.969 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.969 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.969 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.969 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-01-31T05:14:22.969 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.969 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.969 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.969 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.970 INFO:teuthology.orchestra.run.smithi099.stdout: "agent_starting_port": { 2024-01-31T05:14:22.970 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "agent_starting_port", 2024-01-31T05:14:22.970 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:22.970 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.970 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.970 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "4721", 2024-01-31T05:14:22.970 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.970 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.970 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.970 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-01-31T05:14:22.970 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.970 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.970 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.970 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.970 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_ptrace": { 2024-01-31T05:14:22.971 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "allow_ptrace", 2024-01-31T05:14:22.971 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.971 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.971 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.971 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.971 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.971 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.971 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.971 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-01-31T05:14:22.971 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-01-31T05:14:22.971 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.971 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.971 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.971 INFO:teuthology.orchestra.run.smithi099.stdout: "autotune_interval": { 2024-01-31T05:14:22.971 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "autotune_interval", 2024-01-31T05:14:22.972 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:22.972 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.972 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.972 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "600", 2024-01-31T05:14:22.972 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.972 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.972 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.972 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how frequently to autotune daemon memory", 2024-01-31T05:14:22.972 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.972 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.972 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.972 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.972 INFO:teuthology.orchestra.run.smithi099.stdout: "autotune_memory_target_ratio": { 2024-01-31T05:14:22.972 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "autotune_memory_target_ratio", 2024-01-31T05:14:22.973 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "float", 2024-01-31T05:14:22.973 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.973 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.973 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0.7", 2024-01-31T05:14:22.973 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.973 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.973 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.973 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-01-31T05:14:22.973 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.973 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.973 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.973 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.973 INFO:teuthology.orchestra.run.smithi099.stdout: "cephadm_log_destination": { 2024-01-31T05:14:22.973 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "cephadm_log_destination", 2024-01-31T05:14:22.974 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.974 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.974 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.974 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:22.974 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.974 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.974 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:22.974 INFO:teuthology.orchestra.run.smithi099.stdout: "file", 2024-01-31T05:14:22.974 INFO:teuthology.orchestra.run.smithi099.stdout: "file,syslog", 2024-01-31T05:14:22.974 INFO:teuthology.orchestra.run.smithi099.stdout: "syslog" 2024-01-31T05:14:22.974 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:22.974 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-01-31T05:14:22.974 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.974 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.975 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.975 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.975 INFO:teuthology.orchestra.run.smithi099.stdout: "cgroups_split": { 2024-01-31T05:14:22.975 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "cgroups_split", 2024-01-31T05:14:22.975 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.975 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.975 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.975 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:22.975 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.975 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.975 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.975 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-01-31T05:14:22.975 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.975 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.975 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.976 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.976 INFO:teuthology.orchestra.run.smithi099.stdout: "config_checks_enabled": { 2024-01-31T05:14:22.976 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "config_checks_enabled", 2024-01-31T05:14:22.976 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.976 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.976 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.976 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.976 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.976 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.976 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.976 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-01-31T05:14:22.976 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.976 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.976 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.977 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.977 INFO:teuthology.orchestra.run.smithi099.stdout: "config_dashboard": { 2024-01-31T05:14:22.977 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "config_dashboard", 2024-01-31T05:14:22.977 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.977 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.977 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.977 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:22.977 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.977 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.977 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.977 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-01-31T05:14:22.977 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.977 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.977 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.977 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.978 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_alertmanager": { 2024-01-31T05:14:22.978 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_alertmanager", 2024-01-31T05:14:22.978 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.978 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.978 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.978 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-01-31T05:14:22.978 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.978 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.978 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.978 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Prometheus container image", 2024-01-31T05:14:22.978 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.978 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.978 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.978 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.978 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_base": { 2024-01-31T05:14:22.979 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_base", 2024-01-31T05:14:22.979 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.979 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.979 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:22.979 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/ceph/ceph", 2024-01-31T05:14:22.979 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.979 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.979 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.979 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Container image name, without the tag", 2024-01-31T05:14:22.979 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.979 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.979 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.979 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.980 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_elasticsearch": { 2024-01-31T05:14:22.980 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_elasticsearch", 2024-01-31T05:14:22.980 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.980 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.980 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.980 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-01-31T05:14:22.980 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.980 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.980 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.980 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "elasticsearch container image", 2024-01-31T05:14:22.980 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.980 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.980 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.980 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.981 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_grafana": { 2024-01-31T05:14:22.981 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_grafana", 2024-01-31T05:14:22.981 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.981 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.981 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.981 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.12", 2024-01-31T05:14:22.981 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.981 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.981 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.981 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Prometheus container image", 2024-01-31T05:14:22.981 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.981 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.981 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.981 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.982 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_haproxy": { 2024-01-31T05:14:22.982 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_haproxy", 2024-01-31T05:14:22.982 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.982 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.982 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.982 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-01-31T05:14:22.982 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.982 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.982 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.982 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "HAproxy container image", 2024-01-31T05:14:22.982 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.982 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.982 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.982 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.982 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_jaeger_agent": { 2024-01-31T05:14:22.983 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_jaeger_agent", 2024-01-31T05:14:22.983 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.983 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.983 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.983 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-01-31T05:14:22.983 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.983 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.983 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.983 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Jaeger agent container image", 2024-01-31T05:14:22.983 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.983 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.983 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.983 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.983 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_jaeger_collector": { 2024-01-31T05:14:22.984 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_jaeger_collector", 2024-01-31T05:14:22.984 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.984 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.984 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.984 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-01-31T05:14:22.984 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.984 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.984 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.984 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Jaeger collector container image", 2024-01-31T05:14:22.984 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.984 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.984 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.984 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.984 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_jaeger_query": { 2024-01-31T05:14:22.985 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_jaeger_query", 2024-01-31T05:14:22.985 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.985 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.985 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.985 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-01-31T05:14:22.985 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.985 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.985 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.985 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Jaeger query container image", 2024-01-31T05:14:22.985 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.985 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.985 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.985 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.985 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_keepalived": { 2024-01-31T05:14:22.985 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_keepalived", 2024-01-31T05:14:22.986 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.986 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.986 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.986 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-01-31T05:14:22.986 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.986 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.986 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.986 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Keepalived container image", 2024-01-31T05:14:22.986 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.986 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.986 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.986 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.986 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_loki": { 2024-01-31T05:14:22.986 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_loki", 2024-01-31T05:14:22.986 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.986 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.987 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.987 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-01-31T05:14:22.987 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.987 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.987 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.987 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Loki container image", 2024-01-31T05:14:22.987 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.987 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.987 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.987 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.987 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_node_exporter": { 2024-01-31T05:14:22.987 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_node_exporter", 2024-01-31T05:14:22.987 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.987 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.987 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.988 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-01-31T05:14:22.988 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.988 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.988 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.988 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Prometheus container image", 2024-01-31T05:14:22.988 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.988 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.988 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.988 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.988 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_nvmeof": { 2024-01-31T05:14:22.988 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_nvmeof", 2024-01-31T05:14:22.988 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.988 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.989 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.989 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/ceph/nvmeof:latest", 2024-01-31T05:14:22.989 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.989 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.989 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.989 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Nvme-of container image", 2024-01-31T05:14:22.989 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.989 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.989 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.989 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.989 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_prometheus": { 2024-01-31T05:14:22.989 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_prometheus", 2024-01-31T05:14:22.989 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.989 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.989 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.989 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-01-31T05:14:22.990 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.990 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.990 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.990 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Prometheus container image", 2024-01-31T05:14:22.990 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.990 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.990 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.990 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.990 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_promtail": { 2024-01-31T05:14:22.990 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_promtail", 2024-01-31T05:14:22.990 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.990 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.990 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.990 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-01-31T05:14:22.990 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.991 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.991 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.991 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Promtail container image", 2024-01-31T05:14:22.991 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.991 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.991 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.991 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.991 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_snmp_gateway": { 2024-01-31T05:14:22.991 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_snmp_gateway", 2024-01-31T05:14:22.991 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.991 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.991 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.991 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-01-31T05:14:22.991 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.991 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.991 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.992 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "SNMP Gateway container image", 2024-01-31T05:14:22.992 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.992 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.992 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.992 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.992 INFO:teuthology.orchestra.run.smithi099.stdout: "container_init": { 2024-01-31T05:14:22.992 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_init", 2024-01-31T05:14:22.992 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.992 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.992 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.992 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:22.992 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.992 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.993 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.993 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Run podman/docker with `--init`", 2024-01-31T05:14:22.993 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.993 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.993 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.993 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.993 INFO:teuthology.orchestra.run.smithi099.stdout: "daemon_cache_timeout": { 2024-01-31T05:14:22.993 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "daemon_cache_timeout", 2024-01-31T05:14:22.993 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:22.993 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.993 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.993 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "600", 2024-01-31T05:14:22.993 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.993 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.993 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.993 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-01-31T05:14:22.994 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.994 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.994 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.994 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.994 INFO:teuthology.orchestra.run.smithi099.stdout: "default_cephadm_command_timeout": { 2024-01-31T05:14:22.994 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "default_cephadm_command_timeout", 2024-01-31T05:14:22.994 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:22.994 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.994 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.994 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "900", 2024-01-31T05:14:22.994 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.994 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.994 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.994 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-01-31T05:14:22.994 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.995 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.995 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.995 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.995 INFO:teuthology.orchestra.run.smithi099.stdout: "default_registry": { 2024-01-31T05:14:22.995 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "default_registry", 2024-01-31T05:14:22.995 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:22.995 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.995 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.995 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "docker.io", 2024-01-31T05:14:22.995 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.995 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.995 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.995 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-01-31T05:14:22.995 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.995 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.996 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.996 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.996 INFO:teuthology.orchestra.run.smithi099.stdout: "device_cache_timeout": { 2024-01-31T05:14:22.996 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "device_cache_timeout", 2024-01-31T05:14:22.996 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:22.996 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.996 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.996 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "1800", 2024-01-31T05:14:22.996 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.996 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.996 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.996 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "seconds to cache device inventory", 2024-01-31T05:14:22.996 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.996 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.997 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.997 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.997 INFO:teuthology.orchestra.run.smithi099.stdout: "device_enhanced_scan": { 2024-01-31T05:14:22.997 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "device_enhanced_scan", 2024-01-31T05:14:22.997 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:22.997 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.997 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.997 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:22.997 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.997 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.997 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.997 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Use libstoragemgmt during device scans", 2024-01-31T05:14:22.997 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.997 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.997 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.998 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.998 INFO:teuthology.orchestra.run.smithi099.stdout: "facts_cache_timeout": { 2024-01-31T05:14:22.998 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "facts_cache_timeout", 2024-01-31T05:14:22.998 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:22.998 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.998 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.998 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "60", 2024-01-31T05:14:22.998 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.998 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.998 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.998 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "seconds to cache host facts data", 2024-01-31T05:14:22.998 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.998 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.998 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.999 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:22.999 INFO:teuthology.orchestra.run.smithi099.stdout: "host_check_interval": { 2024-01-31T05:14:22.999 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "host_check_interval", 2024-01-31T05:14:22.999 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:22.999 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:22.999 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:22.999 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "600", 2024-01-31T05:14:22.999 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:22.999 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:22.999 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:22.999 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how frequently to perform a host check", 2024-01-31T05:14:22.999 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:22.999 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:22.999 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:22.999 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.000 INFO:teuthology.orchestra.run.smithi099.stdout: "inventory_list_all": { 2024-01-31T05:14:23.000 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "inventory_list_all", 2024-01-31T05:14:23.000 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.000 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.000 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.000 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.000 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.000 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.000 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.000 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-01-31T05:14:23.000 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.000 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.000 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.000 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.001 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.001 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.001 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.001 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.001 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.001 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.001 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.001 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.001 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.001 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.001 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.001 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.001 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.001 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.002 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.002 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.002 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.002 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.002 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.002 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.002 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.002 INFO:teuthology.orchestra.run.smithi099.stdout: "log_refresh_metadata": { 2024-01-31T05:14:23.002 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_refresh_metadata", 2024-01-31T05:14:23.002 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.002 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.002 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.002 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.002 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.003 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.003 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.003 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-01-31T05:14:23.003 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.003 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.003 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.003 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.003 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.003 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.003 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.003 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.003 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.003 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.003 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.003 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.004 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.004 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-01-31T05:14:23.004 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.004 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.004 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.004 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.004 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.004 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.004 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.004 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.004 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.004 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.004 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.004 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.004 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.005 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.005 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.005 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.005 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.005 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.005 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.005 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.005 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.005 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.005 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.005 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.005 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.005 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.005 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.006 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.006 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.006 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.006 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.006 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.006 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.006 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.006 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.006 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.006 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.006 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.006 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.006 INFO:teuthology.orchestra.run.smithi099.stdout: "manage_etc_ceph_ceph_conf": { 2024-01-31T05:14:23.006 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-01-31T05:14:23.007 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.007 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.007 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.007 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.007 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.007 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.007 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.007 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-01-31T05:14:23.007 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.007 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.007 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.007 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.007 INFO:teuthology.orchestra.run.smithi099.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-01-31T05:14:23.007 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-01-31T05:14:23.007 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.007 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.008 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.008 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "*", 2024-01-31T05:14:23.008 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.008 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.008 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.008 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-01-31T05:14:23.008 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.008 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.008 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.008 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.008 INFO:teuthology.orchestra.run.smithi099.stdout: "max_count_per_host": { 2024-01-31T05:14:23.008 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "max_count_per_host", 2024-01-31T05:14:23.009 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.009 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.009 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.009 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10", 2024-01-31T05:14:23.009 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.009 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.009 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.009 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "max number of daemons per service per host", 2024-01-31T05:14:23.009 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.009 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.009 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.009 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.009 INFO:teuthology.orchestra.run.smithi099.stdout: "max_osd_draining_count": { 2024-01-31T05:14:23.009 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "max_osd_draining_count", 2024-01-31T05:14:23.010 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.010 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.010 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.010 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10", 2024-01-31T05:14:23.010 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.010 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.010 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.010 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-01-31T05:14:23.010 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.010 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.010 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.010 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.010 INFO:teuthology.orchestra.run.smithi099.stdout: "migration_current": { 2024-01-31T05:14:23.010 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "migration_current", 2024-01-31T05:14:23.011 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.011 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.011 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.011 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.011 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.011 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.011 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.011 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "internal - do not modify", 2024-01-31T05:14:23.011 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.011 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.011 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.011 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.011 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": { 2024-01-31T05:14:23.011 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "mode", 2024-01-31T05:14:23.012 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.012 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.012 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.012 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "root", 2024-01-31T05:14:23.012 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.012 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.012 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.012 INFO:teuthology.orchestra.run.smithi099.stdout: "cephadm-package", 2024-01-31T05:14:23.012 INFO:teuthology.orchestra.run.smithi099.stdout: "root" 2024-01-31T05:14:23.012 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.012 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "mode for remote execution of cephadm", 2024-01-31T05:14:23.012 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.012 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.012 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.013 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.013 INFO:teuthology.orchestra.run.smithi099.stdout: "prometheus_alerts_path": { 2024-01-31T05:14:23.013 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "prometheus_alerts_path", 2024-01-31T05:14:23.013 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.013 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.013 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.013 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-01-31T05:14:23.013 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.013 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.013 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.013 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-01-31T05:14:23.013 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.013 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.013 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.014 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.014 INFO:teuthology.orchestra.run.smithi099.stdout: "registry_insecure": { 2024-01-31T05:14:23.014 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "registry_insecure", 2024-01-31T05:14:23.014 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.014 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.014 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.014 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.014 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.014 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.014 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.014 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-01-31T05:14:23.014 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.014 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.014 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.014 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.015 INFO:teuthology.orchestra.run.smithi099.stdout: "registry_password": { 2024-01-31T05:14:23.015 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "registry_password", 2024-01-31T05:14:23.015 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.015 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.015 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.015 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.015 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.015 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.015 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.015 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-01-31T05:14:23.015 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.015 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.015 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.015 INFO:teuthology.orchestra.run.smithi099.stdout: "registry_url": { 2024-01-31T05:14:23.016 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "registry_url", 2024-01-31T05:14:23.016 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.016 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.016 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.016 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.016 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.016 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.016 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.016 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-01-31T05:14:23.016 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.016 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.016 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.016 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.017 INFO:teuthology.orchestra.run.smithi099.stdout: "registry_username": { 2024-01-31T05:14:23.017 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "registry_username", 2024-01-31T05:14:23.017 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.017 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.017 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.017 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.017 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.017 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.017 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.017 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-01-31T05:14:23.017 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.017 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.017 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.017 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.017 INFO:teuthology.orchestra.run.smithi099.stdout: "secure_monitoring_stack": { 2024-01-31T05:14:23.018 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "secure_monitoring_stack", 2024-01-31T05:14:23.018 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.018 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.018 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.018 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.018 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.018 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.018 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.018 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-01-31T05:14:23.018 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.018 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.018 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.018 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.018 INFO:teuthology.orchestra.run.smithi099.stdout: "service_discovery_port": { 2024-01-31T05:14:23.019 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "service_discovery_port", 2024-01-31T05:14:23.019 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.019 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.019 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.019 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "8765", 2024-01-31T05:14:23.019 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.019 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.019 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.019 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "cephadm service discovery port", 2024-01-31T05:14:23.019 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.019 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.019 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.019 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.019 INFO:teuthology.orchestra.run.smithi099.stdout: "ssh_config_file": { 2024-01-31T05:14:23.020 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ssh_config_file", 2024-01-31T05:14:23.020 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.020 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.020 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.020 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.020 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.020 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.020 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.020 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-01-31T05:14:23.020 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.020 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.020 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.020 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.020 INFO:teuthology.orchestra.run.smithi099.stdout: "use_agent": { 2024-01-31T05:14:23.021 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "use_agent", 2024-01-31T05:14:23.021 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.021 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.021 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.021 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.021 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.021 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.021 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.021 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-01-31T05:14:23.021 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.021 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.021 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.021 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.021 INFO:teuthology.orchestra.run.smithi099.stdout: "use_repo_digest": { 2024-01-31T05:14:23.022 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "use_repo_digest", 2024-01-31T05:14:23.022 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.022 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.022 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.022 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.022 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.022 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.022 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.022 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-01-31T05:14:23.022 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.022 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.022 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.022 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.022 INFO:teuthology.orchestra.run.smithi099.stdout: "warn_on_failed_host_check": { 2024-01-31T05:14:23.023 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "warn_on_failed_host_check", 2024-01-31T05:14:23.023 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.023 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.023 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.023 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.023 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.023 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.023 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.023 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "raise a health warning if the host check fails", 2024-01-31T05:14:23.023 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.023 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.023 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.023 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.023 INFO:teuthology.orchestra.run.smithi099.stdout: "warn_on_stray_daemons": { 2024-01-31T05:14:23.024 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "warn_on_stray_daemons", 2024-01-31T05:14:23.024 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.024 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.024 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.024 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.024 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.024 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.024 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.024 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-01-31T05:14:23.024 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.024 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.024 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.024 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.024 INFO:teuthology.orchestra.run.smithi099.stdout: "warn_on_stray_hosts": { 2024-01-31T05:14:23.025 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "warn_on_stray_hosts", 2024-01-31T05:14:23.025 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.025 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.025 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.025 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.025 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.025 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.025 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.025 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-01-31T05:14:23.025 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.025 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.025 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.025 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.025 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.026 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.026 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "crash", 2024-01-31T05:14:23.026 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.026 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.026 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.026 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.026 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.026 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.026 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.026 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.026 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.026 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.026 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.027 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.027 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.027 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.027 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.027 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.027 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.027 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.027 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.027 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.027 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.027 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.027 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.027 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.027 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.028 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.028 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.028 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.028 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.028 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.028 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.028 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.028 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.028 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.028 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.028 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.028 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.028 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.028 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.029 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.029 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.029 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.029 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.029 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.029 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.029 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.029 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.029 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.029 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.029 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.029 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.029 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.029 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.030 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.030 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.030 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.030 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.030 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.030 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.030 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.030 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.030 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.030 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.030 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.030 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.030 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.030 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.030 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.031 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.031 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.031 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.031 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.031 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.031 INFO:teuthology.orchestra.run.smithi099.stdout: "retain_interval": { 2024-01-31T05:14:23.031 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "retain_interval", 2024-01-31T05:14:23.031 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:23.031 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.031 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.031 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "31536000", 2024-01-31T05:14:23.031 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.031 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.031 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.032 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how long to retain crashes before pruning them", 2024-01-31T05:14:23.032 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.032 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.032 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.032 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.032 INFO:teuthology.orchestra.run.smithi099.stdout: "warn_recent_interval": { 2024-01-31T05:14:23.032 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "warn_recent_interval", 2024-01-31T05:14:23.032 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:23.032 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.032 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.032 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "1209600", 2024-01-31T05:14:23.032 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.032 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.032 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.033 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "time interval in which to warn about recent crashes", 2024-01-31T05:14:23.033 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.033 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.033 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.033 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.033 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.033 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.033 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.033 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "dashboard", 2024-01-31T05:14:23.033 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.033 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.033 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.033 INFO:teuthology.orchestra.run.smithi099.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-01-31T05:14:23.033 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-01-31T05:14:23.033 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.034 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.034 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.034 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10", 2024-01-31T05:14:23.034 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.034 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.034 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.034 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.034 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.034 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.034 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.034 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.034 INFO:teuthology.orchestra.run.smithi099.stdout: "ALERTMANAGER_API_HOST": { 2024-01-31T05:14:23.034 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ALERTMANAGER_API_HOST", 2024-01-31T05:14:23.034 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.035 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.035 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.035 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.035 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.035 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.035 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.035 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.035 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.035 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.035 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.035 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.035 INFO:teuthology.orchestra.run.smithi099.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-01-31T05:14:23.035 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-01-31T05:14:23.035 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.036 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.036 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.036 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.036 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.036 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.036 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.036 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.036 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.036 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.036 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.036 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.036 INFO:teuthology.orchestra.run.smithi099.stdout: "AUDIT_API_ENABLED": { 2024-01-31T05:14:23.036 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "AUDIT_API_ENABLED", 2024-01-31T05:14:23.037 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.037 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.037 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.037 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.037 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.037 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.037 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.037 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.037 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.037 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.038 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.038 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.038 INFO:teuthology.orchestra.run.smithi099.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-01-31T05:14:23.038 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-01-31T05:14:23.038 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.038 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.038 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.039 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.039 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.039 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.039 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.039 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.039 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.039 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.040 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.040 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.040 INFO:teuthology.orchestra.run.smithi099.stdout: "ENABLE_BROWSABLE_API": { 2024-01-31T05:14:23.040 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ENABLE_BROWSABLE_API", 2024-01-31T05:14:23.040 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.040 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.041 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.041 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.041 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.041 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.041 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.041 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.041 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.042 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.042 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.042 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.042 INFO:teuthology.orchestra.run.smithi099.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-01-31T05:14:23.042 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-01-31T05:14:23.042 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.042 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.043 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.043 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.043 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.043 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.043 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.043 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.043 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.044 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.044 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.044 INFO:teuthology.orchestra.run.smithi099.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-01-31T05:14:23.044 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-01-31T05:14:23.044 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.044 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.044 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.045 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.045 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.045 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.045 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.045 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.045 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.045 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.045 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.045 INFO:teuthology.orchestra.run.smithi099.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-01-31T05:14:23.045 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-01-31T05:14:23.045 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.045 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.045 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.046 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.046 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.046 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.046 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.046 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.046 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.046 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.046 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.046 INFO:teuthology.orchestra.run.smithi099.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-01-31T05:14:23.046 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-01-31T05:14:23.046 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.046 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.046 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.046 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.046 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.047 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.047 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.047 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.047 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.047 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.047 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.047 INFO:teuthology.orchestra.run.smithi099.stdout: "FEATURE_TOGGLE_NFS": { 2024-01-31T05:14:23.047 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-01-31T05:14:23.047 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.047 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.047 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.047 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.047 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.048 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.048 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.048 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.048 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.048 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.048 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.048 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.048 INFO:teuthology.orchestra.run.smithi099.stdout: "FEATURE_TOGGLE_RBD": { 2024-01-31T05:14:23.048 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-01-31T05:14:23.048 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.048 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.048 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.048 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.049 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.049 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.049 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.049 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.049 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.049 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.049 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.049 INFO:teuthology.orchestra.run.smithi099.stdout: "FEATURE_TOGGLE_RGW": { 2024-01-31T05:14:23.049 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-01-31T05:14:23.049 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.049 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.049 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.049 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.049 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.050 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.050 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.050 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.050 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.050 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.050 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.050 INFO:teuthology.orchestra.run.smithi099.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-01-31T05:14:23.050 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-01-31T05:14:23.050 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.050 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.050 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.050 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.050 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.051 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.051 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.051 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.051 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.051 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.051 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.051 INFO:teuthology.orchestra.run.smithi099.stdout: "GRAFANA_API_PASSWORD": { 2024-01-31T05:14:23.051 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "GRAFANA_API_PASSWORD", 2024-01-31T05:14:23.051 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.051 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.051 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.051 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "admin", 2024-01-31T05:14:23.051 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.051 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.052 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.052 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.052 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.052 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.052 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.052 INFO:teuthology.orchestra.run.smithi099.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-01-31T05:14:23.052 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-01-31T05:14:23.052 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.052 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.052 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.052 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.052 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.052 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.052 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.053 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.053 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.053 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.053 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.053 INFO:teuthology.orchestra.run.smithi099.stdout: "GRAFANA_API_URL": { 2024-01-31T05:14:23.053 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "GRAFANA_API_URL", 2024-01-31T05:14:23.053 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.053 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.053 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.053 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.053 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.053 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.054 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.054 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.054 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.054 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.054 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.054 INFO:teuthology.orchestra.run.smithi099.stdout: "GRAFANA_API_USERNAME": { 2024-01-31T05:14:23.054 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "GRAFANA_API_USERNAME", 2024-01-31T05:14:23.054 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.054 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.054 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.054 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "admin", 2024-01-31T05:14:23.054 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.054 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.055 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.055 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.055 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.055 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.055 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.055 INFO:teuthology.orchestra.run.smithi099.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-01-31T05:14:23.055 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-01-31T05:14:23.055 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.055 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.055 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.055 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.055 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.055 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.055 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.056 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.056 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.056 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.056 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.056 INFO:teuthology.orchestra.run.smithi099.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-01-31T05:14:23.056 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-01-31T05:14:23.056 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.056 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.056 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.056 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.056 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.056 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.057 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.057 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.057 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.057 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.057 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.057 INFO:teuthology.orchestra.run.smithi099.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-01-31T05:14:23.057 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-01-31T05:14:23.057 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.057 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.057 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.057 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.057 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.057 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.057 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.058 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.058 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.058 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.058 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.058 INFO:teuthology.orchestra.run.smithi099.stdout: "ISSUE_TRACKER_API_KEY": { 2024-01-31T05:14:23.058 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-01-31T05:14:23.058 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.058 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.058 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.058 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.058 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.058 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.058 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.059 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.059 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.059 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.059 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.059 INFO:teuthology.orchestra.run.smithi099.stdout: "PROMETHEUS_API_HOST": { 2024-01-31T05:14:23.059 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PROMETHEUS_API_HOST", 2024-01-31T05:14:23.059 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.059 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.059 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.059 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.059 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.059 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.059 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.060 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.060 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.060 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.060 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.060 INFO:teuthology.orchestra.run.smithi099.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-01-31T05:14:23.060 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-01-31T05:14:23.060 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.060 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.060 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.060 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.060 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.060 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.060 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.061 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.061 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.061 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.061 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.061 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-01-31T05:14:23.061 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-01-31T05:14:23.061 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.061 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.061 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.061 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.061 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.061 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.061 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.061 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.062 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.062 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.062 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.062 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-01-31T05:14:23.062 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-01-31T05:14:23.062 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.062 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.062 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.062 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.062 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.062 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.062 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.062 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.062 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.063 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.063 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.063 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-01-31T05:14:23.063 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-01-31T05:14:23.063 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.063 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.063 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.063 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.063 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.063 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.063 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.063 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.063 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.063 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.064 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.064 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-01-31T05:14:23.064 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-01-31T05:14:23.064 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.064 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.064 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.064 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.064 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.064 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.064 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.064 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.064 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.064 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.065 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.065 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-01-31T05:14:23.065 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-01-31T05:14:23.065 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.065 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.065 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.065 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.065 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.065 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.065 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.065 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.065 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.066 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.066 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.066 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-01-31T05:14:23.066 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-01-31T05:14:23.066 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.066 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.066 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.066 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.066 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.066 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.066 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.066 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.066 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.067 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.067 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.067 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-01-31T05:14:23.067 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-01-31T05:14:23.067 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.067 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.067 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.067 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.067 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.067 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.067 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.067 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.067 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.068 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.068 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.068 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_ENABLED": { 2024-01-31T05:14:23.068 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_ENABLED", 2024-01-31T05:14:23.068 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.068 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.068 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.068 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.068 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.068 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.068 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.068 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.069 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.069 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.069 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.069 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-01-31T05:14:23.069 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-01-31T05:14:23.069 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.069 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.069 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.069 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-01-31T05:14:23.069 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.069 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.069 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.069 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.069 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.070 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.070 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.070 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-01-31T05:14:23.070 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-01-31T05:14:23.070 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.070 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.070 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.070 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10", 2024-01-31T05:14:23.070 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.070 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.070 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.070 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.070 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.070 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.071 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.071 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-01-31T05:14:23.071 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-01-31T05:14:23.071 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.071 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.071 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.071 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "8", 2024-01-31T05:14:23.071 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.071 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.071 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.071 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.071 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.071 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.071 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.072 INFO:teuthology.orchestra.run.smithi099.stdout: "REST_REQUESTS_TIMEOUT": { 2024-01-31T05:14:23.072 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-01-31T05:14:23.072 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.072 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.072 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.072 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "45", 2024-01-31T05:14:23.072 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.072 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.072 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.072 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.072 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.072 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.073 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.073 INFO:teuthology.orchestra.run.smithi099.stdout: "RGW_API_ACCESS_KEY": { 2024-01-31T05:14:23.073 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "RGW_API_ACCESS_KEY", 2024-01-31T05:14:23.073 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.073 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.073 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.073 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.073 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.073 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.073 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.073 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.073 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.073 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.073 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.074 INFO:teuthology.orchestra.run.smithi099.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-01-31T05:14:23.074 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-01-31T05:14:23.074 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.074 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.074 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.074 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "admin", 2024-01-31T05:14:23.074 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.074 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.074 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.074 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.074 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.074 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.074 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.075 INFO:teuthology.orchestra.run.smithi099.stdout: "RGW_API_SECRET_KEY": { 2024-01-31T05:14:23.075 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "RGW_API_SECRET_KEY", 2024-01-31T05:14:23.075 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.075 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.075 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.075 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.075 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.075 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.075 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.075 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.075 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.075 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.075 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.076 INFO:teuthology.orchestra.run.smithi099.stdout: "RGW_API_SSL_VERIFY": { 2024-01-31T05:14:23.076 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "RGW_API_SSL_VERIFY", 2024-01-31T05:14:23.076 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.076 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.076 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.076 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.076 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.076 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.076 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.076 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.076 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.076 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.076 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.077 INFO:teuthology.orchestra.run.smithi099.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-01-31T05:14:23.077 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-01-31T05:14:23.077 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.077 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.077 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.077 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0", 2024-01-31T05:14:23.077 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.077 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.077 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.077 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.077 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.077 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.077 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.078 INFO:teuthology.orchestra.run.smithi099.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-01-31T05:14:23.078 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-01-31T05:14:23.078 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.078 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.078 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.078 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10", 2024-01-31T05:14:23.078 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.078 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.078 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.078 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.078 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.078 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.078 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.079 INFO:teuthology.orchestra.run.smithi099.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-01-31T05:14:23.079 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-01-31T05:14:23.079 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.079 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.079 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.079 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "5", 2024-01-31T05:14:23.079 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.079 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.079 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.079 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.079 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.079 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.079 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.080 INFO:teuthology.orchestra.run.smithi099.stdout: "cross_origin_url": { 2024-01-31T05:14:23.080 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "cross_origin_url", 2024-01-31T05:14:23.080 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.080 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.080 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.080 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.080 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.080 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.080 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.080 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.080 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.080 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.080 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.081 INFO:teuthology.orchestra.run.smithi099.stdout: "crt_file": { 2024-01-31T05:14:23.081 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "crt_file", 2024-01-31T05:14:23.081 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.081 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.081 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.081 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.081 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.081 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.081 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.081 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.081 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.081 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.081 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.082 INFO:teuthology.orchestra.run.smithi099.stdout: "debug": { 2024-01-31T05:14:23.082 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "debug", 2024-01-31T05:14:23.082 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.082 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.082 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.082 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.082 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.082 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.082 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.082 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Enable/disable debug options", 2024-01-31T05:14:23.082 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.082 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.082 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.083 INFO:teuthology.orchestra.run.smithi099.stdout: "jwt_token_ttl": { 2024-01-31T05:14:23.083 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "jwt_token_ttl", 2024-01-31T05:14:23.083 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.083 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.083 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.083 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "28800", 2024-01-31T05:14:23.083 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.083 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.083 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.083 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.083 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.083 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.083 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.083 INFO:teuthology.orchestra.run.smithi099.stdout: "key_file": { 2024-01-31T05:14:23.084 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "key_file", 2024-01-31T05:14:23.084 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.084 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.084 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.084 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.084 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.084 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.084 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.084 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.084 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.084 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.084 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.085 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.085 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.085 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.085 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.085 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.085 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.085 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.085 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.085 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.085 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.085 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.085 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.085 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.085 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.086 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.086 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.086 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.086 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.086 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.086 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.086 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.086 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.086 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.086 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.086 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.086 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.086 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.086 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.087 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.087 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.087 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.087 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.087 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.087 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.087 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.087 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.087 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.087 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.087 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.087 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.087 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.087 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.087 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.088 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.088 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.088 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.088 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.088 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.088 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.088 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.088 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.088 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.088 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.088 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.088 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.089 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.089 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.089 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.089 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.089 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.089 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.089 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.089 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.089 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.089 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.089 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.089 INFO:teuthology.orchestra.run.smithi099.stdout: "motd": { 2024-01-31T05:14:23.089 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "motd", 2024-01-31T05:14:23.090 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.090 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.090 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.090 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.090 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.090 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.090 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.090 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "The message of the day", 2024-01-31T05:14:23.090 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.090 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.090 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.090 INFO:teuthology.orchestra.run.smithi099.stdout: "redirect_resolve_ip_addr": { 2024-01-31T05:14:23.090 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "redirect_resolve_ip_addr", 2024-01-31T05:14:23.091 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.091 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.091 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.091 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.091 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.091 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.091 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.091 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.091 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.091 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.091 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.091 INFO:teuthology.orchestra.run.smithi099.stdout: "server_addr": { 2024-01-31T05:14:23.091 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "server_addr", 2024-01-31T05:14:23.091 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.092 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.092 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.092 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "::", 2024-01-31T05:14:23.092 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.092 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.092 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.092 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.092 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.092 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.092 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.092 INFO:teuthology.orchestra.run.smithi099.stdout: "server_port": { 2024-01-31T05:14:23.092 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "server_port", 2024-01-31T05:14:23.093 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.093 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.093 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.093 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "8080", 2024-01-31T05:14:23.093 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.093 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.093 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.093 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.093 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.093 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.093 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.093 INFO:teuthology.orchestra.run.smithi099.stdout: "ssl": { 2024-01-31T05:14:23.093 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ssl", 2024-01-31T05:14:23.093 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.094 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.094 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.094 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.094 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.094 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.094 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.094 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.094 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.094 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.094 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.094 INFO:teuthology.orchestra.run.smithi099.stdout: "ssl_server_port": { 2024-01-31T05:14:23.094 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ssl_server_port", 2024-01-31T05:14:23.094 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.094 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.095 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.095 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "8443", 2024-01-31T05:14:23.095 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.095 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.095 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.095 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.095 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.095 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.095 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.095 INFO:teuthology.orchestra.run.smithi099.stdout: "standby_behaviour": { 2024-01-31T05:14:23.095 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "standby_behaviour", 2024-01-31T05:14:23.095 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.095 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.096 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.096 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "redirect", 2024-01-31T05:14:23.096 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.096 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.096 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.096 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.096 INFO:teuthology.orchestra.run.smithi099.stdout: "redirect" 2024-01-31T05:14:23.096 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.096 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.096 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.096 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.096 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.097 INFO:teuthology.orchestra.run.smithi099.stdout: "standby_error_status_code": { 2024-01-31T05:14:23.097 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "standby_error_status_code", 2024-01-31T05:14:23.097 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.097 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.097 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.097 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "500", 2024-01-31T05:14:23.097 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "400", 2024-01-31T05:14:23.097 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "599", 2024-01-31T05:14:23.097 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.097 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.097 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.097 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.097 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.098 INFO:teuthology.orchestra.run.smithi099.stdout: "url_prefix": { 2024-01-31T05:14:23.098 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "url_prefix", 2024-01-31T05:14:23.098 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.098 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.098 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.098 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.098 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.098 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.098 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.098 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.098 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.098 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.098 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.098 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.098 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.099 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "devicehealth", 2024-01-31T05:14:23.099 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.099 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.099 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.099 INFO:teuthology.orchestra.run.smithi099.stdout: "enable_monitoring": { 2024-01-31T05:14:23.099 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "enable_monitoring", 2024-01-31T05:14:23.099 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.099 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.099 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.099 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.099 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.099 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.099 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.100 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "monitor device health metrics", 2024-01-31T05:14:23.100 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.100 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.100 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.100 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.100 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.100 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.100 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.100 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.100 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.100 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.100 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.100 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.101 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.101 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.101 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.101 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.101 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.101 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.101 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.101 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.101 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.101 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.101 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.101 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.101 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.102 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.102 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.102 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.102 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.102 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.102 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.102 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.102 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.102 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.102 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.102 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.102 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.102 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.103 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.103 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.103 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.103 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.103 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.103 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.103 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.103 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.103 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.103 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.103 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.103 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.103 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.103 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.103 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.103 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.104 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.104 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.104 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.104 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.104 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.104 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.104 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.104 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.104 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.104 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.104 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.104 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.105 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.105 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.105 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.105 INFO:teuthology.orchestra.run.smithi099.stdout: "mark_out_threshold": { 2024-01-31T05:14:23.105 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "mark_out_threshold", 2024-01-31T05:14:23.105 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:23.105 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.105 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.105 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "2419200", 2024-01-31T05:14:23.105 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.105 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.105 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.105 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-01-31T05:14:23.106 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.106 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.106 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.106 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": { 2024-01-31T05:14:23.106 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "pool_name", 2024-01-31T05:14:23.106 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.106 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.106 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.106 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "device_health_metrics", 2024-01-31T05:14:23.106 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.106 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.106 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.106 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "name of pool in which to store device health metrics", 2024-01-31T05:14:23.107 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.107 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.107 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.107 INFO:teuthology.orchestra.run.smithi099.stdout: "retention_period": { 2024-01-31T05:14:23.107 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "retention_period", 2024-01-31T05:14:23.107 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:23.107 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.107 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.107 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "15552000", 2024-01-31T05:14:23.107 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.107 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.107 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.107 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how long to retain device health metrics", 2024-01-31T05:14:23.107 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.108 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.108 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.108 INFO:teuthology.orchestra.run.smithi099.stdout: "scrape_frequency": { 2024-01-31T05:14:23.108 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "scrape_frequency", 2024-01-31T05:14:23.108 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:23.108 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.108 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.108 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "86400", 2024-01-31T05:14:23.108 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.108 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.108 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.108 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how frequently to scrape device health metrics", 2024-01-31T05:14:23.108 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.109 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.109 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.109 INFO:teuthology.orchestra.run.smithi099.stdout: "self_heal": { 2024-01-31T05:14:23.109 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "self_heal", 2024-01-31T05:14:23.109 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.109 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.109 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.109 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.109 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.109 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.109 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.109 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-01-31T05:14:23.109 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.110 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.110 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.110 INFO:teuthology.orchestra.run.smithi099.stdout: "sleep_interval": { 2024-01-31T05:14:23.110 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "sleep_interval", 2024-01-31T05:14:23.110 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:23.110 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.110 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.110 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "600", 2024-01-31T05:14:23.110 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.110 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.110 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.110 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how frequently to wake up and check device health", 2024-01-31T05:14:23.110 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.111 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.111 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.111 INFO:teuthology.orchestra.run.smithi099.stdout: "warn_threshold": { 2024-01-31T05:14:23.111 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "warn_threshold", 2024-01-31T05:14:23.111 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:23.111 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.111 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.111 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "7257600", 2024-01-31T05:14:23.111 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.111 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.111 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.111 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-01-31T05:14:23.111 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.111 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.112 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.112 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.112 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.112 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "diskprediction_local", 2024-01-31T05:14:23.112 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.112 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.112 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.112 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.112 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.112 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.112 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.112 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.113 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.113 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.113 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.113 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.113 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.113 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.113 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.113 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.113 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.113 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.113 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.113 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.113 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.113 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.113 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.114 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.114 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.114 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.114 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.114 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.114 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.114 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.114 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.114 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.114 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.114 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.114 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.114 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.115 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.115 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.115 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.115 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.115 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.115 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.115 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.115 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.115 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.115 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.115 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.115 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.115 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.115 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.115 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.116 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.116 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.116 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.116 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.116 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.116 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.116 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.116 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.116 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.116 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.116 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.116 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.116 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.117 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.117 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.117 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.117 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.117 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.117 INFO:teuthology.orchestra.run.smithi099.stdout: "predict_interval": { 2024-01-31T05:14:23.117 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "predict_interval", 2024-01-31T05:14:23.117 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.117 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.117 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.117 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "86400", 2024-01-31T05:14:23.117 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.117 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.117 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.118 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.118 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.118 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.118 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.118 INFO:teuthology.orchestra.run.smithi099.stdout: "predictor_model": { 2024-01-31T05:14:23.118 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "predictor_model", 2024-01-31T05:14:23.118 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.118 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.118 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.118 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "prophetstor", 2024-01-31T05:14:23.118 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.118 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.119 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.119 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.119 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.119 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.119 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.119 INFO:teuthology.orchestra.run.smithi099.stdout: "sleep_interval": { 2024-01-31T05:14:23.119 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "sleep_interval", 2024-01-31T05:14:23.119 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.119 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.119 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.119 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "600", 2024-01-31T05:14:23.119 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.119 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.119 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.120 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.120 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.120 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.120 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.120 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.120 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.120 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "influx", 2024-01-31T05:14:23.120 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": false, 2024-01-31T05:14:23.120 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "influxdb python module not found", 2024-01-31T05:14:23.120 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.120 INFO:teuthology.orchestra.run.smithi099.stdout: "batch_size": { 2024-01-31T05:14:23.121 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "batch_size", 2024-01-31T05:14:23.121 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.121 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.121 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.121 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "5000", 2024-01-31T05:14:23.121 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.121 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.121 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.121 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-01-31T05:14:23.121 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.121 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.121 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.121 INFO:teuthology.orchestra.run.smithi099.stdout: "database": { 2024-01-31T05:14:23.121 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "database", 2024-01-31T05:14:23.122 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.122 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.122 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.122 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "ceph", 2024-01-31T05:14:23.122 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.122 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.122 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.122 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-01-31T05:14:23.122 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.122 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.122 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.122 INFO:teuthology.orchestra.run.smithi099.stdout: "hostname": { 2024-01-31T05:14:23.122 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "hostname", 2024-01-31T05:14:23.122 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.123 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.123 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.123 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.123 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.123 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.123 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.123 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "InfluxDB server hostname", 2024-01-31T05:14:23.123 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.123 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.123 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.123 INFO:teuthology.orchestra.run.smithi099.stdout: "interval": { 2024-01-31T05:14:23.123 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "interval", 2024-01-31T05:14:23.123 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:23.124 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.124 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.124 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "30", 2024-01-31T05:14:23.124 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "5", 2024-01-31T05:14:23.124 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.124 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.124 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-01-31T05:14:23.124 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.124 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.124 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.124 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.124 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.124 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.125 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.125 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.125 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.125 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.125 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.125 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.125 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.125 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.125 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.125 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.125 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.125 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.125 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.126 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.126 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.126 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.126 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.126 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.126 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.126 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.126 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.126 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.126 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.126 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.126 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.126 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.126 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.127 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.127 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.127 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.127 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.127 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.127 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.127 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.127 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.127 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.127 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.127 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.127 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.127 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.127 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.128 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.128 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.128 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.128 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.128 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.128 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.128 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.128 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.128 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.128 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.128 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.128 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.128 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.128 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.129 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.129 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.129 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.129 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.129 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.129 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.129 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.129 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.129 INFO:teuthology.orchestra.run.smithi099.stdout: "password": { 2024-01-31T05:14:23.129 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "password", 2024-01-31T05:14:23.129 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.129 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.129 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.129 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.130 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.130 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.130 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.130 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "password of InfluxDB server user", 2024-01-31T05:14:23.130 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.130 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.130 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.130 INFO:teuthology.orchestra.run.smithi099.stdout: "port": { 2024-01-31T05:14:23.130 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "port", 2024-01-31T05:14:23.130 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.130 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.130 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.130 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "8086", 2024-01-31T05:14:23.131 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.131 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.131 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.131 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "InfluxDB server port", 2024-01-31T05:14:23.131 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.131 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.131 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.131 INFO:teuthology.orchestra.run.smithi099.stdout: "ssl": { 2024-01-31T05:14:23.131 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ssl", 2024-01-31T05:14:23.131 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.131 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.131 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.131 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "false", 2024-01-31T05:14:23.132 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.132 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.132 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.132 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-01-31T05:14:23.132 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.132 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.132 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.132 INFO:teuthology.orchestra.run.smithi099.stdout: "threads": { 2024-01-31T05:14:23.132 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "threads", 2024-01-31T05:14:23.132 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.132 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.132 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.132 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "5", 2024-01-31T05:14:23.133 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "1", 2024-01-31T05:14:23.133 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "32", 2024-01-31T05:14:23.133 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.133 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-01-31T05:14:23.133 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.133 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.133 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.133 INFO:teuthology.orchestra.run.smithi099.stdout: "username": { 2024-01-31T05:14:23.133 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "username", 2024-01-31T05:14:23.133 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.133 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.133 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.133 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.134 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.135 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.135 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.135 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "username of InfluxDB server user", 2024-01-31T05:14:23.135 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.135 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.135 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.135 INFO:teuthology.orchestra.run.smithi099.stdout: "verify_ssl": { 2024-01-31T05:14:23.136 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "verify_ssl", 2024-01-31T05:14:23.136 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.136 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.136 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.136 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "true", 2024-01-31T05:14:23.136 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.136 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.136 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.136 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-01-31T05:14:23.136 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.136 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.136 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.136 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.137 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.137 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "insights", 2024-01-31T05:14:23.137 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.137 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.137 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.137 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.137 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.137 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.137 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.137 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.137 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.137 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.137 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.138 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.138 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.138 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.138 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.138 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.138 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.138 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.138 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.138 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.138 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.138 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.138 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.138 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.139 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.139 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.139 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.139 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.139 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.139 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.139 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.139 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.139 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.139 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.139 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.139 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.139 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.140 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.140 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.140 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.140 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.140 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.140 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.140 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.140 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.140 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.140 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.140 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.140 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.140 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.140 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.141 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.141 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.141 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.141 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.141 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.141 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.141 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.141 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.141 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.141 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.141 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.141 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.141 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.141 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.142 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.142 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.142 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.142 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.142 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.142 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.142 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "iostat", 2024-01-31T05:14:23.142 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.142 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.142 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.142 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.142 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.142 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.143 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.143 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.143 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.143 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.143 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.143 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.143 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.143 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.143 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.143 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.143 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.143 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.143 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.143 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.143 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.144 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.144 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.144 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.144 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.144 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.144 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.144 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.144 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.144 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.144 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.144 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.144 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.145 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.145 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.145 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.145 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.145 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.145 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.145 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.145 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.145 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.145 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.145 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.145 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.145 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.146 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.146 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.146 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.146 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.146 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.146 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.146 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.146 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.146 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.146 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.146 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.146 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.147 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.147 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.147 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.147 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.147 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.147 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.147 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.147 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.147 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.147 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.147 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.147 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.147 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.148 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "k8sevents", 2024-01-31T05:14:23.148 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.148 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.148 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.148 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_event_retention_days": { 2024-01-31T05:14:23.148 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ceph_event_retention_days", 2024-01-31T05:14:23.148 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.148 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.148 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.148 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "7", 2024-01-31T05:14:23.148 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.148 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.148 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.148 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Days to hold ceph event information within local cache", 2024-01-31T05:14:23.149 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.149 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.149 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.149 INFO:teuthology.orchestra.run.smithi099.stdout: "config_check_secs": { 2024-01-31T05:14:23.149 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "config_check_secs", 2024-01-31T05:14:23.149 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.149 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.149 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.149 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10", 2024-01-31T05:14:23.149 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "10", 2024-01-31T05:14:23.149 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.149 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.149 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-01-31T05:14:23.150 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.150 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.150 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.150 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.150 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.150 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.150 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.150 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.150 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.150 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.150 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.150 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.150 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.150 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.151 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.151 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.151 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.151 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.151 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.151 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.151 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.151 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.151 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.151 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.151 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.151 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.151 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.151 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.152 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.152 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.152 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.152 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.152 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.152 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.152 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.152 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.152 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.152 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.152 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.152 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.153 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.153 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.153 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.153 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.153 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.153 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.153 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.153 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.153 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.153 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.153 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.153 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.153 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.153 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.153 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.154 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.154 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.154 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.154 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.154 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.154 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.154 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.154 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.154 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.154 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.154 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.154 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.154 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.154 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.154 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.155 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.155 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "localpool", 2024-01-31T05:14:23.155 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.155 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.155 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.155 INFO:teuthology.orchestra.run.smithi099.stdout: "failure_domain": { 2024-01-31T05:14:23.155 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "failure_domain", 2024-01-31T05:14:23.155 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.155 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.155 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.155 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "host", 2024-01-31T05:14:23.155 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.155 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.156 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.156 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "failure domain for any created local pool", 2024-01-31T05:14:23.156 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-01-31T05:14:23.156 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.156 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.156 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.156 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.156 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.156 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.156 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.156 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.156 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.156 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.157 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.157 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.157 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.157 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.157 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.157 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.157 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.157 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.157 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.157 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.157 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.157 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.157 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.157 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.158 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.158 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.158 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.158 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.158 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.158 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.158 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.158 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.158 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.158 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.158 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.158 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.158 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.159 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.159 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.159 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.159 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.159 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.159 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.159 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.159 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.159 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.159 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.159 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.159 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.159 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.160 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.160 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.160 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.160 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.160 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.160 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.160 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.160 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.160 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.160 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.160 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.160 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.160 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.161 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.161 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.161 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.161 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.161 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.161 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": { 2024-01-31T05:14:23.161 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "min_size", 2024-01-31T05:14:23.161 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.161 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.161 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.161 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.161 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.161 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.161 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.162 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "default min_size for any created local pool", 2024-01-31T05:14:23.162 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-01-31T05:14:23.162 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.162 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.162 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rep": { 2024-01-31T05:14:23.162 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "num_rep", 2024-01-31T05:14:23.162 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.162 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.162 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.162 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "3", 2024-01-31T05:14:23.162 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.162 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.162 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.163 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "default replica count for any created local pool", 2024-01-31T05:14:23.163 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.163 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.163 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.163 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": { 2024-01-31T05:14:23.163 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "pg_num", 2024-01-31T05:14:23.163 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.163 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.163 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.163 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "128", 2024-01-31T05:14:23.163 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.163 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.163 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.164 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "default pg_num for any created local pool", 2024-01-31T05:14:23.164 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.164 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.164 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.164 INFO:teuthology.orchestra.run.smithi099.stdout: "prefix": { 2024-01-31T05:14:23.164 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "prefix", 2024-01-31T05:14:23.164 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.164 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.164 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.164 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.164 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.164 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.165 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.165 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "name prefix for any created local pool", 2024-01-31T05:14:23.165 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.165 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.165 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.165 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.165 INFO:teuthology.orchestra.run.smithi099.stdout: "subtree": { 2024-01-31T05:14:23.165 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "subtree", 2024-01-31T05:14:23.165 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.165 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.165 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.165 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "rack", 2024-01-31T05:14:23.165 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.165 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.166 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.166 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "CRUSH level for which to create a local pool", 2024-01-31T05:14:23.166 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-01-31T05:14:23.166 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.166 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.166 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.166 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.166 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "mds_autoscaler", 2024-01-31T05:14:23.166 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.166 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.166 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.166 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.166 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.167 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.167 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.167 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.167 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.167 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.167 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.167 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.167 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.167 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.167 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.167 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.167 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.167 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.167 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.168 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.168 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.168 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.168 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.168 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.168 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.168 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.168 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.168 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.168 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.168 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.168 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.168 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.168 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.169 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.169 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.169 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.169 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.169 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.169 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.169 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.169 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.169 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.169 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.169 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.169 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.169 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.169 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.170 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.170 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.170 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.170 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.170 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.170 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.170 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.170 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.170 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.170 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.170 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.170 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.170 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.170 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.171 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.171 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.171 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.171 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.171 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.171 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.171 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.171 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.171 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.171 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.171 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.171 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "mirroring", 2024-01-31T05:14:23.172 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.172 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.172 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.172 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.172 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.172 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.172 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.172 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.172 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.172 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.172 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.172 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.172 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.172 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.173 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.173 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.173 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.173 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.173 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.173 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.173 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.173 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.173 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.173 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.173 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.174 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.174 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.174 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.174 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.174 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.174 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.174 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.174 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.174 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.174 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.174 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.174 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.174 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.174 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.175 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.175 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.175 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.175 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.175 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.175 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.175 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.175 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.175 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.175 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.175 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.175 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.175 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.175 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.175 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.176 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.176 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.176 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.176 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.176 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.176 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.176 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.176 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.176 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.176 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.176 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.176 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.177 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.177 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.177 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.177 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.177 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.177 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.177 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.177 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "nfs", 2024-01-31T05:14:23.177 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.177 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.177 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.177 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.178 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.178 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.178 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.178 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.178 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.178 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.178 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.178 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.178 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.178 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.178 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.178 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.178 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.178 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.178 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.179 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.179 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.179 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.179 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.179 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.179 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.179 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.179 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.179 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.179 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.179 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.179 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.179 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.179 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.180 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.180 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.180 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.180 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.180 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.180 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.180 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.180 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.180 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.180 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.180 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.180 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.180 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.181 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.181 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.181 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.181 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.181 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.181 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.181 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.181 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.181 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.181 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.181 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.181 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.181 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.181 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.182 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.182 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.182 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.182 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.182 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.182 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.182 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.182 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.182 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.182 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.182 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.182 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.182 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.182 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.183 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.183 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.183 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "orchestrator", 2024-01-31T05:14:23.183 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.183 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.183 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.183 INFO:teuthology.orchestra.run.smithi099.stdout: "fail_fs": { 2024-01-31T05:14:23.183 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "fail_fs", 2024-01-31T05:14:23.183 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.183 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.183 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.183 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.183 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.183 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.183 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.184 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-01-31T05:14:23.184 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.184 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.184 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.184 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.184 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.184 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.184 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.184 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.184 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.184 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.184 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.184 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.185 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.185 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.185 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.185 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.185 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.185 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.185 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.185 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.185 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.185 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.185 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.185 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.185 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.185 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.185 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.186 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.186 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.186 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.186 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.186 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.186 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.186 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.186 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.186 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.186 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.186 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.186 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.186 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.186 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.186 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.187 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.187 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.187 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.187 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.187 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.187 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.187 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.187 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.187 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.187 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.187 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.187 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.187 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.187 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.187 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.188 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.188 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.188 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.188 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.188 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.188 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.188 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.188 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.188 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.188 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.188 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.188 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.188 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.189 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.189 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.189 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.189 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.189 INFO:teuthology.orchestra.run.smithi099.stdout: "orchestrator": { 2024-01-31T05:14:23.189 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "orchestrator", 2024-01-31T05:14:23.189 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.189 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.189 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.189 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.189 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.189 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.189 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.189 INFO:teuthology.orchestra.run.smithi099.stdout: "cephadm", 2024-01-31T05:14:23.189 INFO:teuthology.orchestra.run.smithi099.stdout: "rook", 2024-01-31T05:14:23.190 INFO:teuthology.orchestra.run.smithi099.stdout: "test_orchestrator" 2024-01-31T05:14:23.190 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.190 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Orchestrator backend", 2024-01-31T05:14:23.190 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.190 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.190 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.190 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.190 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.190 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.190 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "osd_perf_query", 2024-01-31T05:14:23.190 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.190 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.190 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.190 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.191 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.191 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.191 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.191 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.191 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.191 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.191 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.191 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.191 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.191 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.191 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.191 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.191 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.191 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.191 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.192 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.192 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.192 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.192 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.192 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.192 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.192 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.192 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.192 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.192 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.192 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.192 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.192 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.193 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.193 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.193 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.193 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.193 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.193 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.193 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.193 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.193 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.193 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.193 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.193 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.193 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.193 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.194 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.194 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.194 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.194 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.194 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.194 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.194 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.194 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.194 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.194 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.194 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.194 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.194 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.195 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.195 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.195 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.195 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.195 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.195 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.195 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.195 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.195 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.195 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.195 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.195 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.195 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.195 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "osd_support", 2024-01-31T05:14:23.196 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.196 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.196 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.196 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.196 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.196 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.196 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.196 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.196 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.196 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.196 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.196 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.196 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.197 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.197 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.197 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.197 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.197 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.197 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.197 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.197 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.197 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.197 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.197 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.197 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.197 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.197 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.197 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.197 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.198 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.198 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.198 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.198 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.198 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.198 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.198 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.198 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.198 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.198 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.198 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.198 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.198 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.199 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.199 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.199 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.199 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.199 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.199 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.199 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.199 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.199 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.199 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.199 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.199 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.199 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.199 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.200 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.200 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.200 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.200 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.200 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.200 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.200 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.200 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.200 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.200 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.200 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.200 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.200 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.201 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.201 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.201 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.201 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "pg_autoscaler", 2024-01-31T05:14:23.201 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.201 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.201 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.201 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.201 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.201 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.201 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.201 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.202 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.202 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.202 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.202 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.202 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.202 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.202 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.202 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.202 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.202 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.202 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.202 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.202 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.202 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.203 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.203 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.203 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.203 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.203 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.203 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.203 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.203 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.203 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.203 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.203 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.203 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.203 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.203 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.204 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.204 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.204 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.204 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.204 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.204 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.204 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.204 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.204 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.204 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.204 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.204 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.204 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.204 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.205 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.205 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.205 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.205 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.205 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.205 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.205 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.205 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.205 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.205 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.205 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.205 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.205 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.205 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.206 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.206 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.206 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.206 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.206 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.206 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.206 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.206 INFO:teuthology.orchestra.run.smithi099.stdout: "sleep_interval": { 2024-01-31T05:14:23.206 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "sleep_interval", 2024-01-31T05:14:23.206 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:23.206 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.206 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.206 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "60", 2024-01-31T05:14:23.207 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.207 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.207 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.207 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.207 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.207 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.207 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.207 INFO:teuthology.orchestra.run.smithi099.stdout: "threshold": { 2024-01-31T05:14:23.207 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "threshold", 2024-01-31T05:14:23.207 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "float", 2024-01-31T05:14:23.207 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.207 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.207 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "3.0", 2024-01-31T05:14:23.208 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "1.0", 2024-01-31T05:14:23.208 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.208 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.208 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "scaling threshold", 2024-01-31T05:14:23.208 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-01-31T05:14:23.208 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.208 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.208 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.208 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.208 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "progress", 2024-01-31T05:14:23.208 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.208 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.209 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.209 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_pg_recovery_event": { 2024-01-31T05:14:23.209 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "allow_pg_recovery_event", 2024-01-31T05:14:23.209 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.209 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.209 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.209 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.209 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.209 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.209 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.209 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "allow the module to show pg recovery progress", 2024-01-31T05:14:23.209 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.209 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.209 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.210 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": { 2024-01-31T05:14:23.210 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "enabled", 2024-01-31T05:14:23.210 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.210 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.210 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.210 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.210 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.210 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.210 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.210 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.210 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.210 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.210 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.211 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.211 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.211 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.211 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.211 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.211 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.211 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.211 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.211 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.211 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.211 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.211 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.211 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.211 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.212 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.212 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.212 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.212 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.212 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.212 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.212 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.212 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.212 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.212 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.212 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.212 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.212 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.213 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.213 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.213 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.213 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.213 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.213 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.213 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.213 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.213 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.213 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.213 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.213 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.213 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.214 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.214 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.214 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.214 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.214 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.214 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.214 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.214 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.214 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.214 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.214 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.214 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.214 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.215 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.215 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.215 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.215 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.215 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.215 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.215 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.215 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.215 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.215 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.215 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.215 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.215 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.216 INFO:teuthology.orchestra.run.smithi099.stdout: "max_completed_events": { 2024-01-31T05:14:23.216 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "max_completed_events", 2024-01-31T05:14:23.216 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.216 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.216 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.216 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "50", 2024-01-31T05:14:23.216 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.216 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.216 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.216 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "number of past completed events to remember", 2024-01-31T05:14:23.216 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.216 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.216 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.217 INFO:teuthology.orchestra.run.smithi099.stdout: "sleep_interval": { 2024-01-31T05:14:23.217 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "sleep_interval", 2024-01-31T05:14:23.217 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:23.217 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.217 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.217 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "5", 2024-01-31T05:14:23.217 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.217 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.217 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.217 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how long the module is going to sleep", 2024-01-31T05:14:23.217 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.217 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.217 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.218 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.218 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.218 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "prometheus", 2024-01-31T05:14:23.218 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.218 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.218 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.218 INFO:teuthology.orchestra.run.smithi099.stdout: "cache": { 2024-01-31T05:14:23.218 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "cache", 2024-01-31T05:14:23.218 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.218 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.218 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.218 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.219 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.219 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.219 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.219 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.219 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.219 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.219 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.219 INFO:teuthology.orchestra.run.smithi099.stdout: "exclude_perf_counters": { 2024-01-31T05:14:23.219 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "exclude_perf_counters", 2024-01-31T05:14:23.219 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.219 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.219 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.219 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.220 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.220 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.220 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.220 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-01-31T05:14:23.220 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-01-31T05:14:23.220 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.220 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.220 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.220 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.220 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.220 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.220 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.220 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.221 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.221 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.221 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.221 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.221 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.221 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.221 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.221 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.221 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.221 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.221 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.221 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.221 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.221 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.222 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.222 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.222 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.222 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.222 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.222 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.222 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.222 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.222 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.222 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.222 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.222 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.222 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.223 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.223 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.223 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.223 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.223 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.223 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.223 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.223 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.223 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.223 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.223 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.223 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.223 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.223 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.223 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.224 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.224 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.224 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.224 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.224 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.224 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.224 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.224 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.224 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.224 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.224 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.224 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.224 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.225 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.225 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.225 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.225 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.225 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.225 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_stats_pools": { 2024-01-31T05:14:23.225 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rbd_stats_pools", 2024-01-31T05:14:23.225 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.225 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.225 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.225 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.225 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.225 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.226 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.226 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.226 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.226 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.226 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.226 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_stats_pools_refresh_interval": { 2024-01-31T05:14:23.226 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-01-31T05:14:23.226 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.226 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.226 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.226 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "300", 2024-01-31T05:14:23.226 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.226 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.226 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.227 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.227 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.227 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.227 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.227 INFO:teuthology.orchestra.run.smithi099.stdout: "scrape_interval": { 2024-01-31T05:14:23.227 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "scrape_interval", 2024-01-31T05:14:23.227 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "float", 2024-01-31T05:14:23.227 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.227 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.227 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "15.0", 2024-01-31T05:14:23.227 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.227 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.227 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.228 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.228 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.228 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.228 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.228 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.228 INFO:teuthology.orchestra.run.smithi099.stdout: "server_addr": { 2024-01-31T05:14:23.228 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "server_addr", 2024-01-31T05:14:23.228 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.228 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.228 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.228 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "::", 2024-01-31T05:14:23.228 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.228 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.228 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.229 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-01-31T05:14:23.229 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.229 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.229 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.229 INFO:teuthology.orchestra.run.smithi099.stdout: "server_port": { 2024-01-31T05:14:23.229 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "server_port", 2024-01-31T05:14:23.229 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.229 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.229 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.229 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "9283", 2024-01-31T05:14:23.229 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.230 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.230 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.230 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-01-31T05:14:23.230 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.230 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.230 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.230 INFO:teuthology.orchestra.run.smithi099.stdout: "stale_cache_strategy": { 2024-01-31T05:14:23.230 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "stale_cache_strategy", 2024-01-31T05:14:23.230 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.230 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.230 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.230 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "log", 2024-01-31T05:14:23.230 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.231 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.231 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.231 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.231 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.231 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.231 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.231 INFO:teuthology.orchestra.run.smithi099.stdout: "standby_behaviour": { 2024-01-31T05:14:23.231 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "standby_behaviour", 2024-01-31T05:14:23.231 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.231 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.231 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.231 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "default", 2024-01-31T05:14:23.231 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.231 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.232 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.232 INFO:teuthology.orchestra.run.smithi099.stdout: "default", 2024-01-31T05:14:23.232 INFO:teuthology.orchestra.run.smithi099.stdout: "error" 2024-01-31T05:14:23.232 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.232 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.232 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.232 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.232 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.232 INFO:teuthology.orchestra.run.smithi099.stdout: "standby_error_status_code": { 2024-01-31T05:14:23.232 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "standby_error_status_code", 2024-01-31T05:14:23.232 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.232 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.232 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.233 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "500", 2024-01-31T05:14:23.233 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "400", 2024-01-31T05:14:23.233 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "599", 2024-01-31T05:14:23.233 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.233 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.233 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.233 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.233 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.233 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.233 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.233 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.233 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.233 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rbd_support", 2024-01-31T05:14:23.233 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.234 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.234 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.234 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.234 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.234 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.234 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.234 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.234 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.234 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.234 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.234 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.234 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.234 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.234 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.234 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.235 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.235 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.235 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.235 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.235 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.235 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.235 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.235 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.235 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.235 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.235 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.235 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.235 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.236 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.236 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.236 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.236 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.236 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.236 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.236 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.236 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.236 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.236 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.236 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.236 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.237 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.237 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.237 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.237 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.237 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.237 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.237 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.237 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.237 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.237 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.237 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.237 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.237 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.237 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.238 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.238 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.238 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.238 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.238 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.238 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.238 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.238 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.238 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.238 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.238 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.238 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.238 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.239 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.239 INFO:teuthology.orchestra.run.smithi099.stdout: "max_concurrent_snap_create": { 2024-01-31T05:14:23.239 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "max_concurrent_snap_create", 2024-01-31T05:14:23.239 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.239 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.239 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.239 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10", 2024-01-31T05:14:23.239 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.239 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.239 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.239 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.239 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.239 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.240 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.240 INFO:teuthology.orchestra.run.smithi099.stdout: "mirror_snapshot_schedule": { 2024-01-31T05:14:23.240 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "mirror_snapshot_schedule", 2024-01-31T05:14:23.240 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.240 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.240 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.240 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.240 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.240 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.240 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.240 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.241 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.241 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.241 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.241 INFO:teuthology.orchestra.run.smithi099.stdout: "trash_purge_schedule": { 2024-01-31T05:14:23.241 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "trash_purge_schedule", 2024-01-31T05:14:23.241 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.241 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.241 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.241 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.241 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.241 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.241 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.242 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.242 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.242 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.242 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.242 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.242 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.242 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "restful", 2024-01-31T05:14:23.242 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.242 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.242 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.242 INFO:teuthology.orchestra.run.smithi099.stdout: "enable_auth": { 2024-01-31T05:14:23.242 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "enable_auth", 2024-01-31T05:14:23.243 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.243 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.243 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.243 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.243 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.243 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.243 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.243 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.243 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.243 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.243 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.243 INFO:teuthology.orchestra.run.smithi099.stdout: "key_file": { 2024-01-31T05:14:23.243 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "key_file", 2024-01-31T05:14:23.244 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.244 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.244 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.244 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.244 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.244 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.244 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.244 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.244 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.244 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.244 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.244 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.245 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.245 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.245 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.245 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.245 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.245 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.245 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.245 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.245 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.245 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.245 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.245 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.245 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.246 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.246 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.246 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.246 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.246 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.246 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.246 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.246 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.246 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.246 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.246 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.246 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.246 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.246 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.247 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.247 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.247 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.247 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.247 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.247 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.247 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.247 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.247 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.247 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.247 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.247 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.247 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.248 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.248 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.248 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.248 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.248 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.248 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.248 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.248 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.248 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.248 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.248 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.248 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.248 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.249 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.249 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.249 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.249 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.249 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.249 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.249 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.249 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.249 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.249 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.249 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.249 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.249 INFO:teuthology.orchestra.run.smithi099.stdout: "server_addr": { 2024-01-31T05:14:23.250 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "server_addr", 2024-01-31T05:14:23.250 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.250 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.250 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.250 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.250 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.250 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.250 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.250 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.250 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.250 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.250 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.251 INFO:teuthology.orchestra.run.smithi099.stdout: "server_port": { 2024-01-31T05:14:23.251 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "server_port", 2024-01-31T05:14:23.251 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.251 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.251 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.251 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.251 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.251 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.251 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.251 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.251 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.251 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.251 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.251 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.252 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.252 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rgw", 2024-01-31T05:14:23.252 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.252 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.252 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.252 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.252 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.252 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.252 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.252 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.252 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.253 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.253 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.253 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.253 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.253 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.253 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.253 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.253 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.253 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.253 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.253 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.253 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.253 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.253 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.254 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.254 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.254 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.254 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.254 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.254 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.254 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.254 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.254 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.254 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.254 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.254 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.254 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.255 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.255 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.255 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.255 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.255 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.255 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.255 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.255 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.255 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.255 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.255 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.255 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.255 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.255 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.255 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.256 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.256 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.256 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.256 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.256 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.256 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.256 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.256 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.256 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.256 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.256 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.256 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.257 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.257 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.257 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.257 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.257 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.257 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.257 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.257 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.257 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rook", 2024-01-31T05:14:23.257 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.257 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.257 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.257 INFO:teuthology.orchestra.run.smithi099.stdout: "drive_group_interval": { 2024-01-31T05:14:23.258 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "drive_group_interval", 2024-01-31T05:14:23.258 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "float", 2024-01-31T05:14:23.258 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.258 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.258 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "300.0", 2024-01-31T05:14:23.258 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.258 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.258 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.258 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2024-01-31T05:14:23.258 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.258 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.258 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.258 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.258 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.259 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.259 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.259 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.259 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.259 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.259 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.259 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.259 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.259 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.259 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.259 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.259 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.259 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.259 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.260 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.260 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.260 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.260 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.260 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.260 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.260 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.260 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.260 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.260 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.260 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.260 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.260 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.261 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.261 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.261 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.261 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.261 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.261 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.261 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.261 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.261 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.261 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.261 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.261 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.261 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.261 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.262 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.262 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.262 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.262 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.262 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.262 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.262 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.262 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.262 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.262 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.262 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.262 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.262 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.262 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.262 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.263 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.263 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.263 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.263 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.263 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.263 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.263 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.263 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.263 INFO:teuthology.orchestra.run.smithi099.stdout: "storage_class": { 2024-01-31T05:14:23.263 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "storage_class", 2024-01-31T05:14:23.263 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.263 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.263 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.264 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "local", 2024-01-31T05:14:23.264 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.264 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.264 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.264 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-01-31T05:14:23.264 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.264 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.264 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.264 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.264 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.264 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "selftest", 2024-01-31T05:14:23.265 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.265 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.265 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.265 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.265 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.265 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.265 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.265 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.265 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.265 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.265 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.265 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.265 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.265 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.266 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.266 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.266 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.266 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.266 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.266 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.266 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.266 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.266 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.266 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.266 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.266 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.266 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.266 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.267 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.267 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.267 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.267 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.267 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.267 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.267 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.267 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.267 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.267 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.267 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.267 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.267 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.267 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.268 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.268 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.268 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.268 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.268 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.268 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.268 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.268 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.268 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.268 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.268 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.268 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.268 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.268 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.269 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.269 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.269 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.269 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.269 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.269 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.269 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.269 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.269 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.269 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.269 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.269 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.269 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.270 INFO:teuthology.orchestra.run.smithi099.stdout: "roption1": { 2024-01-31T05:14:23.270 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "roption1", 2024-01-31T05:14:23.270 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.270 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.270 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.270 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.270 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.270 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.270 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.270 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.270 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.270 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.270 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.271 INFO:teuthology.orchestra.run.smithi099.stdout: "roption2": { 2024-01-31T05:14:23.271 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "roption2", 2024-01-31T05:14:23.271 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.271 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.271 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.271 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "xyz", 2024-01-31T05:14:23.271 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.271 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.271 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.271 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.271 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.271 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.271 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.272 INFO:teuthology.orchestra.run.smithi099.stdout: "rwoption1": { 2024-01-31T05:14:23.272 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rwoption1", 2024-01-31T05:14:23.272 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.272 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.272 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.272 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.272 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.272 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.272 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.272 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.272 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.272 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.272 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.273 INFO:teuthology.orchestra.run.smithi099.stdout: "rwoption2": { 2024-01-31T05:14:23.273 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rwoption2", 2024-01-31T05:14:23.273 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.273 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.273 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.273 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.273 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.273 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.273 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.273 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.273 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.273 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.273 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.274 INFO:teuthology.orchestra.run.smithi099.stdout: "rwoption3": { 2024-01-31T05:14:23.274 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rwoption3", 2024-01-31T05:14:23.274 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "float", 2024-01-31T05:14:23.274 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.274 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.274 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.274 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.274 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.274 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.274 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.274 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.274 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.274 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.275 INFO:teuthology.orchestra.run.smithi099.stdout: "rwoption4": { 2024-01-31T05:14:23.275 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rwoption4", 2024-01-31T05:14:23.275 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.275 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.275 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.275 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.275 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.275 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.275 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.275 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.275 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.275 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.275 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.276 INFO:teuthology.orchestra.run.smithi099.stdout: "rwoption5": { 2024-01-31T05:14:23.276 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rwoption5", 2024-01-31T05:14:23.276 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.276 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.276 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.276 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.276 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.276 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.276 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.276 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.276 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.276 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.276 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.276 INFO:teuthology.orchestra.run.smithi099.stdout: "rwoption6": { 2024-01-31T05:14:23.277 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rwoption6", 2024-01-31T05:14:23.277 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.277 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.277 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.277 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.277 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.277 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.277 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.277 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.277 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.277 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.277 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.277 INFO:teuthology.orchestra.run.smithi099.stdout: "rwoption7": { 2024-01-31T05:14:23.278 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rwoption7", 2024-01-31T05:14:23.278 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.278 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.278 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.278 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.278 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "1", 2024-01-31T05:14:23.278 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "42", 2024-01-31T05:14:23.278 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.278 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.278 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.278 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.278 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.278 INFO:teuthology.orchestra.run.smithi099.stdout: "testkey": { 2024-01-31T05:14:23.278 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "testkey", 2024-01-31T05:14:23.279 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.279 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.279 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.279 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.279 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.279 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.279 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.279 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.279 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.279 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.279 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.279 INFO:teuthology.orchestra.run.smithi099.stdout: "testlkey": { 2024-01-31T05:14:23.279 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "testlkey", 2024-01-31T05:14:23.280 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.280 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.280 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.280 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.280 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.280 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.280 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.280 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.280 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.280 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.280 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.280 INFO:teuthology.orchestra.run.smithi099.stdout: "testnewline": { 2024-01-31T05:14:23.280 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "testnewline", 2024-01-31T05:14:23.281 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.281 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.281 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.281 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.281 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.281 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.281 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.281 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.281 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.281 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.281 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.281 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.281 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.282 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "snap_schedule", 2024-01-31T05:14:23.282 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.282 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.282 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.282 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_m_granularity": { 2024-01-31T05:14:23.282 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "allow_m_granularity", 2024-01-31T05:14:23.282 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.282 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.282 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.282 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.282 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.282 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.282 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.282 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "allow minute scheduled snapshots", 2024-01-31T05:14:23.282 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.283 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.283 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.283 INFO:teuthology.orchestra.run.smithi099.stdout: "dump_on_update": { 2024-01-31T05:14:23.283 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "dump_on_update", 2024-01-31T05:14:23.283 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.283 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.283 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.283 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.283 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.283 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.283 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.283 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "dump database to debug log on update", 2024-01-31T05:14:23.284 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.284 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.284 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.284 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.284 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.284 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.284 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.284 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.284 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.284 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.284 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.284 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.284 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.285 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.285 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.285 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.285 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.285 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.285 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.285 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.285 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.285 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.285 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.285 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.285 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.285 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.286 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.286 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.286 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.286 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.286 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.286 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.286 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.286 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.286 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.286 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.286 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.286 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.286 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.286 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.287 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.287 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.287 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.287 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.287 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.287 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.287 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.287 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.287 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.287 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.287 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.287 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.287 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.287 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.287 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.288 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.288 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.288 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.288 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.288 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.288 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.288 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.288 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.288 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.288 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.288 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.288 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.288 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.288 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.289 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.289 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.289 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "stats", 2024-01-31T05:14:23.289 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.289 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.289 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.289 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.289 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.289 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.289 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.289 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.289 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.289 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.290 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.290 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.290 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.290 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.290 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.290 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.290 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.290 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.290 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.290 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.290 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.290 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.290 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.290 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.290 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.291 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.291 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.291 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.291 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.291 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.291 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.291 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.291 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.291 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.291 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.291 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.291 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.291 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.292 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.292 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.292 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.292 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.292 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.292 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.292 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.292 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.292 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.292 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.292 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.292 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.292 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.292 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.293 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.293 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.293 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.293 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.293 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.293 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.293 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.293 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.293 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.293 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.293 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.293 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.293 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.293 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.294 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.294 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.294 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.294 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.294 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.294 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "status", 2024-01-31T05:14:23.294 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.294 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.294 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.294 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.294 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.294 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.294 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.294 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.295 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.295 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.295 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.295 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.295 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.295 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.295 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.295 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.295 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.295 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.295 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.295 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.295 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.295 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.296 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.296 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.296 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.296 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.296 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.296 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.296 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.296 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.296 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.296 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.296 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.297 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.297 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.297 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.297 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.297 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.297 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.297 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.297 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.297 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.297 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.297 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.297 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.297 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.297 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.298 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.298 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.298 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.298 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.298 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.298 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.298 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.298 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.298 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.298 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.298 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.298 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.298 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.299 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.299 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.299 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.299 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.299 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.299 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.299 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.299 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.299 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.299 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.299 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.299 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "telegraf", 2024-01-31T05:14:23.299 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.300 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.300 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.300 INFO:teuthology.orchestra.run.smithi099.stdout: "address": { 2024-01-31T05:14:23.300 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "address", 2024-01-31T05:14:23.300 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.300 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.300 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.300 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-01-31T05:14:23.300 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.300 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.300 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.300 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.300 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.300 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.301 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.301 INFO:teuthology.orchestra.run.smithi099.stdout: "interval": { 2024-01-31T05:14:23.301 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "interval", 2024-01-31T05:14:23.301 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:23.301 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.301 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.301 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "15", 2024-01-31T05:14:23.301 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.301 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.301 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.301 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.301 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.301 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.302 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.302 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.302 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.302 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.302 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.302 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.302 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.302 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.302 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.302 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.302 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.302 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.302 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.302 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.303 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.303 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.303 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.303 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.303 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.303 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.303 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.303 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.303 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.303 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.303 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.303 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.303 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.303 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.304 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.304 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.304 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.304 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.304 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.304 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.304 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.304 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.304 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.304 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.304 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.304 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.305 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.305 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.305 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.305 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.305 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.305 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.305 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.305 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.305 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.305 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.305 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.305 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.305 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.305 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.306 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.306 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.306 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.306 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.306 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.306 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.306 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.306 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.306 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.306 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.306 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.306 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.306 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.306 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.307 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.307 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "telemetry", 2024-01-31T05:14:23.307 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.307 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.307 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.307 INFO:teuthology.orchestra.run.smithi099.stdout: "channel_basic": { 2024-01-31T05:14:23.307 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "channel_basic", 2024-01-31T05:14:23.307 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.307 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.307 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.307 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.308 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.308 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.308 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.308 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Share basic cluster information (size, version)", 2024-01-31T05:14:23.308 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.308 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.308 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.308 INFO:teuthology.orchestra.run.smithi099.stdout: "channel_crash": { 2024-01-31T05:14:23.308 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "channel_crash", 2024-01-31T05:14:23.308 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.308 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.308 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.308 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.309 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.309 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.309 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.309 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-01-31T05:14:23.309 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.309 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.309 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.309 INFO:teuthology.orchestra.run.smithi099.stdout: "channel_device": { 2024-01-31T05:14:23.309 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "channel_device", 2024-01-31T05:14:23.309 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.309 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.309 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.310 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.310 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.310 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.310 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.310 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-01-31T05:14:23.310 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.310 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.310 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.310 INFO:teuthology.orchestra.run.smithi099.stdout: "channel_ident": { 2024-01-31T05:14:23.310 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "channel_ident", 2024-01-31T05:14:23.310 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.310 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.310 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.310 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.311 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.311 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.311 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.311 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-01-31T05:14:23.311 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.311 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.311 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.311 INFO:teuthology.orchestra.run.smithi099.stdout: "channel_perf": { 2024-01-31T05:14:23.311 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "channel_perf", 2024-01-31T05:14:23.311 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.311 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.311 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.311 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.312 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.312 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.312 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.312 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Share various performance metrics of a cluster", 2024-01-31T05:14:23.312 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.312 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.312 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.312 INFO:teuthology.orchestra.run.smithi099.stdout: "contact": { 2024-01-31T05:14:23.312 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "contact", 2024-01-31T05:14:23.312 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.312 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.313 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.313 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.313 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.313 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.313 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.313 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.313 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.313 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.313 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.313 INFO:teuthology.orchestra.run.smithi099.stdout: "description": { 2024-01-31T05:14:23.313 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "description", 2024-01-31T05:14:23.313 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.313 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.314 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.314 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.314 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.314 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.314 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.314 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.314 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.314 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.314 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.314 INFO:teuthology.orchestra.run.smithi099.stdout: "device_url": { 2024-01-31T05:14:23.314 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "device_url", 2024-01-31T05:14:23.314 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.315 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.315 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.315 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-01-31T05:14:23.315 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.315 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.315 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.315 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.315 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.315 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.315 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.315 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": { 2024-01-31T05:14:23.315 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "enabled", 2024-01-31T05:14:23.315 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.315 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.316 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.316 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.316 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.316 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.316 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.316 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.316 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.316 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.316 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.316 INFO:teuthology.orchestra.run.smithi099.stdout: "interval": { 2024-01-31T05:14:23.316 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "interval", 2024-01-31T05:14:23.316 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.316 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.317 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.317 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "24", 2024-01-31T05:14:23.317 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "8", 2024-01-31T05:14:23.317 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.317 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.317 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.317 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.317 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.317 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.317 INFO:teuthology.orchestra.run.smithi099.stdout: "last_opt_revision": { 2024-01-31T05:14:23.317 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "last_opt_revision", 2024-01-31T05:14:23.317 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.317 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.318 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.318 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "1", 2024-01-31T05:14:23.318 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.318 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.318 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.318 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.318 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.318 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.318 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.318 INFO:teuthology.orchestra.run.smithi099.stdout: "leaderboard": { 2024-01-31T05:14:23.318 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "leaderboard", 2024-01-31T05:14:23.318 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.318 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.318 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.319 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.319 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.319 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.319 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.319 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.319 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.319 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.319 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.319 INFO:teuthology.orchestra.run.smithi099.stdout: "leaderboard_description": { 2024-01-31T05:14:23.319 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "leaderboard_description", 2024-01-31T05:14:23.319 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.319 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.319 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.319 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.320 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.320 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.320 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.320 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.320 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.320 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.320 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.320 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.320 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.320 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.320 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.320 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.320 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.321 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.321 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.321 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.321 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.321 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.321 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.321 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.321 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.321 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.321 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.321 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.321 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.321 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.321 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.322 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.322 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.322 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.322 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.322 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.322 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.322 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.322 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.322 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.322 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.322 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.322 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.322 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.323 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.323 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.323 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.323 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.323 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.323 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.323 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.323 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.323 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.323 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.323 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.323 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.323 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.324 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.324 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.324 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.324 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.324 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.324 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.324 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.324 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.324 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.324 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.324 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.324 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.325 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.325 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.325 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.325 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.325 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.325 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.325 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.325 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.325 INFO:teuthology.orchestra.run.smithi099.stdout: "organization": { 2024-01-31T05:14:23.325 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "organization", 2024-01-31T05:14:23.325 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.325 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.325 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.325 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.326 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.326 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.326 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.326 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.326 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.326 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.326 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.326 INFO:teuthology.orchestra.run.smithi099.stdout: "proxy": { 2024-01-31T05:14:23.326 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "proxy", 2024-01-31T05:14:23.326 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.326 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.326 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.326 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.326 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.327 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.327 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.327 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.327 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.327 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.327 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.327 INFO:teuthology.orchestra.run.smithi099.stdout: "url": { 2024-01-31T05:14:23.327 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "url", 2024-01-31T05:14:23.327 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.327 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.327 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.327 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-01-31T05:14:23.327 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.328 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.328 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.328 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.328 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.328 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.328 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.328 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.328 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.328 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "test_orchestrator", 2024-01-31T05:14:23.328 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.328 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.329 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.329 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.329 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.329 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.329 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.329 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.329 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.329 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.329 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.329 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.329 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.329 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.329 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.329 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.329 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.330 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.330 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.330 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.330 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.330 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.330 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.330 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.330 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.330 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.330 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.330 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.330 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.330 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.330 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.330 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.331 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.331 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.331 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.331 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.331 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.331 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.331 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.331 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.331 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.331 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.331 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.331 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.331 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.331 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.331 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.332 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.332 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.332 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.332 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.332 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.332 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.332 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.332 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.332 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.332 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.332 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.332 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.333 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.333 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.333 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.333 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.333 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.333 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.333 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.333 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.333 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.333 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.333 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.333 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.333 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "volumes", 2024-01-31T05:14:23.333 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.334 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.334 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.334 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.334 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.334 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.334 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.334 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.334 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.334 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.334 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.334 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.334 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.334 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.334 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.334 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.335 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.335 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.335 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.335 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.335 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.335 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.335 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.335 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.335 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.335 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.335 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.335 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.335 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.335 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.335 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.335 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.336 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.336 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.336 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.336 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.336 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.336 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.336 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.336 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.336 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.336 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.336 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.336 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.336 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.337 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.337 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.337 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.337 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.337 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.337 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.337 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.337 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.337 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.337 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.337 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.337 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.337 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.337 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.337 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.338 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.338 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.338 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.338 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.338 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.338 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.338 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.338 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.338 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.338 INFO:teuthology.orchestra.run.smithi099.stdout: "max_concurrent_clones": { 2024-01-31T05:14:23.338 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "max_concurrent_clones", 2024-01-31T05:14:23.338 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.338 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.338 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.339 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "4", 2024-01-31T05:14:23.339 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.339 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.339 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.339 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Number of asynchronous cloner threads", 2024-01-31T05:14:23.339 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.339 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.339 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.339 INFO:teuthology.orchestra.run.smithi099.stdout: "periodic_async_work": { 2024-01-31T05:14:23.339 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "periodic_async_work", 2024-01-31T05:14:23.339 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.339 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.339 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.339 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.339 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.340 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.340 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.340 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Periodically check for async work", 2024-01-31T05:14:23.340 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.340 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.340 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.340 INFO:teuthology.orchestra.run.smithi099.stdout: "snapshot_clone_delay": { 2024-01-31T05:14:23.340 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "snapshot_clone_delay", 2024-01-31T05:14:23.340 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.340 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.340 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.340 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0", 2024-01-31T05:14:23.340 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.341 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.341 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.341 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-01-31T05:14:23.341 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.341 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.341 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.341 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.341 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.341 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "zabbix", 2024-01-31T05:14:23.341 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.341 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.341 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.341 INFO:teuthology.orchestra.run.smithi099.stdout: "discovery_interval": { 2024-01-31T05:14:23.342 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "discovery_interval", 2024-01-31T05:14:23.342 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "uint", 2024-01-31T05:14:23.342 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.342 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.342 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "100", 2024-01-31T05:14:23.342 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.342 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.342 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.342 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.342 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.342 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.342 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.342 INFO:teuthology.orchestra.run.smithi099.stdout: "identifier": { 2024-01-31T05:14:23.342 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "identifier", 2024-01-31T05:14:23.342 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.343 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.343 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.343 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.343 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.343 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.343 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.343 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.343 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.343 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.343 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.343 INFO:teuthology.orchestra.run.smithi099.stdout: "interval": { 2024-01-31T05:14:23.343 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "interval", 2024-01-31T05:14:23.343 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:23.343 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.343 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.343 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "60", 2024-01-31T05:14:23.344 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.344 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.344 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.344 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.344 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.344 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.344 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.344 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.344 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.344 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.344 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.344 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.344 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.345 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.345 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.345 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.345 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.345 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.345 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.345 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.345 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.345 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.345 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.345 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.345 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.345 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.345 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.345 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.346 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.346 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.346 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.346 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.346 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.346 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.346 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.346 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.346 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.346 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.346 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.346 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.346 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.346 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.346 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.347 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.347 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.347 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.347 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.347 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.347 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.347 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.347 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.347 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.347 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.347 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.347 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.347 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.347 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.347 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.348 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.348 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.348 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.348 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.348 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.348 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.348 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.348 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.348 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.348 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.348 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.348 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.348 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.349 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.349 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.349 INFO:teuthology.orchestra.run.smithi099.stdout: "zabbix_host": { 2024-01-31T05:14:23.349 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "zabbix_host", 2024-01-31T05:14:23.349 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.349 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.349 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.349 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.349 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.349 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.349 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.349 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.349 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.349 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.350 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.350 INFO:teuthology.orchestra.run.smithi099.stdout: "zabbix_port": { 2024-01-31T05:14:23.350 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "zabbix_port", 2024-01-31T05:14:23.350 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.350 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.350 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.350 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10051", 2024-01-31T05:14:23.350 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.350 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.350 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.350 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.350 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.350 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.350 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.351 INFO:teuthology.orchestra.run.smithi099.stdout: "zabbix_sender": { 2024-01-31T05:14:23.351 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "zabbix_sender", 2024-01-31T05:14:23.351 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.351 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.351 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.351 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-01-31T05:14:23.351 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.351 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.351 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.351 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.351 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.351 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.351 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.351 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.351 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.352 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.352 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-01-31T05:14:23.352 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.352 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.352 INFO:teuthology.orchestra.run.smithi099.stdout: "modules": [ 2024-01-31T05:14:23.352 INFO:teuthology.orchestra.run.smithi099.stdout: "cephadm", 2024-01-31T05:14:23.352 INFO:teuthology.orchestra.run.smithi099.stdout: "dashboard", 2024-01-31T05:14:23.352 INFO:teuthology.orchestra.run.smithi099.stdout: "iostat", 2024-01-31T05:14:23.352 INFO:teuthology.orchestra.run.smithi099.stdout: "nfs", 2024-01-31T05:14:23.352 INFO:teuthology.orchestra.run.smithi099.stdout: "restful" 2024-01-31T05:14:23.352 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.352 INFO:teuthology.orchestra.run.smithi099.stdout: "available_modules": [ 2024-01-31T05:14:23.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.352 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "alerts", 2024-01-31T05:14:23.352 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.353 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.353 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.353 INFO:teuthology.orchestra.run.smithi099.stdout: "interval": { 2024-01-31T05:14:23.353 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "interval", 2024-01-31T05:14:23.353 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:23.353 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.353 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.353 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "60", 2024-01-31T05:14:23.353 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.353 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.353 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.353 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "How frequently to reexamine health status", 2024-01-31T05:14:23.353 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.353 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.353 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.354 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.354 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.354 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.354 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.354 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.354 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.354 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.354 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.354 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.354 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.354 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.354 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.354 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.354 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.354 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.355 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.355 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.355 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.355 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.355 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.355 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.355 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.355 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.355 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.355 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.355 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.355 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.355 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.355 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.356 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.356 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.356 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.356 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.356 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.356 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.356 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.356 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.356 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.356 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.356 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.356 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.356 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.357 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.357 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.357 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.357 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.357 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.357 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.357 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.357 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.357 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.357 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.357 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.357 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.357 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.357 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.358 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.358 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.358 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.358 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.358 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.358 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.358 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.358 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.358 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.358 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.358 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_destination": { 2024-01-31T05:14:23.358 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_destination", 2024-01-31T05:14:23.358 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.358 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.359 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.359 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.359 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.359 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.359 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.359 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Email address to send alerts to", 2024-01-31T05:14:23.359 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.359 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.359 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.359 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_from_name": { 2024-01-31T05:14:23.359 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_from_name", 2024-01-31T05:14:23.359 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.359 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.360 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.360 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "Ceph", 2024-01-31T05:14:23.360 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.360 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.360 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.360 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Email From: name", 2024-01-31T05:14:23.360 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.360 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.360 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.360 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_host": { 2024-01-31T05:14:23.360 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_host", 2024-01-31T05:14:23.360 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.360 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.360 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.361 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.361 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.361 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.361 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.361 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "SMTP server", 2024-01-31T05:14:23.361 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.361 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.361 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.361 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_password": { 2024-01-31T05:14:23.361 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_password", 2024-01-31T05:14:23.361 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.361 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.361 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.361 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.361 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.362 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.362 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.362 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Password to authenticate with", 2024-01-31T05:14:23.362 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.362 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.362 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.362 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_port": { 2024-01-31T05:14:23.362 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_port", 2024-01-31T05:14:23.362 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.362 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.362 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.362 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "465", 2024-01-31T05:14:23.362 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.362 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.362 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.363 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "SMTP port", 2024-01-31T05:14:23.363 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.363 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.363 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.363 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_sender": { 2024-01-31T05:14:23.363 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_sender", 2024-01-31T05:14:23.363 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.363 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.363 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.363 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.363 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.363 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.363 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.364 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "SMTP envelope sender", 2024-01-31T05:14:23.364 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.364 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.364 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.364 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_ssl": { 2024-01-31T05:14:23.364 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_ssl", 2024-01-31T05:14:23.364 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.364 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.364 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.364 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.364 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.364 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.365 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.365 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Use SSL to connect to SMTP server", 2024-01-31T05:14:23.365 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.365 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.365 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.365 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_user": { 2024-01-31T05:14:23.365 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_user", 2024-01-31T05:14:23.365 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.365 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.365 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.365 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.365 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.365 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.366 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.366 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "User to authenticate as", 2024-01-31T05:14:23.366 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.366 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.366 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.366 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.366 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.366 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "balancer", 2024-01-31T05:14:23.366 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.366 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.366 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.366 INFO:teuthology.orchestra.run.smithi099.stdout: "active": { 2024-01-31T05:14:23.366 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "active", 2024-01-31T05:14:23.367 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.367 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.367 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.367 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.367 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.367 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.367 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.367 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "automatically balance PGs across cluster", 2024-01-31T05:14:23.367 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.367 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.367 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.367 INFO:teuthology.orchestra.run.smithi099.stdout: "begin_time": { 2024-01-31T05:14:23.367 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "begin_time", 2024-01-31T05:14:23.367 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.368 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.368 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.368 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0000", 2024-01-31T05:14:23.368 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.368 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.368 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.368 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "beginning time of day to automatically balance", 2024-01-31T05:14:23.368 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-01-31T05:14:23.368 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.368 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.368 INFO:teuthology.orchestra.run.smithi099.stdout: "begin_weekday": { 2024-01-31T05:14:23.368 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "begin_weekday", 2024-01-31T05:14:23.368 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "uint", 2024-01-31T05:14:23.369 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.369 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.369 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0", 2024-01-31T05:14:23.369 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "0", 2024-01-31T05:14:23.369 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "6", 2024-01-31T05:14:23.369 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.369 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-01-31T05:14:23.369 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-01-31T05:14:23.369 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.369 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.369 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_compat_max_iterations": { 2024-01-31T05:14:23.369 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "crush_compat_max_iterations", 2024-01-31T05:14:23.369 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "uint", 2024-01-31T05:14:23.369 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.370 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.370 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "25", 2024-01-31T05:14:23.370 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "1", 2024-01-31T05:14:23.370 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "250", 2024-01-31T05:14:23.370 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.370 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-01-31T05:14:23.370 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.370 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.370 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.370 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_compat_metrics": { 2024-01-31T05:14:23.370 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "crush_compat_metrics", 2024-01-31T05:14:23.370 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.370 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.370 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.370 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "pgs,objects,bytes", 2024-01-31T05:14:23.371 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.371 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.371 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.371 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-01-31T05:14:23.371 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-01-31T05:14:23.371 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.371 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.371 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_compat_step": { 2024-01-31T05:14:23.371 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "crush_compat_step", 2024-01-31T05:14:23.371 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "float", 2024-01-31T05:14:23.371 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.371 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.371 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0.5", 2024-01-31T05:14:23.371 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "0.001", 2024-01-31T05:14:23.371 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "0.999", 2024-01-31T05:14:23.371 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.372 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "aggressiveness of optimization", 2024-01-31T05:14:23.372 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-01-31T05:14:23.372 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.372 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.372 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.372 INFO:teuthology.orchestra.run.smithi099.stdout: "end_time": { 2024-01-31T05:14:23.372 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "end_time", 2024-01-31T05:14:23.372 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.372 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.372 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.372 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "2359", 2024-01-31T05:14:23.372 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.372 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.372 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.372 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "ending time of day to automatically balance", 2024-01-31T05:14:23.373 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-01-31T05:14:23.373 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.373 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.373 INFO:teuthology.orchestra.run.smithi099.stdout: "end_weekday": { 2024-01-31T05:14:23.373 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "end_weekday", 2024-01-31T05:14:23.373 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "uint", 2024-01-31T05:14:23.373 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.373 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.373 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0", 2024-01-31T05:14:23.373 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "0", 2024-01-31T05:14:23.373 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "6", 2024-01-31T05:14:23.373 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.373 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-01-31T05:14:23.373 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-01-31T05:14:23.373 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.374 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.374 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.374 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.374 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.374 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.374 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.374 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.374 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.374 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.374 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.374 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.374 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.374 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.374 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.375 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.375 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.375 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.375 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.375 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.375 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.375 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.375 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.375 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.375 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.375 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.375 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.375 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.376 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.376 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.376 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.376 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.376 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.376 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.376 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.376 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.376 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.376 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.376 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.376 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.376 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.377 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.377 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.377 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.377 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.377 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.377 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.377 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.377 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.377 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.377 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.377 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.377 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.377 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.377 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.377 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.377 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.378 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.378 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.378 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.378 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.378 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.378 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.378 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.378 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.378 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.378 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.378 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.378 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.378 INFO:teuthology.orchestra.run.smithi099.stdout: "min_score": { 2024-01-31T05:14:23.378 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "min_score", 2024-01-31T05:14:23.378 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "float", 2024-01-31T05:14:23.379 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.379 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.379 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0", 2024-01-31T05:14:23.379 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.379 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.379 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.379 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-01-31T05:14:23.379 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.379 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.379 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.379 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": { 2024-01-31T05:14:23.379 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "mode", 2024-01-31T05:14:23.379 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.379 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.380 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.380 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "upmap", 2024-01-31T05:14:23.380 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.380 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.380 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.380 INFO:teuthology.orchestra.run.smithi099.stdout: "crush-compat", 2024-01-31T05:14:23.380 INFO:teuthology.orchestra.run.smithi099.stdout: "none", 2024-01-31T05:14:23.380 INFO:teuthology.orchestra.run.smithi099.stdout: "upmap" 2024-01-31T05:14:23.380 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.380 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Balancer mode", 2024-01-31T05:14:23.380 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.380 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.380 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.380 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ids": { 2024-01-31T05:14:23.380 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "pool_ids", 2024-01-31T05:14:23.381 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.381 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.381 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.381 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.381 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.381 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.381 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.381 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-01-31T05:14:23.381 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.381 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.381 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.381 INFO:teuthology.orchestra.run.smithi099.stdout: "sleep_interval": { 2024-01-31T05:14:23.381 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "sleep_interval", 2024-01-31T05:14:23.381 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:23.381 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.382 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.382 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "60", 2024-01-31T05:14:23.382 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.382 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.382 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.382 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-01-31T05:14:23.382 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.382 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.382 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.382 INFO:teuthology.orchestra.run.smithi099.stdout: "upmap_max_deviation": { 2024-01-31T05:14:23.382 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "upmap_max_deviation", 2024-01-31T05:14:23.382 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.382 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.382 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.383 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "5", 2024-01-31T05:14:23.383 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "1", 2024-01-31T05:14:23.383 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.383 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.383 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "deviation below which no optimization is attempted", 2024-01-31T05:14:23.383 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-01-31T05:14:23.383 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.383 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.383 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.383 INFO:teuthology.orchestra.run.smithi099.stdout: "upmap_max_optimizations": { 2024-01-31T05:14:23.383 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "upmap_max_optimizations", 2024-01-31T05:14:23.383 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "uint", 2024-01-31T05:14:23.383 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.383 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.383 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10", 2024-01-31T05:14:23.384 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.384 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.384 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.384 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-01-31T05:14:23.384 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.384 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.384 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.384 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.384 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.384 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "cephadm", 2024-01-31T05:14:23.385 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.385 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.385 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.385 INFO:teuthology.orchestra.run.smithi099.stdout: "agent_down_multiplier": { 2024-01-31T05:14:23.385 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "agent_down_multiplier", 2024-01-31T05:14:23.385 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "float", 2024-01-31T05:14:23.385 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.385 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.385 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "3.0", 2024-01-31T05:14:23.385 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.385 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.385 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.385 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-01-31T05:14:23.385 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.386 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.386 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.386 INFO:teuthology.orchestra.run.smithi099.stdout: "agent_refresh_rate": { 2024-01-31T05:14:23.386 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "agent_refresh_rate", 2024-01-31T05:14:23.386 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:23.386 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.386 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.386 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "20", 2024-01-31T05:14:23.386 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.386 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.386 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.386 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-01-31T05:14:23.386 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.387 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.387 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.387 INFO:teuthology.orchestra.run.smithi099.stdout: "agent_starting_port": { 2024-01-31T05:14:23.387 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "agent_starting_port", 2024-01-31T05:14:23.387 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.387 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.387 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.387 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "4721", 2024-01-31T05:14:23.387 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.387 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.387 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.387 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-01-31T05:14:23.387 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.387 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.388 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.388 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_ptrace": { 2024-01-31T05:14:23.388 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "allow_ptrace", 2024-01-31T05:14:23.388 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.388 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.388 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.388 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.388 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.388 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.388 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.388 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-01-31T05:14:23.388 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-01-31T05:14:23.389 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.389 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.389 INFO:teuthology.orchestra.run.smithi099.stdout: "autotune_interval": { 2024-01-31T05:14:23.389 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "autotune_interval", 2024-01-31T05:14:23.389 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:23.389 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.389 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.389 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "600", 2024-01-31T05:14:23.389 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.389 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.389 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.389 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how frequently to autotune daemon memory", 2024-01-31T05:14:23.389 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.390 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.390 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.390 INFO:teuthology.orchestra.run.smithi099.stdout: "autotune_memory_target_ratio": { 2024-01-31T05:14:23.390 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "autotune_memory_target_ratio", 2024-01-31T05:14:23.390 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "float", 2024-01-31T05:14:23.390 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.390 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.390 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0.7", 2024-01-31T05:14:23.390 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.390 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.390 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.390 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-01-31T05:14:23.390 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.391 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.391 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.391 INFO:teuthology.orchestra.run.smithi099.stdout: "cephadm_log_destination": { 2024-01-31T05:14:23.391 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "cephadm_log_destination", 2024-01-31T05:14:23.391 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.391 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.391 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.391 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.391 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.391 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.391 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.391 INFO:teuthology.orchestra.run.smithi099.stdout: "file", 2024-01-31T05:14:23.391 INFO:teuthology.orchestra.run.smithi099.stdout: "file,syslog", 2024-01-31T05:14:23.391 INFO:teuthology.orchestra.run.smithi099.stdout: "syslog" 2024-01-31T05:14:23.392 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.392 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-01-31T05:14:23.392 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.392 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.392 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.392 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.392 INFO:teuthology.orchestra.run.smithi099.stdout: "cgroups_split": { 2024-01-31T05:14:23.392 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "cgroups_split", 2024-01-31T05:14:23.392 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.392 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.392 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.392 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.392 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.393 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.393 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.393 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-01-31T05:14:23.393 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.393 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.393 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.393 INFO:teuthology.orchestra.run.smithi099.stdout: "config_checks_enabled": { 2024-01-31T05:14:23.393 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "config_checks_enabled", 2024-01-31T05:14:23.393 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.393 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.393 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.393 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.393 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.394 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.394 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.394 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-01-31T05:14:23.394 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.394 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.394 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.394 INFO:teuthology.orchestra.run.smithi099.stdout: "config_dashboard": { 2024-01-31T05:14:23.394 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "config_dashboard", 2024-01-31T05:14:23.394 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.394 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.394 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.394 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.394 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.394 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.395 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.395 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-01-31T05:14:23.395 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.395 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.395 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.395 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_alertmanager": { 2024-01-31T05:14:23.395 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_alertmanager", 2024-01-31T05:14:23.395 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.395 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.395 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.395 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-01-31T05:14:23.395 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.395 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.395 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.395 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Prometheus container image", 2024-01-31T05:14:23.396 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.396 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.396 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.396 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_base": { 2024-01-31T05:14:23.396 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_base", 2024-01-31T05:14:23.396 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.396 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.396 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.396 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/ceph/ceph", 2024-01-31T05:14:23.396 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.396 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.396 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.396 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Container image name, without the tag", 2024-01-31T05:14:23.397 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.397 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.397 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.397 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_elasticsearch": { 2024-01-31T05:14:23.397 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_elasticsearch", 2024-01-31T05:14:23.397 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.397 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.397 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.397 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-01-31T05:14:23.397 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.397 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.397 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.397 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "elasticsearch container image", 2024-01-31T05:14:23.397 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.398 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.398 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.398 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_grafana": { 2024-01-31T05:14:23.398 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_grafana", 2024-01-31T05:14:23.398 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.398 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.398 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.398 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.12", 2024-01-31T05:14:23.398 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.398 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.398 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.398 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Prometheus container image", 2024-01-31T05:14:23.398 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.398 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.399 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.399 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_haproxy": { 2024-01-31T05:14:23.399 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_haproxy", 2024-01-31T05:14:23.399 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.399 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.399 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.399 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-01-31T05:14:23.399 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.399 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.399 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.399 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "HAproxy container image", 2024-01-31T05:14:23.399 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.399 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.399 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.400 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_jaeger_agent": { 2024-01-31T05:14:23.400 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_jaeger_agent", 2024-01-31T05:14:23.400 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.400 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.400 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.400 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-01-31T05:14:23.400 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.400 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.400 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.400 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Jaeger agent container image", 2024-01-31T05:14:23.400 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.400 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.401 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.401 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_jaeger_collector": { 2024-01-31T05:14:23.401 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_jaeger_collector", 2024-01-31T05:14:23.401 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.401 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.401 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.401 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-01-31T05:14:23.401 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.401 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.401 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.401 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Jaeger collector container image", 2024-01-31T05:14:23.401 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.401 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.401 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.402 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_jaeger_query": { 2024-01-31T05:14:23.402 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_jaeger_query", 2024-01-31T05:14:23.402 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.402 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.402 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.402 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-01-31T05:14:23.402 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.402 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.402 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.402 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Jaeger query container image", 2024-01-31T05:14:23.402 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.402 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.402 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.403 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_keepalived": { 2024-01-31T05:14:23.403 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_keepalived", 2024-01-31T05:14:23.403 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.403 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.403 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.403 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-01-31T05:14:23.403 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.403 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.403 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.403 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Keepalived container image", 2024-01-31T05:14:23.403 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.403 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.403 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.403 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_loki": { 2024-01-31T05:14:23.403 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_loki", 2024-01-31T05:14:23.404 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.404 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.404 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.404 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-01-31T05:14:23.404 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.404 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.404 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.404 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Loki container image", 2024-01-31T05:14:23.404 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.404 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.404 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.404 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_node_exporter": { 2024-01-31T05:14:23.404 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_node_exporter", 2024-01-31T05:14:23.404 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.405 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.405 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.405 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-01-31T05:14:23.405 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.405 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.405 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.405 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Prometheus container image", 2024-01-31T05:14:23.405 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.405 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.405 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.405 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_nvmeof": { 2024-01-31T05:14:23.405 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_nvmeof", 2024-01-31T05:14:23.406 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.406 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.406 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.406 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/ceph/nvmeof:latest", 2024-01-31T05:14:23.406 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.406 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.406 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.406 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Nvme-of container image", 2024-01-31T05:14:23.406 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.406 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.406 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.406 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_prometheus": { 2024-01-31T05:14:23.406 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_prometheus", 2024-01-31T05:14:23.406 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.407 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.407 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.407 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-01-31T05:14:23.407 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.407 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.407 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.407 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Prometheus container image", 2024-01-31T05:14:23.407 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.407 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.407 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.407 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_promtail": { 2024-01-31T05:14:23.407 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_promtail", 2024-01-31T05:14:23.407 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.408 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.408 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.408 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-01-31T05:14:23.408 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.408 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.408 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.408 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Promtail container image", 2024-01-31T05:14:23.408 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.408 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.408 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.408 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_snmp_gateway": { 2024-01-31T05:14:23.408 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_snmp_gateway", 2024-01-31T05:14:23.411 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.411 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.411 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.411 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-01-31T05:14:23.411 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.412 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.412 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.412 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "SNMP Gateway container image", 2024-01-31T05:14:23.412 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.412 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.412 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.412 INFO:teuthology.orchestra.run.smithi099.stdout: "container_init": { 2024-01-31T05:14:23.412 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_init", 2024-01-31T05:14:23.412 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.412 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.412 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.412 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.413 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.413 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.413 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.413 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Run podman/docker with `--init`", 2024-01-31T05:14:23.413 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.413 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.413 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.413 INFO:teuthology.orchestra.run.smithi099.stdout: "daemon_cache_timeout": { 2024-01-31T05:14:23.413 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "daemon_cache_timeout", 2024-01-31T05:14:23.413 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:23.413 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.413 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.413 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "600", 2024-01-31T05:14:23.413 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.414 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.414 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.414 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-01-31T05:14:23.414 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.414 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.414 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.414 INFO:teuthology.orchestra.run.smithi099.stdout: "default_cephadm_command_timeout": { 2024-01-31T05:14:23.414 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "default_cephadm_command_timeout", 2024-01-31T05:14:23.414 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.414 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.414 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.414 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "900", 2024-01-31T05:14:23.414 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.415 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.415 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.415 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-01-31T05:14:23.415 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.415 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.415 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.415 INFO:teuthology.orchestra.run.smithi099.stdout: "default_registry": { 2024-01-31T05:14:23.415 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "default_registry", 2024-01-31T05:14:23.415 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.415 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.415 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.415 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "docker.io", 2024-01-31T05:14:23.415 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.415 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.416 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.416 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-01-31T05:14:23.416 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.416 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.416 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.416 INFO:teuthology.orchestra.run.smithi099.stdout: "device_cache_timeout": { 2024-01-31T05:14:23.416 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "device_cache_timeout", 2024-01-31T05:14:23.416 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:23.416 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.416 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.416 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "1800", 2024-01-31T05:14:23.416 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.417 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.417 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.417 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "seconds to cache device inventory", 2024-01-31T05:14:23.417 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.417 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.417 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.417 INFO:teuthology.orchestra.run.smithi099.stdout: "device_enhanced_scan": { 2024-01-31T05:14:23.417 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "device_enhanced_scan", 2024-01-31T05:14:23.417 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.417 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.417 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.417 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.417 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.418 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.418 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.418 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Use libstoragemgmt during device scans", 2024-01-31T05:14:23.418 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.418 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.418 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.418 INFO:teuthology.orchestra.run.smithi099.stdout: "facts_cache_timeout": { 2024-01-31T05:14:23.418 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "facts_cache_timeout", 2024-01-31T05:14:23.418 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:23.418 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.418 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.418 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "60", 2024-01-31T05:14:23.418 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.418 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.419 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.419 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "seconds to cache host facts data", 2024-01-31T05:14:23.419 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.419 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.419 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.419 INFO:teuthology.orchestra.run.smithi099.stdout: "host_check_interval": { 2024-01-31T05:14:23.419 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "host_check_interval", 2024-01-31T05:14:23.419 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:23.419 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.419 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.419 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "600", 2024-01-31T05:14:23.419 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.419 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.419 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.420 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how frequently to perform a host check", 2024-01-31T05:14:23.420 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.420 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.420 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.420 INFO:teuthology.orchestra.run.smithi099.stdout: "inventory_list_all": { 2024-01-31T05:14:23.420 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "inventory_list_all", 2024-01-31T05:14:23.420 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.420 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.420 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.420 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.420 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.420 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.420 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.421 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-01-31T05:14:23.421 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.421 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.421 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.421 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.421 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.421 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.421 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.421 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.421 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.421 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.421 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.421 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.421 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.422 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.422 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.422 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.422 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.422 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.422 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.422 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.422 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.422 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.422 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.422 INFO:teuthology.orchestra.run.smithi099.stdout: "log_refresh_metadata": { 2024-01-31T05:14:23.422 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_refresh_metadata", 2024-01-31T05:14:23.422 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.423 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.423 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.423 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.423 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.423 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.423 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.423 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-01-31T05:14:23.423 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.423 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.423 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.423 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.423 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.423 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.424 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.424 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.424 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.424 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.424 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.424 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.424 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-01-31T05:14:23.424 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.424 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.424 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.424 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.424 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.425 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.425 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.425 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.425 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.425 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.425 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.425 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.425 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.425 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.425 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.425 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.425 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.425 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.425 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.425 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.426 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.426 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.426 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.426 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.426 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.426 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.426 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.426 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.426 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.426 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.426 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.426 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.426 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.427 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.427 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.427 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.427 INFO:teuthology.orchestra.run.smithi099.stdout: "manage_etc_ceph_ceph_conf": { 2024-01-31T05:14:23.427 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-01-31T05:14:23.427 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.427 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.427 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.427 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.427 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.427 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.427 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.427 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-01-31T05:14:23.428 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.428 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.428 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.428 INFO:teuthology.orchestra.run.smithi099.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-01-31T05:14:23.428 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-01-31T05:14:23.428 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.428 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.428 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.428 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "*", 2024-01-31T05:14:23.428 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.428 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.428 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.428 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-01-31T05:14:23.429 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.429 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.429 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.429 INFO:teuthology.orchestra.run.smithi099.stdout: "max_count_per_host": { 2024-01-31T05:14:23.429 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "max_count_per_host", 2024-01-31T05:14:23.429 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.429 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.429 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.429 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10", 2024-01-31T05:14:23.429 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.429 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.429 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.429 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "max number of daemons per service per host", 2024-01-31T05:14:23.429 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.430 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.430 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.430 INFO:teuthology.orchestra.run.smithi099.stdout: "max_osd_draining_count": { 2024-01-31T05:14:23.430 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "max_osd_draining_count", 2024-01-31T05:14:23.430 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.430 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.430 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.430 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10", 2024-01-31T05:14:23.430 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.430 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.430 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.430 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-01-31T05:14:23.430 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.430 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.431 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.431 INFO:teuthology.orchestra.run.smithi099.stdout: "migration_current": { 2024-01-31T05:14:23.431 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "migration_current", 2024-01-31T05:14:23.431 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.431 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.431 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.431 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.431 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.431 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.431 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.431 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "internal - do not modify", 2024-01-31T05:14:23.431 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.431 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.431 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.432 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": { 2024-01-31T05:14:23.432 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "mode", 2024-01-31T05:14:23.432 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.432 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.432 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.432 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "root", 2024-01-31T05:14:23.432 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.432 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.432 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.432 INFO:teuthology.orchestra.run.smithi099.stdout: "cephadm-package", 2024-01-31T05:14:23.432 INFO:teuthology.orchestra.run.smithi099.stdout: "root" 2024-01-31T05:14:23.432 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.432 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "mode for remote execution of cephadm", 2024-01-31T05:14:23.432 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.433 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.433 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.433 INFO:teuthology.orchestra.run.smithi099.stdout: "prometheus_alerts_path": { 2024-01-31T05:14:23.433 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "prometheus_alerts_path", 2024-01-31T05:14:23.433 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.433 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.433 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.433 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-01-31T05:14:23.433 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.433 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.433 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.433 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-01-31T05:14:23.433 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.434 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.434 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.434 INFO:teuthology.orchestra.run.smithi099.stdout: "registry_insecure": { 2024-01-31T05:14:23.434 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "registry_insecure", 2024-01-31T05:14:23.434 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.434 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.434 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.434 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.434 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.434 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.434 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.434 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-01-31T05:14:23.434 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.435 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.435 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.435 INFO:teuthology.orchestra.run.smithi099.stdout: "registry_password": { 2024-01-31T05:14:23.435 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "registry_password", 2024-01-31T05:14:23.435 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.435 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.435 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.435 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.435 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.435 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.435 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.435 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-01-31T05:14:23.435 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.435 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.436 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.436 INFO:teuthology.orchestra.run.smithi099.stdout: "registry_url": { 2024-01-31T05:14:23.436 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "registry_url", 2024-01-31T05:14:23.436 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.436 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.436 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.436 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.436 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.436 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.436 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.436 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-01-31T05:14:23.436 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.436 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.437 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.437 INFO:teuthology.orchestra.run.smithi099.stdout: "registry_username": { 2024-01-31T05:14:23.437 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "registry_username", 2024-01-31T05:14:23.437 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.437 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.437 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.437 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.437 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.437 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.437 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.437 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-01-31T05:14:23.437 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.437 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.437 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.438 INFO:teuthology.orchestra.run.smithi099.stdout: "secure_monitoring_stack": { 2024-01-31T05:14:23.438 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "secure_monitoring_stack", 2024-01-31T05:14:23.438 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.438 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.438 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.438 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.438 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.438 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.438 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.438 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-01-31T05:14:23.438 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.438 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.438 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.438 INFO:teuthology.orchestra.run.smithi099.stdout: "service_discovery_port": { 2024-01-31T05:14:23.439 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "service_discovery_port", 2024-01-31T05:14:23.439 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.439 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.439 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.439 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "8765", 2024-01-31T05:14:23.439 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.439 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.439 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.439 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "cephadm service discovery port", 2024-01-31T05:14:23.439 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.439 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.439 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.439 INFO:teuthology.orchestra.run.smithi099.stdout: "ssh_config_file": { 2024-01-31T05:14:23.440 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ssh_config_file", 2024-01-31T05:14:23.440 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.440 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.440 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.440 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.440 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.440 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.440 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.440 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-01-31T05:14:23.440 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.440 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.440 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.440 INFO:teuthology.orchestra.run.smithi099.stdout: "use_agent": { 2024-01-31T05:14:23.441 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "use_agent", 2024-01-31T05:14:23.441 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.441 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.441 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.441 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.441 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.441 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.441 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.441 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-01-31T05:14:23.441 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.441 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.441 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.441 INFO:teuthology.orchestra.run.smithi099.stdout: "use_repo_digest": { 2024-01-31T05:14:23.441 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "use_repo_digest", 2024-01-31T05:14:23.441 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.442 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.442 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.442 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.442 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.442 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.442 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.442 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-01-31T05:14:23.442 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.442 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.442 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.442 INFO:teuthology.orchestra.run.smithi099.stdout: "warn_on_failed_host_check": { 2024-01-31T05:14:23.442 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "warn_on_failed_host_check", 2024-01-31T05:14:23.443 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.443 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.443 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.443 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.443 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.443 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.443 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.443 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "raise a health warning if the host check fails", 2024-01-31T05:14:23.443 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.443 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.443 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.443 INFO:teuthology.orchestra.run.smithi099.stdout: "warn_on_stray_daemons": { 2024-01-31T05:14:23.443 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "warn_on_stray_daemons", 2024-01-31T05:14:23.443 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.443 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.444 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.444 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.444 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.444 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.444 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.444 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-01-31T05:14:23.444 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.444 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.444 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.444 INFO:teuthology.orchestra.run.smithi099.stdout: "warn_on_stray_hosts": { 2024-01-31T05:14:23.444 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "warn_on_stray_hosts", 2024-01-31T05:14:23.444 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.444 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.444 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.445 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.445 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.445 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.445 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.445 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-01-31T05:14:23.445 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.445 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.445 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.445 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.445 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.445 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "crash", 2024-01-31T05:14:23.445 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.445 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.446 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.446 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.446 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.446 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.446 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.446 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.446 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.446 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.446 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.446 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.446 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.446 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.446 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.446 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.446 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.447 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.447 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.447 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.447 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.447 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.447 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.447 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.447 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.447 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.447 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.447 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.447 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.447 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.447 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.448 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.448 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.448 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.448 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.448 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.448 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.448 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.448 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.448 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.448 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.448 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.448 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.448 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.449 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.449 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.449 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.449 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.449 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.449 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.449 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.449 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.449 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.449 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.449 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.449 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.449 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.449 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.450 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.450 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.450 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.450 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.450 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.450 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.450 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.450 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.450 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.450 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.450 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.450 INFO:teuthology.orchestra.run.smithi099.stdout: "retain_interval": { 2024-01-31T05:14:23.450 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "retain_interval", 2024-01-31T05:14:23.450 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:23.450 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.451 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.451 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "31536000", 2024-01-31T05:14:23.451 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.451 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.451 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.451 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how long to retain crashes before pruning them", 2024-01-31T05:14:23.451 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.451 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.451 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.451 INFO:teuthology.orchestra.run.smithi099.stdout: "warn_recent_interval": { 2024-01-31T05:14:23.451 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "warn_recent_interval", 2024-01-31T05:14:23.451 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:23.451 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.451 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.452 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "1209600", 2024-01-31T05:14:23.452 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.452 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.452 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.452 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "time interval in which to warn about recent crashes", 2024-01-31T05:14:23.452 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.452 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.452 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.452 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.452 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.452 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "dashboard", 2024-01-31T05:14:23.453 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.453 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.453 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.453 INFO:teuthology.orchestra.run.smithi099.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-01-31T05:14:23.453 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-01-31T05:14:23.453 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.453 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.453 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.453 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10", 2024-01-31T05:14:23.453 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.453 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.453 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.453 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.453 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.453 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.454 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.454 INFO:teuthology.orchestra.run.smithi099.stdout: "ALERTMANAGER_API_HOST": { 2024-01-31T05:14:23.454 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ALERTMANAGER_API_HOST", 2024-01-31T05:14:23.454 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.454 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.454 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.454 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.454 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.454 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.454 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.454 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.454 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.454 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.454 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.455 INFO:teuthology.orchestra.run.smithi099.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-01-31T05:14:23.455 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-01-31T05:14:23.455 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.455 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.455 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.455 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.455 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.455 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.455 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.455 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.455 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.455 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.455 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.456 INFO:teuthology.orchestra.run.smithi099.stdout: "AUDIT_API_ENABLED": { 2024-01-31T05:14:23.456 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "AUDIT_API_ENABLED", 2024-01-31T05:14:23.456 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.456 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.456 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.456 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.456 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.456 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.456 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.456 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.456 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.456 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.456 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.457 INFO:teuthology.orchestra.run.smithi099.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-01-31T05:14:23.457 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-01-31T05:14:23.457 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.457 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.457 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.457 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.457 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.457 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.457 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.457 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.457 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.457 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.457 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.458 INFO:teuthology.orchestra.run.smithi099.stdout: "ENABLE_BROWSABLE_API": { 2024-01-31T05:14:23.458 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ENABLE_BROWSABLE_API", 2024-01-31T05:14:23.458 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.458 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.458 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.458 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.458 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.458 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.458 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.458 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.458 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.458 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.458 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.459 INFO:teuthology.orchestra.run.smithi099.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-01-31T05:14:23.459 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-01-31T05:14:23.459 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.459 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.459 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.459 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.459 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.459 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.459 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.459 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.459 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.459 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.459 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.460 INFO:teuthology.orchestra.run.smithi099.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-01-31T05:14:23.460 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-01-31T05:14:23.460 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.460 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.460 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.460 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.460 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.460 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.460 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.460 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.460 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.460 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.460 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.461 INFO:teuthology.orchestra.run.smithi099.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-01-31T05:14:23.461 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-01-31T05:14:23.461 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.461 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.461 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.461 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.461 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.461 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.461 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.461 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.461 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.461 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.461 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.462 INFO:teuthology.orchestra.run.smithi099.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-01-31T05:14:23.462 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-01-31T05:14:23.462 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.462 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.462 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.462 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.462 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.462 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.462 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.462 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.462 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.462 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.462 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.462 INFO:teuthology.orchestra.run.smithi099.stdout: "FEATURE_TOGGLE_NFS": { 2024-01-31T05:14:23.463 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-01-31T05:14:23.463 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.463 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.463 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.463 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.463 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.463 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.463 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.463 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.463 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.463 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.463 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.463 INFO:teuthology.orchestra.run.smithi099.stdout: "FEATURE_TOGGLE_RBD": { 2024-01-31T05:14:23.463 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-01-31T05:14:23.464 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.464 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.464 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.464 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.464 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.464 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.464 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.464 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.464 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.464 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.464 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.464 INFO:teuthology.orchestra.run.smithi099.stdout: "FEATURE_TOGGLE_RGW": { 2024-01-31T05:14:23.464 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-01-31T05:14:23.465 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.465 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.465 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.465 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.465 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.465 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.465 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.465 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.465 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.465 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.465 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.465 INFO:teuthology.orchestra.run.smithi099.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-01-31T05:14:23.465 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-01-31T05:14:23.465 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.466 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.466 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.466 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.466 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.466 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.466 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.466 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.466 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.466 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.466 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.466 INFO:teuthology.orchestra.run.smithi099.stdout: "GRAFANA_API_PASSWORD": { 2024-01-31T05:14:23.466 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "GRAFANA_API_PASSWORD", 2024-01-31T05:14:23.466 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.466 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.467 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.467 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "admin", 2024-01-31T05:14:23.467 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.467 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.467 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.467 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.467 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.467 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.467 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.467 INFO:teuthology.orchestra.run.smithi099.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-01-31T05:14:23.467 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-01-31T05:14:23.467 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.467 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.467 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.468 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.468 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.468 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.468 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.468 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.468 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.468 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.468 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.468 INFO:teuthology.orchestra.run.smithi099.stdout: "GRAFANA_API_URL": { 2024-01-31T05:14:23.468 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "GRAFANA_API_URL", 2024-01-31T05:14:23.468 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.468 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.468 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.469 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.469 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.469 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.469 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.469 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.469 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.469 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.469 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.469 INFO:teuthology.orchestra.run.smithi099.stdout: "GRAFANA_API_USERNAME": { 2024-01-31T05:14:23.469 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "GRAFANA_API_USERNAME", 2024-01-31T05:14:23.469 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.470 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.470 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.470 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "admin", 2024-01-31T05:14:23.470 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.470 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.470 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.470 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.470 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.470 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.470 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.470 INFO:teuthology.orchestra.run.smithi099.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-01-31T05:14:23.470 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-01-31T05:14:23.471 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.471 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.471 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.471 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.471 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.471 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.471 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.471 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.471 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.471 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.471 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.471 INFO:teuthology.orchestra.run.smithi099.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-01-31T05:14:23.471 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-01-31T05:14:23.472 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.472 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.472 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.472 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.472 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.472 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.472 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.472 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.472 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.472 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.472 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.472 INFO:teuthology.orchestra.run.smithi099.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-01-31T05:14:23.472 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-01-31T05:14:23.473 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.473 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.473 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.473 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.473 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.473 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.473 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.473 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.473 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.473 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.473 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.473 INFO:teuthology.orchestra.run.smithi099.stdout: "ISSUE_TRACKER_API_KEY": { 2024-01-31T05:14:23.473 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-01-31T05:14:23.474 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.474 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.474 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.474 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.474 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.474 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.474 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.474 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.474 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.474 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.474 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.474 INFO:teuthology.orchestra.run.smithi099.stdout: "PROMETHEUS_API_HOST": { 2024-01-31T05:14:23.474 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PROMETHEUS_API_HOST", 2024-01-31T05:14:23.475 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.475 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.475 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.475 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.475 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.475 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.475 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.475 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.475 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.475 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.475 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.475 INFO:teuthology.orchestra.run.smithi099.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-01-31T05:14:23.475 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-01-31T05:14:23.476 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.476 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.476 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.476 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.476 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.476 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.476 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.476 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.476 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.476 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.476 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.476 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-01-31T05:14:23.476 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-01-31T05:14:23.476 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.477 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.477 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.477 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.477 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.477 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.477 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.477 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.477 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.477 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.477 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.477 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-01-31T05:14:23.477 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-01-31T05:14:23.477 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.478 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.478 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.478 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.478 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.478 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.478 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.478 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.478 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.478 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.478 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.478 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-01-31T05:14:23.478 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-01-31T05:14:23.478 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.478 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.479 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.479 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.479 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.479 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.479 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.479 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.479 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.479 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.479 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.479 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-01-31T05:14:23.479 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-01-31T05:14:23.479 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.479 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.479 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.480 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.480 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.480 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.480 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.480 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.480 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.480 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.480 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.480 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-01-31T05:14:23.480 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-01-31T05:14:23.480 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.480 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.480 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.481 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.481 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.481 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.481 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.481 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.481 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.481 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.481 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.481 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-01-31T05:14:23.481 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-01-31T05:14:23.481 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.481 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.481 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.481 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.482 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.482 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.482 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.482 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.482 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.482 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.482 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.482 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-01-31T05:14:23.482 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-01-31T05:14:23.482 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.482 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.482 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.482 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.482 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.483 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.483 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.483 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.483 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.483 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.483 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.483 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_ENABLED": { 2024-01-31T05:14:23.483 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_ENABLED", 2024-01-31T05:14:23.483 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.483 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.483 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.483 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.483 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.484 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.484 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.484 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.484 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.484 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.484 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.484 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-01-31T05:14:23.484 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-01-31T05:14:23.484 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.484 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.484 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.484 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-01-31T05:14:23.484 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.485 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.485 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.485 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.485 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.485 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.485 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.485 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-01-31T05:14:23.485 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-01-31T05:14:23.485 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.485 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.485 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.485 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10", 2024-01-31T05:14:23.485 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.486 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.486 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.486 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.486 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.486 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.486 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.486 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-01-31T05:14:23.486 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-01-31T05:14:23.486 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.486 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.486 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.486 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "8", 2024-01-31T05:14:23.486 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.487 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.487 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.487 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.487 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.487 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.487 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.487 INFO:teuthology.orchestra.run.smithi099.stdout: "REST_REQUESTS_TIMEOUT": { 2024-01-31T05:14:23.487 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-01-31T05:14:23.487 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.487 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.487 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.487 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "45", 2024-01-31T05:14:23.487 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.487 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.488 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.488 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.488 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.488 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.488 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.488 INFO:teuthology.orchestra.run.smithi099.stdout: "RGW_API_ACCESS_KEY": { 2024-01-31T05:14:23.488 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "RGW_API_ACCESS_KEY", 2024-01-31T05:14:23.488 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.488 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.488 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.488 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.488 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.489 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.489 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.489 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.489 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.489 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.489 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.489 INFO:teuthology.orchestra.run.smithi099.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-01-31T05:14:23.489 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-01-31T05:14:23.489 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.489 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.489 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.489 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "admin", 2024-01-31T05:14:23.489 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.490 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.490 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.490 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.490 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.490 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.490 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.490 INFO:teuthology.orchestra.run.smithi099.stdout: "RGW_API_SECRET_KEY": { 2024-01-31T05:14:23.490 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "RGW_API_SECRET_KEY", 2024-01-31T05:14:23.490 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.490 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.490 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.490 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.490 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.490 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.491 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.491 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.491 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.491 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.491 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.491 INFO:teuthology.orchestra.run.smithi099.stdout: "RGW_API_SSL_VERIFY": { 2024-01-31T05:14:23.491 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "RGW_API_SSL_VERIFY", 2024-01-31T05:14:23.491 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.491 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.491 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.491 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.491 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.491 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.491 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.492 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.492 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.492 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.492 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.492 INFO:teuthology.orchestra.run.smithi099.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-01-31T05:14:23.492 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-01-31T05:14:23.492 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.492 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.492 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.492 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0", 2024-01-31T05:14:23.492 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.492 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.492 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.492 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.493 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.493 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.493 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.493 INFO:teuthology.orchestra.run.smithi099.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-01-31T05:14:23.493 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-01-31T05:14:23.493 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.493 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.493 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.493 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10", 2024-01-31T05:14:23.493 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.493 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.493 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.493 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.493 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.493 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.493 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.494 INFO:teuthology.orchestra.run.smithi099.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-01-31T05:14:23.494 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-01-31T05:14:23.494 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.494 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.494 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.494 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "5", 2024-01-31T05:14:23.494 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.494 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.494 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.494 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.494 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.494 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.495 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.495 INFO:teuthology.orchestra.run.smithi099.stdout: "cross_origin_url": { 2024-01-31T05:14:23.495 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "cross_origin_url", 2024-01-31T05:14:23.495 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.495 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.495 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.495 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.495 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.495 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.495 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.495 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.495 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.495 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.495 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.496 INFO:teuthology.orchestra.run.smithi099.stdout: "crt_file": { 2024-01-31T05:14:23.496 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "crt_file", 2024-01-31T05:14:23.496 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.496 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.496 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.496 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.496 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.496 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.496 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.496 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.496 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.496 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.496 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.497 INFO:teuthology.orchestra.run.smithi099.stdout: "debug": { 2024-01-31T05:14:23.497 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "debug", 2024-01-31T05:14:23.497 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.497 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.497 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.497 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.497 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.497 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.497 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.497 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Enable/disable debug options", 2024-01-31T05:14:23.497 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.497 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.497 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.497 INFO:teuthology.orchestra.run.smithi099.stdout: "jwt_token_ttl": { 2024-01-31T05:14:23.497 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "jwt_token_ttl", 2024-01-31T05:14:23.498 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.498 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.498 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.498 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "28800", 2024-01-31T05:14:23.498 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.498 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.498 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.498 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.498 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.498 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.498 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.498 INFO:teuthology.orchestra.run.smithi099.stdout: "key_file": { 2024-01-31T05:14:23.498 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "key_file", 2024-01-31T05:14:23.498 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.499 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.499 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.499 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.499 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.499 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.499 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.499 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.499 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.499 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.499 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.499 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.499 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.500 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.500 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.500 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.500 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.500 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.500 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.500 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.500 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.500 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.500 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.500 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.500 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.500 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.500 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.501 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.501 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.501 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.501 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.501 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.501 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.501 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.501 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.501 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.501 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.501 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.501 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.501 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.501 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.501 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.501 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.502 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.502 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.502 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.502 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.502 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.502 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.502 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.502 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.502 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.502 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.502 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.502 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.502 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.502 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.503 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.503 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.503 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.503 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.503 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.503 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.503 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.503 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.503 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.503 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.503 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.503 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.503 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.503 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.504 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.504 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.504 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.504 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.504 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.504 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.504 INFO:teuthology.orchestra.run.smithi099.stdout: "motd": { 2024-01-31T05:14:23.504 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "motd", 2024-01-31T05:14:23.504 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.504 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.504 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.504 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.504 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.505 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.505 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.505 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "The message of the day", 2024-01-31T05:14:23.505 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.505 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.505 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.505 INFO:teuthology.orchestra.run.smithi099.stdout: "redirect_resolve_ip_addr": { 2024-01-31T05:14:23.505 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "redirect_resolve_ip_addr", 2024-01-31T05:14:23.505 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.505 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.505 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.505 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.505 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.505 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.506 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.506 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.506 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.506 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.506 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.506 INFO:teuthology.orchestra.run.smithi099.stdout: "server_addr": { 2024-01-31T05:14:23.506 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "server_addr", 2024-01-31T05:14:23.506 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.506 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.506 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.506 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "::", 2024-01-31T05:14:23.506 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.506 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.507 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.507 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.507 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.507 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.507 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.507 INFO:teuthology.orchestra.run.smithi099.stdout: "server_port": { 2024-01-31T05:14:23.507 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "server_port", 2024-01-31T05:14:23.507 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.507 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.507 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.507 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "8080", 2024-01-31T05:14:23.507 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.508 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.508 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.508 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.508 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.508 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.508 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.508 INFO:teuthology.orchestra.run.smithi099.stdout: "ssl": { 2024-01-31T05:14:23.508 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ssl", 2024-01-31T05:14:23.508 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.508 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.508 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.508 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.508 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.509 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.509 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.509 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.509 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.509 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.509 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.509 INFO:teuthology.orchestra.run.smithi099.stdout: "ssl_server_port": { 2024-01-31T05:14:23.509 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ssl_server_port", 2024-01-31T05:14:23.509 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.509 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.509 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.509 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "8443", 2024-01-31T05:14:23.509 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.510 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.510 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.510 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.510 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.510 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.510 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.510 INFO:teuthology.orchestra.run.smithi099.stdout: "standby_behaviour": { 2024-01-31T05:14:23.510 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "standby_behaviour", 2024-01-31T05:14:23.510 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.510 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.510 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.510 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "redirect", 2024-01-31T05:14:23.510 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.511 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.511 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.511 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.511 INFO:teuthology.orchestra.run.smithi099.stdout: "redirect" 2024-01-31T05:14:23.511 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.511 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.511 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.511 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.511 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.511 INFO:teuthology.orchestra.run.smithi099.stdout: "standby_error_status_code": { 2024-01-31T05:14:23.511 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "standby_error_status_code", 2024-01-31T05:14:23.511 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.511 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.511 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.511 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "500", 2024-01-31T05:14:23.512 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "400", 2024-01-31T05:14:23.512 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "599", 2024-01-31T05:14:23.512 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.512 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.512 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.512 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.512 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.512 INFO:teuthology.orchestra.run.smithi099.stdout: "url_prefix": { 2024-01-31T05:14:23.512 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "url_prefix", 2024-01-31T05:14:23.512 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.512 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.512 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.512 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.512 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.513 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.513 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.513 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.513 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.513 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.513 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.513 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.513 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.513 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "devicehealth", 2024-01-31T05:14:23.513 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.513 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.513 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.514 INFO:teuthology.orchestra.run.smithi099.stdout: "enable_monitoring": { 2024-01-31T05:14:23.514 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "enable_monitoring", 2024-01-31T05:14:23.514 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.514 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.514 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.514 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.514 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.514 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.514 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.514 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "monitor device health metrics", 2024-01-31T05:14:23.514 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.514 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.514 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.515 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.515 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.515 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.515 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.515 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.515 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.515 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.515 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.515 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.515 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.515 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.515 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.515 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.515 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.515 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.516 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.516 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.516 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.516 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.516 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.516 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.516 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.516 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.516 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.516 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.516 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.516 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.517 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.517 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.517 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.517 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.517 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.517 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.517 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.517 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.517 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.517 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.517 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.517 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.517 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.518 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.518 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.518 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.518 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.518 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.518 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.518 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.518 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.518 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.518 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.518 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.518 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.518 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.518 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.519 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.519 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.519 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.519 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.519 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.519 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.519 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.519 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.519 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.519 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.519 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.519 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.519 INFO:teuthology.orchestra.run.smithi099.stdout: "mark_out_threshold": { 2024-01-31T05:14:23.520 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "mark_out_threshold", 2024-01-31T05:14:23.520 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:23.520 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.520 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.520 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "2419200", 2024-01-31T05:14:23.520 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.520 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.520 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.520 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-01-31T05:14:23.520 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.520 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.520 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.521 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": { 2024-01-31T05:14:23.521 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "pool_name", 2024-01-31T05:14:23.521 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.521 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.521 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.521 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "device_health_metrics", 2024-01-31T05:14:23.521 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.521 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.521 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.521 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "name of pool in which to store device health metrics", 2024-01-31T05:14:23.521 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.521 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.521 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.521 INFO:teuthology.orchestra.run.smithi099.stdout: "retention_period": { 2024-01-31T05:14:23.522 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "retention_period", 2024-01-31T05:14:23.522 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:23.522 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.522 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.522 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "15552000", 2024-01-31T05:14:23.522 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.522 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.522 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.522 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how long to retain device health metrics", 2024-01-31T05:14:23.522 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.522 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.522 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.522 INFO:teuthology.orchestra.run.smithi099.stdout: "scrape_frequency": { 2024-01-31T05:14:23.522 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "scrape_frequency", 2024-01-31T05:14:23.523 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:23.523 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.523 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.523 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "86400", 2024-01-31T05:14:23.523 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.523 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.523 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.523 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how frequently to scrape device health metrics", 2024-01-31T05:14:23.523 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.523 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.523 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.523 INFO:teuthology.orchestra.run.smithi099.stdout: "self_heal": { 2024-01-31T05:14:23.523 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "self_heal", 2024-01-31T05:14:23.524 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.524 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.524 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.524 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.524 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.524 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.524 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.524 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-01-31T05:14:23.524 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.524 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.524 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.524 INFO:teuthology.orchestra.run.smithi099.stdout: "sleep_interval": { 2024-01-31T05:14:23.524 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "sleep_interval", 2024-01-31T05:14:23.525 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:23.525 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.525 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.525 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "600", 2024-01-31T05:14:23.525 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.525 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.525 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.525 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how frequently to wake up and check device health", 2024-01-31T05:14:23.525 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.525 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.525 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.525 INFO:teuthology.orchestra.run.smithi099.stdout: "warn_threshold": { 2024-01-31T05:14:23.525 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "warn_threshold", 2024-01-31T05:14:23.525 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:23.526 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.526 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.526 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "7257600", 2024-01-31T05:14:23.526 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.526 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.526 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.526 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-01-31T05:14:23.526 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.526 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.526 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.526 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.526 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.527 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "diskprediction_local", 2024-01-31T05:14:23.527 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.527 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.527 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.527 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.527 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.527 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.527 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.527 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.527 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.527 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.527 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.527 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.527 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.527 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.528 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.528 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.528 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.528 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.528 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.528 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.528 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.528 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.528 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.528 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.528 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.528 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.528 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.529 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.529 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.529 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.529 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.529 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.529 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.529 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.529 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.529 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.529 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.529 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.529 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.529 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.530 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.530 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.530 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.530 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.530 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.530 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.530 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.530 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.530 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.530 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.530 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.530 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.530 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.530 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.530 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.531 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.531 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.531 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.531 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.531 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.531 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.531 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.531 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.531 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.531 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.531 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.531 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.531 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.531 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.532 INFO:teuthology.orchestra.run.smithi099.stdout: "predict_interval": { 2024-01-31T05:14:23.532 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "predict_interval", 2024-01-31T05:14:23.532 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.532 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.532 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.532 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "86400", 2024-01-31T05:14:23.532 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.532 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.532 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.532 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.532 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.532 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.533 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.533 INFO:teuthology.orchestra.run.smithi099.stdout: "predictor_model": { 2024-01-31T05:14:23.533 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "predictor_model", 2024-01-31T05:14:23.533 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.533 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.533 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.533 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "prophetstor", 2024-01-31T05:14:23.533 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.533 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.533 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.533 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.533 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.533 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.534 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.534 INFO:teuthology.orchestra.run.smithi099.stdout: "sleep_interval": { 2024-01-31T05:14:23.534 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "sleep_interval", 2024-01-31T05:14:23.534 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.534 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.534 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.534 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "600", 2024-01-31T05:14:23.534 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.534 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.534 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.534 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.534 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.534 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.534 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.535 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.535 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.535 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "influx", 2024-01-31T05:14:23.535 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": false, 2024-01-31T05:14:23.535 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "influxdb python module not found", 2024-01-31T05:14:23.535 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.535 INFO:teuthology.orchestra.run.smithi099.stdout: "batch_size": { 2024-01-31T05:14:23.535 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "batch_size", 2024-01-31T05:14:23.535 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.535 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.535 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.535 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "5000", 2024-01-31T05:14:23.536 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.536 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.536 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.536 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-01-31T05:14:23.536 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.536 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.536 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.536 INFO:teuthology.orchestra.run.smithi099.stdout: "database": { 2024-01-31T05:14:23.536 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "database", 2024-01-31T05:14:23.536 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.536 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.537 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.537 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "ceph", 2024-01-31T05:14:23.537 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.537 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.537 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.537 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-01-31T05:14:23.537 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.537 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.537 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.537 INFO:teuthology.orchestra.run.smithi099.stdout: "hostname": { 2024-01-31T05:14:23.537 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "hostname", 2024-01-31T05:14:23.537 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.537 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.537 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.538 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.538 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.538 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.538 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.538 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "InfluxDB server hostname", 2024-01-31T05:14:23.538 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.538 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.538 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.538 INFO:teuthology.orchestra.run.smithi099.stdout: "interval": { 2024-01-31T05:14:23.538 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "interval", 2024-01-31T05:14:23.538 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:23.538 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.538 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.539 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "30", 2024-01-31T05:14:23.539 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "5", 2024-01-31T05:14:23.539 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.539 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.539 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-01-31T05:14:23.539 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.539 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.539 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.539 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.539 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.539 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.539 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.539 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.540 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.540 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.540 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.540 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.540 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.540 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.540 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.540 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.540 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.540 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.540 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.540 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.540 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.540 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.541 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.541 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.541 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.541 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.541 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.541 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.541 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.541 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.541 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.541 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.541 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.541 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.541 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.541 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.542 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.542 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.542 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.542 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.542 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.542 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.542 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.542 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.542 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.542 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.542 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.542 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.542 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.542 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.542 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.543 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.543 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.543 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.543 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.543 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.543 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.543 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.543 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.543 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.543 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.543 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.543 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.543 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.543 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.543 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.544 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.544 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.544 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.544 INFO:teuthology.orchestra.run.smithi099.stdout: "password": { 2024-01-31T05:14:23.544 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "password", 2024-01-31T05:14:23.544 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.544 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.544 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.544 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.544 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.544 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.544 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.544 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "password of InfluxDB server user", 2024-01-31T05:14:23.545 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.545 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.545 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.545 INFO:teuthology.orchestra.run.smithi099.stdout: "port": { 2024-01-31T05:14:23.545 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "port", 2024-01-31T05:14:23.545 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.545 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.545 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.545 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "8086", 2024-01-31T05:14:23.545 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.545 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.545 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.545 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "InfluxDB server port", 2024-01-31T05:14:23.545 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.546 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.546 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.546 INFO:teuthology.orchestra.run.smithi099.stdout: "ssl": { 2024-01-31T05:14:23.546 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ssl", 2024-01-31T05:14:23.546 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.546 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.546 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.546 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "false", 2024-01-31T05:14:23.546 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.546 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.546 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.546 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-01-31T05:14:23.546 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.547 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.547 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.547 INFO:teuthology.orchestra.run.smithi099.stdout: "threads": { 2024-01-31T05:14:23.547 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "threads", 2024-01-31T05:14:23.547 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.547 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.547 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.547 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "5", 2024-01-31T05:14:23.547 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "1", 2024-01-31T05:14:23.547 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "32", 2024-01-31T05:14:23.547 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.548 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-01-31T05:14:23.548 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.548 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.548 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.548 INFO:teuthology.orchestra.run.smithi099.stdout: "username": { 2024-01-31T05:14:23.548 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "username", 2024-01-31T05:14:23.548 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.548 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.548 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.548 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.548 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.548 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.549 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.549 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "username of InfluxDB server user", 2024-01-31T05:14:23.549 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.549 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.549 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.549 INFO:teuthology.orchestra.run.smithi099.stdout: "verify_ssl": { 2024-01-31T05:14:23.549 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "verify_ssl", 2024-01-31T05:14:23.549 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.549 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.549 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.549 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "true", 2024-01-31T05:14:23.549 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.550 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.550 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.550 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-01-31T05:14:23.550 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.550 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.550 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.550 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.550 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.550 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "insights", 2024-01-31T05:14:23.550 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.550 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.550 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.550 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.551 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.551 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.551 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.551 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.551 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.551 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.551 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.551 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.551 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.551 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.551 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.551 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.551 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.551 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.552 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.552 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.552 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.552 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.552 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.552 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.552 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.552 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.552 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.552 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.552 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.552 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.552 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.553 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.553 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.553 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.553 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.553 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.553 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.553 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.553 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.553 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.553 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.553 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.553 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.553 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.553 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.554 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.554 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.554 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.554 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.554 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.554 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.554 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.554 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.554 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.554 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.554 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.554 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.554 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.554 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.555 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.555 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.555 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.555 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.555 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.555 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.555 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.555 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.555 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.555 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.555 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.555 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.555 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "iostat", 2024-01-31T05:14:23.556 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.556 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.556 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.556 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.556 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.556 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.556 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.556 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.556 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.556 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.556 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.556 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.556 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.556 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.557 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.557 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.557 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.557 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.557 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.557 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.557 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.557 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.557 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.557 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.557 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.557 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.557 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.558 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.558 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.558 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.558 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.558 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.558 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.558 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.558 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.558 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.558 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.558 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.558 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.558 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.558 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.558 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.559 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.559 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.559 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.559 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.559 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.559 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.559 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.559 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.559 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.559 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.559 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.559 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.559 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.559 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.560 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.560 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.560 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.560 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.560 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.560 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.560 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.560 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.560 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.560 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.560 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.560 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.561 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.561 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.561 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.561 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.561 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "k8sevents", 2024-01-31T05:14:23.561 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.561 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.561 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.561 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_event_retention_days": { 2024-01-31T05:14:23.561 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ceph_event_retention_days", 2024-01-31T05:14:23.561 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.561 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.561 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.562 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "7", 2024-01-31T05:14:23.562 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.562 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.562 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.562 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Days to hold ceph event information within local cache", 2024-01-31T05:14:23.562 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.562 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.562 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.562 INFO:teuthology.orchestra.run.smithi099.stdout: "config_check_secs": { 2024-01-31T05:14:23.562 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "config_check_secs", 2024-01-31T05:14:23.562 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.562 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.562 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.562 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10", 2024-01-31T05:14:23.563 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "10", 2024-01-31T05:14:23.563 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.563 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.563 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-01-31T05:14:23.563 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.563 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.563 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.563 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.563 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.563 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.563 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.563 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.563 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.564 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.564 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.564 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.564 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.564 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.564 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.564 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.564 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.564 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.564 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.564 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.564 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.564 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.565 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.565 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.565 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.565 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.565 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.565 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.565 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.565 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.565 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.565 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.565 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.565 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.565 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.566 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.566 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.566 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.566 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.566 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.566 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.566 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.566 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.566 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.566 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.566 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.566 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.566 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.567 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.567 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.567 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.567 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.567 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.567 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.567 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.567 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.567 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.567 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.567 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.567 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.567 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.568 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.568 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.568 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.568 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.568 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.568 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.568 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.568 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.568 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.568 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.568 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "localpool", 2024-01-31T05:14:23.568 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.569 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.569 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.569 INFO:teuthology.orchestra.run.smithi099.stdout: "failure_domain": { 2024-01-31T05:14:23.569 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "failure_domain", 2024-01-31T05:14:23.569 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.569 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.569 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.569 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "host", 2024-01-31T05:14:23.569 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.569 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.569 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.569 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "failure domain for any created local pool", 2024-01-31T05:14:23.569 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-01-31T05:14:23.570 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.570 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.570 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.570 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.570 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.570 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.570 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.570 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.570 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.570 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.570 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.570 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.570 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.570 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.571 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.571 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.571 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.571 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.571 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.571 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.571 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.571 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.571 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.571 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.571 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.571 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.571 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.572 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.572 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.572 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.572 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.572 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.572 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.572 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.572 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.572 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.572 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.572 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.572 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.572 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.572 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.573 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.573 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.573 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.573 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.573 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.573 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.573 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.573 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.573 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.573 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.573 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.573 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.573 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.573 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.574 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.574 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.574 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.574 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.574 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.574 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.574 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.574 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.574 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.574 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.574 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.574 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.574 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.575 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": { 2024-01-31T05:14:23.575 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "min_size", 2024-01-31T05:14:23.575 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.575 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.575 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.575 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.575 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.575 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.575 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.575 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "default min_size for any created local pool", 2024-01-31T05:14:23.575 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-01-31T05:14:23.575 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.575 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.575 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.576 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rep": { 2024-01-31T05:14:23.576 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "num_rep", 2024-01-31T05:14:23.576 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.576 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.576 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.576 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "3", 2024-01-31T05:14:23.576 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.576 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.576 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.576 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "default replica count for any created local pool", 2024-01-31T05:14:23.576 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.576 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.576 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.576 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.577 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": { 2024-01-31T05:14:23.577 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "pg_num", 2024-01-31T05:14:23.577 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.577 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.577 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.577 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "128", 2024-01-31T05:14:23.577 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.577 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.577 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.577 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "default pg_num for any created local pool", 2024-01-31T05:14:23.577 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.577 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.577 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.577 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.578 INFO:teuthology.orchestra.run.smithi099.stdout: "prefix": { 2024-01-31T05:14:23.578 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "prefix", 2024-01-31T05:14:23.578 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.578 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.578 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.578 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.578 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.578 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.578 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.578 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "name prefix for any created local pool", 2024-01-31T05:14:23.578 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.578 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.578 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.578 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.579 INFO:teuthology.orchestra.run.smithi099.stdout: "subtree": { 2024-01-31T05:14:23.579 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "subtree", 2024-01-31T05:14:23.579 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.579 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.579 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.579 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "rack", 2024-01-31T05:14:23.579 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.579 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.579 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.579 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "CRUSH level for which to create a local pool", 2024-01-31T05:14:23.579 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-01-31T05:14:23.579 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.579 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.579 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.580 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.580 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.580 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.580 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "mds_autoscaler", 2024-01-31T05:14:23.580 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.580 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.580 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.580 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.580 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.580 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.580 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.580 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.506+0000 7f4681f5f640 1 -- 172.21.15.99:0/2142214876 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f46640a12e0 msgr2=0x7f46640a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:23.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.506+0000 7f4681f5f640 1 --2- 172.21.15.99:0/2142214876 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f46640a12e0 0x7f46640a37a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f467c1981d0 tx=0x7f466c00a2d0 comp rx=0 tx=0).stop 2024-01-31T05:14:23.581 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.581 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.581 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.582 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.582 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.582 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.582 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.582 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.582 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.582 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.582 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.582 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.582 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.582 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.582 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.582 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.583 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.583 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.583 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.583 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.583 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.583 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.583 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.583 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.583 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.583 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.583 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.583 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.583 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.584 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.584 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.584 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.584 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.584 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.584 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.584 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.584 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.584 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.584 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.584 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.584 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.585 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.585 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.585 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.585 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.585 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.585 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.585 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.585 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.585 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.585 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.585 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.585 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.585 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.586 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.586 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.586 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.586 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.586 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.586 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.586 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.586 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.586 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.586 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.586 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.586 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.586 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.586 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "mirroring", 2024-01-31T05:14:23.587 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.587 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.587 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.587 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.587 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.587 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.587 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.587 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.587 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.587 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.587 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.587 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.587 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.587 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.588 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.588 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.588 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.588 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.588 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.588 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.588 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.588 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.588 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.588 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.588 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.588 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.588 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.589 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.589 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.589 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.589 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.589 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.589 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.589 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.589 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.589 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.589 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.589 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.589 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.589 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.590 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.590 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.590 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.590 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.590 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.590 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.590 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.590 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.590 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.590 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.590 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.590 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.590 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.590 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.591 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.591 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.591 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.591 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.591 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.591 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.591 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.591 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.591 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.591 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.591 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.591 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.591 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.592 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.592 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.592 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.592 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.592 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.592 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.592 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.592 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "nfs", 2024-01-31T05:14:23.592 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.592 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.592 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.592 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.592 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.592 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.592 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.593 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.593 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.593 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.593 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.593 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.593 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.593 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.593 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.593 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.593 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.593 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.593 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.593 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.593 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.593 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.593 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.594 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.594 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.594 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.594 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.594 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.594 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.594 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.594 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.594 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.594 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.594 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.594 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.594 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.594 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.594 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.594 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.595 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.595 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.595 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.595 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.595 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.595 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.595 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.595 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.595 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.595 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.595 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.595 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.595 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.595 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.595 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.595 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.596 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.596 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.596 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.596 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.596 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.596 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.596 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.596 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.596 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.596 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.596 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.596 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.596 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.597 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.597 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.597 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.597 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.597 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.597 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.597 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "orchestrator", 2024-01-31T05:14:23.597 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.597 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.597 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.597 INFO:teuthology.orchestra.run.smithi099.stdout: "fail_fs": { 2024-01-31T05:14:23.597 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "fail_fs", 2024-01-31T05:14:23.597 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.597 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.597 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.598 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.598 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.598 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.598 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.598 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-01-31T05:14:23.598 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.598 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.598 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.598 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.598 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.598 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.598 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.598 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.598 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.599 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.599 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.599 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.599 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.599 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.599 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.599 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.599 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.599 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.599 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.599 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.599 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.599 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.599 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.599 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.600 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.600 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.600 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.600 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.600 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.600 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.600 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.600 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.600 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.600 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.600 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.600 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.601 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.601 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.601 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.601 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.601 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.601 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.601 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.601 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.601 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.601 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.601 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.601 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.601 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.601 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.601 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.602 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.602 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.602 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.602 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.602 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.602 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.602 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.602 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.602 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.602 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.602 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.602 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.602 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.602 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.602 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.603 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.603 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.603 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.603 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.603 INFO:teuthology.orchestra.run.smithi099.stdout: "orchestrator": { 2024-01-31T05:14:23.603 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "orchestrator", 2024-01-31T05:14:23.603 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.603 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.603 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.603 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.603 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.603 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.603 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.603 INFO:teuthology.orchestra.run.smithi099.stdout: "cephadm", 2024-01-31T05:14:23.604 INFO:teuthology.orchestra.run.smithi099.stdout: "rook", 2024-01-31T05:14:23.604 INFO:teuthology.orchestra.run.smithi099.stdout: "test_orchestrator" 2024-01-31T05:14:23.604 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.604 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Orchestrator backend", 2024-01-31T05:14:23.604 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.604 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.604 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.604 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.604 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.604 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.604 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.604 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "osd_perf_query", 2024-01-31T05:14:23.604 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.604 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.604 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.605 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.605 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.605 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.605 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.605 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.605 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.605 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.605 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.605 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.605 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.605 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.605 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.605 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.605 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.605 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.605 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.606 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.606 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.606 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.606 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.606 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.606 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.606 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.606 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.606 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.606 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.606 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.606 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.606 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.607 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.607 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.607 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.607 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.607 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.607 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.607 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.607 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.607 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.607 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.607 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.607 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.607 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.607 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.608 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.608 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.608 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.608 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.608 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.608 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.608 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.608 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.608 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.608 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.608 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.608 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.609 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.609 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.609 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.609 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.609 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.609 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.609 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.609 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.609 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.609 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.609 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.609 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.609 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.610 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.610 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "osd_support", 2024-01-31T05:14:23.610 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.610 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.610 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.610 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.610 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.610 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.610 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.610 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.610 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.610 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.610 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.610 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.611 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.611 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.611 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.611 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.611 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.611 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.611 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.611 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.611 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.611 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.611 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.611 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.611 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.611 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.612 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.612 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.612 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.612 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.612 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.612 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.612 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.612 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.612 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.612 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.612 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.615 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.615 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.615 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.615 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.615 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.615 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.616 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.616 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.616 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.616 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.616 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.616 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.616 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.616 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.616 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.616 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.616 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.616 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.616 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.617 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.617 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.617 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.617 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.617 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.617 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.617 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.617 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.617 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.617 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.617 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.617 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.617 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.618 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.618 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.618 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.618 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "pg_autoscaler", 2024-01-31T05:14:23.618 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.618 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.618 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.618 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.618 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.618 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.618 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.618 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.619 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.619 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.619 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.619 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.619 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.619 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.619 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.619 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.619 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.619 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.619 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.619 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.619 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.619 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.619 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.620 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.620 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.620 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.620 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.620 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.620 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.620 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.620 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.620 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.620 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.620 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.620 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.621 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.621 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.621 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.621 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.621 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.621 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.621 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.621 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.621 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.621 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.621 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.621 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.621 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.621 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.622 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.622 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.622 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.622 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.622 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.622 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.622 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.622 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.622 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.622 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.622 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.622 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.622 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.622 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.622 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.623 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.623 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.623 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.623 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.623 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.623 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.623 INFO:teuthology.orchestra.run.smithi099.stdout: "sleep_interval": { 2024-01-31T05:14:23.623 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "sleep_interval", 2024-01-31T05:14:23.623 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:23.623 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.623 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.623 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "60", 2024-01-31T05:14:23.623 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.623 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.624 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.624 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.624 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.624 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.624 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.624 INFO:teuthology.orchestra.run.smithi099.stdout: "threshold": { 2024-01-31T05:14:23.624 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "threshold", 2024-01-31T05:14:23.624 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "float", 2024-01-31T05:14:23.624 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.624 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.624 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "3.0", 2024-01-31T05:14:23.624 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "1.0", 2024-01-31T05:14:23.625 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.625 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.625 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "scaling threshold", 2024-01-31T05:14:23.625 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-01-31T05:14:23.625 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.625 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.625 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.625 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.625 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "progress", 2024-01-31T05:14:23.625 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.625 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.625 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.626 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_pg_recovery_event": { 2024-01-31T05:14:23.626 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "allow_pg_recovery_event", 2024-01-31T05:14:23.626 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.626 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.626 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.626 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.626 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.626 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.626 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.626 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "allow the module to show pg recovery progress", 2024-01-31T05:14:23.626 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.626 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.626 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.627 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": { 2024-01-31T05:14:23.627 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "enabled", 2024-01-31T05:14:23.627 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.627 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.627 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.627 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.627 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.627 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.627 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.627 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.627 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.627 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.627 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.627 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.628 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.628 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.628 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.628 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.628 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.628 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.628 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.628 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.628 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.628 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.628 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.628 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.628 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.628 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.629 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.629 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.629 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.629 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.629 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.629 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.629 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.629 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.629 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.629 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.629 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.629 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.629 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.630 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.630 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.630 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.630 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.630 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.630 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.630 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.630 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.630 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.630 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.630 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.630 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.630 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.631 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.631 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.631 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.631 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.631 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.631 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.631 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.631 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.631 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.631 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.631 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.631 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.631 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.631 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.632 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.632 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.632 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.632 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.632 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.632 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.632 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.632 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.632 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.632 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.632 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.632 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.632 INFO:teuthology.orchestra.run.smithi099.stdout: "max_completed_events": { 2024-01-31T05:14:23.633 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "max_completed_events", 2024-01-31T05:14:23.633 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.633 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.633 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.633 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "50", 2024-01-31T05:14:23.633 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.633 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.633 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.633 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "number of past completed events to remember", 2024-01-31T05:14:23.633 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.633 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.633 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.633 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.633 INFO:teuthology.orchestra.run.smithi099.stdout: "sleep_interval": { 2024-01-31T05:14:23.633 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "sleep_interval", 2024-01-31T05:14:23.634 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:23.634 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.634 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.634 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "5", 2024-01-31T05:14:23.634 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.634 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.634 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.634 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how long the module is going to sleep", 2024-01-31T05:14:23.634 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.634 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.634 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.634 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.634 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.634 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.635 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "prometheus", 2024-01-31T05:14:23.635 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.635 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.635 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.635 INFO:teuthology.orchestra.run.smithi099.stdout: "cache": { 2024-01-31T05:14:23.635 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "cache", 2024-01-31T05:14:23.635 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.635 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.635 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.635 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.635 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.635 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.635 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.636 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.636 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.636 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.636 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.636 INFO:teuthology.orchestra.run.smithi099.stdout: "exclude_perf_counters": { 2024-01-31T05:14:23.636 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "exclude_perf_counters", 2024-01-31T05:14:23.636 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.636 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.636 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.636 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.636 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.636 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.637 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.637 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-01-31T05:14:23.637 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-01-31T05:14:23.637 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.637 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.637 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.637 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.637 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.637 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.637 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.637 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.637 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.637 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.637 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.638 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.638 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.638 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.638 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.638 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.638 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.638 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.638 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.638 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.638 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.638 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.638 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.638 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.639 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.639 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.639 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.639 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.639 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.639 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.639 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.639 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.639 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.639 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.639 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.639 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.639 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.640 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.640 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.640 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.640 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.640 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.640 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.640 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.640 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.640 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.640 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.640 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.640 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.640 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.640 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.641 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.641 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.641 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.641 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.641 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.641 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.641 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.641 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.641 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.641 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.641 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.641 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.641 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.642 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.642 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.642 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.642 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.642 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.642 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.642 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_stats_pools": { 2024-01-31T05:14:23.642 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rbd_stats_pools", 2024-01-31T05:14:23.642 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.642 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.642 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.642 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.642 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.643 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.643 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.643 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.643 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.643 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.643 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.643 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.643 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_stats_pools_refresh_interval": { 2024-01-31T05:14:23.643 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-01-31T05:14:23.643 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.643 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.643 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.643 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "300", 2024-01-31T05:14:23.643 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.643 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.644 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.644 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.644 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.644 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.644 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.644 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.644 INFO:teuthology.orchestra.run.smithi099.stdout: "scrape_interval": { 2024-01-31T05:14:23.644 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "scrape_interval", 2024-01-31T05:14:23.644 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "float", 2024-01-31T05:14:23.644 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.644 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.644 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "15.0", 2024-01-31T05:14:23.644 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.644 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.645 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.645 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.645 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.645 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.645 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.645 INFO:teuthology.orchestra.run.smithi099.stdout: "server_addr": { 2024-01-31T05:14:23.645 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "server_addr", 2024-01-31T05:14:23.645 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.645 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.645 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.645 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "::", 2024-01-31T05:14:23.645 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.645 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.646 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.646 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-01-31T05:14:23.646 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.646 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.646 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.646 INFO:teuthology.orchestra.run.smithi099.stdout: "server_port": { 2024-01-31T05:14:23.646 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "server_port", 2024-01-31T05:14:23.646 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.646 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.646 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.646 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "9283", 2024-01-31T05:14:23.646 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.646 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.646 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.647 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-01-31T05:14:23.647 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.647 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.647 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.647 INFO:teuthology.orchestra.run.smithi099.stdout: "stale_cache_strategy": { 2024-01-31T05:14:23.647 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "stale_cache_strategy", 2024-01-31T05:14:23.647 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.647 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.647 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.647 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "log", 2024-01-31T05:14:23.647 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.647 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.647 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.647 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.647 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.648 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.648 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.648 INFO:teuthology.orchestra.run.smithi099.stdout: "standby_behaviour": { 2024-01-31T05:14:23.648 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "standby_behaviour", 2024-01-31T05:14:23.648 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.648 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.648 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.648 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "default", 2024-01-31T05:14:23.648 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.648 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.648 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.648 INFO:teuthology.orchestra.run.smithi099.stdout: "default", 2024-01-31T05:14:23.648 INFO:teuthology.orchestra.run.smithi099.stdout: "error" 2024-01-31T05:14:23.649 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.649 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.649 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.649 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.649 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.649 INFO:teuthology.orchestra.run.smithi099.stdout: "standby_error_status_code": { 2024-01-31T05:14:23.649 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "standby_error_status_code", 2024-01-31T05:14:23.649 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.649 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.649 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.649 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "500", 2024-01-31T05:14:23.649 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "400", 2024-01-31T05:14:23.649 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "599", 2024-01-31T05:14:23.650 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.650 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.650 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.650 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.650 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.650 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.650 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.650 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rbd_support", 2024-01-31T05:14:23.650 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.650 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.650 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.650 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.506+0000 7f4681f5f640 1 -- 172.21.15.99:0/2142214876 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f467c1028c0 msgr2=0x7f467c19e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:23.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.506+0000 7f4681f5f640 1 --2- 172.21.15.99:0/2142214876 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f467c1028c0 0x7f467c19e270 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f467400cad0 tx=0x7f467400cf90 comp rx=0 tx=0).stop 2024-01-31T05:14:23.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.506+0000 7f4681f5f640 1 -- 172.21.15.99:0/2142214876 shutdown_connections 2024-01-31T05:14:23.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.506+0000 7f4681f5f640 1 --2- 172.21.15.99:0/2142214876 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f46640a12e0 0x7f46640a37a0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:23.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.506+0000 7f4681f5f640 1 --2- 172.21.15.99:0/2142214876 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f467c1028c0 0x7f467c19e270 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:23.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.506+0000 7f4681f5f640 1 --2- 172.21.15.99:0/2142214876 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f467c101f00 0x7f467c197240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:23.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.506+0000 7f4681f5f640 1 --2- 172.21.15.99:0/2142214876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f467c100d10 0x7f467c196d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:23.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.506+0000 7f4681f5f640 1 -- 172.21.15.99:0/2142214876 >> 172.21.15.99:0/2142214876 conn(0x7f467c0fc2a0 msgr2=0x7f467c105270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:14:23.652 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.652 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.652 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.652 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.652 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.652 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.652 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.652 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.653 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.653 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.653 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.653 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.653 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.653 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.653 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.653 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.653 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.653 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.653 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.653 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.653 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.653 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.654 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.654 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.654 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.654 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.654 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.654 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.654 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.654 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.654 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.654 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.654 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.654 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.654 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.654 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.654 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.655 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.655 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.655 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.655 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.655 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.655 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.655 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.655 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.655 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.655 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.655 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.655 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.655 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.655 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.655 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.655 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.656 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.656 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.656 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.656 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.656 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.656 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.656 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.656 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.656 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.656 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.656 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.656 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.657 INFO:teuthology.orchestra.run.smithi099.stdout: "max_concurrent_snap_create": { 2024-01-31T05:14:23.657 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "max_concurrent_snap_create", 2024-01-31T05:14:23.657 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.657 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.657 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.657 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10", 2024-01-31T05:14:23.657 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.657 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.657 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.657 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.657 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.657 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.657 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.657 INFO:teuthology.orchestra.run.smithi099.stdout: "mirror_snapshot_schedule": { 2024-01-31T05:14:23.658 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "mirror_snapshot_schedule", 2024-01-31T05:14:23.658 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.658 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.658 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.658 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.658 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.658 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.658 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.658 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.658 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.658 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.658 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.658 INFO:teuthology.orchestra.run.smithi099.stdout: "trash_purge_schedule": { 2024-01-31T05:14:23.659 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "trash_purge_schedule", 2024-01-31T05:14:23.659 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.659 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.659 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.659 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.659 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.659 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.659 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.659 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.659 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.659 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.659 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.659 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.659 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.660 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "restful", 2024-01-31T05:14:23.660 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.660 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.660 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.660 INFO:teuthology.orchestra.run.smithi099.stdout: "enable_auth": { 2024-01-31T05:14:23.660 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "enable_auth", 2024-01-31T05:14:23.660 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.660 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.660 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.660 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.660 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.660 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.661 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.661 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.661 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.661 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.661 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.661 INFO:teuthology.orchestra.run.smithi099.stdout: "key_file": { 2024-01-31T05:14:23.661 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "key_file", 2024-01-31T05:14:23.661 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.661 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.661 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.661 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.661 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.661 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.661 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.662 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.662 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.662 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.662 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.662 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.662 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.662 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.662 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.662 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.662 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.662 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.662 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.663 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.663 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.663 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.663 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.663 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.663 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.663 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.663 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.663 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.663 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.663 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.663 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.663 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.664 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.664 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.664 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.664 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.664 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.664 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.664 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.664 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.664 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.664 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.664 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.664 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.664 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.665 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.665 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.665 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.665 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.665 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.665 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.665 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.665 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.665 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.665 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.665 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.665 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.665 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.665 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.666 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.666 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.666 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.666 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.666 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.666 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.666 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.666 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.666 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.666 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.666 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.666 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.666 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.667 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.667 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.667 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.667 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.667 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.667 INFO:teuthology.orchestra.run.smithi099.stdout: "server_addr": { 2024-01-31T05:14:23.667 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "server_addr", 2024-01-31T05:14:23.667 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.667 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.667 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.667 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.667 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.668 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.668 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.668 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.668 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.668 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.668 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.668 INFO:teuthology.orchestra.run.smithi099.stdout: "server_port": { 2024-01-31T05:14:23.668 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "server_port", 2024-01-31T05:14:23.668 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.668 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.668 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.668 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.668 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.668 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.669 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.669 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.669 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.669 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.669 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.669 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.669 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.669 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rgw", 2024-01-31T05:14:23.669 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.669 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.669 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.670 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.670 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.670 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.670 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.670 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.670 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.670 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.670 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.670 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.670 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.670 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.670 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.670 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.670 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.670 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.671 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.671 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.671 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.671 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.671 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.671 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.671 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.671 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.671 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.671 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.671 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.671 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.671 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.672 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.672 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.672 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.672 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.672 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.672 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.672 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.672 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.672 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.672 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.672 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.672 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.673 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.673 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.673 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.673 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.673 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.673 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.673 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.673 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.673 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.673 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.673 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.673 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.673 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.674 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.674 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.674 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.674 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.674 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.674 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.674 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.674 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.674 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.674 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.674 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.674 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.674 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.674 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.674 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.675 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rook", 2024-01-31T05:14:23.675 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.675 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.675 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.675 INFO:teuthology.orchestra.run.smithi099.stdout: "drive_group_interval": { 2024-01-31T05:14:23.675 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "drive_group_interval", 2024-01-31T05:14:23.675 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "float", 2024-01-31T05:14:23.675 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.675 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.675 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "300.0", 2024-01-31T05:14:23.675 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.675 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.676 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.676 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2024-01-31T05:14:23.676 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.676 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.676 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.676 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.676 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.676 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.676 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.676 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.676 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.676 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.677 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.677 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.677 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.677 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.677 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.677 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.677 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.677 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.677 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.677 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.677 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.677 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.677 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.678 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.678 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.678 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.678 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.678 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.678 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.678 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.678 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.678 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.678 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.678 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.678 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.678 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.679 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.679 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.679 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.679 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.679 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.679 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.679 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.679 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.679 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.679 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.679 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.679 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.679 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.679 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.679 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.680 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.680 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.680 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.680 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.680 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.680 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.680 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.680 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.680 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.680 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.680 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.681 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.681 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.681 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.681 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.681 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.681 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.681 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.681 INFO:teuthology.orchestra.run.smithi099.stdout: "storage_class": { 2024-01-31T05:14:23.681 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "storage_class", 2024-01-31T05:14:23.681 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.681 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.681 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.681 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "local", 2024-01-31T05:14:23.682 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.682 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.682 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.682 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-01-31T05:14:23.682 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.682 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.682 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.682 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.682 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.682 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "selftest", 2024-01-31T05:14:23.682 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.682 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.682 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.683 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.683 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.683 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.683 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.683 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.683 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.683 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.683 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.683 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.683 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.683 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.683 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.683 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.683 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.684 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.684 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.684 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.684 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.684 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.684 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.684 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.684 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.684 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.684 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.684 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.684 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.685 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.685 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.685 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.685 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.685 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.685 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.685 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.685 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.685 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.685 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.685 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.685 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.685 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.685 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.686 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.686 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.686 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.686 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.686 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.686 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.686 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.686 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.686 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.686 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.686 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.686 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.686 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.687 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.687 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.687 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.687 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.687 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.687 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.687 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.687 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.687 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.687 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.687 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.687 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.687 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.688 INFO:teuthology.orchestra.run.smithi099.stdout: "roption1": { 2024-01-31T05:14:23.688 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "roption1", 2024-01-31T05:14:23.688 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.688 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.688 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.688 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.688 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.688 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.688 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.688 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.688 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.688 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.688 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.689 INFO:teuthology.orchestra.run.smithi099.stdout: "roption2": { 2024-01-31T05:14:23.689 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "roption2", 2024-01-31T05:14:23.689 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.689 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.689 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.689 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "xyz", 2024-01-31T05:14:23.689 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.689 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.689 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.689 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.689 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.689 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.689 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.690 INFO:teuthology.orchestra.run.smithi099.stdout: "rwoption1": { 2024-01-31T05:14:23.690 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rwoption1", 2024-01-31T05:14:23.690 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.690 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.690 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.690 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.690 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.690 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.690 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.690 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.690 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.690 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.690 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.690 INFO:teuthology.orchestra.run.smithi099.stdout: "rwoption2": { 2024-01-31T05:14:23.691 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rwoption2", 2024-01-31T05:14:23.691 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.691 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.691 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.691 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.691 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.691 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.691 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.691 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.691 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.691 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.691 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.691 INFO:teuthology.orchestra.run.smithi099.stdout: "rwoption3": { 2024-01-31T05:14:23.692 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rwoption3", 2024-01-31T05:14:23.692 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "float", 2024-01-31T05:14:23.692 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.692 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.692 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.692 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.692 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.692 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.692 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.692 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.692 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.692 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.693 INFO:teuthology.orchestra.run.smithi099.stdout: "rwoption4": { 2024-01-31T05:14:23.693 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rwoption4", 2024-01-31T05:14:23.693 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.693 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.693 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.693 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.693 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.693 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.693 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.693 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.693 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.693 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.693 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.693 INFO:teuthology.orchestra.run.smithi099.stdout: "rwoption5": { 2024-01-31T05:14:23.694 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rwoption5", 2024-01-31T05:14:23.694 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.694 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.694 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.694 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.694 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.694 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.694 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.694 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.694 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.694 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.694 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.694 INFO:teuthology.orchestra.run.smithi099.stdout: "rwoption6": { 2024-01-31T05:14:23.694 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rwoption6", 2024-01-31T05:14:23.695 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.695 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.695 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.695 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.695 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.695 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.695 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.695 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.695 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.695 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.695 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.695 INFO:teuthology.orchestra.run.smithi099.stdout: "rwoption7": { 2024-01-31T05:14:23.695 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rwoption7", 2024-01-31T05:14:23.695 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.695 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.696 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.696 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.696 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "1", 2024-01-31T05:14:23.696 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "42", 2024-01-31T05:14:23.696 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.696 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.696 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.696 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.696 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.696 INFO:teuthology.orchestra.run.smithi099.stdout: "testkey": { 2024-01-31T05:14:23.696 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "testkey", 2024-01-31T05:14:23.696 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.697 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.697 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.697 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.697 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.697 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.697 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.697 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.697 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.697 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.697 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.697 INFO:teuthology.orchestra.run.smithi099.stdout: "testlkey": { 2024-01-31T05:14:23.697 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "testlkey", 2024-01-31T05:14:23.697 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.697 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.697 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.698 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.698 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.698 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.698 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.698 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.698 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.698 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.698 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.698 INFO:teuthology.orchestra.run.smithi099.stdout: "testnewline": { 2024-01-31T05:14:23.698 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "testnewline", 2024-01-31T05:14:23.698 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.698 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.698 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.699 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.699 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.699 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.699 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.699 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.699 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.699 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.699 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.699 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.699 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.699 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "snap_schedule", 2024-01-31T05:14:23.699 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.699 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.700 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.700 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_m_granularity": { 2024-01-31T05:14:23.700 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "allow_m_granularity", 2024-01-31T05:14:23.700 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.700 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.700 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.700 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.700 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.700 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.700 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.700 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "allow minute scheduled snapshots", 2024-01-31T05:14:23.700 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.701 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.701 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.701 INFO:teuthology.orchestra.run.smithi099.stdout: "dump_on_update": { 2024-01-31T05:14:23.701 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "dump_on_update", 2024-01-31T05:14:23.701 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.701 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.701 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.701 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.701 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.701 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.701 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.701 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "dump database to debug log on update", 2024-01-31T05:14:23.701 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.701 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.701 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.702 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.702 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.702 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.702 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.702 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.702 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.702 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.702 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.702 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.702 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.702 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.702 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.702 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.702 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.702 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.703 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.703 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.703 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.703 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.703 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.703 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.703 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.703 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.703 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.703 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.703 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.703 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.703 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.704 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.704 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.704 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.704 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.704 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.704 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.704 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.704 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.704 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.704 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.704 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.704 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.705 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.705 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.705 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.705 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.705 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.705 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.705 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.705 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.705 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.705 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.705 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.705 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.705 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.706 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.706 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.706 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.706 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.706 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.706 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.706 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.706 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.706 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.706 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.706 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.706 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.706 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.706 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.707 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.707 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "stats", 2024-01-31T05:14:23.707 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.707 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.707 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.707 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.707 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.707 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.707 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.707 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.707 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.707 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.707 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.707 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.708 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.708 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.708 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.708 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.708 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.708 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.708 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.708 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.708 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.708 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.708 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.708 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.709 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.709 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.709 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.709 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.709 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.709 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.709 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.709 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.709 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.709 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.709 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.709 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.709 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.710 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.710 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.710 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.710 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.710 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.710 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.710 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.710 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.710 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.710 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.710 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.710 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.710 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.711 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.711 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.711 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.711 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.711 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.711 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.711 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.711 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.711 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.711 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.711 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.711 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.711 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.712 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.712 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.712 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.712 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.712 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.712 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.712 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.712 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.712 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "status", 2024-01-31T05:14:23.712 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.712 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.713 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.713 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.713 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.713 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.713 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.713 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.713 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.713 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.713 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.713 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.713 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.713 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.713 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.713 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.714 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.714 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.714 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.714 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.714 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.714 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.714 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.714 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.714 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.714 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.714 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.714 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.714 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.715 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.715 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.715 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.715 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.715 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.715 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.715 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.715 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.715 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.715 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.715 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.715 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.715 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.715 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.716 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.716 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.716 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.716 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.716 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.716 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.716 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.716 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.716 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.716 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.716 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.716 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.716 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.717 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.717 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.717 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.717 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.717 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.717 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.717 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.717 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.717 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.717 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.717 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.717 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.717 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.718 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.718 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.718 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "telegraf", 2024-01-31T05:14:23.718 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.718 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.718 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.718 INFO:teuthology.orchestra.run.smithi099.stdout: "address": { 2024-01-31T05:14:23.718 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "address", 2024-01-31T05:14:23.718 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.718 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.718 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.718 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-01-31T05:14:23.719 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.719 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.719 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.719 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.719 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.719 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.719 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.719 INFO:teuthology.orchestra.run.smithi099.stdout: "interval": { 2024-01-31T05:14:23.719 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "interval", 2024-01-31T05:14:23.719 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:23.719 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.719 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.719 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "15", 2024-01-31T05:14:23.720 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.720 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.720 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.720 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.720 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.720 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.720 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.506+0000 7f4681f5f640 1 -- 172.21.15.99:0/2142214876 shutdown_connections 2024-01-31T05:14:23.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:22.506+0000 7f4681f5f640 1 -- 172.21.15.99:0/2142214876 wait complete. 2024-01-31T05:14:23.722 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:14:22 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/4094079167' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-31T05:14:23.722 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:14:22 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/2675909747' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-31T05:14:23.722 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:14:22 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/2142214876' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-01-31T05:14:23.722 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:14:22 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/4094079167' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-31T05:14:23.722 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:14:22 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/2675909747' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-31T05:14:23.722 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:14:22 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/2142214876' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-01-31T05:14:23.723 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.723 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.723 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.723 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.723 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.723 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.723 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.723 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.723 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.723 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.723 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.723 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.724 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.724 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.724 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.724 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.724 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.724 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.724 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.724 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.724 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.724 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.724 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.724 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.724 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.725 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.725 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.725 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.725 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.725 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.725 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.725 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.725 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.725 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.725 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.725 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.725 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.725 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.725 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.726 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.726 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.726 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.726 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.726 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.726 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.726 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.726 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.726 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.726 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.726 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.726 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.726 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.726 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.727 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.727 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.727 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.727 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.727 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.727 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.727 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.727 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.727 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.727 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.727 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.727 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.727 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.727 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.728 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.728 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "telemetry", 2024-01-31T05:14:23.728 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.728 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.728 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.728 INFO:teuthology.orchestra.run.smithi099.stdout: "channel_basic": { 2024-01-31T05:14:23.728 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "channel_basic", 2024-01-31T05:14:23.728 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.728 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.728 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.728 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.729 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.729 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.729 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.729 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Share basic cluster information (size, version)", 2024-01-31T05:14:23.729 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.729 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.729 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.729 INFO:teuthology.orchestra.run.smithi099.stdout: "channel_crash": { 2024-01-31T05:14:23.729 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "channel_crash", 2024-01-31T05:14:23.729 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.729 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.729 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.729 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.730 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.730 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.730 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.730 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-01-31T05:14:23.730 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.730 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.730 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.730 INFO:teuthology.orchestra.run.smithi099.stdout: "channel_device": { 2024-01-31T05:14:23.730 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "channel_device", 2024-01-31T05:14:23.730 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.730 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.730 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.730 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-01-31T05:14:23.730 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.731 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.731 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.731 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-01-31T05:14:23.731 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.731 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.731 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.731 INFO:teuthology.orchestra.run.smithi099.stdout: "channel_ident": { 2024-01-31T05:14:23.731 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "channel_ident", 2024-01-31T05:14:23.731 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.731 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.731 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.731 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.731 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.732 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.732 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.732 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-01-31T05:14:23.732 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.732 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.732 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.732 INFO:teuthology.orchestra.run.smithi099.stdout: "channel_perf": { 2024-01-31T05:14:23.732 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "channel_perf", 2024-01-31T05:14:23.732 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.732 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.732 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.732 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.732 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.733 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.733 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.733 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Share various performance metrics of a cluster", 2024-01-31T05:14:23.733 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.733 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.733 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.733 INFO:teuthology.orchestra.run.smithi099.stdout: "contact": { 2024-01-31T05:14:23.733 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "contact", 2024-01-31T05:14:23.733 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.733 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.733 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.733 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.733 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.733 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.734 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.734 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.734 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.734 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.734 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.734 INFO:teuthology.orchestra.run.smithi099.stdout: "description": { 2024-01-31T05:14:23.734 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "description", 2024-01-31T05:14:23.734 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.734 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.734 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.734 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.734 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.734 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.735 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.735 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.735 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.735 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.735 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.735 INFO:teuthology.orchestra.run.smithi099.stdout: "device_url": { 2024-01-31T05:14:23.735 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "device_url", 2024-01-31T05:14:23.735 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.735 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.735 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.735 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-01-31T05:14:23.735 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.735 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.735 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.736 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.736 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.736 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.736 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.736 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": { 2024-01-31T05:14:23.736 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "enabled", 2024-01-31T05:14:23.736 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.736 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.736 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.736 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.736 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.736 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.736 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.737 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.737 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.737 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.737 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.737 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.737 INFO:teuthology.orchestra.run.smithi099.stdout: "interval": { 2024-01-31T05:14:23.737 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "interval", 2024-01-31T05:14:23.737 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.737 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.737 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.737 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "24", 2024-01-31T05:14:23.737 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "8", 2024-01-31T05:14:23.737 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.737 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.738 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.738 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.738 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.738 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.738 INFO:teuthology.orchestra.run.smithi099.stdout: "last_opt_revision": { 2024-01-31T05:14:23.738 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "last_opt_revision", 2024-01-31T05:14:23.738 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.738 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.738 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.738 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "1", 2024-01-31T05:14:23.738 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.738 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.738 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.738 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.739 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.739 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.739 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.739 INFO:teuthology.orchestra.run.smithi099.stdout: "leaderboard": { 2024-01-31T05:14:23.739 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "leaderboard", 2024-01-31T05:14:23.739 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.739 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.739 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.739 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.739 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.739 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.739 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.740 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.740 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.740 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.740 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.740 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.740 INFO:teuthology.orchestra.run.smithi099.stdout: "leaderboard_description": { 2024-01-31T05:14:23.740 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "leaderboard_description", 2024-01-31T05:14:23.740 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.740 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.740 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.740 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.740 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.740 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.741 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.741 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.741 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.741 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.741 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.741 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.741 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.741 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.741 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.741 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.741 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.741 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.741 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.741 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.742 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.742 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.742 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.742 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.742 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.742 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.742 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.742 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.742 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.742 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.742 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.742 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.742 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.743 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.743 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.743 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.743 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.743 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.743 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.743 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.743 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.743 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.743 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.743 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.743 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.743 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.743 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.743 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.744 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.744 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.744 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.744 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.744 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.744 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.744 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.744 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.744 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.744 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.744 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.744 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.744 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.744 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.745 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.745 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.745 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.745 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.745 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.745 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.745 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.745 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.745 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.745 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.745 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.745 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.745 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.745 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.746 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.746 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.746 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.746 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.746 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.746 INFO:teuthology.orchestra.run.smithi099.stdout: "organization": { 2024-01-31T05:14:23.746 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "organization", 2024-01-31T05:14:23.746 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.746 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.746 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.746 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.746 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.746 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.746 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.747 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.747 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.747 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.747 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.747 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.747 INFO:teuthology.orchestra.run.smithi099.stdout: "proxy": { 2024-01-31T05:14:23.747 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "proxy", 2024-01-31T05:14:23.747 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.747 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.747 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.747 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.747 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.747 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.747 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.747 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.748 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.748 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.748 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.748 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.748 INFO:teuthology.orchestra.run.smithi099.stdout: "url": { 2024-01-31T05:14:23.748 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "url", 2024-01-31T05:14:23.748 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.748 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.748 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.748 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-01-31T05:14:23.748 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.748 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.748 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.748 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.749 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.749 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.749 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.749 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.749 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.749 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.749 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "test_orchestrator", 2024-01-31T05:14:23.749 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.749 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.749 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.749 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.749 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.749 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.749 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.750 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.750 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.750 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.750 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.750 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.750 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.750 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.750 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.750 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.750 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.750 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.750 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.750 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.750 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.750 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.751 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.751 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.751 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.751 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.751 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.751 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.751 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.751 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.751 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.751 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.751 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.751 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.751 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.751 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.752 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.752 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.752 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.752 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.752 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.752 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.752 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.752 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.752 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.752 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.752 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.752 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.752 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.752 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.753 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.753 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.753 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.753 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.753 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.753 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.753 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.753 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.753 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.753 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.753 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.753 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.753 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.753 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.754 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.754 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.754 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.754 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.754 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.754 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.754 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.754 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.754 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.754 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.754 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.754 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "volumes", 2024-01-31T05:14:23.754 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.755 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.755 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.755 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.755 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.755 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.755 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.755 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.755 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.755 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.755 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.755 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.755 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.755 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.755 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.755 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.756 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.756 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.756 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.756 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.756 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.756 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.756 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.756 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.756 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.756 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.756 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.756 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.756 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.757 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.757 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.757 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.757 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.757 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.757 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.757 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.757 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.757 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.757 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.757 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.757 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.757 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.757 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.758 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.758 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.758 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.758 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.758 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.758 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.758 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.758 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.758 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.758 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.758 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.758 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.758 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.758 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.759 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.759 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.759 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.759 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.759 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.759 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.759 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.759 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.759 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.759 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.759 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.759 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.759 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.759 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.760 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.760 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.760 INFO:teuthology.orchestra.run.smithi099.stdout: "max_concurrent_clones": { 2024-01-31T05:14:23.760 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "max_concurrent_clones", 2024-01-31T05:14:23.760 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.760 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.760 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.760 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "4", 2024-01-31T05:14:23.760 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.760 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.760 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.760 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Number of asynchronous cloner threads", 2024-01-31T05:14:23.760 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.760 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.761 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.761 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.761 INFO:teuthology.orchestra.run.smithi099.stdout: "periodic_async_work": { 2024-01-31T05:14:23.761 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "periodic_async_work", 2024-01-31T05:14:23.761 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.761 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.761 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.761 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.761 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.761 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.761 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.761 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Periodically check for async work", 2024-01-31T05:14:23.761 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.761 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.762 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.762 INFO:teuthology.orchestra.run.smithi099.stdout: "snapshot_clone_delay": { 2024-01-31T05:14:23.762 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "snapshot_clone_delay", 2024-01-31T05:14:23.762 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.762 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.762 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.762 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0", 2024-01-31T05:14:23.762 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.762 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.762 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.762 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-01-31T05:14:23.762 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.762 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.763 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.763 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.763 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.763 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.763 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.763 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "zabbix", 2024-01-31T05:14:23.763 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-01-31T05:14:23.763 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-01-31T05:14:23.763 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-01-31T05:14:23.763 INFO:teuthology.orchestra.run.smithi099.stdout: "discovery_interval": { 2024-01-31T05:14:23.763 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "discovery_interval", 2024-01-31T05:14:23.763 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "uint", 2024-01-31T05:14:23.763 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.763 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.763 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "100", 2024-01-31T05:14:23.764 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.764 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.764 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.764 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.764 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.764 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.764 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.764 INFO:teuthology.orchestra.run.smithi099.stdout: "identifier": { 2024-01-31T05:14:23.764 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "identifier", 2024-01-31T05:14:23.764 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.764 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.764 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.765 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.765 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.765 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.765 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.765 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.765 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.765 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.765 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.765 INFO:teuthology.orchestra.run.smithi099.stdout: "interval": { 2024-01-31T05:14:23.765 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "interval", 2024-01-31T05:14:23.765 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-01-31T05:14:23.765 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.765 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.765 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "60", 2024-01-31T05:14:23.766 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.766 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.766 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.766 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.766 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.766 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.766 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.766 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.766 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-01-31T05:14:23.766 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-01-31T05:14:23.766 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.766 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.766 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.766 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.767 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.767 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.767 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.767 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.767 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.767 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.767 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.767 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.767 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.767 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.767 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.767 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.767 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.767 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.768 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-01-31T05:14:23.768 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-01-31T05:14:23.768 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.768 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.768 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.768 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.768 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.768 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.768 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.768 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.768 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.768 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.769 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.769 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-01-31T05:14:23.769 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-01-31T05:14:23.769 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.769 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.769 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.769 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-01-31T05:14:23.769 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.769 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.769 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-01-31T05:14:23.769 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-01-31T05:14:23.769 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-01-31T05:14:23.769 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-01-31T05:14:23.770 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-01-31T05:14:23.770 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-01-31T05:14:23.770 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-01-31T05:14:23.770 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.770 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.770 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.770 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.770 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.770 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-01-31T05:14:23.770 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-01-31T05:14:23.770 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-01-31T05:14:23.770 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.771 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-01-31T05:14:23.771 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-01-31T05:14:23.771 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.771 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.771 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.771 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.771 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.771 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.771 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.771 INFO:teuthology.orchestra.run.smithi099.stdout: "zabbix_host": { 2024-01-31T05:14:23.771 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "zabbix_host", 2024-01-31T05:14:23.771 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.771 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.771 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.771 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-01-31T05:14:23.772 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.772 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.772 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.772 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.772 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.772 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.772 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.772 INFO:teuthology.orchestra.run.smithi099.stdout: "zabbix_port": { 2024-01-31T05:14:23.772 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "zabbix_port", 2024-01-31T05:14:23.772 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-01-31T05:14:23.772 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.772 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.772 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10051", 2024-01-31T05:14:23.773 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.773 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.773 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.773 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.773 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.773 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.773 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.773 INFO:teuthology.orchestra.run.smithi099.stdout: "zabbix_sender": { 2024-01-31T05:14:23.773 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "zabbix_sender", 2024-01-31T05:14:23.773 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-01-31T05:14:23.773 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-01-31T05:14:23.773 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-01-31T05:14:23.773 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-01-31T05:14:23.774 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-01-31T05:14:23.774 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-01-31T05:14:23.774 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-01-31T05:14:23.774 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-01-31T05:14:23.774 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-01-31T05:14:23.774 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-01-31T05:14:23.774 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-01-31T05:14:23.774 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.774 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.774 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.774 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.774 INFO:teuthology.orchestra.run.smithi099.stdout: "services": { 2024-01-31T05:14:23.774 INFO:teuthology.orchestra.run.smithi099.stdout: "dashboard": "https://172.21.15.99:8443/" 2024-01-31T05:14:23.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.774 INFO:teuthology.orchestra.run.smithi099.stdout: "always_on_modules": { 2024-01-31T05:14:23.775 INFO:teuthology.orchestra.run.smithi099.stdout: "octopus": [ 2024-01-31T05:14:23.775 INFO:teuthology.orchestra.run.smithi099.stdout: "balancer", 2024-01-31T05:14:23.775 INFO:teuthology.orchestra.run.smithi099.stdout: "crash", 2024-01-31T05:14:23.775 INFO:teuthology.orchestra.run.smithi099.stdout: "devicehealth", 2024-01-31T05:14:23.775 INFO:teuthology.orchestra.run.smithi099.stdout: "orchestrator", 2024-01-31T05:14:23.775 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscaler", 2024-01-31T05:14:23.775 INFO:teuthology.orchestra.run.smithi099.stdout: "progress", 2024-01-31T05:14:23.775 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_support", 2024-01-31T05:14:23.775 INFO:teuthology.orchestra.run.smithi099.stdout: "status", 2024-01-31T05:14:23.775 INFO:teuthology.orchestra.run.smithi099.stdout: "telemetry", 2024-01-31T05:14:23.775 INFO:teuthology.orchestra.run.smithi099.stdout: "volumes" 2024-01-31T05:14:23.775 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.775 INFO:teuthology.orchestra.run.smithi099.stdout: "pacific": [ 2024-01-31T05:14:23.775 INFO:teuthology.orchestra.run.smithi099.stdout: "balancer", 2024-01-31T05:14:23.775 INFO:teuthology.orchestra.run.smithi099.stdout: "crash", 2024-01-31T05:14:23.776 INFO:teuthology.orchestra.run.smithi099.stdout: "devicehealth", 2024-01-31T05:14:23.776 INFO:teuthology.orchestra.run.smithi099.stdout: "orchestrator", 2024-01-31T05:14:23.776 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscaler", 2024-01-31T05:14:23.776 INFO:teuthology.orchestra.run.smithi099.stdout: "progress", 2024-01-31T05:14:23.776 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_support", 2024-01-31T05:14:23.776 INFO:teuthology.orchestra.run.smithi099.stdout: "status", 2024-01-31T05:14:23.776 INFO:teuthology.orchestra.run.smithi099.stdout: "telemetry", 2024-01-31T05:14:23.776 INFO:teuthology.orchestra.run.smithi099.stdout: "volumes" 2024-01-31T05:14:23.776 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.776 INFO:teuthology.orchestra.run.smithi099.stdout: "quincy": [ 2024-01-31T05:14:23.776 INFO:teuthology.orchestra.run.smithi099.stdout: "balancer", 2024-01-31T05:14:23.776 INFO:teuthology.orchestra.run.smithi099.stdout: "crash", 2024-01-31T05:14:23.777 INFO:teuthology.orchestra.run.smithi099.stdout: "devicehealth", 2024-01-31T05:14:23.777 INFO:teuthology.orchestra.run.smithi099.stdout: "orchestrator", 2024-01-31T05:14:23.777 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscaler", 2024-01-31T05:14:23.777 INFO:teuthology.orchestra.run.smithi099.stdout: "progress", 2024-01-31T05:14:23.777 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_support", 2024-01-31T05:14:23.777 INFO:teuthology.orchestra.run.smithi099.stdout: "status", 2024-01-31T05:14:23.777 INFO:teuthology.orchestra.run.smithi099.stdout: "telemetry", 2024-01-31T05:14:23.777 INFO:teuthology.orchestra.run.smithi099.stdout: "volumes" 2024-01-31T05:14:23.777 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.777 INFO:teuthology.orchestra.run.smithi099.stdout: "reef": [ 2024-01-31T05:14:23.777 INFO:teuthology.orchestra.run.smithi099.stdout: "balancer", 2024-01-31T05:14:23.777 INFO:teuthology.orchestra.run.smithi099.stdout: "crash", 2024-01-31T05:14:23.777 INFO:teuthology.orchestra.run.smithi099.stdout: "devicehealth", 2024-01-31T05:14:23.777 INFO:teuthology.orchestra.run.smithi099.stdout: "orchestrator", 2024-01-31T05:14:23.777 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscaler", 2024-01-31T05:14:23.778 INFO:teuthology.orchestra.run.smithi099.stdout: "progress", 2024-01-31T05:14:23.778 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_support", 2024-01-31T05:14:23.778 INFO:teuthology.orchestra.run.smithi099.stdout: "status", 2024-01-31T05:14:23.778 INFO:teuthology.orchestra.run.smithi099.stdout: "telemetry", 2024-01-31T05:14:23.778 INFO:teuthology.orchestra.run.smithi099.stdout: "volumes" 2024-01-31T05:14:23.778 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-01-31T05:14:23.778 INFO:teuthology.orchestra.run.smithi099.stdout: "squid": [ 2024-01-31T05:14:23.778 INFO:teuthology.orchestra.run.smithi099.stdout: "balancer", 2024-01-31T05:14:23.778 INFO:teuthology.orchestra.run.smithi099.stdout: "crash", 2024-01-31T05:14:23.778 INFO:teuthology.orchestra.run.smithi099.stdout: "devicehealth", 2024-01-31T05:14:23.778 INFO:teuthology.orchestra.run.smithi099.stdout: "orchestrator", 2024-01-31T05:14:23.778 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscaler", 2024-01-31T05:14:23.778 INFO:teuthology.orchestra.run.smithi099.stdout: "progress", 2024-01-31T05:14:23.778 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_support", 2024-01-31T05:14:23.779 INFO:teuthology.orchestra.run.smithi099.stdout: "status", 2024-01-31T05:14:23.779 INFO:teuthology.orchestra.run.smithi099.stdout: "telemetry", 2024-01-31T05:14:23.779 INFO:teuthology.orchestra.run.smithi099.stdout: "volumes" 2024-01-31T05:14:23.779 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-01-31T05:14:23.779 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.779 INFO:teuthology.orchestra.run.smithi099.stdout: "last_failure_osd_epoch": 3, 2024-01-31T05:14:23.779 INFO:teuthology.orchestra.run.smithi099.stdout: "active_clients": [ 2024-01-31T05:14:23.779 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.779 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "devicehealth", 2024-01-31T05:14:23.779 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-01-31T05:14:23.779 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.779 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-01-31T05:14:23.779 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:0", 2024-01-31T05:14:23.779 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1488125855 2024-01-31T05:14:23.779 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.780 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-01-31T05:14:23.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.780 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.780 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "libcephsqlite", 2024-01-31T05:14:23.780 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-01-31T05:14:23.780 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.780 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-01-31T05:14:23.780 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:0", 2024-01-31T05:14:23.780 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 231463475 2024-01-31T05:14:23.780 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.780 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-01-31T05:14:23.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.780 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.780 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rbd_support", 2024-01-31T05:14:23.781 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-01-31T05:14:23.781 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.781 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-01-31T05:14:23.781 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:0", 2024-01-31T05:14:23.781 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2800754321 2024-01-31T05:14:23.781 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.781 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-01-31T05:14:23.781 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:23.781 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.781 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "volumes", 2024-01-31T05:14:23.781 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-01-31T05:14:23.781 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-01-31T05:14:23.781 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-01-31T05:14:23.781 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:0", 2024-01-31T05:14:23.782 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1499649828 2024-01-31T05:14:23.782 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.782 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-01-31T05:14:23.782 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:23.782 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-01-31T05:14:23.782 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-01-31T05:14:23.813 DEBUG:tasks.check_counter:Getting stats from a 2024-01-31T05:14:23.814 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph daemon mds.a perf dump 2024-01-31T05:14:23.814 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:14:22 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/4094079167' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-31T05:14:23.814 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:14:22 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/2675909747' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-31T05:14:23.814 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:14:22 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/2142214876' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-01-31T05:14:24.064 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:14:24.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:14:23 smithi099 ceph-mon[31615]: pgmap v439: 97 pgs: 97 active+clean; 35 MiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 538 op/s 2024-01-31T05:14:24.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:14:23 smithi181 ceph-mon[36434]: pgmap v439: 97 pgs: 97 active+clean; 35 MiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 538 op/s 2024-01-31T05:14:24.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:14:23 smithi179 ceph-mon[35652]: pgmap v439: 97 pgs: 97 active+clean; 35 MiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 538 op/s 2024-01-31T05:14:25.778 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:14:25 smithi099 ceph-mon[31615]: pgmap v440: 97 pgs: 97 active+clean; 37 MiB data, 829 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 365 op/s 2024-01-31T05:14:25.904 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-01-31T05:14:25.905 INFO:teuthology.orchestra.run.smithi099.stdout: "AsyncMessenger::Worker-0": { 2024-01-31T05:14:25.905 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_messages": 7247, 2024-01-31T05:14:25.905 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages": 4598, 2024-01-31T05:14:25.905 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_bytes": 3017685, 2024-01-31T05:14:25.905 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_bytes": 4898269, 2024-01-31T05:14:25.905 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_created_connections": 14, 2024-01-31T05:14:25.905 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_active_connections": 5, 2024-01-31T05:14:25.905 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_total_time": 0.549108036, 2024-01-31T05:14:25.905 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_send_time": 0.151252606, 2024-01-31T05:14:25.905 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_recv_time": 0.286309613, 2024-01-31T05:14:25.905 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_fast_dispatch_time": 0.183528516, 2024-01-31T05:14:25.905 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages_queue_lat": { 2024-01-31T05:14:25.906 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 4596, 2024-01-31T05:14:25.906 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.104903020, 2024-01-31T05:14:25.906 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000022824 2024-01-31T05:14:25.906 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.906 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_handle_ack_lat": { 2024-01-31T05:14:25.906 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 10059, 2024-01-31T05:14:25.906 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.001444068, 2024-01-31T05:14:25.906 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000143 2024-01-31T05:14:25.906 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.906 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_encrypted_bytes": 0, 2024-01-31T05:14:25.906 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_encrypted_bytes": 0 2024-01-31T05:14:25.906 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.906 INFO:teuthology.orchestra.run.smithi099.stdout: "AsyncMessenger::Worker-1": { 2024-01-31T05:14:25.906 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_messages": 1248, 2024-01-31T05:14:25.907 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages": 1007, 2024-01-31T05:14:25.907 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_bytes": 1281416, 2024-01-31T05:14:25.907 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_bytes": 503387, 2024-01-31T05:14:25.907 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_created_connections": 15, 2024-01-31T05:14:25.907 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_active_connections": 7, 2024-01-31T05:14:25.907 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_total_time": 0.088089350, 2024-01-31T05:14:25.907 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_send_time": 0.032312442, 2024-01-31T05:14:25.907 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_recv_time": 0.058337584, 2024-01-31T05:14:25.907 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_fast_dispatch_time": 0.010267767, 2024-01-31T05:14:25.907 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages_queue_lat": { 2024-01-31T05:14:25.907 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 1007, 2024-01-31T05:14:25.907 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.045821861, 2024-01-31T05:14:25.907 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000045503 2024-01-31T05:14:25.908 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.908 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_handle_ack_lat": { 2024-01-31T05:14:25.908 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 1174, 2024-01-31T05:14:25.908 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000163612, 2024-01-31T05:14:25.908 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000139 2024-01-31T05:14:25.908 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.908 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_encrypted_bytes": 848224, 2024-01-31T05:14:25.908 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_encrypted_bytes": 109280 2024-01-31T05:14:25.908 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.908 INFO:teuthology.orchestra.run.smithi099.stdout: "AsyncMessenger::Worker-2": { 2024-01-31T05:14:25.908 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_messages": 2075, 2024-01-31T05:14:25.908 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages": 4043, 2024-01-31T05:14:25.908 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_bytes": 703172, 2024-01-31T05:14:25.908 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_bytes": 2995106, 2024-01-31T05:14:25.909 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_created_connections": 10, 2024-01-31T05:14:25.909 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_active_connections": 6, 2024-01-31T05:14:25.909 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_total_time": 0.451192334, 2024-01-31T05:14:25.909 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_send_time": 0.197231899, 2024-01-31T05:14:25.909 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_recv_time": 0.101887957, 2024-01-31T05:14:25.909 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_fast_dispatch_time": 0.174945213, 2024-01-31T05:14:25.909 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages_queue_lat": { 2024-01-31T05:14:25.909 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 4041, 2024-01-31T05:14:25.909 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.137225888, 2024-01-31T05:14:25.909 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000033958 2024-01-31T05:14:25.909 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.909 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_handle_ack_lat": { 2024-01-31T05:14:25.909 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 4577, 2024-01-31T05:14:25.909 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000533566, 2024-01-31T05:14:25.910 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000116 2024-01-31T05:14:25.910 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.910 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_encrypted_bytes": 549440, 2024-01-31T05:14:25.910 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_encrypted_bytes": 2305664 2024-01-31T05:14:25.910 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.910 INFO:teuthology.orchestra.run.smithi099.stdout: "cct": { 2024-01-31T05:14:25.910 INFO:teuthology.orchestra.run.smithi099.stdout: "total_workers": 1, 2024-01-31T05:14:25.910 INFO:teuthology.orchestra.run.smithi099.stdout: "unhealthy_workers": 0 2024-01-31T05:14:25.910 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.910 INFO:teuthology.orchestra.run.smithi099.stdout: "finisher-MDSRank": { 2024-01-31T05:14:25.910 INFO:teuthology.orchestra.run.smithi099.stdout: "queue_len": 0, 2024-01-31T05:14:25.910 INFO:teuthology.orchestra.run.smithi099.stdout: "complete_latency": { 2024-01-31T05:14:25.910 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 1129, 2024-01-31T05:14:25.910 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.714795518, 2024-01-31T05:14:25.911 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000633122 2024-01-31T05:14:25.911 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:25.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.911 INFO:teuthology.orchestra.run.smithi099.stdout: "finisher-PurgeQueue": { 2024-01-31T05:14:25.911 INFO:teuthology.orchestra.run.smithi099.stdout: "queue_len": 0, 2024-01-31T05:14:25.911 INFO:teuthology.orchestra.run.smithi099.stdout: "complete_latency": { 2024-01-31T05:14:25.911 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 1382, 2024-01-31T05:14:25.911 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.066255583, 2024-01-31T05:14:25.911 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000047941 2024-01-31T05:14:25.911 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:25.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.911 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-01-31T05:14:25.911 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 1168, 2024-01-31T05:14:25.911 INFO:teuthology.orchestra.run.smithi099.stdout: "reply": 1162, 2024-01-31T05:14:25.912 INFO:teuthology.orchestra.run.smithi099.stdout: "reply_latency": { 2024-01-31T05:14:25.912 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 1162, 2024-01-31T05:14:25.912 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 1.604040183, 2024-01-31T05:14:25.912 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.001380413 2024-01-31T05:14:25.912 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.912 INFO:teuthology.orchestra.run.smithi099.stdout: "slow_reply": 0, 2024-01-31T05:14:25.912 INFO:teuthology.orchestra.run.smithi099.stdout: "forward": 6, 2024-01-31T05:14:25.912 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_fetch_complete": 0, 2024-01-31T05:14:25.912 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_fetch_keys": 0, 2024-01-31T05:14:25.912 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_commit": 11, 2024-01-31T05:14:25.912 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_split": 0, 2024-01-31T05:14:25.912 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_merge": 0, 2024-01-31T05:14:25.912 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes": 34, 2024-01-31T05:14:25.912 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_top": 10, 2024-01-31T05:14:25.913 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_bottom": 11, 2024-01-31T05:14:25.913 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_pin_tail": 13, 2024-01-31T05:14:25.913 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_pinned": 19, 2024-01-31T05:14:25.913 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_expired": 254, 2024-01-31T05:14:25.913 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_with_caps": 0, 2024-01-31T05:14:25.913 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 0, 2024-01-31T05:14:25.913 INFO:teuthology.orchestra.run.smithi099.stdout: "subtrees": 5, 2024-01-31T05:14:25.913 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse": 1896, 2024-01-31T05:14:25.913 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_hit": 1681, 2024-01-31T05:14:25.913 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_forward": 2, 2024-01-31T05:14:25.913 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_discover": 60, 2024-01-31T05:14:25.913 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_dir_fetch": 0, 2024-01-31T05:14:25.913 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_remote_ino": 2, 2024-01-31T05:14:25.913 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_lock": 0, 2024-01-31T05:14:25.914 INFO:teuthology.orchestra.run.smithi099.stdout: "load_cent": 0, 2024-01-31T05:14:25.914 INFO:teuthology.orchestra.run.smithi099.stdout: "q": 0, 2024-01-31T05:14:25.914 INFO:teuthology.orchestra.run.smithi099.stdout: "exported": 38, 2024-01-31T05:14:25.914 INFO:teuthology.orchestra.run.smithi099.stdout: "exported_inodes": 5, 2024-01-31T05:14:25.914 INFO:teuthology.orchestra.run.smithi099.stdout: "imported": 45, 2024-01-31T05:14:25.914 INFO:teuthology.orchestra.run.smithi099.stdout: "imported_inodes": 598, 2024-01-31T05:14:25.914 INFO:teuthology.orchestra.run.smithi099.stdout: "openino_dir_fetch": 0, 2024-01-31T05:14:25.914 INFO:teuthology.orchestra.run.smithi099.stdout: "openino_backtrace_fetch": 575, 2024-01-31T05:14:25.914 INFO:teuthology.orchestra.run.smithi099.stdout: "openino_peer_discover": 3, 2024-01-31T05:14:25.916 INFO:teuthology.orchestra.run.smithi099.stdout: "root_rfiles": 1122, 2024-01-31T05:14:25.916 INFO:teuthology.orchestra.run.smithi099.stdout: "root_rbytes": 9415333, 2024-01-31T05:14:25.916 INFO:teuthology.orchestra.run.smithi099.stdout: "root_rsnaps": 0, 2024-01-31T05:14:25.916 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_backtrace_fetch": 575, 2024-01-31T05:14:25.916 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_set_tag": 0, 2024-01-31T05:14:25.917 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_backtrace_repaired": 0, 2024-01-31T05:14:25.917 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_inotable_repaired": 0, 2024-01-31T05:14:25.917 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_dir_inodes": 15, 2024-01-31T05:14:25.917 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_dir_base_inodes": 0, 2024-01-31T05:14:25.917 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_dirfrag_rstats": 15, 2024-01-31T05:14:25.917 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_file_inodes": 560, 2024-01-31T05:14:25.917 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_inode_file_caps": 2, 2024-01-31T05:14:25.917 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_revoke": 150, 2024-01-31T05:14:25.917 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_grant": 747, 2024-01-31T05:14:25.917 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_trunc": 0, 2024-01-31T05:14:25.917 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-01-31T05:14:25.917 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_flush_ack": 0, 2024-01-31T05:14:25.917 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_caps": 302, 2024-01-31T05:14:25.917 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_caps_dirty": 126, 2024-01-31T05:14:25.917 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_cap_release": 39, 2024-01-31T05:14:25.918 INFO:teuthology.orchestra.run.smithi099.stdout: "process_request_cap_release": 909 2024-01-31T05:14:25.918 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.918 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_cache": { 2024-01-31T05:14:25.918 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_update": 0, 2024-01-31T05:14:25.918 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_update_receipt": 0, 2024-01-31T05:14:25.918 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_try_discover": 0, 2024-01-31T05:14:25.918 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_send_discover": 67, 2024-01-31T05:14:25.918 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_handle_discover": 15, 2024-01-31T05:14:25.918 INFO:teuthology.orchestra.run.smithi099.stdout: "num_strays": 1, 2024-01-31T05:14:25.918 INFO:teuthology.orchestra.run.smithi099.stdout: "num_strays_delayed": 0, 2024-01-31T05:14:25.918 INFO:teuthology.orchestra.run.smithi099.stdout: "num_strays_enqueuing": 0, 2024-01-31T05:14:25.918 INFO:teuthology.orchestra.run.smithi099.stdout: "strays_created": 624, 2024-01-31T05:14:25.918 INFO:teuthology.orchestra.run.smithi099.stdout: "strays_enqueued": 623, 2024-01-31T05:14:25.919 INFO:teuthology.orchestra.run.smithi099.stdout: "strays_reintegrated": 0, 2024-01-31T05:14:25.919 INFO:teuthology.orchestra.run.smithi099.stdout: "strays_migrated": 0, 2024-01-31T05:14:25.919 INFO:teuthology.orchestra.run.smithi099.stdout: "num_recovering_processing": 0, 2024-01-31T05:14:25.919 INFO:teuthology.orchestra.run.smithi099.stdout: "num_recovering_enqueued": 0, 2024-01-31T05:14:25.919 INFO:teuthology.orchestra.run.smithi099.stdout: "num_recovering_prioritized": 0, 2024-01-31T05:14:25.919 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_started": 0, 2024-01-31T05:14:25.919 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_completed": 0, 2024-01-31T05:14:25.919 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_enqueue_scrub": 0, 2024-01-31T05:14:25.919 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_exportdir": 38, 2024-01-31T05:14:25.919 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_flush": 0, 2024-01-31T05:14:25.919 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_fragmentdir": 0, 2024-01-31T05:14:25.919 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_fragstats": 0, 2024-01-31T05:14:25.919 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_inodestats": 0 2024-01-31T05:14:25.920 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.920 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_log": { 2024-01-31T05:14:25.920 INFO:teuthology.orchestra.run.smithi099.stdout: "evlrg": 0, 2024-01-31T05:14:25.920 INFO:teuthology.orchestra.run.smithi099.stdout: "evadd": 2086, 2024-01-31T05:14:25.920 INFO:teuthology.orchestra.run.smithi099.stdout: "evex": 0, 2024-01-31T05:14:25.920 INFO:teuthology.orchestra.run.smithi099.stdout: "evtrm": 0, 2024-01-31T05:14:25.920 INFO:teuthology.orchestra.run.smithi099.stdout: "ev": 2086, 2024-01-31T05:14:25.920 INFO:teuthology.orchestra.run.smithi099.stdout: "evexg": 0, 2024-01-31T05:14:25.930 INFO:teuthology.orchestra.run.smithi099.stdout: "evexd": 0, 2024-01-31T05:14:25.930 INFO:teuthology.orchestra.run.smithi099.stdout: "segadd": 4, 2024-01-31T05:14:25.930 INFO:teuthology.orchestra.run.smithi099.stdout: "segex": 0, 2024-01-31T05:14:25.930 INFO:teuthology.orchestra.run.smithi099.stdout: "segtrm": 0, 2024-01-31T05:14:25.930 INFO:teuthology.orchestra.run.smithi099.stdout: "seg": 4, 2024-01-31T05:14:25.931 INFO:teuthology.orchestra.run.smithi099.stdout: "segmjr": 2, 2024-01-31T05:14:25.931 INFO:teuthology.orchestra.run.smithi099.stdout: "segexg": 0, 2024-01-31T05:14:25.931 INFO:teuthology.orchestra.run.smithi099.stdout: "segexd": 0, 2024-01-31T05:14:25.931 INFO:teuthology.orchestra.run.smithi099.stdout: "expos": 4194304, 2024-01-31T05:14:25.931 INFO:teuthology.orchestra.run.smithi099.stdout: "wrpos": 8790658, 2024-01-31T05:14:25.931 INFO:teuthology.orchestra.run.smithi099.stdout: "rdpos": 0, 2024-01-31T05:14:25.931 INFO:teuthology.orchestra.run.smithi099.stdout: "jlat": { 2024-01-31T05:14:25.931 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 293, 2024-01-31T05:14:25.931 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 1.405089278, 2024-01-31T05:14:25.931 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.004795526 2024-01-31T05:14:25.931 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.931 INFO:teuthology.orchestra.run.smithi099.stdout: "replayed": 0 2024-01-31T05:14:25.931 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.931 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_mem": { 2024-01-31T05:14:25.932 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 34, 2024-01-31T05:14:25.932 INFO:teuthology.orchestra.run.smithi099.stdout: "ino+": 782, 2024-01-31T05:14:25.932 INFO:teuthology.orchestra.run.smithi099.stdout: "ino-": 748, 2024-01-31T05:14:25.932 INFO:teuthology.orchestra.run.smithi099.stdout: "dir": 33, 2024-01-31T05:14:25.932 INFO:teuthology.orchestra.run.smithi099.stdout: "dir+": 190, 2024-01-31T05:14:25.932 INFO:teuthology.orchestra.run.smithi099.stdout: "dir-": 157, 2024-01-31T05:14:25.932 INFO:teuthology.orchestra.run.smithi099.stdout: "dn": 29, 2024-01-31T05:14:25.932 INFO:teuthology.orchestra.run.smithi099.stdout: "dn+": 1531, 2024-01-31T05:14:25.932 INFO:teuthology.orchestra.run.smithi099.stdout: "dn-": 1502, 2024-01-31T05:14:25.932 INFO:teuthology.orchestra.run.smithi099.stdout: "cap": 0, 2024-01-31T05:14:25.932 INFO:teuthology.orchestra.run.smithi099.stdout: "cap+": 1086, 2024-01-31T05:14:25.932 INFO:teuthology.orchestra.run.smithi099.stdout: "cap-": 1086, 2024-01-31T05:14:25.932 INFO:teuthology.orchestra.run.smithi099.stdout: "rss": 64560, 2024-01-31T05:14:25.933 INFO:teuthology.orchestra.run.smithi099.stdout: "heap": 199036 2024-01-31T05:14:25.933 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.933 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_server": { 2024-01-31T05:14:25.933 INFO:teuthology.orchestra.run.smithi099.stdout: "dispatch_client_request": 1447, 2024-01-31T05:14:25.933 INFO:teuthology.orchestra.run.smithi099.stdout: "dispatch_server_request": 87, 2024-01-31T05:14:25.933 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_request": 1168, 2024-01-31T05:14:25.933 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_session": 39, 2024-01-31T05:14:25.933 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_peer_request": 259, 2024-01-31T05:14:25.933 INFO:teuthology.orchestra.run.smithi099.stdout: "req_create_latency": { 2024-01-31T05:14:25.933 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 11, 2024-01-31T05:14:25.933 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.027489939, 2024-01-31T05:14:25.933 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.002499085 2024-01-31T05:14:25.933 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.933 INFO:teuthology.orchestra.run.smithi099.stdout: "req_getattr_latency": { 2024-01-31T05:14:25.934 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 1, 2024-01-31T05:14:25.934 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.001600761, 2024-01-31T05:14:25.934 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.001600761 2024-01-31T05:14:25.934 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.934 INFO:teuthology.orchestra.run.smithi099.stdout: "req_getfilelock_latency": { 2024-01-31T05:14:25.934 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:25.934 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:25.934 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:25.934 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.934 INFO:teuthology.orchestra.run.smithi099.stdout: "req_link_latency": { 2024-01-31T05:14:25.934 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 1, 2024-01-31T05:14:25.934 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.008720591, 2024-01-31T05:14:25.934 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.008720591 2024-01-31T05:14:25.934 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.934 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookup_latency": { 2024-01-31T05:14:25.935 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 446, 2024-01-31T05:14:25.935 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.175801665, 2024-01-31T05:14:25.935 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000394174 2024-01-31T05:14:25.935 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.935 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookuphash_latency": { 2024-01-31T05:14:25.935 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:25.935 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:25.935 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:25.935 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.935 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookupino_latency": { 2024-01-31T05:14:25.935 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:25.935 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:25.935 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:25.935 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.936 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookupname_latency": { 2024-01-31T05:14:25.936 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:25.936 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:25.936 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:25.936 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.936 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookupparent_latency": { 2024-01-31T05:14:25.936 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:25.936 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:25.936 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:25.936 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.936 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookupsnap_latency": { 2024-01-31T05:14:25.936 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:25.936 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:25.936 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:25.936 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.937 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lssnap_latency": { 2024-01-31T05:14:25.937 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:25.937 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:25.937 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:25.937 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.937 INFO:teuthology.orchestra.run.smithi099.stdout: "req_mkdir_latency": { 2024-01-31T05:14:25.938 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 4, 2024-01-31T05:14:25.938 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.005720592, 2024-01-31T05:14:25.938 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.001430148 2024-01-31T05:14:25.938 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.938 INFO:teuthology.orchestra.run.smithi099.stdout: "req_mknod_latency": { 2024-01-31T05:14:25.938 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 7, 2024-01-31T05:14:25.938 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.005333551, 2024-01-31T05:14:25.938 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000761935 2024-01-31T05:14:25.938 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.938 INFO:teuthology.orchestra.run.smithi099.stdout: "req_mksnap_latency": { 2024-01-31T05:14:25.938 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:25.938 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:25.938 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:25.938 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.939 INFO:teuthology.orchestra.run.smithi099.stdout: "req_open_latency": { 2024-01-31T05:14:25.939 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:25.939 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:25.939 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:25.939 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.939 INFO:teuthology.orchestra.run.smithi099.stdout: "req_readdir_latency": { 2024-01-31T05:14:25.939 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 54, 2024-01-31T05:14:25.939 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.032342723, 2024-01-31T05:14:25.939 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000598939 2024-01-31T05:14:25.939 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.939 INFO:teuthology.orchestra.run.smithi099.stdout: "req_rename_latency": { 2024-01-31T05:14:25.939 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 4, 2024-01-31T05:14:25.939 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.069813625, 2024-01-31T05:14:25.939 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.017453406 2024-01-31T05:14:25.939 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.940 INFO:teuthology.orchestra.run.smithi099.stdout: "req_renamesnap_latency": { 2024-01-31T05:14:25.940 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:25.940 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:25.940 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:25.940 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.940 INFO:teuthology.orchestra.run.smithi099.stdout: "req_snapdiff_latency": { 2024-01-31T05:14:25.940 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:25.940 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:25.940 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:25.940 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.940 INFO:teuthology.orchestra.run.smithi099.stdout: "req_rmdir_latency": { 2024-01-31T05:14:25.940 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 22, 2024-01-31T05:14:25.940 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.419848744, 2024-01-31T05:14:25.940 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.019084033 2024-01-31T05:14:25.941 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.941 INFO:teuthology.orchestra.run.smithi099.stdout: "req_rmsnap_latency": { 2024-01-31T05:14:25.941 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:25.941 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:25.941 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:25.941 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.941 INFO:teuthology.orchestra.run.smithi099.stdout: "req_rmxattr_latency": { 2024-01-31T05:14:25.941 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:25.941 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:25.941 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:25.941 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.941 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setattr_latency": { 2024-01-31T05:14:25.941 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:25.941 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:25.941 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:25.942 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.942 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setdirlayout_latency": { 2024-01-31T05:14:25.942 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:25.942 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:25.942 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:25.942 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.942 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setfilelock_latency": { 2024-01-31T05:14:25.942 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:25.942 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:25.942 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:25.942 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.942 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setlayout_latency": { 2024-01-31T05:14:25.942 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:25.942 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:25.942 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:25.943 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.943 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setxattr_latency": { 2024-01-31T05:14:25.943 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:25.943 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:25.943 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:25.943 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.943 INFO:teuthology.orchestra.run.smithi099.stdout: "req_symlink_latency": { 2024-01-31T05:14:25.943 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 6, 2024-01-31T05:14:25.943 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.004736766, 2024-01-31T05:14:25.943 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000789461 2024-01-31T05:14:25.943 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.943 INFO:teuthology.orchestra.run.smithi099.stdout: "req_unlink_latency": { 2024-01-31T05:14:25.943 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 606, 2024-01-31T05:14:25.943 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.852631226, 2024-01-31T05:14:25.944 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.001406982 2024-01-31T05:14:25.944 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.944 INFO:teuthology.orchestra.run.smithi099.stdout: "cap_revoke_eviction": 0, 2024-01-31T05:14:25.944 INFO:teuthology.orchestra.run.smithi099.stdout: "cap_acquisition_throttle": 0, 2024-01-31T05:14:25.944 INFO:teuthology.orchestra.run.smithi099.stdout: "req_getvxattr_latency": { 2024-01-31T05:14:25.944 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:25.944 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:25.944 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:25.944 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:25.944 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.944 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_sessions": { 2024-01-31T05:14:25.944 INFO:teuthology.orchestra.run.smithi099.stdout: "session_count": 1, 2024-01-31T05:14:25.944 INFO:teuthology.orchestra.run.smithi099.stdout: "session_add": 2, 2024-01-31T05:14:25.944 INFO:teuthology.orchestra.run.smithi099.stdout: "session_remove": 1, 2024-01-31T05:14:25.945 INFO:teuthology.orchestra.run.smithi099.stdout: "sessions_open": 1, 2024-01-31T05:14:25.945 INFO:teuthology.orchestra.run.smithi099.stdout: "sessions_stale": 0, 2024-01-31T05:14:25.945 INFO:teuthology.orchestra.run.smithi099.stdout: "total_load": 879, 2024-01-31T05:14:25.945 INFO:teuthology.orchestra.run.smithi099.stdout: "average_load": 879, 2024-01-31T05:14:25.945 INFO:teuthology.orchestra.run.smithi099.stdout: "avg_session_uptime": 176, 2024-01-31T05:14:25.945 INFO:teuthology.orchestra.run.smithi099.stdout: "mdthresh_evicted": 0 2024-01-31T05:14:25.945 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.945 INFO:teuthology.orchestra.run.smithi099.stdout: "mempool": { 2024-01-31T05:14:25.945 INFO:teuthology.orchestra.run.smithi099.stdout: "bloom_filter_bytes": 0, 2024-01-31T05:14:25.945 INFO:teuthology.orchestra.run.smithi099.stdout: "bloom_filter_items": 0, 2024-01-31T05:14:25.945 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_alloc_bytes": 0, 2024-01-31T05:14:25.945 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_alloc_items": 0, 2024-01-31T05:14:25.945 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_data_bytes": 0, 2024-01-31T05:14:25.945 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_data_items": 0, 2024-01-31T05:14:25.946 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_onode_bytes": 0, 2024-01-31T05:14:25.946 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_onode_items": 0, 2024-01-31T05:14:25.946 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_meta_bytes": 0, 2024-01-31T05:14:25.946 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_meta_items": 0, 2024-01-31T05:14:25.946 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_other_bytes": 0, 2024-01-31T05:14:25.946 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_other_items": 0, 2024-01-31T05:14:25.946 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_buffer_bytes": 0, 2024-01-31T05:14:25.946 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_buffer_items": 0, 2024-01-31T05:14:25.946 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_extent_bytes": 0, 2024-01-31T05:14:25.946 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_extent_items": 0, 2024-01-31T05:14:25.946 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_blob_bytes": 0, 2024-01-31T05:14:25.946 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_blob_items": 0, 2024-01-31T05:14:25.946 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_shared_blob_bytes": 0, 2024-01-31T05:14:25.946 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_shared_blob_items": 0, 2024-01-31T05:14:25.947 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_inline_bl_bytes": 0, 2024-01-31T05:14:25.947 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_inline_bl_items": 0, 2024-01-31T05:14:25.947 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_fsck_bytes": 0, 2024-01-31T05:14:25.947 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_fsck_items": 0, 2024-01-31T05:14:25.947 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_txc_bytes": 0, 2024-01-31T05:14:25.947 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_txc_items": 0, 2024-01-31T05:14:25.947 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_deferred_bytes": 0, 2024-01-31T05:14:25.947 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_deferred_items": 0, 2024-01-31T05:14:25.947 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_bytes": 0, 2024-01-31T05:14:25.947 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_items": 0, 2024-01-31T05:14:25.947 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_bytes": 0, 2024-01-31T05:14:25.947 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_items": 0, 2024-01-31T05:14:25.947 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_reader_bytes": 0, 2024-01-31T05:14:25.947 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_reader_items": 0, 2024-01-31T05:14:25.948 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_writer_bytes": 0, 2024-01-31T05:14:25.948 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_writer_items": 0, 2024-01-31T05:14:25.948 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_anon_bytes": 342781, 2024-01-31T05:14:25.948 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_anon_items": 133, 2024-01-31T05:14:25.948 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_meta_bytes": 176, 2024-01-31T05:14:25.948 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_meta_items": 2, 2024-01-31T05:14:25.948 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_bytes": 0, 2024-01-31T05:14:25.948 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_items": 0, 2024-01-31T05:14:25.948 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mapbl_bytes": 0, 2024-01-31T05:14:25.948 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mapbl_items": 0, 2024-01-31T05:14:25.948 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pglog_bytes": 0, 2024-01-31T05:14:25.948 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pglog_items": 0, 2024-01-31T05:14:25.948 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_bytes": 7240, 2024-01-31T05:14:25.949 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_items": 152, 2024-01-31T05:14:25.949 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_mapping_bytes": 0, 2024-01-31T05:14:25.949 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_mapping_items": 0, 2024-01-31T05:14:25.949 INFO:teuthology.orchestra.run.smithi099.stdout: "pgmap_bytes": 0, 2024-01-31T05:14:25.949 INFO:teuthology.orchestra.run.smithi099.stdout: "pgmap_items": 0, 2024-01-31T05:14:25.949 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_co_bytes": 155567, 2024-01-31T05:14:25.949 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_co_items": 1553, 2024-01-31T05:14:25.949 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_1_bytes": 0, 2024-01-31T05:14:25.949 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_1_items": 0, 2024-01-31T05:14:25.949 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_2_bytes": 0, 2024-01-31T05:14:25.949 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_2_items": 0 2024-01-31T05:14:25.949 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.949 INFO:teuthology.orchestra.run.smithi099.stdout: "objecter": { 2024-01-31T05:14:25.949 INFO:teuthology.orchestra.run.smithi099.stdout: "op_active": 0, 2024-01-31T05:14:25.950 INFO:teuthology.orchestra.run.smithi099.stdout: "op_laggy": 0, 2024-01-31T05:14:25.950 INFO:teuthology.orchestra.run.smithi099.stdout: "op_send": 1739, 2024-01-31T05:14:25.950 INFO:teuthology.orchestra.run.smithi099.stdout: "op_send_bytes": 4742218, 2024-01-31T05:14:25.950 INFO:teuthology.orchestra.run.smithi099.stdout: "op_resend": 33, 2024-01-31T05:14:25.950 INFO:teuthology.orchestra.run.smithi099.stdout: "op_reply": 1739, 2024-01-31T05:14:25.950 INFO:teuthology.orchestra.run.smithi099.stdout: "op_latency": { 2024-01-31T05:14:25.950 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 1739, 2024-01-31T05:14:25.950 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 4.298900857, 2024-01-31T05:14:25.950 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.002472053 2024-01-31T05:14:25.950 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.950 INFO:teuthology.orchestra.run.smithi099.stdout: "op_inflight": 0, 2024-01-31T05:14:25.950 INFO:teuthology.orchestra.run.smithi099.stdout: "oplen_avg": { 2024-01-31T05:14:25.950 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 1739, 2024-01-31T05:14:25.950 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 1790 2024-01-31T05:14:25.950 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.950 INFO:teuthology.orchestra.run.smithi099.stdout: "op": 1739, 2024-01-31T05:14:25.951 INFO:teuthology.orchestra.run.smithi099.stdout: "op_r": 639, 2024-01-31T05:14:25.951 INFO:teuthology.orchestra.run.smithi099.stdout: "op_w": 1100, 2024-01-31T05:14:25.951 INFO:teuthology.orchestra.run.smithi099.stdout: "op_rmw": 0, 2024-01-31T05:14:25.951 INFO:teuthology.orchestra.run.smithi099.stdout: "op_pg": 0, 2024-01-31T05:14:25.951 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_stat": 0, 2024-01-31T05:14:25.951 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_create": 10, 2024-01-31T05:14:25.951 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_read": 64, 2024-01-31T05:14:25.951 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_write": 357, 2024-01-31T05:14:25.951 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_writefull": 48, 2024-01-31T05:14:25.951 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_writesame": 0, 2024-01-31T05:14:25.951 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_append": 0, 2024-01-31T05:14:25.951 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_zero": 0, 2024-01-31T05:14:25.951 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_truncate": 0, 2024-01-31T05:14:25.951 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_delete": 653, 2024-01-31T05:14:25.951 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_mapext": 0, 2024-01-31T05:14:25.952 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_sparse_read": 0, 2024-01-31T05:14:25.952 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_clonerange": 0, 2024-01-31T05:14:25.952 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_getxattr": 575, 2024-01-31T05:14:25.952 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_setxattr": 20, 2024-01-31T05:14:25.952 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_cmpxattr": 0, 2024-01-31T05:14:25.952 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_rmxattr": 0, 2024-01-31T05:14:25.952 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_resetxattrs": 0, 2024-01-31T05:14:25.952 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_call": 0, 2024-01-31T05:14:25.952 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_watch": 0, 2024-01-31T05:14:25.952 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_notify": 0, 2024-01-31T05:14:25.953 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_src_cmpxattr": 0, 2024-01-31T05:14:25.953 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_pgls": 0, 2024-01-31T05:14:25.953 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_pgls_filter": 0, 2024-01-31T05:14:25.953 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_other": 0, 2024-01-31T05:14:25.953 INFO:teuthology.orchestra.run.smithi099.stdout: "linger_active": 0, 2024-01-31T05:14:25.953 INFO:teuthology.orchestra.run.smithi099.stdout: "linger_send": 0, 2024-01-31T05:14:25.953 INFO:teuthology.orchestra.run.smithi099.stdout: "linger_resend": 0, 2024-01-31T05:14:25.953 INFO:teuthology.orchestra.run.smithi099.stdout: "linger_ping": 0, 2024-01-31T05:14:25.953 INFO:teuthology.orchestra.run.smithi099.stdout: "poolop_active": 0, 2024-01-31T05:14:25.953 INFO:teuthology.orchestra.run.smithi099.stdout: "poolop_send": 0, 2024-01-31T05:14:25.953 INFO:teuthology.orchestra.run.smithi099.stdout: "poolop_resend": 0, 2024-01-31T05:14:25.953 INFO:teuthology.orchestra.run.smithi099.stdout: "poolstat_active": 0, 2024-01-31T05:14:25.953 INFO:teuthology.orchestra.run.smithi099.stdout: "poolstat_send": 0, 2024-01-31T05:14:25.953 INFO:teuthology.orchestra.run.smithi099.stdout: "poolstat_resend": 0, 2024-01-31T05:14:25.954 INFO:teuthology.orchestra.run.smithi099.stdout: "statfs_active": 0, 2024-01-31T05:14:25.954 INFO:teuthology.orchestra.run.smithi099.stdout: "statfs_send": 0, 2024-01-31T05:14:25.954 INFO:teuthology.orchestra.run.smithi099.stdout: "statfs_resend": 0, 2024-01-31T05:14:25.954 INFO:teuthology.orchestra.run.smithi099.stdout: "command_active": 0, 2024-01-31T05:14:25.954 INFO:teuthology.orchestra.run.smithi099.stdout: "command_send": 0, 2024-01-31T05:14:25.954 INFO:teuthology.orchestra.run.smithi099.stdout: "command_resend": 0, 2024-01-31T05:14:25.954 INFO:teuthology.orchestra.run.smithi099.stdout: "map_epoch": 88, 2024-01-31T05:14:25.954 INFO:teuthology.orchestra.run.smithi099.stdout: "map_full": 0, 2024-01-31T05:14:25.954 INFO:teuthology.orchestra.run.smithi099.stdout: "map_inc": 2, 2024-01-31T05:14:25.954 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_sessions": 12, 2024-01-31T05:14:25.954 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_session_open": 12, 2024-01-31T05:14:25.954 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_session_close": 0, 2024-01-31T05:14:25.954 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_laggy": 0, 2024-01-31T05:14:25.954 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_wr": 48, 2024-01-31T05:14:25.954 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_rd": 0, 2024-01-31T05:14:25.955 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_del": 15 2024-01-31T05:14:25.955 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.955 INFO:teuthology.orchestra.run.smithi099.stdout: "oft": { 2024-01-31T05:14:25.955 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_total_objs": 1, 2024-01-31T05:14:25.955 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_total_kv_pairs": 0, 2024-01-31T05:14:25.955 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_total_updates": 0, 2024-01-31T05:14:25.955 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_total_removes": 0 2024-01-31T05:14:25.955 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.955 INFO:teuthology.orchestra.run.smithi099.stdout: "osd-slow-ops": { 2024-01-31T05:14:25.955 INFO:teuthology.orchestra.run.smithi099.stdout: "slow_ops_count": 0 2024-01-31T05:14:25.955 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.955 INFO:teuthology.orchestra.run.smithi099.stdout: "purge_queue": { 2024-01-31T05:14:25.955 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executing_ops": 0, 2024-01-31T05:14:25.956 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executing_ops_high_water": 8, 2024-01-31T05:14:25.956 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executing": 0, 2024-01-31T05:14:25.956 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executing_high_water": 6, 2024-01-31T05:14:25.956 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executed_ops": 640, 2024-01-31T05:14:25.956 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executed": 623, 2024-01-31T05:14:25.956 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_item_in_journal": 0 2024-01-31T05:14:25.956 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.956 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-01-31T05:14:25.956 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-01-31T05:14:25.956 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 104857600, 2024-01-31T05:14:25.956 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-01-31T05:14:25.956 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 10567, 2024-01-31T05:14:25.956 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 3972584, 2024-01-31T05:14:25.956 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:25.957 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 10567, 2024-01-31T05:14:25.957 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 0, 2024-01-31T05:14:25.957 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 0, 2024-01-31T05:14:25.957 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 10567, 2024-01-31T05:14:25.957 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 3972584, 2024-01-31T05:14:25.957 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-01-31T05:14:25.957 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:25.957 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:25.957 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:25.957 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:25.957 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.957 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-objecter_bytes": { 2024-01-31T05:14:25.957 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-01-31T05:14:25.958 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 104857600, 2024-01-31T05:14:25.958 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-01-31T05:14:25.958 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 0, 2024-01-31T05:14:25.958 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 0, 2024-01-31T05:14:25.958 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:25.958 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 0, 2024-01-31T05:14:25.958 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 1739, 2024-01-31T05:14:25.958 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 4805141, 2024-01-31T05:14:25.958 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 1739, 2024-01-31T05:14:25.958 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 4805141, 2024-01-31T05:14:25.958 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-01-31T05:14:25.959 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:25.959 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:25.959 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:25.959 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:25.959 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.959 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-objecter_ops": { 2024-01-31T05:14:25.959 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-01-31T05:14:25.959 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 1024, 2024-01-31T05:14:25.959 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-01-31T05:14:25.959 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 0, 2024-01-31T05:14:25.959 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 0, 2024-01-31T05:14:25.959 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:25.959 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 0, 2024-01-31T05:14:25.959 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 1739, 2024-01-31T05:14:25.959 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 1739, 2024-01-31T05:14:25.960 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 1739, 2024-01-31T05:14:25.960 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 1739, 2024-01-31T05:14:25.960 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-01-31T05:14:25.960 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:25.960 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:25.960 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:25.960 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:25.960 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.960 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-write_buf_throttle": { 2024-01-31T05:14:25.960 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-01-31T05:14:25.960 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 3758096384, 2024-01-31T05:14:25.961 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-01-31T05:14:25.961 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 623, 2024-01-31T05:14:25.961 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 62923, 2024-01-31T05:14:25.961 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:25.961 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 623, 2024-01-31T05:14:25.961 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 0, 2024-01-31T05:14:25.961 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 0, 2024-01-31T05:14:25.961 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 64, 2024-01-31T05:14:25.961 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 62923, 2024-01-31T05:14:25.961 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-01-31T05:14:25.961 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:25.961 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:25.961 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:25.962 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:25.962 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:25.962 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-write_buf_throttle-0x55d988fb66e0": { 2024-01-31T05:14:25.962 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-01-31T05:14:25.962 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 3758096384, 2024-01-31T05:14:25.962 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-01-31T05:14:25.962 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 2086, 2024-01-31T05:14:25.962 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 4596354, 2024-01-31T05:14:25.962 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:25.962 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 2086, 2024-01-31T05:14:25.962 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 0, 2024-01-31T05:14:25.962 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 0, 2024-01-31T05:14:25.962 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 293, 2024-01-31T05:14:25.962 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 4596354, 2024-01-31T05:14:25.963 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-01-31T05:14:25.963 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:25.963 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:25.963 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:25.963 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:25.963 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:25.963 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-01-31T05:14:26.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:14:25 smithi181 ceph-mon[36434]: pgmap v440: 97 pgs: 97 active+clean; 37 MiB data, 829 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 365 op/s 2024-01-31T05:14:26.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:14:25 smithi179 ceph-mon[35652]: pgmap v440: 97 pgs: 97 active+clean; 37 MiB data, 829 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 365 op/s 2024-01-31T05:14:26.687 INFO:tasks.check_counter:Daemon mds.a mds.exported=38 2024-01-31T05:14:26.687 INFO:tasks.check_counter:Daemon mds.a mds.imported=45 2024-01-31T05:14:26.687 DEBUG:tasks.check_counter:Getting stats from d 2024-01-31T05:14:26.687 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph daemon mds.d perf dump 2024-01-31T05:14:26.936 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:14:28.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:14:27 smithi099 ceph-mon[31615]: pgmap v441: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 327 op/s 2024-01-31T05:14:28.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:14:27 smithi181 ceph-mon[36434]: pgmap v441: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 327 op/s 2024-01-31T05:14:28.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:14:27 smithi179 ceph-mon[35652]: pgmap v441: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 327 op/s 2024-01-31T05:14:28.685 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-01-31T05:14:28.686 INFO:teuthology.orchestra.run.smithi099.stdout: "AsyncMessenger::Worker-0": { 2024-01-31T05:14:28.686 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_messages": 4, 2024-01-31T05:14:28.686 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages": 4, 2024-01-31T05:14:28.686 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_bytes": 2992, 2024-01-31T05:14:28.686 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_bytes": 448, 2024-01-31T05:14:28.686 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_created_connections": 4, 2024-01-31T05:14:28.686 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_active_connections": 0, 2024-01-31T05:14:28.686 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_total_time": 0.001346114, 2024-01-31T05:14:28.686 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_send_time": 0.000039271, 2024-01-31T05:14:28.686 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_recv_time": 0.000488462, 2024-01-31T05:14:28.686 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-01-31T05:14:28.686 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages_queue_lat": { 2024-01-31T05:14:28.686 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 3, 2024-01-31T05:14:28.686 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000759940, 2024-01-31T05:14:28.687 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000253313 2024-01-31T05:14:28.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:28.687 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_handle_ack_lat": { 2024-01-31T05:14:28.687 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:28.687 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:28.687 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:28.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:28.687 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-01-31T05:14:28.687 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_encrypted_bytes": 448 2024-01-31T05:14:28.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:28.687 INFO:teuthology.orchestra.run.smithi099.stdout: "AsyncMessenger::Worker-1": { 2024-01-31T05:14:28.687 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_messages": 98, 2024-01-31T05:14:28.687 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages": 93, 2024-01-31T05:14:28.687 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_bytes": 708944, 2024-01-31T05:14:28.688 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_bytes": 54672, 2024-01-31T05:14:28.688 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_created_connections": 2, 2024-01-31T05:14:28.688 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_active_connections": 1, 2024-01-31T05:14:28.688 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_total_time": 0.017535080, 2024-01-31T05:14:28.688 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_send_time": 0.005561398, 2024-01-31T05:14:28.688 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_recv_time": 0.014897012, 2024-01-31T05:14:28.688 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_fast_dispatch_time": 0.001633189, 2024-01-31T05:14:28.688 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages_queue_lat": { 2024-01-31T05:14:28.688 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 92, 2024-01-31T05:14:28.688 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.004596496, 2024-01-31T05:14:28.688 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000049961 2024-01-31T05:14:28.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:28.688 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_handle_ack_lat": { 2024-01-31T05:14:28.688 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:28.689 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:28.689 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:28.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:28.689 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_encrypted_bytes": 708944, 2024-01-31T05:14:28.689 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_encrypted_bytes": 54672 2024-01-31T05:14:28.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:28.689 INFO:teuthology.orchestra.run.smithi099.stdout: "AsyncMessenger::Worker-2": { 2024-01-31T05:14:28.689 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_messages": 1, 2024-01-31T05:14:28.689 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages": 70, 2024-01-31T05:14:28.689 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_bytes": 160, 2024-01-31T05:14:28.689 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_bytes": 89312, 2024-01-31T05:14:28.689 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_created_connections": 3, 2024-01-31T05:14:28.689 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_active_connections": 2, 2024-01-31T05:14:28.689 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_total_time": 0.005348107, 2024-01-31T05:14:28.689 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_send_time": 0.003657948, 2024-01-31T05:14:28.690 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_recv_time": 0.001070665, 2024-01-31T05:14:28.690 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-01-31T05:14:28.690 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages_queue_lat": { 2024-01-31T05:14:28.690 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 68, 2024-01-31T05:14:28.690 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.003033169, 2024-01-31T05:14:28.690 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000044605 2024-01-31T05:14:28.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:28.690 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_handle_ack_lat": { 2024-01-31T05:14:28.690 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:28.690 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:28.690 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:28.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:28.690 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_encrypted_bytes": 160, 2024-01-31T05:14:28.690 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_encrypted_bytes": 89312 2024-01-31T05:14:28.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:28.691 INFO:teuthology.orchestra.run.smithi099.stdout: "cct": { 2024-01-31T05:14:28.691 INFO:teuthology.orchestra.run.smithi099.stdout: "total_workers": 0, 2024-01-31T05:14:28.691 INFO:teuthology.orchestra.run.smithi099.stdout: "unhealthy_workers": 0 2024-01-31T05:14:28.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:28.691 INFO:teuthology.orchestra.run.smithi099.stdout: "mempool": { 2024-01-31T05:14:28.691 INFO:teuthology.orchestra.run.smithi099.stdout: "bloom_filter_bytes": 0, 2024-01-31T05:14:28.691 INFO:teuthology.orchestra.run.smithi099.stdout: "bloom_filter_items": 0, 2024-01-31T05:14:28.691 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_alloc_bytes": 0, 2024-01-31T05:14:28.691 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_alloc_items": 0, 2024-01-31T05:14:28.691 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_data_bytes": 0, 2024-01-31T05:14:28.691 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_data_items": 0, 2024-01-31T05:14:28.691 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_onode_bytes": 0, 2024-01-31T05:14:28.691 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_onode_items": 0, 2024-01-31T05:14:28.691 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_meta_bytes": 0, 2024-01-31T05:14:28.691 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_meta_items": 0, 2024-01-31T05:14:28.692 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_other_bytes": 0, 2024-01-31T05:14:28.692 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_other_items": 0, 2024-01-31T05:14:28.692 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_buffer_bytes": 0, 2024-01-31T05:14:28.692 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_buffer_items": 0, 2024-01-31T05:14:28.692 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_extent_bytes": 0, 2024-01-31T05:14:28.692 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_extent_items": 0, 2024-01-31T05:14:28.692 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_blob_bytes": 0, 2024-01-31T05:14:28.692 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_blob_items": 0, 2024-01-31T05:14:28.692 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_shared_blob_bytes": 0, 2024-01-31T05:14:28.692 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_shared_blob_items": 0, 2024-01-31T05:14:28.692 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_inline_bl_bytes": 0, 2024-01-31T05:14:28.692 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_inline_bl_items": 0, 2024-01-31T05:14:28.692 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_fsck_bytes": 0, 2024-01-31T05:14:28.692 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_fsck_items": 0, 2024-01-31T05:14:28.693 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_txc_bytes": 0, 2024-01-31T05:14:28.693 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_txc_items": 0, 2024-01-31T05:14:28.693 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_deferred_bytes": 0, 2024-01-31T05:14:28.693 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_deferred_items": 0, 2024-01-31T05:14:28.693 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_bytes": 0, 2024-01-31T05:14:28.693 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_items": 0, 2024-01-31T05:14:28.693 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_bytes": 0, 2024-01-31T05:14:28.693 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_items": 0, 2024-01-31T05:14:28.693 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_reader_bytes": 0, 2024-01-31T05:14:28.693 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_reader_items": 0, 2024-01-31T05:14:28.693 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_writer_bytes": 0, 2024-01-31T05:14:28.693 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_writer_items": 0, 2024-01-31T05:14:28.693 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_anon_bytes": 148779, 2024-01-31T05:14:28.693 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_anon_items": 27, 2024-01-31T05:14:28.693 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_meta_bytes": 0, 2024-01-31T05:14:28.693 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_meta_items": 0, 2024-01-31T05:14:28.694 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_bytes": 0, 2024-01-31T05:14:28.694 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_items": 0, 2024-01-31T05:14:28.694 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mapbl_bytes": 0, 2024-01-31T05:14:28.694 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mapbl_items": 0, 2024-01-31T05:14:28.694 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pglog_bytes": 0, 2024-01-31T05:14:28.694 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pglog_items": 0, 2024-01-31T05:14:28.694 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_bytes": 0, 2024-01-31T05:14:28.694 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_items": 0, 2024-01-31T05:14:28.694 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_mapping_bytes": 0, 2024-01-31T05:14:28.694 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_mapping_items": 0, 2024-01-31T05:14:28.694 INFO:teuthology.orchestra.run.smithi099.stdout: "pgmap_bytes": 0, 2024-01-31T05:14:28.694 INFO:teuthology.orchestra.run.smithi099.stdout: "pgmap_items": 0, 2024-01-31T05:14:28.694 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_co_bytes": 928, 2024-01-31T05:14:28.694 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_co_items": 2, 2024-01-31T05:14:28.694 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_1_bytes": 0, 2024-01-31T05:14:28.695 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_1_items": 0, 2024-01-31T05:14:28.695 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_2_bytes": 0, 2024-01-31T05:14:28.695 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_2_items": 0 2024-01-31T05:14:28.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:28.695 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-01-31T05:14:28.695 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-01-31T05:14:28.695 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 104857600, 2024-01-31T05:14:28.695 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-01-31T05:14:28.695 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 99, 2024-01-31T05:14:28.695 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 695141, 2024-01-31T05:14:28.695 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:28.695 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 99, 2024-01-31T05:14:28.695 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 0, 2024-01-31T05:14:28.695 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 0, 2024-01-31T05:14:28.696 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 99, 2024-01-31T05:14:28.696 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 695141, 2024-01-31T05:14:28.696 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-01-31T05:14:28.696 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:28.696 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:28.696 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:28.696 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:28.696 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:28.696 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-01-31T05:14:29.319 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-01-31T05:14:29.320 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-01-31T05:14:29.320 DEBUG:tasks.check_counter:Getting stats from g 2024-01-31T05:14:29.320 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph daemon mds.g perf dump 2024-01-31T05:14:29.562 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:14:30.027 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:14:29 smithi099 ceph-mon[31615]: pgmap v442: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 751 KiB/s rd, 777 KiB/s wr, 273 op/s 2024-01-31T05:14:30.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:14:29 smithi181 ceph-mon[36434]: pgmap v442: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 751 KiB/s rd, 777 KiB/s wr, 273 op/s 2024-01-31T05:14:30.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:14:29 smithi179 ceph-mon[35652]: pgmap v442: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 751 KiB/s rd, 777 KiB/s wr, 273 op/s 2024-01-31T05:14:31.700 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-01-31T05:14:31.700 INFO:teuthology.orchestra.run.smithi099.stdout: "AsyncMessenger::Worker-0": { 2024-01-31T05:14:31.700 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_messages": 421, 2024-01-31T05:14:31.700 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages": 400, 2024-01-31T05:14:31.700 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_bytes": 928064, 2024-01-31T05:14:31.700 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_bytes": 148217, 2024-01-31T05:14:31.701 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_created_connections": 5, 2024-01-31T05:14:31.701 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_active_connections": 1, 2024-01-31T05:14:31.701 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_total_time": 0.047540692, 2024-01-31T05:14:31.701 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_send_time": 0.018077111, 2024-01-31T05:14:31.701 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_recv_time": 0.020936569, 2024-01-31T05:14:31.701 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_fast_dispatch_time": 0.009558788, 2024-01-31T05:14:31.701 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages_queue_lat": { 2024-01-31T05:14:31.701 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 399, 2024-01-31T05:14:31.701 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.016712434, 2024-01-31T05:14:31.701 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000041885 2024-01-31T05:14:31.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.701 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_handle_ack_lat": { 2024-01-31T05:14:31.701 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:31.701 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:31.702 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:31.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.702 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_encrypted_bytes": 826256, 2024-01-31T05:14:31.702 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_encrypted_bytes": 53984 2024-01-31T05:14:31.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.702 INFO:teuthology.orchestra.run.smithi099.stdout: "AsyncMessenger::Worker-1": { 2024-01-31T05:14:31.702 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_messages": 556, 2024-01-31T05:14:31.702 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages": 623, 2024-01-31T05:14:31.702 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_bytes": 4738180, 2024-01-31T05:14:31.702 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_bytes": 368326, 2024-01-31T05:14:31.702 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_created_connections": 5, 2024-01-31T05:14:31.702 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_active_connections": 4, 2024-01-31T05:14:31.702 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_total_time": 0.039637740, 2024-01-31T05:14:31.703 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_send_time": 0.012125864, 2024-01-31T05:14:31.703 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_recv_time": 0.012894890, 2024-01-31T05:14:31.703 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_fast_dispatch_time": 0.011804438, 2024-01-31T05:14:31.703 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages_queue_lat": { 2024-01-31T05:14:31.703 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 621, 2024-01-31T05:14:31.703 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.015667358, 2024-01-31T05:14:31.703 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000025229 2024-01-31T05:14:31.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.703 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_handle_ack_lat": { 2024-01-31T05:14:31.703 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:31.703 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:31.703 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:31.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.704 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_encrypted_bytes": 160, 2024-01-31T05:14:31.704 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_encrypted_bytes": 195664 2024-01-31T05:14:31.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.704 INFO:teuthology.orchestra.run.smithi099.stdout: "AsyncMessenger::Worker-2": { 2024-01-31T05:14:31.704 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_messages": 8, 2024-01-31T05:14:31.704 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages": 8, 2024-01-31T05:14:31.704 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_bytes": 4621, 2024-01-31T05:14:31.704 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_bytes": 1704, 2024-01-31T05:14:31.704 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_created_connections": 5, 2024-01-31T05:14:31.704 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_active_connections": 4, 2024-01-31T05:14:31.704 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_total_time": 0.001516632, 2024-01-31T05:14:31.704 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_send_time": 0.000107118, 2024-01-31T05:14:31.704 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_recv_time": 0.001282398, 2024-01-31T05:14:31.705 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_fast_dispatch_time": 0.000080524, 2024-01-31T05:14:31.705 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages_queue_lat": { 2024-01-31T05:14:31.705 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 7, 2024-01-31T05:14:31.705 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.002707853, 2024-01-31T05:14:31.705 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000386836 2024-01-31T05:14:31.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.705 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_handle_ack_lat": { 2024-01-31T05:14:31.705 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:31.705 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:31.705 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:31.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.705 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-01-31T05:14:31.706 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_encrypted_bytes": 448 2024-01-31T05:14:31.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.706 INFO:teuthology.orchestra.run.smithi099.stdout: "cct": { 2024-01-31T05:14:31.706 INFO:teuthology.orchestra.run.smithi099.stdout: "total_workers": 1, 2024-01-31T05:14:31.706 INFO:teuthology.orchestra.run.smithi099.stdout: "unhealthy_workers": 0 2024-01-31T05:14:31.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.706 INFO:teuthology.orchestra.run.smithi099.stdout: "finisher-MDSRank": { 2024-01-31T05:14:31.706 INFO:teuthology.orchestra.run.smithi099.stdout: "queue_len": 0, 2024-01-31T05:14:31.706 INFO:teuthology.orchestra.run.smithi099.stdout: "complete_latency": { 2024-01-31T05:14:31.706 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 1516, 2024-01-31T05:14:31.706 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.031774948, 2024-01-31T05:14:31.706 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000020959 2024-01-31T05:14:31.706 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:31.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.707 INFO:teuthology.orchestra.run.smithi099.stdout: "finisher-PurgeQueue": { 2024-01-31T05:14:31.707 INFO:teuthology.orchestra.run.smithi099.stdout: "queue_len": 0, 2024-01-31T05:14:31.707 INFO:teuthology.orchestra.run.smithi099.stdout: "complete_latency": { 2024-01-31T05:14:31.707 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:31.707 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:31.707 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:31.707 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:31.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.707 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-01-31T05:14:31.707 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-01-31T05:14:31.707 INFO:teuthology.orchestra.run.smithi099.stdout: "reply": 0, 2024-01-31T05:14:31.707 INFO:teuthology.orchestra.run.smithi099.stdout: "reply_latency": { 2024-01-31T05:14:31.708 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:31.708 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:31.708 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:31.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.708 INFO:teuthology.orchestra.run.smithi099.stdout: "slow_reply": 0, 2024-01-31T05:14:31.708 INFO:teuthology.orchestra.run.smithi099.stdout: "forward": 0, 2024-01-31T05:14:31.708 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_fetch_complete": 0, 2024-01-31T05:14:31.708 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_fetch_keys": 0, 2024-01-31T05:14:31.708 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_commit": 0, 2024-01-31T05:14:31.708 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_split": 0, 2024-01-31T05:14:31.708 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_merge": 0, 2024-01-31T05:14:31.709 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes": 675, 2024-01-31T05:14:31.709 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_top": 0, 2024-01-31T05:14:31.709 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_bottom": 675, 2024-01-31T05:14:31.709 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_pin_tail": 0, 2024-01-31T05:14:31.709 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_pinned": 675, 2024-01-31T05:14:31.709 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_expired": 0, 2024-01-31T05:14:31.709 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_with_caps": 0, 2024-01-31T05:14:31.709 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 0, 2024-01-31T05:14:31.709 INFO:teuthology.orchestra.run.smithi099.stdout: "subtrees": 1, 2024-01-31T05:14:31.710 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse": 0, 2024-01-31T05:14:31.710 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_hit": 0, 2024-01-31T05:14:31.710 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_forward": 0, 2024-01-31T05:14:31.710 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_discover": 0, 2024-01-31T05:14:31.710 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_dir_fetch": 0, 2024-01-31T05:14:31.710 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_remote_ino": 0, 2024-01-31T05:14:31.710 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_lock": 0, 2024-01-31T05:14:31.710 INFO:teuthology.orchestra.run.smithi099.stdout: "load_cent": 0, 2024-01-31T05:14:31.710 INFO:teuthology.orchestra.run.smithi099.stdout: "q": 0, 2024-01-31T05:14:31.710 INFO:teuthology.orchestra.run.smithi099.stdout: "exported": 0, 2024-01-31T05:14:31.710 INFO:teuthology.orchestra.run.smithi099.stdout: "exported_inodes": 0, 2024-01-31T05:14:31.710 INFO:teuthology.orchestra.run.smithi099.stdout: "imported": 0, 2024-01-31T05:14:31.710 INFO:teuthology.orchestra.run.smithi099.stdout: "imported_inodes": 0, 2024-01-31T05:14:31.711 INFO:teuthology.orchestra.run.smithi099.stdout: "openino_dir_fetch": 0, 2024-01-31T05:14:31.711 INFO:teuthology.orchestra.run.smithi099.stdout: "openino_backtrace_fetch": 0, 2024-01-31T05:14:31.711 INFO:teuthology.orchestra.run.smithi099.stdout: "openino_peer_discover": 0, 2024-01-31T05:14:31.711 INFO:teuthology.orchestra.run.smithi099.stdout: "root_rfiles": 0, 2024-01-31T05:14:31.711 INFO:teuthology.orchestra.run.smithi099.stdout: "root_rbytes": 0, 2024-01-31T05:14:31.711 INFO:teuthology.orchestra.run.smithi099.stdout: "root_rsnaps": 0, 2024-01-31T05:14:31.711 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_backtrace_fetch": 0, 2024-01-31T05:14:31.711 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_set_tag": 0, 2024-01-31T05:14:31.711 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_backtrace_repaired": 0, 2024-01-31T05:14:31.711 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_inotable_repaired": 0, 2024-01-31T05:14:31.711 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_dir_inodes": 0, 2024-01-31T05:14:31.711 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_dir_base_inodes": 0, 2024-01-31T05:14:31.711 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_dirfrag_rstats": 0, 2024-01-31T05:14:31.711 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_file_inodes": 0, 2024-01-31T05:14:31.711 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_inode_file_caps": 0, 2024-01-31T05:14:31.712 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_revoke": 0, 2024-01-31T05:14:31.712 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_grant": 0, 2024-01-31T05:14:31.712 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_trunc": 0, 2024-01-31T05:14:31.712 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-01-31T05:14:31.712 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_flush_ack": 0, 2024-01-31T05:14:31.712 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_caps": 0, 2024-01-31T05:14:31.712 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_caps_dirty": 0, 2024-01-31T05:14:31.712 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_cap_release": 0, 2024-01-31T05:14:31.712 INFO:teuthology.orchestra.run.smithi099.stdout: "process_request_cap_release": 0 2024-01-31T05:14:31.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.712 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_cache": { 2024-01-31T05:14:31.712 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_update": 0, 2024-01-31T05:14:31.712 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_update_receipt": 0, 2024-01-31T05:14:31.712 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_try_discover": 0, 2024-01-31T05:14:31.713 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_send_discover": 0, 2024-01-31T05:14:31.713 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_handle_discover": 0, 2024-01-31T05:14:31.713 INFO:teuthology.orchestra.run.smithi099.stdout: "num_strays": 0, 2024-01-31T05:14:31.713 INFO:teuthology.orchestra.run.smithi099.stdout: "num_strays_delayed": 0, 2024-01-31T05:14:31.713 INFO:teuthology.orchestra.run.smithi099.stdout: "num_strays_enqueuing": 0, 2024-01-31T05:14:31.713 INFO:teuthology.orchestra.run.smithi099.stdout: "strays_created": 0, 2024-01-31T05:14:31.713 INFO:teuthology.orchestra.run.smithi099.stdout: "strays_enqueued": 0, 2024-01-31T05:14:31.713 INFO:teuthology.orchestra.run.smithi099.stdout: "strays_reintegrated": 0, 2024-01-31T05:14:31.713 INFO:teuthology.orchestra.run.smithi099.stdout: "strays_migrated": 0, 2024-01-31T05:14:31.714 INFO:teuthology.orchestra.run.smithi099.stdout: "num_recovering_processing": 0, 2024-01-31T05:14:31.714 INFO:teuthology.orchestra.run.smithi099.stdout: "num_recovering_enqueued": 0, 2024-01-31T05:14:31.714 INFO:teuthology.orchestra.run.smithi099.stdout: "num_recovering_prioritized": 0, 2024-01-31T05:14:31.714 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_started": 0, 2024-01-31T05:14:31.714 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_completed": 0, 2024-01-31T05:14:31.714 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_enqueue_scrub": 0, 2024-01-31T05:14:31.714 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_exportdir": 0, 2024-01-31T05:14:31.714 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_flush": 0, 2024-01-31T05:14:31.714 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_fragmentdir": 0, 2024-01-31T05:14:31.714 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_fragstats": 0, 2024-01-31T05:14:31.714 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_inodestats": 0 2024-01-31T05:14:31.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.714 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_log": { 2024-01-31T05:14:31.715 INFO:teuthology.orchestra.run.smithi099.stdout: "evlrg": 0, 2024-01-31T05:14:31.715 INFO:teuthology.orchestra.run.smithi099.stdout: "evadd": 0, 2024-01-31T05:14:31.715 INFO:teuthology.orchestra.run.smithi099.stdout: "evex": 0, 2024-01-31T05:14:31.715 INFO:teuthology.orchestra.run.smithi099.stdout: "evtrm": 0, 2024-01-31T05:14:31.715 INFO:teuthology.orchestra.run.smithi099.stdout: "ev": 2086, 2024-01-31T05:14:31.715 INFO:teuthology.orchestra.run.smithi099.stdout: "evexg": 0, 2024-01-31T05:14:31.715 INFO:teuthology.orchestra.run.smithi099.stdout: "evexd": 0, 2024-01-31T05:14:31.715 INFO:teuthology.orchestra.run.smithi099.stdout: "segadd": 0, 2024-01-31T05:14:31.715 INFO:teuthology.orchestra.run.smithi099.stdout: "segex": 0, 2024-01-31T05:14:31.715 INFO:teuthology.orchestra.run.smithi099.stdout: "segtrm": 0, 2024-01-31T05:14:31.715 INFO:teuthology.orchestra.run.smithi099.stdout: "seg": 4, 2024-01-31T05:14:31.715 INFO:teuthology.orchestra.run.smithi099.stdout: "segmjr": 2, 2024-01-31T05:14:31.715 INFO:teuthology.orchestra.run.smithi099.stdout: "segexg": 0, 2024-01-31T05:14:31.715 INFO:teuthology.orchestra.run.smithi099.stdout: "segexd": 0, 2024-01-31T05:14:31.715 INFO:teuthology.orchestra.run.smithi099.stdout: "expos": 4194304, 2024-01-31T05:14:31.716 INFO:teuthology.orchestra.run.smithi099.stdout: "wrpos": 8790658, 2024-01-31T05:14:31.716 INFO:teuthology.orchestra.run.smithi099.stdout: "rdpos": 8789520, 2024-01-31T05:14:31.716 INFO:teuthology.orchestra.run.smithi099.stdout: "jlat": { 2024-01-31T05:14:31.716 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:31.716 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:31.716 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:31.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.716 INFO:teuthology.orchestra.run.smithi099.stdout: "replayed": 2086 2024-01-31T05:14:31.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.716 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_mem": { 2024-01-31T05:14:31.716 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 7, 2024-01-31T05:14:31.716 INFO:teuthology.orchestra.run.smithi099.stdout: "ino+": 804, 2024-01-31T05:14:31.716 INFO:teuthology.orchestra.run.smithi099.stdout: "ino-": 797, 2024-01-31T05:14:31.716 INFO:teuthology.orchestra.run.smithi099.stdout: "dir": 5, 2024-01-31T05:14:31.717 INFO:teuthology.orchestra.run.smithi099.stdout: "dir+": 213, 2024-01-31T05:14:31.717 INFO:teuthology.orchestra.run.smithi099.stdout: "dir-": 208, 2024-01-31T05:14:31.717 INFO:teuthology.orchestra.run.smithi099.stdout: "dn": 675, 2024-01-31T05:14:31.717 INFO:teuthology.orchestra.run.smithi099.stdout: "dn+": 1445, 2024-01-31T05:14:31.717 INFO:teuthology.orchestra.run.smithi099.stdout: "dn-": 770, 2024-01-31T05:14:31.717 INFO:teuthology.orchestra.run.smithi099.stdout: "cap": 0, 2024-01-31T05:14:31.717 INFO:teuthology.orchestra.run.smithi099.stdout: "cap+": 0, 2024-01-31T05:14:31.717 INFO:teuthology.orchestra.run.smithi099.stdout: "cap-": 0, 2024-01-31T05:14:31.717 INFO:teuthology.orchestra.run.smithi099.stdout: "rss": 50992, 2024-01-31T05:14:31.717 INFO:teuthology.orchestra.run.smithi099.stdout: "heap": 207228 2024-01-31T05:14:31.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.717 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_server": { 2024-01-31T05:14:31.717 INFO:teuthology.orchestra.run.smithi099.stdout: "dispatch_client_request": 0, 2024-01-31T05:14:31.717 INFO:teuthology.orchestra.run.smithi099.stdout: "dispatch_server_request": 0, 2024-01-31T05:14:31.718 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_request": 0, 2024-01-31T05:14:31.718 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_session": 0, 2024-01-31T05:14:31.718 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_peer_request": 0, 2024-01-31T05:14:31.718 INFO:teuthology.orchestra.run.smithi099.stdout: "req_create_latency": { 2024-01-31T05:14:31.718 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:31.718 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:31.718 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:31.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.718 INFO:teuthology.orchestra.run.smithi099.stdout: "req_getattr_latency": { 2024-01-31T05:14:31.718 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:31.718 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:31.718 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:31.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.718 INFO:teuthology.orchestra.run.smithi099.stdout: "req_getfilelock_latency": { 2024-01-31T05:14:31.719 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:31.719 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:31.719 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:31.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.719 INFO:teuthology.orchestra.run.smithi099.stdout: "req_link_latency": { 2024-01-31T05:14:31.719 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:31.719 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:31.719 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:31.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.719 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookup_latency": { 2024-01-31T05:14:31.719 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:31.719 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:31.719 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:31.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.720 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookuphash_latency": { 2024-01-31T05:14:31.720 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:31.720 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:31.720 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:31.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.720 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookupino_latency": { 2024-01-31T05:14:31.720 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:31.720 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:31.720 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:31.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.720 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookupname_latency": { 2024-01-31T05:14:31.720 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:31.720 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:31.720 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:31.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.721 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookupparent_latency": { 2024-01-31T05:14:31.721 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:31.721 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:31.721 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:31.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.721 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookupsnap_latency": { 2024-01-31T05:14:31.721 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:31.721 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:31.721 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:31.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.721 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lssnap_latency": { 2024-01-31T05:14:31.721 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:31.721 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:31.721 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:31.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.722 INFO:teuthology.orchestra.run.smithi099.stdout: "req_mkdir_latency": { 2024-01-31T05:14:31.722 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:31.722 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:31.722 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:31.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.722 INFO:teuthology.orchestra.run.smithi099.stdout: "req_mknod_latency": { 2024-01-31T05:14:31.722 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:31.723 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:31.723 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:31.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.723 INFO:teuthology.orchestra.run.smithi099.stdout: "req_mksnap_latency": { 2024-01-31T05:14:31.723 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:31.723 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:31.723 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:31.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.723 INFO:teuthology.orchestra.run.smithi099.stdout: "req_open_latency": { 2024-01-31T05:14:31.723 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:31.723 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:31.723 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:31.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.723 INFO:teuthology.orchestra.run.smithi099.stdout: "req_readdir_latency": { 2024-01-31T05:14:31.723 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:31.724 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:31.724 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:31.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.724 INFO:teuthology.orchestra.run.smithi099.stdout: "req_rename_latency": { 2024-01-31T05:14:31.724 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:31.724 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:31.724 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:31.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.724 INFO:teuthology.orchestra.run.smithi099.stdout: "req_renamesnap_latency": { 2024-01-31T05:14:31.724 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:31.724 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:31.724 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:31.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.725 INFO:teuthology.orchestra.run.smithi099.stdout: "req_snapdiff_latency": { 2024-01-31T05:14:31.725 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:31.725 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:31.725 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:31.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.725 INFO:teuthology.orchestra.run.smithi099.stdout: "req_rmdir_latency": { 2024-01-31T05:14:31.725 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:31.725 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:31.725 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:31.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.725 INFO:teuthology.orchestra.run.smithi099.stdout: "req_rmsnap_latency": { 2024-01-31T05:14:31.725 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:31.725 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:31.725 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:31.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.726 INFO:teuthology.orchestra.run.smithi099.stdout: "req_rmxattr_latency": { 2024-01-31T05:14:31.726 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:31.726 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:31.726 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:31.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.726 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setattr_latency": { 2024-01-31T05:14:31.726 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:31.726 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:31.726 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:31.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.726 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setdirlayout_latency": { 2024-01-31T05:14:31.726 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:31.726 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:31.726 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:31.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.727 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setfilelock_latency": { 2024-01-31T05:14:31.727 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:31.727 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:31.727 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:31.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.727 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setlayout_latency": { 2024-01-31T05:14:31.727 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:31.727 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:31.727 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:31.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.727 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setxattr_latency": { 2024-01-31T05:14:31.727 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:31.727 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:31.728 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:31.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.728 INFO:teuthology.orchestra.run.smithi099.stdout: "req_symlink_latency": { 2024-01-31T05:14:31.728 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:31.728 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:31.728 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:31.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.728 INFO:teuthology.orchestra.run.smithi099.stdout: "req_unlink_latency": { 2024-01-31T05:14:31.728 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:31.728 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:31.728 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:31.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.728 INFO:teuthology.orchestra.run.smithi099.stdout: "cap_revoke_eviction": 0, 2024-01-31T05:14:31.728 INFO:teuthology.orchestra.run.smithi099.stdout: "cap_acquisition_throttle": 0, 2024-01-31T05:14:31.729 INFO:teuthology.orchestra.run.smithi099.stdout: "req_getvxattr_latency": { 2024-01-31T05:14:31.729 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:31.729 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:31.729 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:31.729 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:31.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.729 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_sessions": { 2024-01-31T05:14:31.729 INFO:teuthology.orchestra.run.smithi099.stdout: "session_count": 1, 2024-01-31T05:14:31.729 INFO:teuthology.orchestra.run.smithi099.stdout: "session_add": 2, 2024-01-31T05:14:31.729 INFO:teuthology.orchestra.run.smithi099.stdout: "session_remove": 1, 2024-01-31T05:14:31.729 INFO:teuthology.orchestra.run.smithi099.stdout: "sessions_open": 2, 2024-01-31T05:14:31.729 INFO:teuthology.orchestra.run.smithi099.stdout: "sessions_stale": 0, 2024-01-31T05:14:31.729 INFO:teuthology.orchestra.run.smithi099.stdout: "total_load": 0, 2024-01-31T05:14:31.729 INFO:teuthology.orchestra.run.smithi099.stdout: "average_load": 0, 2024-01-31T05:14:31.730 INFO:teuthology.orchestra.run.smithi099.stdout: "avg_session_uptime": 2406, 2024-01-31T05:14:31.730 INFO:teuthology.orchestra.run.smithi099.stdout: "mdthresh_evicted": 0 2024-01-31T05:14:31.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.730 INFO:teuthology.orchestra.run.smithi099.stdout: "mempool": { 2024-01-31T05:14:31.730 INFO:teuthology.orchestra.run.smithi099.stdout: "bloom_filter_bytes": 0, 2024-01-31T05:14:31.730 INFO:teuthology.orchestra.run.smithi099.stdout: "bloom_filter_items": 0, 2024-01-31T05:14:31.730 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_alloc_bytes": 0, 2024-01-31T05:14:31.730 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_alloc_items": 0, 2024-01-31T05:14:31.730 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_data_bytes": 0, 2024-01-31T05:14:31.730 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_data_items": 0, 2024-01-31T05:14:31.730 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_onode_bytes": 0, 2024-01-31T05:14:31.730 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_onode_items": 0, 2024-01-31T05:14:31.730 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_meta_bytes": 0, 2024-01-31T05:14:31.730 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_meta_items": 0, 2024-01-31T05:14:31.730 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_other_bytes": 0, 2024-01-31T05:14:31.731 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_other_items": 0, 2024-01-31T05:14:31.731 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_buffer_bytes": 0, 2024-01-31T05:14:31.731 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_buffer_items": 0, 2024-01-31T05:14:31.731 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_extent_bytes": 0, 2024-01-31T05:14:31.731 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_extent_items": 0, 2024-01-31T05:14:31.731 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_blob_bytes": 0, 2024-01-31T05:14:31.731 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_blob_items": 0, 2024-01-31T05:14:31.731 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_shared_blob_bytes": 0, 2024-01-31T05:14:31.731 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_shared_blob_items": 0, 2024-01-31T05:14:31.731 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_inline_bl_bytes": 0, 2024-01-31T05:14:31.731 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_inline_bl_items": 0, 2024-01-31T05:14:31.731 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_fsck_bytes": 0, 2024-01-31T05:14:31.731 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_fsck_items": 0, 2024-01-31T05:14:31.731 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_txc_bytes": 0, 2024-01-31T05:14:31.731 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_txc_items": 0, 2024-01-31T05:14:31.732 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_deferred_bytes": 0, 2024-01-31T05:14:31.732 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_deferred_items": 0, 2024-01-31T05:14:31.732 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_bytes": 0, 2024-01-31T05:14:31.732 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_items": 0, 2024-01-31T05:14:31.732 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_bytes": 0, 2024-01-31T05:14:31.732 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_items": 0, 2024-01-31T05:14:31.732 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_reader_bytes": 0, 2024-01-31T05:14:31.732 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_reader_items": 0, 2024-01-31T05:14:31.732 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_writer_bytes": 0, 2024-01-31T05:14:31.732 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_writer_items": 0, 2024-01-31T05:14:31.732 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_anon_bytes": 197413, 2024-01-31T05:14:31.732 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_anon_items": 55, 2024-01-31T05:14:31.732 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_meta_bytes": 0, 2024-01-31T05:14:31.732 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_meta_items": 0, 2024-01-31T05:14:31.733 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_bytes": 0, 2024-01-31T05:14:31.733 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_items": 0, 2024-01-31T05:14:31.733 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mapbl_bytes": 0, 2024-01-31T05:14:31.733 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mapbl_items": 0, 2024-01-31T05:14:31.733 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pglog_bytes": 0, 2024-01-31T05:14:31.733 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pglog_items": 0, 2024-01-31T05:14:31.733 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_bytes": 7240, 2024-01-31T05:14:31.733 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_items": 152, 2024-01-31T05:14:31.733 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_mapping_bytes": 0, 2024-01-31T05:14:31.733 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_mapping_items": 0, 2024-01-31T05:14:31.733 INFO:teuthology.orchestra.run.smithi099.stdout: "pgmap_bytes": 0, 2024-01-31T05:14:31.733 INFO:teuthology.orchestra.run.smithi099.stdout: "pgmap_items": 0, 2024-01-31T05:14:31.733 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_co_bytes": 498184, 2024-01-31T05:14:31.733 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_co_items": 3443, 2024-01-31T05:14:31.733 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_1_bytes": 0, 2024-01-31T05:14:31.733 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_1_items": 0, 2024-01-31T05:14:31.734 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_2_bytes": 0, 2024-01-31T05:14:31.734 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_2_items": 0 2024-01-31T05:14:31.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.734 INFO:teuthology.orchestra.run.smithi099.stdout: "objecter": { 2024-01-31T05:14:31.734 INFO:teuthology.orchestra.run.smithi099.stdout: "op_active": 0, 2024-01-31T05:14:31.734 INFO:teuthology.orchestra.run.smithi099.stdout: "op_laggy": 0, 2024-01-31T05:14:31.734 INFO:teuthology.orchestra.run.smithi099.stdout: "op_send": 862, 2024-01-31T05:14:31.734 INFO:teuthology.orchestra.run.smithi099.stdout: "op_send_bytes": 21, 2024-01-31T05:14:31.734 INFO:teuthology.orchestra.run.smithi099.stdout: "op_resend": 3, 2024-01-31T05:14:31.734 INFO:teuthology.orchestra.run.smithi099.stdout: "op_reply": 862, 2024-01-31T05:14:31.734 INFO:teuthology.orchestra.run.smithi099.stdout: "op_latency": { 2024-01-31T05:14:31.734 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 862, 2024-01-31T05:14:31.734 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.752982644, 2024-01-31T05:14:31.734 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000873529 2024-01-31T05:14:31.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.735 INFO:teuthology.orchestra.run.smithi099.stdout: "op_inflight": 0, 2024-01-31T05:14:31.735 INFO:teuthology.orchestra.run.smithi099.stdout: "oplen_avg": { 2024-01-31T05:14:31.735 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 862, 2024-01-31T05:14:31.735 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 863 2024-01-31T05:14:31.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.735 INFO:teuthology.orchestra.run.smithi099.stdout: "op": 862, 2024-01-31T05:14:31.735 INFO:teuthology.orchestra.run.smithi099.stdout: "op_r": 862, 2024-01-31T05:14:31.735 INFO:teuthology.orchestra.run.smithi099.stdout: "op_w": 0, 2024-01-31T05:14:31.735 INFO:teuthology.orchestra.run.smithi099.stdout: "op_rmw": 0, 2024-01-31T05:14:31.735 INFO:teuthology.orchestra.run.smithi099.stdout: "op_pg": 0, 2024-01-31T05:14:31.735 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_stat": 493, 2024-01-31T05:14:31.735 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_create": 0, 2024-01-31T05:14:31.735 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_read": 367, 2024-01-31T05:14:31.735 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_write": 0, 2024-01-31T05:14:31.735 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_writefull": 0, 2024-01-31T05:14:31.736 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_writesame": 0, 2024-01-31T05:14:31.736 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_append": 0, 2024-01-31T05:14:31.736 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_zero": 0, 2024-01-31T05:14:31.736 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_truncate": 0, 2024-01-31T05:14:31.736 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_delete": 0, 2024-01-31T05:14:31.736 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_mapext": 0, 2024-01-31T05:14:31.736 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_sparse_read": 0, 2024-01-31T05:14:31.736 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_clonerange": 0, 2024-01-31T05:14:31.736 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_getxattr": 1, 2024-01-31T05:14:31.736 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_setxattr": 0, 2024-01-31T05:14:31.736 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_cmpxattr": 0, 2024-01-31T05:14:31.736 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_rmxattr": 0, 2024-01-31T05:14:31.736 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_resetxattrs": 0, 2024-01-31T05:14:31.737 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_call": 0, 2024-01-31T05:14:31.737 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_watch": 0, 2024-01-31T05:14:31.737 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_notify": 0, 2024-01-31T05:14:31.737 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_src_cmpxattr": 0, 2024-01-31T05:14:31.737 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_pgls": 0, 2024-01-31T05:14:31.737 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_pgls_filter": 0, 2024-01-31T05:14:31.737 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_other": 0, 2024-01-31T05:14:31.737 INFO:teuthology.orchestra.run.smithi099.stdout: "linger_active": 0, 2024-01-31T05:14:31.737 INFO:teuthology.orchestra.run.smithi099.stdout: "linger_send": 0, 2024-01-31T05:14:31.737 INFO:teuthology.orchestra.run.smithi099.stdout: "linger_resend": 0, 2024-01-31T05:14:31.737 INFO:teuthology.orchestra.run.smithi099.stdout: "linger_ping": 0, 2024-01-31T05:14:31.737 INFO:teuthology.orchestra.run.smithi099.stdout: "poolop_active": 0, 2024-01-31T05:14:31.737 INFO:teuthology.orchestra.run.smithi099.stdout: "poolop_send": 0, 2024-01-31T05:14:31.737 INFO:teuthology.orchestra.run.smithi099.stdout: "poolop_resend": 0, 2024-01-31T05:14:31.737 INFO:teuthology.orchestra.run.smithi099.stdout: "poolstat_active": 0, 2024-01-31T05:14:31.738 INFO:teuthology.orchestra.run.smithi099.stdout: "poolstat_send": 0, 2024-01-31T05:14:31.738 INFO:teuthology.orchestra.run.smithi099.stdout: "poolstat_resend": 0, 2024-01-31T05:14:31.738 INFO:teuthology.orchestra.run.smithi099.stdout: "statfs_active": 0, 2024-01-31T05:14:31.738 INFO:teuthology.orchestra.run.smithi099.stdout: "statfs_send": 0, 2024-01-31T05:14:31.738 INFO:teuthology.orchestra.run.smithi099.stdout: "statfs_resend": 0, 2024-01-31T05:14:31.738 INFO:teuthology.orchestra.run.smithi099.stdout: "command_active": 0, 2024-01-31T05:14:31.738 INFO:teuthology.orchestra.run.smithi099.stdout: "command_send": 0, 2024-01-31T05:14:31.738 INFO:teuthology.orchestra.run.smithi099.stdout: "command_resend": 0, 2024-01-31T05:14:31.738 INFO:teuthology.orchestra.run.smithi099.stdout: "map_epoch": 88, 2024-01-31T05:14:31.738 INFO:teuthology.orchestra.run.smithi099.stdout: "map_full": 0, 2024-01-31T05:14:31.738 INFO:teuthology.orchestra.run.smithi099.stdout: "map_inc": 2, 2024-01-31T05:14:31.738 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_sessions": 6, 2024-01-31T05:14:31.738 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_session_open": 6, 2024-01-31T05:14:31.738 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_session_close": 0, 2024-01-31T05:14:31.739 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_laggy": 0, 2024-01-31T05:14:31.739 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_wr": 0, 2024-01-31T05:14:31.739 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_rd": 2, 2024-01-31T05:14:31.739 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_del": 0 2024-01-31T05:14:31.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.739 INFO:teuthology.orchestra.run.smithi099.stdout: "oft": { 2024-01-31T05:14:31.739 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_total_objs": 0, 2024-01-31T05:14:31.739 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_total_kv_pairs": 0, 2024-01-31T05:14:31.739 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_total_updates": 0, 2024-01-31T05:14:31.739 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_total_removes": 0 2024-01-31T05:14:31.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.739 INFO:teuthology.orchestra.run.smithi099.stdout: "osd-slow-ops": { 2024-01-31T05:14:31.739 INFO:teuthology.orchestra.run.smithi099.stdout: "slow_ops_count": 0 2024-01-31T05:14:31.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.740 INFO:teuthology.orchestra.run.smithi099.stdout: "purge_queue": { 2024-01-31T05:14:31.740 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executing_ops": 0, 2024-01-31T05:14:31.740 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executing_ops_high_water": 0, 2024-01-31T05:14:31.740 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executing": 0, 2024-01-31T05:14:31.740 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executing_high_water": 0, 2024-01-31T05:14:31.740 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executed_ops": 0, 2024-01-31T05:14:31.740 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executed": 0, 2024-01-31T05:14:31.740 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_item_in_journal": 0 2024-01-31T05:14:31.740 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.740 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-01-31T05:14:31.740 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-01-31T05:14:31.740 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 104857600, 2024-01-31T05:14:31.740 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-01-31T05:14:31.740 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 981, 2024-01-31T05:14:31.741 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 5573615, 2024-01-31T05:14:31.741 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:31.741 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 981, 2024-01-31T05:14:31.741 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 0, 2024-01-31T05:14:31.741 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 0, 2024-01-31T05:14:31.741 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 981, 2024-01-31T05:14:31.741 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 5573615, 2024-01-31T05:14:31.741 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-01-31T05:14:31.741 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:31.741 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:31.741 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:31.741 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:31.741 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.741 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-objecter_bytes": { 2024-01-31T05:14:31.741 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-01-31T05:14:31.742 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 104857600, 2024-01-31T05:14:31.742 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-01-31T05:14:31.742 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 0, 2024-01-31T05:14:31.742 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 0, 2024-01-31T05:14:31.742 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:31.742 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 0, 2024-01-31T05:14:31.742 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 862, 2024-01-31T05:14:31.742 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 4596359, 2024-01-31T05:14:31.742 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 862, 2024-01-31T05:14:31.742 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 4596359, 2024-01-31T05:14:31.742 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-01-31T05:14:31.742 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:31.742 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:31.742 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:31.742 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:31.743 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.743 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-objecter_ops": { 2024-01-31T05:14:31.743 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-01-31T05:14:31.743 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 1024, 2024-01-31T05:14:31.743 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-01-31T05:14:31.743 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 0, 2024-01-31T05:14:31.743 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 0, 2024-01-31T05:14:31.743 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:31.743 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 0, 2024-01-31T05:14:31.743 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 862, 2024-01-31T05:14:31.743 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 862, 2024-01-31T05:14:31.743 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 862, 2024-01-31T05:14:31.743 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 862, 2024-01-31T05:14:31.743 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-01-31T05:14:31.744 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:31.744 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:31.744 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:31.744 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:31.744 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.744 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-write_buf_throttle": { 2024-01-31T05:14:31.744 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-01-31T05:14:31.744 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 3758096384, 2024-01-31T05:14:31.744 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-01-31T05:14:31.744 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 0, 2024-01-31T05:14:31.744 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 0, 2024-01-31T05:14:31.744 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:31.744 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 0, 2024-01-31T05:14:31.744 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 0, 2024-01-31T05:14:31.744 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 0, 2024-01-31T05:14:31.745 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 0, 2024-01-31T05:14:31.745 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 0, 2024-01-31T05:14:31.745 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-01-31T05:14:31.745 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:31.745 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:31.745 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:31.745 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:31.745 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:31.745 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-write_buf_throttle-0x560747b90960": { 2024-01-31T05:14:31.745 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-01-31T05:14:31.745 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 3758096384, 2024-01-31T05:14:31.745 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-01-31T05:14:31.745 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 0, 2024-01-31T05:14:31.745 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 0, 2024-01-31T05:14:31.745 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:31.746 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 0, 2024-01-31T05:14:31.746 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 0, 2024-01-31T05:14:31.746 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 0, 2024-01-31T05:14:31.746 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 0, 2024-01-31T05:14:31.746 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 0, 2024-01-31T05:14:31.746 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-01-31T05:14:31.746 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:31.746 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:31.746 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:31.746 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:31.746 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:31.746 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-01-31T05:14:32.002 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:14:31 smithi099 ceph-mon[31615]: pgmap v443: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 346 KiB/s wr, 164 op/s 2024-01-31T05:14:32.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:14:31 smithi181 ceph-mon[36434]: pgmap v443: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 346 KiB/s wr, 164 op/s 2024-01-31T05:14:32.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:14:31 smithi179 ceph-mon[35652]: pgmap v443: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 346 KiB/s wr, 164 op/s 2024-01-31T05:14:32.613 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-01-31T05:14:32.614 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-01-31T05:14:32.614 DEBUG:tasks.check_counter:Getting stats from j 2024-01-31T05:14:32.614 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph daemon mds.j perf dump 2024-01-31T05:14:32.853 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.a/config 2024-01-31T05:14:33.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:14:33 smithi099 ceph-mon[31615]: pgmap v444: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 346 KiB/s wr, 156 op/s 2024-01-31T05:14:33.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:14:33 smithi181 ceph-mon[36434]: pgmap v444: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 346 KiB/s wr, 156 op/s 2024-01-31T05:14:33.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:14:33 smithi179 ceph-mon[35652]: pgmap v444: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 346 KiB/s wr, 156 op/s 2024-01-31T05:14:34.561 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-01-31T05:14:34.561 INFO:teuthology.orchestra.run.smithi099.stdout: "AsyncMessenger::Worker-0": { 2024-01-31T05:14:34.561 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_messages": 100, 2024-01-31T05:14:34.561 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages": 95, 2024-01-31T05:14:34.561 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_bytes": 709488, 2024-01-31T05:14:34.562 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_bytes": 55920, 2024-01-31T05:14:34.562 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_created_connections": 4, 2024-01-31T05:14:34.562 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_active_connections": 0, 2024-01-31T05:14:34.562 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_total_time": 0.018008510, 2024-01-31T05:14:34.562 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_send_time": 0.005162302, 2024-01-31T05:14:34.562 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_recv_time": 0.014389660, 2024-01-31T05:14:34.562 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_fast_dispatch_time": 0.001619324, 2024-01-31T05:14:34.562 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages_queue_lat": { 2024-01-31T05:14:34.562 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 94, 2024-01-31T05:14:34.562 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.003875020, 2024-01-31T05:14:34.562 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000041223 2024-01-31T05:14:34.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:34.562 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_handle_ack_lat": { 2024-01-31T05:14:34.562 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:34.563 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:34.563 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:34.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:34.563 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_encrypted_bytes": 709488, 2024-01-31T05:14:34.563 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_encrypted_bytes": 55920 2024-01-31T05:14:34.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:34.563 INFO:teuthology.orchestra.run.smithi099.stdout: "AsyncMessenger::Worker-1": { 2024-01-31T05:14:34.563 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_messages": 5, 2024-01-31T05:14:34.563 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages": 74, 2024-01-31T05:14:34.563 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_bytes": 3152, 2024-01-31T05:14:34.563 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_bytes": 90112, 2024-01-31T05:14:34.563 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_created_connections": 3, 2024-01-31T05:14:34.563 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_active_connections": 2, 2024-01-31T05:14:34.563 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_total_time": 0.005822283, 2024-01-31T05:14:34.563 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_send_time": 0.003541579, 2024-01-31T05:14:34.564 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_recv_time": 0.001641299, 2024-01-31T05:14:34.564 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-01-31T05:14:34.564 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages_queue_lat": { 2024-01-31T05:14:34.564 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 73, 2024-01-31T05:14:34.564 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.004088847, 2024-01-31T05:14:34.564 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000056011 2024-01-31T05:14:34.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:34.564 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_handle_ack_lat": { 2024-01-31T05:14:34.564 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:34.564 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:34.564 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:34.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:34.564 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-01-31T05:14:34.564 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_encrypted_bytes": 90112 2024-01-31T05:14:34.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:34.565 INFO:teuthology.orchestra.run.smithi099.stdout: "AsyncMessenger::Worker-2": { 2024-01-31T05:14:34.565 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_messages": 0, 2024-01-31T05:14:34.565 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages": 2, 2024-01-31T05:14:34.565 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_bytes": 0, 2024-01-31T05:14:34.565 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_bytes": 0, 2024-01-31T05:14:34.565 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_created_connections": 2, 2024-01-31T05:14:34.565 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_active_connections": 1, 2024-01-31T05:14:34.565 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_total_time": 0.000418244, 2024-01-31T05:14:34.565 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_send_time": 0.000000000, 2024-01-31T05:14:34.565 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_recv_time": 0.000354793, 2024-01-31T05:14:34.565 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-01-31T05:14:34.565 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages_queue_lat": { 2024-01-31T05:14:34.565 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:34.565 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:34.566 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:34.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:34.566 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_handle_ack_lat": { 2024-01-31T05:14:34.566 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:34.566 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:34.566 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:34.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:34.566 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_encrypted_bytes": 0, 2024-01-31T05:14:34.566 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_encrypted_bytes": 0 2024-01-31T05:14:34.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:34.566 INFO:teuthology.orchestra.run.smithi099.stdout: "cct": { 2024-01-31T05:14:34.566 INFO:teuthology.orchestra.run.smithi099.stdout: "total_workers": 0, 2024-01-31T05:14:34.566 INFO:teuthology.orchestra.run.smithi099.stdout: "unhealthy_workers": 0 2024-01-31T05:14:34.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:34.566 INFO:teuthology.orchestra.run.smithi099.stdout: "mempool": { 2024-01-31T05:14:34.567 INFO:teuthology.orchestra.run.smithi099.stdout: "bloom_filter_bytes": 0, 2024-01-31T05:14:34.567 INFO:teuthology.orchestra.run.smithi099.stdout: "bloom_filter_items": 0, 2024-01-31T05:14:34.567 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_alloc_bytes": 0, 2024-01-31T05:14:34.567 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_alloc_items": 0, 2024-01-31T05:14:34.567 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_data_bytes": 0, 2024-01-31T05:14:34.567 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_data_items": 0, 2024-01-31T05:14:34.567 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_onode_bytes": 0, 2024-01-31T05:14:34.567 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_onode_items": 0, 2024-01-31T05:14:34.567 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_meta_bytes": 0, 2024-01-31T05:14:34.567 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_meta_items": 0, 2024-01-31T05:14:34.567 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_other_bytes": 0, 2024-01-31T05:14:34.567 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_other_items": 0, 2024-01-31T05:14:34.568 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_buffer_bytes": 0, 2024-01-31T05:14:34.568 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_buffer_items": 0, 2024-01-31T05:14:34.568 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_extent_bytes": 0, 2024-01-31T05:14:34.568 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_extent_items": 0, 2024-01-31T05:14:34.568 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_blob_bytes": 0, 2024-01-31T05:14:34.568 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_blob_items": 0, 2024-01-31T05:14:34.568 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_shared_blob_bytes": 0, 2024-01-31T05:14:34.568 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_shared_blob_items": 0, 2024-01-31T05:14:34.568 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_inline_bl_bytes": 0, 2024-01-31T05:14:34.568 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_inline_bl_items": 0, 2024-01-31T05:14:34.569 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_fsck_bytes": 0, 2024-01-31T05:14:34.569 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_fsck_items": 0, 2024-01-31T05:14:34.569 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_txc_bytes": 0, 2024-01-31T05:14:34.569 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_txc_items": 0, 2024-01-31T05:14:34.569 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_deferred_bytes": 0, 2024-01-31T05:14:34.569 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_deferred_items": 0, 2024-01-31T05:14:34.569 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_bytes": 0, 2024-01-31T05:14:34.569 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_items": 0, 2024-01-31T05:14:34.569 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_bytes": 0, 2024-01-31T05:14:34.569 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_items": 0, 2024-01-31T05:14:34.569 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_reader_bytes": 0, 2024-01-31T05:14:34.569 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_reader_items": 0, 2024-01-31T05:14:34.569 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_writer_bytes": 0, 2024-01-31T05:14:34.569 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_writer_items": 0, 2024-01-31T05:14:34.570 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_anon_bytes": 148863, 2024-01-31T05:14:34.570 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_anon_items": 28, 2024-01-31T05:14:34.570 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_meta_bytes": 0, 2024-01-31T05:14:34.570 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_meta_items": 0, 2024-01-31T05:14:34.570 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_bytes": 0, 2024-01-31T05:14:34.570 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_items": 0, 2024-01-31T05:14:34.570 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mapbl_bytes": 0, 2024-01-31T05:14:34.570 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mapbl_items": 0, 2024-01-31T05:14:34.570 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pglog_bytes": 0, 2024-01-31T05:14:34.570 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pglog_items": 0, 2024-01-31T05:14:34.570 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_bytes": 0, 2024-01-31T05:14:34.570 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_items": 0, 2024-01-31T05:14:34.570 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_mapping_bytes": 0, 2024-01-31T05:14:34.570 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_mapping_items": 0, 2024-01-31T05:14:34.570 INFO:teuthology.orchestra.run.smithi099.stdout: "pgmap_bytes": 0, 2024-01-31T05:14:34.571 INFO:teuthology.orchestra.run.smithi099.stdout: "pgmap_items": 0, 2024-01-31T05:14:34.571 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_co_bytes": 928, 2024-01-31T05:14:34.571 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_co_items": 2, 2024-01-31T05:14:34.571 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_1_bytes": 0, 2024-01-31T05:14:34.571 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_1_items": 0, 2024-01-31T05:14:34.571 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_2_bytes": 0, 2024-01-31T05:14:34.571 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_2_items": 0 2024-01-31T05:14:34.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-01-31T05:14:34.571 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-01-31T05:14:34.571 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-01-31T05:14:34.571 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 104857600, 2024-01-31T05:14:34.571 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-01-31T05:14:34.571 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 101, 2024-01-31T05:14:34.571 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 695401, 2024-01-31T05:14:34.571 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:34.572 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 101, 2024-01-31T05:14:34.572 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 0, 2024-01-31T05:14:34.572 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 0, 2024-01-31T05:14:34.572 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 101, 2024-01-31T05:14:34.572 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 695401, 2024-01-31T05:14:34.572 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-01-31T05:14:34.572 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-01-31T05:14:34.572 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-01-31T05:14:34.572 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-01-31T05:14:34.572 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:34.572 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-01-31T05:14:34.572 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-01-31T05:14:35.380 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-01-31T05:14:35.380 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-01-31T05:14:35.380 DEBUG:tasks.check_counter:Getting stats from b 2024-01-31T05:14:35.381 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph daemon mds.b perf dump 2024-01-31T05:14:35.631 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.b/config 2024-01-31T05:14:36.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:14:35 smithi099 ceph-mon[31615]: pgmap v445: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 279 KiB/s wr, 45 op/s 2024-01-31T05:14:36.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:14:35 smithi181 ceph-mon[36434]: pgmap v445: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 279 KiB/s wr, 45 op/s 2024-01-31T05:14:36.097 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:14:35 smithi179 ceph-mon[35652]: pgmap v445: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 279 KiB/s wr, 45 op/s 2024-01-31T05:14:37.380 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-01-31T05:14:37.380 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-0": { 2024-01-31T05:14:37.380 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 20875, 2024-01-31T05:14:37.380 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 26210, 2024-01-31T05:14:37.380 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 7540575, 2024-01-31T05:14:37.380 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 37881679, 2024-01-31T05:14:37.380 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 42, 2024-01-31T05:14:37.380 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 4, 2024-01-31T05:14:37.380 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 1.388851697, 2024-01-31T05:14:37.381 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 0.487010201, 2024-01-31T05:14:37.381 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 0.484833220, 2024-01-31T05:14:37.381 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 0.380123227, 2024-01-31T05:14:37.381 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-01-31T05:14:37.381 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 26209, 2024-01-31T05:14:37.381 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 6.835001992, 2024-01-31T05:14:37.381 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000260788 2024-01-31T05:14:37.381 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.381 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-01-31T05:14:37.381 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 20952, 2024-01-31T05:14:37.381 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.003429036, 2024-01-31T05:14:37.381 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000163 2024-01-31T05:14:37.381 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.382 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 867616, 2024-01-31T05:14:37.382 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 64544 2024-01-31T05:14:37.382 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.382 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-1": { 2024-01-31T05:14:37.382 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 27909, 2024-01-31T05:14:37.382 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 30430, 2024-01-31T05:14:37.382 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 11013074, 2024-01-31T05:14:37.382 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 73366914, 2024-01-31T05:14:37.382 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 12, 2024-01-31T05:14:37.382 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 6, 2024-01-31T05:14:37.382 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 2.034729347, 2024-01-31T05:14:37.382 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 0.741863694, 2024-01-31T05:14:37.382 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 0.543823295, 2024-01-31T05:14:37.382 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 0.690561647, 2024-01-31T05:14:37.383 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-01-31T05:14:37.383 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 30429, 2024-01-31T05:14:37.383 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 13.824519006, 2024-01-31T05:14:37.383 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000454320 2024-01-31T05:14:37.383 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.383 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-01-31T05:14:37.383 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 15257, 2024-01-31T05:14:37.383 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.002406833, 2024-01-31T05:14:37.383 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000157 2024-01-31T05:14:37.383 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.383 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-01-31T05:14:37.383 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 200608 2024-01-31T05:14:37.383 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.383 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-2": { 2024-01-31T05:14:37.383 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 77304, 2024-01-31T05:14:37.384 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 134824, 2024-01-31T05:14:37.384 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 28643430, 2024-01-31T05:14:37.384 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 129996114, 2024-01-31T05:14:37.384 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 37, 2024-01-31T05:14:37.384 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 7, 2024-01-31T05:14:37.384 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 5.344345410, 2024-01-31T05:14:37.384 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 2.600263445, 2024-01-31T05:14:37.384 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 7.432619113, 2024-01-31T05:14:37.384 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 0.484938842, 2024-01-31T05:14:37.384 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-01-31T05:14:37.384 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 134822, 2024-01-31T05:14:37.384 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 8.988628430, 2024-01-31T05:14:37.384 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000066670 2024-01-31T05:14:37.384 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.385 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-01-31T05:14:37.385 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 164542, 2024-01-31T05:14:37.385 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.022810836, 2024-01-31T05:14:37.385 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000138 2024-01-31T05:14:37.385 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.385 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 22321984, 2024-01-31T05:14:37.385 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 64382544 2024-01-31T05:14:37.385 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.385 INFO:teuthology.orchestra.run.smithi179.stdout: "cct": { 2024-01-31T05:14:37.385 INFO:teuthology.orchestra.run.smithi179.stdout: "total_workers": 1, 2024-01-31T05:14:37.385 INFO:teuthology.orchestra.run.smithi179.stdout: "unhealthy_workers": 0 2024-01-31T05:14:37.386 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.386 INFO:teuthology.orchestra.run.smithi179.stdout: "finisher-MDSRank": { 2024-01-31T05:14:37.386 INFO:teuthology.orchestra.run.smithi179.stdout: "queue_len": 0, 2024-01-31T05:14:37.386 INFO:teuthology.orchestra.run.smithi179.stdout: "complete_latency": { 2024-01-31T05:14:37.386 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 12942, 2024-01-31T05:14:37.386 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 39.378965874, 2024-01-31T05:14:37.386 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.003042726 2024-01-31T05:14:37.386 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-01-31T05:14:37.386 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.386 INFO:teuthology.orchestra.run.smithi179.stdout: "finisher-PurgeQueue": { 2024-01-31T05:14:37.386 INFO:teuthology.orchestra.run.smithi179.stdout: "queue_len": 0, 2024-01-31T05:14:37.386 INFO:teuthology.orchestra.run.smithi179.stdout: "complete_latency": { 2024-01-31T05:14:37.386 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 22448, 2024-01-31T05:14:37.386 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 4.109015473, 2024-01-31T05:14:37.386 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000183045 2024-01-31T05:14:37.387 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-01-31T05:14:37.387 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.387 INFO:teuthology.orchestra.run.smithi179.stdout: "mds": { 2024-01-31T05:14:37.387 INFO:teuthology.orchestra.run.smithi179.stdout: "request": 36832, 2024-01-31T05:14:37.387 INFO:teuthology.orchestra.run.smithi179.stdout: "reply": 36663, 2024-01-31T05:14:37.387 INFO:teuthology.orchestra.run.smithi179.stdout: "reply_latency": { 2024-01-31T05:14:37.387 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 36663, 2024-01-31T05:14:37.387 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 560.846726737, 2024-01-31T05:14:37.387 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.015297349 2024-01-31T05:14:37.387 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.387 INFO:teuthology.orchestra.run.smithi179.stdout: "slow_reply": 0, 2024-01-31T05:14:37.387 INFO:teuthology.orchestra.run.smithi179.stdout: "forward": 169, 2024-01-31T05:14:37.387 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_fetch_complete": 6, 2024-01-31T05:14:37.388 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_fetch_keys": 2, 2024-01-31T05:14:37.388 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_commit": 2789, 2024-01-31T05:14:37.388 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_split": 8, 2024-01-31T05:14:37.388 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_merge": 2, 2024-01-31T05:14:37.388 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes": 374, 2024-01-31T05:14:37.388 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_top": 72, 2024-01-31T05:14:37.388 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_bottom": 290, 2024-01-31T05:14:37.388 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_pin_tail": 12, 2024-01-31T05:14:37.388 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_pinned": 271, 2024-01-31T05:14:37.388 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_expired": 2524, 2024-01-31T05:14:37.388 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_with_caps": 2, 2024-01-31T05:14:37.388 INFO:teuthology.orchestra.run.smithi179.stdout: "caps": 2, 2024-01-31T05:14:37.388 INFO:teuthology.orchestra.run.smithi179.stdout: "subtrees": 6, 2024-01-31T05:14:37.389 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse": 46383, 2024-01-31T05:14:37.389 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_hit": 45157, 2024-01-31T05:14:37.389 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_forward": 65, 2024-01-31T05:14:37.389 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_discover": 110, 2024-01-31T05:14:37.389 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_dir_fetch": 1, 2024-01-31T05:14:37.389 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_remote_ino": 1, 2024-01-31T05:14:37.389 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_lock": 11, 2024-01-31T05:14:37.389 INFO:teuthology.orchestra.run.smithi179.stdout: "load_cent": 0, 2024-01-31T05:14:37.389 INFO:teuthology.orchestra.run.smithi179.stdout: "q": 0, 2024-01-31T05:14:37.389 INFO:teuthology.orchestra.run.smithi179.stdout: "exported": 222, 2024-01-31T05:14:37.389 INFO:teuthology.orchestra.run.smithi179.stdout: "exported_inodes": 2208, 2024-01-31T05:14:37.389 INFO:teuthology.orchestra.run.smithi179.stdout: "imported": 122, 2024-01-31T05:14:37.389 INFO:teuthology.orchestra.run.smithi179.stdout: "imported_inodes": 41, 2024-01-31T05:14:37.389 INFO:teuthology.orchestra.run.smithi179.stdout: "openino_dir_fetch": 0, 2024-01-31T05:14:37.390 INFO:teuthology.orchestra.run.smithi179.stdout: "openino_backtrace_fetch": 10100, 2024-01-31T05:14:37.390 INFO:teuthology.orchestra.run.smithi179.stdout: "openino_peer_discover": 3, 2024-01-31T05:14:37.390 INFO:teuthology.orchestra.run.smithi179.stdout: "root_rfiles": 4, 2024-01-31T05:14:37.390 INFO:teuthology.orchestra.run.smithi179.stdout: "root_rbytes": 234, 2024-01-31T05:14:37.390 INFO:teuthology.orchestra.run.smithi179.stdout: "root_rsnaps": 0, 2024-01-31T05:14:37.390 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_backtrace_fetch": 10100, 2024-01-31T05:14:37.390 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_set_tag": 0, 2024-01-31T05:14:37.390 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_backtrace_repaired": 0, 2024-01-31T05:14:37.390 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_inotable_repaired": 0, 2024-01-31T05:14:37.390 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_dir_inodes": 1220, 2024-01-31T05:14:37.390 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_dir_base_inodes": 4, 2024-01-31T05:14:37.390 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_dirfrag_rstats": 1216, 2024-01-31T05:14:37.390 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_file_inodes": 8880, 2024-01-31T05:14:37.390 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_inode_file_caps": 274, 2024-01-31T05:14:37.390 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_revoke": 6674, 2024-01-31T05:14:37.391 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_grant": 27927, 2024-01-31T05:14:37.391 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_trunc": 231, 2024-01-31T05:14:37.391 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-01-31T05:14:37.391 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_flush_ack": 0, 2024-01-31T05:14:37.391 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_caps": 21166, 2024-01-31T05:14:37.391 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_caps_dirty": 13207, 2024-01-31T05:14:37.391 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_cap_release": 144, 2024-01-31T05:14:37.391 INFO:teuthology.orchestra.run.smithi179.stdout: "process_request_cap_release": 18377 2024-01-31T05:14:37.391 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.391 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_cache": { 2024-01-31T05:14:37.391 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_update": 0, 2024-01-31T05:14:37.391 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_update_receipt": 0, 2024-01-31T05:14:37.391 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_try_discover": 0, 2024-01-31T05:14:37.391 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_send_discover": 113, 2024-01-31T05:14:37.392 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_handle_discover": 400, 2024-01-31T05:14:37.392 INFO:teuthology.orchestra.run.smithi179.stdout: "num_strays": 23, 2024-01-31T05:14:37.392 INFO:teuthology.orchestra.run.smithi179.stdout: "num_strays_delayed": 0, 2024-01-31T05:14:37.392 INFO:teuthology.orchestra.run.smithi179.stdout: "num_strays_enqueuing": 0, 2024-01-31T05:14:37.392 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_created": 12149, 2024-01-31T05:14:37.392 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_enqueued": 12024, 2024-01-31T05:14:37.392 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_reintegrated": 101, 2024-01-31T05:14:37.392 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_migrated": 8, 2024-01-31T05:14:37.392 INFO:teuthology.orchestra.run.smithi179.stdout: "num_recovering_processing": 0, 2024-01-31T05:14:37.392 INFO:teuthology.orchestra.run.smithi179.stdout: "num_recovering_enqueued": 0, 2024-01-31T05:14:37.392 INFO:teuthology.orchestra.run.smithi179.stdout: "num_recovering_prioritized": 0, 2024-01-31T05:14:37.392 INFO:teuthology.orchestra.run.smithi179.stdout: "recovery_started": 0, 2024-01-31T05:14:37.393 INFO:teuthology.orchestra.run.smithi179.stdout: "recovery_completed": 0, 2024-01-31T05:14:37.393 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_enqueue_scrub": 4, 2024-01-31T05:14:37.393 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_exportdir": 222, 2024-01-31T05:14:37.393 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_flush": 0, 2024-01-31T05:14:37.393 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_fragmentdir": 10, 2024-01-31T05:14:37.393 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_fragstats": 0, 2024-01-31T05:14:37.393 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_inodestats": 0 2024-01-31T05:14:37.393 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.393 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_log": { 2024-01-31T05:14:37.393 INFO:teuthology.orchestra.run.smithi179.stdout: "evlrg": 0, 2024-01-31T05:14:37.393 INFO:teuthology.orchestra.run.smithi179.stdout: "evadd": 60819, 2024-01-31T05:14:37.393 INFO:teuthology.orchestra.run.smithi179.stdout: "evex": 52890, 2024-01-31T05:14:37.393 INFO:teuthology.orchestra.run.smithi179.stdout: "evtrm": 52890, 2024-01-31T05:14:37.393 INFO:teuthology.orchestra.run.smithi179.stdout: "ev": 7929, 2024-01-31T05:14:37.394 INFO:teuthology.orchestra.run.smithi179.stdout: "evexg": 0, 2024-01-31T05:14:37.394 INFO:teuthology.orchestra.run.smithi179.stdout: "evexd": 7916, 2024-01-31T05:14:37.394 INFO:teuthology.orchestra.run.smithi179.stdout: "segadd": 84, 2024-01-31T05:14:37.394 INFO:teuthology.orchestra.run.smithi179.stdout: "segex": 73, 2024-01-31T05:14:37.394 INFO:teuthology.orchestra.run.smithi179.stdout: "segtrm": 73, 2024-01-31T05:14:37.394 INFO:teuthology.orchestra.run.smithi179.stdout: "seg": 11, 2024-01-31T05:14:37.394 INFO:teuthology.orchestra.run.smithi179.stdout: "segmjr": 1, 2024-01-31T05:14:37.394 INFO:teuthology.orchestra.run.smithi179.stdout: "segexg": 0, 2024-01-31T05:14:37.394 INFO:teuthology.orchestra.run.smithi179.stdout: "segexd": 11, 2024-01-31T05:14:37.394 INFO:teuthology.orchestra.run.smithi179.stdout: "expos": 119706791, 2024-01-31T05:14:37.394 INFO:teuthology.orchestra.run.smithi179.stdout: "wrpos": 133632275, 2024-01-31T05:14:37.394 INFO:teuthology.orchestra.run.smithi179.stdout: "rdpos": 0, 2024-01-31T05:14:37.394 INFO:teuthology.orchestra.run.smithi179.stdout: "jlat": { 2024-01-31T05:14:37.394 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 6178, 2024-01-31T05:14:37.395 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 236.293863826, 2024-01-31T05:14:37.395 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.038247630 2024-01-31T05:14:37.395 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.395 INFO:teuthology.orchestra.run.smithi179.stdout: "replayed": 0 2024-01-31T05:14:37.395 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.395 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_mem": { 2024-01-31T05:14:37.395 INFO:teuthology.orchestra.run.smithi179.stdout: "ino": 53, 2024-01-31T05:14:37.395 INFO:teuthology.orchestra.run.smithi179.stdout: "ino+": 14342, 2024-01-31T05:14:37.395 INFO:teuthology.orchestra.run.smithi179.stdout: "ino-": 14289, 2024-01-31T05:14:37.395 INFO:teuthology.orchestra.run.smithi179.stdout: "dir": 56, 2024-01-31T05:14:37.395 INFO:teuthology.orchestra.run.smithi179.stdout: "dir+": 1921, 2024-01-31T05:14:37.395 INFO:teuthology.orchestra.run.smithi179.stdout: "dir-": 1865, 2024-01-31T05:14:37.395 INFO:teuthology.orchestra.run.smithi179.stdout: "dn": 374, 2024-01-31T05:14:37.395 INFO:teuthology.orchestra.run.smithi179.stdout: "dn+": 27410, 2024-01-31T05:14:37.395 INFO:teuthology.orchestra.run.smithi179.stdout: "dn-": 27036, 2024-01-31T05:14:37.395 INFO:teuthology.orchestra.run.smithi179.stdout: "cap": 2, 2024-01-31T05:14:37.396 INFO:teuthology.orchestra.run.smithi179.stdout: "cap+": 14306, 2024-01-31T05:14:37.396 INFO:teuthology.orchestra.run.smithi179.stdout: "cap-": 14304, 2024-01-31T05:14:37.396 INFO:teuthology.orchestra.run.smithi179.stdout: "rss": 154616, 2024-01-31T05:14:37.396 INFO:teuthology.orchestra.run.smithi179.stdout: "heap": 207228 2024-01-31T05:14:37.396 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.396 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_server": { 2024-01-31T05:14:37.396 INFO:teuthology.orchestra.run.smithi179.stdout: "dispatch_client_request": 45856, 2024-01-31T05:14:37.396 INFO:teuthology.orchestra.run.smithi179.stdout: "dispatch_server_request": 1261, 2024-01-31T05:14:37.396 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_request": 36832, 2024-01-31T05:14:37.396 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_session": 517, 2024-01-31T05:14:37.396 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_peer_request": 1944, 2024-01-31T05:14:37.396 INFO:teuthology.orchestra.run.smithi179.stdout: "req_create_latency": { 2024-01-31T05:14:37.396 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 11532, 2024-01-31T05:14:37.396 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 477.044349290, 2024-01-31T05:14:37.397 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.041367009 2024-01-31T05:14:37.397 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.397 INFO:teuthology.orchestra.run.smithi179.stdout: "req_getattr_latency": { 2024-01-31T05:14:37.397 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 226, 2024-01-31T05:14:37.397 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.714677691, 2024-01-31T05:14:37.397 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.003162290 2024-01-31T05:14:37.397 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.397 INFO:teuthology.orchestra.run.smithi179.stdout: "req_getfilelock_latency": { 2024-01-31T05:14:37.397 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:37.397 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:37.397 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:37.397 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.397 INFO:teuthology.orchestra.run.smithi179.stdout: "req_link_latency": { 2024-01-31T05:14:37.397 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 220, 2024-01-31T05:14:37.398 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 3.132185755, 2024-01-31T05:14:37.398 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.014237207 2024-01-31T05:14:37.398 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.398 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookup_latency": { 2024-01-31T05:14:37.398 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 7113, 2024-01-31T05:14:37.398 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 6.018842856, 2024-01-31T05:14:37.398 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000846175 2024-01-31T05:14:37.398 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.398 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookuphash_latency": { 2024-01-31T05:14:37.398 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:37.398 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:37.398 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:37.398 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.398 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupino_latency": { 2024-01-31T05:14:37.398 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 1, 2024-01-31T05:14:37.399 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000202911, 2024-01-31T05:14:37.399 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000202911 2024-01-31T05:14:37.399 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.399 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupname_latency": { 2024-01-31T05:14:37.399 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:37.399 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:37.399 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:37.399 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.399 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupparent_latency": { 2024-01-31T05:14:37.399 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:37.399 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:37.399 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:37.399 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.399 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupsnap_latency": { 2024-01-31T05:14:37.399 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:37.400 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:37.400 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:37.400 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.400 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lssnap_latency": { 2024-01-31T05:14:37.401 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:37.401 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:37.401 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:37.401 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.401 INFO:teuthology.orchestra.run.smithi179.stdout: "req_mkdir_latency": { 2024-01-31T05:14:37.401 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 1779, 2024-01-31T05:14:37.401 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 11.781174433, 2024-01-31T05:14:37.401 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.006622357 2024-01-31T05:14:37.401 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.401 INFO:teuthology.orchestra.run.smithi179.stdout: "req_mknod_latency": { 2024-01-31T05:14:37.401 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 470, 2024-01-31T05:14:37.401 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 6.862438361, 2024-01-31T05:14:37.401 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.014600932 2024-01-31T05:14:37.401 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.402 INFO:teuthology.orchestra.run.smithi179.stdout: "req_mksnap_latency": { 2024-01-31T05:14:37.402 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:37.402 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:37.402 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:37.402 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.402 INFO:teuthology.orchestra.run.smithi179.stdout: "req_open_latency": { 2024-01-31T05:14:37.402 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 44, 2024-01-31T05:14:37.402 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.017619457, 2024-01-31T05:14:37.402 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000400442 2024-01-31T05:14:37.402 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.402 INFO:teuthology.orchestra.run.smithi179.stdout: "req_readdir_latency": { 2024-01-31T05:14:37.402 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 1629, 2024-01-31T05:14:37.402 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 5.106468504, 2024-01-31T05:14:37.402 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.003134725 2024-01-31T05:14:37.403 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.403 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rename_latency": { 2024-01-31T05:14:37.403 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 512, 2024-01-31T05:14:37.403 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 6.328172248, 2024-01-31T05:14:37.403 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.012359711 2024-01-31T05:14:37.403 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.403 INFO:teuthology.orchestra.run.smithi179.stdout: "req_renamesnap_latency": { 2024-01-31T05:14:37.403 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:37.403 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:37.403 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:37.403 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.403 INFO:teuthology.orchestra.run.smithi179.stdout: "req_snapdiff_latency": { 2024-01-31T05:14:37.403 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:37.403 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:37.403 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:37.404 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.404 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rmdir_latency": { 2024-01-31T05:14:37.404 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 1771, 2024-01-31T05:14:37.404 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 20.674145608, 2024-01-31T05:14:37.404 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.011673712 2024-01-31T05:14:37.404 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.404 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rmsnap_latency": { 2024-01-31T05:14:37.404 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:37.404 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:37.404 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:37.404 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.404 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rmxattr_latency": { 2024-01-31T05:14:37.405 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:37.405 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:37.405 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:37.405 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.405 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setattr_latency": { 2024-01-31T05:14:37.405 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 236, 2024-01-31T05:14:37.405 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 3.934652920, 2024-01-31T05:14:37.405 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.016672258 2024-01-31T05:14:37.405 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.405 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setdirlayout_latency": { 2024-01-31T05:14:37.405 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:37.405 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:37.405 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:37.405 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.406 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setfilelock_latency": { 2024-01-31T05:14:37.406 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:37.406 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:37.406 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:37.406 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.406 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setlayout_latency": { 2024-01-31T05:14:37.406 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:37.406 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:37.406 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:37.406 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.406 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setxattr_latency": { 2024-01-31T05:14:37.406 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 8, 2024-01-31T05:14:37.406 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.019592125, 2024-01-31T05:14:37.406 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.002449015 2024-01-31T05:14:37.407 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.407 INFO:teuthology.orchestra.run.smithi179.stdout: "req_symlink_latency": { 2024-01-31T05:14:37.407 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 452, 2024-01-31T05:14:37.407 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 3.022809966, 2024-01-31T05:14:37.407 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.006687632 2024-01-31T05:14:37.407 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.407 INFO:teuthology.orchestra.run.smithi179.stdout: "req_unlink_latency": { 2024-01-31T05:14:37.407 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 10670, 2024-01-31T05:14:37.407 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 16.189394612, 2024-01-31T05:14:37.407 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.001517281 2024-01-31T05:14:37.407 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.407 INFO:teuthology.orchestra.run.smithi179.stdout: "cap_revoke_eviction": 0, 2024-01-31T05:14:37.407 INFO:teuthology.orchestra.run.smithi179.stdout: "cap_acquisition_throttle": 0, 2024-01-31T05:14:37.407 INFO:teuthology.orchestra.run.smithi179.stdout: "req_getvxattr_latency": { 2024-01-31T05:14:37.408 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:37.408 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:37.408 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:37.408 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-01-31T05:14:37.408 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.408 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_sessions": { 2024-01-31T05:14:37.408 INFO:teuthology.orchestra.run.smithi179.stdout: "session_count": 1, 2024-01-31T05:14:37.408 INFO:teuthology.orchestra.run.smithi179.stdout: "session_add": 3, 2024-01-31T05:14:37.408 INFO:teuthology.orchestra.run.smithi179.stdout: "session_remove": 2, 2024-01-31T05:14:37.408 INFO:teuthology.orchestra.run.smithi179.stdout: "sessions_open": 1, 2024-01-31T05:14:37.408 INFO:teuthology.orchestra.run.smithi179.stdout: "sessions_stale": 0, 2024-01-31T05:14:37.408 INFO:teuthology.orchestra.run.smithi179.stdout: "total_load": 21535, 2024-01-31T05:14:37.408 INFO:teuthology.orchestra.run.smithi179.stdout: "average_load": 21535, 2024-01-31T05:14:37.408 INFO:teuthology.orchestra.run.smithi179.stdout: "avg_session_uptime": 196, 2024-01-31T05:14:37.409 INFO:teuthology.orchestra.run.smithi179.stdout: "mdthresh_evicted": 0 2024-01-31T05:14:37.409 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.409 INFO:teuthology.orchestra.run.smithi179.stdout: "mempool": { 2024-01-31T05:14:37.409 INFO:teuthology.orchestra.run.smithi179.stdout: "bloom_filter_bytes": 360, 2024-01-31T05:14:37.409 INFO:teuthology.orchestra.run.smithi179.stdout: "bloom_filter_items": 360, 2024-01-31T05:14:37.409 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_alloc_bytes": 0, 2024-01-31T05:14:37.409 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_alloc_items": 0, 2024-01-31T05:14:37.409 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_data_bytes": 0, 2024-01-31T05:14:37.409 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_data_items": 0, 2024-01-31T05:14:37.409 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_onode_bytes": 0, 2024-01-31T05:14:37.409 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_onode_items": 0, 2024-01-31T05:14:37.409 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_meta_bytes": 0, 2024-01-31T05:14:37.409 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_meta_items": 0, 2024-01-31T05:14:37.409 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_other_bytes": 0, 2024-01-31T05:14:37.410 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_other_items": 0, 2024-01-31T05:14:37.410 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_buffer_bytes": 0, 2024-01-31T05:14:37.410 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_buffer_items": 0, 2024-01-31T05:14:37.410 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_extent_bytes": 0, 2024-01-31T05:14:37.410 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_extent_items": 0, 2024-01-31T05:14:37.410 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_blob_bytes": 0, 2024-01-31T05:14:37.410 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_blob_items": 0, 2024-01-31T05:14:37.410 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_shared_blob_bytes": 0, 2024-01-31T05:14:37.410 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_shared_blob_items": 0, 2024-01-31T05:14:37.410 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_inline_bl_bytes": 0, 2024-01-31T05:14:37.410 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_inline_bl_items": 0, 2024-01-31T05:14:37.410 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_fsck_bytes": 0, 2024-01-31T05:14:37.410 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_fsck_items": 0, 2024-01-31T05:14:37.410 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_txc_bytes": 0, 2024-01-31T05:14:37.410 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_txc_items": 0, 2024-01-31T05:14:37.411 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_deferred_bytes": 0, 2024-01-31T05:14:37.411 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_deferred_items": 0, 2024-01-31T05:14:37.411 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_bytes": 0, 2024-01-31T05:14:37.411 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_items": 0, 2024-01-31T05:14:37.411 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_bytes": 0, 2024-01-31T05:14:37.411 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_items": 0, 2024-01-31T05:14:37.411 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_reader_bytes": 0, 2024-01-31T05:14:37.411 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_reader_items": 0, 2024-01-31T05:14:37.411 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_writer_bytes": 0, 2024-01-31T05:14:37.411 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_writer_items": 0, 2024-01-31T05:14:37.411 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_anon_bytes": 312266, 2024-01-31T05:14:37.411 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_anon_items": 136, 2024-01-31T05:14:37.411 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_meta_bytes": 176, 2024-01-31T05:14:37.411 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_meta_items": 2, 2024-01-31T05:14:37.411 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_bytes": 0, 2024-01-31T05:14:37.411 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_items": 0, 2024-01-31T05:14:37.412 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_mapbl_bytes": 0, 2024-01-31T05:14:37.412 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_mapbl_items": 0, 2024-01-31T05:14:37.412 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_pglog_bytes": 0, 2024-01-31T05:14:37.412 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_pglog_items": 0, 2024-01-31T05:14:37.412 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_bytes": 7240, 2024-01-31T05:14:37.412 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_items": 152, 2024-01-31T05:14:37.412 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_mapping_bytes": 0, 2024-01-31T05:14:37.412 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_mapping_items": 0, 2024-01-31T05:14:37.412 INFO:teuthology.orchestra.run.smithi179.stdout: "pgmap_bytes": 0, 2024-01-31T05:14:37.412 INFO:teuthology.orchestra.run.smithi179.stdout: "pgmap_items": 0, 2024-01-31T05:14:37.412 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_co_bytes": 480620, 2024-01-31T05:14:37.412 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_co_items": 7166, 2024-01-31T05:14:37.412 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_1_bytes": 0, 2024-01-31T05:14:37.413 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_1_items": 0, 2024-01-31T05:14:37.413 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_2_bytes": 0, 2024-01-31T05:14:37.413 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_2_items": 0 2024-01-31T05:14:37.413 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.413 INFO:teuthology.orchestra.run.smithi179.stdout: "objecter": { 2024-01-31T05:14:37.413 INFO:teuthology.orchestra.run.smithi179.stdout: "op_active": 0, 2024-01-31T05:14:37.413 INFO:teuthology.orchestra.run.smithi179.stdout: "op_laggy": 0, 2024-01-31T05:14:37.413 INFO:teuthology.orchestra.run.smithi179.stdout: "op_send": 47353, 2024-01-31T05:14:37.413 INFO:teuthology.orchestra.run.smithi179.stdout: "op_send_bytes": 154515189, 2024-01-31T05:14:37.413 INFO:teuthology.orchestra.run.smithi179.stdout: "op_resend": 37, 2024-01-31T05:14:37.413 INFO:teuthology.orchestra.run.smithi179.stdout: "op_reply": 47353, 2024-01-31T05:14:37.413 INFO:teuthology.orchestra.run.smithi179.stdout: "op_latency": { 2024-01-31T05:14:37.413 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 47353, 2024-01-31T05:14:37.413 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 4808.260387157, 2024-01-31T05:14:37.414 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.101540776 2024-01-31T05:14:37.414 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.414 INFO:teuthology.orchestra.run.smithi179.stdout: "op_inflight": 0, 2024-01-31T05:14:37.414 INFO:teuthology.orchestra.run.smithi179.stdout: "oplen_avg": { 2024-01-31T05:14:37.414 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 47353, 2024-01-31T05:14:37.414 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 79154 2024-01-31T05:14:37.414 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.414 INFO:teuthology.orchestra.run.smithi179.stdout: "op": 47353, 2024-01-31T05:14:37.414 INFO:teuthology.orchestra.run.smithi179.stdout: "op_r": 10422, 2024-01-31T05:14:37.414 INFO:teuthology.orchestra.run.smithi179.stdout: "op_w": 36931, 2024-01-31T05:14:37.414 INFO:teuthology.orchestra.run.smithi179.stdout: "op_rmw": 0, 2024-01-31T05:14:37.414 INFO:teuthology.orchestra.run.smithi179.stdout: "op_pg": 0, 2024-01-31T05:14:37.414 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_stat": 1117, 2024-01-31T05:14:37.414 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_create": 13602, 2024-01-31T05:14:37.415 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_read": 310, 2024-01-31T05:14:37.415 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_write": 6484, 2024-01-31T05:14:37.415 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_writefull": 202, 2024-01-31T05:14:37.415 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_writesame": 0, 2024-01-31T05:14:37.415 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_append": 0, 2024-01-31T05:14:37.415 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_zero": 0, 2024-01-31T05:14:37.415 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_truncate": 8, 2024-01-31T05:14:37.415 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_delete": 13517, 2024-01-31T05:14:37.415 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_mapext": 0, 2024-01-31T05:14:37.415 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_sparse_read": 0, 2024-01-31T05:14:37.415 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_clonerange": 0, 2024-01-31T05:14:37.415 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_getxattr": 10112, 2024-01-31T05:14:37.415 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_setxattr": 27664, 2024-01-31T05:14:37.415 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_cmpxattr": 0, 2024-01-31T05:14:37.415 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_rmxattr": 0, 2024-01-31T05:14:37.415 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_resetxattrs": 0, 2024-01-31T05:14:37.416 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_call": 0, 2024-01-31T05:14:37.416 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_watch": 0, 2024-01-31T05:14:37.416 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_notify": 0, 2024-01-31T05:14:37.416 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_src_cmpxattr": 0, 2024-01-31T05:14:37.416 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_pgls": 0, 2024-01-31T05:14:37.416 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_pgls_filter": 0, 2024-01-31T05:14:37.416 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_other": 278, 2024-01-31T05:14:37.416 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_active": 0, 2024-01-31T05:14:37.416 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_send": 0, 2024-01-31T05:14:37.416 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_resend": 0, 2024-01-31T05:14:37.416 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_ping": 0, 2024-01-31T05:14:37.416 INFO:teuthology.orchestra.run.smithi179.stdout: "poolop_active": 0, 2024-01-31T05:14:37.416 INFO:teuthology.orchestra.run.smithi179.stdout: "poolop_send": 0, 2024-01-31T05:14:37.416 INFO:teuthology.orchestra.run.smithi179.stdout: "poolop_resend": 0, 2024-01-31T05:14:37.417 INFO:teuthology.orchestra.run.smithi179.stdout: "poolstat_active": 0, 2024-01-31T05:14:37.417 INFO:teuthology.orchestra.run.smithi179.stdout: "poolstat_send": 0, 2024-01-31T05:14:37.417 INFO:teuthology.orchestra.run.smithi179.stdout: "poolstat_resend": 0, 2024-01-31T05:14:37.417 INFO:teuthology.orchestra.run.smithi179.stdout: "statfs_active": 0, 2024-01-31T05:14:37.417 INFO:teuthology.orchestra.run.smithi179.stdout: "statfs_send": 0, 2024-01-31T05:14:37.417 INFO:teuthology.orchestra.run.smithi179.stdout: "statfs_resend": 0, 2024-01-31T05:14:37.417 INFO:teuthology.orchestra.run.smithi179.stdout: "command_active": 0, 2024-01-31T05:14:37.417 INFO:teuthology.orchestra.run.smithi179.stdout: "command_send": 0, 2024-01-31T05:14:37.417 INFO:teuthology.orchestra.run.smithi179.stdout: "command_resend": 0, 2024-01-31T05:14:37.417 INFO:teuthology.orchestra.run.smithi179.stdout: "map_epoch": 88, 2024-01-31T05:14:37.417 INFO:teuthology.orchestra.run.smithi179.stdout: "map_full": 0, 2024-01-31T05:14:37.417 INFO:teuthology.orchestra.run.smithi179.stdout: "map_inc": 3, 2024-01-31T05:14:37.417 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_sessions": 12, 2024-01-31T05:14:37.417 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_session_open": 12, 2024-01-31T05:14:37.417 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_session_close": 0, 2024-01-31T05:14:37.417 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_laggy": 0, 2024-01-31T05:14:37.418 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_wr": 5525, 2024-01-31T05:14:37.418 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_rd": 16, 2024-01-31T05:14:37.418 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_del": 319 2024-01-31T05:14:37.418 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.418 INFO:teuthology.orchestra.run.smithi179.stdout: "oft": { 2024-01-31T05:14:37.418 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_objs": 1, 2024-01-31T05:14:37.418 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_kv_pairs": 0, 2024-01-31T05:14:37.418 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_updates": 0, 2024-01-31T05:14:37.418 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_removes": 0 2024-01-31T05:14:37.418 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.418 INFO:teuthology.orchestra.run.smithi179.stdout: "osd-slow-ops": { 2024-01-31T05:14:37.418 INFO:teuthology.orchestra.run.smithi179.stdout: "slow_ops_count": 0 2024-01-31T05:14:37.418 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.419 INFO:teuthology.orchestra.run.smithi179.stdout: "purge_queue": { 2024-01-31T05:14:37.419 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing_ops": 0, 2024-01-31T05:14:37.419 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing_ops_high_water": 14, 2024-01-31T05:14:37.419 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing": 0, 2024-01-31T05:14:37.419 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing_high_water": 6, 2024-01-31T05:14:37.419 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executed_ops": 12940, 2024-01-31T05:14:37.419 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executed": 12024, 2024-01-31T05:14:37.419 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_item_in_journal": 0 2024-01-31T05:14:37.419 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.419 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-01-31T05:14:37.419 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-01-31T05:14:37.419 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 104857600, 2024-01-31T05:14:37.419 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-01-31T05:14:37.419 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 126084, 2024-01-31T05:14:37.420 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 33020211, 2024-01-31T05:14:37.420 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:37.420 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 126084, 2024-01-31T05:14:37.420 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 0, 2024-01-31T05:14:37.420 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 0, 2024-01-31T05:14:37.420 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 126084, 2024-01-31T05:14:37.420 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 33020211, 2024-01-31T05:14:37.420 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-01-31T05:14:37.420 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:37.420 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:37.420 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:37.420 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-01-31T05:14:37.420 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.420 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-objecter_bytes": { 2024-01-31T05:14:37.421 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-01-31T05:14:37.421 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 104857600, 2024-01-31T05:14:37.421 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-01-31T05:14:37.421 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 0, 2024-01-31T05:14:37.421 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 0, 2024-01-31T05:14:37.421 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:37.421 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 0, 2024-01-31T05:14:37.421 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 47353, 2024-01-31T05:14:37.421 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 155729573, 2024-01-31T05:14:37.421 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 47353, 2024-01-31T05:14:37.421 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 155729573, 2024-01-31T05:14:37.421 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-01-31T05:14:37.421 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:37.422 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:37.422 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:37.422 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-01-31T05:14:37.422 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.422 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-objecter_ops": { 2024-01-31T05:14:37.422 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-01-31T05:14:37.422 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 1024, 2024-01-31T05:14:37.422 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-01-31T05:14:37.422 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 0, 2024-01-31T05:14:37.422 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 0, 2024-01-31T05:14:37.422 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:37.422 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 0, 2024-01-31T05:14:37.422 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 47353, 2024-01-31T05:14:37.423 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 47353, 2024-01-31T05:14:37.423 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 47353, 2024-01-31T05:14:37.423 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 47353, 2024-01-31T05:14:37.423 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-01-31T05:14:37.423 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:37.423 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:37.423 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:37.423 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-01-31T05:14:37.423 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.423 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-write_buf_throttle": { 2024-01-31T05:14:37.423 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-01-31T05:14:37.423 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 3758096384, 2024-01-31T05:14:37.423 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-01-31T05:14:37.423 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 12024, 2024-01-31T05:14:37.423 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 1214488, 2024-01-31T05:14:37.423 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:37.424 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 12024, 2024-01-31T05:14:37.424 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 0, 2024-01-31T05:14:37.424 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 0, 2024-01-31T05:14:37.424 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 306, 2024-01-31T05:14:37.424 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 1214488, 2024-01-31T05:14:37.424 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-01-31T05:14:37.424 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:37.424 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:37.424 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:37.424 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-01-31T05:14:37.424 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:37.424 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-write_buf_throttle-0x55ad0eb3e6e0": { 2024-01-31T05:14:37.424 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-01-31T05:14:37.424 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 3758096384, 2024-01-31T05:14:37.425 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-01-31T05:14:37.425 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 60819, 2024-01-31T05:14:37.425 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 129437971, 2024-01-31T05:14:37.425 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:37.425 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 60819, 2024-01-31T05:14:37.425 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 0, 2024-01-31T05:14:37.425 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 0, 2024-01-31T05:14:37.425 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 6178, 2024-01-31T05:14:37.425 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 129437971, 2024-01-31T05:14:37.425 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-01-31T05:14:37.425 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:37.425 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:37.425 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:37.425 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-01-31T05:14:37.425 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-01-31T05:14:37.425 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-01-31T05:14:38.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:14:37 smithi099 ceph-mon[31615]: pgmap v446: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.4 KiB/s wr, 16 op/s 2024-01-31T05:14:38.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:14:37 smithi181 ceph-mon[36434]: pgmap v446: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.4 KiB/s wr, 16 op/s 2024-01-31T05:14:38.129 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:14:37 smithi179 ceph-mon[35652]: pgmap v446: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.4 KiB/s wr, 16 op/s 2024-01-31T05:14:38.156 INFO:tasks.check_counter:Daemon mds.b mds.exported=222 2024-01-31T05:14:38.156 INFO:tasks.check_counter:Daemon mds.b mds.imported=122 2024-01-31T05:14:38.157 DEBUG:tasks.check_counter:Getting stats from e 2024-01-31T05:14:38.157 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph daemon mds.e perf dump 2024-01-31T05:14:38.400 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.b/config 2024-01-31T05:14:39.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:14:39 smithi179 ceph-mon[35652]: pgmap v447: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.3 KiB/s wr, 14 op/s 2024-01-31T05:14:40.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:14:39 smithi099 ceph-mon[31615]: pgmap v447: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.3 KiB/s wr, 14 op/s 2024-01-31T05:14:40.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:14:39 smithi181 ceph-mon[36434]: pgmap v447: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.3 KiB/s wr, 14 op/s 2024-01-31T05:14:40.138 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-01-31T05:14:40.138 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-0": { 2024-01-31T05:14:40.139 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 846, 2024-01-31T05:14:40.139 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 822, 2024-01-31T05:14:40.139 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 50802254, 2024-01-31T05:14:40.139 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 280877, 2024-01-31T05:14:40.139 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 7, 2024-01-31T05:14:40.139 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 3, 2024-01-31T05:14:40.139 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 0.096255452, 2024-01-31T05:14:40.139 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 0.027402170, 2024-01-31T05:14:40.139 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 0.047767475, 2024-01-31T05:14:40.139 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 0.020237054, 2024-01-31T05:14:40.139 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-01-31T05:14:40.139 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 821, 2024-01-31T05:14:40.139 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.027478635, 2024-01-31T05:14:40.139 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000033469 2024-01-31T05:14:40.140 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.140 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-01-31T05:14:40.140 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:40.140 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:40.140 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:40.140 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.140 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 844592, 2024-01-31T05:14:40.140 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 57264 2024-01-31T05:14:40.140 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.140 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-1": { 2024-01-31T05:14:40.140 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 145, 2024-01-31T05:14:40.140 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 216, 2024-01-31T05:14:40.140 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 41984538, 2024-01-31T05:14:40.140 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 242818, 2024-01-31T05:14:40.140 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 6, 2024-01-31T05:14:40.141 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 5, 2024-01-31T05:14:40.141 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 0.034763379, 2024-01-31T05:14:40.141 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 0.004981918, 2024-01-31T05:14:40.141 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 0.025298103, 2024-01-31T05:14:40.141 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 0.002877714, 2024-01-31T05:14:40.141 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-01-31T05:14:40.141 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 214, 2024-01-31T05:14:40.141 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.013622263, 2024-01-31T05:14:40.141 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000063655 2024-01-31T05:14:40.141 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.141 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-01-31T05:14:40.141 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:40.141 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:40.141 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:40.141 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.142 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 160, 2024-01-31T05:14:40.142 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 197968 2024-01-31T05:14:40.142 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.142 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-2": { 2024-01-31T05:14:40.142 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 315, 2024-01-31T05:14:40.142 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 315, 2024-01-31T05:14:40.142 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 37830021, 2024-01-31T05:14:40.142 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 97176, 2024-01-31T05:14:40.142 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 6, 2024-01-31T05:14:40.142 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 5, 2024-01-31T05:14:40.142 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 0.046669083, 2024-01-31T05:14:40.142 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 0.006757991, 2024-01-31T05:14:40.142 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 0.028547703, 2024-01-31T05:14:40.142 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 0.009013881, 2024-01-31T05:14:40.142 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-01-31T05:14:40.142 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 314, 2024-01-31T05:14:40.143 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.012572692, 2024-01-31T05:14:40.143 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000040040 2024-01-31T05:14:40.143 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.143 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-01-31T05:14:40.143 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:40.143 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:40.143 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:40.143 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.143 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-01-31T05:14:40.143 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 448 2024-01-31T05:14:40.143 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.144 INFO:teuthology.orchestra.run.smithi179.stdout: "cct": { 2024-01-31T05:14:40.144 INFO:teuthology.orchestra.run.smithi179.stdout: "total_workers": 1, 2024-01-31T05:14:40.144 INFO:teuthology.orchestra.run.smithi179.stdout: "unhealthy_workers": 0 2024-01-31T05:14:40.144 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.144 INFO:teuthology.orchestra.run.smithi179.stdout: "finisher-MDSRank": { 2024-01-31T05:14:40.144 INFO:teuthology.orchestra.run.smithi179.stdout: "queue_len": 0, 2024-01-31T05:14:40.144 INFO:teuthology.orchestra.run.smithi179.stdout: "complete_latency": { 2024-01-31T05:14:40.144 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 1877, 2024-01-31T05:14:40.144 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.271367373, 2024-01-31T05:14:40.144 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000144575 2024-01-31T05:14:40.144 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-01-31T05:14:40.144 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.145 INFO:teuthology.orchestra.run.smithi179.stdout: "finisher-PurgeQueue": { 2024-01-31T05:14:40.145 INFO:teuthology.orchestra.run.smithi179.stdout: "queue_len": 0, 2024-01-31T05:14:40.145 INFO:teuthology.orchestra.run.smithi179.stdout: "complete_latency": { 2024-01-31T05:14:40.145 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:40.145 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:40.145 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:40.145 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-01-31T05:14:40.145 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.145 INFO:teuthology.orchestra.run.smithi179.stdout: "mds": { 2024-01-31T05:14:40.145 INFO:teuthology.orchestra.run.smithi179.stdout: "request": 0, 2024-01-31T05:14:40.145 INFO:teuthology.orchestra.run.smithi179.stdout: "reply": 0, 2024-01-31T05:14:40.145 INFO:teuthology.orchestra.run.smithi179.stdout: "reply_latency": { 2024-01-31T05:14:40.145 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:40.145 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:40.146 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:40.146 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.146 INFO:teuthology.orchestra.run.smithi179.stdout: "slow_reply": 0, 2024-01-31T05:14:40.146 INFO:teuthology.orchestra.run.smithi179.stdout: "forward": 0, 2024-01-31T05:14:40.146 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_fetch_complete": 0, 2024-01-31T05:14:40.146 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_fetch_keys": 0, 2024-01-31T05:14:40.146 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_commit": 0, 2024-01-31T05:14:40.146 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_split": 0, 2024-01-31T05:14:40.146 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_merge": 0, 2024-01-31T05:14:40.146 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes": 12674, 2024-01-31T05:14:40.146 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_top": 6493, 2024-01-31T05:14:40.146 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_bottom": 6181, 2024-01-31T05:14:40.146 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_pin_tail": 0, 2024-01-31T05:14:40.146 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_pinned": 3397, 2024-01-31T05:14:40.146 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_expired": 0, 2024-01-31T05:14:40.147 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_with_caps": 0, 2024-01-31T05:14:40.147 INFO:teuthology.orchestra.run.smithi179.stdout: "caps": 0, 2024-01-31T05:14:40.147 INFO:teuthology.orchestra.run.smithi179.stdout: "subtrees": 2, 2024-01-31T05:14:40.147 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse": 0, 2024-01-31T05:14:40.147 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_hit": 0, 2024-01-31T05:14:40.147 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_forward": 0, 2024-01-31T05:14:40.147 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_discover": 0, 2024-01-31T05:14:40.147 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_dir_fetch": 0, 2024-01-31T05:14:40.147 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_remote_ino": 0, 2024-01-31T05:14:40.147 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_lock": 0, 2024-01-31T05:14:40.147 INFO:teuthology.orchestra.run.smithi179.stdout: "load_cent": 0, 2024-01-31T05:14:40.147 INFO:teuthology.orchestra.run.smithi179.stdout: "q": 0, 2024-01-31T05:14:40.147 INFO:teuthology.orchestra.run.smithi179.stdout: "exported": 0, 2024-01-31T05:14:40.147 INFO:teuthology.orchestra.run.smithi179.stdout: "exported_inodes": 0, 2024-01-31T05:14:40.148 INFO:teuthology.orchestra.run.smithi179.stdout: "imported": 0, 2024-01-31T05:14:40.148 INFO:teuthology.orchestra.run.smithi179.stdout: "imported_inodes": 0, 2024-01-31T05:14:40.148 INFO:teuthology.orchestra.run.smithi179.stdout: "openino_dir_fetch": 0, 2024-01-31T05:14:40.148 INFO:teuthology.orchestra.run.smithi179.stdout: "openino_backtrace_fetch": 0, 2024-01-31T05:14:40.148 INFO:teuthology.orchestra.run.smithi179.stdout: "openino_peer_discover": 0, 2024-01-31T05:14:40.148 INFO:teuthology.orchestra.run.smithi179.stdout: "root_rfiles": 4, 2024-01-31T05:14:40.148 INFO:teuthology.orchestra.run.smithi179.stdout: "root_rbytes": 234, 2024-01-31T05:14:40.148 INFO:teuthology.orchestra.run.smithi179.stdout: "root_rsnaps": 0, 2024-01-31T05:14:40.148 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_backtrace_fetch": 0, 2024-01-31T05:14:40.148 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_set_tag": 0, 2024-01-31T05:14:40.148 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_backtrace_repaired": 0, 2024-01-31T05:14:40.148 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_inotable_repaired": 0, 2024-01-31T05:14:40.148 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_dir_inodes": 0, 2024-01-31T05:14:40.148 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_dir_base_inodes": 0, 2024-01-31T05:14:40.149 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_dirfrag_rstats": 0, 2024-01-31T05:14:40.149 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_file_inodes": 0, 2024-01-31T05:14:40.149 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_inode_file_caps": 0, 2024-01-31T05:14:40.149 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_revoke": 0, 2024-01-31T05:14:40.149 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_grant": 0, 2024-01-31T05:14:40.149 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_trunc": 0, 2024-01-31T05:14:40.149 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-01-31T05:14:40.149 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_flush_ack": 0, 2024-01-31T05:14:40.149 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_caps": 0, 2024-01-31T05:14:40.149 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_caps_dirty": 0, 2024-01-31T05:14:40.149 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_cap_release": 0, 2024-01-31T05:14:40.149 INFO:teuthology.orchestra.run.smithi179.stdout: "process_request_cap_release": 0 2024-01-31T05:14:40.149 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.149 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_cache": { 2024-01-31T05:14:40.149 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_update": 0, 2024-01-31T05:14:40.150 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_update_receipt": 0, 2024-01-31T05:14:40.150 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_try_discover": 0, 2024-01-31T05:14:40.150 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_send_discover": 0, 2024-01-31T05:14:40.150 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_handle_discover": 0, 2024-01-31T05:14:40.150 INFO:teuthology.orchestra.run.smithi179.stdout: "num_strays": 0, 2024-01-31T05:14:40.150 INFO:teuthology.orchestra.run.smithi179.stdout: "num_strays_delayed": 0, 2024-01-31T05:14:40.150 INFO:teuthology.orchestra.run.smithi179.stdout: "num_strays_enqueuing": 0, 2024-01-31T05:14:40.150 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_created": 0, 2024-01-31T05:14:40.150 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_enqueued": 0, 2024-01-31T05:14:40.150 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_reintegrated": 0, 2024-01-31T05:14:40.150 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_migrated": 0, 2024-01-31T05:14:40.150 INFO:teuthology.orchestra.run.smithi179.stdout: "num_recovering_processing": 0, 2024-01-31T05:14:40.150 INFO:teuthology.orchestra.run.smithi179.stdout: "num_recovering_enqueued": 0, 2024-01-31T05:14:40.150 INFO:teuthology.orchestra.run.smithi179.stdout: "num_recovering_prioritized": 0, 2024-01-31T05:14:40.150 INFO:teuthology.orchestra.run.smithi179.stdout: "recovery_started": 0, 2024-01-31T05:14:40.151 INFO:teuthology.orchestra.run.smithi179.stdout: "recovery_completed": 0, 2024-01-31T05:14:40.151 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_enqueue_scrub": 0, 2024-01-31T05:14:40.151 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_exportdir": 0, 2024-01-31T05:14:40.151 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_flush": 0, 2024-01-31T05:14:40.151 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_fragmentdir": 0, 2024-01-31T05:14:40.151 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_fragstats": 0, 2024-01-31T05:14:40.151 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_inodestats": 0 2024-01-31T05:14:40.151 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.151 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_log": { 2024-01-31T05:14:40.151 INFO:teuthology.orchestra.run.smithi179.stdout: "evlrg": 0, 2024-01-31T05:14:40.151 INFO:teuthology.orchestra.run.smithi179.stdout: "evadd": 0, 2024-01-31T05:14:40.151 INFO:teuthology.orchestra.run.smithi179.stdout: "evex": 0, 2024-01-31T05:14:40.151 INFO:teuthology.orchestra.run.smithi179.stdout: "evtrm": 0, 2024-01-31T05:14:40.151 INFO:teuthology.orchestra.run.smithi179.stdout: "ev": 60819, 2024-01-31T05:14:40.152 INFO:teuthology.orchestra.run.smithi179.stdout: "evexg": 0, 2024-01-31T05:14:40.152 INFO:teuthology.orchestra.run.smithi179.stdout: "evexd": 0, 2024-01-31T05:14:40.152 INFO:teuthology.orchestra.run.smithi179.stdout: "segadd": 0, 2024-01-31T05:14:40.152 INFO:teuthology.orchestra.run.smithi179.stdout: "segex": 0, 2024-01-31T05:14:40.152 INFO:teuthology.orchestra.run.smithi179.stdout: "segtrm": 0, 2024-01-31T05:14:40.152 INFO:teuthology.orchestra.run.smithi179.stdout: "seg": 11, 2024-01-31T05:14:40.152 INFO:teuthology.orchestra.run.smithi179.stdout: "segmjr": 15, 2024-01-31T05:14:40.152 INFO:teuthology.orchestra.run.smithi179.stdout: "segexg": 0, 2024-01-31T05:14:40.152 INFO:teuthology.orchestra.run.smithi179.stdout: "segexd": 0, 2024-01-31T05:14:40.152 INFO:teuthology.orchestra.run.smithi179.stdout: "expos": 119706791, 2024-01-31T05:14:40.152 INFO:teuthology.orchestra.run.smithi179.stdout: "wrpos": 133632275, 2024-01-31T05:14:40.152 INFO:teuthology.orchestra.run.smithi179.stdout: "rdpos": 133627974, 2024-01-31T05:14:40.152 INFO:teuthology.orchestra.run.smithi179.stdout: "jlat": { 2024-01-31T05:14:40.152 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:40.152 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:40.153 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:40.153 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.153 INFO:teuthology.orchestra.run.smithi179.stdout: "replayed": 60819 2024-01-31T05:14:40.153 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.153 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_mem": { 2024-01-31T05:14:40.153 INFO:teuthology.orchestra.run.smithi179.stdout: "ino": 46, 2024-01-31T05:14:40.153 INFO:teuthology.orchestra.run.smithi179.stdout: "ino+": 14297, 2024-01-31T05:14:40.153 INFO:teuthology.orchestra.run.smithi179.stdout: "ino-": 14251, 2024-01-31T05:14:40.153 INFO:teuthology.orchestra.run.smithi179.stdout: "dir": 45, 2024-01-31T05:14:40.153 INFO:teuthology.orchestra.run.smithi179.stdout: "dir+": 1889, 2024-01-31T05:14:40.153 INFO:teuthology.orchestra.run.smithi179.stdout: "dir-": 1844, 2024-01-31T05:14:40.153 INFO:teuthology.orchestra.run.smithi179.stdout: "dn": 12674, 2024-01-31T05:14:40.153 INFO:teuthology.orchestra.run.smithi179.stdout: "dn+": 27046, 2024-01-31T05:14:40.153 INFO:teuthology.orchestra.run.smithi179.stdout: "dn-": 14372, 2024-01-31T05:14:40.154 INFO:teuthology.orchestra.run.smithi179.stdout: "cap": 0, 2024-01-31T05:14:40.154 INFO:teuthology.orchestra.run.smithi179.stdout: "cap+": 0, 2024-01-31T05:14:40.154 INFO:teuthology.orchestra.run.smithi179.stdout: "cap-": 0, 2024-01-31T05:14:40.154 INFO:teuthology.orchestra.run.smithi179.stdout: "rss": 88528, 2024-01-31T05:14:40.154 INFO:teuthology.orchestra.run.smithi179.stdout: "heap": 207228 2024-01-31T05:14:40.154 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.154 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_server": { 2024-01-31T05:14:40.154 INFO:teuthology.orchestra.run.smithi179.stdout: "dispatch_client_request": 0, 2024-01-31T05:14:40.154 INFO:teuthology.orchestra.run.smithi179.stdout: "dispatch_server_request": 0, 2024-01-31T05:14:40.154 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_request": 0, 2024-01-31T05:14:40.154 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_session": 0, 2024-01-31T05:14:40.154 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_peer_request": 0, 2024-01-31T05:14:40.154 INFO:teuthology.orchestra.run.smithi179.stdout: "req_create_latency": { 2024-01-31T05:14:40.154 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:40.154 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:40.155 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:40.155 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.155 INFO:teuthology.orchestra.run.smithi179.stdout: "req_getattr_latency": { 2024-01-31T05:14:40.155 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:40.155 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:40.155 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:40.155 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.155 INFO:teuthology.orchestra.run.smithi179.stdout: "req_getfilelock_latency": { 2024-01-31T05:14:40.155 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:40.155 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:40.155 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:40.155 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.155 INFO:teuthology.orchestra.run.smithi179.stdout: "req_link_latency": { 2024-01-31T05:14:40.155 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:40.156 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:40.156 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:40.156 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.156 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookup_latency": { 2024-01-31T05:14:40.156 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:40.156 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:40.156 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:40.156 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.156 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookuphash_latency": { 2024-01-31T05:14:40.156 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:40.156 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:40.156 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:40.156 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.156 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupino_latency": { 2024-01-31T05:14:40.157 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:40.157 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:40.157 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:40.157 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.157 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupname_latency": { 2024-01-31T05:14:40.157 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:40.157 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:40.157 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:40.157 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.157 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupparent_latency": { 2024-01-31T05:14:40.157 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:40.157 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:40.157 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:40.157 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.158 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupsnap_latency": { 2024-01-31T05:14:40.158 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:40.158 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:40.158 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:40.158 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.158 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lssnap_latency": { 2024-01-31T05:14:40.158 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:40.158 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:40.158 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:40.158 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.158 INFO:teuthology.orchestra.run.smithi179.stdout: "req_mkdir_latency": { 2024-01-31T05:14:40.158 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:40.159 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:40.159 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:40.159 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.159 INFO:teuthology.orchestra.run.smithi179.stdout: "req_mknod_latency": { 2024-01-31T05:14:40.159 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:40.159 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:40.159 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:40.159 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.159 INFO:teuthology.orchestra.run.smithi179.stdout: "req_mksnap_latency": { 2024-01-31T05:14:40.160 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:40.160 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:40.160 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:40.160 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.160 INFO:teuthology.orchestra.run.smithi179.stdout: "req_open_latency": { 2024-01-31T05:14:40.160 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:40.160 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:40.160 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:40.160 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.160 INFO:teuthology.orchestra.run.smithi179.stdout: "req_readdir_latency": { 2024-01-31T05:14:40.160 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:40.160 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:40.160 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:40.160 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.161 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rename_latency": { 2024-01-31T05:14:40.161 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:40.161 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:40.161 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:40.161 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.161 INFO:teuthology.orchestra.run.smithi179.stdout: "req_renamesnap_latency": { 2024-01-31T05:14:40.161 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:40.161 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:40.161 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:40.161 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.161 INFO:teuthology.orchestra.run.smithi179.stdout: "req_snapdiff_latency": { 2024-01-31T05:14:40.161 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:40.161 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:40.161 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:40.161 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.162 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rmdir_latency": { 2024-01-31T05:14:40.162 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:40.162 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:40.162 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:40.162 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.162 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rmsnap_latency": { 2024-01-31T05:14:40.162 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:40.162 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:40.162 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:40.162 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.162 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rmxattr_latency": { 2024-01-31T05:14:40.162 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:40.162 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:40.162 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:40.162 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.163 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setattr_latency": { 2024-01-31T05:14:40.163 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:40.163 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:40.163 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:40.163 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.163 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setdirlayout_latency": { 2024-01-31T05:14:40.163 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:40.163 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:40.163 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:40.163 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.163 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setfilelock_latency": { 2024-01-31T05:14:40.163 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:40.163 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:40.163 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:40.164 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.164 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setlayout_latency": { 2024-01-31T05:14:40.164 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:40.164 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:40.164 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:40.164 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.164 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setxattr_latency": { 2024-01-31T05:14:40.164 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:40.164 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:40.165 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:40.165 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.165 INFO:teuthology.orchestra.run.smithi179.stdout: "req_symlink_latency": { 2024-01-31T05:14:40.165 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:40.165 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:40.165 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:40.165 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.165 INFO:teuthology.orchestra.run.smithi179.stdout: "req_unlink_latency": { 2024-01-31T05:14:40.166 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:40.166 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:40.166 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:40.166 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.166 INFO:teuthology.orchestra.run.smithi179.stdout: "cap_revoke_eviction": 0, 2024-01-31T05:14:40.166 INFO:teuthology.orchestra.run.smithi179.stdout: "cap_acquisition_throttle": 0, 2024-01-31T05:14:40.166 INFO:teuthology.orchestra.run.smithi179.stdout: "req_getvxattr_latency": { 2024-01-31T05:14:40.166 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:40.166 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:40.166 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:40.166 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-01-31T05:14:40.166 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.166 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_sessions": { 2024-01-31T05:14:40.166 INFO:teuthology.orchestra.run.smithi179.stdout: "session_count": 1, 2024-01-31T05:14:40.167 INFO:teuthology.orchestra.run.smithi179.stdout: "session_add": 3, 2024-01-31T05:14:40.167 INFO:teuthology.orchestra.run.smithi179.stdout: "session_remove": 2, 2024-01-31T05:14:40.167 INFO:teuthology.orchestra.run.smithi179.stdout: "sessions_open": 2, 2024-01-31T05:14:40.167 INFO:teuthology.orchestra.run.smithi179.stdout: "sessions_stale": 0, 2024-01-31T05:14:40.167 INFO:teuthology.orchestra.run.smithi179.stdout: "total_load": 0, 2024-01-31T05:14:40.167 INFO:teuthology.orchestra.run.smithi179.stdout: "average_load": 0, 2024-01-31T05:14:40.167 INFO:teuthology.orchestra.run.smithi179.stdout: "avg_session_uptime": 3380, 2024-01-31T05:14:40.167 INFO:teuthology.orchestra.run.smithi179.stdout: "mdthresh_evicted": 0 2024-01-31T05:14:40.167 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.167 INFO:teuthology.orchestra.run.smithi179.stdout: "mempool": { 2024-01-31T05:14:40.167 INFO:teuthology.orchestra.run.smithi179.stdout: "bloom_filter_bytes": 0, 2024-01-31T05:14:40.167 INFO:teuthology.orchestra.run.smithi179.stdout: "bloom_filter_items": 0, 2024-01-31T05:14:40.167 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_alloc_bytes": 0, 2024-01-31T05:14:40.167 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_alloc_items": 0, 2024-01-31T05:14:40.168 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_data_bytes": 0, 2024-01-31T05:14:40.168 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_data_items": 0, 2024-01-31T05:14:40.168 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_onode_bytes": 0, 2024-01-31T05:14:40.168 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_onode_items": 0, 2024-01-31T05:14:40.168 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_meta_bytes": 0, 2024-01-31T05:14:40.168 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_meta_items": 0, 2024-01-31T05:14:40.168 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_other_bytes": 0, 2024-01-31T05:14:40.168 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_other_items": 0, 2024-01-31T05:14:40.168 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_buffer_bytes": 0, 2024-01-31T05:14:40.168 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_buffer_items": 0, 2024-01-31T05:14:40.168 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_extent_bytes": 0, 2024-01-31T05:14:40.168 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_extent_items": 0, 2024-01-31T05:14:40.168 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_blob_bytes": 0, 2024-01-31T05:14:40.169 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_blob_items": 0, 2024-01-31T05:14:40.169 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_shared_blob_bytes": 0, 2024-01-31T05:14:40.169 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_shared_blob_items": 0, 2024-01-31T05:14:40.169 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_inline_bl_bytes": 0, 2024-01-31T05:14:40.169 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_inline_bl_items": 0, 2024-01-31T05:14:40.169 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_fsck_bytes": 0, 2024-01-31T05:14:40.169 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_fsck_items": 0, 2024-01-31T05:14:40.169 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_txc_bytes": 0, 2024-01-31T05:14:40.169 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_txc_items": 0, 2024-01-31T05:14:40.169 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_deferred_bytes": 0, 2024-01-31T05:14:40.169 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_deferred_items": 0, 2024-01-31T05:14:40.169 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_bytes": 0, 2024-01-31T05:14:40.169 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_items": 0, 2024-01-31T05:14:40.169 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_bytes": 0, 2024-01-31T05:14:40.170 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_items": 0, 2024-01-31T05:14:40.170 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_reader_bytes": 0, 2024-01-31T05:14:40.170 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_reader_items": 0, 2024-01-31T05:14:40.170 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_writer_bytes": 0, 2024-01-31T05:14:40.170 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_writer_items": 0, 2024-01-31T05:14:40.170 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_anon_bytes": 230490, 2024-01-31T05:14:40.170 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_anon_items": 91, 2024-01-31T05:14:40.170 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_meta_bytes": 0, 2024-01-31T05:14:40.170 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_meta_items": 0, 2024-01-31T05:14:40.170 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_bytes": 0, 2024-01-31T05:14:40.170 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_items": 0, 2024-01-31T05:14:40.170 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_mapbl_bytes": 0, 2024-01-31T05:14:40.170 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_mapbl_items": 0, 2024-01-31T05:14:40.170 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_pglog_bytes": 0, 2024-01-31T05:14:40.171 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_pglog_items": 0, 2024-01-31T05:14:40.171 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_bytes": 7240, 2024-01-31T05:14:40.171 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_items": 152, 2024-01-31T05:14:40.171 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_mapping_bytes": 0, 2024-01-31T05:14:40.171 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_mapping_items": 0, 2024-01-31T05:14:40.171 INFO:teuthology.orchestra.run.smithi179.stdout: "pgmap_bytes": 0, 2024-01-31T05:14:40.171 INFO:teuthology.orchestra.run.smithi179.stdout: "pgmap_items": 0, 2024-01-31T05:14:40.171 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_co_bytes": 9088212, 2024-01-31T05:14:40.171 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_co_items": 54905, 2024-01-31T05:14:40.171 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_1_bytes": 0, 2024-01-31T05:14:40.171 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_1_items": 0, 2024-01-31T05:14:40.171 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_2_bytes": 0, 2024-01-31T05:14:40.171 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_2_items": 0 2024-01-31T05:14:40.172 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.172 INFO:teuthology.orchestra.run.smithi179.stdout: "objecter": { 2024-01-31T05:14:40.172 INFO:teuthology.orchestra.run.smithi179.stdout: "op_active": 0, 2024-01-31T05:14:40.172 INFO:teuthology.orchestra.run.smithi179.stdout: "op_laggy": 0, 2024-01-31T05:14:40.172 INFO:teuthology.orchestra.run.smithi179.stdout: "op_send": 1174, 2024-01-31T05:14:40.172 INFO:teuthology.orchestra.run.smithi179.stdout: "op_send_bytes": 26, 2024-01-31T05:14:40.172 INFO:teuthology.orchestra.run.smithi179.stdout: "op_resend": 4, 2024-01-31T05:14:40.172 INFO:teuthology.orchestra.run.smithi179.stdout: "op_reply": 1174, 2024-01-31T05:14:40.172 INFO:teuthology.orchestra.run.smithi179.stdout: "op_latency": { 2024-01-31T05:14:40.172 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 1174, 2024-01-31T05:14:40.172 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 1.341969120, 2024-01-31T05:14:40.172 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.001143074 2024-01-31T05:14:40.172 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.173 INFO:teuthology.orchestra.run.smithi179.stdout: "op_inflight": 0, 2024-01-31T05:14:40.173 INFO:teuthology.orchestra.run.smithi179.stdout: "oplen_avg": { 2024-01-31T05:14:40.173 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 1174, 2024-01-31T05:14:40.173 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 1175 2024-01-31T05:14:40.173 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.173 INFO:teuthology.orchestra.run.smithi179.stdout: "op": 1174, 2024-01-31T05:14:40.173 INFO:teuthology.orchestra.run.smithi179.stdout: "op_r": 1174, 2024-01-31T05:14:40.173 INFO:teuthology.orchestra.run.smithi179.stdout: "op_w": 0, 2024-01-31T05:14:40.173 INFO:teuthology.orchestra.run.smithi179.stdout: "op_rmw": 0, 2024-01-31T05:14:40.173 INFO:teuthology.orchestra.run.smithi179.stdout: "op_pg": 0, 2024-01-31T05:14:40.173 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_stat": 724, 2024-01-31T05:14:40.173 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_create": 0, 2024-01-31T05:14:40.173 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_read": 447, 2024-01-31T05:14:40.173 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_write": 0, 2024-01-31T05:14:40.174 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_writefull": 0, 2024-01-31T05:14:40.174 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_writesame": 0, 2024-01-31T05:14:40.174 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_append": 0, 2024-01-31T05:14:40.174 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_zero": 0, 2024-01-31T05:14:40.174 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_truncate": 0, 2024-01-31T05:14:40.174 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_delete": 0, 2024-01-31T05:14:40.174 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_mapext": 0, 2024-01-31T05:14:40.174 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_sparse_read": 0, 2024-01-31T05:14:40.174 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_clonerange": 0, 2024-01-31T05:14:40.174 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_getxattr": 2, 2024-01-31T05:14:40.174 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_setxattr": 0, 2024-01-31T05:14:40.174 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_cmpxattr": 0, 2024-01-31T05:14:40.174 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_rmxattr": 0, 2024-01-31T05:14:40.174 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_resetxattrs": 0, 2024-01-31T05:14:40.174 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_call": 0, 2024-01-31T05:14:40.175 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_watch": 0, 2024-01-31T05:14:40.175 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_notify": 0, 2024-01-31T05:14:40.175 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_src_cmpxattr": 0, 2024-01-31T05:14:40.175 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_pgls": 0, 2024-01-31T05:14:40.175 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_pgls_filter": 0, 2024-01-31T05:14:40.175 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_other": 0, 2024-01-31T05:14:40.175 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_active": 0, 2024-01-31T05:14:40.175 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_send": 0, 2024-01-31T05:14:40.175 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_resend": 0, 2024-01-31T05:14:40.175 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_ping": 0, 2024-01-31T05:14:40.175 INFO:teuthology.orchestra.run.smithi179.stdout: "poolop_active": 0, 2024-01-31T05:14:40.175 INFO:teuthology.orchestra.run.smithi179.stdout: "poolop_send": 0, 2024-01-31T05:14:40.175 INFO:teuthology.orchestra.run.smithi179.stdout: "poolop_resend": 0, 2024-01-31T05:14:40.175 INFO:teuthology.orchestra.run.smithi179.stdout: "poolstat_active": 0, 2024-01-31T05:14:40.176 INFO:teuthology.orchestra.run.smithi179.stdout: "poolstat_send": 0, 2024-01-31T05:14:40.176 INFO:teuthology.orchestra.run.smithi179.stdout: "poolstat_resend": 0, 2024-01-31T05:14:40.176 INFO:teuthology.orchestra.run.smithi179.stdout: "statfs_active": 0, 2024-01-31T05:14:40.176 INFO:teuthology.orchestra.run.smithi179.stdout: "statfs_send": 0, 2024-01-31T05:14:40.176 INFO:teuthology.orchestra.run.smithi179.stdout: "statfs_resend": 0, 2024-01-31T05:14:40.176 INFO:teuthology.orchestra.run.smithi179.stdout: "command_active": 0, 2024-01-31T05:14:40.176 INFO:teuthology.orchestra.run.smithi179.stdout: "command_send": 0, 2024-01-31T05:14:40.176 INFO:teuthology.orchestra.run.smithi179.stdout: "command_resend": 0, 2024-01-31T05:14:40.176 INFO:teuthology.orchestra.run.smithi179.stdout: "map_epoch": 88, 2024-01-31T05:14:40.176 INFO:teuthology.orchestra.run.smithi179.stdout: "map_full": 0, 2024-01-31T05:14:40.176 INFO:teuthology.orchestra.run.smithi179.stdout: "map_inc": 2, 2024-01-31T05:14:40.177 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_sessions": 10, 2024-01-31T05:14:40.177 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_session_open": 10, 2024-01-31T05:14:40.177 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_session_close": 0, 2024-01-31T05:14:40.177 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_laggy": 0, 2024-01-31T05:14:40.177 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_wr": 0, 2024-01-31T05:14:40.177 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_rd": 2, 2024-01-31T05:14:40.177 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_del": 0 2024-01-31T05:14:40.177 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.177 INFO:teuthology.orchestra.run.smithi179.stdout: "oft": { 2024-01-31T05:14:40.177 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_objs": 0, 2024-01-31T05:14:40.177 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_kv_pairs": 0, 2024-01-31T05:14:40.177 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_updates": 0, 2024-01-31T05:14:40.177 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_removes": 0 2024-01-31T05:14:40.177 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.177 INFO:teuthology.orchestra.run.smithi179.stdout: "osd-slow-ops": { 2024-01-31T05:14:40.177 INFO:teuthology.orchestra.run.smithi179.stdout: "slow_ops_count": 0 2024-01-31T05:14:40.178 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.178 INFO:teuthology.orchestra.run.smithi179.stdout: "purge_queue": { 2024-01-31T05:14:40.178 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing_ops": 0, 2024-01-31T05:14:40.178 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing_ops_high_water": 0, 2024-01-31T05:14:40.178 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing": 0, 2024-01-31T05:14:40.178 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing_high_water": 0, 2024-01-31T05:14:40.178 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executed_ops": 0, 2024-01-31T05:14:40.178 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executed": 0, 2024-01-31T05:14:40.178 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_item_in_journal": 0 2024-01-31T05:14:40.178 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.178 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-01-31T05:14:40.178 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-01-31T05:14:40.178 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 104857600, 2024-01-31T05:14:40.178 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-01-31T05:14:40.179 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 1302, 2024-01-31T05:14:40.179 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 130490238, 2024-01-31T05:14:40.179 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:40.179 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 1302, 2024-01-31T05:14:40.179 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 0, 2024-01-31T05:14:40.179 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 0, 2024-01-31T05:14:40.179 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 1302, 2024-01-31T05:14:40.179 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 130490238, 2024-01-31T05:14:40.179 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-01-31T05:14:40.179 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:40.179 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:40.179 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:40.179 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-01-31T05:14:40.179 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.179 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-objecter_bytes": { 2024-01-31T05:14:40.179 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-01-31T05:14:40.180 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 104857600, 2024-01-31T05:14:40.180 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-01-31T05:14:40.180 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 0, 2024-01-31T05:14:40.180 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 0, 2024-01-31T05:14:40.180 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:40.180 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 0, 2024-01-31T05:14:40.180 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 1174, 2024-01-31T05:14:40.180 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 129443317, 2024-01-31T05:14:40.180 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 1174, 2024-01-31T05:14:40.180 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 129443317, 2024-01-31T05:14:40.180 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-01-31T05:14:40.180 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:40.180 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:40.180 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:40.181 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-01-31T05:14:40.181 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.181 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-objecter_ops": { 2024-01-31T05:14:40.181 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-01-31T05:14:40.181 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 1024, 2024-01-31T05:14:40.181 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-01-31T05:14:40.181 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 0, 2024-01-31T05:14:40.181 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 0, 2024-01-31T05:14:40.181 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:40.181 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 0, 2024-01-31T05:14:40.181 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 1174, 2024-01-31T05:14:40.181 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 1174, 2024-01-31T05:14:40.181 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 1174, 2024-01-31T05:14:40.181 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 1174, 2024-01-31T05:14:40.181 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-01-31T05:14:40.181 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:40.182 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:40.182 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:40.182 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-01-31T05:14:40.182 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.182 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-write_buf_throttle": { 2024-01-31T05:14:40.182 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-01-31T05:14:40.182 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 3758096384, 2024-01-31T05:14:40.182 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-01-31T05:14:40.182 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 0, 2024-01-31T05:14:40.182 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 0, 2024-01-31T05:14:40.182 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:40.182 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 0, 2024-01-31T05:14:40.182 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 0, 2024-01-31T05:14:40.182 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 0, 2024-01-31T05:14:40.182 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 0, 2024-01-31T05:14:40.183 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 0, 2024-01-31T05:14:40.183 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-01-31T05:14:40.183 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:40.183 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:40.183 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:40.183 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-01-31T05:14:40.183 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:40.183 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-write_buf_throttle-0x55b794b1c960": { 2024-01-31T05:14:40.183 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-01-31T05:14:40.183 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 3758096384, 2024-01-31T05:14:40.183 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-01-31T05:14:40.183 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 0, 2024-01-31T05:14:40.183 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 0, 2024-01-31T05:14:40.183 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:40.183 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 0, 2024-01-31T05:14:40.183 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 0, 2024-01-31T05:14:40.184 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 0, 2024-01-31T05:14:40.184 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 0, 2024-01-31T05:14:40.184 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 0, 2024-01-31T05:14:40.184 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-01-31T05:14:40.184 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:40.184 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:40.184 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:40.184 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-01-31T05:14:40.184 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-01-31T05:14:40.184 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-01-31T05:14:40.908 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-01-31T05:14:40.908 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-01-31T05:14:40.908 DEBUG:tasks.check_counter:Getting stats from h 2024-01-31T05:14:40.909 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph daemon mds.h perf dump 2024-01-31T05:14:41.146 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.b/config 2024-01-31T05:14:41.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:14:41 smithi179 ceph-mon[35652]: pgmap v448: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 426 B/s wr, 9 op/s 2024-01-31T05:14:42.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:14:41 smithi099 ceph-mon[31615]: pgmap v448: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 426 B/s wr, 9 op/s 2024-01-31T05:14:42.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:14:41 smithi181 ceph-mon[36434]: pgmap v448: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 426 B/s wr, 9 op/s 2024-01-31T05:14:42.817 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-01-31T05:14:42.817 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-0": { 2024-01-31T05:14:42.817 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 3704, 2024-01-31T05:14:42.817 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 5348, 2024-01-31T05:14:42.817 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 2103977, 2024-01-31T05:14:42.817 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 6803397, 2024-01-31T05:14:42.817 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 17, 2024-01-31T05:14:42.818 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 6, 2024-01-31T05:14:42.818 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 0.271798572, 2024-01-31T05:14:42.818 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 0.112677021, 2024-01-31T05:14:42.818 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 0.158650266, 2024-01-31T05:14:42.818 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 0.026082714, 2024-01-31T05:14:42.818 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-01-31T05:14:42.818 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 5346, 2024-01-31T05:14:42.818 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.148947436, 2024-01-31T05:14:42.818 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000027861 2024-01-31T05:14:42.818 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.818 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-01-31T05:14:42.818 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 6056, 2024-01-31T05:14:42.818 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000951074, 2024-01-31T05:14:42.818 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000157 2024-01-31T05:14:42.819 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.819 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 1551824, 2024-01-31T05:14:42.819 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 2351696 2024-01-31T05:14:42.819 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.819 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-1": { 2024-01-31T05:14:42.819 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 7590, 2024-01-31T05:14:42.819 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 5924, 2024-01-31T05:14:42.819 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 2912676, 2024-01-31T05:14:42.819 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 1933846, 2024-01-31T05:14:42.819 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 11, 2024-01-31T05:14:42.819 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 6, 2024-01-31T05:14:42.819 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 0.407192071, 2024-01-31T05:14:42.819 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 0.176615903, 2024-01-31T05:14:42.820 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 0.292894256, 2024-01-31T05:14:42.820 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 0.008415590, 2024-01-31T05:14:42.820 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-01-31T05:14:42.820 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 5924, 2024-01-31T05:14:42.820 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.149460057, 2024-01-31T05:14:42.820 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000025229 2024-01-31T05:14:42.820 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.820 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-01-31T05:14:42.820 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 12759, 2024-01-31T05:14:42.820 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.001878710, 2024-01-31T05:14:42.820 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000147 2024-01-31T05:14:42.820 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.820 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 160, 2024-01-31T05:14:42.820 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 201088 2024-01-31T05:14:42.821 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.821 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-2": { 2024-01-31T05:14:42.821 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 561, 2024-01-31T05:14:42.821 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 563, 2024-01-31T05:14:42.821 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 211354, 2024-01-31T05:14:42.821 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 338108, 2024-01-31T05:14:42.821 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 12, 2024-01-31T05:14:42.821 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 7, 2024-01-31T05:14:42.821 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 0.038934786, 2024-01-31T05:14:42.821 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 0.010331734, 2024-01-31T05:14:42.821 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 0.012132899, 2024-01-31T05:14:42.821 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 0.012376978, 2024-01-31T05:14:42.821 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-01-31T05:14:42.822 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 561, 2024-01-31T05:14:42.822 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.044401161, 2024-01-31T05:14:42.822 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000079146 2024-01-31T05:14:42.822 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.822 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-01-31T05:14:42.822 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 4, 2024-01-31T05:14:42.822 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000324, 2024-01-31T05:14:42.822 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000081 2024-01-31T05:14:42.822 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.822 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 0, 2024-01-31T05:14:42.822 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 0 2024-01-31T05:14:42.822 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.822 INFO:teuthology.orchestra.run.smithi179.stdout: "cct": { 2024-01-31T05:14:42.822 INFO:teuthology.orchestra.run.smithi179.stdout: "total_workers": 1, 2024-01-31T05:14:42.823 INFO:teuthology.orchestra.run.smithi179.stdout: "unhealthy_workers": 0 2024-01-31T05:14:42.823 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.823 INFO:teuthology.orchestra.run.smithi179.stdout: "finisher-MDSRank": { 2024-01-31T05:14:42.823 INFO:teuthology.orchestra.run.smithi179.stdout: "queue_len": 0, 2024-01-31T05:14:42.823 INFO:teuthology.orchestra.run.smithi179.stdout: "complete_latency": { 2024-01-31T05:14:42.823 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 1309, 2024-01-31T05:14:42.823 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.792011272, 2024-01-31T05:14:42.823 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000605050 2024-01-31T05:14:42.823 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-01-31T05:14:42.823 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.823 INFO:teuthology.orchestra.run.smithi179.stdout: "finisher-PurgeQueue": { 2024-01-31T05:14:42.823 INFO:teuthology.orchestra.run.smithi179.stdout: "queue_len": 0, 2024-01-31T05:14:42.823 INFO:teuthology.orchestra.run.smithi179.stdout: "complete_latency": { 2024-01-31T05:14:42.824 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 1176, 2024-01-31T05:14:42.824 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.068648889, 2024-01-31T05:14:42.824 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000058374 2024-01-31T05:14:42.824 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-01-31T05:14:42.824 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.824 INFO:teuthology.orchestra.run.smithi179.stdout: "mds": { 2024-01-31T05:14:42.824 INFO:teuthology.orchestra.run.smithi179.stdout: "request": 1194, 2024-01-31T05:14:42.824 INFO:teuthology.orchestra.run.smithi179.stdout: "reply": 1152, 2024-01-31T05:14:42.824 INFO:teuthology.orchestra.run.smithi179.stdout: "reply_latency": { 2024-01-31T05:14:42.824 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 1152, 2024-01-31T05:14:42.824 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 2.932698837, 2024-01-31T05:14:42.824 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.002545745 2024-01-31T05:14:42.825 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.825 INFO:teuthology.orchestra.run.smithi179.stdout: "slow_reply": 0, 2024-01-31T05:14:42.825 INFO:teuthology.orchestra.run.smithi179.stdout: "forward": 42, 2024-01-31T05:14:42.825 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_fetch_complete": 2, 2024-01-31T05:14:42.825 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_fetch_keys": 0, 2024-01-31T05:14:42.825 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_commit": 11, 2024-01-31T05:14:42.825 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_split": 0, 2024-01-31T05:14:42.825 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_merge": 0, 2024-01-31T05:14:42.825 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes": 95, 2024-01-31T05:14:42.825 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_top": 37, 2024-01-31T05:14:42.825 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_bottom": 21, 2024-01-31T05:14:42.825 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_pin_tail": 37, 2024-01-31T05:14:42.825 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_pinned": 41, 2024-01-31T05:14:42.826 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_expired": 281, 2024-01-31T05:14:42.826 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_with_caps": 0, 2024-01-31T05:14:42.826 INFO:teuthology.orchestra.run.smithi179.stdout: "caps": 0, 2024-01-31T05:14:42.826 INFO:teuthology.orchestra.run.smithi179.stdout: "subtrees": 4, 2024-01-31T05:14:42.826 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse": 2265, 2024-01-31T05:14:42.826 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_hit": 1863, 2024-01-31T05:14:42.826 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_forward": 39, 2024-01-31T05:14:42.826 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_discover": 83, 2024-01-31T05:14:42.826 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_dir_fetch": 0, 2024-01-31T05:14:42.826 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_remote_ino": 4, 2024-01-31T05:14:42.826 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_lock": 7, 2024-01-31T05:14:42.826 INFO:teuthology.orchestra.run.smithi179.stdout: "load_cent": 0, 2024-01-31T05:14:42.826 INFO:teuthology.orchestra.run.smithi179.stdout: "q": 0, 2024-01-31T05:14:42.826 INFO:teuthology.orchestra.run.smithi179.stdout: "exported": 33, 2024-01-31T05:14:42.827 INFO:teuthology.orchestra.run.smithi179.stdout: "exported_inodes": 10, 2024-01-31T05:14:42.827 INFO:teuthology.orchestra.run.smithi179.stdout: "imported": 47, 2024-01-31T05:14:42.827 INFO:teuthology.orchestra.run.smithi179.stdout: "imported_inodes": 411, 2024-01-31T05:14:42.827 INFO:teuthology.orchestra.run.smithi179.stdout: "openino_dir_fetch": 0, 2024-01-31T05:14:42.827 INFO:teuthology.orchestra.run.smithi179.stdout: "openino_backtrace_fetch": 292, 2024-01-31T05:14:42.827 INFO:teuthology.orchestra.run.smithi179.stdout: "openino_peer_discover": 7, 2024-01-31T05:14:42.827 INFO:teuthology.orchestra.run.smithi179.stdout: "root_rfiles": 1122, 2024-01-31T05:14:42.827 INFO:teuthology.orchestra.run.smithi179.stdout: "root_rbytes": 9415333, 2024-01-31T05:14:42.827 INFO:teuthology.orchestra.run.smithi179.stdout: "root_rsnaps": 0, 2024-01-31T05:14:42.827 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_backtrace_fetch": 292, 2024-01-31T05:14:42.827 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_set_tag": 0, 2024-01-31T05:14:42.827 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_backtrace_repaired": 0, 2024-01-31T05:14:42.827 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_inotable_repaired": 0, 2024-01-31T05:14:42.827 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_dir_inodes": 9, 2024-01-31T05:14:42.828 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_dir_base_inodes": 0, 2024-01-31T05:14:42.828 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_dirfrag_rstats": 9, 2024-01-31T05:14:42.828 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_file_inodes": 283, 2024-01-31T05:14:42.828 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_inode_file_caps": 34, 2024-01-31T05:14:42.828 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_revoke": 332, 2024-01-31T05:14:42.828 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_grant": 800, 2024-01-31T05:14:42.828 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_trunc": 10, 2024-01-31T05:14:42.828 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-01-31T05:14:42.828 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_flush_ack": 0, 2024-01-31T05:14:42.828 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_caps": 492, 2024-01-31T05:14:42.828 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_caps_dirty": 154, 2024-01-31T05:14:42.828 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_cap_release": 49, 2024-01-31T05:14:42.828 INFO:teuthology.orchestra.run.smithi179.stdout: "process_request_cap_release": 883 2024-01-31T05:14:42.828 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.829 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_cache": { 2024-01-31T05:14:42.829 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_update": 0, 2024-01-31T05:14:42.829 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_update_receipt": 0, 2024-01-31T05:14:42.829 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_try_discover": 0, 2024-01-31T05:14:42.829 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_send_discover": 103, 2024-01-31T05:14:42.829 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_handle_discover": 64, 2024-01-31T05:14:42.829 INFO:teuthology.orchestra.run.smithi179.stdout: "num_strays": 27, 2024-01-31T05:14:42.829 INFO:teuthology.orchestra.run.smithi179.stdout: "num_strays_delayed": 0, 2024-01-31T05:14:42.829 INFO:teuthology.orchestra.run.smithi179.stdout: "num_strays_enqueuing": 0, 2024-01-31T05:14:42.829 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_created": 516, 2024-01-31T05:14:42.829 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_enqueued": 486, 2024-01-31T05:14:42.829 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_reintegrated": 8, 2024-01-31T05:14:42.829 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_migrated": 0, 2024-01-31T05:14:42.829 INFO:teuthology.orchestra.run.smithi179.stdout: "num_recovering_processing": 0, 2024-01-31T05:14:42.829 INFO:teuthology.orchestra.run.smithi179.stdout: "num_recovering_enqueued": 0, 2024-01-31T05:14:42.830 INFO:teuthology.orchestra.run.smithi179.stdout: "num_recovering_prioritized": 0, 2024-01-31T05:14:42.830 INFO:teuthology.orchestra.run.smithi179.stdout: "recovery_started": 0, 2024-01-31T05:14:42.830 INFO:teuthology.orchestra.run.smithi179.stdout: "recovery_completed": 0, 2024-01-31T05:14:42.830 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_enqueue_scrub": 0, 2024-01-31T05:14:42.830 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_exportdir": 33, 2024-01-31T05:14:42.830 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_flush": 0, 2024-01-31T05:14:42.830 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_fragmentdir": 0, 2024-01-31T05:14:42.830 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_fragstats": 0, 2024-01-31T05:14:42.830 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_inodestats": 0 2024-01-31T05:14:42.830 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.830 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_log": { 2024-01-31T05:14:42.830 INFO:teuthology.orchestra.run.smithi179.stdout: "evlrg": 0, 2024-01-31T05:14:42.830 INFO:teuthology.orchestra.run.smithi179.stdout: "evadd": 1817, 2024-01-31T05:14:42.830 INFO:teuthology.orchestra.run.smithi179.stdout: "evex": 0, 2024-01-31T05:14:42.831 INFO:teuthology.orchestra.run.smithi179.stdout: "evtrm": 0, 2024-01-31T05:14:42.831 INFO:teuthology.orchestra.run.smithi179.stdout: "ev": 1817, 2024-01-31T05:14:42.831 INFO:teuthology.orchestra.run.smithi179.stdout: "evexg": 0, 2024-01-31T05:14:42.831 INFO:teuthology.orchestra.run.smithi179.stdout: "evexd": 0, 2024-01-31T05:14:42.831 INFO:teuthology.orchestra.run.smithi179.stdout: "segadd": 3, 2024-01-31T05:14:42.831 INFO:teuthology.orchestra.run.smithi179.stdout: "segex": 0, 2024-01-31T05:14:42.831 INFO:teuthology.orchestra.run.smithi179.stdout: "segtrm": 0, 2024-01-31T05:14:42.831 INFO:teuthology.orchestra.run.smithi179.stdout: "seg": 3, 2024-01-31T05:14:42.831 INFO:teuthology.orchestra.run.smithi179.stdout: "segmjr": 2, 2024-01-31T05:14:42.831 INFO:teuthology.orchestra.run.smithi179.stdout: "segexg": 0, 2024-01-31T05:14:42.831 INFO:teuthology.orchestra.run.smithi179.stdout: "segexd": 0, 2024-01-31T05:14:42.831 INFO:teuthology.orchestra.run.smithi179.stdout: "expos": 4194304, 2024-01-31T05:14:42.831 INFO:teuthology.orchestra.run.smithi179.stdout: "wrpos": 8091538, 2024-01-31T05:14:42.831 INFO:teuthology.orchestra.run.smithi179.stdout: "rdpos": 0, 2024-01-31T05:14:42.832 INFO:teuthology.orchestra.run.smithi179.stdout: "jlat": { 2024-01-31T05:14:42.832 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 531, 2024-01-31T05:14:42.832 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 2.025210728, 2024-01-31T05:14:42.832 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.003813956 2024-01-31T05:14:42.832 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.832 INFO:teuthology.orchestra.run.smithi179.stdout: "replayed": 0 2024-01-31T05:14:42.832 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.832 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_mem": { 2024-01-31T05:14:42.832 INFO:teuthology.orchestra.run.smithi179.stdout: "ino": 58, 2024-01-31T05:14:42.832 INFO:teuthology.orchestra.run.smithi179.stdout: "ino+": 665, 2024-01-31T05:14:42.832 INFO:teuthology.orchestra.run.smithi179.stdout: "ino-": 607, 2024-01-31T05:14:42.832 INFO:teuthology.orchestra.run.smithi179.stdout: "dir": 57, 2024-01-31T05:14:42.832 INFO:teuthology.orchestra.run.smithi179.stdout: "dir+": 220, 2024-01-31T05:14:42.833 INFO:teuthology.orchestra.run.smithi179.stdout: "dir-": 163, 2024-01-31T05:14:42.833 INFO:teuthology.orchestra.run.smithi179.stdout: "dn": 95, 2024-01-31T05:14:42.833 INFO:teuthology.orchestra.run.smithi179.stdout: "dn+": 1374, 2024-01-31T05:14:42.833 INFO:teuthology.orchestra.run.smithi179.stdout: "dn-": 1279, 2024-01-31T05:14:42.833 INFO:teuthology.orchestra.run.smithi179.stdout: "cap": 0, 2024-01-31T05:14:42.833 INFO:teuthology.orchestra.run.smithi179.stdout: "cap+": 659, 2024-01-31T05:14:42.833 INFO:teuthology.orchestra.run.smithi179.stdout: "cap-": 659, 2024-01-31T05:14:42.833 INFO:teuthology.orchestra.run.smithi179.stdout: "rss": 67792, 2024-01-31T05:14:42.833 INFO:teuthology.orchestra.run.smithi179.stdout: "heap": 199036 2024-01-31T05:14:42.833 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.833 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_server": { 2024-01-31T05:14:42.833 INFO:teuthology.orchestra.run.smithi179.stdout: "dispatch_client_request": 2180, 2024-01-31T05:14:42.833 INFO:teuthology.orchestra.run.smithi179.stdout: "dispatch_server_request": 191, 2024-01-31T05:14:42.833 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_request": 1194, 2024-01-31T05:14:42.834 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_session": 94, 2024-01-31T05:14:42.834 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_peer_request": 584, 2024-01-31T05:14:42.834 INFO:teuthology.orchestra.run.smithi179.stdout: "req_create_latency": { 2024-01-31T05:14:42.834 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 50, 2024-01-31T05:14:42.834 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.079211632, 2024-01-31T05:14:42.834 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.001584232 2024-01-31T05:14:42.834 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.834 INFO:teuthology.orchestra.run.smithi179.stdout: "req_getattr_latency": { 2024-01-31T05:14:42.834 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 22, 2024-01-31T05:14:42.834 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.074167810, 2024-01-31T05:14:42.834 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.003371264 2024-01-31T05:14:42.834 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.834 INFO:teuthology.orchestra.run.smithi179.stdout: "req_getfilelock_latency": { 2024-01-31T05:14:42.834 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:42.834 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:42.835 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:42.835 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.835 INFO:teuthology.orchestra.run.smithi179.stdout: "req_link_latency": { 2024-01-31T05:14:42.835 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 11, 2024-01-31T05:14:42.835 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.184095298, 2024-01-31T05:14:42.835 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.016735936 2024-01-31T05:14:42.835 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.835 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookup_latency": { 2024-01-31T05:14:42.835 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 333, 2024-01-31T05:14:42.835 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.154181126, 2024-01-31T05:14:42.835 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000463006 2024-01-31T05:14:42.835 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.835 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookuphash_latency": { 2024-01-31T05:14:42.835 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:42.836 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:42.836 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:42.836 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.836 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupino_latency": { 2024-01-31T05:14:42.836 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:42.836 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:42.836 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:42.836 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.836 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupname_latency": { 2024-01-31T05:14:42.836 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:42.836 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:42.836 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:42.836 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.837 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupparent_latency": { 2024-01-31T05:14:42.837 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:42.837 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:42.837 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:42.837 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.837 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupsnap_latency": { 2024-01-31T05:14:42.837 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:42.837 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:42.837 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:42.837 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.837 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lssnap_latency": { 2024-01-31T05:14:42.837 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:42.837 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:42.837 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:42.838 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.838 INFO:teuthology.orchestra.run.smithi179.stdout: "req_mkdir_latency": { 2024-01-31T05:14:42.838 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 27, 2024-01-31T05:14:42.838 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.034138657, 2024-01-31T05:14:42.838 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.001264394 2024-01-31T05:14:42.838 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.839 INFO:teuthology.orchestra.run.smithi179.stdout: "req_mknod_latency": { 2024-01-31T05:14:42.839 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 18, 2024-01-31T05:14:42.839 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.021952627, 2024-01-31T05:14:42.839 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.001219590 2024-01-31T05:14:42.839 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.839 INFO:teuthology.orchestra.run.smithi179.stdout: "req_mksnap_latency": { 2024-01-31T05:14:42.839 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:42.839 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:42.839 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:42.839 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.839 INFO:teuthology.orchestra.run.smithi179.stdout: "req_open_latency": { 2024-01-31T05:14:42.839 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:42.839 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:42.839 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:42.839 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.840 INFO:teuthology.orchestra.run.smithi179.stdout: "req_readdir_latency": { 2024-01-31T05:14:42.840 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 89, 2024-01-31T05:14:42.840 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.078383063, 2024-01-31T05:14:42.840 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000880708 2024-01-31T05:14:42.840 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.840 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rename_latency": { 2024-01-31T05:14:42.840 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 39, 2024-01-31T05:14:42.840 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.897276485, 2024-01-31T05:14:42.840 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.023007089 2024-01-31T05:14:42.840 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.840 INFO:teuthology.orchestra.run.smithi179.stdout: "req_renamesnap_latency": { 2024-01-31T05:14:42.840 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:42.840 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:42.840 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:42.841 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.841 INFO:teuthology.orchestra.run.smithi179.stdout: "req_snapdiff_latency": { 2024-01-31T05:14:42.841 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:42.841 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:42.841 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:42.841 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.841 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rmdir_latency": { 2024-01-31T05:14:42.841 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 71, 2024-01-31T05:14:42.841 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.584874373, 2024-01-31T05:14:42.841 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.008237667 2024-01-31T05:14:42.841 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.841 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rmsnap_latency": { 2024-01-31T05:14:42.841 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:42.841 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:42.841 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:42.841 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.842 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rmxattr_latency": { 2024-01-31T05:14:42.842 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:42.842 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:42.842 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:42.842 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.842 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setattr_latency": { 2024-01-31T05:14:42.842 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 10, 2024-01-31T05:14:42.842 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.010594456, 2024-01-31T05:14:42.842 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.001059445 2024-01-31T05:14:42.842 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.842 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setdirlayout_latency": { 2024-01-31T05:14:42.842 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:42.842 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:42.842 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:42.843 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.843 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setfilelock_latency": { 2024-01-31T05:14:42.843 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:42.843 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:42.843 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:42.843 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.843 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setlayout_latency": { 2024-01-31T05:14:42.843 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:42.843 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:42.843 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:42.843 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.843 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setxattr_latency": { 2024-01-31T05:14:42.843 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:42.843 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:42.843 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:42.844 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.844 INFO:teuthology.orchestra.run.smithi179.stdout: "req_symlink_latency": { 2024-01-31T05:14:42.844 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 21, 2024-01-31T05:14:42.844 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.022112343, 2024-01-31T05:14:42.844 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.001052968 2024-01-31T05:14:42.844 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.844 INFO:teuthology.orchestra.run.smithi179.stdout: "req_unlink_latency": { 2024-01-31T05:14:42.844 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 461, 2024-01-31T05:14:42.844 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.791710967, 2024-01-31T05:14:42.844 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.001717377 2024-01-31T05:14:42.844 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.844 INFO:teuthology.orchestra.run.smithi179.stdout: "cap_revoke_eviction": 0, 2024-01-31T05:14:42.844 INFO:teuthology.orchestra.run.smithi179.stdout: "cap_acquisition_throttle": 0, 2024-01-31T05:14:42.844 INFO:teuthology.orchestra.run.smithi179.stdout: "req_getvxattr_latency": { 2024-01-31T05:14:42.844 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:42.845 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:42.845 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:42.845 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-01-31T05:14:42.845 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.845 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_sessions": { 2024-01-31T05:14:42.845 INFO:teuthology.orchestra.run.smithi179.stdout: "session_count": 1, 2024-01-31T05:14:42.845 INFO:teuthology.orchestra.run.smithi179.stdout: "session_add": 2, 2024-01-31T05:14:42.845 INFO:teuthology.orchestra.run.smithi179.stdout: "session_remove": 1, 2024-01-31T05:14:42.845 INFO:teuthology.orchestra.run.smithi179.stdout: "sessions_open": 1, 2024-01-31T05:14:42.845 INFO:teuthology.orchestra.run.smithi179.stdout: "sessions_stale": 0, 2024-01-31T05:14:42.845 INFO:teuthology.orchestra.run.smithi179.stdout: "total_load": 758, 2024-01-31T05:14:42.845 INFO:teuthology.orchestra.run.smithi179.stdout: "average_load": 758, 2024-01-31T05:14:42.845 INFO:teuthology.orchestra.run.smithi179.stdout: "avg_session_uptime": 105, 2024-01-31T05:14:42.845 INFO:teuthology.orchestra.run.smithi179.stdout: "mdthresh_evicted": 0 2024-01-31T05:14:42.845 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.846 INFO:teuthology.orchestra.run.smithi179.stdout: "mempool": { 2024-01-31T05:14:42.846 INFO:teuthology.orchestra.run.smithi179.stdout: "bloom_filter_bytes": 0, 2024-01-31T05:14:42.846 INFO:teuthology.orchestra.run.smithi179.stdout: "bloom_filter_items": 0, 2024-01-31T05:14:42.846 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_alloc_bytes": 0, 2024-01-31T05:14:42.846 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_alloc_items": 0, 2024-01-31T05:14:42.846 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_data_bytes": 0, 2024-01-31T05:14:42.846 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_data_items": 0, 2024-01-31T05:14:42.846 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_onode_bytes": 0, 2024-01-31T05:14:42.846 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_onode_items": 0, 2024-01-31T05:14:42.846 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_meta_bytes": 0, 2024-01-31T05:14:42.846 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_meta_items": 0, 2024-01-31T05:14:42.846 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_other_bytes": 0, 2024-01-31T05:14:42.846 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_other_items": 0, 2024-01-31T05:14:42.847 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_buffer_bytes": 0, 2024-01-31T05:14:42.847 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_buffer_items": 0, 2024-01-31T05:14:42.847 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_extent_bytes": 0, 2024-01-31T05:14:42.847 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_extent_items": 0, 2024-01-31T05:14:42.847 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_blob_bytes": 0, 2024-01-31T05:14:42.847 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_blob_items": 0, 2024-01-31T05:14:42.847 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_shared_blob_bytes": 0, 2024-01-31T05:14:42.847 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_shared_blob_items": 0, 2024-01-31T05:14:42.847 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_inline_bl_bytes": 0, 2024-01-31T05:14:42.847 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_inline_bl_items": 0, 2024-01-31T05:14:42.847 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_fsck_bytes": 0, 2024-01-31T05:14:42.847 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_fsck_items": 0, 2024-01-31T05:14:42.848 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_txc_bytes": 0, 2024-01-31T05:14:42.848 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_txc_items": 0, 2024-01-31T05:14:42.848 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_deferred_bytes": 0, 2024-01-31T05:14:42.848 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_deferred_items": 0, 2024-01-31T05:14:42.848 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_bytes": 0, 2024-01-31T05:14:42.848 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_items": 0, 2024-01-31T05:14:42.848 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_bytes": 0, 2024-01-31T05:14:42.848 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_items": 0, 2024-01-31T05:14:42.848 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_reader_bytes": 0, 2024-01-31T05:14:42.848 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_reader_items": 0, 2024-01-31T05:14:42.848 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_writer_bytes": 0, 2024-01-31T05:14:42.849 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_writer_items": 0, 2024-01-31T05:14:42.849 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_anon_bytes": 315198, 2024-01-31T05:14:42.849 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_anon_items": 158, 2024-01-31T05:14:42.849 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_meta_bytes": 968, 2024-01-31T05:14:42.849 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_meta_items": 11, 2024-01-31T05:14:42.849 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_bytes": 0, 2024-01-31T05:14:42.849 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_items": 0, 2024-01-31T05:14:42.849 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_mapbl_bytes": 0, 2024-01-31T05:14:42.849 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_mapbl_items": 0, 2024-01-31T05:14:42.849 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_pglog_bytes": 0, 2024-01-31T05:14:42.849 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_pglog_items": 0, 2024-01-31T05:14:42.849 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_bytes": 7240, 2024-01-31T05:14:42.849 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_items": 152, 2024-01-31T05:14:42.849 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_mapping_bytes": 0, 2024-01-31T05:14:42.850 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_mapping_items": 0, 2024-01-31T05:14:42.850 INFO:teuthology.orchestra.run.smithi179.stdout: "pgmap_bytes": 0, 2024-01-31T05:14:42.850 INFO:teuthology.orchestra.run.smithi179.stdout: "pgmap_items": 0, 2024-01-31T05:14:42.850 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_co_bytes": 281363, 2024-01-31T05:14:42.850 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_co_items": 5224, 2024-01-31T05:14:42.850 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_1_bytes": 0, 2024-01-31T05:14:42.850 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_1_items": 0, 2024-01-31T05:14:42.850 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_2_bytes": 0, 2024-01-31T05:14:42.850 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_2_items": 0 2024-01-31T05:14:42.850 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.850 INFO:teuthology.orchestra.run.smithi179.stdout: "objecter": { 2024-01-31T05:14:42.850 INFO:teuthology.orchestra.run.smithi179.stdout: "op_active": 0, 2024-01-31T05:14:42.850 INFO:teuthology.orchestra.run.smithi179.stdout: "op_laggy": 0, 2024-01-31T05:14:42.850 INFO:teuthology.orchestra.run.smithi179.stdout: "op_send": 1631, 2024-01-31T05:14:42.851 INFO:teuthology.orchestra.run.smithi179.stdout: "op_send_bytes": 4006715, 2024-01-31T05:14:42.851 INFO:teuthology.orchestra.run.smithi179.stdout: "op_resend": 27, 2024-01-31T05:14:42.851 INFO:teuthology.orchestra.run.smithi179.stdout: "op_reply": 1631, 2024-01-31T05:14:42.851 INFO:teuthology.orchestra.run.smithi179.stdout: "op_latency": { 2024-01-31T05:14:42.851 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 1631, 2024-01-31T05:14:42.851 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 4.401898671, 2024-01-31T05:14:42.851 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.002698895 2024-01-31T05:14:42.851 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.851 INFO:teuthology.orchestra.run.smithi179.stdout: "op_inflight": 0, 2024-01-31T05:14:42.851 INFO:teuthology.orchestra.run.smithi179.stdout: "oplen_avg": { 2024-01-31T05:14:42.851 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 1631, 2024-01-31T05:14:42.851 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 1680 2024-01-31T05:14:42.851 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.851 INFO:teuthology.orchestra.run.smithi179.stdout: "op": 1631, 2024-01-31T05:14:42.852 INFO:teuthology.orchestra.run.smithi179.stdout: "op_r": 366, 2024-01-31T05:14:42.852 INFO:teuthology.orchestra.run.smithi179.stdout: "op_w": 1265, 2024-01-31T05:14:42.852 INFO:teuthology.orchestra.run.smithi179.stdout: "op_rmw": 0, 2024-01-31T05:14:42.852 INFO:teuthology.orchestra.run.smithi179.stdout: "op_pg": 0, 2024-01-31T05:14:42.852 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_stat": 0, 2024-01-31T05:14:42.852 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_create": 10, 2024-01-31T05:14:42.852 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_read": 72, 2024-01-31T05:14:42.852 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_write": 603, 2024-01-31T05:14:42.852 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_writefull": 49, 2024-01-31T05:14:42.852 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_writesame": 0, 2024-01-31T05:14:42.852 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_append": 0, 2024-01-31T05:14:42.852 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_zero": 0, 2024-01-31T05:14:42.852 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_truncate": 0, 2024-01-31T05:14:42.852 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_delete": 563, 2024-01-31T05:14:42.853 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_mapext": 0, 2024-01-31T05:14:42.853 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_sparse_read": 0, 2024-01-31T05:14:42.853 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_clonerange": 0, 2024-01-31T05:14:42.853 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_getxattr": 294, 2024-01-31T05:14:42.853 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_setxattr": 20, 2024-01-31T05:14:42.853 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_cmpxattr": 0, 2024-01-31T05:14:42.853 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_rmxattr": 0, 2024-01-31T05:14:42.853 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_resetxattrs": 0, 2024-01-31T05:14:42.853 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_call": 0, 2024-01-31T05:14:42.853 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_watch": 0, 2024-01-31T05:14:42.853 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_notify": 0, 2024-01-31T05:14:42.853 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_src_cmpxattr": 0, 2024-01-31T05:14:42.853 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_pgls": 0, 2024-01-31T05:14:42.853 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_pgls_filter": 0, 2024-01-31T05:14:42.853 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_other": 10, 2024-01-31T05:14:42.854 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_active": 0, 2024-01-31T05:14:42.854 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_send": 0, 2024-01-31T05:14:42.854 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_resend": 0, 2024-01-31T05:14:42.854 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_ping": 0, 2024-01-31T05:14:42.854 INFO:teuthology.orchestra.run.smithi179.stdout: "poolop_active": 0, 2024-01-31T05:14:42.854 INFO:teuthology.orchestra.run.smithi179.stdout: "poolop_send": 0, 2024-01-31T05:14:42.854 INFO:teuthology.orchestra.run.smithi179.stdout: "poolop_resend": 0, 2024-01-31T05:14:42.854 INFO:teuthology.orchestra.run.smithi179.stdout: "poolstat_active": 0, 2024-01-31T05:14:42.854 INFO:teuthology.orchestra.run.smithi179.stdout: "poolstat_send": 0, 2024-01-31T05:14:42.854 INFO:teuthology.orchestra.run.smithi179.stdout: "poolstat_resend": 0, 2024-01-31T05:14:42.854 INFO:teuthology.orchestra.run.smithi179.stdout: "statfs_active": 0, 2024-01-31T05:14:42.854 INFO:teuthology.orchestra.run.smithi179.stdout: "statfs_send": 0, 2024-01-31T05:14:42.854 INFO:teuthology.orchestra.run.smithi179.stdout: "statfs_resend": 0, 2024-01-31T05:14:42.855 INFO:teuthology.orchestra.run.smithi179.stdout: "command_active": 0, 2024-01-31T05:14:42.855 INFO:teuthology.orchestra.run.smithi179.stdout: "command_send": 0, 2024-01-31T05:14:42.855 INFO:teuthology.orchestra.run.smithi179.stdout: "command_resend": 0, 2024-01-31T05:14:42.855 INFO:teuthology.orchestra.run.smithi179.stdout: "map_epoch": 88, 2024-01-31T05:14:42.855 INFO:teuthology.orchestra.run.smithi179.stdout: "map_full": 0, 2024-01-31T05:14:42.855 INFO:teuthology.orchestra.run.smithi179.stdout: "map_inc": 2, 2024-01-31T05:14:42.855 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_sessions": 12, 2024-01-31T05:14:42.855 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_session_open": 12, 2024-01-31T05:14:42.855 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_session_close": 0, 2024-01-31T05:14:42.855 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_laggy": 0, 2024-01-31T05:14:42.855 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_wr": 42, 2024-01-31T05:14:42.855 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_rd": 4, 2024-01-31T05:14:42.855 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_del": 13 2024-01-31T05:14:42.855 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.855 INFO:teuthology.orchestra.run.smithi179.stdout: "oft": { 2024-01-31T05:14:42.856 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_objs": 1, 2024-01-31T05:14:42.856 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_kv_pairs": 0, 2024-01-31T05:14:42.856 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_updates": 0, 2024-01-31T05:14:42.856 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_removes": 0 2024-01-31T05:14:42.856 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.856 INFO:teuthology.orchestra.run.smithi179.stdout: "osd-slow-ops": { 2024-01-31T05:14:42.856 INFO:teuthology.orchestra.run.smithi179.stdout: "slow_ops_count": 0 2024-01-31T05:14:42.856 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.856 INFO:teuthology.orchestra.run.smithi179.stdout: "purge_queue": { 2024-01-31T05:14:42.856 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing_ops": 0, 2024-01-31T05:14:42.856 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing_ops_high_water": 10, 2024-01-31T05:14:42.856 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing": 0, 2024-01-31T05:14:42.857 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing_high_water": 6, 2024-01-31T05:14:42.857 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executed_ops": 551, 2024-01-31T05:14:42.857 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executed": 486, 2024-01-31T05:14:42.857 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_item_in_journal": 0 2024-01-31T05:14:42.857 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.857 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-01-31T05:14:42.857 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-01-31T05:14:42.857 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 104857600, 2024-01-31T05:14:42.857 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-01-31T05:14:42.857 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 11851, 2024-01-31T05:14:42.857 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 4067219, 2024-01-31T05:14:42.857 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:42.857 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 11851, 2024-01-31T05:14:42.857 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 0, 2024-01-31T05:14:42.858 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 0, 2024-01-31T05:14:42.858 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 11851, 2024-01-31T05:14:42.858 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 4067219, 2024-01-31T05:14:42.858 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-01-31T05:14:42.858 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:42.858 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:42.858 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:42.858 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-01-31T05:14:42.858 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.858 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-objecter_bytes": { 2024-01-31T05:14:42.858 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-01-31T05:14:42.858 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 104857600, 2024-01-31T05:14:42.858 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-01-31T05:14:42.858 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 0, 2024-01-31T05:14:42.858 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 0, 2024-01-31T05:14:42.859 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:42.859 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 0, 2024-01-31T05:14:42.859 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 1631, 2024-01-31T05:14:42.859 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 4055769, 2024-01-31T05:14:42.859 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 1631, 2024-01-31T05:14:42.859 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 4055769, 2024-01-31T05:14:42.859 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-01-31T05:14:42.859 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:42.859 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:42.859 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:42.859 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-01-31T05:14:42.859 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.859 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-objecter_ops": { 2024-01-31T05:14:42.859 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-01-31T05:14:42.860 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 1024, 2024-01-31T05:14:42.860 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-01-31T05:14:42.860 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 0, 2024-01-31T05:14:42.860 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 0, 2024-01-31T05:14:42.860 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:42.860 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 0, 2024-01-31T05:14:42.860 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 1631, 2024-01-31T05:14:42.860 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 1631, 2024-01-31T05:14:42.860 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 1631, 2024-01-31T05:14:42.860 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 1631, 2024-01-31T05:14:42.860 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-01-31T05:14:42.860 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:42.860 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:42.860 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:42.860 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-01-31T05:14:42.861 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.861 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-write_buf_throttle": { 2024-01-31T05:14:42.861 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-01-31T05:14:42.861 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 3758096384, 2024-01-31T05:14:42.861 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-01-31T05:14:42.861 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 486, 2024-01-31T05:14:42.861 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 49086, 2024-01-31T05:14:42.861 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:42.861 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 486, 2024-01-31T05:14:42.861 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 0, 2024-01-31T05:14:42.861 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 0, 2024-01-31T05:14:42.861 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 72, 2024-01-31T05:14:42.861 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 49086, 2024-01-31T05:14:42.861 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-01-31T05:14:42.862 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:42.862 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:42.862 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:42.862 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-01-31T05:14:42.862 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:42.862 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-write_buf_throttle-0x55dd9ce3a6e0": { 2024-01-31T05:14:42.862 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-01-31T05:14:42.862 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 3758096384, 2024-01-31T05:14:42.862 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-01-31T05:14:42.862 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 1817, 2024-01-31T05:14:42.862 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 3897234, 2024-01-31T05:14:42.862 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:42.862 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 1817, 2024-01-31T05:14:42.862 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 0, 2024-01-31T05:14:42.863 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 0, 2024-01-31T05:14:42.863 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 531, 2024-01-31T05:14:42.863 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 3897234, 2024-01-31T05:14:42.863 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-01-31T05:14:42.863 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:42.863 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:42.863 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:42.863 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-01-31T05:14:42.863 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-01-31T05:14:42.863 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-01-31T05:14:43.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:14:43 smithi099 ceph-mon[31615]: pgmap v449: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 12 op/s 2024-01-31T05:14:43.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:14:43 smithi181 ceph-mon[36434]: pgmap v449: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 12 op/s 2024-01-31T05:14:43.598 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:14:43 smithi179 ceph-mon[35652]: pgmap v449: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 12 op/s 2024-01-31T05:14:43.625 INFO:tasks.check_counter:Daemon mds.h mds.exported=33 2024-01-31T05:14:43.625 INFO:tasks.check_counter:Daemon mds.h mds.imported=47 2024-01-31T05:14:43.625 DEBUG:tasks.check_counter:Getting stats from k 2024-01-31T05:14:43.626 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph daemon mds.k perf dump 2024-01-31T05:14:43.862 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.b/config 2024-01-31T05:14:44.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:14:44 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:14:44.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:14:44 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:14:44.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:14:44 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-31T05:14:45.503 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:14:45 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:14:45.503 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:14:45 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:14:45.503 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:14:45 smithi179 ceph-mon[35652]: pgmap v450: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 426 B/s wr, 11 op/s 2024-01-31T05:14:45.503 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:14:45 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:14:45.543 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-01-31T05:14:45.543 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-0": { 2024-01-31T05:14:45.543 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 135, 2024-01-31T05:14:45.543 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 109, 2024-01-31T05:14:45.543 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 849346, 2024-01-31T05:14:45.543 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 60365, 2024-01-31T05:14:45.543 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 5, 2024-01-31T05:14:45.543 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 1, 2024-01-31T05:14:45.543 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 0.022165491, 2024-01-31T05:14:45.543 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 0.005946500, 2024-01-31T05:14:45.544 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 0.018654508, 2024-01-31T05:14:45.544 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 0.002160626, 2024-01-31T05:14:45.544 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-01-31T05:14:45.548 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 109, 2024-01-31T05:14:45.548 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.010229841, 2024-01-31T05:14:45.548 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000093851 2024-01-31T05:14:45.548 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.548 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-01-31T05:14:45.548 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:45.548 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:45.548 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:45.548 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.549 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 848512, 2024-01-31T05:14:45.549 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 60048 2024-01-31T05:14:45.549 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.549 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-1": { 2024-01-31T05:14:45.549 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 237, 2024-01-31T05:14:45.549 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 311, 2024-01-31T05:14:45.549 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 66062, 2024-01-31T05:14:45.549 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 275097, 2024-01-31T05:14:45.549 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 5, 2024-01-31T05:14:45.549 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 4, 2024-01-31T05:14:45.549 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 0.024711569, 2024-01-31T05:14:45.549 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 0.008917173, 2024-01-31T05:14:45.549 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 0.005737598, 2024-01-31T05:14:45.550 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 0.007265180, 2024-01-31T05:14:45.550 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-01-31T05:14:45.550 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 309, 2024-01-31T05:14:45.550 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.017072171, 2024-01-31T05:14:45.550 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000055249 2024-01-31T05:14:45.550 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.550 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-01-31T05:14:45.550 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:45.550 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:45.550 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:45.550 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.550 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 160, 2024-01-31T05:14:45.551 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 201696 2024-01-31T05:14:45.551 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.551 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-2": { 2024-01-31T05:14:45.551 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 700, 2024-01-31T05:14:45.551 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 702, 2024-01-31T05:14:45.551 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 4400843, 2024-01-31T05:14:45.551 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 217758, 2024-01-31T05:14:45.551 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 4, 2024-01-31T05:14:45.551 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 3, 2024-01-31T05:14:45.551 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 0.063850134, 2024-01-31T05:14:45.551 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 0.022173280, 2024-01-31T05:14:45.551 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 0.017450712, 2024-01-31T05:14:45.552 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 0.018811046, 2024-01-31T05:14:45.552 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-01-31T05:14:45.552 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 700, 2024-01-31T05:14:45.552 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.025462151, 2024-01-31T05:14:45.552 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000036374 2024-01-31T05:14:45.552 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.552 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-01-31T05:14:45.552 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:45.552 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:45.552 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:45.552 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.552 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 0, 2024-01-31T05:14:45.552 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 0 2024-01-31T05:14:45.553 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.553 INFO:teuthology.orchestra.run.smithi179.stdout: "cct": { 2024-01-31T05:14:45.553 INFO:teuthology.orchestra.run.smithi179.stdout: "total_workers": 1, 2024-01-31T05:14:45.553 INFO:teuthology.orchestra.run.smithi179.stdout: "unhealthy_workers": 0 2024-01-31T05:14:45.553 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.553 INFO:teuthology.orchestra.run.smithi179.stdout: "finisher-MDSRank": { 2024-01-31T05:14:45.553 INFO:teuthology.orchestra.run.smithi179.stdout: "queue_len": 0, 2024-01-31T05:14:45.553 INFO:teuthology.orchestra.run.smithi179.stdout: "complete_latency": { 2024-01-31T05:14:45.553 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 1613, 2024-01-31T05:14:45.553 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.040927638, 2024-01-31T05:14:45.553 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000025373 2024-01-31T05:14:45.553 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-01-31T05:14:45.553 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.553 INFO:teuthology.orchestra.run.smithi179.stdout: "finisher-PurgeQueue": { 2024-01-31T05:14:45.554 INFO:teuthology.orchestra.run.smithi179.stdout: "queue_len": 0, 2024-01-31T05:14:45.554 INFO:teuthology.orchestra.run.smithi179.stdout: "complete_latency": { 2024-01-31T05:14:45.554 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:45.554 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:45.554 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:45.554 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-01-31T05:14:45.554 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.554 INFO:teuthology.orchestra.run.smithi179.stdout: "mds": { 2024-01-31T05:14:45.554 INFO:teuthology.orchestra.run.smithi179.stdout: "request": 0, 2024-01-31T05:14:45.554 INFO:teuthology.orchestra.run.smithi179.stdout: "reply": 0, 2024-01-31T05:14:45.554 INFO:teuthology.orchestra.run.smithi179.stdout: "reply_latency": { 2024-01-31T05:14:45.554 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:45.554 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:45.554 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:45.554 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.555 INFO:teuthology.orchestra.run.smithi179.stdout: "slow_reply": 0, 2024-01-31T05:14:45.555 INFO:teuthology.orchestra.run.smithi179.stdout: "forward": 0, 2024-01-31T05:14:45.555 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_fetch_complete": 0, 2024-01-31T05:14:45.555 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_fetch_keys": 0, 2024-01-31T05:14:45.555 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_commit": 0, 2024-01-31T05:14:45.555 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_split": 0, 2024-01-31T05:14:45.555 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_merge": 0, 2024-01-31T05:14:45.555 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes": 584, 2024-01-31T05:14:45.555 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_top": 0, 2024-01-31T05:14:45.555 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_bottom": 584, 2024-01-31T05:14:45.555 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_pin_tail": 0, 2024-01-31T05:14:45.555 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_pinned": 584, 2024-01-31T05:14:45.555 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_expired": 2, 2024-01-31T05:14:45.555 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_with_caps": 0, 2024-01-31T05:14:45.556 INFO:teuthology.orchestra.run.smithi179.stdout: "caps": 0, 2024-01-31T05:14:45.556 INFO:teuthology.orchestra.run.smithi179.stdout: "subtrees": 1, 2024-01-31T05:14:45.556 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse": 0, 2024-01-31T05:14:45.556 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_hit": 0, 2024-01-31T05:14:45.556 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_forward": 0, 2024-01-31T05:14:45.556 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_discover": 0, 2024-01-31T05:14:45.556 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_dir_fetch": 0, 2024-01-31T05:14:45.556 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_remote_ino": 0, 2024-01-31T05:14:45.556 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_lock": 0, 2024-01-31T05:14:45.556 INFO:teuthology.orchestra.run.smithi179.stdout: "load_cent": 0, 2024-01-31T05:14:45.556 INFO:teuthology.orchestra.run.smithi179.stdout: "q": 0, 2024-01-31T05:14:45.556 INFO:teuthology.orchestra.run.smithi179.stdout: "exported": 0, 2024-01-31T05:14:45.556 INFO:teuthology.orchestra.run.smithi179.stdout: "exported_inodes": 0, 2024-01-31T05:14:45.557 INFO:teuthology.orchestra.run.smithi179.stdout: "imported": 0, 2024-01-31T05:14:45.557 INFO:teuthology.orchestra.run.smithi179.stdout: "imported_inodes": 0, 2024-01-31T05:14:45.557 INFO:teuthology.orchestra.run.smithi179.stdout: "openino_dir_fetch": 0, 2024-01-31T05:14:45.557 INFO:teuthology.orchestra.run.smithi179.stdout: "openino_backtrace_fetch": 0, 2024-01-31T05:14:45.557 INFO:teuthology.orchestra.run.smithi179.stdout: "openino_peer_discover": 0, 2024-01-31T05:14:45.557 INFO:teuthology.orchestra.run.smithi179.stdout: "root_rfiles": 0, 2024-01-31T05:14:45.557 INFO:teuthology.orchestra.run.smithi179.stdout: "root_rbytes": 0, 2024-01-31T05:14:45.557 INFO:teuthology.orchestra.run.smithi179.stdout: "root_rsnaps": 0, 2024-01-31T05:14:45.557 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_backtrace_fetch": 0, 2024-01-31T05:14:45.557 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_set_tag": 0, 2024-01-31T05:14:45.557 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_backtrace_repaired": 0, 2024-01-31T05:14:45.557 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_inotable_repaired": 0, 2024-01-31T05:14:45.557 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_dir_inodes": 0, 2024-01-31T05:14:45.558 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_dir_base_inodes": 0, 2024-01-31T05:14:45.558 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_dirfrag_rstats": 0, 2024-01-31T05:14:45.558 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_file_inodes": 0, 2024-01-31T05:14:45.558 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_inode_file_caps": 0, 2024-01-31T05:14:45.558 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_revoke": 0, 2024-01-31T05:14:45.558 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_grant": 0, 2024-01-31T05:14:45.558 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_trunc": 0, 2024-01-31T05:14:45.558 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-01-31T05:14:45.558 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_flush_ack": 0, 2024-01-31T05:14:45.558 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_caps": 0, 2024-01-31T05:14:45.558 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_caps_dirty": 0, 2024-01-31T05:14:45.558 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_cap_release": 0, 2024-01-31T05:14:45.558 INFO:teuthology.orchestra.run.smithi179.stdout: "process_request_cap_release": 0 2024-01-31T05:14:45.558 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.558 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_cache": { 2024-01-31T05:14:45.559 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_update": 0, 2024-01-31T05:14:45.559 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_update_receipt": 0, 2024-01-31T05:14:45.559 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_try_discover": 0, 2024-01-31T05:14:45.559 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_send_discover": 0, 2024-01-31T05:14:45.559 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_handle_discover": 0, 2024-01-31T05:14:45.559 INFO:teuthology.orchestra.run.smithi179.stdout: "num_strays": 0, 2024-01-31T05:14:45.559 INFO:teuthology.orchestra.run.smithi179.stdout: "num_strays_delayed": 0, 2024-01-31T05:14:45.559 INFO:teuthology.orchestra.run.smithi179.stdout: "num_strays_enqueuing": 0, 2024-01-31T05:14:45.559 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_created": 0, 2024-01-31T05:14:45.559 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_enqueued": 0, 2024-01-31T05:14:45.559 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_reintegrated": 0, 2024-01-31T05:14:45.559 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_migrated": 0, 2024-01-31T05:14:45.559 INFO:teuthology.orchestra.run.smithi179.stdout: "num_recovering_processing": 0, 2024-01-31T05:14:45.559 INFO:teuthology.orchestra.run.smithi179.stdout: "num_recovering_enqueued": 0, 2024-01-31T05:14:45.559 INFO:teuthology.orchestra.run.smithi179.stdout: "num_recovering_prioritized": 0, 2024-01-31T05:14:45.560 INFO:teuthology.orchestra.run.smithi179.stdout: "recovery_started": 0, 2024-01-31T05:14:45.560 INFO:teuthology.orchestra.run.smithi179.stdout: "recovery_completed": 0, 2024-01-31T05:14:45.560 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_enqueue_scrub": 0, 2024-01-31T05:14:45.560 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_exportdir": 0, 2024-01-31T05:14:45.560 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_flush": 0, 2024-01-31T05:14:45.560 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_fragmentdir": 0, 2024-01-31T05:14:45.560 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_fragstats": 0, 2024-01-31T05:14:45.560 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_inodestats": 0 2024-01-31T05:14:45.560 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.560 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_log": { 2024-01-31T05:14:45.560 INFO:teuthology.orchestra.run.smithi179.stdout: "evlrg": 0, 2024-01-31T05:14:45.560 INFO:teuthology.orchestra.run.smithi179.stdout: "evadd": 0, 2024-01-31T05:14:45.560 INFO:teuthology.orchestra.run.smithi179.stdout: "evex": 0, 2024-01-31T05:14:45.560 INFO:teuthology.orchestra.run.smithi179.stdout: "evtrm": 0, 2024-01-31T05:14:45.561 INFO:teuthology.orchestra.run.smithi179.stdout: "ev": 2081, 2024-01-31T05:14:45.561 INFO:teuthology.orchestra.run.smithi179.stdout: "evexg": 0, 2024-01-31T05:14:45.561 INFO:teuthology.orchestra.run.smithi179.stdout: "evexd": 0, 2024-01-31T05:14:45.561 INFO:teuthology.orchestra.run.smithi179.stdout: "segadd": 0, 2024-01-31T05:14:45.561 INFO:teuthology.orchestra.run.smithi179.stdout: "segex": 0, 2024-01-31T05:14:45.561 INFO:teuthology.orchestra.run.smithi179.stdout: "segtrm": 0, 2024-01-31T05:14:45.561 INFO:teuthology.orchestra.run.smithi179.stdout: "seg": 5, 2024-01-31T05:14:45.561 INFO:teuthology.orchestra.run.smithi179.stdout: "segmjr": 2, 2024-01-31T05:14:45.561 INFO:teuthology.orchestra.run.smithi179.stdout: "segexg": 0, 2024-01-31T05:14:45.561 INFO:teuthology.orchestra.run.smithi179.stdout: "segexd": 0, 2024-01-31T05:14:45.561 INFO:teuthology.orchestra.run.smithi179.stdout: "expos": 4194304, 2024-01-31T05:14:45.561 INFO:teuthology.orchestra.run.smithi179.stdout: "wrpos": 8396064, 2024-01-31T05:14:45.561 INFO:teuthology.orchestra.run.smithi179.stdout: "rdpos": 8396016, 2024-01-31T05:14:45.561 INFO:teuthology.orchestra.run.smithi179.stdout: "jlat": { 2024-01-31T05:14:45.561 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:45.562 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:45.562 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:45.562 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.562 INFO:teuthology.orchestra.run.smithi179.stdout: "replayed": 2081 2024-01-31T05:14:45.562 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.562 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_mem": { 2024-01-31T05:14:45.562 INFO:teuthology.orchestra.run.smithi179.stdout: "ino": 15, 2024-01-31T05:14:45.562 INFO:teuthology.orchestra.run.smithi179.stdout: "ino+": 704, 2024-01-31T05:14:45.562 INFO:teuthology.orchestra.run.smithi179.stdout: "ino-": 689, 2024-01-31T05:14:45.562 INFO:teuthology.orchestra.run.smithi179.stdout: "dir": 13, 2024-01-31T05:14:45.562 INFO:teuthology.orchestra.run.smithi179.stdout: "dir+": 219, 2024-01-31T05:14:45.562 INFO:teuthology.orchestra.run.smithi179.stdout: "dir-": 206, 2024-01-31T05:14:45.562 INFO:teuthology.orchestra.run.smithi179.stdout: "dn": 584, 2024-01-31T05:14:45.562 INFO:teuthology.orchestra.run.smithi179.stdout: "dn+": 1276, 2024-01-31T05:14:45.562 INFO:teuthology.orchestra.run.smithi179.stdout: "dn-": 692, 2024-01-31T05:14:45.563 INFO:teuthology.orchestra.run.smithi179.stdout: "cap": 0, 2024-01-31T05:14:45.563 INFO:teuthology.orchestra.run.smithi179.stdout: "cap+": 0, 2024-01-31T05:14:45.563 INFO:teuthology.orchestra.run.smithi179.stdout: "cap-": 0, 2024-01-31T05:14:45.563 INFO:teuthology.orchestra.run.smithi179.stdout: "rss": 49156, 2024-01-31T05:14:45.563 INFO:teuthology.orchestra.run.smithi179.stdout: "heap": 207228 2024-01-31T05:14:45.563 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.563 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_server": { 2024-01-31T05:14:45.563 INFO:teuthology.orchestra.run.smithi179.stdout: "dispatch_client_request": 0, 2024-01-31T05:14:45.563 INFO:teuthology.orchestra.run.smithi179.stdout: "dispatch_server_request": 0, 2024-01-31T05:14:45.563 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_request": 0, 2024-01-31T05:14:45.563 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_session": 0, 2024-01-31T05:14:45.563 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_peer_request": 0, 2024-01-31T05:14:45.563 INFO:teuthology.orchestra.run.smithi179.stdout: "req_create_latency": { 2024-01-31T05:14:45.563 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:45.563 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:45.564 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:45.564 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.564 INFO:teuthology.orchestra.run.smithi179.stdout: "req_getattr_latency": { 2024-01-31T05:14:45.564 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:45.564 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:45.564 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:45.564 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.564 INFO:teuthology.orchestra.run.smithi179.stdout: "req_getfilelock_latency": { 2024-01-31T05:14:45.564 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:45.564 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:45.564 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:45.564 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.564 INFO:teuthology.orchestra.run.smithi179.stdout: "req_link_latency": { 2024-01-31T05:14:45.564 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:45.565 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:45.565 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:45.565 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.565 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookup_latency": { 2024-01-31T05:14:45.565 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:45.565 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:45.565 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:45.565 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.565 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookuphash_latency": { 2024-01-31T05:14:45.565 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:45.565 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:45.565 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:45.565 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.565 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupino_latency": { 2024-01-31T05:14:45.565 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:45.566 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:45.566 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:45.566 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.566 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupname_latency": { 2024-01-31T05:14:45.566 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:45.566 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:45.566 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:45.566 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.566 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupparent_latency": { 2024-01-31T05:14:45.566 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:45.566 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:45.566 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:45.566 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.566 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupsnap_latency": { 2024-01-31T05:14:45.566 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:45.567 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:45.567 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:45.567 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.567 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lssnap_latency": { 2024-01-31T05:14:45.567 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:45.567 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:45.567 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:45.567 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.567 INFO:teuthology.orchestra.run.smithi179.stdout: "req_mkdir_latency": { 2024-01-31T05:14:45.567 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:45.567 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:45.568 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:45.568 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.568 INFO:teuthology.orchestra.run.smithi179.stdout: "req_mknod_latency": { 2024-01-31T05:14:45.568 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:45.568 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:45.568 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:45.568 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.568 INFO:teuthology.orchestra.run.smithi179.stdout: "req_mksnap_latency": { 2024-01-31T05:14:45.569 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:45.569 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:45.569 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:45.569 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.569 INFO:teuthology.orchestra.run.smithi179.stdout: "req_open_latency": { 2024-01-31T05:14:45.569 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:45.569 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:45.569 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:45.569 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.569 INFO:teuthology.orchestra.run.smithi179.stdout: "req_readdir_latency": { 2024-01-31T05:14:45.569 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:45.569 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:45.569 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:45.569 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.570 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rename_latency": { 2024-01-31T05:14:45.570 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:45.570 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:45.570 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:45.570 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.570 INFO:teuthology.orchestra.run.smithi179.stdout: "req_renamesnap_latency": { 2024-01-31T05:14:45.570 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:45.570 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:45.570 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:45.570 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.570 INFO:teuthology.orchestra.run.smithi179.stdout: "req_snapdiff_latency": { 2024-01-31T05:14:45.570 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:45.570 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:45.570 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:45.570 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.571 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rmdir_latency": { 2024-01-31T05:14:45.571 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:45.571 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:45.571 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:45.571 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.571 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rmsnap_latency": { 2024-01-31T05:14:45.571 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:45.571 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:45.571 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:45.571 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.571 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rmxattr_latency": { 2024-01-31T05:14:45.571 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:45.571 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:45.571 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:45.572 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.572 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setattr_latency": { 2024-01-31T05:14:45.572 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:45.572 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:45.572 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:45.572 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.572 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setdirlayout_latency": { 2024-01-31T05:14:45.572 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:45.572 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:45.572 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:45.572 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.572 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setfilelock_latency": { 2024-01-31T05:14:45.572 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:45.573 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:45.573 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:45.573 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.573 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setlayout_latency": { 2024-01-31T05:14:45.573 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:45.573 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:45.573 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:45.573 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.573 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setxattr_latency": { 2024-01-31T05:14:45.573 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:45.573 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:45.573 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:45.573 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.574 INFO:teuthology.orchestra.run.smithi179.stdout: "req_symlink_latency": { 2024-01-31T05:14:45.574 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:45.574 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:45.574 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:45.574 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.574 INFO:teuthology.orchestra.run.smithi179.stdout: "req_unlink_latency": { 2024-01-31T05:14:45.574 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:45.574 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:45.574 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:45.574 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.574 INFO:teuthology.orchestra.run.smithi179.stdout: "cap_revoke_eviction": 0, 2024-01-31T05:14:45.574 INFO:teuthology.orchestra.run.smithi179.stdout: "cap_acquisition_throttle": 0, 2024-01-31T05:14:45.574 INFO:teuthology.orchestra.run.smithi179.stdout: "req_getvxattr_latency": { 2024-01-31T05:14:45.574 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:45.574 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:45.574 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:45.575 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-01-31T05:14:45.575 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.575 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_sessions": { 2024-01-31T05:14:45.575 INFO:teuthology.orchestra.run.smithi179.stdout: "session_count": 1, 2024-01-31T05:14:45.575 INFO:teuthology.orchestra.run.smithi179.stdout: "session_add": 2, 2024-01-31T05:14:45.575 INFO:teuthology.orchestra.run.smithi179.stdout: "session_remove": 1, 2024-01-31T05:14:45.575 INFO:teuthology.orchestra.run.smithi179.stdout: "sessions_open": 1, 2024-01-31T05:14:45.575 INFO:teuthology.orchestra.run.smithi179.stdout: "sessions_stale": 0, 2024-01-31T05:14:45.575 INFO:teuthology.orchestra.run.smithi179.stdout: "total_load": 0, 2024-01-31T05:14:45.575 INFO:teuthology.orchestra.run.smithi179.stdout: "average_load": 0, 2024-01-31T05:14:45.575 INFO:teuthology.orchestra.run.smithi179.stdout: "avg_session_uptime": 1794, 2024-01-31T05:14:45.575 INFO:teuthology.orchestra.run.smithi179.stdout: "mdthresh_evicted": 0 2024-01-31T05:14:45.575 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.575 INFO:teuthology.orchestra.run.smithi179.stdout: "mempool": { 2024-01-31T05:14:45.575 INFO:teuthology.orchestra.run.smithi179.stdout: "bloom_filter_bytes": 0, 2024-01-31T05:14:45.575 INFO:teuthology.orchestra.run.smithi179.stdout: "bloom_filter_items": 0, 2024-01-31T05:14:45.576 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_alloc_bytes": 0, 2024-01-31T05:14:45.576 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_alloc_items": 0, 2024-01-31T05:14:45.576 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_data_bytes": 0, 2024-01-31T05:14:45.576 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_data_items": 0, 2024-01-31T05:14:45.576 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_onode_bytes": 0, 2024-01-31T05:14:45.576 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_onode_items": 0, 2024-01-31T05:14:45.576 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_meta_bytes": 0, 2024-01-31T05:14:45.576 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_meta_items": 0, 2024-01-31T05:14:45.576 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_other_bytes": 0, 2024-01-31T05:14:45.576 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_other_items": 0, 2024-01-31T05:14:45.576 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_buffer_bytes": 0, 2024-01-31T05:14:45.576 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_buffer_items": 0, 2024-01-31T05:14:45.576 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_extent_bytes": 0, 2024-01-31T05:14:45.576 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_extent_items": 0, 2024-01-31T05:14:45.576 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_blob_bytes": 0, 2024-01-31T05:14:45.577 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_blob_items": 0, 2024-01-31T05:14:45.577 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_shared_blob_bytes": 0, 2024-01-31T05:14:45.577 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_shared_blob_items": 0, 2024-01-31T05:14:45.577 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_inline_bl_bytes": 0, 2024-01-31T05:14:45.577 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_inline_bl_items": 0, 2024-01-31T05:14:45.577 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_fsck_bytes": 0, 2024-01-31T05:14:45.577 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_fsck_items": 0, 2024-01-31T05:14:45.577 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_txc_bytes": 0, 2024-01-31T05:14:45.577 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_txc_items": 0, 2024-01-31T05:14:45.577 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_deferred_bytes": 0, 2024-01-31T05:14:45.577 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_deferred_items": 0, 2024-01-31T05:14:45.577 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_bytes": 0, 2024-01-31T05:14:45.577 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_items": 0, 2024-01-31T05:14:45.578 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_bytes": 0, 2024-01-31T05:14:45.578 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_items": 0, 2024-01-31T05:14:45.578 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_reader_bytes": 0, 2024-01-31T05:14:45.578 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_reader_items": 0, 2024-01-31T05:14:45.578 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_writer_bytes": 0, 2024-01-31T05:14:45.578 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_writer_items": 0, 2024-01-31T05:14:45.578 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_anon_bytes": 189552, 2024-01-31T05:14:45.578 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_anon_items": 57, 2024-01-31T05:14:45.578 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_meta_bytes": 0, 2024-01-31T05:14:45.578 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_meta_items": 0, 2024-01-31T05:14:45.578 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_bytes": 0, 2024-01-31T05:14:45.578 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_items": 0, 2024-01-31T05:14:45.578 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_mapbl_bytes": 0, 2024-01-31T05:14:45.578 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_mapbl_items": 0, 2024-01-31T05:14:45.578 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_pglog_bytes": 0, 2024-01-31T05:14:45.579 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_pglog_items": 0, 2024-01-31T05:14:45.579 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_bytes": 7240, 2024-01-31T05:14:45.579 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_items": 152, 2024-01-31T05:14:45.579 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_mapping_bytes": 0, 2024-01-31T05:14:45.579 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_mapping_items": 0, 2024-01-31T05:14:45.579 INFO:teuthology.orchestra.run.smithi179.stdout: "pgmap_bytes": 0, 2024-01-31T05:14:45.579 INFO:teuthology.orchestra.run.smithi179.stdout: "pgmap_items": 0, 2024-01-31T05:14:45.579 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_co_bytes": 463279, 2024-01-31T05:14:45.579 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_co_items": 3532, 2024-01-31T05:14:45.579 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_1_bytes": 0, 2024-01-31T05:14:45.579 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_1_items": 0, 2024-01-31T05:14:45.579 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_2_bytes": 0, 2024-01-31T05:14:45.579 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_2_items": 0 2024-01-31T05:14:45.579 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.580 INFO:teuthology.orchestra.run.smithi179.stdout: "objecter": { 2024-01-31T05:14:45.580 INFO:teuthology.orchestra.run.smithi179.stdout: "op_active": 0, 2024-01-31T05:14:45.580 INFO:teuthology.orchestra.run.smithi179.stdout: "op_laggy": 0, 2024-01-31T05:14:45.580 INFO:teuthology.orchestra.run.smithi179.stdout: "op_send": 937, 2024-01-31T05:14:45.580 INFO:teuthology.orchestra.run.smithi179.stdout: "op_send_bytes": 21, 2024-01-31T05:14:45.580 INFO:teuthology.orchestra.run.smithi179.stdout: "op_resend": 3, 2024-01-31T05:14:45.580 INFO:teuthology.orchestra.run.smithi179.stdout: "op_reply": 937, 2024-01-31T05:14:45.580 INFO:teuthology.orchestra.run.smithi179.stdout: "op_latency": { 2024-01-31T05:14:45.580 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 937, 2024-01-31T05:14:45.580 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 1.535964659, 2024-01-31T05:14:45.580 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.001639236 2024-01-31T05:14:45.580 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.580 INFO:teuthology.orchestra.run.smithi179.stdout: "op_inflight": 0, 2024-01-31T05:14:45.580 INFO:teuthology.orchestra.run.smithi179.stdout: "oplen_avg": { 2024-01-31T05:14:45.580 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 937, 2024-01-31T05:14:45.581 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 938 2024-01-31T05:14:45.581 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.581 INFO:teuthology.orchestra.run.smithi179.stdout: "op": 937, 2024-01-31T05:14:45.581 INFO:teuthology.orchestra.run.smithi179.stdout: "op_r": 937, 2024-01-31T05:14:45.581 INFO:teuthology.orchestra.run.smithi179.stdout: "op_w": 0, 2024-01-31T05:14:45.581 INFO:teuthology.orchestra.run.smithi179.stdout: "op_rmw": 0, 2024-01-31T05:14:45.581 INFO:teuthology.orchestra.run.smithi179.stdout: "op_pg": 0, 2024-01-31T05:14:45.581 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_stat": 550, 2024-01-31T05:14:45.581 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_create": 0, 2024-01-31T05:14:45.581 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_read": 385, 2024-01-31T05:14:45.581 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_write": 0, 2024-01-31T05:14:45.581 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_writefull": 0, 2024-01-31T05:14:45.581 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_writesame": 0, 2024-01-31T05:14:45.581 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_append": 0, 2024-01-31T05:14:45.582 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_zero": 0, 2024-01-31T05:14:45.582 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_truncate": 0, 2024-01-31T05:14:45.582 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_delete": 0, 2024-01-31T05:14:45.582 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_mapext": 0, 2024-01-31T05:14:45.582 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_sparse_read": 0, 2024-01-31T05:14:45.582 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_clonerange": 0, 2024-01-31T05:14:45.582 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_getxattr": 1, 2024-01-31T05:14:45.582 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_setxattr": 0, 2024-01-31T05:14:45.582 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_cmpxattr": 0, 2024-01-31T05:14:45.582 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_rmxattr": 0, 2024-01-31T05:14:45.582 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_resetxattrs": 0, 2024-01-31T05:14:45.582 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_call": 0, 2024-01-31T05:14:45.582 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_watch": 0, 2024-01-31T05:14:45.582 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_notify": 0, 2024-01-31T05:14:45.582 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_src_cmpxattr": 0, 2024-01-31T05:14:45.583 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_pgls": 0, 2024-01-31T05:14:45.583 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_pgls_filter": 0, 2024-01-31T05:14:45.583 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_other": 0, 2024-01-31T05:14:45.583 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_active": 0, 2024-01-31T05:14:45.583 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_send": 0, 2024-01-31T05:14:45.583 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_resend": 0, 2024-01-31T05:14:45.583 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_ping": 0, 2024-01-31T05:14:45.583 INFO:teuthology.orchestra.run.smithi179.stdout: "poolop_active": 0, 2024-01-31T05:14:45.583 INFO:teuthology.orchestra.run.smithi179.stdout: "poolop_send": 0, 2024-01-31T05:14:45.583 INFO:teuthology.orchestra.run.smithi179.stdout: "poolop_resend": 0, 2024-01-31T05:14:45.583 INFO:teuthology.orchestra.run.smithi179.stdout: "poolstat_active": 0, 2024-01-31T05:14:45.583 INFO:teuthology.orchestra.run.smithi179.stdout: "poolstat_send": 0, 2024-01-31T05:14:45.583 INFO:teuthology.orchestra.run.smithi179.stdout: "poolstat_resend": 0, 2024-01-31T05:14:45.583 INFO:teuthology.orchestra.run.smithi179.stdout: "statfs_active": 0, 2024-01-31T05:14:45.584 INFO:teuthology.orchestra.run.smithi179.stdout: "statfs_send": 0, 2024-01-31T05:14:45.584 INFO:teuthology.orchestra.run.smithi179.stdout: "statfs_resend": 0, 2024-01-31T05:14:45.584 INFO:teuthology.orchestra.run.smithi179.stdout: "command_active": 0, 2024-01-31T05:14:45.584 INFO:teuthology.orchestra.run.smithi179.stdout: "command_send": 0, 2024-01-31T05:14:45.584 INFO:teuthology.orchestra.run.smithi179.stdout: "command_resend": 0, 2024-01-31T05:14:45.584 INFO:teuthology.orchestra.run.smithi179.stdout: "map_epoch": 88, 2024-01-31T05:14:45.584 INFO:teuthology.orchestra.run.smithi179.stdout: "map_full": 0, 2024-01-31T05:14:45.584 INFO:teuthology.orchestra.run.smithi179.stdout: "map_inc": 2, 2024-01-31T05:14:45.584 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_sessions": 5, 2024-01-31T05:14:45.584 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_session_open": 5, 2024-01-31T05:14:45.584 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_session_close": 0, 2024-01-31T05:14:45.584 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_laggy": 0, 2024-01-31T05:14:45.584 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_wr": 0, 2024-01-31T05:14:45.584 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_rd": 2, 2024-01-31T05:14:45.585 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_del": 0 2024-01-31T05:14:45.585 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.585 INFO:teuthology.orchestra.run.smithi179.stdout: "oft": { 2024-01-31T05:14:45.585 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_objs": 0, 2024-01-31T05:14:45.585 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_kv_pairs": 0, 2024-01-31T05:14:45.585 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_updates": 0, 2024-01-31T05:14:45.585 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_removes": 0 2024-01-31T05:14:45.585 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.585 INFO:teuthology.orchestra.run.smithi179.stdout: "osd-slow-ops": { 2024-01-31T05:14:45.585 INFO:teuthology.orchestra.run.smithi179.stdout: "slow_ops_count": 0 2024-01-31T05:14:45.585 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.585 INFO:teuthology.orchestra.run.smithi179.stdout: "purge_queue": { 2024-01-31T05:14:45.585 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing_ops": 0, 2024-01-31T05:14:45.585 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing_ops_high_water": 0, 2024-01-31T05:14:45.586 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing": 0, 2024-01-31T05:14:45.586 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing_high_water": 0, 2024-01-31T05:14:45.586 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executed_ops": 0, 2024-01-31T05:14:45.586 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executed": 0, 2024-01-31T05:14:45.586 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_item_in_journal": 0 2024-01-31T05:14:45.586 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.586 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-01-31T05:14:45.586 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-01-31T05:14:45.586 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 104857600, 2024-01-31T05:14:45.586 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-01-31T05:14:45.586 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 1068, 2024-01-31T05:14:45.586 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 5210574, 2024-01-31T05:14:45.586 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:45.586 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 1068, 2024-01-31T05:14:45.586 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 0, 2024-01-31T05:14:45.587 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 0, 2024-01-31T05:14:45.587 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 1068, 2024-01-31T05:14:45.587 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 5210574, 2024-01-31T05:14:45.587 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-01-31T05:14:45.587 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:45.587 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:45.587 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:45.587 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-01-31T05:14:45.587 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.587 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-objecter_bytes": { 2024-01-31T05:14:45.587 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-01-31T05:14:45.587 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 104857600, 2024-01-31T05:14:45.587 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-01-31T05:14:45.587 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 0, 2024-01-31T05:14:45.587 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 0, 2024-01-31T05:14:45.588 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:45.588 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 0, 2024-01-31T05:14:45.588 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 937, 2024-01-31T05:14:45.588 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 4202403, 2024-01-31T05:14:45.588 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 937, 2024-01-31T05:14:45.588 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 4202403, 2024-01-31T05:14:45.588 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-01-31T05:14:45.588 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:45.588 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:45.588 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:45.588 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-01-31T05:14:45.588 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.588 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-objecter_ops": { 2024-01-31T05:14:45.589 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-01-31T05:14:45.589 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 1024, 2024-01-31T05:14:45.589 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-01-31T05:14:45.589 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 0, 2024-01-31T05:14:45.589 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 0, 2024-01-31T05:14:45.589 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:45.589 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 0, 2024-01-31T05:14:45.589 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 937, 2024-01-31T05:14:45.589 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 937, 2024-01-31T05:14:45.589 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 937, 2024-01-31T05:14:45.589 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 937, 2024-01-31T05:14:45.589 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-01-31T05:14:45.589 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:45.589 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:45.589 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:45.590 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-01-31T05:14:45.590 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.590 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-write_buf_throttle": { 2024-01-31T05:14:45.590 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-01-31T05:14:45.590 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 3758096384, 2024-01-31T05:14:45.590 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-01-31T05:14:45.590 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 0, 2024-01-31T05:14:45.590 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 0, 2024-01-31T05:14:45.590 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:45.590 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 0, 2024-01-31T05:14:45.590 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 0, 2024-01-31T05:14:45.590 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 0, 2024-01-31T05:14:45.590 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 0, 2024-01-31T05:14:45.590 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 0, 2024-01-31T05:14:45.591 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-01-31T05:14:45.591 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:45.591 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:45.591 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:45.591 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-01-31T05:14:45.591 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-01-31T05:14:45.591 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-write_buf_throttle-0x55e11cbac960": { 2024-01-31T05:14:45.591 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-01-31T05:14:45.591 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 3758096384, 2024-01-31T05:14:45.591 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-01-31T05:14:45.591 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 0, 2024-01-31T05:14:45.591 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 0, 2024-01-31T05:14:45.591 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:45.592 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 0, 2024-01-31T05:14:45.592 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 0, 2024-01-31T05:14:45.592 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 0, 2024-01-31T05:14:45.592 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 0, 2024-01-31T05:14:45.592 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 0, 2024-01-31T05:14:45.592 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-01-31T05:14:45.593 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-01-31T05:14:45.593 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-01-31T05:14:45.593 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-01-31T05:14:45.593 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-01-31T05:14:45.593 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-01-31T05:14:45.593 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-01-31T05:14:45.594 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:14:45 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:14:45.594 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:14:45 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:14:45.594 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:14:45 smithi181 ceph-mon[36434]: pgmap v450: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 426 B/s wr, 11 op/s 2024-01-31T05:14:45.594 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:14:45 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:14:45.594 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:14:45 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-31T05:14:45.594 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:14:45 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-31T05:14:45.594 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:14:45 smithi099 ceph-mon[31615]: pgmap v450: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 426 B/s wr, 11 op/s 2024-01-31T05:14:45.594 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:14:45 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' 2024-01-31T05:14:46.340 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-01-31T05:14:46.341 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-01-31T05:14:46.341 DEBUG:tasks.check_counter:Getting stats from c 2024-01-31T05:14:46.341 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph daemon mds.c perf dump 2024-01-31T05:14:46.588 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.c/config 2024-01-31T05:14:47.960 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:14:47 smithi181 ceph-mon[36434]: pgmap v451: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 426 B/s wr, 11 op/s 2024-01-31T05:14:48.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:14:47 smithi099 ceph-mon[31615]: pgmap v451: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 426 B/s wr, 11 op/s 2024-01-31T05:14:48.097 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:14:47 smithi179 ceph-mon[35652]: pgmap v451: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 426 B/s wr, 11 op/s 2024-01-31T05:14:48.244 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-01-31T05:14:48.244 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-0": { 2024-01-31T05:14:48.244 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 11070, 2024-01-31T05:14:48.244 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 8674, 2024-01-31T05:14:48.245 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 5256545, 2024-01-31T05:14:48.245 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 6943966, 2024-01-31T05:14:48.245 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 9, 2024-01-31T05:14:48.245 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 4, 2024-01-31T05:14:48.245 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.587914531, 2024-01-31T05:14:48.245 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.224909942, 2024-01-31T05:14:48.245 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.425802234, 2024-01-31T05:14:48.245 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.036949262, 2024-01-31T05:14:48.245 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-01-31T05:14:48.245 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 8676, 2024-01-31T05:14:48.245 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.189743634, 2024-01-31T05:14:48.245 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000021869 2024-01-31T05:14:48.245 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.245 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-01-31T05:14:48.246 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 16869, 2024-01-31T05:14:48.246 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.002479447, 2024-01-31T05:14:48.246 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000146 2024-01-31T05:14:48.246 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.246 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 856912, 2024-01-31T05:14:48.246 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 238672 2024-01-31T05:14:48.246 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.246 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-1": { 2024-01-31T05:14:48.246 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 1927, 2024-01-31T05:14:48.246 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 2217, 2024-01-31T05:14:48.246 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 682039, 2024-01-31T05:14:48.246 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 4320964, 2024-01-31T05:14:48.246 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 11, 2024-01-31T05:14:48.246 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 7, 2024-01-31T05:14:48.246 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.152017982, 2024-01-31T05:14:48.247 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.069428376, 2024-01-31T05:14:48.247 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.057735360, 2024-01-31T05:14:48.247 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.025264127, 2024-01-31T05:14:48.247 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-01-31T05:14:48.247 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 2215, 2024-01-31T05:14:48.247 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.067653184, 2024-01-31T05:14:48.247 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000030543 2024-01-31T05:14:48.247 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.247 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-01-31T05:14:48.247 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 2011, 2024-01-31T05:14:48.247 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000303401, 2024-01-31T05:14:48.247 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000150 2024-01-31T05:14:48.247 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.247 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 160, 2024-01-31T05:14:48.248 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 203008 2024-01-31T05:14:48.248 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.248 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-2": { 2024-01-31T05:14:48.248 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 4310, 2024-01-31T05:14:48.248 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 7349, 2024-01-31T05:14:48.248 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 1583107, 2024-01-31T05:14:48.248 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 4307559, 2024-01-31T05:14:48.248 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 20, 2024-01-31T05:14:48.248 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 8, 2024-01-31T05:14:48.248 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.312638681, 2024-01-31T05:14:48.248 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.141751769, 2024-01-31T05:14:48.248 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.210075247, 2024-01-31T05:14:48.248 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.017224344, 2024-01-31T05:14:48.248 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-01-31T05:14:48.249 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 7345, 2024-01-31T05:14:48.249 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.158789031, 2024-01-31T05:14:48.249 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000021618 2024-01-31T05:14:48.249 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.249 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-01-31T05:14:48.249 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 8754, 2024-01-31T05:14:48.249 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.001259317, 2024-01-31T05:14:48.249 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000143 2024-01-31T05:14:48.249 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.249 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 1214320, 2024-01-31T05:14:48.249 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 3706656 2024-01-31T05:14:48.249 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.249 INFO:teuthology.orchestra.run.smithi181.stdout: "cct": { 2024-01-31T05:14:48.249 INFO:teuthology.orchestra.run.smithi181.stdout: "total_workers": 1, 2024-01-31T05:14:48.250 INFO:teuthology.orchestra.run.smithi181.stdout: "unhealthy_workers": 0 2024-01-31T05:14:48.250 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.250 INFO:teuthology.orchestra.run.smithi181.stdout: "finisher-MDSRank": { 2024-01-31T05:14:48.250 INFO:teuthology.orchestra.run.smithi181.stdout: "queue_len": 0, 2024-01-31T05:14:48.250 INFO:teuthology.orchestra.run.smithi181.stdout: "complete_latency": { 2024-01-31T05:14:48.250 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 2146, 2024-01-31T05:14:48.250 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 1.388148247, 2024-01-31T05:14:48.250 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000646853 2024-01-31T05:14:48.250 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-01-31T05:14:48.250 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.250 INFO:teuthology.orchestra.run.smithi181.stdout: "finisher-PurgeQueue": { 2024-01-31T05:14:48.250 INFO:teuthology.orchestra.run.smithi181.stdout: "queue_len": 0, 2024-01-31T05:14:48.250 INFO:teuthology.orchestra.run.smithi181.stdout: "complete_latency": { 2024-01-31T05:14:48.250 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 1976, 2024-01-31T05:14:48.250 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.228376520, 2024-01-31T05:14:48.251 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000115575 2024-01-31T05:14:48.251 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-01-31T05:14:48.251 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.251 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": { 2024-01-31T05:14:48.251 INFO:teuthology.orchestra.run.smithi181.stdout: "request": 1940, 2024-01-31T05:14:48.251 INFO:teuthology.orchestra.run.smithi181.stdout: "reply": 1892, 2024-01-31T05:14:48.251 INFO:teuthology.orchestra.run.smithi181.stdout: "reply_latency": { 2024-01-31T05:14:48.251 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 1892, 2024-01-31T05:14:48.251 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 7.594494870, 2024-01-31T05:14:48.251 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.004014003 2024-01-31T05:14:48.251 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.251 INFO:teuthology.orchestra.run.smithi181.stdout: "slow_reply": 0, 2024-01-31T05:14:48.251 INFO:teuthology.orchestra.run.smithi181.stdout: "forward": 48, 2024-01-31T05:14:48.251 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_fetch_complete": 0, 2024-01-31T05:14:48.252 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_fetch_keys": 0, 2024-01-31T05:14:48.252 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_commit": 11, 2024-01-31T05:14:48.252 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_split": 0, 2024-01-31T05:14:48.252 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_merge": 0, 2024-01-31T05:14:48.252 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes": 64, 2024-01-31T05:14:48.252 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_top": 25, 2024-01-31T05:14:48.252 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_bottom": 16, 2024-01-31T05:14:48.252 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_pin_tail": 23, 2024-01-31T05:14:48.252 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_pinned": 26, 2024-01-31T05:14:48.252 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_expired": 410, 2024-01-31T05:14:48.252 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_with_caps": 1, 2024-01-31T05:14:48.252 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": 1, 2024-01-31T05:14:48.252 INFO:teuthology.orchestra.run.smithi181.stdout: "subtrees": 6, 2024-01-31T05:14:48.252 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse": 3501, 2024-01-31T05:14:48.253 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_hit": 2925, 2024-01-31T05:14:48.253 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_forward": 38, 2024-01-31T05:14:48.253 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_discover": 175, 2024-01-31T05:14:48.253 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_dir_fetch": 0, 2024-01-31T05:14:48.253 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_remote_ino": 5, 2024-01-31T05:14:48.253 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_lock": 1, 2024-01-31T05:14:48.253 INFO:teuthology.orchestra.run.smithi181.stdout: "load_cent": 0, 2024-01-31T05:14:48.253 INFO:teuthology.orchestra.run.smithi181.stdout: "q": 0, 2024-01-31T05:14:48.253 INFO:teuthology.orchestra.run.smithi181.stdout: "exported": 40, 2024-01-31T05:14:48.253 INFO:teuthology.orchestra.run.smithi181.stdout: "exported_inodes": 25, 2024-01-31T05:14:48.253 INFO:teuthology.orchestra.run.smithi181.stdout: "imported": 105, 2024-01-31T05:14:48.253 INFO:teuthology.orchestra.run.smithi181.stdout: "imported_inodes": 739, 2024-01-31T05:14:48.253 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_dir_fetch": 0, 2024-01-31T05:14:48.254 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_backtrace_fetch": 665, 2024-01-31T05:14:48.254 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_peer_discover": 6, 2024-01-31T05:14:48.254 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rfiles": 1122, 2024-01-31T05:14:48.255 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rbytes": 9415333, 2024-01-31T05:14:48.255 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rsnaps": 0, 2024-01-31T05:14:48.255 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_backtrace_fetch": 665, 2024-01-31T05:14:48.255 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_set_tag": 0, 2024-01-31T05:14:48.255 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_backtrace_repaired": 0, 2024-01-31T05:14:48.255 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_inotable_repaired": 0, 2024-01-31T05:14:48.255 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dir_inodes": 86, 2024-01-31T05:14:48.255 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dir_base_inodes": 0, 2024-01-31T05:14:48.255 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dirfrag_rstats": 86, 2024-01-31T05:14:48.255 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_file_inodes": 579, 2024-01-31T05:14:48.255 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_inode_file_caps": 63, 2024-01-31T05:14:48.255 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_revoke": 581, 2024-01-31T05:14:48.255 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_grant": 1350, 2024-01-31T05:14:48.256 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_trunc": 14, 2024-01-31T05:14:48.256 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-01-31T05:14:48.256 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_flush_ack": 0, 2024-01-31T05:14:48.256 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_caps": 1189, 2024-01-31T05:14:48.256 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_caps_dirty": 503, 2024-01-31T05:14:48.256 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_cap_release": 64, 2024-01-31T05:14:48.256 INFO:teuthology.orchestra.run.smithi181.stdout: "process_request_cap_release": 1445 2024-01-31T05:14:48.256 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.256 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_cache": { 2024-01-31T05:14:48.256 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_update": 0, 2024-01-31T05:14:48.256 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_update_receipt": 0, 2024-01-31T05:14:48.256 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_try_discover": 0, 2024-01-31T05:14:48.256 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_send_discover": 208, 2024-01-31T05:14:48.256 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_handle_discover": 85, 2024-01-31T05:14:48.257 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays": 8, 2024-01-31T05:14:48.257 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays_delayed": 0, 2024-01-31T05:14:48.257 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays_enqueuing": 0, 2024-01-31T05:14:48.257 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_created": 867, 2024-01-31T05:14:48.257 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_enqueued": 853, 2024-01-31T05:14:48.257 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_reintegrated": 3, 2024-01-31T05:14:48.257 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_migrated": 4, 2024-01-31T05:14:48.257 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_processing": 0, 2024-01-31T05:14:48.257 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_enqueued": 0, 2024-01-31T05:14:48.257 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_prioritized": 0, 2024-01-31T05:14:48.257 INFO:teuthology.orchestra.run.smithi181.stdout: "recovery_started": 0, 2024-01-31T05:14:48.257 INFO:teuthology.orchestra.run.smithi181.stdout: "recovery_completed": 0, 2024-01-31T05:14:48.257 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_enqueue_scrub": 0, 2024-01-31T05:14:48.258 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_exportdir": 40, 2024-01-31T05:14:48.258 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_flush": 0, 2024-01-31T05:14:48.258 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_fragmentdir": 0, 2024-01-31T05:14:48.258 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_fragstats": 0, 2024-01-31T05:14:48.258 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_inodestats": 0 2024-01-31T05:14:48.258 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.258 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_log": { 2024-01-31T05:14:48.258 INFO:teuthology.orchestra.run.smithi181.stdout: "evlrg": 0, 2024-01-31T05:14:48.258 INFO:teuthology.orchestra.run.smithi181.stdout: "evadd": 3438, 2024-01-31T05:14:48.258 INFO:teuthology.orchestra.run.smithi181.stdout: "evex": 0, 2024-01-31T05:14:48.258 INFO:teuthology.orchestra.run.smithi181.stdout: "evtrm": 0, 2024-01-31T05:14:48.258 INFO:teuthology.orchestra.run.smithi181.stdout: "ev": 3438, 2024-01-31T05:14:48.258 INFO:teuthology.orchestra.run.smithi181.stdout: "evexg": 0, 2024-01-31T05:14:48.258 INFO:teuthology.orchestra.run.smithi181.stdout: "evexd": 0, 2024-01-31T05:14:48.258 INFO:teuthology.orchestra.run.smithi181.stdout: "segadd": 5, 2024-01-31T05:14:48.259 INFO:teuthology.orchestra.run.smithi181.stdout: "segex": 0, 2024-01-31T05:14:48.259 INFO:teuthology.orchestra.run.smithi181.stdout: "segtrm": 0, 2024-01-31T05:14:48.259 INFO:teuthology.orchestra.run.smithi181.stdout: "seg": 5, 2024-01-31T05:14:48.259 INFO:teuthology.orchestra.run.smithi181.stdout: "segmjr": 2, 2024-01-31T05:14:48.259 INFO:teuthology.orchestra.run.smithi181.stdout: "segexg": 0, 2024-01-31T05:14:48.259 INFO:teuthology.orchestra.run.smithi181.stdout: "segexd": 0, 2024-01-31T05:14:48.259 INFO:teuthology.orchestra.run.smithi181.stdout: "expos": 4194304, 2024-01-31T05:14:48.259 INFO:teuthology.orchestra.run.smithi181.stdout: "wrpos": 11663207, 2024-01-31T05:14:48.259 INFO:teuthology.orchestra.run.smithi181.stdout: "rdpos": 0, 2024-01-31T05:14:48.259 INFO:teuthology.orchestra.run.smithi181.stdout: "jlat": { 2024-01-31T05:14:48.259 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 816, 2024-01-31T05:14:48.259 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 2.448742185, 2024-01-31T05:14:48.259 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.003000909 2024-01-31T05:14:48.260 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.260 INFO:teuthology.orchestra.run.smithi181.stdout: "replayed": 0 2024-01-31T05:14:48.260 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.260 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_mem": { 2024-01-31T05:14:48.260 INFO:teuthology.orchestra.run.smithi181.stdout: "ino": 41, 2024-01-31T05:14:48.260 INFO:teuthology.orchestra.run.smithi181.stdout: "ino+": 1067, 2024-01-31T05:14:48.260 INFO:teuthology.orchestra.run.smithi181.stdout: "ino-": 1026, 2024-01-31T05:14:48.260 INFO:teuthology.orchestra.run.smithi181.stdout: "dir": 39, 2024-01-31T05:14:48.260 INFO:teuthology.orchestra.run.smithi181.stdout: "dir+": 319, 2024-01-31T05:14:48.260 INFO:teuthology.orchestra.run.smithi181.stdout: "dir-": 280, 2024-01-31T05:14:48.260 INFO:teuthology.orchestra.run.smithi181.stdout: "dn": 64, 2024-01-31T05:14:48.260 INFO:teuthology.orchestra.run.smithi181.stdout: "dn+": 2191, 2024-01-31T05:14:48.260 INFO:teuthology.orchestra.run.smithi181.stdout: "dn-": 2127, 2024-01-31T05:14:48.260 INFO:teuthology.orchestra.run.smithi181.stdout: "cap": 1, 2024-01-31T05:14:48.261 INFO:teuthology.orchestra.run.smithi181.stdout: "cap+": 1318, 2024-01-31T05:14:48.261 INFO:teuthology.orchestra.run.smithi181.stdout: "cap-": 1317, 2024-01-31T05:14:48.261 INFO:teuthology.orchestra.run.smithi181.stdout: "rss": 79172, 2024-01-31T05:14:48.261 INFO:teuthology.orchestra.run.smithi181.stdout: "heap": 199036 2024-01-31T05:14:48.261 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.261 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_server": { 2024-01-31T05:14:48.261 INFO:teuthology.orchestra.run.smithi181.stdout: "dispatch_client_request": 3243, 2024-01-31T05:14:48.261 INFO:teuthology.orchestra.run.smithi181.stdout: "dispatch_server_request": 611, 2024-01-31T05:14:48.261 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_request": 1940, 2024-01-31T05:14:48.261 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_session": 109, 2024-01-31T05:14:48.261 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_peer_request": 948, 2024-01-31T05:14:48.261 INFO:teuthology.orchestra.run.smithi181.stdout: "req_create_latency": { 2024-01-31T05:14:48.261 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 57, 2024-01-31T05:14:48.262 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.065617912, 2024-01-31T05:14:48.262 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.001151191 2024-01-31T05:14:48.262 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.262 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getattr_latency": { 2024-01-31T05:14:48.262 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 26, 2024-01-31T05:14:48.262 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.087813925, 2024-01-31T05:14:48.262 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.003377458 2024-01-31T05:14:48.262 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.262 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getfilelock_latency": { 2024-01-31T05:14:48.262 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:48.262 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:48.262 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:48.262 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.262 INFO:teuthology.orchestra.run.smithi181.stdout: "req_link_latency": { 2024-01-31T05:14:48.262 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 9, 2024-01-31T05:14:48.262 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.181248363, 2024-01-31T05:14:48.263 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.020138707 2024-01-31T05:14:48.263 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.263 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookup_latency": { 2024-01-31T05:14:48.263 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 623, 2024-01-31T05:14:48.263 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.380102281, 2024-01-31T05:14:48.263 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000610116 2024-01-31T05:14:48.263 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.263 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookuphash_latency": { 2024-01-31T05:14:48.263 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:48.263 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:48.263 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:48.263 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.263 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupino_latency": { 2024-01-31T05:14:48.263 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:48.264 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:48.264 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:48.264 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.264 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupname_latency": { 2024-01-31T05:14:48.264 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:48.264 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:48.264 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:48.264 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.264 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupparent_latency": { 2024-01-31T05:14:48.264 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:48.264 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:48.264 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:48.264 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.264 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupsnap_latency": { 2024-01-31T05:14:48.265 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:48.265 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:48.265 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:48.265 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.265 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lssnap_latency": { 2024-01-31T05:14:48.265 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:48.265 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:48.266 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:48.266 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.266 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mkdir_latency": { 2024-01-31T05:14:48.266 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 32, 2024-01-31T05:14:48.266 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.036058404, 2024-01-31T05:14:48.266 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.001126825 2024-01-31T05:14:48.266 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.266 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mknod_latency": { 2024-01-31T05:14:48.266 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 29, 2024-01-31T05:14:48.266 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.032900705, 2024-01-31T05:14:48.266 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.001134507 2024-01-31T05:14:48.266 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.266 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mksnap_latency": { 2024-01-31T05:14:48.266 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:48.267 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:48.267 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:48.267 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.267 INFO:teuthology.orchestra.run.smithi181.stdout: "req_open_latency": { 2024-01-31T05:14:48.267 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 2, 2024-01-31T05:14:48.267 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.002624017, 2024-01-31T05:14:48.267 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.001312008 2024-01-31T05:14:48.267 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.267 INFO:teuthology.orchestra.run.smithi181.stdout: "req_readdir_latency": { 2024-01-31T05:14:48.267 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 154, 2024-01-31T05:14:48.267 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.122878163, 2024-01-31T05:14:48.267 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000797910 2024-01-31T05:14:48.267 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.267 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rename_latency": { 2024-01-31T05:14:48.268 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 35, 2024-01-31T05:14:48.268 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 1.780622432, 2024-01-31T05:14:48.268 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.050874926 2024-01-31T05:14:48.268 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.268 INFO:teuthology.orchestra.run.smithi181.stdout: "req_renamesnap_latency": { 2024-01-31T05:14:48.268 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:48.268 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:48.268 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:48.268 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.268 INFO:teuthology.orchestra.run.smithi181.stdout: "req_snapdiff_latency": { 2024-01-31T05:14:48.268 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:48.268 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:48.268 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:48.269 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.269 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmdir_latency": { 2024-01-31T05:14:48.269 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 134, 2024-01-31T05:14:48.269 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 3.603497387, 2024-01-31T05:14:48.269 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.026891771 2024-01-31T05:14:48.269 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.269 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmsnap_latency": { 2024-01-31T05:14:48.269 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:48.269 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:48.269 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:48.269 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.270 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmxattr_latency": { 2024-01-31T05:14:48.270 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:48.270 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:48.270 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:48.270 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.270 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setattr_latency": { 2024-01-31T05:14:48.270 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 14, 2024-01-31T05:14:48.270 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.025814018, 2024-01-31T05:14:48.270 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.001843858 2024-01-31T05:14:48.270 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.270 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setdirlayout_latency": { 2024-01-31T05:14:48.270 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:48.270 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:48.270 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:48.271 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.271 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setfilelock_latency": { 2024-01-31T05:14:48.271 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:48.271 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:48.271 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:48.271 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.271 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setlayout_latency": { 2024-01-31T05:14:48.271 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:48.271 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:48.271 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:48.271 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.271 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setxattr_latency": { 2024-01-31T05:14:48.271 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:48.271 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:48.272 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:48.272 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.272 INFO:teuthology.orchestra.run.smithi181.stdout: "req_symlink_latency": { 2024-01-31T05:14:48.272 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 28, 2024-01-31T05:14:48.272 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.027309765, 2024-01-31T05:14:48.272 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000975348 2024-01-31T05:14:48.272 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.272 INFO:teuthology.orchestra.run.smithi181.stdout: "req_unlink_latency": { 2024-01-31T05:14:48.272 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 749, 2024-01-31T05:14:48.272 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 1.248007498, 2024-01-31T05:14:48.272 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.001666231 2024-01-31T05:14:48.272 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.272 INFO:teuthology.orchestra.run.smithi181.stdout: "cap_revoke_eviction": 0, 2024-01-31T05:14:48.272 INFO:teuthology.orchestra.run.smithi181.stdout: "cap_acquisition_throttle": 0, 2024-01-31T05:14:48.273 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getvxattr_latency": { 2024-01-31T05:14:48.273 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:48.273 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:48.273 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:48.273 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-01-31T05:14:48.273 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.273 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_sessions": { 2024-01-31T05:14:48.273 INFO:teuthology.orchestra.run.smithi181.stdout: "session_count": 1, 2024-01-31T05:14:48.273 INFO:teuthology.orchestra.run.smithi181.stdout: "session_add": 2, 2024-01-31T05:14:48.273 INFO:teuthology.orchestra.run.smithi181.stdout: "session_remove": 1, 2024-01-31T05:14:48.273 INFO:teuthology.orchestra.run.smithi181.stdout: "sessions_open": 1, 2024-01-31T05:14:48.273 INFO:teuthology.orchestra.run.smithi181.stdout: "sessions_stale": 0, 2024-01-31T05:14:48.273 INFO:teuthology.orchestra.run.smithi181.stdout: "total_load": 1404, 2024-01-31T05:14:48.273 INFO:teuthology.orchestra.run.smithi181.stdout: "average_load": 1404, 2024-01-31T05:14:48.274 INFO:teuthology.orchestra.run.smithi181.stdout: "avg_session_uptime": 207, 2024-01-31T05:14:48.274 INFO:teuthology.orchestra.run.smithi181.stdout: "mdthresh_evicted": 0 2024-01-31T05:14:48.274 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.274 INFO:teuthology.orchestra.run.smithi181.stdout: "mempool": { 2024-01-31T05:14:48.274 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_bytes": 0, 2024-01-31T05:14:48.274 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_items": 0, 2024-01-31T05:14:48.274 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_bytes": 0, 2024-01-31T05:14:48.274 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_items": 0, 2024-01-31T05:14:48.274 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_bytes": 0, 2024-01-31T05:14:48.274 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_items": 0, 2024-01-31T05:14:48.274 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_bytes": 0, 2024-01-31T05:14:48.274 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_items": 0, 2024-01-31T05:14:48.274 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_bytes": 0, 2024-01-31T05:14:48.274 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_items": 0, 2024-01-31T05:14:48.275 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_bytes": 0, 2024-01-31T05:14:48.275 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_items": 0, 2024-01-31T05:14:48.275 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_bytes": 0, 2024-01-31T05:14:48.275 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_items": 0, 2024-01-31T05:14:48.275 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_bytes": 0, 2024-01-31T05:14:48.275 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_items": 0, 2024-01-31T05:14:48.275 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_bytes": 0, 2024-01-31T05:14:48.275 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_items": 0, 2024-01-31T05:14:48.275 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_bytes": 0, 2024-01-31T05:14:48.275 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_items": 0, 2024-01-31T05:14:48.275 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_bytes": 0, 2024-01-31T05:14:48.275 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_items": 0, 2024-01-31T05:14:48.275 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_bytes": 0, 2024-01-31T05:14:48.275 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_items": 0, 2024-01-31T05:14:48.276 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_bytes": 0, 2024-01-31T05:14:48.276 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_items": 0, 2024-01-31T05:14:48.276 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_bytes": 0, 2024-01-31T05:14:48.276 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_items": 0, 2024-01-31T05:14:48.276 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_bytes": 0, 2024-01-31T05:14:48.276 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_items": 0, 2024-01-31T05:14:48.276 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_bytes": 0, 2024-01-31T05:14:48.276 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_items": 0, 2024-01-31T05:14:48.276 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_bytes": 0, 2024-01-31T05:14:48.276 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_items": 0, 2024-01-31T05:14:48.276 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_bytes": 0, 2024-01-31T05:14:48.276 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_items": 0, 2024-01-31T05:14:48.276 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_bytes": 305535, 2024-01-31T05:14:48.277 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_items": 122, 2024-01-31T05:14:48.277 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_bytes": 88, 2024-01-31T05:14:48.277 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_items": 1, 2024-01-31T05:14:48.277 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_bytes": 0, 2024-01-31T05:14:48.277 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_items": 0, 2024-01-31T05:14:48.277 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_bytes": 0, 2024-01-31T05:14:48.277 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_items": 0, 2024-01-31T05:14:48.277 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_bytes": 0, 2024-01-31T05:14:48.277 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_items": 0, 2024-01-31T05:14:48.277 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_bytes": 7240, 2024-01-31T05:14:48.277 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_items": 152, 2024-01-31T05:14:48.277 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_bytes": 0, 2024-01-31T05:14:48.277 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_items": 0, 2024-01-31T05:14:48.277 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_bytes": 0, 2024-01-31T05:14:48.278 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_items": 0, 2024-01-31T05:14:48.278 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_bytes": 191797, 2024-01-31T05:14:48.278 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_items": 2208, 2024-01-31T05:14:48.278 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_bytes": 0, 2024-01-31T05:14:48.278 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_items": 0, 2024-01-31T05:14:48.278 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_bytes": 0, 2024-01-31T05:14:48.278 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_items": 0 2024-01-31T05:14:48.278 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.278 INFO:teuthology.orchestra.run.smithi181.stdout: "objecter": { 2024-01-31T05:14:48.278 INFO:teuthology.orchestra.run.smithi181.stdout: "op_active": 0, 2024-01-31T05:14:48.278 INFO:teuthology.orchestra.run.smithi181.stdout: "op_laggy": 0, 2024-01-31T05:14:48.278 INFO:teuthology.orchestra.run.smithi181.stdout: "op_send": 2775, 2024-01-31T05:14:48.278 INFO:teuthology.orchestra.run.smithi181.stdout: "op_send_bytes": 7657099, 2024-01-31T05:14:48.279 INFO:teuthology.orchestra.run.smithi181.stdout: "op_resend": 33, 2024-01-31T05:14:48.279 INFO:teuthology.orchestra.run.smithi181.stdout: "op_reply": 2775, 2024-01-31T05:14:48.279 INFO:teuthology.orchestra.run.smithi181.stdout: "op_latency": { 2024-01-31T05:14:48.279 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 2775, 2024-01-31T05:14:48.279 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 5.973879549, 2024-01-31T05:14:48.279 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.002152749 2024-01-31T05:14:48.279 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.279 INFO:teuthology.orchestra.run.smithi181.stdout: "op_inflight": 0, 2024-01-31T05:14:48.279 INFO:teuthology.orchestra.run.smithi181.stdout: "oplen_avg": { 2024-01-31T05:14:48.279 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 2775, 2024-01-31T05:14:48.279 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 2827 2024-01-31T05:14:48.279 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.279 INFO:teuthology.orchestra.run.smithi181.stdout: "op": 2775, 2024-01-31T05:14:48.279 INFO:teuthology.orchestra.run.smithi181.stdout: "op_r": 781, 2024-01-31T05:14:48.280 INFO:teuthology.orchestra.run.smithi181.stdout: "op_w": 1994, 2024-01-31T05:14:48.280 INFO:teuthology.orchestra.run.smithi181.stdout: "op_rmw": 0, 2024-01-31T05:14:48.280 INFO:teuthology.orchestra.run.smithi181.stdout: "op_pg": 0, 2024-01-31T05:14:48.280 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_stat": 0, 2024-01-31T05:14:48.280 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_create": 10, 2024-01-31T05:14:48.280 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_read": 116, 2024-01-31T05:14:48.280 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_write": 932, 2024-01-31T05:14:48.280 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_writefull": 75, 2024-01-31T05:14:48.280 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_writesame": 0, 2024-01-31T05:14:48.280 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_append": 0, 2024-01-31T05:14:48.280 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_zero": 0, 2024-01-31T05:14:48.280 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_truncate": 0, 2024-01-31T05:14:48.280 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_delete": 925, 2024-01-31T05:14:48.280 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_mapext": 0, 2024-01-31T05:14:48.280 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_sparse_read": 0, 2024-01-31T05:14:48.281 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_clonerange": 0, 2024-01-31T05:14:48.281 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_getxattr": 665, 2024-01-31T05:14:48.281 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_setxattr": 20, 2024-01-31T05:14:48.281 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_cmpxattr": 0, 2024-01-31T05:14:48.281 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_rmxattr": 0, 2024-01-31T05:14:48.281 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_resetxattrs": 0, 2024-01-31T05:14:48.281 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_call": 0, 2024-01-31T05:14:48.281 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_watch": 0, 2024-01-31T05:14:48.281 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_notify": 0, 2024-01-31T05:14:48.281 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_src_cmpxattr": 0, 2024-01-31T05:14:48.281 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_pgls": 0, 2024-01-31T05:14:48.281 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_pgls_filter": 0, 2024-01-31T05:14:48.281 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_other": 19, 2024-01-31T05:14:48.281 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_active": 0, 2024-01-31T05:14:48.282 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_send": 0, 2024-01-31T05:14:48.282 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_resend": 0, 2024-01-31T05:14:48.282 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_ping": 0, 2024-01-31T05:14:48.282 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_active": 0, 2024-01-31T05:14:48.282 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_send": 0, 2024-01-31T05:14:48.282 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_resend": 0, 2024-01-31T05:14:48.282 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_active": 0, 2024-01-31T05:14:48.282 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_send": 0, 2024-01-31T05:14:48.282 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_resend": 0, 2024-01-31T05:14:48.282 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_active": 0, 2024-01-31T05:14:48.282 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_send": 0, 2024-01-31T05:14:48.282 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_resend": 0, 2024-01-31T05:14:48.282 INFO:teuthology.orchestra.run.smithi181.stdout: "command_active": 0, 2024-01-31T05:14:48.282 INFO:teuthology.orchestra.run.smithi181.stdout: "command_send": 0, 2024-01-31T05:14:48.282 INFO:teuthology.orchestra.run.smithi181.stdout: "command_resend": 0, 2024-01-31T05:14:48.283 INFO:teuthology.orchestra.run.smithi181.stdout: "map_epoch": 88, 2024-01-31T05:14:48.283 INFO:teuthology.orchestra.run.smithi181.stdout: "map_full": 0, 2024-01-31T05:14:48.283 INFO:teuthology.orchestra.run.smithi181.stdout: "map_inc": 2, 2024-01-31T05:14:48.283 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_sessions": 12, 2024-01-31T05:14:48.283 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_session_open": 12, 2024-01-31T05:14:48.283 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_session_close": 0, 2024-01-31T05:14:48.283 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_laggy": 0, 2024-01-31T05:14:48.283 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_wr": 51, 2024-01-31T05:14:48.283 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_rd": 0, 2024-01-31T05:14:48.283 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_del": 14 2024-01-31T05:14:48.283 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.283 INFO:teuthology.orchestra.run.smithi181.stdout: "oft": { 2024-01-31T05:14:48.283 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_objs": 1, 2024-01-31T05:14:48.283 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_kv_pairs": 0, 2024-01-31T05:14:48.283 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_updates": 0, 2024-01-31T05:14:48.284 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_removes": 0 2024-01-31T05:14:48.284 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.284 INFO:teuthology.orchestra.run.smithi181.stdout: "osd-slow-ops": { 2024-01-31T05:14:48.284 INFO:teuthology.orchestra.run.smithi181.stdout: "slow_ops_count": 0 2024-01-31T05:14:48.284 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.284 INFO:teuthology.orchestra.run.smithi181.stdout: "purge_queue": { 2024-01-31T05:14:48.284 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_ops": 0, 2024-01-31T05:14:48.284 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_ops_high_water": 10, 2024-01-31T05:14:48.284 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing": 0, 2024-01-31T05:14:48.284 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_high_water": 6, 2024-01-31T05:14:48.284 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executed_ops": 912, 2024-01-31T05:14:48.284 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executed": 853, 2024-01-31T05:14:48.284 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_item_in_journal": 0 2024-01-31T05:14:48.284 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.285 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-01-31T05:14:48.285 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-01-31T05:14:48.285 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-01-31T05:14:48.285 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-01-31T05:14:48.285 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 17303, 2024-01-31T05:14:48.285 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 5804107, 2024-01-31T05:14:48.285 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:48.285 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 17303, 2024-01-31T05:14:48.285 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-01-31T05:14:48.285 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-01-31T05:14:48.285 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 17303, 2024-01-31T05:14:48.285 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 5804107, 2024-01-31T05:14:48.285 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-01-31T05:14:48.285 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:48.286 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:48.286 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:48.286 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-01-31T05:14:48.286 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.286 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-objecter_bytes": { 2024-01-31T05:14:48.286 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-01-31T05:14:48.286 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-01-31T05:14:48.286 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-01-31T05:14:48.286 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-01-31T05:14:48.286 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-01-31T05:14:48.286 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:48.286 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-01-31T05:14:48.286 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 2775, 2024-01-31T05:14:48.286 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 7743252, 2024-01-31T05:14:48.287 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 2775, 2024-01-31T05:14:48.287 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 7743252, 2024-01-31T05:14:48.287 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-01-31T05:14:48.287 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:48.287 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:48.287 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:48.287 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-01-31T05:14:48.287 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.287 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-objecter_ops": { 2024-01-31T05:14:48.287 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-01-31T05:14:48.287 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 1024, 2024-01-31T05:14:48.287 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-01-31T05:14:48.287 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-01-31T05:14:48.287 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-01-31T05:14:48.287 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:48.287 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-01-31T05:14:48.287 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 2775, 2024-01-31T05:14:48.288 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 2775, 2024-01-31T05:14:48.288 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 2775, 2024-01-31T05:14:48.288 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 2775, 2024-01-31T05:14:48.288 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-01-31T05:14:48.288 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:48.288 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:48.288 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:48.288 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-01-31T05:14:48.288 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.288 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-write_buf_throttle": { 2024-01-31T05:14:48.288 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-01-31T05:14:48.288 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 3758096384, 2024-01-31T05:14:48.288 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-01-31T05:14:48.288 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 853, 2024-01-31T05:14:48.289 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 86153, 2024-01-31T05:14:48.289 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:48.289 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 853, 2024-01-31T05:14:48.289 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-01-31T05:14:48.289 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-01-31T05:14:48.289 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 116, 2024-01-31T05:14:48.289 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 86153, 2024-01-31T05:14:48.289 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-01-31T05:14:48.289 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:48.289 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:48.289 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:48.289 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-01-31T05:14:48.289 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:48.289 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-write_buf_throttle-0x55e850ae26e0": { 2024-01-31T05:14:48.289 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-01-31T05:14:48.289 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 3758096384, 2024-01-31T05:14:48.290 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-01-31T05:14:48.290 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 3438, 2024-01-31T05:14:48.290 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 7468903, 2024-01-31T05:14:48.290 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:48.290 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 3438, 2024-01-31T05:14:48.290 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-01-31T05:14:48.290 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-01-31T05:14:48.290 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 816, 2024-01-31T05:14:48.290 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 7468903, 2024-01-31T05:14:48.290 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-01-31T05:14:48.290 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:48.290 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:48.290 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:48.290 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-01-31T05:14:48.291 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-01-31T05:14:48.291 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-01-31T05:14:49.081 INFO:tasks.check_counter:Daemon mds.c mds.exported=40 2024-01-31T05:14:49.081 INFO:tasks.check_counter:Daemon mds.c mds.imported=105 2024-01-31T05:14:49.081 DEBUG:tasks.check_counter:Getting stats from f 2024-01-31T05:14:49.082 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph daemon mds.f perf dump 2024-01-31T05:14:49.326 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.c/config 2024-01-31T05:14:50.055 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:14:49 smithi181 ceph-mon[36434]: pgmap v452: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 11 op/s 2024-01-31T05:14:50.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:14:49 smithi099 ceph-mon[31615]: pgmap v452: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 11 op/s 2024-01-31T05:14:50.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:14:49 smithi179 ceph-mon[35652]: pgmap v452: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 11 op/s 2024-01-31T05:14:50.883 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-01-31T05:14:50.883 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-0": { 2024-01-31T05:14:50.884 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 451, 2024-01-31T05:14:50.884 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 427, 2024-01-31T05:14:50.884 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 953504, 2024-01-31T05:14:50.884 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 158805, 2024-01-31T05:14:50.884 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 5, 2024-01-31T05:14:50.884 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 1, 2024-01-31T05:14:50.884 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.054721286, 2024-01-31T05:14:50.884 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.016445842, 2024-01-31T05:14:50.884 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.025121994, 2024-01-31T05:14:50.884 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.013683633, 2024-01-31T05:14:50.884 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-01-31T05:14:50.884 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 426, 2024-01-31T05:14:50.884 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.019878256, 2024-01-31T05:14:50.885 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000046662 2024-01-31T05:14:50.885 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.885 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-01-31T05:14:50.885 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:50.885 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:50.885 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:50.885 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.885 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 844976, 2024-01-31T05:14:50.885 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 58352 2024-01-31T05:14:50.885 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.885 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-1": { 2024-01-31T05:14:50.885 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 7, 2024-01-31T05:14:50.886 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 78, 2024-01-31T05:14:50.886 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 3708, 2024-01-31T05:14:50.886 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 204252, 2024-01-31T05:14:50.886 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 4, 2024-01-31T05:14:50.886 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 3, 2024-01-31T05:14:50.886 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.005873368, 2024-01-31T05:14:50.886 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.003149351, 2024-01-31T05:14:50.886 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.001776642, 2024-01-31T05:14:50.886 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.000234382, 2024-01-31T05:14:50.886 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-01-31T05:14:50.886 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 77, 2024-01-31T05:14:50.886 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.006129150, 2024-01-31T05:14:50.886 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000079599 2024-01-31T05:14:50.886 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.887 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-01-31T05:14:50.887 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:50.887 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:50.887 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:50.887 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.887 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-01-31T05:14:50.887 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 203568 2024-01-31T05:14:50.887 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.887 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-2": { 2024-01-31T05:14:50.887 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 632, 2024-01-31T05:14:50.887 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 634, 2024-01-31T05:14:50.887 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 4058519, 2024-01-31T05:14:50.887 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 196559, 2024-01-31T05:14:50.887 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 4, 2024-01-31T05:14:50.888 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 3, 2024-01-31T05:14:50.888 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.045617131, 2024-01-31T05:14:50.888 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.014633525, 2024-01-31T05:14:50.888 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.013447540, 2024-01-31T05:14:50.888 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.014506347, 2024-01-31T05:14:50.888 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-01-31T05:14:50.888 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 632, 2024-01-31T05:14:50.888 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.021991515, 2024-01-31T05:14:50.888 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000034796 2024-01-31T05:14:50.888 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.888 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-01-31T05:14:50.888 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:50.888 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:50.889 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:50.889 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.889 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 0, 2024-01-31T05:14:50.889 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 0 2024-01-31T05:14:50.889 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.889 INFO:teuthology.orchestra.run.smithi181.stdout: "cct": { 2024-01-31T05:14:50.889 INFO:teuthology.orchestra.run.smithi181.stdout: "total_workers": 1, 2024-01-31T05:14:50.889 INFO:teuthology.orchestra.run.smithi181.stdout: "unhealthy_workers": 0 2024-01-31T05:14:50.889 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.889 INFO:teuthology.orchestra.run.smithi181.stdout: "finisher-MDSRank": { 2024-01-31T05:14:50.889 INFO:teuthology.orchestra.run.smithi181.stdout: "queue_len": 0, 2024-01-31T05:14:50.889 INFO:teuthology.orchestra.run.smithi181.stdout: "complete_latency": { 2024-01-31T05:14:50.889 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 1668, 2024-01-31T05:14:50.889 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.040935234, 2024-01-31T05:14:50.889 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000024541 2024-01-31T05:14:50.890 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-01-31T05:14:50.890 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.890 INFO:teuthology.orchestra.run.smithi181.stdout: "finisher-PurgeQueue": { 2024-01-31T05:14:50.890 INFO:teuthology.orchestra.run.smithi181.stdout: "queue_len": 0, 2024-01-31T05:14:50.890 INFO:teuthology.orchestra.run.smithi181.stdout: "complete_latency": { 2024-01-31T05:14:50.890 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:50.890 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:50.890 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:50.890 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-01-31T05:14:50.890 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.890 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": { 2024-01-31T05:14:50.890 INFO:teuthology.orchestra.run.smithi181.stdout: "request": 0, 2024-01-31T05:14:50.890 INFO:teuthology.orchestra.run.smithi181.stdout: "reply": 0, 2024-01-31T05:14:50.890 INFO:teuthology.orchestra.run.smithi181.stdout: "reply_latency": { 2024-01-31T05:14:50.891 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:50.891 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:50.891 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:50.891 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.891 INFO:teuthology.orchestra.run.smithi181.stdout: "slow_reply": 0, 2024-01-31T05:14:50.891 INFO:teuthology.orchestra.run.smithi181.stdout: "forward": 0, 2024-01-31T05:14:50.891 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_fetch_complete": 0, 2024-01-31T05:14:50.891 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_fetch_keys": 0, 2024-01-31T05:14:50.891 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_commit": 0, 2024-01-31T05:14:50.891 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_split": 0, 2024-01-31T05:14:50.891 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_merge": 0, 2024-01-31T05:14:50.891 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes": 738, 2024-01-31T05:14:50.891 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_top": 3, 2024-01-31T05:14:50.891 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_bottom": 735, 2024-01-31T05:14:50.892 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_pin_tail": 0, 2024-01-31T05:14:50.892 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_pinned": 733, 2024-01-31T05:14:50.892 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_expired": 1, 2024-01-31T05:14:50.892 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_with_caps": 0, 2024-01-31T05:14:50.892 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": 0, 2024-01-31T05:14:50.892 INFO:teuthology.orchestra.run.smithi181.stdout: "subtrees": 1, 2024-01-31T05:14:50.892 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse": 0, 2024-01-31T05:14:50.892 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_hit": 0, 2024-01-31T05:14:50.892 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_forward": 0, 2024-01-31T05:14:50.892 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_discover": 0, 2024-01-31T05:14:50.892 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_dir_fetch": 0, 2024-01-31T05:14:50.892 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_remote_ino": 0, 2024-01-31T05:14:50.892 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_lock": 0, 2024-01-31T05:14:50.892 INFO:teuthology.orchestra.run.smithi181.stdout: "load_cent": 0, 2024-01-31T05:14:50.893 INFO:teuthology.orchestra.run.smithi181.stdout: "q": 0, 2024-01-31T05:14:50.893 INFO:teuthology.orchestra.run.smithi181.stdout: "exported": 0, 2024-01-31T05:14:50.893 INFO:teuthology.orchestra.run.smithi181.stdout: "exported_inodes": 0, 2024-01-31T05:14:50.893 INFO:teuthology.orchestra.run.smithi181.stdout: "imported": 0, 2024-01-31T05:14:50.893 INFO:teuthology.orchestra.run.smithi181.stdout: "imported_inodes": 0, 2024-01-31T05:14:50.893 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_dir_fetch": 0, 2024-01-31T05:14:50.893 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_backtrace_fetch": 0, 2024-01-31T05:14:50.893 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_peer_discover": 0, 2024-01-31T05:14:50.893 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rfiles": 0, 2024-01-31T05:14:50.893 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rbytes": 0, 2024-01-31T05:14:50.893 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rsnaps": 0, 2024-01-31T05:14:50.893 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_backtrace_fetch": 0, 2024-01-31T05:14:50.893 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_set_tag": 0, 2024-01-31T05:14:50.893 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_backtrace_repaired": 0, 2024-01-31T05:14:50.893 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_inotable_repaired": 0, 2024-01-31T05:14:50.894 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dir_inodes": 0, 2024-01-31T05:14:50.894 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dir_base_inodes": 0, 2024-01-31T05:14:50.894 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dirfrag_rstats": 0, 2024-01-31T05:14:50.894 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_file_inodes": 0, 2024-01-31T05:14:50.894 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_inode_file_caps": 0, 2024-01-31T05:14:50.894 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_revoke": 0, 2024-01-31T05:14:50.894 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_grant": 0, 2024-01-31T05:14:50.894 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_trunc": 0, 2024-01-31T05:14:50.894 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-01-31T05:14:50.894 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_flush_ack": 0, 2024-01-31T05:14:50.894 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_caps": 0, 2024-01-31T05:14:50.894 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_caps_dirty": 0, 2024-01-31T05:14:50.894 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_cap_release": 0, 2024-01-31T05:14:50.894 INFO:teuthology.orchestra.run.smithi181.stdout: "process_request_cap_release": 0 2024-01-31T05:14:50.895 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.895 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_cache": { 2024-01-31T05:14:50.895 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_update": 0, 2024-01-31T05:14:50.895 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_update_receipt": 0, 2024-01-31T05:14:50.895 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_try_discover": 0, 2024-01-31T05:14:50.895 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_send_discover": 0, 2024-01-31T05:14:50.895 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_handle_discover": 0, 2024-01-31T05:14:50.895 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays": 0, 2024-01-31T05:14:50.895 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays_delayed": 0, 2024-01-31T05:14:50.895 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays_enqueuing": 0, 2024-01-31T05:14:50.895 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_created": 0, 2024-01-31T05:14:50.895 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_enqueued": 0, 2024-01-31T05:14:50.895 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_reintegrated": 0, 2024-01-31T05:14:50.895 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_migrated": 0, 2024-01-31T05:14:50.896 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_processing": 0, 2024-01-31T05:14:50.896 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_enqueued": 0, 2024-01-31T05:14:50.896 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_prioritized": 0, 2024-01-31T05:14:50.896 INFO:teuthology.orchestra.run.smithi181.stdout: "recovery_started": 0, 2024-01-31T05:14:50.896 INFO:teuthology.orchestra.run.smithi181.stdout: "recovery_completed": 0, 2024-01-31T05:14:50.896 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_enqueue_scrub": 0, 2024-01-31T05:14:50.896 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_exportdir": 0, 2024-01-31T05:14:50.896 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_flush": 0, 2024-01-31T05:14:50.896 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_fragmentdir": 0, 2024-01-31T05:14:50.896 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_fragstats": 0, 2024-01-31T05:14:50.896 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_inodestats": 0 2024-01-31T05:14:50.896 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.896 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_log": { 2024-01-31T05:14:50.896 INFO:teuthology.orchestra.run.smithi181.stdout: "evlrg": 0, 2024-01-31T05:14:50.897 INFO:teuthology.orchestra.run.smithi181.stdout: "evadd": 0, 2024-01-31T05:14:50.897 INFO:teuthology.orchestra.run.smithi181.stdout: "evex": 0, 2024-01-31T05:14:50.897 INFO:teuthology.orchestra.run.smithi181.stdout: "evtrm": 0, 2024-01-31T05:14:50.897 INFO:teuthology.orchestra.run.smithi181.stdout: "ev": 1817, 2024-01-31T05:14:50.897 INFO:teuthology.orchestra.run.smithi181.stdout: "evexg": 0, 2024-01-31T05:14:50.897 INFO:teuthology.orchestra.run.smithi181.stdout: "evexd": 0, 2024-01-31T05:14:50.897 INFO:teuthology.orchestra.run.smithi181.stdout: "segadd": 0, 2024-01-31T05:14:50.897 INFO:teuthology.orchestra.run.smithi181.stdout: "segex": 0, 2024-01-31T05:14:50.897 INFO:teuthology.orchestra.run.smithi181.stdout: "segtrm": 0, 2024-01-31T05:14:50.897 INFO:teuthology.orchestra.run.smithi181.stdout: "seg": 3, 2024-01-31T05:14:50.897 INFO:teuthology.orchestra.run.smithi181.stdout: "segmjr": 2, 2024-01-31T05:14:50.897 INFO:teuthology.orchestra.run.smithi181.stdout: "segexg": 0, 2024-01-31T05:14:50.897 INFO:teuthology.orchestra.run.smithi181.stdout: "segexd": 0, 2024-01-31T05:14:50.897 INFO:teuthology.orchestra.run.smithi181.stdout: "expos": 4194304, 2024-01-31T05:14:50.898 INFO:teuthology.orchestra.run.smithi181.stdout: "wrpos": 8091538, 2024-01-31T05:14:50.898 INFO:teuthology.orchestra.run.smithi181.stdout: "rdpos": 8090400, 2024-01-31T05:14:50.898 INFO:teuthology.orchestra.run.smithi181.stdout: "jlat": { 2024-01-31T05:14:50.898 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:50.898 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:50.898 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:50.898 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.898 INFO:teuthology.orchestra.run.smithi181.stdout: "replayed": 1817 2024-01-31T05:14:50.898 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.898 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_mem": { 2024-01-31T05:14:50.898 INFO:teuthology.orchestra.run.smithi181.stdout: "ino": 33, 2024-01-31T05:14:50.898 INFO:teuthology.orchestra.run.smithi181.stdout: "ino+": 666, 2024-01-31T05:14:50.898 INFO:teuthology.orchestra.run.smithi181.stdout: "ino-": 633, 2024-01-31T05:14:50.898 INFO:teuthology.orchestra.run.smithi181.stdout: "dir": 31, 2024-01-31T05:14:50.898 INFO:teuthology.orchestra.run.smithi181.stdout: "dir+": 226, 2024-01-31T05:14:50.899 INFO:teuthology.orchestra.run.smithi181.stdout: "dir-": 195, 2024-01-31T05:14:50.899 INFO:teuthology.orchestra.run.smithi181.stdout: "dn": 738, 2024-01-31T05:14:50.899 INFO:teuthology.orchestra.run.smithi181.stdout: "dn+": 1226, 2024-01-31T05:14:50.899 INFO:teuthology.orchestra.run.smithi181.stdout: "dn-": 488, 2024-01-31T05:14:50.899 INFO:teuthology.orchestra.run.smithi181.stdout: "cap": 0, 2024-01-31T05:14:50.899 INFO:teuthology.orchestra.run.smithi181.stdout: "cap+": 0, 2024-01-31T05:14:50.899 INFO:teuthology.orchestra.run.smithi181.stdout: "cap-": 0, 2024-01-31T05:14:50.899 INFO:teuthology.orchestra.run.smithi181.stdout: "rss": 49348, 2024-01-31T05:14:50.899 INFO:teuthology.orchestra.run.smithi181.stdout: "heap": 207228 2024-01-31T05:14:50.899 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.899 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_server": { 2024-01-31T05:14:50.899 INFO:teuthology.orchestra.run.smithi181.stdout: "dispatch_client_request": 0, 2024-01-31T05:14:50.899 INFO:teuthology.orchestra.run.smithi181.stdout: "dispatch_server_request": 0, 2024-01-31T05:14:50.899 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_request": 0, 2024-01-31T05:14:50.899 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_session": 0, 2024-01-31T05:14:50.900 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_peer_request": 0, 2024-01-31T05:14:50.900 INFO:teuthology.orchestra.run.smithi181.stdout: "req_create_latency": { 2024-01-31T05:14:50.900 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:50.900 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:50.900 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:50.900 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.900 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getattr_latency": { 2024-01-31T05:14:50.900 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:50.900 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:50.900 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:50.900 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.900 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getfilelock_latency": { 2024-01-31T05:14:50.900 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:50.901 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:50.901 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:50.901 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.901 INFO:teuthology.orchestra.run.smithi181.stdout: "req_link_latency": { 2024-01-31T05:14:50.901 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:50.901 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:50.901 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:50.901 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.901 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookup_latency": { 2024-01-31T05:14:50.901 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:50.901 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:50.901 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:50.901 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.901 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookuphash_latency": { 2024-01-31T05:14:50.901 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:50.902 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:50.902 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:50.902 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.902 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupino_latency": { 2024-01-31T05:14:50.902 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:50.902 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:50.902 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:50.902 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.902 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupname_latency": { 2024-01-31T05:14:50.902 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:50.902 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:50.902 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:50.902 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.902 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupparent_latency": { 2024-01-31T05:14:50.903 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:50.903 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:50.903 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:50.903 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.903 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupsnap_latency": { 2024-01-31T05:14:50.903 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:50.903 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:50.903 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:50.903 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.903 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lssnap_latency": { 2024-01-31T05:14:50.903 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:50.903 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:50.903 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:50.903 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.903 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mkdir_latency": { 2024-01-31T05:14:50.904 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:50.904 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:50.904 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:50.904 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.905 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mknod_latency": { 2024-01-31T05:14:50.905 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:50.905 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:50.905 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:50.905 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.905 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mksnap_latency": { 2024-01-31T05:14:50.905 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:50.905 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:50.905 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:50.906 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.906 INFO:teuthology.orchestra.run.smithi181.stdout: "req_open_latency": { 2024-01-31T05:14:50.906 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:50.906 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:50.906 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:50.906 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.906 INFO:teuthology.orchestra.run.smithi181.stdout: "req_readdir_latency": { 2024-01-31T05:14:50.906 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:50.906 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:50.906 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:50.906 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.906 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rename_latency": { 2024-01-31T05:14:50.906 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:50.907 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:50.907 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:50.907 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.907 INFO:teuthology.orchestra.run.smithi181.stdout: "req_renamesnap_latency": { 2024-01-31T05:14:50.907 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:50.907 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:50.907 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:50.907 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.907 INFO:teuthology.orchestra.run.smithi181.stdout: "req_snapdiff_latency": { 2024-01-31T05:14:50.907 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:50.908 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:50.908 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:50.908 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.908 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmdir_latency": { 2024-01-31T05:14:50.908 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:50.908 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:50.908 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:50.908 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.908 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmsnap_latency": { 2024-01-31T05:14:50.908 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:50.908 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:50.908 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:50.909 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.909 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmxattr_latency": { 2024-01-31T05:14:50.909 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:50.909 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:50.909 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:50.909 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.909 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setattr_latency": { 2024-01-31T05:14:50.909 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:50.909 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:50.909 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:50.909 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.909 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setdirlayout_latency": { 2024-01-31T05:14:50.910 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:50.910 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:50.910 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:50.910 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.910 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setfilelock_latency": { 2024-01-31T05:14:50.910 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:50.910 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:50.910 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:50.910 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.910 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setlayout_latency": { 2024-01-31T05:14:50.910 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:50.910 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:50.910 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:50.911 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.911 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setxattr_latency": { 2024-01-31T05:14:50.911 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:50.911 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:50.911 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:50.911 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.911 INFO:teuthology.orchestra.run.smithi181.stdout: "req_symlink_latency": { 2024-01-31T05:14:50.911 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:50.911 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:50.911 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:50.911 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.911 INFO:teuthology.orchestra.run.smithi181.stdout: "req_unlink_latency": { 2024-01-31T05:14:50.911 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:50.912 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:50.912 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:50.912 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.912 INFO:teuthology.orchestra.run.smithi181.stdout: "cap_revoke_eviction": 0, 2024-01-31T05:14:50.912 INFO:teuthology.orchestra.run.smithi181.stdout: "cap_acquisition_throttle": 0, 2024-01-31T05:14:50.912 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getvxattr_latency": { 2024-01-31T05:14:50.912 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:50.912 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:50.912 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:50.912 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-01-31T05:14:50.912 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.912 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_sessions": { 2024-01-31T05:14:50.912 INFO:teuthology.orchestra.run.smithi181.stdout: "session_count": 1, 2024-01-31T05:14:50.913 INFO:teuthology.orchestra.run.smithi181.stdout: "session_add": 2, 2024-01-31T05:14:50.913 INFO:teuthology.orchestra.run.smithi181.stdout: "session_remove": 1, 2024-01-31T05:14:50.913 INFO:teuthology.orchestra.run.smithi181.stdout: "sessions_open": 1, 2024-01-31T05:14:50.913 INFO:teuthology.orchestra.run.smithi181.stdout: "sessions_stale": 0, 2024-01-31T05:14:50.913 INFO:teuthology.orchestra.run.smithi181.stdout: "total_load": 0, 2024-01-31T05:14:50.913 INFO:teuthology.orchestra.run.smithi181.stdout: "average_load": 0, 2024-01-31T05:14:50.913 INFO:teuthology.orchestra.run.smithi181.stdout: "avg_session_uptime": 1852, 2024-01-31T05:14:50.913 INFO:teuthology.orchestra.run.smithi181.stdout: "mdthresh_evicted": 0 2024-01-31T05:14:50.913 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.913 INFO:teuthology.orchestra.run.smithi181.stdout: "mempool": { 2024-01-31T05:14:50.913 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_bytes": 0, 2024-01-31T05:14:50.913 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_items": 0, 2024-01-31T05:14:50.913 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_bytes": 0, 2024-01-31T05:14:50.913 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_items": 0, 2024-01-31T05:14:50.914 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_bytes": 0, 2024-01-31T05:14:50.914 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_items": 0, 2024-01-31T05:14:50.914 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_bytes": 0, 2024-01-31T05:14:50.914 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_items": 0, 2024-01-31T05:14:50.914 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_bytes": 0, 2024-01-31T05:14:50.914 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_items": 0, 2024-01-31T05:14:50.914 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_bytes": 0, 2024-01-31T05:14:50.914 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_items": 0, 2024-01-31T05:14:50.914 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_bytes": 0, 2024-01-31T05:14:50.914 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_items": 0, 2024-01-31T05:14:50.914 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_bytes": 0, 2024-01-31T05:14:50.914 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_items": 0, 2024-01-31T05:14:50.914 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_bytes": 0, 2024-01-31T05:14:50.915 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_items": 0, 2024-01-31T05:14:50.915 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_bytes": 0, 2024-01-31T05:14:50.915 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_items": 0, 2024-01-31T05:14:50.915 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_bytes": 0, 2024-01-31T05:14:50.915 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_items": 0, 2024-01-31T05:14:50.915 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_bytes": 0, 2024-01-31T05:14:50.915 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_items": 0, 2024-01-31T05:14:50.915 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_bytes": 0, 2024-01-31T05:14:50.915 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_items": 0, 2024-01-31T05:14:50.915 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_bytes": 0, 2024-01-31T05:14:50.915 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_items": 0, 2024-01-31T05:14:50.915 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_bytes": 0, 2024-01-31T05:14:50.915 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_items": 0, 2024-01-31T05:14:50.915 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_bytes": 0, 2024-01-31T05:14:50.916 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_items": 0, 2024-01-31T05:14:50.916 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_bytes": 0, 2024-01-31T05:14:50.916 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_items": 0, 2024-01-31T05:14:50.916 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_bytes": 0, 2024-01-31T05:14:50.916 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_items": 0, 2024-01-31T05:14:50.916 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_bytes": 182158, 2024-01-31T05:14:50.916 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_items": 71, 2024-01-31T05:14:50.916 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_bytes": 0, 2024-01-31T05:14:50.916 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_items": 0, 2024-01-31T05:14:50.916 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_bytes": 0, 2024-01-31T05:14:50.916 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_items": 0, 2024-01-31T05:14:50.916 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_bytes": 0, 2024-01-31T05:14:50.916 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_items": 0, 2024-01-31T05:14:50.917 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_bytes": 0, 2024-01-31T05:14:50.917 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_items": 0, 2024-01-31T05:14:50.917 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_bytes": 7240, 2024-01-31T05:14:50.917 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_items": 152, 2024-01-31T05:14:50.917 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_bytes": 0, 2024-01-31T05:14:50.917 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_items": 0, 2024-01-31T05:14:50.917 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_bytes": 0, 2024-01-31T05:14:50.917 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_items": 0, 2024-01-31T05:14:50.917 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_bytes": 640552, 2024-01-31T05:14:50.917 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_items": 7897, 2024-01-31T05:14:50.917 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_bytes": 0, 2024-01-31T05:14:50.917 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_items": 0, 2024-01-31T05:14:50.917 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_bytes": 0, 2024-01-31T05:14:50.917 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_items": 0 2024-01-31T05:14:50.918 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.918 INFO:teuthology.orchestra.run.smithi181.stdout: "objecter": { 2024-01-31T05:14:50.918 INFO:teuthology.orchestra.run.smithi181.stdout: "op_active": 0, 2024-01-31T05:14:50.918 INFO:teuthology.orchestra.run.smithi181.stdout: "op_laggy": 0, 2024-01-31T05:14:50.918 INFO:teuthology.orchestra.run.smithi181.stdout: "op_send": 957, 2024-01-31T05:14:50.918 INFO:teuthology.orchestra.run.smithi181.stdout: "op_send_bytes": 21, 2024-01-31T05:14:50.918 INFO:teuthology.orchestra.run.smithi181.stdout: "op_resend": 3, 2024-01-31T05:14:50.918 INFO:teuthology.orchestra.run.smithi181.stdout: "op_reply": 957, 2024-01-31T05:14:50.918 INFO:teuthology.orchestra.run.smithi181.stdout: "op_latency": { 2024-01-31T05:14:50.918 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 957, 2024-01-31T05:14:50.918 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.922981385, 2024-01-31T05:14:50.918 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000964452 2024-01-31T05:14:50.918 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.919 INFO:teuthology.orchestra.run.smithi181.stdout: "op_inflight": 0, 2024-01-31T05:14:50.919 INFO:teuthology.orchestra.run.smithi181.stdout: "oplen_avg": { 2024-01-31T05:14:50.919 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 957, 2024-01-31T05:14:50.919 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 958 2024-01-31T05:14:50.919 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.919 INFO:teuthology.orchestra.run.smithi181.stdout: "op": 957, 2024-01-31T05:14:50.919 INFO:teuthology.orchestra.run.smithi181.stdout: "op_r": 957, 2024-01-31T05:14:50.919 INFO:teuthology.orchestra.run.smithi181.stdout: "op_w": 0, 2024-01-31T05:14:50.919 INFO:teuthology.orchestra.run.smithi181.stdout: "op_rmw": 0, 2024-01-31T05:14:50.919 INFO:teuthology.orchestra.run.smithi181.stdout: "op_pg": 0, 2024-01-31T05:14:50.919 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_stat": 562, 2024-01-31T05:14:50.919 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_create": 0, 2024-01-31T05:14:50.919 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_read": 393, 2024-01-31T05:14:50.920 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_write": 0, 2024-01-31T05:14:50.920 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_writefull": 0, 2024-01-31T05:14:50.920 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_writesame": 0, 2024-01-31T05:14:50.920 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_append": 0, 2024-01-31T05:14:50.920 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_zero": 0, 2024-01-31T05:14:50.920 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_truncate": 0, 2024-01-31T05:14:50.920 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_delete": 0, 2024-01-31T05:14:50.920 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_mapext": 0, 2024-01-31T05:14:50.920 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_sparse_read": 0, 2024-01-31T05:14:50.920 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_clonerange": 0, 2024-01-31T05:14:50.920 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_getxattr": 1, 2024-01-31T05:14:50.920 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_setxattr": 0, 2024-01-31T05:14:50.920 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_cmpxattr": 0, 2024-01-31T05:14:50.920 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_rmxattr": 0, 2024-01-31T05:14:50.921 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_resetxattrs": 0, 2024-01-31T05:14:50.921 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_call": 0, 2024-01-31T05:14:50.921 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_watch": 0, 2024-01-31T05:14:50.921 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_notify": 0, 2024-01-31T05:14:50.921 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_src_cmpxattr": 0, 2024-01-31T05:14:50.921 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_pgls": 0, 2024-01-31T05:14:50.921 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_pgls_filter": 0, 2024-01-31T05:14:50.921 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_other": 0, 2024-01-31T05:14:50.921 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_active": 0, 2024-01-31T05:14:50.921 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_send": 0, 2024-01-31T05:14:50.921 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_resend": 0, 2024-01-31T05:14:50.921 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_ping": 0, 2024-01-31T05:14:50.921 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_active": 0, 2024-01-31T05:14:50.922 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_send": 0, 2024-01-31T05:14:50.922 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_resend": 0, 2024-01-31T05:14:50.922 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_active": 0, 2024-01-31T05:14:50.922 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_send": 0, 2024-01-31T05:14:50.922 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_resend": 0, 2024-01-31T05:14:50.922 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_active": 0, 2024-01-31T05:14:50.922 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_send": 0, 2024-01-31T05:14:50.922 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_resend": 0, 2024-01-31T05:14:50.922 INFO:teuthology.orchestra.run.smithi181.stdout: "command_active": 0, 2024-01-31T05:14:50.922 INFO:teuthology.orchestra.run.smithi181.stdout: "command_send": 0, 2024-01-31T05:14:50.922 INFO:teuthology.orchestra.run.smithi181.stdout: "command_resend": 0, 2024-01-31T05:14:50.922 INFO:teuthology.orchestra.run.smithi181.stdout: "map_epoch": 88, 2024-01-31T05:14:50.922 INFO:teuthology.orchestra.run.smithi181.stdout: "map_full": 0, 2024-01-31T05:14:50.922 INFO:teuthology.orchestra.run.smithi181.stdout: "map_inc": 2, 2024-01-31T05:14:50.923 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_sessions": 4, 2024-01-31T05:14:50.923 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_session_open": 4, 2024-01-31T05:14:50.923 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_session_close": 0, 2024-01-31T05:14:50.923 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_laggy": 0, 2024-01-31T05:14:50.923 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_wr": 0, 2024-01-31T05:14:50.923 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_rd": 2, 2024-01-31T05:14:50.923 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_del": 0 2024-01-31T05:14:50.923 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.923 INFO:teuthology.orchestra.run.smithi181.stdout: "oft": { 2024-01-31T05:14:50.923 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_objs": 0, 2024-01-31T05:14:50.923 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_kv_pairs": 0, 2024-01-31T05:14:50.923 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_updates": 0, 2024-01-31T05:14:50.923 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_removes": 0 2024-01-31T05:14:50.923 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.923 INFO:teuthology.orchestra.run.smithi181.stdout: "osd-slow-ops": { 2024-01-31T05:14:50.924 INFO:teuthology.orchestra.run.smithi181.stdout: "slow_ops_count": 0 2024-01-31T05:14:50.924 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.924 INFO:teuthology.orchestra.run.smithi181.stdout: "purge_queue": { 2024-01-31T05:14:50.924 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_ops": 0, 2024-01-31T05:14:50.924 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_ops_high_water": 0, 2024-01-31T05:14:50.924 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing": 0, 2024-01-31T05:14:50.924 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_high_water": 0, 2024-01-31T05:14:50.924 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executed_ops": 0, 2024-01-31T05:14:50.924 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executed": 0, 2024-01-31T05:14:50.924 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_item_in_journal": 0 2024-01-31T05:14:50.924 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.924 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-01-31T05:14:50.924 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-01-31T05:14:50.925 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-01-31T05:14:50.925 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-01-31T05:14:50.925 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 1086, 2024-01-31T05:14:50.925 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 4908538, 2024-01-31T05:14:50.925 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:50.925 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 1086, 2024-01-31T05:14:50.925 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-01-31T05:14:50.925 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-01-31T05:14:50.925 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 1086, 2024-01-31T05:14:50.925 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 4908538, 2024-01-31T05:14:50.925 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-01-31T05:14:50.925 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:50.925 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:50.925 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:50.926 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-01-31T05:14:50.926 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.926 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-objecter_bytes": { 2024-01-31T05:14:50.926 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-01-31T05:14:50.926 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-01-31T05:14:50.926 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-01-31T05:14:50.926 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-01-31T05:14:50.926 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-01-31T05:14:50.926 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:50.926 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-01-31T05:14:50.926 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 957, 2024-01-31T05:14:50.926 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 3897239, 2024-01-31T05:14:50.926 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 957, 2024-01-31T05:14:50.926 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 3897239, 2024-01-31T05:14:50.926 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-01-31T05:14:50.927 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:50.927 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:50.927 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:50.927 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-01-31T05:14:50.927 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.927 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-objecter_ops": { 2024-01-31T05:14:50.927 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-01-31T05:14:50.927 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 1024, 2024-01-31T05:14:50.927 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-01-31T05:14:50.927 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-01-31T05:14:50.927 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-01-31T05:14:50.927 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:50.927 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-01-31T05:14:50.927 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 957, 2024-01-31T05:14:50.928 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 957, 2024-01-31T05:14:50.928 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 957, 2024-01-31T05:14:50.928 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 957, 2024-01-31T05:14:50.928 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-01-31T05:14:50.928 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:50.928 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:50.928 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:50.928 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-01-31T05:14:50.928 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.928 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-write_buf_throttle": { 2024-01-31T05:14:50.928 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-01-31T05:14:50.928 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 3758096384, 2024-01-31T05:14:50.928 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-01-31T05:14:50.928 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-01-31T05:14:50.928 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-01-31T05:14:50.929 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:50.929 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-01-31T05:14:50.929 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-01-31T05:14:50.929 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-01-31T05:14:50.929 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 0, 2024-01-31T05:14:50.929 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 0, 2024-01-31T05:14:50.929 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-01-31T05:14:50.929 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:50.929 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:50.929 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:50.929 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-01-31T05:14:50.929 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:50.929 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-write_buf_throttle-0x558ab0bc6960": { 2024-01-31T05:14:50.929 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-01-31T05:14:50.930 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 3758096384, 2024-01-31T05:14:50.930 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-01-31T05:14:50.930 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-01-31T05:14:50.930 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-01-31T05:14:50.930 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:50.930 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-01-31T05:14:50.930 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-01-31T05:14:50.930 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-01-31T05:14:50.930 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 0, 2024-01-31T05:14:50.930 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 0, 2024-01-31T05:14:50.931 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-01-31T05:14:50.931 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:50.931 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:50.931 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:50.931 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-01-31T05:14:50.931 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-01-31T05:14:50.932 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-01-31T05:14:51.641 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-01-31T05:14:51.641 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-01-31T05:14:51.641 DEBUG:tasks.check_counter:Getting stats from i 2024-01-31T05:14:51.641 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph daemon mds.i perf dump 2024-01-31T05:14:51.881 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.c/config 2024-01-31T05:14:52.002 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:14:51 smithi181 ceph-mon[36434]: pgmap v453: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-01-31T05:14:52.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:14:51 smithi099 ceph-mon[31615]: pgmap v453: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-01-31T05:14:52.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:14:51 smithi179 ceph-mon[35652]: pgmap v453: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-01-31T05:14:53.356 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-01-31T05:14:53.356 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-0": { 2024-01-31T05:14:53.356 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 7780, 2024-01-31T05:14:53.356 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 5078, 2024-01-31T05:14:53.356 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 3823980, 2024-01-31T05:14:53.357 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 5420793, 2024-01-31T05:14:53.357 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 11, 2024-01-31T05:14:53.357 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 4, 2024-01-31T05:14:53.357 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.424912508, 2024-01-31T05:14:53.357 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.160865369, 2024-01-31T05:14:53.357 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.317695794, 2024-01-31T05:14:53.357 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.025115232, 2024-01-31T05:14:53.357 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-01-31T05:14:53.357 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 5079, 2024-01-31T05:14:53.357 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.114703890, 2024-01-31T05:14:53.357 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000022583 2024-01-31T05:14:53.357 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.357 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-01-31T05:14:53.357 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 11048, 2024-01-31T05:14:53.358 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.001617730, 2024-01-31T05:14:53.358 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000146 2024-01-31T05:14:53.358 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.358 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 857696, 2024-01-31T05:14:53.358 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 141968 2024-01-31T05:14:53.358 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.358 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-1": { 2024-01-31T05:14:53.358 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 782, 2024-01-31T05:14:53.358 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 686, 2024-01-31T05:14:53.358 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 338186, 2024-01-31T05:14:53.358 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 561480, 2024-01-31T05:14:53.358 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 15, 2024-01-31T05:14:53.358 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 7, 2024-01-31T05:14:53.358 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.052804419, 2024-01-31T05:14:53.358 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.019102882, 2024-01-31T05:14:53.359 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.026474703, 2024-01-31T05:14:53.359 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.008047354, 2024-01-31T05:14:53.359 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-01-31T05:14:53.359 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 685, 2024-01-31T05:14:53.359 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.042881077, 2024-01-31T05:14:53.359 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000062600 2024-01-31T05:14:53.359 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.359 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-01-31T05:14:53.359 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 617, 2024-01-31T05:14:53.359 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000073859, 2024-01-31T05:14:53.359 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000119 2024-01-31T05:14:53.359 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.359 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-01-31T05:14:53.359 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 205056 2024-01-31T05:14:53.360 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.360 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-2": { 2024-01-31T05:14:53.360 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 3710, 2024-01-31T05:14:53.360 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 5280, 2024-01-31T05:14:53.360 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 1371005, 2024-01-31T05:14:53.360 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 2940232, 2024-01-31T05:14:53.360 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 14, 2024-01-31T05:14:53.360 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 8, 2024-01-31T05:14:53.360 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.253450955, 2024-01-31T05:14:53.360 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.112329704, 2024-01-31T05:14:53.360 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.153941913, 2024-01-31T05:14:53.360 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.014880039, 2024-01-31T05:14:53.360 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-01-31T05:14:53.360 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 5276, 2024-01-31T05:14:53.361 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.112658502, 2024-01-31T05:14:53.361 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000021353 2024-01-31T05:14:53.361 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.361 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-01-31T05:14:53.361 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 6781, 2024-01-31T05:14:53.361 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000993330, 2024-01-31T05:14:53.361 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000146 2024-01-31T05:14:53.361 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.361 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 699440, 2024-01-31T05:14:53.361 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 2271808 2024-01-31T05:14:53.361 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.361 INFO:teuthology.orchestra.run.smithi181.stdout: "cct": { 2024-01-31T05:14:53.361 INFO:teuthology.orchestra.run.smithi181.stdout: "total_workers": 1, 2024-01-31T05:14:53.361 INFO:teuthology.orchestra.run.smithi181.stdout: "unhealthy_workers": 0 2024-01-31T05:14:53.361 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.362 INFO:teuthology.orchestra.run.smithi181.stdout: "finisher-MDSRank": { 2024-01-31T05:14:53.362 INFO:teuthology.orchestra.run.smithi181.stdout: "queue_len": 0, 2024-01-31T05:14:53.362 INFO:teuthology.orchestra.run.smithi181.stdout: "complete_latency": { 2024-01-31T05:14:53.362 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 1260, 2024-01-31T05:14:53.362 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.733677479, 2024-01-31T05:14:53.362 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000582283 2024-01-31T05:14:53.362 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-01-31T05:14:53.362 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.362 INFO:teuthology.orchestra.run.smithi181.stdout: "finisher-PurgeQueue": { 2024-01-31T05:14:53.362 INFO:teuthology.orchestra.run.smithi181.stdout: "queue_len": 0, 2024-01-31T05:14:53.362 INFO:teuthology.orchestra.run.smithi181.stdout: "complete_latency": { 2024-01-31T05:14:53.362 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 1245, 2024-01-31T05:14:53.362 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.059621882, 2024-01-31T05:14:53.362 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000047889 2024-01-31T05:14:53.362 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-01-31T05:14:53.363 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.363 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": { 2024-01-31T05:14:53.363 INFO:teuthology.orchestra.run.smithi181.stdout: "request": 1275, 2024-01-31T05:14:53.363 INFO:teuthology.orchestra.run.smithi181.stdout: "reply": 1236, 2024-01-31T05:14:53.363 INFO:teuthology.orchestra.run.smithi181.stdout: "reply_latency": { 2024-01-31T05:14:53.363 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 1236, 2024-01-31T05:14:53.363 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 2.368772641, 2024-01-31T05:14:53.363 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.001916482 2024-01-31T05:14:53.363 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.363 INFO:teuthology.orchestra.run.smithi181.stdout: "slow_reply": 0, 2024-01-31T05:14:53.363 INFO:teuthology.orchestra.run.smithi181.stdout: "forward": 39, 2024-01-31T05:14:53.363 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_fetch_complete": 2, 2024-01-31T05:14:53.363 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_fetch_keys": 0, 2024-01-31T05:14:53.363 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_commit": 11, 2024-01-31T05:14:53.363 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_split": 0, 2024-01-31T05:14:53.364 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_merge": 0, 2024-01-31T05:14:53.364 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes": 52, 2024-01-31T05:14:53.364 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_top": 19, 2024-01-31T05:14:53.364 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_bottom": 15, 2024-01-31T05:14:53.364 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_pin_tail": 18, 2024-01-31T05:14:53.364 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_pinned": 24, 2024-01-31T05:14:53.364 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_expired": 326, 2024-01-31T05:14:53.364 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_with_caps": 1, 2024-01-31T05:14:53.364 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": 1, 2024-01-31T05:14:53.364 INFO:teuthology.orchestra.run.smithi181.stdout: "subtrees": 6, 2024-01-31T05:14:53.364 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse": 2303, 2024-01-31T05:14:53.364 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_hit": 1979, 2024-01-31T05:14:53.364 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_forward": 38, 2024-01-31T05:14:53.364 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_discover": 96, 2024-01-31T05:14:53.365 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_dir_fetch": 0, 2024-01-31T05:14:53.365 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_remote_ino": 1, 2024-01-31T05:14:53.365 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_lock": 5, 2024-01-31T05:14:53.365 INFO:teuthology.orchestra.run.smithi181.stdout: "load_cent": 0, 2024-01-31T05:14:53.365 INFO:teuthology.orchestra.run.smithi181.stdout: "q": 0, 2024-01-31T05:14:53.365 INFO:teuthology.orchestra.run.smithi181.stdout: "exported": 30, 2024-01-31T05:14:53.365 INFO:teuthology.orchestra.run.smithi181.stdout: "exported_inodes": 13, 2024-01-31T05:14:53.365 INFO:teuthology.orchestra.run.smithi181.stdout: "imported": 44, 2024-01-31T05:14:53.365 INFO:teuthology.orchestra.run.smithi181.stdout: "imported_inodes": 472, 2024-01-31T05:14:53.365 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_dir_fetch": 0, 2024-01-31T05:14:53.365 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_backtrace_fetch": 426, 2024-01-31T05:14:53.365 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_peer_discover": 4, 2024-01-31T05:14:53.365 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rfiles": 1122, 2024-01-31T05:14:53.365 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rbytes": 9415333, 2024-01-31T05:14:53.366 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rsnaps": 0, 2024-01-31T05:14:53.366 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_backtrace_fetch": 426, 2024-01-31T05:14:53.366 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_set_tag": 0, 2024-01-31T05:14:53.366 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_backtrace_repaired": 0, 2024-01-31T05:14:53.366 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_inotable_repaired": 0, 2024-01-31T05:14:53.366 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dir_inodes": 28, 2024-01-31T05:14:53.366 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dir_base_inodes": 0, 2024-01-31T05:14:53.366 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dirfrag_rstats": 28, 2024-01-31T05:14:53.366 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_file_inodes": 398, 2024-01-31T05:14:53.366 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_inode_file_caps": 13, 2024-01-31T05:14:53.366 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_revoke": 270, 2024-01-31T05:14:53.366 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_grant": 777, 2024-01-31T05:14:53.366 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_trunc": 6, 2024-01-31T05:14:53.366 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-01-31T05:14:53.366 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_flush_ack": 0, 2024-01-31T05:14:53.367 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_caps": 554, 2024-01-31T05:14:53.367 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_caps_dirty": 257, 2024-01-31T05:14:53.367 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_cap_release": 36, 2024-01-31T05:14:53.367 INFO:teuthology.orchestra.run.smithi181.stdout: "process_request_cap_release": 1009 2024-01-31T05:14:53.367 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.367 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_cache": { 2024-01-31T05:14:53.367 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_update": 0, 2024-01-31T05:14:53.367 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_update_receipt": 0, 2024-01-31T05:14:53.367 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_try_discover": 0, 2024-01-31T05:14:53.367 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_send_discover": 109, 2024-01-31T05:14:53.367 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_handle_discover": 38, 2024-01-31T05:14:53.367 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays": 8, 2024-01-31T05:14:53.367 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays_delayed": 0, 2024-01-31T05:14:53.367 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays_enqueuing": 0, 2024-01-31T05:14:53.367 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_created": 541, 2024-01-31T05:14:53.368 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_enqueued": 531, 2024-01-31T05:14:53.368 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_reintegrated": 5, 2024-01-31T05:14:53.368 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_migrated": 1, 2024-01-31T05:14:53.368 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_processing": 0, 2024-01-31T05:14:53.368 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_enqueued": 0, 2024-01-31T05:14:53.368 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_prioritized": 0, 2024-01-31T05:14:53.368 INFO:teuthology.orchestra.run.smithi181.stdout: "recovery_started": 0, 2024-01-31T05:14:53.368 INFO:teuthology.orchestra.run.smithi181.stdout: "recovery_completed": 0, 2024-01-31T05:14:53.368 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_enqueue_scrub": 0, 2024-01-31T05:14:53.368 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_exportdir": 30, 2024-01-31T05:14:53.368 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_flush": 0, 2024-01-31T05:14:53.368 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_fragmentdir": 0, 2024-01-31T05:14:53.368 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_fragstats": 0, 2024-01-31T05:14:53.368 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_inodestats": 0 2024-01-31T05:14:53.369 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.369 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_log": { 2024-01-31T05:14:53.369 INFO:teuthology.orchestra.run.smithi181.stdout: "evlrg": 0, 2024-01-31T05:14:53.369 INFO:teuthology.orchestra.run.smithi181.stdout: "evadd": 2081, 2024-01-31T05:14:53.369 INFO:teuthology.orchestra.run.smithi181.stdout: "evex": 0, 2024-01-31T05:14:53.370 INFO:teuthology.orchestra.run.smithi181.stdout: "evtrm": 0, 2024-01-31T05:14:53.370 INFO:teuthology.orchestra.run.smithi181.stdout: "ev": 2081, 2024-01-31T05:14:53.370 INFO:teuthology.orchestra.run.smithi181.stdout: "evexg": 0, 2024-01-31T05:14:53.370 INFO:teuthology.orchestra.run.smithi181.stdout: "evexd": 0, 2024-01-31T05:14:53.370 INFO:teuthology.orchestra.run.smithi181.stdout: "segadd": 5, 2024-01-31T05:14:53.370 INFO:teuthology.orchestra.run.smithi181.stdout: "segex": 0, 2024-01-31T05:14:53.370 INFO:teuthology.orchestra.run.smithi181.stdout: "segtrm": 0, 2024-01-31T05:14:53.370 INFO:teuthology.orchestra.run.smithi181.stdout: "seg": 5, 2024-01-31T05:14:53.370 INFO:teuthology.orchestra.run.smithi181.stdout: "segmjr": 2, 2024-01-31T05:14:53.370 INFO:teuthology.orchestra.run.smithi181.stdout: "segexg": 0, 2024-01-31T05:14:53.370 INFO:teuthology.orchestra.run.smithi181.stdout: "segexd": 0, 2024-01-31T05:14:53.370 INFO:teuthology.orchestra.run.smithi181.stdout: "expos": 4194304, 2024-01-31T05:14:53.370 INFO:teuthology.orchestra.run.smithi181.stdout: "wrpos": 8396064, 2024-01-31T05:14:53.371 INFO:teuthology.orchestra.run.smithi181.stdout: "rdpos": 0, 2024-01-31T05:14:53.371 INFO:teuthology.orchestra.run.smithi181.stdout: "jlat": { 2024-01-31T05:14:53.371 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 432, 2024-01-31T05:14:53.371 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 1.374538873, 2024-01-31T05:14:53.371 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.003181802 2024-01-31T05:14:53.371 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.371 INFO:teuthology.orchestra.run.smithi181.stdout: "replayed": 0 2024-01-31T05:14:53.371 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.371 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_mem": { 2024-01-31T05:14:53.371 INFO:teuthology.orchestra.run.smithi181.stdout: "ino": 43, 2024-01-31T05:14:53.371 INFO:teuthology.orchestra.run.smithi181.stdout: "ino+": 721, 2024-01-31T05:14:53.371 INFO:teuthology.orchestra.run.smithi181.stdout: "ino-": 678, 2024-01-31T05:14:53.371 INFO:teuthology.orchestra.run.smithi181.stdout: "dir": 42, 2024-01-31T05:14:53.372 INFO:teuthology.orchestra.run.smithi181.stdout: "dir+": 224, 2024-01-31T05:14:53.372 INFO:teuthology.orchestra.run.smithi181.stdout: "dir-": 182, 2024-01-31T05:14:53.372 INFO:teuthology.orchestra.run.smithi181.stdout: "dn": 52, 2024-01-31T05:14:53.372 INFO:teuthology.orchestra.run.smithi181.stdout: "dn+": 1457, 2024-01-31T05:14:53.372 INFO:teuthology.orchestra.run.smithi181.stdout: "dn-": 1405, 2024-01-31T05:14:53.372 INFO:teuthology.orchestra.run.smithi181.stdout: "cap": 1, 2024-01-31T05:14:53.372 INFO:teuthology.orchestra.run.smithi181.stdout: "cap+": 916, 2024-01-31T05:14:53.372 INFO:teuthology.orchestra.run.smithi181.stdout: "cap-": 915, 2024-01-31T05:14:53.372 INFO:teuthology.orchestra.run.smithi181.stdout: "rss": 64788, 2024-01-31T05:14:53.372 INFO:teuthology.orchestra.run.smithi181.stdout: "heap": 199036 2024-01-31T05:14:53.372 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.372 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_server": { 2024-01-31T05:14:53.372 INFO:teuthology.orchestra.run.smithi181.stdout: "dispatch_client_request": 1938, 2024-01-31T05:14:53.373 INFO:teuthology.orchestra.run.smithi181.stdout: "dispatch_server_request": 198, 2024-01-31T05:14:53.373 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_request": 1275, 2024-01-31T05:14:53.373 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_session": 66, 2024-01-31T05:14:53.373 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_peer_request": 560, 2024-01-31T05:14:53.373 INFO:teuthology.orchestra.run.smithi181.stdout: "req_create_latency": { 2024-01-31T05:14:53.373 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 32, 2024-01-31T05:14:53.373 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.038894760, 2024-01-31T05:14:53.373 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.001215461 2024-01-31T05:14:53.373 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.373 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getattr_latency": { 2024-01-31T05:14:53.373 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 2, 2024-01-31T05:14:53.373 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.007844696, 2024-01-31T05:14:53.373 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.003922348 2024-01-31T05:14:53.373 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.374 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getfilelock_latency": { 2024-01-31T05:14:53.374 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:53.374 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:53.374 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:53.374 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.374 INFO:teuthology.orchestra.run.smithi181.stdout: "req_link_latency": { 2024-01-31T05:14:53.374 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 18, 2024-01-31T05:14:53.374 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.387879166, 2024-01-31T05:14:53.374 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.021548842 2024-01-31T05:14:53.374 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.374 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookup_latency": { 2024-01-31T05:14:53.374 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 473, 2024-01-31T05:14:53.374 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.187797247, 2024-01-31T05:14:53.374 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000397034 2024-01-31T05:14:53.375 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.375 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookuphash_latency": { 2024-01-31T05:14:53.375 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:53.375 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:53.375 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:53.375 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.375 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupino_latency": { 2024-01-31T05:14:53.375 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 1, 2024-01-31T05:14:53.375 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000133338, 2024-01-31T05:14:53.375 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000133338 2024-01-31T05:14:53.375 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.375 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupname_latency": { 2024-01-31T05:14:53.375 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:53.375 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:53.375 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:53.376 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.376 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupparent_latency": { 2024-01-31T05:14:53.376 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:53.376 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:53.376 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:53.376 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.376 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupsnap_latency": { 2024-01-31T05:14:53.376 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:53.376 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:53.376 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:53.376 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.376 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lssnap_latency": { 2024-01-31T05:14:53.376 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:53.376 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:53.377 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:53.377 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.377 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mkdir_latency": { 2024-01-31T05:14:53.377 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 14, 2024-01-31T05:14:53.377 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.016492385, 2024-01-31T05:14:53.378 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.001178027 2024-01-31T05:14:53.378 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.378 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mknod_latency": { 2024-01-31T05:14:53.378 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 14, 2024-01-31T05:14:53.378 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.020599053, 2024-01-31T05:14:53.378 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.001471360 2024-01-31T05:14:53.378 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.378 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mksnap_latency": { 2024-01-31T05:14:53.378 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:53.378 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:53.378 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:53.378 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.379 INFO:teuthology.orchestra.run.smithi181.stdout: "req_open_latency": { 2024-01-31T05:14:53.379 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:53.379 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:53.379 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:53.379 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.379 INFO:teuthology.orchestra.run.smithi181.stdout: "req_readdir_latency": { 2024-01-31T05:14:53.379 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 81, 2024-01-31T05:14:53.379 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.066694305, 2024-01-31T05:14:53.379 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000823386 2024-01-31T05:14:53.379 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.379 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rename_latency": { 2024-01-31T05:14:53.379 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 23, 2024-01-31T05:14:53.379 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.442979462, 2024-01-31T05:14:53.379 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.019259976 2024-01-31T05:14:53.380 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.380 INFO:teuthology.orchestra.run.smithi181.stdout: "req_renamesnap_latency": { 2024-01-31T05:14:53.380 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:53.380 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:53.380 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:53.380 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.380 INFO:teuthology.orchestra.run.smithi181.stdout: "req_snapdiff_latency": { 2024-01-31T05:14:53.380 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:53.380 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:53.380 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:53.380 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.380 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmdir_latency": { 2024-01-31T05:14:53.380 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 54, 2024-01-31T05:14:53.380 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.388435960, 2024-01-31T05:14:53.381 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.007193258 2024-01-31T05:14:53.381 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.381 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmsnap_latency": { 2024-01-31T05:14:53.381 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:53.381 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:53.381 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:53.381 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.381 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmxattr_latency": { 2024-01-31T05:14:53.381 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:53.381 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:53.381 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:53.381 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.381 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setattr_latency": { 2024-01-31T05:14:53.381 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 6, 2024-01-31T05:14:53.381 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.010070487, 2024-01-31T05:14:53.382 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.001678414 2024-01-31T05:14:53.382 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.382 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setdirlayout_latency": { 2024-01-31T05:14:53.382 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:53.382 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:53.382 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:53.382 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.382 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setfilelock_latency": { 2024-01-31T05:14:53.382 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:53.382 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:53.382 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:53.382 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.382 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setlayout_latency": { 2024-01-31T05:14:53.382 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:53.382 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:53.382 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:53.383 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.383 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setxattr_latency": { 2024-01-31T05:14:53.383 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:53.383 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:53.383 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:53.383 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.383 INFO:teuthology.orchestra.run.smithi181.stdout: "req_symlink_latency": { 2024-01-31T05:14:53.383 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 11, 2024-01-31T05:14:53.383 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.009871756, 2024-01-31T05:14:53.383 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000897432 2024-01-31T05:14:53.383 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.383 INFO:teuthology.orchestra.run.smithi181.stdout: "req_unlink_latency": { 2024-01-31T05:14:53.383 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 507, 2024-01-31T05:14:53.383 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.791080026, 2024-01-31T05:14:53.383 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.001560315 2024-01-31T05:14:53.384 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.384 INFO:teuthology.orchestra.run.smithi181.stdout: "cap_revoke_eviction": 0, 2024-01-31T05:14:53.384 INFO:teuthology.orchestra.run.smithi181.stdout: "cap_acquisition_throttle": 0, 2024-01-31T05:14:53.384 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getvxattr_latency": { 2024-01-31T05:14:53.384 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:53.384 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:53.384 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:53.384 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-01-31T05:14:53.384 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.384 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_sessions": { 2024-01-31T05:14:53.384 INFO:teuthology.orchestra.run.smithi181.stdout: "session_count": 1, 2024-01-31T05:14:53.385 INFO:teuthology.orchestra.run.smithi181.stdout: "session_add": 2, 2024-01-31T05:14:53.385 INFO:teuthology.orchestra.run.smithi181.stdout: "session_remove": 1, 2024-01-31T05:14:53.385 INFO:teuthology.orchestra.run.smithi181.stdout: "sessions_open": 1, 2024-01-31T05:14:53.385 INFO:teuthology.orchestra.run.smithi181.stdout: "sessions_stale": 0, 2024-01-31T05:14:53.385 INFO:teuthology.orchestra.run.smithi181.stdout: "total_load": 901, 2024-01-31T05:14:53.385 INFO:teuthology.orchestra.run.smithi181.stdout: "average_load": 901, 2024-01-31T05:14:53.385 INFO:teuthology.orchestra.run.smithi181.stdout: "avg_session_uptime": 205, 2024-01-31T05:14:53.385 INFO:teuthology.orchestra.run.smithi181.stdout: "mdthresh_evicted": 0 2024-01-31T05:14:53.385 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.385 INFO:teuthology.orchestra.run.smithi181.stdout: "mempool": { 2024-01-31T05:14:53.385 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_bytes": 0, 2024-01-31T05:14:53.385 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_items": 0, 2024-01-31T05:14:53.385 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_bytes": 0, 2024-01-31T05:14:53.386 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_items": 0, 2024-01-31T05:14:53.386 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_bytes": 0, 2024-01-31T05:14:53.386 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_items": 0, 2024-01-31T05:14:53.386 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_bytes": 0, 2024-01-31T05:14:53.386 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_items": 0, 2024-01-31T05:14:53.386 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_bytes": 0, 2024-01-31T05:14:53.386 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_items": 0, 2024-01-31T05:14:53.386 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_bytes": 0, 2024-01-31T05:14:53.386 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_items": 0, 2024-01-31T05:14:53.386 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_bytes": 0, 2024-01-31T05:14:53.386 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_items": 0, 2024-01-31T05:14:53.386 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_bytes": 0, 2024-01-31T05:14:53.386 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_items": 0, 2024-01-31T05:14:53.386 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_bytes": 0, 2024-01-31T05:14:53.387 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_items": 0, 2024-01-31T05:14:53.387 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_bytes": 0, 2024-01-31T05:14:53.387 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_items": 0, 2024-01-31T05:14:53.387 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_bytes": 0, 2024-01-31T05:14:53.387 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_items": 0, 2024-01-31T05:14:53.387 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_bytes": 0, 2024-01-31T05:14:53.387 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_items": 0, 2024-01-31T05:14:53.387 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_bytes": 0, 2024-01-31T05:14:53.387 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_items": 0, 2024-01-31T05:14:53.387 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_bytes": 0, 2024-01-31T05:14:53.387 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_items": 0, 2024-01-31T05:14:53.387 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_bytes": 0, 2024-01-31T05:14:53.387 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_items": 0, 2024-01-31T05:14:53.387 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_bytes": 0, 2024-01-31T05:14:53.388 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_items": 0, 2024-01-31T05:14:53.388 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_bytes": 0, 2024-01-31T05:14:53.388 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_items": 0, 2024-01-31T05:14:53.388 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_bytes": 0, 2024-01-31T05:14:53.388 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_items": 0, 2024-01-31T05:14:53.388 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_bytes": 310503, 2024-01-31T05:14:53.388 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_items": 124, 2024-01-31T05:14:53.388 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_bytes": 0, 2024-01-31T05:14:53.388 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_items": 0, 2024-01-31T05:14:53.388 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_bytes": 0, 2024-01-31T05:14:53.388 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_items": 0, 2024-01-31T05:14:53.388 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_bytes": 0, 2024-01-31T05:14:53.388 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_items": 0, 2024-01-31T05:14:53.389 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_bytes": 0, 2024-01-31T05:14:53.389 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_items": 0, 2024-01-31T05:14:53.389 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_bytes": 7240, 2024-01-31T05:14:53.389 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_items": 152, 2024-01-31T05:14:53.389 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_bytes": 0, 2024-01-31T05:14:53.389 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_items": 0, 2024-01-31T05:14:53.389 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_bytes": 0, 2024-01-31T05:14:53.389 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_items": 0, 2024-01-31T05:14:53.389 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_bytes": 189284, 2024-01-31T05:14:53.389 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_items": 2003, 2024-01-31T05:14:53.389 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_bytes": 0, 2024-01-31T05:14:53.389 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_items": 0, 2024-01-31T05:14:53.389 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_bytes": 0, 2024-01-31T05:14:53.390 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_items": 0 2024-01-31T05:14:53.390 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.390 INFO:teuthology.orchestra.run.smithi181.stdout: "objecter": { 2024-01-31T05:14:53.390 INFO:teuthology.orchestra.run.smithi181.stdout: "op_active": 0, 2024-01-31T05:14:53.390 INFO:teuthology.orchestra.run.smithi181.stdout: "op_laggy": 0, 2024-01-31T05:14:53.390 INFO:teuthology.orchestra.run.smithi181.stdout: "op_send": 1688, 2024-01-31T05:14:53.390 INFO:teuthology.orchestra.run.smithi181.stdout: "op_send_bytes": 4327559, 2024-01-31T05:14:53.390 INFO:teuthology.orchestra.run.smithi181.stdout: "op_resend": 28, 2024-01-31T05:14:53.390 INFO:teuthology.orchestra.run.smithi181.stdout: "op_reply": 1688, 2024-01-31T05:14:53.391 INFO:teuthology.orchestra.run.smithi181.stdout: "op_latency": { 2024-01-31T05:14:53.391 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 1688, 2024-01-31T05:14:53.391 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 3.876921824, 2024-01-31T05:14:53.391 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.002296754 2024-01-31T05:14:53.391 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.391 INFO:teuthology.orchestra.run.smithi181.stdout: "op_inflight": 0, 2024-01-31T05:14:53.391 INFO:teuthology.orchestra.run.smithi181.stdout: "oplen_avg": { 2024-01-31T05:14:53.391 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 1688, 2024-01-31T05:14:53.391 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 1739 2024-01-31T05:14:53.391 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.391 INFO:teuthology.orchestra.run.smithi181.stdout: "op": 1688, 2024-01-31T05:14:53.391 INFO:teuthology.orchestra.run.smithi181.stdout: "op_r": 499, 2024-01-31T05:14:53.392 INFO:teuthology.orchestra.run.smithi181.stdout: "op_w": 1189, 2024-01-31T05:14:53.392 INFO:teuthology.orchestra.run.smithi181.stdout: "op_rmw": 0, 2024-01-31T05:14:53.392 INFO:teuthology.orchestra.run.smithi181.stdout: "op_pg": 0, 2024-01-31T05:14:53.392 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_stat": 0, 2024-01-31T05:14:53.392 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_create": 10, 2024-01-31T05:14:53.392 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_read": 71, 2024-01-31T05:14:53.392 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_write": 503, 2024-01-31T05:14:53.392 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_writefull": 52, 2024-01-31T05:14:53.392 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_writesame": 0, 2024-01-31T05:14:53.392 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_append": 0, 2024-01-31T05:14:53.393 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_zero": 0, 2024-01-31T05:14:53.393 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_truncate": 0, 2024-01-31T05:14:53.393 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_delete": 585, 2024-01-31T05:14:53.393 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_mapext": 0, 2024-01-31T05:14:53.393 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_sparse_read": 0, 2024-01-31T05:14:53.393 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_clonerange": 0, 2024-01-31T05:14:53.393 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_getxattr": 428, 2024-01-31T05:14:53.393 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_setxattr": 20, 2024-01-31T05:14:53.393 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_cmpxattr": 0, 2024-01-31T05:14:53.393 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_rmxattr": 0, 2024-01-31T05:14:53.393 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_resetxattrs": 0, 2024-01-31T05:14:53.393 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_call": 0, 2024-01-31T05:14:53.394 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_watch": 0, 2024-01-31T05:14:53.394 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_notify": 0, 2024-01-31T05:14:53.394 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_src_cmpxattr": 0, 2024-01-31T05:14:53.394 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_pgls": 0, 2024-01-31T05:14:53.394 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_pgls_filter": 0, 2024-01-31T05:14:53.394 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_other": 8, 2024-01-31T05:14:53.394 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_active": 0, 2024-01-31T05:14:53.394 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_send": 0, 2024-01-31T05:14:53.394 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_resend": 0, 2024-01-31T05:14:53.394 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_ping": 0, 2024-01-31T05:14:53.395 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_active": 0, 2024-01-31T05:14:53.395 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_send": 0, 2024-01-31T05:14:53.395 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_resend": 0, 2024-01-31T05:14:53.395 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_active": 0, 2024-01-31T05:14:53.395 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_send": 0, 2024-01-31T05:14:53.395 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_resend": 0, 2024-01-31T05:14:53.395 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_active": 0, 2024-01-31T05:14:53.395 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_send": 0, 2024-01-31T05:14:53.395 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_resend": 0, 2024-01-31T05:14:53.395 INFO:teuthology.orchestra.run.smithi181.stdout: "command_active": 0, 2024-01-31T05:14:53.395 INFO:teuthology.orchestra.run.smithi181.stdout: "command_send": 0, 2024-01-31T05:14:53.396 INFO:teuthology.orchestra.run.smithi181.stdout: "command_resend": 0, 2024-01-31T05:14:53.396 INFO:teuthology.orchestra.run.smithi181.stdout: "map_epoch": 88, 2024-01-31T05:14:53.396 INFO:teuthology.orchestra.run.smithi181.stdout: "map_full": 0, 2024-01-31T05:14:53.396 INFO:teuthology.orchestra.run.smithi181.stdout: "map_inc": 2, 2024-01-31T05:14:53.396 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_sessions": 12, 2024-01-31T05:14:53.396 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_session_open": 12, 2024-01-31T05:14:53.396 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_session_close": 0, 2024-01-31T05:14:53.396 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_laggy": 0, 2024-01-31T05:14:53.396 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_wr": 44, 2024-01-31T05:14:53.396 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_rd": 4, 2024-01-31T05:14:53.397 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_del": 14 2024-01-31T05:14:53.397 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.397 INFO:teuthology.orchestra.run.smithi181.stdout: "oft": { 2024-01-31T05:14:53.397 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_objs": 1, 2024-01-31T05:14:53.397 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_kv_pairs": 0, 2024-01-31T05:14:53.397 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_updates": 0, 2024-01-31T05:14:53.397 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_removes": 0 2024-01-31T05:14:53.397 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.397 INFO:teuthology.orchestra.run.smithi181.stdout: "osd-slow-ops": { 2024-01-31T05:14:53.397 INFO:teuthology.orchestra.run.smithi181.stdout: "slow_ops_count": 0 2024-01-31T05:14:53.398 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.398 INFO:teuthology.orchestra.run.smithi181.stdout: "purge_queue": { 2024-01-31T05:14:53.398 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_ops": 0, 2024-01-31T05:14:53.398 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_ops_high_water": 8, 2024-01-31T05:14:53.398 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing": 0, 2024-01-31T05:14:53.398 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_high_water": 6, 2024-01-31T05:14:53.398 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executed_ops": 572, 2024-01-31T05:14:53.398 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executed": 531, 2024-01-31T05:14:53.398 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_item_in_journal": 0 2024-01-31T05:14:53.399 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.399 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-01-31T05:14:53.399 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-01-31T05:14:53.399 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-01-31T05:14:53.399 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-01-31T05:14:53.399 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 12268, 2024-01-31T05:14:53.399 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 4330782, 2024-01-31T05:14:53.399 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:53.399 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 12268, 2024-01-31T05:14:53.399 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-01-31T05:14:53.400 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-01-31T05:14:53.400 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 12268, 2024-01-31T05:14:53.400 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 4330782, 2024-01-31T05:14:53.400 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-01-31T05:14:53.400 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:53.400 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:53.400 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:53.400 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-01-31T05:14:53.400 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.401 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-objecter_bytes": { 2024-01-31T05:14:53.401 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-01-31T05:14:53.401 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-01-31T05:14:53.401 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-01-31T05:14:53.401 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-01-31T05:14:53.401 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-01-31T05:14:53.401 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:53.401 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-01-31T05:14:53.401 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 1688, 2024-01-31T05:14:53.402 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 4381158, 2024-01-31T05:14:53.402 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 1688, 2024-01-31T05:14:53.402 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 4381158, 2024-01-31T05:14:53.402 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-01-31T05:14:53.402 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:53.402 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:53.402 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:53.402 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-01-31T05:14:53.402 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.402 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-objecter_ops": { 2024-01-31T05:14:53.403 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-01-31T05:14:53.403 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 1024, 2024-01-31T05:14:53.403 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-01-31T05:14:53.403 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-01-31T05:14:53.403 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-01-31T05:14:53.403 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:53.403 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-01-31T05:14:53.403 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 1688, 2024-01-31T05:14:53.403 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 1688, 2024-01-31T05:14:53.404 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 1688, 2024-01-31T05:14:53.404 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 1688, 2024-01-31T05:14:53.404 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-01-31T05:14:53.404 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:53.404 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:53.404 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:53.404 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-01-31T05:14:53.404 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.404 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-write_buf_throttle": { 2024-01-31T05:14:53.404 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-01-31T05:14:53.404 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 3758096384, 2024-01-31T05:14:53.405 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-01-31T05:14:53.405 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 531, 2024-01-31T05:14:53.405 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 53631, 2024-01-31T05:14:53.405 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:53.405 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 531, 2024-01-31T05:14:53.405 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-01-31T05:14:53.405 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-01-31T05:14:53.405 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 71, 2024-01-31T05:14:53.405 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 53631, 2024-01-31T05:14:53.405 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-01-31T05:14:53.405 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:53.405 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:53.405 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:53.405 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-01-31T05:14:53.405 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:53.406 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-write_buf_throttle-0x56120e1886e0": { 2024-01-31T05:14:53.406 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-01-31T05:14:53.406 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 3758096384, 2024-01-31T05:14:53.406 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-01-31T05:14:53.406 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 2081, 2024-01-31T05:14:53.406 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 4201760, 2024-01-31T05:14:53.406 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:53.406 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 2081, 2024-01-31T05:14:53.406 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-01-31T05:14:53.406 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-01-31T05:14:53.406 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 432, 2024-01-31T05:14:53.406 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 4201760, 2024-01-31T05:14:53.406 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-01-31T05:14:53.407 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:53.407 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:53.407 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:53.407 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-01-31T05:14:53.407 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-01-31T05:14:53.407 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-01-31T05:14:53.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:14:53 smithi099 ceph-mon[31615]: pgmap v454: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 12 op/s 2024-01-31T05:14:53.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:14:53 smithi181 ceph-mon[36434]: pgmap v454: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 12 op/s 2024-01-31T05:14:53.632 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:14:53 smithi179 ceph-mon[35652]: pgmap v454: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 12 op/s 2024-01-31T05:14:54.197 INFO:tasks.check_counter:Daemon mds.i mds.exported=30 2024-01-31T05:14:54.197 INFO:tasks.check_counter:Daemon mds.i mds.imported=44 2024-01-31T05:14:54.197 DEBUG:tasks.check_counter:Getting stats from l 2024-01-31T05:14:54.198 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 -- ceph daemon mds.l perf dump 2024-01-31T05:14:54.435 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/mon.c/config 2024-01-31T05:14:55.813 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:14:55 smithi181 ceph-mon[36434]: pgmap v455: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-01-31T05:14:56.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:14:55 smithi099 ceph-mon[31615]: pgmap v455: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-01-31T05:14:56.103 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-01-31T05:14:56.103 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-0": { 2024-01-31T05:14:56.103 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 691, 2024-01-31T05:14:56.103 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 691, 2024-01-31T05:14:56.103 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 4399811, 2024-01-31T05:14:56.103 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 214106, 2024-01-31T05:14:56.103 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 7, 2024-01-31T05:14:56.103 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 3, 2024-01-31T05:14:56.103 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.068053794, 2024-01-31T05:14:56.104 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.022245802, 2024-01-31T05:14:56.104 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.018934599, 2024-01-31T05:14:56.104 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.020177165, 2024-01-31T05:14:56.104 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-01-31T05:14:56.104 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 690, 2024-01-31T05:14:56.104 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.026994467, 2024-01-31T05:14:56.104 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000039122 2024-01-31T05:14:56.104 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.104 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-01-31T05:14:56.104 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:56.104 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:56.104 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:56.104 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.105 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-01-31T05:14:56.105 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 448 2024-01-31T05:14:56.105 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.105 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-1": { 2024-01-31T05:14:56.105 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 4, 2024-01-31T05:14:56.105 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 81, 2024-01-31T05:14:56.105 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 1550, 2024-01-31T05:14:56.105 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 206425, 2024-01-31T05:14:56.105 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 5, 2024-01-31T05:14:56.105 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 4, 2024-01-31T05:14:56.105 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.006003247, 2024-01-31T05:14:56.105 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.003170359, 2024-01-31T05:14:56.105 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.001841306, 2024-01-31T05:14:56.105 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.000132600, 2024-01-31T05:14:56.105 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-01-31T05:14:56.106 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 79, 2024-01-31T05:14:56.106 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.007377441, 2024-01-31T05:14:56.106 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000093385 2024-01-31T05:14:56.106 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.106 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-01-31T05:14:56.106 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:56.106 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:56.106 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:56.106 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.106 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 160, 2024-01-31T05:14:56.106 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 205424 2024-01-31T05:14:56.106 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.106 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-2": { 2024-01-31T05:14:56.106 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 419, 2024-01-31T05:14:56.107 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 395, 2024-01-31T05:14:56.107 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 4193259, 2024-01-31T05:14:56.107 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 150443, 2024-01-31T05:14:56.107 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 4, 2024-01-31T05:14:56.107 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 3, 2024-01-31T05:14:56.107 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.048335394, 2024-01-31T05:14:56.107 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.015965604, 2024-01-31T05:14:56.107 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.024207977, 2024-01-31T05:14:56.107 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.010325126, 2024-01-31T05:14:56.107 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-01-31T05:14:56.107 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 394, 2024-01-31T05:14:56.107 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.015507638, 2024-01-31T05:14:56.107 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000039359 2024-01-31T05:14:56.107 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.107 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-01-31T05:14:56.108 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:56.108 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:56.108 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:56.108 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.108 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 847232, 2024-01-31T05:14:56.108 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 61808 2024-01-31T05:14:56.108 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.108 INFO:teuthology.orchestra.run.smithi181.stdout: "cct": { 2024-01-31T05:14:56.108 INFO:teuthology.orchestra.run.smithi181.stdout: "total_workers": 1, 2024-01-31T05:14:56.108 INFO:teuthology.orchestra.run.smithi181.stdout: "unhealthy_workers": 0 2024-01-31T05:14:56.108 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.108 INFO:teuthology.orchestra.run.smithi181.stdout: "finisher-MDSRank": { 2024-01-31T05:14:56.108 INFO:teuthology.orchestra.run.smithi181.stdout: "queue_len": 0, 2024-01-31T05:14:56.108 INFO:teuthology.orchestra.run.smithi181.stdout: "complete_latency": { 2024-01-31T05:14:56.109 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 1660, 2024-01-31T05:14:56.109 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.044941420, 2024-01-31T05:14:56.109 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000027073 2024-01-31T05:14:56.109 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-01-31T05:14:56.109 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.109 INFO:teuthology.orchestra.run.smithi181.stdout: "finisher-PurgeQueue": { 2024-01-31T05:14:56.109 INFO:teuthology.orchestra.run.smithi181.stdout: "queue_len": 0, 2024-01-31T05:14:56.109 INFO:teuthology.orchestra.run.smithi181.stdout: "complete_latency": { 2024-01-31T05:14:56.109 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:56.109 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:56.109 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:56.109 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-01-31T05:14:56.109 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.109 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": { 2024-01-31T05:14:56.110 INFO:teuthology.orchestra.run.smithi181.stdout: "request": 0, 2024-01-31T05:14:56.110 INFO:teuthology.orchestra.run.smithi181.stdout: "reply": 0, 2024-01-31T05:14:56.110 INFO:teuthology.orchestra.run.smithi181.stdout: "reply_latency": { 2024-01-31T05:14:56.110 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:56.110 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:56.110 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:56.110 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.110 INFO:teuthology.orchestra.run.smithi181.stdout: "slow_reply": 0, 2024-01-31T05:14:56.110 INFO:teuthology.orchestra.run.smithi181.stdout: "forward": 0, 2024-01-31T05:14:56.110 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_fetch_complete": 0, 2024-01-31T05:14:56.110 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_fetch_keys": 0, 2024-01-31T05:14:56.110 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_commit": 0, 2024-01-31T05:14:56.110 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_split": 0, 2024-01-31T05:14:56.110 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_merge": 0, 2024-01-31T05:14:56.110 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes": 979, 2024-01-31T05:14:56.111 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_top": 2, 2024-01-31T05:14:56.111 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_bottom": 977, 2024-01-31T05:14:56.111 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_pin_tail": 0, 2024-01-31T05:14:56.111 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_pinned": 976, 2024-01-31T05:14:56.111 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_expired": 1, 2024-01-31T05:14:56.111 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_with_caps": 0, 2024-01-31T05:14:56.111 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": 0, 2024-01-31T05:14:56.111 INFO:teuthology.orchestra.run.smithi181.stdout: "subtrees": 1, 2024-01-31T05:14:56.111 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse": 0, 2024-01-31T05:14:56.111 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_hit": 0, 2024-01-31T05:14:56.111 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_forward": 0, 2024-01-31T05:14:56.111 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_discover": 0, 2024-01-31T05:14:56.111 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_dir_fetch": 0, 2024-01-31T05:14:56.111 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_remote_ino": 0, 2024-01-31T05:14:56.112 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_lock": 0, 2024-01-31T05:14:56.112 INFO:teuthology.orchestra.run.smithi181.stdout: "load_cent": 0, 2024-01-31T05:14:56.112 INFO:teuthology.orchestra.run.smithi181.stdout: "q": 0, 2024-01-31T05:14:56.112 INFO:teuthology.orchestra.run.smithi181.stdout: "exported": 0, 2024-01-31T05:14:56.112 INFO:teuthology.orchestra.run.smithi181.stdout: "exported_inodes": 0, 2024-01-31T05:14:56.112 INFO:teuthology.orchestra.run.smithi181.stdout: "imported": 0, 2024-01-31T05:14:56.112 INFO:teuthology.orchestra.run.smithi181.stdout: "imported_inodes": 0, 2024-01-31T05:14:56.112 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_dir_fetch": 0, 2024-01-31T05:14:56.112 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_backtrace_fetch": 0, 2024-01-31T05:14:56.112 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_peer_discover": 0, 2024-01-31T05:14:56.112 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rfiles": 0, 2024-01-31T05:14:56.112 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rbytes": 0, 2024-01-31T05:14:56.112 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rsnaps": 0, 2024-01-31T05:14:56.112 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_backtrace_fetch": 0, 2024-01-31T05:14:56.113 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_set_tag": 0, 2024-01-31T05:14:56.113 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_backtrace_repaired": 0, 2024-01-31T05:14:56.113 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_inotable_repaired": 0, 2024-01-31T05:14:56.113 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dir_inodes": 0, 2024-01-31T05:14:56.113 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dir_base_inodes": 0, 2024-01-31T05:14:56.113 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dirfrag_rstats": 0, 2024-01-31T05:14:56.113 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_file_inodes": 0, 2024-01-31T05:14:56.113 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_inode_file_caps": 0, 2024-01-31T05:14:56.113 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_revoke": 0, 2024-01-31T05:14:56.113 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_grant": 0, 2024-01-31T05:14:56.113 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_trunc": 0, 2024-01-31T05:14:56.113 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-01-31T05:14:56.113 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_flush_ack": 0, 2024-01-31T05:14:56.113 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_caps": 0, 2024-01-31T05:14:56.113 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_caps_dirty": 0, 2024-01-31T05:14:56.114 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_cap_release": 0, 2024-01-31T05:14:56.114 INFO:teuthology.orchestra.run.smithi181.stdout: "process_request_cap_release": 0 2024-01-31T05:14:56.114 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.114 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_cache": { 2024-01-31T05:14:56.114 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_update": 0, 2024-01-31T05:14:56.114 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_update_receipt": 0, 2024-01-31T05:14:56.114 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_try_discover": 0, 2024-01-31T05:14:56.114 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_send_discover": 0, 2024-01-31T05:14:56.114 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_handle_discover": 0, 2024-01-31T05:14:56.114 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays": 0, 2024-01-31T05:14:56.114 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays_delayed": 0, 2024-01-31T05:14:56.114 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays_enqueuing": 0, 2024-01-31T05:14:56.114 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_created": 0, 2024-01-31T05:14:56.114 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_enqueued": 0, 2024-01-31T05:14:56.114 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_reintegrated": 0, 2024-01-31T05:14:56.115 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_migrated": 0, 2024-01-31T05:14:56.115 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_processing": 0, 2024-01-31T05:14:56.115 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_enqueued": 0, 2024-01-31T05:14:56.115 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_prioritized": 0, 2024-01-31T05:14:56.115 INFO:teuthology.orchestra.run.smithi181.stdout: "recovery_started": 0, 2024-01-31T05:14:56.115 INFO:teuthology.orchestra.run.smithi181.stdout: "recovery_completed": 0, 2024-01-31T05:14:56.115 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_enqueue_scrub": 0, 2024-01-31T05:14:56.115 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_exportdir": 0, 2024-01-31T05:14:56.115 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_flush": 0, 2024-01-31T05:14:56.115 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_fragmentdir": 0, 2024-01-31T05:14:56.115 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_fragstats": 0, 2024-01-31T05:14:56.115 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_inodestats": 0 2024-01-31T05:14:56.115 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.115 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_log": { 2024-01-31T05:14:56.115 INFO:teuthology.orchestra.run.smithi181.stdout: "evlrg": 0, 2024-01-31T05:14:56.116 INFO:teuthology.orchestra.run.smithi181.stdout: "evadd": 0, 2024-01-31T05:14:56.116 INFO:teuthology.orchestra.run.smithi181.stdout: "evex": 0, 2024-01-31T05:14:56.116 INFO:teuthology.orchestra.run.smithi181.stdout: "evtrm": 0, 2024-01-31T05:14:56.116 INFO:teuthology.orchestra.run.smithi181.stdout: "ev": 3438, 2024-01-31T05:14:56.116 INFO:teuthology.orchestra.run.smithi181.stdout: "evexg": 0, 2024-01-31T05:14:56.116 INFO:teuthology.orchestra.run.smithi181.stdout: "evexd": 0, 2024-01-31T05:14:56.116 INFO:teuthology.orchestra.run.smithi181.stdout: "segadd": 0, 2024-01-31T05:14:56.116 INFO:teuthology.orchestra.run.smithi181.stdout: "segex": 0, 2024-01-31T05:14:56.116 INFO:teuthology.orchestra.run.smithi181.stdout: "segtrm": 0, 2024-01-31T05:14:56.116 INFO:teuthology.orchestra.run.smithi181.stdout: "seg": 5, 2024-01-31T05:14:56.116 INFO:teuthology.orchestra.run.smithi181.stdout: "segmjr": 2, 2024-01-31T05:14:56.116 INFO:teuthology.orchestra.run.smithi181.stdout: "segexg": 0, 2024-01-31T05:14:56.116 INFO:teuthology.orchestra.run.smithi181.stdout: "segexd": 0, 2024-01-31T05:14:56.116 INFO:teuthology.orchestra.run.smithi181.stdout: "expos": 4194304, 2024-01-31T05:14:56.117 INFO:teuthology.orchestra.run.smithi181.stdout: "wrpos": 11663207, 2024-01-31T05:14:56.117 INFO:teuthology.orchestra.run.smithi181.stdout: "rdpos": 11662069, 2024-01-31T05:14:56.117 INFO:teuthology.orchestra.run.smithi181.stdout: "jlat": { 2024-01-31T05:14:56.117 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:56.117 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:56.117 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:56.117 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.117 INFO:teuthology.orchestra.run.smithi181.stdout: "replayed": 3438 2024-01-31T05:14:56.117 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.117 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_mem": { 2024-01-31T05:14:56.117 INFO:teuthology.orchestra.run.smithi181.stdout: "ino": 15, 2024-01-31T05:14:56.117 INFO:teuthology.orchestra.run.smithi181.stdout: "ino+": 1043, 2024-01-31T05:14:56.117 INFO:teuthology.orchestra.run.smithi181.stdout: "ino-": 1028, 2024-01-31T05:14:56.117 INFO:teuthology.orchestra.run.smithi181.stdout: "dir": 13, 2024-01-31T05:14:56.117 INFO:teuthology.orchestra.run.smithi181.stdout: "dir+": 302, 2024-01-31T05:14:56.118 INFO:teuthology.orchestra.run.smithi181.stdout: "dir-": 289, 2024-01-31T05:14:56.118 INFO:teuthology.orchestra.run.smithi181.stdout: "dn": 979, 2024-01-31T05:14:56.118 INFO:teuthology.orchestra.run.smithi181.stdout: "dn+": 1968, 2024-01-31T05:14:56.118 INFO:teuthology.orchestra.run.smithi181.stdout: "dn-": 989, 2024-01-31T05:14:56.118 INFO:teuthology.orchestra.run.smithi181.stdout: "cap": 0, 2024-01-31T05:14:56.118 INFO:teuthology.orchestra.run.smithi181.stdout: "cap+": 0, 2024-01-31T05:14:56.118 INFO:teuthology.orchestra.run.smithi181.stdout: "cap-": 0, 2024-01-31T05:14:56.118 INFO:teuthology.orchestra.run.smithi181.stdout: "rss": 50208, 2024-01-31T05:14:56.118 INFO:teuthology.orchestra.run.smithi181.stdout: "heap": 207228 2024-01-31T05:14:56.118 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.118 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_server": { 2024-01-31T05:14:56.118 INFO:teuthology.orchestra.run.smithi181.stdout: "dispatch_client_request": 0, 2024-01-31T05:14:56.118 INFO:teuthology.orchestra.run.smithi181.stdout: "dispatch_server_request": 0, 2024-01-31T05:14:56.118 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_request": 0, 2024-01-31T05:14:56.119 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_session": 0, 2024-01-31T05:14:56.119 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_peer_request": 0, 2024-01-31T05:14:56.119 INFO:teuthology.orchestra.run.smithi181.stdout: "req_create_latency": { 2024-01-31T05:14:56.119 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:56.119 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:56.119 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:56.119 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.119 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getattr_latency": { 2024-01-31T05:14:56.119 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:56.119 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:56.119 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:56.119 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.120 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getfilelock_latency": { 2024-01-31T05:14:56.120 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:56.120 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:56.120 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:56.120 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.120 INFO:teuthology.orchestra.run.smithi181.stdout: "req_link_latency": { 2024-01-31T05:14:56.120 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:56.120 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:56.120 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:56.120 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.120 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookup_latency": { 2024-01-31T05:14:56.120 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:56.120 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:56.121 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:56.121 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.121 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookuphash_latency": { 2024-01-31T05:14:56.121 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:56.121 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:56.121 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:56.121 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.121 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupino_latency": { 2024-01-31T05:14:56.121 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:56.121 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:56.121 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:56.121 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.121 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupname_latency": { 2024-01-31T05:14:56.121 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:56.122 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:56.122 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:56.122 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.122 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupparent_latency": { 2024-01-31T05:14:56.122 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:56.122 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:56.122 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:56.122 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.122 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupsnap_latency": { 2024-01-31T05:14:56.122 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:56.122 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:56.122 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:56.122 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.122 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lssnap_latency": { 2024-01-31T05:14:56.122 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:56.123 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:56.123 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:56.123 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.123 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mkdir_latency": { 2024-01-31T05:14:56.123 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:56.123 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:56.123 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:56.124 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.124 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mknod_latency": { 2024-01-31T05:14:56.124 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:56.124 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:56.124 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:56.124 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.124 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mksnap_latency": { 2024-01-31T05:14:56.124 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:56.124 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:56.124 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:56.124 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.124 INFO:teuthology.orchestra.run.smithi181.stdout: "req_open_latency": { 2024-01-31T05:14:56.124 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:56.125 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:56.125 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:56.125 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.125 INFO:teuthology.orchestra.run.smithi181.stdout: "req_readdir_latency": { 2024-01-31T05:14:56.125 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:56.125 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:56.125 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:56.125 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.125 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rename_latency": { 2024-01-31T05:14:56.125 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:56.125 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:56.125 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:56.125 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.125 INFO:teuthology.orchestra.run.smithi181.stdout: "req_renamesnap_latency": { 2024-01-31T05:14:56.126 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:56.126 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:56.126 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:56.126 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.126 INFO:teuthology.orchestra.run.smithi181.stdout: "req_snapdiff_latency": { 2024-01-31T05:14:56.126 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:56.126 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:56.126 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:56.126 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.126 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmdir_latency": { 2024-01-31T05:14:56.126 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:56.126 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:56.126 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:56.126 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.126 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmsnap_latency": { 2024-01-31T05:14:56.127 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:56.127 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:56.127 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:56.127 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.127 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmxattr_latency": { 2024-01-31T05:14:56.127 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:56.127 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:56.127 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:56.127 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.127 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setattr_latency": { 2024-01-31T05:14:56.127 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:56.127 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:56.127 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:56.127 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.127 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setdirlayout_latency": { 2024-01-31T05:14:56.128 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:56.128 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:56.128 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:56.128 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.128 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setfilelock_latency": { 2024-01-31T05:14:56.128 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:56.128 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:56.128 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:56.128 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.128 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setlayout_latency": { 2024-01-31T05:14:56.128 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:56.128 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:56.128 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:56.128 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.128 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setxattr_latency": { 2024-01-31T05:14:56.129 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:56.129 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:56.129 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:56.129 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.129 INFO:teuthology.orchestra.run.smithi181.stdout: "req_symlink_latency": { 2024-01-31T05:14:56.129 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:56.129 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:56.129 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:56.129 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.129 INFO:teuthology.orchestra.run.smithi181.stdout: "req_unlink_latency": { 2024-01-31T05:14:56.129 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:56.129 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:56.129 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:56.129 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.129 INFO:teuthology.orchestra.run.smithi181.stdout: "cap_revoke_eviction": 0, 2024-01-31T05:14:56.130 INFO:teuthology.orchestra.run.smithi181.stdout: "cap_acquisition_throttle": 0, 2024-01-31T05:14:56.130 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getvxattr_latency": { 2024-01-31T05:14:56.130 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:56.130 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:56.130 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:56.130 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-01-31T05:14:56.130 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.130 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_sessions": { 2024-01-31T05:14:56.130 INFO:teuthology.orchestra.run.smithi181.stdout: "session_count": 1, 2024-01-31T05:14:56.130 INFO:teuthology.orchestra.run.smithi181.stdout: "session_add": 2, 2024-01-31T05:14:56.130 INFO:teuthology.orchestra.run.smithi181.stdout: "session_remove": 1, 2024-01-31T05:14:56.130 INFO:teuthology.orchestra.run.smithi181.stdout: "sessions_open": 1, 2024-01-31T05:14:56.130 INFO:teuthology.orchestra.run.smithi181.stdout: "sessions_stale": 0, 2024-01-31T05:14:56.130 INFO:teuthology.orchestra.run.smithi181.stdout: "total_load": 0, 2024-01-31T05:14:56.130 INFO:teuthology.orchestra.run.smithi181.stdout: "average_load": 0, 2024-01-31T05:14:56.131 INFO:teuthology.orchestra.run.smithi181.stdout: "avg_session_uptime": 1858, 2024-01-31T05:14:56.131 INFO:teuthology.orchestra.run.smithi181.stdout: "mdthresh_evicted": 0 2024-01-31T05:14:56.131 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.131 INFO:teuthology.orchestra.run.smithi181.stdout: "mempool": { 2024-01-31T05:14:56.131 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_bytes": 0, 2024-01-31T05:14:56.131 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_items": 0, 2024-01-31T05:14:56.131 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_bytes": 0, 2024-01-31T05:14:56.131 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_items": 0, 2024-01-31T05:14:56.131 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_bytes": 0, 2024-01-31T05:14:56.131 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_items": 0, 2024-01-31T05:14:56.131 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_bytes": 0, 2024-01-31T05:14:56.131 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_items": 0, 2024-01-31T05:14:56.131 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_bytes": 0, 2024-01-31T05:14:56.131 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_items": 0, 2024-01-31T05:14:56.131 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_bytes": 0, 2024-01-31T05:14:56.132 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_items": 0, 2024-01-31T05:14:56.132 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_bytes": 0, 2024-01-31T05:14:56.132 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_items": 0, 2024-01-31T05:14:56.132 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_bytes": 0, 2024-01-31T05:14:56.132 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_items": 0, 2024-01-31T05:14:56.132 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_bytes": 0, 2024-01-31T05:14:56.132 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_items": 0, 2024-01-31T05:14:56.132 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_bytes": 0, 2024-01-31T05:14:56.132 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_items": 0, 2024-01-31T05:14:56.132 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_bytes": 0, 2024-01-31T05:14:56.132 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_items": 0, 2024-01-31T05:14:56.132 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_bytes": 0, 2024-01-31T05:14:56.132 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_items": 0, 2024-01-31T05:14:56.132 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_bytes": 0, 2024-01-31T05:14:56.133 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_items": 0, 2024-01-31T05:14:56.133 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_bytes": 0, 2024-01-31T05:14:56.133 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_items": 0, 2024-01-31T05:14:56.133 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_bytes": 0, 2024-01-31T05:14:56.133 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_items": 0, 2024-01-31T05:14:56.133 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_bytes": 0, 2024-01-31T05:14:56.133 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_items": 0, 2024-01-31T05:14:56.133 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_bytes": 0, 2024-01-31T05:14:56.133 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_items": 0, 2024-01-31T05:14:56.133 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_bytes": 0, 2024-01-31T05:14:56.133 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_items": 0, 2024-01-31T05:14:56.133 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_bytes": 206536, 2024-01-31T05:14:56.133 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_items": 68, 2024-01-31T05:14:56.133 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_bytes": 0, 2024-01-31T05:14:56.133 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_items": 0, 2024-01-31T05:14:56.134 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_bytes": 0, 2024-01-31T05:14:56.134 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_items": 0, 2024-01-31T05:14:56.134 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_bytes": 0, 2024-01-31T05:14:56.134 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_items": 0, 2024-01-31T05:14:56.134 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_bytes": 0, 2024-01-31T05:14:56.134 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_items": 0, 2024-01-31T05:14:56.134 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_bytes": 7240, 2024-01-31T05:14:56.134 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_items": 152, 2024-01-31T05:14:56.134 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_bytes": 0, 2024-01-31T05:14:56.134 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_items": 0, 2024-01-31T05:14:56.134 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_bytes": 0, 2024-01-31T05:14:56.134 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_items": 0, 2024-01-31T05:14:56.134 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_bytes": 741381, 2024-01-31T05:14:56.134 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_items": 5162, 2024-01-31T05:14:56.134 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_bytes": 0, 2024-01-31T05:14:56.135 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_items": 0, 2024-01-31T05:14:56.135 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_bytes": 0, 2024-01-31T05:14:56.135 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_items": 0 2024-01-31T05:14:56.135 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.135 INFO:teuthology.orchestra.run.smithi181.stdout: "objecter": { 2024-01-31T05:14:56.135 INFO:teuthology.orchestra.run.smithi181.stdout: "op_active": 0, 2024-01-31T05:14:56.135 INFO:teuthology.orchestra.run.smithi181.stdout: "op_laggy": 0, 2024-01-31T05:14:56.135 INFO:teuthology.orchestra.run.smithi181.stdout: "op_send": 975, 2024-01-31T05:14:56.135 INFO:teuthology.orchestra.run.smithi181.stdout: "op_send_bytes": 21, 2024-01-31T05:14:56.135 INFO:teuthology.orchestra.run.smithi181.stdout: "op_resend": 3, 2024-01-31T05:14:56.135 INFO:teuthology.orchestra.run.smithi181.stdout: "op_reply": 975, 2024-01-31T05:14:56.135 INFO:teuthology.orchestra.run.smithi181.stdout: "op_latency": { 2024-01-31T05:14:56.135 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 975, 2024-01-31T05:14:56.135 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 1.751964696, 2024-01-31T05:14:56.135 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.001796886 2024-01-31T05:14:56.135 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.136 INFO:teuthology.orchestra.run.smithi181.stdout: "op_inflight": 0, 2024-01-31T05:14:56.136 INFO:teuthology.orchestra.run.smithi181.stdout: "oplen_avg": { 2024-01-31T05:14:56.136 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 975, 2024-01-31T05:14:56.136 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 976 2024-01-31T05:14:56.136 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.136 INFO:teuthology.orchestra.run.smithi181.stdout: "op": 975, 2024-01-31T05:14:56.136 INFO:teuthology.orchestra.run.smithi181.stdout: "op_r": 975, 2024-01-31T05:14:56.136 INFO:teuthology.orchestra.run.smithi181.stdout: "op_w": 0, 2024-01-31T05:14:56.136 INFO:teuthology.orchestra.run.smithi181.stdout: "op_rmw": 0, 2024-01-31T05:14:56.136 INFO:teuthology.orchestra.run.smithi181.stdout: "op_pg": 0, 2024-01-31T05:14:56.136 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_stat": 570, 2024-01-31T05:14:56.136 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_create": 0, 2024-01-31T05:14:56.136 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_read": 403, 2024-01-31T05:14:56.136 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_write": 0, 2024-01-31T05:14:56.136 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_writefull": 0, 2024-01-31T05:14:56.137 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_writesame": 0, 2024-01-31T05:14:56.137 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_append": 0, 2024-01-31T05:14:56.137 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_zero": 0, 2024-01-31T05:14:56.137 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_truncate": 0, 2024-01-31T05:14:56.137 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_delete": 0, 2024-01-31T05:14:56.137 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_mapext": 0, 2024-01-31T05:14:56.137 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_sparse_read": 0, 2024-01-31T05:14:56.137 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_clonerange": 0, 2024-01-31T05:14:56.137 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_getxattr": 1, 2024-01-31T05:14:56.137 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_setxattr": 0, 2024-01-31T05:14:56.137 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_cmpxattr": 0, 2024-01-31T05:14:56.137 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_rmxattr": 0, 2024-01-31T05:14:56.137 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_resetxattrs": 0, 2024-01-31T05:14:56.137 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_call": 0, 2024-01-31T05:14:56.138 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_watch": 0, 2024-01-31T05:14:56.138 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_notify": 0, 2024-01-31T05:14:56.138 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_src_cmpxattr": 0, 2024-01-31T05:14:56.138 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_pgls": 0, 2024-01-31T05:14:56.138 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_pgls_filter": 0, 2024-01-31T05:14:56.138 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_other": 0, 2024-01-31T05:14:56.138 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_active": 0, 2024-01-31T05:14:56.138 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_send": 0, 2024-01-31T05:14:56.138 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_resend": 0, 2024-01-31T05:14:56.138 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_ping": 0, 2024-01-31T05:14:56.138 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_active": 0, 2024-01-31T05:14:56.138 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_send": 0, 2024-01-31T05:14:56.138 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_resend": 0, 2024-01-31T05:14:56.138 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_active": 0, 2024-01-31T05:14:56.138 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_send": 0, 2024-01-31T05:14:56.139 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_resend": 0, 2024-01-31T05:14:56.139 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_active": 0, 2024-01-31T05:14:56.139 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_send": 0, 2024-01-31T05:14:56.139 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_resend": 0, 2024-01-31T05:14:56.139 INFO:teuthology.orchestra.run.smithi181.stdout: "command_active": 0, 2024-01-31T05:14:56.139 INFO:teuthology.orchestra.run.smithi181.stdout: "command_send": 0, 2024-01-31T05:14:56.139 INFO:teuthology.orchestra.run.smithi181.stdout: "command_resend": 0, 2024-01-31T05:14:56.139 INFO:teuthology.orchestra.run.smithi181.stdout: "map_epoch": 88, 2024-01-31T05:14:56.139 INFO:teuthology.orchestra.run.smithi181.stdout: "map_full": 0, 2024-01-31T05:14:56.139 INFO:teuthology.orchestra.run.smithi181.stdout: "map_inc": 2, 2024-01-31T05:14:56.139 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_sessions": 7, 2024-01-31T05:14:56.139 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_session_open": 7, 2024-01-31T05:14:56.139 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_session_close": 0, 2024-01-31T05:14:56.139 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_laggy": 0, 2024-01-31T05:14:56.139 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_wr": 0, 2024-01-31T05:14:56.140 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_rd": 2, 2024-01-31T05:14:56.140 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_del": 0 2024-01-31T05:14:56.140 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.140 INFO:teuthology.orchestra.run.smithi181.stdout: "oft": { 2024-01-31T05:14:56.140 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_objs": 0, 2024-01-31T05:14:56.140 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_kv_pairs": 0, 2024-01-31T05:14:56.140 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_updates": 0, 2024-01-31T05:14:56.140 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_removes": 0 2024-01-31T05:14:56.140 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.140 INFO:teuthology.orchestra.run.smithi181.stdout: "osd-slow-ops": { 2024-01-31T05:14:56.140 INFO:teuthology.orchestra.run.smithi181.stdout: "slow_ops_count": 0 2024-01-31T05:14:56.140 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.140 INFO:teuthology.orchestra.run.smithi181.stdout: "purge_queue": { 2024-01-31T05:14:56.140 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_ops": 0, 2024-01-31T05:14:56.140 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_ops_high_water": 0, 2024-01-31T05:14:56.141 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing": 0, 2024-01-31T05:14:56.141 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_high_water": 0, 2024-01-31T05:14:56.141 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executed_ops": 0, 2024-01-31T05:14:56.141 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executed": 0, 2024-01-31T05:14:56.141 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_item_in_journal": 0 2024-01-31T05:14:56.141 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.141 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-01-31T05:14:56.141 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-01-31T05:14:56.141 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-01-31T05:14:56.141 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-01-31T05:14:56.141 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 1110, 2024-01-31T05:14:56.141 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 8484968, 2024-01-31T05:14:56.141 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:56.141 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 1110, 2024-01-31T05:14:56.141 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-01-31T05:14:56.142 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-01-31T05:14:56.142 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 1110, 2024-01-31T05:14:56.142 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 8484968, 2024-01-31T05:14:56.142 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-01-31T05:14:56.142 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:56.142 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:56.142 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:56.142 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-01-31T05:14:56.142 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.142 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-objecter_bytes": { 2024-01-31T05:14:56.142 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-01-31T05:14:56.142 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-01-31T05:14:56.142 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-01-31T05:14:56.142 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-01-31T05:14:56.142 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-01-31T05:14:56.143 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:56.143 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-01-31T05:14:56.143 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 975, 2024-01-31T05:14:56.143 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 7468908, 2024-01-31T05:14:56.143 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 975, 2024-01-31T05:14:56.143 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 7468908, 2024-01-31T05:14:56.143 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-01-31T05:14:56.143 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:56.143 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:56.143 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:56.143 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-01-31T05:14:56.143 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.143 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-objecter_ops": { 2024-01-31T05:14:56.143 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-01-31T05:14:56.143 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 1024, 2024-01-31T05:14:56.144 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-01-31T05:14:56.144 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-01-31T05:14:56.144 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-01-31T05:14:56.144 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:56.144 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-01-31T05:14:56.144 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 975, 2024-01-31T05:14:56.144 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 975, 2024-01-31T05:14:56.144 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 975, 2024-01-31T05:14:56.144 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 975, 2024-01-31T05:14:56.144 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-01-31T05:14:56.144 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:56.144 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:56.144 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:56.144 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-01-31T05:14:56.144 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.145 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-write_buf_throttle": { 2024-01-31T05:14:56.145 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-01-31T05:14:56.145 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 3758096384, 2024-01-31T05:14:56.145 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-01-31T05:14:56.145 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-01-31T05:14:56.145 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-01-31T05:14:56.145 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:56.145 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-01-31T05:14:56.145 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-01-31T05:14:56.145 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-01-31T05:14:56.145 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 0, 2024-01-31T05:14:56.145 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 0, 2024-01-31T05:14:56.145 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-01-31T05:14:56.145 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:56.145 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:56.146 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:56.146 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-01-31T05:14:56.146 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-01-31T05:14:56.146 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-write_buf_throttle-0x5618d2ff4960": { 2024-01-31T05:14:56.146 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-01-31T05:14:56.146 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 3758096384, 2024-01-31T05:14:56.146 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-01-31T05:14:56.146 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-01-31T05:14:56.146 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-01-31T05:14:56.146 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-01-31T05:14:56.146 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-01-31T05:14:56.146 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-01-31T05:14:56.146 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-01-31T05:14:56.146 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 0, 2024-01-31T05:14:56.146 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 0, 2024-01-31T05:14:56.147 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-01-31T05:14:56.147 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-01-31T05:14:56.147 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-01-31T05:14:56.147 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-01-31T05:14:56.147 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-01-31T05:14:56.147 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-01-31T05:14:56.147 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-01-31T05:14:56.147 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:14:55 smithi179 ceph-mon[35652]: pgmap v455: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-01-31T05:14:56.755 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-01-31T05:14:56.755 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-01-31T05:14:56.755 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-01-31T05:14:56.767 INFO:tasks.kclient:Unmounting kernel clients... 2024-01-31T05:14:56.767 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-31T05:14:56.767 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-31T05:14:56.788 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-31T05:14:56.788 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-31T05:14:56.847 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:14:57.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:56.999+0000 7f67e3b1f640 1 -- 172.21.15.99:0/1939069527 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f67dc101fd0 msgr2=0x7f67dc102450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:57.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:56.999+0000 7f67e3b1f640 1 --2- 172.21.15.99:0/1939069527 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f67dc101fd0 0x7f67dc102450 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f67cc009900 tx=0x7f67cc02bc30 comp rx=0 tx=0).stop 2024-01-31T05:14:57.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:56.999+0000 7f67e3b1f640 1 -- 172.21.15.99:0/1939069527 shutdown_connections 2024-01-31T05:14:57.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:56.999+0000 7f67e3b1f640 1 --2- 172.21.15.99:0/1939069527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67dc102990 0x7f67dc109220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:57.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:56.999+0000 7f67e3b1f640 1 --2- 172.21.15.99:0/1939069527 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f67dc101fd0 0x7f67dc102450 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:57.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:56.999+0000 7f67e3b1f640 1 --2- 172.21.15.99:0/1939069527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f67dc0ff000 0x7f67dc0ff420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:57.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:56.999+0000 7f67e3b1f640 1 -- 172.21.15.99:0/1939069527 >> 172.21.15.99:0/1939069527 conn(0x7f67dc0fa930 msgr2=0x7f67dc0fcd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:14:57.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:56.999+0000 7f67e3b1f640 1 -- 172.21.15.99:0/1939069527 shutdown_connections 2024-01-31T05:14:57.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:56.999+0000 7f67e3b1f640 1 -- 172.21.15.99:0/1939069527 wait complete. 2024-01-31T05:14:57.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:56.999+0000 7f67e3b1f640 1 Processor -- start 2024-01-31T05:14:57.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:56.999+0000 7f67e3b1f640 1 -- start start 2024-01-31T05:14:57.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.000+0000 7f67e3b1f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f67dc0ff000 0x7f67dc196d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:57.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.000+0000 7f67e3b1f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67dc101fd0 0x7f67dc197250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:57.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.000+0000 7f67e3b1f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f67dc102990 0x7f67dc19e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:57.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.000+0000 7f67e3b1f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc19e7f0 con 0x7f67dc102990 2024-01-31T05:14:57.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.000+0000 7f67e3b1f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc19e960 con 0x7f67dc101fd0 2024-01-31T05:14:57.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.000+0000 7f67e3b1f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc19eb20 con 0x7f67dc0ff000 2024-01-31T05:14:57.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.000+0000 7f67e20bc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f67dc102990 0x7f67dc19e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:57.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.000+0000 7f67e20bc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f67dc102990 0x7f67dc19e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48390/0 (socket says 172.21.15.99:48390) 2024-01-31T05:14:57.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.000+0000 7f67e20bc640 1 -- 172.21.15.99:0/898009863 learned_addr learned my addr 172.21.15.99:0/898009863 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:14:57.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.000+0000 7f67e10ba640 1 --2- 172.21.15.99:0/898009863 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67dc101fd0 0x7f67dc197250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:57.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.000+0000 7f67e18bb640 1 --2- 172.21.15.99:0/898009863 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f67dc0ff000 0x7f67dc196d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:57.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.000+0000 7f67e20bc640 1 -- 172.21.15.99:0/898009863 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f67dc0ff000 msgr2=0x7f67dc196d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:57.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.000+0000 7f67e20bc640 1 --2- 172.21.15.99:0/898009863 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f67dc0ff000 0x7f67dc196d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:57.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.000+0000 7f67e20bc640 1 -- 172.21.15.99:0/898009863 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67dc101fd0 msgr2=0x7f67dc197250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:57.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.000+0000 7f67e20bc640 1 --2- 172.21.15.99:0/898009863 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67dc101fd0 0x7f67dc197250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:57.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.000+0000 7f67e20bc640 1 -- 172.21.15.99:0/898009863 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67cc009560 con 0x7f67dc102990 2024-01-31T05:14:57.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.000+0000 7f67e10ba640 1 --2- 172.21.15.99:0/898009863 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67dc101fd0 0x7f67dc197250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:14:57.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.000+0000 7f67e18bb640 1 --2- 172.21.15.99:0/898009863 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f67dc0ff000 0x7f67dc196d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:14:57.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.000+0000 7f67e20bc640 1 --2- 172.21.15.99:0/898009863 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f67dc102990 0x7f67dc19e280 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f67d400eb10 tx=0x7f67d400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:14:57.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.000+0000 7f67d2ffd640 1 -- 172.21.15.99:0/898009863 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d4004b20 con 0x7f67dc102990 2024-01-31T05:14:57.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.000+0000 7f67d2ffd640 1 -- 172.21.15.99:0/898009863 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f67d4004c80 con 0x7f67dc102990 2024-01-31T05:14:57.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.000+0000 7f67d2ffd640 1 -- 172.21.15.99:0/898009863 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d4010690 con 0x7f67dc102990 2024-01-31T05:14:57.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.000+0000 7f67e3b1f640 1 -- 172.21.15.99:0/898009863 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67dc19ee00 con 0x7f67dc102990 2024-01-31T05:14:57.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.000+0000 7f67e3b1f640 1 -- 172.21.15.99:0/898009863 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67dc19f230 con 0x7f67dc102990 2024-01-31T05:14:57.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.001+0000 7f67e3b1f640 1 -- 172.21.15.99:0/898009863 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67dc1081d0 con 0x7f67dc102990 2024-01-31T05:14:57.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.002+0000 7f67d2ffd640 1 -- 172.21.15.99:0/898009863 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 20) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f67d4005020 con 0x7f67dc102990 2024-01-31T05:14:57.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.003+0000 7f67d2ffd640 1 --2- 172.21.15.99:0/898009863 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f67c80a12e0 0x7f67c80a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:57.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.003+0000 7f67e18bb640 1 --2- 172.21.15.99:0/898009863 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f67c80a12e0 0x7f67c80a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:57.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.003+0000 7f67d2ffd640 1 -- 172.21.15.99:0/898009863 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f67d4014070 con 0x7f67dc102990 2024-01-31T05:14:57.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.003+0000 7f67e18bb640 1 --2- 172.21.15.99:0/898009863 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f67c80a12e0 0x7f67c80a37a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f67dc1981e0 tx=0x7f67d8005e90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:14:57.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.007+0000 7f67d2ffd640 1 -- 172.21.15.99:0/898009863 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f67d4096690 con 0x7f67dc102990 2024-01-31T05:14:57.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.179+0000 7f67e3b1f640 1 -- 172.21.15.99:0/898009863 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f67dc10c610 con 0x7f67dc102990 2024-01-31T05:14:57.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.181+0000 7f67d2ffd640 1 -- 172.21.15.99:0/898009863 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22426 (secure 0 0 0) 0x7f67d40985c0 con 0x7f67dc102990 2024-01-31T05:14:57.181 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:14:57.182 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":88,"fsid":"9288ff44-bff5-11ee-95b3-87774f69a715","created":"2024-01-31T05:01:26.130917+0000","modified":"2024-01-31T05:10:21.675877+0000","last_up_change":"2024-01-31T05:08:31.228478+0000","last_in_change":"2024-01-31T05:08:10.799511+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:46.842423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:09:18.693558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-31T05:09:19.734003+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b45878d9-28f1-4821-ba72-26a32d3fc780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6803","nonce":1213805280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6805","nonce":1213805280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6809","nonce":1213805280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6807","nonce":1213805280}]},"public_addr":"172.21.15.99:6803/1213805280","cluster_addr":"172.21.15.99:6805/1213805280","heartbeat_back_addr":"172.21.15.99:6809/1213805280","heartbeat_front_addr":"172.21.15.99:6807/1213805280","state":["exists","up"]},{"osd":1,"uuid":"e0b71ff3-5d97-4659-8dea-4c9091e1beb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6801","nonce":2019451677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6803","nonce":2019451677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6807","nonce":2019451677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6805","nonce":2019451677}]},"public_addr":"172.21.15.179:6801/2019451677","cluster_addr":"172.21.15.179:6803/2019451677","heartbeat_back_addr":"172.21.15.179:6807/2019451677","heartbeat_front_addr":"172.21.15.179:6805/2019451677","state":["exists","up"]},{"osd":2,"uuid":"11c919c8-19a9-48b0-8880-3002efcb64f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6801","nonce":3934284457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6803","nonce":3934284457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6807","nonce":3934284457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6805","nonce":3934284457}]},"public_addr":"172.21.15.181:6801/3934284457","cluster_addr":"172.21.15.181:6803/3934284457","heartbeat_back_addr":"172.21.15.181:6807/3934284457","heartbeat_front_addr":"172.21.15.181:6805/3934284457","state":["exists","up"]},{"osd":3,"uuid":"bcab5135-a5d1-45ae-a9b8-674425d3999e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6811","nonce":4207675427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6813","nonce":4207675427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6817","nonce":4207675427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6815","nonce":4207675427}]},"public_addr":"172.21.15.99:6811/4207675427","cluster_addr":"172.21.15.99:6813/4207675427","heartbeat_back_addr":"172.21.15.99:6817/4207675427","heartbeat_front_addr":"172.21.15.99:6815/4207675427","state":["exists","up"]},{"osd":4,"uuid":"0250d7ac-3894-457a-9c04-cc7205d61eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6809","nonce":2861083896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6811","nonce":2861083896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6815","nonce":2861083896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6813","nonce":2861083896}]},"public_addr":"172.21.15.179:6809/2861083896","cluster_addr":"172.21.15.179:6811/2861083896","heartbeat_back_addr":"172.21.15.179:6815/2861083896","heartbeat_front_addr":"172.21.15.179:6813/2861083896","state":["exists","up"]},{"osd":5,"uuid":"5e19222a-c2a4-45bc-8445-1d302f26d11c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6809","nonce":1485017095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6811","nonce":1485017095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6815","nonce":1485017095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6813","nonce":1485017095}]},"public_addr":"172.21.15.181:6809/1485017095","cluster_addr":"172.21.15.181:6811/1485017095","heartbeat_back_addr":"172.21.15.181:6815/1485017095","heartbeat_front_addr":"172.21.15.181:6813/1485017095","state":["exists","up"]},{"osd":6,"uuid":"56555035-f9fc-4e91-96dd-caa632d58adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6819","nonce":1534047839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6821","nonce":1534047839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6825","nonce":1534047839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6823","nonce":1534047839}]},"public_addr":"172.21.15.99:6819/1534047839","cluster_addr":"172.21.15.99:6821/1534047839","heartbeat_back_addr":"172.21.15.99:6825/1534047839","heartbeat_front_addr":"172.21.15.99:6823/1534047839","state":["exists","up"]},{"osd":7,"uuid":"5e079cf5-1340-4599-88a6-df410ef0148e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6817","nonce":3875950553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6819","nonce":3875950553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6823","nonce":3875950553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6821","nonce":3875950553}]},"public_addr":"172.21.15.179:6817/3875950553","cluster_addr":"172.21.15.179:6819/3875950553","heartbeat_back_addr":"172.21.15.179:6823/3875950553","heartbeat_front_addr":"172.21.15.179:6821/3875950553","state":["exists","up"]},{"osd":8,"uuid":"10a73592-4251-4492-b67d-ce9b9d7fff32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6817","nonce":179568936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6819","nonce":179568936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6823","nonce":179568936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6821","nonce":179568936}]},"public_addr":"172.21.15.181:6817/179568936","cluster_addr":"172.21.15.181:6819/179568936","heartbeat_back_addr":"172.21.15.181:6823/179568936","heartbeat_front_addr":"172.21.15.181:6821/179568936","state":["exists","up"]},{"osd":9,"uuid":"f6620e1e-f761-4f1c-917f-cbc748df32a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6827","nonce":315759515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6829","nonce":315759515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6833","nonce":315759515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6831","nonce":315759515}]},"public_addr":"172.21.15.99:6827/315759515","cluster_addr":"172.21.15.99:6829/315759515","heartbeat_back_addr":"172.21.15.99:6833/315759515","heartbeat_front_addr":"172.21.15.99:6831/315759515","state":["exists","up"]},{"osd":10,"uuid":"ee86af7d-66f8-4795-bcc3-dfec79e4680c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6825","nonce":2985063934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6827","nonce":2985063934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6831","nonce":2985063934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6829","nonce":2985063934}]},"public_addr":"172.21.15.179:6825/2985063934","cluster_addr":"172.21.15.179:6827/2985063934","heartbeat_back_addr":"172.21.15.179:6831/2985063934","heartbeat_front_addr":"172.21.15.179:6829/2985063934","state":["exists","up"]},{"osd":11,"uuid":"82f04fee-f6ae-4630-a75b-b12a9c4ab2e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6825","nonce":1858219600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6827","nonce":1858219600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6831","nonce":1858219600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6829","nonce":1858219600}]},"public_addr":"172.21.15.181:6825/1858219600","cluster_addr":"172.21.15.181:6827/1858219600","heartbeat_back_addr":"172.21.15.181:6831/1858219600","heartbeat_front_addr":"172.21.15.181:6829/1858219600","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:55.518970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:04:19.936339+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:04:44.064814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:09.331683+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:34.616774+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:58.881810+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:06:23.869838+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:06:49.127331+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:07:12.847187+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:07:38.231045+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:08:03.949162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:08:28.471802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:0/401101729":"2024-02-01T05:02:20.510858+0000","172.21.15.99:6801/1993198206":"2024-02-01T05:02:20.510858+0000","172.21.15.99:0/3819754569":"2024-02-01T05:02:20.510858+0000","172.21.15.99:0/475390265":"2024-02-01T05:01:53.732026+0000","172.21.15.99:6800/1993198206":"2024-02-01T05:02:20.510858+0000","172.21.15.99:6800/1706888338":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/4150146075":"2024-02-01T05:01:53.732026+0000","172.21.15.99:6801/1706888338":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/2851066598":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/1865156424":"2024-02-01T05:02:20.510858+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:14:57.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.184+0000 7f67e3b1f640 1 -- 172.21.15.99:0/898009863 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f67c80a12e0 msgr2=0x7f67c80a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:57.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.184+0000 7f67e3b1f640 1 --2- 172.21.15.99:0/898009863 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f67c80a12e0 0x7f67c80a37a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f67dc1981e0 tx=0x7f67d8005e90 comp rx=0 tx=0).stop 2024-01-31T05:14:57.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.184+0000 7f67e3b1f640 1 -- 172.21.15.99:0/898009863 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f67dc102990 msgr2=0x7f67dc19e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:57.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.184+0000 7f67e3b1f640 1 --2- 172.21.15.99:0/898009863 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f67dc102990 0x7f67dc19e280 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f67d400eb10 tx=0x7f67d400c2d0 comp rx=0 tx=0).stop 2024-01-31T05:14:57.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.184+0000 7f67e3b1f640 1 -- 172.21.15.99:0/898009863 shutdown_connections 2024-01-31T05:14:57.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.184+0000 7f67e3b1f640 1 --2- 172.21.15.99:0/898009863 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f67c80a12e0 0x7f67c80a37a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:57.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.184+0000 7f67e3b1f640 1 --2- 172.21.15.99:0/898009863 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f67dc102990 0x7f67dc19e280 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:57.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.184+0000 7f67e3b1f640 1 --2- 172.21.15.99:0/898009863 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67dc101fd0 0x7f67dc197250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:57.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.184+0000 7f67e3b1f640 1 --2- 172.21.15.99:0/898009863 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f67dc0ff000 0x7f67dc196d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:57.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.184+0000 7f67e3b1f640 1 -- 172.21.15.99:0/898009863 >> 172.21.15.99:0/898009863 conn(0x7f67dc0fa930 msgr2=0x7f67dc1053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:14:57.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.184+0000 7f67e3b1f640 1 -- 172.21.15.99:0/898009863 shutdown_connections 2024-01-31T05:14:57.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.184+0000 7f67e3b1f640 1 -- 172.21.15.99:0/898009863 wait complete. 2024-01-31T05:14:57.195 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-31T05:04:46.842423+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-31T05:09:18.693558+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-31T05:09:19.734003+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-31T05:14:57.195 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-31T05:14:57.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.301+0000 7fe062db1640 1 -- 172.21.15.99:0/600442881 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe05c0fed60 msgr2=0x7fe05c0ff1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:57.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.301+0000 7fe062db1640 1 --2- 172.21.15.99:0/600442881 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe05c0fed60 0x7fe05c0ff1e0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fe050009900 tx=0x7fe05002bc30 comp rx=0 tx=0).stop 2024-01-31T05:14:57.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.301+0000 7fe062db1640 1 -- 172.21.15.99:0/600442881 shutdown_connections 2024-01-31T05:14:57.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.301+0000 7fe062db1640 1 --2- 172.21.15.99:0/600442881 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe05c0ff720 0x7fe05c1092d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:57.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.301+0000 7fe062db1640 1 --2- 172.21.15.99:0/600442881 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe05c0fed60 0x7fe05c0ff1e0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:57.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.301+0000 7fe062db1640 1 --2- 172.21.15.99:0/600442881 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe05c1022f0 0x7fe05c102710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:57.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.301+0000 7fe062db1640 1 -- 172.21.15.99:0/600442881 >> 172.21.15.99:0/600442881 conn(0x7fe05c0fa8e0 msgr2=0x7fe05c0fcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:14:57.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.301+0000 7fe062db1640 1 -- 172.21.15.99:0/600442881 shutdown_connections 2024-01-31T05:14:57.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.301+0000 7fe062db1640 1 -- 172.21.15.99:0/600442881 wait complete. 2024-01-31T05:14:57.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.302+0000 7fe062db1640 1 Processor -- start 2024-01-31T05:14:57.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.302+0000 7fe062db1640 1 -- start start 2024-01-31T05:14:57.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.302+0000 7fe062db1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe05c0fed60 0x7fe05c196cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:57.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.302+0000 7fe062db1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe05c0ff720 0x7fe05c197230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:57.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.302+0000 7fe062db1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe05c1022f0 0x7fe05c19e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:57.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.302+0000 7fe062db1640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c19e7d0 con 0x7fe05c0ff720 2024-01-31T05:14:57.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.302+0000 7fe062db1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c19e940 con 0x7fe05c0fed60 2024-01-31T05:14:57.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.302+0000 7fe062db1640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c19eb00 con 0x7fe05c1022f0 2024-01-31T05:14:57.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.302+0000 7fe05bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe05c0ff720 0x7fe05c197230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:57.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.302+0000 7fe05bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe05c0ff720 0x7fe05c197230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48418/0 (socket says 172.21.15.99:48418) 2024-01-31T05:14:57.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.302+0000 7fe05bfff640 1 -- 172.21.15.99:0/862014188 learned_addr learned my addr 172.21.15.99:0/862014188 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:14:57.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.302+0000 7fe060b4d640 1 --2- 172.21.15.99:0/862014188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe05c0fed60 0x7fe05c196cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:57.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.302+0000 7fe06134e640 1 --2- 172.21.15.99:0/862014188 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe05c1022f0 0x7fe05c19e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:57.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.302+0000 7fe05bfff640 1 -- 172.21.15.99:0/862014188 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe05c1022f0 msgr2=0x7fe05c19e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:57.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.302+0000 7fe05bfff640 1 --2- 172.21.15.99:0/862014188 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe05c1022f0 0x7fe05c19e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:57.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.302+0000 7fe05bfff640 1 -- 172.21.15.99:0/862014188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe05c0fed60 msgr2=0x7fe05c196cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:57.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.302+0000 7fe05bfff640 1 --2- 172.21.15.99:0/862014188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe05c0fed60 0x7fe05c196cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:57.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.302+0000 7fe05bfff640 1 -- 172.21.15.99:0/862014188 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe050009560 con 0x7fe05c0ff720 2024-01-31T05:14:57.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.302+0000 7fe060b4d640 1 --2- 172.21.15.99:0/862014188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe05c0fed60 0x7fe05c196cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:14:57.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.302+0000 7fe05bfff640 1 --2- 172.21.15.99:0/862014188 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe05c0ff720 0x7fe05c197230 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fe050009230 tx=0x7fe050004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:14:57.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.302+0000 7fe059ffb640 1 -- 172.21.15.99:0/862014188 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe050004440 con 0x7fe05c0ff720 2024-01-31T05:14:57.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.302+0000 7fe062db1640 1 -- 172.21.15.99:0/862014188 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe05c19ed80 con 0x7fe05c0ff720 2024-01-31T05:14:57.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.302+0000 7fe059ffb640 1 -- 172.21.15.99:0/862014188 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe0500054c0 con 0x7fe05c0ff720 2024-01-31T05:14:57.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.303+0000 7fe059ffb640 1 -- 172.21.15.99:0/862014188 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe050003e50 con 0x7fe05c0ff720 2024-01-31T05:14:57.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.303+0000 7fe062db1640 1 -- 172.21.15.99:0/862014188 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe05c19f1d0 con 0x7fe05c0ff720 2024-01-31T05:14:57.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.304+0000 7fe062db1640 1 -- 172.21.15.99:0/862014188 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe05c1082d0 con 0x7fe05c0ff720 2024-01-31T05:14:57.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.305+0000 7fe059ffb640 1 -- 172.21.15.99:0/862014188 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 20) v1 ==== 135895+0+0 (secure 0 0 0) 0x7fe0500035f0 con 0x7fe05c0ff720 2024-01-31T05:14:57.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.305+0000 7fe059ffb640 1 --2- 172.21.15.99:0/862014188 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe0440a12e0 0x7fe0440a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:57.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.305+0000 7fe059ffb640 1 -- 172.21.15.99:0/862014188 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fe0500ef5b0 con 0x7fe05c0ff720 2024-01-31T05:14:57.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.305+0000 7fe060b4d640 1 --2- 172.21.15.99:0/862014188 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe0440a12e0 0x7fe0440a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:57.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.306+0000 7fe060b4d640 1 --2- 172.21.15.99:0/862014188 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe0440a12e0 0x7fe0440a37a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe04c005fd0 tx=0x7fe04c0082b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:14:57.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.310+0000 7fe059ffb640 1 -- 172.21.15.99:0/862014188 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fe0500b8a60 con 0x7fe05c0ff720 2024-01-31T05:14:57.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.481+0000 7fe062db1640 1 -- 172.21.15.99:0/862014188 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe05c10c870 con 0x7fe05c0ff720 2024-01-31T05:14:57.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.482+0000 7fe059ffb640 1 -- 172.21.15.99:0/862014188 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe0500ba990 con 0x7fe05c0ff720 2024-01-31T05:14:57.481 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-01-31T05:14:57.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.484+0000 7fe062db1640 1 -- 172.21.15.99:0/862014188 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe0440a12e0 msgr2=0x7fe0440a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:57.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.484+0000 7fe062db1640 1 --2- 172.21.15.99:0/862014188 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe0440a12e0 0x7fe0440a37a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe04c005fd0 tx=0x7fe04c0082b0 comp rx=0 tx=0).stop 2024-01-31T05:14:57.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.484+0000 7fe062db1640 1 -- 172.21.15.99:0/862014188 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe05c0ff720 msgr2=0x7fe05c197230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:57.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.484+0000 7fe062db1640 1 --2- 172.21.15.99:0/862014188 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe05c0ff720 0x7fe05c197230 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fe050009230 tx=0x7fe050004040 comp rx=0 tx=0).stop 2024-01-31T05:14:57.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.484+0000 7fe062db1640 1 -- 172.21.15.99:0/862014188 shutdown_connections 2024-01-31T05:14:57.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.484+0000 7fe062db1640 1 --2- 172.21.15.99:0/862014188 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fe0440a12e0 0x7fe0440a37a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:57.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.484+0000 7fe062db1640 1 --2- 172.21.15.99:0/862014188 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe05c1022f0 0x7fe05c19e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:57.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.484+0000 7fe062db1640 1 --2- 172.21.15.99:0/862014188 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe05c0ff720 0x7fe05c197230 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:57.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.484+0000 7fe062db1640 1 --2- 172.21.15.99:0/862014188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe05c0fed60 0x7fe05c196cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:57.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.484+0000 7fe062db1640 1 -- 172.21.15.99:0/862014188 >> 172.21.15.99:0/862014188 conn(0x7fe05c0fa8e0 msgr2=0x7fe05c1054a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:14:57.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.484+0000 7fe062db1640 1 -- 172.21.15.99:0/862014188 shutdown_connections 2024-01-31T05:14:57.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.484+0000 7fe062db1640 1 -- 172.21.15.99:0/862014188 wait complete. 2024-01-31T05:14:57.494 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-31T05:14:57.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.599+0000 7f01b9492640 1 -- 172.21.15.99:0/2691763869 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01b40ffe70 msgr2=0x7f01b41002f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:57.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.599+0000 7f01b9492640 1 --2- 172.21.15.99:0/2691763869 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01b40ffe70 0x7f01b41002f0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f019c009900 tx=0x7f019c02bc30 comp rx=0 tx=0).stop 2024-01-31T05:14:57.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.599+0000 7f01b9492640 1 -- 172.21.15.99:0/2691763869 shutdown_connections 2024-01-31T05:14:57.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.599+0000 7f01b9492640 1 --2- 172.21.15.99:0/2691763869 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01b4100830 0x7f01b41080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:57.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.599+0000 7f01b9492640 1 --2- 172.21.15.99:0/2691763869 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01b40ffe70 0x7f01b41002f0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:57.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.599+0000 7f01b9492640 1 --2- 172.21.15.99:0/2691763869 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f01b4101220 0x7f01b4101640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:57.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.599+0000 7f01b9492640 1 -- 172.21.15.99:0/2691763869 >> 172.21.15.99:0/2691763869 conn(0x7f01b40fa8e0 msgr2=0x7f01b40fcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:14:57.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.599+0000 7f01b9492640 1 -- 172.21.15.99:0/2691763869 shutdown_connections 2024-01-31T05:14:57.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.599+0000 7f01b9492640 1 -- 172.21.15.99:0/2691763869 wait complete. 2024-01-31T05:14:57.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.600+0000 7f01b9492640 1 Processor -- start 2024-01-31T05:14:57.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.600+0000 7f01b9492640 1 -- start start 2024-01-31T05:14:57.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.600+0000 7f01b9492640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01b40ffe70 0x7f01b4196cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:57.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.600+0000 7f01b9492640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01b4100830 0x7f01b4197230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:57.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.600+0000 7f01b9492640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f01b4101220 0x7f01b419e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:57.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.600+0000 7f01b9492640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b419e7d0 con 0x7f01b4100830 2024-01-31T05:14:57.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.600+0000 7f01b9492640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b419e940 con 0x7f01b40ffe70 2024-01-31T05:14:57.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.600+0000 7f01b9492640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b419eb00 con 0x7f01b4101220 2024-01-31T05:14:57.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.600+0000 7f01abfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01b4100830 0x7f01b4197230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:57.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.600+0000 7f01abfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01b4100830 0x7f01b4197230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48436/0 (socket says 172.21.15.99:48436) 2024-01-31T05:14:57.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.600+0000 7f01abfff640 1 -- 172.21.15.99:0/2570614537 learned_addr learned my addr 172.21.15.99:0/2570614537 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:14:57.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.600+0000 7f01b2ffd640 1 --2- 172.21.15.99:0/2570614537 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01b40ffe70 0x7f01b4196cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:57.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.600+0000 7f01b37fe640 1 --2- 172.21.15.99:0/2570614537 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f01b4101220 0x7f01b419e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:57.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.600+0000 7f01abfff640 1 -- 172.21.15.99:0/2570614537 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f01b4101220 msgr2=0x7f01b419e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:57.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.600+0000 7f01abfff640 1 --2- 172.21.15.99:0/2570614537 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f01b4101220 0x7f01b419e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:57.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.600+0000 7f01abfff640 1 -- 172.21.15.99:0/2570614537 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01b40ffe70 msgr2=0x7f01b4196cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:57.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.600+0000 7f01abfff640 1 --2- 172.21.15.99:0/2570614537 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01b40ffe70 0x7f01b4196cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:57.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.600+0000 7f01abfff640 1 -- 172.21.15.99:0/2570614537 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f019c009560 con 0x7f01b4100830 2024-01-31T05:14:57.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.600+0000 7f01b2ffd640 1 --2- 172.21.15.99:0/2570614537 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01b40ffe70 0x7f01b4196cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:14:57.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.601+0000 7f01abfff640 1 --2- 172.21.15.99:0/2570614537 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01b4100830 0x7f01b4197230 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f019c009230 tx=0x7f019c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:14:57.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.601+0000 7f01b0ff9640 1 -- 172.21.15.99:0/2570614537 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019c004440 con 0x7f01b4100830 2024-01-31T05:14:57.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.601+0000 7f01b0ff9640 1 -- 172.21.15.99:0/2570614537 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f019c0054c0 con 0x7f01b4100830 2024-01-31T05:14:57.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.601+0000 7f01b9492640 1 -- 172.21.15.99:0/2570614537 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01b419ed80 con 0x7f01b4100830 2024-01-31T05:14:57.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.601+0000 7f01b0ff9640 1 -- 172.21.15.99:0/2570614537 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019c003e80 con 0x7f01b4100830 2024-01-31T05:14:57.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.601+0000 7f01b9492640 1 -- 172.21.15.99:0/2570614537 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01b419f1d0 con 0x7f01b4100830 2024-01-31T05:14:57.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.602+0000 7f01b9492640 1 -- 172.21.15.99:0/2570614537 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01b410b4c0 con 0x7f01b4100830 2024-01-31T05:14:57.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.603+0000 7f01b0ff9640 1 -- 172.21.15.99:0/2570614537 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 20) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f019c0035f0 con 0x7f01b4100830 2024-01-31T05:14:57.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.603+0000 7f01b0ff9640 1 --2- 172.21.15.99:0/2570614537 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f01a00a1360 0x7f01a00a3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:57.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.603+0000 7f01b2ffd640 1 --2- 172.21.15.99:0/2570614537 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f01a00a1360 0x7f01a00a3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:57.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.603+0000 7f01b0ff9640 1 -- 172.21.15.99:0/2570614537 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f019c0ef4f0 con 0x7f01b4100830 2024-01-31T05:14:57.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.604+0000 7f01b2ffd640 1 --2- 172.21.15.99:0/2570614537 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f01a00a1360 0x7f01a00a3820 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f01a4005fd0 tx=0x7f01a4005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:14:57.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.608+0000 7f01b0ff9640 1 -- 172.21.15.99:0/2570614537 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f019c0b8ac0 con 0x7f01b4100830 2024-01-31T05:14:57.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.779+0000 7f01b9492640 1 -- 172.21.15.99:0/2570614537 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f01b419f360 con 0x7f01b4100830 2024-01-31T05:14:57.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.779+0000 7f01b0ff9640 1 -- 172.21.15.99:0/2570614537 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f019c0430a0 con 0x7f01b4100830 2024-01-31T05:14:57.779 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-01-31T05:14:57.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.781+0000 7f01b9492640 1 -- 172.21.15.99:0/2570614537 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f01a00a1360 msgr2=0x7f01a00a3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:57.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.781+0000 7f01b9492640 1 --2- 172.21.15.99:0/2570614537 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f01a00a1360 0x7f01a00a3820 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f01a4005fd0 tx=0x7f01a4005850 comp rx=0 tx=0).stop 2024-01-31T05:14:57.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.781+0000 7f01b9492640 1 -- 172.21.15.99:0/2570614537 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01b4100830 msgr2=0x7f01b4197230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:57.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.781+0000 7f01b9492640 1 --2- 172.21.15.99:0/2570614537 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01b4100830 0x7f01b4197230 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f019c009230 tx=0x7f019c004040 comp rx=0 tx=0).stop 2024-01-31T05:14:57.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.781+0000 7f01b9492640 1 -- 172.21.15.99:0/2570614537 shutdown_connections 2024-01-31T05:14:57.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.781+0000 7f01b9492640 1 --2- 172.21.15.99:0/2570614537 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f01a00a1360 0x7f01a00a3820 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:57.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.781+0000 7f01b9492640 1 --2- 172.21.15.99:0/2570614537 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f01b4101220 0x7f01b419e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:57.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.781+0000 7f01b9492640 1 --2- 172.21.15.99:0/2570614537 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01b4100830 0x7f01b4197230 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:57.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.781+0000 7f01b9492640 1 --2- 172.21.15.99:0/2570614537 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01b40ffe70 0x7f01b4196cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:57.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.781+0000 7f01b9492640 1 -- 172.21.15.99:0/2570614537 >> 172.21.15.99:0/2570614537 conn(0x7f01b40fa8e0 msgr2=0x7f01b40fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:14:57.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.781+0000 7f01b9492640 1 -- 172.21.15.99:0/2570614537 shutdown_connections 2024-01-31T05:14:57.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.781+0000 7f01b9492640 1 -- 172.21.15.99:0/2570614537 wait complete. 2024-01-31T05:14:57.790 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:14:57 smithi099 ceph-mon[31615]: pgmap v456: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-01-31T05:14:57.791 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:14:57 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/898009863' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:14:57.791 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:14:57 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/862014188' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-31T05:14:57.792 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-31T05:14:57.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.896+0000 7f7381de1640 1 -- 172.21.15.99:0/4168182272 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f737c101790 msgr2=0x7f737c103b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:57.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.896+0000 7f7381de1640 1 --2- 172.21.15.99:0/4168182272 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f737c101790 0x7f737c103b80 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f736c009900 tx=0x7f736c02bc30 comp rx=0 tx=0).stop 2024-01-31T05:14:57.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.896+0000 7f7381de1640 1 -- 172.21.15.99:0/4168182272 shutdown_connections 2024-01-31T05:14:57.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.896+0000 7f7381de1640 1 --2- 172.21.15.99:0/4168182272 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f737c1069f0 0x7f737c108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:57.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.896+0000 7f7381de1640 1 --2- 172.21.15.99:0/4168182272 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f737c1040c0 0x7f737c1064b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:57.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.896+0000 7f7381de1640 1 --2- 172.21.15.99:0/4168182272 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f737c101790 0x7f737c103b80 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:57.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.896+0000 7f7381de1640 1 -- 172.21.15.99:0/4168182272 >> 172.21.15.99:0/4168182272 conn(0x7f737c0fb1a0 msgr2=0x7f737c0fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:14:57.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.896+0000 7f7381de1640 1 -- 172.21.15.99:0/4168182272 shutdown_connections 2024-01-31T05:14:57.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.896+0000 7f7381de1640 1 -- 172.21.15.99:0/4168182272 wait complete. 2024-01-31T05:14:57.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.897+0000 7f7381de1640 1 Processor -- start 2024-01-31T05:14:57.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.897+0000 7f7381de1640 1 -- start start 2024-01-31T05:14:57.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.897+0000 7f7381de1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f737c101790 0x7f737c196c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:57.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.897+0000 7f7381de1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f737c1040c0 0x7f737c1971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:57.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.897+0000 7f7381de1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f737c1069f0 0x7f737c19e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:57.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.897+0000 7f7381de1640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737c19e790 con 0x7f737c1040c0 2024-01-31T05:14:57.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.897+0000 7f7381de1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737c19e900 con 0x7f737c101790 2024-01-31T05:14:57.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.897+0000 7f7381de1640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737c19eac0 con 0x7f737c1069f0 2024-01-31T05:14:57.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.897+0000 7f737affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f737c1040c0 0x7f737c1971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:57.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.897+0000 7f737affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f737c1040c0 0x7f737c1971c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48452/0 (socket says 172.21.15.99:48452) 2024-01-31T05:14:57.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.897+0000 7f737affd640 1 -- 172.21.15.99:0/672051505 learned_addr learned my addr 172.21.15.99:0/672051505 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:14:57.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.897+0000 7f737b7fe640 1 --2- 172.21.15.99:0/672051505 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f737c101790 0x7f737c196c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:57.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.898+0000 7f737bfff640 1 --2- 172.21.15.99:0/672051505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f737c1069f0 0x7f737c19e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:57.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.898+0000 7f737affd640 1 -- 172.21.15.99:0/672051505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f737c1069f0 msgr2=0x7f737c19e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:57.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.898+0000 7f737affd640 1 --2- 172.21.15.99:0/672051505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f737c1069f0 0x7f737c19e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:57.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.898+0000 7f737affd640 1 -- 172.21.15.99:0/672051505 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f737c101790 msgr2=0x7f737c196c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:57.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.898+0000 7f737affd640 1 --2- 172.21.15.99:0/672051505 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f737c101790 0x7f737c196c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:57.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.898+0000 7f737affd640 1 -- 172.21.15.99:0/672051505 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f736c009560 con 0x7f737c1040c0 2024-01-31T05:14:57.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.898+0000 7f737affd640 1 --2- 172.21.15.99:0/672051505 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f737c1040c0 0x7f737c1971c0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f737000d770 tx=0x7f737000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:14:57.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.898+0000 7f7378ff9640 1 -- 172.21.15.99:0/672051505 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7370009c30 con 0x7f737c1040c0 2024-01-31T05:14:57.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.898+0000 7f7378ff9640 1 -- 172.21.15.99:0/672051505 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f737000de80 con 0x7f737c1040c0 2024-01-31T05:14:57.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.898+0000 7f7381de1640 1 -- 172.21.15.99:0/672051505 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f737c19eda0 con 0x7f737c1040c0 2024-01-31T05:14:57.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.898+0000 7f7378ff9640 1 -- 172.21.15.99:0/672051505 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737000f620 con 0x7f737c1040c0 2024-01-31T05:14:57.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.898+0000 7f7381de1640 1 -- 172.21.15.99:0/672051505 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f737c19f220 con 0x7f737c1040c0 2024-01-31T05:14:57.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.899+0000 7f7381de1640 1 -- 172.21.15.99:0/672051505 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f737c0fcc90 con 0x7f737c1040c0 2024-01-31T05:14:57.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.900+0000 7f7378ff9640 1 -- 172.21.15.99:0/672051505 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 20) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f7370010460 con 0x7f737c1040c0 2024-01-31T05:14:57.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.900+0000 7f7378ff9640 1 --2- 172.21.15.99:0/672051505 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f73640a12e0 0x7f73640a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:57.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.901+0000 7f737b7fe640 1 --2- 172.21.15.99:0/672051505 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f73640a12e0 0x7f73640a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:57.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.901+0000 7f7378ff9640 1 -- 172.21.15.99:0/672051505 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f73700cc820 con 0x7f737c1040c0 2024-01-31T05:14:57.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.901+0000 7f737b7fe640 1 --2- 172.21.15.99:0/672051505 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f73640a12e0 0x7f73640a37a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f736c005ab0 tx=0x7f736c02c5d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:14:57.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:57.905+0000 7f7378ff9640 1 -- 172.21.15.99:0/672051505 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f7370095d60 con 0x7f737c1040c0 2024-01-31T05:14:58.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:14:57 smithi181 ceph-mon[36434]: pgmap v456: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-01-31T05:14:58.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:14:57 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/898009863' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:14:58.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:14:57 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/862014188' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-31T05:14:58.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.077+0000 7f7381de1640 1 -- 172.21.15.99:0/672051505 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f737c02cbb0 con 0x7f737c1040c0 2024-01-31T05:14:58.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.077+0000 7f7378ff9640 1 -- 172.21.15.99:0/672051505 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7370099380 con 0x7f737c1040c0 2024-01-31T05:14:58.077 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 64 2024-01-31T05:14:58.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.079+0000 7f7381de1640 1 -- 172.21.15.99:0/672051505 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f73640a12e0 msgr2=0x7f73640a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:58.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.079+0000 7f7381de1640 1 --2- 172.21.15.99:0/672051505 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f73640a12e0 0x7f73640a37a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f736c005ab0 tx=0x7f736c02c5d0 comp rx=0 tx=0).stop 2024-01-31T05:14:58.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.079+0000 7f7381de1640 1 -- 172.21.15.99:0/672051505 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f737c1040c0 msgr2=0x7f737c1971c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:58.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.079+0000 7f7381de1640 1 --2- 172.21.15.99:0/672051505 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f737c1040c0 0x7f737c1971c0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f737000d770 tx=0x7f737000dc30 comp rx=0 tx=0).stop 2024-01-31T05:14:58.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.079+0000 7f7381de1640 1 -- 172.21.15.99:0/672051505 shutdown_connections 2024-01-31T05:14:58.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.079+0000 7f7381de1640 1 --2- 172.21.15.99:0/672051505 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f73640a12e0 0x7f73640a37a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:58.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.079+0000 7f7381de1640 1 --2- 172.21.15.99:0/672051505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f737c1069f0 0x7f737c19e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:58.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.079+0000 7f7381de1640 1 --2- 172.21.15.99:0/672051505 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f737c1040c0 0x7f737c1971c0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:58.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.079+0000 7f7381de1640 1 --2- 172.21.15.99:0/672051505 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f737c101790 0x7f737c196c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:58.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.079+0000 7f7381de1640 1 -- 172.21.15.99:0/672051505 >> 172.21.15.99:0/672051505 conn(0x7f737c0fb1a0 msgr2=0x7f737c102030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:14:58.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.079+0000 7f7381de1640 1 -- 172.21.15.99:0/672051505 shutdown_connections 2024-01-31T05:14:58.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.079+0000 7f7381de1640 1 -- 172.21.15.99:0/672051505 wait complete. 2024-01-31T05:14:58.090 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-31T05:14:58.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:14:57 smithi179 ceph-mon[35652]: pgmap v456: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-01-31T05:14:58.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:14:57 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/898009863' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:14:58.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:14:57 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/862014188' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-31T05:14:58.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.192+0000 7fc8d4542640 1 -- 172.21.15.99:0/2388056582 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8cc1017a0 msgr2=0x7fc8cc108030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:58.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.192+0000 7fc8d4542640 1 --2- 172.21.15.99:0/2388056582 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8cc1017a0 0x7fc8cc108030 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4009ca0 tx=0x7fc8c402c0f0 comp rx=0 tx=0).stop 2024-01-31T05:14:58.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.193+0000 7fc8d4542640 1 -- 172.21.15.99:0/2388056582 shutdown_connections 2024-01-31T05:14:58.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.193+0000 7fc8d4542640 1 --2- 172.21.15.99:0/2388056582 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8cc1017a0 0x7fc8cc108030 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:58.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.193+0000 7fc8d4542640 1 --2- 172.21.15.99:0/2388056582 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8cc100de0 0x7fc8cc101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:58.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.193+0000 7fc8d4542640 1 --2- 172.21.15.99:0/2388056582 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8cc0ffbf0 0x7fc8cc100010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:58.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.193+0000 7fc8d4542640 1 -- 172.21.15.99:0/2388056582 >> 172.21.15.99:0/2388056582 conn(0x7fc8cc0fb180 msgr2=0x7fc8cc0fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:14:58.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.193+0000 7fc8d4542640 1 -- 172.21.15.99:0/2388056582 shutdown_connections 2024-01-31T05:14:58.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.193+0000 7fc8d4542640 1 -- 172.21.15.99:0/2388056582 wait complete. 2024-01-31T05:14:58.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.193+0000 7fc8d4542640 1 Processor -- start 2024-01-31T05:14:58.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.193+0000 7fc8d4542640 1 -- start start 2024-01-31T05:14:58.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.193+0000 7fc8d4542640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8cc0ffbf0 0x7fc8cc195b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:58.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.193+0000 7fc8d4542640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8cc100de0 0x7fc8cc1960d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:58.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.193+0000 7fc8d4542640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8cc1017a0 0x7fc8cc19d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:58.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.193+0000 7fc8d4542640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc19d680 con 0x7fc8cc100de0 2024-01-31T05:14:58.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.193+0000 7fc8d4542640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc19d7f0 con 0x7fc8cc1017a0 2024-01-31T05:14:58.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.193+0000 7fc8d4542640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc19d9b0 con 0x7fc8cc0ffbf0 2024-01-31T05:14:58.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.193+0000 7fc8d1add640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8cc100de0 0x7fc8cc1960d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:58.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.193+0000 7fc8d1add640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8cc100de0 0x7fc8cc1960d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48478/0 (socket says 172.21.15.99:48478) 2024-01-31T05:14:58.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.193+0000 7fc8d1add640 1 -- 172.21.15.99:0/3282316771 learned_addr learned my addr 172.21.15.99:0/3282316771 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:14:58.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.194+0000 7fc8d2adf640 1 --2- 172.21.15.99:0/3282316771 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8cc1017a0 0x7fc8cc19d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:58.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.194+0000 7fc8d22de640 1 --2- 172.21.15.99:0/3282316771 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8cc0ffbf0 0x7fc8cc195b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:58.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.194+0000 7fc8d1add640 1 -- 172.21.15.99:0/3282316771 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8cc0ffbf0 msgr2=0x7fc8cc195b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:58.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.194+0000 7fc8d1add640 1 --2- 172.21.15.99:0/3282316771 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8cc0ffbf0 0x7fc8cc195b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:58.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.194+0000 7fc8d1add640 1 -- 172.21.15.99:0/3282316771 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8cc1017a0 msgr2=0x7fc8cc19d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:58.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.194+0000 7fc8d1add640 1 --2- 172.21.15.99:0/3282316771 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8cc1017a0 0x7fc8cc19d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:58.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.194+0000 7fc8d1add640 1 -- 172.21.15.99:0/3282316771 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c4009900 con 0x7fc8cc100de0 2024-01-31T05:14:58.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.194+0000 7fc8d2adf640 1 --2- 172.21.15.99:0/3282316771 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8cc1017a0 0x7fc8cc19d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:14:58.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.194+0000 7fc8d1add640 1 --2- 172.21.15.99:0/3282316771 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8cc100de0 0x7fc8cc1960d0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc00e9f0 tx=0x7fc8bc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:14:58.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.194+0000 7fc8c37fe640 1 -- 172.21.15.99:0/3282316771 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc009720 con 0x7fc8cc100de0 2024-01-31T05:14:58.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.194+0000 7fc8d4542640 1 -- 172.21.15.99:0/3282316771 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8cc19dc90 con 0x7fc8cc100de0 2024-01-31T05:14:58.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.194+0000 7fc8c37fe640 1 -- 172.21.15.99:0/3282316771 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc8bc00cd80 con 0x7fc8cc100de0 2024-01-31T05:14:58.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.194+0000 7fc8c37fe640 1 -- 172.21.15.99:0/3282316771 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc010430 con 0x7fc8cc100de0 2024-01-31T05:14:58.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.194+0000 7fc8d4542640 1 -- 172.21.15.99:0/3282316771 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8cc19e150 con 0x7fc8cc100de0 2024-01-31T05:14:58.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.195+0000 7fc8d4542640 1 -- 172.21.15.99:0/3282316771 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8cc106f80 con 0x7fc8cc100de0 2024-01-31T05:14:58.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.197+0000 7fc8c37fe640 1 -- 172.21.15.99:0/3282316771 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 20) v1 ==== 135895+0+0 (secure 0 0 0) 0x7fc8bc005000 con 0x7fc8cc100de0 2024-01-31T05:14:58.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.197+0000 7fc8c37fe640 1 --2- 172.21.15.99:0/3282316771 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc8b80a12e0 0x7fc8b80a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:58.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.197+0000 7fc8d22de640 1 --2- 172.21.15.99:0/3282316771 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc8b80a12e0 0x7fc8b80a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:58.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.197+0000 7fc8c37fe640 1 -- 172.21.15.99:0/3282316771 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fc8bc014070 con 0x7fc8cc100de0 2024-01-31T05:14:58.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.198+0000 7fc8d22de640 1 --2- 172.21.15.99:0/3282316771 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc8b80a12e0 0x7fc8b80a37a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8005fd0 tx=0x7fc8c8005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:14:58.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.201+0000 7fc8c37fe640 1 -- 172.21.15.99:0/3282316771 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fc8bc096680 con 0x7fc8cc100de0 2024-01-31T05:14:58.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.385+0000 7fc8d4542640 1 -- 172.21.15.99:0/3282316771 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc8cc10b4b0 con 0x7fc8cc100de0 2024-01-31T05:14:58.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.385+0000 7fc8c37fe640 1 -- 172.21.15.99:0/3282316771 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v88) v1 ==== 81+0+590 (secure 0 0 0) 0x7fc8bc099ca0 con 0x7fc8cc100de0 2024-01-31T05:14:58.385 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:0/401101729 2024-02-01T05:02:20.510858+0000 2024-01-31T05:14:58.385 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:6801/1993198206 2024-02-01T05:02:20.510858+0000 2024-01-31T05:14:58.385 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:0/3819754569 2024-02-01T05:02:20.510858+0000 2024-01-31T05:14:58.385 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:0/475390265 2024-02-01T05:01:53.732026+0000 2024-01-31T05:14:58.385 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:6800/1993198206 2024-02-01T05:02:20.510858+0000 2024-01-31T05:14:58.385 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:6800/1706888338 2024-02-01T05:01:53.732026+0000 2024-01-31T05:14:58.385 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:0/4150146075 2024-02-01T05:01:53.732026+0000 2024-01-31T05:14:58.385 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:6801/1706888338 2024-02-01T05:01:53.732026+0000 2024-01-31T05:14:58.386 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:0/2851066598 2024-02-01T05:01:53.732026+0000 2024-01-31T05:14:58.386 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:0/1865156424 2024-02-01T05:02:20.510858+0000 2024-01-31T05:14:58.387 INFO:teuthology.orchestra.run.smithi099.stderr:listed 10 entries 2024-01-31T05:14:58.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.387+0000 7fc8d4542640 1 -- 172.21.15.99:0/3282316771 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc8b80a12e0 msgr2=0x7fc8b80a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:58.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.387+0000 7fc8d4542640 1 --2- 172.21.15.99:0/3282316771 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc8b80a12e0 0x7fc8b80a37a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8005fd0 tx=0x7fc8c8005850 comp rx=0 tx=0).stop 2024-01-31T05:14:58.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.387+0000 7fc8d4542640 1 -- 172.21.15.99:0/3282316771 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8cc100de0 msgr2=0x7fc8cc1960d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:58.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.387+0000 7fc8d4542640 1 --2- 172.21.15.99:0/3282316771 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8cc100de0 0x7fc8cc1960d0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc00e9f0 tx=0x7fc8bc00edf0 comp rx=0 tx=0).stop 2024-01-31T05:14:58.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.387+0000 7fc8d4542640 1 -- 172.21.15.99:0/3282316771 shutdown_connections 2024-01-31T05:14:58.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.387+0000 7fc8d4542640 1 --2- 172.21.15.99:0/3282316771 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc8b80a12e0 0x7fc8b80a37a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:58.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.387+0000 7fc8d4542640 1 --2- 172.21.15.99:0/3282316771 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8cc1017a0 0x7fc8cc19d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:58.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.387+0000 7fc8d4542640 1 --2- 172.21.15.99:0/3282316771 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8cc100de0 0x7fc8cc1960d0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:58.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.387+0000 7fc8d4542640 1 --2- 172.21.15.99:0/3282316771 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8cc0ffbf0 0x7fc8cc195b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:58.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.387+0000 7fc8d4542640 1 -- 172.21.15.99:0/3282316771 >> 172.21.15.99:0/3282316771 conn(0x7fc8cc0fb180 msgr2=0x7fc8cc104150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:14:58.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.387+0000 7fc8d4542640 1 -- 172.21.15.99:0/3282316771 shutdown_connections 2024-01-31T05:14:58.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:58.387+0000 7fc8d4542640 1 -- 172.21.15.99:0/3282316771 wait complete. 2024-01-31T05:14:58.398 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-31T05:14:58.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:14:58.398 DEBUG:teuthology.orchestra.run.smithi099:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-01-31T05:14:58.555 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi099.front.sepia.ceph.com 2024-01-31T05:14:58.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:14:58.556 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-31T05:14:58.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:14:58.593 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2024-01-31T05:14:58.653 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-31T05:14:58.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:14:58.653 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-31T05:14:58.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:14:58.722 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link delete ceph-brx 2024-01-31T05:14:58.819 INFO:tasks.kclient:Unmounting kernel clients... 2024-01-31T05:14:58.819 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-01-31T05:14:58.819 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-31T05:14:58.835 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056360,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17756 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/sda1 /var/lib/containers/storage/overlay ext4 rw,seclabel,relatime 0 0 overlay /var/lib/containers/storage/overlay/b4b8915bc6014cb15ba36137c226cea9301f4f60a74793b52152bf1d286e2486/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/OOJH2KJ4QNN3MXMFQQBIFLAKLX:/var/lib/containers/storage/overlay/l/NP3LH4WAGFX7P3ACRWTIJQ4P4W,upperdir=/var/lib/containers/storage/overlay/b4b8915bc6014cb15ba36137c226cea9301f4f60a74793b52152bf1d286e2486/diff,workdir=/var/lib/containers/storage/overlay/b4b8915bc6014cb15ba36137c226cea9301f4f60a74793b52152bf1d286e2486/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/e623dc4f3a55806bbdedcd9355a52c566c77b562e41c6221f53a4c90325763a5/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/OOJH2KJ4QNN3MXMFQQBIFLAKLX:/var/lib/containers/storage/overlay/l/NP3LH4WAGFX7P3ACRWTIJQ4P4W,upperdir=/var/lib/containers/storage/overlay/e623dc4f3a55806bbdedcd9355a52c566c77b562e41c6221f53a4c90325763a5/diff,workdir=/var/lib/containers/storage/overlay/e623dc4f3a55806bbdedcd9355a52c566c77b562e41c6221f53a4c90325763a5/work,metacopy=on,volatile 0 0 tmpfs /run/user/0 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,inode64 0 0 binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0 overlay /var/lib/containers/storage/overlay/1c2c923eab9a00d2ac0a6caa60b9fe3086601c0d78538cc865f0b36330da408a/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/OOJH2KJ4QNN3MXMFQQBIFLAKLX:/var/lib/containers/storage/overlay/l/NP3LH4WAGFX7P3ACRWTIJQ4P4W,upperdir=/var/lib/containers/storage/overlay/1c2c923eab9a00d2ac0a6caa60b9fe3086601c0d78538cc865f0b36330da408a/diff,workdir=/var/lib/containers/storage/overlay/1c2c923eab9a00d2ac0a6caa60b9fe3086601c0d78538cc865f0b36330da408a/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/2278edf981acd413e88fab8d36709050511bcbe2f72a968346fabca601ce1958/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/OOJH2KJ4QNN3MXMFQQBIFLAKLX:/var/lib/containers/storage/overlay/l/NP3LH4WAGFX7P3ACRWTIJQ4P4W,upperdir=/var/lib/containers/storage/overlay/2278edf981acd413e88fab8d36709050511bcbe2f72a968346fabca601ce1958/diff,workdir=/var/lib/containers/storage/overlay/2278edf981acd413e88fab8d36709050511bcbe2f72a968346fabca601ce1958/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/dc521e8377b2295d86825e5610202deaff13c447c21449ad7f5950aec52c418f/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/OOJH2KJ4QNN3MXMFQQBIFLAKLX:/var/lib/containers/storage/overlay/l/NP3LH4WAGFX7P3ACRWTIJQ4P4W,upperdir=/var/lib/containers/storage/overlay/dc521e8377b2295d86825e5610202deaff13c447c21449ad7f5950aec52c418f/diff,workdir=/var/lib/containers/storage/overlay/dc521e8377b2295d86825e5610202deaff13c447c21449ad7f5950aec52c418f/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/6779eafc17be5042015a08b5587603d31062b11795f82cab2c593ea91d36d49e/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/OOJH2KJ4QNN3MXMFQQBIFLAKLX:/var/lib/containers/storage/overlay/l/NP3LH4WAGFX7P3ACRWTIJQ4P4W,upperdir=/var/lib/containers/storage/overlay/6779eafc17be5042015a08b5587603d31062b11795f82cab2c593ea91d36d49e/diff,workdir=/var/lib/containers/storage/overlay/6779eafc17be5042015a08b5587603d31062b11795f82cab2c593ea91d36d49e/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/077e7a1652154472a2252c1cced4776a6fe53522127ecb82e2d20444f32351fd/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/OOJH2KJ4QNN3MXMFQQBIFLAKLX:/var/lib/containers/storage/overlay/l/NP3LH4WAGFX7P3ACRWTIJQ4P4W,upperdir=/var/lib/containers/storage/overlay/077e7a1652154472a2252c1cced4776a6fe53522127ecb82e2d20444f32351fd/diff,workdir=/var/lib/containers/storage/overlay/077e7a1652154472a2252c1cced4776a6fe53522127ecb82e2d20444f32351fd/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/8414bf7f35773a26e4c636947f90e29c332e72c4edd3546cdabf902729453e0e/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/OOJH2KJ4QNN3MXMFQQBIFLAKLX:/var/lib/containers/storage/overlay/l/NP3LH4WAGFX7P3ACRWTIJQ4P4W,upperdir=/var/lib/containers/storage/overlay/8414bf7f35773a26e4c636947f90e29c332e72c4edd3546cdabf902729453e0e/diff,workdir=/var/lib/containers/storage/overlay/8414bf7f35773a26e4c636947f90e29c332e72c4edd3546cdabf902729453e0e/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/7bd31148c52a559c362efb9e1e2dd76bf9baf8dcdf767119a41e9bde3f0fe39b/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/OOJH2KJ4QNN3MXMFQQBIFLAKLX:/var/lib/containers/storage/overlay/l/NP3LH4WAGFX7P3ACRWTIJQ4P4W,upperdir=/var/lib/containers/storage/overlay/7bd31148c52a559c362efb9e1e2dd76bf9baf8dcdf767119a41e9bde3f0fe39b/diff,workdir=/var/lib/containers/storage/overlay/7bd31148c52a559c362efb9e1e2dd76bf9baf8dcdf767119a41e9bde3f0fe39b/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/ab34de1bd4ee5d1731c699d178b720988af4e4778d46c4f34aa9c4aa6e9af402/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/OOJH2KJ4QNN3MXMFQQBIFLAKLX:/var/lib/containers/storage/overlay/l/NP3LH4WAGFX7P3ACRWTIJQ4P4W,upperdir=/var/lib/containers/storage/overlay/ab34de1bd4ee5d1731c699d178b720988af4e4778d46c4f34aa9c4aa6e9af402/diff,workdir=/var/lib/containers/storage/overlay/ab34de1bd4ee5d1731c699d178b720988af4e4778d46c4f34aa9c4aa6e9af402/work,metacopy=on,volatile 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 2024-01-31T05:14:58.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:14:58.835 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2024-01-31T05:14:58.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-31T05:14:58.894 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link delete ceph-brx 2024-01-31T05:14:58.965 INFO:teuthology.orchestra.run.smithi099.stderr:Cannot find device "ceph-brx" 2024-01-31T05:14:58.966 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T05:14:58.966 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-01-31T05:14:58.977 INFO:tasks.cephadm:Teardown begin 2024-01-31T05:14:58.978 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-31T05:14:58.978 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T05:14:59.031 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:14:58 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/2570614537' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-31T05:14:59.031 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:14:58 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/672051505' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-31T05:14:59.031 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:14:58 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/3282316771' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-01-31T05:14:59.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:14:58 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/2570614537' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-31T05:14:59.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:14:58 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/672051505' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-31T05:14:59.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:14:58 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/3282316771' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-01-31T05:14:59.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.111+0000 7fc03bdc4640 1 -- 172.21.15.99:0/1953834356 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc034100e00 msgr2=0x7fc034101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:59.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.111+0000 7fc03bdc4640 1 --2- 172.21.15.99:0/1953834356 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc034100e00 0x7fc034101280 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc024009900 tx=0x7fc02402bc30 comp rx=0 tx=0).stop 2024-01-31T05:14:59.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.111+0000 7fc03bdc4640 1 -- 172.21.15.99:0/1953834356 shutdown_connections 2024-01-31T05:14:59.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.111+0000 7fc03bdc4640 1 --2- 172.21.15.99:0/1953834356 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc0341017c0 0x7fc034108050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:59.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.111+0000 7fc03bdc4640 1 --2- 172.21.15.99:0/1953834356 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc034100e00 0x7fc034101280 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:59.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.111+0000 7fc03bdc4640 1 --2- 172.21.15.99:0/1953834356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0340ffc10 0x7fc034100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:59.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.111+0000 7fc03bdc4640 1 -- 172.21.15.99:0/1953834356 >> 172.21.15.99:0/1953834356 conn(0x7fc0340fb180 msgr2=0x7fc0340fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:14:59.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.111+0000 7fc03bdc4640 1 -- 172.21.15.99:0/1953834356 shutdown_connections 2024-01-31T05:14:59.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.111+0000 7fc03bdc4640 1 -- 172.21.15.99:0/1953834356 wait complete. 2024-01-31T05:14:59.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.111+0000 7fc03bdc4640 1 Processor -- start 2024-01-31T05:14:59.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.111+0000 7fc03bdc4640 1 -- start start 2024-01-31T05:14:59.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.111+0000 7fc03bdc4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0340ffc10 0x7fc034195bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:59.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.111+0000 7fc03bdc4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc034100e00 0x7fc0341960f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:59.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.112+0000 7fc03bdc4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0341017c0 0x7fc03419d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:59.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.112+0000 7fc03bdc4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc03419d6a0 con 0x7fc0340ffc10 2024-01-31T05:14:59.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.112+0000 7fc03bdc4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc03419d810 con 0x7fc0341017c0 2024-01-31T05:14:59.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.112+0000 7fc03bdc4640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc03419d9d0 con 0x7fc034100e00 2024-01-31T05:14:59.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.112+0000 7fc039b60640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0340ffc10 0x7fc034195bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:59.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.112+0000 7fc039b60640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0340ffc10 0x7fc034195bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48504/0 (socket says 172.21.15.99:48504) 2024-01-31T05:14:59.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.112+0000 7fc039b60640 1 -- 172.21.15.99:0/3371323000 learned_addr learned my addr 172.21.15.99:0/3371323000 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:14:59.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.112+0000 7fc03935f640 1 --2- 172.21.15.99:0/3371323000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc034100e00 0x7fc0341960f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:59.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.112+0000 7fc039b60640 1 -- 172.21.15.99:0/3371323000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc034100e00 msgr2=0x7fc0341960f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:59.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.112+0000 7fc039b60640 1 --2- 172.21.15.99:0/3371323000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc034100e00 0x7fc0341960f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:59.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.112+0000 7fc039b60640 1 -- 172.21.15.99:0/3371323000 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0341017c0 msgr2=0x7fc03419d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:59.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.112+0000 7fc039b60640 1 --2- 172.21.15.99:0/3371323000 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0341017c0 0x7fc03419d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:59.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.112+0000 7fc039b60640 1 -- 172.21.15.99:0/3371323000 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc024009560 con 0x7fc0340ffc10 2024-01-31T05:14:59.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.112+0000 7fc039b60640 1 --2- 172.21.15.99:0/3371323000 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0340ffc10 0x7fc034195bb0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fc03000ea80 tx=0x7fc03000ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:14:59.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.112+0000 7fc02affd640 1 -- 172.21.15.99:0/3371323000 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03000ce40 con 0x7fc0340ffc10 2024-01-31T05:14:59.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.112+0000 7fc02affd640 1 -- 172.21.15.99:0/3371323000 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc030011930 con 0x7fc0340ffc10 2024-01-31T05:14:59.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.112+0000 7fc03bdc4640 1 -- 172.21.15.99:0/3371323000 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc03419dcb0 con 0x7fc0340ffc10 2024-01-31T05:14:59.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.112+0000 7fc02affd640 1 -- 172.21.15.99:0/3371323000 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03001aaa0 con 0x7fc0340ffc10 2024-01-31T05:14:59.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.112+0000 7fc03bdc4640 1 -- 172.21.15.99:0/3371323000 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc03419e190 con 0x7fc0340ffc10 2024-01-31T05:14:59.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.113+0000 7fc03bdc4640 1 -- 172.21.15.99:0/3371323000 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc034106fb0 con 0x7fc0340ffc10 2024-01-31T05:14:59.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.114+0000 7fc02affd640 1 -- 172.21.15.99:0/3371323000 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 20) v1 ==== 135895+0+0 (secure 0 0 0) 0x7fc03001ac00 con 0x7fc0340ffc10 2024-01-31T05:14:59.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.115+0000 7fc02affd640 1 --2- 172.21.15.99:0/3371323000 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc0200a12e0 0x7fc0200a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:59.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.115+0000 7fc03935f640 1 --2- 172.21.15.99:0/3371323000 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc0200a12e0 0x7fc0200a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:59.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.115+0000 7fc02affd640 1 -- 172.21.15.99:0/3371323000 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fc0300cd030 con 0x7fc0340ffc10 2024-01-31T05:14:59.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.115+0000 7fc03935f640 1 --2- 172.21.15.99:0/3371323000 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc0200a12e0 0x7fc0200a37a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc024005ab0 tx=0x7fc02402c5d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:14:59.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.119+0000 7fc02affd640 1 -- 172.21.15.99:0/3371323000 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fc030096570 con 0x7fc0340ffc10 2024-01-31T05:14:59.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:14:58 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/2570614537' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-31T05:14:59.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:14:58 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/672051505' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-31T05:14:59.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:14:58 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/3282316771' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-01-31T05:14:59.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.331+0000 7fc03bdc4640 1 -- 172.21.15.99:0/3371323000 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc03402cb90 con 0x7fc0340ffc10 2024-01-31T05:14:59.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.332+0000 7fc02affd640 1 -- 172.21.15.99:0/3371323000 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+11418 (secure 0 0 0) 0x7fc030099b90 con 0x7fc0340ffc10 2024-01-31T05:14:59.331 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:14:59.331 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/1488539026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1488539026},{"type":"v1","addr":"172.21.15.99:6835","nonce":1488539026}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/1649552652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1649552652},{"type":"v1","addr":"172.21.15.99:6837","nonce":1649552652}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-01-31T05:09:20.564215+0000","modified":"2024-01-31T05:13:57.479481+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24461,"mds_2":24457,"mds_3":24439,"mds_4":14619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6839/4070477446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4070477446},{"type":"v1","addr":"172.21.15.99:6839","nonce":4070477446}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":61,"addr":"172.21.15.99:6841/3069939345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6840","nonce":3069939345},{"type":"v1","addr":"172.21.15.99:6841","nonce":3069939345}]},"join_fscid":-1,"export_targets":[0,1,3],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24376":{"gid":24376,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6833/427201290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":427201290},{"type":"v1","addr":"172.21.15.181:6833","nonce":427201290}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24401":{"gid":24401,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/472161020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":472161020},{"type":"v1","addr":"172.21.15.179:6833","nonce":472161020}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24427":{"gid":24427,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/1038715471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1038715471},{"type":"v1","addr":"172.21.15.181:6835","nonce":1038715471}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24434":{"gid":24434,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/966976592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":966976592},{"type":"v1","addr":"172.21.15.179:6835","nonce":966976592}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24439":{"gid":24439,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":65,"addr":"172.21.15.181:6837/3875964154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3875964154},{"type":"v1","addr":"172.21.15.181:6837","nonce":3875964154}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24457":{"gid":24457,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":63,"addr":"172.21.15.181:6839/996120687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":996120687},{"type":"v1","addr":"172.21.15.181:6839","nonce":996120687}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":63,"addr":"172.21.15.179:6837/837402830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":837402830},{"type":"v1","addr":"172.21.15.179:6837","nonce":837402830}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6839/754762785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":754762785},{"type":"v1","addr":"172.21.15.179:6839","nonce":754762785}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-31T05:14:59.332 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 42 2024-01-31T05:14:59.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.334+0000 7fc03bdc4640 1 -- 172.21.15.99:0/3371323000 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc0200a12e0 msgr2=0x7fc0200a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:59.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.334+0000 7fc03bdc4640 1 --2- 172.21.15.99:0/3371323000 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc0200a12e0 0x7fc0200a37a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc024005ab0 tx=0x7fc02402c5d0 comp rx=0 tx=0).stop 2024-01-31T05:14:59.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.334+0000 7fc03bdc4640 1 -- 172.21.15.99:0/3371323000 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0340ffc10 msgr2=0x7fc034195bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:59.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.334+0000 7fc03bdc4640 1 --2- 172.21.15.99:0/3371323000 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0340ffc10 0x7fc034195bb0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fc03000ea80 tx=0x7fc03000ef40 comp rx=0 tx=0).stop 2024-01-31T05:14:59.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.334+0000 7fc03bdc4640 1 -- 172.21.15.99:0/3371323000 shutdown_connections 2024-01-31T05:14:59.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.334+0000 7fc03bdc4640 1 --2- 172.21.15.99:0/3371323000 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fc0200a12e0 0x7fc0200a37a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:59.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.334+0000 7fc03bdc4640 1 --2- 172.21.15.99:0/3371323000 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0341017c0 0x7fc03419d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:59.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.334+0000 7fc03bdc4640 1 --2- 172.21.15.99:0/3371323000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc034100e00 0x7fc0341960f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:59.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.334+0000 7fc03bdc4640 1 --2- 172.21.15.99:0/3371323000 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0340ffc10 0x7fc034195bb0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:59.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.334+0000 7fc03bdc4640 1 -- 172.21.15.99:0/3371323000 >> 172.21.15.99:0/3371323000 conn(0x7fc0340fb180 msgr2=0x7fc034104180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:14:59.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.334+0000 7fc03bdc4640 1 -- 172.21.15.99:0/3371323000 shutdown_connections 2024-01-31T05:14:59.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.334+0000 7fc03bdc4640 1 -- 172.21.15.99:0/3371323000 wait complete. 2024-01-31T05:14:59.345 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-31T05:14:59.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.488+0000 7f8e50078640 1 -- 172.21.15.99:0/1192865962 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e48104180 msgr2=0x7f8e48106570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:59.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.488+0000 7f8e50078640 1 --2- 172.21.15.99:0/1192865962 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e48104180 0x7f8e48106570 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c009900 tx=0x7f8e3c02bc30 comp rx=0 tx=0).stop 2024-01-31T05:14:59.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.488+0000 7f8e50078640 1 -- 172.21.15.99:0/1192865962 shutdown_connections 2024-01-31T05:14:59.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.488+0000 7f8e50078640 1 --2- 172.21.15.99:0/1192865962 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e48106ab0 0x7f8e48108ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:59.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.488+0000 7f8e50078640 1 --2- 172.21.15.99:0/1192865962 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e48104180 0x7f8e48106570 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:59.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.488+0000 7f8e50078640 1 --2- 172.21.15.99:0/1192865962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e48101850 0x7f8e48103c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:59.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.488+0000 7f8e50078640 1 -- 172.21.15.99:0/1192865962 >> 172.21.15.99:0/1192865962 conn(0x7f8e480fb180 msgr2=0x7f8e480fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:14:59.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.488+0000 7f8e50078640 1 -- 172.21.15.99:0/1192865962 shutdown_connections 2024-01-31T05:14:59.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.488+0000 7f8e50078640 1 -- 172.21.15.99:0/1192865962 wait complete. 2024-01-31T05:14:59.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.488+0000 7f8e50078640 1 Processor -- start 2024-01-31T05:14:59.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.488+0000 7f8e50078640 1 -- start start 2024-01-31T05:14:59.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.488+0000 7f8e50078640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e48101850 0x7f8e48196c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:59.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.488+0000 7f8e50078640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e48104180 0x7f8e481971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:59.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.488+0000 7f8e50078640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e48106ab0 0x7f8e4819e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:59.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.489+0000 7f8e50078640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4819e780 con 0x7f8e48101850 2024-01-31T05:14:59.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.489+0000 7f8e50078640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4819e8f0 con 0x7f8e48104180 2024-01-31T05:14:59.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.489+0000 7f8e50078640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4819eab0 con 0x7f8e48106ab0 2024-01-31T05:14:59.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.489+0000 7f8e4de14640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e48101850 0x7f8e48196c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:59.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.489+0000 7f8e4de14640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e48101850 0x7f8e48196c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48526/0 (socket says 172.21.15.99:48526) 2024-01-31T05:14:59.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.489+0000 7f8e4de14640 1 -- 172.21.15.99:0/2664683015 learned_addr learned my addr 172.21.15.99:0/2664683015 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:14:59.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.489+0000 7f8e4e615640 1 --2- 172.21.15.99:0/2664683015 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e48106ab0 0x7f8e4819e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:59.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.489+0000 7f8e4d613640 1 --2- 172.21.15.99:0/2664683015 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e48104180 0x7f8e481971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:59.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.489+0000 7f8e4de14640 1 -- 172.21.15.99:0/2664683015 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e48106ab0 msgr2=0x7f8e4819e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:59.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.489+0000 7f8e4de14640 1 --2- 172.21.15.99:0/2664683015 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e48106ab0 0x7f8e4819e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:59.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.489+0000 7f8e4de14640 1 -- 172.21.15.99:0/2664683015 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e48104180 msgr2=0x7f8e481971b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:59.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.489+0000 7f8e4de14640 1 --2- 172.21.15.99:0/2664683015 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e48104180 0x7f8e481971b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:59.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.489+0000 7f8e4de14640 1 -- 172.21.15.99:0/2664683015 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e3c009560 con 0x7f8e48101850 2024-01-31T05:14:59.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.489+0000 7f8e4de14640 1 --2- 172.21.15.99:0/2664683015 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e48101850 0x7f8e48196c70 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f8e4400d950 tx=0x7f8e4400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:14:59.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.489+0000 7f8e3affd640 1 -- 172.21.15.99:0/2664683015 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e44009c30 con 0x7f8e48101850 2024-01-31T05:14:59.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.489+0000 7f8e3affd640 1 -- 172.21.15.99:0/2664683015 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e44009d90 con 0x7f8e48101850 2024-01-31T05:14:59.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.489+0000 7f8e50078640 1 -- 172.21.15.99:0/2664683015 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e4819ed90 con 0x7f8e48101850 2024-01-31T05:14:59.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.489+0000 7f8e3affd640 1 -- 172.21.15.99:0/2664683015 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4400f740 con 0x7f8e48101850 2024-01-31T05:14:59.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.489+0000 7f8e50078640 1 -- 172.21.15.99:0/2664683015 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e4819f260 con 0x7f8e48101850 2024-01-31T05:14:59.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.490+0000 7f8e50078640 1 -- 172.21.15.99:0/2664683015 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e480fcc70 con 0x7f8e48101850 2024-01-31T05:14:59.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.491+0000 7f8e3affd640 1 -- 172.21.15.99:0/2664683015 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 20) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f8e44010a20 con 0x7f8e48101850 2024-01-31T05:14:59.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.492+0000 7f8e3affd640 1 --2- 172.21.15.99:0/2664683015 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f8e340a1360 0x7f8e340a3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:59.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.492+0000 7f8e4d613640 1 --2- 172.21.15.99:0/2664683015 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f8e340a1360 0x7f8e340a3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:59.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.492+0000 7f8e3affd640 1 -- 172.21.15.99:0/2664683015 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f8e440cc710 con 0x7f8e48101850 2024-01-31T05:14:59.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.492+0000 7f8e4d613640 1 --2- 172.21.15.99:0/2664683015 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f8e340a1360 0x7f8e340a3820 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c006010 tx=0x7f8e3c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:14:59.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.496+0000 7f8e3affd640 1 -- 172.21.15.99:0/2664683015 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f8e44095c50 con 0x7f8e48101850 2024-01-31T05:14:59.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.702+0000 7f8e50078640 1 -- 172.21.15.99:0/2664683015 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e4810c5b0 con 0x7f8e48101850 2024-01-31T05:14:59.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.702+0000 7f8e3affd640 1 -- 172.21.15.99:0/2664683015 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+11418 (secure 0 0 0) 0x7f8e44099270 con 0x7f8e48101850 2024-01-31T05:14:59.702 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:14:59.702 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/1488539026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1488539026},{"type":"v1","addr":"172.21.15.99:6835","nonce":1488539026}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/1649552652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1649552652},{"type":"v1","addr":"172.21.15.99:6837","nonce":1649552652}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-01-31T05:09:20.564215+0000","modified":"2024-01-31T05:13:57.479481+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24461,"mds_2":24457,"mds_3":24439,"mds_4":14619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6839/4070477446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4070477446},{"type":"v1","addr":"172.21.15.99:6839","nonce":4070477446}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":61,"addr":"172.21.15.99:6841/3069939345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6840","nonce":3069939345},{"type":"v1","addr":"172.21.15.99:6841","nonce":3069939345}]},"join_fscid":-1,"export_targets":[0,1,3],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24376":{"gid":24376,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6833/427201290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":427201290},{"type":"v1","addr":"172.21.15.181:6833","nonce":427201290}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24401":{"gid":24401,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/472161020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":472161020},{"type":"v1","addr":"172.21.15.179:6833","nonce":472161020}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24427":{"gid":24427,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/1038715471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":1038715471},{"type":"v1","addr":"172.21.15.181:6835","nonce":1038715471}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24434":{"gid":24434,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/966976592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":966976592},{"type":"v1","addr":"172.21.15.179:6835","nonce":966976592}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24439":{"gid":24439,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":65,"addr":"172.21.15.181:6837/3875964154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3875964154},{"type":"v1","addr":"172.21.15.181:6837","nonce":3875964154}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24457":{"gid":24457,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":63,"addr":"172.21.15.181:6839/996120687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":996120687},{"type":"v1","addr":"172.21.15.181:6839","nonce":996120687}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":63,"addr":"172.21.15.179:6837/837402830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":837402830},{"type":"v1","addr":"172.21.15.179:6837","nonce":837402830}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6839/754762785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":754762785},{"type":"v1","addr":"172.21.15.179:6839","nonce":754762785}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-31T05:14:59.702 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 42 2024-01-31T05:14:59.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.704+0000 7f8e50078640 1 -- 172.21.15.99:0/2664683015 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f8e340a1360 msgr2=0x7f8e340a3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:59.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.704+0000 7f8e50078640 1 --2- 172.21.15.99:0/2664683015 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f8e340a1360 0x7f8e340a3820 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c006010 tx=0x7f8e3c000bc0 comp rx=0 tx=0).stop 2024-01-31T05:14:59.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.704+0000 7f8e50078640 1 -- 172.21.15.99:0/2664683015 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e48101850 msgr2=0x7f8e48196c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:59.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.704+0000 7f8e50078640 1 --2- 172.21.15.99:0/2664683015 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e48101850 0x7f8e48196c70 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f8e4400d950 tx=0x7f8e4400de10 comp rx=0 tx=0).stop 2024-01-31T05:14:59.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.704+0000 7f8e50078640 1 -- 172.21.15.99:0/2664683015 shutdown_connections 2024-01-31T05:14:59.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.704+0000 7f8e50078640 1 --2- 172.21.15.99:0/2664683015 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f8e340a1360 0x7f8e340a3820 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:59.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.704+0000 7f8e50078640 1 --2- 172.21.15.99:0/2664683015 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e48106ab0 0x7f8e4819e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:59.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.704+0000 7f8e50078640 1 --2- 172.21.15.99:0/2664683015 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e48104180 0x7f8e481971b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:59.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.704+0000 7f8e50078640 1 --2- 172.21.15.99:0/2664683015 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e48101850 0x7f8e48196c70 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:59.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.704+0000 7f8e50078640 1 -- 172.21.15.99:0/2664683015 >> 172.21.15.99:0/2664683015 conn(0x7f8e480fb180 msgr2=0x7f8e481020f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:14:59.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.705+0000 7f8e50078640 1 -- 172.21.15.99:0/2664683015 shutdown_connections 2024-01-31T05:14:59.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.705+0000 7f8e50078640 1 -- 172.21.15.99:0/2664683015 wait complete. 2024-01-31T05:14:59.715 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-31T05:14:59.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.817+0000 7fdd433ab640 1 -- 172.21.15.99:0/2236241739 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd3c101790 msgr2=0x7fdd3c103b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:59.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.817+0000 7fdd433ab640 1 --2- 172.21.15.99:0/2236241739 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd3c101790 0x7fdd3c103b80 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fdd34009900 tx=0x7fdd3402bc30 comp rx=0 tx=0).stop 2024-01-31T05:14:59.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.817+0000 7fdd433ab640 1 -- 172.21.15.99:0/2236241739 shutdown_connections 2024-01-31T05:14:59.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.817+0000 7fdd433ab640 1 --2- 172.21.15.99:0/2236241739 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdd3c1069f0 0x7fdd3c108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:59.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.817+0000 7fdd433ab640 1 --2- 172.21.15.99:0/2236241739 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd3c1040c0 0x7fdd3c1064b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:59.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.817+0000 7fdd433ab640 1 --2- 172.21.15.99:0/2236241739 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd3c101790 0x7fdd3c103b80 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:59.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.817+0000 7fdd433ab640 1 -- 172.21.15.99:0/2236241739 >> 172.21.15.99:0/2236241739 conn(0x7fdd3c0fb180 msgr2=0x7fdd3c0fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:14:59.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.818+0000 7fdd433ab640 1 -- 172.21.15.99:0/2236241739 shutdown_connections 2024-01-31T05:14:59.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.818+0000 7fdd433ab640 1 -- 172.21.15.99:0/2236241739 wait complete. 2024-01-31T05:14:59.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.818+0000 7fdd433ab640 1 Processor -- start 2024-01-31T05:14:59.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.818+0000 7fdd433ab640 1 -- start start 2024-01-31T05:14:59.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.818+0000 7fdd433ab640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdd3c101790 0x7fdd3c196d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:59.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.818+0000 7fdd433ab640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd3c1040c0 0x7fdd3c197250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:59.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.818+0000 7fdd433ab640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd3c1069f0 0x7fdd3c19e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:59.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.818+0000 7fdd433ab640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3c19e7f0 con 0x7fdd3c1040c0 2024-01-31T05:14:59.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.818+0000 7fdd433ab640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3c19e960 con 0x7fdd3c1069f0 2024-01-31T05:14:59.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.818+0000 7fdd433ab640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3c19eb20 con 0x7fdd3c101790 2024-01-31T05:14:59.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.818+0000 7fdd40946640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd3c1040c0 0x7fdd3c197250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:59.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.818+0000 7fdd40946640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd3c1040c0 0x7fdd3c197250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48544/0 (socket says 172.21.15.99:48544) 2024-01-31T05:14:59.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.818+0000 7fdd40946640 1 -- 172.21.15.99:0/1033598051 learned_addr learned my addr 172.21.15.99:0/1033598051 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:14:59.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.819+0000 7fdd41147640 1 --2- 172.21.15.99:0/1033598051 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdd3c101790 0x7fdd3c196d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:59.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.819+0000 7fdd40946640 1 -- 172.21.15.99:0/1033598051 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdd3c101790 msgr2=0x7fdd3c196d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:59.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.819+0000 7fdd40946640 1 --2- 172.21.15.99:0/1033598051 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdd3c101790 0x7fdd3c196d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:59.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.819+0000 7fdd41948640 1 --2- 172.21.15.99:0/1033598051 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd3c1069f0 0x7fdd3c19e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:59.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.819+0000 7fdd40946640 1 -- 172.21.15.99:0/1033598051 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd3c1069f0 msgr2=0x7fdd3c19e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:14:59.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.819+0000 7fdd40946640 1 --2- 172.21.15.99:0/1033598051 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd3c1069f0 0x7fdd3c19e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:14:59.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.819+0000 7fdd40946640 1 -- 172.21.15.99:0/1033598051 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd34009560 con 0x7fdd3c1040c0 2024-01-31T05:14:59.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.819+0000 7fdd41147640 1 --2- 172.21.15.99:0/1033598051 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdd3c101790 0x7fdd3c196d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:14:59.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.819+0000 7fdd41948640 1 --2- 172.21.15.99:0/1033598051 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd3c1069f0 0x7fdd3c19e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:14:59.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.819+0000 7fdd40946640 1 --2- 172.21.15.99:0/1033598051 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd3c1040c0 0x7fdd3c197250 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c00c970 tx=0x7fdd2c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:14:59.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.819+0000 7fdd327fc640 1 -- 172.21.15.99:0/1033598051 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c007bb0 con 0x7fdd3c1040c0 2024-01-31T05:14:59.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.819+0000 7fdd327fc640 1 -- 172.21.15.99:0/1033598051 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdd2c007d10 con 0x7fdd3c1040c0 2024-01-31T05:14:59.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.819+0000 7fdd327fc640 1 -- 172.21.15.99:0/1033598051 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c004e20 con 0x7fdd3c1040c0 2024-01-31T05:14:59.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.819+0000 7fdd433ab640 1 -- 172.21.15.99:0/1033598051 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd3c19ee00 con 0x7fdd3c1040c0 2024-01-31T05:14:59.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.819+0000 7fdd433ab640 1 -- 172.21.15.99:0/1033598051 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd3c19f280 con 0x7fdd3c1040c0 2024-01-31T05:14:59.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.820+0000 7fdd433ab640 1 -- 172.21.15.99:0/1033598051 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd3c0fcc70 con 0x7fdd3c1040c0 2024-01-31T05:14:59.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.821+0000 7fdd327fc640 1 -- 172.21.15.99:0/1033598051 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 20) v1 ==== 135895+0+0 (secure 0 0 0) 0x7fdd2c004fc0 con 0x7fdd3c1040c0 2024-01-31T05:14:59.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.822+0000 7fdd327fc640 1 --2- 172.21.15.99:0/1033598051 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fdd280a12e0 0x7fdd280a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:14:59.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.822+0000 7fdd41147640 1 --2- 172.21.15.99:0/1033598051 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fdd280a12e0 0x7fdd280a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:14:59.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.822+0000 7fdd327fc640 1 -- 172.21.15.99:0/1033598051 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fdd2c0cc880 con 0x7fdd3c1040c0 2024-01-31T05:14:59.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.822+0000 7fdd41147640 1 --2- 172.21.15.99:0/1033598051 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fdd280a12e0 0x7fdd280a37a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fdd34036040 tx=0x7fdd34000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:14:59.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.826+0000 7fdd327fc640 1 -- 172.21.15.99:0/1033598051 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fdd2c095d30 con 0x7fdd3c1040c0 2024-01-31T05:14:59.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:14:59.999+0000 7fdd433ab640 1 -- 172.21.15.99:0/1033598051 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd3c10c7f0 con 0x7fdd3c1040c0 2024-01-31T05:14:59.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.000+0000 7fdd327fc640 1 -- 172.21.15.99:0/1033598051 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22426 (secure 0 0 0) 0x7fdd2c097c60 con 0x7fdd3c1040c0 2024-01-31T05:15:00.000 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-01-31T05:15:00.000 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":88,"fsid":"9288ff44-bff5-11ee-95b3-87774f69a715","created":"2024-01-31T05:01:26.130917+0000","modified":"2024-01-31T05:10:21.675877+0000","last_up_change":"2024-01-31T05:08:31.228478+0000","last_in_change":"2024-01-31T05:08:10.799511+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-31T05:04:46.842423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-31T05:09:18.693558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-31T05:09:19.734003+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b45878d9-28f1-4821-ba72-26a32d3fc780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6803","nonce":1213805280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6805","nonce":1213805280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6809","nonce":1213805280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1213805280},{"type":"v1","addr":"172.21.15.99:6807","nonce":1213805280}]},"public_addr":"172.21.15.99:6803/1213805280","cluster_addr":"172.21.15.99:6805/1213805280","heartbeat_back_addr":"172.21.15.99:6809/1213805280","heartbeat_front_addr":"172.21.15.99:6807/1213805280","state":["exists","up"]},{"osd":1,"uuid":"e0b71ff3-5d97-4659-8dea-4c9091e1beb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6801","nonce":2019451677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6803","nonce":2019451677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6807","nonce":2019451677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2019451677},{"type":"v1","addr":"172.21.15.179:6805","nonce":2019451677}]},"public_addr":"172.21.15.179:6801/2019451677","cluster_addr":"172.21.15.179:6803/2019451677","heartbeat_back_addr":"172.21.15.179:6807/2019451677","heartbeat_front_addr":"172.21.15.179:6805/2019451677","state":["exists","up"]},{"osd":2,"uuid":"11c919c8-19a9-48b0-8880-3002efcb64f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6801","nonce":3934284457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6803","nonce":3934284457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6807","nonce":3934284457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":3934284457},{"type":"v1","addr":"172.21.15.181:6805","nonce":3934284457}]},"public_addr":"172.21.15.181:6801/3934284457","cluster_addr":"172.21.15.181:6803/3934284457","heartbeat_back_addr":"172.21.15.181:6807/3934284457","heartbeat_front_addr":"172.21.15.181:6805/3934284457","state":["exists","up"]},{"osd":3,"uuid":"bcab5135-a5d1-45ae-a9b8-674425d3999e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6811","nonce":4207675427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6813","nonce":4207675427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6817","nonce":4207675427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":4207675427},{"type":"v1","addr":"172.21.15.99:6815","nonce":4207675427}]},"public_addr":"172.21.15.99:6811/4207675427","cluster_addr":"172.21.15.99:6813/4207675427","heartbeat_back_addr":"172.21.15.99:6817/4207675427","heartbeat_front_addr":"172.21.15.99:6815/4207675427","state":["exists","up"]},{"osd":4,"uuid":"0250d7ac-3894-457a-9c04-cc7205d61eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6809","nonce":2861083896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6811","nonce":2861083896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6815","nonce":2861083896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2861083896},{"type":"v1","addr":"172.21.15.179:6813","nonce":2861083896}]},"public_addr":"172.21.15.179:6809/2861083896","cluster_addr":"172.21.15.179:6811/2861083896","heartbeat_back_addr":"172.21.15.179:6815/2861083896","heartbeat_front_addr":"172.21.15.179:6813/2861083896","state":["exists","up"]},{"osd":5,"uuid":"5e19222a-c2a4-45bc-8445-1d302f26d11c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6809","nonce":1485017095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6811","nonce":1485017095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6815","nonce":1485017095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":1485017095},{"type":"v1","addr":"172.21.15.181:6813","nonce":1485017095}]},"public_addr":"172.21.15.181:6809/1485017095","cluster_addr":"172.21.15.181:6811/1485017095","heartbeat_back_addr":"172.21.15.181:6815/1485017095","heartbeat_front_addr":"172.21.15.181:6813/1485017095","state":["exists","up"]},{"osd":6,"uuid":"56555035-f9fc-4e91-96dd-caa632d58adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6819","nonce":1534047839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6821","nonce":1534047839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6825","nonce":1534047839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1534047839},{"type":"v1","addr":"172.21.15.99:6823","nonce":1534047839}]},"public_addr":"172.21.15.99:6819/1534047839","cluster_addr":"172.21.15.99:6821/1534047839","heartbeat_back_addr":"172.21.15.99:6825/1534047839","heartbeat_front_addr":"172.21.15.99:6823/1534047839","state":["exists","up"]},{"osd":7,"uuid":"5e079cf5-1340-4599-88a6-df410ef0148e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6817","nonce":3875950553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6819","nonce":3875950553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6823","nonce":3875950553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3875950553},{"type":"v1","addr":"172.21.15.179:6821","nonce":3875950553}]},"public_addr":"172.21.15.179:6817/3875950553","cluster_addr":"172.21.15.179:6819/3875950553","heartbeat_back_addr":"172.21.15.179:6823/3875950553","heartbeat_front_addr":"172.21.15.179:6821/3875950553","state":["exists","up"]},{"osd":8,"uuid":"10a73592-4251-4492-b67d-ce9b9d7fff32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6817","nonce":179568936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6819","nonce":179568936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6823","nonce":179568936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":179568936},{"type":"v1","addr":"172.21.15.181:6821","nonce":179568936}]},"public_addr":"172.21.15.181:6817/179568936","cluster_addr":"172.21.15.181:6819/179568936","heartbeat_back_addr":"172.21.15.181:6823/179568936","heartbeat_front_addr":"172.21.15.181:6821/179568936","state":["exists","up"]},{"osd":9,"uuid":"f6620e1e-f761-4f1c-917f-cbc748df32a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6827","nonce":315759515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6829","nonce":315759515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6833","nonce":315759515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":315759515},{"type":"v1","addr":"172.21.15.99:6831","nonce":315759515}]},"public_addr":"172.21.15.99:6827/315759515","cluster_addr":"172.21.15.99:6829/315759515","heartbeat_back_addr":"172.21.15.99:6833/315759515","heartbeat_front_addr":"172.21.15.99:6831/315759515","state":["exists","up"]},{"osd":10,"uuid":"ee86af7d-66f8-4795-bcc3-dfec79e4680c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6825","nonce":2985063934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6827","nonce":2985063934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6831","nonce":2985063934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2985063934},{"type":"v1","addr":"172.21.15.179:6829","nonce":2985063934}]},"public_addr":"172.21.15.179:6825/2985063934","cluster_addr":"172.21.15.179:6827/2985063934","heartbeat_back_addr":"172.21.15.179:6831/2985063934","heartbeat_front_addr":"172.21.15.179:6829/2985063934","state":["exists","up"]},{"osd":11,"uuid":"82f04fee-f6ae-4630-a75b-b12a9c4ab2e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6825","nonce":1858219600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6827","nonce":1858219600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6831","nonce":1858219600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1858219600},{"type":"v1","addr":"172.21.15.181:6829","nonce":1858219600}]},"public_addr":"172.21.15.181:6825/1858219600","cluster_addr":"172.21.15.181:6827/1858219600","heartbeat_back_addr":"172.21.15.181:6831/1858219600","heartbeat_front_addr":"172.21.15.181:6829/1858219600","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:03:55.518970+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:04:19.936339+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:04:44.064814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:09.331683+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:34.616774+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:05:58.881810+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:06:23.869838+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:06:49.127331+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:07:12.847187+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:07:38.231045+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:08:03.949162+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-31T05:08:28.471802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:0/401101729":"2024-02-01T05:02:20.510858+0000","172.21.15.99:6801/1993198206":"2024-02-01T05:02:20.510858+0000","172.21.15.99:0/3819754569":"2024-02-01T05:02:20.510858+0000","172.21.15.99:0/475390265":"2024-02-01T05:01:53.732026+0000","172.21.15.99:6800/1993198206":"2024-02-01T05:02:20.510858+0000","172.21.15.99:6800/1706888338":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/4150146075":"2024-02-01T05:01:53.732026+0000","172.21.15.99:6801/1706888338":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/2851066598":"2024-02-01T05:01:53.732026+0000","172.21.15.99:0/1865156424":"2024-02-01T05:02:20.510858+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-31T05:15:00.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.002+0000 7fdd433ab640 1 -- 172.21.15.99:0/1033598051 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fdd280a12e0 msgr2=0x7fdd280a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:15:00.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.002+0000 7fdd433ab640 1 --2- 172.21.15.99:0/1033598051 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fdd280a12e0 0x7fdd280a37a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fdd34036040 tx=0x7fdd34000bc0 comp rx=0 tx=0).stop 2024-01-31T05:15:00.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.002+0000 7fdd433ab640 1 -- 172.21.15.99:0/1033598051 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd3c1040c0 msgr2=0x7fdd3c197250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:15:00.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.002+0000 7fdd433ab640 1 --2- 172.21.15.99:0/1033598051 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd3c1040c0 0x7fdd3c197250 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c00c970 tx=0x7fdd2c00ce30 comp rx=0 tx=0).stop 2024-01-31T05:15:00.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.002+0000 7fdd433ab640 1 -- 172.21.15.99:0/1033598051 shutdown_connections 2024-01-31T05:15:00.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.002+0000 7fdd433ab640 1 --2- 172.21.15.99:0/1033598051 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fdd280a12e0 0x7fdd280a37a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:15:00.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.002+0000 7fdd433ab640 1 --2- 172.21.15.99:0/1033598051 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd3c1069f0 0x7fdd3c19e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:15:00.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.002+0000 7fdd433ab640 1 --2- 172.21.15.99:0/1033598051 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd3c1040c0 0x7fdd3c197250 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:15:00.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.002+0000 7fdd433ab640 1 --2- 172.21.15.99:0/1033598051 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdd3c101790 0x7fdd3c196d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:15:00.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.002+0000 7fdd433ab640 1 -- 172.21.15.99:0/1033598051 >> 172.21.15.99:0/1033598051 conn(0x7fdd3c0fb180 msgr2=0x7fdd3c1023b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:15:00.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.002+0000 7fdd433ab640 1 -- 172.21.15.99:0/1033598051 shutdown_connections 2024-01-31T05:15:00.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.002+0000 7fdd433ab640 1 -- 172.21.15.99:0/1033598051 wait complete. 2024-01-31T05:15:00.011 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:14:59 smithi099 ceph-mon[31615]: pgmap v457: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-01-31T05:15:00.011 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:14:59 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/3371323000' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:15:00.011 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:14:59 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/2664683015' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:15:00.013 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-31T05:15:00.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:14:59 smithi181 ceph-mon[36434]: pgmap v457: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-01-31T05:15:00.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:14:59 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/3371323000' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:15:00.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:14:59 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/2664683015' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:15:00.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.119+0000 7f61e8e09640 1 -- 172.21.15.99:0/4099659030 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61e41017a0 msgr2=0x7f61e4108030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:15:00.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.119+0000 7f61e8e09640 1 --2- 172.21.15.99:0/4099659030 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61e41017a0 0x7f61e4108030 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f61dc009ca0 tx=0x7f61dc02c0f0 comp rx=0 tx=0).stop 2024-01-31T05:15:00.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.119+0000 7f61e8e09640 1 -- 172.21.15.99:0/4099659030 shutdown_connections 2024-01-31T05:15:00.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.119+0000 7f61e8e09640 1 --2- 172.21.15.99:0/4099659030 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61e41017a0 0x7f61e4108030 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:15:00.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.119+0000 7f61e8e09640 1 --2- 172.21.15.99:0/4099659030 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f61e4100de0 0x7f61e4101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:15:00.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.119+0000 7f61e8e09640 1 --2- 172.21.15.99:0/4099659030 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61e40ffbf0 0x7f61e4100010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:15:00.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.119+0000 7f61e8e09640 1 -- 172.21.15.99:0/4099659030 >> 172.21.15.99:0/4099659030 conn(0x7f61e40fb180 msgr2=0x7f61e40fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:15:00.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.119+0000 7f61e8e09640 1 -- 172.21.15.99:0/4099659030 shutdown_connections 2024-01-31T05:15:00.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.119+0000 7f61e8e09640 1 -- 172.21.15.99:0/4099659030 wait complete. 2024-01-31T05:15:00.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.120+0000 7f61e8e09640 1 Processor -- start 2024-01-31T05:15:00.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.120+0000 7f61e8e09640 1 -- start start 2024-01-31T05:15:00.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.120+0000 7f61e8e09640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61e40ffbf0 0x7f61e4068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:15:00.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.120+0000 7f61e8e09640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61e4100de0 0x7f61e419b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:15:00.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.120+0000 7f61e8e09640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f61e41017a0 0x7f61e419dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:15:00.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.120+0000 7f61e8e09640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e419e750 con 0x7f61e4100de0 2024-01-31T05:15:00.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.120+0000 7f61e8e09640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e419e8c0 con 0x7f61e40ffbf0 2024-01-31T05:15:00.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.120+0000 7f61e8e09640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e419ea80 con 0x7f61e41017a0 2024-01-31T05:15:00.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.120+0000 7f61dbfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61e4100de0 0x7f61e419b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:15:00.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.120+0000 7f61dbfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61e4100de0 0x7f61e419b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48556/0 (socket says 172.21.15.99:48556) 2024-01-31T05:15:00.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.120+0000 7f61dbfff640 1 -- 172.21.15.99:0/2117658168 learned_addr learned my addr 172.21.15.99:0/2117658168 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:15:00.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.120+0000 7f61e259c640 1 --2- 172.21.15.99:0/2117658168 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61e40ffbf0 0x7f61e4068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:15:00.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.120+0000 7f61dbfff640 1 -- 172.21.15.99:0/2117658168 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f61e41017a0 msgr2=0x7f61e419dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:15:00.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.120+0000 7f61dbfff640 1 --2- 172.21.15.99:0/2117658168 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f61e41017a0 0x7f61e419dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:15:00.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.120+0000 7f61dbfff640 1 -- 172.21.15.99:0/2117658168 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61e40ffbf0 msgr2=0x7f61e4068a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:15:00.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.120+0000 7f61dbfff640 1 --2- 172.21.15.99:0/2117658168 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61e40ffbf0 0x7f61e4068a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:15:00.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.120+0000 7f61dbfff640 1 -- 172.21.15.99:0/2117658168 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61dc009900 con 0x7f61e4100de0 2024-01-31T05:15:00.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.120+0000 7f61e259c640 1 --2- 172.21.15.99:0/2117658168 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61e40ffbf0 0x7f61e4068a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:15:00.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.121+0000 7f61dbfff640 1 --2- 172.21.15.99:0/2117658168 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61e4100de0 0x7f61e419b950 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f61cc00d770 tx=0x7f61cc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:15:00.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.121+0000 7f61db7fe640 1 -- 172.21.15.99:0/2117658168 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61cc009c30 con 0x7f61e4100de0 2024-01-31T05:15:00.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.121+0000 7f61e8e09640 1 -- 172.21.15.99:0/2117658168 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61e419ed60 con 0x7f61e4100de0 2024-01-31T05:15:00.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.121+0000 7f61db7fe640 1 -- 172.21.15.99:0/2117658168 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f61cc00de80 con 0x7f61e4100de0 2024-01-31T05:15:00.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.121+0000 7f61db7fe640 1 -- 172.21.15.99:0/2117658168 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61cc004d80 con 0x7f61e4100de0 2024-01-31T05:15:00.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.121+0000 7f61e8e09640 1 -- 172.21.15.99:0/2117658168 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61e419f1c0 con 0x7f61e4100de0 2024-01-31T05:15:00.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.122+0000 7f61e8e09640 1 -- 172.21.15.99:0/2117658168 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61e4106f80 con 0x7f61e4100de0 2024-01-31T05:15:00.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.123+0000 7f61db7fe640 1 -- 172.21.15.99:0/2117658168 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 20) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f61cc004ee0 con 0x7f61e4100de0 2024-01-31T05:15:00.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.123+0000 7f61db7fe640 1 --2- 172.21.15.99:0/2117658168 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f61d00a12e0 0x7f61d00a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:15:00.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.124+0000 7f61db7fe640 1 -- 172.21.15.99:0/2117658168 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f61cc0cc650 con 0x7f61e4100de0 2024-01-31T05:15:00.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.124+0000 7f61e259c640 1 --2- 172.21.15.99:0/2117658168 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f61d00a12e0 0x7f61d00a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:15:00.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.124+0000 7f61e259c640 1 --2- 172.21.15.99:0/2117658168 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f61d00a12e0 0x7f61d00a37a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f61e4100c40 tx=0x7f61d4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:15:00.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.128+0000 7f61db7fe640 1 -- 172.21.15.99:0/2117658168 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f61cc095b90 con 0x7f61e4100de0 2024-01-31T05:15:00.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:14:59 smithi179 ceph-mon[35652]: pgmap v457: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-01-31T05:15:00.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:14:59 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/3371323000' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:15:00.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:14:59 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/2664683015' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-31T05:15:00.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.370+0000 7f61e8e09640 1 -- 172.21.15.99:0/2117658168 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f61e410b680 con 0x7f61e4100de0 2024-01-31T05:15:00.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.372+0000 7f61db7fe640 1 -- 172.21.15.99:0/2117658168 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v43) v1 ==== 161+0+0 (secure 0 0 0) 0x7f61cc0991b0 con 0x7f61e4100de0 2024-01-31T05:15:00.371 INFO:teuthology.orchestra.run.smithi099.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-31T05:15:00.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.375+0000 7f61e8e09640 1 -- 172.21.15.99:0/2117658168 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f61d00a12e0 msgr2=0x7f61d00a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:15:00.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.375+0000 7f61e8e09640 1 --2- 172.21.15.99:0/2117658168 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f61d00a12e0 0x7f61d00a37a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f61e4100c40 tx=0x7f61d4005f90 comp rx=0 tx=0).stop 2024-01-31T05:15:00.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.375+0000 7f61e8e09640 1 -- 172.21.15.99:0/2117658168 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61e4100de0 msgr2=0x7f61e419b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:15:00.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.375+0000 7f61e8e09640 1 --2- 172.21.15.99:0/2117658168 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61e4100de0 0x7f61e419b950 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f61cc00d770 tx=0x7f61cc00dc30 comp rx=0 tx=0).stop 2024-01-31T05:15:00.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.377+0000 7f61e8e09640 1 -- 172.21.15.99:0/2117658168 shutdown_connections 2024-01-31T05:15:00.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.378+0000 7f61e8e09640 1 --2- 172.21.15.99:0/2117658168 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f61d00a12e0 0x7f61d00a37a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:15:00.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.378+0000 7f61e8e09640 1 --2- 172.21.15.99:0/2117658168 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f61e41017a0 0x7f61e419dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:15:00.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.378+0000 7f61e8e09640 1 --2- 172.21.15.99:0/2117658168 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61e4100de0 0x7f61e419b950 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:15:00.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.378+0000 7f61e8e09640 1 --2- 172.21.15.99:0/2117658168 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61e40ffbf0 0x7f61e4068a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:15:00.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.378+0000 7f61e8e09640 1 -- 172.21.15.99:0/2117658168 >> 172.21.15.99:0/2117658168 conn(0x7f61e40fb180 msgr2=0x7f61e4104150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:15:00.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.379+0000 7f61e8e09640 1 -- 172.21.15.99:0/2117658168 shutdown_connections 2024-01-31T05:15:00.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.379+0000 7f61e8e09640 1 -- 172.21.15.99:0/2117658168 wait complete. 2024-01-31T05:15:00.394 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-31T05:15:00.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.519+0000 7f3726278640 1 -- 172.21.15.99:0/2816923366 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3720100de0 msgr2=0x7f3720101260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:15:00.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.519+0000 7f3726278640 1 --2- 172.21.15.99:0/2816923366 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3720100de0 0x7f3720101260 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3714009860 tx=0x7f371402bb70 comp rx=0 tx=0).stop 2024-01-31T05:15:00.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.519+0000 7f3726278640 1 -- 172.21.15.99:0/2816923366 shutdown_connections 2024-01-31T05:15:00.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.519+0000 7f3726278640 1 --2- 172.21.15.99:0/2816923366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37201017a0 0x7f3720108030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:15:00.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.519+0000 7f3726278640 1 --2- 172.21.15.99:0/2816923366 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3720100de0 0x7f3720101260 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:15:00.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.519+0000 7f3726278640 1 --2- 172.21.15.99:0/2816923366 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f37200ffbf0 0x7f3720100010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:15:00.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.519+0000 7f3726278640 1 -- 172.21.15.99:0/2816923366 >> 172.21.15.99:0/2816923366 conn(0x7f37200fb180 msgr2=0x7f37200fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:15:00.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.519+0000 7f3726278640 1 -- 172.21.15.99:0/2816923366 shutdown_connections 2024-01-31T05:15:00.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.519+0000 7f3726278640 1 -- 172.21.15.99:0/2816923366 wait complete. 2024-01-31T05:15:00.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.519+0000 7f3726278640 1 Processor -- start 2024-01-31T05:15:00.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.519+0000 7f3726278640 1 -- start start 2024-01-31T05:15:00.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.520+0000 7f3726278640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f37200ffbf0 0x7f3720195c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:15:00.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.520+0000 7f3726278640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3720100de0 0x7f3720196180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:15:00.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.520+0000 7f3726278640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37201017a0 0x7f372019d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:15:00.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.520+0000 7f3726278640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372019d720 con 0x7f3720100de0 2024-01-31T05:15:00.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.520+0000 7f3726278640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372019d890 con 0x7f37201017a0 2024-01-31T05:15:00.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.520+0000 7f3726278640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372019da50 con 0x7f37200ffbf0 2024-01-31T05:15:00.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.520+0000 7f371f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3720100de0 0x7f3720196180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:15:00.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.520+0000 7f371f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3720100de0 0x7f3720196180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48606/0 (socket says 172.21.15.99:48606) 2024-01-31T05:15:00.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.520+0000 7f371f7fe640 1 -- 172.21.15.99:0/2167013481 learned_addr learned my addr 172.21.15.99:0/2167013481 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:15:00.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.520+0000 7f3724815640 1 --2- 172.21.15.99:0/2167013481 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37201017a0 0x7f372019d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:15:00.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.520+0000 7f371ffff640 1 --2- 172.21.15.99:0/2167013481 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f37200ffbf0 0x7f3720195c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:15:00.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.520+0000 7f371f7fe640 1 -- 172.21.15.99:0/2167013481 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f37200ffbf0 msgr2=0x7f3720195c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:15:00.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.520+0000 7f371f7fe640 1 --2- 172.21.15.99:0/2167013481 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f37200ffbf0 0x7f3720195c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:15:00.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.520+0000 7f371f7fe640 1 -- 172.21.15.99:0/2167013481 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37201017a0 msgr2=0x7f372019d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:15:00.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.520+0000 7f371f7fe640 1 --2- 172.21.15.99:0/2167013481 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37201017a0 0x7f372019d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:15:00.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.520+0000 7f371f7fe640 1 -- 172.21.15.99:0/2167013481 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3718009900 con 0x7f3720100de0 2024-01-31T05:15:00.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.520+0000 7f371f7fe640 1 --2- 172.21.15.99:0/2167013481 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3720100de0 0x7f3720196180 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f3714034a00 tx=0x7f3714034780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:15:00.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.520+0000 7f371d7fa640 1 -- 172.21.15.99:0/2167013481 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3714004510 con 0x7f3720100de0 2024-01-31T05:15:00.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.521+0000 7f3726278640 1 -- 172.21.15.99:0/2167013481 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3714009490 con 0x7f3720100de0 2024-01-31T05:15:00.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.521+0000 7f371d7fa640 1 -- 172.21.15.99:0/2167013481 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f371402c9d0 con 0x7f3720100de0 2024-01-31T05:15:00.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.521+0000 7f371d7fa640 1 -- 172.21.15.99:0/2167013481 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3714032600 con 0x7f3720100de0 2024-01-31T05:15:00.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.521+0000 7f3726278640 1 -- 172.21.15.99:0/2167013481 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f372019dff0 con 0x7f3720100de0 2024-01-31T05:15:00.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.522+0000 7f3726278640 1 -- 172.21.15.99:0/2167013481 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3720107020 con 0x7f3720100de0 2024-01-31T05:15:00.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.522+0000 7f371d7fa640 1 -- 172.21.15.99:0/2167013481 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 20) v1 ==== 135895+0+0 (secure 0 0 0) 0x7f371403b040 con 0x7f3720100de0 2024-01-31T05:15:00.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.523+0000 7f371d7fa640 1 --2- 172.21.15.99:0/2167013481 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f37080a12e0 0x7f37080a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:15:00.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.523+0000 7f371ffff640 1 --2- 172.21.15.99:0/2167013481 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f37080a12e0 0x7f37080a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:15:00.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.523+0000 7f371d7fa640 1 -- 172.21.15.99:0/2167013481 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8554+0+0 (secure 0 0 0) 0x7f37140ee7f0 con 0x7f3720100de0 2024-01-31T05:15:00.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.524+0000 7f371ffff640 1 --2- 172.21.15.99:0/2167013481 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f37080a12e0 0x7f37080a37a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3720197110 tx=0x7f3710005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:15:00.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.528+0000 7f371d7fa640 1 -- 172.21.15.99:0/2167013481 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f37140b7b50 con 0x7f3720100de0 2024-01-31T05:15:00.568 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:00 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mon-a[31611]: 2024-01-31T05:15:00.371+0000 7fcac0935700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-31T05:15:00.568 INFO:journalctl@ceph.mds.g.smithi099.stdout:Jan 31 05:15:00 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-g[73552]: ignoring --setuser ceph since I am not root 2024-01-31T05:15:00.568 INFO:journalctl@ceph.mds.g.smithi099.stdout:Jan 31 05:15:00 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-g[73552]: ignoring --setgroup ceph since I am not root 2024-01-31T05:15:00.569 INFO:journalctl@ceph.mds.g.smithi099.stdout:Jan 31 05:15:00 smithi099 ceph-mds[73556]: -- 172.21.15.99:0/4244548012 <== mon.0 v2:172.21.15.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558aed1cd520 con 0x558aed1a2c00 2024-01-31T05:15:00.569 INFO:journalctl@ceph.mds.g.smithi099.stdout:Jan 31 05:15:00 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-g[73552]: starting mds.g at 2024-01-31T05:15:00.569 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:15:00 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: ignoring --setuser ceph since I am not root 2024-01-31T05:15:00.569 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:15:00 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: ignoring --setgroup ceph since I am not root 2024-01-31T05:15:00.569 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:15:00 smithi099 ceph-mds[73918]: -- 172.21.15.99:0/3668237494 <== mon.0 v2:172.21.15.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558834801520 con 0x5588347d6c00 2024-01-31T05:15:00.569 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:15:00 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: starting mds.a at 2024-01-31T05:15:00.741 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:15:00 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: ignoring --setuser ceph since I am not root 2024-01-31T05:15:00.742 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:15:00 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: ignoring --setgroup ceph since I am not root 2024-01-31T05:15:00.742 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:15:00 smithi181 ceph-mds[68164]: -- 172.21.15.181:0/1318882669 <== mon.2 v2:172.21.15.179:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x562d5a1fd520 con 0x562d5a1d2800 2024-01-31T05:15:00.742 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:15:00 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: starting mds.c at 2024-01-31T05:15:00.742 INFO:journalctl@ceph.mds.b.smithi179.stdout:Jan 31 05:15:00 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-b[66457]: ignoring --setuser ceph since I am not root 2024-01-31T05:15:00.742 INFO:journalctl@ceph.mds.b.smithi179.stdout:Jan 31 05:15:00 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-b[66457]: ignoring --setgroup ceph since I am not root 2024-01-31T05:15:00.742 INFO:journalctl@ceph.mds.b.smithi179.stdout:Jan 31 05:15:00 smithi179 ceph-mds[66461]: -- 172.21.15.179:0/70302804 <== mon.1 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x559206ae3520 con 0x559206ab8c00 2024-01-31T05:15:00.742 INFO:journalctl@ceph.mds.b.smithi179.stdout:Jan 31 05:15:00 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-b[66457]: starting mds.b at 2024-01-31T05:15:00.743 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:15:00 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: ignoring --setuser ceph since I am not root 2024-01-31T05:15:00.743 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:15:00 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: ignoring --setgroup ceph since I am not root 2024-01-31T05:15:00.743 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:15:00 smithi181 ceph-mds[68484]: -- 172.21.15.181:0/2845561368 <== mon.2 v2:172.21.15.179:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ba002b7520 con 0x55ba0028d000 2024-01-31T05:15:00.743 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:15:00 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: starting mds.i at 2024-01-31T05:15:00.744 INFO:journalctl@ceph.mds.e.smithi179.stdout:Jan 31 05:15:00 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-e[65832]: ignoring --setuser ceph since I am not root 2024-01-31T05:15:00.744 INFO:journalctl@ceph.mds.e.smithi179.stdout:Jan 31 05:15:00 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-e[65832]: ignoring --setgroup ceph since I am not root 2024-01-31T05:15:00.744 INFO:journalctl@ceph.mds.e.smithi179.stdout:Jan 31 05:15:00 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-e[65832]: starting mds.e at 2024-01-31T05:15:00.744 INFO:journalctl@ceph.mds.f.smithi181.stdout:Jan 31 05:15:00 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-f[67853]: ignoring --setuser ceph since I am not root 2024-01-31T05:15:00.744 INFO:journalctl@ceph.mds.f.smithi181.stdout:Jan 31 05:15:00 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-f[67853]: ignoring --setgroup ceph since I am not root 2024-01-31T05:15:00.744 INFO:journalctl@ceph.mds.f.smithi181.stdout:Jan 31 05:15:00 smithi181 ceph-mds[67857]: -- 172.21.15.181:0/2170908584 <== mon.1 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558344bd7520 con 0x558344bacc00 2024-01-31T05:15:00.744 INFO:journalctl@ceph.mds.f.smithi181.stdout:Jan 31 05:15:00 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-f[67853]: starting mds.f at 2024-01-31T05:15:00.745 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:15:00 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: ignoring --setuser ceph since I am not root 2024-01-31T05:15:00.745 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:15:00 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: ignoring --setgroup ceph since I am not root 2024-01-31T05:15:00.745 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:15:00 smithi179 ceph-mds[66144]: -- 172.21.15.179:0/4288421728 <== mon.2 v2:172.21.15.179:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5640cedf9520 con 0x5640cedcec00 2024-01-31T05:15:00.745 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:15:00 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: starting mds.h at 2024-01-31T05:15:00.745 INFO:journalctl@ceph.mds.l.smithi181.stdout:Jan 31 05:15:00 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-l[67541]: ignoring --setuser ceph since I am not root 2024-01-31T05:15:00.745 INFO:journalctl@ceph.mds.l.smithi181.stdout:Jan 31 05:15:00 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-l[67541]: ignoring --setgroup ceph since I am not root 2024-01-31T05:15:00.745 INFO:journalctl@ceph.mds.l.smithi181.stdout:Jan 31 05:15:00 smithi181 ceph-mds[67545]: -- 172.21.15.181:0/3323427837 <== mon.0 v2:172.21.15.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556cbdc6f520 con 0x556cbdc44800 2024-01-31T05:15:00.745 INFO:journalctl@ceph.mds.l.smithi181.stdout:Jan 31 05:15:00 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-l[67541]: starting mds.l at 2024-01-31T05:15:00.745 INFO:journalctl@ceph.mds.k.smithi179.stdout:Jan 31 05:15:00 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-k[65508]: ignoring --setuser ceph since I am not root 2024-01-31T05:15:00.746 INFO:journalctl@ceph.mds.k.smithi179.stdout:Jan 31 05:15:00 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-k[65508]: ignoring --setgroup ceph since I am not root 2024-01-31T05:15:00.746 INFO:journalctl@ceph.mds.k.smithi179.stdout:Jan 31 05:15:00 smithi179 ceph-mds[65512]: -- 172.21.15.179:0/3219036365 <== mon.2 v2:172.21.15.179:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55df4ebb1520 con 0x55df4eb86c00 2024-01-31T05:15:00.746 INFO:journalctl@ceph.mds.k.smithi179.stdout:Jan 31 05:15:00 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-k[65508]: starting mds.k at 2024-01-31T05:15:00.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:00.769+0000 7f3726278640 1 -- 172.21.15.99:0/2167013481 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f372002ca70 con 0x7f3720100de0 2024-01-31T05:15:01.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:00 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/1033598051' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:15:01.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:00 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/2117658168' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-01-31T05:15:01.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:00 smithi099 ceph-mon[31615]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-01-31T05:15:01.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:00 smithi099 ceph-mon[31615]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-31T05:15:01.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:00 smithi099 ceph-mon[31615]: Health check cleared: MDS_DAMAGE (was: 4 MDSs report damaged metadata) 2024-01-31T05:15:01.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:00 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/2117658168' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-01-31T05:15:01.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:00 smithi099 ceph-mon[31615]: osdmap e89: 12 total, 12 up, 12 in 2024-01-31T05:15:01.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:00 smithi099 ceph-mon[31615]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-01-31T05:15:01.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:15:00 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/1033598051' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:15:01.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:15:00 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/2117658168' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-01-31T05:15:01.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:15:00 smithi181 ceph-mon[36434]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-01-31T05:15:01.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:15:00 smithi181 ceph-mon[36434]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-31T05:15:01.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:15:00 smithi181 ceph-mon[36434]: Health check cleared: MDS_DAMAGE (was: 4 MDSs report damaged metadata) 2024-01-31T05:15:01.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:15:00 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/2117658168' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-01-31T05:15:01.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:15:00 smithi181 ceph-mon[36434]: osdmap e89: 12 total, 12 up, 12 in 2024-01-31T05:15:01.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:15:00 smithi181 ceph-mon[36434]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-01-31T05:15:01.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:15:00 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/1033598051' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-31T05:15:01.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:15:00 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/2117658168' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-01-31T05:15:01.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:15:00 smithi179 ceph-mon[35652]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-01-31T05:15:01.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:15:00 smithi179 ceph-mon[35652]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-31T05:15:01.132 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:15:00 smithi179 ceph-mon[35652]: Health check cleared: MDS_DAMAGE (was: 4 MDSs report damaged metadata) 2024-01-31T05:15:01.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:15:00 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/2117658168' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-01-31T05:15:01.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:15:00 smithi179 ceph-mon[35652]: osdmap e89: 12 total, 12 up, 12 in 2024-01-31T05:15:01.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:15:00 smithi179 ceph-mon[35652]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-01-31T05:15:01.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.377+0000 7f371d7fa640 1 -- 172.21.15.99:0/2167013481 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v44) v1 ==== 104+0+0 (secure 0 0 0) 0x7f37140b9a80 con 0x7f3720100de0 2024-01-31T05:15:01.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.380+0000 7f3726278640 1 -- 172.21.15.99:0/2167013481 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f37080a12e0 msgr2=0x7f37080a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:15:01.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.380+0000 7f3726278640 1 --2- 172.21.15.99:0/2167013481 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f37080a12e0 0x7f37080a37a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3720197110 tx=0x7f3710005f90 comp rx=0 tx=0).stop 2024-01-31T05:15:01.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.380+0000 7f3726278640 1 -- 172.21.15.99:0/2167013481 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3720100de0 msgr2=0x7f3720196180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:15:01.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.380+0000 7f3726278640 1 --2- 172.21.15.99:0/2167013481 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3720100de0 0x7f3720196180 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f3714034a00 tx=0x7f3714034780 comp rx=0 tx=0).stop 2024-01-31T05:15:01.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.380+0000 7f3726278640 1 -- 172.21.15.99:0/2167013481 shutdown_connections 2024-01-31T05:15:01.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.380+0000 7f3726278640 1 --2- 172.21.15.99:0/2167013481 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7f37080a12e0 0x7f37080a37a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:15:01.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.380+0000 7f3726278640 1 --2- 172.21.15.99:0/2167013481 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37201017a0 0x7f372019d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:15:01.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.380+0000 7f3726278640 1 --2- 172.21.15.99:0/2167013481 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3720100de0 0x7f3720196180 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:15:01.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.380+0000 7f3726278640 1 --2- 172.21.15.99:0/2167013481 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f37200ffbf0 0x7f3720195c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:15:01.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.380+0000 7f3726278640 1 -- 172.21.15.99:0/2167013481 >> 172.21.15.99:0/2167013481 conn(0x7f37200fb180 msgr2=0x7f37201041f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:15:01.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.380+0000 7f3726278640 1 -- 172.21.15.99:0/2167013481 shutdown_connections 2024-01-31T05:15:01.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.380+0000 7f3726278640 1 -- 172.21.15.99:0/2167013481 wait complete. 2024-01-31T05:15:01.393 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-31T05:15:01.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.500+0000 7fa92e46e640 1 -- 172.21.15.99:0/4039273839 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9281040b0 msgr2=0x7fa9281064a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:15:01.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.500+0000 7fa92e46e640 1 --2- 172.21.15.99:0/4039273839 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9281040b0 0x7fa9281064a0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fa91c009900 tx=0x7fa91c02bc30 comp rx=0 tx=0).stop 2024-01-31T05:15:01.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.500+0000 7fa92e46e640 1 -- 172.21.15.99:0/4039273839 shutdown_connections 2024-01-31T05:15:01.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.500+0000 7fa92e46e640 1 --2- 172.21.15.99:0/4039273839 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9281069e0 0x7fa928108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:15:01.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.500+0000 7fa92e46e640 1 --2- 172.21.15.99:0/4039273839 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9281040b0 0x7fa9281064a0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:15:01.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.500+0000 7fa92e46e640 1 --2- 172.21.15.99:0/4039273839 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa928101780 0x7fa928103b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:15:01.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.500+0000 7fa92e46e640 1 -- 172.21.15.99:0/4039273839 >> 172.21.15.99:0/4039273839 conn(0x7fa9280fb190 msgr2=0x7fa9280fd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:15:01.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.500+0000 7fa92e46e640 1 -- 172.21.15.99:0/4039273839 shutdown_connections 2024-01-31T05:15:01.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.500+0000 7fa92e46e640 1 -- 172.21.15.99:0/4039273839 wait complete. 2024-01-31T05:15:01.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.501+0000 7fa92e46e640 1 Processor -- start 2024-01-31T05:15:01.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.501+0000 7fa92e46e640 1 -- start start 2024-01-31T05:15:01.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.501+0000 7fa92e46e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa928101780 0x7fa928196d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:15:01.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.501+0000 7fa92e46e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9281040b0 0x7fa928197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:15:01.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.501+0000 7fa92e46e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9281069e0 0x7fa92819e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:15:01.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.501+0000 7fa92e46e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92819e830 con 0x7fa9281040b0 2024-01-31T05:15:01.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.501+0000 7fa92e46e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92819e9a0 con 0x7fa928101780 2024-01-31T05:15:01.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.501+0000 7fa92e46e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92819eb60 con 0x7fa9281069e0 2024-01-31T05:15:01.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.501+0000 7fa9277fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9281040b0 0x7fa928197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:15:01.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.501+0000 7fa9277fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9281040b0 0x7fa928197280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48630/0 (socket says 172.21.15.99:48630) 2024-01-31T05:15:01.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.501+0000 7fa9277fe640 1 -- 172.21.15.99:0/1625592472 learned_addr learned my addr 172.21.15.99:0/1625592472 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:15:01.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.502+0000 7fa927fff640 1 --2- 172.21.15.99:0/1625592472 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa928101780 0x7fa928196d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:15:01.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.502+0000 7fa92ca0b640 1 --2- 172.21.15.99:0/1625592472 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9281069e0 0x7fa92819e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:15:01.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.502+0000 7fa9277fe640 1 -- 172.21.15.99:0/1625592472 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9281069e0 msgr2=0x7fa92819e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:15:01.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.502+0000 7fa9277fe640 1 --2- 172.21.15.99:0/1625592472 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9281069e0 0x7fa92819e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:15:01.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.502+0000 7fa9277fe640 1 -- 172.21.15.99:0/1625592472 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa928101780 msgr2=0x7fa928196d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:15:01.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.502+0000 7fa9277fe640 1 --2- 172.21.15.99:0/1625592472 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa928101780 0x7fa928196d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:15:01.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.502+0000 7fa9277fe640 1 -- 172.21.15.99:0/1625592472 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa91c009560 con 0x7fa9281040b0 2024-01-31T05:15:01.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.502+0000 7fa927fff640 1 --2- 172.21.15.99:0/1625592472 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa928101780 0x7fa928196d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-31T05:15:01.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.502+0000 7fa9277fe640 1 --2- 172.21.15.99:0/1625592472 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9281040b0 0x7fa928197280 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fa91c009230 tx=0x7fa91c004f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:15:01.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.502+0000 7fa9257fa640 1 -- 172.21.15.99:0/1625592472 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91c0043d0 con 0x7fa9281040b0 2024-01-31T05:15:01.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.502+0000 7fa9257fa640 1 -- 172.21.15.99:0/1625592472 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa91c0054c0 con 0x7fa9281040b0 2024-01-31T05:15:01.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.502+0000 7fa92e46e640 1 -- 172.21.15.99:0/1625592472 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa92819ede0 con 0x7fa9281040b0 2024-01-31T05:15:01.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.502+0000 7fa9257fa640 1 -- 172.21.15.99:0/1625592472 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91c003e60 con 0x7fa9281040b0 2024-01-31T05:15:01.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.502+0000 7fa92e46e640 1 -- 172.21.15.99:0/1625592472 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa92819f270 con 0x7fa9281040b0 2024-01-31T05:15:01.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.503+0000 7fa92e46e640 1 -- 172.21.15.99:0/1625592472 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9280fcc80 con 0x7fa9281040b0 2024-01-31T05:15:01.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.505+0000 7fa9257fa640 1 -- 172.21.15.99:0/1625592472 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 20) v1 ==== 135895+0+0 (secure 0 0 0) 0x7fa91c0035f0 con 0x7fa9281040b0 2024-01-31T05:15:01.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.505+0000 7fa9257fa640 1 --2- 172.21.15.99:0/1625592472 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa9100a1360 0x7fa9100a3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:15:01.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.505+0000 7fa927fff640 1 --2- 172.21.15.99:0/1625592472 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa9100a1360 0x7fa9100a3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:15:01.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.506+0000 7fa9257fa640 1 -- 172.21.15.99:0/1625592472 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8554+0+0 (secure 0 0 0) 0x7fa91c0efa30 con 0x7fa9281040b0 2024-01-31T05:15:01.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.506+0000 7fa927fff640 1 --2- 172.21.15.99:0/1625592472 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa9100a1360 0x7fa9100a3820 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa9180058c0 tx=0x7fa918005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:15:01.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.509+0000 7fa9257fa640 1 -- 172.21.15.99:0/1625592472 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fa91c0b8d10 con 0x7fa9281040b0 2024-01-31T05:15:01.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:01.681+0000 7fa92e46e640 1 -- 172.21.15.99:0/1625592472 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa92810c5b0 con 0x7fa9281040b0 2024-01-31T05:15:02.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:01 smithi099 ceph-mon[31615]: pgmap v459: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-01-31T05:15:02.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:01 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/2167013481' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-01-31T05:15:02.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:01 smithi099 ceph-mon[31615]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-01-31T05:15:02.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:01 smithi099 ceph-mon[31615]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-01-31T05:15:02.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:01 smithi099 ceph-mon[31615]: Cluster is now healthy 2024-01-31T05:15:02.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:01 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/2167013481' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-01-31T05:15:02.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:01 smithi099 ceph-mon[31615]: mds.? [v2:172.21.15.179:6834/2109710500,v1:172.21.15.179:6835/2109710500] up:boot 2024-01-31T05:15:02.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:01 smithi099 ceph-mon[31615]: mds.? [v2:172.21.15.99:6840/2340462130,v1:172.21.15.99:6841/2340462130] up:boot 2024-01-31T05:15:02.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:01 smithi099 ceph-mon[31615]: mds.? [v2:172.21.15.181:6833/122657248,v1:172.21.15.181:6835/122657248] up:boot 2024-01-31T05:15:02.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:01 smithi099 ceph-mon[31615]: mds.? [v2:172.21.15.181:6832/3201487620,v1:172.21.15.181:6834/3201487620] up:boot 2024-01-31T05:15:02.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:01 smithi099 ceph-mon[31615]: mds.? [v2:172.21.15.179:6832/1969574004,v1:172.21.15.179:6833/1969574004] up:boot 2024-01-31T05:15:02.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:01 smithi099 ceph-mon[31615]: mds.? [v2:172.21.15.99:6838/1115295586,v1:172.21.15.99:6839/1115295586] up:boot 2024-01-31T05:15:02.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:01 smithi099 ceph-mon[31615]: mds.? [v2:172.21.15.179:6838/765413910,v1:172.21.15.179:6839/765413910] up:boot 2024-01-31T05:15:02.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:01 smithi099 ceph-mon[31615]: mds.? [v2:172.21.15.179:6836/3886089072,v1:172.21.15.179:6837/3886089072] up:boot 2024-01-31T05:15:02.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:01 smithi099 ceph-mon[31615]: mds.? [v2:172.21.15.181:6836/3202192636,v1:172.21.15.181:6838/3202192636] up:boot 2024-01-31T05:15:02.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:01 smithi099 ceph-mon[31615]: mds.? [v2:172.21.15.181:6837/1583396153,v1:172.21.15.181:6839/1583396153] up:boot 2024-01-31T05:15:02.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:01 smithi099 ceph-mon[31615]: fsmap 12 up:standby 2024-01-31T05:15:02.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:01 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-01-31T05:15:02.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:01 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-01-31T05:15:02.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:01 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-01-31T05:15:02.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:01 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-01-31T05:15:02.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:01 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-01-31T05:15:02.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:01 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-01-31T05:15:02.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:01 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-01-31T05:15:02.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:01 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-01-31T05:15:02.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:01 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-01-31T05:15:02.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:01 smithi099 ceph-mon[31615]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-01-31T05:15:02.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:01 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/1625592472' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-01-31T05:15:02.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:15:01 smithi181 ceph-mon[36434]: pgmap v459: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-01-31T05:15:02.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:15:01 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/2167013481' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-01-31T05:15:02.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:15:01 smithi181 ceph-mon[36434]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-01-31T05:15:02.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:15:01 smithi181 ceph-mon[36434]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-01-31T05:15:02.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:15:01 smithi181 ceph-mon[36434]: Cluster is now healthy 2024-01-31T05:15:02.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:15:01 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/2167013481' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-01-31T05:15:02.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:15:01 smithi181 ceph-mon[36434]: mds.? [v2:172.21.15.179:6834/2109710500,v1:172.21.15.179:6835/2109710500] up:boot 2024-01-31T05:15:02.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:15:01 smithi181 ceph-mon[36434]: mds.? [v2:172.21.15.99:6840/2340462130,v1:172.21.15.99:6841/2340462130] up:boot 2024-01-31T05:15:02.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:15:01 smithi181 ceph-mon[36434]: mds.? [v2:172.21.15.181:6833/122657248,v1:172.21.15.181:6835/122657248] up:boot 2024-01-31T05:15:02.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:15:01 smithi181 ceph-mon[36434]: mds.? [v2:172.21.15.181:6832/3201487620,v1:172.21.15.181:6834/3201487620] up:boot 2024-01-31T05:15:02.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:15:01 smithi181 ceph-mon[36434]: mds.? [v2:172.21.15.179:6832/1969574004,v1:172.21.15.179:6833/1969574004] up:boot 2024-01-31T05:15:02.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:15:01 smithi181 ceph-mon[36434]: mds.? [v2:172.21.15.99:6838/1115295586,v1:172.21.15.99:6839/1115295586] up:boot 2024-01-31T05:15:02.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:15:01 smithi181 ceph-mon[36434]: mds.? [v2:172.21.15.179:6838/765413910,v1:172.21.15.179:6839/765413910] up:boot 2024-01-31T05:15:02.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:15:01 smithi181 ceph-mon[36434]: mds.? [v2:172.21.15.179:6836/3886089072,v1:172.21.15.179:6837/3886089072] up:boot 2024-01-31T05:15:02.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:15:01 smithi181 ceph-mon[36434]: mds.? [v2:172.21.15.181:6836/3202192636,v1:172.21.15.181:6838/3202192636] up:boot 2024-01-31T05:15:02.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:15:01 smithi181 ceph-mon[36434]: mds.? [v2:172.21.15.181:6837/1583396153,v1:172.21.15.181:6839/1583396153] up:boot 2024-01-31T05:15:02.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:15:01 smithi181 ceph-mon[36434]: fsmap 12 up:standby 2024-01-31T05:15:02.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:15:01 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-01-31T05:15:02.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:15:01 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-01-31T05:15:02.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:15:01 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-01-31T05:15:02.072 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:15:01 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-01-31T05:15:02.073 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:15:01 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-01-31T05:15:02.073 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:15:01 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-01-31T05:15:02.073 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:15:01 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-01-31T05:15:02.073 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:15:01 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-01-31T05:15:02.073 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:15:01 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-01-31T05:15:02.073 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:15:01 smithi181 ceph-mon[36434]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-01-31T05:15:02.073 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:15:01 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/1625592472' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-01-31T05:15:02.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:15:01 smithi179 ceph-mon[35652]: pgmap v459: 97 pgs: 97 active+clean; 37 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-01-31T05:15:02.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:15:01 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/2167013481' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-01-31T05:15:02.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:15:01 smithi179 ceph-mon[35652]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-01-31T05:15:02.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:15:01 smithi179 ceph-mon[35652]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-01-31T05:15:02.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:15:01 smithi179 ceph-mon[35652]: Cluster is now healthy 2024-01-31T05:15:02.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:15:01 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/2167013481' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-01-31T05:15:02.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:15:01 smithi179 ceph-mon[35652]: mds.? [v2:172.21.15.179:6834/2109710500,v1:172.21.15.179:6835/2109710500] up:boot 2024-01-31T05:15:02.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:15:01 smithi179 ceph-mon[35652]: mds.? [v2:172.21.15.99:6840/2340462130,v1:172.21.15.99:6841/2340462130] up:boot 2024-01-31T05:15:02.133 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:15:01 smithi179 ceph-mon[35652]: mds.? [v2:172.21.15.181:6833/122657248,v1:172.21.15.181:6835/122657248] up:boot 2024-01-31T05:15:02.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:15:01 smithi179 ceph-mon[35652]: mds.? [v2:172.21.15.181:6832/3201487620,v1:172.21.15.181:6834/3201487620] up:boot 2024-01-31T05:15:02.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:15:01 smithi179 ceph-mon[35652]: mds.? [v2:172.21.15.179:6832/1969574004,v1:172.21.15.179:6833/1969574004] up:boot 2024-01-31T05:15:02.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:15:01 smithi179 ceph-mon[35652]: mds.? [v2:172.21.15.99:6838/1115295586,v1:172.21.15.99:6839/1115295586] up:boot 2024-01-31T05:15:02.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:15:01 smithi179 ceph-mon[35652]: mds.? [v2:172.21.15.179:6838/765413910,v1:172.21.15.179:6839/765413910] up:boot 2024-01-31T05:15:02.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:15:01 smithi179 ceph-mon[35652]: mds.? [v2:172.21.15.179:6836/3886089072,v1:172.21.15.179:6837/3886089072] up:boot 2024-01-31T05:15:02.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:15:01 smithi179 ceph-mon[35652]: mds.? [v2:172.21.15.181:6836/3202192636,v1:172.21.15.181:6838/3202192636] up:boot 2024-01-31T05:15:02.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:15:01 smithi179 ceph-mon[35652]: mds.? [v2:172.21.15.181:6837/1583396153,v1:172.21.15.181:6839/1583396153] up:boot 2024-01-31T05:15:02.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:15:01 smithi179 ceph-mon[35652]: fsmap 12 up:standby 2024-01-31T05:15:02.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:15:01 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-01-31T05:15:02.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:15:01 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-01-31T05:15:02.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:15:01 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-01-31T05:15:02.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:15:01 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-01-31T05:15:02.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:15:01 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-01-31T05:15:02.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:15:01 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-01-31T05:15:02.134 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:15:01 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-01-31T05:15:02.135 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:15:01 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-01-31T05:15:02.135 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:15:01 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-01-31T05:15:02.135 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:15:01 smithi179 ceph-mon[35652]: from='mgr.14152 172.21.15.99:0/2297379529' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-01-31T05:15:02.135 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:15:01 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/1625592472' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-01-31T05:15:02.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.379+0000 7fa9257fa640 1 -- 172.21.15.99:0/1625592472 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v90) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa91c0430d0 con 0x7fa9281040b0 2024-01-31T05:15:02.379 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_metadata' removed 2024-01-31T05:15:02.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.383+0000 7fa92e46e640 1 -- 172.21.15.99:0/1625592472 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa9100a1360 msgr2=0x7fa9100a3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:15:02.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.383+0000 7fa92e46e640 1 --2- 172.21.15.99:0/1625592472 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa9100a1360 0x7fa9100a3820 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa9180058c0 tx=0x7fa918005850 comp rx=0 tx=0).stop 2024-01-31T05:15:02.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.383+0000 7fa92e46e640 1 -- 172.21.15.99:0/1625592472 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9281040b0 msgr2=0x7fa928197280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:15:02.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.383+0000 7fa92e46e640 1 --2- 172.21.15.99:0/1625592472 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9281040b0 0x7fa928197280 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fa91c009230 tx=0x7fa91c004f40 comp rx=0 tx=0).stop 2024-01-31T05:15:02.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.383+0000 7fa92e46e640 1 -- 172.21.15.99:0/1625592472 shutdown_connections 2024-01-31T05:15:02.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.383+0000 7fa92e46e640 1 --2- 172.21.15.99:0/1625592472 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fa9100a1360 0x7fa9100a3820 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:15:02.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.383+0000 7fa92e46e640 1 --2- 172.21.15.99:0/1625592472 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9281069e0 0x7fa92819e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:15:02.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.383+0000 7fa92e46e640 1 --2- 172.21.15.99:0/1625592472 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9281040b0 0x7fa928197280 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:15:02.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.383+0000 7fa92e46e640 1 --2- 172.21.15.99:0/1625592472 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa928101780 0x7fa928196d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:15:02.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.383+0000 7fa92e46e640 1 -- 172.21.15.99:0/1625592472 >> 172.21.15.99:0/1625592472 conn(0x7fa9280fb190 msgr2=0x7fa9281021c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:15:02.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.383+0000 7fa92e46e640 1 -- 172.21.15.99:0/1625592472 shutdown_connections 2024-01-31T05:15:02.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.383+0000 7fa92e46e640 1 -- 172.21.15.99:0/1625592472 wait complete. 2024-01-31T05:15:02.398 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-31T05:15:02.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.510+0000 7fb13fe94640 1 -- 172.21.15.99:0/252723943 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1380ffbf0 msgr2=0x7fb138100010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:15:02.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.510+0000 7fb13fe94640 1 --2- 172.21.15.99:0/252723943 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1380ffbf0 0x7fb138100010 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fb134009ca0 tx=0x7fb13402c0f0 comp rx=0 tx=0).stop 2024-01-31T05:15:02.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.510+0000 7fb13fe94640 1 -- 172.21.15.99:0/252723943 shutdown_connections 2024-01-31T05:15:02.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.510+0000 7fb13fe94640 1 --2- 172.21.15.99:0/252723943 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1381017a0 0x7fb138108030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:15:02.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.510+0000 7fb13fe94640 1 --2- 172.21.15.99:0/252723943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb138100de0 0x7fb138101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:15:02.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.510+0000 7fb13fe94640 1 --2- 172.21.15.99:0/252723943 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1380ffbf0 0x7fb138100010 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:15:02.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.510+0000 7fb13fe94640 1 -- 172.21.15.99:0/252723943 >> 172.21.15.99:0/252723943 conn(0x7fb1380fb180 msgr2=0x7fb1380fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:15:02.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.511+0000 7fb13fe94640 1 -- 172.21.15.99:0/252723943 shutdown_connections 2024-01-31T05:15:02.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.511+0000 7fb13fe94640 1 -- 172.21.15.99:0/252723943 wait complete. 2024-01-31T05:15:02.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.511+0000 7fb13fe94640 1 Processor -- start 2024-01-31T05:15:02.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.511+0000 7fb13fe94640 1 -- start start 2024-01-31T05:15:02.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.511+0000 7fb13fe94640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1380ffbf0 0x7fb1380689e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:15:02.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.511+0000 7fb13fe94640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb138100de0 0x7fb13819ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:15:02.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.511+0000 7fb13fe94640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1381017a0 0x7fb13819e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:15:02.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.511+0000 7fb13fe94640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13819e800 con 0x7fb138100de0 2024-01-31T05:15:02.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.511+0000 7fb13fe94640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13819e970 con 0x7fb1380ffbf0 2024-01-31T05:15:02.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.511+0000 7fb13fe94640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13819eb30 con 0x7fb1381017a0 2024-01-31T05:15:02.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.511+0000 7fb13d42f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb138100de0 0x7fb13819ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:15:02.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.511+0000 7fb13d42f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb138100de0 0x7fb13819ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48648/0 (socket says 172.21.15.99:48648) 2024-01-31T05:15:02.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.511+0000 7fb13d42f640 1 -- 172.21.15.99:0/2383917831 learned_addr learned my addr 172.21.15.99:0/2383917831 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-01-31T05:15:02.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.512+0000 7fb13e431640 1 --2- 172.21.15.99:0/2383917831 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1381017a0 0x7fb13819e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:15:02.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.512+0000 7fb13dc30640 1 --2- 172.21.15.99:0/2383917831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1380ffbf0 0x7fb1380689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:15:02.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.512+0000 7fb13d42f640 1 -- 172.21.15.99:0/2383917831 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1381017a0 msgr2=0x7fb13819e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:15:02.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.512+0000 7fb13d42f640 1 --2- 172.21.15.99:0/2383917831 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1381017a0 0x7fb13819e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:15:02.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.512+0000 7fb13d42f640 1 -- 172.21.15.99:0/2383917831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1380ffbf0 msgr2=0x7fb1380689e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:15:02.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.512+0000 7fb13d42f640 1 --2- 172.21.15.99:0/2383917831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1380ffbf0 0x7fb1380689e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:15:02.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.512+0000 7fb13d42f640 1 -- 172.21.15.99:0/2383917831 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb134009900 con 0x7fb138100de0 2024-01-31T05:15:02.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.512+0000 7fb13dc30640 1 --2- 172.21.15.99:0/2383917831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1380ffbf0 0x7fb1380689e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-31T05:15:02.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.512+0000 7fb13d42f640 1 --2- 172.21.15.99:0/2383917831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb138100de0 0x7fb13819ba30 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fb12800e9f0 tx=0x7fb12800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:15:02.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.512+0000 7fb12effd640 1 -- 172.21.15.99:0/2383917831 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb128009700 con 0x7fb138100de0 2024-01-31T05:15:02.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.512+0000 7fb13fe94640 1 -- 172.21.15.99:0/2383917831 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb13819ee10 con 0x7fb138100de0 2024-01-31T05:15:02.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.512+0000 7fb12effd640 1 -- 172.21.15.99:0/2383917831 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb12800cd80 con 0x7fb138100de0 2024-01-31T05:15:02.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.512+0000 7fb12effd640 1 -- 172.21.15.99:0/2383917831 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb128018860 con 0x7fb138100de0 2024-01-31T05:15:02.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.512+0000 7fb13fe94640 1 -- 172.21.15.99:0/2383917831 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb13819f290 con 0x7fb138100de0 2024-01-31T05:15:02.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.513+0000 7fb13fe94640 1 -- 172.21.15.99:0/2383917831 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb138107000 con 0x7fb138100de0 2024-01-31T05:15:02.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.514+0000 7fb12effd640 1 -- 172.21.15.99:0/2383917831 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 20) v1 ==== 135895+0+0 (secure 0 0 0) 0x7fb1280189c0 con 0x7fb138100de0 2024-01-31T05:15:02.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.514+0000 7fb12effd640 1 --2- 172.21.15.99:0/2383917831 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb1240a12e0 0x7fb1240a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-31T05:15:02.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.515+0000 7fb13dc30640 1 --2- 172.21.15.99:0/2383917831 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb1240a12e0 0x7fb1240a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-31T05:15:02.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.515+0000 7fb12effd640 1 -- 172.21.15.99:0/2383917831 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8058+0+0 (secure 0 0 0) 0x7fb128014070 con 0x7fb138100de0 2024-01-31T05:15:02.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.515+0000 7fb13dc30640 1 --2- 172.21.15.99:0/2383917831 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb1240a12e0 0x7fb1240a37a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb134032520 tx=0x7fb134005c50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-31T05:15:02.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.519+0000 7fb12effd640 1 -- 172.21.15.99:0/2383917831 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fb128052600 con 0x7fb138100de0 2024-01-31T05:15:02.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:02.703+0000 7fb13fe94640 1 -- 172.21.15.99:0/2383917831 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb13810b4b0 con 0x7fb138100de0 2024-01-31T05:15:03.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:03.385+0000 7fb12effd640 1 -- 172.21.15.99:0/2383917831 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v91) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb1280963f0 con 0x7fb138100de0 2024-01-31T05:15:03.384 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_data' removed 2024-01-31T05:15:03.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:03.388+0000 7fb13fe94640 1 -- 172.21.15.99:0/2383917831 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb1240a12e0 msgr2=0x7fb1240a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:15:03.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:03.388+0000 7fb13fe94640 1 --2- 172.21.15.99:0/2383917831 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb1240a12e0 0x7fb1240a37a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb134032520 tx=0x7fb134005c50 comp rx=0 tx=0).stop 2024-01-31T05:15:03.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:03.388+0000 7fb13fe94640 1 -- 172.21.15.99:0/2383917831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb138100de0 msgr2=0x7fb13819ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-31T05:15:03.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:03.388+0000 7fb13fe94640 1 --2- 172.21.15.99:0/2383917831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb138100de0 0x7fb13819ba30 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fb12800e9f0 tx=0x7fb12800eeb0 comp rx=0 tx=0).stop 2024-01-31T05:15:03.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:03.388+0000 7fb13fe94640 1 -- 172.21.15.99:0/2383917831 shutdown_connections 2024-01-31T05:15:03.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:03.388+0000 7fb13fe94640 1 --2- 172.21.15.99:0/2383917831 >> [v2:172.21.15.99:6800/3925720924,v1:172.21.15.99:6801/3925720924] conn(0x7fb1240a12e0 0x7fb1240a37a0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:15:03.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:03.388+0000 7fb13fe94640 1 --2- 172.21.15.99:0/2383917831 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1381017a0 0x7fb13819e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:15:03.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:03.388+0000 7fb13fe94640 1 --2- 172.21.15.99:0/2383917831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb138100de0 0x7fb13819ba30 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:15:03.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:03.388+0000 7fb13fe94640 1 --2- 172.21.15.99:0/2383917831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1380ffbf0 0x7fb1380689e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-31T05:15:03.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:03.388+0000 7fb13fe94640 1 -- 172.21.15.99:0/2383917831 >> 172.21.15.99:0/2383917831 conn(0x7fb1380fb180 msgr2=0x7fb1381041d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-31T05:15:03.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:03.388+0000 7fb13fe94640 1 -- 172.21.15.99:0/2383917831 shutdown_connections 2024-01-31T05:15:03.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-01-31T05:15:03.388+0000 7fb13fe94640 1 -- 172.21.15.99:0/2383917831 wait complete. 2024-01-31T05:15:03.408 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-01-31T05:15:03.438 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-01-31T05:15:03.478 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-01-31T05:15:03.519 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-01-31T05:15:03.519 DEBUG:teuthology.orchestra.run.smithi099:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-01-31T05:15:03.536 DEBUG:teuthology.orchestra.run.smithi179:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-01-31T05:15:03.552 DEBUG:teuthology.orchestra.run.smithi181:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-01-31T05:15:03.575 INFO:tasks.cephadm:Stopping all daemons... 2024-01-31T05:15:03.575 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-01-31T05:15:03.575 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mon.a 2024-01-31T05:15:03.818 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:03 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/1625592472' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-01-31T05:15:03.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:03 smithi099 ceph-mon[31615]: osdmap e90: 12 total, 12 up, 12 in 2024-01-31T05:15:03.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:03 smithi099 ceph-mon[31615]: pgmap v461: 65 pgs: 65 active+clean; 577 KiB data, 840 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:15:03.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:03 smithi099 ceph-mon[31615]: from='client.? 172.21.15.99:0/2383917831' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-01-31T05:15:03.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:03 smithi099 systemd[1]: Stopping Ceph mon.a for 9288ff44-bff5-11ee-95b3-87774f69a715... 2024-01-31T05:15:03.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:15:03 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/1625592472' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-01-31T05:15:03.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:15:03 smithi181 ceph-mon[36434]: osdmap e90: 12 total, 12 up, 12 in 2024-01-31T05:15:03.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:15:03 smithi181 ceph-mon[36434]: pgmap v461: 65 pgs: 65 active+clean; 577 KiB data, 840 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:15:03.821 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:15:03 smithi181 ceph-mon[36434]: from='client.? 172.21.15.99:0/2383917831' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-01-31T05:15:03.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:15:03 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/1625592472' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-01-31T05:15:03.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:15:03 smithi179 ceph-mon[35652]: osdmap e90: 12 total, 12 up, 12 in 2024-01-31T05:15:03.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:15:03 smithi179 ceph-mon[35652]: pgmap v461: 65 pgs: 65 active+clean; 577 KiB data, 840 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-31T05:15:03.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:15:03 smithi179 ceph-mon[35652]: from='client.? 172.21.15.99:0/2383917831' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-01-31T05:15:04.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:03 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mon-a[31611]: 2024-01-31T05:15:03.881+0000 7fcac6140700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-01-31T05:15:04.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:03 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mon-a[31611]: 2024-01-31T05:15:03.881+0000 7fcac6140700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-01-31T05:15:04.318 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:04 smithi099 podman[90916]: 2024-01-31 05:15:04.117244338 +0000 UTC m=+0.349869064 container died c2448782b9b73a11a7c08f5cbea7acc3e9bdeb4d47f2405d8cea65483307b709 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mon-a, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.31.3, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240123, GIT_CLEAN=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183) 2024-01-31T05:15:04.811 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:04 smithi099 podman[90916]: 2024-01-31 05:15:04.611432285 +0000 UTC m=+0.844057057 container cleanup c2448782b9b73a11a7c08f5cbea7acc3e9bdeb4d47f2405d8cea65483307b709 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mon-a, GIT_CLEAN=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240123, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.31.3, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240125.044502-661946e, maintainer=Guillaume Abrioux ) 2024-01-31T05:15:04.812 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:04 smithi099 bash[90916]: ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mon-a 2024-01-31T05:15:05.039 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mon.a.service' 2024-01-31T05:15:05.064 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:04 smithi099 podman[90930]: 2024-01-31 05:15:04.813190853 +0000 UTC m=+0.694890882 container remove c2448782b9b73a11a7c08f5cbea7acc3e9bdeb4d47f2405d8cea65483307b709 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mon-a, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240123, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.31.3, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, RELEASE=wip-vshankar-testing-20240125.044502-661946e) 2024-01-31T05:15:05.064 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:05 smithi099 systemd[1]: ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mon.a.service: Deactivated successfully. 2024-01-31T05:15:05.064 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:05 smithi099 systemd[1]: Stopped Ceph mon.a for 9288ff44-bff5-11ee-95b3-87774f69a715. 2024-01-31T05:15:05.064 INFO:journalctl@ceph.mon.a.smithi099.stdout:Jan 31 05:15:05 smithi099 systemd[1]: ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mon.a.service: Consumed 14.916s CPU time. 2024-01-31T05:15:05.092 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-31T05:15:05.092 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-01-31T05:15:05.092 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-01-31T05:15:05.092 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mon.b 2024-01-31T05:15:05.382 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:15:05 smithi179 systemd[1]: Stopping Ceph mon.b for 9288ff44-bff5-11ee-95b3-87774f69a715... 2024-01-31T05:15:05.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:15:05 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mon-b[35648]: 2024-01-31T05:15:05.480+0000 7f9a663c4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-01-31T05:15:05.882 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:15:05 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mon-b[35648]: 2024-01-31T05:15:05.480+0000 7f9a663c4700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-01-31T05:15:05.883 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:15:05 smithi179 podman[69661]: 2024-01-31 05:15:05.563236826 +0000 UTC m=+0.288397762 container died 3f34d781cfae37c2c393c8dcde3cf43c2cb1aacda1948702c4a923a5012a9360 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mon-b, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240123, org.label-schema.license=GPLv2, io.buildah.version=1.31.3, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-01-31T05:15:06.190 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:15:05 smithi179 podman[69661]: 2024-01-31 05:15:05.989995978 +0000 UTC m=+0.715156894 container cleanup 3f34d781cfae37c2c393c8dcde3cf43c2cb1aacda1948702c4a923a5012a9360 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mon-b, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240123, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, RELEASE=wip-vshankar-testing-20240125.044502-661946e) 2024-01-31T05:15:06.190 INFO:journalctl@ceph.mon.b.smithi179.stdout:Jan 31 05:15:05 smithi179 bash[69661]: ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mon-b 2024-01-31T05:15:06.407 DEBUG:teuthology.orchestra.run.smithi179:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mon.b.service' 2024-01-31T05:15:06.476 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-31T05:15:06.476 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-01-31T05:15:06.476 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-01-31T05:15:06.476 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mon.c 2024-01-31T05:15:06.781 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:15:06 smithi181 systemd[1]: Stopping Ceph mon.c for 9288ff44-bff5-11ee-95b3-87774f69a715... 2024-01-31T05:15:07.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:15:06 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mon-c[36417]: 2024-01-31T05:15:06.780+0000 7f902b713700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-01-31T05:15:07.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:15:06 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mon-c[36417]: 2024-01-31T05:15:06.780+0000 7f902b713700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-01-31T05:15:07.071 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:15:06 smithi181 podman[71758]: 2024-01-31 05:15:06.904348522 +0000 UTC m=+0.230220678 container died 06764ffa8ade6e0c65798bd8e34763d7bf2738a456eb17789347f9e79d0fd32e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mon-c, ceph=True, io.buildah.version=1.31.3, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240123, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-01-31T05:15:07.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:15:07 smithi181 podman[71758]: 2024-01-31 05:15:07.281668944 +0000 UTC m=+0.607541092 container cleanup 06764ffa8ade6e0c65798bd8e34763d7bf2738a456eb17789347f9e79d0fd32e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mon-c, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240123, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.31.3, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183) 2024-01-31T05:15:07.571 INFO:journalctl@ceph.mon.c.smithi181.stdout:Jan 31 05:15:07 smithi181 bash[71758]: ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mon-c 2024-01-31T05:15:07.745 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mon.c.service' 2024-01-31T05:15:07.794 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-31T05:15:07.795 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-01-31T05:15:07.795 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-01-31T05:15:07.795 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mgr.x 2024-01-31T05:15:08.107 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:15:07 smithi099 systemd[1]: Stopping Ceph mgr.x for 9288ff44-bff5-11ee-95b3-87774f69a715... 2024-01-31T05:15:08.382 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:15:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x[31848]: 2024-01-31T05:15:08.107+0000 7f49b3caf700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-31T05:15:08.382 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:15:08 smithi099 podman[91037]: 2024-01-31 05:15:08.13817222 +0000 UTC m=+0.146470030 container died 3ad20d70eb124d8d19f3882c28c7e779935dbe775daf0c74ea4e0adde2fcaffc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, RELEASE=wip-vshankar-testing-20240125.044502-661946e, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240123, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-01-31T05:15:08.816 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:15:08 smithi099 podman[91037]: 2024-01-31 05:15:08.558091587 +0000 UTC m=+0.566389440 container cleanup 3ad20d70eb124d8d19f3882c28c7e779935dbe775daf0c74ea4e0adde2fcaffc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x, GIT_BRANCH=HEAD, org.label-schema.build-date=20240123, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.vendor=CentOS, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-01-31T05:15:08.816 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 31 05:15:08 smithi099 bash[91037]: ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-x 2024-01-31T05:15:09.030 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mgr.x.service' 2024-01-31T05:15:09.067 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-31T05:15:09.067 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-01-31T05:15:09.068 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-01-31T05:15:09.068 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mgr.y 2024-01-31T05:15:09.382 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Jan 31 05:15:09 smithi179 systemd[1]: Stopping Ceph mgr.y for 9288ff44-bff5-11ee-95b3-87774f69a715... 2024-01-31T05:15:09.653 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Jan 31 05:15:09 smithi179 podman[69785]: 2024-01-31 05:15:09.399400081 +0000 UTC m=+0.134506076 container died 709d4d484e430061792bb5d303c42ab9e01c4a749260f7e94825316dee0aee9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-y, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240125.044502-661946e, io.buildah.version=1.31.3, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240123, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-01-31T05:15:09.962 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Jan 31 05:15:09 smithi179 podman[69785]: 2024-01-31 05:15:09.728813198 +0000 UTC m=+0.463919138 container cleanup 709d4d484e430061792bb5d303c42ab9e01c4a749260f7e94825316dee0aee9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-y, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, ceph=True, io.buildah.version=1.31.3, org.label-schema.build-date=20240123, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-01-31T05:15:09.962 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Jan 31 05:15:09 smithi179 bash[69785]: ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-y 2024-01-31T05:15:10.194 DEBUG:teuthology.orchestra.run.smithi179:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mgr.y.service' 2024-01-31T05:15:10.218 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Jan 31 05:15:09 smithi179 podman[69799]: 2024-01-31 05:15:09.963821833 +0000 UTC m=+0.556721641 container remove 709d4d484e430061792bb5d303c42ab9e01c4a749260f7e94825316dee0aee9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-y, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, io.buildah.version=1.31.3, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240125.044502-661946e, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240123, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-01-31T05:15:10.218 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Jan 31 05:15:09 smithi179 systemd[1]: ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-01-31T05:15:10.218 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Jan 31 05:15:10 smithi179 systemd[1]: ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mgr.y.service: Failed with result 'exit-code'. 2024-01-31T05:15:10.218 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Jan 31 05:15:10 smithi179 systemd[1]: Stopped Ceph mgr.y for 9288ff44-bff5-11ee-95b3-87774f69a715. 2024-01-31T05:15:10.218 INFO:journalctl@ceph.mgr.y.smithi179.stdout:Jan 31 05:15:10 smithi179 systemd[1]: ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mgr.y.service: Consumed 10.807s CPU time. 2024-01-31T05:15:10.232 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-31T05:15:10.232 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-01-31T05:15:10.232 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-01-31T05:15:10.232 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mgr.z 2024-01-31T05:15:10.571 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Jan 31 05:15:10 smithi181 systemd[1]: Stopping Ceph mgr.z for 9288ff44-bff5-11ee-95b3-87774f69a715... 2024-01-31T05:15:10.892 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Jan 31 05:15:10 smithi181 podman[71881]: 2024-01-31 05:15:10.598695437 +0000 UTC m=+0.162561989 container died 48f729b6ae87d48e3bd97bf9e5533a6b1a14d5fc7749b6d3e831227785a60544 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-z, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240123, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.31.3, org.label-schema.name=CentOS Stream 8 Base Image) 2024-01-31T05:15:11.288 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Jan 31 05:15:10 smithi181 podman[71881]: 2024-01-31 05:15:10.894441614 +0000 UTC m=+0.458308169 container cleanup 48f729b6ae87d48e3bd97bf9e5533a6b1a14d5fc7749b6d3e831227785a60544 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-z, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.31.3, org.label-schema.build-date=20240123, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240125.044502-661946e) 2024-01-31T05:15:11.288 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Jan 31 05:15:10 smithi181 bash[71881]: ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-z 2024-01-31T05:15:11.288 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Jan 31 05:15:11 smithi181 podman[71895]: 2024-01-31 05:15:11.070755263 +0000 UTC m=+0.464985448 container remove 48f729b6ae87d48e3bd97bf9e5533a6b1a14d5fc7749b6d3e831227785a60544 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mgr-z, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240123, GIT_BRANCH=HEAD, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-01-31T05:15:11.288 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Jan 31 05:15:11 smithi181 systemd[1]: ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-01-31T05:15:11.302 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mgr.z.service' 2024-01-31T05:15:11.339 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-31T05:15:11.339 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-01-31T05:15:11.339 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-01-31T05:15:11.340 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-9288ff44-bff5-11ee-95b3-87774f69a715@osd.0 2024-01-31T05:15:11.661 INFO:journalctl@ceph.osd.0.smithi099.stdout:Jan 31 05:15:11 smithi099 systemd[1]: Stopping Ceph osd.0 for 9288ff44-bff5-11ee-95b3-87774f69a715... 2024-01-31T05:15:12.068 INFO:journalctl@ceph.osd.0.smithi099.stdout:Jan 31 05:15:11 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-0[46680]: 2024-01-31T05:15:11.662+0000 7fc888f01700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-31T05:15:12.127 INFO:journalctl@ceph.osd.0.smithi099.stdout:Jan 31 05:15:11 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-0[46680]: 2024-01-31T05:15:11.662+0000 7fc888f01700 -1 osd.0 91 *** Got signal Terminated *** 2024-01-31T05:15:12.127 INFO:journalctl@ceph.osd.0.smithi099.stdout:Jan 31 05:15:11 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-0[46680]: 2024-01-31T05:15:11.662+0000 7fc888f01700 -1 osd.0 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-31T05:15:17.262 INFO:journalctl@ceph.osd.0.smithi099.stdout:Jan 31 05:15:16 smithi099 podman[91160]: 2024-01-31 05:15:16.999721296 +0000 UTC m=+5.474680684 container died fc1986db2d2ef612c7a3c0abb75ed732111f49329fe574dd3894b639e5d1a79b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240125.044502-661946e, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_CLEAN=True, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240123, org.label-schema.license=GPLv2) 2024-01-31T05:15:17.568 INFO:journalctl@ceph.osd.0.smithi099.stdout:Jan 31 05:15:17 smithi099 podman[91160]: 2024-01-31 05:15:17.47131038 +0000 UTC m=+5.946269766 container cleanup fc1986db2d2ef612c7a3c0abb75ed732111f49329fe574dd3894b639e5d1a79b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.31.3, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240125.044502-661946e, CEPH_POINT_RELEASE=, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.build-date=20240123, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-01-31T05:15:17.568 INFO:journalctl@ceph.osd.0.smithi099.stdout:Jan 31 05:15:17 smithi099 bash[91160]: ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-0 2024-01-31T05:15:18.068 INFO:journalctl@ceph.osd.0.smithi099.stdout:Jan 31 05:15:17 smithi099 podman[91179]: 2024-01-31 05:15:17.772792844 +0000 UTC m=+0.770646783 container remove fc1986db2d2ef612c7a3c0abb75ed732111f49329fe574dd3894b639e5d1a79b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-0, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.31.3, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240123, org.label-schema.license=GPLv2) 2024-01-31T05:15:18.358 INFO:journalctl@ceph.osd.0.smithi099.stdout:Jan 31 05:15:18 smithi099 podman[91267]: 2024-01-31 05:15:17.985565773 +0000 UTC m=+0.017966793 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-31T05:15:18.358 INFO:journalctl@ceph.osd.0.smithi099.stdout:Jan 31 05:15:18 smithi099 podman[91267]: 2024-01-31 05:15:18.09031782 +0000 UTC m=+0.122718828 container create 66068e2af3dd2870bc8ff3fb2a8ada61224de233e1ef49afb635b3a619a27b7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-0-deactivate, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_CLEAN=True, org.label-schema.build-date=20240123, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.31.3, org.label-schema.vendor=CentOS, ceph=True) 2024-01-31T05:15:18.642 INFO:journalctl@ceph.osd.0.smithi099.stdout:Jan 31 05:15:18 smithi099 podman[91267]: 2024-01-31 05:15:18.359520299 +0000 UTC m=+0.391921313 container init 66068e2af3dd2870bc8ff3fb2a8ada61224de233e1ef49afb635b3a619a27b7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-0-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.31.3, org.label-schema.build-date=20240123, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True) 2024-01-31T05:15:18.642 INFO:journalctl@ceph.osd.0.smithi099.stdout:Jan 31 05:15:18 smithi099 podman[91267]: 2024-01-31 05:15:18.363321405 +0000 UTC m=+0.395722421 container start 66068e2af3dd2870bc8ff3fb2a8ada61224de233e1ef49afb635b3a619a27b7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-0-deactivate, ceph=True, org.label-schema.build-date=20240123, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, RELEASE=wip-vshankar-testing-20240125.044502-661946e, io.buildah.version=1.31.3, org.label-schema.vendor=CentOS) 2024-01-31T05:15:18.642 INFO:journalctl@ceph.osd.0.smithi099.stdout:Jan 31 05:15:18 smithi099 podman[91267]: 2024-01-31 05:15:18.459799931 +0000 UTC m=+0.492200943 container attach 66068e2af3dd2870bc8ff3fb2a8ada61224de233e1ef49afb635b3a619a27b7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-0-deactivate, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240123, GIT_BRANCH=HEAD, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240125.044502-661946e) 2024-01-31T05:15:19.068 INFO:journalctl@ceph.osd.0.smithi099.stdout:Jan 31 05:15:18 smithi099 podman[91267]: 2024-01-31 05:15:18.643840386 +0000 UTC m=+0.676241414 container died 66068e2af3dd2870bc8ff3fb2a8ada61224de233e1ef49afb635b3a619a27b7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-0-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240123, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.license=GPLv2, io.buildah.version=1.31.3, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-01-31T05:15:19.427 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@osd.0.service' 2024-01-31T05:15:19.454 INFO:journalctl@ceph.osd.0.smithi099.stdout:Jan 31 05:15:19 smithi099 podman[91294]: 2024-01-31 05:15:19.405278804 +0000 UTC m=+0.755744436 container remove 66068e2af3dd2870bc8ff3fb2a8ada61224de233e1ef49afb635b3a619a27b7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-0-deactivate, org.label-schema.build-date=20240123, ceph=True, io.buildah.version=1.31.3, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-01-31T05:15:19.454 INFO:journalctl@ceph.osd.0.smithi099.stdout:Jan 31 05:15:19 smithi099 systemd[1]: ceph-9288ff44-bff5-11ee-95b3-87774f69a715@osd.0.service: Deactivated successfully. 2024-01-31T05:15:19.454 INFO:journalctl@ceph.osd.0.smithi099.stdout:Jan 31 05:15:19 smithi099 systemd[1]: Stopped Ceph osd.0 for 9288ff44-bff5-11ee-95b3-87774f69a715. 2024-01-31T05:15:19.454 INFO:journalctl@ceph.osd.0.smithi099.stdout:Jan 31 05:15:19 smithi099 systemd[1]: ceph-9288ff44-bff5-11ee-95b3-87774f69a715@osd.0.service: Consumed 25.190s CPU time. 2024-01-31T05:15:19.470 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-31T05:15:19.470 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-01-31T05:15:19.471 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-01-31T05:15:19.471 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ceph-9288ff44-bff5-11ee-95b3-87774f69a715@osd.1 2024-01-31T05:15:19.757 INFO:journalctl@ceph.osd.1.smithi179.stdout:Jan 31 05:15:19 smithi179 systemd[1]: Stopping Ceph osd.1 for 9288ff44-bff5-11ee-95b3-87774f69a715... 2024-01-31T05:15:20.132 INFO:journalctl@ceph.osd.1.smithi179.stdout:Jan 31 05:15:19 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-1[40253]: 2024-01-31T05:15:19.757+0000 7f65409ba700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-31T05:15:20.132 INFO:journalctl@ceph.osd.1.smithi179.stdout:Jan 31 05:15:19 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-1[40253]: 2024-01-31T05:15:19.757+0000 7f65409ba700 -1 osd.1 91 *** Got signal Terminated *** 2024-01-31T05:15:20.132 INFO:journalctl@ceph.osd.1.smithi179.stdout:Jan 31 05:15:19 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-1[40253]: 2024-01-31T05:15:19.757+0000 7f65409ba700 -1 osd.1 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-31T05:15:25.534 INFO:journalctl@ceph.osd.1.smithi179.stdout:Jan 31 05:15:25 smithi179 podman[69909]: 2024-01-31 05:15:25.232674762 +0000 UTC m=+5.571500878 container died 17cfc249192c2e338202b0f3ca9122db4c65b36ac3005fbcdb5899d4e4c791a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-1, org.label-schema.build-date=20240123, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.31.3, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183) 2024-01-31T05:15:25.826 INFO:journalctl@ceph.osd.1.smithi179.stdout:Jan 31 05:15:25 smithi179 podman[69909]: 2024-01-31 05:15:25.634178505 +0000 UTC m=+5.973004614 container cleanup 17cfc249192c2e338202b0f3ca9122db4c65b36ac3005fbcdb5899d4e4c791a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-1, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240123, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.schema-version=1.0, io.buildah.version=1.31.3, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-01-31T05:15:25.826 INFO:journalctl@ceph.osd.1.smithi179.stdout:Jan 31 05:15:25 smithi179 bash[69909]: ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-1 2024-01-31T05:15:26.132 INFO:journalctl@ceph.osd.1.smithi179.stdout:Jan 31 05:15:25 smithi179 podman[69926]: 2024-01-31 05:15:25.827500442 +0000 UTC m=+0.595619180 container remove 17cfc249192c2e338202b0f3ca9122db4c65b36ac3005fbcdb5899d4e4c791a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-1, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.31.3, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240123, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240125.044502-661946e) 2024-01-31T05:15:26.497 INFO:journalctl@ceph.osd.1.smithi179.stdout:Jan 31 05:15:26 smithi179 podman[70019]: 2024-01-31 05:15:26.129611067 +0000 UTC m=+0.017253424 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-31T05:15:26.497 INFO:journalctl@ceph.osd.1.smithi179.stdout:Jan 31 05:15:26 smithi179 podman[70019]: 2024-01-31 05:15:26.236887507 +0000 UTC m=+0.124529857 container create e34ebda9195dee3bf12fe5a4765ca72bdf3d68cbe53e25c0e516971cc1d9c95e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240123, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.31.3, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240125.044502-661946e) 2024-01-31T05:15:26.497 INFO:journalctl@ceph.osd.1.smithi179.stdout:Jan 31 05:15:26 smithi179 podman[70019]: 2024-01-31 05:15:26.498298262 +0000 UTC m=+0.385940622 container init e34ebda9195dee3bf12fe5a4765ca72bdf3d68cbe53e25c0e516971cc1d9c95e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-1-deactivate, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240123, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240125.044502-661946e, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-01-31T05:15:26.783 INFO:journalctl@ceph.osd.1.smithi179.stdout:Jan 31 05:15:26 smithi179 podman[70019]: 2024-01-31 05:15:26.50208701 +0000 UTC m=+0.389729369 container start e34ebda9195dee3bf12fe5a4765ca72bdf3d68cbe53e25c0e516971cc1d9c95e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-1-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240123, io.buildah.version=1.31.3, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-01-31T05:15:26.783 INFO:journalctl@ceph.osd.1.smithi179.stdout:Jan 31 05:15:26 smithi179 podman[70019]: 2024-01-31 05:15:26.598421331 +0000 UTC m=+0.486063698 container attach e34ebda9195dee3bf12fe5a4765ca72bdf3d68cbe53e25c0e516971cc1d9c95e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-1-deactivate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240123, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.31.3, RELEASE=wip-vshankar-testing-20240125.044502-661946e) 2024-01-31T05:15:27.075 INFO:journalctl@ceph.osd.1.smithi179.stdout:Jan 31 05:15:26 smithi179 podman[70019]: 2024-01-31 05:15:26.784951226 +0000 UTC m=+0.672593591 container died e34ebda9195dee3bf12fe5a4765ca72bdf3d68cbe53e25c0e516971cc1d9c95e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-1-deactivate, RELEASE=wip-vshankar-testing-20240125.044502-661946e, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, io.buildah.version=1.31.3, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240123) 2024-01-31T05:15:27.374 DEBUG:teuthology.orchestra.run.smithi179:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@osd.1.service' 2024-01-31T05:15:27.417 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-31T05:15:27.418 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-01-31T05:15:27.418 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-01-31T05:15:27.418 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-9288ff44-bff5-11ee-95b3-87774f69a715@osd.2 2024-01-31T05:15:27.713 INFO:journalctl@ceph.osd.2.smithi181.stdout:Jan 31 05:15:27 smithi181 systemd[1]: Stopping Ceph osd.2 for 9288ff44-bff5-11ee-95b3-87774f69a715... 2024-01-31T05:15:28.071 INFO:journalctl@ceph.osd.2.smithi181.stdout:Jan 31 05:15:27 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-2[41611]: 2024-01-31T05:15:27.714+0000 7f2479c47700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-31T05:15:28.071 INFO:journalctl@ceph.osd.2.smithi181.stdout:Jan 31 05:15:27 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-2[41611]: 2024-01-31T05:15:27.714+0000 7f2479c47700 -1 osd.2 91 *** Got signal Terminated *** 2024-01-31T05:15:28.071 INFO:journalctl@ceph.osd.2.smithi181.stdout:Jan 31 05:15:27 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-2[41611]: 2024-01-31T05:15:27.714+0000 7f2479c47700 -1 osd.2 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-31T05:15:33.464 INFO:journalctl@ceph.osd.2.smithi181.stdout:Jan 31 05:15:33 smithi181 podman[72004]: 2024-01-31 05:15:33.194965692 +0000 UTC m=+5.589680012 container died 2f3b11f459d3d27af55ce3eb77ab1294ff7e12d91bfdf18d4bf1a9c4e3ee2c88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-2, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, io.buildah.version=1.31.3, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.build-date=20240123) 2024-01-31T05:15:33.813 INFO:journalctl@ceph.osd.2.smithi181.stdout:Jan 31 05:15:33 smithi181 podman[72004]: 2024-01-31 05:15:33.555678755 +0000 UTC m=+5.950393083 container cleanup 2f3b11f459d3d27af55ce3eb77ab1294ff7e12d91bfdf18d4bf1a9c4e3ee2c88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240123, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.31.3) 2024-01-31T05:15:33.813 INFO:journalctl@ceph.osd.2.smithi181.stdout:Jan 31 05:15:33 smithi181 bash[72004]: ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-2 2024-01-31T05:15:34.071 INFO:journalctl@ceph.osd.2.smithi181.stdout:Jan 31 05:15:33 smithi181 podman[72019]: 2024-01-31 05:15:33.815138102 +0000 UTC m=+0.615947718 container remove 2f3b11f459d3d27af55ce3eb77ab1294ff7e12d91bfdf18d4bf1a9c4e3ee2c88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240123, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.31.3, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240125.044502-661946e) 2024-01-31T05:15:34.417 INFO:journalctl@ceph.osd.2.smithi181.stdout:Jan 31 05:15:34 smithi181 podman[72112]: 2024-01-31 05:15:34.023122596 +0000 UTC m=+0.017887444 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-31T05:15:34.417 INFO:journalctl@ceph.osd.2.smithi181.stdout:Jan 31 05:15:34 smithi181 podman[72112]: 2024-01-31 05:15:34.132890836 +0000 UTC m=+0.127655687 container create 6794f0602cdd4882b27d20288d375f6d857f4951de27d7fa057f1888da9e98b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-2-deactivate, RELEASE=wip-vshankar-testing-20240125.044502-661946e, maintainer=Guillaume Abrioux , GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, io.buildah.version=1.31.3, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240123) 2024-01-31T05:15:34.417 INFO:journalctl@ceph.osd.2.smithi181.stdout:Jan 31 05:15:34 smithi181 podman[72112]: 2024-01-31 05:15:34.343577283 +0000 UTC m=+0.338342115 container init 6794f0602cdd4882b27d20288d375f6d857f4951de27d7fa057f1888da9e98b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-2-deactivate, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, ceph=True, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.build-date=20240123, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-01-31T05:15:34.417 INFO:journalctl@ceph.osd.2.smithi181.stdout:Jan 31 05:15:34 smithi181 podman[72112]: 2024-01-31 05:15:34.346901372 +0000 UTC m=+0.341666212 container start 6794f0602cdd4882b27d20288d375f6d857f4951de27d7fa057f1888da9e98b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-2-deactivate, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240125.044502-661946e, maintainer=Guillaume Abrioux , GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.license=GPLv2, io.buildah.version=1.31.3, org.label-schema.build-date=20240123) 2024-01-31T05:15:34.417 INFO:journalctl@ceph.osd.2.smithi181.stdout:Jan 31 05:15:34 smithi181 podman[72112]: 2024-01-31 05:15:34.41849701 +0000 UTC m=+0.413261854 container attach 6794f0602cdd4882b27d20288d375f6d857f4951de27d7fa057f1888da9e98b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-2-deactivate, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.vendor=CentOS, io.buildah.version=1.31.3, org.label-schema.build-date=20240123, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240125.044502-661946e) 2024-01-31T05:15:34.821 INFO:journalctl@ceph.osd.2.smithi181.stdout:Jan 31 05:15:34 smithi181 podman[72112]: 2024-01-31 05:15:34.641139118 +0000 UTC m=+0.635903947 container died 6794f0602cdd4882b27d20288d375f6d857f4951de27d7fa057f1888da9e98b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-2-deactivate, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240123, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.31.3, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-01-31T05:15:35.135 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@osd.2.service' 2024-01-31T05:15:35.161 INFO:journalctl@ceph.osd.2.smithi181.stdout:Jan 31 05:15:35 smithi181 podman[72138]: 2024-01-31 05:15:35.111875191 +0000 UTC m=+0.465213500 container remove 6794f0602cdd4882b27d20288d375f6d857f4951de27d7fa057f1888da9e98b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-2-deactivate, RELEASE=wip-vshankar-testing-20240125.044502-661946e, io.buildah.version=1.31.3, org.label-schema.build-date=20240123, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-01-31T05:15:35.161 INFO:journalctl@ceph.osd.2.smithi181.stdout:Jan 31 05:15:35 smithi181 systemd[1]: ceph-9288ff44-bff5-11ee-95b3-87774f69a715@osd.2.service: Deactivated successfully. 2024-01-31T05:15:35.161 INFO:journalctl@ceph.osd.2.smithi181.stdout:Jan 31 05:15:35 smithi181 systemd[1]: Stopped Ceph osd.2 for 9288ff44-bff5-11ee-95b3-87774f69a715. 2024-01-31T05:15:35.161 INFO:journalctl@ceph.osd.2.smithi181.stdout:Jan 31 05:15:35 smithi181 systemd[1]: ceph-9288ff44-bff5-11ee-95b3-87774f69a715@osd.2.service: Consumed 25.599s CPU time. 2024-01-31T05:15:35.178 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-31T05:15:35.178 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-01-31T05:15:35.178 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-01-31T05:15:35.178 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-9288ff44-bff5-11ee-95b3-87774f69a715@osd.3 2024-01-31T05:15:35.480 INFO:journalctl@ceph.osd.3.smithi099.stdout:Jan 31 05:15:35 smithi099 systemd[1]: Stopping Ceph osd.3 for 9288ff44-bff5-11ee-95b3-87774f69a715... 2024-01-31T05:15:35.818 INFO:journalctl@ceph.osd.3.smithi099.stdout:Jan 31 05:15:35 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-3[53638]: 2024-01-31T05:15:35.479+0000 7fc2dfd9f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-31T05:15:35.818 INFO:journalctl@ceph.osd.3.smithi099.stdout:Jan 31 05:15:35 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-3[53638]: 2024-01-31T05:15:35.479+0000 7fc2dfd9f700 -1 osd.3 91 *** Got signal Terminated *** 2024-01-31T05:15:35.818 INFO:journalctl@ceph.osd.3.smithi099.stdout:Jan 31 05:15:35 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-3[53638]: 2024-01-31T05:15:35.479+0000 7fc2dfd9f700 -1 osd.3 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-31T05:15:37.690 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:15:37 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:15:37.322+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:15:38.068 INFO:journalctl@ceph.osd.3.smithi099.stdout:Jan 31 05:15:37 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-3[53638]: 2024-01-31T05:15:37.823+0000 7fc2dcb9b700 -1 osd.3 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.391015+0000 front 2024-01-31T05:15:15.391044+0000 (oldest deadline 2024-01-31T05:15:37.091171+0000) 2024-01-31T05:15:38.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:15:38 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:15:38.345+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:15:39.071 INFO:journalctl@ceph.osd.5.smithi181.stdout:Jan 31 05:15:38 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-5[48622]: 2024-01-31T05:15:38.694+0000 7fe4bcf97700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.485049+0000 front 2024-01-31T05:15:14.485132+0000 (oldest deadline 2024-01-31T05:15:38.485774+0000) 2024-01-31T05:15:39.318 INFO:journalctl@ceph.osd.3.smithi099.stdout:Jan 31 05:15:38 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-3[53638]: 2024-01-31T05:15:38.866+0000 7fc2dcb9b700 -1 osd.3 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.391015+0000 front 2024-01-31T05:15:15.391044+0000 (oldest deadline 2024-01-31T05:15:37.091171+0000) 2024-01-31T05:15:39.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:15:39 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:15:39.345+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:15:40.071 INFO:journalctl@ceph.osd.5.smithi181.stdout:Jan 31 05:15:39 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-5[48622]: 2024-01-31T05:15:39.708+0000 7fe4bcf97700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.485049+0000 front 2024-01-31T05:15:14.485132+0000 (oldest deadline 2024-01-31T05:15:38.485774+0000) 2024-01-31T05:15:40.318 INFO:journalctl@ceph.osd.3.smithi099.stdout:Jan 31 05:15:39 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-3[53638]: 2024-01-31T05:15:39.859+0000 7fc2dcb9b700 -1 osd.3 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.391015+0000 front 2024-01-31T05:15:15.391044+0000 (oldest deadline 2024-01-31T05:15:37.091171+0000) 2024-01-31T05:15:40.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:15:39 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:15:39.926+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:15:40.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:15:40 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:15:40.373+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:15:40.821 INFO:journalctl@ceph.osd.5.smithi181.stdout:Jan 31 05:15:40 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-5[48622]: 2024-01-31T05:15:40.726+0000 7fe4bcf97700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.485049+0000 front 2024-01-31T05:15:14.485132+0000 (oldest deadline 2024-01-31T05:15:38.485774+0000) 2024-01-31T05:15:40.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:15:40 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:15:40.541+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:15:41.147 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:15:40 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:15:40.902+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:16.191633+0000 front 2024-01-31T05:15:16.191698+0000 (oldest deadline 2024-01-31T05:15:40.291832+0000) 2024-01-31T05:15:41.148 INFO:journalctl@ceph.osd.3.smithi099.stdout:Jan 31 05:15:40 smithi099 podman[91374]: 2024-01-31 05:15:40.864373051 +0000 UTC m=+5.492044281 container died e87b873284d7279f0e68fd2b90be1450111919df24cb1a36f052bf5fb92e6e7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-3, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240123, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.31.3, org.label-schema.schema-version=1.0) 2024-01-31T05:15:41.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:15:40 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:15:40.917+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:15:41.568 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:15:41 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:15:41.387+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:15:41.569 INFO:journalctl@ceph.osd.3.smithi099.stdout:Jan 31 05:15:41 smithi099 podman[91374]: 2024-01-31 05:15:41.33094133 +0000 UTC m=+5.958612561 container cleanup e87b873284d7279f0e68fd2b90be1450111919df24cb1a36f052bf5fb92e6e7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-3, org.label-schema.build-date=20240123, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.31.3, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_BRANCH=HEAD) 2024-01-31T05:15:41.569 INFO:journalctl@ceph.osd.3.smithi099.stdout:Jan 31 05:15:41 smithi099 bash[91374]: ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-3 2024-01-31T05:15:41.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:15:41 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:15:41.539+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:15:41.821 INFO:journalctl@ceph.osd.5.smithi181.stdout:Jan 31 05:15:41 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-5[48622]: 2024-01-31T05:15:41.702+0000 7fe4bcf97700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.485049+0000 front 2024-01-31T05:15:14.485132+0000 (oldest deadline 2024-01-31T05:15:38.485774+0000) 2024-01-31T05:15:41.897 INFO:journalctl@ceph.osd.3.smithi099.stdout:Jan 31 05:15:41 smithi099 podman[91403]: 2024-01-31 05:15:41.598756 +0000 UTC m=+0.735534980 container remove e87b873284d7279f0e68fd2b90be1450111919df24cb1a36f052bf5fb92e6e7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-3, GIT_CLEAN=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240123, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240125.044502-661946e, io.buildah.version=1.31.3) 2024-01-31T05:15:42.149 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:15:41 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:15:41.897+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:16.191633+0000 front 2024-01-31T05:15:16.191698+0000 (oldest deadline 2024-01-31T05:15:40.291832+0000) 2024-01-31T05:15:42.150 INFO:journalctl@ceph.osd.3.smithi099.stdout:Jan 31 05:15:41 smithi099 podman[91492]: 2024-01-31 05:15:41.85223123 +0000 UTC m=+0.017499673 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-31T05:15:42.150 INFO:journalctl@ceph.osd.3.smithi099.stdout:Jan 31 05:15:42 smithi099 podman[91492]: 2024-01-31 05:15:42.008325885 +0000 UTC m=+0.173594368 container create 117e9c85ac5831e972c96f3b919e46b765d233a76e46d84cf22245a889578c01 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240123, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.31.3, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-01-31T05:15:42.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:15:41 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:15:41.928+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:15:42.558 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:15:42 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:15:42.380+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:15:42.558 INFO:journalctl@ceph.osd.3.smithi099.stdout:Jan 31 05:15:42 smithi099 podman[91492]: 2024-01-31 05:15:42.277565933 +0000 UTC m=+0.442834371 container init 117e9c85ac5831e972c96f3b919e46b765d233a76e46d84cf22245a889578c01 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-3-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.31.3, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240125.044502-661946e, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240123, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-01-31T05:15:42.558 INFO:journalctl@ceph.osd.3.smithi099.stdout:Jan 31 05:15:42 smithi099 podman[91492]: 2024-01-31 05:15:42.280689613 +0000 UTC m=+0.445958054 container start 117e9c85ac5831e972c96f3b919e46b765d233a76e46d84cf22245a889578c01 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-3-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240123, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, io.buildah.version=1.31.3, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux ) 2024-01-31T05:15:42.559 INFO:journalctl@ceph.osd.3.smithi099.stdout:Jan 31 05:15:42 smithi099 podman[91492]: 2024-01-31 05:15:42.385980768 +0000 UTC m=+0.551249225 container attach 117e9c85ac5831e972c96f3b919e46b765d233a76e46d84cf22245a889578c01 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.31.3, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240123) 2024-01-31T05:15:42.559 INFO:journalctl@ceph.osd.3.smithi099.stdout:Jan 31 05:15:42 smithi099 podman[91492]: 2024-01-31 05:15:42.55985957 +0000 UTC m=+0.725128009 container died 117e9c85ac5831e972c96f3b919e46b765d233a76e46d84cf22245a889578c01 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-3-deactivate, ceph=True, io.buildah.version=1.31.3, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240125.044502-661946e, CEPH_POINT_RELEASE=, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240123, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-01-31T05:15:42.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:15:42 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:15:42.495+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:15:42.821 INFO:journalctl@ceph.osd.5.smithi181.stdout:Jan 31 05:15:42 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-5[48622]: 2024-01-31T05:15:42.741+0000 7fe4bcf97700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.485049+0000 front 2024-01-31T05:15:14.485132+0000 (oldest deadline 2024-01-31T05:15:38.485774+0000) 2024-01-31T05:15:43.264 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:15:42 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:15:42.941+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:16.191633+0000 front 2024-01-31T05:15:16.191698+0000 (oldest deadline 2024-01-31T05:15:40.291832+0000) 2024-01-31T05:15:43.299 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@osd.3.service' 2024-01-31T05:15:43.343 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-31T05:15:43.343 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-01-31T05:15:43.343 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-01-31T05:15:43.343 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ceph-9288ff44-bff5-11ee-95b3-87774f69a715@osd.4 2024-01-31T05:15:43.373 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:15:42 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:15:42.889+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:15:43.568 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:15:43 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:15:43.364+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:15:43.629 INFO:journalctl@ceph.osd.4.smithi179.stdout:Jan 31 05:15:43 smithi179 systemd[1]: Stopping Ceph osd.4 for 9288ff44-bff5-11ee-95b3-87774f69a715... 2024-01-31T05:15:43.759 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:15:43 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:15:43.448+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:15:43.882 INFO:journalctl@ceph.osd.4.smithi179.stdout:Jan 31 05:15:43 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-4[47113]: 2024-01-31T05:15:43.630+0000 7f870c1e5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-31T05:15:43.882 INFO:journalctl@ceph.osd.4.smithi179.stdout:Jan 31 05:15:43 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-4[47113]: 2024-01-31T05:15:43.630+0000 7f870c1e5700 -1 osd.4 91 *** Got signal Terminated *** 2024-01-31T05:15:43.882 INFO:journalctl@ceph.osd.4.smithi179.stdout:Jan 31 05:15:43 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-4[47113]: 2024-01-31T05:15:43.630+0000 7f870c1e5700 -1 osd.4 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-31T05:15:44.071 INFO:journalctl@ceph.osd.5.smithi181.stdout:Jan 31 05:15:43 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-5[48622]: 2024-01-31T05:15:43.761+0000 7fe4bcf97700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.485049+0000 front 2024-01-31T05:15:14.485132+0000 (oldest deadline 2024-01-31T05:15:38.485774+0000) 2024-01-31T05:15:44.318 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:15:43 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:15:43.927+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:16.191633+0000 front 2024-01-31T05:15:16.191698+0000 (oldest deadline 2024-01-31T05:15:40.291832+0000) 2024-01-31T05:15:44.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:15:43 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:15:43.934+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:15:44.739 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:15:44 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:15:44.442+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:15:44.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:15:44 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:15:44.338+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:15:45.071 INFO:journalctl@ceph.osd.5.smithi181.stdout:Jan 31 05:15:44 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-5[48622]: 2024-01-31T05:15:44.739+0000 7fe4bcf97700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.485049+0000 front 2024-01-31T05:15:14.485132+0000 (oldest deadline 2024-01-31T05:15:38.485774+0000) 2024-01-31T05:15:45.318 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:15:44 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:15:44.920+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:16.191633+0000 front 2024-01-31T05:15:16.191698+0000 (oldest deadline 2024-01-31T05:15:40.291832+0000) 2024-01-31T05:15:45.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:15:44 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:15:44.949+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:15:45.741 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:15:45 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:15:45.422+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:15:45.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:15:45 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:15:45.341+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:15:46.071 INFO:journalctl@ceph.osd.5.smithi181.stdout:Jan 31 05:15:45 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-5[48622]: 2024-01-31T05:15:45.741+0000 7fe4bcf97700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.485049+0000 front 2024-01-31T05:15:14.485132+0000 (oldest deadline 2024-01-31T05:15:38.485774+0000) 2024-01-31T05:15:46.259 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:15:45 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:15:45.995+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:15:46.318 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:15:45 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:15:45.949+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:16.191633+0000 front 2024-01-31T05:15:16.191698+0000 (oldest deadline 2024-01-31T05:15:40.291832+0000) 2024-01-31T05:15:46.318 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:15:45 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:15:45.949+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:20.792981+0000 front 2024-01-31T05:15:20.792878+0000 (oldest deadline 2024-01-31T05:15:45.493020+0000) 2024-01-31T05:15:46.632 INFO:journalctl@ceph.osd.4.smithi179.stdout:Jan 31 05:15:46 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-4[47113]: 2024-01-31T05:15:46.261+0000 7f8704fd9700 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.622330+0000 front 2024-01-31T05:15:21.622353+0000 (oldest deadline 2024-01-31T05:15:45.722451+0000) 2024-01-31T05:15:46.632 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:15:46 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:15:46.481+0000 7ffa09cae700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.414603+0000 front 2024-01-31T05:15:21.414625+0000 (oldest deadline 2024-01-31T05:15:46.114742+0000) 2024-01-31T05:15:46.773 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:15:46 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:15:46.433+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:15:46.774 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:15:46 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:15:46.433+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:15:46.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:15:46 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:15:46.332+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:15:46.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:15:46 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:15:46.332+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:23.429225+0000 front 2024-01-31T05:15:23.429193+0000 (oldest deadline 2024-01-31T05:15:45.729329+0000) 2024-01-31T05:15:47.071 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:15:46 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:15:46.849+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.769908+0000 front 2024-01-31T05:15:21.770050+0000 (oldest deadline 2024-01-31T05:15:46.469991+0000) 2024-01-31T05:15:47.071 INFO:journalctl@ceph.osd.5.smithi181.stdout:Jan 31 05:15:46 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-5[48622]: 2024-01-31T05:15:46.774+0000 7fe4bcf97700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.485049+0000 front 2024-01-31T05:15:14.485132+0000 (oldest deadline 2024-01-31T05:15:38.485774+0000) 2024-01-31T05:15:47.318 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:15:46 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:15:46.960+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:16.191633+0000 front 2024-01-31T05:15:16.191698+0000 (oldest deadline 2024-01-31T05:15:40.291832+0000) 2024-01-31T05:15:47.318 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:15:46 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:15:46.960+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:20.792981+0000 front 2024-01-31T05:15:20.792878+0000 (oldest deadline 2024-01-31T05:15:45.493020+0000) 2024-01-31T05:15:47.382 INFO:journalctl@ceph.osd.4.smithi179.stdout:Jan 31 05:15:47 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-4[47113]: 2024-01-31T05:15:47.221+0000 7f8704fd9700 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.622330+0000 front 2024-01-31T05:15:21.622353+0000 (oldest deadline 2024-01-31T05:15:45.722451+0000) 2024-01-31T05:15:47.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:15:47 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:15:47.011+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:15:47.768 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:15:47 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:15:47.447+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:15:47.769 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:15:47 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:15:47.447+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:15:47.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:15:47 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:15:47.362+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:15:47.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:15:47 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:15:47.362+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:23.429225+0000 front 2024-01-31T05:15:23.429193+0000 (oldest deadline 2024-01-31T05:15:45.729329+0000) 2024-01-31T05:15:47.882 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:15:47 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:15:47.465+0000 7ffa09cae700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.414603+0000 front 2024-01-31T05:15:21.414625+0000 (oldest deadline 2024-01-31T05:15:46.114742+0000) 2024-01-31T05:15:48.071 INFO:journalctl@ceph.osd.5.smithi181.stdout:Jan 31 05:15:47 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-5[48622]: 2024-01-31T05:15:47.769+0000 7fe4bcf97700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.485049+0000 front 2024-01-31T05:15:14.485132+0000 (oldest deadline 2024-01-31T05:15:38.485774+0000) 2024-01-31T05:15:48.071 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:15:47 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:15:47.891+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.769908+0000 front 2024-01-31T05:15:21.770050+0000 (oldest deadline 2024-01-31T05:15:46.469991+0000) 2024-01-31T05:15:48.318 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:15:47 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:15:47.918+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:16.191633+0000 front 2024-01-31T05:15:16.191698+0000 (oldest deadline 2024-01-31T05:15:40.291832+0000) 2024-01-31T05:15:48.318 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:15:47 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:15:47.918+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:20.792981+0000 front 2024-01-31T05:15:20.792878+0000 (oldest deadline 2024-01-31T05:15:45.493020+0000) 2024-01-31T05:15:48.382 INFO:journalctl@ceph.osd.4.smithi179.stdout:Jan 31 05:15:48 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-4[47113]: 2024-01-31T05:15:48.192+0000 7f8704fd9700 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.622330+0000 front 2024-01-31T05:15:21.622353+0000 (oldest deadline 2024-01-31T05:15:45.722451+0000) 2024-01-31T05:15:48.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:15:48 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:15:48.021+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:15:48.747 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:15:48 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:15:48.440+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:15:48.747 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:15:48 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:15:48.440+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:15:48.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:15:48 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:15:48.402+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:15:48.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:15:48 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:15:48.402+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:23.429225+0000 front 2024-01-31T05:15:23.429193+0000 (oldest deadline 2024-01-31T05:15:45.729329+0000) 2024-01-31T05:15:48.882 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:15:48 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:15:48.446+0000 7ffa09cae700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.414603+0000 front 2024-01-31T05:15:21.414625+0000 (oldest deadline 2024-01-31T05:15:46.114742+0000) 2024-01-31T05:15:49.071 INFO:journalctl@ceph.osd.5.smithi181.stdout:Jan 31 05:15:48 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-5[48622]: 2024-01-31T05:15:48.748+0000 7fe4bcf97700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.485049+0000 front 2024-01-31T05:15:14.485132+0000 (oldest deadline 2024-01-31T05:15:38.485774+0000) 2024-01-31T05:15:49.071 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:15:48 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:15:48.844+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.769908+0000 front 2024-01-31T05:15:21.770050+0000 (oldest deadline 2024-01-31T05:15:46.469991+0000) 2024-01-31T05:15:49.318 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:15:48 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:15:48.888+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:16.191633+0000 front 2024-01-31T05:15:16.191698+0000 (oldest deadline 2024-01-31T05:15:40.291832+0000) 2024-01-31T05:15:49.318 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:15:48 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:15:48.888+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:20.792981+0000 front 2024-01-31T05:15:20.792878+0000 (oldest deadline 2024-01-31T05:15:45.493020+0000) 2024-01-31T05:15:49.382 INFO:journalctl@ceph.osd.4.smithi179.stdout:Jan 31 05:15:49 smithi179 podman[70138]: 2024-01-31 05:15:49.077422794 +0000 UTC m=+5.541134417 container died a2e32cfb1701fcb46a97e804dee6cacf4cbaac9e5fa3556038efd023ce7a227c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240123, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.31.3) 2024-01-31T05:15:49.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:15:48 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:15:48.992+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:15:49.714 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:15:49 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:15:49.435+0000 7ffa09cae700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.414603+0000 front 2024-01-31T05:15:21.414625+0000 (oldest deadline 2024-01-31T05:15:46.114742+0000) 2024-01-31T05:15:49.714 INFO:journalctl@ceph.osd.4.smithi179.stdout:Jan 31 05:15:49 smithi179 podman[70138]: 2024-01-31 05:15:49.472767711 +0000 UTC m=+5.936479339 container cleanup a2e32cfb1701fcb46a97e804dee6cacf4cbaac9e5fa3556038efd023ce7a227c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240123, RELEASE=wip-vshankar-testing-20240125.044502-661946e, io.buildah.version=1.31.3, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-01-31T05:15:49.714 INFO:journalctl@ceph.osd.4.smithi179.stdout:Jan 31 05:15:49 smithi179 bash[70138]: ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-4 2024-01-31T05:15:49.793 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:15:49 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:15:49.485+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:15:49.793 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:15:49 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:15:49.485+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:15:49.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:15:49 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:15:49.434+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:15:49.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:15:49 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:15:49.434+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:23.429225+0000 front 2024-01-31T05:15:23.429193+0000 (oldest deadline 2024-01-31T05:15:45.729329+0000) 2024-01-31T05:15:49.973 INFO:journalctl@ceph.osd.4.smithi179.stdout:Jan 31 05:15:49 smithi179 podman[70155]: 2024-01-31 05:15:49.715523272 +0000 UTC m=+0.635441381 container remove a2e32cfb1701fcb46a97e804dee6cacf4cbaac9e5fa3556038efd023ce7a227c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-4, org.label-schema.vendor=CentOS, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.31.3, RELEASE=wip-vshankar-testing-20240125.044502-661946e, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240123, GIT_BRANCH=HEAD, ceph=True) 2024-01-31T05:15:50.071 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:15:49 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:15:49.864+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.769908+0000 front 2024-01-31T05:15:21.770050+0000 (oldest deadline 2024-01-31T05:15:46.469991+0000) 2024-01-31T05:15:50.071 INFO:journalctl@ceph.osd.5.smithi181.stdout:Jan 31 05:15:49 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-5[48622]: 2024-01-31T05:15:49.793+0000 7fe4bcf97700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.485049+0000 front 2024-01-31T05:15:14.485132+0000 (oldest deadline 2024-01-31T05:15:38.485774+0000) 2024-01-31T05:15:50.072 INFO:journalctl@ceph.osd.5.smithi181.stdout:Jan 31 05:15:49 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-5[48622]: 2024-01-31T05:15:49.793+0000 7fe4bcf97700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.287733+0000 front 2024-01-31T05:15:24.287583+0000 (oldest deadline 2024-01-31T05:15:48.987574+0000) 2024-01-31T05:15:50.243 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:15:49 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:15:49.973+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:15:50.243 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:15:49 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:15:49.973+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.701398+0000 front 2024-01-31T05:15:24.701437+0000 (oldest deadline 2024-01-31T05:15:49.401612+0000) 2024-01-31T05:15:50.243 INFO:journalctl@ceph.osd.4.smithi179.stdout:Jan 31 05:15:49 smithi179 podman[70244]: 2024-01-31 05:15:49.999679233 +0000 UTC m=+0.110317575 container create 7a054474751022847687f433ee0d4d311bdffc2b92c0347e06aab40ae0aee575 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-4-deactivate, RELEASE=wip-vshankar-testing-20240125.044502-661946e, io.buildah.version=1.31.3, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240123, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-01-31T05:15:50.243 INFO:journalctl@ceph.osd.4.smithi179.stdout:Jan 31 05:15:50 smithi179 podman[70244]: 2024-01-31 05:15:49.907122163 +0000 UTC m=+0.017760527 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-31T05:15:50.318 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:15:49 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:15:49.861+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:16.191633+0000 front 2024-01-31T05:15:16.191698+0000 (oldest deadline 2024-01-31T05:15:40.291832+0000) 2024-01-31T05:15:50.318 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:15:49 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:15:49.861+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:20.792981+0000 front 2024-01-31T05:15:20.792878+0000 (oldest deadline 2024-01-31T05:15:45.493020+0000) 2024-01-31T05:15:50.530 INFO:journalctl@ceph.osd.4.smithi179.stdout:Jan 31 05:15:50 smithi179 podman[70244]: 2024-01-31 05:15:50.244339539 +0000 UTC m=+0.354977888 container init 7a054474751022847687f433ee0d4d311bdffc2b92c0347e06aab40ae0aee575 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-4-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.31.3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.build-date=20240123, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD) 2024-01-31T05:15:50.530 INFO:journalctl@ceph.osd.4.smithi179.stdout:Jan 31 05:15:50 smithi179 podman[70244]: 2024-01-31 05:15:50.248140347 +0000 UTC m=+0.358778699 container start 7a054474751022847687f433ee0d4d311bdffc2b92c0347e06aab40ae0aee575 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-4-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.build-date=20240123, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.31.3, GIT_CLEAN=True) 2024-01-31T05:15:50.530 INFO:journalctl@ceph.osd.4.smithi179.stdout:Jan 31 05:15:50 smithi179 podman[70244]: 2024-01-31 05:15:50.336038054 +0000 UTC m=+0.446676414 container attach 7a054474751022847687f433ee0d4d311bdffc2b92c0347e06aab40ae0aee575 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-4-deactivate, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.build-date=20240123, io.buildah.version=1.31.3, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-01-31T05:15:50.530 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:15:50 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:15:50.479+0000 7ffa09cae700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.414603+0000 front 2024-01-31T05:15:21.414625+0000 (oldest deadline 2024-01-31T05:15:46.114742+0000) 2024-01-31T05:15:50.811 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:15:50 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:15:50.393+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:15:50.811 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:15:50 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:15:50.393+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:23.429225+0000 front 2024-01-31T05:15:23.429193+0000 (oldest deadline 2024-01-31T05:15:45.729329+0000) 2024-01-31T05:15:50.819 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:15:50 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:15:50.475+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:15:50.819 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:15:50 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:15:50.475+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:15:50.820 INFO:journalctl@ceph.osd.4.smithi179.stdout:Jan 31 05:15:50 smithi179 podman[70244]: 2024-01-31 05:15:50.531400119 +0000 UTC m=+0.642038486 container died 7a054474751022847687f433ee0d4d311bdffc2b92c0347e06aab40ae0aee575 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-4-deactivate, org.label-schema.build-date=20240123, GIT_CLEAN=True, ceph=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.31.3, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-01-31T05:15:51.068 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:15:50 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:15:50.812+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:16.191633+0000 front 2024-01-31T05:15:16.191698+0000 (oldest deadline 2024-01-31T05:15:40.291832+0000) 2024-01-31T05:15:51.068 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:15:50 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:15:50.812+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:20.792981+0000 front 2024-01-31T05:15:20.792878+0000 (oldest deadline 2024-01-31T05:15:45.493020+0000) 2024-01-31T05:15:51.071 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:15:50 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:15:50.900+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.769908+0000 front 2024-01-31T05:15:21.770050+0000 (oldest deadline 2024-01-31T05:15:46.469991+0000) 2024-01-31T05:15:51.071 INFO:journalctl@ceph.osd.5.smithi181.stdout:Jan 31 05:15:50 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-5[48622]: 2024-01-31T05:15:50.819+0000 7fe4bcf97700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.485049+0000 front 2024-01-31T05:15:14.485132+0000 (oldest deadline 2024-01-31T05:15:38.485774+0000) 2024-01-31T05:15:51.071 INFO:journalctl@ceph.osd.5.smithi181.stdout:Jan 31 05:15:50 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-5[48622]: 2024-01-31T05:15:50.819+0000 7fe4bcf97700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.287733+0000 front 2024-01-31T05:15:24.287583+0000 (oldest deadline 2024-01-31T05:15:48.987574+0000) 2024-01-31T05:15:51.088 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:15:50 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:15:50.950+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:15:51.088 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:15:50 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:15:50.950+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.701398+0000 front 2024-01-31T05:15:24.701437+0000 (oldest deadline 2024-01-31T05:15:49.401612+0000) 2024-01-31T05:15:51.108 DEBUG:teuthology.orchestra.run.smithi179:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@osd.4.service' 2024-01-31T05:15:51.191 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-31T05:15:51.191 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-01-31T05:15:51.191 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-01-31T05:15:51.191 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-9288ff44-bff5-11ee-95b3-87774f69a715@osd.5 2024-01-31T05:15:51.487 INFO:journalctl@ceph.osd.5.smithi181.stdout:Jan 31 05:15:51 smithi181 systemd[1]: Stopping Ceph osd.5 for 9288ff44-bff5-11ee-95b3-87774f69a715... 2024-01-31T05:15:51.771 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:15:51 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:15:51.486+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:15:51.771 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:15:51 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:15:51.486+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:15:51.772 INFO:journalctl@ceph.osd.5.smithi181.stdout:Jan 31 05:15:51 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-5[48622]: 2024-01-31T05:15:51.513+0000 7fe4c41a3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-31T05:15:51.772 INFO:journalctl@ceph.osd.5.smithi181.stdout:Jan 31 05:15:51 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-5[48622]: 2024-01-31T05:15:51.513+0000 7fe4c41a3700 -1 osd.5 91 *** Got signal Terminated *** 2024-01-31T05:15:51.772 INFO:journalctl@ceph.osd.5.smithi181.stdout:Jan 31 05:15:51 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-5[48622]: 2024-01-31T05:15:51.513+0000 7fe4c41a3700 -1 osd.5 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-31T05:15:51.772 INFO:journalctl@ceph.osd.5.smithi181.stdout:Jan 31 05:15:51 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-5[48622]: 2024-01-31T05:15:51.772+0000 7fe4bcf97700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.485049+0000 front 2024-01-31T05:15:14.485132+0000 (oldest deadline 2024-01-31T05:15:38.485774+0000) 2024-01-31T05:15:51.801 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:15:51 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:15:51.432+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:15:51.801 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:15:51 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:15:51.432+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:23.429225+0000 front 2024-01-31T05:15:23.429193+0000 (oldest deadline 2024-01-31T05:15:45.729329+0000) 2024-01-31T05:15:51.882 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:15:51 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:15:51.510+0000 7ffa09cae700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.414603+0000 front 2024-01-31T05:15:21.414625+0000 (oldest deadline 2024-01-31T05:15:46.114742+0000) 2024-01-31T05:15:52.068 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:15:51 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:15:51.802+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:16.191633+0000 front 2024-01-31T05:15:16.191698+0000 (oldest deadline 2024-01-31T05:15:40.291832+0000) 2024-01-31T05:15:52.068 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:15:51 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:15:51.802+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:20.792981+0000 front 2024-01-31T05:15:20.792878+0000 (oldest deadline 2024-01-31T05:15:45.493020+0000) 2024-01-31T05:15:52.071 INFO:journalctl@ceph.osd.5.smithi181.stdout:Jan 31 05:15:51 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-5[48622]: 2024-01-31T05:15:51.772+0000 7fe4bcf97700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.287733+0000 front 2024-01-31T05:15:24.287583+0000 (oldest deadline 2024-01-31T05:15:48.987574+0000) 2024-01-31T05:15:52.071 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:15:51 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:15:51.907+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.769908+0000 front 2024-01-31T05:15:21.770050+0000 (oldest deadline 2024-01-31T05:15:46.469991+0000) 2024-01-31T05:15:52.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:15:51 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:15:51.989+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:15:52.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:15:51 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:15:51.989+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.701398+0000 front 2024-01-31T05:15:24.701437+0000 (oldest deadline 2024-01-31T05:15:49.401612+0000) 2024-01-31T05:15:52.801 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:15:52 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:15:52.447+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:15:52.801 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:15:52 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:15:52.447+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:15:52.801 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:15:52 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:15:52.396+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:15:52.801 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:15:52 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:15:52.396+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:23.429225+0000 front 2024-01-31T05:15:23.429193+0000 (oldest deadline 2024-01-31T05:15:45.729329+0000) 2024-01-31T05:15:52.882 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:15:52 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:15:52.556+0000 7ffa09cae700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.414603+0000 front 2024-01-31T05:15:21.414625+0000 (oldest deadline 2024-01-31T05:15:46.114742+0000) 2024-01-31T05:15:53.068 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:15:52 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:15:52.802+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:16.191633+0000 front 2024-01-31T05:15:16.191698+0000 (oldest deadline 2024-01-31T05:15:40.291832+0000) 2024-01-31T05:15:53.068 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:15:52 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:15:52.802+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:20.792981+0000 front 2024-01-31T05:15:20.792878+0000 (oldest deadline 2024-01-31T05:15:45.493020+0000) 2024-01-31T05:15:53.071 INFO:journalctl@ceph.osd.5.smithi181.stdout:Jan 31 05:15:52 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-5[48622]: 2024-01-31T05:15:52.801+0000 7fe4bcf97700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.485049+0000 front 2024-01-31T05:15:14.485132+0000 (oldest deadline 2024-01-31T05:15:38.485774+0000) 2024-01-31T05:15:53.071 INFO:journalctl@ceph.osd.5.smithi181.stdout:Jan 31 05:15:52 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-5[48622]: 2024-01-31T05:15:52.801+0000 7fe4bcf97700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.287733+0000 front 2024-01-31T05:15:24.287583+0000 (oldest deadline 2024-01-31T05:15:48.987574+0000) 2024-01-31T05:15:53.071 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:15:52 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:15:52.951+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.769908+0000 front 2024-01-31T05:15:21.770050+0000 (oldest deadline 2024-01-31T05:15:46.469991+0000) 2024-01-31T05:15:53.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:15:52 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:15:52.975+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:15:53.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:15:52 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:15:52.975+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.701398+0000 front 2024-01-31T05:15:24.701437+0000 (oldest deadline 2024-01-31T05:15:49.401612+0000) 2024-01-31T05:15:53.770 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:15:53 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:15:53.471+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:15:53.771 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:15:53 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:15:53.471+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:15:53.796 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:15:53 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:15:53.388+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:15:53.796 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:15:53 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:15:53.388+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:23.429225+0000 front 2024-01-31T05:15:23.429193+0000 (oldest deadline 2024-01-31T05:15:45.729329+0000) 2024-01-31T05:15:53.882 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:15:53 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:15:53.549+0000 7ffa09cae700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.414603+0000 front 2024-01-31T05:15:21.414625+0000 (oldest deadline 2024-01-31T05:15:46.114742+0000) 2024-01-31T05:15:54.068 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:15:53 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:15:53.796+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:16.191633+0000 front 2024-01-31T05:15:16.191698+0000 (oldest deadline 2024-01-31T05:15:40.291832+0000) 2024-01-31T05:15:54.068 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:15:53 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:15:53.796+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:20.792981+0000 front 2024-01-31T05:15:20.792878+0000 (oldest deadline 2024-01-31T05:15:45.493020+0000) 2024-01-31T05:15:54.071 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:15:53 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:15:53.933+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.769908+0000 front 2024-01-31T05:15:21.770050+0000 (oldest deadline 2024-01-31T05:15:46.469991+0000) 2024-01-31T05:15:54.071 INFO:journalctl@ceph.osd.5.smithi181.stdout:Jan 31 05:15:53 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-5[48622]: 2024-01-31T05:15:53.771+0000 7fe4bcf97700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.485049+0000 front 2024-01-31T05:15:14.485132+0000 (oldest deadline 2024-01-31T05:15:38.485774+0000) 2024-01-31T05:15:54.071 INFO:journalctl@ceph.osd.5.smithi181.stdout:Jan 31 05:15:53 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-5[48622]: 2024-01-31T05:15:53.771+0000 7fe4bcf97700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.287733+0000 front 2024-01-31T05:15:24.287583+0000 (oldest deadline 2024-01-31T05:15:48.987574+0000) 2024-01-31T05:15:54.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:15:53 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:15:53.976+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:15:54.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:15:53 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:15:53.976+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.701398+0000 front 2024-01-31T05:15:24.701437+0000 (oldest deadline 2024-01-31T05:15:49.401612+0000) 2024-01-31T05:15:54.739 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:15:54 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:15:54.439+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:15:54.740 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:15:54 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:15:54.439+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:15:54.740 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:15:54 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:15:54.439+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:15:54.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:15:54 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:15:54.376+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:15:54.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:15:54 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:15:54.376+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:23.429225+0000 front 2024-01-31T05:15:23.429193+0000 (oldest deadline 2024-01-31T05:15:45.729329+0000) 2024-01-31T05:15:54.882 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:15:54 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:15:54.505+0000 7ffa09cae700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.414603+0000 front 2024-01-31T05:15:21.414625+0000 (oldest deadline 2024-01-31T05:15:46.114742+0000) 2024-01-31T05:15:55.071 INFO:journalctl@ceph.osd.5.smithi181.stdout:Jan 31 05:15:54 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-5[48622]: 2024-01-31T05:15:54.740+0000 7fe4bcf97700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.485049+0000 front 2024-01-31T05:15:14.485132+0000 (oldest deadline 2024-01-31T05:15:38.485774+0000) 2024-01-31T05:15:55.071 INFO:journalctl@ceph.osd.5.smithi181.stdout:Jan 31 05:15:54 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-5[48622]: 2024-01-31T05:15:54.740+0000 7fe4bcf97700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.287733+0000 front 2024-01-31T05:15:24.287583+0000 (oldest deadline 2024-01-31T05:15:48.987574+0000) 2024-01-31T05:15:55.071 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:15:54 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:15:54.928+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.769908+0000 front 2024-01-31T05:15:21.770050+0000 (oldest deadline 2024-01-31T05:15:46.469991+0000) 2024-01-31T05:15:55.071 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:15:54 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:15:54.928+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:28.771067+0000 front 2024-01-31T05:15:28.771106+0000 (oldest deadline 2024-01-31T05:15:54.071204+0000) 2024-01-31T05:15:55.318 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:15:54 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:15:54.835+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:16.191633+0000 front 2024-01-31T05:15:16.191698+0000 (oldest deadline 2024-01-31T05:15:40.291832+0000) 2024-01-31T05:15:55.318 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:15:54 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:15:54.835+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:20.792981+0000 front 2024-01-31T05:15:20.792878+0000 (oldest deadline 2024-01-31T05:15:45.493020+0000) 2024-01-31T05:15:55.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:15:54 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:15:54.974+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:15:55.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:15:54 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:15:54.974+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.701398+0000 front 2024-01-31T05:15:24.701437+0000 (oldest deadline 2024-01-31T05:15:49.401612+0000) 2024-01-31T05:15:55.814 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:15:55 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:15:55.384+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:15:55.814 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:15:55 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:15:55.384+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:23.429225+0000 front 2024-01-31T05:15:23.429193+0000 (oldest deadline 2024-01-31T05:15:45.729329+0000) 2024-01-31T05:15:55.821 INFO:journalctl@ceph.osd.5.smithi181.stdout:Jan 31 05:15:55 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-5[48622]: 2024-01-31T05:15:55.697+0000 7fe4bcf97700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.485049+0000 front 2024-01-31T05:15:14.485132+0000 (oldest deadline 2024-01-31T05:15:38.485774+0000) 2024-01-31T05:15:55.821 INFO:journalctl@ceph.osd.5.smithi181.stdout:Jan 31 05:15:55 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-5[48622]: 2024-01-31T05:15:55.697+0000 7fe4bcf97700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.287733+0000 front 2024-01-31T05:15:24.287583+0000 (oldest deadline 2024-01-31T05:15:48.987574+0000) 2024-01-31T05:15:55.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:15:55 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:15:55.455+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:15:55.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:15:55 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:15:55.455+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:15:55.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:15:55 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:15:55.455+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:15:55.882 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:15:55 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:15:55.475+0000 7ffa09cae700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.414603+0000 front 2024-01-31T05:15:21.414625+0000 (oldest deadline 2024-01-31T05:15:46.114742+0000) 2024-01-31T05:15:56.068 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:15:55 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:15:55.815+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:16.191633+0000 front 2024-01-31T05:15:16.191698+0000 (oldest deadline 2024-01-31T05:15:40.291832+0000) 2024-01-31T05:15:56.068 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:15:55 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:15:55.815+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:20.792981+0000 front 2024-01-31T05:15:20.792878+0000 (oldest deadline 2024-01-31T05:15:45.493020+0000) 2024-01-31T05:15:56.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:15:55 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:15:55.960+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.769908+0000 front 2024-01-31T05:15:21.770050+0000 (oldest deadline 2024-01-31T05:15:46.469991+0000) 2024-01-31T05:15:56.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:15:55 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:15:55.960+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:28.771067+0000 front 2024-01-31T05:15:28.771106+0000 (oldest deadline 2024-01-31T05:15:54.071204+0000) 2024-01-31T05:15:56.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:15:55 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:15:55.930+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:15:56.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:15:55 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:15:55.930+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.701398+0000 front 2024-01-31T05:15:24.701437+0000 (oldest deadline 2024-01-31T05:15:49.401612+0000) 2024-01-31T05:15:56.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:15:55 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:15:55.930+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:29.402167+0000 front 2024-01-31T05:15:29.402154+0000 (oldest deadline 2024-01-31T05:15:55.302060+0000) 2024-01-31T05:15:56.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:15:56 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:15:56.409+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:15:56.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:15:56 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:15:56.409+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:23.429225+0000 front 2024-01-31T05:15:23.429193+0000 (oldest deadline 2024-01-31T05:15:45.729329+0000) 2024-01-31T05:15:56.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:15:56 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:15:56.409+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:30.931585+0000 front 2024-01-31T05:15:30.931516+0000 (oldest deadline 2024-01-31T05:15:55.631632+0000) 2024-01-31T05:15:56.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:15:56 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:15:56.504+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:15:56.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:15:56 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:15:56.504+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:15:56.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:15:56 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:15:56.504+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:15:56.882 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:15:56 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:15:56.452+0000 7ffa09cae700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.414603+0000 front 2024-01-31T05:15:21.414625+0000 (oldest deadline 2024-01-31T05:15:46.114742+0000) 2024-01-31T05:15:57.270 INFO:journalctl@ceph.osd.5.smithi181.stdout:Jan 31 05:15:56 smithi181 podman[72229]: 2024-01-31 05:15:56.982810142 +0000 UTC m=+5.593730506 container died 66917db634a5c1563578b9f6f9fb385850f80bde296d3bdb61e028d05121bfe1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-5, io.buildah.version=1.31.3, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.build-date=20240123, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240125.044502-661946e) 2024-01-31T05:15:57.270 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:15:56 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:15:56.992+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.769908+0000 front 2024-01-31T05:15:21.770050+0000 (oldest deadline 2024-01-31T05:15:46.469991+0000) 2024-01-31T05:15:57.271 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:15:56 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:15:56.992+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:28.771067+0000 front 2024-01-31T05:15:28.771106+0000 (oldest deadline 2024-01-31T05:15:54.071204+0000) 2024-01-31T05:15:57.318 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:15:56 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:15:56.834+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:16.191633+0000 front 2024-01-31T05:15:16.191698+0000 (oldest deadline 2024-01-31T05:15:40.291832+0000) 2024-01-31T05:15:57.318 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:15:56 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:15:56.834+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:20.792981+0000 front 2024-01-31T05:15:20.792878+0000 (oldest deadline 2024-01-31T05:15:45.493020+0000) 2024-01-31T05:15:57.318 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:15:56 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:15:56.834+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:31.294879+0000 front 2024-01-31T05:15:31.294802+0000 (oldest deadline 2024-01-31T05:15:55.994752+0000) 2024-01-31T05:15:57.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:15:56 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:15:56.973+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:15:57.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:15:56 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:15:56.973+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.701398+0000 front 2024-01-31T05:15:24.701437+0000 (oldest deadline 2024-01-31T05:15:49.401612+0000) 2024-01-31T05:15:57.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:15:56 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:15:56.973+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:29.402167+0000 front 2024-01-31T05:15:29.402154+0000 (oldest deadline 2024-01-31T05:15:55.302060+0000) 2024-01-31T05:15:57.571 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:15:57 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:15:57.496+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:15:57.571 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:15:57 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:15:57.496+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:15:57.571 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:15:57 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:15:57.496+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:15:57.571 INFO:journalctl@ceph.osd.5.smithi181.stdout:Jan 31 05:15:57 smithi181 podman[72229]: 2024-01-31 05:15:57.271592158 +0000 UTC m=+5.882512520 container cleanup 66917db634a5c1563578b9f6f9fb385850f80bde296d3bdb61e028d05121bfe1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.31.3, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240123, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-01-31T05:15:57.571 INFO:journalctl@ceph.osd.5.smithi181.stdout:Jan 31 05:15:57 smithi181 bash[72229]: ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-5 2024-01-31T05:15:57.571 INFO:journalctl@ceph.osd.5.smithi181.stdout:Jan 31 05:15:57 smithi181 podman[72246]: 2024-01-31 05:15:57.506123145 +0000 UTC m=+0.527077903 container remove 66917db634a5c1563578b9f6f9fb385850f80bde296d3bdb61e028d05121bfe1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-5, io.buildah.version=1.31.3, org.label-schema.build-date=20240123, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-01-31T05:15:57.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:15:57 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:15:57.445+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:15:57.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:15:57 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:15:57.445+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:23.429225+0000 front 2024-01-31T05:15:23.429193+0000 (oldest deadline 2024-01-31T05:15:45.729329+0000) 2024-01-31T05:15:57.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:15:57 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:15:57.445+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:30.931585+0000 front 2024-01-31T05:15:30.931516+0000 (oldest deadline 2024-01-31T05:15:55.631632+0000) 2024-01-31T05:15:57.882 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:15:57 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:15:57.455+0000 7ffa09cae700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.414603+0000 front 2024-01-31T05:15:21.414625+0000 (oldest deadline 2024-01-31T05:15:46.114742+0000) 2024-01-31T05:15:58.124 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:15:57 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:15:57.978+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.769908+0000 front 2024-01-31T05:15:21.770050+0000 (oldest deadline 2024-01-31T05:15:46.469991+0000) 2024-01-31T05:15:58.124 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:15:57 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:15:57.978+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:28.771067+0000 front 2024-01-31T05:15:28.771106+0000 (oldest deadline 2024-01-31T05:15:54.071204+0000) 2024-01-31T05:15:58.125 INFO:journalctl@ceph.osd.5.smithi181.stdout:Jan 31 05:15:57 smithi181 podman[72341]: 2024-01-31 05:15:57.732944132 +0000 UTC m=+0.017129312 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-31T05:15:58.125 INFO:journalctl@ceph.osd.5.smithi181.stdout:Jan 31 05:15:57 smithi181 podman[72341]: 2024-01-31 05:15:57.832156183 +0000 UTC m=+0.116341357 container create adb7d61d2e1e9547335dc508df19b3609504069368ffb02d7254ece70748f49f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240123, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.31.3, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, ceph=True, RELEASE=wip-vshankar-testing-20240125.044502-661946e) 2024-01-31T05:15:58.125 INFO:journalctl@ceph.osd.5.smithi181.stdout:Jan 31 05:15:58 smithi181 podman[72341]: 2024-01-31 05:15:58.051383266 +0000 UTC m=+0.335568456 container init adb7d61d2e1e9547335dc508df19b3609504069368ffb02d7254ece70748f49f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-5-deactivate, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.31.3, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240123, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, RELEASE=wip-vshankar-testing-20240125.044502-661946e) 2024-01-31T05:15:58.125 INFO:journalctl@ceph.osd.5.smithi181.stdout:Jan 31 05:15:58 smithi181 podman[72341]: 2024-01-31 05:15:58.054561367 +0000 UTC m=+0.338746541 container start adb7d61d2e1e9547335dc508df19b3609504069368ffb02d7254ece70748f49f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-5-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.31.3, ceph=True, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240123, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183) 2024-01-31T05:15:58.125 INFO:journalctl@ceph.osd.5.smithi181.stdout:Jan 31 05:15:58 smithi181 podman[72341]: 2024-01-31 05:15:58.125960191 +0000 UTC m=+0.410145374 container attach adb7d61d2e1e9547335dc508df19b3609504069368ffb02d7254ece70748f49f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-5-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.schema-version=1.0, io.buildah.version=1.31.3, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240123, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-01-31T05:15:58.318 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:15:57 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:15:57.872+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:16.191633+0000 front 2024-01-31T05:15:16.191698+0000 (oldest deadline 2024-01-31T05:15:40.291832+0000) 2024-01-31T05:15:58.318 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:15:57 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:15:57.872+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:20.792981+0000 front 2024-01-31T05:15:20.792878+0000 (oldest deadline 2024-01-31T05:15:45.493020+0000) 2024-01-31T05:15:58.318 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:15:57 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:15:57.872+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:31.294879+0000 front 2024-01-31T05:15:31.294802+0000 (oldest deadline 2024-01-31T05:15:55.994752+0000) 2024-01-31T05:15:58.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:15:57 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:15:57.989+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:15:58.383 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:15:57 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:15:57.989+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.701398+0000 front 2024-01-31T05:15:24.701437+0000 (oldest deadline 2024-01-31T05:15:49.401612+0000) 2024-01-31T05:15:58.383 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:15:57 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:15:57.989+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:29.402167+0000 front 2024-01-31T05:15:29.402154+0000 (oldest deadline 2024-01-31T05:15:55.302060+0000) 2024-01-31T05:15:58.521 INFO:journalctl@ceph.osd.5.smithi181.stdout:Jan 31 05:15:58 smithi181 podman[72341]: 2024-01-31 05:15:58.333035752 +0000 UTC m=+0.617220939 container died adb7d61d2e1e9547335dc508df19b3609504069368ffb02d7254ece70748f49f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-5-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.31.3, org.label-schema.license=GPLv2, org.label-schema.build-date=20240123, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-vshankar-testing-20240125.044502-661946e) 2024-01-31T05:15:58.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:15:58 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:15:58.453+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:15:58.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:15:58 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:15:58.453+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:23.429225+0000 front 2024-01-31T05:15:23.429193+0000 (oldest deadline 2024-01-31T05:15:45.729329+0000) 2024-01-31T05:15:58.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:15:58 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:15:58.453+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:30.931585+0000 front 2024-01-31T05:15:30.931516+0000 (oldest deadline 2024-01-31T05:15:55.631632+0000) 2024-01-31T05:15:58.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:15:58 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:15:58.521+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:15:58.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:15:58 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:15:58.521+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:15:58.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:15:58 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:15:58.521+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:15:58.875 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@osd.5.service' 2024-01-31T05:15:58.882 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:15:58 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:15:58.479+0000 7ffa09cae700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.414603+0000 front 2024-01-31T05:15:21.414625+0000 (oldest deadline 2024-01-31T05:15:46.114742+0000) 2024-01-31T05:15:58.882 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:15:58 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:15:58.479+0000 7ffa09cae700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.016091+0000 front 2024-01-31T05:15:32.015929+0000 (oldest deadline 2024-01-31T05:15:58.416459+0000) 2024-01-31T05:15:58.917 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-31T05:15:58.918 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-01-31T05:15:58.918 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-01-31T05:15:58.918 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-9288ff44-bff5-11ee-95b3-87774f69a715@osd.6 2024-01-31T05:15:59.207 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:15:58 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:15:58.898+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:16.191633+0000 front 2024-01-31T05:15:16.191698+0000 (oldest deadline 2024-01-31T05:15:40.291832+0000) 2024-01-31T05:15:59.207 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:15:58 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:15:58.898+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:20.792981+0000 front 2024-01-31T05:15:20.792878+0000 (oldest deadline 2024-01-31T05:15:45.493020+0000) 2024-01-31T05:15:59.207 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:15:58 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:15:58.898+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:31.294879+0000 front 2024-01-31T05:15:31.294802+0000 (oldest deadline 2024-01-31T05:15:55.994752+0000) 2024-01-31T05:15:59.207 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:15:58 smithi099 systemd[1]: Stopping Ceph osd.6 for 9288ff44-bff5-11ee-95b3-87774f69a715... 2024-01-31T05:15:59.207 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:15:59 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:15:59.207+0000 7f405a003700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-31T05:15:59.207 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:15:59 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:15:59.207+0000 7f405a003700 -1 osd.6 91 *** Got signal Terminated *** 2024-01-31T05:15:59.207 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:15:59 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:15:59.207+0000 7f405a003700 -1 osd.6 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-31T05:15:59.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:15:58 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:15:58.997+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.769908+0000 front 2024-01-31T05:15:21.770050+0000 (oldest deadline 2024-01-31T05:15:46.469991+0000) 2024-01-31T05:15:59.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:15:58 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:15:58.997+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:28.771067+0000 front 2024-01-31T05:15:28.771106+0000 (oldest deadline 2024-01-31T05:15:54.071204+0000) 2024-01-31T05:15:59.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:15:59 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:15:59.020+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:15:59.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:15:59 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:15:59.020+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.701398+0000 front 2024-01-31T05:15:24.701437+0000 (oldest deadline 2024-01-31T05:15:49.401612+0000) 2024-01-31T05:15:59.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:15:59 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:15:59.020+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:29.402167+0000 front 2024-01-31T05:15:29.402154+0000 (oldest deadline 2024-01-31T05:15:55.302060+0000) 2024-01-31T05:15:59.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:15:59 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:15:59.459+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:15:59.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:15:59 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:15:59.459+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:23.429225+0000 front 2024-01-31T05:15:23.429193+0000 (oldest deadline 2024-01-31T05:15:45.729329+0000) 2024-01-31T05:15:59.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:15:59 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:15:59.459+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:30.931585+0000 front 2024-01-31T05:15:30.931516+0000 (oldest deadline 2024-01-31T05:15:55.631632+0000) 2024-01-31T05:15:59.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:15:59 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:15:59.505+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:15:59.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:15:59 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:15:59.505+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:15:59.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:15:59 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:15:59.505+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:15:59.882 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:15:59 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:15:59.453+0000 7ffa09cae700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.414603+0000 front 2024-01-31T05:15:21.414625+0000 (oldest deadline 2024-01-31T05:15:46.114742+0000) 2024-01-31T05:15:59.882 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:15:59 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:15:59.453+0000 7ffa09cae700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.016091+0000 front 2024-01-31T05:15:32.015929+0000 (oldest deadline 2024-01-31T05:15:58.416459+0000) 2024-01-31T05:16:00.318 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:15:59 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:15:59.886+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:16.191633+0000 front 2024-01-31T05:15:16.191698+0000 (oldest deadline 2024-01-31T05:15:40.291832+0000) 2024-01-31T05:16:00.318 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:15:59 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:15:59.886+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:20.792981+0000 front 2024-01-31T05:15:20.792878+0000 (oldest deadline 2024-01-31T05:15:45.493020+0000) 2024-01-31T05:16:00.318 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:15:59 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:15:59.886+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:31.294879+0000 front 2024-01-31T05:15:31.294802+0000 (oldest deadline 2024-01-31T05:15:55.994752+0000) 2024-01-31T05:16:00.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:15:59 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:15:59.987+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.769908+0000 front 2024-01-31T05:15:21.770050+0000 (oldest deadline 2024-01-31T05:15:46.469991+0000) 2024-01-31T05:16:00.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:15:59 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:15:59.987+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:28.771067+0000 front 2024-01-31T05:15:28.771106+0000 (oldest deadline 2024-01-31T05:15:54.071204+0000) 2024-01-31T05:16:00.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:15:59 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:15:59.979+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:16:00.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:15:59 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:15:59.979+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.701398+0000 front 2024-01-31T05:15:24.701437+0000 (oldest deadline 2024-01-31T05:15:49.401612+0000) 2024-01-31T05:16:00.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:15:59 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:15:59.979+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:29.402167+0000 front 2024-01-31T05:15:29.402154+0000 (oldest deadline 2024-01-31T05:15:55.302060+0000) 2024-01-31T05:16:00.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:00 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:00.503+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:16:00.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:00 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:00.503+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:23.429225+0000 front 2024-01-31T05:15:23.429193+0000 (oldest deadline 2024-01-31T05:15:45.729329+0000) 2024-01-31T05:16:00.819 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:00 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:00.503+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:30.931585+0000 front 2024-01-31T05:15:30.931516+0000 (oldest deadline 2024-01-31T05:15:55.631632+0000) 2024-01-31T05:16:00.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:00 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:00.465+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:16:00.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:00 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:00.465+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:16:00.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:00 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:00.465+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:16:00.882 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:16:00 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:16:00.435+0000 7ffa09cae700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.414603+0000 front 2024-01-31T05:15:21.414625+0000 (oldest deadline 2024-01-31T05:15:46.114742+0000) 2024-01-31T05:16:00.882 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:16:00 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:16:00.435+0000 7ffa09cae700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.016091+0000 front 2024-01-31T05:15:32.015929+0000 (oldest deadline 2024-01-31T05:15:58.416459+0000) 2024-01-31T05:16:01.318 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:16:00 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:16:00.894+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:16.191633+0000 front 2024-01-31T05:15:16.191698+0000 (oldest deadline 2024-01-31T05:15:40.291832+0000) 2024-01-31T05:16:01.318 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:16:00 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:16:00.894+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:20.792981+0000 front 2024-01-31T05:15:20.792878+0000 (oldest deadline 2024-01-31T05:15:45.493020+0000) 2024-01-31T05:16:01.318 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:16:00 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:16:00.894+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:31.294879+0000 front 2024-01-31T05:15:31.294802+0000 (oldest deadline 2024-01-31T05:15:55.994752+0000) 2024-01-31T05:16:01.320 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:01 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:01.017+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.769908+0000 front 2024-01-31T05:15:21.770050+0000 (oldest deadline 2024-01-31T05:15:46.469991+0000) 2024-01-31T05:16:01.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:01 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:01.017+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:28.771067+0000 front 2024-01-31T05:15:28.771106+0000 (oldest deadline 2024-01-31T05:15:54.071204+0000) 2024-01-31T05:16:01.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:01 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:01.008+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:16:01.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:01 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:01.008+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.701398+0000 front 2024-01-31T05:15:24.701437+0000 (oldest deadline 2024-01-31T05:15:49.401612+0000) 2024-01-31T05:16:01.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:01 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:01.008+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:29.402167+0000 front 2024-01-31T05:15:29.402154+0000 (oldest deadline 2024-01-31T05:15:55.302060+0000) 2024-01-31T05:16:01.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:01 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:01.483+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:16:01.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:01 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:01.483+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:23.429225+0000 front 2024-01-31T05:15:23.429193+0000 (oldest deadline 2024-01-31T05:15:45.729329+0000) 2024-01-31T05:16:01.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:01 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:01.483+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:30.931585+0000 front 2024-01-31T05:15:30.931516+0000 (oldest deadline 2024-01-31T05:15:55.631632+0000) 2024-01-31T05:16:01.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:01 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:01.446+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:16:01.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:01 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:01.446+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:16:01.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:01 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:01.446+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:16:01.882 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:16:01 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:16:01.475+0000 7ffa09cae700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.414603+0000 front 2024-01-31T05:15:21.414625+0000 (oldest deadline 2024-01-31T05:15:46.114742+0000) 2024-01-31T05:16:01.882 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:16:01 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:16:01.475+0000 7ffa09cae700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.016091+0000 front 2024-01-31T05:15:32.015929+0000 (oldest deadline 2024-01-31T05:15:58.416459+0000) 2024-01-31T05:16:02.318 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:16:01 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:16:01.913+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:16.191633+0000 front 2024-01-31T05:15:16.191698+0000 (oldest deadline 2024-01-31T05:15:40.291832+0000) 2024-01-31T05:16:02.318 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:16:01 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:16:01.913+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:20.792981+0000 front 2024-01-31T05:15:20.792878+0000 (oldest deadline 2024-01-31T05:15:45.493020+0000) 2024-01-31T05:16:02.318 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:16:01 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:16:01.913+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:31.294879+0000 front 2024-01-31T05:15:31.294802+0000 (oldest deadline 2024-01-31T05:15:55.994752+0000) 2024-01-31T05:16:02.318 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:16:01 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:16:01.913+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:38.796028+0000 front 2024-01-31T05:15:38.796052+0000 (oldest deadline 2024-01-31T05:16:01.096303+0000) 2024-01-31T05:16:02.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:02 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:02.008+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.769908+0000 front 2024-01-31T05:15:21.770050+0000 (oldest deadline 2024-01-31T05:15:46.469991+0000) 2024-01-31T05:16:02.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:02 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:02.008+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:28.771067+0000 front 2024-01-31T05:15:28.771106+0000 (oldest deadline 2024-01-31T05:15:54.071204+0000) 2024-01-31T05:16:02.383 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:02 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:02.030+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:16:02.384 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:02 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:02.030+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.701398+0000 front 2024-01-31T05:15:24.701437+0000 (oldest deadline 2024-01-31T05:15:49.401612+0000) 2024-01-31T05:16:02.384 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:02 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:02.030+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:29.402167+0000 front 2024-01-31T05:15:29.402154+0000 (oldest deadline 2024-01-31T05:15:55.302060+0000) 2024-01-31T05:16:02.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:02 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:02.500+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:16:02.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:02 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:02.500+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:23.429225+0000 front 2024-01-31T05:15:23.429193+0000 (oldest deadline 2024-01-31T05:15:45.729329+0000) 2024-01-31T05:16:02.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:02 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:02.500+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:30.931585+0000 front 2024-01-31T05:15:30.931516+0000 (oldest deadline 2024-01-31T05:15:55.631632+0000) 2024-01-31T05:16:02.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:02 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:02.476+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:16:02.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:02 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:02.476+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:16:02.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:02 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:02.476+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:16:02.882 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:16:02 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:16:02.479+0000 7ffa09cae700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.414603+0000 front 2024-01-31T05:15:21.414625+0000 (oldest deadline 2024-01-31T05:15:46.114742+0000) 2024-01-31T05:16:02.882 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:16:02 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:16:02.479+0000 7ffa09cae700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.016091+0000 front 2024-01-31T05:15:32.015929+0000 (oldest deadline 2024-01-31T05:15:58.416459+0000) 2024-01-31T05:16:03.318 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:16:02 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:16:02.874+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:16.191633+0000 front 2024-01-31T05:15:16.191698+0000 (oldest deadline 2024-01-31T05:15:40.291832+0000) 2024-01-31T05:16:03.318 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:16:02 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:16:02.874+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:20.792981+0000 front 2024-01-31T05:15:20.792878+0000 (oldest deadline 2024-01-31T05:15:45.493020+0000) 2024-01-31T05:16:03.318 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:16:02 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:16:02.874+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:31.294879+0000 front 2024-01-31T05:15:31.294802+0000 (oldest deadline 2024-01-31T05:15:55.994752+0000) 2024-01-31T05:16:03.318 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:16:02 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:16:02.874+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:38.796028+0000 front 2024-01-31T05:15:38.796052+0000 (oldest deadline 2024-01-31T05:16:01.096303+0000) 2024-01-31T05:16:03.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:03 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:03.003+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.769908+0000 front 2024-01-31T05:15:21.770050+0000 (oldest deadline 2024-01-31T05:15:46.469991+0000) 2024-01-31T05:16:03.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:03 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:03.003+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:28.771067+0000 front 2024-01-31T05:15:28.771106+0000 (oldest deadline 2024-01-31T05:15:54.071204+0000) 2024-01-31T05:16:03.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:03 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:03.003+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:37.372822+0000 front 2024-01-31T05:15:37.372978+0000 (oldest deadline 2024-01-31T05:16:02.072855+0000) 2024-01-31T05:16:03.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:03 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:03.056+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:16:03.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:03 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:03.056+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.701398+0000 front 2024-01-31T05:15:24.701437+0000 (oldest deadline 2024-01-31T05:15:49.401612+0000) 2024-01-31T05:16:03.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:03 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:03.056+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:29.402167+0000 front 2024-01-31T05:15:29.402154+0000 (oldest deadline 2024-01-31T05:15:55.302060+0000) 2024-01-31T05:16:03.591 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:03 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:03.447+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:16:03.591 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:03 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:03.447+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:16:03.591 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:03 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:03.447+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:16:03.591 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:03 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:03.447+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:40.103826+0000 front 2024-01-31T05:15:40.103813+0000 (oldest deadline 2024-01-31T05:16:03.003809+0000) 2024-01-31T05:16:03.819 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:03 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:03.539+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:16:03.819 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:03 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:03.539+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:23.429225+0000 front 2024-01-31T05:15:23.429193+0000 (oldest deadline 2024-01-31T05:15:45.729329+0000) 2024-01-31T05:16:03.819 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:03 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:03.539+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:30.931585+0000 front 2024-01-31T05:15:30.931516+0000 (oldest deadline 2024-01-31T05:15:55.631632+0000) 2024-01-31T05:16:03.882 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:16:03 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:16:03.513+0000 7ffa09cae700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.414603+0000 front 2024-01-31T05:15:21.414625+0000 (oldest deadline 2024-01-31T05:15:46.114742+0000) 2024-01-31T05:16:03.882 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:16:03 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:16:03.513+0000 7ffa09cae700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.016091+0000 front 2024-01-31T05:15:32.015929+0000 (oldest deadline 2024-01-31T05:15:58.416459+0000) 2024-01-31T05:16:04.318 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:16:03 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:16:03.871+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:16.191633+0000 front 2024-01-31T05:15:16.191698+0000 (oldest deadline 2024-01-31T05:15:40.291832+0000) 2024-01-31T05:16:04.318 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:16:03 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:16:03.871+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:20.792981+0000 front 2024-01-31T05:15:20.792878+0000 (oldest deadline 2024-01-31T05:15:45.493020+0000) 2024-01-31T05:16:04.318 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:16:03 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:16:03.871+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:31.294879+0000 front 2024-01-31T05:15:31.294802+0000 (oldest deadline 2024-01-31T05:15:55.994752+0000) 2024-01-31T05:16:04.319 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:16:03 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6[60206]: 2024-01-31T05:16:03.871+0000 7f4056dff700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:38.796028+0000 front 2024-01-31T05:15:38.796052+0000 (oldest deadline 2024-01-31T05:16:01.096303+0000) 2024-01-31T05:16:04.320 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:04 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:04.014+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.769908+0000 front 2024-01-31T05:15:21.770050+0000 (oldest deadline 2024-01-31T05:15:46.469991+0000) 2024-01-31T05:16:04.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:04 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:04.014+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:28.771067+0000 front 2024-01-31T05:15:28.771106+0000 (oldest deadline 2024-01-31T05:15:54.071204+0000) 2024-01-31T05:16:04.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:04 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:04.014+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:37.372822+0000 front 2024-01-31T05:15:37.372978+0000 (oldest deadline 2024-01-31T05:16:02.072855+0000) 2024-01-31T05:16:04.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:04 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:04.017+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:16:04.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:04 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:04.017+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.701398+0000 front 2024-01-31T05:15:24.701437+0000 (oldest deadline 2024-01-31T05:15:49.401612+0000) 2024-01-31T05:16:04.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:04 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:04.017+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:29.402167+0000 front 2024-01-31T05:15:29.402154+0000 (oldest deadline 2024-01-31T05:15:55.302060+0000) 2024-01-31T05:16:04.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:04 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:04.017+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:38.703667+0000 front 2024-01-31T05:15:38.703620+0000 (oldest deadline 2024-01-31T05:16:04.003649+0000) 2024-01-31T05:16:04.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:04 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:04.447+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:16:04.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:04 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:04.447+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:16:04.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:04 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:04.447+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:16:04.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:04 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:04.447+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:40.103826+0000 front 2024-01-31T05:15:40.103813+0000 (oldest deadline 2024-01-31T05:16:03.003809+0000) 2024-01-31T05:16:04.882 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:16:04 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:16:04.539+0000 7ffa09cae700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.414603+0000 front 2024-01-31T05:15:21.414625+0000 (oldest deadline 2024-01-31T05:15:46.114742+0000) 2024-01-31T05:16:04.882 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:16:04 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:16:04.539+0000 7ffa09cae700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.016091+0000 front 2024-01-31T05:15:32.015929+0000 (oldest deadline 2024-01-31T05:15:58.416459+0000) 2024-01-31T05:16:05.068 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:16:04 smithi099 podman[91599]: 2024-01-31 05:16:04.764830268 +0000 UTC m=+5.655701364 container died 43a2351bd4268c328f0256a4abd9c326833d4f5981ecb0c3a4c6ff8a7bd2951f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240123, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.31.3) 2024-01-31T05:16:05.068 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:04 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:04.583+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:16:05.068 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:04 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:04.583+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:23.429225+0000 front 2024-01-31T05:15:23.429193+0000 (oldest deadline 2024-01-31T05:15:45.729329+0000) 2024-01-31T05:16:05.069 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:04 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:04.583+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:30.931585+0000 front 2024-01-31T05:15:30.931516+0000 (oldest deadline 2024-01-31T05:15:55.631632+0000) 2024-01-31T05:16:05.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:04 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:04.970+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.769908+0000 front 2024-01-31T05:15:21.770050+0000 (oldest deadline 2024-01-31T05:15:46.469991+0000) 2024-01-31T05:16:05.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:04 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:04.971+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:28.771067+0000 front 2024-01-31T05:15:28.771106+0000 (oldest deadline 2024-01-31T05:15:54.071204+0000) 2024-01-31T05:16:05.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:04 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:04.971+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:37.372822+0000 front 2024-01-31T05:15:37.372978+0000 (oldest deadline 2024-01-31T05:16:02.072855+0000) 2024-01-31T05:16:05.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:05 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:05.049+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:16:05.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:05 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:05.049+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.701398+0000 front 2024-01-31T05:15:24.701437+0000 (oldest deadline 2024-01-31T05:15:49.401612+0000) 2024-01-31T05:16:05.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:05 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:05.049+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:29.402167+0000 front 2024-01-31T05:15:29.402154+0000 (oldest deadline 2024-01-31T05:15:55.302060+0000) 2024-01-31T05:16:05.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:05 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:05.049+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:38.703667+0000 front 2024-01-31T05:15:38.703620+0000 (oldest deadline 2024-01-31T05:16:04.003649+0000) 2024-01-31T05:16:05.508 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:16:05 smithi099 podman[91599]: 2024-01-31 05:16:05.257847769 +0000 UTC m=+6.148718862 container cleanup 43a2351bd4268c328f0256a4abd9c326833d4f5981ecb0c3a4c6ff8a7bd2951f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6, RELEASE=wip-vshankar-testing-20240125.044502-661946e, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240123, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.31.3, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-01-31T05:16:05.508 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:16:05 smithi099 bash[91599]: ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6 2024-01-31T05:16:05.818 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:16:05 smithi099 podman[91618]: 2024-01-31 05:16:05.509435677 +0000 UTC m=+0.735104959 container remove 43a2351bd4268c328f0256a4abd9c326833d4f5981ecb0c3a4c6ff8a7bd2951f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240123, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.31.3, RELEASE=wip-vshankar-testing-20240125.044502-661946e, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-01-31T05:16:05.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:05 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:05.586+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:16:05.819 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:05 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:05.586+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:23.429225+0000 front 2024-01-31T05:15:23.429193+0000 (oldest deadline 2024-01-31T05:15:45.729329+0000) 2024-01-31T05:16:05.819 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:05 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:05.586+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:30.931585+0000 front 2024-01-31T05:15:30.931516+0000 (oldest deadline 2024-01-31T05:15:55.631632+0000) 2024-01-31T05:16:05.819 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:05 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:05.586+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:39.033132+0000 front 2024-01-31T05:15:39.033161+0000 (oldest deadline 2024-01-31T05:16:04.933241+0000) 2024-01-31T05:16:05.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:05 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:05.421+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:16:05.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:05 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:05.421+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:16:05.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:05 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:05.421+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:16:05.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:05 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:05.421+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:40.103826+0000 front 2024-01-31T05:15:40.103813+0000 (oldest deadline 2024-01-31T05:16:03.003809+0000) 2024-01-31T05:16:05.882 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:16:05 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:16:05.541+0000 7ffa09cae700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.414603+0000 front 2024-01-31T05:15:21.414625+0000 (oldest deadline 2024-01-31T05:15:46.114742+0000) 2024-01-31T05:16:05.882 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:16:05 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:16:05.541+0000 7ffa09cae700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.016091+0000 front 2024-01-31T05:15:32.015929+0000 (oldest deadline 2024-01-31T05:15:58.416459+0000) 2024-01-31T05:16:06.153 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:16:05 smithi099 podman[91713]: 2024-01-31 05:16:05.727739893 +0000 UTC m=+0.018099338 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-31T05:16:06.153 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:16:05 smithi099 podman[91713]: 2024-01-31 05:16:05.835281165 +0000 UTC m=+0.125640604 container create 2cfc470449a266b5f3791dc87d0f17280ef56ad58c850494bc0dc7c7b84882c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240123, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, io.buildah.version=1.31.3, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-01-31T05:16:06.153 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:16:06 smithi099 podman[91713]: 2024-01-31 05:16:06.064618347 +0000 UTC m=+0.354977793 container init 2cfc470449a266b5f3791dc87d0f17280ef56ad58c850494bc0dc7c7b84882c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.31.3, org.label-schema.license=GPLv2, org.label-schema.build-date=20240123, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-01-31T05:16:06.153 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:16:06 smithi099 podman[91713]: 2024-01-31 05:16:06.067991927 +0000 UTC m=+0.358351362 container start 2cfc470449a266b5f3791dc87d0f17280ef56ad58c850494bc0dc7c7b84882c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6-deactivate, RELEASE=wip-vshankar-testing-20240125.044502-661946e, io.buildah.version=1.31.3, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240123, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-01-31T05:16:06.153 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:16:06 smithi099 podman[91713]: 2024-01-31 05:16:06.15430177 +0000 UTC m=+0.444661226 container attach 2cfc470449a266b5f3791dc87d0f17280ef56ad58c850494bc0dc7c7b84882c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240123, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.31.3, ceph=True, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-01-31T05:16:06.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:05 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:05.944+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.769908+0000 front 2024-01-31T05:15:21.770050+0000 (oldest deadline 2024-01-31T05:15:46.469991+0000) 2024-01-31T05:16:06.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:05 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:05.944+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:28.771067+0000 front 2024-01-31T05:15:28.771106+0000 (oldest deadline 2024-01-31T05:15:54.071204+0000) 2024-01-31T05:16:06.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:05 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:05.944+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:37.372822+0000 front 2024-01-31T05:15:37.372978+0000 (oldest deadline 2024-01-31T05:16:02.072855+0000) 2024-01-31T05:16:06.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:06 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:06.077+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:16:06.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:06 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:06.077+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.701398+0000 front 2024-01-31T05:15:24.701437+0000 (oldest deadline 2024-01-31T05:15:49.401612+0000) 2024-01-31T05:16:06.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:06 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:06.077+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:29.402167+0000 front 2024-01-31T05:15:29.402154+0000 (oldest deadline 2024-01-31T05:15:55.302060+0000) 2024-01-31T05:16:06.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:06 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:06.077+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:38.703667+0000 front 2024-01-31T05:15:38.703620+0000 (oldest deadline 2024-01-31T05:16:04.003649+0000) 2024-01-31T05:16:06.560 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 31 05:16:06 smithi099 podman[91713]: 2024-01-31 05:16:06.348641439 +0000 UTC m=+0.639000888 container died 2cfc470449a266b5f3791dc87d0f17280ef56ad58c850494bc0dc7c7b84882c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-6-deactivate, ceph=True, io.buildah.version=1.31.3, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240123, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240125.044502-661946e) 2024-01-31T05:16:06.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:06 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:06.560+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:16:06.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:06 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:06.560+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:23.429225+0000 front 2024-01-31T05:15:23.429193+0000 (oldest deadline 2024-01-31T05:15:45.729329+0000) 2024-01-31T05:16:06.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:06 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:06.560+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:30.931585+0000 front 2024-01-31T05:15:30.931516+0000 (oldest deadline 2024-01-31T05:15:55.631632+0000) 2024-01-31T05:16:06.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:06 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:06.560+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:39.033132+0000 front 2024-01-31T05:15:39.033161+0000 (oldest deadline 2024-01-31T05:16:04.933241+0000) 2024-01-31T05:16:06.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:06 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:06.448+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:16:06.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:06 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:06.448+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:16:06.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:06 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:06.448+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:16:06.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:06 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:06.448+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:40.103826+0000 front 2024-01-31T05:15:40.103813+0000 (oldest deadline 2024-01-31T05:16:03.003809+0000) 2024-01-31T05:16:06.883 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:16:06 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:16:06.498+0000 7ffa09cae700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.414603+0000 front 2024-01-31T05:15:21.414625+0000 (oldest deadline 2024-01-31T05:15:46.114742+0000) 2024-01-31T05:16:06.883 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:16:06 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:16:06.498+0000 7ffa09cae700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.016091+0000 front 2024-01-31T05:15:32.015929+0000 (oldest deadline 2024-01-31T05:15:58.416459+0000) 2024-01-31T05:16:06.883 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:16:06 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:16:06.498+0000 7ffa09cae700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:40.017858+0000 front 2024-01-31T05:15:40.017886+0000 (oldest deadline 2024-01-31T05:16:05.918015+0000) 2024-01-31T05:16:06.996 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@osd.6.service' 2024-01-31T05:16:07.038 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-31T05:16:07.038 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-01-31T05:16:07.038 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-01-31T05:16:07.038 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ceph-9288ff44-bff5-11ee-95b3-87774f69a715@osd.7 2024-01-31T05:16:07.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:06 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:06.991+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.769908+0000 front 2024-01-31T05:15:21.770050+0000 (oldest deadline 2024-01-31T05:15:46.469991+0000) 2024-01-31T05:16:07.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:06 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:06.991+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:28.771067+0000 front 2024-01-31T05:15:28.771106+0000 (oldest deadline 2024-01-31T05:15:54.071204+0000) 2024-01-31T05:16:07.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:06 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:06.991+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:37.372822+0000 front 2024-01-31T05:15:37.372978+0000 (oldest deadline 2024-01-31T05:16:02.072855+0000) 2024-01-31T05:16:07.333 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:16:07 smithi179 systemd[1]: Stopping Ceph osd.7 for 9288ff44-bff5-11ee-95b3-87774f69a715... 2024-01-31T05:16:07.333 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:07 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:07.034+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:16:07.333 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:07 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:07.034+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.701398+0000 front 2024-01-31T05:15:24.701437+0000 (oldest deadline 2024-01-31T05:15:49.401612+0000) 2024-01-31T05:16:07.333 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:07 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:07.034+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:29.402167+0000 front 2024-01-31T05:15:29.402154+0000 (oldest deadline 2024-01-31T05:15:55.302060+0000) 2024-01-31T05:16:07.333 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:07 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:07.034+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:38.703667+0000 front 2024-01-31T05:15:38.703620+0000 (oldest deadline 2024-01-31T05:16:04.003649+0000) 2024-01-31T05:16:07.632 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:16:07 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:16:07.333+0000 7ffa0ceb2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-31T05:16:07.632 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:16:07 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:16:07.333+0000 7ffa0ceb2700 -1 osd.7 91 *** Got signal Terminated *** 2024-01-31T05:16:07.632 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:16:07 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:16:07.333+0000 7ffa0ceb2700 -1 osd.7 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-31T05:16:07.632 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:16:07 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:16:07.466+0000 7ffa09cae700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.414603+0000 front 2024-01-31T05:15:21.414625+0000 (oldest deadline 2024-01-31T05:15:46.114742+0000) 2024-01-31T05:16:07.633 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:16:07 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:16:07.466+0000 7ffa09cae700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.016091+0000 front 2024-01-31T05:15:32.015929+0000 (oldest deadline 2024-01-31T05:15:58.416459+0000) 2024-01-31T05:16:07.633 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:16:07 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:16:07.466+0000 7ffa09cae700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:40.017858+0000 front 2024-01-31T05:15:40.017886+0000 (oldest deadline 2024-01-31T05:16:05.918015+0000) 2024-01-31T05:16:07.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:07 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:07.584+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:16:07.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:07 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:07.584+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:23.429225+0000 front 2024-01-31T05:15:23.429193+0000 (oldest deadline 2024-01-31T05:15:45.729329+0000) 2024-01-31T05:16:07.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:07 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:07.584+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:30.931585+0000 front 2024-01-31T05:15:30.931516+0000 (oldest deadline 2024-01-31T05:15:55.631632+0000) 2024-01-31T05:16:07.819 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:07 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:07.584+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:39.033132+0000 front 2024-01-31T05:15:39.033161+0000 (oldest deadline 2024-01-31T05:16:04.933241+0000) 2024-01-31T05:16:07.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:07.461+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:16:07.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:07.461+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:16:07.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:07.461+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:16:07.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:07.461+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:40.103826+0000 front 2024-01-31T05:15:40.103813+0000 (oldest deadline 2024-01-31T05:16:03.003809+0000) 2024-01-31T05:16:08.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:07.984+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.769908+0000 front 2024-01-31T05:15:21.770050+0000 (oldest deadline 2024-01-31T05:15:46.469991+0000) 2024-01-31T05:16:08.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:07.984+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:28.771067+0000 front 2024-01-31T05:15:28.771106+0000 (oldest deadline 2024-01-31T05:15:54.071204+0000) 2024-01-31T05:16:08.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:07 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:07.984+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:37.372822+0000 front 2024-01-31T05:15:37.372978+0000 (oldest deadline 2024-01-31T05:16:02.072855+0000) 2024-01-31T05:16:08.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:08 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:08.013+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:16:08.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:08 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:08.013+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.701398+0000 front 2024-01-31T05:15:24.701437+0000 (oldest deadline 2024-01-31T05:15:49.401612+0000) 2024-01-31T05:16:08.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:08 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:08.013+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:29.402167+0000 front 2024-01-31T05:15:29.402154+0000 (oldest deadline 2024-01-31T05:15:55.302060+0000) 2024-01-31T05:16:08.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:08 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:08.013+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:38.703667+0000 front 2024-01-31T05:15:38.703620+0000 (oldest deadline 2024-01-31T05:16:04.003649+0000) 2024-01-31T05:16:08.661 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:16:08 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:16:08.424+0000 7ffa09cae700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.414603+0000 front 2024-01-31T05:15:21.414625+0000 (oldest deadline 2024-01-31T05:15:46.114742+0000) 2024-01-31T05:16:08.661 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:16:08 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:16:08.424+0000 7ffa09cae700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.016091+0000 front 2024-01-31T05:15:32.015929+0000 (oldest deadline 2024-01-31T05:15:58.416459+0000) 2024-01-31T05:16:08.661 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:16:08 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:16:08.424+0000 7ffa09cae700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:40.017858+0000 front 2024-01-31T05:15:40.017886+0000 (oldest deadline 2024-01-31T05:16:05.918015+0000) 2024-01-31T05:16:08.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:08.555+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:16:08.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:08.555+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:23.429225+0000 front 2024-01-31T05:15:23.429193+0000 (oldest deadline 2024-01-31T05:15:45.729329+0000) 2024-01-31T05:16:08.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:08.555+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:30.931585+0000 front 2024-01-31T05:15:30.931516+0000 (oldest deadline 2024-01-31T05:15:55.631632+0000) 2024-01-31T05:16:08.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:08 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:08.555+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:39.033132+0000 front 2024-01-31T05:15:39.033161+0000 (oldest deadline 2024-01-31T05:16:04.933241+0000) 2024-01-31T05:16:08.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:08.448+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:16:08.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:08.448+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:16:08.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:08.448+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:16:08.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:08.448+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:40.103826+0000 front 2024-01-31T05:15:40.103813+0000 (oldest deadline 2024-01-31T05:16:03.003809+0000) 2024-01-31T05:16:09.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:08.966+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.769908+0000 front 2024-01-31T05:15:21.770050+0000 (oldest deadline 2024-01-31T05:15:46.469991+0000) 2024-01-31T05:16:09.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:08.966+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:28.771067+0000 front 2024-01-31T05:15:28.771106+0000 (oldest deadline 2024-01-31T05:15:54.071204+0000) 2024-01-31T05:16:09.322 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:08 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:08.966+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:37.372822+0000 front 2024-01-31T05:15:37.372978+0000 (oldest deadline 2024-01-31T05:16:02.072855+0000) 2024-01-31T05:16:09.388 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:09 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:09.001+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:16:09.389 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:09 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:09.001+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.701398+0000 front 2024-01-31T05:15:24.701437+0000 (oldest deadline 2024-01-31T05:15:49.401612+0000) 2024-01-31T05:16:09.389 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:09 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:09.001+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:29.402167+0000 front 2024-01-31T05:15:29.402154+0000 (oldest deadline 2024-01-31T05:15:55.302060+0000) 2024-01-31T05:16:09.389 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:09 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:09.001+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:38.703667+0000 front 2024-01-31T05:15:38.703620+0000 (oldest deadline 2024-01-31T05:16:04.003649+0000) 2024-01-31T05:16:09.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:09 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:09.561+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:16:09.819 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:09 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:09.561+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:23.429225+0000 front 2024-01-31T05:15:23.429193+0000 (oldest deadline 2024-01-31T05:15:45.729329+0000) 2024-01-31T05:16:09.819 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:09 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:09.561+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:30.931585+0000 front 2024-01-31T05:15:30.931516+0000 (oldest deadline 2024-01-31T05:15:55.631632+0000) 2024-01-31T05:16:09.819 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:09 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:09.561+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:39.033132+0000 front 2024-01-31T05:15:39.033161+0000 (oldest deadline 2024-01-31T05:16:04.933241+0000) 2024-01-31T05:16:09.825 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:09 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:09.483+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:16:09.825 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:09 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:09.483+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:16:09.825 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:09 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:09.483+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:16:09.825 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:09 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:09.483+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:40.103826+0000 front 2024-01-31T05:15:40.103813+0000 (oldest deadline 2024-01-31T05:16:03.003809+0000) 2024-01-31T05:16:09.883 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:16:09 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:16:09.456+0000 7ffa09cae700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.414603+0000 front 2024-01-31T05:15:21.414625+0000 (oldest deadline 2024-01-31T05:15:46.114742+0000) 2024-01-31T05:16:09.883 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:16:09 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:16:09.456+0000 7ffa09cae700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.016091+0000 front 2024-01-31T05:15:32.015929+0000 (oldest deadline 2024-01-31T05:15:58.416459+0000) 2024-01-31T05:16:09.883 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:16:09 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:16:09.456+0000 7ffa09cae700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:40.017858+0000 front 2024-01-31T05:15:40.017886+0000 (oldest deadline 2024-01-31T05:16:05.918015+0000) 2024-01-31T05:16:10.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:09 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:09.976+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.769908+0000 front 2024-01-31T05:15:21.770050+0000 (oldest deadline 2024-01-31T05:15:46.469991+0000) 2024-01-31T05:16:10.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:09 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:09.976+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:28.771067+0000 front 2024-01-31T05:15:28.771106+0000 (oldest deadline 2024-01-31T05:15:54.071204+0000) 2024-01-31T05:16:10.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:09 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:09.976+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:37.372822+0000 front 2024-01-31T05:15:37.372978+0000 (oldest deadline 2024-01-31T05:16:02.072855+0000) 2024-01-31T05:16:10.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:09 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:09.976+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:48.176006+0000 front 2024-01-31T05:15:48.176116+0000 (oldest deadline 2024-01-31T05:16:09.875929+0000) 2024-01-31T05:16:10.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:10.040+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:16:10.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:10.040+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.701398+0000 front 2024-01-31T05:15:24.701437+0000 (oldest deadline 2024-01-31T05:15:49.401612+0000) 2024-01-31T05:16:10.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:10.040+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:29.402167+0000 front 2024-01-31T05:15:29.402154+0000 (oldest deadline 2024-01-31T05:15:55.302060+0000) 2024-01-31T05:16:10.383 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:10.040+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:38.703667+0000 front 2024-01-31T05:15:38.703620+0000 (oldest deadline 2024-01-31T05:16:04.003649+0000) 2024-01-31T05:16:10.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:10 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:10.552+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:16:10.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:10 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:10.552+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:23.429225+0000 front 2024-01-31T05:15:23.429193+0000 (oldest deadline 2024-01-31T05:15:45.729329+0000) 2024-01-31T05:16:10.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:10 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:10.552+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:30.931585+0000 front 2024-01-31T05:15:30.931516+0000 (oldest deadline 2024-01-31T05:15:55.631632+0000) 2024-01-31T05:16:10.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:10 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:10.552+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:39.033132+0000 front 2024-01-31T05:15:39.033161+0000 (oldest deadline 2024-01-31T05:16:04.933241+0000) 2024-01-31T05:16:10.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:10 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:10.474+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:16:10.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:10 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:10.474+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:16:10.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:10 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:10.474+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:16:10.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:10 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:10.474+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:40.103826+0000 front 2024-01-31T05:15:40.103813+0000 (oldest deadline 2024-01-31T05:16:03.003809+0000) 2024-01-31T05:16:10.882 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:16:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:16:10.479+0000 7ffa09cae700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.414603+0000 front 2024-01-31T05:15:21.414625+0000 (oldest deadline 2024-01-31T05:15:46.114742+0000) 2024-01-31T05:16:10.882 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:16:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:16:10.479+0000 7ffa09cae700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.016091+0000 front 2024-01-31T05:15:32.015929+0000 (oldest deadline 2024-01-31T05:15:58.416459+0000) 2024-01-31T05:16:10.882 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:16:10 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:16:10.479+0000 7ffa09cae700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:40.017858+0000 front 2024-01-31T05:15:40.017886+0000 (oldest deadline 2024-01-31T05:16:05.918015+0000) 2024-01-31T05:16:11.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:11 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:11.000+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.769908+0000 front 2024-01-31T05:15:21.770050+0000 (oldest deadline 2024-01-31T05:15:46.469991+0000) 2024-01-31T05:16:11.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:11 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:11.000+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:28.771067+0000 front 2024-01-31T05:15:28.771106+0000 (oldest deadline 2024-01-31T05:15:54.071204+0000) 2024-01-31T05:16:11.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:11 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:11.000+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:37.372822+0000 front 2024-01-31T05:15:37.372978+0000 (oldest deadline 2024-01-31T05:16:02.072855+0000) 2024-01-31T05:16:11.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:11 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:11.000+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:48.176006+0000 front 2024-01-31T05:15:48.176116+0000 (oldest deadline 2024-01-31T05:16:09.875929+0000) 2024-01-31T05:16:11.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:11 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:11.077+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:16:11.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:11 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:11.077+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.701398+0000 front 2024-01-31T05:15:24.701437+0000 (oldest deadline 2024-01-31T05:15:49.401612+0000) 2024-01-31T05:16:11.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:11 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:11.077+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:29.402167+0000 front 2024-01-31T05:15:29.402154+0000 (oldest deadline 2024-01-31T05:15:55.302060+0000) 2024-01-31T05:16:11.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:11 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:11.077+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:38.703667+0000 front 2024-01-31T05:15:38.703620+0000 (oldest deadline 2024-01-31T05:16:04.003649+0000) 2024-01-31T05:16:11.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:11 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:11.562+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:16:11.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:11 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:11.562+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:23.429225+0000 front 2024-01-31T05:15:23.429193+0000 (oldest deadline 2024-01-31T05:15:45.729329+0000) 2024-01-31T05:16:11.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:11 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:11.562+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:30.931585+0000 front 2024-01-31T05:15:30.931516+0000 (oldest deadline 2024-01-31T05:15:55.631632+0000) 2024-01-31T05:16:11.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:11 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:11.562+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:39.033132+0000 front 2024-01-31T05:15:39.033161+0000 (oldest deadline 2024-01-31T05:16:04.933241+0000) 2024-01-31T05:16:11.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:11 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:11.562+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.734748+0000 front 2024-01-31T05:15:47.734758+0000 (oldest deadline 2024-01-31T05:16:11.234668+0000) 2024-01-31T05:16:11.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:11 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:11.478+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:16:11.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:11 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:11.478+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:16:11.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:11 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:11.478+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:16:11.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:11 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:11.478+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:40.103826+0000 front 2024-01-31T05:15:40.103813+0000 (oldest deadline 2024-01-31T05:16:03.003809+0000) 2024-01-31T05:16:11.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:11 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:11.478+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.605332+0000 front 2024-01-31T05:15:47.605496+0000 (oldest deadline 2024-01-31T05:16:11.105241+0000) 2024-01-31T05:16:11.882 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:16:11 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:16:11.439+0000 7ffa09cae700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.414603+0000 front 2024-01-31T05:15:21.414625+0000 (oldest deadline 2024-01-31T05:15:46.114742+0000) 2024-01-31T05:16:11.882 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:16:11 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:16:11.439+0000 7ffa09cae700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.016091+0000 front 2024-01-31T05:15:32.015929+0000 (oldest deadline 2024-01-31T05:15:58.416459+0000) 2024-01-31T05:16:11.882 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:16:11 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7[54113]: 2024-01-31T05:16:11.439+0000 7ffa09cae700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:40.017858+0000 front 2024-01-31T05:15:40.017886+0000 (oldest deadline 2024-01-31T05:16:05.918015+0000) 2024-01-31T05:16:12.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:11 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:11.961+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.769908+0000 front 2024-01-31T05:15:21.770050+0000 (oldest deadline 2024-01-31T05:15:46.469991+0000) 2024-01-31T05:16:12.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:11 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:11.961+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:28.771067+0000 front 2024-01-31T05:15:28.771106+0000 (oldest deadline 2024-01-31T05:15:54.071204+0000) 2024-01-31T05:16:12.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:11 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:11.961+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:37.372822+0000 front 2024-01-31T05:15:37.372978+0000 (oldest deadline 2024-01-31T05:16:02.072855+0000) 2024-01-31T05:16:12.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:11 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:11.961+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:48.176006+0000 front 2024-01-31T05:15:48.176116+0000 (oldest deadline 2024-01-31T05:16:09.875929+0000) 2024-01-31T05:16:12.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:12 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:12.110+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:16:12.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:12 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:12.110+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.701398+0000 front 2024-01-31T05:15:24.701437+0000 (oldest deadline 2024-01-31T05:15:49.401612+0000) 2024-01-31T05:16:12.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:12 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:12.110+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:29.402167+0000 front 2024-01-31T05:15:29.402154+0000 (oldest deadline 2024-01-31T05:15:55.302060+0000) 2024-01-31T05:16:12.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:12 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:12.110+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:38.703667+0000 front 2024-01-31T05:15:38.703620+0000 (oldest deadline 2024-01-31T05:16:04.003649+0000) 2024-01-31T05:16:12.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:12 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:12.110+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:48.104600+0000 front 2024-01-31T05:15:48.104539+0000 (oldest deadline 2024-01-31T05:16:11.604713+0000) 2024-01-31T05:16:12.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:12 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:12.517+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:16:12.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:12 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:12.517+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:23.429225+0000 front 2024-01-31T05:15:23.429193+0000 (oldest deadline 2024-01-31T05:15:45.729329+0000) 2024-01-31T05:16:12.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:12 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:12.517+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:30.931585+0000 front 2024-01-31T05:15:30.931516+0000 (oldest deadline 2024-01-31T05:15:55.631632+0000) 2024-01-31T05:16:12.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:12 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:12.517+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:39.033132+0000 front 2024-01-31T05:15:39.033161+0000 (oldest deadline 2024-01-31T05:16:04.933241+0000) 2024-01-31T05:16:12.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:12 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:12.517+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.734748+0000 front 2024-01-31T05:15:47.734758+0000 (oldest deadline 2024-01-31T05:16:11.234668+0000) 2024-01-31T05:16:12.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:12 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:12.474+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:16:12.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:12 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:12.474+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:16:12.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:12 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:12.474+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:16:12.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:12 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:12.474+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:40.103826+0000 front 2024-01-31T05:15:40.103813+0000 (oldest deadline 2024-01-31T05:16:03.003809+0000) 2024-01-31T05:16:12.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:12 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:12.474+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.605332+0000 front 2024-01-31T05:15:47.605496+0000 (oldest deadline 2024-01-31T05:16:11.105241+0000) 2024-01-31T05:16:12.918 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:16:12 smithi179 podman[70352]: 2024-01-31 05:16:12.669207988 +0000 UTC m=+5.436133913 container died 6fc0d6555bfa2fa12a424775ea7494c1adcaa634869eaa9bb6eb95bb76d77a35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7, org.label-schema.build-date=20240123, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240125.044502-661946e, io.buildah.version=1.31.3, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-01-31T05:16:13.251 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:16:13 smithi179 podman[70352]: 2024-01-31 05:16:13.018160558 +0000 UTC m=+5.785086471 container cleanup 6fc0d6555bfa2fa12a424775ea7494c1adcaa634869eaa9bb6eb95bb76d77a35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240123, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.31.3, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True) 2024-01-31T05:16:13.251 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:16:13 smithi179 bash[70352]: ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7 2024-01-31T05:16:13.252 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:13 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:13.142+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:16:13.252 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:13 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:13.142+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.701398+0000 front 2024-01-31T05:15:24.701437+0000 (oldest deadline 2024-01-31T05:15:49.401612+0000) 2024-01-31T05:16:13.252 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:13 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:13.142+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:29.402167+0000 front 2024-01-31T05:15:29.402154+0000 (oldest deadline 2024-01-31T05:15:55.302060+0000) 2024-01-31T05:16:13.252 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:13 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:13.142+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:38.703667+0000 front 2024-01-31T05:15:38.703620+0000 (oldest deadline 2024-01-31T05:16:04.003649+0000) 2024-01-31T05:16:13.252 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:13 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:13.142+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:48.104600+0000 front 2024-01-31T05:15:48.104539+0000 (oldest deadline 2024-01-31T05:16:11.604713+0000) 2024-01-31T05:16:13.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:12 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:12.941+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.769908+0000 front 2024-01-31T05:15:21.770050+0000 (oldest deadline 2024-01-31T05:15:46.469991+0000) 2024-01-31T05:16:13.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:12 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:12.941+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:28.771067+0000 front 2024-01-31T05:15:28.771106+0000 (oldest deadline 2024-01-31T05:15:54.071204+0000) 2024-01-31T05:16:13.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:12 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:12.941+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:37.372822+0000 front 2024-01-31T05:15:37.372978+0000 (oldest deadline 2024-01-31T05:16:02.072855+0000) 2024-01-31T05:16:13.322 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:12 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:12.941+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:48.176006+0000 front 2024-01-31T05:15:48.176116+0000 (oldest deadline 2024-01-31T05:16:09.875929+0000) 2024-01-31T05:16:13.632 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:16:13 smithi179 podman[70382]: 2024-01-31 05:16:13.252841838 +0000 UTC m=+0.580432933 container remove 6fc0d6555bfa2fa12a424775ea7494c1adcaa634869eaa9bb6eb95bb76d77a35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7, GIT_BRANCH=HEAD, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.build-date=20240123, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-01-31T05:16:13.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:13 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:13.567+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:16:13.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:13 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:13.567+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:23.429225+0000 front 2024-01-31T05:15:23.429193+0000 (oldest deadline 2024-01-31T05:15:45.729329+0000) 2024-01-31T05:16:13.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:13 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:13.567+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:30.931585+0000 front 2024-01-31T05:15:30.931516+0000 (oldest deadline 2024-01-31T05:15:55.631632+0000) 2024-01-31T05:16:13.819 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:13 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:13.567+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:39.033132+0000 front 2024-01-31T05:15:39.033161+0000 (oldest deadline 2024-01-31T05:16:04.933241+0000) 2024-01-31T05:16:13.819 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:13 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:13.567+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.734748+0000 front 2024-01-31T05:15:47.734758+0000 (oldest deadline 2024-01-31T05:16:11.234668+0000) 2024-01-31T05:16:13.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:13 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:13.475+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:16:13.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:13 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:13.475+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:16:13.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:13 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:13.475+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:16:13.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:13 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:13.475+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:40.103826+0000 front 2024-01-31T05:15:40.103813+0000 (oldest deadline 2024-01-31T05:16:03.003809+0000) 2024-01-31T05:16:13.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:13 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:13.475+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.605332+0000 front 2024-01-31T05:15:47.605496+0000 (oldest deadline 2024-01-31T05:16:11.105241+0000) 2024-01-31T05:16:13.980 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:16:13 smithi179 podman[70475]: 2024-01-31 05:16:13.580764373 +0000 UTC m=+0.017281674 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-31T05:16:13.980 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:16:13 smithi179 podman[70475]: 2024-01-31 05:16:13.687291184 +0000 UTC m=+0.123808433 container create 5a9e949ca8bbafbb3cdd15f0f6c7b4f02c5a3178bd0df7cbf846655278b3b5b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_BRANCH=HEAD, org.label-schema.build-date=20240123, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.31.3) 2024-01-31T05:16:13.980 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:16:13 smithi179 podman[70475]: 2024-01-31 05:16:13.873447931 +0000 UTC m=+0.309965205 container init 5a9e949ca8bbafbb3cdd15f0f6c7b4f02c5a3178bd0df7cbf846655278b3b5b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240123, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.schema-version=1.0, io.buildah.version=1.31.3, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-01-31T05:16:13.980 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:16:13 smithi179 podman[70475]: 2024-01-31 05:16:13.876821277 +0000 UTC m=+0.313338536 container start 5a9e949ca8bbafbb3cdd15f0f6c7b4f02c5a3178bd0df7cbf846655278b3b5b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240123, ceph=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.31.3, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240125.044502-661946e) 2024-01-31T05:16:13.980 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:16:13 smithi179 podman[70475]: 2024-01-31 05:16:13.981481577 +0000 UTC m=+0.417998837 container attach 5a9e949ca8bbafbb3cdd15f0f6c7b4f02c5a3178bd0df7cbf846655278b3b5b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.31.3, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_BRANCH=HEAD, org.label-schema.build-date=20240123, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183) 2024-01-31T05:16:14.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:13 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:13.915+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.769908+0000 front 2024-01-31T05:15:21.770050+0000 (oldest deadline 2024-01-31T05:15:46.469991+0000) 2024-01-31T05:16:14.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:13 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:13.915+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:28.771067+0000 front 2024-01-31T05:15:28.771106+0000 (oldest deadline 2024-01-31T05:15:54.071204+0000) 2024-01-31T05:16:14.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:13 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:13.915+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:37.372822+0000 front 2024-01-31T05:15:37.372978+0000 (oldest deadline 2024-01-31T05:16:02.072855+0000) 2024-01-31T05:16:14.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:13 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:13.915+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:48.176006+0000 front 2024-01-31T05:15:48.176116+0000 (oldest deadline 2024-01-31T05:16:09.875929+0000) 2024-01-31T05:16:14.382 INFO:journalctl@ceph.osd.7.smithi179.stdout:Jan 31 05:16:14 smithi179 podman[70475]: 2024-01-31 05:16:14.158216783 +0000 UTC m=+0.594734074 container died 5a9e949ca8bbafbb3cdd15f0f6c7b4f02c5a3178bd0df7cbf846655278b3b5b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-7-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240123, io.buildah.version=1.31.3, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240125.044502-661946e) 2024-01-31T05:16:14.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:14 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:14.155+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:16:14.383 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:14 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:14.155+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.701398+0000 front 2024-01-31T05:15:24.701437+0000 (oldest deadline 2024-01-31T05:15:49.401612+0000) 2024-01-31T05:16:14.383 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:14 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:14.155+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:29.402167+0000 front 2024-01-31T05:15:29.402154+0000 (oldest deadline 2024-01-31T05:15:55.302060+0000) 2024-01-31T05:16:14.383 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:14 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:14.155+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:38.703667+0000 front 2024-01-31T05:15:38.703620+0000 (oldest deadline 2024-01-31T05:16:04.003649+0000) 2024-01-31T05:16:14.383 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:14 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:14.155+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:48.104600+0000 front 2024-01-31T05:15:48.104539+0000 (oldest deadline 2024-01-31T05:16:11.604713+0000) 2024-01-31T05:16:14.820 DEBUG:teuthology.orchestra.run.smithi179:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@osd.7.service' 2024-01-31T05:16:14.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:14 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:14.438+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:16:14.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:14 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:14.438+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:16:14.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:14 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:14.438+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:16:14.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:14 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:14.438+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:40.103826+0000 front 2024-01-31T05:15:40.103813+0000 (oldest deadline 2024-01-31T05:16:03.003809+0000) 2024-01-31T05:16:14.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:14 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:14.438+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.605332+0000 front 2024-01-31T05:15:47.605496+0000 (oldest deadline 2024-01-31T05:16:11.105241+0000) 2024-01-31T05:16:14.862 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-31T05:16:14.862 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-01-31T05:16:14.862 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-01-31T05:16:14.862 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-9288ff44-bff5-11ee-95b3-87774f69a715@osd.8 2024-01-31T05:16:15.068 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:14 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:14.591+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:16:15.068 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:14 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:14.591+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:23.429225+0000 front 2024-01-31T05:15:23.429193+0000 (oldest deadline 2024-01-31T05:15:45.729329+0000) 2024-01-31T05:16:15.068 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:14 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:14.591+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:30.931585+0000 front 2024-01-31T05:15:30.931516+0000 (oldest deadline 2024-01-31T05:15:55.631632+0000) 2024-01-31T05:16:15.069 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:14 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:14.591+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:39.033132+0000 front 2024-01-31T05:15:39.033161+0000 (oldest deadline 2024-01-31T05:16:04.933241+0000) 2024-01-31T05:16:15.069 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:14 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:14.591+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.734748+0000 front 2024-01-31T05:15:47.734758+0000 (oldest deadline 2024-01-31T05:16:11.234668+0000) 2024-01-31T05:16:15.189 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:14 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:14.912+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.769908+0000 front 2024-01-31T05:15:21.770050+0000 (oldest deadline 2024-01-31T05:15:46.469991+0000) 2024-01-31T05:16:15.189 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:14 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:14.912+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:28.771067+0000 front 2024-01-31T05:15:28.771106+0000 (oldest deadline 2024-01-31T05:15:54.071204+0000) 2024-01-31T05:16:15.189 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:14 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:14.912+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:37.372822+0000 front 2024-01-31T05:15:37.372978+0000 (oldest deadline 2024-01-31T05:16:02.072855+0000) 2024-01-31T05:16:15.189 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:14 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:14.912+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:48.176006+0000 front 2024-01-31T05:15:48.176116+0000 (oldest deadline 2024-01-31T05:16:09.875929+0000) 2024-01-31T05:16:15.189 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:14 smithi181 systemd[1]: Stopping Ceph osd.8 for 9288ff44-bff5-11ee-95b3-87774f69a715... 2024-01-31T05:16:15.189 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:15 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:15.189+0000 7f28a857f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-31T05:16:15.189 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:15 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:15.189+0000 7f28a857f700 -1 osd.8 91 *** Got signal Terminated *** 2024-01-31T05:16:15.189 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:15 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:15.189+0000 7f28a857f700 -1 osd.8 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-31T05:16:15.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:15 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:15.111+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:16:15.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:15 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:15.111+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.701398+0000 front 2024-01-31T05:15:24.701437+0000 (oldest deadline 2024-01-31T05:15:49.401612+0000) 2024-01-31T05:16:15.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:15 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:15.111+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:29.402167+0000 front 2024-01-31T05:15:29.402154+0000 (oldest deadline 2024-01-31T05:15:55.302060+0000) 2024-01-31T05:16:15.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:15 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:15.111+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:38.703667+0000 front 2024-01-31T05:15:38.703620+0000 (oldest deadline 2024-01-31T05:16:04.003649+0000) 2024-01-31T05:16:15.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:15 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:15.111+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:48.104600+0000 front 2024-01-31T05:15:48.104539+0000 (oldest deadline 2024-01-31T05:16:11.604713+0000) 2024-01-31T05:16:15.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:15 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:15.486+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:16:15.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:15 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:15.486+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:16:15.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:15 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:15.486+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:16:15.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:15 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:15.486+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:40.103826+0000 front 2024-01-31T05:15:40.103813+0000 (oldest deadline 2024-01-31T05:16:03.003809+0000) 2024-01-31T05:16:15.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:15 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:15.486+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.605332+0000 front 2024-01-31T05:15:47.605496+0000 (oldest deadline 2024-01-31T05:16:11.105241+0000) 2024-01-31T05:16:16.068 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:15 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:15.576+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:16:16.068 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:15 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:15.576+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:23.429225+0000 front 2024-01-31T05:15:23.429193+0000 (oldest deadline 2024-01-31T05:15:45.729329+0000) 2024-01-31T05:16:16.068 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:15 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:15.576+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:30.931585+0000 front 2024-01-31T05:15:30.931516+0000 (oldest deadline 2024-01-31T05:15:55.631632+0000) 2024-01-31T05:16:16.068 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:15 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:15.576+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:39.033132+0000 front 2024-01-31T05:15:39.033161+0000 (oldest deadline 2024-01-31T05:16:04.933241+0000) 2024-01-31T05:16:16.069 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:15 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:15.576+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.734748+0000 front 2024-01-31T05:15:47.734758+0000 (oldest deadline 2024-01-31T05:16:11.234668+0000) 2024-01-31T05:16:16.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:15 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:15.930+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.769908+0000 front 2024-01-31T05:15:21.770050+0000 (oldest deadline 2024-01-31T05:15:46.469991+0000) 2024-01-31T05:16:16.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:15 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:15.930+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:28.771067+0000 front 2024-01-31T05:15:28.771106+0000 (oldest deadline 2024-01-31T05:15:54.071204+0000) 2024-01-31T05:16:16.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:15 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:15.930+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:37.372822+0000 front 2024-01-31T05:15:37.372978+0000 (oldest deadline 2024-01-31T05:16:02.072855+0000) 2024-01-31T05:16:16.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:15 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:15.930+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:48.176006+0000 front 2024-01-31T05:15:48.176116+0000 (oldest deadline 2024-01-31T05:16:09.875929+0000) 2024-01-31T05:16:16.632 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:16 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:16.139+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:16:16.632 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:16 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:16.139+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.701398+0000 front 2024-01-31T05:15:24.701437+0000 (oldest deadline 2024-01-31T05:15:49.401612+0000) 2024-01-31T05:16:16.632 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:16 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:16.139+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:29.402167+0000 front 2024-01-31T05:15:29.402154+0000 (oldest deadline 2024-01-31T05:15:55.302060+0000) 2024-01-31T05:16:16.633 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:16 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:16.139+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:38.703667+0000 front 2024-01-31T05:15:38.703620+0000 (oldest deadline 2024-01-31T05:16:04.003649+0000) 2024-01-31T05:16:16.633 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:16 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:16.139+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:48.104600+0000 front 2024-01-31T05:15:48.104539+0000 (oldest deadline 2024-01-31T05:16:11.604713+0000) 2024-01-31T05:16:16.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:16 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:16.564+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:16:16.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:16 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:16.564+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:23.429225+0000 front 2024-01-31T05:15:23.429193+0000 (oldest deadline 2024-01-31T05:15:45.729329+0000) 2024-01-31T05:16:16.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:16 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:16.564+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:30.931585+0000 front 2024-01-31T05:15:30.931516+0000 (oldest deadline 2024-01-31T05:15:55.631632+0000) 2024-01-31T05:16:16.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:16 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:16.564+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:39.033132+0000 front 2024-01-31T05:15:39.033161+0000 (oldest deadline 2024-01-31T05:16:04.933241+0000) 2024-01-31T05:16:16.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:16 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:16.564+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.734748+0000 front 2024-01-31T05:15:47.734758+0000 (oldest deadline 2024-01-31T05:16:11.234668+0000) 2024-01-31T05:16:16.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:16 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:16.518+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:16:16.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:16 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:16.518+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:16:16.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:16 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:16.518+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:16:16.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:16 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:16.518+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:40.103826+0000 front 2024-01-31T05:15:40.103813+0000 (oldest deadline 2024-01-31T05:16:03.003809+0000) 2024-01-31T05:16:16.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:16 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:16.518+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.605332+0000 front 2024-01-31T05:15:47.605496+0000 (oldest deadline 2024-01-31T05:16:11.105241+0000) 2024-01-31T05:16:17.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:16 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:16.939+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.769908+0000 front 2024-01-31T05:15:21.770050+0000 (oldest deadline 2024-01-31T05:15:46.469991+0000) 2024-01-31T05:16:17.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:16 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:16.939+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:28.771067+0000 front 2024-01-31T05:15:28.771106+0000 (oldest deadline 2024-01-31T05:15:54.071204+0000) 2024-01-31T05:16:17.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:16 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:16.939+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:37.372822+0000 front 2024-01-31T05:15:37.372978+0000 (oldest deadline 2024-01-31T05:16:02.072855+0000) 2024-01-31T05:16:17.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:16 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:16.939+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:48.176006+0000 front 2024-01-31T05:15:48.176116+0000 (oldest deadline 2024-01-31T05:16:09.875929+0000) 2024-01-31T05:16:17.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:17 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:17.100+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:16:17.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:17 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:17.100+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.701398+0000 front 2024-01-31T05:15:24.701437+0000 (oldest deadline 2024-01-31T05:15:49.401612+0000) 2024-01-31T05:16:17.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:17 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:17.100+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:29.402167+0000 front 2024-01-31T05:15:29.402154+0000 (oldest deadline 2024-01-31T05:15:55.302060+0000) 2024-01-31T05:16:17.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:17 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:17.100+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:38.703667+0000 front 2024-01-31T05:15:38.703620+0000 (oldest deadline 2024-01-31T05:16:04.003649+0000) 2024-01-31T05:16:17.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:17 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:17.100+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:48.104600+0000 front 2024-01-31T05:15:48.104539+0000 (oldest deadline 2024-01-31T05:16:11.604713+0000) 2024-01-31T05:16:17.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:17 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:17.513+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:16:17.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:17 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:17.513+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:16:17.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:17 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:17.513+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:16:17.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:17 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:17.513+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:40.103826+0000 front 2024-01-31T05:15:40.103813+0000 (oldest deadline 2024-01-31T05:16:03.003809+0000) 2024-01-31T05:16:17.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:17 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:17.513+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.605332+0000 front 2024-01-31T05:15:47.605496+0000 (oldest deadline 2024-01-31T05:16:11.105241+0000) 2024-01-31T05:16:18.068 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:17 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:17.579+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:16:18.068 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:17 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:17.579+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:23.429225+0000 front 2024-01-31T05:15:23.429193+0000 (oldest deadline 2024-01-31T05:15:45.729329+0000) 2024-01-31T05:16:18.068 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:17 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:17.579+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:30.931585+0000 front 2024-01-31T05:15:30.931516+0000 (oldest deadline 2024-01-31T05:15:55.631632+0000) 2024-01-31T05:16:18.068 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:17 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:17.579+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:39.033132+0000 front 2024-01-31T05:15:39.033161+0000 (oldest deadline 2024-01-31T05:16:04.933241+0000) 2024-01-31T05:16:18.068 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:17 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:17.579+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.734748+0000 front 2024-01-31T05:15:47.734758+0000 (oldest deadline 2024-01-31T05:16:11.234668+0000) 2024-01-31T05:16:18.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:17 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:17.938+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.769908+0000 front 2024-01-31T05:15:21.770050+0000 (oldest deadline 2024-01-31T05:15:46.469991+0000) 2024-01-31T05:16:18.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:17 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:17.938+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:28.771067+0000 front 2024-01-31T05:15:28.771106+0000 (oldest deadline 2024-01-31T05:15:54.071204+0000) 2024-01-31T05:16:18.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:17 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:17.938+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:37.372822+0000 front 2024-01-31T05:15:37.372978+0000 (oldest deadline 2024-01-31T05:16:02.072855+0000) 2024-01-31T05:16:18.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:17 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:17.938+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:48.176006+0000 front 2024-01-31T05:15:48.176116+0000 (oldest deadline 2024-01-31T05:16:09.875929+0000) 2024-01-31T05:16:18.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:18 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:18.074+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:16:18.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:18 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:18.074+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.701398+0000 front 2024-01-31T05:15:24.701437+0000 (oldest deadline 2024-01-31T05:15:49.401612+0000) 2024-01-31T05:16:18.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:18 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:18.074+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:29.402167+0000 front 2024-01-31T05:15:29.402154+0000 (oldest deadline 2024-01-31T05:15:55.302060+0000) 2024-01-31T05:16:18.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:18 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:18.074+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:38.703667+0000 front 2024-01-31T05:15:38.703620+0000 (oldest deadline 2024-01-31T05:16:04.003649+0000) 2024-01-31T05:16:18.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:18 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:18.074+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:48.104600+0000 front 2024-01-31T05:15:48.104539+0000 (oldest deadline 2024-01-31T05:16:11.604713+0000) 2024-01-31T05:16:18.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:18 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:18.550+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:16:18.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:18 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:18.550+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:16:18.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:18 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:18.550+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:16:18.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:18 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:18.550+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:40.103826+0000 front 2024-01-31T05:15:40.103813+0000 (oldest deadline 2024-01-31T05:16:03.003809+0000) 2024-01-31T05:16:18.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:18 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:18.550+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.605332+0000 front 2024-01-31T05:15:47.605496+0000 (oldest deadline 2024-01-31T05:16:11.105241+0000) 2024-01-31T05:16:19.068 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:18 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:18.626+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:16:19.068 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:18 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:18.626+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:23.429225+0000 front 2024-01-31T05:15:23.429193+0000 (oldest deadline 2024-01-31T05:15:45.729329+0000) 2024-01-31T05:16:19.069 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:18 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:18.626+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:30.931585+0000 front 2024-01-31T05:15:30.931516+0000 (oldest deadline 2024-01-31T05:15:55.631632+0000) 2024-01-31T05:16:19.069 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:18 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:18.626+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:39.033132+0000 front 2024-01-31T05:15:39.033161+0000 (oldest deadline 2024-01-31T05:16:04.933241+0000) 2024-01-31T05:16:19.069 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:18 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:18.626+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.734748+0000 front 2024-01-31T05:15:47.734758+0000 (oldest deadline 2024-01-31T05:16:11.234668+0000) 2024-01-31T05:16:19.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:18 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:18.954+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.769908+0000 front 2024-01-31T05:15:21.770050+0000 (oldest deadline 2024-01-31T05:15:46.469991+0000) 2024-01-31T05:16:19.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:18 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:18.954+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:28.771067+0000 front 2024-01-31T05:15:28.771106+0000 (oldest deadline 2024-01-31T05:15:54.071204+0000) 2024-01-31T05:16:19.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:18 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:18.954+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:37.372822+0000 front 2024-01-31T05:15:37.372978+0000 (oldest deadline 2024-01-31T05:16:02.072855+0000) 2024-01-31T05:16:19.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:18 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:18.954+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:48.176006+0000 front 2024-01-31T05:15:48.176116+0000 (oldest deadline 2024-01-31T05:16:09.875929+0000) 2024-01-31T05:16:19.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:18 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:18.954+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:53.377057+0000 front 2024-01-31T05:15:53.377092+0000 (oldest deadline 2024-01-31T05:16:18.077161+0000) 2024-01-31T05:16:19.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:19 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:19.088+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:16:19.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:19 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:19.088+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.701398+0000 front 2024-01-31T05:15:24.701437+0000 (oldest deadline 2024-01-31T05:15:49.401612+0000) 2024-01-31T05:16:19.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:19 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:19.088+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:29.402167+0000 front 2024-01-31T05:15:29.402154+0000 (oldest deadline 2024-01-31T05:15:55.302060+0000) 2024-01-31T05:16:19.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:19 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:19.088+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:38.703667+0000 front 2024-01-31T05:15:38.703620+0000 (oldest deadline 2024-01-31T05:16:04.003649+0000) 2024-01-31T05:16:19.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:19 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:19.088+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:48.104600+0000 front 2024-01-31T05:15:48.104539+0000 (oldest deadline 2024-01-31T05:16:11.604713+0000) 2024-01-31T05:16:19.908 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:19 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:19.590+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:16:19.908 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:19 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:19.590+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:16:19.908 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:19 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:19.590+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:16:19.909 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:19 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:19.590+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:40.103826+0000 front 2024-01-31T05:15:40.103813+0000 (oldest deadline 2024-01-31T05:16:03.003809+0000) 2024-01-31T05:16:19.909 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:19 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:19.590+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.605332+0000 front 2024-01-31T05:15:47.605496+0000 (oldest deadline 2024-01-31T05:16:11.105241+0000) 2024-01-31T05:16:19.909 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:19 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:19.590+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:56.406305+0000 front 2024-01-31T05:15:56.406222+0000 (oldest deadline 2024-01-31T05:16:19.306316+0000) 2024-01-31T05:16:20.068 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:19 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:19.599+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:16:20.068 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:19 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:19.599+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:23.429225+0000 front 2024-01-31T05:15:23.429193+0000 (oldest deadline 2024-01-31T05:15:45.729329+0000) 2024-01-31T05:16:20.069 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:19 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:19.599+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:30.931585+0000 front 2024-01-31T05:15:30.931516+0000 (oldest deadline 2024-01-31T05:15:55.631632+0000) 2024-01-31T05:16:20.069 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:19 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:19.599+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:39.033132+0000 front 2024-01-31T05:15:39.033161+0000 (oldest deadline 2024-01-31T05:16:04.933241+0000) 2024-01-31T05:16:20.069 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:19 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:19.599+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.734748+0000 front 2024-01-31T05:15:47.734758+0000 (oldest deadline 2024-01-31T05:16:11.234668+0000) 2024-01-31T05:16:20.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:19 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:19.908+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.769908+0000 front 2024-01-31T05:15:21.770050+0000 (oldest deadline 2024-01-31T05:15:46.469991+0000) 2024-01-31T05:16:20.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:19 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:19.908+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:28.771067+0000 front 2024-01-31T05:15:28.771106+0000 (oldest deadline 2024-01-31T05:15:54.071204+0000) 2024-01-31T05:16:20.321 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:19 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:19.908+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:37.372822+0000 front 2024-01-31T05:15:37.372978+0000 (oldest deadline 2024-01-31T05:16:02.072855+0000) 2024-01-31T05:16:20.322 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:19 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:19.909+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:48.176006+0000 front 2024-01-31T05:15:48.176116+0000 (oldest deadline 2024-01-31T05:16:09.875929+0000) 2024-01-31T05:16:20.322 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:19 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8[55699]: 2024-01-31T05:16:19.909+0000 7f28a1373700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:53.377057+0000 front 2024-01-31T05:15:53.377092+0000 (oldest deadline 2024-01-31T05:16:18.077161+0000) 2024-01-31T05:16:20.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:20 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:20.081+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:16:20.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:20 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:20.081+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.701398+0000 front 2024-01-31T05:15:24.701437+0000 (oldest deadline 2024-01-31T05:15:49.401612+0000) 2024-01-31T05:16:20.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:20 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:20.081+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:29.402167+0000 front 2024-01-31T05:15:29.402154+0000 (oldest deadline 2024-01-31T05:15:55.302060+0000) 2024-01-31T05:16:20.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:20 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:20.081+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:38.703667+0000 front 2024-01-31T05:15:38.703620+0000 (oldest deadline 2024-01-31T05:16:04.003649+0000) 2024-01-31T05:16:20.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:20 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:20.081+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:48.104600+0000 front 2024-01-31T05:15:48.104539+0000 (oldest deadline 2024-01-31T05:16:11.604713+0000) 2024-01-31T05:16:20.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:20 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:20.081+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:53.306031+0000 front 2024-01-31T05:15:53.305889+0000 (oldest deadline 2024-01-31T05:16:19.205937+0000) 2024-01-31T05:16:20.821 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:20 smithi181 podman[72458]: 2024-01-31 05:16:20.543471571 +0000 UTC m=+5.482856524 container died a5b79c83c1e10ec0b9ac74a762d0f73884c0a305d28f729a8267976915affb87 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.31.3, org.label-schema.build-date=20240123, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240125.044502-661946e, ceph=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-01-31T05:16:20.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:20 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:20.586+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:16:20.822 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:20 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:20.586+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:16:20.822 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:20 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:20.586+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:16:20.822 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:20 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:20.586+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:40.103826+0000 front 2024-01-31T05:15:40.103813+0000 (oldest deadline 2024-01-31T05:16:03.003809+0000) 2024-01-31T05:16:20.822 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:20 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:20.586+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.605332+0000 front 2024-01-31T05:15:47.605496+0000 (oldest deadline 2024-01-31T05:16:11.105241+0000) 2024-01-31T05:16:20.822 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:20 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:20.586+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:56.406305+0000 front 2024-01-31T05:15:56.406222+0000 (oldest deadline 2024-01-31T05:16:19.306316+0000) 2024-01-31T05:16:21.068 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:20 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:20.587+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:16:21.068 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:20 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:20.587+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:23.429225+0000 front 2024-01-31T05:15:23.429193+0000 (oldest deadline 2024-01-31T05:15:45.729329+0000) 2024-01-31T05:16:21.068 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:20 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:20.587+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:30.931585+0000 front 2024-01-31T05:15:30.931516+0000 (oldest deadline 2024-01-31T05:15:55.631632+0000) 2024-01-31T05:16:21.068 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:20 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:20.587+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:39.033132+0000 front 2024-01-31T05:15:39.033161+0000 (oldest deadline 2024-01-31T05:16:04.933241+0000) 2024-01-31T05:16:21.068 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:20 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:20.587+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.734748+0000 front 2024-01-31T05:15:47.734758+0000 (oldest deadline 2024-01-31T05:16:11.234668+0000) 2024-01-31T05:16:21.147 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:20 smithi181 podman[72458]: 2024-01-31 05:16:20.897912237 +0000 UTC m=+5.837297174 container cleanup a5b79c83c1e10ec0b9ac74a762d0f73884c0a305d28f729a8267976915affb87 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240125.044502-661946e, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, io.buildah.version=1.31.3, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240123) 2024-01-31T05:16:21.148 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:20 smithi181 bash[72458]: ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8 2024-01-31T05:16:21.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:21 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:21.130+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:16:21.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:21 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:21.130+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.701398+0000 front 2024-01-31T05:15:24.701437+0000 (oldest deadline 2024-01-31T05:15:49.401612+0000) 2024-01-31T05:16:21.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:21 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:21.130+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:29.402167+0000 front 2024-01-31T05:15:29.402154+0000 (oldest deadline 2024-01-31T05:15:55.302060+0000) 2024-01-31T05:16:21.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:21 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:21.130+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:38.703667+0000 front 2024-01-31T05:15:38.703620+0000 (oldest deadline 2024-01-31T05:16:04.003649+0000) 2024-01-31T05:16:21.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:21 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:21.130+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:48.104600+0000 front 2024-01-31T05:15:48.104539+0000 (oldest deadline 2024-01-31T05:16:11.604713+0000) 2024-01-31T05:16:21.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:21 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:21.130+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:53.306031+0000 front 2024-01-31T05:15:53.305889+0000 (oldest deadline 2024-01-31T05:16:19.205937+0000) 2024-01-31T05:16:21.448 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:21 smithi181 podman[72476]: 2024-01-31 05:16:21.148888525 +0000 UTC m=+0.607594481 container remove a5b79c83c1e10ec0b9ac74a762d0f73884c0a305d28f729a8267976915affb87 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8, ceph=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240123, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-01-31T05:16:21.709 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:21 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:21.548+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:16:21.709 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:21 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:21.548+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:16:21.709 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:21 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:21.548+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:16:21.709 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:21 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:21.548+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:40.103826+0000 front 2024-01-31T05:15:40.103813+0000 (oldest deadline 2024-01-31T05:16:03.003809+0000) 2024-01-31T05:16:21.709 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:21 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:21.548+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.605332+0000 front 2024-01-31T05:15:47.605496+0000 (oldest deadline 2024-01-31T05:16:11.105241+0000) 2024-01-31T05:16:21.710 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:21 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:21.548+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:56.406305+0000 front 2024-01-31T05:15:56.406222+0000 (oldest deadline 2024-01-31T05:16:19.306316+0000) 2024-01-31T05:16:21.710 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:21 smithi181 podman[72568]: 2024-01-31 05:16:21.449741956 +0000 UTC m=+0.105182920 container create 6f8689ab3c1dfdb1c9e6564412fab2bea0b011778cc8cb9cc9e5cad6659e3063 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240125.044502-661946e, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.31.3, org.label-schema.build-date=20240123, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-01-31T05:16:21.710 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:21 smithi181 podman[72568]: 2024-01-31 05:16:21.361915275 +0000 UTC m=+0.017356247 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-31T05:16:21.710 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:21 smithi181 podman[72568]: 2024-01-31 05:16:21.635454516 +0000 UTC m=+0.290895482 container init 6f8689ab3c1dfdb1c9e6564412fab2bea0b011778cc8cb9cc9e5cad6659e3063 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240123, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.31.3, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-01-31T05:16:21.710 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:21 smithi181 podman[72568]: 2024-01-31 05:16:21.638485718 +0000 UTC m=+0.293926682 container start 6f8689ab3c1dfdb1c9e6564412fab2bea0b011778cc8cb9cc9e5cad6659e3063 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240123, RELEASE=wip-vshankar-testing-20240125.044502-661946e, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.schema-version=1.0, io.buildah.version=1.31.3, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-01-31T05:16:21.710 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:21 smithi181 podman[72568]: 2024-01-31 05:16:21.710201919 +0000 UTC m=+0.365642902 container attach 6f8689ab3c1dfdb1c9e6564412fab2bea0b011778cc8cb9cc9e5cad6659e3063 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8-deactivate, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240123, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux ) 2024-01-31T05:16:22.068 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:21 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:21.613+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:16:22.068 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:21 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:21.613+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:23.429225+0000 front 2024-01-31T05:15:23.429193+0000 (oldest deadline 2024-01-31T05:15:45.729329+0000) 2024-01-31T05:16:22.068 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:21 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:21.613+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:30.931585+0000 front 2024-01-31T05:15:30.931516+0000 (oldest deadline 2024-01-31T05:15:55.631632+0000) 2024-01-31T05:16:22.068 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:21 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:21.613+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:39.033132+0000 front 2024-01-31T05:15:39.033161+0000 (oldest deadline 2024-01-31T05:16:04.933241+0000) 2024-01-31T05:16:22.069 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:21 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:21.613+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.734748+0000 front 2024-01-31T05:15:47.734758+0000 (oldest deadline 2024-01-31T05:16:11.234668+0000) 2024-01-31T05:16:22.069 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:21 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:21.613+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:55.935805+0000 front 2024-01-31T05:15:55.935887+0000 (oldest deadline 2024-01-31T05:16:20.635601+0000) 2024-01-31T05:16:22.071 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:21 smithi181 podman[72568]: 2024-01-31 05:16:21.917380743 +0000 UTC m=+0.572821734 container died 6f8689ab3c1dfdb1c9e6564412fab2bea0b011778cc8cb9cc9e5cad6659e3063 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240123, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.schema-version=1.0, io.buildah.version=1.31.3, RELEASE=wip-vshankar-testing-20240125.044502-661946e, maintainer=Guillaume Abrioux ) 2024-01-31T05:16:22.445 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:22 smithi181 podman[72593]: 2024-01-31 05:16:22.43034199 +0000 UTC m=+0.503358900 container remove 6f8689ab3c1dfdb1c9e6564412fab2bea0b011778cc8cb9cc9e5cad6659e3063 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-8-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.31.3, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.build-date=20240123, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-01-31T05:16:22.445 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:22 smithi181 systemd[1]: ceph-9288ff44-bff5-11ee-95b3-87774f69a715@osd.8.service: Deactivated successfully. 2024-01-31T05:16:22.445 INFO:journalctl@ceph.osd.8.smithi181.stdout:Jan 31 05:16:22 smithi181 systemd[1]: Stopped Ceph osd.8 for 9288ff44-bff5-11ee-95b3-87774f69a715. 2024-01-31T05:16:22.448 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@osd.8.service' 2024-01-31T05:16:22.489 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-31T05:16:22.489 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-01-31T05:16:22.489 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-01-31T05:16:22.489 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-9288ff44-bff5-11ee-95b3-87774f69a715@osd.9 2024-01-31T05:16:22.632 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:22 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:22.163+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:16:22.632 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:22 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:22.163+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.701398+0000 front 2024-01-31T05:15:24.701437+0000 (oldest deadline 2024-01-31T05:15:49.401612+0000) 2024-01-31T05:16:22.632 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:22 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:22.163+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:29.402167+0000 front 2024-01-31T05:15:29.402154+0000 (oldest deadline 2024-01-31T05:15:55.302060+0000) 2024-01-31T05:16:22.632 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:22 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:22.163+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:38.703667+0000 front 2024-01-31T05:15:38.703620+0000 (oldest deadline 2024-01-31T05:16:04.003649+0000) 2024-01-31T05:16:22.632 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:22 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:22.163+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:48.104600+0000 front 2024-01-31T05:15:48.104539+0000 (oldest deadline 2024-01-31T05:16:11.604713+0000) 2024-01-31T05:16:22.633 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:22 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:22.163+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:53.306031+0000 front 2024-01-31T05:15:53.305889+0000 (oldest deadline 2024-01-31T05:16:19.205937+0000) 2024-01-31T05:16:22.696 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:22 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:22.509+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:16:22.696 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:22 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:22.509+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:16:22.696 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:22 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:22.509+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:16:22.697 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:22 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:22.509+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:40.103826+0000 front 2024-01-31T05:15:40.103813+0000 (oldest deadline 2024-01-31T05:16:03.003809+0000) 2024-01-31T05:16:22.697 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:22 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:22.509+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.605332+0000 front 2024-01-31T05:15:47.605496+0000 (oldest deadline 2024-01-31T05:16:11.105241+0000) 2024-01-31T05:16:22.697 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:22 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:22.509+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:56.406305+0000 front 2024-01-31T05:15:56.406222+0000 (oldest deadline 2024-01-31T05:16:19.306316+0000) 2024-01-31T05:16:22.776 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:22 smithi099 systemd[1]: Stopping Ceph osd.9 for 9288ff44-bff5-11ee-95b3-87774f69a715... 2024-01-31T05:16:22.776 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:22 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:22.641+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:16:22.776 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:22 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:22.641+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:23.429225+0000 front 2024-01-31T05:15:23.429193+0000 (oldest deadline 2024-01-31T05:15:45.729329+0000) 2024-01-31T05:16:22.776 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:22 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:22.641+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:30.931585+0000 front 2024-01-31T05:15:30.931516+0000 (oldest deadline 2024-01-31T05:15:55.631632+0000) 2024-01-31T05:16:22.776 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:22 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:22.641+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:39.033132+0000 front 2024-01-31T05:15:39.033161+0000 (oldest deadline 2024-01-31T05:16:04.933241+0000) 2024-01-31T05:16:22.776 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:22 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:22.641+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.734748+0000 front 2024-01-31T05:15:47.734758+0000 (oldest deadline 2024-01-31T05:16:11.234668+0000) 2024-01-31T05:16:22.776 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:22 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:22.641+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:55.935805+0000 front 2024-01-31T05:15:55.935887+0000 (oldest deadline 2024-01-31T05:16:20.635601+0000) 2024-01-31T05:16:22.776 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:22 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:22.775+0000 7f23a4ff1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-31T05:16:22.776 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:22 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:22.775+0000 7f23a4ff1700 -1 osd.9 91 *** Got signal Terminated *** 2024-01-31T05:16:22.777 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:22 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:22.775+0000 7f23a4ff1700 -1 osd.9 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-31T05:16:23.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:23 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:23.117+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:16:23.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:23 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:23.117+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.701398+0000 front 2024-01-31T05:15:24.701437+0000 (oldest deadline 2024-01-31T05:15:49.401612+0000) 2024-01-31T05:16:23.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:23 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:23.117+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:29.402167+0000 front 2024-01-31T05:15:29.402154+0000 (oldest deadline 2024-01-31T05:15:55.302060+0000) 2024-01-31T05:16:23.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:23 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:23.117+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:38.703667+0000 front 2024-01-31T05:15:38.703620+0000 (oldest deadline 2024-01-31T05:16:04.003649+0000) 2024-01-31T05:16:23.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:23 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:23.117+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:48.104600+0000 front 2024-01-31T05:15:48.104539+0000 (oldest deadline 2024-01-31T05:16:11.604713+0000) 2024-01-31T05:16:23.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:23 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:23.117+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:53.306031+0000 front 2024-01-31T05:15:53.305889+0000 (oldest deadline 2024-01-31T05:16:19.205937+0000) 2024-01-31T05:16:23.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:23 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:23.536+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:16:23.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:23 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:23.536+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:16:23.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:23 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:23.536+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:16:23.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:23 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:23.536+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:40.103826+0000 front 2024-01-31T05:15:40.103813+0000 (oldest deadline 2024-01-31T05:16:03.003809+0000) 2024-01-31T05:16:23.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:23 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:23.536+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.605332+0000 front 2024-01-31T05:15:47.605496+0000 (oldest deadline 2024-01-31T05:16:11.105241+0000) 2024-01-31T05:16:23.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:23 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:23.536+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:56.406305+0000 front 2024-01-31T05:15:56.406222+0000 (oldest deadline 2024-01-31T05:16:19.306316+0000) 2024-01-31T05:16:24.068 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:23 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:23.597+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:16:24.068 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:23 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:23.597+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:23.429225+0000 front 2024-01-31T05:15:23.429193+0000 (oldest deadline 2024-01-31T05:15:45.729329+0000) 2024-01-31T05:16:24.068 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:23 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:23.597+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:30.931585+0000 front 2024-01-31T05:15:30.931516+0000 (oldest deadline 2024-01-31T05:15:55.631632+0000) 2024-01-31T05:16:24.068 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:23 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:23.597+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:39.033132+0000 front 2024-01-31T05:15:39.033161+0000 (oldest deadline 2024-01-31T05:16:04.933241+0000) 2024-01-31T05:16:24.069 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:23 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:23.597+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.734748+0000 front 2024-01-31T05:15:47.734758+0000 (oldest deadline 2024-01-31T05:16:11.234668+0000) 2024-01-31T05:16:24.069 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:23 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:23.597+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:55.935805+0000 front 2024-01-31T05:15:55.935887+0000 (oldest deadline 2024-01-31T05:16:20.635601+0000) 2024-01-31T05:16:24.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:24 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:24.081+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:16:24.383 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:24 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:24.081+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.701398+0000 front 2024-01-31T05:15:24.701437+0000 (oldest deadline 2024-01-31T05:15:49.401612+0000) 2024-01-31T05:16:24.383 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:24 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:24.081+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:29.402167+0000 front 2024-01-31T05:15:29.402154+0000 (oldest deadline 2024-01-31T05:15:55.302060+0000) 2024-01-31T05:16:24.383 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:24 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:24.081+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:38.703667+0000 front 2024-01-31T05:15:38.703620+0000 (oldest deadline 2024-01-31T05:16:04.003649+0000) 2024-01-31T05:16:24.383 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:24 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:24.081+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:48.104600+0000 front 2024-01-31T05:15:48.104539+0000 (oldest deadline 2024-01-31T05:16:11.604713+0000) 2024-01-31T05:16:24.383 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:24 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:24.081+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:53.306031+0000 front 2024-01-31T05:15:53.305889+0000 (oldest deadline 2024-01-31T05:16:19.205937+0000) 2024-01-31T05:16:24.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:24 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:24.566+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:16:24.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:24 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:24.566+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:23.429225+0000 front 2024-01-31T05:15:23.429193+0000 (oldest deadline 2024-01-31T05:15:45.729329+0000) 2024-01-31T05:16:24.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:24 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:24.566+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:30.931585+0000 front 2024-01-31T05:15:30.931516+0000 (oldest deadline 2024-01-31T05:15:55.631632+0000) 2024-01-31T05:16:24.819 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:24 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:24.566+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:39.033132+0000 front 2024-01-31T05:15:39.033161+0000 (oldest deadline 2024-01-31T05:16:04.933241+0000) 2024-01-31T05:16:24.819 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:24 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:24.566+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.734748+0000 front 2024-01-31T05:15:47.734758+0000 (oldest deadline 2024-01-31T05:16:11.234668+0000) 2024-01-31T05:16:24.819 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:24 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:24.566+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:55.935805+0000 front 2024-01-31T05:15:55.935887+0000 (oldest deadline 2024-01-31T05:16:20.635601+0000) 2024-01-31T05:16:24.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:24 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:24.525+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:16:24.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:24 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:24.525+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:16:24.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:24 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:24.525+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:16:24.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:24 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:24.525+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:40.103826+0000 front 2024-01-31T05:15:40.103813+0000 (oldest deadline 2024-01-31T05:16:03.003809+0000) 2024-01-31T05:16:24.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:24 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:24.525+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.605332+0000 front 2024-01-31T05:15:47.605496+0000 (oldest deadline 2024-01-31T05:16:11.105241+0000) 2024-01-31T05:16:24.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:24 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:24.525+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:56.406305+0000 front 2024-01-31T05:15:56.406222+0000 (oldest deadline 2024-01-31T05:16:19.306316+0000) 2024-01-31T05:16:25.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:25 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:25.037+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:16:25.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:25 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:25.037+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.701398+0000 front 2024-01-31T05:15:24.701437+0000 (oldest deadline 2024-01-31T05:15:49.401612+0000) 2024-01-31T05:16:25.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:25 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:25.037+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:29.402167+0000 front 2024-01-31T05:15:29.402154+0000 (oldest deadline 2024-01-31T05:15:55.302060+0000) 2024-01-31T05:16:25.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:25 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:25.037+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:38.703667+0000 front 2024-01-31T05:15:38.703620+0000 (oldest deadline 2024-01-31T05:16:04.003649+0000) 2024-01-31T05:16:25.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:25 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:25.037+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:48.104600+0000 front 2024-01-31T05:15:48.104539+0000 (oldest deadline 2024-01-31T05:16:11.604713+0000) 2024-01-31T05:16:25.383 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:25 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:25.037+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:53.306031+0000 front 2024-01-31T05:15:53.305889+0000 (oldest deadline 2024-01-31T05:16:19.205937+0000) 2024-01-31T05:16:25.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:25 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:25.567+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:16:25.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:25 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:25.567+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:16:25.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:25 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:25.567+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:16:25.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:25 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:25.567+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:40.103826+0000 front 2024-01-31T05:15:40.103813+0000 (oldest deadline 2024-01-31T05:16:03.003809+0000) 2024-01-31T05:16:25.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:25 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:25.567+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.605332+0000 front 2024-01-31T05:15:47.605496+0000 (oldest deadline 2024-01-31T05:16:11.105241+0000) 2024-01-31T05:16:25.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:25 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:25.567+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:56.406305+0000 front 2024-01-31T05:15:56.406222+0000 (oldest deadline 2024-01-31T05:16:19.306316+0000) 2024-01-31T05:16:26.068 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:25 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:25.586+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:16:26.068 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:25 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:25.586+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:23.429225+0000 front 2024-01-31T05:15:23.429193+0000 (oldest deadline 2024-01-31T05:15:45.729329+0000) 2024-01-31T05:16:26.068 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:25 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:25.586+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:30.931585+0000 front 2024-01-31T05:15:30.931516+0000 (oldest deadline 2024-01-31T05:15:55.631632+0000) 2024-01-31T05:16:26.068 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:25 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:25.586+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:39.033132+0000 front 2024-01-31T05:15:39.033161+0000 (oldest deadline 2024-01-31T05:16:04.933241+0000) 2024-01-31T05:16:26.068 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:25 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:25.586+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.734748+0000 front 2024-01-31T05:15:47.734758+0000 (oldest deadline 2024-01-31T05:16:11.234668+0000) 2024-01-31T05:16:26.069 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:25 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:25.586+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:55.935805+0000 front 2024-01-31T05:15:55.935887+0000 (oldest deadline 2024-01-31T05:16:20.635601+0000) 2024-01-31T05:16:26.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:26 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:26.030+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:16:26.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:26 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:26.030+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.701398+0000 front 2024-01-31T05:15:24.701437+0000 (oldest deadline 2024-01-31T05:15:49.401612+0000) 2024-01-31T05:16:26.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:26 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:26.030+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:29.402167+0000 front 2024-01-31T05:15:29.402154+0000 (oldest deadline 2024-01-31T05:15:55.302060+0000) 2024-01-31T05:16:26.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:26 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:26.030+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:38.703667+0000 front 2024-01-31T05:15:38.703620+0000 (oldest deadline 2024-01-31T05:16:04.003649+0000) 2024-01-31T05:16:26.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:26 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:26.030+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:48.104600+0000 front 2024-01-31T05:15:48.104539+0000 (oldest deadline 2024-01-31T05:16:11.604713+0000) 2024-01-31T05:16:26.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:26 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:26.030+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:53.306031+0000 front 2024-01-31T05:15:53.305889+0000 (oldest deadline 2024-01-31T05:16:19.205937+0000) 2024-01-31T05:16:26.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:26 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:26.535+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:16:26.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:26 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:26.535+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:16:26.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:26 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:26.535+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:16:26.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:26 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:26.535+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:40.103826+0000 front 2024-01-31T05:15:40.103813+0000 (oldest deadline 2024-01-31T05:16:03.003809+0000) 2024-01-31T05:16:26.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:26 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:26.535+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.605332+0000 front 2024-01-31T05:15:47.605496+0000 (oldest deadline 2024-01-31T05:16:11.105241+0000) 2024-01-31T05:16:26.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:26 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:26.535+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:56.406305+0000 front 2024-01-31T05:15:56.406222+0000 (oldest deadline 2024-01-31T05:16:19.306316+0000) 2024-01-31T05:16:27.068 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:26 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:26.587+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:16:27.068 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:26 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:26.587+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:23.429225+0000 front 2024-01-31T05:15:23.429193+0000 (oldest deadline 2024-01-31T05:15:45.729329+0000) 2024-01-31T05:16:27.068 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:26 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:26.587+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:30.931585+0000 front 2024-01-31T05:15:30.931516+0000 (oldest deadline 2024-01-31T05:15:55.631632+0000) 2024-01-31T05:16:27.068 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:26 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:26.587+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:39.033132+0000 front 2024-01-31T05:15:39.033161+0000 (oldest deadline 2024-01-31T05:16:04.933241+0000) 2024-01-31T05:16:27.069 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:26 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:26.587+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.734748+0000 front 2024-01-31T05:15:47.734758+0000 (oldest deadline 2024-01-31T05:16:11.234668+0000) 2024-01-31T05:16:27.069 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:26 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:26.587+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:55.935805+0000 front 2024-01-31T05:15:55.935887+0000 (oldest deadline 2024-01-31T05:16:20.635601+0000) 2024-01-31T05:16:27.069 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:26 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:26.587+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6822 osd.6 since back 2024-01-31T05:16:00.635941+0000 front 2024-01-31T05:16:00.635973+0000 (oldest deadline 2024-01-31T05:16:26.535923+0000) 2024-01-31T05:16:27.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:27 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:27.052+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:16:27.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:27 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:27.052+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.701398+0000 front 2024-01-31T05:15:24.701437+0000 (oldest deadline 2024-01-31T05:15:49.401612+0000) 2024-01-31T05:16:27.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:27 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:27.052+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:29.402167+0000 front 2024-01-31T05:15:29.402154+0000 (oldest deadline 2024-01-31T05:15:55.302060+0000) 2024-01-31T05:16:27.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:27 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:27.052+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:38.703667+0000 front 2024-01-31T05:15:38.703620+0000 (oldest deadline 2024-01-31T05:16:04.003649+0000) 2024-01-31T05:16:27.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:27 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:27.052+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:48.104600+0000 front 2024-01-31T05:15:48.104539+0000 (oldest deadline 2024-01-31T05:16:11.604713+0000) 2024-01-31T05:16:27.383 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:27 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:27.052+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:53.306031+0000 front 2024-01-31T05:15:53.305889+0000 (oldest deadline 2024-01-31T05:16:19.205937+0000) 2024-01-31T05:16:27.383 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:27 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:27.052+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6822 osd.6 since back 2024-01-31T05:16:01.507199+0000 front 2024-01-31T05:16:01.507157+0000 (oldest deadline 2024-01-31T05:16:26.207131+0000) 2024-01-31T05:16:27.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:27 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:27.542+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:16:27.822 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:27 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:27.542+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:16:27.822 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:27 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:27.542+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:16:27.822 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:27 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:27.542+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:40.103826+0000 front 2024-01-31T05:15:40.103813+0000 (oldest deadline 2024-01-31T05:16:03.003809+0000) 2024-01-31T05:16:27.822 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:27 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:27.542+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.605332+0000 front 2024-01-31T05:15:47.605496+0000 (oldest deadline 2024-01-31T05:16:11.105241+0000) 2024-01-31T05:16:27.822 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:27 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:27.542+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:56.406305+0000 front 2024-01-31T05:15:56.406222+0000 (oldest deadline 2024-01-31T05:16:19.306316+0000) 2024-01-31T05:16:28.068 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:27 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:27.591+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.727389+0000 front 2024-01-31T05:15:14.727414+0000 (oldest deadline 2024-01-31T05:15:37.027551+0000) 2024-01-31T05:16:28.068 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:27 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:27.591+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:23.429225+0000 front 2024-01-31T05:15:23.429193+0000 (oldest deadline 2024-01-31T05:15:45.729329+0000) 2024-01-31T05:16:28.068 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:27 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:27.591+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:30.931585+0000 front 2024-01-31T05:15:30.931516+0000 (oldest deadline 2024-01-31T05:15:55.631632+0000) 2024-01-31T05:16:28.069 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:27 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:27.591+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:39.033132+0000 front 2024-01-31T05:15:39.033161+0000 (oldest deadline 2024-01-31T05:16:04.933241+0000) 2024-01-31T05:16:28.069 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:27 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:27.591+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.734748+0000 front 2024-01-31T05:15:47.734758+0000 (oldest deadline 2024-01-31T05:16:11.234668+0000) 2024-01-31T05:16:28.069 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:27 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:27.591+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:55.935805+0000 front 2024-01-31T05:15:55.935887+0000 (oldest deadline 2024-01-31T05:16:20.635601+0000) 2024-01-31T05:16:28.069 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:27 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9[67041]: 2024-01-31T05:16:27.591+0000 7f23a1ded700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.99:6822 osd.6 since back 2024-01-31T05:16:00.635941+0000 front 2024-01-31T05:16:00.635973+0000 (oldest deadline 2024-01-31T05:16:26.535923+0000) 2024-01-31T05:16:28.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:28 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:28.036+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:16:28.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:28 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:28.036+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.701398+0000 front 2024-01-31T05:15:24.701437+0000 (oldest deadline 2024-01-31T05:15:49.401612+0000) 2024-01-31T05:16:28.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:28 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:28.036+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:29.402167+0000 front 2024-01-31T05:15:29.402154+0000 (oldest deadline 2024-01-31T05:15:55.302060+0000) 2024-01-31T05:16:28.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:28 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:28.036+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:38.703667+0000 front 2024-01-31T05:15:38.703620+0000 (oldest deadline 2024-01-31T05:16:04.003649+0000) 2024-01-31T05:16:28.383 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:28 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:28.036+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:48.104600+0000 front 2024-01-31T05:15:48.104539+0000 (oldest deadline 2024-01-31T05:16:11.604713+0000) 2024-01-31T05:16:28.383 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:28 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:28.036+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:53.306031+0000 front 2024-01-31T05:15:53.305889+0000 (oldest deadline 2024-01-31T05:16:19.205937+0000) 2024-01-31T05:16:28.383 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:28 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:28.036+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6822 osd.6 since back 2024-01-31T05:16:01.507199+0000 front 2024-01-31T05:16:01.507157+0000 (oldest deadline 2024-01-31T05:16:26.207131+0000) 2024-01-31T05:16:28.434 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:28 smithi099 podman[91829]: 2024-01-31 05:16:28.176343199 +0000 UTC m=+5.495718571 container died 61b33cd3e78b2ae10324775b9b9209103558b59dcd91f603258a557df24431f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.build-date=20240123, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.31.3, RELEASE=wip-vshankar-testing-20240125.044502-661946e) 2024-01-31T05:16:28.800 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:28 smithi099 podman[91829]: 2024-01-31 05:16:28.617376556 +0000 UTC m=+5.936751959 container cleanup 61b33cd3e78b2ae10324775b9b9209103558b59dcd91f603258a557df24431f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.31.3, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240123, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240125.044502-661946e) 2024-01-31T05:16:28.800 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:28 smithi099 bash[91829]: ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9 2024-01-31T05:16:28.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:28 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:28.563+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:16:28.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:28 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:28.563+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:16:28.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:28 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:28.563+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:16:28.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:28 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:28.563+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:40.103826+0000 front 2024-01-31T05:15:40.103813+0000 (oldest deadline 2024-01-31T05:16:03.003809+0000) 2024-01-31T05:16:28.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:28 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:28.563+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.605332+0000 front 2024-01-31T05:15:47.605496+0000 (oldest deadline 2024-01-31T05:16:11.105241+0000) 2024-01-31T05:16:28.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:28 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:28.563+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:56.406305+0000 front 2024-01-31T05:15:56.406222+0000 (oldest deadline 2024-01-31T05:16:19.306316+0000) 2024-01-31T05:16:29.068 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:28 smithi099 podman[91848]: 2024-01-31 05:16:28.802031383 +0000 UTC m=+0.623402946 container remove 61b33cd3e78b2ae10324775b9b9209103558b59dcd91f603258a557df24431f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240125.044502-661946e, CEPH_POINT_RELEASE=, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, io.buildah.version=1.31.3, org.label-schema.build-date=20240123) 2024-01-31T05:16:29.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:29 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:29.019+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:16:29.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:29 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:29.019+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.701398+0000 front 2024-01-31T05:15:24.701437+0000 (oldest deadline 2024-01-31T05:15:49.401612+0000) 2024-01-31T05:16:29.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:29 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:29.019+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:29.402167+0000 front 2024-01-31T05:15:29.402154+0000 (oldest deadline 2024-01-31T05:15:55.302060+0000) 2024-01-31T05:16:29.383 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:29 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:29.019+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:38.703667+0000 front 2024-01-31T05:15:38.703620+0000 (oldest deadline 2024-01-31T05:16:04.003649+0000) 2024-01-31T05:16:29.383 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:29 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:29.019+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:48.104600+0000 front 2024-01-31T05:15:48.104539+0000 (oldest deadline 2024-01-31T05:16:11.604713+0000) 2024-01-31T05:16:29.383 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:29 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:29.019+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:53.306031+0000 front 2024-01-31T05:15:53.305889+0000 (oldest deadline 2024-01-31T05:16:19.205937+0000) 2024-01-31T05:16:29.383 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:29 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:29.019+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6822 osd.6 since back 2024-01-31T05:16:01.507199+0000 front 2024-01-31T05:16:01.507157+0000 (oldest deadline 2024-01-31T05:16:26.207131+0000) 2024-01-31T05:16:29.504 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:29 smithi099 podman[91940]: 2024-01-31 05:16:29.122035865 +0000 UTC m=+0.017723754 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-31T05:16:29.504 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:29 smithi099 podman[91940]: 2024-01-31 05:16:29.227717342 +0000 UTC m=+0.123405226 container create 69dce0c0fab0967adb42eb4124c7069599d7e10e3b3ca8f341cee7f6d5d36085 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9-deactivate, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.31.3, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240123, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240125.044502-661946e, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-01-31T05:16:29.504 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:29 smithi099 podman[91940]: 2024-01-31 05:16:29.421901438 +0000 UTC m=+0.317589320 container init 69dce0c0fab0967adb42eb4124c7069599d7e10e3b3ca8f341cee7f6d5d36085 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9-deactivate, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240123, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, io.buildah.version=1.31.3, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-01-31T05:16:29.504 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:29 smithi099 podman[91940]: 2024-01-31 05:16:29.424991952 +0000 UTC m=+0.320679834 container start 69dce0c0fab0967adb42eb4124c7069599d7e10e3b3ca8f341cee7f6d5d36085 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9-deactivate, org.label-schema.build-date=20240123, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.31.3, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-01-31T05:16:29.504 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:29 smithi099 podman[91940]: 2024-01-31 05:16:29.505154539 +0000 UTC m=+0.400842430 container attach 69dce0c0fab0967adb42eb4124c7069599d7e10e3b3ca8f341cee7f6d5d36085 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.31.3, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, RELEASE=wip-vshankar-testing-20240125.044502-661946e, ceph=True, org.label-schema.build-date=20240123, org.label-schema.schema-version=1.0) 2024-01-31T05:16:29.818 INFO:journalctl@ceph.osd.9.smithi099.stdout:Jan 31 05:16:29 smithi099 podman[91940]: 2024-01-31 05:16:29.702473974 +0000 UTC m=+0.598161856 container died 69dce0c0fab0967adb42eb4124c7069599d7e10e3b3ca8f341cee7f6d5d36085 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-9-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240123, maintainer=Guillaume Abrioux , GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.31.3, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-01-31T05:16:30.071 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:29 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:29.580+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:16:30.071 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:29 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:29.580+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:16:30.071 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:29 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:29.580+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:16:30.071 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:29 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:29.580+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:40.103826+0000 front 2024-01-31T05:15:40.103813+0000 (oldest deadline 2024-01-31T05:16:03.003809+0000) 2024-01-31T05:16:30.071 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:29 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:29.580+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.605332+0000 front 2024-01-31T05:15:47.605496+0000 (oldest deadline 2024-01-31T05:16:11.105241+0000) 2024-01-31T05:16:30.072 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:29 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:29.580+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:56.406305+0000 front 2024-01-31T05:15:56.406222+0000 (oldest deadline 2024-01-31T05:16:19.306316+0000) 2024-01-31T05:16:30.260 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@osd.9.service' 2024-01-31T05:16:30.302 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-31T05:16:30.302 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-01-31T05:16:30.302 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-01-31T05:16:30.303 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ceph-9288ff44-bff5-11ee-95b3-87774f69a715@osd.10 2024-01-31T05:16:30.332 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:30 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:29.999+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:16:30.332 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:30 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:29.999+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.701398+0000 front 2024-01-31T05:15:24.701437+0000 (oldest deadline 2024-01-31T05:15:49.401612+0000) 2024-01-31T05:16:30.332 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:30 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:29.999+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:29.402167+0000 front 2024-01-31T05:15:29.402154+0000 (oldest deadline 2024-01-31T05:15:55.302060+0000) 2024-01-31T05:16:30.332 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:30 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:29.999+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:38.703667+0000 front 2024-01-31T05:15:38.703620+0000 (oldest deadline 2024-01-31T05:16:04.003649+0000) 2024-01-31T05:16:30.332 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:30 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:29.999+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:48.104600+0000 front 2024-01-31T05:15:48.104539+0000 (oldest deadline 2024-01-31T05:16:11.604713+0000) 2024-01-31T05:16:30.332 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:30 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:29.999+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:53.306031+0000 front 2024-01-31T05:15:53.305889+0000 (oldest deadline 2024-01-31T05:16:19.205937+0000) 2024-01-31T05:16:30.332 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:30 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:29.999+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6822 osd.6 since back 2024-01-31T05:16:01.507199+0000 front 2024-01-31T05:16:01.507157+0000 (oldest deadline 2024-01-31T05:16:26.207131+0000) 2024-01-31T05:16:30.603 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:30 smithi179 systemd[1]: Stopping Ceph osd.10 for 9288ff44-bff5-11ee-95b3-87774f69a715... 2024-01-31T05:16:30.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:30 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:30.571+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:16:30.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:30 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:30.571+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:16:30.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:30 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:30.571+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:16:30.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:30 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:30.571+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:40.103826+0000 front 2024-01-31T05:15:40.103813+0000 (oldest deadline 2024-01-31T05:16:03.003809+0000) 2024-01-31T05:16:30.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:30 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:30.571+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.605332+0000 front 2024-01-31T05:15:47.605496+0000 (oldest deadline 2024-01-31T05:16:11.105241+0000) 2024-01-31T05:16:30.822 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:30 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:30.571+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:56.406305+0000 front 2024-01-31T05:15:56.406222+0000 (oldest deadline 2024-01-31T05:16:19.306316+0000) 2024-01-31T05:16:30.882 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:30 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:30.604+0000 7fc52960f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-31T05:16:30.882 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:30 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:30.604+0000 7fc52960f700 -1 osd.10 91 *** Got signal Terminated *** 2024-01-31T05:16:30.883 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:30 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:30.604+0000 7fc52960f700 -1 osd.10 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-31T05:16:31.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:31 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:31.032+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:16:31.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:31 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:31.032+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.701398+0000 front 2024-01-31T05:15:24.701437+0000 (oldest deadline 2024-01-31T05:15:49.401612+0000) 2024-01-31T05:16:31.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:31 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:31.032+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:29.402167+0000 front 2024-01-31T05:15:29.402154+0000 (oldest deadline 2024-01-31T05:15:55.302060+0000) 2024-01-31T05:16:31.383 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:31 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:31.032+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:38.703667+0000 front 2024-01-31T05:15:38.703620+0000 (oldest deadline 2024-01-31T05:16:04.003649+0000) 2024-01-31T05:16:31.383 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:31 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:31.032+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:48.104600+0000 front 2024-01-31T05:15:48.104539+0000 (oldest deadline 2024-01-31T05:16:11.604713+0000) 2024-01-31T05:16:31.383 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:31 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:31.032+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:53.306031+0000 front 2024-01-31T05:15:53.305889+0000 (oldest deadline 2024-01-31T05:16:19.205937+0000) 2024-01-31T05:16:31.383 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:31 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:31.032+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6822 osd.6 since back 2024-01-31T05:16:01.507199+0000 front 2024-01-31T05:16:01.507157+0000 (oldest deadline 2024-01-31T05:16:26.207131+0000) 2024-01-31T05:16:32.071 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:31 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:31.579+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:16:32.071 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:31 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:31.579+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:16:32.071 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:31 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:31.579+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:16:32.071 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:31 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:31.579+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:40.103826+0000 front 2024-01-31T05:15:40.103813+0000 (oldest deadline 2024-01-31T05:16:03.003809+0000) 2024-01-31T05:16:32.071 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:31 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:31.579+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.605332+0000 front 2024-01-31T05:15:47.605496+0000 (oldest deadline 2024-01-31T05:16:11.105241+0000) 2024-01-31T05:16:32.071 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:31 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:31.579+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:56.406305+0000 front 2024-01-31T05:15:56.406222+0000 (oldest deadline 2024-01-31T05:16:19.306316+0000) 2024-01-31T05:16:32.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:31 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:31.998+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:16:32.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:31 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:31.998+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.701398+0000 front 2024-01-31T05:15:24.701437+0000 (oldest deadline 2024-01-31T05:15:49.401612+0000) 2024-01-31T05:16:32.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:31 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:31.998+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:29.402167+0000 front 2024-01-31T05:15:29.402154+0000 (oldest deadline 2024-01-31T05:15:55.302060+0000) 2024-01-31T05:16:32.383 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:31 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:31.998+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:38.703667+0000 front 2024-01-31T05:15:38.703620+0000 (oldest deadline 2024-01-31T05:16:04.003649+0000) 2024-01-31T05:16:32.383 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:31 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:31.998+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:48.104600+0000 front 2024-01-31T05:15:48.104539+0000 (oldest deadline 2024-01-31T05:16:11.604713+0000) 2024-01-31T05:16:32.383 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:31 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:31.998+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:53.306031+0000 front 2024-01-31T05:15:53.305889+0000 (oldest deadline 2024-01-31T05:16:19.205937+0000) 2024-01-31T05:16:32.383 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:31 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:31.998+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6822 osd.6 since back 2024-01-31T05:16:01.507199+0000 front 2024-01-31T05:16:01.507157+0000 (oldest deadline 2024-01-31T05:16:26.207131+0000) 2024-01-31T05:16:32.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:32 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:32.555+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:16:32.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:32 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:32.555+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:16:32.822 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:32 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:32.555+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:16:32.822 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:32 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:32.555+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:40.103826+0000 front 2024-01-31T05:15:40.103813+0000 (oldest deadline 2024-01-31T05:16:03.003809+0000) 2024-01-31T05:16:32.822 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:32 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:32.555+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.605332+0000 front 2024-01-31T05:15:47.605496+0000 (oldest deadline 2024-01-31T05:16:11.105241+0000) 2024-01-31T05:16:32.822 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:32 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:32.555+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:56.406305+0000 front 2024-01-31T05:15:56.406222+0000 (oldest deadline 2024-01-31T05:16:19.306316+0000) 2024-01-31T05:16:33.383 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:33 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:33.009+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:16:33.383 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:33 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:33.009+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.701398+0000 front 2024-01-31T05:15:24.701437+0000 (oldest deadline 2024-01-31T05:15:49.401612+0000) 2024-01-31T05:16:33.383 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:33 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:33.009+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:29.402167+0000 front 2024-01-31T05:15:29.402154+0000 (oldest deadline 2024-01-31T05:15:55.302060+0000) 2024-01-31T05:16:33.383 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:33 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:33.009+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:38.703667+0000 front 2024-01-31T05:15:38.703620+0000 (oldest deadline 2024-01-31T05:16:04.003649+0000) 2024-01-31T05:16:33.383 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:33 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:33.009+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:48.104600+0000 front 2024-01-31T05:15:48.104539+0000 (oldest deadline 2024-01-31T05:16:11.604713+0000) 2024-01-31T05:16:33.383 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:33 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:33.009+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:53.306031+0000 front 2024-01-31T05:15:53.305889+0000 (oldest deadline 2024-01-31T05:16:19.205937+0000) 2024-01-31T05:16:33.383 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:33 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:33.009+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6822 osd.6 since back 2024-01-31T05:16:01.507199+0000 front 2024-01-31T05:16:01.507157+0000 (oldest deadline 2024-01-31T05:16:26.207131+0000) 2024-01-31T05:16:33.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:33 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:33.544+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:16:33.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:33 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:33.544+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:16:33.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:33 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:33.544+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:16:33.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:33 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:33.544+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:40.103826+0000 front 2024-01-31T05:15:40.103813+0000 (oldest deadline 2024-01-31T05:16:03.003809+0000) 2024-01-31T05:16:33.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:33 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:33.544+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.605332+0000 front 2024-01-31T05:15:47.605496+0000 (oldest deadline 2024-01-31T05:16:11.105241+0000) 2024-01-31T05:16:33.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:33 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:33.544+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:56.406305+0000 front 2024-01-31T05:15:56.406222+0000 (oldest deadline 2024-01-31T05:16:19.306316+0000) 2024-01-31T05:16:33.822 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:33 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:33.544+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6820 osd.7 since back 2024-01-31T05:16:08.107790+0000 front 2024-01-31T05:16:08.107896+0000 (oldest deadline 2024-01-31T05:16:33.407618+0000) 2024-01-31T05:16:34.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:34 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:34.051+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:16:34.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:34 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:34.051+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.701398+0000 front 2024-01-31T05:15:24.701437+0000 (oldest deadline 2024-01-31T05:15:49.401612+0000) 2024-01-31T05:16:34.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:34 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:34.051+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:29.402167+0000 front 2024-01-31T05:15:29.402154+0000 (oldest deadline 2024-01-31T05:15:55.302060+0000) 2024-01-31T05:16:34.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:34 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:34.051+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:38.703667+0000 front 2024-01-31T05:15:38.703620+0000 (oldest deadline 2024-01-31T05:16:04.003649+0000) 2024-01-31T05:16:34.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:34 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:34.051+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:48.104600+0000 front 2024-01-31T05:15:48.104539+0000 (oldest deadline 2024-01-31T05:16:11.604713+0000) 2024-01-31T05:16:34.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:34 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:34.051+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:53.306031+0000 front 2024-01-31T05:15:53.305889+0000 (oldest deadline 2024-01-31T05:16:19.205937+0000) 2024-01-31T05:16:34.383 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:34 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:34.051+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6822 osd.6 since back 2024-01-31T05:16:01.507199+0000 front 2024-01-31T05:16:01.507157+0000 (oldest deadline 2024-01-31T05:16:26.207131+0000) 2024-01-31T05:16:34.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:34 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:34.553+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:16:34.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:34 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:34.553+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:16:34.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:34 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:34.553+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:16:34.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:34 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:34.553+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:40.103826+0000 front 2024-01-31T05:15:40.103813+0000 (oldest deadline 2024-01-31T05:16:03.003809+0000) 2024-01-31T05:16:34.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:34 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:34.553+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.605332+0000 front 2024-01-31T05:15:47.605496+0000 (oldest deadline 2024-01-31T05:16:11.105241+0000) 2024-01-31T05:16:34.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:34 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:34.553+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:56.406305+0000 front 2024-01-31T05:15:56.406222+0000 (oldest deadline 2024-01-31T05:16:19.306316+0000) 2024-01-31T05:16:34.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:34 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:34.553+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6820 osd.7 since back 2024-01-31T05:16:08.107790+0000 front 2024-01-31T05:16:08.107896+0000 (oldest deadline 2024-01-31T05:16:33.407618+0000) 2024-01-31T05:16:35.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:35 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:35.009+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:14.700193+0000 front 2024-01-31T05:15:14.700242+0000 (oldest deadline 2024-01-31T05:15:39.400211+0000) 2024-01-31T05:16:35.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:35 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:35.009+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:24.701398+0000 front 2024-01-31T05:15:24.701437+0000 (oldest deadline 2024-01-31T05:15:49.401612+0000) 2024-01-31T05:16:35.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:35 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:35.009+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:29.402167+0000 front 2024-01-31T05:15:29.402154+0000 (oldest deadline 2024-01-31T05:15:55.302060+0000) 2024-01-31T05:16:35.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:35 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:35.009+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:38.703667+0000 front 2024-01-31T05:15:38.703620+0000 (oldest deadline 2024-01-31T05:16:04.003649+0000) 2024-01-31T05:16:35.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:35 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:35.009+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:48.104600+0000 front 2024-01-31T05:15:48.104539+0000 (oldest deadline 2024-01-31T05:16:11.604713+0000) 2024-01-31T05:16:35.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:35 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:35.009+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:53.306031+0000 front 2024-01-31T05:15:53.305889+0000 (oldest deadline 2024-01-31T05:16:19.205937+0000) 2024-01-31T05:16:35.382 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:35 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10[60757]: 2024-01-31T05:16:35.009+0000 7fc522403700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.99:6822 osd.6 since back 2024-01-31T05:16:01.507199+0000 front 2024-01-31T05:16:01.507157+0000 (oldest deadline 2024-01-31T05:16:26.207131+0000) 2024-01-31T05:16:35.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:35 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:35.530+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:16:35.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:35 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:35.530+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:16:35.821 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:35 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:35.530+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:16:35.822 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:35 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:35.530+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:40.103826+0000 front 2024-01-31T05:15:40.103813+0000 (oldest deadline 2024-01-31T05:16:03.003809+0000) 2024-01-31T05:16:35.822 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:35 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:35.530+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.605332+0000 front 2024-01-31T05:15:47.605496+0000 (oldest deadline 2024-01-31T05:16:11.105241+0000) 2024-01-31T05:16:35.822 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:35 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:35.530+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:56.406305+0000 front 2024-01-31T05:15:56.406222+0000 (oldest deadline 2024-01-31T05:16:19.306316+0000) 2024-01-31T05:16:35.822 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:35 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:35.530+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6820 osd.7 since back 2024-01-31T05:16:08.107790+0000 front 2024-01-31T05:16:08.107896+0000 (oldest deadline 2024-01-31T05:16:33.407618+0000) 2024-01-31T05:16:36.313 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:35 smithi179 podman[70581]: 2024-01-31 05:16:35.988943802 +0000 UTC m=+5.494357168 container died 4b872feb21c79a4f73957dda962b961a25a1df34747a015b4809733c035e7cc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.31.3, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240123, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-01-31T05:16:36.313 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:36 smithi179 podman[70581]: 2024-01-31 05:16:36.313857224 +0000 UTC m=+5.819270598 container cleanup 4b872feb21c79a4f73957dda962b961a25a1df34747a015b4809733c035e7cc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.31.3, org.label-schema.build-date=20240123, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True) 2024-01-31T05:16:36.632 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:36 smithi179 bash[70581]: ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10 2024-01-31T05:16:36.632 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:36 smithi179 podman[70598]: 2024-01-31 05:16:36.556762206 +0000 UTC m=+0.566534097 container remove 4b872feb21c79a4f73957dda962b961a25a1df34747a015b4809733c035e7cc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.build-date=20240123, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.31.3, CEPH_POINT_RELEASE=, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-01-31T05:16:37.071 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:36 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:36.575+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:16:37.071 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:36 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:36.575+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:16:37.071 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:36 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:36.575+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:16:37.071 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:36 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:36.575+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:40.103826+0000 front 2024-01-31T05:15:40.103813+0000 (oldest deadline 2024-01-31T05:16:03.003809+0000) 2024-01-31T05:16:37.071 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:36 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:36.575+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.605332+0000 front 2024-01-31T05:15:47.605496+0000 (oldest deadline 2024-01-31T05:16:11.105241+0000) 2024-01-31T05:16:37.071 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:36 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:36.575+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:56.406305+0000 front 2024-01-31T05:15:56.406222+0000 (oldest deadline 2024-01-31T05:16:19.306316+0000) 2024-01-31T05:16:37.071 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:36 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:36.575+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6820 osd.7 since back 2024-01-31T05:16:08.107790+0000 front 2024-01-31T05:16:08.107896+0000 (oldest deadline 2024-01-31T05:16:33.407618+0000) 2024-01-31T05:16:37.284 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:36 smithi179 podman[70692]: 2024-01-31 05:16:36.880171891 +0000 UTC m=+0.017593394 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-31T05:16:37.284 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:36 smithi179 podman[70692]: 2024-01-31 05:16:36.999242001 +0000 UTC m=+0.136663486 container create 4e395106770652ac006d34a4f420121da445d0ae733e297a583d8a3a7ac35042 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10-deactivate, GIT_CLEAN=True, io.buildah.version=1.31.3, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240125.044502-661946e, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240123, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183) 2024-01-31T05:16:37.284 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:37 smithi179 podman[70692]: 2024-01-31 05:16:37.218717897 +0000 UTC m=+0.356139385 container init 4e395106770652ac006d34a4f420121da445d0ae733e297a583d8a3a7ac35042 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.31.3, org.label-schema.license=GPLv2, org.label-schema.build-date=20240123, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183) 2024-01-31T05:16:37.284 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:37 smithi179 podman[70692]: 2024-01-31 05:16:37.221957922 +0000 UTC m=+0.359379412 container start 4e395106770652ac006d34a4f420121da445d0ae733e297a583d8a3a7ac35042 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.31.3, RELEASE=wip-vshankar-testing-20240125.044502-661946e, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240123, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-01-31T05:16:37.284 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:37 smithi179 podman[70692]: 2024-01-31 05:16:37.285239958 +0000 UTC m=+0.422661480 container attach 4e395106770652ac006d34a4f420121da445d0ae733e297a583d8a3a7ac35042 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.31.3, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.build-date=20240123) 2024-01-31T05:16:37.632 INFO:journalctl@ceph.osd.10.smithi179.stdout:Jan 31 05:16:37 smithi179 podman[70692]: 2024-01-31 05:16:37.496960051 +0000 UTC m=+0.634381552 container died 4e395106770652ac006d34a4f420121da445d0ae733e297a583d8a3a7ac35042 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-10-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.build-date=20240123, ceph=True, RELEASE=wip-vshankar-testing-20240125.044502-661946e, io.buildah.version=1.31.3) 2024-01-31T05:16:38.027 DEBUG:teuthology.orchestra.run.smithi179:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@osd.10.service' 2024-01-31T05:16:38.071 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:37 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:37.618+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:16:38.071 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:37 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:37.618+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:16:38.071 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:37 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:37.618+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:16:38.071 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:37 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:37.618+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:40.103826+0000 front 2024-01-31T05:15:40.103813+0000 (oldest deadline 2024-01-31T05:16:03.003809+0000) 2024-01-31T05:16:38.071 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:37 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:37.618+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.605332+0000 front 2024-01-31T05:15:47.605496+0000 (oldest deadline 2024-01-31T05:16:11.105241+0000) 2024-01-31T05:16:38.071 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:37 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:37.618+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:56.406305+0000 front 2024-01-31T05:15:56.406222+0000 (oldest deadline 2024-01-31T05:16:19.306316+0000) 2024-01-31T05:16:38.071 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:37 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:37.618+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6820 osd.7 since back 2024-01-31T05:16:08.107790+0000 front 2024-01-31T05:16:08.107896+0000 (oldest deadline 2024-01-31T05:16:33.407618+0000) 2024-01-31T05:16:38.108 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-31T05:16:38.109 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-01-31T05:16:38.109 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-01-31T05:16:38.109 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-9288ff44-bff5-11ee-95b3-87774f69a715@osd.11 2024-01-31T05:16:38.571 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:38 smithi181 systemd[1]: Stopping Ceph osd.11 for 9288ff44-bff5-11ee-95b3-87774f69a715... 2024-01-31T05:16:38.571 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:38 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:38.373+0000 7ffb8b559700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-31T05:16:38.571 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:38 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:38.373+0000 7ffb8b559700 -1 osd.11 91 *** Got signal Terminated *** 2024-01-31T05:16:38.571 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:38 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:38.373+0000 7ffb8b559700 -1 osd.11 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-31T05:16:39.071 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:38 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:38.614+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:16:39.071 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:38 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:38.614+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:16:39.071 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:38 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:38.614+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:16:39.071 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:38 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:38.614+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:40.103826+0000 front 2024-01-31T05:15:40.103813+0000 (oldest deadline 2024-01-31T05:16:03.003809+0000) 2024-01-31T05:16:39.071 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:38 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:38.614+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.605332+0000 front 2024-01-31T05:15:47.605496+0000 (oldest deadline 2024-01-31T05:16:11.105241+0000) 2024-01-31T05:16:39.071 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:38 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:38.614+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:56.406305+0000 front 2024-01-31T05:15:56.406222+0000 (oldest deadline 2024-01-31T05:16:19.306316+0000) 2024-01-31T05:16:39.071 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:38 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:38.614+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6820 osd.7 since back 2024-01-31T05:16:08.107790+0000 front 2024-01-31T05:16:08.107896+0000 (oldest deadline 2024-01-31T05:16:33.407618+0000) 2024-01-31T05:16:40.072 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:39 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:39.589+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:16:40.072 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:39 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:39.589+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:16:40.073 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:39 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:39.589+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:16:40.073 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:39 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:39.589+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:40.103826+0000 front 2024-01-31T05:15:40.103813+0000 (oldest deadline 2024-01-31T05:16:03.003809+0000) 2024-01-31T05:16:40.073 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:39 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:39.589+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.605332+0000 front 2024-01-31T05:15:47.605496+0000 (oldest deadline 2024-01-31T05:16:11.105241+0000) 2024-01-31T05:16:40.073 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:39 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:39.589+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:56.406305+0000 front 2024-01-31T05:15:56.406222+0000 (oldest deadline 2024-01-31T05:16:19.306316+0000) 2024-01-31T05:16:40.073 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:39 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:39.589+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6820 osd.7 since back 2024-01-31T05:16:08.107790+0000 front 2024-01-31T05:16:08.107896+0000 (oldest deadline 2024-01-31T05:16:33.407618+0000) 2024-01-31T05:16:40.823 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:40 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:40.563+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:16:40.823 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:40 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:40.563+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:16:40.824 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:40 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:40.563+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:16:40.824 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:40 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:40.563+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:40.103826+0000 front 2024-01-31T05:15:40.103813+0000 (oldest deadline 2024-01-31T05:16:03.003809+0000) 2024-01-31T05:16:40.824 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:40 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:40.563+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.605332+0000 front 2024-01-31T05:15:47.605496+0000 (oldest deadline 2024-01-31T05:16:11.105241+0000) 2024-01-31T05:16:40.824 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:40 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:40.563+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:56.406305+0000 front 2024-01-31T05:15:56.406222+0000 (oldest deadline 2024-01-31T05:16:19.306316+0000) 2024-01-31T05:16:40.824 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:40 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:40.563+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6820 osd.7 since back 2024-01-31T05:16:08.107790+0000 front 2024-01-31T05:16:08.107896+0000 (oldest deadline 2024-01-31T05:16:33.407618+0000) 2024-01-31T05:16:42.071 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:41 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:41.610+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:16:42.071 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:41 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:41.610+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:16:42.071 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:41 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:41.610+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:16:42.071 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:41 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:41.610+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:40.103826+0000 front 2024-01-31T05:15:40.103813+0000 (oldest deadline 2024-01-31T05:16:03.003809+0000) 2024-01-31T05:16:42.071 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:41 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:41.610+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.605332+0000 front 2024-01-31T05:15:47.605496+0000 (oldest deadline 2024-01-31T05:16:11.105241+0000) 2024-01-31T05:16:42.072 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:41 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:41.610+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:56.406305+0000 front 2024-01-31T05:15:56.406222+0000 (oldest deadline 2024-01-31T05:16:19.306316+0000) 2024-01-31T05:16:42.072 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:41 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:41.610+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6820 osd.7 since back 2024-01-31T05:16:08.107790+0000 front 2024-01-31T05:16:08.107896+0000 (oldest deadline 2024-01-31T05:16:33.407618+0000) 2024-01-31T05:16:43.071 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:42 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:42.586+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-01-31T05:15:15.198865+0000 front 2024-01-31T05:15:15.198928+0000 (oldest deadline 2024-01-31T05:15:40.498784+0000) 2024-01-31T05:16:43.071 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:42 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:42.586+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6804 osd.1 since back 2024-01-31T05:15:21.600020+0000 front 2024-01-31T05:15:21.599891+0000 (oldest deadline 2024-01-31T05:15:46.300010+0000) 2024-01-31T05:16:43.071 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:42 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:42.586+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-01-31T05:15:32.101492+0000 front 2024-01-31T05:15:32.101583+0000 (oldest deadline 2024-01-31T05:15:53.801645+0000) 2024-01-31T05:16:43.071 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:42 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:42.586+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.99:6814 osd.3 since back 2024-01-31T05:15:40.103826+0000 front 2024-01-31T05:15:40.103813+0000 (oldest deadline 2024-01-31T05:16:03.003809+0000) 2024-01-31T05:16:43.072 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:42 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:42.586+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6812 osd.4 since back 2024-01-31T05:15:47.605332+0000 front 2024-01-31T05:15:47.605496+0000 (oldest deadline 2024-01-31T05:16:11.105241+0000) 2024-01-31T05:16:43.072 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:42 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:42.586+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-01-31T05:15:56.406305+0000 front 2024-01-31T05:15:56.406222+0000 (oldest deadline 2024-01-31T05:16:19.306316+0000) 2024-01-31T05:16:43.072 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:42 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:42.586+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.179:6820 osd.7 since back 2024-01-31T05:16:08.107790+0000 front 2024-01-31T05:16:08.107896+0000 (oldest deadline 2024-01-31T05:16:33.407618+0000) 2024-01-31T05:16:43.072 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:42 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11[62792]: 2024-01-31T05:16:42.586+0000 7ffb8434d700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.181:6820 osd.8 since back 2024-01-31T05:16:18.008873+0000 front 2024-01-31T05:16:18.008913+0000 (oldest deadline 2024-01-31T05:16:42.108970+0000) 2024-01-31T05:16:44.238 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:43 smithi181 podman[72697]: 2024-01-31 05:16:43.913543253 +0000 UTC m=+5.609582771 container died 3fabee58035bbada0e1105dcbb857bd980f79e342595e78c75f9cdfc38982a79 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240125.044502-661946e, ceph=True, io.buildah.version=1.31.3, org.label-schema.build-date=20240123, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-01-31T05:16:44.571 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:44 smithi181 podman[72697]: 2024-01-31 05:16:44.24003294 +0000 UTC m=+5.936072462 container cleanup 3fabee58035bbada0e1105dcbb857bd980f79e342595e78c75f9cdfc38982a79 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240123, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, io.buildah.version=1.31.3) 2024-01-31T05:16:44.571 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:44 smithi181 bash[72697]: ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11 2024-01-31T05:16:44.571 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:44 smithi181 podman[72714]: 2024-01-31 05:16:44.466320284 +0000 UTC m=+0.551316795 container remove 3fabee58035bbada0e1105dcbb857bd980f79e342595e78c75f9cdfc38982a79 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.31.3, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.build-date=20240123, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-01-31T05:16:45.170 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:44 smithi181 podman[72809]: 2024-01-31 05:16:44.801796947 +0000 UTC m=+0.017715082 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-31T05:16:45.170 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:44 smithi181 podman[72809]: 2024-01-31 05:16:44.911918294 +0000 UTC m=+0.127836421 container create 065caeade340ec7dcfc5c61a7c323fc160cf9e217ae0a7efe72afb88a45bd056 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.31.3, org.label-schema.build-date=20240123, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183) 2024-01-31T05:16:45.170 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:45 smithi181 podman[72809]: 2024-01-31 05:16:45.096716081 +0000 UTC m=+0.312634241 container init 065caeade340ec7dcfc5c61a7c323fc160cf9e217ae0a7efe72afb88a45bd056 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11-deactivate, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.31.3, org.label-schema.build-date=20240123, ceph=True, RELEASE=wip-vshankar-testing-20240125.044502-661946e) 2024-01-31T05:16:45.170 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:45 smithi181 podman[72809]: 2024-01-31 05:16:45.099820781 +0000 UTC m=+0.315738916 container start 065caeade340ec7dcfc5c61a7c323fc160cf9e217ae0a7efe72afb88a45bd056 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.31.3, ceph=True, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.build-date=20240123, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-01-31T05:16:45.170 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:45 smithi181 podman[72809]: 2024-01-31 05:16:45.171640279 +0000 UTC m=+0.387558430 container attach 065caeade340ec7dcfc5c61a7c323fc160cf9e217ae0a7efe72afb88a45bd056 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11-deactivate, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240123, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.31.3, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True) 2024-01-31T05:16:45.571 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:45 smithi181 podman[72809]: 2024-01-31 05:16:45.385405374 +0000 UTC m=+0.601323509 container died 065caeade340ec7dcfc5c61a7c323fc160cf9e217ae0a7efe72afb88a45bd056 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.31.3, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240123, maintainer=Guillaume Abrioux ) 2024-01-31T05:16:45.927 INFO:journalctl@ceph.osd.11.smithi181.stdout:Jan 31 05:16:45 smithi181 podman[72835]: 2024-01-31 05:16:45.918953135 +0000 UTC m=+0.524063509 container remove 065caeade340ec7dcfc5c61a7c323fc160cf9e217ae0a7efe72afb88a45bd056 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-osd-11-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.31.3, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240123, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183) 2024-01-31T05:16:45.932 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@osd.11.service' 2024-01-31T05:16:45.971 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-31T05:16:45.971 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-01-31T05:16:45.971 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-01-31T05:16:45.971 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mds.a 2024-01-31T05:16:46.276 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:16:46 smithi099 systemd[1]: Stopping Ceph mds.a for 9288ff44-bff5-11ee-95b3-87774f69a715... 2024-01-31T05:16:46.568 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:16:46 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:16:46.276+0000 7f1508562700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-31T05:16:46.568 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:16:46 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a[73914]: 2024-01-31T05:16:46.276+0000 7f1508562700 -1 mds.a *** got signal Terminated *** 2024-01-31T05:16:48.818 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:16:48 smithi099 podman[92060]: 2024-01-31 05:16:48.442702676 +0000 UTC m=+2.274851245 container died f5357530e711151c53fa94f7727cbd135754c0bd892b2d1b981d91c2fed4b996 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a, io.buildah.version=1.31.3, org.label-schema.build-date=20240123, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240125.044502-661946e, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-01-31T05:16:49.318 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:16:49 smithi099 podman[92060]: 2024-01-31 05:16:49.051183161 +0000 UTC m=+2.883331721 container cleanup f5357530e711151c53fa94f7727cbd135754c0bd892b2d1b981d91c2fed4b996 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240123, ceph=True, io.buildah.version=1.31.3, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-01-31T05:16:49.318 INFO:journalctl@ceph.mds.a.smithi099.stdout:Jan 31 05:16:49 smithi099 bash[92060]: ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-a 2024-01-31T05:16:49.434 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mds.a.service' 2024-01-31T05:16:49.472 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-31T05:16:49.473 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-01-31T05:16:49.473 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-01-31T05:16:49.473 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mds.d 2024-01-31T05:16:49.818 INFO:journalctl@ceph.mds.d.smithi099.stdout:Jan 31 05:16:49 smithi099 systemd[1]: Stopping Ceph mds.d for 9288ff44-bff5-11ee-95b3-87774f69a715... 2024-01-31T05:16:50.318 INFO:journalctl@ceph.mds.d.smithi099.stdout:Jan 31 05:16:49 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-d[72947]: 2024-01-31T05:16:49.862+0000 7f773bb76700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-31T05:16:50.318 INFO:journalctl@ceph.mds.d.smithi099.stdout:Jan 31 05:16:49 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-d[72947]: 2024-01-31T05:16:49.862+0000 7f773bb76700 -1 mds.d *** got signal Terminated *** 2024-01-31T05:16:54.204 INFO:journalctl@ceph.mds.d.smithi099.stdout:Jan 31 05:16:53 smithi099 podman[92181]: 2024-01-31 05:16:53.869326994 +0000 UTC m=+4.179088228 container died fd036ce99dc8b9e86bb24994d13ad8f1b4c1d210fb78e854159c070cf678be94 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-d, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240123, CEPH_POINT_RELEASE=, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.license=GPLv2, io.buildah.version=1.31.3, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-01-31T05:16:54.512 INFO:journalctl@ceph.mds.d.smithi099.stdout:Jan 31 05:16:54 smithi099 podman[92181]: 2024-01-31 05:16:54.3042434 +0000 UTC m=+4.614004637 container cleanup fd036ce99dc8b9e86bb24994d13ad8f1b4c1d210fb78e854159c070cf678be94 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-d, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.31.3, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.license=GPLv2, org.label-schema.build-date=20240123, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-01-31T05:16:54.512 INFO:journalctl@ceph.mds.d.smithi099.stdout:Jan 31 05:16:54 smithi099 bash[92181]: ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-d 2024-01-31T05:16:54.726 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mds.d.service' 2024-01-31T05:16:54.761 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-31T05:16:54.761 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-01-31T05:16:54.762 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-01-31T05:16:54.762 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mds.g 2024-01-31T05:16:55.090 INFO:journalctl@ceph.mds.g.smithi099.stdout:Jan 31 05:16:54 smithi099 systemd[1]: Stopping Ceph mds.g for 9288ff44-bff5-11ee-95b3-87774f69a715... 2024-01-31T05:16:55.568 INFO:journalctl@ceph.mds.g.smithi099.stdout:Jan 31 05:16:55 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-g[73552]: 2024-01-31T05:16:55.090+0000 7f8cfcdd5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-31T05:16:55.568 INFO:journalctl@ceph.mds.g.smithi099.stdout:Jan 31 05:16:55 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-g[73552]: 2024-01-31T05:16:55.090+0000 7f8cfcdd5700 -1 mds.g *** got signal Terminated *** 2024-01-31T05:16:56.774 INFO:journalctl@ceph.mds.g.smithi099.stdout:Jan 31 05:16:56 smithi099 podman[92301]: 2024-01-31 05:16:56.439030734 +0000 UTC m=+1.462181199 container died 29817ee4f467e29f47311a0f1a1fc90f5155f5cdd1a14610f05577492e4d2ccc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-g, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, io.buildah.version=1.31.3, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240123, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240125.044502-661946e, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-01-31T05:16:57.068 INFO:journalctl@ceph.mds.g.smithi099.stdout:Jan 31 05:16:56 smithi099 podman[92301]: 2024-01-31 05:16:56.866542533 +0000 UTC m=+1.889692998 container cleanup 29817ee4f467e29f47311a0f1a1fc90f5155f5cdd1a14610f05577492e4d2ccc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-g, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.license=GPLv2, io.buildah.version=1.31.3, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240123, GIT_BRANCH=HEAD) 2024-01-31T05:16:57.068 INFO:journalctl@ceph.mds.g.smithi099.stdout:Jan 31 05:16:56 smithi099 bash[92301]: ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-g 2024-01-31T05:16:57.289 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mds.g.service' 2024-01-31T05:16:57.323 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-31T05:16:57.323 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-01-31T05:16:57.324 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-01-31T05:16:57.324 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mds.j 2024-01-31T05:16:57.818 INFO:journalctl@ceph.mds.j.smithi099.stdout:Jan 31 05:16:57 smithi099 systemd[1]: Stopping Ceph mds.j for 9288ff44-bff5-11ee-95b3-87774f69a715... 2024-01-31T05:16:57.818 INFO:journalctl@ceph.mds.j.smithi099.stdout:Jan 31 05:16:57 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-j[72558]: 2024-01-31T05:16:57.636+0000 7f5fedc99700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-31T05:16:57.818 INFO:journalctl@ceph.mds.j.smithi099.stdout:Jan 31 05:16:57 smithi099 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-j[72558]: 2024-01-31T05:16:57.636+0000 7f5fedc99700 -1 mds.j *** got signal Terminated *** 2024-01-31T05:16:59.302 INFO:journalctl@ceph.mds.j.smithi099.stdout:Jan 31 05:16:59 smithi099 podman[92420]: 2024-01-31 05:16:59.02062503 +0000 UTC m=+1.479088942 container died f70d8b2a2333e93a6a06584d08d7c53381c44833254b200712c22fdcb6756f75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-j, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.31.3, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240125.044502-661946e, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240123, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-01-31T05:16:59.302 INFO:journalctl@ceph.mds.j.smithi099.stdout:Jan 31 05:16:59 smithi099 podman[92420]: 2024-01-31 05:16:59.303636986 +0000 UTC m=+1.762100887 container cleanup f70d8b2a2333e93a6a06584d08d7c53381c44833254b200712c22fdcb6756f75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-j, org.label-schema.build-date=20240123, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.31.3, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-01-31T05:16:59.568 INFO:journalctl@ceph.mds.j.smithi099.stdout:Jan 31 05:16:59 smithi099 bash[92420]: ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-j 2024-01-31T05:16:59.568 INFO:journalctl@ceph.mds.j.smithi099.stdout:Jan 31 05:16:59 smithi099 podman[92432]: 2024-01-31 05:16:59.538028 +0000 UTC m=+0.520987842 container remove f70d8b2a2333e93a6a06584d08d7c53381c44833254b200712c22fdcb6756f75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-j, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240125.044502-661946e, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240123, org.label-schema.schema-version=1.0, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-01-31T05:16:59.653 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mds.j.service' 2024-01-31T05:16:59.687 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-31T05:16:59.687 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-01-31T05:16:59.687 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-01-31T05:16:59.687 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mds.b 2024-01-31T05:17:00.047 INFO:journalctl@ceph.mds.b.smithi179.stdout:Jan 31 05:16:59 smithi179 systemd[1]: Stopping Ceph mds.b for 9288ff44-bff5-11ee-95b3-87774f69a715... 2024-01-31T05:17:00.382 INFO:journalctl@ceph.mds.b.smithi179.stdout:Jan 31 05:17:00 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-b[66457]: 2024-01-31T05:17:00.046+0000 7f1769359700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-31T05:17:00.382 INFO:journalctl@ceph.mds.b.smithi179.stdout:Jan 31 05:17:00 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-b[66457]: 2024-01-31T05:17:00.046+0000 7f1769359700 -1 mds.b *** got signal Terminated *** 2024-01-31T05:17:04.332 INFO:journalctl@ceph.mds.b.smithi179.stdout:Jan 31 05:17:04 smithi179 podman[70809]: 2024-01-31 05:17:04.054333545 +0000 UTC m=+4.174344713 container died 95f2ec3f19ea0106236866e20c8dc1b322fae0444e23f46c9c1ea72de571cf12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.31.3, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240123, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_CLEAN=True) 2024-01-31T05:17:04.632 INFO:journalctl@ceph.mds.b.smithi179.stdout:Jan 31 05:17:04 smithi179 podman[70809]: 2024-01-31 05:17:04.424268435 +0000 UTC m=+4.544279616 container cleanup 95f2ec3f19ea0106236866e20c8dc1b322fae0444e23f46c9c1ea72de571cf12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.build-date=20240123, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240125.044502-661946e, io.buildah.version=1.31.3) 2024-01-31T05:17:04.632 INFO:journalctl@ceph.mds.b.smithi179.stdout:Jan 31 05:17:04 smithi179 bash[70809]: ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-b 2024-01-31T05:17:04.844 DEBUG:teuthology.orchestra.run.smithi179:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mds.b.service' 2024-01-31T05:17:04.880 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-31T05:17:04.880 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-01-31T05:17:04.881 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-01-31T05:17:04.881 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mds.e 2024-01-31T05:17:05.311 INFO:journalctl@ceph.mds.e.smithi179.stdout:Jan 31 05:17:04 smithi179 systemd[1]: Stopping Ceph mds.e for 9288ff44-bff5-11ee-95b3-87774f69a715... 2024-01-31T05:17:05.632 INFO:journalctl@ceph.mds.e.smithi179.stdout:Jan 31 05:17:05 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-e[65832]: 2024-01-31T05:17:05.311+0000 7f6ce9d48700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-31T05:17:05.632 INFO:journalctl@ceph.mds.e.smithi179.stdout:Jan 31 05:17:05 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-e[65832]: 2024-01-31T05:17:05.311+0000 7f6ce9d48700 -1 mds.e *** got signal Terminated *** 2024-01-31T05:17:08.786 INFO:journalctl@ceph.mds.e.smithi179.stdout:Jan 31 05:17:08 smithi179 podman[70932]: 2024-01-31 05:17:08.449544917 +0000 UTC m=+3.345017671 container died fe8e57110bfbc9ae478b98cf69f303fb859b2b50ddf5648194605c949d917a89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-e, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.31.3, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240123, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240125.044502-661946e) 2024-01-31T05:17:09.070 INFO:journalctl@ceph.mds.e.smithi179.stdout:Jan 31 05:17:08 smithi179 podman[70932]: 2024-01-31 05:17:08.887399973 +0000 UTC m=+3.782872726 container cleanup fe8e57110bfbc9ae478b98cf69f303fb859b2b50ddf5648194605c949d917a89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-e, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.license=GPLv2, org.label-schema.build-date=20240123, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.31.3, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux ) 2024-01-31T05:17:09.071 INFO:journalctl@ceph.mds.e.smithi179.stdout:Jan 31 05:17:08 smithi179 bash[70932]: ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-e 2024-01-31T05:17:09.302 DEBUG:teuthology.orchestra.run.smithi179:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mds.e.service' 2024-01-31T05:17:09.326 INFO:journalctl@ceph.mds.e.smithi179.stdout:Jan 31 05:17:09 smithi179 podman[70946]: 2024-01-31 05:17:09.072032391 +0000 UTC m=+0.615812565 container remove fe8e57110bfbc9ae478b98cf69f303fb859b2b50ddf5648194605c949d917a89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-e, RELEASE=wip-vshankar-testing-20240125.044502-661946e, io.buildah.version=1.31.3, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240123, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-01-31T05:17:09.326 INFO:journalctl@ceph.mds.e.smithi179.stdout:Jan 31 05:17:09 smithi179 systemd[1]: ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mds.e.service: Deactivated successfully. 2024-01-31T05:17:09.326 INFO:journalctl@ceph.mds.e.smithi179.stdout:Jan 31 05:17:09 smithi179 systemd[1]: Stopped Ceph mds.e for 9288ff44-bff5-11ee-95b3-87774f69a715. 2024-01-31T05:17:09.326 INFO:journalctl@ceph.mds.e.smithi179.stdout:Jan 31 05:17:09 smithi179 systemd[1]: ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mds.e.service: Consumed 13.891s CPU time. 2024-01-31T05:17:09.338 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-31T05:17:09.338 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-01-31T05:17:09.338 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-01-31T05:17:09.338 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mds.h 2024-01-31T05:17:09.632 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:17:09 smithi179 systemd[1]: Stopping Ceph mds.h for 9288ff44-bff5-11ee-95b3-87774f69a715... 2024-01-31T05:17:10.132 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:17:09 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:17:09.673+0000 7f11f0f6a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-31T05:17:10.132 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:17:09 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h[66140]: 2024-01-31T05:17:09.673+0000 7f11f0f6a700 -1 mds.h *** got signal Terminated *** 2024-01-31T05:17:12.707 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:17:12 smithi179 podman[71054]: 2024-01-31 05:17:12.437498341 +0000 UTC m=+2.879524592 container died c01094228e2ecd33c593f5ff44881522a233ac88c842addd9674e70eff06ad10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h, RELEASE=wip-vshankar-testing-20240125.044502-661946e, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.31.3, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240123) 2024-01-31T05:17:13.066 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:17:12 smithi179 podman[71054]: 2024-01-31 05:17:12.808389804 +0000 UTC m=+3.250416019 container cleanup c01094228e2ecd33c593f5ff44881522a233ac88c842addd9674e70eff06ad10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240125.044502-661946e, io.buildah.version=1.31.3, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240123) 2024-01-31T05:17:13.066 INFO:journalctl@ceph.mds.h.smithi179.stdout:Jan 31 05:17:12 smithi179 bash[71054]: ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-h 2024-01-31T05:17:13.223 DEBUG:teuthology.orchestra.run.smithi179:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mds.h.service' 2024-01-31T05:17:13.260 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-31T05:17:13.260 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-01-31T05:17:13.260 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-01-31T05:17:13.260 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mds.k 2024-01-31T05:17:13.586 INFO:journalctl@ceph.mds.k.smithi179.stdout:Jan 31 05:17:13 smithi179 systemd[1]: Stopping Ceph mds.k for 9288ff44-bff5-11ee-95b3-87774f69a715... 2024-01-31T05:17:13.882 INFO:journalctl@ceph.mds.k.smithi179.stdout:Jan 31 05:17:13 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-k[65508]: 2024-01-31T05:17:13.586+0000 7f9505b11700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-31T05:17:13.882 INFO:journalctl@ceph.mds.k.smithi179.stdout:Jan 31 05:17:13 smithi179 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-k[65508]: 2024-01-31T05:17:13.586+0000 7f9505b11700 -1 mds.k *** got signal Terminated *** 2024-01-31T05:17:16.706 INFO:journalctl@ceph.mds.k.smithi179.stdout:Jan 31 05:17:16 smithi179 podman[71187]: 2024-01-31 05:17:16.436724261 +0000 UTC m=+2.957950539 container died 78d89daaa42e936b7a31e04c645ed13f7e506a16a6c372e243e49a845c3795cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-k, RELEASE=wip-vshankar-testing-20240125.044502-661946e, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.31.3, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240123, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-01-31T05:17:17.056 INFO:journalctl@ceph.mds.k.smithi179.stdout:Jan 31 05:17:16 smithi179 podman[71187]: 2024-01-31 05:17:16.79885818 +0000 UTC m=+3.320084451 container cleanup 78d89daaa42e936b7a31e04c645ed13f7e506a16a6c372e243e49a845c3795cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-k, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.build-date=20240123, io.buildah.version=1.31.3, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240125.044502-661946e) 2024-01-31T05:17:17.057 INFO:journalctl@ceph.mds.k.smithi179.stdout:Jan 31 05:17:16 smithi179 bash[71187]: ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-k 2024-01-31T05:17:17.215 DEBUG:teuthology.orchestra.run.smithi179:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mds.k.service' 2024-01-31T05:17:17.249 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-31T05:17:17.250 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-01-31T05:17:17.250 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-01-31T05:17:17.250 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mds.c 2024-01-31T05:17:17.571 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:17:17 smithi181 systemd[1]: Stopping Ceph mds.c for 9288ff44-bff5-11ee-95b3-87774f69a715... 2024-01-31T05:17:18.071 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:17:17 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:17:17.624+0000 7fa75e6ea700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-31T05:17:18.071 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:17:17 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c[68160]: 2024-01-31T05:17:17.624+0000 7fa75e6ea700 -1 mds.c *** got signal Terminated *** 2024-01-31T05:17:20.757 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:17:20 smithi181 podman[72916]: 2024-01-31 05:17:20.461664063 +0000 UTC m=+3.018761156 container died f7610ed57c6dd9de3de9dc683a27bf1a4ff8528c90a6b6c559ddfd69ef5c62f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240123, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.31.3, RELEASE=wip-vshankar-testing-20240125.044502-661946e) 2024-01-31T05:17:20.757 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:17:20 smithi181 podman[72916]: 2024-01-31 05:17:20.75779859 +0000 UTC m=+3.314895684 container cleanup f7610ed57c6dd9de3de9dc683a27bf1a4ff8528c90a6b6c559ddfd69ef5c62f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c, ceph=True, org.label-schema.build-date=20240123, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.31.3) 2024-01-31T05:17:21.071 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:17:20 smithi181 bash[72916]: ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c 2024-01-31T05:17:21.071 INFO:journalctl@ceph.mds.c.smithi181.stdout:Jan 31 05:17:20 smithi181 podman[72942]: 2024-01-31 05:17:20.983910827 +0000 UTC m=+0.521915029 container remove f7610ed57c6dd9de3de9dc683a27bf1a4ff8528c90a6b6c559ddfd69ef5c62f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-c, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240123, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.31.3, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240125.044502-661946e) 2024-01-31T05:17:21.126 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mds.c.service' 2024-01-31T05:17:21.164 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-31T05:17:21.165 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-01-31T05:17:21.165 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-01-31T05:17:21.165 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mds.f 2024-01-31T05:17:21.485 INFO:journalctl@ceph.mds.f.smithi181.stdout:Jan 31 05:17:21 smithi181 systemd[1]: Stopping Ceph mds.f for 9288ff44-bff5-11ee-95b3-87774f69a715... 2024-01-31T05:17:21.821 INFO:journalctl@ceph.mds.f.smithi181.stdout:Jan 31 05:17:21 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-f[67853]: 2024-01-31T05:17:21.486+0000 7f3ad1379700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-31T05:17:21.821 INFO:journalctl@ceph.mds.f.smithi181.stdout:Jan 31 05:17:21 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-f[67853]: 2024-01-31T05:17:21.486+0000 7f3ad1379700 -1 mds.f *** got signal Terminated *** 2024-01-31T05:17:24.768 INFO:journalctl@ceph.mds.f.smithi181.stdout:Jan 31 05:17:24 smithi181 podman[73048]: 2024-01-31 05:17:24.437269427 +0000 UTC m=+3.056972651 container died c4b143c29662619216dc466014e008afcef1640152d57d25fb618827995352a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-f, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.31.3, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.build-date=20240123, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-01-31T05:17:25.071 INFO:journalctl@ceph.mds.f.smithi181.stdout:Jan 31 05:17:24 smithi181 podman[73048]: 2024-01-31 05:17:24.886160929 +0000 UTC m=+3.505864144 container cleanup c4b143c29662619216dc466014e008afcef1640152d57d25fb618827995352a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-f, org.label-schema.build-date=20240123, RELEASE=wip-vshankar-testing-20240125.044502-661946e, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.31.3, org.label-schema.vendor=CentOS) 2024-01-31T05:17:25.071 INFO:journalctl@ceph.mds.f.smithi181.stdout:Jan 31 05:17:24 smithi181 bash[73048]: ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-f 2024-01-31T05:17:25.295 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mds.f.service' 2024-01-31T05:17:25.331 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-31T05:17:25.331 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-01-31T05:17:25.331 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-01-31T05:17:25.332 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mds.i 2024-01-31T05:17:25.571 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:17:25 smithi181 systemd[1]: Stopping Ceph mds.i for 9288ff44-bff5-11ee-95b3-87774f69a715... 2024-01-31T05:17:26.071 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:17:25 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:17:25.689+0000 7f605f756700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-31T05:17:26.071 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:17:25 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i[68480]: 2024-01-31T05:17:25.689+0000 7f605f756700 -1 mds.i *** got signal Terminated *** 2024-01-31T05:17:28.780 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:17:28 smithi181 podman[73169]: 2024-01-31 05:17:28.456077214 +0000 UTC m=+2.915531236 container died 2ad233c1f567fbeb7524a54ea748c8a273fcc7a5b69e106b43fbc871d7ab73ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.31.3, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240123, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-01-31T05:17:29.071 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:17:28 smithi181 podman[73169]: 2024-01-31 05:17:28.856753274 +0000 UTC m=+3.316207289 container cleanup 2ad233c1f567fbeb7524a54ea748c8a273fcc7a5b69e106b43fbc871d7ab73ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i, RELEASE=wip-vshankar-testing-20240125.044502-661946e, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.31.3, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240123) 2024-01-31T05:17:29.071 INFO:journalctl@ceph.mds.i.smithi181.stdout:Jan 31 05:17:28 smithi181 bash[73169]: ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-i 2024-01-31T05:17:29.229 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mds.i.service' 2024-01-31T05:17:29.265 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-31T05:17:29.265 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-01-31T05:17:29.265 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-01-31T05:17:29.265 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mds.l 2024-01-31T05:17:29.821 INFO:journalctl@ceph.mds.l.smithi181.stdout:Jan 31 05:17:29 smithi181 systemd[1]: Stopping Ceph mds.l for 9288ff44-bff5-11ee-95b3-87774f69a715... 2024-01-31T05:17:29.821 INFO:journalctl@ceph.mds.l.smithi181.stdout:Jan 31 05:17:29 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-l[67541]: 2024-01-31T05:17:29.575+0000 7f8e225de700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-31T05:17:29.821 INFO:journalctl@ceph.mds.l.smithi181.stdout:Jan 31 05:17:29 smithi181 ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-l[67541]: 2024-01-31T05:17:29.575+0000 7f8e225de700 -1 mds.l *** got signal Terminated *** 2024-01-31T05:17:32.759 INFO:journalctl@ceph.mds.l.smithi181.stdout:Jan 31 05:17:32 smithi181 podman[73289]: 2024-01-31 05:17:32.437376659 +0000 UTC m=+2.953060068 container died 377206dd4be8e65cf676099a756b168c8b6aa3d505a7531a6fad832dfb2f1050 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.31.3, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, ceph=True, org.label-schema.build-date=20240123, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-01-31T05:17:33.059 INFO:journalctl@ceph.mds.l.smithi181.stdout:Jan 31 05:17:32 smithi181 podman[73289]: 2024-01-31 05:17:32.884977636 +0000 UTC m=+3.400661031 container cleanup 377206dd4be8e65cf676099a756b168c8b6aa3d505a7531a6fad832dfb2f1050 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-l, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.31.3, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240123, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, maintainer=Guillaume Abrioux ) 2024-01-31T05:17:33.059 INFO:journalctl@ceph.mds.l.smithi181.stdout:Jan 31 05:17:32 smithi181 bash[73289]: ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-l 2024-01-31T05:17:33.298 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mds.l.service' 2024-01-31T05:17:33.321 INFO:journalctl@ceph.mds.l.smithi181.stdout:Jan 31 05:17:33 smithi181 podman[73304]: 2024-01-31 05:17:33.060975614 +0000 UTC m=+0.620662369 container remove 377206dd4be8e65cf676099a756b168c8b6aa3d505a7531a6fad832dfb2f1050 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-9288ff44-bff5-11ee-95b3-87774f69a715-mds-l, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.31.3, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240125.044502-661946e, ceph=True, org.label-schema.build-date=20240123, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.license=GPLv2) 2024-01-31T05:17:33.321 INFO:journalctl@ceph.mds.l.smithi181.stdout:Jan 31 05:17:33 smithi181 systemd[1]: ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mds.l.service: Deactivated successfully. 2024-01-31T05:17:33.321 INFO:journalctl@ceph.mds.l.smithi181.stdout:Jan 31 05:17:33 smithi181 systemd[1]: Stopped Ceph mds.l for 9288ff44-bff5-11ee-95b3-87774f69a715. 2024-01-31T05:17:33.321 INFO:journalctl@ceph.mds.l.smithi181.stdout:Jan 31 05:17:33 smithi181 systemd[1]: ceph-9288ff44-bff5-11ee-95b3-87774f69a715@mds.l.service: Consumed 2.182s CPU time. 2024-01-31T05:17:33.332 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-31T05:17:33.332 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-01-31T05:17:33.332 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 --force --keep-logs 2024-01-31T05:17:33.524 INFO:teuthology.orchestra.run.smithi099.stdout:Deleting cluster with fsid: 9288ff44-bff5-11ee-95b3-87774f69a715 2024-01-31T05:17:35.852 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 --force --keep-logs 2024-01-31T05:17:36.040 INFO:teuthology.orchestra.run.smithi179.stdout:Deleting cluster with fsid: 9288ff44-bff5-11ee-95b3-87774f69a715 2024-01-31T05:17:38.454 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 --force --keep-logs 2024-01-31T05:17:38.642 INFO:teuthology.orchestra.run.smithi181.stdout:Deleting cluster with fsid: 9288ff44-bff5-11ee-95b3-87774f69a715 2024-01-31T05:17:41.021 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-01-31T05:17:41.055 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-01-31T05:17:41.084 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-01-31T05:17:41.112 INFO:tasks.cephadm:Archiving crash dumps... 2024-01-31T05:17:41.114 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/crash to /home/teuthworker/archive/vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7539479/remote/smithi099/crash 2024-01-31T05:17:41.115 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/crash -- . 2024-01-31T05:17:41.146 INFO:teuthology.orchestra.run.smithi099.stderr:tar: /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/crash: Cannot open: No such file or directory 2024-01-31T05:17:41.146 INFO:teuthology.orchestra.run.smithi099.stderr:tar: Error is not recoverable: exiting now 2024-01-31T05:17:41.148 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/crash to /home/teuthworker/archive/vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7539479/remote/smithi179/crash 2024-01-31T05:17:41.148 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/crash -- . 2024-01-31T05:17:41.197 INFO:teuthology.orchestra.run.smithi179.stderr:tar: /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/crash: Cannot open: No such file or directory 2024-01-31T05:17:41.197 INFO:teuthology.orchestra.run.smithi179.stderr:tar: Error is not recoverable: exiting now 2024-01-31T05:17:41.199 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/crash to /home/teuthworker/archive/vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7539479/remote/smithi181/crash 2024-01-31T05:17:41.199 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/crash -- . 2024-01-31T05:17:41.233 INFO:teuthology.orchestra.run.smithi181.stderr:tar: /var/lib/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/crash: Cannot open: No such file or directory 2024-01-31T05:17:41.233 INFO:teuthology.orchestra.run.smithi181.stderr:tar: Error is not recoverable: exiting now 2024-01-31T05:17:41.234 INFO:tasks.cephadm:Checking cluster log for badness... 2024-01-31T05:17:41.235 DEBUG:teuthology.orchestra.run.smithi099:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-01-31T05:17:41.276 INFO:teuthology.orchestra.run.smithi099.stderr:grep: /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph.log: No such file or directory 2024-01-31T05:17:41.278 INFO:tasks.cephadm:Compressing logs... 2024-01-31T05:17:41.278 DEBUG:teuthology.orchestra.run.smithi099:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-31T05:17:41.320 DEBUG:teuthology.orchestra.run.smithi179:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-31T05:17:41.323 DEBUG:teuthology.orchestra.run.smithi181:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-31T05:17:41.347 INFO:teuthology.orchestra.run.smithi179.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-01-31T05:17:41.348 INFO:teuthology.orchestra.run.smithi179.stderr:: No such file or directory 2024-01-31T05:17:41.348 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-osd.10.log 2024-01-31T05:17:41.348 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mds.b.log 2024-01-31T05:17:41.348 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-osd.4.log 2024-01-31T05:17:41.348 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-osd.10.log: /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-osd.1.log 2024-01-31T05:17:41.353 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mds.k.log 2024-01-31T05:17:41.353 INFO:teuthology.orchestra.run.smithi179.stderr: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-01-31T05:17:41.353 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mds.h.log 2024-01-31T05:17:41.353 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-osd.7.log 2024-01-31T05:17:41.353 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mds.e.log 2024-01-31T05:17:41.357 INFO:teuthology.orchestra.run.smithi099.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-01-31T05:17:41.357 INFO:teuthology.orchestra.run.smithi099.stderr:: No such file or directory 2024-01-31T05:17:41.357 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-osd.6.log 2024-01-31T05:17:41.357 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mon.a.log 2024-01-31T05:17:41.357 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mds.g.log 2024-01-31T05:17:41.357 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mds.j.log 2024-01-31T05:17:41.357 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-osd.3.log 2024-01-31T05:17:41.357 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mds.g.log: /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mgr.x.log 2024-01-31T05:17:41.357 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-osd.0.log 2024-01-31T05:17:41.357 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-volume.log 2024-01-31T05:17:41.358 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-osd.0.log: 94.6% -- replaced with /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mds.j.log.gz 2024-01-31T05:17:41.358 INFO:teuthology.orchestra.run.smithi099.stderr: 93.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-01-31T05:17:41.359 INFO:teuthology.orchestra.run.smithi181.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-01-31T05:17:41.359 INFO:teuthology.orchestra.run.smithi181.stderr:: No such file or directory 2024-01-31T05:17:41.359 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mds.l.log 2024-01-31T05:17:41.359 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mds.i.log 2024-01-31T05:17:41.359 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-osd.11.log 2024-01-31T05:17:41.359 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mgr.z.log 2024-01-31T05:17:41.359 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-osd.8.log 2024-01-31T05:17:41.359 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-osd.11.log: /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mgr.z.log: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-01-31T05:17:41.359 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-osd.5.log 2024-01-31T05:17:41.359 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mds.f.log 2024-01-31T05:17:41.359 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-osd.8.log: /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-osd.2.log 2024-01-31T05:17:41.360 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mds.c.log 2024-01-31T05:17:41.360 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-osd.2.log: 92.2% -- replaced with /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mgr.z.log.gz 2024-01-31T05:17:41.360 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-volume.log 2024-01-31T05:17:41.363 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-osd.9.log 2024-01-31T05:17:41.363 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mds.d.log 2024-01-31T05:17:41.368 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mgr.y.log 2024-01-31T05:17:41.369 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mon.c.log 2024-01-31T05:17:41.376 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mds.a.log 2024-01-31T05:17:41.379 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mds.d.log: 91.0% -- replaced with /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-volume.log.gz 2024-01-31T05:17:41.380 INFO:teuthology.orchestra.run.smithi099.stderr: 94.5% -- replaced with /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mds.d.log.gz 2024-01-31T05:17:41.387 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-volume.log 2024-01-31T05:17:41.393 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-volume.log: /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mon.c.log: 90.9% -- replaced with /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-volume.log.gz 2024-01-31T05:17:41.401 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mgr.y.log: 92.1%gzip -5 --verbose -- /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mon.b.log 2024-01-31T05:17:41.401 INFO:teuthology.orchestra.run.smithi179.stderr: -- replaced with /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mgr.y.log.gz 2024-01-31T05:17:41.427 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-volume.log: /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mon.b.log: 91.0% -- replaced with /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-volume.log.gz 2024-01-31T05:17:41.544 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mds.a.log: 90.0% -- replaced with /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mgr.x.log.gz 2024-01-31T05:17:41.601 INFO:teuthology.orchestra.run.smithi181.stderr: 94.0% -- replaced with /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mds.f.log.gz 2024-01-31T05:17:41.626 INFO:teuthology.orchestra.run.smithi099.stderr: 94.1% -- replaced with /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mds.g.log.gz 2024-01-31T05:17:41.659 INFO:teuthology.orchestra.run.smithi179.stderr: 94.0% -- replaced with /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mds.k.log.gz 2024-01-31T05:17:41.755 INFO:teuthology.orchestra.run.smithi181.stderr: 94.1% -- replaced with /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mds.l.log.gz 2024-01-31T05:17:41.777 INFO:teuthology.orchestra.run.smithi181.stderr: 92.0% -- replaced with /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mon.c.log.gz 2024-01-31T05:17:41.829 INFO:teuthology.orchestra.run.smithi179.stderr: 92.1% -- replaced with /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mon.b.log.gz 2024-01-31T05:17:42.210 INFO:teuthology.orchestra.run.smithi099.stderr: 90.7% -- replaced with /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mon.a.log.gz 2024-01-31T05:17:42.933 INFO:teuthology.orchestra.run.smithi099.stderr: 93.8% -- replaced with /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-osd.9.log.gz 2024-01-31T05:17:42.936 INFO:teuthology.orchestra.run.smithi099.stderr: 94.0% -- replaced with /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mds.a.log.gz 2024-01-31T05:17:43.165 INFO:teuthology.orchestra.run.smithi179.stderr: 93.7% -- replaced with /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mds.h.log.gz 2024-01-31T05:17:43.399 INFO:teuthology.orchestra.run.smithi179.stderr: 93.8% -- replaced with /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-osd.4.log.gz 2024-01-31T05:17:43.510 INFO:teuthology.orchestra.run.smithi181.stderr: 93.8% -- replaced with /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-osd.11.log.gz 2024-01-31T05:17:43.708 INFO:teuthology.orchestra.run.smithi181.stderr: 93.7% -- replaced with /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-osd.2.log.gz 2024-01-31T05:17:43.814 INFO:teuthology.orchestra.run.smithi181.stderr: 93.7% -- replaced with /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mds.i.log.gz 2024-01-31T05:17:43.859 INFO:teuthology.orchestra.run.smithi099.stderr: 93.6% -- replaced with /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-osd.0.log.gz 2024-01-31T05:17:43.934 INFO:teuthology.orchestra.run.smithi099.stderr: 93.8% -- replaced with /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-osd.6.log.gz 2024-01-31T05:17:44.024 INFO:teuthology.orchestra.run.smithi181.stderr: 93.9% -- replaced with /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-osd.8.log.gz 2024-01-31T05:17:44.151 INFO:teuthology.orchestra.run.smithi099.stderr: 93.6% -- replaced with /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-osd.3.log.gz 2024-01-31T05:17:44.152 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-01-31T05:17:44.152 INFO:teuthology.orchestra.run.smithi099.stderr:real 0m2.819s 2024-01-31T05:17:44.153 INFO:teuthology.orchestra.run.smithi099.stderr:user 0m11.949s 2024-01-31T05:17:44.153 INFO:teuthology.orchestra.run.smithi099.stderr:sys 0m0.444s 2024-01-31T05:17:44.589 INFO:teuthology.orchestra.run.smithi179.stderr: 93.8% -- replaced with /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-osd.7.log.gz 2024-01-31T05:17:44.597 INFO:teuthology.orchestra.run.smithi179.stderr: 93.9% -- replaced with /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-osd.10.log.gz 2024-01-31T05:17:44.711 INFO:teuthology.orchestra.run.smithi179.stderr: 93.8% -- replaced with /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-osd.1.log.gz 2024-01-31T05:17:44.746 INFO:teuthology.orchestra.run.smithi181.stderr: 93.6% -- replaced with /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mds.c.log.gz 2024-01-31T05:17:44.833 INFO:teuthology.orchestra.run.smithi181.stderr: 93.8% -- replaced with /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-osd.5.log.gz 2024-01-31T05:17:44.835 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-01-31T05:17:44.835 INFO:teuthology.orchestra.run.smithi181.stderr:real 0m3.498s 2024-01-31T05:17:44.835 INFO:teuthology.orchestra.run.smithi181.stderr:user 0m16.812s 2024-01-31T05:17:44.835 INFO:teuthology.orchestra.run.smithi181.stderr:sys 0m0.548s 2024-01-31T05:17:45.670 INFO:teuthology.orchestra.run.smithi179.stderr: 95.1% -- replaced with /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mds.e.log.gz 2024-01-31T05:18:24.714 INFO:teuthology.orchestra.run.smithi179.stderr: 93.1% -- replaced with /var/log/ceph/9288ff44-bff5-11ee-95b3-87774f69a715/ceph-mds.b.log.gz 2024-01-31T05:18:24.715 INFO:teuthology.orchestra.run.smithi179.stderr: 2024-01-31T05:18:24.715 INFO:teuthology.orchestra.run.smithi179.stderr:real 0m43.381s 2024-01-31T05:18:24.715 INFO:teuthology.orchestra.run.smithi179.stderr:user 0m59.488s 2024-01-31T05:18:24.715 INFO:teuthology.orchestra.run.smithi179.stderr:sys 0m1.826s 2024-01-31T05:18:24.715 INFO:tasks.cephadm:Archiving logs... 2024-01-31T05:18:24.716 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7539479/remote/smithi099/log 2024-01-31T05:18:24.717 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-31T05:18:26.222 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7539479/remote/smithi179/log 2024-01-31T05:18:26.223 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-31T05:18:34.138 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7539479/remote/smithi181/log 2024-01-31T05:18:34.139 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-31T05:18:36.038 INFO:tasks.cephadm:Removing cluster... 2024-01-31T05:18:36.038 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 --force 2024-01-31T05:18:36.232 INFO:teuthology.orchestra.run.smithi099.stdout:Deleting cluster with fsid: 9288ff44-bff5-11ee-95b3-87774f69a715 2024-01-31T05:18:36.495 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 --force 2024-01-31T05:18:36.686 INFO:teuthology.orchestra.run.smithi179.stdout:Deleting cluster with fsid: 9288ff44-bff5-11ee-95b3-87774f69a715 2024-01-31T05:18:37.067 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 9288ff44-bff5-11ee-95b3-87774f69a715 --force 2024-01-31T05:18:37.256 INFO:teuthology.orchestra.run.smithi181.stdout:Deleting cluster with fsid: 9288ff44-bff5-11ee-95b3-87774f69a715 2024-01-31T05:18:37.519 INFO:tasks.cephadm:Removing cephadm ... 2024-01-31T05:18:37.519 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf /home/ubuntu/cephtest/cephadm 2024-01-31T05:18:37.538 DEBUG:teuthology.orchestra.run.smithi179:> rm -rf /home/ubuntu/cephtest/cephadm 2024-01-31T05:18:37.554 DEBUG:teuthology.orchestra.run.smithi181:> rm -rf /home/ubuntu/cephtest/cephadm 2024-01-31T05:18:37.570 INFO:tasks.cephadm:Teardown complete 2024-01-31T05:18:37.571 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-01-31T05:18:37.582 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-01-31T05:18:37.582 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-31T05:18:37.585 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-31T05:18:37.597 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-31T05:18:37.702 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-01-31T05:18:37.712 INFO:teuthology.task.clock:Checking final clock skew... 2024-01-31T05:18:37.712 DEBUG:teuthology.orchestra.run.smithi099:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-31T05:18:37.715 DEBUG:teuthology.orchestra.run.smithi179:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-31T05:18:37.717 DEBUG:teuthology.orchestra.run.smithi181:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-31T05:18:37.729 INFO:teuthology.orchestra.run.smithi179.stderr:bash: line 1: ntpq: command not found 2024-01-31T05:18:37.729 INFO:teuthology.orchestra.run.smithi099.stderr:bash: line 1: ntpq: command not found 2024-01-31T05:18:37.731 INFO:teuthology.orchestra.run.smithi181.stderr:bash: line 1: ntpq: command not found 2024-01-31T05:18:37.732 INFO:teuthology.orchestra.run.smithi179.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-31T05:18:37.733 INFO:teuthology.orchestra.run.smithi179.stdout:=============================================================================== 2024-01-31T05:18:37.733 INFO:teuthology.orchestra.run.smithi179.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 60 +421us[ +421us] +/- 63ms 2024-01-31T05:18:37.733 INFO:teuthology.orchestra.run.smithi179.stdout:^* hv02.front.sepia.ceph.com 3 7 377 125 -474us[ -483us] +/- 54ms 2024-01-31T05:18:37.733 INFO:teuthology.orchestra.run.smithi179.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 60 +336us[ +336us] +/- 88ms 2024-01-31T05:18:37.733 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-01-31T05:18:37.734 INFO:teuthology.orchestra.run.smithi099.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-31T05:18:37.734 INFO:teuthology.orchestra.run.smithi099.stdout:=============================================================================== 2024-01-31T05:18:37.734 INFO:teuthology.orchestra.run.smithi099.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 60 +419us[ +436us] +/- 63ms 2024-01-31T05:18:37.734 INFO:teuthology.orchestra.run.smithi099.stdout:^* hv02.front.sepia.ceph.com 3 6 377 58 -517us[ -500us] +/- 54ms 2024-01-31T05:18:37.734 INFO:teuthology.orchestra.run.smithi099.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 60 +339us[ +356us] +/- 88ms 2024-01-31T05:18:37.734 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-01-31T05:18:37.735 INFO:teuthology.orchestra.run.smithi181.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-31T05:18:37.735 INFO:teuthology.orchestra.run.smithi181.stdout:=============================================================================== 2024-01-31T05:18:37.735 INFO:teuthology.orchestra.run.smithi181.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 59 +417us[ +417us] +/- 63ms 2024-01-31T05:18:37.735 INFO:teuthology.orchestra.run.smithi181.stdout:^* hv02.front.sepia.ceph.com 3 6 377 59 -522us[ -527us] +/- 54ms 2024-01-31T05:18:37.736 INFO:teuthology.orchestra.run.smithi181.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 59 +347us[ +347us] +/- 88ms 2024-01-31T05:18:37.736 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-01-31T05:18:37.736 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-01-31T05:18:37.746 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-01-31T05:18:37.746 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-01-31T05:18:37.776 DEBUG:teuthology.orchestra.run.smithi099:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-01-31T05:18:37.862 DEBUG:teuthology.orchestra.run.smithi179:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-01-31T05:18:37.933 DEBUG:teuthology.orchestra.run.smithi181:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-01-31T05:18:38.002 DEBUG:teuthology.orchestra.run.smithi099:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-31T05:18:38.034 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T05:18:38.034 DEBUG:teuthology.orchestra.run.smithi179:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-31T05:18:38.064 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T05:18:38.064 DEBUG:teuthology.orchestra.run.smithi181:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-31T05:18:38.093 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T05:18:38.094 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-01-31T05:18:38.105 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-01-31T05:18:38.115 INFO:teuthology.task.internal:Duration was 1517.036200 seconds 2024-01-31T05:18:38.115 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-01-31T05:18:38.125 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-01-31T05:18:38.125 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-31T05:18:38.128 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-31T05:18:38.130 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-31T05:18:38.170 INFO:teuthology.orchestra.run.smithi099.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-31T05:18:38.170 INFO:teuthology.orchestra.run.smithi179.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-31T05:18:38.176 INFO:teuthology.orchestra.run.smithi181.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-31T05:18:38.662 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-01-31T05:18:38.662 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi099.front.sepia.ceph.com 2024-01-31T05:18:38.662 DEBUG:teuthology.orchestra.run.smithi099:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-31T05:18:38.682 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi179.front.sepia.ceph.com 2024-01-31T05:18:38.682 DEBUG:teuthology.orchestra.run.smithi179:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-31T05:18:38.736 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi181.front.sepia.ceph.com 2024-01-31T05:18:38.736 DEBUG:teuthology.orchestra.run.smithi181:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-31T05:18:38.758 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-01-31T05:18:38.758 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-31T05:18:38.761 DEBUG:teuthology.orchestra.run.smithi179:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-31T05:18:38.778 DEBUG:teuthology.orchestra.run.smithi181:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-31T05:18:38.827 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-01-31T05:18:38.827 DEBUG:teuthology.orchestra.run.smithi099:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-31T05:18:38.831 DEBUG:teuthology.orchestra.run.smithi179:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-31T05:18:38.847 DEBUG:teuthology.orchestra.run.smithi181:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-31T05:18:39.262 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-01-31T05:18:39.273 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-01-31T05:18:39.273 DEBUG:teuthology.orchestra.run.smithi099:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-31T05:18:39.300 DEBUG:teuthology.orchestra.run.smithi179:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-31T05:18:39.327 DEBUG:teuthology.orchestra.run.smithi181:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-31T05:18:39.354 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-01-31T05:18:39.365 DEBUG:teuthology.orchestra.run.smithi099:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-31T05:18:39.368 DEBUG:teuthology.orchestra.run.smithi179:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-31T05:18:39.370 DEBUG:teuthology.orchestra.run.smithi181:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-31T05:18:39.391 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = core 2024-01-31T05:18:39.393 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern = core 2024-01-31T05:18:39.420 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern = core 2024-01-31T05:18:39.450 DEBUG:teuthology.orchestra.run.smithi099:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-31T05:18:39.463 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T05:18:39.464 DEBUG:teuthology.orchestra.run.smithi179:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-31T05:18:39.478 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T05:18:39.478 DEBUG:teuthology.orchestra.run.smithi181:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-31T05:18:39.503 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-31T05:18:39.504 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-01-31T05:18:39.516 INFO:teuthology.task.internal:Transferring archived files... 2024-01-31T05:18:39.516 DEBUG:teuthology.misc:Transferring archived files from smithi099:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7539479/remote/smithi099 2024-01-31T05:18:39.516 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-31T05:18:39.560 DEBUG:teuthology.misc:Transferring archived files from smithi179:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7539479/remote/smithi179 2024-01-31T05:18:39.560 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-31T05:18:39.598 DEBUG:teuthology.misc:Transferring archived files from smithi181:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7539479/remote/smithi181 2024-01-31T05:18:39.598 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-31T05:18:39.636 INFO:teuthology.task.internal:Removing archive directory... 2024-01-31T05:18:39.636 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-31T05:18:39.639 DEBUG:teuthology.orchestra.run.smithi179:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-31T05:18:39.641 DEBUG:teuthology.orchestra.run.smithi181:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-31T05:18:39.684 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-01-31T05:18:39.694 INFO:teuthology.task.internal:Not uploading archives. 2024-01-31T05:18:39.695 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-01-31T05:18:39.717 INFO:teuthology.task.internal:Tidying up after the test... 2024-01-31T05:18:39.717 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-31T05:18:39.719 DEBUG:teuthology.orchestra.run.smithi179:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-31T05:18:39.721 DEBUG:teuthology.orchestra.run.smithi181:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-31T05:18:39.731 INFO:teuthology.orchestra.run.smithi099.stdout: 265929 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 31 05:18 /home/ubuntu/cephtest 2024-01-31T05:18:39.733 INFO:teuthology.orchestra.run.smithi179.stdout: 262162 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 31 05:18 /home/ubuntu/cephtest 2024-01-31T05:18:39.737 INFO:teuthology.orchestra.run.smithi181.stdout: 262162 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 31 05:18 /home/ubuntu/cephtest 2024-01-31T05:18:39.739 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-01-31T05:18:39.750 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-01-31T05:18:39.809 INFO:teuthology.nuke:Checking targets against current locks 2024-01-31T05:18:39.835 DEBUG:teuthology.nuke:shortname: smithi099 2024-01-31T05:18:39.835 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-31T05:18:39.855 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7539479', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-31 04:40:02.912658', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHgfinytNuPe5fL0szIiNJSo+6YbrKeiyXe5nYg56kuj7x7mmSeIaruiwQupw1QuFWH5DPWSS0B9NLIcWdTX1cw='} 2024-01-31T05:18:39.858 DEBUG:teuthology.nuke:shortname: smithi179 2024-01-31T05:18:39.858 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-31T05:18:39.882 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7539479', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-31 04:40:02.913827', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMuqElmGQnrB9hKXh1g2rZk67yC1MYVax0g3rxq3PKCVo8L63S2/hyMFG7YpdI0f7Rxc0/6bYyVlmAk8a86gocc='} 2024-01-31T05:18:39.883 DEBUG:teuthology.nuke:shortname: smithi181 2024-01-31T05:18:39.883 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-31T05:18:39.909 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi181.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7539479', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-31 04:40:02.911193', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE7Xx1DCcFR78jhAjbZAAIJdamEISjrfRT0lpfmK6Buwr5ulkBGnLutMhfWsU4Ne/R3lwreXDI0WGTQQtS34Qjc='} 2024-01-31T05:18:39.914 INFO:teuthology.orchestra.console.smithi099:Power off 2024-01-31T05:18:39.915 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-31T05:18:39.938 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off 2024-01-31T05:18:39.938 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-31T05:18:39.953 INFO:teuthology.orchestra.console.smithi179:Power off 2024-01-31T05:18:39.953 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-31T05:18:39.965 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2024-01-31T05:18:39.975 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off 2024-01-31T05:18:39.975 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-31T05:18:39.989 INFO:teuthology.orchestra.console.smithi181:Power off 2024-01-31T05:18:39.990 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-31T05:18:39.999 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2024-01-31T05:18:40.019 DEBUG:teuthology.orchestra.console.smithi181:power off output: Chassis Power Control: Down/Off 2024-01-31T05:18:40.019 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-31T05:18:40.044 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2024-01-31T05:18:43.966 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-31T05:18:44.000 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-31T05:18:44.045 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-31T05:18:44.076 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2024-01-31T05:18:44.109 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2024-01-31T05:18:44.154 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2024-01-31T05:18:48.078 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-31T05:18:48.110 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-31T05:18:48.155 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-31T05:18:48.188 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2024-01-31T05:18:48.217 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2024-01-31T05:18:48.264 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2024-01-31T05:18:48.319 INFO:teuthology.orchestra.console.smithi179:Power off completed 2024-01-31T05:18:48.364 INFO:teuthology.orchestra.console.smithi181:Power off completed 2024-01-31T05:18:52.193 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-31T05:18:52.303 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2024-01-31T05:18:52.403 INFO:teuthology.orchestra.console.smithi099:Power off completed 2024-01-31T05:18:52.508 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/fsstress}} duration: 1517.0362000465393 failure_reason: 'error during scrub thrashing: rank damage found: {''backtrace''}' flavor: default owner: scheduled_vshankar@teuthology status: fail success: false 2024-01-31T05:18:52.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-31T05:18:52.594 INFO:teuthology.run:FAIL